-- Logs begin at Thu 2022-08-18 10:37:48 UTC, end at Thu 2022-08-18 13:14:44 UTC. -- Aug 18 11:14:13.512853 n-d-853611-3 systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 11:14:13.522473 n-d-853611-3 devstack@n-api.service[106217]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 11:14:13.524174 n-d-853611-3 devstack@n-api.service[106217]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 11:14:13 2022] *** Aug 18 11:14:13.524174 n-d-853611-3 devstack@n-api.service[106217]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 11:14:13.524174 n-d-853611-3 devstack@n-api.service[106217]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 11:14:13.524174 n-d-853611-3 devstack@n-api.service[106217]: nodename: n-d-853611-3 Aug 18 11:14:13.524174 n-d-853611-3 devstack@n-api.service[106217]: machine: x86_64 Aug 18 11:14:13.524174 n-d-853611-3 devstack@n-api.service[106217]: clock source: unix Aug 18 11:14:13.524174 n-d-853611-3 devstack@n-api.service[106217]: pcre jit disabled Aug 18 11:14:13.524174 n-d-853611-3 devstack@n-api.service[106217]: detected number of CPU cores: 4 Aug 18 11:14:13.524174 n-d-853611-3 devstack@n-api.service[106217]: current working directory: / Aug 18 11:14:13.524174 n-d-853611-3 devstack@n-api.service[106217]: detected binary path: /usr/bin/uwsgi-core Aug 18 11:14:13.524174 n-d-853611-3 devstack@n-api.service[106217]: your processes number limit is 47680 Aug 18 11:14:13.524174 n-d-853611-3 devstack@n-api.service[106217]: your memory page size is 4096 bytes Aug 18 11:14:13.524174 n-d-853611-3 devstack@n-api.service[106217]: detected max file descriptor number: 2048 Aug 18 11:14:13.524174 n-d-853611-3 devstack@n-api.service[106217]: lock engine: pthread robust mutexes Aug 18 11:14:13.525593 n-d-853611-3 devstack@n-api.service[106217]: thunder lock: enabled Aug 18 11:14:13.525593 n-d-853611-3 devstack@n-api.service[106217]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 11:14:13.525593 n-d-853611-3 devstack@n-api.service[106217]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 11:14:13.564995 n-d-853611-3 devstack@n-api.service[106217]: Python main interpreter initialized at 0x55c276a9f9c0 Aug 18 11:14:13.564995 n-d-853611-3 devstack@n-api.service[106217]: python threads support enabled Aug 18 11:14:13.564995 n-d-853611-3 devstack@n-api.service[106217]: your server socket listen backlog is limited to 100 connections Aug 18 11:14:13.564995 n-d-853611-3 devstack@n-api.service[106217]: your mercy for graceful operations on workers is 90 seconds Aug 18 11:14:13.565401 n-d-853611-3 devstack@n-api.service[106217]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 11:14:13.565479 n-d-853611-3 devstack@n-api.service[106217]: *** Operational MODE: preforking *** Aug 18 11:14:13.565698 n-d-853611-3 devstack@n-api.service[106217]: *** uWSGI is running in multiple interpreter mode *** Aug 18 11:14:13.565698 n-d-853611-3 devstack@n-api.service[106217]: spawned uWSGI master process (pid: 106217) Aug 18 11:14:13.565916 n-d-853611-3 systemd[1]: Started Devstack devstack@n-api.service. Aug 18 11:14:13.567331 n-d-853611-3 devstack@n-api.service[106217]: spawned uWSGI worker 1 (pid: 106218, cores: 1) Aug 18 11:14:13.567331 n-d-853611-3 devstack@n-api.service[106217]: spawned uWSGI worker 2 (pid: 106219, cores: 1) Aug 18 11:14:13.567331 n-d-853611-3 devstack@n-api.service[106217]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 11:14:14.250901 n-d-853611-3 devstack@n-api.service[106218]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 11:14:14.279529 n-d-853611-3 devstack@n-api.service[106219]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 11:14:15.369984 n-d-853611-3 devstack@n-api.service[106218]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:14:15.369984 n-d-853611-3 devstack@n-api.service[106218]: from cryptography.utils import int_from_bytes Aug 18 11:14:15.371249 n-d-853611-3 devstack@n-api.service[106218]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:14:15.371249 n-d-853611-3 devstack@n-api.service[106218]: from cryptography.utils import int_from_bytes Aug 18 11:14:15.392990 n-d-853611-3 devstack@n-api.service[106219]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:14:15.392990 n-d-853611-3 devstack@n-api.service[106219]: from cryptography.utils import int_from_bytes Aug 18 11:14:15.393569 n-d-853611-3 devstack@n-api.service[106219]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:14:15.393569 n-d-853611-3 devstack@n-api.service[106219]: from cryptography.utils import int_from_bytes Aug 18 11:14:17.970609 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 11:14:17.971199 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 11:14:17.971329 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 11:14:17.971699 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 11:14:17.971963 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 11:14:17.972363 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.972674 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 11:14:17.973233 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.973360 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 11:14:17.973489 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.973489 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.973657 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 11:14:17.973723 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.973887 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 11:14:17.974048 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.974200 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 11:14:17.974455 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.974556 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.974797 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.974897 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.975123 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.975224 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.975407 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.975508 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.975730 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.975827 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.976060 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-853611-3 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.976163 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.976384 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.976483 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.976709 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.976795 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.977025 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.977116 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.977292 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.977377 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.977613 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.977698 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.977941 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-853611-3 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.978028 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.978268 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.978382 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.978613 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.978816 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.978929 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.979244 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.979405 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.980216 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.980407 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.980407 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.980756 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.981027 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.981156 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.981349 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.981470 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.981804 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.981899 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.982123 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.982219 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.982471 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.982579 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.982798 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.982884 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.983143 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.983237 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-853611-3 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.983466 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.983551 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.983785 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.983922 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.984110 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.984208 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.984428 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.984562 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.984760 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.984865 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.985120 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.985273 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.985484 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-853611-3 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.985625 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.985808 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.986012 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.986157 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.986282 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.986509 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.986645 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.986771 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.986897 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.987132 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.987238 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.987462 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.987557 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.987771 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.987857 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.988087 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.988174 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.988407 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.988493 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.988737 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.988831 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.989047 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.989150 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.989358 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.989444 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.989613 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.989705 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.989929 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.990023 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.990255 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.990345 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.990602 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.990706 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.990928 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.991024 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.991184 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.991282 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.991424 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.991536 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.991752 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.991889 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.992078 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.992165 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.992394 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.992532 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.992716 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.992802 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.993038 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.993123 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.993293 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.993387 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.993549 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.993657 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.993869 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.993955 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.994194 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.994297 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.994528 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.994623 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.994845 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.994953 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.995225 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.995316 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.995636 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.995953 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.996028 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.996278 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.996369 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.996664 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.996755 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.996926 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.997010 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.999175 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.999335 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.999409 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.999475 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.999539 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.999604 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.999667 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.999744 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.999810 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.999874 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:17.999944 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.000010 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.000126 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.000202 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.001409 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.001556 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.001649 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.001729 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.001815 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.001900 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.002022 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.002152 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.002242 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.002321 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.002411 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.002528 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.002648 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.002742 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.002821 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.002898 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.002986 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.003064 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.003152 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.003230 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.003305 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.003380 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.003464 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.003542 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.003618 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.003701 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.003778 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.003861 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.003938 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.004014 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.004090 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.004175 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.004253 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.004396 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.004541 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.004714 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.004854 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.005031 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.005187 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.005350 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.005505 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.005662 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.005807 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.005974 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.006135 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.006291 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.006483 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.006649 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.006800 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.006938 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.007116 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.007274 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.007434 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.007592 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.007733 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.007848 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.008052 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.008148 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.008367 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.008453 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.008679 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.008765 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.009006 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.009102 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.009318 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.009405 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.009629 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.009715 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.009950 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.010044 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.010265 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.010360 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.010601 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.010739 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.011103 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.011417 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.011718 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.011818 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.012051 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.013826 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.013931 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.014019 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.014019 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.014265 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.014265 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.014406 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.014849 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.014932 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.015016 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.015016 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.015166 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.015242 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.015325 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.015421 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.015421 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.015626 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.015704 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.015790 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.015876 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.016004 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.016096 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.016319 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.016571 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.016717 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.016928 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.017071 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.017241 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.017552 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.017639 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.017866 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.018172 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.018264 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.018517 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.018828 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.018916 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.019162 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.019316 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.019452 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.019598 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.019779 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.019933 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.020090 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:14:18.020274 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.020414 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.020605 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.020738 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.021090 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.021178 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.021414 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.021717 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.021854 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.022080 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.022179 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.022407 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.022563 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.022786 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.022930 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.023113 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.023210 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.023447 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.023534 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.023767 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.023853 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.024086 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.024174 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.024406 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.024495 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.024732 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.024827 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.025059 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.025157 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.025394 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.025470 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.025717 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.025793 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.026042 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.026170 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.026901 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.026994 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.027402 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.027591 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.027927 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.028199 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.028278 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.028579 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.028832 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.028934 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.029215 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.029303 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.029546 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.029632 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.029909 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.029996 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.030270 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.030620 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.030711 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.030958 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.031230 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.031329 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.031604 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.031760 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.031925 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.032096 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.032388 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.032484 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.032768 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.033016 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.033104 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.033414 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.033639 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.033770 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.034138 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.034256 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.034515 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.034845 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.034933 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.035170 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.035259 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.035520 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.035606 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.035848 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.035951 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.036174 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.036261 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.036498 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.036593 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.036827 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.036925 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.037181 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.037266 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.042563 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.042563 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.042809 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.042904 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.042985 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.043112 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.043112 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.043251 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.043374 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.043374 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.043523 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.043600 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.043600 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.043728 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.044323 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.044412 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.044491 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.044567 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.044650 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.044728 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.044812 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.044890 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.044974 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.045053 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.045128 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.045203 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.045203 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.045203 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.045403 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.045486 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.045577 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.045655 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.045740 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.045818 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.045899 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.045976 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.046056 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.046133 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.046218 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.046341 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.046457 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.046457 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.046619 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.046713 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.046713 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.046856 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.046934 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.047010 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.047075 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.047234 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.047366 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.047552 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.047872 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.047961 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.048191 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.048386 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.048513 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.048834 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.048919 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.049157 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.049411 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.049578 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.049800 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.050375 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.050509 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.050592 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.050726 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.050816 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.050894 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.050971 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.051096 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.051184 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.051429 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.051516 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.051761 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.051855 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.052086 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.052318 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.052417 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.052700 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.052820 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.053015 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.053167 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.053327 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.053514 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.053639 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.053865 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.053950 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.054217 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.054320 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.054564 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.054655 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.054880 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.054964 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.055192 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.055356 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.055504 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.055836 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.055929 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.056156 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.056258 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.056473 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.056627 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.056789 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.056931 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.057098 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.057189 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.057449 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.057576 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.057973 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.058077 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.058481 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.058808 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.058966 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.059160 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.059385 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.059499 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.059709 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.059839 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.060029 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.060171 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.060390 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.060501 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.060711 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.060827 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.061065 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.061153 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.061414 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.061501 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.061747 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.061842 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.062091 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.062185 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.062398 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.062556 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.062752 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.062838 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.063073 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.063158 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.063402 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.063497 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.063718 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.063804 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.064037 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.064121 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.064347 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.064431 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.064733 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.064836 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.065256 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.065358 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.065445 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.065524 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.065612 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.065691 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.065926 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.066013 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.066256 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.066345 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.066595 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.066698 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.066911 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.066997 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.067232 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.067333 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.067553 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.067640 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.067875 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.067961 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.068202 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.068297 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.068519 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.068604 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.068839 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.068926 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.069152 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.069316 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.069482 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.069570 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.069798 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.069883 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.070131 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.070277 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.070451 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.070591 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.070770 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.070865 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.071102 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.071190 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.071415 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.071500 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.071742 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.071848 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.072055 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.072147 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.072378 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.072504 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.072684 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.072768 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.072996 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.073082 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.073358 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.073484 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.073752 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.074081 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.074237 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.074415 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.074642 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.074841 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.074967 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.075162 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.075295 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.075477 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.075618 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.075794 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.075937 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.076110 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.076252 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.076423 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.076578 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.076741 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.076897 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.077062 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.077209 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.077378 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.077521 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.077693 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.077840 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.078003 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.078175 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.078325 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.078511 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.078668 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.078848 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.078991 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.079177 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.079299 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.079485 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.079575 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.079796 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.079923 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.080131 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.080223 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.080448 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.080541 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.080759 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.080848 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.081072 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.081170 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.081385 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.081471 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.081734 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.081822 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.082052 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.082158 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.082363 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.082502 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.082710 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.082824 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.083038 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.083131 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.083353 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.083483 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.083680 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.083803 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.084002 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.084096 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.084323 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.084484 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.084630 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.084751 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.084950 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.085045 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.085265 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.085371 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.085588 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.085682 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.085907 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.086001 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.086225 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.086325 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.086574 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.086679 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.086904 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.086992 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.087219 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.087306 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.087533 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.087620 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.087847 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.087939 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.088158 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.088253 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.088476 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.088588 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.089312 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.089423 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.089636 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.089957 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.090275 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.090546 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.090635 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.090899 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.090996 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.091230 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.091495 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.091581 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.091837 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.091932 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.092182 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.092268 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.092512 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.092597 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.092843 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.092937 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.093175 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.093276 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.093499 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.093657 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.093816 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.093962 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.094130 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.094265 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.094520 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.094674 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.094802 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.094928 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.095084 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.095232 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.095400 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.095538 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.095710 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.095846 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.096027 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.096185 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.096319 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.096450 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.096633 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.096769 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.096941 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.097091 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.097248 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.097383 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.097552 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.097668 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.097856 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.097989 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.098166 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.098289 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.098505 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.098629 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.098835 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.098966 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.099150 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.099291 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.099459 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.099575 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.099770 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.099912 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.100086 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.100219 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.100405 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.100535 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.100714 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.100855 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.101022 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.101113 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.101373 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.101461 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.101684 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.101762 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.102014 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.102112 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.102328 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.102421 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.102683 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.102761 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.102995 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.103071 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.103303 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.103392 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.103611 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.103687 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.103926 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.104003 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.104241 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.104326 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.105138 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.105232 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.105532 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.105849 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.105939 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.106164 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.106265 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.107018 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.107124 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.108440 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.108654 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.108768 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.108882 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.109008 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.109549 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.109669 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.109768 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.109861 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.109953 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.109953 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.110140 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.110237 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.110237 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.110401 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.110522 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.110522 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.110691 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.110832 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.110832 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.111108 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.111246 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.111380 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.111574 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.111884 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.112087 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.112279 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.112474 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.112617 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.112746 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.112926 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.113389 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.113518 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.113518 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.113836 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.114040 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.114140 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.114376 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.114501 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.114735 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.114833 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.115078 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.115275 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.115395 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.115490 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.115713 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.115808 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.116076 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.116193 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.116399 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.116689 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.116786 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.117013 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.117115 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.117337 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.117425 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.117648 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.117745 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.117962 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.118058 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.118279 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.118375 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.118621 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.118721 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.118937 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.119040 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.119247 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.119339 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.119561 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.119656 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.119874 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.119961 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.120237 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.120372 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.120557 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.120871 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.121187 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.121271 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.121495 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.121585 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.121813 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.121908 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.122122 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.122221 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.122471 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.122649 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.122804 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.122938 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.123078 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.123212 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.123381 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.123487 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.123713 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.123825 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.124035 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.124135 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.124345 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.124443 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.124661 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.124775 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.124973 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.125073 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.125327 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.125429 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.125638 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.125745 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.125982 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.126092 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.126303 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.126404 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.126650 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.126793 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.126965 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.127060 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.127279 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.127372 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.127613 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.127710 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.127932 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.128017 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.128243 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.128338 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.128565 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.128682 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.128885 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.128987 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.129204 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.129312 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.129519 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.129661 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.129836 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.129975 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.130155 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.130258 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.130494 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.130586 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.130817 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.130911 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.131139 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.131235 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.131460 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.131553 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.131781 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.131868 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.132088 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.132181 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.132405 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.132500 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.132724 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.132816 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.133034 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.133133 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.133349 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.133436 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.133663 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.133749 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.133973 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.134085 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.134295 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.134396 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.134639 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.134726 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.134955 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.135052 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.135268 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.135352 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.135580 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.135731 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.135973 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.136343 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.136540 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.136630 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.136827 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.136913 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.137221 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.137314 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.137531 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.137618 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.137844 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.137937 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.138155 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.138247 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.138491 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.138584 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.138802 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.138971 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.139215 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.139307 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.139798 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.139892 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.140113 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.140208 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.140420 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.140541 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.140737 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.140865 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.141057 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.141185 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.141411 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.141548 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.141735 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.141829 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.142141 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.142248 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.142407 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.142507 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.142760 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.142864 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.143075 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.143170 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.143391 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.143491 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.143697 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.143785 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.144031 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.144119 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.144345 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.144438 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.144671 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.144755 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.144980 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.145094 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.145293 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.145415 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.145603 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.145733 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.145931 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.146159 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.146260 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.146500 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.146603 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.146821 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.147011 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.147153 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.147331 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.147484 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.147644 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.147815 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.148068 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.148170 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.148385 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.148472 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.148701 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.148803 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.149033 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.149163 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.149363 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.149502 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.149683 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.149821 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.149990 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.150241 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.150370 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.150511 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.150652 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.150840 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.150982 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.151118 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.151805 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.151994 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.152272 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.152619 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.152840 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.153060 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.153360 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.153448 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.153704 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.153796 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.154038 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.154193 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.154375 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.154555 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.154716 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.154913 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.155033 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.155344 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.155432 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.155655 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.155753 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.155976 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.156080 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.156306 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.156394 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.156620 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.156714 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.156937 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.157023 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.157252 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.157343 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.157563 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.157657 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.157875 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.157964 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.158189 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.158282 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.158541 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.158633 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.158853 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.158942 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.159176 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.159264 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.159494 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.159578 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.159813 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.159956 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.160125 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.160269 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.160436 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.160571 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.160765 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.160906 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.161078 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.161209 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.161391 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.161536 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.161704 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.161840 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.162017 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.162159 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.162370 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.162604 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.162741 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.162882 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.163020 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.163144 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.163323 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.163456 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.163637 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.163757 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.163949 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.164085 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.164297 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.164429 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.164636 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.164761 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.164967 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.165101 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.165291 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.165432 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.165630 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.165775 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.165944 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.166075 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.166260 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.166390 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.166612 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.166747 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.166991 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.167801 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.168165 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.168394 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.168504 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.168725 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.168858 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.169052 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.169193 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.169380 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.169513 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.169652 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.169779 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.169967 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.170067 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.170300 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.170389 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.170640 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.170730 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.170974 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.171068 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.171295 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.171382 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.171611 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.171715 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.171928 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.172026 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.172243 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.172333 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.172558 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.172658 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.172888 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.172975 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.173226 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.173318 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.173537 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.173632 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.173851 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.173938 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.174163 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.174256 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.174516 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.174626 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.174843 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.174935 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.175168 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.175255 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.175492 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.175588 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.175816 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.175914 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.176147 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.176283 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.176465 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.176598 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.176789 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.176928 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.177110 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.177243 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.177431 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.177573 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.177757 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.178010 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.178160 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.178348 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.178537 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.178698 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.178845 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.179022 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.179157 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.179343 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.179485 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.179666 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.179988 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.180110 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.180308 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.180446 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.180630 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.180754 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.180951 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.181090 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.181267 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.181410 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.181590 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.181727 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.181913 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.182062 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.182233 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.182578 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.182711 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.182841 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.182985 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.183412 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.183520 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.183762 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.183850 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.184096 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.184191 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.184432 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.184527 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.184778 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.184867 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.185108 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.185195 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.185423 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.185510 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.185752 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.185845 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.186082 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.186179 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.186403 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.186573 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.186753 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.186848 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.187076 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.187179 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.187393 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.187478 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.187713 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.187800 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.188032 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.188121 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.188348 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.188423 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.188664 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.188755 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.188984 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.189080 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.189304 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.189399 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.189623 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.189710 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.189939 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.190034 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.190263 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.190352 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.190609 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.190710 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.190936 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.191039 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.191270 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.191483 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.191598 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.191809 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.191904 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.192153 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.192239 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.192489 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.192576 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.192822 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.193059 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.193144 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.193380 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.193463 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.193718 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.193803 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.194048 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.194127 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.194381 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.194484 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.194738 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.194823 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.195055 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.195131 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.195369 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.195446 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.195679 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.195763 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.195992 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.196075 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.196308 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.196385 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.196624 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.196713 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.196936 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.197065 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.197307 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.197488 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.197644 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.197847 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.197986 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.198207 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.198406 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.198863 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.199146 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.199442 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.199532 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.199804 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.199891 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.200125 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.200225 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.200462 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.200559 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.200777 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.200882 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.201094 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.201199 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.201420 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.201515 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.201742 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.201836 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.202077 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.202170 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.202369 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.202536 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.202720 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.202814 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.203043 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.203139 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.203379 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.203475 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.203696 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.203790 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.204005 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.204128 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.204327 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.204417 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.204640 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.204726 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.204950 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.205038 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.205261 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.205359 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.205580 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.205675 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.205895 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.205982 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.206216 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.206317 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.206561 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.206666 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.206877 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.206972 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.207192 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.207278 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.207503 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.207602 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.207823 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.207917 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.208133 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.208218 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.208453 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.208553 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.208769 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.208855 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.209084 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.209171 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.209399 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.209488 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.209722 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.209814 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.210030 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.210119 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.210344 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.210446 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.210710 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.210798 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.211034 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.211119 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.211346 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.211432 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.211673 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.211757 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.211993 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.212079 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.212350 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.212439 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.212678 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.212764 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.212997 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.213243 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.213388 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.213591 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.213682 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.214547 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.214643 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.215101 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.215319 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.215449 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.215667 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.215779 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.215990 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.216145 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.216313 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.216485 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.216639 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.216800 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.216976 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.217166 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.217300 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.217481 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.217621 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.217814 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.217943 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.218135 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.218274 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.218480 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.218604 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.218826 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.218930 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.219145 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.219232 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.219464 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.219551 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.219783 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.219878 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.220102 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.220189 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.220421 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.220515 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.220785 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.220889 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.221056 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.221154 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.221375 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.221463 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.221701 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.221790 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.222015 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.222149 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.222333 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.222419 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.222701 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.223210 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.223313 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.223393 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.223480 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.223571 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.223650 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.223726 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.223942 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.224029 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.224261 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.224360 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.224580 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.224675 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.224906 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.224993 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.225225 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.225323 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.225541 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.225626 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.225852 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.225937 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.226237 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.226336 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.226585 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.226676 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.226902 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.227023 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.227337 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.227424 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.227735 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.227837 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.230357 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.230490 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.230631 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.230631 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.230836 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.230917 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.230917 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.231071 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.231071 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.231213 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.231213 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.231351 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.231428 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.231749 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.231846 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.232066 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.232363 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.232451 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.232686 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.232979 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.233067 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.233322 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.233617 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.233704 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.233940 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.234214 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.234316 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.234725 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.236333 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.236425 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.236521 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.236602 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.236686 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.236764 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.236840 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.236840 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.236993 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.237083 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.237162 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.237238 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.237304 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.237414 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.237724 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.237879 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.238099 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.238407 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.238590 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.238825 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.238947 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.239152 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.239474 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.239578 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.239798 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.240004 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.240122 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.240429 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.240526 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.240745 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.240832 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.241064 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.241151 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.241382 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.241475 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.241699 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.241802 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.242018 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.242117 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.242340 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.242417 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.242698 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.242810 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.243016 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.243093 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.243332 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.243408 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.243650 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.243741 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.243973 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.244062 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.244293 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.244388 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.244628 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.244740 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.244965 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.245116 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.245391 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.245544 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.245758 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.246280 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.246477 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.246632 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.246784 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.246970 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.247118 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.247305 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.247441 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.247635 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.247771 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.247957 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.248211 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.248349 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.248492 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.248628 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.248746 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.248912 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.249098 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.249228 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.249342 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.249539 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.249660 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.249858 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.249992 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.250181 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.250310 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.250531 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.250679 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.250863 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.250987 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.251184 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.251290 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.251520 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.251614 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.251836 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.251938 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.252158 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.252262 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.252476 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.252584 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.252794 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.252884 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.253110 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.253200 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.253436 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.253540 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.253751 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.253839 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.254088 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.254184 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.254383 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.254512 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.254729 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.254819 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.255054 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.255151 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.255372 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.255472 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.255685 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.255782 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.256008 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.256106 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.256330 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.256426 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.256662 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.256754 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.256996 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.257087 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.257313 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.257410 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.257646 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.257739 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.257971 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.258075 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.258300 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.258449 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.258637 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.258780 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.258871 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 11:14:18.259016 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.259355 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.259678 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.260000 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.260315 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:14:18.260567 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 11:14:18.420618 n-d-853611-3 devstack@n-api.service[106218]: INFO dbcounter [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Registered counter for database nova_api Aug 18 11:14:18.420827 n-d-853611-3 devstack@n-api.service[106219]: INFO dbcounter [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] Registered counter for database nova_api Aug 18 11:14:18.441911 n-d-853611-3 devstack@n-api.service[106219]: DEBUG oslo_db.sqlalchemy.engines [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:14:18.445369 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_db.sqlalchemy.engines [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:14:18.449449 n-d-853611-3 devstack@n-api.service[106219]: DEBUG dbcounter [-] [106219] Writer thread running {{(pid=106219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:14:18.454020 n-d-853611-3 devstack@n-api.service[106218]: DEBUG dbcounter [-] [106218] Writer thread running {{(pid=106218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:14:18.507327 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.context [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68989ef7-340f-4449-87c1-932f111c2bdb(cell1) {{(pid=106219) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 11:14:18.511234 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.context [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68989ef7-340f-4449-87c1-932f111c2bdb(cell1) {{(pid=106218) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 11:14:18.512001 n-d-853611-3 devstack@n-api.service[106219]: DEBUG oslo_concurrency.lockutils [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:18.512570 n-d-853611-3 devstack@n-api.service[106219]: DEBUG oslo_concurrency.lockutils [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:18.514218 n-d-853611-3 devstack@n-api.service[106219]: DEBUG oslo_concurrency.lockutils [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:18.515318 n-d-853611-3 devstack@n-api.service[106219]: DEBUG oslo_concurrency.lockutils [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:18.515752 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:18.515867 n-d-853611-3 devstack@n-api.service[106219]: DEBUG oslo_concurrency.lockutils [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:18.516231 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:18.517800 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:18.518140 n-d-853611-3 devstack@n-api.service[106219]: DEBUG oslo_concurrency.lockutils [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:18.518558 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:14:18.519012 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:14:18.520407 n-d-853611-3 devstack@n-api.service[106219]: INFO dbcounter [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] Registered counter for database nova_cell0 Aug 18 11:14:18.521046 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:14:18.523137 n-d-853611-3 devstack@n-api.service[106218]: INFO dbcounter [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Registered counter for database nova_cell0 Aug 18 11:14:18.527147 n-d-853611-3 devstack@n-api.service[106219]: INFO dbcounter [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] Registered counter for database nova_cell1 Aug 18 11:14:18.529839 n-d-853611-3 devstack@n-api.service[106218]: INFO dbcounter [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Registered counter for database nova_cell1 Aug 18 11:14:18.535970 n-d-853611-3 devstack@n-api.service[106219]: DEBUG oslo_db.sqlalchemy.engines [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:14:18.537981 n-d-853611-3 devstack@n-api.service[106219]: DEBUG oslo_db.sqlalchemy.engines [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:14:18.539776 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_db.sqlalchemy.engines [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:14:18.543343 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_db.sqlalchemy.engines [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:14:18.544123 n-d-853611-3 devstack@n-api.service[106219]: DEBUG dbcounter [-] [106219] Writer thread running {{(pid=106219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:14:18.546764 n-d-853611-3 devstack@n-api.service[106218]: DEBUG dbcounter [-] [106218] Writer thread running {{(pid=106218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:14:18.549868 n-d-853611-3 devstack@n-api.service[106219]: DEBUG dbcounter [-] [106219] Writer thread running {{(pid=106219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:14:18.688552 n-d-853611-3 devstack@n-api.service[106218]: DEBUG dbcounter [-] [106218] Writer thread running {{(pid=106218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:14:18.699676 n-d-853611-3 devstack@n-api.service[106218]: INFO dbcounter [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Registered counter for database nova_cell0 Aug 18 11:14:18.701029 n-d-853611-3 devstack@n-api.service[106219]: INFO dbcounter [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] Registered counter for database nova_cell0 Aug 18 11:14:18.709225 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_db.sqlalchemy.engines [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:14:18.713367 n-d-853611-3 devstack@n-api.service[106219]: DEBUG oslo_db.sqlalchemy.engines [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:14:18.714851 n-d-853611-3 devstack@n-api.service[106218]: DEBUG dbcounter [-] [106218] Writer thread running {{(pid=106218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:14:18.719004 n-d-853611-3 devstack@n-api.service[106219]: DEBUG dbcounter [-] [106219] Writer thread running {{(pid=106219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:14:19.059723 n-d-853611-3 devstack@n-api.service[106219]: WARNING keystonemiddleware.auth_token [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 11:14:19.061386 n-d-853611-3 devstack@n-api.service[106218]: WARNING keystonemiddleware.auth_token [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 11:14:19.067149 n-d-853611-3 devstack@n-api.service[106219]: WARNING keystonemiddleware.auth_token [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 11:14:19.068742 n-d-853611-3 devstack@n-api.service[106218]: WARNING keystonemiddleware.auth_token [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 11:14:19.414538 n-d-853611-3 devstack@n-api.service[106219]: WARNING keystonemiddleware.auth_token [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 11:14:19.415518 n-d-853611-3 devstack@n-api.service[106218]: WARNING keystonemiddleware.auth_token [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 11:14:19.421490 n-d-853611-3 devstack@n-api.service[106219]: WARNING keystonemiddleware.auth_token [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 11:14:19.422094 n-d-853611-3 devstack@n-api.service[106218]: WARNING keystonemiddleware.auth_token [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 11:14:19.426871 n-d-853611-3 devstack@n-api.service[106219]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c276a9f9c0 pid: 106219 (default app) Aug 18 11:14:19.427384 n-d-853611-3 devstack@n-api.service[106218]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c276a9f9c0 pid: 106218 (default app) Aug 18 11:14:19.428989 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:14:19.430193 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-267cfafa-d200-4a91-9ec3-26a27bbe66da None None] 10.222.0.73 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001774 Aug 18 11:14:19.430645 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 788 bytes} [Thu Aug 18 11:14:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:15:40.530024 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:40.531915 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002607 Aug 18 11:15:40.532323 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 1/2] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 18 11:15:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:15:40.545032 n-d-853611-3 devstack@n-api.service[106219]: DEBUG dbcounter [-] [106219] Writing DB stats nova_api:SELECT=3 {{(pid=106219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:40.546386 n-d-853611-3 devstack@n-api.service[106219]: DEBUG dbcounter [-] [106219] Writing DB stats nova_cell0:SELECT=3 {{(pid=106219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:40.547258 n-d-853611-3 devstack@n-api.service[106219]: DEBUG dbcounter [-] [106219] Writing DB stats nova_cell1:SELECT=3 {{(pid=106219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:40.548361 n-d-853611-3 devstack@n-api.service[106219]: DEBUG dbcounter [-] [106219] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:41.445294 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-af67bce3-1db9-4de7-b9db-9f9d961d84e4 admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:41.479099 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-af67bce3-1db9-4de7-b9db-9f9d961d84e4 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.939485 Aug 18 11:15:41.480008 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 2/3] 10.222.0.73 () {60 vars in 1292 bytes} [Thu Aug 18 11:15:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:15:44.001839 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:44.002888 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-b1e3ee6f-2b44-4b34-a96d-bf6e3c8252c0 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 18 11:15:44.003463 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 2/4] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 18 11:15:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:15:44.446780 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-95b265df-5043-4144-8fa2-10bdb9b05ec5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "name": "cirros256", "swap": 0, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256}} {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:44.467368 n-d-853611-3 devstack@n-api.service[106219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:15:44.467368 n-d-853611-3 devstack@n-api.service[106219]: warnings.warn(msg) Aug 18 11:15:44.500421 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-95b265df-5043-4144-8fa2-10bdb9b05ec5 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.490163 Aug 18 11:15:44.501089 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 3/5] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 18 11:15:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:15:44.515166 n-d-853611-3 devstack@n-api.service[106218]: DEBUG dbcounter [-] [106218] Writing DB stats nova_api:SELECT=3 {{(pid=106218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:44.515971 n-d-853611-3 devstack@n-api.service[106218]: DEBUG dbcounter [-] [106218] Writing DB stats nova_cell0:SELECT=3 {{(pid=106218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:44.516938 n-d-853611-3 devstack@n-api.service[106218]: DEBUG dbcounter [-] [106218] Writing DB stats nova_cell1:SELECT=3 {{(pid=106218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:44.517957 n-d-853611-3 devstack@n-api.service[106218]: DEBUG dbcounter [-] [106218] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:15:44.735949 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-6854c998-4c7d-4ecc-97e3-58b57112e57c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:44.740435 n-d-853611-3 devstack@n-api.service[106218]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:15:44.740435 n-d-853611-3 devstack@n-api.service[106218]: warnings.warn(msg) Aug 18 11:15:44.802309 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-6854c998-4c7d-4ecc-97e3-58b57112e57c admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292775 Aug 18 11:15:44.802945 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 3/6] 10.222.0.73 () {64 vars in 1336 bytes} [Thu Aug 18 11:15:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:47.227626 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-95b265df-5043-4144-8fa2-10bdb9b05ec5 admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:47.229229 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-95b265df-5043-4144-8fa2-10bdb9b05ec5 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002047 Aug 18 11:15:47.230777 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 4/7] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 18 11:15:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:15:47.961731 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-83a40620-7386-4eea-baa9-ed603a67cef5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:47.981841 n-d-853611-3 devstack@n-api.service[106218]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:15:47.981841 n-d-853611-3 devstack@n-api.service[106218]: warnings.warn(msg) Aug 18 11:15:48.010394 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-83a40620-7386-4eea-baa9-ed603a67cef5 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.774319 Aug 18 11:15:48.011670 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 4/8] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 18 11:15:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:15:48.025362 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-220c59f8-9156-4d7c-aeb6-bbf85e0d1780 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:48.030053 n-d-853611-3 devstack@n-api.service[106219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:15:48.030053 n-d-853611-3 devstack@n-api.service[106219]: warnings.warn(msg) Aug 18 11:15:48.081097 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-220c59f8-9156-4d7c-aeb6-bbf85e0d1780 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061063 Aug 18 11:15:48.083664 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 5/9] 10.222.0.73 () {64 vars in 1336 bytes} [Thu Aug 18 11:15:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:50.990003 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-83a40620-7386-4eea-baa9-ed603a67cef5 admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:50.991781 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-83a40620-7386-4eea-baa9-ed603a67cef5 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002392 Aug 18 11:15:50.992891 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 5/10] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 18 11:15:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:15:51.503186 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-c7f19885-b0a4-4f0c-b05e-721221152d6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "swap": 0, "name": "ds1G"}} {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:51.530257 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-c7f19885-b0a4-4f0c-b05e-721221152d6a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.530804 Aug 18 11:15:51.531257 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 6/11] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 18 11:15:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:15:51.544626 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-484c0682-1454-47ba-8c96-9805e6f203d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:51.580621 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-484c0682-1454-47ba-8c96-9805e6f203d4 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038239 Aug 18 11:15:51.589202 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 6/12] 10.222.0.73 () {64 vars in 1336 bytes} [Thu Aug 18 11:15:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:54.339026 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-c7f19885-b0a4-4f0c-b05e-721221152d6a admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:54.340058 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-c7f19885-b0a4-4f0c-b05e-721221152d6a admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 18 11:15:54.344893 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 7/13] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 18 11:15:54 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:15:54.809968 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-eaa16210-4538-4e3f-8444-396f6f32e1ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:54.831936 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-eaa16210-4538-4e3f-8444-396f6f32e1ef admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481534 Aug 18 11:15:54.832602 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 7/14] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 18 11:15:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 11:15:54.845768 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-2c555124-2b45-4935-89d7-988e6ebb0d2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:54.872199 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-2c555124-2b45-4935-89d7-988e6ebb0d2d admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030753 Aug 18 11:15:54.872800 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 8/15] 10.222.0.73 () {64 vars in 1336 bytes} [Thu Aug 18 11:15:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:15:57.462303 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-eaa16210-4538-4e3f-8444-396f6f32e1ef admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:15:57.465430 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-eaa16210-4538-4e3f-8444-396f6f32e1ef admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003196 Aug 18 11:15:57.466527 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 8/16] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 18 11:15:57 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:15:58.073307 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-97780739-0db3-40d2-836e-e214c4311fb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:58.098850 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-97780739-0db3-40d2-836e-e214c4311fb3 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.624404 Aug 18 11:15:58.108149 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 9/17] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 18 11:15:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:15:58.114889 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-6fd5c210-ac5d-4e3e-acfa-61614da833d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:15:58.147470 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-6fd5c210-ac5d-4e3e-acfa-61614da833d8 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038590 Aug 18 11:15:58.148929 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 9/18] 10.222.0.73 () {64 vars in 1336 bytes} [Thu Aug 18 11:15:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:16:00.675393 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-97780739-0db3-40d2-836e-e214c4311fb3 admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:00.678089 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-97780739-0db3-40d2-836e-e214c4311fb3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003117 Aug 18 11:16:00.678795 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 10/19] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 18 11:16:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:01.149617 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-717331aa-a322-4f5f-ae24-9a31abac2fe1 admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:01.176267 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-717331aa-a322-4f5f-ae24-9a31abac2fe1 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.490939 Aug 18 11:16:01.177614 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 10/20] 10.222.0.73 () {60 vars in 1292 bytes} [Thu Aug 18 11:16:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:16:03.573984 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-97780739-0db3-40d2-836e-e214c4311fb3 admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:03.575056 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-97780739-0db3-40d2-836e-e214c4311fb3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 18 11:16:03.575468 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 11/21] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 18 11:16:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:04.063484 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-b02ea926-59d0-45f1-bf51-4046201361a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "id": "1"}} {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:16:04.087569 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-b02ea926-59d0-45f1-bf51-4046201361a9 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.505804 Aug 18 11:16:04.088576 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 11/22] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 18 11:16:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:16:04.101282 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-67480d5a-6584-4255-9ce8-b35e8fcfcadc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:16:04.126573 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-67480d5a-6584-4255-9ce8-b35e8fcfcadc admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029404 Aug 18 11:16:04.127169 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 12/23] 10.222.0.73 () {64 vars in 1333 bytes} [Thu Aug 18 11:16:04 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:16:06.483649 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-b02ea926-59d0-45f1-bf51-4046201361a9 admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:06.484666 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-b02ea926-59d0-45f1-bf51-4046201361a9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 18 11:16:06.485013 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 12/24] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 18 11:16:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:06.919122 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-6b4f2401-afa6-41f9-aa21-65d57f598e76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048}} {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:16:06.938667 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-6b4f2401-afa6-41f9-aa21-65d57f598e76 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.446828 Aug 18 11:16:06.939256 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 13/25] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 18 11:16:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:16:06.951347 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-b982a581-63fd-4f66-8b54-956e63772589 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:16:06.980639 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-b982a581-63fd-4f66-8b54-956e63772589 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032264 Aug 18 11:16:06.981686 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 13/26] 10.222.0.73 () {64 vars in 1333 bytes} [Thu Aug 18 11:16:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:16:09.361372 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-6b4f2401-afa6-41f9-aa21-65d57f598e76 admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:09.362404 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-6b4f2401-afa6-41f9-aa21-65d57f598e76 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 18 11:16:09.362963 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 14/27] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 18 11:16:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:09.775773 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-61ecfc57-f379-4797-902d-3c200e6fdcc8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "disk": 40, "name": "m1.medium", "id": "3", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:16:09.794501 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-61ecfc57-f379-4797-902d-3c200e6fdcc8 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.425570 Aug 18 11:16:09.794986 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 14/28] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 18 11:16:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 11:16:09.808795 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-20b5340b-6998-467b-872d-e4cb5b6a6a8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:16:09.835746 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-20b5340b-6998-467b-872d-e4cb5b6a6a8d admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031185 Aug 18 11:16:09.836369 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 15/29] 10.222.0.73 () {64 vars in 1333 bytes} [Thu Aug 18 11:16:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:16:12.245265 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-61ecfc57-f379-4797-902d-3c200e6fdcc8 admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:12.246912 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-61ecfc57-f379-4797-902d-3c200e6fdcc8 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002061 Aug 18 11:16:12.247327 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 15/30] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 18 11:16:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:12.673253 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-45ec75f4-e306-4c68-a423-aa7ac09399bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:16:12.682014 n-d-853611-3 devstack@n-api.service[106219]: DEBUG dbcounter [-] [106219] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:16:12.698097 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-45ec75f4-e306-4c68-a423-aa7ac09399bc admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.444474 Aug 18 11:16:12.698722 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 16/31] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 18 11:16:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 11:16:12.710967 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-f2ee84ea-aaa9-42c2-b249-b6e2b4d0e13c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:16:12.738799 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-f2ee84ea-aaa9-42c2-b249-b6e2b4d0e13c admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028553 Aug 18 11:16:12.739465 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 16/32] 10.222.0.73 () {64 vars in 1333 bytes} [Thu Aug 18 11:16:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:16:15.198011 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-45ec75f4-e306-4c68-a423-aa7ac09399bc admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:15.199727 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-45ec75f4-e306-4c68-a423-aa7ac09399bc admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002142 Aug 18 11:16:15.200139 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 17/33] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 18 11:16:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:15.642546 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-c0963109-bc90-4a20-9061-5fe462008838 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0}} {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:16:15.648785 n-d-853611-3 devstack@n-api.service[106218]: DEBUG dbcounter [-] [106218] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:16:15.663853 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-c0963109-bc90-4a20-9061-5fe462008838 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.457403 Aug 18 11:16:15.664585 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 17/34] 10.222.0.73 () {64 vars in 1283 bytes} [Thu Aug 18 11:16:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:16:15.677115 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-2ad30c0f-a63c-4ddc-91fc-3e0cc154ab2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:16:15.711742 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-2ad30c0f-a63c-4ddc-91fc-3e0cc154ab2b admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038940 Aug 18 11:16:15.713135 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 18/35] 10.222.0.73 () {64 vars in 1333 bytes} [Thu Aug 18 11:16:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:16:39.227777 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-c0963109-bc90-4a20-9061-5fe462008838 admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:39.228806 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-c0963109-bc90-4a20-9061-5fe462008838 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 18 11:16:39.229226 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 18/36] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 18 11:16:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:39.239712 n-d-853611-3 devstack@n-api.service[106219]: DEBUG dbcounter [-] [106219] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:16:39.630750 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-2ead39a0-3a8c-4ab2-a2d2-c24935c2474a admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:39.649024 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-2ead39a0-3a8c-4ab2-a2d2-c24935c2474a admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413759 Aug 18 11:16:39.649581 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 19/37] 10.222.0.73 () {60 vars in 1292 bytes} [Thu Aug 18 11:16:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:16:40.713331 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-c0963109-bc90-4a20-9061-5fe462008838 admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:40.714104 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-c0963109-bc90-4a20-9061-5fe462008838 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 18 11:16:40.714536 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 19/38] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 18 11:16:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:41.269728 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-59b2b5f9-0639-4fa0-a2ed-88c94ecda756 admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:41.275508 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.wsgi [None req-59b2b5f9-0639-4fa0-a2ed-88c94ecda756 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-59b2b5f9-0639-4fa0-a2ed-88c94ecda756 admin admin] Request method failure captured: Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: Accept: application/json Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: Accept-Encoding: gzip, deflate Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: Connection: keep-alive Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: Content-Length: 0 Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: Host: 10.222.0.73 Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: Openstack-Api-Version: compute 2.90 Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: Openstack-System-Scope: None Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: User-Agent: python-novaclient Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: X-Auth-Token: gAAAAABi_h-YHftuYh00j_DAruNd61u5_Ba1A7mlcNZHUEMInnBrfKF1cQAOVezFq4qCwYYfRRAEzPoZBOXLBfgSm75ffdqDswLblWKC8T9iUI2f-U0DxBlqTQ9SpkLfcvqPH6eHel8MaPI8_5okU5eco4YBQDKE9KMptW7EKojJp4VYyGxtBRo Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: X-Domain-Id: None Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: X-Domain-Name: None Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: X-Identity-Status: Confirmed Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: X-Is-Admin-Project: True Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: X-Project-Domain-Id: default Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: X-Project-Domain-Name: Default Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: X-Project-Id: b0c3e7888e1b4c449e834dc338af563a Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: X-Project-Name: admin Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: X-Role: admin,member,reader Aug 18 11:16:41.278798 n-d-853611-3 devstack@n-api.service[106219]: X-Roles: admin,member,reader Aug 18 11:16:41.280275 n-d-853611-3 devstack@n-api.service[106219]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:16:41.280275 n-d-853611-3 devstack@n-api.service[106219]: X-Tenant: admin Aug 18 11:16:41.280275 n-d-853611-3 devstack@n-api.service[106219]: X-Tenant-Id: b0c3e7888e1b4c449e834dc338af563a Aug 18 11:16:41.280275 n-d-853611-3 devstack@n-api.service[106219]: X-Tenant-Name: admin Aug 18 11:16:41.280275 n-d-853611-3 devstack@n-api.service[106219]: X-User: admin Aug 18 11:16:41.280275 n-d-853611-3 devstack@n-api.service[106219]: X-User-Domain-Id: default Aug 18 11:16:41.280275 n-d-853611-3 devstack@n-api.service[106219]: X-User-Domain-Name: Default Aug 18 11:16:41.280275 n-d-853611-3 devstack@n-api.service[106219]: X-User-Id: f4378fc3a30444b0adb3a66de656bd46 Aug 18 11:16:41.280275 n-d-853611-3 devstack@n-api.service[106219]: X-User-Name: admin Aug 18 11:16:41.280275 n-d-853611-3 devstack@n-api.service[106219]: method: > Aug 18 11:16:41.280275 n-d-853611-3 devstack@n-api.service[106219]: exception: Flavor 42 could not be found. Aug 18 11:16:41.280275 n-d-853611-3 devstack@n-api.service[106219]: action_args: {'id': '42'} Aug 18 11:16:41.280275 n-d-853611-3 devstack@n-api.service[106219]: {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:16:41.280275 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:16:41.281212 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:41.282358 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-59b2b5f9-0639-4fa0-a2ed-88c94ecda756 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:16:41.284264 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-59b2b5f9-0639-4fa0-a2ed-88c94ecda756 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.406396 Aug 18 11:16:41.284264 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 20/39] 10.222.0.73 () {60 vars in 1190 bytes} [Thu Aug 18 11:16:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:16:41.290931 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-80f5c64e-991a-4f2d-af51-5311d94d675f admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:41.313985 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-80f5c64e-991a-4f2d-af51-5311d94d675f admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026728 Aug 18 11:16:41.315039 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 20/40] 10.222.0.73 () {60 vars in 1210 bytes} [Thu Aug 18 11:16:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:16:41.341917 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-2a94f329-1fe0-4ce3-8fac-cbcadbfd222c admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:41.366508 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-2a94f329-1fe0-4ce3-8fac-cbcadbfd222c admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028165 Aug 18 11:16:41.367052 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 21/41] 10.222.0.73 () {60 vars in 1210 bytes} [Thu Aug 18 11:16:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:16:41.376343 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-e51abfba-e468-418e-bb12-5b0617d68eeb admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:41.381941 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.wsgi [None req-e51abfba-e468-418e-bb12-5b0617d68eeb admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-e51abfba-e468-418e-bb12-5b0617d68eeb admin admin] Request method failure captured: Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: Accept: application/json Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: Accept-Encoding: gzip, deflate Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: Connection: keep-alive Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: Content-Length: 0 Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: Host: 10.222.0.73 Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: Openstack-Api-Version: compute 2.90 Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: Openstack-System-Scope: None Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: User-Agent: python-novaclient Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: X-Auth-Token: gAAAAABi_h-YHftuYh00j_DAruNd61u5_Ba1A7mlcNZHUEMInnBrfKF1cQAOVezFq4qCwYYfRRAEzPoZBOXLBfgSm75ffdqDswLblWKC8T9iUI2f-U0DxBlqTQ9SpkLfcvqPH6eHel8MaPI8_5okU5eco4YBQDKE9KMptW7EKojJp4VYyGxtBRo Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: X-Domain-Id: None Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: X-Domain-Name: None Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: X-Identity-Status: Confirmed Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: X-Is-Admin-Project: True Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: X-Project-Domain-Id: default Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: X-Project-Domain-Name: Default Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: X-Project-Id: b0c3e7888e1b4c449e834dc338af563a Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: X-Project-Name: admin Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: X-Role: admin,member,reader Aug 18 11:16:41.385501 n-d-853611-3 devstack@n-api.service[106218]: X-Roles: admin,member,reader Aug 18 11:16:41.387053 n-d-853611-3 devstack@n-api.service[106218]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:16:41.387053 n-d-853611-3 devstack@n-api.service[106218]: X-Tenant: admin Aug 18 11:16:41.387053 n-d-853611-3 devstack@n-api.service[106218]: X-Tenant-Id: b0c3e7888e1b4c449e834dc338af563a Aug 18 11:16:41.387053 n-d-853611-3 devstack@n-api.service[106218]: X-Tenant-Name: admin Aug 18 11:16:41.387053 n-d-853611-3 devstack@n-api.service[106218]: X-User: admin Aug 18 11:16:41.387053 n-d-853611-3 devstack@n-api.service[106218]: X-User-Domain-Id: default Aug 18 11:16:41.387053 n-d-853611-3 devstack@n-api.service[106218]: X-User-Domain-Name: Default Aug 18 11:16:41.387053 n-d-853611-3 devstack@n-api.service[106218]: X-User-Id: f4378fc3a30444b0adb3a66de656bd46 Aug 18 11:16:41.387053 n-d-853611-3 devstack@n-api.service[106218]: X-User-Name: admin Aug 18 11:16:41.387053 n-d-853611-3 devstack@n-api.service[106218]: method: > Aug 18 11:16:41.387053 n-d-853611-3 devstack@n-api.service[106218]: exception: Flavor 42 could not be found. Aug 18 11:16:41.387053 n-d-853611-3 devstack@n-api.service[106218]: action_args: {'id': '42'} Aug 18 11:16:41.387053 n-d-853611-3 devstack@n-api.service[106218]: {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:16:41.387053 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:16:41.388007 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:41.389266 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-e51abfba-e468-418e-bb12-5b0617d68eeb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:16:41.390508 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-e51abfba-e468-418e-bb12-5b0617d68eeb admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014154 Aug 18 11:16:41.390508 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 21/42] 10.222.0.73 () {60 vars in 1190 bytes} [Thu Aug 18 11:16:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:16:42.390378 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-2a94f329-1fe0-4ce3-8fac-cbcadbfd222c admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:42.391466 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-2a94f329-1fe0-4ce3-8fac-cbcadbfd222c admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 18 11:16:42.391869 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 22/43] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 18 11:16:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:42.941722 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-9720aa86-1962-4c56-9d0d-4b2408d20b3e admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:42.947080 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.wsgi [None req-9720aa86-1962-4c56-9d0d-4b2408d20b3e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-9720aa86-1962-4c56-9d0d-4b2408d20b3e admin admin] Request method failure captured: Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: Accept: application/json Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: Accept-Encoding: gzip, deflate Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: Connection: keep-alive Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: Content-Length: 0 Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: Host: 10.222.0.73 Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: Openstack-Api-Version: compute 2.90 Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: Openstack-System-Scope: None Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: User-Agent: python-novaclient Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: X-Auth-Token: gAAAAABi_h-a_XXoTQnZNTD5GY2WEuA2hXQem5Q3txTBcq9bvEBo7JgnXMZ5OyuMR8dQQ8rLugl0rn24WHhHINIrZ9SmQTiJi2s4ov43W1rnEuett2QRVJ1fBk5LN-ny5QIQnE1tVdW0ynHAl5oQ8g11_CytMuMxgJCUj6-_WL0xeeuH18hJv3E Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: X-Domain-Id: None Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: X-Domain-Name: None Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: X-Identity-Status: Confirmed Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: X-Is-Admin-Project: True Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: X-Project-Domain-Id: default Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: X-Project-Domain-Name: Default Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: X-Project-Id: b0c3e7888e1b4c449e834dc338af563a Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: X-Project-Name: admin Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: X-Role: admin,member,reader Aug 18 11:16:42.948580 n-d-853611-3 devstack@n-api.service[106218]: X-Roles: admin,member,reader Aug 18 11:16:42.950028 n-d-853611-3 devstack@n-api.service[106218]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:16:42.950028 n-d-853611-3 devstack@n-api.service[106218]: X-Tenant: admin Aug 18 11:16:42.950028 n-d-853611-3 devstack@n-api.service[106218]: X-Tenant-Id: b0c3e7888e1b4c449e834dc338af563a Aug 18 11:16:42.950028 n-d-853611-3 devstack@n-api.service[106218]: X-Tenant-Name: admin Aug 18 11:16:42.950028 n-d-853611-3 devstack@n-api.service[106218]: X-User: admin Aug 18 11:16:42.950028 n-d-853611-3 devstack@n-api.service[106218]: X-User-Domain-Id: default Aug 18 11:16:42.950028 n-d-853611-3 devstack@n-api.service[106218]: X-User-Domain-Name: Default Aug 18 11:16:42.950028 n-d-853611-3 devstack@n-api.service[106218]: X-User-Id: f4378fc3a30444b0adb3a66de656bd46 Aug 18 11:16:42.950028 n-d-853611-3 devstack@n-api.service[106218]: X-User-Name: admin Aug 18 11:16:42.950028 n-d-853611-3 devstack@n-api.service[106218]: method: > Aug 18 11:16:42.950028 n-d-853611-3 devstack@n-api.service[106218]: exception: Flavor 84 could not be found. Aug 18 11:16:42.950028 n-d-853611-3 devstack@n-api.service[106218]: action_args: {'id': '84'} Aug 18 11:16:42.950028 n-d-853611-3 devstack@n-api.service[106218]: {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:16:42.950028 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:16:42.951099 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:42.952499 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-9720aa86-1962-4c56-9d0d-4b2408d20b3e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:16:42.953681 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-9720aa86-1962-4c56-9d0d-4b2408d20b3e admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.414100 Aug 18 11:16:42.953681 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 22/44] 10.222.0.73 () {60 vars in 1190 bytes} [Thu Aug 18 11:16:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:16:42.959810 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-23fca955-dadc-4cfa-83c0-52e698aba84d admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:42.975818 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-23fca955-dadc-4cfa-83c0-52e698aba84d admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019671 Aug 18 11:16:42.976359 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 23/45] 10.222.0.73 () {60 vars in 1210 bytes} [Thu Aug 18 11:16:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:16:42.985504 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-a8571182-d40f-49e1-ad1e-3c6379ed3dd0 admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:43.001002 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-a8571182-d40f-49e1-ad1e-3c6379ed3dd0 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018967 Aug 18 11:16:43.001534 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 23/46] 10.222.0.73 () {60 vars in 1210 bytes} [Thu Aug 18 11:16:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:16:43.010741 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-2217c7a7-d590-495a-aff1-ff80bb4fb5e9 admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:43.016027 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.wsgi [None req-2217c7a7-d590-495a-aff1-ff80bb4fb5e9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-2217c7a7-d590-495a-aff1-ff80bb4fb5e9 admin admin] Request method failure captured: Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: Accept: application/json Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: Accept-Encoding: gzip, deflate Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: Connection: keep-alive Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: Content-Length: 0 Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: Host: 10.222.0.73 Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: Openstack-Api-Version: compute 2.90 Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: Openstack-System-Scope: None Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: User-Agent: python-novaclient Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: X-Auth-Token: gAAAAABi_h-a_XXoTQnZNTD5GY2WEuA2hXQem5Q3txTBcq9bvEBo7JgnXMZ5OyuMR8dQQ8rLugl0rn24WHhHINIrZ9SmQTiJi2s4ov43W1rnEuett2QRVJ1fBk5LN-ny5QIQnE1tVdW0ynHAl5oQ8g11_CytMuMxgJCUj6-_WL0xeeuH18hJv3E Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: X-Domain-Id: None Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: X-Domain-Name: None Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: X-Identity-Status: Confirmed Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: X-Is-Admin-Project: True Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: X-Project-Domain-Id: default Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: X-Project-Domain-Name: Default Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: X-Project-Id: b0c3e7888e1b4c449e834dc338af563a Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: X-Project-Name: admin Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: X-Role: admin,member,reader Aug 18 11:16:43.018173 n-d-853611-3 devstack@n-api.service[106219]: X-Roles: admin,member,reader Aug 18 11:16:43.019752 n-d-853611-3 devstack@n-api.service[106219]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:16:43.019752 n-d-853611-3 devstack@n-api.service[106219]: X-Tenant: admin Aug 18 11:16:43.019752 n-d-853611-3 devstack@n-api.service[106219]: X-Tenant-Id: b0c3e7888e1b4c449e834dc338af563a Aug 18 11:16:43.019752 n-d-853611-3 devstack@n-api.service[106219]: X-Tenant-Name: admin Aug 18 11:16:43.019752 n-d-853611-3 devstack@n-api.service[106219]: X-User: admin Aug 18 11:16:43.019752 n-d-853611-3 devstack@n-api.service[106219]: X-User-Domain-Id: default Aug 18 11:16:43.019752 n-d-853611-3 devstack@n-api.service[106219]: X-User-Domain-Name: Default Aug 18 11:16:43.019752 n-d-853611-3 devstack@n-api.service[106219]: X-User-Id: f4378fc3a30444b0adb3a66de656bd46 Aug 18 11:16:43.019752 n-d-853611-3 devstack@n-api.service[106219]: X-User-Name: admin Aug 18 11:16:43.019752 n-d-853611-3 devstack@n-api.service[106219]: method: > Aug 18 11:16:43.019752 n-d-853611-3 devstack@n-api.service[106219]: exception: Flavor 84 could not be found. Aug 18 11:16:43.019752 n-d-853611-3 devstack@n-api.service[106219]: action_args: {'id': '84'} Aug 18 11:16:43.019752 n-d-853611-3 devstack@n-api.service[106219]: {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:16:43.019752 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:16:43.020683 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:43.021952 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-2217c7a7-d590-495a-aff1-ff80bb4fb5e9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:16:43.023255 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-2217c7a7-d590-495a-aff1-ff80bb4fb5e9 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012571 Aug 18 11:16:43.023255 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 24/47] 10.222.0.73 () {60 vars in 1190 bytes} [Thu Aug 18 11:16:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:16:43.985785 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-a8571182-d40f-49e1-ad1e-3c6379ed3dd0 admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:43.986995 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-a8571182-d40f-49e1-ad1e-3c6379ed3dd0 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 18 11:16:43.987429 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 24/48] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 18 11:16:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:44.518888 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-f9dbb03f-5e43-4189-87e4-a476f6856258 admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:44.524624 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.wsgi [None req-f9dbb03f-5e43-4189-87e4-a476f6856258 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-f9dbb03f-5e43-4189-87e4-a476f6856258 admin admin] Request method failure captured: Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: Accept: application/json Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: Accept-Encoding: gzip, deflate Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: Connection: keep-alive Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: Content-Length: 0 Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: Host: 10.222.0.73 Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: Openstack-Api-Version: compute 2.90 Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: Openstack-System-Scope: None Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: User-Agent: python-novaclient Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: X-Auth-Token: gAAAAABi_h-bbsfsFgRyJeSoJacbXUwk8s_l0Z82em53VxaD6TZonvTfdWADPyDe4foqxVR9sVhbpiZOKT72yGpZPI2sAzfl54VdBU3YsFEyPqxF3YhyTP2i2EuAanHkweqAn98cbeq-lKh3pQ-o9kic-G8-VCV6MI0hkPVt1RIiRaEEOxn8PSQ Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: X-Domain-Id: None Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: X-Domain-Name: None Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: X-Identity-Status: Confirmed Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: X-Is-Admin-Project: True Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: X-Project-Domain-Id: default Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: X-Project-Domain-Name: Default Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: X-Project-Id: b0c3e7888e1b4c449e834dc338af563a Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: X-Project-Name: admin Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: X-Role: admin,member,reader Aug 18 11:16:44.526113 n-d-853611-3 devstack@n-api.service[106219]: X-Roles: admin,member,reader Aug 18 11:16:44.527603 n-d-853611-3 devstack@n-api.service[106219]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:16:44.527603 n-d-853611-3 devstack@n-api.service[106219]: X-Tenant: admin Aug 18 11:16:44.527603 n-d-853611-3 devstack@n-api.service[106219]: X-Tenant-Id: b0c3e7888e1b4c449e834dc338af563a Aug 18 11:16:44.527603 n-d-853611-3 devstack@n-api.service[106219]: X-Tenant-Name: admin Aug 18 11:16:44.527603 n-d-853611-3 devstack@n-api.service[106219]: X-User: admin Aug 18 11:16:44.527603 n-d-853611-3 devstack@n-api.service[106219]: X-User-Domain-Id: default Aug 18 11:16:44.527603 n-d-853611-3 devstack@n-api.service[106219]: X-User-Domain-Name: Default Aug 18 11:16:44.527603 n-d-853611-3 devstack@n-api.service[106219]: X-User-Id: f4378fc3a30444b0adb3a66de656bd46 Aug 18 11:16:44.527603 n-d-853611-3 devstack@n-api.service[106219]: X-User-Name: admin Aug 18 11:16:44.527603 n-d-853611-3 devstack@n-api.service[106219]: method: > Aug 18 11:16:44.527603 n-d-853611-3 devstack@n-api.service[106219]: exception: Flavor 451 could not be found. Aug 18 11:16:44.527603 n-d-853611-3 devstack@n-api.service[106219]: action_args: {'id': '451'} Aug 18 11:16:44.527603 n-d-853611-3 devstack@n-api.service[106219]: {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:16:44.527603 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:16:44.528426 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: ERROR nova.api.openstack.wsgi Aug 18 11:16:44.529442 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-f9dbb03f-5e43-4189-87e4-a476f6856258 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:16:44.530455 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-f9dbb03f-5e43-4189-87e4-a476f6856258 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.403396 Aug 18 11:16:44.530455 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 25/49] 10.222.0.73 () {60 vars in 1193 bytes} [Thu Aug 18 11:16:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:16:44.537566 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-a09801ac-da41-42cc-a683-4f271affaa52 admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:44.552740 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-a09801ac-da41-42cc-a683-4f271affaa52 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018780 Aug 18 11:16:44.553268 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 25/50] 10.222.0.73 () {60 vars in 1210 bytes} [Thu Aug 18 11:16:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:16:44.562502 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-15e8fe7a-4369-4340-896b-c95ed93ddadd admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:44.577587 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-15e8fe7a-4369-4340-896b-c95ed93ddadd admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018553 Aug 18 11:16:44.578140 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 26/51] 10.222.0.73 () {60 vars in 1210 bytes} [Thu Aug 18 11:16:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:16:44.588067 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-f8dbbb4f-8c94-4127-80f7-7130e903422f admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:44.593285 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.wsgi [None req-f8dbbb4f-8c94-4127-80f7-7130e903422f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-f8dbbb4f-8c94-4127-80f7-7130e903422f admin admin] Request method failure captured: Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: Accept: application/json Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: Accept-Encoding: gzip, deflate Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: Connection: keep-alive Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: Content-Length: 0 Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: Host: 10.222.0.73 Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: Openstack-Api-Version: compute 2.90 Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: Openstack-System-Scope: None Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: User-Agent: python-novaclient Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: X-Auth-Token: gAAAAABi_h-bbsfsFgRyJeSoJacbXUwk8s_l0Z82em53VxaD6TZonvTfdWADPyDe4foqxVR9sVhbpiZOKT72yGpZPI2sAzfl54VdBU3YsFEyPqxF3YhyTP2i2EuAanHkweqAn98cbeq-lKh3pQ-o9kic-G8-VCV6MI0hkPVt1RIiRaEEOxn8PSQ Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: X-Domain-Id: None Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: X-Domain-Name: None Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: X-Identity-Status: Confirmed Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: X-Is-Admin-Project: True Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: X-Project-Domain-Id: default Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: X-Project-Domain-Name: Default Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: X-Project-Id: b0c3e7888e1b4c449e834dc338af563a Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: X-Project-Name: admin Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: X-Role: admin,member,reader Aug 18 11:16:44.594805 n-d-853611-3 devstack@n-api.service[106218]: X-Roles: admin,member,reader Aug 18 11:16:44.596445 n-d-853611-3 devstack@n-api.service[106218]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b0c3e7888e1b4c449e834dc338af563a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:16:44.596445 n-d-853611-3 devstack@n-api.service[106218]: X-Tenant: admin Aug 18 11:16:44.596445 n-d-853611-3 devstack@n-api.service[106218]: X-Tenant-Id: b0c3e7888e1b4c449e834dc338af563a Aug 18 11:16:44.596445 n-d-853611-3 devstack@n-api.service[106218]: X-Tenant-Name: admin Aug 18 11:16:44.596445 n-d-853611-3 devstack@n-api.service[106218]: X-User: admin Aug 18 11:16:44.596445 n-d-853611-3 devstack@n-api.service[106218]: X-User-Domain-Id: default Aug 18 11:16:44.596445 n-d-853611-3 devstack@n-api.service[106218]: X-User-Domain-Name: Default Aug 18 11:16:44.596445 n-d-853611-3 devstack@n-api.service[106218]: X-User-Id: f4378fc3a30444b0adb3a66de656bd46 Aug 18 11:16:44.596445 n-d-853611-3 devstack@n-api.service[106218]: X-User-Name: admin Aug 18 11:16:44.596445 n-d-853611-3 devstack@n-api.service[106218]: method: > Aug 18 11:16:44.596445 n-d-853611-3 devstack@n-api.service[106218]: exception: Flavor 451 could not be found. Aug 18 11:16:44.596445 n-d-853611-3 devstack@n-api.service[106218]: action_args: {'id': '451'} Aug 18 11:16:44.596445 n-d-853611-3 devstack@n-api.service[106218]: {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:16:44.596445 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:16:44.597324 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: ERROR nova.api.openstack.wsgi Aug 18 11:16:44.598589 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-f8dbbb4f-8c94-4127-80f7-7130e903422f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:16:44.599797 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-f8dbbb4f-8c94-4127-80f7-7130e903422f admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011696 Aug 18 11:16:44.599797 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 26/52] 10.222.0.73 () {60 vars in 1193 bytes} [Thu Aug 18 11:16:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:16:45.592087 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-15e8fe7a-4369-4340-896b-c95ed93ddadd admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:45.593110 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-15e8fe7a-4369-4340-896b-c95ed93ddadd admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 18 11:16:45.593530 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 27/53] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 18 11:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:46.127603 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-79109c3d-936d-4dd4-b7d2-3ba4847563de admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:16:46.146804 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-79109c3d-936d-4dd4-b7d2-3ba4847563de admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.414510 Aug 18 11:16:46.147364 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 27/54] 10.222.0.73 () {64 vars in 1235 bytes} [Thu Aug 18 11:16:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:16:47.141845 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-15e8fe7a-4369-4340-896b-c95ed93ddadd admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:47.143007 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-15e8fe7a-4369-4340-896b-c95ed93ddadd admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Aug 18 11:16:47.143411 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 28/55] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 18 11:16:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:47.668968 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-9c20bb97-cedc-4fa9-abc8-52af934051cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:16:47.689610 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-9c20bb97-cedc-4fa9-abc8-52af934051cb admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.409807 Aug 18 11:16:47.690172 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 28/56] 10.222.0.73 () {64 vars in 1235 bytes} [Thu Aug 18 11:16:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:16:48.653822 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-15e8fe7a-4369-4340-896b-c95ed93ddadd admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:48.654871 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-15e8fe7a-4369-4340-896b-c95ed93ddadd admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 18 11:16:48.655267 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 29/57] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 18 11:16:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:49.179663 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-61c93b18-cb30-4272-b129-65d19fc50533 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:16:49.198716 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-61c93b18-cb30-4272-b129-65d19fc50533 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.405953 Aug 18 11:16:49.199262 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 29/58] 10.222.0.73 () {64 vars in 1235 bytes} [Thu Aug 18 11:16:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 11:16:50.168014 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-15e8fe7a-4369-4340-896b-c95ed93ddadd admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:50.169035 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-15e8fe7a-4369-4340-896b-c95ed93ddadd admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 18 11:16:50.169440 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 30/59] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 18 11:16:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:50.708649 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-cd687b09-1c74-4134-878a-6535d24fbf80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:16:50.727361 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-cd687b09-1c74-4134-878a-6535d24fbf80 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.414001 Aug 18 11:16:50.727926 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 30/60] 10.222.0.73 () {64 vars in 1235 bytes} [Thu Aug 18 11:16:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:16:51.700089 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-15e8fe7a-4369-4340-896b-c95ed93ddadd admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:51.701381 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-15e8fe7a-4369-4340-896b-c95ed93ddadd admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002346 Aug 18 11:16:51.701800 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 31/61] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 18 11:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:16:52.240885 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-bccba9fe-9626-40fb-a2b4-2d908bf1e178 admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:16:52.261658 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-bccba9fe-9626-40fb-a2b4-2d908bf1e178 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.422599 Aug 18 11:16:52.262198 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 31/62] 10.222.0.73 () {60 vars in 1202 bytes} [Thu Aug 18 11:16:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:17:46.215001 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-15e8fe7a-4369-4340-896b-c95ed93ddadd admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:46.216029 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-15e8fe7a-4369-4340-896b-c95ed93ddadd admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 18 11:17:46.216435 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 32/63] 10.222.0.73 () {54 vars in 931 bytes} [Thu Aug 18 11:17:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:17:46.227485 n-d-853611-3 devstack@n-api.service[106218]: DEBUG dbcounter [-] [106218] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:17:46.622291 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-6b80b761-bf59-412b-8ac3-92e638f6562c admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:46.643708 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-6b80b761-bf59-412b-8ac3-92e638f6562c admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.420728 Aug 18 11:17:46.644275 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 32/64] 10.222.0.73 () {60 vars in 1292 bytes} [Thu Aug 18 11:17:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:17:46.665989 n-d-853611-3 devstack@n-api.service[106219]: DEBUG dbcounter [-] [106219] Writing DB stats nova_api:SELECT=14 {{(pid=106219) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:17:46.670017 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-a7cd1568-c014-4acd-a665-8b8cfae4fba1 admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:46.677941 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-a7cd1568-c014-4acd-a665-8b8cfae4fba1 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013349 Aug 18 11:17:46.678510 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 33/65] 10.222.0.73 () {60 vars in 1283 bytes} [Thu Aug 18 11:17:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:46.690910 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-dc02f96f-a605-4d95-b855-6fe775934dd7 admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:46.698793 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-dc02f96f-a605-4d95-b855-6fe775934dd7 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011437 Aug 18 11:17:46.699325 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 33/66] 10.222.0.73 () {60 vars in 1286 bytes} [Thu Aug 18 11:17:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:46.711713 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-1f797319-07d4-4915-b94b-9f3529fa82c6 admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:46.719634 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-1f797319-07d4-4915-b94b-9f3529fa82c6 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011569 Aug 18 11:17:46.720165 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 34/67] 10.222.0.73 () {60 vars in 1286 bytes} [Thu Aug 18 11:17:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:17:46.731685 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-75d8e841-41fc-4292-97f1-ce97ff2708a8 admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:17:46.739204 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-75d8e841-41fc-4292-97f1-ce97ff2708a8 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011137 Aug 18 11:17:46.739723 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 34/68] 10.222.0.73 () {60 vars in 1283 bytes} [Thu Aug 18 11:17:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:23:21.345118 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-1f797319-07d4-4915-b94b-9f3529fa82c6 admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:23:21.346315 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-1f797319-07d4-4915-b94b-9f3529fa82c6 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Aug 18 11:23:21.346806 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 35/69] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 18 11:23:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:23:21.488967 n-d-853611-3 devstack@n-api.service[106218]: DEBUG dbcounter [-] [106218] Writing DB stats nova_api:SELECT=6 {{(pid=106218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:23:21.637052 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-7fd5c324-72b9-4884-ab60-8179f104cf46 admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:23:21.639415 n-d-853611-3 devstack@n-api.service[106218]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:23:21.639415 n-d-853611-3 devstack@n-api.service[106218]: warnings.warn(msg) Aug 18 11:23:21.640568 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-7fd5c324-72b9-4884-ab60-8179f104cf46 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:23:21.641080 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-7fd5c324-72b9-4884-ab60-8179f104cf46 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:23:21.641517 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-7fd5c324-72b9-4884-ab60-8179f104cf46 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:23:21.642245 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-7fd5c324-72b9-4884-ab60-8179f104cf46 admin admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:23:21.642737 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-7fd5c324-72b9-4884-ab60-8179f104cf46 admin admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:23:21.643198 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-7fd5c324-72b9-4884-ab60-8179f104cf46 admin admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:23:21.686971 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-7fd5c324-72b9-4884-ab60-8179f104cf46 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.199509 Aug 18 11:23:21.687558 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 35/70] 10.222.0.73 () {60 vars in 1193 bytes} [Thu Aug 18 11:23:21 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:23:22.524572 n-d-853611-3 devstack@n-api.service[106219]: DEBUG nova.api.openstack.wsgi [None req-1f797319-07d4-4915-b94b-9f3529fa82c6 admin admin] Calling method '>' {{(pid=106219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:23:22.525613 n-d-853611-3 devstack@n-api.service[106219]: INFO nova.api.openstack.requestlog [None req-1f797319-07d4-4915-b94b-9f3529fa82c6 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 18 11:23:22.526059 n-d-853611-3 devstack@n-api.service[106219]: [pid: 106219|app: 0|req: 36/71] 10.222.0.73 () {56 vars in 1074 bytes} [Thu Aug 18 11:23:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:23:22.730638 n-d-853611-3 devstack@n-api.service[106218]: DEBUG nova.api.openstack.wsgi [None req-a09130a6-4da7-47f4-a5c3-6ae9ef25f65a admin admin] Calling method '>' {{(pid=106218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:23:22.732956 n-d-853611-3 devstack@n-api.service[106218]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:23:22.732956 n-d-853611-3 devstack@n-api.service[106218]: warnings.warn(msg) Aug 18 11:23:22.734092 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-a09130a6-4da7-47f4-a5c3-6ae9ef25f65a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:23:22.734608 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-a09130a6-4da7-47f4-a5c3-6ae9ef25f65a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:23:22.735046 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-a09130a6-4da7-47f4-a5c3-6ae9ef25f65a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:23:22.735766 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-a09130a6-4da7-47f4-a5c3-6ae9ef25f65a admin admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:23:22.736216 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-a09130a6-4da7-47f4-a5c3-6ae9ef25f65a admin admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:23:22.736635 n-d-853611-3 devstack@n-api.service[106218]: DEBUG oslo_concurrency.lockutils [None req-a09130a6-4da7-47f4-a5c3-6ae9ef25f65a admin admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:23:22.759789 n-d-853611-3 devstack@n-api.service[106218]: INFO nova.api.openstack.requestlog [None req-a09130a6-4da7-47f4-a5c3-6ae9ef25f65a admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.091580 Aug 18 11:23:22.760352 n-d-853611-3 devstack@n-api.service[106218]: [pid: 106218|app: 0|req: 36/72] 10.222.0.73 () {60 vars in 1193 bytes} [Thu Aug 18 11:23:22 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:24:08.611119 n-d-853611-3 devstack@n-api.service[106217]: Thu Aug 18 11:24:08 2022 - graceful shutdown triggered... Aug 18 11:24:08.611660 n-d-853611-3 devstack@n-api.service[106218]: Gracefully killing worker 1 (pid: 106218)... Aug 18 11:24:08.611355 n-d-853611-3 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 18 11:24:08.612729 n-d-853611-3 devstack@n-api.service[106219]: Gracefully killing worker 2 (pid: 106219)... Aug 18 11:24:09.612260 n-d-853611-3 devstack@n-api.service[106217]: worker 1 buried after 1 seconds Aug 18 11:24:09.612260 n-d-853611-3 devstack@n-api.service[106217]: worker 2 buried after 1 seconds Aug 18 11:24:09.612260 n-d-853611-3 devstack@n-api.service[106217]: goodbye to uWSGI. Aug 18 11:24:09.613856 n-d-853611-3 systemd[1]: devstack@n-api.service: Succeeded. Aug 18 11:24:09.614457 n-d-853611-3 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 18 11:24:09.617213 n-d-853611-3 systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 11:24:09.632992 n-d-853611-3 devstack@n-api.service[122201]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 11:24:09.646219 n-d-853611-3 devstack@n-api.service[122201]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 11:24:09 2022] *** Aug 18 11:24:09.646219 n-d-853611-3 devstack@n-api.service[122201]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 11:24:09.646219 n-d-853611-3 devstack@n-api.service[122201]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 11:24:09.646219 n-d-853611-3 devstack@n-api.service[122201]: nodename: n-d-853611-3 Aug 18 11:24:09.646219 n-d-853611-3 devstack@n-api.service[122201]: machine: x86_64 Aug 18 11:24:09.646219 n-d-853611-3 devstack@n-api.service[122201]: clock source: unix Aug 18 11:24:09.646219 n-d-853611-3 devstack@n-api.service[122201]: pcre jit disabled Aug 18 11:24:09.646219 n-d-853611-3 devstack@n-api.service[122201]: detected number of CPU cores: 4 Aug 18 11:24:09.646219 n-d-853611-3 devstack@n-api.service[122201]: current working directory: / Aug 18 11:24:09.646219 n-d-853611-3 devstack@n-api.service[122201]: detected binary path: /usr/bin/uwsgi-core Aug 18 11:24:09.646219 n-d-853611-3 devstack@n-api.service[122201]: your processes number limit is 47680 Aug 18 11:24:09.646219 n-d-853611-3 devstack@n-api.service[122201]: your memory page size is 4096 bytes Aug 18 11:24:09.646219 n-d-853611-3 devstack@n-api.service[122201]: detected max file descriptor number: 2048 Aug 18 11:24:09.646219 n-d-853611-3 devstack@n-api.service[122201]: lock engine: pthread robust mutexes Aug 18 11:24:09.647360 n-d-853611-3 devstack@n-api.service[122201]: thunder lock: enabled Aug 18 11:24:09.647360 n-d-853611-3 devstack@n-api.service[122201]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 11:24:09.647360 n-d-853611-3 devstack@n-api.service[122201]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 11:24:09.690776 n-d-853611-3 devstack@n-api.service[122201]: Python main interpreter initialized at 0x556e6bef49c0 Aug 18 11:24:09.690776 n-d-853611-3 devstack@n-api.service[122201]: python threads support enabled Aug 18 11:24:09.690776 n-d-853611-3 devstack@n-api.service[122201]: your server socket listen backlog is limited to 100 connections Aug 18 11:24:09.690776 n-d-853611-3 devstack@n-api.service[122201]: your mercy for graceful operations on workers is 90 seconds Aug 18 11:24:09.691253 n-d-853611-3 devstack@n-api.service[122201]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 11:24:09.691253 n-d-853611-3 devstack@n-api.service[122201]: *** Operational MODE: preforking *** Aug 18 11:24:09.691505 n-d-853611-3 devstack@n-api.service[122201]: *** uWSGI is running in multiple interpreter mode *** Aug 18 11:24:09.691505 n-d-853611-3 devstack@n-api.service[122201]: spawned uWSGI master process (pid: 122201) Aug 18 11:24:09.691710 n-d-853611-3 systemd[1]: Started Devstack devstack@n-api.service. Aug 18 11:24:09.692831 n-d-853611-3 devstack@n-api.service[122201]: spawned uWSGI worker 1 (pid: 122209, cores: 1) Aug 18 11:24:09.693367 n-d-853611-3 devstack@n-api.service[122201]: spawned uWSGI worker 2 (pid: 122210, cores: 1) Aug 18 11:24:09.693675 n-d-853611-3 devstack@n-api.service[122201]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 11:24:10.379167 n-d-853611-3 devstack@n-api.service[122210]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 11:24:10.404054 n-d-853611-3 devstack@n-api.service[122209]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 11:24:11.562122 n-d-853611-3 devstack@n-api.service[122210]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:24:11.562122 n-d-853611-3 devstack@n-api.service[122210]: from cryptography.utils import int_from_bytes Aug 18 11:24:11.562790 n-d-853611-3 devstack@n-api.service[122210]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:24:11.562790 n-d-853611-3 devstack@n-api.service[122210]: from cryptography.utils import int_from_bytes Aug 18 11:24:11.617725 n-d-853611-3 devstack@n-api.service[122209]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:24:11.617725 n-d-853611-3 devstack@n-api.service[122209]: from cryptography.utils import int_from_bytes Aug 18 11:24:11.618377 n-d-853611-3 devstack@n-api.service[122209]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 11:24:11.618377 n-d-853611-3 devstack@n-api.service[122209]: from cryptography.utils import int_from_bytes Aug 18 11:24:14.022782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 11:24:14.023396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 11:24:14.023551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 11:24:14.023913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 11:24:14.024169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 11:24:14.024560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.024887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.025200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.025525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.025854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.026166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.026520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.026846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.027173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.027434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.027752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.028072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-853611-3 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.028396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.028703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.029011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.029646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.029968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.030292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.030628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.031129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.032416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.032416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.032416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.035055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.035055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.035055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.035055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.035055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.035055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.035055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.035055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-853611-3 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.036404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.036404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.036404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.036715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.037040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.037452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.037658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.037983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.038288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.038662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.038982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.039301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.039624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.039924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.040235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.040550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.040863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.041166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.041468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.041716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.042021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.042349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.042694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.043018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.043270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.043520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.043838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.044158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.044467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.044778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.045091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.045397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.045706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.046087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.046412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.046734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.047064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.047373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.047687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.048001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.048325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.048721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.048973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.049283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.049623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.049941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.050250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.050591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.050913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.051386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.051921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.052286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.052612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.052951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.053257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.053509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.053817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.054127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.054489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.054778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.055090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.055394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.055695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.056002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.056310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.056615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.056922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.057243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.057527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.057833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.058142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.058462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.058788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.059105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.059412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.059718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.060020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.060326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.060645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.060949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.061253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.061571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.061879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.062187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.062531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.062844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.063150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.063464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.063765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.064075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.064385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.064691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.064997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.065307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.065629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.065918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.066188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.066563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.066868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.067188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.067475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.067794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.068108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.068419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.068719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.069035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.069377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.069708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.070054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.070369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.070729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.071063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.071381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.071697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.072016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.072347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.072658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.072971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.073281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.073597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.073916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.074247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.074592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.074911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.075232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.075543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.075860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.076190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.076521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.076824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.077167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.077510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.077826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.078148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.078496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.078811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.079120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.079431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.079753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.080085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.080396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.080715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.081027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.081337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.081646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.081958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.082871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.083240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.083561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.083882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.084197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.084517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.084831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.085144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.085457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.085764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.086071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.086389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.086727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.087035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.087357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.087685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.087998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.088332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.088645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.088956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.089269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.089579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.089888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.090204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.090541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.090852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.091177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.091488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.091795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.092119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.092431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.092737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.093053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.093364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.093674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.093985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.094298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.094654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.094967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.095279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.095613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.095944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.096247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.096569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.096895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.097211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.097529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.097847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.098766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.099031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.099335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.099646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.099962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.100253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.100557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.100859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.101162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.101541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.101887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.102201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.102531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.102836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.103179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.103485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.103829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.104206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.104516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.104811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.105121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.105441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.105752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.106064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.106376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.106788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.107108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.107420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.107740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.108051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.108374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.108687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.109086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.109297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.109613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.109950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.110282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.110623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.111010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.111323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.111901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.112236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.112534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.112845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.113156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.113505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.114010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.114336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.114677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.115002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.115315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.115638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.115944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.116261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.116589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.116922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.117234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.117548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.117871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.118182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.118515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.118830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.119235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.119425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.119739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.120051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.120361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.120671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.120977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.121291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.121599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.121902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.122210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.122542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.122865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.123176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.123495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.123813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.124119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.124424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.124757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.125058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.125362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.125665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.125968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.126310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.126650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.126955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.127276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.127601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.127913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.128238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.128543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.128855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.129260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.129653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.129923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.130214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.130549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.130865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.131178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.131501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.131811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.132129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.132440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.132744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.133054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.133373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.133951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.134284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.134629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.134950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.135271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.135591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.135921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.136074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 11:24:14.136571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 11:24:14.136718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.136718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.137024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 11:24:14.137187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.137343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 11:24:14.137500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.137646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 11:24:14.137801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.137983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.138139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.138286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.138506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.138661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.138814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.138970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.139118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.139501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.139664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.139819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.139966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.140119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.140273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.140434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.140640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.140794 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.140975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.141134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.141292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.141454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.141637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.141797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-853611-3 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.141951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.142098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.142251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.142413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.142603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.142761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.142914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.143098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.143263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.143430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.143576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.143756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.143918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.144066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.144231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.144231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.144535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.145348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.145508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.145663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.145967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.146124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.146271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.146451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.146608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.146767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.146912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.147066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.147219 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.147374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.147521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.147677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.147831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.147988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.148173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.148333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.148488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.148685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.148834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-853611-3 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.149022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.149170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.149315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.149633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.149787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.149933 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.150097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.150244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.150405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.150603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.150759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.150906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.151060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.151243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.151410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.151565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.151749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.151910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.152065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.152221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.152416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.152565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.152739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.152900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.153049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.153049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.153377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.153377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.153678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.153871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.154034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.154199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.154367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.154544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.154692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.154910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.155073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.155234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.155382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.155563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.155746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.155938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.156095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.156252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.156398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.156554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.156707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.156854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.157014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.157168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.157324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.157478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.157626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.157770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.157926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.158080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.158248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.158401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.158585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.158742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.158890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.159035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.159180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.159325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.159470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.159783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.159938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.160085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.160231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.161458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.161632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.161800 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.161959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.162114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.162271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.162462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.162619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.162816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.162969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.163187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.163356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.163503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.163674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.163829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.163984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.164139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.164305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.164462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.164691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.164691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.164992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.165154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.165307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.165307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.165633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.165633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.165941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.166101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.166262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.166445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.166624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.166624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.166924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.167077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.167235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.167398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.167559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.167723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.167906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.168073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.168234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.168399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.168553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.168706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.176671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.176932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.177097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.177274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.177438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.177601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.177781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.177947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.178100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.178266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.178419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.178603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.178767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.178928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.179082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.179248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.179400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.179560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.179724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.179888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.180058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.180211 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.180363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.180596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.180796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.180974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.181150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.182232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.183221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.183221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.183600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.183772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.183954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.184119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.184282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.184436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.184589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.184742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.184904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.185070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.185232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.185436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.185605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.185758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.185921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.186074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.186226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.186393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.186750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.186914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.187079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.187281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.187556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.187835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.188109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.188109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.188626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.188910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.189121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.189288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.189446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.189606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.189768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.189922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.190089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.190253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.190407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.190588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.190753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.190907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.191086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.191248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.191410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.191625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.191890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.191890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.192417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.192674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.192934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.193208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.193577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.193874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.194152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.194328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.194505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.194505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.194805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.194971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.195126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.195126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.195432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.195432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.195720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.195888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.196042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.196221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.196376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.196528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 11:24:14.196797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.196964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.197118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.197279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.197442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.197603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.197766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.197928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.198090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.198250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.198446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.198446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.198813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.198977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.199129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.199289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.200336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.201260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.201445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.202197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.202383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.202383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.202780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.202953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.203111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.203272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.203451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.203606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.203758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.203927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.204096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.204251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.204403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.204555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.204715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.204936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.205205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.205473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.205733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.206008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.206299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.206624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.206925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.207150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.207869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.208582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.208767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.208934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.209099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.209253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.209408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.209560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.209730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.209885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.210045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.210208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.210370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.210609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.210860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.211130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.211419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.211693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.211951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.212234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.212509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.212786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.213066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.213398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.213661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.213944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.214162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.214322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.214504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.214686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.214842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.215009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.215165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.215326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.215487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.215487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.215797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.215951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.216104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.216256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.216409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.216569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.216750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.216904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.217056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.217215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.217383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.217551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.217719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.217882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.218037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.218190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.218356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.218554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.218726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.218726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.219039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.219192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.219192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.219491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.219725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.219889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.220052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.220205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.220357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.220524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.220679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.220840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.221015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.221169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.221322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.221484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.221645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.221806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.221961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.222121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.222275 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.222457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.222629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.222795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.224286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.224455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.232436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.232685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.232898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.233102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.233281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.233281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.233613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.233771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.233925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.234078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.234231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.234406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.234610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.234774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.234774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.235073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.235224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.235384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.235549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.235703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.235854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.236003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.236160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.236312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.236487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.236910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.237067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.237218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.237378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.237538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.237690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.237847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.238006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.238157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.238307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.238549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.238736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.238892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.238892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.239179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.239330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.239497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.239649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.239801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.239801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.240214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.240384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.240550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.240550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.240850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.241001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.241152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.241317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.241478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.241630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.241781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.241978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.242139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.242307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.242522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.242717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.242882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.242882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.243183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.243183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.243609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.243831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.244048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.244250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.244485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.244682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.244845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.244996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.245148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.245307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.245484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.245644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.245796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.245946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.246105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.246256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.246415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.246611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.246773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.246935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.247107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.247107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.247487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.247653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.247813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.247965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.248123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.248284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.248445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.248597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.248749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.248899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.249056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.249216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.249383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.249545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.249696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.249869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.250085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.250085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.250492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.250492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.250880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.251104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.251265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.251265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.251579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.251579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.251877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.252029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.252194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.252355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.252523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.252680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.252831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.252981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.252981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.253289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.253449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.253610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.253780 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.253939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.254130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.254326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.254643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.254896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.255061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.255230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.255392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.255552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.255712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.255872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.255872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.256193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.256352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.256563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.256782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.256976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.257186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.257421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.257626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.257782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.257932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.258092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.258244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.258415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.258608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.258773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.258927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.259080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.259246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.259408 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.259560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.259723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.259883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.260043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.260205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.260374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.260534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.260687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.260687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.260993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.261160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.261312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.261470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.261623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.261781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.261945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.262097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.262248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.262408 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.262625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.262778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.262942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.263102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.263260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.263420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.263571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.263721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.263881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.264034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.264193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.264345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.264505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.264664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.264831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.264984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.265135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.265293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.265445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.265605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.265765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.265924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.266076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.266234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.266392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.266594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.266594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.266594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.267018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.267180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.267332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.267498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.267498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.267793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.267944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.268095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.268245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.268414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.268575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.268734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.268884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.269041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.269207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.269358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.269509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.269658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.270321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.270558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.270757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.270956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.271122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.271275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.271436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.271587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.271799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.271932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.272067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.272166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.272263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.272351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.272452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.272556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.272658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.272762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.272853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.272953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.273050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.273050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.273233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.273326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.273413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.273527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.273618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.273720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.273825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.273920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.274014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.274109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.274208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.274326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.274416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.274535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.274620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.274762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.274868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.274963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.274963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.274963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.275198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.275290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.275379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.275490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.275490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.275666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.275761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.275847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.275933 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.276018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.276116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.276203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.276300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.276300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.276475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.276568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.276655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.276740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.276831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.276917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.277010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.277104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.277190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.277292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.277383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.277476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.277570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.277657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.277787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.277888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.278006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.278125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.278214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.278298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.278390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.278788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.278901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.279054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.279054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.279054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.279280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.279353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.279353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.279353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.279614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.279702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.279794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.279906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.280003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.280099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.280185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.280283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.280382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.280477 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.280592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.280686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.280779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.280872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.280965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.281060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.281190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.281292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.281386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.281480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.281480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.281635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.281768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.281868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.281950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.282023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.282110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.282204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.282290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.282382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.282486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.282572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.282670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.282670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.282670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.282897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.282979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.282979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.284265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.284369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.284482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.284576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.284669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.284774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.284862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.284959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.285092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.285200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.285289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.285416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.286035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.286119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.286200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.286296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.286296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.286656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.286768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.286865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.286968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.287066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.287168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.287261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.287359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.287470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.287580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.287688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.287778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.287874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.287969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.288057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.288142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.288227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.288312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.288423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.288514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.288614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.288709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.288812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.288905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.289016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.289134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.289227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.289321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.289321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.289484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.289599 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.289689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.289774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.289865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.289959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.290111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.290213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.290296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.290383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.290484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.290572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.290675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.290771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.290866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.290971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.291066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.291160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.291266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.291361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.291472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.291569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.291662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.291755 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.291872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.291971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.292061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.292143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.292240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.292336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.292427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.292521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.292624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.292736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.292828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.292928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.293023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.293117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.293117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.293281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.293367 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.293465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.293551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.293634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.293634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.294223 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.294304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.294454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.294558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.294661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.294773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.294873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.295056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.295152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.295247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.295335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.295448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.295551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.295651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.295738 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.295838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.295934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.296036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.296155 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.296255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.296351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.296446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.296558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.296666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.296766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.296862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.296956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.297049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.297136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.297228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.297341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.297341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.297508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.297595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.297697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.297786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.297881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.297970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.298052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.298139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.298233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.298335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.298745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.298866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.298956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.299079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.299187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.299277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.299373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.299475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.299577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.299665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.299762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.299931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.300020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.300105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.300192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.300285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.300372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.300466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.300552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.300636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.300736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.300834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.300975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.301084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.301172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.301254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.301348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.301555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.301785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.301892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.301985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.302068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.302162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.302257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.302356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.302497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.302592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.302669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.302741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.302812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.302892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.302966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.303038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.303124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.303233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.303327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.303423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.324815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.325701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.325932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.326286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.327230 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.327546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.327812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.328037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.328193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.328995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.329384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.329707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.330215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.330529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.331436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.331719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.332057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.333040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.333697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.334207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.334755 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.334866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.334992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.335757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.336216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.336216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.336548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.336881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.337032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.337246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.337357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.337482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.337595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.337703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.337798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.337873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.338001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.338098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.338215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.338344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.338474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 11:24:14.338549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.338549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.338549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.338549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.338549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.338549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.338549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.338549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.339862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.340902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.341923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.342894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.343691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.344622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.345110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.345110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.345110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.345110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.345110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.345110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.345110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.345510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.345510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.345510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.345510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.345510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.345510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.345510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.346638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.347480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.348043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.348043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.348043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.348043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.348043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.348043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.348043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.348043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.348455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.348455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.348611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.348917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.349225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.349538 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.349846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.350152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.350483 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.350791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.351119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.351423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.351727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.352035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.352347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.352650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.352953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.353259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.353560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.353872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.354173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.354505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.354813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.355122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.355423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.355731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.356030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.356356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.356661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.357010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.357336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.357644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.357963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.358277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.358635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.358986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.359301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.359889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.360220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.360538 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.360876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.361202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.361508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.362069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.362371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.362723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.363033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.363343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.363685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.364002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.364310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.364617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.364989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.365299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.365611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.366010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.366232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.366563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.366879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.367186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.367502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.367852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.368173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.368490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.368807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.369122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.369431 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.369739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.370045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.370351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.370695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.371023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.371335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.371640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.372073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.372386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.372703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.373024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.373333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.373652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.373973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.374284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.374631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.374943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.375269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.375823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.375948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.376252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.376564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.376867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.377170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.377478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.377795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.378103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.378406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.378734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.379617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.380060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.380178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.380481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.380784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.381094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.381395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.381695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.381996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.382295 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.382620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.382918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.383228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.383528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.383828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.384127 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.384430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.384729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.385068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.385402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.385716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.386045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.386356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.386702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.386996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.387313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.387632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.387950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.388284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.388618 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.388928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.389237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.389544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.389855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.390164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.390496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.390828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.391154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.391458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.391780 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.392097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.392415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.392727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.393037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.393362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.393672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.393981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.394288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.394621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.395010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.395327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.395652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.395960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.396276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.396590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.396915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.397746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.398056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.398378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.398727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.399075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.399405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.399752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.400106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.400451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.400765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.401068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 11:24:14.401311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 11:24:14.454909 n-d-853611-3 devstack@n-api.service[122210]: INFO dbcounter [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] Registered counter for database nova_api Aug 18 11:24:14.477320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_db.sqlalchemy.engines [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:24:14.485448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writer thread running {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:24:14.547500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.context [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68989ef7-340f-4449-87c1-932f111c2bdb(cell1) {{(pid=122210) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 11:24:14.551779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:14.552452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:14.552556 n-d-853611-3 devstack@n-api.service[122209]: INFO dbcounter [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] Registered counter for database nova_api Aug 18 11:24:14.555701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:14.557013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:14.557823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:14.561673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:14.564942 n-d-853611-3 devstack@n-api.service[122210]: INFO dbcounter [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] Registered counter for database nova_cell0 Aug 18 11:24:14.570330 n-d-853611-3 devstack@n-api.service[122210]: INFO dbcounter [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] Registered counter for database nova_cell1 Aug 18 11:24:14.573818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_db.sqlalchemy.engines [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:24:14.578842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_db.sqlalchemy.engines [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:24:14.582273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writer thread running {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:24:14.583975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_db.sqlalchemy.engines [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:24:14.585799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writer thread running {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:24:14.650529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.context [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68989ef7-340f-4449-87c1-932f111c2bdb(cell1) {{(pid=122209) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 11:24:14.655017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:14.655623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:14.657315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:14.658173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:14.658765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:14.661501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:14.663755 n-d-853611-3 devstack@n-api.service[122209]: INFO dbcounter [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] Registered counter for database nova_cell0 Aug 18 11:24:14.668188 n-d-853611-3 devstack@n-api.service[122209]: INFO dbcounter [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] Registered counter for database nova_cell1 Aug 18 11:24:14.675753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_db.sqlalchemy.engines [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:24:14.679279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_db.sqlalchemy.engines [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:24:14.693055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writer thread running {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:24:14.694514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writer thread running {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:24:14.738940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writer thread running {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:24:14.750722 n-d-853611-3 devstack@n-api.service[122210]: INFO dbcounter [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] Registered counter for database nova_cell0 Aug 18 11:24:14.759375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_db.sqlalchemy.engines [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:24:14.764033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writer thread running {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:24:14.843993 n-d-853611-3 devstack@n-api.service[122209]: INFO dbcounter [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] Registered counter for database nova_cell0 Aug 18 11:24:14.853328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_db.sqlalchemy.engines [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 11:24:14.860617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writer thread running {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 11:24:15.139516 n-d-853611-3 devstack@n-api.service[122210]: WARNING keystonemiddleware.auth_token [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 11:24:15.147087 n-d-853611-3 devstack@n-api.service[122210]: WARNING keystonemiddleware.auth_token [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 11:24:15.185929 n-d-853611-3 devstack@n-api.service[122209]: WARNING keystonemiddleware.auth_token [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 11:24:15.193251 n-d-853611-3 devstack@n-api.service[122209]: WARNING keystonemiddleware.auth_token [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 11:24:15.525276 n-d-853611-3 devstack@n-api.service[122210]: WARNING keystonemiddleware.auth_token [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 11:24:15.531811 n-d-853611-3 devstack@n-api.service[122210]: WARNING keystonemiddleware.auth_token [None req-4f6c7e40-d8da-42b0-abf3-d34b98e3e792 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 11:24:15.538169 n-d-853611-3 devstack@n-api.service[122209]: WARNING keystonemiddleware.auth_token [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 11:24:15.539029 n-d-853611-3 devstack@n-api.service[122210]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556e6bef49c0 pid: 122210 (default app) Aug 18 11:24:15.544180 n-d-853611-3 devstack@n-api.service[122209]: WARNING keystonemiddleware.auth_token [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 11:24:15.550306 n-d-853611-3 devstack@n-api.service[122209]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556e6bef49c0 pid: 122209 (default app) Aug 18 11:24:54.766256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:54.768374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:54.769179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:54.770173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:55.335413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:24:55.337279 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c2695498-655f-4125-a3da-048a42b9fc24 None None] 10.222.0.73 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002755 Aug 18 11:24:55.344569 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1/1] 10.222.0.73 () {56 vars in 886 bytes} [Thu Aug 18 11:24:55 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 18 11:24:56.264974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:56.266124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:56.267420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:56.268445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:24:56.348935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4839958e-ed4c-400e-960a-7e9713d99135 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:24:56.361752 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:56.361752 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:24:56.363702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4839958e-ed4c-400e-960a-7e9713d99135 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:56.364767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4839958e-ed4c-400e-960a-7e9713d99135 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:56.365580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4839958e-ed4c-400e-960a-7e9713d99135 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:56.366577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4839958e-ed4c-400e-960a-7e9713d99135 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:56.367238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4839958e-ed4c-400e-960a-7e9713d99135 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:56.367846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4839958e-ed4c-400e-960a-7e9713d99135 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:56.449095 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4839958e-ed4c-400e-960a-7e9713d99135 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.690565 Aug 18 11:24:56.450364 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1/2] 10.222.0.73 () {58 vars in 1176 bytes} [Thu Aug 18 11:24:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:24:56.466373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ffb83ce0-e605-4c7e-b46b-c6ed29514029 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1656639107"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:24:56.508944 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:56.508944 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:24:56.510248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.aggregate [None req-ffb83ce0-e605-4c7e-b46b-c6ed29514029 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Generated uuid adb8a3cc-4469-4efb-b596-eb0765fdf69f for aggregate {{(pid=122210) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:24:56.631081 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ffb83ce0-e605-4c7e-b46b-c6ed29514029 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.169314 Aug 18 11:24:56.632685 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2/3] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:24:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:24:56.649708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-72e6017d-f64f-4284-84b4-a336d44bedef tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853611-3"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:24:56.653751 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:56.653751 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:24:56.675565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72e6017d-f64f-4284-84b4-a336d44bedef tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:56.676492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72e6017d-f64f-4284-84b4-a336d44bedef tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:56.677126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72e6017d-f64f-4284-84b4-a336d44bedef tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:57.520545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8f519c5e-b1aa-47cb-9497-8485286f71f4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '.version_select at 0x7f51ae566280>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:24:57.522663 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:57.522663 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:24:57.529738 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8f519c5e-b1aa-47cb-9497-8485286f71f4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68989ef7-340f-4449-87c1-932f111c2bdb(cell1) {{(pid=122209) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 18 11:24:57.530728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f519c5e-b1aa-47cb-9497-8485286f71f4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:57.531383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f519c5e-b1aa-47cb-9497-8485286f71f4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:57.531967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f519c5e-b1aa-47cb-9497-8485286f71f4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:57.562891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f519c5e-b1aa-47cb-9497-8485286f71f4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:57.565426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f519c5e-b1aa-47cb-9497-8485286f71f4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:57.566279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f519c5e-b1aa-47cb-9497-8485286f71f4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:57.607406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f519c5e-b1aa-47cb-9497-8485286f71f4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:57.607930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f519c5e-b1aa-47cb-9497-8485286f71f4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:57.608470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f519c5e-b1aa-47cb-9497-8485286f71f4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:57.618740 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8f519c5e-b1aa-47cb-9497-8485286f71f4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.370168 Aug 18 11:24:57.619567 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2/4] 10.222.0.73 () {58 vars in 1167 bytes} [Thu Aug 18 11:24:56 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:24:57.692052 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-72e6017d-f64f-4284-84b4-a336d44bedef tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 1.052064 Aug 18 11:24:57.693022 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3/5] 10.222.0.73 () {60 vars in 1191 bytes} [Thu Aug 18 11:24:56 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:24:57.721217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-864b07d7-c019-4937-bc5b-058ee24de018 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:24:57.724332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-864b07d7-c019-4937-bc5b-058ee24de018 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:57.724848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-864b07d7-c019-4937-bc5b-058ee24de018 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:57.725522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-864b07d7-c019-4937-bc5b-058ee24de018 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:57.726305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-864b07d7-c019-4937-bc5b-058ee24de018 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:57.726802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-864b07d7-c019-4937-bc5b-058ee24de018 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:57.731418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-864b07d7-c019-4937-bc5b-058ee24de018 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:57.870006 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-864b07d7-c019-4937-bc5b-058ee24de018 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] 10.222.0.73 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.248929 Aug 18 11:24:57.872485 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 3/6] 10.222.0.73 () {58 vars in 1164 bytes} [Thu Aug 18 11:24:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:24:58.095271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7931af1f-8f4a-40d4-9838-c713e334f780 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-233351781", "ram": 512, "vcpus": 1, "disk": 10, "id": 2123965828, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:24:58.105183 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:58.105183 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:24:58.176816 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7931af1f-8f4a-40d4-9838-c713e334f780 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.479981 Aug 18 11:24:58.178120 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4/7] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:24:57 2022] POST /compute/v2.1/flavors => generated 415 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:24:58.424453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-13a7b18d-eba4-421b-aa68-1fad4ff6796e tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1826568572", "id": 524045532, "os-flavor-access:is_public": "True"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:24:58.439256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5c175dbf-65d0-4fee-abc3-8bd47e6a4b91 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Calling method '.version_select at 0x7f51acb00ee0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:24:58.443170 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:58.443170 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:24:58.456997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5c175dbf-65d0-4fee-abc3-8bd47e6a4b91 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68989ef7-340f-4449-87c1-932f111c2bdb(cell1) {{(pid=122210) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 18 11:24:58.457754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c175dbf-65d0-4fee-abc3-8bd47e6a4b91 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:58.458243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c175dbf-65d0-4fee-abc3-8bd47e6a4b91 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:58.459417 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:58.459417 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:24:58.467814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c175dbf-65d0-4fee-abc3-8bd47e6a4b91 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:58.505042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c175dbf-65d0-4fee-abc3-8bd47e6a4b91 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:58.507287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c175dbf-65d0-4fee-abc3-8bd47e6a4b91 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:58.508726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c175dbf-65d0-4fee-abc3-8bd47e6a4b91 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:58.540052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c175dbf-65d0-4fee-abc3-8bd47e6a4b91 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:58.540589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c175dbf-65d0-4fee-abc3-8bd47e6a4b91 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:58.541038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c175dbf-65d0-4fee-abc3-8bd47e6a4b91 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:58.551631 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-13a7b18d-eba4-421b-aa68-1fad4ff6796e tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.676079 Aug 18 11:24:58.554151 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 4/8] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:24:57 2022] POST /compute/v2.1/flavors => generated 427 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:24:58.559029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8a7c1033-1a6d-4e3b-b5e7-59c9c730c552 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853611-3"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:24:58.564384 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:58.564384 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:24:58.565308 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5c175dbf-65d0-4fee-abc3-8bd47e6a4b91 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.385836 Aug 18 11:24:58.578168 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 5/9] 10.222.0.73 () {60 vars in 1208 bytes} [Thu Aug 18 11:24:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:24:58.578168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-46cd0a33-5820-455b-ba87-94b9a4e21c99 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:24:58.578168 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:58.578168 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:24:58.578168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46cd0a33-5820-455b-ba87-94b9a4e21c99 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:58.578829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46cd0a33-5820-455b-ba87-94b9a4e21c99 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:58.578829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46cd0a33-5820-455b-ba87-94b9a4e21c99 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:58.578829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46cd0a33-5820-455b-ba87-94b9a4e21c99 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:58.578829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46cd0a33-5820-455b-ba87-94b9a4e21c99 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:58.580048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46cd0a33-5820-455b-ba87-94b9a4e21c99 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:58.615621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8a7c1033-1a6d-4e3b-b5e7-59c9c730c552 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:58.616039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8a7c1033-1a6d-4e3b-b5e7-59c9c730c552 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:58.616473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8a7c1033-1a6d-4e3b-b5e7-59c9c730c552 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:58.660711 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-46cd0a33-5820-455b-ba87-94b9a4e21c99 tempest-AZAdminV2TestJSON-1442845198 tempest-AZAdminV2TestJSON-1442845198-project-admin] 10.222.0.73 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.091303 Aug 18 11:24:58.672060 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 6/10] 10.222.0.73 () {58 vars in 1185 bytes} [Thu Aug 18 11:24:58 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:24:58.710717 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-8a7c1033-1a6d-4e3b-b5e7-59c9c730c552 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-853611-3. Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8a7c1033-1a6d-4e3b-b5e7-59c9c730c552 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Request method failure captured: Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 39 Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGGtrlJLl8jLAJKWVbLvLTUlFP56HfI9u2wUXbz671QhGA93ZjVAKuYcxNVgAOiY0WezHKsjnePzMgz9_LaWIwcg_f3UEZCnh0eTkEEq_50NDcUVGmrgyofSOT249_7DvjOWEREYXhh2WG0mhQ8IIMC79Plw8Lr0fX_1q04c6Gha-0 Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:24:58.751969 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:24:58.753228 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:24:58.753228 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:24:58.753228 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:24:58.753228 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:24:58.753228 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:24:58.753228 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:24:58.753228 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:24:58.753228 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e142868b2e984bd583f7b45a2fb32e95 Aug 18 11:24:58.753228 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:24:58.753228 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:24:58.753228 n-d-853611-3 devstack@n-api.service[122209]: {"add_host": {"host": "n-h2-853611-3"}} Aug 18 11:24:58.753228 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:24:58.753228 n-d-853611-3 devstack@n-api.service[122209]: exception: Aggregate 1 already has host n-h2-853611-3. Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-853611-3'}}} Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result.read() Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 11:24:58.753910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-853611-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi session.flush() Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 11:24:58.754857 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 11:24:58.755860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 11:24:58.756708 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result.read() Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-853611-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 18, 11, 24, 58, 687910), 'updated_at': None, 'host': 'n-h2-853611-3', 'aggregate_id': 1}] Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:24:58.757530 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6607, in add_host_to_aggregate Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-853611-3. Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:24:58.758333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-853611-3. Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:24:58.762014 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:24:58.766951 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-853611-3. Aug 18 11:24:58.766951 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:24:58.766951 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8a7c1033-1a6d-4e3b-b5e7-59c9c730c552 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-853611-3. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:24:58.766951 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8a7c1033-1a6d-4e3b-b5e7-59c9c730c552 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.198610 Aug 18 11:24:58.766951 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 5/11] 10.222.0.73 () {60 vars in 1191 bytes} [Thu Aug 18 11:24:58 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 18 11:24:58.770860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b13d2b9f-6fa3-4dce-9963-03ac0facb33f tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:24:58.771714 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:58.771714 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:24:58.840575 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b13d2b9f-6fa3-4dce-9963-03ac0facb33f tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/524045532" status: 202 len: 0 microversion: 2.1 time: 0.079700 Aug 18 11:24:58.841516 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 6/12] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:24:58 2022] DELETE /compute/v2.1/flavors/524045532 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:24:58.848187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-460445e0-b30a-47a3-9ff4-2a30b551d278 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853611-3"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:24:58.851284 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:58.851284 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:24:58.864139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-460445e0-b30a-47a3-9ff4-2a30b551d278 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:24:58.864909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-460445e0-b30a-47a3-9ff4-2a30b551d278 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:24:58.866761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-460445e0-b30a-47a3-9ff4-2a30b551d278 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:24:59.153117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1fa62ee0-a50a-4ba8-8c72-2406e5af6227 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:24:59.200127 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-1fa62ee0-a50a-4ba8-8c72-2406e5af6227 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] HTTP exception thrown: Flavor 2123965828 has no extra specs with key hw:cpu_thread_policy. Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1fa62ee0-a50a-4ba8-8c72-2406e5af6227 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Request method failure captured: Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/flavors/2123965828/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGGL15inAy9xk3jNm7eINQEF0hJsiPZYfQnqCrLz7sUOnZX_xFKUzhZIAXKBWPY7VUKufgx7LECMyQGvq_2WdfLgPhgTWmcciKc5Ji85mr_ASv0yxcej0izBso6mfsw1R34UVg-w_J_MEatzG-zxAHBnoeaKwJyprrgH7OZiekSvis Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: dccb631a40b14b66aeb4472229f2777a Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:24:59.200526 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:24:59.201733 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:24:59.201733 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 Aug 18 11:24:59.201733 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: dccb631a40b14b66aeb4472229f2777a Aug 18 11:24:59.201733 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 Aug 18 11:24:59.201733 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project Aug 18 11:24:59.201733 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:24:59.201733 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:24:59.201733 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: defed375795f40719273c81851fa7168 Aug 18 11:24:59.201733 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project Aug 18 11:24:59.201733 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:24:59.201733 n-d-853611-3 devstack@n-api.service[122210]: exception: Flavor 2123965828 has no extra specs with key hw:cpu_thread_policy. Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'flavor_id': '2123965828', 'id': 'hw:cpu_thread_policy'} Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2123965828 has no extra specs with key hw:cpu_thread_policy. Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:24:59.202288 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:24:59.203328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:24:59.203328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:24:59.203328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:24:59.203328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:24:59.203328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:24:59.203328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2123965828 has no extra specs with key hw:cpu_thread_policy. Aug 18 11:24:59.203328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:24:59.203328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1fa62ee0-a50a-4ba8-8c72-2406e5af6227 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Returning 404 to user: Flavor 2123965828 has no extra specs with key hw:cpu_thread_policy. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:24:59.203328 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1fa62ee0-a50a-4ba8-8c72-2406e5af6227 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] 10.222.0.73 "GET /compute/v2.1/flavors/2123965828/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.528557 Aug 18 11:24:59.203328 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 7/13] 10.222.0.73 () {58 vars in 1266 bytes} [Thu Aug 18 11:24:58 2022] GET /compute/v2.1/flavors/2123965828/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 530 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:24:59.232486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e8de6d6-a768-4165-9129-fd1b09d1db8c tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:24:59.293161 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9e8de6d6-a768-4165-9129-fd1b09d1db8c tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.082500 Aug 18 11:24:59.294095 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 8/14] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:24:59 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:24:59.299828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-822051bb-3a9b-4656-aa46-5ce6521cad03 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:24:59.303339 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:59.303339 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:24:59.304531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-822051bb-3a9b-4656-aa46-5ce6521cad03 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'defed375795f40719273c81851fa7168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccb631a40b14b66aeb4472229f2777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-822051bb-3a9b-4656-aa46-5ce6521cad03 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Request method failure captured: Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/flavors/2123965828/os-extra_specs HTTP/1.1 Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 66 Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGGL15inAy9xk3jNm7eINQEF0hJsiPZYfQnqCrLz7sUOnZX_xFKUzhZIAXKBWPY7VUKufgx7LECMyQGvq_2WdfLgPhgTWmcciKc5Ji85mr_ASv0yxcej0izBso6mfsw1R34UVg-w_J_MEatzG-zxAHBnoeaKwJyprrgH7OZiekSvis Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: dccb631a40b14b66aeb4472229f2777a Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:24:59.307303 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:24:59.308344 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:24:59.308344 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 Aug 18 11:24:59.308344 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: dccb631a40b14b66aeb4472229f2777a Aug 18 11:24:59.308344 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 Aug 18 11:24:59.308344 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project Aug 18 11:24:59.308344 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:24:59.308344 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:24:59.308344 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: defed375795f40719273c81851fa7168 Aug 18 11:24:59.308344 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project Aug 18 11:24:59.308344 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:24:59.308344 n-d-853611-3 devstack@n-api.service[122210]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 18 11:24:59.308344 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'flavor_id': '2123965828', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:24:59.308936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 18 11:24:59.309800 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:24:59.312588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-822051bb-3a9b-4656-aa46-5ce6521cad03 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:24:59.314326 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-822051bb-3a9b-4656-aa46-5ce6521cad03 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] 10.222.0.73 "POST /compute/v2.1/flavors/2123965828/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.018167 Aug 18 11:24:59.319498 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 9/15] 10.222.0.73 () {60 vars in 1224 bytes} [Thu Aug 18 11:24:59 2022] POST /compute/v2.1/flavors/2123965828/os-extra_specs => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:24:59.324896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7be23f9c-eba9-4bba-9eaf-6e65e65c8695 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1724937058", "id": 46634565, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:24:59.328412 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:59.328412 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:24:59.353220 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7be23f9c-eba9-4bba-9eaf-6e65e65c8695 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.031844 Aug 18 11:24:59.354534 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 10/16] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:24:59 2022] POST /compute/v2.1/flavors => generated 411 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:24:59.359924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f4520568-3c89-4445-a908-ba9c6698d78f tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:24:59.419439 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f4520568-3c89-4445-a908-ba9c6698d78f tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors/2123965828/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.063227 Aug 18 11:24:59.423633 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 11/17] 10.222.0.73 () {60 vars in 1224 bytes} [Thu Aug 18 11:24:59 2022] POST /compute/v2.1/flavors/2123965828/os-extra_specs => generated 66 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:24:59.430086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f6f7b2f1-ce7e-43ab-b1a6-df1bb4a75a18 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:24:59.502860 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f6f7b2f1-ce7e-43ab-b1a6-df1bb4a75a18 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5797 microversion: 2.1 time: 0.075117 Aug 18 11:24:59.506986 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 12/18] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:24:59 2022] GET /compute/v2.1/flavors/detail => generated 5797 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:24:59.520328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8faa16f8-20a0-49af-b73f-1b3740b74ffe tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:24:59.537344 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:59.537344 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:24:59.539039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8faa16f8-20a0-49af-b73f-1b3740b74ffe tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'defed375795f40719273c81851fa7168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccb631a40b14b66aeb4472229f2777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8faa16f8-20a0-49af-b73f-1b3740b74ffe tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Request method failure captured: Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/flavors/2123965828/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGGL15inAy9xk3jNm7eINQEF0hJsiPZYfQnqCrLz7sUOnZX_xFKUzhZIAXKBWPY7VUKufgx7LECMyQGvq_2WdfLgPhgTWmcciKc5Ji85mr_ASv0yxcej0izBso6mfsw1R34UVg-w_J_MEatzG-zxAHBnoeaKwJyprrgH7OZiekSvis Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: dccb631a40b14b66aeb4472229f2777a Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:24:59.551621 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:24:59.552874 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:24:59.552874 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 Aug 18 11:24:59.552874 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: dccb631a40b14b66aeb4472229f2777a Aug 18 11:24:59.552874 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 Aug 18 11:24:59.552874 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project Aug 18 11:24:59.552874 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:24:59.552874 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:24:59.552874 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: defed375795f40719273c81851fa7168 Aug 18 11:24:59.552874 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project Aug 18 11:24:59.552874 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:24:59.552874 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'flavor_id': '2123965828', 'id': 'hw:numa_nodes'} Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:24:59.554115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 18 11:24:59.555426 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:24:59.558251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8faa16f8-20a0-49af-b73f-1b3740b74ffe tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:24:59.562008 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8faa16f8-20a0-49af-b73f-1b3740b74ffe tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] 10.222.0.73 "DELETE /compute/v2.1/flavors/2123965828/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.054979 Aug 18 11:24:59.566947 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 13/19] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:24:59 2022] DELETE /compute/v2.1/flavors/2123965828/os-extra_specs/hw:numa_nodes => generated 124 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:24:59.579520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fa60f098-4028-47bb-a767-770a85695ab5 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:24:59.592248 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:59.592248 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:24:59.676996 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fa60f098-4028-47bb-a767-770a85695ab5 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/46634565" status: 202 len: 0 microversion: 2.1 time: 0.108799 Aug 18 11:24:59.684572 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 14/20] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:24:59 2022] DELETE /compute/v2.1/flavors/46634565 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:24:59.697502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d247c1ae-218d-4c86-be87-a9cee35f6a7c tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:24:59.789395 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d247c1ae-218d-4c86-be87-a9cee35f6a7c tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors/2123965828/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.103607 Aug 18 11:24:59.794401 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 15/21] 10.222.0.73 () {60 vars in 1224 bytes} [Thu Aug 18 11:24:59 2022] POST /compute/v2.1/flavors/2123965828/os-extra_specs => generated 66 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:24:59.807670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cda65568-5434-4092-92bc-4a0e9a45c9af tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:24:59.868274 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cda65568-5434-4092-92bc-4a0e9a45c9af tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.072607 Aug 18 11:24:59.869375 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 16/22] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:24:59 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:24:59.886473 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-460445e0-b30a-47a3-9ff4-2a30b551d278 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 1.043164 Aug 18 11:24:59.887201 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 7/23] 10.222.0.73 () {60 vars in 1191 bytes} [Thu Aug 18 11:24:58 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:24:59.907345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fc0e459c-2ea2-47e3-8874-3c2ce193c67d tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1356725157", "id": 904523920, "os-flavor-access:is_public": "True"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:24:59.910566 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:59.910566 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:24:59.924950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-40805edf-f681-42cc-89ec-4560a9f1e1e3 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:24:59.932400 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:59.932400 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:24:59.933800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-40805edf-f681-42cc-89ec-4560a9f1e1e3 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'defed375795f40719273c81851fa7168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccb631a40b14b66aeb4472229f2777a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-40805edf-f681-42cc-89ec-4560a9f1e1e3 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Request method failure captured: Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: request: PUT /compute/v2.1/flavors/2123965828/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 22 Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGGL15inAy9xk3jNm7eINQEF0hJsiPZYfQnqCrLz7sUOnZX_xFKUzhZIAXKBWPY7VUKufgx7LECMyQGvq_2WdfLgPhgTWmcciKc5Ji85mr_ASv0yxcej0izBso6mfsw1R34UVg-w_J_MEatzG-zxAHBnoeaKwJyprrgH7OZiekSvis Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: dccb631a40b14b66aeb4472229f2777a Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:24:59.945392 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:24:59.946740 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/dccb631a40b14b66aeb4472229f2777a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:24:59.946740 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 Aug 18 11:24:59.946740 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: dccb631a40b14b66aeb4472229f2777a Aug 18 11:24:59.946740 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 Aug 18 11:24:59.946740 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project Aug 18 11:24:59.946740 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:24:59.946740 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:24:59.946740 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: defed375795f40719273c81851fa7168 Aug 18 11:24:59.946740 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project Aug 18 11:24:59.946740 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:24:59.946740 n-d-853611-3 devstack@n-api.service[122210]: {"hw:numa_nodes": "1"} Aug 18 11:24:59.946740 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:24:59.946740 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'flavor_id': '2123965828', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:24:59.947882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 18 11:24:59.948833 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:24:59.953694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-40805edf-f681-42cc-89ec-4560a9f1e1e3 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:24:59.956405 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-40805edf-f681-42cc-89ec-4560a9f1e1e3 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907 tempest-FlavorsExtraSpecsNegativeTestJSON-2130718907-project] 10.222.0.73 "PUT /compute/v2.1/flavors/2123965828/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.049959 Aug 18 11:24:59.957003 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 17/24] 10.222.0.73 () {60 vars in 1265 bytes} [Thu Aug 18 11:24:59 2022] PUT /compute/v2.1/flavors/2123965828/os-extra_specs/hw:numa_nodes => generated 124 bytes in 88 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:24:59.972499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cc01e972-1cc2-4abd-b72f-a834fe928676 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:24:59.973411 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:24:59.973411 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:24:59.991718 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fc0e459c-2ea2-47e3-8874-3c2ce193c67d tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.094489 Aug 18 11:25:00.006261 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 8/25] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:24:59 2022] POST /compute/v2.1/flavors => generated 426 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:00.017857 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cc01e972-1cc2-4abd-b72f-a834fe928676 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.055050 Aug 18 11:25:00.025909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-169052c7-0368-4c6f-bfb2-eb1379d8c322 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:00.027392 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 18/26] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:24:59 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:00.029500 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:00.029500 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:00.036594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-43ae024c-a08b-4df4-8347-a649e02bae7b tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:00.049720 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:00.049720 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:00.069195 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-169052c7-0368-4c6f-bfb2-eb1379d8c322 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] HTTP exception thrown: Flavor 2123965828 has no extra specs with key hw:cpu_thread_policy. Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-169052c7-0368-4c6f-bfb2-eb1379d8c322 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] Request method failure captured: Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/flavors/2123965828/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGIGkUaC8p3LIFXgU11eXdlZt9hV7DRThg0DsQ-6_TgDNo6QDcT9QLH4B7ryowbdmPQuQPZ-yoVqVcZhHUVGpQO21qkKkzT4MlRWMA6ZxXi5SAPUCO9SJLH0HrVxiy6QTYcywvgKe-0g4cVjTEziWLLitAREUxpA1mk3LGLPE5E3nk Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: be81d522289442ab8de3152915aae0c9 Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:25:00.072365 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:25:00.073843 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/be81d522289442ab8de3152915aae0c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/be81d522289442ab8de3152915aae0c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_be81d522289442ab8de3152915aae0c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/be81d522289442ab8de3152915aae0c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:00.073843 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 Aug 18 11:25:00.073843 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: be81d522289442ab8de3152915aae0c9 Aug 18 11:25:00.073843 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 Aug 18 11:25:00.073843 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin Aug 18 11:25:00.073843 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:00.073843 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:00.073843 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 017b1c13873d4f17bc03970e3a5ef1f6 Aug 18 11:25:00.073843 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin Aug 18 11:25:00.073843 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:00.073843 n-d-853611-3 devstack@n-api.service[122209]: exception: Flavor 2123965828 has no extra specs with key hw:cpu_thread_policy. Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'flavor_id': '2123965828', 'id': 'hw:cpu_thread_policy'} Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2123965828 has no extra specs with key hw:cpu_thread_policy. Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:00.074418 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.075477 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:00.075477 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:00.075477 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:00.075477 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:00.075477 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:00.075477 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2123965828 has no extra specs with key hw:cpu_thread_policy. Aug 18 11:25:00.075477 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.079680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-169052c7-0368-4c6f-bfb2-eb1379d8c322 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] Returning 404 to user: Flavor 2123965828 has no extra specs with key hw:cpu_thread_policy. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:00.082534 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-169052c7-0368-4c6f-bfb2-eb1379d8c322 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/2123965828/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.074400 Aug 18 11:25:00.090569 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 9/27] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:25:00 2022] DELETE /compute/v2.1/flavors/2123965828/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:00.097877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4a508c5e-e10a-4576-9645-1e5ef77b3a08 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1830708512"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:00.098240 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-43ae024c-a08b-4df4-8347-a649e02bae7b tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/904523920" status: 202 len: 0 microversion: 2.1 time: 0.069347 Aug 18 11:25:00.099395 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 19/28] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:25:00 2022] DELETE /compute/v2.1/flavors/904523920 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:25:00.106236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8a339820-45ae-4a49-a1b7-d4d54685e4d3 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-515192371"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:00.107831 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:00.107831 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:00.109971 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:00.109971 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:00.111345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.aggregate [None req-4a508c5e-e10a-4576-9645-1e5ef77b3a08 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Generated uuid 0ec5370d-5ddd-4318-97b7-700ab20164d7 for aggregate {{(pid=122209) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:00.112930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.aggregate [None req-8a339820-45ae-4a49-a1b7-d4d54685e4d3 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Generated uuid b0b4c9cc-0d1c-472b-8019-f539463ea1e0 for aggregate {{(pid=122210) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:00.165442 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8a339820-45ae-4a49-a1b7-d4d54685e4d3 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.064728 Aug 18 11:25:00.169319 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 20/29] 10.222.0.73 () {62 vars in 1205 bytes} [Thu Aug 18 11:25:00 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:00.182719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3820552f-b1bb-424c-879f-defd29085263 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:00.185252 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:00.185252 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:00.187518 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-3820552f-b1bb-424c-879f-defd29085263 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3820552f-b1bb-424c-879f-defd29085263 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] Request method failure captured: Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: request: PUT /compute/v2.1/flavors/2123965828/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 27 Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGIGkUaC8p3LIFXgU11eXdlZt9hV7DRThg0DsQ-6_TgDNo6QDcT9QLH4B7ryowbdmPQuQPZ-yoVqVcZhHUVGpQO21qkKkzT4MlRWMA6ZxXi5SAPUCO9SJLH0HrVxiy6QTYcywvgKe-0g4cVjTEziWLLitAREUxpA1mk3LGLPE5E3nk Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: be81d522289442ab8de3152915aae0c9 Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:25:00.189670 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:25:00.191058 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/be81d522289442ab8de3152915aae0c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/be81d522289442ab8de3152915aae0c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_be81d522289442ab8de3152915aae0c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/be81d522289442ab8de3152915aae0c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:00.191058 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 Aug 18 11:25:00.191058 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: be81d522289442ab8de3152915aae0c9 Aug 18 11:25:00.191058 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 Aug 18 11:25:00.191058 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin Aug 18 11:25:00.191058 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:00.191058 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:00.191058 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 017b1c13873d4f17bc03970e3a5ef1f6 Aug 18 11:25:00.191058 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin Aug 18 11:25:00.191058 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:25:00.191058 n-d-853611-3 devstack@n-api.service[122210]: {"hw:cpu_policy": "shared"} Aug 18 11:25:00.191058 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:25:00.191058 n-d-853611-3 devstack@n-api.service[122210]: exception: Request body and URI mismatch Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'flavor_id': '2123965828', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:00.191828 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:00.193001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:00.193001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:00.193001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 18 11:25:00.193001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.193974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3820552f-b1bb-424c-879f-defd29085263 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:00.195119 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3820552f-b1bb-424c-879f-defd29085263 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] 10.222.0.73 "PUT /compute/v2.1/flavors/2123965828/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.024618 Aug 18 11:25:00.201287 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 21/30] 10.222.0.73 () {60 vars in 1265 bytes} [Thu Aug 18 11:25:00 2022] PUT /compute/v2.1/flavors/2123965828/os-extra_specs/hw:numa_nodes => generated 73 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:25:00.207554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-440b5807-3fc5-4e48-a844-6fb09c483556 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:00.228198 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4a508c5e-e10a-4576-9645-1e5ef77b3a08 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.136196 Aug 18 11:25:00.228795 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 10/31] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:00.248781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-df8448a8-2a26-4d46-adcb-a984c588c85c tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-525969074"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:00.272214 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-440b5807-3fc5-4e48-a844-6fb09c483556 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.059623 Aug 18 11:25:00.272214 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 22/32] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:00 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:00.277416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7a7926a8-7248-4982-a387-4f6a149a6c65 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7a7926a8-7248-4982-a387-4f6a149a6c65 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] Request method failure captured: Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: request: PUT /compute/v2.1/flavors/2123965828/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 49 Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGIGkUaC8p3LIFXgU11eXdlZt9hV7DRThg0DsQ-6_TgDNo6QDcT9QLH4B7ryowbdmPQuQPZ-yoVqVcZhHUVGpQO21qkKkzT4MlRWMA6ZxXi5SAPUCO9SJLH0HrVxiy6QTYcywvgKe-0g4cVjTEziWLLitAREUxpA1mk3LGLPE5E3nk Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: be81d522289442ab8de3152915aae0c9 Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:25:00.288463 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:25:00.289654 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/be81d522289442ab8de3152915aae0c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/be81d522289442ab8de3152915aae0c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_be81d522289442ab8de3152915aae0c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/be81d522289442ab8de3152915aae0c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:00.289654 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 Aug 18 11:25:00.289654 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: be81d522289442ab8de3152915aae0c9 Aug 18 11:25:00.289654 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 Aug 18 11:25:00.289654 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin Aug 18 11:25:00.289654 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:00.289654 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:00.289654 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 017b1c13873d4f17bc03970e3a5ef1f6 Aug 18 11:25:00.289654 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin Aug 18 11:25:00.289654 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:25:00.289654 n-d-853611-3 devstack@n-api.service[122210]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 18 11:25:00.289654 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'flavor_id': '2123965828', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance: Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 18 11:25:00.292283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.293607 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:00.294758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:00.294758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:00.294758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:25:00.294758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:25:00.294758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 18 11:25:00.294758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:00.298511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7a7926a8-7248-4982-a387-4f6a149a6c65 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:00.307966 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7a7926a8-7248-4982-a387-4f6a149a6c65 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] 10.222.0.73 "PUT /compute/v2.1/flavors/2123965828/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.039631 Aug 18 11:25:00.314171 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 23/33] 10.222.0.73 () {60 vars in 1265 bytes} [Thu Aug 18 11:25:00 2022] PUT /compute/v2.1/flavors/2123965828/os-extra_specs/hw:numa_nodes => generated 117 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:25:00.394829 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:00.394829 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:00.442334 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-df8448a8-2a26-4d46-adcb-a984c588c85c tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-aggregates/2" status: 200 len: 298 microversion: 2.41 time: 0.207788 Aug 18 11:25:00.443273 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 11/34] 10.222.0.73 () {62 vars in 1210 bytes} [Thu Aug 18 11:25:00 2022] PUT /compute/v2.1/os-aggregates/2 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:00.453454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-13324f6c-29b2-4d81-a704-42191a2c933f tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1811362032", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:00.461201 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:00.461201 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:00.485534 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-13324f6c-29b2-4d81-a704-42191a2c933f tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.040255 Aug 18 11:25:00.487011 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 12/35] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:00 2022] POST /compute/v2.1/flavors => generated 507 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:00.493179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-62ee97c9-50c8-4ac0-ae1c-023031dcc96d tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:00.495197 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:00.495197 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:00.516124 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-62ee97c9-50c8-4ac0-ae1c-023031dcc96d tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/2123965828" status: 202 len: 0 microversion: 2.1 time: 0.027514 Aug 18 11:25:00.521847 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 13/36] 10.222.0.73 () {58 vars in 1161 bytes} [Thu Aug 18 11:25:00 2022] DELETE /compute/v2.1/flavors/2123965828 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:25:00.527549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-12e76db7-271b-47d1-9886-8a422a640cd1 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:00.528666 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:00.528666 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:00.537667 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-12e76db7-271b-47d1-9886-8a422a640cd1 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] 10.222.0.73 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 298 microversion: 2.41 time: 0.014014 Aug 18 11:25:00.539681 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 14/37] 10.222.0.73 () {60 vars in 1190 bytes} [Thu Aug 18 11:25:00 2022] GET /compute/v2.1/os-aggregates/2 => generated 298 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:00.551074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cd47fde0-9974-447a-82b1-efd48bc4126b tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:00.553920 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:00.553920 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:00.582711 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cd47fde0-9974-447a-82b1-efd48bc4126b tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/0fd41236-a37b-4f0e-b2de-0ed487a74697" status: 202 len: 0 microversion: 2.1 time: 0.041372 Aug 18 11:25:00.583601 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 15/38] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:25:00 2022] DELETE /compute/v2.1/flavors/0fd41236-a37b-4f0e-b2de-0ed487a74697 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:25:00.597999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8aecc354-4e5a-41ef-9cb8-04d5f8f97078 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:00.677138 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8aecc354-4e5a-41ef-9cb8-04d5f8f97078 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938 tempest-FlavorsExtraSpecsNegativeTestJSON-1059270938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089156 Aug 18 11:25:00.681323 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 16/39] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:00.703477 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-addd562b-20a1-4d73-92df-39bc137c86b5 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853611-3"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:00.715203 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:00.715203 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:00.732095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-addd562b-20a1-4d73-92df-39bc137c86b5 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:00.733071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-addd562b-20a1-4d73-92df-39bc137c86b5 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:00.733754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-addd562b-20a1-4d73-92df-39bc137c86b5 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:01.010368 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-addd562b-20a1-4d73-92df-39bc137c86b5 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 313 microversion: 2.41 time: 0.327654 Aug 18 11:25:01.018502 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 17/40] 10.222.0.73 () {62 vars in 1232 bytes} [Thu Aug 18 11:25:00 2022] POST /compute/v2.1/os-aggregates/2/action => generated 313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:01.023950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0b620987-3261-4bb8-9466-7720965fc9fd tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:01.075042 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0b620987-3261-4bb8-9466-7720965fc9fd tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054897 Aug 18 11:25:01.076544 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 18/41] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:01.093203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0028befd-2c04-4b13-a707-3c1ed985165e tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853611-3"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:01.096622 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:01.096622 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:01.119030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0028befd-2c04-4b13-a707-3c1ed985165e tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:01.121521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0028befd-2c04-4b13-a707-3c1ed985165e tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:01.122786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0028befd-2c04-4b13-a707-3c1ed985165e tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:01.149426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a66e4a2-1e24-4059-b316-101858a86573 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853611-3"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:01.153252 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:01.153252 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:01.154145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6a66e4a2-1e24-4059-b316-101858a86573 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'e7bf8cf343c048a5bb522f71337b0ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39b73599884493a85679bc82dcc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a66e4a2-1e24-4059-b316-101858a86573 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Request method failure captured: Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 39 Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGEYTRrUG_T7LYt2eDtLno6hzghANeusWQi4XsXqfxOAjo6EGzCSjbVHDVAo2R9Z1pdLgHnQyB5nG_iYDAFRsp8jy-WwgxafpuhFBsWMwRtMGVT37oMUSyDRO9oT5gkVf_Y_phiuwjUbdsVzIYGK_F0NQeZimT7tsAjkAEa8QoZ9p0 Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 2e39b73599884493a85679bc82dcc371 Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:25:01.163794 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:25:01.165112 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2e39b73599884493a85679bc82dcc371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/2e39b73599884493a85679bc82dcc371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_2e39b73599884493a85679bc82dcc371"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2e39b73599884493a85679bc82dcc371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:01.165112 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:01.165112 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 2e39b73599884493a85679bc82dcc371 Aug 18 11:25:01.165112 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:01.165112 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AggregatesAdminNegativeTestJSON-1323751813-project Aug 18 11:25:01.165112 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:01.165112 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:01.165112 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e7bf8cf343c048a5bb522f71337b0ca2 Aug 18 11:25:01.165112 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813-project Aug 18 11:25:01.165112 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:25:01.165112 n-d-853611-3 devstack@n-api.service[122210]: {"add_host": {"host": "n-h2-853611-3"}} Aug 18 11:25:01.165112 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:25:01.165112 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h2-853611-3'}}} Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:01.166896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 18 11:25:01.168289 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.174867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a66e4a2-1e24-4059-b316-101858a86573 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:01.177899 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6a66e4a2-1e24-4059-b316-101858a86573 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] 10.222.0.73 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.861726 Aug 18 11:25:01.181781 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 24/42] 10.222.0.73 () {60 vars in 1191 bytes} [Thu Aug 18 11:25:00 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 867 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:01.194731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c981625b-f60f-4853-ad49-bf8afdd35238 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-394937739", "id": "0ae12fe7-687e-401b-a32a-31a77d67b482", "os-flavor-access:is_public": "True"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:01.198419 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:01.198419 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:01.245463 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c981625b-f60f-4853-ad49-bf8afdd35238 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.060269 Aug 18 11:25:01.246798 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 25/43] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:01 2022] POST /compute/v2.1/flavors => generated 506 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:01.267896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4cc9de44-76f5-4834-80fa-6b2a2cc1d75d tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:01.271182 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:01.271182 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:01.317215 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4cc9de44-76f5-4834-80fa-6b2a2cc1d75d tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.059052 Aug 18 11:25:01.317892 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 26/44] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:25:01 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:01.331085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94a057fb-967f-496e-9ec4-58a42e314ad0 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:01.331944 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:01.331944 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:01.334139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=10 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:01.358766 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0028befd-2c04-4b13-a707-3c1ed985165e tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.41 time: 0.281160 Aug 18 11:25:01.359630 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 19/45] 10.222.0.73 () {62 vars in 1232 bytes} [Thu Aug 18 11:25:01 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:01.367659 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-94a057fb-967f-496e-9ec4-58a42e314ad0 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/0ae12fe7-687e-401b-a32a-31a77d67b482" status: 202 len: 0 microversion: 2.1 time: 0.047940 Aug 18 11:25:01.368652 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 27/46] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:25:01 2022] DELETE /compute/v2.1/flavors/0ae12fe7-687e-401b-a32a-31a77d67b482 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:25:01.378970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-232a8758-dccd-42f4-b5c3-da4d8ef153b4 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:01.384318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-182669fd-57a5-4a63-9bd1-8f24d6050f36 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1427890755"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:01.389061 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:01.389061 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:01.389825 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:01.389825 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:01.394330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.aggregate [None req-182669fd-57a5-4a63-9bd1-8f24d6050f36 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Generated uuid 90fa2e86-9925-41e2-8afe-18300dd84bdb for aggregate {{(pid=122209) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:01.420008 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-182669fd-57a5-4a63-9bd1-8f24d6050f36 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050013 Aug 18 11:25:01.438482 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 20/47] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:01.445389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-90cf0024-3d2e-45ba-93c0-86f9134b86fe tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:01.456616 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-232a8758-dccd-42f4-b5c3-da4d8ef153b4 tempest-AggregatesAdminTestV241-309494684 tempest-AggregatesAdminTestV241-309494684-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.41 time: 0.082685 Aug 18 11:25:01.457450 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 28/48] 10.222.0.73 () {60 vars in 1193 bytes} [Thu Aug 18 11:25:01 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:01.475059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9af6bef4-8a44-4be7-b072-ed6b0c5ce442 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2027862724"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:01.475418 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-90cf0024-3d2e-45ba-93c0-86f9134b86fe tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035023 Aug 18 11:25:01.476504 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 21/49] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:01.494072 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:01.494072 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:01.498250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7a1bd454-649c-4919-963c-351fa96ff7c2 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-492385439", "name": "tempest-test_aggregate-1876108569"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:01.511253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af6bef4-8a44-4be7-b072-ed6b0c5ce442 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:01.511947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af6bef4-8a44-4be7-b072-ed6b0c5ce442 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:01.512539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af6bef4-8a44-4be7-b072-ed6b0c5ce442 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:01.529557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af6bef4-8a44-4be7-b072-ed6b0c5ce442 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:01.533173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af6bef4-8a44-4be7-b072-ed6b0c5ce442 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:01.534814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af6bef4-8a44-4be7-b072-ed6b0c5ce442 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:01.541578 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:01.541578 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:01.544432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.aggregate [None req-7a1bd454-649c-4919-963c-351fa96ff7c2 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Generated uuid 89b488a8-b59a-4596-8dce-b26e145e4610 for aggregate {{(pid=122209) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:01.559339 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-9af6bef4-8a44-4be7-b072-ed6b0c5ce442 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2027862724 could not be found. Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9af6bef4-8a44-4be7-b072-ed6b0c5ce442 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Request method failure captured: Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 58 Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGGtrlJLl8jLAJKWVbLvLTUlFP56HfI9u2wUXbz671QhGA93ZjVAKuYcxNVgAOiY0WezHKsjnePzMgz9_LaWIwcg_f3UEZCnh0eTkEEq_50NDcUVGmrgyofSOT249_7DvjOWEREYXhh2WG0mhQ8IIMC79Plw8Lr0fX_1q04c6Gha-0 Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:25:01.566028 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:25:01.567401 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:01.567401 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:01.567401 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:25:01.567401 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:01.567401 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:25:01.567401 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:01.567401 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:01.567401 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e142868b2e984bd583f7b45a2fb32e95 Aug 18 11:25:01.567401 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:25:01.567401 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:25:01.567401 n-d-853611-3 devstack@n-api.service[122210]: {"add_host": {"host": "tempest-nonexist_host-2027862724"}} Aug 18 11:25:01.567401 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:25:01.567401 n-d-853611-3 devstack@n-api.service[122210]: exception: Compute host tempest-nonexist_host-2027862724 could not be found. Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-2027862724'}}} Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5962, in _get_service_in_cell_by_host Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2027862724' is not mapped to any cell Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:01.568284 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5968, in _get_service_in_cell_by_host Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6587, in add_host_to_aggregate Aug 18 11:25:01.569377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5970, in _get_service_in_cell_by_host Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2027862724 could not be found. Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2027862724 could not be found. Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:01.570329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.571564 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:01.571564 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:01.571564 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:01.571564 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:01.571564 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:01.571564 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2027862724 could not be found. Aug 18 11:25:01.571564 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.573316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9af6bef4-8a44-4be7-b072-ed6b0c5ce442 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2027862724 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:01.574390 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9af6bef4-8a44-4be7-b072-ed6b0c5ce442 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.111717 Aug 18 11:25:01.575538 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 29/50] 10.222.0.73 () {60 vars in 1191 bytes} [Thu Aug 18 11:25:01 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:01.582196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e368475e-24d6-458e-8602-ccc8966be430 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1514920081", "id": 1784924488, "os-flavor-access:is_public": "True"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:01.585279 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:01.585279 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:01.598651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=8,nova_api:DELETE=11,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:01.608472 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e368475e-24d6-458e-8602-ccc8966be430 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.031609 Aug 18 11:25:01.615937 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7a1bd454-649c-4919-963c-351fa96ff7c2 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.122068 Aug 18 11:25:01.618311 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 30/51] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:01 2022] POST /compute/v2.1/flavors => generated 414 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:01.620712 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 22/52] 10.222.0.73 () {60 vars in 1165 bytes} [Thu Aug 18 11:25:01 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:01.623901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1efd650-0d14-4d41-b7c5-bcbdd157f358 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:01.624927 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:01.624927 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:01.630573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-80491867-a9fa-4ecf-a8a0-04853928f7d5 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:01.652020 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-80491867-a9fa-4ecf-a8a0-04853928f7d5 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/1784924488" status: 200 len: 414 microversion: 2.1 time: 0.026499 Aug 18 11:25:01.658828 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 23/53] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:25:01 2022] GET /compute/v2.1/flavors/1784924488 => generated 414 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:01.661876 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1efd650-0d14-4d41-b7c5-bcbdd157f358 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.042097 Aug 18 11:25:01.664573 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 31/54] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:25:01 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:01.668605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7d0286c6-8931-412a-bd5c-b34e2f0dddbf tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:01.669442 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:01.669442 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:01.704596 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7d0286c6-8931-412a-bd5c-b34e2f0dddbf tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.044161 Aug 18 11:25:01.705461 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 24/55] 10.222.0.73 () {58 vars in 1143 bytes} [Thu Aug 18 11:25:01 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:01.717607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6f7b483b-12ac-42fa-a956-a57bfebf0c28 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6f7b483b-12ac-42fa-a956-a57bfebf0c28 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Request method failure captured: Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 283 Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGGtrlJLl8jLAJKWVbLvLTUlFP56HfI9u2wUXbz671QhGA93ZjVAKuYcxNVgAOiY0WezHKsjnePzMgz9_LaWIwcg_f3UEZCnh0eTkEEq_50NDcUVGmrgyofSOT249_7DvjOWEREYXhh2WG0mhQ8IIMC79Plw8Lr0fX_1q04c6Gha-0 Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:25:01.726234 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:25:01.727418 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:01.727418 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:01.727418 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:25:01.727418 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:01.727418 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:25:01.727418 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:01.727418 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:01.727418 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e142868b2e984bd583f7b45a2fb32e95 Aug 18 11:25:01.727418 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:25:01.727418 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:25:01.728549 n-d-853611-3 devstack@n-api.service[122209]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 18 11:25:01.728549 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:01.728549 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:25:01.728549 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 18 11:25:01.728549 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:01.728549 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:01.728549 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:25:01.728549 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:25:01.728549 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:25:01.728549 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:01.729360 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:01.730982 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:01.731952 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:25:01.731952 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:25:01.731952 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:25:01.731952 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:01.733214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6f7b483b-12ac-42fa-a956-a57bfebf0c28 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:01.746741 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6f7b483b-12ac-42fa-a956-a57bfebf0c28 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.028293 Aug 18 11:25:01.755669 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 25/56] 10.222.0.73 () {60 vars in 1165 bytes} [Thu Aug 18 11:25:01 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:25:01.765787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3e5a2803-4c63-468f-b496-9415ff84aa2b tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853611-3"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:01.772624 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:01.772624 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:01.802463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e5a2803-4c63-468f-b496-9415ff84aa2b tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:01.803033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e5a2803-4c63-468f-b496-9415ff84aa2b tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:01.806627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e5a2803-4c63-468f-b496-9415ff84aa2b tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:02.013419 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3e5a2803-4c63-468f-b496-9415ff84aa2b tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 313 microversion: 2.1 time: 0.256526 Aug 18 11:25:02.014024 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 26/57] 10.222.0.73 () {60 vars in 1191 bytes} [Thu Aug 18 11:25:01 2022] POST /compute/v2.1/os-aggregates/5/action => generated 313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:02.038147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-42107c8d-a4e5-4bf8-99a6-c1686270bcf5 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-42107c8d-a4e5-4bf8-99a6-c1686270bcf5 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Request method failure captured: Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 27 Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGGtrlJLl8jLAJKWVbLvLTUlFP56HfI9u2wUXbz671QhGA93ZjVAKuYcxNVgAOiY0WezHKsjnePzMgz9_LaWIwcg_f3UEZCnh0eTkEEq_50NDcUVGmrgyofSOT249_7DvjOWEREYXhh2WG0mhQ8IIMC79Plw8Lr0fX_1q04c6Gha-0 Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:25:02.041733 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:25:02.043147 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:02.043147 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:02.043147 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:25:02.043147 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:02.043147 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:25:02.043147 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:02.043147 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:02.043147 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e142868b2e984bd583f7b45a2fb32e95 Aug 18 11:25:02.043147 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:25:02.043147 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:25:02.043147 n-d-853611-3 devstack@n-api.service[122209]: {"aggregate": {"name": ""}} Aug 18 11:25:02.043147 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:02.043147 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi '' Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:02.044361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 18 11:25:02.045584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.047366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-42107c8d-a4e5-4bf8-99a6-c1686270bcf5 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:02.047366 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-42107c8d-a4e5-4bf8-99a6-c1686270bcf5 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.015359 Aug 18 11:25:02.047366 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 27/58] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:02 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:25:02.056972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-efa21328-6b6b-46ae-bcaf-e705f23f0314 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1917797766"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:02.060257 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:02.060257 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:02.061186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-efa21328-6b6b-46ae-bcaf-e705f23f0314 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'e7bf8cf343c048a5bb522f71337b0ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39b73599884493a85679bc82dcc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-efa21328-6b6b-46ae-bcaf-e705f23f0314 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Request method failure captured: Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 60 Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGEYTRrUG_T7LYt2eDtLno6hzghANeusWQi4XsXqfxOAjo6EGzCSjbVHDVAo2R9Z1pdLgHnQyB5nG_iYDAFRsp8jy-WwgxafpuhFBsWMwRtMGVT37oMUSyDRO9oT5gkVf_Y_phiuwjUbdsVzIYGK_F0NQeZimT7tsAjkAEa8QoZ9p0 Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 2e39b73599884493a85679bc82dcc371 Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:25:02.064180 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:25:02.065323 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2e39b73599884493a85679bc82dcc371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/2e39b73599884493a85679bc82dcc371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_2e39b73599884493a85679bc82dcc371"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2e39b73599884493a85679bc82dcc371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:02.065323 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:02.065323 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 2e39b73599884493a85679bc82dcc371 Aug 18 11:25:02.065323 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:02.065323 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AggregatesAdminNegativeTestJSON-1323751813-project Aug 18 11:25:02.065323 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:02.065323 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:02.065323 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e7bf8cf343c048a5bb522f71337b0ca2 Aug 18 11:25:02.065323 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813-project Aug 18 11:25:02.065323 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:25:02.065323 n-d-853611-3 devstack@n-api.service[122209]: {"aggregate": {"name": "tempest-test_aggregate-1917797766"}} Aug 18 11:25:02.065323 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:02.065323 n-d-853611-3 devstack@n-api.service[122209]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1917797766'}}} Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:25:02.066046 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:25:02.067409 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 18 11:25:02.071003 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.071003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-efa21328-6b6b-46ae-bcaf-e705f23f0314 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:02.071003 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-efa21328-6b6b-46ae-bcaf-e705f23f0314 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012655 Aug 18 11:25:02.071003 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 28/59] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:02 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:02.075898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9df441fe-4128-4c4b-8887-08653e3fe348 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-669943924"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:02.079919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.aggregate [None req-9df441fe-4128-4c4b-8887-08653e3fe348 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Generated uuid c3424d66-4de5-4210-ac51-c4b02bf93fc2 for aggregate {{(pid=122209) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:02.109358 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9df441fe-4128-4c4b-8887-08653e3fe348 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.036893 Aug 18 11:25:02.121026 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 29/60] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:02 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:02.129401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c0a5e83b-3b50-4546-8872-9d1b4bb26812 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-669943924"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:02.132063 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:02.132063 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:02.133114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.aggregate [None req-c0a5e83b-3b50-4546-8872-9d1b4bb26812 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Generated uuid c79c6047-5bdc-45ba-9143-b1247dd21b4c for aggregate {{(pid=122209) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:02.144639 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-c0a5e83b-3b50-4546-8872-9d1b4bb26812 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-669943924 already exists. Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c0a5e83b-3b50-4546-8872-9d1b4bb26812 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Request method failure captured: Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 59 Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGGtrlJLl8jLAJKWVbLvLTUlFP56HfI9u2wUXbz671QhGA93ZjVAKuYcxNVgAOiY0WezHKsjnePzMgz9_LaWIwcg_f3UEZCnh0eTkEEq_50NDcUVGmrgyofSOT249_7DvjOWEREYXhh2WG0mhQ8IIMC79Plw8Lr0fX_1q04c6Gha-0 Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:25:02.147134 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:25:02.148335 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:02.148335 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:02.148335 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:25:02.148335 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:02.148335 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:25:02.148335 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:02.148335 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:02.148335 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e142868b2e984bd583f7b45a2fb32e95 Aug 18 11:25:02.148335 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:25:02.148335 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:25:02.148335 n-d-853611-3 devstack@n-api.service[122209]: {"aggregate": {"name": "tempest-test_aggregate-669943924"}} Aug 18 11:25:02.148335 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:02.148335 n-d-853611-3 devstack@n-api.service[122209]: exception: Aggregate tempest-test_aggregate-669943924 already exists. Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-669943924'}}} Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6424, in create_aggregate Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 18 11:25:02.149054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-669943924 already exists. Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:02.149995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 18 11:25:02.151043 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 18 11:25:02.151043 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-669943924 already exists. Aug 18 11:25:02.151043 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.151043 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:02.151043 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.151043 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.151043 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.151043 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.151043 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:02.151043 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:02.151043 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-669943924 already exists. Aug 18 11:25:02.151043 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.151043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c0a5e83b-3b50-4546-8872-9d1b4bb26812 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-669943924 already exists. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:02.151043 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c0a5e83b-3b50-4546-8872-9d1b4bb26812 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.026413 Aug 18 11:25:02.156103 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 30/61] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:02 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 28 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:25:02.160974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cd55f199-0906-4c8c-b4e7-b4fee3497dfe tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.161554 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:02.161554 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:02.207382 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cd55f199-0906-4c8c-b4e7-b4fee3497dfe tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.053546 Aug 18 11:25:02.212387 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 31/62] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:25:02 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:02.248946 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8cc5029b-e9d6-4055-a3a5-1233271cdba4 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-81782699"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:02.252135 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:02.252135 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:02.258958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.aggregate [None req-8cc5029b-e9d6-4055-a3a5-1233271cdba4 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Generated uuid 2649bdf7-5b66-4f41-9f2e-3aca2acc69aa for aggregate {{(pid=122209) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:02.314952 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8cc5029b-e9d6-4055-a3a5-1233271cdba4 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.099567 Aug 18 11:25:02.322376 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 32/63] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:02 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:02.322473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c61c2080-0925-4048-8166-8d055113236f tempest-FlavorsAdminTestJSON-1727532952 tempest-FlavorsAdminTestJSON-1727532952-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.329922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cb615e1d-b93f-424f-8351-644fd3db4f63 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.331263 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:02.331263 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:02.334221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cb615e1d-b93f-424f-8351-644fd3db4f63 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'e7bf8cf343c048a5bb522f71337b0ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39b73599884493a85679bc82dcc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cb615e1d-b93f-424f-8351-644fd3db4f63 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Request method failure captured: Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGEYTRrUG_T7LYt2eDtLno6hzghANeusWQi4XsXqfxOAjo6EGzCSjbVHDVAo2R9Z1pdLgHnQyB5nG_iYDAFRsp8jy-WwgxafpuhFBsWMwRtMGVT37oMUSyDRO9oT5gkVf_Y_phiuwjUbdsVzIYGK_F0NQeZimT7tsAjkAEa8QoZ9p0 Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 2e39b73599884493a85679bc82dcc371 Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:25:02.338177 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:25:02.339347 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2e39b73599884493a85679bc82dcc371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/2e39b73599884493a85679bc82dcc371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_2e39b73599884493a85679bc82dcc371"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2e39b73599884493a85679bc82dcc371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:02.339347 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:02.339347 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 2e39b73599884493a85679bc82dcc371 Aug 18 11:25:02.339347 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:02.339347 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AggregatesAdminNegativeTestJSON-1323751813-project Aug 18 11:25:02.339347 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:02.339347 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:02.339347 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e7bf8cf343c048a5bb522f71337b0ca2 Aug 18 11:25:02.339347 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813-project Aug 18 11:25:02.339347 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:02.339347 n-d-853611-3 devstack@n-api.service[122209]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 18 11:25:02.339347 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '7'} Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:02.339939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.340871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cb615e1d-b93f-424f-8351-644fd3db4f63 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:02.344031 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cb615e1d-b93f-424f-8351-644fd3db4f63 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.019564 Aug 18 11:25:02.347958 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 33/64] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:25:02 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:25:02.354992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0d9468f0-4642-4d3e-bfee-2fe750d7adce tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.388488 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c61c2080-0925-4048-8166-8d055113236f tempest-FlavorsAdminTestJSON-1727532952 tempest-FlavorsAdminTestJSON-1727532952-project] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.720110 Aug 18 11:25:02.394365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 32/65] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:01 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:02.397898 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0d9468f0-4642-4d3e-bfee-2fe750d7adce tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.048633 Aug 18 11:25:02.400065 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 34/66] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:25:02 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:02.407764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4d2b7e68-f566-4824-a942-52e5eca9d415 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.408862 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:02.408862 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:02.417805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4f19a41c-2188-4d89-a8b5-960bfb541e41 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.418777 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:02.418777 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:02.429566 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-4d2b7e68-f566-4824-a942-52e5eca9d415 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4d2b7e68-f566-4824-a942-52e5eca9d415 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Request method failure captured: Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGGtrlJLl8jLAJKWVbLvLTUlFP56HfI9u2wUXbz671QhGA93ZjVAKuYcxNVgAOiY0WezHKsjnePzMgz9_LaWIwcg_f3UEZCnh0eTkEEq_50NDcUVGmrgyofSOT249_7DvjOWEREYXhh2WG0mhQ8IIMC79Plw8Lr0fX_1q04c6Gha-0 Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:25:02.431643 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:25:02.432700 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:02.432700 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:02.432700 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:25:02.432700 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:02.432700 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:25:02.432700 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:02.432700 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:02.432700 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e142868b2e984bd583f7b45a2fb32e95 Aug 18 11:25:02.432700 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:25:02.432700 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:25:02.432700 n-d-853611-3 devstack@n-api.service[122210]: exception: Aggregate -1 could not be found. Aug 18 11:25:02.432700 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '-1'} Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6483, in delete_aggregate Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 18 11:25:02.433322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.434243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.435356 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.435356 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.435356 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:02.435356 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:02.435356 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 18 11:25:02.435356 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.435356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4d2b7e68-f566-4824-a942-52e5eca9d415 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:02.435356 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4d2b7e68-f566-4824-a942-52e5eca9d415 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.029511 Aug 18 11:25:02.435356 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 33/67] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:25:02 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:25:02.448028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-72bbf56d-31dd-48aa-a6cd-9e8bfebbd33b tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1599064999"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:02.453865 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4f19a41c-2188-4d89-a8b5-960bfb541e41 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/1784924488" status: 202 len: 0 microversion: 2.1 time: 0.041694 Aug 18 11:25:02.454177 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:02.454177 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:02.455680 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 35/68] 10.222.0.73 () {58 vars in 1161 bytes} [Thu Aug 18 11:25:02 2022] DELETE /compute/v2.1/flavors/1784924488 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:25:02.459079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.aggregate [None req-72bbf56d-31dd-48aa-a6cd-9e8bfebbd33b tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Generated uuid d9d2701a-4725-43d1-9a27-64f6feb42bf6 for aggregate {{(pid=122210) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:02.464657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2eb03992-cb19-4053-9bca-546c439e077c tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.500087 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-72bbf56d-31dd-48aa-a6cd-9e8bfebbd33b tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056043 Aug 18 11:25:02.502056 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 34/69] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:02 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:02.513411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-82360dbc-6c71-45d5-946c-cfa8593779d5 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.514336 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:02.514336 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:02.515320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-82360dbc-6c71-45d5-946c-cfa8593779d5 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'e7bf8cf343c048a5bb522f71337b0ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39b73599884493a85679bc82dcc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:02.525708 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2eb03992-cb19-4053-9bca-546c439e077c tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066189 Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-82360dbc-6c71-45d5-946c-cfa8593779d5 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Request method failure captured: Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGEYTRrUG_T7LYt2eDtLno6hzghANeusWQi4XsXqfxOAjo6EGzCSjbVHDVAo2R9Z1pdLgHnQyB5nG_iYDAFRsp8jy-WwgxafpuhFBsWMwRtMGVT37oMUSyDRO9oT5gkVf_Y_phiuwjUbdsVzIYGK_F0NQeZimT7tsAjkAEa8QoZ9p0 Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 2e39b73599884493a85679bc82dcc371 Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:25:02.526089 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:25:02.527192 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2e39b73599884493a85679bc82dcc371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/2e39b73599884493a85679bc82dcc371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_2e39b73599884493a85679bc82dcc371"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2e39b73599884493a85679bc82dcc371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:02.527192 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:02.527192 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 2e39b73599884493a85679bc82dcc371 Aug 18 11:25:02.527192 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:02.527192 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AggregatesAdminNegativeTestJSON-1323751813-project Aug 18 11:25:02.527192 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:02.527192 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:02.527192 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e7bf8cf343c048a5bb522f71337b0ca2 Aug 18 11:25:02.527192 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813-project Aug 18 11:25:02.527192 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:25:02.527192 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 18 11:25:02.527192 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '8'} Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:02.527780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.528691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-82360dbc-6c71-45d5-946c-cfa8593779d5 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:02.529568 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-82360dbc-6c71-45d5-946c-cfa8593779d5 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] 10.222.0.73 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.018337 Aug 18 11:25:02.529568 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 35/70] 10.222.0.73 () {58 vars in 1149 bytes} [Thu Aug 18 11:25:02 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:25:02.529687 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 36/71] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:25:02.556397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-32d7dd32-b06f-4b58-808e-5481061866c7 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1111477396", "id": 1669408305, "os-flavor-access:is_public": "False"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:02.559650 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:02.559650 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:02.573076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c868a11-d06b-4e7e-99a0-3e47e20263f3 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.577599 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:02.577599 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:02.581022 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-32d7dd32-b06f-4b58-808e-5481061866c7 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.028371 Aug 18 11:25:02.588461 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 37/72] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:02 2022] POST /compute/v2.1/flavors => generated 430 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:25:02.604702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a30cc67b-fe40-4e99-8ff6-74da7437d672 tempest-FlavorsAdminTestJSON-1727532952 tempest-FlavorsAdminTestJSON-1727532952-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "1669408305"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:02.630373 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-a30cc67b-fe40-4e99-8ff6-74da7437d672 tempest-FlavorsAdminTestJSON-1727532952 tempest-FlavorsAdminTestJSON-1727532952-project] HTTP exception thrown: Flavor 1669408305 could not be found. Aug 18 11:25:02.634200 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4c868a11-d06b-4e7e-99a0-3e47e20263f3 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.078191 Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a30cc67b-fe40-4e99-8ff6-74da7437d672 tempest-FlavorsAdminTestJSON-1727532952 tempest-FlavorsAdminTestJSON-1727532952-project] Request method failure captured: Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 107 Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGGcs-XUYGjyNu6jxcPyURTEplrlQsoBW81PKhMnhK1EHvVkVpCf2ObFoUtzxQ69eTvYWTDxkkLbiLEZ2ZpqHrPH_BsRgNFTqedzUK4W3MAGTThoodyWKrMHjkmOIQcKZiT1g7ByhutJzoZDzHuAQrzC4KxBqs4J3TfOviZtoFomPc Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 3e95954d2e004727920492eed32d464a Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-FlavorsAdminTestJSON-1727532952 Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:25:02.634942 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:25:02.636495 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3e95954d2e004727920492eed32d464a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3e95954d2e004727920492eed32d464a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3e95954d2e004727920492eed32d464a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3e95954d2e004727920492eed32d464a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:02.636495 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-FlavorsAdminTestJSON-1727532952 Aug 18 11:25:02.636495 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 3e95954d2e004727920492eed32d464a Aug 18 11:25:02.636495 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1727532952 Aug 18 11:25:02.636495 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-FlavorsAdminTestJSON-1727532952-project Aug 18 11:25:02.636495 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:02.636495 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:02.636495 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: d2ff9049eba64a2698e7f7851dc25515 Aug 18 11:25:02.636495 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-FlavorsAdminTestJSON-1727532952-project Aug 18 11:25:02.636495 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:25:02.636495 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "test", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "1669408305"}} Aug 18 11:25:02.636495 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:02.636495 n-d-853611-3 devstack@n-api.service[122209]: exception: Flavor 1669408305 could not be found. Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '1669408305'}}} Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1669408305 could not be found. Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.637470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1669408305 could not be found. Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.640441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.641937 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.641937 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:02.641937 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:02.641937 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1669408305 could not be found. Aug 18 11:25:02.641937 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.642332 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 36/73] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:25:02 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:02.643673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a30cc67b-fe40-4e99-8ff6-74da7437d672 tempest-FlavorsAdminTestJSON-1727532952 tempest-FlavorsAdminTestJSON-1727532952-project] Returning 400 to user: Flavor 1669408305 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:02.644694 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a30cc67b-fe40-4e99-8ff6-74da7437d672 tempest-FlavorsAdminTestJSON-1727532952 tempest-FlavorsAdminTestJSON-1727532952-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.046502 Aug 18 11:25:02.646454 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 38/74] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:02 2022] POST /compute/v2.1/servers => generated 81 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:25:02.651922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6e3a72cc-9a8a-4533-b37b-927bc0a37dc1 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.654495 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:02.654495 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:02.666202 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-6e3a72cc-9a8a-4533-b37b-927bc0a37dc1 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6e3a72cc-9a8a-4533-b37b-927bc0a37dc1 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Request method failure captured: Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGGtrlJLl8jLAJKWVbLvLTUlFP56HfI9u2wUXbz671QhGA93ZjVAKuYcxNVgAOiY0WezHKsjnePzMgz9_LaWIwcg_f3UEZCnh0eTkEEq_50NDcUVGmrgyofSOT249_7DvjOWEREYXhh2WG0mhQ8IIMC79Plw8Lr0fX_1q04c6Gha-0 Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:25:02.668298 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:25:02.670210 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:02.670210 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:02.670210 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:25:02.670210 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:02.670210 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:25:02.670210 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:02.670210 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:02.670210 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e142868b2e984bd583f7b45a2fb32e95 Aug 18 11:25:02.670210 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:25:02.670210 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:02.670210 n-d-853611-3 devstack@n-api.service[122209]: exception: Aggregate -1 could not be found. Aug 18 11:25:02.670210 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '-1'} Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6430, in get_aggregate Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.670978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 18 11:25:02.671978 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.673918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6e3a72cc-9a8a-4533-b37b-927bc0a37dc1 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:02.673918 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6e3a72cc-9a8a-4533-b37b-927bc0a37dc1 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.022753 Aug 18 11:25:02.673918 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 39/75] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:25:02 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:25:02.676935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d63c1e8a-5cd7-4078-8efc-9bfc6b2b3efa tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.705642 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d63c1e8a-5cd7-4078-8efc-9bfc6b2b3efa tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/1669408305" status: 202 len: 0 microversion: 2.1 time: 0.033469 Aug 18 11:25:02.712863 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 40/76] 10.222.0.73 () {58 vars in 1161 bytes} [Thu Aug 18 11:25:02 2022] DELETE /compute/v2.1/flavors/1669408305 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:25:02.718061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f0c345b7-46d3-432e-83d2-d7cbdf5a905d tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.718921 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:02.718921 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:02.720469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f0c345b7-46d3-432e-83d2-d7cbdf5a905d tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'e7bf8cf343c048a5bb522f71337b0ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39b73599884493a85679bc82dcc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f0c345b7-46d3-432e-83d2-d7cbdf5a905d tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Request method failure captured: Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGEYTRrUG_T7LYt2eDtLno6hzghANeusWQi4XsXqfxOAjo6EGzCSjbVHDVAo2R9Z1pdLgHnQyB5nG_iYDAFRsp8jy-WwgxafpuhFBsWMwRtMGVT37oMUSyDRO9oT5gkVf_Y_phiuwjUbdsVzIYGK_F0NQeZimT7tsAjkAEa8QoZ9p0 Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 2e39b73599884493a85679bc82dcc371 Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:25:02.722256 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:25:02.723572 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2e39b73599884493a85679bc82dcc371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/2e39b73599884493a85679bc82dcc371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_2e39b73599884493a85679bc82dcc371"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2e39b73599884493a85679bc82dcc371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:02.723572 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:02.723572 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 2e39b73599884493a85679bc82dcc371 Aug 18 11:25:02.723572 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:02.723572 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AggregatesAdminNegativeTestJSON-1323751813-project Aug 18 11:25:02.723572 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:02.723572 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:02.723572 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e7bf8cf343c048a5bb522f71337b0ca2 Aug 18 11:25:02.723572 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813-project Aug 18 11:25:02.723572 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:02.723572 n-d-853611-3 devstack@n-api.service[122209]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 18 11:25:02.723572 n-d-853611-3 devstack@n-api.service[122209]: action_args: {} Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:02.724212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:02.725152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f0c345b7-46d3-432e-83d2-d7cbdf5a905d tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:02.725987 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f0c345b7-46d3-432e-83d2-d7cbdf5a905d tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] 10.222.0.73 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.009595 Aug 18 11:25:02.725987 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 41/77] 10.222.0.73 () {58 vars in 1143 bytes} [Thu Aug 18 11:25:02 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:02.728972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7728137c-acc8-43af-899a-5ead053377c1 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.751862 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7728137c-acc8-43af-899a-5ead053377c1 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025721 Aug 18 11:25:02.753376 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 42/78] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:02.771758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9fa94e76-ec2b-4384-8692-921ab59b0f53 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1280416049", "id": 2021396154, "os-flavor-access:is_public": "False"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:02.800827 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9fa94e76-ec2b-4384-8692-921ab59b0f53 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.032661 Aug 18 11:25:02.802033 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 43/79] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:02 2022] POST /compute/v2.1/flavors => generated 415 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:02.814510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e90747dc-9dfc-4772-a0a3-4e23fabe79e2 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2111199357", "id": 4569697, "os-flavor-access:is_public": "True"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:02.841459 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e90747dc-9dfc-4772-a0a3-4e23fabe79e2 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.1 time: 0.030666 Aug 18 11:25:02.842725 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 44/80] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:02.857433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-124f1b7e-1992-4c29-b734-c44d4e11c00a tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.879503 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-124f1b7e-1992-4c29-b734-c44d4e11c00a tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.029079 Aug 18 11:25:02.882473 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 45/81] 10.222.0.73 () {58 vars in 1169 bytes} [Thu Aug 18 11:25:02 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:25:02.893356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bd36c7b5-e8c3-4b28-a749-2fa378b38c78 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.906055 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bd36c7b5-e8c3-4b28-a749-2fa378b38c78 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.017143 Aug 18 11:25:02.907149 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 46/82] 10.222.0.73 () {58 vars in 1177 bytes} [Thu Aug 18 11:25:02 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:02.920390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b73bc115-c8e1-4197-b5c3-0803e7fd08b9 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.935797 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b73bc115-c8e1-4197-b5c3-0803e7fd08b9 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.019537 Aug 18 11:25:02.937621 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 47/83] 10.222.0.73 () {58 vars in 1171 bytes} [Thu Aug 18 11:25:02 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:02.953100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-825fe92e-b396-4344-abc5-9cc92042b189 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:02.965595 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-825fe92e-b396-4344-abc5-9cc92042b189 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.018192 Aug 18 11:25:02.967026 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 48/84] 10.222.0.73 () {58 vars in 1169 bytes} [Thu Aug 18 11:25:02 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:02.981382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-61a0cdc9-dc8f-4621-8ce0-87247598f797 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.013660 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-61a0cdc9-dc8f-4621-8ce0-87247598f797 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5386 microversion: 2.1 time: 0.036535 Aug 18 11:25:03.025221 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 49/85] 10.222.0.73 () {58 vars in 1169 bytes} [Thu Aug 18 11:25:02 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:03.032799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-337ae98a-2ec1-4503-b44f-0beecf205709 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.074578 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-337ae98a-2ec1-4503-b44f-0beecf205709 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5386 microversion: 2.1 time: 0.045837 Aug 18 11:25:03.080249 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 50/86] 10.222.0.73 () {58 vars in 1175 bytes} [Thu Aug 18 11:25:03 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:25:03.107643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e75972b6-53d5-4905-8eff-72b2ad13ab2c tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.138999 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e75972b6-53d5-4905-8eff-72b2ad13ab2c tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5386 microversion: 2.1 time: 0.046477 Aug 18 11:25:03.140286 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 51/87] 10.222.0.73 () {58 vars in 1173 bytes} [Thu Aug 18 11:25:03 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:03.160253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-feb4d3d5-02dd-450d-8096-12c729d41f36 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.191141 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-feb4d3d5-02dd-450d-8096-12c729d41f36 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5386 microversion: 2.1 time: 0.036471 Aug 18 11:25:03.192512 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 52/88] 10.222.0.73 () {58 vars in 1169 bytes} [Thu Aug 18 11:25:03 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5386 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:03.217594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-80bd2c2c-88e2-4cca-9381-91ad0261d1f4 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.279910 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-80bd2c2c-88e2-4cca-9381-91ad0261d1f4 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/4569697" status: 202 len: 0 microversion: 2.1 time: 0.066409 Aug 18 11:25:03.279910 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 53/89] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:25:03 2022] DELETE /compute/v2.1/flavors/4569697 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:25:03.292560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e911c1cb-6fa4-4176-a7f2-fcc10f5e3104 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.314173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:DELETE=13 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:03.324376 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e911c1cb-6fa4-4176-a7f2-fcc10f5e3104 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039174 Aug 18 11:25:03.325155 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 54/90] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:25:03.343439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b0cd6c87-c881-4ef4-990b-428a5b054a32 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.371726 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b0cd6c87-c881-4ef4-990b-428a5b054a32 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/2021396154" status: 202 len: 0 microversion: 2.1 time: 0.033156 Aug 18 11:25:03.373267 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 55/91] 10.222.0.73 () {58 vars in 1161 bytes} [Thu Aug 18 11:25:03 2022] DELETE /compute/v2.1/flavors/2021396154 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:25:03.390600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f201e441-0594-4fc0-8e07-005c86d19a37 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.446055 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f201e441-0594-4fc0-8e07-005c86d19a37 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068497 Aug 18 11:25:03.447825 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 56/92] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:03.450386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1586508313", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "availability_zone": "tempest-test_az-492385439"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:03.471441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:03.471919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:03.473747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:03.474561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:03.477819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:03.480113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:03.480372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-611d40fb-6ecf-4faf-a74b-30fd47d7659a tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1817950285", "id": 114207229, "os-flavor-access:is_public": "False"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:03.511318 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-611d40fb-6ecf-4faf-a74b-30fd47d7659a tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.043715 Aug 18 11:25:03.513181 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 57/93] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:03 2022] POST /compute/v2.1/flavors => generated 412 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:03.525792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-46c0885a-cb0e-4f8f-a39e-d06069111393 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.553083 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-46c0885a-cb0e-4f8f-a39e-d06069111393 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032289 Aug 18 11:25:03.553983 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 58/94] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:25:03.575899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5395903d-41e6-4e1c-b479-408ad99708f6 tempest-FlavorsAdminTestJSON-1727532952 tempest-FlavorsAdminTestJSON-1727532952-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.612588 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5395903d-41e6-4e1c-b479-408ad99708f6 tempest-FlavorsAdminTestJSON-1727532952 tempest-FlavorsAdminTestJSON-1727532952-project] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045031 Aug 18 11:25:03.614030 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 59/95] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:03.633225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-749bfdd1-01a1-49ae-93cf-530a5703eb42 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.653021 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-749bfdd1-01a1-49ae-93cf-530a5703eb42 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/114207229" status: 202 len: 0 microversion: 2.1 time: 0.024381 Aug 18 11:25:03.657477 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 60/96] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:25:03 2022] DELETE /compute/v2.1/flavors/114207229 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:25:03.664419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f45828ac-4caa-4cc4-b9b5-463ceafc28b1 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.697221 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f45828ac-4caa-4cc4-b9b5-463ceafc28b1 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038183 Aug 18 11:25:03.714323 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 61/97] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:03.722597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-695fffc2-c8cf-4dfe-a4d1-b802bef0bfb5 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1349698812", "id": 1043702244, "os-flavor-access:is_public": "True"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:03.749389 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-695fffc2-c8cf-4dfe-a4d1-b802bef0bfb5 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.033610 Aug 18 11:25:03.757530 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 62/98] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:03 2022] POST /compute/v2.1/flavors => generated 414 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:03.771470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8e9ebb21-7bfc-415e-96b0-bec1e7708f82 tempest-FlavorsAdminTestJSON-1727532952 tempest-FlavorsAdminTestJSON-1727532952-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.804118 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8e9ebb21-7bfc-415e-96b0-bec1e7708f82 tempest-FlavorsAdminTestJSON-1727532952 tempest-FlavorsAdminTestJSON-1727532952-project] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.044255 Aug 18 11:25:03.804865 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 63/99] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:03 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:03.824793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e5f4e4d1-4dab-454e-868a-275c1a3f8029 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.855075 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e5f4e4d1-4dab-454e-868a-275c1a3f8029 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/1043702244" status: 202 len: 0 microversion: 2.1 time: 0.035480 Aug 18 11:25:03.861268 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 64/100] 10.222.0.73 () {58 vars in 1161 bytes} [Thu Aug 18 11:25:03 2022] DELETE /compute/v2.1/flavors/1043702244 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:25:03.866674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-894a0baa-87a1-4942-b9e5-7ef06cb896d4 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:03.899743 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-894a0baa-87a1-4942-b9e5-7ef06cb896d4 tempest-FlavorsAdminTestJSON-1463038938 tempest-FlavorsAdminTestJSON-1463038938-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037016 Aug 18 11:25:03.907625 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 65/101] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:04.529258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9bdada5b-7414-44cb-8f72-e83387caa691 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Action: 'create', calling method: .version_select at 0x7f51ae34a670>, body: {"keypair": {"name": "tempest-keypair-293170781", "type": "ssh", "user_id": "76e49ec649584422b2c6e4e73ec3ccb6", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQGZKP/QyZgXNHFZCNqPyFFitt9UAQX97je9LnTWI/mzXvDHFUpVO0AYMiXHWfnsGOFh6/edLPnmyi8xGjPE4qdf+bpVNqutI859SS+408XyuZw0ewYA/TQwxc0SNtkKA=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:04.566411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-9bdada5b-7414-44cb-8f72-e83387caa691 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Getting quotas for project c30b1a9794074d1182640849502090cc. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:25:04.575221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-9bdada5b-7414-44cb-8f72-e83387caa691 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Getting quotas for user 6677602f8efc4d8b9fccfa8a63afe749 and project c30b1a9794074d1182640849502090cc. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:25:04.623495 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9bdada5b-7414-44cb-8f72-e83387caa691 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.516547 Aug 18 11:25:04.624274 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 66/102] 10.222.0.73 () {62 vars in 1200 bytes} [Thu Aug 18 11:25:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 519 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 18 11:25:04.638745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3a1c6253-764a-4a0c-a4e8-1a628c62f802 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Action: 'create', calling method: .version_select at 0x7f51ac75f310>, body: {"keypair": {"name": "tempest-keypair-1150474344", "type": "ssh", "user_id": "76e49ec649584422b2c6e4e73ec3ccb6", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVb8WtXzi2o3CeC+E0cXcnnKBuoDj7NU366ClytlEO5n/u3ufjemH33OM3UYBcG/Z3Xf5OfulrJwn6OZvM9+WRkiqL4vE4hWccTidDF22wTZlQCXsZKLHZlQcC5/0hDAA=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:04.667603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-3a1c6253-764a-4a0c-a4e8-1a628c62f802 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Getting quotas for project c30b1a9794074d1182640849502090cc. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:25:04.677427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-3a1c6253-764a-4a0c-a4e8-1a628c62f802 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Getting quotas for user 6677602f8efc4d8b9fccfa8a63afe749 and project c30b1a9794074d1182640849502090cc. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:25:04.709258 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3a1c6253-764a-4a0c-a4e8-1a628c62f802 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.074641 Aug 18 11:25:04.710539 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 67/103] 10.222.0.73 () {62 vars in 1200 bytes} [Thu Aug 18 11:25:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 11:25:04.729181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7623a51b-c85f-46eb-87b1-6ce6e3f7998e tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Calling method '.version_select at 0x7f51ac689a60>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:04.761235 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7623a51b-c85f-46eb-87b1-6ce6e3f7998e tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] 10.222.0.73 "GET /compute/v2.1/os-keypairs/tempest-keypair-293170781?user_id=76e49ec649584422b2c6e4e73ec3ccb6" status: 200 len: 511 microversion: 2.10 time: 0.043746 Aug 18 11:25:04.761852 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 68/104] 10.222.0.73 () {60 vars in 1337 bytes} [Thu Aug 18 11:25:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-293170781?user_id=76e49ec649584422b2c6e4e73ec3ccb6 => generated 511 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 11:25:04.781101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aa9fa71f-9f51-402a-9406-b696c730a6ef tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Action: 'create', calling method: .version_select at 0x7f51ac689c10>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1669883862", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF16YkhgSwKWaLWdlaK6RQrSdIIIRi2c3GGPv4091pf5mHjqcEhpSqiVXbFmfVO9wniXlZ1plRU4sjQq0r6Dhocotzr7xv76bt3wiPSkfsDK9PdnP3QjE33Suoto/+XW3A=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:04.835127 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-aa9fa71f-9f51-402a-9406-b696c730a6ef tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Getting quotas for project c30b1a9794074d1182640849502090cc. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:25:04.853777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-aa9fa71f-9f51-402a-9406-b696c730a6ef tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Getting quotas for user 6677602f8efc4d8b9fccfa8a63afe749 and project c30b1a9794074d1182640849502090cc. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:25:04.913142 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aa9fa71f-9f51-402a-9406-b696c730a6ef tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.141252 Aug 18 11:25:04.918477 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 69/105] 10.222.0.73 () {62 vars in 1200 bytes} [Thu Aug 18 11:25:04 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 11:25:04.939107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eb3e1626-7c1c-4fb9-9446-fc253ce0dc44 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Calling method '.version_select at 0x7f51ac6a1f70>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:04.950379 n-d-853611-3 devstack@n-api.service[122209]: WARNING oslo_db.sqlalchemy.utils [None req-eb3e1626-7c1c-4fb9-9446-fc253ce0dc44 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 18 11:25:04.965093 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eb3e1626-7c1c-4fb9-9446-fc253ce0dc44 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] 10.222.0.73 "GET /compute/v2.1/os-keypairs?user_id=76e49ec649584422b2c6e4e73ec3ccb6" status: 200 len: 725 microversion: 2.10 time: 0.032792 Aug 18 11:25:04.966003 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 70/106] 10.222.0.73 () {60 vars in 1259 bytes} [Thu Aug 18 11:25:04 2022] GET /compute/v2.1/os-keypairs?user_id=76e49ec649584422b2c6e4e73ec3ccb6 => generated 725 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:04.978376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e52a6b09-c8ee-45d1-9634-7b1f97e631e7 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Calling method '.version_select at 0x7f51ac698310>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:05.009200 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e52a6b09-c8ee-45d1-9634-7b1f97e631e7 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1669883862" status: 204 len: 0 microversion: 2.10 time: 0.035315 Aug 18 11:25:05.012363 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 71/107] 10.222.0.73 () {60 vars in 1325 bytes} [Thu Aug 18 11:25:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1669883862 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 18 11:25:05.026846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-275a623e-1477-4cc6-8271-5b3a5c0d8799 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Calling method '.version_select at 0x7f51ac689d30>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:05.074288 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-275a623e-1477-4cc6-8271-5b3a5c0d8799 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1150474344?user_id=76e49ec649584422b2c6e4e73ec3ccb6" status: 204 len: 0 microversion: 2.10 time: 0.055667 Aug 18 11:25:05.075152 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 72/108] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:25:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1150474344?user_id=76e49ec649584422b2c6e4e73ec3ccb6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 18 11:25:05.087135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c3f1a188-0456-492b-919d-726a95a0a0c1 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] Calling method '.version_select at 0x7f51ac6a1a60>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:05.116297 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c3f1a188-0456-492b-919d-726a95a0a0c1 tempest-KeyPairsV210TestJSON-2055434363 tempest-KeyPairsV210TestJSON-2055434363-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-293170781?user_id=76e49ec649584422b2c6e4e73ec3ccb6" status: 204 len: 0 microversion: 2.10 time: 0.034277 Aug 18 11:25:05.117191 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 73/109] 10.222.0.73 () {60 vars in 1340 bytes} [Thu Aug 18 11:25:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-293170781?user_id=76e49ec649584422b2c6e4e73ec3ccb6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:25:05.270145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:25:05.937202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:25:05.937961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:25:05.938524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:25:05.938990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:25:05.939415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:25:05.965613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:05.966681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:05.968122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:05.968894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:05.970209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:05.970679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:06.026300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Getting quotas for project 2f9f8e64f23b4d8583490483c4030f40. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:25:06.034797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Getting quotas for user b935333d5dd84e61b99b5ea97050147a and project 2f9f8e64f23b4d8583490483c4030f40. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:25:06.050381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:25:06.055704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:25:06.183701 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-33592066-7cd7-449e-b6f0-509e3e7bddc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.544114 Aug 18 11:25:06.191239 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 37/110] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:25:06.196631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9b9c5488-8b8e-472e-97e1-098b8b450bed tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:06.197378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9b9c5488-8b8e-472e-97e1-098b8b450bed tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:07.679041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9b9c5488-8b8e-472e-97e1-098b8b450bed tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:07.713954 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9b9c5488-8b8e-472e-97e1-098b8b450bed tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1242 microversion: 2.1 time: 1.521096 Aug 18 11:25:07.729912 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 74/111] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:06 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1242 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:08.737597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b599ce5-3994-465f-a7b5-60506a6b3ed7 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:08.738980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9b599ce5-3994-465f-a7b5-60506a6b3ed7 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:08.777868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b599ce5-3994-465f-a7b5-60506a6b3ed7 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:08.778558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b599ce5-3994-465f-a7b5-60506a6b3ed7 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:08.779568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b599ce5-3994-465f-a7b5-60506a6b3ed7 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:08.785473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b599ce5-3994-465f-a7b5-60506a6b3ed7 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:08.786382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b599ce5-3994-465f-a7b5-60506a6b3ed7 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:08.792462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b599ce5-3994-465f-a7b5-60506a6b3ed7 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:09.257670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9b599ce5-3994-465f-a7b5-60506a6b3ed7 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:09.305042 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b599ce5-3994-465f-a7b5-60506a6b3ed7 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1290 microversion: 2.1 time: 0.572623 Aug 18 11:25:09.309078 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 38/112] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:08 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1290 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:10.307572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:10.331605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-69af6572-53cf-45fd-98c7-ed7c1e062720 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:10.333546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-69af6572-53cf-45fd-98c7-ed7c1e062720 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:10.340644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69af6572-53cf-45fd-98c7-ed7c1e062720 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:10.341529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69af6572-53cf-45fd-98c7-ed7c1e062720 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:10.342099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69af6572-53cf-45fd-98c7-ed7c1e062720 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:10.343172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69af6572-53cf-45fd-98c7-ed7c1e062720 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:10.344066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69af6572-53cf-45fd-98c7-ed7c1e062720 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:10.344902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69af6572-53cf-45fd-98c7-ed7c1e062720 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:10.486131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-69af6572-53cf-45fd-98c7-ed7c1e062720 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:10.496515 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-69af6572-53cf-45fd-98c7-ed7c1e062720 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1296 microversion: 2.1 time: 0.169393 Aug 18 11:25:10.498844 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 39/113] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:10 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1296 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:11.059624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c9565552-80be-431a-9671-afa7e6cf43b3 tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-159687318", "id": 450395240, "os-flavor-access:is_public": "False"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:11.063287 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:11.063287 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:11.073083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=12,nova_api:INSERT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:11.095728 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c9565552-80be-431a-9671-afa7e6cf43b3 tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.793080 Aug 18 11:25:11.097073 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 75/114] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:10 2022] POST /compute/v2.1/flavors => generated 427 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:11.111494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f316bc2a-e09e-4ce9-aec9-b66482cf74ba tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1f0426f92367479e8091ba2bc240901f"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:11.122703 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:11.122703 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:11.521796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-13c30740-2f1c-42ca-9104-0bb6fb9cc4e8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:11.522865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-13c30740-2f1c-42ca-9104-0bb6fb9cc4e8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:11.533029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13c30740-2f1c-42ca-9104-0bb6fb9cc4e8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:11.533525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13c30740-2f1c-42ca-9104-0bb6fb9cc4e8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:11.533960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13c30740-2f1c-42ca-9104-0bb6fb9cc4e8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:11.534719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13c30740-2f1c-42ca-9104-0bb6fb9cc4e8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:11.535876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13c30740-2f1c-42ca-9104-0bb6fb9cc4e8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:11.536888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13c30740-2f1c-42ca-9104-0bb6fb9cc4e8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:12.581264 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f316bc2a-e09e-4ce9-aec9-b66482cf74ba tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors/450395240/action" status: 200 len: 96 microversion: 2.1 time: 1.473989 Aug 18 11:25:12.589193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-13c30740-2f1c-42ca-9104-0bb6fb9cc4e8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:12.596952 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 40/115] 10.222.0.73 () {60 vars in 1197 bytes} [Thu Aug 18 11:25:11 2022] POST /compute/v2.1/flavors/450395240/action => generated 96 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:25:12.637500 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-13c30740-2f1c-42ca-9104-0bb6fb9cc4e8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1338 microversion: 2.1 time: 1.122439 Aug 18 11:25:12.639456 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 76/116] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:11 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1338 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:13.668469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d0117a64-3db9-4150-a643-c40803f45389 tempest-FlavorsAccessTestJSON-2000634976 tempest-FlavorsAccessTestJSON-2000634976-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:13.782634 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d0117a64-3db9-4150-a643-c40803f45389 tempest-FlavorsAccessTestJSON-2000634976 tempest-FlavorsAccessTestJSON-2000634976-project] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 1.180188 Aug 18 11:25:13.784973 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 41/117] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:12 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:13.812052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5f51b224-2ad3-4622-8da7-183132dc9cc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:13.814574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5f51b224-2ad3-4622-8da7-183132dc9cc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:13.840917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f51b224-2ad3-4622-8da7-183132dc9cc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:13.845887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f51b224-2ad3-4622-8da7-183132dc9cc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:13.849312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f51b224-2ad3-4622-8da7-183132dc9cc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:13.853144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f51b224-2ad3-4622-8da7-183132dc9cc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:13.854354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f51b224-2ad3-4622-8da7-183132dc9cc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:13.856543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f51b224-2ad3-4622-8da7-183132dc9cc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:13.918265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a5429c61-d90a-4c4f-a996-7e0c85c89fbd tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Calling method '.version_select at 0x7f51ac6a1160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:13.920239 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:13.920239 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:13.929087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5429c61-d90a-4c4f-a996-7e0c85c89fbd tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:13.933516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5429c61-d90a-4c4f-a996-7e0c85c89fbd tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:13.946039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5429c61-d90a-4c4f-a996-7e0c85c89fbd tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:14.036127 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5429c61-d90a-4c4f-a996-7e0c85c89fbd tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:14.039027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5429c61-d90a-4c4f-a996-7e0c85c89fbd tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:14.040435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5429c61-d90a-4c4f-a996-7e0c85c89fbd tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:14.084489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5429c61-d90a-4c4f-a996-7e0c85c89fbd tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:14.096513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5429c61-d90a-4c4f-a996-7e0c85c89fbd tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:14.102203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5429c61-d90a-4c4f-a996-7e0c85c89fbd tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:14.146099 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a5429c61-d90a-4c4f-a996-7e0c85c89fbd tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.182458 Aug 18 11:25:14.152232 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 77/118] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:25:14.196258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fba3f46f-2955-49d6-b7ab-5394ebd1a934 tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1f0426f92367479e8091ba2bc240901f"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:14.202054 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:14.202054 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:14.367548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5f51b224-2ad3-4622-8da7-183132dc9cc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:14.381443 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5f51b224-2ad3-4622-8da7-183132dc9cc4 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1338 microversion: 2.1 time: 0.591769 Aug 18 11:25:14.383093 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 42/119] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:13 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1338 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:14.904122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99bae97d-88dd-456b-b5d2-67a04dae0bc5 tempest-AZAdminNegativeTestJSON-1382143662 tempest-AZAdminNegativeTestJSON-1382143662-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:14.904921 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:14.904921 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:14.906442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-99bae97d-88dd-456b-b5d2-67a04dae0bc5 tempest-AZAdminNegativeTestJSON-1382143662 tempest-AZAdminNegativeTestJSON-1382143662-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'adf68805b9ee495595a80e6e8198794e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba655ab0b2fb4f7ab430b745168a25cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99bae97d-88dd-456b-b5d2-67a04dae0bc5 tempest-AZAdminNegativeTestJSON-1382143662 tempest-AZAdminNegativeTestJSON-1382143662-project] Request method failure captured: Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGVgoFcVh1eOlSESwiFI7a6BSkNN0rd-cekytVj4uTAaObL54WTxyCrLs9Dwbkj_N9E7-R_sGn3rTFOeQEHwizhgkcUjEe2mVTuevsPcufUWQRLgeR8H1H0Sm0veQUjYfGufbvq6KHSp834NwaWWj_rVux4cV2_QGcYXYboo1ACw_c Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ba655ab0b2fb4f7ab430b745168a25cf Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1382143662 Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:25:14.911378 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:25:14.912875 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ba655ab0b2fb4f7ab430b745168a25cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ba655ab0b2fb4f7ab430b745168a25cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ba655ab0b2fb4f7ab430b745168a25cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ba655ab0b2fb4f7ab430b745168a25cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:14.912875 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AZAdminNegativeTestJSON-1382143662 Aug 18 11:25:14.912875 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ba655ab0b2fb4f7ab430b745168a25cf Aug 18 11:25:14.912875 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1382143662 Aug 18 11:25:14.912875 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AZAdminNegativeTestJSON-1382143662-project Aug 18 11:25:14.912875 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:14.912875 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:14.912875 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: adf68805b9ee495595a80e6e8198794e Aug 18 11:25:14.912875 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AZAdminNegativeTestJSON-1382143662-project Aug 18 11:25:14.912875 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:25:14.912875 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 18 11:25:14.912875 n-d-853611-3 devstack@n-api.service[122210]: action_args: {} Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:14.913785 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:14.915062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99bae97d-88dd-456b-b5d2-67a04dae0bc5 tempest-AZAdminNegativeTestJSON-1382143662 tempest-AZAdminNegativeTestJSON-1382143662-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:14.916336 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-99bae97d-88dd-456b-b5d2-67a04dae0bc5 tempest-AZAdminNegativeTestJSON-1382143662 tempest-AZAdminNegativeTestJSON-1382143662-project] 10.222.0.73 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.529777 Aug 18 11:25:14.917853 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 43/120] 10.222.0.73 () {58 vars in 1185 bytes} [Thu Aug 18 11:25:14 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 534 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:14.936269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-18bdf49a-b63c-47cf-b627-d7974ac7e766 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Calling method '.version_select at 0x7f51ac7bd5e0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:14.941008 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:14.941008 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:14.945540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18bdf49a-b63c-47cf-b627-d7974ac7e766 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:14.947557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18bdf49a-b63c-47cf-b627-d7974ac7e766 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:14.951316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18bdf49a-b63c-47cf-b627-d7974ac7e766 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:15.038010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18bdf49a-b63c-47cf-b627-d7974ac7e766 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:15.040349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18bdf49a-b63c-47cf-b627-d7974ac7e766 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:15.042160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18bdf49a-b63c-47cf-b627-d7974ac7e766 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:15.135008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18bdf49a-b63c-47cf-b627-d7974ac7e766 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:15.137139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18bdf49a-b63c-47cf-b627-d7974ac7e766 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:15.138351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18bdf49a-b63c-47cf-b627-d7974ac7e766 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:15.159787 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-18bdf49a-b63c-47cf-b627-d7974ac7e766 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/n-h2-853611-3/servers" status: 200 len: 196 microversion: 2.1 time: 0.238847 Aug 18 11:25:15.161547 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 44/121] 10.222.0.73 () {58 vars in 1212 bytes} [Thu Aug 18 11:25:14 2022] GET /compute/v2.1/os-hypervisors/n-h2-853611-3/servers => generated 196 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:15.238393 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fba3f46f-2955-49d6-b7ab-5394ebd1a934 tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors/450395240/action" status: 200 len: 21 microversion: 2.1 time: 1.077717 Aug 18 11:25:15.239867 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 78/122] 10.222.0.73 () {60 vars in 1197 bytes} [Thu Aug 18 11:25:14 2022] POST /compute/v2.1/flavors/450395240/action => generated 21 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:25:15.268650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a787b3b8-aa03-4e1e-96b8-b922807ace3b tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Calling method '.version_select at 0x7f51ac58d550>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:15.271676 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:15.271676 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:15.275444 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a787b3b8-aa03-4e1e-96b8-b922807ace3b tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:15.279407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a787b3b8-aa03-4e1e-96b8-b922807ace3b tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:15.280308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a787b3b8-aa03-4e1e-96b8-b922807ace3b tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:15.339298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a787b3b8-aa03-4e1e-96b8-b922807ace3b tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:15.340380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a787b3b8-aa03-4e1e-96b8-b922807ace3b tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:15.341145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a787b3b8-aa03-4e1e-96b8-b922807ace3b tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:15.366582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a787b3b8-aa03-4e1e-96b8-b922807ace3b tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:15.367659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a787b3b8-aa03-4e1e-96b8-b922807ace3b tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:15.368383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a787b3b8-aa03-4e1e-96b8-b922807ace3b tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:15.382004 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a787b3b8-aa03-4e1e-96b8-b922807ace3b tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.132174 Aug 18 11:25:15.383538 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 79/123] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:15.401325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4b26b0b8-fce3-488c-9f24-37dbcc709c59 tempest-FlavorsAccessTestJSON-2000634976 tempest-FlavorsAccessTestJSON-2000634976-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:15.490326 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4b26b0b8-fce3-488c-9f24-37dbcc709c59 tempest-FlavorsAccessTestJSON-2000634976 tempest-FlavorsAccessTestJSON-2000634976-project] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.104447 Aug 18 11:25:15.496039 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 80/124] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:15.509732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5cfcb222-153b-420d-8f93-d0f5aa91d856 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Calling method '.version_select at 0x7f51ac63d3a0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:15.511302 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:15.511302 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:15.512722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfcb222-153b-420d-8f93-d0f5aa91d856 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:15.513797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfcb222-153b-420d-8f93-d0f5aa91d856 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:15.525758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfcb222-153b-420d-8f93-d0f5aa91d856 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:15.602829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfcb222-153b-420d-8f93-d0f5aa91d856 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:15.603334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfcb222-153b-420d-8f93-d0f5aa91d856 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:15.603910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfcb222-153b-420d-8f93-d0f5aa91d856 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:15.620620 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5cfcb222-153b-420d-8f93-d0f5aa91d856 tempest-HypervisorAdminUnderV252Test-385862693 tempest-HypervisorAdminUnderV252Test-385862693-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/n-h2-853611-3/search" status: 200 len: 104 microversion: 2.1 time: 0.120421 Aug 18 11:25:15.623010 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 81/125] 10.222.0.73 () {58 vars in 1209 bytes} [Thu Aug 18 11:25:15 2022] GET /compute/v2.1/os-hypervisors/n-h2-853611-3/search => generated 104 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:15.635267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-315f52c1-2196-4abe-af87-cbf2d8f6869b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:15.635984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-315f52c1-2196-4abe-af87-cbf2d8f6869b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:15.650315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-315f52c1-2196-4abe-af87-cbf2d8f6869b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:15.651368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-315f52c1-2196-4abe-af87-cbf2d8f6869b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:15.652730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-315f52c1-2196-4abe-af87-cbf2d8f6869b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:15.655511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-315f52c1-2196-4abe-af87-cbf2d8f6869b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:15.656226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-315f52c1-2196-4abe-af87-cbf2d8f6869b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:15.657090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-315f52c1-2196-4abe-af87-cbf2d8f6869b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:15.915726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-315f52c1-2196-4abe-af87-cbf2d8f6869b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:15.925223 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-315f52c1-2196-4abe-af87-cbf2d8f6869b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1338 microversion: 2.1 time: 0.300876 Aug 18 11:25:15.931146 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 82/126] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:15 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1338 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:15.943490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4d3d9b87-6032-45b6-b698-89131495e73e tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:15.946703 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:15.946703 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:15.982350 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4d3d9b87-6032-45b6-b698-89131495e73e tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/450395240" status: 202 len: 0 microversion: 2.1 time: 0.054762 Aug 18 11:25:15.983561 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 83/127] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:25:15 2022] DELETE /compute/v2.1/flavors/450395240 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:25:16.008635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=10 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:16.028699 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-684ec40c-4364-4810-b013-99540a596f46 tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:16.045217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:16.091718 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-684ec40c-4364-4810-b013-99540a596f46 tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.101754 Aug 18 11:25:16.094541 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 84/128] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:16.177593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99034dfa-5008-4534-9bbd-b129dc4af4e2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:16.192506 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-99034dfa-5008-4534-9bbd-b129dc4af4e2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.026304 Aug 18 11:25:16.193757 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 45/129] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:25:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:16.207012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8d2b4530-7bd8-40be-9a48-c2944603a253 tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1550304825", "id": 1405906093, "os-flavor-access:is_public": "False"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:16.214631 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:16.214631 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:16.250973 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8d2b4530-7bd8-40be-9a48-c2944603a253 tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.055652 Aug 18 11:25:16.264190 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 46/130] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:16 2022] POST /compute/v2.1/flavors => generated 431 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:16.398286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-85a1ebcf-dbb6-4c0e-b705-cead0dd73946 req-8f7cc9b4-511f-409e-abac-898e22a838ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ca1ed8-935b-4952-b52c-21029f23af9e", "tag": "b7e2bee5-614a-49db-839f-724b4e2a9fd9"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:16.419309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-85a1ebcf-dbb6-4c0e-b705-cead0dd73946 req-8f7cc9b4-511f-409e-abac-898e22a838ac service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:16.420277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-85a1ebcf-dbb6-4c0e-b705-cead0dd73946 req-8f7cc9b4-511f-409e-abac-898e22a838ac service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:16.421403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-85a1ebcf-dbb6-4c0e-b705-cead0dd73946 req-8f7cc9b4-511f-409e-abac-898e22a838ac service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:16.447485 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-85a1ebcf-dbb6-4c0e-b705-cead0dd73946 req-8f7cc9b4-511f-409e-abac-898e22a838ac service nova] Creating event network-changed:b7e2bee5-614a-49db-839f-724b4e2a9fd9 for instance 86ca1ed8-935b-4952-b52c-21029f23af9e on n-h2-853611-3 Aug 18 11:25:16.448289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-85a1ebcf-dbb6-4c0e-b705-cead0dd73946 req-8f7cc9b4-511f-409e-abac-898e22a838ac service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:25:16.448821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-85a1ebcf-dbb6-4c0e-b705-cead0dd73946 req-8f7cc9b4-511f-409e-abac-898e22a838ac service nova] Acquired lock "compute-rpcapi-router" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:25:16.450146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5888d224-59e4-4538-a597-337b0e0a9896 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:16.450781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5888d224-59e4-4538-a597-337b0e0a9896 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:16.451366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5888d224-59e4-4538-a597-337b0e0a9896 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:16.452233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5888d224-59e4-4538-a597-337b0e0a9896 None None] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:16.453351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5888d224-59e4-4538-a597-337b0e0a9896 None None] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:16.453914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5888d224-59e4-4538-a597-337b0e0a9896 None None] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:16.463828 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.compute.rpcapi [None req-5888d224-59e4-4538-a597-337b0e0a9896 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 11:25:16.465319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5888d224-59e4-4538-a597-337b0e0a9896 None None] Releasing lock "compute-rpcapi-router" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:25:16.508407 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5888d224-59e4-4538-a597-337b0e0a9896 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.412486 Aug 18 11:25:16.510080 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 85/131] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:16.524632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d0f5b85b-e11c-472d-9e54-28ef949a60bc tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:16.528013 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:16.528013 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:16.572255 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d0f5b85b-e11c-472d-9e54-28ef949a60bc tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/1405906093/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.060048 Aug 18 11:25:16.576292 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 86/132] 10.222.0.73 () {58 vars in 1209 bytes} [Thu Aug 18 11:25:16 2022] GET /compute/v2.1/flavors/1405906093/os-flavor-access => generated 21 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:25:16.595890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-39347d62-e9c3-42d5-a2e7-0583056f5085 tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:16.599751 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:16.599751 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:16.646279 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-39347d62-e9c3-42d5-a2e7-0583056f5085 tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/1405906093" status: 202 len: 0 microversion: 2.1 time: 0.061600 Aug 18 11:25:16.652820 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 87/133] 10.222.0.73 () {58 vars in 1161 bytes} [Thu Aug 18 11:25:16 2022] DELETE /compute/v2.1/flavors/1405906093 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:25:16.658681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1fda2964-b4e3-44d0-b292-a2f3df471ddb tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:16.696833 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1fda2964-b4e3-44d0-b292-a2f3df471ddb tempest-FlavorsAccessTestJSON-448670803 tempest-FlavorsAccessTestJSON-448670803-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042382 Aug 18 11:25:16.725505 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 88/134] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:16.950402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3accace4-9dd3-458b-aa47-037bfe098f12 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:16.951534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3accace4-9dd3-458b-aa47-037bfe098f12 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:16.961380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3accace4-9dd3-458b-aa47-037bfe098f12 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:16.962054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3accace4-9dd3-458b-aa47-037bfe098f12 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:16.962530 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3accace4-9dd3-458b-aa47-037bfe098f12 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:16.963423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3accace4-9dd3-458b-aa47-037bfe098f12 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:16.964109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3accace4-9dd3-458b-aa47-037bfe098f12 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:16.964830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3accace4-9dd3-458b-aa47-037bfe098f12 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:17.132162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6efde16b-acad-4b39-854f-f4651f392dc5 tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-385533189", "id": 482198356, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:17.160187 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6efde16b-acad-4b39-854f-f4651f392dc5 tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.883535 Aug 18 11:25:17.174261 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 47/135] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:16 2022] POST /compute/v2.1/flavors => generated 421 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:17.188820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02ae5b7a-664a-4fc6-abcb-80bb661aeb26 tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:17.204521 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-02ae5b7a-664a-4fc6-abcb-80bb661aeb26 tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028882 Aug 18 11:25:17.212262 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 48/136] 10.222.0.73 () {58 vars in 1182 bytes} [Thu Aug 18 11:25:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:25:17.223223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-87778f82-c848-4172-ad64-e88ddcd15735 tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1109581236", "id": 215349971, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:17.278725 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-87778f82-c848-4172-ad64-e88ddcd15735 tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.064440 Aug 18 11:25:17.279976 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 49/137] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:17 2022] POST /compute/v2.1/flavors => generated 422 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:17.293208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a68f8629-9e49-4cb0-bee7-64818e52a1d4 tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:17.311371 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a68f8629-9e49-4cb0-bee7-64818e52a1d4 tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022097 Aug 18 11:25:17.329289 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 50/138] 10.222.0.73 () {58 vars in 1182 bytes} [Thu Aug 18 11:25:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:25:17.341852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4da56195-9fb0-4d75-8cb9-ed3138cbd4fb tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Action: 'create', calling method: .version_select at 0x7f51ac6ff940>, body: {"keypair": {"name": "tempest-keypair-404870432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs8OyS/ENJC6Y9FwFj49P+ZPiaKe/mIAYINtWclvIxyMymbMKQdIyJWzOtDbAiuLyltORRAD3hNhIaTU/SG+LdwHgaT3+FByduHNJygw4pS5+7Xj/Up1QropTE7b5wPLw=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:17.418959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-4da56195-9fb0-4d75-8cb9-ed3138cbd4fb tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Getting quotas for project f4ef9f21efdd4ce1a61a905fec4ea89d. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:25:17.439559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-4da56195-9fb0-4d75-8cb9-ed3138cbd4fb tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Getting quotas for user d2cb8f009ae94e7199fd7153c87b099c and project f4ef9f21efdd4ce1a61a905fec4ea89d. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:25:17.446447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=9,nova_api:INSERT=9 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:17.509994 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4da56195-9fb0-4d75-8cb9-ed3138cbd4fb tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.179046 Aug 18 11:25:17.510629 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 51/139] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:25:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:17.700725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=14 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:18.606509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3accace4-9dd3-458b-aa47-037bfe098f12 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:18.615970 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3accace4-9dd3-458b-aa47-037bfe098f12 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1338 microversion: 2.1 time: 1.669159 Aug 18 11:25:18.644097 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 89/140] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:16 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1338 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:25:19.869270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ca1c2209-1d99-4f8b-bc0c-dd4fc9f5e7d2 tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1907462502", "ram": 512, "vcpus": 1, "disk": 10, "id": 1397191454, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:19.924846 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ca1c2209-1d99-4f8b-bc0c-dd4fc9f5e7d2 tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.972969 Aug 18 11:25:19.935451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cb09930c-3d82-4cdf-8103-82a06e2bd5ee tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Action: 'update', calling method: .version_select at 0x7f51ac5031f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:19.946481 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 52/141] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:18 2022] POST /compute/v2.1/flavors => generated 416 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:19.968778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c07cdb9c-cf59-4a48-9105-ab05a756e373 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:19.969665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c07cdb9c-cf59-4a48-9105-ab05a756e373 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:20.005039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c07cdb9c-cf59-4a48-9105-ab05a756e373 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:20.010728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c07cdb9c-cf59-4a48-9105-ab05a756e373 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:20.012030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c07cdb9c-cf59-4a48-9105-ab05a756e373 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:20.017534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c07cdb9c-cf59-4a48-9105-ab05a756e373 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:20.022004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c07cdb9c-cf59-4a48-9105-ab05a756e373 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:20.024691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c07cdb9c-cf59-4a48-9105-ab05a756e373 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:20.636422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c07cdb9c-cf59-4a48-9105-ab05a756e373 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:20.660476 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c07cdb9c-cf59-4a48-9105-ab05a756e373 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1338 microversion: 2.1 time: 0.712464 Aug 18 11:25:20.661375 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 53/142] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:19 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1338 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:20.687174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-edfb06f1-cfe2-4653-8636-94bc6d3e7811 tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:20.697023 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:20.697023 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:20.783255 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-edfb06f1-cfe2-4653-8636-94bc6d3e7811 tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors/1397191454/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.119210 Aug 18 11:25:20.787513 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 54/143] 10.222.0.73 () {60 vars in 1224 bytes} [Thu Aug 18 11:25:20 2022] POST /compute/v2.1/flavors/1397191454/os-extra_specs => generated 66 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:25:21.332456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb09930c-3d82-4cdf-8103-82a06e2bd5ee tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:21.333063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb09930c-3d82-4cdf-8103-82a06e2bd5ee tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:21.333539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb09930c-3d82-4cdf-8103-82a06e2bd5ee tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:21.334574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb09930c-3d82-4cdf-8103-82a06e2bd5ee tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:21.338998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb09930c-3d82-4cdf-8103-82a06e2bd5ee tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:21.339624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb09930c-3d82-4cdf-8103-82a06e2bd5ee tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:21.526332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59d902bc-3c6a-4660-befa-22a6e5076423 tempest-FlavorsExtraSpecsTestJSON-1860669216 tempest-FlavorsExtraSpecsTestJSON-1860669216-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:21.545586 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59d902bc-3c6a-4660-befa-22a6e5076423 tempest-FlavorsExtraSpecsTestJSON-1860669216 tempest-FlavorsExtraSpecsTestJSON-1860669216-project] 10.222.0.73 "GET /compute/v2.1/flavors/1397191454/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.752965 Aug 18 11:25:21.552178 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 55/144] 10.222.0.73 () {58 vars in 1203 bytes} [Thu Aug 18 11:25:20 2022] GET /compute/v2.1/flavors/1397191454/os-extra_specs => generated 66 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:25:21.570912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59aa71c9-977f-4147-834a-5bef23f33751 tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:21.579944 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cb09930c-3d82-4cdf-8103-82a06e2bd5ee tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/194f8609412e46688417393a48b7e6c0" status: 200 len: 240 microversion: 2.36 time: 2.347036 Aug 18 11:25:21.595526 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 90/145] 10.222.0.73 () {62 vars in 1303 bytes} [Thu Aug 18 11:25:19 2022] PUT /compute/v2.1/os-quota-sets/194f8609412e46688417393a48b7e6c0 => generated 240 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:21.618271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4a8e4d55-1aeb-4ae6-8daa-de03fe48cdd1 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Calling method '.version_select at 0x7f51ac4f8670>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:21.674365 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59aa71c9-977f-4147-834a-5bef23f33751 tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors/1397191454/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.113544 Aug 18 11:25:21.675652 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 56/146] 10.222.0.73 () {60 vars in 1224 bytes} [Thu Aug 18 11:25:21 2022] POST /compute/v2.1/flavors/1397191454/os-extra_specs => generated 66 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:25:21.687472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-46b6bdd7-a82e-47f6-ad55-0ce44e4ba56a tempest-FlavorsExtraSpecsTestJSON-1860669216 tempest-FlavorsExtraSpecsTestJSON-1860669216-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:21.710502 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-46b6bdd7-a82e-47f6-ad55-0ce44e4ba56a tempest-FlavorsExtraSpecsTestJSON-1860669216 tempest-FlavorsExtraSpecsTestJSON-1860669216-project] 10.222.0.73 "GET /compute/v2.1/flavors/1397191454/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.027653 Aug 18 11:25:21.711082 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 57/147] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 11:25:21 2022] GET /compute/v2.1/flavors/1397191454/os-extra_specs/hw:numa_nodes => generated 22 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 11:25:21.716279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11a51a6a-ff82-404f-9227-aabc27806599 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:21.720408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-11a51a6a-ff82-404f-9227-aabc27806599 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:21.729731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11a51a6a-ff82-404f-9227-aabc27806599 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:21.730867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11a51a6a-ff82-404f-9227-aabc27806599 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:21.734031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11a51a6a-ff82-404f-9227-aabc27806599 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:21.737991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11a51a6a-ff82-404f-9227-aabc27806599 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:21.738715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11a51a6a-ff82-404f-9227-aabc27806599 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:21.740485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11a51a6a-ff82-404f-9227-aabc27806599 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:22.173098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a8e4d55-1aeb-4ae6-8daa-de03fe48cdd1 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:22.174556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a8e4d55-1aeb-4ae6-8daa-de03fe48cdd1 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:22.175691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a8e4d55-1aeb-4ae6-8daa-de03fe48cdd1 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:22.178892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a8e4d55-1aeb-4ae6-8daa-de03fe48cdd1 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:22.180050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a8e4d55-1aeb-4ae6-8daa-de03fe48cdd1 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:22.181625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a8e4d55-1aeb-4ae6-8daa-de03fe48cdd1 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:22.236888 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4a8e4d55-1aeb-4ae6-8daa-de03fe48cdd1 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/194f8609412e46688417393a48b7e6c0/detail" status: 200 len: 672 microversion: 2.36 time: 0.625700 Aug 18 11:25:22.239166 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 91/148] 10.222.0.73 () {60 vars in 1304 bytes} [Thu Aug 18 11:25:21 2022] GET /compute/v2.1/os-quota-sets/194f8609412e46688417393a48b7e6c0/detail => generated 672 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 11:25:22.251098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ca4ca079-c932-41b7-ae91-2d55b77c0aae tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:22.258039 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:22.258039 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:22.327916 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ca4ca079-c932-41b7-ae91-2d55b77c0aae tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors/1397191454/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.087245 Aug 18 11:25:22.331574 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 92/149] 10.222.0.73 () {60 vars in 1224 bytes} [Thu Aug 18 11:25:22 2022] POST /compute/v2.1/flavors/1397191454/os-extra_specs => generated 66 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:25:22.342810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-96b0cd6d-d5b0-48a0-8946-bd408cd9d69e tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:22.369033 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-96b0cd6d-d5b0-48a0-8946-bd408cd9d69e tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/1397191454/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031779 Aug 18 11:25:22.373198 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 93/150] 10.222.0.73 () {58 vars in 1203 bytes} [Thu Aug 18 11:25:22 2022] GET /compute/v2.1/flavors/1397191454/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 11:25:22.394643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ef39c9ba-b093-4a7f-bc72-6589c3a3c5df tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:22.399580 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:22.399580 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:22.435930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11a51a6a-ff82-404f-9227-aabc27806599 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:22.459808 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-11a51a6a-ff82-404f-9227-aabc27806599 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1338 microversion: 2.1 time: 0.747418 Aug 18 11:25:22.485383 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 58/151] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:21 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1338 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:22.507824 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ef39c9ba-b093-4a7f-bc72-6589c3a3c5df tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] 10.222.0.73 "PUT /compute/v2.1/flavors/1397191454/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.125489 Aug 18 11:25:22.513871 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 94/152] 10.222.0.73 () {60 vars in 1265 bytes} [Thu Aug 18 11:25:22 2022] PUT /compute/v2.1/flavors/1397191454/os-extra_specs/hw:numa_nodes => generated 22 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:25:22.522376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d647c886-58f3-4894-ad6b-ba90ae78b1de tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:22.533282 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d647c886-58f3-4894-ad6b-ba90ae78b1de tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/1397191454/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015127 Aug 18 11:25:22.535504 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 59/153] 10.222.0.73 () {58 vars in 1203 bytes} [Thu Aug 18 11:25:22 2022] GET /compute/v2.1/flavors/1397191454/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:25:22.551771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7ad47ffc-3bd2-4b90-b5c4-81508e4a422e tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:22.553427 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:22.553427 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:22.610035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=7,nova_api:INSERT=1,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:22.629886 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7ad47ffc-3bd2-4b90-b5c4-81508e4a422e tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/1397191454/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.082612 Aug 18 11:25:22.631961 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 95/154] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:25:22 2022] DELETE /compute/v2.1/flavors/1397191454/os-extra_specs/hw:numa_nodes => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:22.643758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3aaf547c-0eb2-439b-ba16-db52dc90aad0 tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:22.645770 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:22.645770 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:22.687588 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3aaf547c-0eb2-439b-ba16-db52dc90aad0 tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/1397191454/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.049289 Aug 18 11:25:22.688575 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 60/155] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:25:22 2022] DELETE /compute/v2.1/flavors/1397191454/os-extra_specs/hw:cpu_policy => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:22.697756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-16ea95f7-a98d-4e6d-8f72-17e222550fc1 tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:22.723629 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-16ea95f7-a98d-4e6d-8f72-17e222550fc1 tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/1397191454/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023603 Aug 18 11:25:22.724378 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 96/156] 10.222.0.73 () {58 vars in 1203 bytes} [Thu Aug 18 11:25:22 2022] GET /compute/v2.1/flavors/1397191454/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:25:22.738224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c90e44b9-66bf-496a-9286-5f54d4fa93c9 tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:22.739307 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:22.739307 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:22.799703 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c90e44b9-66bf-496a-9286-5f54d4fa93c9 tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/1397191454" status: 202 len: 0 microversion: 2.1 time: 0.066930 Aug 18 11:25:22.803400 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 61/157] 10.222.0.73 () {58 vars in 1161 bytes} [Thu Aug 18 11:25:22 2022] DELETE /compute/v2.1/flavors/1397191454 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:25:22.812740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-61a137a5-5301-4a8e-b007-5d0cd3231273 tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:22.839592 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-61a137a5-5301-4a8e-b007-5d0cd3231273 tempest-FlavorsExtraSpecsTestJSON-122367518 tempest-FlavorsExtraSpecsTestJSON-122367518-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.032052 Aug 18 11:25:22.840217 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 97/158] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:22 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:25:22.873354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1195245972", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "215349971", "adminPass": "***", "networks": [{"uuid": "0a2a7a12-5844-4901-b419-1481340e7ff7"}], "security_groups": [{"name": "tempest-securitygroup--1501895346"}], "key_name": "tempest-keypair-404870432", "user_data": "}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:23.048368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] validate_networks() for [('0a2a7a12-5844-4901-b419-1481340e7ff7', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:25:23.387107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-808eb881-d888-45f6-9ea2-80af13350a45 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Action: 'update', calling method: .version_select at 0x7f51ac46edc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:23.662054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808eb881-d888-45f6-9ea2-80af13350a45 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:23.662769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808eb881-d888-45f6-9ea2-80af13350a45 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:23.663367 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808eb881-d888-45f6-9ea2-80af13350a45 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:23.664387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808eb881-d888-45f6-9ea2-80af13350a45 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:23.664996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808eb881-d888-45f6-9ea2-80af13350a45 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:23.665808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808eb881-d888-45f6-9ea2-80af13350a45 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:23.702956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808eb881-d888-45f6-9ea2-80af13350a45 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:23.704171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808eb881-d888-45f6-9ea2-80af13350a45 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:23.705112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808eb881-d888-45f6-9ea2-80af13350a45 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:23.706384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808eb881-d888-45f6-9ea2-80af13350a45 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:23.707200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808eb881-d888-45f6-9ea2-80af13350a45 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:23.707899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808eb881-d888-45f6-9ea2-80af13350a45 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:23.784491 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-808eb881-d888-45f6-9ea2-80af13350a45 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/194f8609412e46688417393a48b7e6c0?user_id=21266541fb01464d9ee7723d8a406f41" status: 200 len: 240 microversion: 2.36 time: 0.401622 Aug 18 11:25:23.786312 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 98/159] 10.222.0.73 () {62 vars in 1384 bytes} [Thu Aug 18 11:25:23 2022] PUT /compute/v2.1/os-quota-sets/194f8609412e46688417393a48b7e6c0?user_id=21266541fb01464d9ee7723d8a406f41 => generated 240 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:23.791607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4f97543b-49d8-4201-8fba-9a8f169be607 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:23.792243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4f97543b-49d8-4201-8fba-9a8f169be607 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:23.800218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f97543b-49d8-4201-8fba-9a8f169be607 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:23.801018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f97543b-49d8-4201-8fba-9a8f169be607 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:23.801464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f97543b-49d8-4201-8fba-9a8f169be607 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:23.802203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f97543b-49d8-4201-8fba-9a8f169be607 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:23.803371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f97543b-49d8-4201-8fba-9a8f169be607 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:23.803932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f97543b-49d8-4201-8fba-9a8f169be607 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:24.002418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4f97543b-49d8-4201-8fba-9a8f169be607 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:24.017869 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4f97543b-49d8-4201-8fba-9a8f169be607 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1338 microversion: 2.1 time: 0.230387 Aug 18 11:25:24.019810 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 99/160] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:23 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1338 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:24.027902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c152634c-870a-4dfb-a7b9-e8e4729093e2 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] Calling method '.version_select at 0x7f51ac4811f0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:24.192258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:25:24.192766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:25:24.198734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:25:24.199145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:25:24.199730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:25:24.213397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:24.214085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:24.214542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:24.215456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:24.215901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:24.216480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:24.235895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Getting quotas for project f4ef9f21efdd4ce1a61a905fec4ea89d. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:25:24.240338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Getting quotas for user d2cb8f009ae94e7199fd7153c87b099c and project f4ef9f21efdd4ce1a61a905fec4ea89d. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:25:24.251416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:25:24.253755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:25:24.303848 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-632c7e7b-937d-4d3b-8a21-4fc34f3bef59 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.438832 Aug 18 11:25:24.304820 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 62/161] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:25:24.316663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-39785a48-7795-4b2d-b7bf-1b871f6b2e1f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:24.317422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-39785a48-7795-4b2d-b7bf-1b871f6b2e1f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:24.400641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-39785a48-7795-4b2d-b7bf-1b871f6b2e1f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:24.414479 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-39785a48-7795-4b2d-b7bf-1b871f6b2e1f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1262 microversion: 2.1 time: 0.102707 Aug 18 11:25:24.415268 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 63/162] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:24 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1262 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:24.530357 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c152634c-870a-4dfb-a7b9-e8e4729093e2 tempest-QuotasAdminTestV236-1814849495 tempest-QuotasAdminTestV236-1814849495-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/194f8609412e46688417393a48b7e6c0?user_id=21266541fb01464d9ee7723d8a406f41" status: 200 len: 282 microversion: 2.36 time: 0.508306 Aug 18 11:25:24.532170 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 100/163] 10.222.0.73 () {60 vars in 1364 bytes} [Thu Aug 18 11:25:24 2022] GET /compute/v2.1/os-quota-sets/194f8609412e46688417393a48b7e6c0?user_id=21266541fb01464d9ee7723d8a406f41 => generated 282 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:25.041534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-90b112d6-b276-4b34-8492-a02b3febf3db tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:25.042542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-90b112d6-b276-4b34-8492-a02b3febf3db tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:25.068001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90b112d6-b276-4b34-8492-a02b3febf3db tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:25.068502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90b112d6-b276-4b34-8492-a02b3febf3db tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:25.068940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90b112d6-b276-4b34-8492-a02b3febf3db tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:25.072115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90b112d6-b276-4b34-8492-a02b3febf3db tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:25.072589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90b112d6-b276-4b34-8492-a02b3febf3db tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:25.073019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90b112d6-b276-4b34-8492-a02b3febf3db tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:25.076963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=61 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:25.308816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-90b112d6-b276-4b34-8492-a02b3febf3db tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:25.334326 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-90b112d6-b276-4b34-8492-a02b3febf3db tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1338 microversion: 2.1 time: 0.298819 Aug 18 11:25:25.337151 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 64/164] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:25 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1338 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:25:25.436064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4abf2676-8acd-4d46-9fae-7fd759b27b0a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:25.437083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4abf2676-8acd-4d46-9fae-7fd759b27b0a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:25.443518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4abf2676-8acd-4d46-9fae-7fd759b27b0a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:25.444070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4abf2676-8acd-4d46-9fae-7fd759b27b0a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:25.444527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4abf2676-8acd-4d46-9fae-7fd759b27b0a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:25.445257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4abf2676-8acd-4d46-9fae-7fd759b27b0a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:25.445720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4abf2676-8acd-4d46-9fae-7fd759b27b0a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:25.446143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4abf2676-8acd-4d46-9fae-7fd759b27b0a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:25.532029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4abf2676-8acd-4d46-9fae-7fd759b27b0a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:25.541437 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4abf2676-8acd-4d46-9fae-7fd759b27b0a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1258 microversion: 2.1 time: 0.109370 Aug 18 11:25:25.542396 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 101/165] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:25 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1258 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:26.355943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2aa66f85-d806-4440-92dc-0559855d5cbd tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:26.356875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2aa66f85-d806-4440-92dc-0559855d5cbd tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:26.365274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2aa66f85-d806-4440-92dc-0559855d5cbd tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:26.366227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2aa66f85-d806-4440-92dc-0559855d5cbd tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:26.367042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2aa66f85-d806-4440-92dc-0559855d5cbd tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:26.367976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2aa66f85-d806-4440-92dc-0559855d5cbd tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:26.368777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2aa66f85-d806-4440-92dc-0559855d5cbd tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:26.369405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2aa66f85-d806-4440-92dc-0559855d5cbd tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:26.535577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2aa66f85-d806-4440-92dc-0559855d5cbd tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:26.546540 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2aa66f85-d806-4440-92dc-0559855d5cbd tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1338 microversion: 2.1 time: 0.194431 Aug 18 11:25:26.548898 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 65/166] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:26 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1338 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:26.568693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ea4fc186-f2aa-4aec-992b-0d283cf81f6a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:26.569240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ea4fc186-f2aa-4aec-992b-0d283cf81f6a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:26.575453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ea4fc186-f2aa-4aec-992b-0d283cf81f6a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:26.575947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ea4fc186-f2aa-4aec-992b-0d283cf81f6a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:26.576428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ea4fc186-f2aa-4aec-992b-0d283cf81f6a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:26.583715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ea4fc186-f2aa-4aec-992b-0d283cf81f6a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:26.586284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ea4fc186-f2aa-4aec-992b-0d283cf81f6a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:26.587180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ea4fc186-f2aa-4aec-992b-0d283cf81f6a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:26.594170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=86 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:26.688259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ea4fc186-f2aa-4aec-992b-0d283cf81f6a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:26.701559 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ea4fc186-f2aa-4aec-992b-0d283cf81f6a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1320 microversion: 2.1 time: 0.137347 Aug 18 11:25:26.702604 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 102/167] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:26 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1320 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:27.018971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1172010647", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:27.101306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:25:27.182070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d035f389-26a4-418b-9775-0ce89030b891 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Calling method '.version_select at 0x7f51ac437940>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:27.183478 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:27.183478 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:27.185220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d035f389-26a4-418b-9775-0ce89030b891 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:27.186645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d035f389-26a4-418b-9775-0ce89030b891 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:27.187357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d035f389-26a4-418b-9775-0ce89030b891 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:27.215601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d035f389-26a4-418b-9775-0ce89030b891 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:27.216359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d035f389-26a4-418b-9775-0ce89030b891 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:27.216881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d035f389-26a4-418b-9775-0ce89030b891 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:27.236983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d035f389-26a4-418b-9775-0ce89030b891 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:27.237838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d035f389-26a4-418b-9775-0ce89030b891 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:27.238517 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d035f389-26a4-418b-9775-0ce89030b891 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:27.246170 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d035f389-26a4-418b-9775-0ce89030b891 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.542627 Aug 18 11:25:27.247039 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 103/168] 10.222.0.73 () {60 vars in 1187 bytes} [Thu Aug 18 11:25:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:27.261192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-93e21651-4e0b-46b9-9479-a34efb3357f3 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Calling method '.version_select at 0x7f51ac503b80>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:27.263024 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:27.263024 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:27.265260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93e21651-4e0b-46b9-9479-a34efb3357f3 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:27.265997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93e21651-4e0b-46b9-9479-a34efb3357f3 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:27.266704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93e21651-4e0b-46b9-9479-a34efb3357f3 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:27.285077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93e21651-4e0b-46b9-9479-a34efb3357f3 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:27.285934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93e21651-4e0b-46b9-9479-a34efb3357f3 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:27.286529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93e21651-4e0b-46b9-9479-a34efb3357f3 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:27.302954 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-93e21651-4e0b-46b9-9479-a34efb3357f3 tempest-HypervisorAdminV228Test-1154800912 tempest-HypervisorAdminV228Test-1154800912-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.043458 Aug 18 11:25:27.302954 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 104/169] 10.222.0.73 () {60 vars in 1193 bytes} [Thu Aug 18 11:25:27 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 11:25:27.416273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:25:27.417304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:25:27.417774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:25:27.418837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:25:27.419259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:25:27.439900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:27.442420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:27.442668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:27.445475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:27.445957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:27.447113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:27.500111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Getting quotas for project 89daeef39bfc4a6d9655a6adf698dcb3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:25:27.510795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Getting quotas for user 4888e1219d22476b8767e9fcef0bd6e0 and project 89daeef39bfc4a6d9655a6adf698dcb3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:25:27.536832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:25:27.539529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:25:27.636659 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7d6460ef-a01a-477c-a19c-5b41b3a6a93b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013488 Aug 18 11:25:27.646184 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 66/170] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:25:27.651644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-25af565e-a38a-4f01-97a1-d41918ce61e9 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:27.652551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-25af565e-a38a-4f01-97a1-d41918ce61e9 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:27.660310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25af565e-a38a-4f01-97a1-d41918ce61e9 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:27.661088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25af565e-a38a-4f01-97a1-d41918ce61e9 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:27.661698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25af565e-a38a-4f01-97a1-d41918ce61e9 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:27.662675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25af565e-a38a-4f01-97a1-d41918ce61e9 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:27.663332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25af565e-a38a-4f01-97a1-d41918ce61e9 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:27.663996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25af565e-a38a-4f01-97a1-d41918ce61e9 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:28.120426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-25af565e-a38a-4f01-97a1-d41918ce61e9 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:28.142893 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-25af565e-a38a-4f01-97a1-d41918ce61e9 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1338 microversion: 2.1 time: 0.494679 Aug 18 11:25:28.148582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6898201e-43df-4fe6-b450-708b5e5316b8 tempest-FlavorMetadataValidation-1908985580 tempest-FlavorMetadataValidation-1908985580-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-921245545", "id": 251778255, "os-flavor-access:is_public": "True"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:28.153875 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:28.153875 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:28.167373 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 67/171] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:27 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1338 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:28.185329 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6898201e-43df-4fe6-b450-708b5e5316b8 tempest-FlavorMetadataValidation-1908985580 tempest-FlavorMetadataValidation-1908985580-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.656339 Aug 18 11:25:28.187023 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 105/172] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:25:27 2022] POST /compute/v2.1/flavors => generated 467 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 11:25:28.199786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e7442371-3896-4e74-a570-70168e5ba28a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:28.200223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-324ffdd5-ea0a-4d51-ba0c-6b9985beb7aa tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:28.200402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e7442371-3896-4e74-a570-70168e5ba28a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:28.202180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-324ffdd5-ea0a-4d51-ba0c-6b9985beb7aa tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:28.209032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7442371-3896-4e74-a570-70168e5ba28a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:28.209793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7442371-3896-4e74-a570-70168e5ba28a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:28.210813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7442371-3896-4e74-a570-70168e5ba28a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:28.213163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7442371-3896-4e74-a570-70168e5ba28a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:28.214280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7442371-3896-4e74-a570-70168e5ba28a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:28.215305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7442371-3896-4e74-a570-70168e5ba28a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:28.227234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=10,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:28.331098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-324ffdd5-ea0a-4d51-ba0c-6b9985beb7aa tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:28.343468 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-324ffdd5-ea0a-4d51-ba0c-6b9985beb7aa tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 200 len: 1220 microversion: 2.1 time: 0.174392 Aug 18 11:25:28.344747 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 68/173] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:28 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 1220 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:28.349559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5232a0e0-ff0a-48cf-8db0-0a13d51c0171 tempest-FlavorMetadataValidation-1908985580 tempest-FlavorMetadataValidation-1908985580-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:28.354072 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:28.354072 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:28.377134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e7442371-3896-4e74-a570-70168e5ba28a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:28.390533 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e7442371-3896-4e74-a570-70168e5ba28a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1320 microversion: 2.1 time: 0.196977 Aug 18 11:25:28.394678 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 106/174] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:28 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1320 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:28.734928 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5232a0e0-ff0a-48cf-8db0-0a13d51c0171 tempest-FlavorMetadataValidation-1908985580 tempest-FlavorMetadataValidation-1908985580-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors/251778255/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.389122 Aug 18 11:25:28.736335 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 69/175] 10.222.0.73 () {62 vars in 1262 bytes} [Thu Aug 18 11:25:28 2022] POST /compute/v2.1/flavors/251778255/os-extra_specs => generated 62 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:28.746908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-97a4380d-94e5-4231-8937-e32daddd1efa tempest-FlavorMetadataValidation-1908985580 tempest-FlavorMetadataValidation-1908985580-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:28.747979 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:28.747979 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:28.771955 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-97a4380d-94e5-4231-8937-e32daddd1efa tempest-FlavorMetadataValidation-1908985580 tempest-FlavorMetadataValidation-1908985580-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/251778255" status: 202 len: 0 microversion: 2.86 time: 0.029170 Aug 18 11:25:28.773140 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 107/176] 10.222.0.73 () {60 vars in 1199 bytes} [Thu Aug 18 11:25:28 2022] DELETE /compute/v2.1/flavors/251778255 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:25:28.785169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c95e49c-dd94-4616-891c-81cf20fd8bc4 tempest-FlavorMetadataValidation-1908985580 tempest-FlavorMetadataValidation-1908985580-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:28.839693 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4c95e49c-dd94-4616-891c-81cf20fd8bc4 tempest-FlavorMetadataValidation-1908985580 tempest-FlavorMetadataValidation-1908985580-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 6678 microversion: 2.86 time: 0.058261 Aug 18 11:25:28.855805 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 70/177] 10.222.0.73 () {60 vars in 1187 bytes} [Thu Aug 18 11:25:28 2022] GET /compute/v2.1/flavors/detail => generated 6678 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:25:29.169212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3b71ad01-9c8f-46e5-b84d-906a0ea2402c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:29.170657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3b71ad01-9c8f-46e5-b84d-906a0ea2402c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:29.180322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b71ad01-9c8f-46e5-b84d-906a0ea2402c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:29.180778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b71ad01-9c8f-46e5-b84d-906a0ea2402c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:29.182082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b71ad01-9c8f-46e5-b84d-906a0ea2402c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:29.183296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b71ad01-9c8f-46e5-b84d-906a0ea2402c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:29.184063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b71ad01-9c8f-46e5-b84d-906a0ea2402c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:29.184739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b71ad01-9c8f-46e5-b84d-906a0ea2402c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:29.368226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f692551-a4de-4a87-8996-41f288b8f7b2 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:29.369189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f692551-a4de-4a87-8996-41f288b8f7b2 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:29.387072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f692551-a4de-4a87-8996-41f288b8f7b2 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:29.389388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f692551-a4de-4a87-8996-41f288b8f7b2 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:29.390247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f692551-a4de-4a87-8996-41f288b8f7b2 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:29.391318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f692551-a4de-4a87-8996-41f288b8f7b2 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:29.396563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f692551-a4de-4a87-8996-41f288b8f7b2 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:29.397667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f692551-a4de-4a87-8996-41f288b8f7b2 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:29.422101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3b71ad01-9c8f-46e5-b84d-906a0ea2402c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:29.433007 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3b71ad01-9c8f-46e5-b84d-906a0ea2402c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1338 microversion: 2.1 time: 0.268678 Aug 18 11:25:29.437452 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 108/178] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:29 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1338 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:29.455791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2cd5dad2-0bdf-4410-9c49-1877a3622df2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:29.456633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2cd5dad2-0bdf-4410-9c49-1877a3622df2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:29.464967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cd5dad2-0bdf-4410-9c49-1877a3622df2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:29.465592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cd5dad2-0bdf-4410-9c49-1877a3622df2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:29.466206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cd5dad2-0bdf-4410-9c49-1877a3622df2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:29.468130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cd5dad2-0bdf-4410-9c49-1877a3622df2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:29.468263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cd5dad2-0bdf-4410-9c49-1877a3622df2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:29.468838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cd5dad2-0bdf-4410-9c49-1877a3622df2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:29.486882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2f692551-a4de-4a87-8996-41f288b8f7b2 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:29.502002 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f692551-a4de-4a87-8996-41f288b8f7b2 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 200 len: 1293 microversion: 2.1 time: 0.135031 Aug 18 11:25:29.503360 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 71/179] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:29 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 1293 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:29.613702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2cd5dad2-0bdf-4410-9c49-1877a3622df2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:29.627049 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2cd5dad2-0bdf-4410-9c49-1877a3622df2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1320 microversion: 2.1 time: 0.183710 Aug 18 11:25:29.629095 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 109/180] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:29 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1320 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:30.347988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-186d7002-466f-4971-907c-072b74189d2c req-41629f28-5f63-420b-b954-b23c4f40ee48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ca1ed8-935b-4952-b52c-21029f23af9e", "name": "network-vif-plugged", "status": "completed", "tag": "b7e2bee5-614a-49db-839f-724b4e2a9fd9"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:30.404093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-186d7002-466f-4971-907c-072b74189d2c req-41629f28-5f63-420b-b954-b23c4f40ee48 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:30.407242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-186d7002-466f-4971-907c-072b74189d2c req-41629f28-5f63-420b-b954-b23c4f40ee48 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:30.407778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-186d7002-466f-4971-907c-072b74189d2c req-41629f28-5f63-420b-b954-b23c4f40ee48 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:30.478205 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-186d7002-466f-4971-907c-072b74189d2c req-41629f28-5f63-420b-b954-b23c4f40ee48 service nova] Creating event network-vif-plugged:b7e2bee5-614a-49db-839f-724b4e2a9fd9 for instance 86ca1ed8-935b-4952-b52c-21029f23af9e on n-h2-853611-3 Aug 18 11:25:30.488206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-186d7002-466f-4971-907c-072b74189d2c req-41629f28-5f63-420b-b954-b23c4f40ee48 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:25:30.489244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-186d7002-466f-4971-907c-072b74189d2c req-41629f28-5f63-420b-b954-b23c4f40ee48 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:25:30.491691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df3f1803-41d4-48d0-be47-4a076dd63c5e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:30.492537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df3f1803-41d4-48d0-be47-4a076dd63c5e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:30.493239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df3f1803-41d4-48d0-be47-4a076dd63c5e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:30.494130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df3f1803-41d4-48d0-be47-4a076dd63c5e None None] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:30.494764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df3f1803-41d4-48d0-be47-4a076dd63c5e None None] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:30.495346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df3f1803-41d4-48d0-be47-4a076dd63c5e None None] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:30.507944 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.compute.rpcapi [None req-df3f1803-41d4-48d0-be47-4a076dd63c5e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 11:25:30.515873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df3f1803-41d4-48d0-be47-4a076dd63c5e None None] Releasing lock "compute-rpcapi-router" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:25:30.522858 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ffe5c7ce-ff79-4948-8b40-afb6dff6424d tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Calling method '.version_select at 0x7f51ac437160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:30.566358 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df3f1803-41d4-48d0-be47-4a076dd63c5e None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.458805 Aug 18 11:25:30.568300 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 72/181] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:30.574346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ce8a0618-0542-43a6-b33c-0274333fc52e tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:30.575347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ce8a0618-0542-43a6-b33c-0274333fc52e tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:30.585494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce8a0618-0542-43a6-b33c-0274333fc52e tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:30.586175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce8a0618-0542-43a6-b33c-0274333fc52e tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:30.586804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce8a0618-0542-43a6-b33c-0274333fc52e tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:30.587872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce8a0618-0542-43a6-b33c-0274333fc52e tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:30.588491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce8a0618-0542-43a6-b33c-0274333fc52e tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:30.589305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce8a0618-0542-43a6-b33c-0274333fc52e tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:30.812628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ce8a0618-0542-43a6-b33c-0274333fc52e tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:30.822703 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ce8a0618-0542-43a6-b33c-0274333fc52e tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1338 microversion: 2.1 time: 0.252701 Aug 18 11:25:30.823686 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 73/182] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:30 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1338 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:30.829607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-81850fa3-15a8-46ab-b4f4-795cda16ea2e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:30.830474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-81850fa3-15a8-46ab-b4f4-795cda16ea2e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:30.836799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81850fa3-15a8-46ab-b4f4-795cda16ea2e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:30.837509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81850fa3-15a8-46ab-b4f4-795cda16ea2e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:30.838106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81850fa3-15a8-46ab-b4f4-795cda16ea2e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:30.839114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81850fa3-15a8-46ab-b4f4-795cda16ea2e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:30.839718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81850fa3-15a8-46ab-b4f4-795cda16ea2e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:30.840385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81850fa3-15a8-46ab-b4f4-795cda16ea2e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:30.937728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-81850fa3-15a8-46ab-b4f4-795cda16ea2e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:30.955932 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-81850fa3-15a8-46ab-b4f4-795cda16ea2e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 200 len: 1299 microversion: 2.1 time: 0.130253 Aug 18 11:25:30.957236 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 74/183] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:30 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:30.963513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9bab09d5-8cc4-4180-8c5a-f4553f9df364 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:30.964498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9bab09d5-8cc4-4180-8c5a-f4553f9df364 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:30.985415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bab09d5-8cc4-4180-8c5a-f4553f9df364 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:30.985919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bab09d5-8cc4-4180-8c5a-f4553f9df364 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:30.986381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bab09d5-8cc4-4180-8c5a-f4553f9df364 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:30.987121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bab09d5-8cc4-4180-8c5a-f4553f9df364 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:30.987580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bab09d5-8cc4-4180-8c5a-f4553f9df364 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:30.988026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bab09d5-8cc4-4180-8c5a-f4553f9df364 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:31.109888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9bab09d5-8cc4-4180-8c5a-f4553f9df364 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:31.121821 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9bab09d5-8cc4-4180-8c5a-f4553f9df364 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1320 microversion: 2.1 time: 0.163209 Aug 18 11:25:31.124067 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 75/184] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:30 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1320 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:31.386133 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ffe5c7ce-ff79-4948-8b40-afb6dff6424d tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0" status: 200 len: 371 microversion: 2.1 time: 1.068815 Aug 18 11:25:31.387053 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 110/185] 10.222.0.73 () {58 vars in 1242 bytes} [Thu Aug 18 11:25:30 2022] GET /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0 => generated 371 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:31.400077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-452dd055-1594-4ec5-9f15-b7fcc108179c tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Action: 'update', calling method: .version_select at 0x7f51ac811ee0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:31.847224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-23c475e5-d4f6-4a1b-9e94-f92b7ad4b59f tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:31.848713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-23c475e5-d4f6-4a1b-9e94-f92b7ad4b59f tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:31.859954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23c475e5-d4f6-4a1b-9e94-f92b7ad4b59f tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:31.862569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23c475e5-d4f6-4a1b-9e94-f92b7ad4b59f tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:31.866113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23c475e5-d4f6-4a1b-9e94-f92b7ad4b59f tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:31.867746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23c475e5-d4f6-4a1b-9e94-f92b7ad4b59f tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:31.870179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23c475e5-d4f6-4a1b-9e94-f92b7ad4b59f tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:31.872281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23c475e5-d4f6-4a1b-9e94-f92b7ad4b59f tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:32.046646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-452dd055-1594-4ec5-9f15-b7fcc108179c tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:32.049615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-452dd055-1594-4ec5-9f15-b7fcc108179c tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:32.050413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-452dd055-1594-4ec5-9f15-b7fcc108179c tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:32.053571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-452dd055-1594-4ec5-9f15-b7fcc108179c tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:32.059398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-452dd055-1594-4ec5-9f15-b7fcc108179c tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:32.061504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-452dd055-1594-4ec5-9f15-b7fcc108179c tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:32.184156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-23c475e5-d4f6-4a1b-9e94-f92b7ad4b59f tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:32.199646 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-23c475e5-d4f6-4a1b-9e94-f92b7ad4b59f tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1338 microversion: 2.1 time: 0.355625 Aug 18 11:25:32.218332 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 111/186] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:31 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1338 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:32.224320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-be848902-eb18-488a-91f5-1b726c99a731 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:32.224962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-be848902-eb18-488a-91f5-1b726c99a731 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:32.240153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be848902-eb18-488a-91f5-1b726c99a731 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:32.240653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be848902-eb18-488a-91f5-1b726c99a731 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:32.241088 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be848902-eb18-488a-91f5-1b726c99a731 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:32.241797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be848902-eb18-488a-91f5-1b726c99a731 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:32.242244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be848902-eb18-488a-91f5-1b726c99a731 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:32.249454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be848902-eb18-488a-91f5-1b726c99a731 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:32.274396 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-452dd055-1594-4ec5-9f15-b7fcc108179c tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0" status: 200 len: 328 microversion: 2.1 time: 0.871163 Aug 18 11:25:32.288704 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 76/187] 10.222.0.73 () {60 vars in 1262 bytes} [Thu Aug 18 11:25:31 2022] PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0 => generated 328 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:32.304681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bed90382-ecc8-4a62-9a54-0f64fbe79fda tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:32.305312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bed90382-ecc8-4a62-9a54-0f64fbe79fda tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:32.322061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bed90382-ecc8-4a62-9a54-0f64fbe79fda tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:32.322585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bed90382-ecc8-4a62-9a54-0f64fbe79fda tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:32.323024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bed90382-ecc8-4a62-9a54-0f64fbe79fda tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:32.323724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bed90382-ecc8-4a62-9a54-0f64fbe79fda tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:32.324220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bed90382-ecc8-4a62-9a54-0f64fbe79fda tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:32.328370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bed90382-ecc8-4a62-9a54-0f64fbe79fda tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:32.501220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-be848902-eb18-488a-91f5-1b726c99a731 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:32.502422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bed90382-ecc8-4a62-9a54-0f64fbe79fda tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:32.512319 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-be848902-eb18-488a-91f5-1b726c99a731 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 200 len: 1341 microversion: 2.1 time: 0.292758 Aug 18 11:25:32.515570 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 112/188] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:32 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 1341 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:32.515894 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bed90382-ecc8-4a62-9a54-0f64fbe79fda tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1320 microversion: 2.1 time: 0.225592 Aug 18 11:25:32.516491 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 77/189] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:32 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:32.670323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-aae5220f-4055-4418-b080-3cda6d47812b req-86057a98-fd46-41a2-90b8-f13254442406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5de87cb-7296-4818-98c3-8ef54eaae832", "tag": "69499d3b-66d5-414a-b16e-beb10a38cce8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:32.709427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aae5220f-4055-4418-b080-3cda6d47812b req-86057a98-fd46-41a2-90b8-f13254442406 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:32.711246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aae5220f-4055-4418-b080-3cda6d47812b req-86057a98-fd46-41a2-90b8-f13254442406 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:32.712219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aae5220f-4055-4418-b080-3cda6d47812b req-86057a98-fd46-41a2-90b8-f13254442406 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:32.740330 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-aae5220f-4055-4418-b080-3cda6d47812b req-86057a98-fd46-41a2-90b8-f13254442406 service nova] Creating event network-changed:69499d3b-66d5-414a-b16e-beb10a38cce8 for instance f5de87cb-7296-4818-98c3-8ef54eaae832 on n-h2-853611-3 Aug 18 11:25:32.747827 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-aae5220f-4055-4418-b080-3cda6d47812b req-86057a98-fd46-41a2-90b8-f13254442406 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084624 Aug 18 11:25:32.748975 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 78/190] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:32.833062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2058995562", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:32.933476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:25:33.404674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:25:33.405105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:25:33.405587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:25:33.406002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:25:33.406418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:25:33.425346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:33.425842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:33.426349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:33.427091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:33.427552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:33.427984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:33.476471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Getting quotas for project 3e4325e83c4644f982eca04c86527df0. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:25:33.482964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Getting quotas for user e61d177afe774ff6aa6b3e7b476383bc and project 3e4325e83c4644f982eca04c86527df0. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:25:33.496045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.utils [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] cores quota exceeded for 3e4325e83c4644f982eca04c86527df0, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122209) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 18 11:25:33.497066 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Request method failure captured: Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 145 Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGoLPT8kqC7vnpYBdnc1enIWJA0DHVRnJMOQWCqxhEEI9ztJDx_e9qInmeESvBmtVwPnEw6U7ZctOAgqx7Y1aR-EfmUoN8QsRpt7zJdViQyNoGXDXDnSJfI96cpv8jr3MdaaM1PHFyOjkR-Z9IpFO_-2AhY0o9Wk2b83NMRZ7nUKIg Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 3e4325e83c4644f982eca04c86527df0 Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-QuotasAdminNegativeTest-1562129330 Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:25:33.501256 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:25:33.502724 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3e4325e83c4644f982eca04c86527df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3e4325e83c4644f982eca04c86527df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3e4325e83c4644f982eca04c86527df0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3e4325e83c4644f982eca04c86527df0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:33.502724 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-QuotasAdminNegativeTest-1562129330 Aug 18 11:25:33.502724 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 3e4325e83c4644f982eca04c86527df0 Aug 18 11:25:33.502724 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1562129330 Aug 18 11:25:33.502724 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-QuotasAdminNegativeTest-1562129330-project Aug 18 11:25:33.502724 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:33.502724 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:33.502724 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e61d177afe774ff6aa6b3e7b476383bc Aug 18 11:25:33.502724 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-QuotasAdminNegativeTest-1562129330-project Aug 18 11:25:33.502724 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:25:33.502724 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2058995562", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} Aug 18 11:25:33.502724 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2058995562', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452'}}} Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 18 11:25:33.503431 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:33.505136 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:33.506284 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:33.509256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:33.509256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:33.509256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:33.509256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:33.509256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 18 11:25:33.509256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:33.509256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:33.509256 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ea61b7b5-1c0a-44b4-a92f-0ddef5600a94 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.975755 Aug 18 11:25:33.509256 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 113/191] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:32 2022] POST /compute/v2.1/servers => generated 111 bytes in 978 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:33.509256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-97b1898f-5a8c-40cd-b8f7-143727058f2c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:33.510701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-97b1898f-5a8c-40cd-b8f7-143727058f2c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:33.521471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97b1898f-5a8c-40cd-b8f7-143727058f2c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:33.522683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97b1898f-5a8c-40cd-b8f7-143727058f2c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:33.524218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97b1898f-5a8c-40cd-b8f7-143727058f2c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:33.525200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97b1898f-5a8c-40cd-b8f7-143727058f2c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:33.525883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97b1898f-5a8c-40cd-b8f7-143727058f2c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:33.526650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97b1898f-5a8c-40cd-b8f7-143727058f2c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:33.618080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1162220388", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:33.696730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-97b1898f-5a8c-40cd-b8f7-143727058f2c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:33.707393 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-97b1898f-5a8c-40cd-b8f7-143727058f2c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1488 microversion: 2.1 time: 0.201838 Aug 18 11:25:33.717959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:25:33.718081 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 114/192] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:33 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1488 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:33.734274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-155cb55d-8454-49bc-98d4-4936fb978c54 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Action: 'update', calling method: .version_select at 0x7f51ac4813a0>, body: {"quota_set": {"cores": 20}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:34.045449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:25:34.045881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:25:34.046468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:25:34.047069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:25:34.047513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:25:34.062307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:34.062853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:34.063297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:34.063989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:34.064460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:34.066214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:34.086387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Getting quotas for project 582d4d6dc459486cbfb696c35cc814f4. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:25:34.090621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Getting quotas for user cc840057087743e2b23eaf6da3997b56 and project 582d4d6dc459486cbfb696c35cc814f4. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:25:34.103184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:25:34.105670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:25:34.189162 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-99fa8b74-701d-4af3-9907-7676f10d8e22 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079153 Aug 18 11:25:34.191078 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 79/193] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:25:34.205064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e36074b-967c-4d70-ba50-23753a2fbe92 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:34.205397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e36074b-967c-4d70-ba50-23753a2fbe92 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:34.219062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e36074b-967c-4d70-ba50-23753a2fbe92 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:34.219565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e36074b-967c-4d70-ba50-23753a2fbe92 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:34.220243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e36074b-967c-4d70-ba50-23753a2fbe92 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:34.220983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e36074b-967c-4d70-ba50-23753a2fbe92 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:34.222509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e36074b-967c-4d70-ba50-23753a2fbe92 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:34.223153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e36074b-967c-4d70-ba50-23753a2fbe92 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:34.256440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-155cb55d-8454-49bc-98d4-4936fb978c54 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:34.256998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-155cb55d-8454-49bc-98d4-4936fb978c54 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:34.257337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-155cb55d-8454-49bc-98d4-4936fb978c54 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:34.258672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-155cb55d-8454-49bc-98d4-4936fb978c54 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:34.259133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-155cb55d-8454-49bc-98d4-4936fb978c54 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:34.262134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-155cb55d-8454-49bc-98d4-4936fb978c54 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:34.374467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:34.399890 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-155cb55d-8454-49bc-98d4-4936fb978c54 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0" status: 200 len: 329 microversion: 2.1 time: 0.679626 Aug 18 11:25:34.407983 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 115/194] 10.222.0.73 () {60 vars in 1262 bytes} [Thu Aug 18 11:25:33 2022] PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0 => generated 329 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:34.414403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7058124a-d835-4253-a624-49fb50f4fa21 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:34.421090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7058124a-d835-4253-a624-49fb50f4fa21 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:34.439318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7058124a-d835-4253-a624-49fb50f4fa21 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:34.441955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7058124a-d835-4253-a624-49fb50f4fa21 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:34.443107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7058124a-d835-4253-a624-49fb50f4fa21 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:34.444986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7058124a-d835-4253-a624-49fb50f4fa21 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:34.445691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7058124a-d835-4253-a624-49fb50f4fa21 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:34.447109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7058124a-d835-4253-a624-49fb50f4fa21 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:34.587257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e36074b-967c-4d70-ba50-23753a2fbe92 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:34.602776 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e36074b-967c-4d70-ba50-23753a2fbe92 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 200 len: 1341 microversion: 2.1 time: 0.409192 Aug 18 11:25:34.606365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 80/195] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:34 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 1341 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:34.615283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3ef564ea-fec4-46e6-ba5d-cb6c17a39d9c tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:34.616084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3ef564ea-fec4-46e6-ba5d-cb6c17a39d9c tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:34.639480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ef564ea-fec4-46e6-ba5d-cb6c17a39d9c tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:34.640761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ef564ea-fec4-46e6-ba5d-cb6c17a39d9c tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:34.641948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ef564ea-fec4-46e6-ba5d-cb6c17a39d9c tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:34.642897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ef564ea-fec4-46e6-ba5d-cb6c17a39d9c tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:34.643781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ef564ea-fec4-46e6-ba5d-cb6c17a39d9c tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:34.644402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ef564ea-fec4-46e6-ba5d-cb6c17a39d9c tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:34.814891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7058124a-d835-4253-a624-49fb50f4fa21 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:34.826046 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7058124a-d835-4253-a624-49fb50f4fa21 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1388 microversion: 2.1 time: 0.416647 Aug 18 11:25:34.826691 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 116/196] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:34 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1388 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:34.833247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6c4f76a7-c2ed-4fa0-a6c6-42468d013ef9 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:34.835285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6c4f76a7-c2ed-4fa0-a6c6-42468d013ef9 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:34.972262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6c4f76a7-c2ed-4fa0-a6c6-42468d013ef9 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc840057087743e2b23eaf6da3997b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582d4d6dc459486cbfb696c35cc814f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:34.983525 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6c4f76a7-c2ed-4fa0-a6c6-42468d013ef9 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 200 len: 1223 microversion: 2.1 time: 0.153873 Aug 18 11:25:34.998874 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 117/197] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:34 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 1223 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:35.009464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8dabc25d-6806-407b-9cda-73112e0fb863 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Calling method '.version_select at 0x7f51ac481c10>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:35.358801 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8dabc25d-6806-407b-9cda-73112e0fb863 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0" status: 200 len: 371 microversion: 2.1 time: 0.355822 Aug 18 11:25:35.370695 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 118/198] 10.222.0.73 () {58 vars in 1242 bytes} [Thu Aug 18 11:25:34 2022] GET /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0 => generated 371 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:35.491396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-edaaedac-eb57-436c-8a33-c6cac847830f tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Calling method '.version_select at 0x7f51ac3adf70>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:35.492194 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:35.492194 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:35.493374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edaaedac-eb57-436c-8a33-c6cac847830f tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:35.493794 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edaaedac-eb57-436c-8a33-c6cac847830f tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:35.494227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edaaedac-eb57-436c-8a33-c6cac847830f tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:35.496682 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3ef564ea-fec4-46e6-ba5d-cb6c17a39d9c tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1639 microversion: 2.1 time: 0.887048 Aug 18 11:25:35.497278 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 81/199] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:34 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1639 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:35.509466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edaaedac-eb57-436c-8a33-c6cac847830f tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:35.509946 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edaaedac-eb57-436c-8a33-c6cac847830f tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:35.510374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edaaedac-eb57-436c-8a33-c6cac847830f tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:35.522306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edaaedac-eb57-436c-8a33-c6cac847830f tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:35.522818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edaaedac-eb57-436c-8a33-c6cac847830f tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:35.523316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edaaedac-eb57-436c-8a33-c6cac847830f tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:35.529439 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-edaaedac-eb57-436c-8a33-c6cac847830f tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.168235 Aug 18 11:25:35.529998 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 119/200] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:35.539229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ec103ed7-3ff5-4ace-9150-045b14ad6401 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Action: 'update', calling method: .version_select at 0x7f51ac3adb80>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:35.551806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7e60d53-9d71-4fa6-bdff-7ec4719de5c5 tempest-FlavorsV255TestJSON-1082364338 tempest-FlavorsV255TestJSON-1082364338-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-512845104", "id": 2116211166, "os-flavor-access:is_public": "True"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:35.554925 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:35.554925 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:35.571371 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a7e60d53-9d71-4fa6-bdff-7ec4719de5c5 tempest-FlavorsV255TestJSON-1082364338 tempest-FlavorsV255TestJSON-1082364338-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.071959 Aug 18 11:25:35.572003 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 82/201] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:25:35 2022] POST /compute/v2.1/flavors => generated 448 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:35.631170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec103ed7-3ff5-4ace-9150-045b14ad6401 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:35.631655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec103ed7-3ff5-4ace-9150-045b14ad6401 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:35.635065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec103ed7-3ff5-4ace-9150-045b14ad6401 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:35.636382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec103ed7-3ff5-4ace-9150-045b14ad6401 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:35.637178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec103ed7-3ff5-4ace-9150-045b14ad6401 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:35.637881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d1833f05-3bc0-4dd0-a4b3-24ab8ec0b5d1 req-7eff5cb1-6f70-4bf9-beac-54d059ed0d76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22337998-2a5d-4fdc-a5f7-6d1067a13c9c", "tag": "ba49d06a-552b-4db3-9851-132789c232c7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:35.638070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec103ed7-3ff5-4ace-9150-045b14ad6401 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:35.650900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d1833f05-3bc0-4dd0-a4b3-24ab8ec0b5d1 req-7eff5cb1-6f70-4bf9-beac-54d059ed0d76 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:35.652088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d1833f05-3bc0-4dd0-a4b3-24ab8ec0b5d1 req-7eff5cb1-6f70-4bf9-beac-54d059ed0d76 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:35.652738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d1833f05-3bc0-4dd0-a4b3-24ab8ec0b5d1 req-7eff5cb1-6f70-4bf9-beac-54d059ed0d76 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:35.664286 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d1833f05-3bc0-4dd0-a4b3-24ab8ec0b5d1 req-7eff5cb1-6f70-4bf9-beac-54d059ed0d76 service nova] Creating event network-changed:ba49d06a-552b-4db3-9851-132789c232c7 for instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c on n-h1-853611-3 Aug 18 11:25:35.670832 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d1833f05-3bc0-4dd0-a4b3-24ab8ec0b5d1 req-7eff5cb1-6f70-4bf9-beac-54d059ed0d76 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097463 Aug 18 11:25:35.672619 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 83/202] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:35.680699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3e4e8922-aa12-4f70-baaf-bbe770a8f6c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:35.681478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3e4e8922-aa12-4f70-baaf-bbe770a8f6c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:35.693413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e4e8922-aa12-4f70-baaf-bbe770a8f6c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:35.693914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e4e8922-aa12-4f70-baaf-bbe770a8f6c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:35.694355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e4e8922-aa12-4f70-baaf-bbe770a8f6c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:35.695121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e4e8922-aa12-4f70-baaf-bbe770a8f6c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:35.695555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e4e8922-aa12-4f70-baaf-bbe770a8f6c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:35.695980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e4e8922-aa12-4f70-baaf-bbe770a8f6c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:35.715861 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ec103ed7-3ff5-4ace-9150-045b14ad6401 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0" status: 200 len: 328 microversion: 2.1 time: 0.180209 Aug 18 11:25:35.718278 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 120/203] 10.222.0.73 () {60 vars in 1262 bytes} [Thu Aug 18 11:25:35 2022] PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0 => generated 328 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:35.741795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3e4e8922-aa12-4f70-baaf-bbe770a8f6c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:25:35.909294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eec0ea30-8408-41d9-8dc2-dcac702e5b86 tempest-HypervisorAdminNegativeUnderV252Test-1970261739 tempest-HypervisorAdminNegativeUnderV252Test-1970261739-project] Calling method '.version_select at 0x7f51ac437670>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:35.910094 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:35.910094 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:35.911603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eec0ea30-8408-41d9-8dc2-dcac702e5b86 tempest-HypervisorAdminNegativeUnderV252Test-1970261739 tempest-HypervisorAdminNegativeUnderV252Test-1970261739-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'b8297c9ac4b54a7f9d391a800dc84810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79df98e6956f4606a1429381e452ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eec0ea30-8408-41d9-8dc2-dcac702e5b86 tempest-HypervisorAdminNegativeUnderV252Test-1970261739 tempest-HypervisorAdminNegativeUnderV252Test-1970261739-project] Request method failure captured: Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-hypervisors/n-h2-853611-3/search HTTP/1.1 Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGt5DIfo9YUiyetRH_gOLh2dyMYjWKarEyoK1lS3Fv_TZodLg_IMewn7_rjlTUm_jRirjCph8S3jgE4pm5BLH2FEOoBdZSV1H4ED1Deak4cpj6iTg2lO22ncitRTJGa8nCl4hIMOMJavXa1HqQqsKUd4lYgKV3xetXrmVUu7ZtKduI Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 79df98e6956f4606a1429381e452ae58 Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1970261739 Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:25:35.914201 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:25:35.915600 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/79df98e6956f4606a1429381e452ae58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/79df98e6956f4606a1429381e452ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_79df98e6956f4606a1429381e452ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/79df98e6956f4606a1429381e452ae58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:35.915600 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1970261739 Aug 18 11:25:35.915600 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 79df98e6956f4606a1429381e452ae58 Aug 18 11:25:35.915600 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1970261739 Aug 18 11:25:35.915600 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1970261739-project Aug 18 11:25:35.915600 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:35.915600 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:35.915600 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b8297c9ac4b54a7f9d391a800dc84810 Aug 18 11:25:35.915600 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1970261739-project Aug 18 11:25:35.915600 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:25:35.915600 n-d-853611-3 devstack@n-api.service[122209]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 18 11:25:35.915600 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'n-h2-853611-3'} Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:35.916241 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 18 11:25:35.917260 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:35.927059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eec0ea30-8408-41d9-8dc2-dcac702e5b86 tempest-HypervisorAdminNegativeUnderV252Test-1970261739 tempest-HypervisorAdminNegativeUnderV252Test-1970261739-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:35.931062 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eec0ea30-8408-41d9-8dc2-dcac702e5b86 tempest-HypervisorAdminNegativeUnderV252Test-1970261739 tempest-HypervisorAdminNegativeUnderV252Test-1970261739-project] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/n-h2-853611-3/search" status: 403 len: 117 microversion: 2.1 time: 0.210752 Aug 18 11:25:35.937398 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 121/204] 10.222.0.73 () {58 vars in 1209 bytes} [Thu Aug 18 11:25:35 2022] GET /compute/v2.1/os-hypervisors/n-h2-853611-3/search => generated 117 bytes in 219 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:35.947845 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3e4e8922-aa12-4f70-baaf-bbe770a8f6c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "DELETE /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 204 len: 0 microversion: 2.1 time: 0.273858 Aug 18 11:25:35.953227 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 84/205] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:25:35 2022] DELETE /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:25:35.977967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b4facbad-10c7-4ff7-bfe5-31803150298f tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:35.979173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b4facbad-10c7-4ff7-bfe5-31803150298f tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:36.132873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d4f345bb-e921-48aa-9a92-b9dd0f911bca tempest-FlavorsV255TestJSON-1189807044 tempest-FlavorsV255TestJSON-1189807044-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:36.146376 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d4f345bb-e921-48aa-9a92-b9dd0f911bca tempest-FlavorsV255TestJSON-1189807044 tempest-FlavorsV255TestJSON-1189807044-project] 10.222.0.73 "GET /compute/v2.1/flavors/2116211166" status: 200 len: 448 microversion: 2.55 time: 0.206817 Aug 18 11:25:36.148910 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 122/206] 10.222.0.73 () {60 vars in 1199 bytes} [Thu Aug 18 11:25:35 2022] GET /compute/v2.1/flavors/2116211166 => generated 448 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:36.157827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d1a14f15-1799-4fec-af59-6c7b78e6ebb5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:36.159399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d1a14f15-1799-4fec-af59-6c7b78e6ebb5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:36.162484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4facbad-10c7-4ff7-bfe5-31803150298f tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.162976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4facbad-10c7-4ff7-bfe5-31803150298f tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.163416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4facbad-10c7-4ff7-bfe5-31803150298f tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.164123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4facbad-10c7-4ff7-bfe5-31803150298f tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.164776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4facbad-10c7-4ff7-bfe5-31803150298f tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.165201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4facbad-10c7-4ff7-bfe5-31803150298f tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.169902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1a14f15-1799-4fec-af59-6c7b78e6ebb5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.171350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1a14f15-1799-4fec-af59-6c7b78e6ebb5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.172018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1a14f15-1799-4fec-af59-6c7b78e6ebb5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.173832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1a14f15-1799-4fec-af59-6c7b78e6ebb5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.174687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1a14f15-1799-4fec-af59-6c7b78e6ebb5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.176102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1a14f15-1799-4fec-af59-6c7b78e6ebb5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.370562 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d1a14f15-1799-4fec-af59-6c7b78e6ebb5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:36.380554 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d1a14f15-1799-4fec-af59-6c7b78e6ebb5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1388 microversion: 2.1 time: 0.230349 Aug 18 11:25:36.390568 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 123/207] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:36 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1388 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:36.390568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1176101549", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:36.450041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b4facbad-10c7-4ff7-bfe5-31803150298f tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:36.457979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:25:36.467600 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b4facbad-10c7-4ff7-bfe5-31803150298f tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 200 len: 1341 microversion: 2.1 time: 0.512340 Aug 18 11:25:36.468203 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 85/208] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:35 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 1341 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:36.473304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-57aa6b8b-7552-4437-aa45-81e6e3f9cb8a tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Calling method '.version_select at 0x7f51ac905550>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:36.473483 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:36.473483 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:36.474520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57aa6b8b-7552-4437-aa45-81e6e3f9cb8a tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.475005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57aa6b8b-7552-4437-aa45-81e6e3f9cb8a tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.475442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57aa6b8b-7552-4437-aa45-81e6e3f9cb8a tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.481433 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-57aa6b8b-7552-4437-aa45-81e6e3f9cb8a tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-57aa6b8b-7552-4437-aa45-81e6e3f9cb8a tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Request method failure captured: Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGugBLixEQ7YYc6kuGDTjUGMWCf2i_ql9lPYwfwO7nwSAOVagUIZyERhBOI7baXs7Od_wjJYLHCz6U1X69XlRGFXFg_cUZewEPjuHbEapwSBzWQiHTZnP3rl6H0Sj8hGRVhGU6lL7FfqsGmmmTC6rk9dlRScCmBexxU6zqabSQ2wc8 Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: d92d3f746899480a8f4bd208ef407648 Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-841559323 Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:25:36.484238 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:25:36.485384 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d92d3f746899480a8f4bd208ef407648"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d92d3f746899480a8f4bd208ef407648"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d92d3f746899480a8f4bd208ef407648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d92d3f746899480a8f4bd208ef407648"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:36.485384 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-841559323 Aug 18 11:25:36.485384 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: d92d3f746899480a8f4bd208ef407648 Aug 18 11:25:36.485384 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-841559323 Aug 18 11:25:36.485384 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin Aug 18 11:25:36.485384 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:36.485384 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:36.485384 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 090b36a62a3749ed9e296036140cc6d3 Aug 18 11:25:36.485384 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin Aug 18 11:25:36.485384 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:25:36.485384 n-d-853611-3 devstack@n-api.service[122210]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 18 11:25:36.485384 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:36.486052 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:36.487157 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:36.487157 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:36.487157 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:36.487157 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 18 11:25:36.487157 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:36.487157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-57aa6b8b-7552-4437-aa45-81e6e3f9cb8a tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:36.487157 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-57aa6b8b-7552-4437-aa45-81e6e3f9cb8a tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.016513 Aug 18 11:25:36.490200 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 86/209] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 11:25:36 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:36.495033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-51439269-4076-4a79-ae0f-106c59fa9ae8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:36.495759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-51439269-4076-4a79-ae0f-106c59fa9ae8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:36.503586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51439269-4076-4a79-ae0f-106c59fa9ae8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.504082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51439269-4076-4a79-ae0f-106c59fa9ae8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.504521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51439269-4076-4a79-ae0f-106c59fa9ae8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.505225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51439269-4076-4a79-ae0f-106c59fa9ae8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.505681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51439269-4076-4a79-ae0f-106c59fa9ae8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.506108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51439269-4076-4a79-ae0f-106c59fa9ae8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.522636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:36.650350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-51439269-4076-4a79-ae0f-106c59fa9ae8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:36.659174 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-51439269-4076-4a79-ae0f-106c59fa9ae8 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1494 microversion: 2.1 time: 0.167827 Aug 18 11:25:36.659810 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 87/210] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:36 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1494 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:36.664272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8acf1728-f889-4054-a155-2696bbb29c7a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:36.664881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8acf1728-f889-4054-a155-2696bbb29c7a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:36.671032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8acf1728-f889-4054-a155-2696bbb29c7a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.671807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8acf1728-f889-4054-a155-2696bbb29c7a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.672562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8acf1728-f889-4054-a155-2696bbb29c7a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.673213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8acf1728-f889-4054-a155-2696bbb29c7a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.673874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8acf1728-f889-4054-a155-2696bbb29c7a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.674483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8acf1728-f889-4054-a155-2696bbb29c7a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.748095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8acf1728-f889-4054-a155-2696bbb29c7a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc840057087743e2b23eaf6da3997b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582d4d6dc459486cbfb696c35cc814f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:36.756029 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8acf1728-f889-4054-a155-2696bbb29c7a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 200 len: 1281 microversion: 2.1 time: 0.095295 Aug 18 11:25:36.756602 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 88/211] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:36 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:36.761021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eeee4fab-daee-4b2b-b587-2306b22901c4 tempest-FlavorsV255TestJSON-1082364338 tempest-FlavorsV255TestJSON-1082364338-project-admin] Action: 'update', calling method: .version_select at 0x7f51ae917c10>, body: {"flavor": {"description": "new"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:36.773101 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:36.773101 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:36.797109 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eeee4fab-daee-4b2b-b587-2306b22901c4 tempest-FlavorsV255TestJSON-1082364338 tempest-FlavorsV255TestJSON-1082364338-project-admin] 10.222.0.73 "PUT /compute/v2.1/flavors/2116211166" status: 200 len: 449 microversion: 2.55 time: 0.039451 Aug 18 11:25:36.797705 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 89/212] 10.222.0.73 () {62 vars in 1219 bytes} [Thu Aug 18 11:25:36 2022] PUT /compute/v2.1/flavors/2116211166 => generated 449 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:36.802316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-223ba502-a375-40b3-8caa-35d2e53adf3c tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Calling method '.version_select at 0x7f51ac721790>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:36.803140 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:36.803140 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:36.804222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-223ba502-a375-40b3-8caa-35d2e53adf3c tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.804698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-223ba502-a375-40b3-8caa-35d2e53adf3c tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.805201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-223ba502-a375-40b3-8caa-35d2e53adf3c tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.821488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-223ba502-a375-40b3-8caa-35d2e53adf3c tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.821892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-223ba502-a375-40b3-8caa-35d2e53adf3c tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.822324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-223ba502-a375-40b3-8caa-35d2e53adf3c tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.833244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-223ba502-a375-40b3-8caa-35d2e53adf3c tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.833717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-223ba502-a375-40b3-8caa-35d2e53adf3c tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.834150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-223ba502-a375-40b3-8caa-35d2e53adf3c tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.840060 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-223ba502-a375-40b3-8caa-35d2e53adf3c tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.041397 Aug 18 11:25:36.840835 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 90/213] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:36.845964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e5aea52a-b503-4a17-a552-96e8358ef023 tempest-FlavorsV255TestJSON-1189807044 tempest-FlavorsV255TestJSON-1189807044-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:36.848565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:25:36.849120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:25:36.849671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:25:36.850325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:25:36.850844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:25:36.860403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.860993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.861489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.862277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.862984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.863560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.869335 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e5aea52a-b503-4a17-a552-96e8358ef023 tempest-FlavorsV255TestJSON-1189807044 tempest-FlavorsV255TestJSON-1189807044-project] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 6589 microversion: 2.55 time: 0.026976 Aug 18 11:25:36.869945 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 91/214] 10.222.0.73 () {60 vars in 1187 bytes} [Thu Aug 18 11:25:36 2022] GET /compute/v2.1/flavors/detail => generated 6589 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:25:36.882572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-276d0ccc-4ab4-4b6c-8636-fdea39800baa tempest-HypervisorAdminNegativeUnderV252Test-1970261739 tempest-HypervisorAdminNegativeUnderV252Test-1970261739-project] Calling method '.version_select at 0x7f51ac79b310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:36.882572 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:36.882572 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:36.882572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-276d0ccc-4ab4-4b6c-8636-fdea39800baa tempest-HypervisorAdminNegativeUnderV252Test-1970261739 tempest-HypervisorAdminNegativeUnderV252Test-1970261739-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'b8297c9ac4b54a7f9d391a800dc84810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79df98e6956f4606a1429381e452ae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:36.882572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-276d0ccc-4ab4-4b6c-8636-fdea39800baa tempest-HypervisorAdminNegativeUnderV252Test-1970261739 tempest-HypervisorAdminNegativeUnderV252Test-1970261739-project] Request method failure captured: Aug 18 11:25:36.882572 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 18 11:25:36.882572 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:36.882572 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:36.882572 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGt5DIfo9YUiyetRH_gOLh2dyMYjWKarEyoK1lS3Fv_TZodLg_IMewn7_rjlTUm_jRirjCph8S3jgE4pm5BLH2FEOoBdZSV1H4ED1Deak4cpj6iTg2lO22ncitRTJGa8nCl4hIMOMJavXa1HqQqsKUd4lYgKV3xetXrmVUu7ZtKduI Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 79df98e6956f4606a1429381e452ae58 Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1970261739 Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:25:36.883200 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/79df98e6956f4606a1429381e452ae58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/79df98e6956f4606a1429381e452ae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_79df98e6956f4606a1429381e452ae58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/79df98e6956f4606a1429381e452ae58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1970261739 Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 79df98e6956f4606a1429381e452ae58 Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1970261739 Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1970261739-project Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: b8297c9ac4b54a7f9d391a800dc84810 Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1970261739-project Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '1'} Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 18 11:25:36.884081 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:36.885322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:36.886331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:25:36.886331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:25:36.886331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 18 11:25:36.886331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:36.886331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-276d0ccc-4ab4-4b6c-8636-fdea39800baa tempest-HypervisorAdminNegativeUnderV252Test-1970261739 tempest-HypervisorAdminNegativeUnderV252Test-1970261739-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:36.886331 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-276d0ccc-4ab4-4b6c-8636-fdea39800baa tempest-HypervisorAdminNegativeUnderV252Test-1970261739 tempest-HypervisorAdminNegativeUnderV252Test-1970261739-project] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009414 Aug 18 11:25:36.886331 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 92/215] 10.222.0.73 () {58 vars in 1176 bytes} [Thu Aug 18 11:25:36 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:36.892216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-79d2c81d-228a-48fb-a386-31fadb457001 tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Calling method '.version_select at 0x7f51ac5f4820>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:36.895967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79d2c81d-228a-48fb-a386-31fadb457001 tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:36.896959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79d2c81d-228a-48fb-a386-31fadb457001 tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:36.898165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79d2c81d-228a-48fb-a386-31fadb457001 tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:36.908052 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-79d2c81d-228a-48fb-a386-31fadb457001 tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] HTTP exception thrown: No hypervisor matching '94fa7df0-daa3-4297-b221-238cc52e6f53' could be found. Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-79d2c81d-228a-48fb-a386-31fadb457001 tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Request method failure captured: Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-hypervisors/94fa7df0-daa3-4297-b221-238cc52e6f53/servers HTTP/1.1 Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGugBLixEQ7YYc6kuGDTjUGMWCf2i_ql9lPYwfwO7nwSAOVagUIZyERhBOI7baXs7Od_wjJYLHCz6U1X69XlRGFXFg_cUZewEPjuHbEapwSBzWQiHTZnP3rl6H0Sj8hGRVhGU6lL7FfqsGmmmTC6rk9dlRScCmBexxU6zqabSQ2wc8 Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: d92d3f746899480a8f4bd208ef407648 Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-841559323 Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:25:36.910407 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:25:36.911792 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d92d3f746899480a8f4bd208ef407648"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d92d3f746899480a8f4bd208ef407648"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d92d3f746899480a8f4bd208ef407648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d92d3f746899480a8f4bd208ef407648"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:36.911792 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-841559323 Aug 18 11:25:36.911792 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: d92d3f746899480a8f4bd208ef407648 Aug 18 11:25:36.911792 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-841559323 Aug 18 11:25:36.911792 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin Aug 18 11:25:36.911792 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:36.911792 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:36.911792 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 090b36a62a3749ed9e296036140cc6d3 Aug 18 11:25:36.911792 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin Aug 18 11:25:36.911792 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:25:36.911792 n-d-853611-3 devstack@n-api.service[122210]: exception: No hypervisor matching '94fa7df0-daa3-4297-b221-238cc52e6f53' could be found. Aug 18 11:25:36.911792 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '94fa7df0-daa3-4297-b221-238cc52e6f53'} Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '94fa7df0-daa3-4297-b221-238cc52e6f53' could be found. Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:36.912446 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:36.913535 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:36.913535 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:36.913535 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:36.913535 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:36.913535 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '94fa7df0-daa3-4297-b221-238cc52e6f53' could be found. Aug 18 11:25:36.913535 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:36.915528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-79d2c81d-228a-48fb-a386-31fadb457001 tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] Returning 404 to user: No hypervisor matching '94fa7df0-daa3-4297-b221-238cc52e6f53' could be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:36.917000 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-79d2c81d-228a-48fb-a386-31fadb457001 tempest-HypervisorAdminNegativeUnderV252Test-841559323 tempest-HypervisorAdminNegativeUnderV252Test-841559323-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/94fa7df0-daa3-4297-b221-238cc52e6f53/servers" status: 404 len: 123 microversion: 2.1 time: 0.030490 Aug 18 11:25:36.918589 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 93/216] 10.222.0.73 () {58 vars in 1281 bytes} [Thu Aug 18 11:25:36 2022] GET /compute/v2.1/os-hypervisors/94fa7df0-daa3-4297-b221-238cc52e6f53/servers => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:36.927367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0dbc8cb3-5d23-4124-8f42-ac22b5823575 tempest-FlavorsV255TestJSON-1189807044 tempest-FlavorsV255TestJSON-1189807044-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:36.957267 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0dbc8cb3-5d23-4124-8f42-ac22b5823575 tempest-FlavorsV255TestJSON-1189807044 tempest-FlavorsV255TestJSON-1189807044-project] 10.222.0.73 "GET /compute/v2.1/flavors" status: 200 len: 3679 microversion: 2.55 time: 0.036835 Aug 18 11:25:36.969838 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 94/217] 10.222.0.73 () {60 vars in 1166 bytes} [Thu Aug 18 11:25:36 2022] GET /compute/v2.1/flavors => generated 3679 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:25:36.976871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11b31aa3-eec5-4333-88a2-0a7d7217ad46 tempest-FlavorsV255TestJSON-1082364338 tempest-FlavorsV255TestJSON-1082364338-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:36.977905 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:36.977905 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:36.982691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=2,nova_api:INSERT=7,nova_api:RELEASE=2,nova_api:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:37.006474 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-11b31aa3-eec5-4333-88a2-0a7d7217ad46 tempest-FlavorsV255TestJSON-1082364338 tempest-FlavorsV255TestJSON-1082364338-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/2116211166" status: 202 len: 0 microversion: 2.55 time: 0.034747 Aug 18 11:25:37.011519 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 95/218] 10.222.0.73 () {60 vars in 1202 bytes} [Thu Aug 18 11:25:36 2022] DELETE /compute/v2.1/flavors/2116211166 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:25:37.026887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f476b33c-90a9-4c61-ae51-5a348439137d tempest-FlavorsV255TestJSON-1082364338 tempest-FlavorsV255TestJSON-1082364338-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:37.088905 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f476b33c-90a9-4c61-ae51-5a348439137d tempest-FlavorsV255TestJSON-1082364338 tempest-FlavorsV255TestJSON-1082364338-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 6150 microversion: 2.55 time: 0.073848 Aug 18 11:25:37.102695 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 96/219] 10.222.0.73 () {60 vars in 1187 bytes} [Thu Aug 18 11:25:37 2022] GET /compute/v2.1/flavors/detail => generated 6150 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:25:37.104491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Getting quotas for project 3e4325e83c4644f982eca04c86527df0. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:25:37.115951 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Getting quotas for user e61d177afe774ff6aa6b3e7b476383bc and project 3e4325e83c4644f982eca04c86527df0. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:25:37.134309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.utils [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] instances quota exceeded for 3e4325e83c4644f982eca04c86527df0, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122209) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 18 11:25:37.134759 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Request method failure captured: Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 145 Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGoLPT8kqC7vnpYBdnc1enIWJA0DHVRnJMOQWCqxhEEI9ztJDx_e9qInmeESvBmtVwPnEw6U7ZctOAgqx7Y1aR-EfmUoN8QsRpt7zJdViQyNoGXDXDnSJfI96cpv8jr3MdaaM1PHFyOjkR-Z9IpFO_-2AhY0o9Wk2b83NMRZ7nUKIg Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 3e4325e83c4644f982eca04c86527df0 Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-QuotasAdminNegativeTest-1562129330 Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:25:37.136719 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:25:37.137946 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3e4325e83c4644f982eca04c86527df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3e4325e83c4644f982eca04c86527df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3e4325e83c4644f982eca04c86527df0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3e4325e83c4644f982eca04c86527df0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:37.137946 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-QuotasAdminNegativeTest-1562129330 Aug 18 11:25:37.137946 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 3e4325e83c4644f982eca04c86527df0 Aug 18 11:25:37.137946 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1562129330 Aug 18 11:25:37.137946 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-QuotasAdminNegativeTest-1562129330-project Aug 18 11:25:37.137946 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:37.137946 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:37.137946 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e61d177afe774ff6aa6b3e7b476383bc Aug 18 11:25:37.137946 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-QuotasAdminNegativeTest-1562129330-project Aug 18 11:25:37.137946 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:25:37.137946 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1176101549", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} Aug 18 11:25:37.137946 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1176101549', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452'}}} Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 18 11:25:37.138707 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:37.139771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:37.140835 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:37.141890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:37.141890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:37.141890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:37.141890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:37.141890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 18 11:25:37.141890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:37.141890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:37.141890 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a7b7725c-2673-4cb5-bcba-3d27ee3efcde tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.755924 Aug 18 11:25:37.142726 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 124/220] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:36 2022] POST /compute/v2.1/servers => generated 119 bytes in 761 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:37.152050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d56af70c-7192-454a-bcce-4929eb1fb0a0 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Action: 'update', calling method: .version_select at 0x7f51ac65b040>, body: {"quota_set": {"instances": 10}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:37.406155 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dcdac2c6-a6ec-4254-90ee-ca48bee3ceb9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:37.407413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dcdac2c6-a6ec-4254-90ee-ca48bee3ceb9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:37.414299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcdac2c6-a6ec-4254-90ee-ca48bee3ceb9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:37.414948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcdac2c6-a6ec-4254-90ee-ca48bee3ceb9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:37.419051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcdac2c6-a6ec-4254-90ee-ca48bee3ceb9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:37.420198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcdac2c6-a6ec-4254-90ee-ca48bee3ceb9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:37.420777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcdac2c6-a6ec-4254-90ee-ca48bee3ceb9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:37.422028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcdac2c6-a6ec-4254-90ee-ca48bee3ceb9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:37.488230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d56af70c-7192-454a-bcce-4929eb1fb0a0 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:37.489111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d56af70c-7192-454a-bcce-4929eb1fb0a0 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:37.490044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d56af70c-7192-454a-bcce-4929eb1fb0a0 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:37.490839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d56af70c-7192-454a-bcce-4929eb1fb0a0 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:37.491300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d56af70c-7192-454a-bcce-4929eb1fb0a0 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:37.491912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d56af70c-7192-454a-bcce-4929eb1fb0a0 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:37.590671 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d56af70c-7192-454a-bcce-4929eb1fb0a0 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0" status: 200 len: 329 microversion: 2.1 time: 0.445694 Aug 18 11:25:37.592012 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 97/221] 10.222.0.73 () {60 vars in 1262 bytes} [Thu Aug 18 11:25:37 2022] PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0 => generated 329 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:37.624305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-48334348-9495-46af-9613-c6b8e7206552 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:37.624963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-48334348-9495-46af-9613-c6b8e7206552 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:37.645285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48334348-9495-46af-9613-c6b8e7206552 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:37.645790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48334348-9495-46af-9613-c6b8e7206552 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:37.646238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48334348-9495-46af-9613-c6b8e7206552 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:37.649495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48334348-9495-46af-9613-c6b8e7206552 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:37.651999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48334348-9495-46af-9613-c6b8e7206552 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:37.652457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48334348-9495-46af-9613-c6b8e7206552 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:37.921679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-48334348-9495-46af-9613-c6b8e7206552 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:37.936102 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-48334348-9495-46af-9613-c6b8e7206552 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 200 len: 1341 microversion: 2.1 time: 0.341865 Aug 18 11:25:37.937048 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 98/222] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:37 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 1341 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:37.943503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-347150d1-05a7-4f31-8229-ab866bce0d1b tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Calling method '.version_select at 0x7f51ac5893a0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:38.021951 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dcdac2c6-a6ec-4254-90ee-ca48bee3ceb9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:38.030714 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dcdac2c6-a6ec-4254-90ee-ca48bee3ceb9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1388 microversion: 2.1 time: 0.633049 Aug 18 11:25:38.040453 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-347150d1-05a7-4f31-8229-ab866bce0d1b tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0" status: 200 len: 371 microversion: 2.1 time: 0.101788 Aug 18 11:25:38.041793 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 99/223] 10.222.0.73 () {58 vars in 1242 bytes} [Thu Aug 18 11:25:37 2022] GET /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0 => generated 371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:38.042990 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 125/224] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:37 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1388 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:38.049051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c8a31f88-a609-417c-9962-39999f58de9d tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:38.050593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c8a31f88-a609-417c-9962-39999f58de9d tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:38.056109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a60324e1-b030-472f-9857-0b47084a538e tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:38.056920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a60324e1-b030-472f-9857-0b47084a538e tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:38.059584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8a31f88-a609-417c-9962-39999f58de9d tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:38.062162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8a31f88-a609-417c-9962-39999f58de9d tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:38.064011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8a31f88-a609-417c-9962-39999f58de9d tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:38.064626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a60324e1-b030-472f-9857-0b47084a538e tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:38.065264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8a31f88-a609-417c-9962-39999f58de9d tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:38.065433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a60324e1-b030-472f-9857-0b47084a538e tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:38.065744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8a31f88-a609-417c-9962-39999f58de9d tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:38.066133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a60324e1-b030-472f-9857-0b47084a538e tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:38.066237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8a31f88-a609-417c-9962-39999f58de9d tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:38.067094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a60324e1-b030-472f-9857-0b47084a538e tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:38.067689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a60324e1-b030-472f-9857-0b47084a538e tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:38.068255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a60324e1-b030-472f-9857-0b47084a538e tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:38.431762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c8a31f88-a609-417c-9962-39999f58de9d tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:38.440386 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c8a31f88-a609-417c-9962-39999f58de9d tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1494 microversion: 2.1 time: 0.397066 Aug 18 11:25:38.454948 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 100/225] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:38 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1494 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:38.461514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34bd717e-31af-4542-98e9-0921bb729343 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Action: 'update', calling method: .version_select at 0x7f51ac589e50>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:38.511585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a60324e1-b030-472f-9857-0b47084a538e tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc840057087743e2b23eaf6da3997b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582d4d6dc459486cbfb696c35cc814f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:38.526712 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a60324e1-b030-472f-9857-0b47084a538e tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 200 len: 1323 microversion: 2.1 time: 0.482231 Aug 18 11:25:38.541028 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 126/226] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:38 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 1323 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:38.945215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34bd717e-31af-4542-98e9-0921bb729343 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:38.947754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34bd717e-31af-4542-98e9-0921bb729343 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:38.949138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34bd717e-31af-4542-98e9-0921bb729343 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:38.953234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34bd717e-31af-4542-98e9-0921bb729343 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:38.953234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34bd717e-31af-4542-98e9-0921bb729343 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:38.953234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34bd717e-31af-4542-98e9-0921bb729343 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:38.959569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f1f9b1f2-8285-473a-bc9e-d4f63439ef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:38.960347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f1f9b1f2-8285-473a-bc9e-d4f63439ef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:38.968560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1f9b1f2-8285-473a-bc9e-d4f63439ef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:38.977105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1f9b1f2-8285-473a-bc9e-d4f63439ef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:38.977931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1f9b1f2-8285-473a-bc9e-d4f63439ef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:38.979499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1f9b1f2-8285-473a-bc9e-d4f63439ef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:38.981605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1f9b1f2-8285-473a-bc9e-d4f63439ef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:38.983544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1f9b1f2-8285-473a-bc9e-d4f63439ef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:39.080280 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34bd717e-31af-4542-98e9-0921bb729343 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0" status: 200 len: 325 microversion: 2.1 time: 0.624002 Aug 18 11:25:39.103782 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 101/227] 10.222.0.73 () {60 vars in 1262 bytes} [Thu Aug 18 11:25:38 2022] PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0 => generated 325 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:39.126241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-837c5aac-523c-4415-ab1f-91c3959631aa tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:39.127934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-837c5aac-523c-4415-ab1f-91c3959631aa tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:39.153832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-837c5aac-523c-4415-ab1f-91c3959631aa tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:39.156166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-837c5aac-523c-4415-ab1f-91c3959631aa tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:39.158373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-837c5aac-523c-4415-ab1f-91c3959631aa tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:39.163010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-837c5aac-523c-4415-ab1f-91c3959631aa tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:39.164572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-837c5aac-523c-4415-ab1f-91c3959631aa tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:39.166868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-837c5aac-523c-4415-ab1f-91c3959631aa tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:39.608698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-837c5aac-523c-4415-ab1f-91c3959631aa tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:39.616515 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-837c5aac-523c-4415-ab1f-91c3959631aa tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1388 microversion: 2.1 time: 0.510764 Aug 18 11:25:39.626810 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 102/228] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:39 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1388 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:39.639574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1514916716", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:39.682935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f1f9b1f2-8285-473a-bc9e-d4f63439ef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:39.706646 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f1f9b1f2-8285-473a-bc9e-d4f63439ef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 200 len: 1341 microversion: 2.1 time: 0.750205 Aug 18 11:25:39.708457 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 127/229] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:38 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 1341 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:39.730810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-14bf6059-e17f-4e73-87db-989622f45712 req-ad54c12d-e8ee-411a-977e-0a2f9cfec413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ca1ed8-935b-4952-b52c-21029f23af9e", "name": "network-vif-deleted", "tag": "b7e2bee5-614a-49db-839f-724b4e2a9fd9"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:39.737869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:25:39.757177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-14bf6059-e17f-4e73-87db-989622f45712 req-ad54c12d-e8ee-411a-977e-0a2f9cfec413 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:39.757979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-14bf6059-e17f-4e73-87db-989622f45712 req-ad54c12d-e8ee-411a-977e-0a2f9cfec413 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:39.758746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-14bf6059-e17f-4e73-87db-989622f45712 req-ad54c12d-e8ee-411a-977e-0a2f9cfec413 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:39.771616 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-14bf6059-e17f-4e73-87db-989622f45712 req-ad54c12d-e8ee-411a-977e-0a2f9cfec413 service nova] Creating event network-vif-deleted:b7e2bee5-614a-49db-839f-724b4e2a9fd9 for instance 86ca1ed8-935b-4952-b52c-21029f23af9e on n-h2-853611-3 Aug 18 11:25:39.779648 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-14bf6059-e17f-4e73-87db-989622f45712 req-ad54c12d-e8ee-411a-977e-0a2f9cfec413 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068620 Aug 18 11:25:39.780832 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 128/230] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:39.786621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-d6f11dc7-2e14-48dd-84ce-27f5a6f5b2d4 req-a2be78a2-b402-429c-a990-7262670214ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5de87cb-7296-4818-98c3-8ef54eaae832", "name": "network-vif-plugged", "status": "completed", "tag": "69499d3b-66d5-414a-b16e-beb10a38cce8"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:39.799769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d6f11dc7-2e14-48dd-84ce-27f5a6f5b2d4 req-a2be78a2-b402-429c-a990-7262670214ee service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:39.800547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d6f11dc7-2e14-48dd-84ce-27f5a6f5b2d4 req-a2be78a2-b402-429c-a990-7262670214ee service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:39.801067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d6f11dc7-2e14-48dd-84ce-27f5a6f5b2d4 req-a2be78a2-b402-429c-a990-7262670214ee service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:39.817282 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-d6f11dc7-2e14-48dd-84ce-27f5a6f5b2d4 req-a2be78a2-b402-429c-a990-7262670214ee service nova] Creating event network-vif-plugged:69499d3b-66d5-414a-b16e-beb10a38cce8 for instance f5de87cb-7296-4818-98c3-8ef54eaae832 on n-h2-853611-3 Aug 18 11:25:39.823426 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-d6f11dc7-2e14-48dd-84ce-27f5a6f5b2d4 req-a2be78a2-b402-429c-a990-7262670214ee service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041131 Aug 18 11:25:39.824435 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 129/231] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:39.830884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4d2f4d56-6765-4caf-abf4-c028ef6ca2c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:39.831796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4d2f4d56-6765-4caf-abf4-c028ef6ca2c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:39.839652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d2f4d56-6765-4caf-abf4-c028ef6ca2c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:39.840474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d2f4d56-6765-4caf-abf4-c028ef6ca2c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:39.841018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d2f4d56-6765-4caf-abf4-c028ef6ca2c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:39.842097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d2f4d56-6765-4caf-abf4-c028ef6ca2c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:39.842681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d2f4d56-6765-4caf-abf4-c028ef6ca2c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:39.843150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d2f4d56-6765-4caf-abf4-c028ef6ca2c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:39.848368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:39.887615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d2f4d56-6765-4caf-abf4-c028ef6ca2c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:39.888089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d2f4d56-6765-4caf-abf4-c028ef6ca2c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:39.888522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d2f4d56-6765-4caf-abf4-c028ef6ca2c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:39.888991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-4d2f4d56-6765-4caf-abf4-c028ef6ca2c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lazy-loading 'fault' on Instance uuid 86ca1ed8-935b-4952-b52c-21029f23af9e {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:25:40.022335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4d2f4d56-6765-4caf-abf4-c028ef6ca2c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b935333d5dd84e61b99b5ea97050147a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9f8e64f23b4d8583490483c4030f40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:40.035282 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4d2f4d56-6765-4caf-abf4-c028ef6ca2c6 tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 200 len: 1328 microversion: 2.1 time: 0.208696 Aug 18 11:25:40.058146 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 130/232] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:39 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 1328 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:40.063322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7fe2798c-4f74-4e99-9bba-66354c2d6e9d tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:40.064184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7fe2798c-4f74-4e99-9bba-66354c2d6e9d tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:40.073035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fe2798c-4f74-4e99-9bba-66354c2d6e9d tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:40.083241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fe2798c-4f74-4e99-9bba-66354c2d6e9d tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:40.084166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fe2798c-4f74-4e99-9bba-66354c2d6e9d tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:40.085058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fe2798c-4f74-4e99-9bba-66354c2d6e9d tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:40.085652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fe2798c-4f74-4e99-9bba-66354c2d6e9d tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:40.086345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fe2798c-4f74-4e99-9bba-66354c2d6e9d tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:40.161111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:25:40.161573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:25:40.161982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:25:40.162386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:25:40.162842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:25:40.172620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:40.173104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:40.173582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:40.174629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:40.175634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:40.176289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:40.198247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Getting quotas for project 3e4325e83c4644f982eca04c86527df0. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:25:40.203130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Getting quotas for user e61d177afe774ff6aa6b3e7b476383bc and project 3e4325e83c4644f982eca04c86527df0. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:25:40.217420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.utils [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] ram quota exceeded for 3e4325e83c4644f982eca04c86527df0, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122210) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 18 11:25:40.218934 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Request method failure captured: Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 145 Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGoLPT8kqC7vnpYBdnc1enIWJA0DHVRnJMOQWCqxhEEI9ztJDx_e9qInmeESvBmtVwPnEw6U7ZctOAgqx7Y1aR-EfmUoN8QsRpt7zJdViQyNoGXDXDnSJfI96cpv8jr3MdaaM1PHFyOjkR-Z9IpFO_-2AhY0o9Wk2b83NMRZ7nUKIg Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 3e4325e83c4644f982eca04c86527df0 Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-QuotasAdminNegativeTest-1562129330 Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:25:40.223607 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:25:40.225771 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3e4325e83c4644f982eca04c86527df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3e4325e83c4644f982eca04c86527df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3e4325e83c4644f982eca04c86527df0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3e4325e83c4644f982eca04c86527df0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:40.225771 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-QuotasAdminNegativeTest-1562129330 Aug 18 11:25:40.225771 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 3e4325e83c4644f982eca04c86527df0 Aug 18 11:25:40.225771 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1562129330 Aug 18 11:25:40.225771 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-QuotasAdminNegativeTest-1562129330-project Aug 18 11:25:40.225771 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:40.225771 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:40.225771 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e61d177afe774ff6aa6b3e7b476383bc Aug 18 11:25:40.225771 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-QuotasAdminNegativeTest-1562129330-project Aug 18 11:25:40.225771 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:25:40.225771 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1514916716", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} Aug 18 11:25:40.225771 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1514916716', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452'}}} Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 18 11:25:40.227173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:40.229102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:40.233871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:40.237500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:40.237500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:40.237500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:40.237500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:40.237500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 18 11:25:40.237500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:40.237500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:40.237500 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-41363a33-a4eb-4093-a291-65cb9e5ab3b3 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.596898 Aug 18 11:25:40.237500 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 103/233] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:39 2022] POST /compute/v2.1/servers => generated 110 bytes in 598 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:40.244443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6b04a970-3285-442a-8b8f-4e4c68ec5c00 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Action: 'update', calling method: .version_select at 0x7f51ac4fc430>, body: {"quota_set": {"ram": 51200}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:40.364895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7fe2798c-4f74-4e99-9bba-66354c2d6e9d tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc840057087743e2b23eaf6da3997b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582d4d6dc459486cbfb696c35cc814f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:40.376189 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7fe2798c-4f74-4e99-9bba-66354c2d6e9d tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 200 len: 1323 microversion: 2.1 time: 0.316744 Aug 18 11:25:40.387080 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 131/234] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:40 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 1323 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:40.642354 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-feceef0a-39b5-45d6-849e-392a29e54378 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:40.643057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-feceef0a-39b5-45d6-849e-392a29e54378 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:40.651439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-feceef0a-39b5-45d6-849e-392a29e54378 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:40.652086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-feceef0a-39b5-45d6-849e-392a29e54378 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:40.653151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-feceef0a-39b5-45d6-849e-392a29e54378 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:40.654241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-feceef0a-39b5-45d6-849e-392a29e54378 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:40.655072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-feceef0a-39b5-45d6-849e-392a29e54378 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:40.655487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-feceef0a-39b5-45d6-849e-392a29e54378 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:40.680439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b04a970-3285-442a-8b8f-4e4c68ec5c00 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:40.681021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b04a970-3285-442a-8b8f-4e4c68ec5c00 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:40.681467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b04a970-3285-442a-8b8f-4e4c68ec5c00 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:40.685526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b04a970-3285-442a-8b8f-4e4c68ec5c00 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:40.686072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b04a970-3285-442a-8b8f-4e4c68ec5c00 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:40.686621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b04a970-3285-442a-8b8f-4e4c68ec5c00 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:40.786253 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6b04a970-3285-442a-8b8f-4e4c68ec5c00 tempest-QuotasAdminNegativeTest-120258623 tempest-QuotasAdminNegativeTest-120258623-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0" status: 200 len: 329 microversion: 2.1 time: 0.548063 Aug 18 11:25:40.787448 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 104/235] 10.222.0.73 () {60 vars in 1262 bytes} [Thu Aug 18 11:25:40 2022] PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0 => generated 329 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:40.795453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2091e073-f801-4a70-b8cd-86f8d6f15c42 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:40.797677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2091e073-f801-4a70-b8cd-86f8d6f15c42 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:40.811538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2091e073-f801-4a70-b8cd-86f8d6f15c42 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:40.812621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2091e073-f801-4a70-b8cd-86f8d6f15c42 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:40.813349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2091e073-f801-4a70-b8cd-86f8d6f15c42 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:40.814263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2091e073-f801-4a70-b8cd-86f8d6f15c42 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:40.814949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2091e073-f801-4a70-b8cd-86f8d6f15c42 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:40.815788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2091e073-f801-4a70-b8cd-86f8d6f15c42 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:40.899614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-feceef0a-39b5-45d6-849e-392a29e54378 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:40.908927 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-feceef0a-39b5-45d6-849e-392a29e54378 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1388 microversion: 2.1 time: 0.272419 Aug 18 11:25:40.909543 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 132/236] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:40 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1388 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:40.915119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-87a72419-4edd-40ea-bb94-9f4b0b9f5507 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Action: 'update', calling method: .version_select at 0x7f51ac3ad670>, body: {"quota_set": {"ram": 0}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:40.920341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-87a72419-4edd-40ea-bb94-9f4b0b9f5507 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'e61d177afe774ff6aa6b3e7b476383bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4325e83c4644f982eca04c86527df0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-87a72419-4edd-40ea-bb94-9f4b0b9f5507 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Request method failure captured: Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: request: PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0 HTTP/1.1 Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 25 Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGoLPT8kqC7vnpYBdnc1enIWJA0DHVRnJMOQWCqxhEEI9ztJDx_e9qInmeESvBmtVwPnEw6U7ZctOAgqx7Y1aR-EfmUoN8QsRpt7zJdViQyNoGXDXDnSJfI96cpv8jr3MdaaM1PHFyOjkR-Z9IpFO_-2AhY0o9Wk2b83NMRZ7nUKIg Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 3e4325e83c4644f982eca04c86527df0 Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-QuotasAdminNegativeTest-1562129330 Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:25:40.923105 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:25:40.924266 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3e4325e83c4644f982eca04c86527df0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3e4325e83c4644f982eca04c86527df0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3e4325e83c4644f982eca04c86527df0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3e4325e83c4644f982eca04c86527df0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:40.924266 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-QuotasAdminNegativeTest-1562129330 Aug 18 11:25:40.924266 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 3e4325e83c4644f982eca04c86527df0 Aug 18 11:25:40.924266 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1562129330 Aug 18 11:25:40.924266 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-QuotasAdminNegativeTest-1562129330-project Aug 18 11:25:40.924266 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:40.924266 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:40.924266 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e61d177afe774ff6aa6b3e7b476383bc Aug 18 11:25:40.924266 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-QuotasAdminNegativeTest-1562129330-project Aug 18 11:25:40.924266 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:25:40.924266 n-d-853611-3 devstack@n-api.service[122209]: {"quota_set": {"ram": 0}} Aug 18 11:25:40.924266 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:25:40.924266 n-d-853611-3 devstack@n-api.service[122209]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 18 11:25:40.924266 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3e4325e83c4644f982eca04c86527df0', 'body': {'quota_set': {'ram': 0}}} Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:40.924996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:40.925981 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:40.927155 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:40.927155 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:40.927155 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:25:40.927155 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:25:40.927155 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 18 11:25:40.927155 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:40.929379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-87a72419-4edd-40ea-bb94-9f4b0b9f5507 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:40.931905 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-87a72419-4edd-40ea-bb94-9f4b0b9f5507 tempest-QuotasAdminNegativeTest-1562129330 tempest-QuotasAdminNegativeTest-1562129330-project] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0" status: 403 len: 116 microversion: 2.1 time: 0.019783 Aug 18 11:25:40.933543 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 133/237] 10.222.0.73 () {60 vars in 1262 bytes} [Thu Aug 18 11:25:40 2022] PUT /compute/v2.1/os-quota-sets/3e4325e83c4644f982eca04c86527df0 => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:41.003037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2091e073-f801-4a70-b8cd-86f8d6f15c42 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:41.011233 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2091e073-f801-4a70-b8cd-86f8d6f15c42 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 200 len: 1341 microversion: 2.1 time: 0.222383 Aug 18 11:25:41.011848 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 105/238] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:40 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 1341 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:41.063283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0ecb992e-4e69-4bfc-9351-1e644c8fbc1c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:41.065026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0ecb992e-4e69-4bfc-9351-1e644c8fbc1c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:41.076772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ecb992e-4e69-4bfc-9351-1e644c8fbc1c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:41.077643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ecb992e-4e69-4bfc-9351-1e644c8fbc1c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:41.078605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ecb992e-4e69-4bfc-9351-1e644c8fbc1c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:41.079770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ecb992e-4e69-4bfc-9351-1e644c8fbc1c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:41.081001 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ecb992e-4e69-4bfc-9351-1e644c8fbc1c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:41.081929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ecb992e-4e69-4bfc-9351-1e644c8fbc1c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:41.102243 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-0ecb992e-4e69-4bfc-9351-1e644c8fbc1c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] HTTP exception thrown: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0ecb992e-4e69-4bfc-9351-1e644c8fbc1c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Request method failure captured: Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e HTTP/1.1 Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGFJWwwobtXaB4o_UCF-ZhEmJ3Ubd4QPIjK-tNHGzAsrpB0zPLnblmZY3vy8sjyKJKe3errdoZqXeBvdV2kgyTe3_PWmfV3BdjL5k2H0SiJH-dJVUaOqtwesxPsTQJwjsQ79eRa-RXSx1U1RWVFHNZ9urNDHtdgxqB8GKY6veZmzkI Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 2f9f8e64f23b4d8583490483c4030f40 Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AggregatesAdminTestJSON-1273950221 Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:25:41.115120 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:25:41.116669 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2f9f8e64f23b4d8583490483c4030f40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/2f9f8e64f23b4d8583490483c4030f40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_2f9f8e64f23b4d8583490483c4030f40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2f9f8e64f23b4d8583490483c4030f40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:41.116669 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AggregatesAdminTestJSON-1273950221 Aug 18 11:25:41.116669 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 2f9f8e64f23b4d8583490483c4030f40 Aug 18 11:25:41.116669 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1273950221 Aug 18 11:25:41.116669 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AggregatesAdminTestJSON-1273950221-project Aug 18 11:25:41.116669 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:41.116669 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:41.116669 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b935333d5dd84e61b99b5ea97050147a Aug 18 11:25:41.116669 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AggregatesAdminTestJSON-1273950221-project Aug 18 11:25:41.116669 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:41.116669 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:41.116669 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '86ca1ed8-935b-4952-b52c-21029f23af9e'} Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:41.117309 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:41.118417 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:41.119411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0ecb992e-4e69-4bfc-9351-1e644c8fbc1c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Returning 404 to user: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:41.120331 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0ecb992e-4e69-4bfc-9351-1e644c8fbc1c tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 404 len: 111 microversion: 2.1 time: 0.065689 Aug 18 11:25:41.121015 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 134/239] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:41 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:41.131175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-038227ba-4856-42c9-8693-ede0575f36f9 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853611-3"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:41.134664 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:41.134664 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:41.162100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-038227ba-4856-42c9-8693-ede0575f36f9 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:41.163491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-038227ba-4856-42c9-8693-ede0575f36f9 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:41.164387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-038227ba-4856-42c9-8693-ede0575f36f9 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:41.318496 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-038227ba-4856-42c9-8693-ede0575f36f9 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 298 microversion: 2.1 time: 0.191704 Aug 18 11:25:41.319114 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 106/240] 10.222.0.73 () {60 vars in 1191 bytes} [Thu Aug 18 11:25:41 2022] POST /compute/v2.1/os-aggregates/5/action => generated 298 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:41.332883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d2d594cb-05b5-4c21-989d-d493a3432a1b tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:41.333907 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:41.333907 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:41.360273 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d2d594cb-05b5-4c21-989d-d493a3432a1b tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.032429 Aug 18 11:25:41.361500 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 135/241] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:25:41 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:41.373984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f7fa3bdb-5d4b-4ecb-8b6f-8333eabc0a4a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-873416904"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:41.376708 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:41.376708 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:41.377636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.aggregate [None req-f7fa3bdb-5d4b-4ecb-8b6f-8333eabc0a4a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Generated uuid 6f110947-0136-4bc7-a9f6-9ed0ffd6752d for aggregate {{(pid=122210) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:41.400731 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f7fa3bdb-5d4b-4ecb-8b6f-8333eabc0a4a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.031319 Aug 18 11:25:41.401680 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 107/242] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:41 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:41.405387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-87adafc9-fdf9-4b04-a9f2-55300fb500d8 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:41.406019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-87adafc9-fdf9-4b04-a9f2-55300fb500d8 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:41.413114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87adafc9-fdf9-4b04-a9f2-55300fb500d8 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:41.413831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87adafc9-fdf9-4b04-a9f2-55300fb500d8 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:41.414484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87adafc9-fdf9-4b04-a9f2-55300fb500d8 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:41.414611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2889c9e7-2f7c-43fa-8dee-0e33f517746a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853611-3"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:41.415458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87adafc9-fdf9-4b04-a9f2-55300fb500d8 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:41.416071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87adafc9-fdf9-4b04-a9f2-55300fb500d8 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:41.416655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87adafc9-fdf9-4b04-a9f2-55300fb500d8 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:41.417069 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:41.417069 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:41.430041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2889c9e7-2f7c-43fa-8dee-0e33f517746a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:41.430563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2889c9e7-2f7c-43fa-8dee-0e33f517746a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:41.431276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2889c9e7-2f7c-43fa-8dee-0e33f517746a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:41.627797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-87adafc9-fdf9-4b04-a9f2-55300fb500d8 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc840057087743e2b23eaf6da3997b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582d4d6dc459486cbfb696c35cc814f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:41.630295 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2889c9e7-2f7c-43fa-8dee-0e33f517746a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.219844 Aug 18 11:25:41.631254 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 108/243] 10.222.0.73 () {60 vars in 1191 bytes} [Thu Aug 18 11:25:41 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:41.643901 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-87adafc9-fdf9-4b04-a9f2-55300fb500d8 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 200 len: 1323 microversion: 2.1 time: 0.247975 Aug 18 11:25:41.645396 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 136/244] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:41 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 1323 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:41.650785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e1dd7caa-29bd-4be8-a9aa-550528d66b2c tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:41.652007 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:41.652007 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:41.656818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=89,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:41.662409 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e1dd7caa-29bd-4be8-a9aa-550528d66b2c tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.023496 Aug 18 11:25:41.667229 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 109/245] 10.222.0.73 () {58 vars in 1149 bytes} [Thu Aug 18 11:25:41 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:25:41.676393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c3e67b0c-719e-481f-9806-06b16a143b7a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853611-3"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:41.679665 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:41.679665 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:41.688792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3e67b0c-719e-481f-9806-06b16a143b7a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:41.689611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3e67b0c-719e-481f-9806-06b16a143b7a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:41.690297 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3e67b0c-719e-481f-9806-06b16a143b7a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:41.818991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f77b743a-34ef-4bf6-9959-38f1a9ada4cc req-c63ab30f-6348-40a2-9025-369803d78b20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "294a7aa1-4490-4569-b325-24ca4c1dde28", "tag": "2ecc822a-3334-4712-967b-24e6ce852509"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:41.836292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f77b743a-34ef-4bf6-9959-38f1a9ada4cc req-c63ab30f-6348-40a2-9025-369803d78b20 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:41.836763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f77b743a-34ef-4bf6-9959-38f1a9ada4cc req-c63ab30f-6348-40a2-9025-369803d78b20 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:41.837388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f77b743a-34ef-4bf6-9959-38f1a9ada4cc req-c63ab30f-6348-40a2-9025-369803d78b20 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:41.848188 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c3e67b0c-719e-481f-9806-06b16a143b7a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.175976 Aug 18 11:25:41.851187 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 137/246] 10.222.0.73 () {60 vars in 1191 bytes} [Thu Aug 18 11:25:41 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:41.860838 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f77b743a-34ef-4bf6-9959-38f1a9ada4cc req-c63ab30f-6348-40a2-9025-369803d78b20 service nova] Creating event network-changed:2ecc822a-3334-4712-967b-24e6ce852509 for instance 294a7aa1-4490-4569-b325-24ca4c1dde28 on n-h1-853611-3 Aug 18 11:25:41.868058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-81e79e0c-9b71-465b-9645-6a5681408f93 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:41.869016 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f77b743a-34ef-4bf6-9959-38f1a9ada4cc req-c63ab30f-6348-40a2-9025-369803d78b20 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054597 Aug 18 11:25:41.869722 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:41.869722 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:41.875059 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 110/247] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:41.935748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7a054a7-6545-4e24-8a3f-d620716016e4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:41.936454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e7a054a7-6545-4e24-8a3f-d620716016e4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:41.938394 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-81e79e0c-9b71-465b-9645-6a5681408f93 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.079440 Aug 18 11:25:41.940358 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 138/248] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:25:41 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 18 11:25:41.951859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b863a830-8884-433b-b5cb-57f612f26fb7 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-189691982"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:41.955657 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:41.955657 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:41.956766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.aggregate [None req-b863a830-8884-433b-b5cb-57f612f26fb7 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Generated uuid fbf3e5cc-c50b-419e-abda-0e91fa5a7d1d for aggregate {{(pid=122209) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:41.969889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7a054a7-6545-4e24-8a3f-d620716016e4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:41.970501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7a054a7-6545-4e24-8a3f-d620716016e4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:41.970730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7a054a7-6545-4e24-8a3f-d620716016e4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:41.971431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7a054a7-6545-4e24-8a3f-d620716016e4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:41.971889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7a054a7-6545-4e24-8a3f-d620716016e4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:41.972462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7a054a7-6545-4e24-8a3f-d620716016e4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:41.998215 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b863a830-8884-433b-b5cb-57f612f26fb7 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049724 Aug 18 11:25:41.999616 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 139/249] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:42.010168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4749a5a8-1603-47b6-b5e3-47b70123135b tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853611-3"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:42.016460 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:42.016460 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:42.033801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4749a5a8-1603-47b6-b5e3-47b70123135b tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:42.035694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4749a5a8-1603-47b6-b5e3-47b70123135b tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:42.036230 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4749a5a8-1603-47b6-b5e3-47b70123135b tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:42.254243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e7a054a7-6545-4e24-8a3f-d620716016e4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:42.271533 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e7a054a7-6545-4e24-8a3f-d620716016e4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1388 microversion: 2.1 time: 0.345024 Aug 18 11:25:42.272902 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 111/250] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:41 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1388 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:42.280539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bc2b92f0-d2b0-4010-b1a5-cff5bb662763 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:42.281923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bc2b92f0-d2b0-4010-b1a5-cff5bb662763 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:42.293796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc2b92f0-d2b0-4010-b1a5-cff5bb662763 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:42.296314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc2b92f0-d2b0-4010-b1a5-cff5bb662763 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:42.296905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc2b92f0-d2b0-4010-b1a5-cff5bb662763 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:42.298978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc2b92f0-d2b0-4010-b1a5-cff5bb662763 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:42.301030 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4749a5a8-1603-47b6-b5e3-47b70123135b tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.294677 Aug 18 11:25:42.301647 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 140/251] 10.222.0.73 () {60 vars in 1194 bytes} [Thu Aug 18 11:25:42 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:25:42.312230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc2b92f0-d2b0-4010-b1a5-cff5bb662763 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:42.313228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e85ca945-3ccf-4a0b-924b-4eb99b5b7873 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:42.313892 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:42.313892 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:42.314391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc2b92f0-d2b0-4010-b1a5-cff5bb662763 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:42.328722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=5 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:42.338246 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e85ca945-3ccf-4a0b-924b-4eb99b5b7873 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.029710 Aug 18 11:25:42.339204 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 141/252] 10.222.0.73 () {58 vars in 1143 bytes} [Thu Aug 18 11:25:42 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:25:42.358363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-75517956-a365-4f95-8e59-37492cd08f82 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853611-3"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:42.365374 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:42.365374 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:42.377248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75517956-a365-4f95-8e59-37492cd08f82 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:42.377919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75517956-a365-4f95-8e59-37492cd08f82 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:42.378569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75517956-a365-4f95-8e59-37492cd08f82 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:42.535474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bc2b92f0-d2b0-4010-b1a5-cff5bb662763 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:42.543092 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bc2b92f0-d2b0-4010-b1a5-cff5bb662763 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 200 len: 1469 microversion: 2.1 time: 0.268996 Aug 18 11:25:42.546620 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 112/253] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:42 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 1469 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:42.611372 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-75517956-a365-4f95-8e59-37492cd08f82 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.263296 Aug 18 11:25:42.614477 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 142/254] 10.222.0.73 () {60 vars in 1194 bytes} [Thu Aug 18 11:25:42 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:25:42.635541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9e6b68fd-ecd6-4560-af56-7694b1dce1a0 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:42.639604 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:42.639604 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:42.702004 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9e6b68fd-ecd6-4560-af56-7694b1dce1a0 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.082623 Aug 18 11:25:42.703053 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 143/255] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:25:42 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 18 11:25:42.718865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3b15a46e-b55d-4e22-aae9-69e86f517024 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:42.719561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3b15a46e-b55d-4e22-aae9-69e86f517024 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:42.730901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b15a46e-b55d-4e22-aae9-69e86f517024 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:42.732037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b15a46e-b55d-4e22-aae9-69e86f517024 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:42.732791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b15a46e-b55d-4e22-aae9-69e86f517024 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:42.733605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b15a46e-b55d-4e22-aae9-69e86f517024 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:42.734252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b15a46e-b55d-4e22-aae9-69e86f517024 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:42.734727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b15a46e-b55d-4e22-aae9-69e86f517024 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:43.066487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ded114b7-7458-45b5-b0fa-933e0f46786b tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:43.067006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ded114b7-7458-45b5-b0fa-933e0f46786b tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:43.078708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded114b7-7458-45b5-b0fa-933e0f46786b tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:43.082829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded114b7-7458-45b5-b0fa-933e0f46786b tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:43.083680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded114b7-7458-45b5-b0fa-933e0f46786b tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:43.086036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded114b7-7458-45b5-b0fa-933e0f46786b tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:43.087936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded114b7-7458-45b5-b0fa-933e0f46786b tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:43.088882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded114b7-7458-45b5-b0fa-933e0f46786b tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:43.125571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ded114b7-7458-45b5-b0fa-933e0f46786b tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:25:43.229936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3b15a46e-b55d-4e22-aae9-69e86f517024 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc840057087743e2b23eaf6da3997b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582d4d6dc459486cbfb696c35cc814f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:43.241975 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3b15a46e-b55d-4e22-aae9-69e86f517024 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 200 len: 1323 microversion: 2.1 time: 0.534481 Aug 18 11:25:43.242575 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 144/256] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:42 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 1323 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:43.270337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-e4e8e4ca-5913-4be0-922a-07a31268ebc1 req-b45d9af0-4672-4e5a-9633-2d5e81625bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22337998-2a5d-4fdc-a5f7-6d1067a13c9c", "name": "network-vif-plugged", "status": "completed", "tag": "ba49d06a-552b-4db3-9851-132789c232c7"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:43.300763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e4e8e4ca-5913-4be0-922a-07a31268ebc1 req-b45d9af0-4672-4e5a-9633-2d5e81625bc5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:43.302537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e4e8e4ca-5913-4be0-922a-07a31268ebc1 req-b45d9af0-4672-4e5a-9633-2d5e81625bc5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:43.304968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e4e8e4ca-5913-4be0-922a-07a31268ebc1 req-b45d9af0-4672-4e5a-9633-2d5e81625bc5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:43.321214 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-e4e8e4ca-5913-4be0-922a-07a31268ebc1 req-b45d9af0-4672-4e5a-9633-2d5e81625bc5 service nova] Creating event network-vif-plugged:ba49d06a-552b-4db3-9851-132789c232c7 for instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c on n-h1-853611-3 Aug 18 11:25:43.329911 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-e4e8e4ca-5913-4be0-922a-07a31268ebc1 req-b45d9af0-4672-4e5a-9633-2d5e81625bc5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069317 Aug 18 11:25:43.331389 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 145/257] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:43.337269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e63e412c-b712-41a4-98b6-106b26fe0138 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-688983005"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:43.342913 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:43.342913 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:43.344543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.aggregate [None req-e63e412c-b712-41a4-98b6-106b26fe0138 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Generated uuid 0332fe4f-a565-4071-b28c-9ae98b32e7e9 for aggregate {{(pid=122209) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:43.354696 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ded114b7-7458-45b5-b0fa-933e0f46786b tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] 10.222.0.73 "DELETE /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 204 len: 0 microversion: 2.1 time: 0.773591 Aug 18 11:25:43.356150 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 113/258] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:25:42 2022] DELETE /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:25:43.365518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a630038f-4814-4aa2-b548-282b83a59724 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:43.366573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a630038f-4814-4aa2-b548-282b83a59724 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:43.393844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a630038f-4814-4aa2-b548-282b83a59724 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:43.394337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a630038f-4814-4aa2-b548-282b83a59724 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:43.394801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a630038f-4814-4aa2-b548-282b83a59724 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:43.395578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a630038f-4814-4aa2-b548-282b83a59724 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:43.396039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a630038f-4814-4aa2-b548-282b83a59724 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:43.397558 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e63e412c-b712-41a4-98b6-106b26fe0138 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064872 Aug 18 11:25:43.398144 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 146/259] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:43.406224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a630038f-4814-4aa2-b548-282b83a59724 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:43.406342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2b66f9f-8ac6-4652-8e68-2681e1ed13c6 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:43.407185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a2b66f9f-8ac6-4652-8e68-2681e1ed13c6 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:43.414584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2b66f9f-8ac6-4652-8e68-2681e1ed13c6 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:43.415075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2b66f9f-8ac6-4652-8e68-2681e1ed13c6 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:43.415507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2b66f9f-8ac6-4652-8e68-2681e1ed13c6 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:43.416806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2b66f9f-8ac6-4652-8e68-2681e1ed13c6 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:43.417288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2b66f9f-8ac6-4652-8e68-2681e1ed13c6 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:43.417674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2b66f9f-8ac6-4652-8e68-2681e1ed13c6 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:43.580429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a630038f-4814-4aa2-b548-282b83a59724 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:43.588353 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a630038f-4814-4aa2-b548-282b83a59724 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1388 microversion: 2.1 time: 0.230475 Aug 18 11:25:43.588931 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 114/260] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:43 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1388 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:43.613186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a2b66f9f-8ac6-4652-8e68-2681e1ed13c6 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:43.624604 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a2b66f9f-8ac6-4652-8e68-2681e1ed13c6 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 200 len: 1475 microversion: 2.1 time: 0.225178 Aug 18 11:25:43.625520 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 147/261] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:43 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 1475 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:43.654139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-18246915-354e-401a-8d91-c871dfc57a10 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853611-3"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:43.658236 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:43.658236 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:43.667514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18246915-354e-401a-8d91-c871dfc57a10 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:43.668206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18246915-354e-401a-8d91-c871dfc57a10 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:43.669258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18246915-354e-401a-8d91-c871dfc57a10 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:43.804700 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-18246915-354e-401a-8d91-c871dfc57a10 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.168510 Aug 18 11:25:43.811023 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 148/262] 10.222.0.73 () {60 vars in 1194 bytes} [Thu Aug 18 11:25:43 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:43.900586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-28e1b434-5541-4d36-81fc-935de5b50421 tempest-FlavorsV261TestJSON-483765699 tempest-FlavorsV261TestJSON-483765699-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1943944153", "id": 2065050015, "os-flavor-access:is_public": "True"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:43.904590 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:43.904590 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:43.924478 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-28e1b434-5541-4d36-81fc-935de5b50421 tempest-FlavorsV261TestJSON-483765699 tempest-FlavorsV261TestJSON-483765699-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.334519 Aug 18 11:25:43.925035 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 115/263] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:25:43 2022] POST /compute/v2.1/flavors => generated 468 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:43.929689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1962be34-8477-441c-ac2c-ab8c47efc082 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853611-3"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:43.932322 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:43.932322 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:43.941086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1962be34-8477-441c-ac2c-ab8c47efc082 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:43.941639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1962be34-8477-441c-ac2c-ab8c47efc082 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:43.942142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1962be34-8477-441c-ac2c-ab8c47efc082 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:44.042003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1097962647", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:44.078787 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1962be34-8477-441c-ac2c-ab8c47efc082 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.152460 Aug 18 11:25:44.079846 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 116/264] 10.222.0.73 () {60 vars in 1194 bytes} [Thu Aug 18 11:25:43 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:44.099354 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:25:44.213047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-14cbca82-2d02-47c1-896d-078d6cc0fc29 tempest-FlavorsV261TestJSON-1893222980 tempest-FlavorsV261TestJSON-1893222980-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:44.224313 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-14cbca82-2d02-47c1-896d-078d6cc0fc29 tempest-FlavorsV261TestJSON-1893222980 tempest-FlavorsV261TestJSON-1893222980-project] 10.222.0.73 "GET /compute/v2.1/flavors/2065050015" status: 200 len: 468 microversion: 2.61 time: 0.143435 Aug 18 11:25:44.225306 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 117/265] 10.222.0.73 () {60 vars in 1199 bytes} [Thu Aug 18 11:25:44 2022] GET /compute/v2.1/flavors/2065050015 => generated 468 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:44.229746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2baac7eb-a371-4ec2-88bb-08a5ddfcfbe4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:44.230514 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:44.230514 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:44.252663 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2baac7eb-a371-4ec2-88bb-08a5ddfcfbe4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.026077 Aug 18 11:25:44.254063 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 118/266] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:25:44 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:44.260081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0504f241-c027-40c7-b92f-9488d454ed9b tempest-FlavorsV261TestJSON-483765699 tempest-FlavorsV261TestJSON-483765699-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:44.264116 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:44.264116 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:44.294240 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0504f241-c027-40c7-b92f-9488d454ed9b tempest-FlavorsV261TestJSON-483765699 tempest-FlavorsV261TestJSON-483765699-project-admin] 10.222.0.73 "PUT /compute/v2.1/flavors/2065050015" status: 200 len: 469 microversion: 2.61 time: 0.038053 Aug 18 11:25:44.302779 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 119/267] 10.222.0.73 () {62 vars in 1219 bytes} [Thu Aug 18 11:25:44 2022] PUT /compute/v2.1/flavors/2065050015 => generated 469 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:25:44.302779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2fbec8a5-960f-46d9-b194-45e273903302 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-569476271"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:44.302779 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:44.302779 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:44.303671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.aggregate [None req-2fbec8a5-960f-46d9-b194-45e273903302 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Generated uuid ac9a2bc5-1b15-4d03-8d08-bbca3aa93ea2 for aggregate {{(pid=122210) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:44.325905 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2fbec8a5-960f-46d9-b194-45e273903302 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.028362 Aug 18 11:25:44.326751 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 120/268] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:44.328405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:25:44.329607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:25:44.330090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:25:44.330519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:25:44.330930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:25:44.332120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bf763e32-6f75-4320-bac5-bbd0ec4588a6 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:44.332805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bf763e32-6f75-4320-bac5-bbd0ec4588a6 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:44.339832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf763e32-6f75-4320-bac5-bbd0ec4588a6 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:44.340827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf763e32-6f75-4320-bac5-bbd0ec4588a6 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:44.341618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf763e32-6f75-4320-bac5-bbd0ec4588a6 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:44.342309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf763e32-6f75-4320-bac5-bbd0ec4588a6 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:44.342867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf763e32-6f75-4320-bac5-bbd0ec4588a6 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:44.343288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf763e32-6f75-4320-bac5-bbd0ec4588a6 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:44.345176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:44.346258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:44.346258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:44.346914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:44.347364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:44.347780 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:44.354177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=20 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:44.360087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:44.369389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Getting quotas for project 7543ea6a7a5d4831b185b45f59c6a31d. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:25:44.374777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Getting quotas for user 9ffb27f7ddc54fe59b815112f0601848 and project 7543ea6a7a5d4831b185b45f59c6a31d. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:25:44.386819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:25:44.389864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:25:44.445033 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-169b014c-6aa5-4efd-aa39-533a0e5f03dc tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632694 Aug 18 11:25:44.445836 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 149/269] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:25:44.450035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8357c8de-59b2-4af9-98f1-2ff9744f8338 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-235778396"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:44.453547 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:44.453547 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:44.454503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.aggregate [None req-8357c8de-59b2-4af9-98f1-2ff9744f8338 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Generated uuid 137939f2-bbcd-49b7-9313-fd063d3a4065 for aggregate {{(pid=122209) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:44.483215 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8357c8de-59b2-4af9-98f1-2ff9744f8338 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.034551 Aug 18 11:25:44.484405 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 150/270] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:44.489871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a53a516b-01b4-4aa5-a873-938ccc3a7f20 tempest-FlavorsV261TestJSON-1893222980 tempest-FlavorsV261TestJSON-1893222980-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:44.521451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bf763e32-6f75-4320-bac5-bbd0ec4588a6 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc840057087743e2b23eaf6da3997b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582d4d6dc459486cbfb696c35cc814f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:44.530332 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a53a516b-01b4-4aa5-a873-938ccc3a7f20 tempest-FlavorsV261TestJSON-1893222980 tempest-FlavorsV261TestJSON-1893222980-project] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 7153 microversion: 2.61 time: 0.044700 Aug 18 11:25:44.530543 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bf763e32-6f75-4320-bac5-bbd0ec4588a6 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 200 len: 1323 microversion: 2.1 time: 0.202477 Aug 18 11:25:44.531443 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 121/271] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:44 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 1323 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:44.534772 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 151/272] 10.222.0.73 () {60 vars in 1187 bytes} [Thu Aug 18 11:25:44 2022] GET /compute/v2.1/flavors/detail => generated 7153 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:25:44.536279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b548f98d-59a8-4593-abb1-bcb136290c1a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:44.537033 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:44.537033 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:44.554585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-58792890-8c07-4983-a6f6-9d9bf481184d tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:44.554585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-58792890-8c07-4983-a6f6-9d9bf481184d tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:44.566320 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b548f98d-59a8-4593-abb1-bcb136290c1a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.031702 Aug 18 11:25:44.570735 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 122/273] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:25:44 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:44.584622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f8ad094-df85-4414-a757-9f6586ab607c tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853611-3"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:44.590485 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:44.590485 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:44.608113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f8ad094-df85-4414-a757-9f6586ab607c tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:44.608605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f8ad094-df85-4414-a757-9f6586ab607c tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:44.609029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f8ad094-df85-4414-a757-9f6586ab607c tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:44.628661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-58792890-8c07-4983-a6f6-9d9bf481184d tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:44.636673 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-58792890-8c07-4983-a6f6-9d9bf481184d tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1219 microversion: 2.1 time: 0.100859 Aug 18 11:25:44.639764 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 152/274] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:44 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:44.656817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0d089561-daf6-4a71-b128-8cd62e5378ed tempest-FlavorsV261TestJSON-1893222980 tempest-FlavorsV261TestJSON-1893222980-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:44.682985 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0d089561-daf6-4a71-b128-8cd62e5378ed tempest-FlavorsV261TestJSON-1893222980 tempest-FlavorsV261TestJSON-1893222980-project] 10.222.0.73 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.61 time: 0.040011 Aug 18 11:25:44.683870 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 153/275] 10.222.0.73 () {60 vars in 1166 bytes} [Thu Aug 18 11:25:44 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:25:44.701660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-645b197a-3811-4c87-8ccb-0058db1e1abc tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:44.702448 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:44.702448 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:44.712983 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-645b197a-3811-4c87-8ccb-0058db1e1abc tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-645b197a-3811-4c87-8ccb-0058db1e1abc tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Request method failure captured: Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGI106ofM49q68HTvI50EOGJllUy7aPN-cVac9KejhYkzHXdqALPfncwHnrbCUC_5TX2FA9VW9O_KUd6fZtjksyIhQnP7UM7m4WKYkTp48yusJzk5MKPagAYnItCvaXhpH3pcUbMC87Z-QTMd0URPV3SkEnywqM2-Fbh-f4sOs5Z9k Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 188b4e00f20c4b83860cf5691151cf9a Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AggregatesAdminTestJSON-1548551180 Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:25:44.714472 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:25:44.716204 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:44.716204 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AggregatesAdminTestJSON-1548551180 Aug 18 11:25:44.716204 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 188b4e00f20c4b83860cf5691151cf9a Aug 18 11:25:44.716204 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1548551180 Aug 18 11:25:44.716204 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AggregatesAdminTestJSON-1548551180-project-admin Aug 18 11:25:44.716204 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:44.716204 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:44.716204 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 67280966d1f943828aba65c2082b3bd5 Aug 18 11:25:44.716204 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AggregatesAdminTestJSON-1548551180-project-admin Aug 18 11:25:44.716204 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:44.716204 n-d-853611-3 devstack@n-api.service[122209]: exception: Aggregate 12 could not be found. Aug 18 11:25:44.716204 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '12'} Aug 18 11:25:44.716204 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6430, in get_aggregate Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:44.717095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 18 11:25:44.718814 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:44.720284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-645b197a-3811-4c87-8ccb-0058db1e1abc tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:44.720284 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-645b197a-3811-4c87-8ccb-0058db1e1abc tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.030472 Aug 18 11:25:44.720284 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 154/276] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:25:44 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:25:44.725184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7fbd9116-53a8-4b2a-93cb-f1e3baa8bef2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:44.727169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7fbd9116-53a8-4b2a-93cb-f1e3baa8bef2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:44.736064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fbd9116-53a8-4b2a-93cb-f1e3baa8bef2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:44.736760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fbd9116-53a8-4b2a-93cb-f1e3baa8bef2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:44.737426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fbd9116-53a8-4b2a-93cb-f1e3baa8bef2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:44.738193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fbd9116-53a8-4b2a-93cb-f1e3baa8bef2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:44.738833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fbd9116-53a8-4b2a-93cb-f1e3baa8bef2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:44.739448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fbd9116-53a8-4b2a-93cb-f1e3baa8bef2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:44.849682 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f8ad094-df85-4414-a757-9f6586ab607c tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.276270 Aug 18 11:25:44.858749 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 123/277] 10.222.0.73 () {60 vars in 1194 bytes} [Thu Aug 18 11:25:44 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:44.865036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4d091eb5-d796-4f7b-8aaf-8bfd2806e355 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:44.866511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4d091eb5-d796-4f7b-8aaf-8bfd2806e355 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:44.875999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d091eb5-d796-4f7b-8aaf-8bfd2806e355 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:44.876488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d091eb5-d796-4f7b-8aaf-8bfd2806e355 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:44.876920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d091eb5-d796-4f7b-8aaf-8bfd2806e355 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:44.877634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d091eb5-d796-4f7b-8aaf-8bfd2806e355 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:44.878063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d091eb5-d796-4f7b-8aaf-8bfd2806e355 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:44.878933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d091eb5-d796-4f7b-8aaf-8bfd2806e355 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:45.057647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7fbd9116-53a8-4b2a-93cb-f1e3baa8bef2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:45.069702 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7fbd9116-53a8-4b2a-93cb-f1e3baa8bef2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1388 microversion: 2.1 time: 0.348311 Aug 18 11:25:45.071480 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 155/278] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:44 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1388 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:45.078584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9d2e6cc4-a6ed-4047-9b84-28643e532759 tempest-FlavorsV261TestJSON-483765699 tempest-FlavorsV261TestJSON-483765699-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:45.081851 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:45.081851 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:45.110288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4d091eb5-d796-4f7b-8aaf-8bfd2806e355 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:45.120868 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9d2e6cc4-a6ed-4047-9b84-28643e532759 tempest-FlavorsV261TestJSON-483765699 tempest-FlavorsV261TestJSON-483765699-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/2065050015" status: 202 len: 0 microversion: 2.61 time: 0.047547 Aug 18 11:25:45.121463 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4d091eb5-d796-4f7b-8aaf-8bfd2806e355 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 200 len: 1475 microversion: 2.1 time: 0.261107 Aug 18 11:25:45.122769 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 156/279] 10.222.0.73 () {60 vars in 1202 bytes} [Thu Aug 18 11:25:45 2022] DELETE /compute/v2.1/flavors/2065050015 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:25:45.128095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-72c4a4c7-0749-4ea0-9d2f-5fce0709ff13 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:45.131945 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 124/280] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:44 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 1475 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:45.134193 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:45.134193 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:45.146588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-38a0aa0d-2343-4403-99e1-ac6f6b27c518 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853611-3"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:45.150904 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:45.150904 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:45.153584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-38a0aa0d-2343-4403-99e1-ac6f6b27c518 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'e7bf8cf343c048a5bb522f71337b0ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e39b73599884493a85679bc82dcc371', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-38a0aa0d-2343-4403-99e1-ac6f6b27c518 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Request method failure captured: Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 42 Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGEYTRrUG_T7LYt2eDtLno6hzghANeusWQi4XsXqfxOAjo6EGzCSjbVHDVAo2R9Z1pdLgHnQyB5nG_iYDAFRsp8jy-WwgxafpuhFBsWMwRtMGVT37oMUSyDRO9oT5gkVf_Y_phiuwjUbdsVzIYGK_F0NQeZimT7tsAjkAEa8QoZ9p0 Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 2e39b73599884493a85679bc82dcc371 Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:25:45.156602 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:25:45.158299 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2e39b73599884493a85679bc82dcc371"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/2e39b73599884493a85679bc82dcc371"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_2e39b73599884493a85679bc82dcc371"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2e39b73599884493a85679bc82dcc371"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:45.158299 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:45.158299 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 2e39b73599884493a85679bc82dcc371 Aug 18 11:25:45.158299 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813 Aug 18 11:25:45.158299 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AggregatesAdminNegativeTestJSON-1323751813-project Aug 18 11:25:45.158299 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:45.158299 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:45.158299 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e7bf8cf343c048a5bb522f71337b0ca2 Aug 18 11:25:45.158299 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1323751813-project Aug 18 11:25:45.158299 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:25:45.158299 n-d-853611-3 devstack@n-api.service[122210]: {"remove_host": {"host": "n-h2-853611-3"}} Aug 18 11:25:45.158299 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:25:45.158299 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-853611-3'}}} Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:45.159063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 18 11:25:45.160127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-72c4a4c7-0749-4ea0-9d2f-5fce0709ff13 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-72c4a4c7-0749-4ea0-9d2f-5fce0709ff13 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Request method failure captured: Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGI106ofM49q68HTvI50EOGJllUy7aPN-cVac9KejhYkzHXdqALPfncwHnrbCUC_5TX2FA9VW9O_KUd6fZtjksyIhQnP7UM7m4WKYkTp48yusJzk5MKPagAYnItCvaXhpH3pcUbMC87Z-QTMd0URPV3SkEnywqM2-Fbh-f4sOs5Z9k Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 188b4e00f20c4b83860cf5691151cf9a Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AggregatesAdminTestJSON-1548551180 Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:25:45.164024 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:25:45.167337 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:45.167337 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AggregatesAdminTestJSON-1548551180 Aug 18 11:25:45.167337 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 188b4e00f20c4b83860cf5691151cf9a Aug 18 11:25:45.167337 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1548551180 Aug 18 11:25:45.167337 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AggregatesAdminTestJSON-1548551180-project-admin Aug 18 11:25:45.167337 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:45.167337 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:45.167337 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 67280966d1f943828aba65c2082b3bd5 Aug 18 11:25:45.167337 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AggregatesAdminTestJSON-1548551180-project-admin Aug 18 11:25:45.167337 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:45.167337 n-d-853611-3 devstack@n-api.service[122209]: exception: Aggregate 12 could not be found. Aug 18 11:25:45.167337 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '12'} Aug 18 11:25:45.167337 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6483, in delete_aggregate Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:25:45.170350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:45.173969 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:45.178179 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:45.178179 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:45.178179 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:45.178179 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 18 11:25:45.178179 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.178179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-72c4a4c7-0749-4ea0-9d2f-5fce0709ff13 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:45.178179 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-72c4a4c7-0749-4ea0-9d2f-5fce0709ff13 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.040714 Aug 18 11:25:45.178179 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 157/281] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:25:45 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:25:45.178179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-231e9072-0ab9-4795-9fc4-0bdda220942b tempest-FlavorsV261TestJSON-483765699 tempest-FlavorsV261TestJSON-483765699-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:45.179518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-38a0aa0d-2343-4403-99e1-ac6f6b27c518 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:45.180595 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-38a0aa0d-2343-4403-99e1-ac6f6b27c518 tempest-AggregatesAdminNegativeTestJSON-1323751813 tempest-AggregatesAdminNegativeTestJSON-1323751813-project] 10.222.0.73 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.047565 Aug 18 11:25:45.181515 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 125/282] 10.222.0.73 () {60 vars in 1194 bytes} [Thu Aug 18 11:25:45 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:45.193026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-91199eea-339a-4584-8c1b-a020ea25f6a0 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1597965416", "name": "tempest-test_aggregate-1606406934"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:45.222595 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:45.222595 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:45.224593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.aggregate [None req-91199eea-339a-4584-8c1b-a020ea25f6a0 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Generated uuid ce0f192c-aeb3-414d-b038-ae68b11312b1 for aggregate {{(pid=122210) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:45.225610 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-231e9072-0ab9-4795-9fc4-0bdda220942b tempest-FlavorsV261TestJSON-483765699 tempest-FlavorsV261TestJSON-483765699-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.058707 Aug 18 11:25:45.237642 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 158/283] 10.222.0.73 () {60 vars in 1187 bytes} [Thu Aug 18 11:25:45 2022] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:25:45.243285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8e78808e-721e-4635-bf86-d84ce5fa06d5 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853611-3"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:45.246730 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:45.246730 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:45.261178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e78808e-721e-4635-bf86-d84ce5fa06d5 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:45.264507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e78808e-721e-4635-bf86-d84ce5fa06d5 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:45.265196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e78808e-721e-4635-bf86-d84ce5fa06d5 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:45.317458 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-91199eea-339a-4584-8c1b-a020ea25f6a0 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.130777 Aug 18 11:25:45.320250 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 126/284] 10.222.0.73 () {60 vars in 1165 bytes} [Thu Aug 18 11:25:45 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:45.373307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a3609940-270c-4144-a252-a3a2638d5de8 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:45.375168 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:45.375168 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:45.457921 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a3609940-270c-4144-a252-a3a2638d5de8 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.125062 Aug 18 11:25:45.462064 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 127/285] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:25:45 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:45.560844 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8e78808e-721e-4635-bf86-d84ce5fa06d5 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.321545 Aug 18 11:25:45.562592 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 159/286] 10.222.0.73 () {60 vars in 1194 bytes} [Thu Aug 18 11:25:45 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:45.570265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8e0d7fa1-f8f5-4536-a326-e4f2e338a4f9 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:45.571518 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:45.571518 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:45.595074 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-8e0d7fa1-f8f5-4536-a326-e4f2e338a4f9 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8e0d7fa1-f8f5-4536-a326-e4f2e338a4f9 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Request method failure captured: Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGI106ofM49q68HTvI50EOGJllUy7aPN-cVac9KejhYkzHXdqALPfncwHnrbCUC_5TX2FA9VW9O_KUd6fZtjksyIhQnP7UM7m4WKYkTp48yusJzk5MKPagAYnItCvaXhpH3pcUbMC87Z-QTMd0URPV3SkEnywqM2-Fbh-f4sOs5Z9k Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 188b4e00f20c4b83860cf5691151cf9a Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AggregatesAdminTestJSON-1548551180 Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:25:45.596954 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:25:45.598092 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:45.598092 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AggregatesAdminTestJSON-1548551180 Aug 18 11:25:45.598092 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 188b4e00f20c4b83860cf5691151cf9a Aug 18 11:25:45.598092 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1548551180 Aug 18 11:25:45.598092 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AggregatesAdminTestJSON-1548551180-project-admin Aug 18 11:25:45.598092 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:45.598092 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:45.598092 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 67280966d1f943828aba65c2082b3bd5 Aug 18 11:25:45.598092 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AggregatesAdminTestJSON-1548551180-project-admin Aug 18 11:25:45.598092 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:45.598092 n-d-853611-3 devstack@n-api.service[122209]: exception: Aggregate 14 could not be found. Aug 18 11:25:45.598092 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '14'} Aug 18 11:25:45.598092 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6430, in get_aggregate Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:45.598849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 18 11:25:45.599851 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.602553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8e0d7fa1-f8f5-4536-a326-e4f2e338a4f9 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:45.603560 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8e0d7fa1-f8f5-4536-a326-e4f2e338a4f9 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.039791 Aug 18 11:25:45.609220 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 160/287] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:25:45 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:25:45.623686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d89a21f4-3485-4d78-b3cf-54dfe8a63880 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:45.624702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d89a21f4-3485-4d78-b3cf-54dfe8a63880 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:45.632528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d89a21f4-3485-4d78-b3cf-54dfe8a63880 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:45.633490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d89a21f4-3485-4d78-b3cf-54dfe8a63880 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:45.634470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d89a21f4-3485-4d78-b3cf-54dfe8a63880 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:45.635499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d89a21f4-3485-4d78-b3cf-54dfe8a63880 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:45.636374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d89a21f4-3485-4d78-b3cf-54dfe8a63880 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:45.636981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d89a21f4-3485-4d78-b3cf-54dfe8a63880 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:45.877995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d89a21f4-3485-4d78-b3cf-54dfe8a63880 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc840057087743e2b23eaf6da3997b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582d4d6dc459486cbfb696c35cc814f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:45.886658 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d89a21f4-3485-4d78-b3cf-54dfe8a63880 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 200 len: 1323 microversion: 2.1 time: 0.275812 Aug 18 11:25:45.887523 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 161/288] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:45 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 1323 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:45.892218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9763bc22-0dcc-4095-b474-c39446255be3 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:45.892967 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:45.892967 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:45.927479 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9763bc22-0dcc-4095-b474-c39446255be3 tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.038641 Aug 18 11:25:45.929970 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 162/289] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:25:45 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:45.938275 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-afe83cd2-5191-4e04-a27f-f5298b8dd471 req-9e76c69b-ad22-4d70-a250-0d128482572f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5de87cb-7296-4818-98c3-8ef54eaae832", "name": "network-vif-deleted", "tag": "69499d3b-66d5-414a-b16e-beb10a38cce8"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:45.948995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-afe83cd2-5191-4e04-a27f-f5298b8dd471 req-9e76c69b-ad22-4d70-a250-0d128482572f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:45.949526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-afe83cd2-5191-4e04-a27f-f5298b8dd471 req-9e76c69b-ad22-4d70-a250-0d128482572f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:45.951604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-afe83cd2-5191-4e04-a27f-f5298b8dd471 req-9e76c69b-ad22-4d70-a250-0d128482572f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:45.964294 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-afe83cd2-5191-4e04-a27f-f5298b8dd471 req-9e76c69b-ad22-4d70-a250-0d128482572f service nova] Creating event network-vif-deleted:69499d3b-66d5-414a-b16e-beb10a38cce8 for instance f5de87cb-7296-4818-98c3-8ef54eaae832 on n-h2-853611-3 Aug 18 11:25:45.970947 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-afe83cd2-5191-4e04-a27f-f5298b8dd471 req-9e76c69b-ad22-4d70-a250-0d128482572f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039491 Aug 18 11:25:45.971544 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 163/290] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:45.974804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd8ce409-e1d9-4e27-a5be-dcec7eaf1d8b tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:45.977569 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:45.977569 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:45.977924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e8737e1a-4daf-4ef6-acf1-f2e89a838888 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:45.978847 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:45.978847 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:45.979002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd8ce409-e1d9-4e27-a5be-dcec7eaf1d8b tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:45.979403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd8ce409-e1d9-4e27-a5be-dcec7eaf1d8b tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:45.980000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd8ce409-e1d9-4e27-a5be-dcec7eaf1d8b tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:45.982368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd8ce409-e1d9-4e27-a5be-dcec7eaf1d8b tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:45.982898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd8ce409-e1d9-4e27-a5be-dcec7eaf1d8b tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:45.983535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd8ce409-e1d9-4e27-a5be-dcec7eaf1d8b tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:45.989988 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-e8737e1a-4daf-4ef6-acf1-f2e89a838888 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e8737e1a-4daf-4ef6-acf1-f2e89a838888 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Request method failure captured: Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGI106ofM49q68HTvI50EOGJllUy7aPN-cVac9KejhYkzHXdqALPfncwHnrbCUC_5TX2FA9VW9O_KUd6fZtjksyIhQnP7UM7m4WKYkTp48yusJzk5MKPagAYnItCvaXhpH3pcUbMC87Z-QTMd0URPV3SkEnywqM2-Fbh-f4sOs5Z9k Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 188b4e00f20c4b83860cf5691151cf9a Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AggregatesAdminTestJSON-1548551180 Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:25:45.991860 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:25:45.993004 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/188b4e00f20c4b83860cf5691151cf9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:45.993004 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AggregatesAdminTestJSON-1548551180 Aug 18 11:25:45.993004 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 188b4e00f20c4b83860cf5691151cf9a Aug 18 11:25:45.993004 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1548551180 Aug 18 11:25:45.993004 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AggregatesAdminTestJSON-1548551180-project-admin Aug 18 11:25:45.993004 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:45.993004 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:45.993004 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 67280966d1f943828aba65c2082b3bd5 Aug 18 11:25:45.993004 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AggregatesAdminTestJSON-1548551180-project-admin Aug 18 11:25:45.993004 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:45.993004 n-d-853611-3 devstack@n-api.service[122209]: exception: Aggregate 14 could not be found. Aug 18 11:25:45.993004 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '14'} Aug 18 11:25:45.993004 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6483, in delete_aggregate Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:25:45.993776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:45.994831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:45.996801 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:45.996801 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:45.996801 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:45.996801 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 18 11:25:45.996801 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:45.996801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e8737e1a-4daf-4ef6-acf1-f2e89a838888 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:45.996801 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e8737e1a-4daf-4ef6-acf1-f2e89a838888 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.020353 Aug 18 11:25:46.000090 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 164/291] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:25:45 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:25:46.004955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f4b14027-8485-4ff5-9921-db9c98d787ec tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:46.005791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f4b14027-8485-4ff5-9921-db9c98d787ec tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:46.013604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4b14027-8485-4ff5-9921-db9c98d787ec tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.014093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4b14027-8485-4ff5-9921-db9c98d787ec tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.014568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4b14027-8485-4ff5-9921-db9c98d787ec tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.015275 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4b14027-8485-4ff5-9921-db9c98d787ec tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.015668 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd8ce409-e1d9-4e27-a5be-dcec7eaf1d8b tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.552195 Aug 18 11:25:46.015791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4b14027-8485-4ff5-9921-db9c98d787ec tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.016170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4b14027-8485-4ff5-9921-db9c98d787ec tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.016274 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 128/292] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:25:45 2022] GET /compute/v2.1/os-services => generated 944 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:46.020738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd5e7053-3966-4469-a57e-fd4cbbb13c9d tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1049625808"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:46.023346 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:46.023346 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:46.024614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.aggregate [None req-dd5e7053-3966-4469-a57e-fd4cbbb13c9d tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Generated uuid cfdb4959-5c95-4270-b932-1bd91fad5a04 for aggregate {{(pid=122210) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:46.053505 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd5e7053-3966-4469-a57e-fd4cbbb13c9d tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.036202 Aug 18 11:25:46.054115 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 129/293] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:46 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:46.059786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e676474-e567-4921-97cc-7b7534b1878e tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1588308313"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:46.064401 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:46.064401 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:46.066712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.aggregate [None req-7e676474-e567-4921-97cc-7b7534b1878e tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Generated uuid 29d55d55-7d02-45f0-9bdb-fae84dbcccd6 for aggregate {{(pid=122210) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:46.094181 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e676474-e567-4921-97cc-7b7534b1878e tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038666 Aug 18 11:25:46.095405 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 130/294] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:46 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:46.099982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26619e9e-9d59-4036-af13-f54933c1217e tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:46.100748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f4b14027-8485-4ff5-9921-db9c98d787ec tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:46.102806 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:46.102806 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:46.104045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26619e9e-9d59-4036-af13-f54933c1217e tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.104567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26619e9e-9d59-4036-af13-f54933c1217e tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.105005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26619e9e-9d59-4036-af13-f54933c1217e tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.105737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26619e9e-9d59-4036-af13-f54933c1217e tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.107154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26619e9e-9d59-4036-af13-f54933c1217e tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.107762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26619e9e-9d59-4036-af13-f54933c1217e tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.110158 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f4b14027-8485-4ff5-9921-db9c98d787ec tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1271 microversion: 2.1 time: 0.108767 Aug 18 11:25:46.111071 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 165/295] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:46 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:46.112436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=21 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:46.116466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7cb9804c-d888-493e-9a4e-c2a472bf49af tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:46.119154 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:46.119154 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:46.128013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:46.129701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7cb9804c-d888-493e-9a4e-c2a472bf49af tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.130587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7cb9804c-d888-493e-9a4e-c2a472bf49af tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.131235 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7cb9804c-d888-493e-9a4e-c2a472bf49af tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.140364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7cb9804c-d888-493e-9a4e-c2a472bf49af tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.140997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7cb9804c-d888-493e-9a4e-c2a472bf49af tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.141438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7cb9804c-d888-493e-9a4e-c2a472bf49af tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.150052 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-26619e9e-9d59-4036-af13-f54933c1217e tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.052386 Aug 18 11:25:46.151041 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 131/296] 10.222.0.73 () {58 vars in 1170 bytes} [Thu Aug 18 11:25:46 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:46.151263 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.compute.aggregates [None req-7cb9804c-d888-493e-9a4e-c2a472bf49af tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 18 11:25:46.151776 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-7cb9804c-d888-493e-9a4e-c2a472bf49af tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7cb9804c-d888-493e-9a4e-c2a472bf49af tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Request method failure captured: Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 42 Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGGtrlJLl8jLAJKWVbLvLTUlFP56HfI9u2wUXbz671QhGA93ZjVAKuYcxNVgAOiY0WezHKsjnePzMgz9_LaWIwcg_f3UEZCnh0eTkEEq_50NDcUVGmrgyofSOT249_7DvjOWEREYXhh2WG0mhQ8IIMC79Plw8Lr0fX_1q04c6Gha-0 Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:25:46.154197 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:25:46.155391 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6a3fced02b4143f6bfca3403755ad2d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:46.155391 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:46.155391 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6a3fced02b4143f6bfca3403755ad2d9 Aug 18 11:25:46.155391 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-810190363 Aug 18 11:25:46.155391 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:25:46.155391 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:46.155391 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:46.155391 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e142868b2e984bd583f7b45a2fb32e95 Aug 18 11:25:46.155391 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin Aug 18 11:25:46.155391 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:25:46.155391 n-d-853611-3 devstack@n-api.service[122209]: {"remove_host": {"host": "nonexist_host"}} Aug 18 11:25:46.155391 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:46.155391 n-d-853611-3 devstack@n-api.service[122209]: exception: Cannot remove host nonexist_host in aggregate 15 Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5962, in _get_service_in_cell_by_host Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5968, in _get_service_in_cell_by_host Aug 18 11:25:46.156117 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6649, in remove_host_from_aggregate Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 18 11:25:46.157743 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5970, in _get_service_in_cell_by_host Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:46.160375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:46.162005 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:46.162005 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:46.162005 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:46.162005 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:46.162005 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Aug 18 11:25:46.162005 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:46.162005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7cb9804c-d888-493e-9a4e-c2a472bf49af tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:46.162005 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7cb9804c-d888-493e-9a4e-c2a472bf49af tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.043402 Aug 18 11:25:46.162587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-273c49ee-5146-4b57-b575-a0d24554c77e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:46.162587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-273c49ee-5146-4b57-b575-a0d24554c77e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:46.163170 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 166/297] 10.222.0.73 () {60 vars in 1194 bytes} [Thu Aug 18 11:25:46 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:25:46.165200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7bc8bff3-8432-4a29-a12b-41f55b8ce3c2 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:46.166130 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:46.166130 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:46.168427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-273c49ee-5146-4b57-b575-a0d24554c77e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.170250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-273c49ee-5146-4b57-b575-a0d24554c77e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.170884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-273c49ee-5146-4b57-b575-a0d24554c77e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.171826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-273c49ee-5146-4b57-b575-a0d24554c77e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.172354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-273c49ee-5146-4b57-b575-a0d24554c77e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.172975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-273c49ee-5146-4b57-b575-a0d24554c77e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.173589 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7bc8bff3-8432-4a29-a12b-41f55b8ce3c2 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.011780 Aug 18 11:25:46.174148 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 167/298] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:25:46 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:46.178628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-437770b4-b20d-41d9-bbca-a493578ea53c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:46.179577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-437770b4-b20d-41d9-bbca-a493578ea53c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:46.185542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437770b4-b20d-41d9-bbca-a493578ea53c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.186248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437770b4-b20d-41d9-bbca-a493578ea53c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.186703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437770b4-b20d-41d9-bbca-a493578ea53c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.187589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437770b4-b20d-41d9-bbca-a493578ea53c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.188039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437770b4-b20d-41d9-bbca-a493578ea53c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.188451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437770b4-b20d-41d9-bbca-a493578ea53c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.226030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437770b4-b20d-41d9-bbca-a493578ea53c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.226533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437770b4-b20d-41d9-bbca-a493578ea53c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.226964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437770b4-b20d-41d9-bbca-a493578ea53c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.227405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-437770b4-b20d-41d9-bbca-a493578ea53c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lazy-loading 'fault' on Instance uuid f5de87cb-7296-4818-98c3-8ef54eaae832 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:25:46.278810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-437770b4-b20d-41d9-bbca-a493578ea53c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:46.286876 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-437770b4-b20d-41d9-bbca-a493578ea53c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 200 len: 1310 microversion: 2.1 time: 0.111543 Aug 18 11:25:46.287460 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 168/299] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:46 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 1310 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:46.302208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2b06e9cb-927f-427e-94e0-2232638852c7 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:46.304962 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:46.304962 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:46.306207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b06e9cb-927f-427e-94e0-2232638852c7 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.307135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b06e9cb-927f-427e-94e0-2232638852c7 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.307343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b06e9cb-927f-427e-94e0-2232638852c7 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.308054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b06e9cb-927f-427e-94e0-2232638852c7 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.308514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b06e9cb-927f-427e-94e0-2232638852c7 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.308963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b06e9cb-927f-427e-94e0-2232638852c7 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.331607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-273c49ee-5146-4b57-b575-a0d24554c77e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:46.340111 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-273c49ee-5146-4b57-b575-a0d24554c77e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1587 microversion: 2.1 time: 0.188005 Aug 18 11:25:46.341506 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 132/300] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:46 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1587 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:46.346925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6d72175b-8104-453b-9c4f-2ce9c68bd47f tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:46.348334 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:46.348334 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:46.353506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=7,nova_api:DELETE=7 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:46.371540 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2b06e9cb-927f-427e-94e0-2232638852c7 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.075241 Aug 18 11:25:46.374811 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 169/301] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:25:46 2022] GET /compute/v2.1/os-services => generated 944 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:46.380051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-59e3d9d1-d2c3-440f-afd8-bfca3fc79d32 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:46.382973 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:46.382973 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:46.399139 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6d72175b-8104-453b-9c4f-2ce9c68bd47f tempest-AggregatesAdminNegativeTestJSON-810190363 tempest-AggregatesAdminNegativeTestJSON-810190363-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.056314 Aug 18 11:25:46.406977 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 133/302] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:25:46 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:46.414737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b070aa9-f919-460a-9d07-a6c8ee125a64 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:46.415274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b070aa9-f919-460a-9d07-a6c8ee125a64 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:46.422984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b070aa9-f919-460a-9d07-a6c8ee125a64 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.423468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b070aa9-f919-460a-9d07-a6c8ee125a64 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.423897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b070aa9-f919-460a-9d07-a6c8ee125a64 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.424589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b070aa9-f919-460a-9d07-a6c8ee125a64 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.425431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b070aa9-f919-460a-9d07-a6c8ee125a64 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.425870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b070aa9-f919-460a-9d07-a6c8ee125a64 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.433827 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-59e3d9d1-d2c3-440f-afd8-bfca3fc79d32 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.057566 Aug 18 11:25:46.436071 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 170/303] 10.222.0.73 () {60 vars in 1194 bytes} [Thu Aug 18 11:25:46 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:46.440894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-02b6cd73-3ac3-4ae4-92db-396ee8879845 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:46.474812 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:46.474812 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:46.477590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b6cd73-3ac3-4ae4-92db-396ee8879845 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.478312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b6cd73-3ac3-4ae4-92db-396ee8879845 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.479117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b6cd73-3ac3-4ae4-92db-396ee8879845 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.482217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b6cd73-3ac3-4ae4-92db-396ee8879845 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.482974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b6cd73-3ac3-4ae4-92db-396ee8879845 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.484024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b6cd73-3ac3-4ae4-92db-396ee8879845 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.551500 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-02b6cd73-3ac3-4ae4-92db-396ee8879845 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?host=n-d-853611-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.114122 Aug 18 11:25:46.557338 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 171/304] 10.222.0.73 () {58 vars in 1194 bytes} [Thu Aug 18 11:25:46 2022] GET /compute/v2.1/os-services?host=n-d-853611-3&binary=xxx => generated 16 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:25:46.564288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-144d1702-1d48-4271-bd0a-23c61c5ab81b tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:46.564288 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:46.564288 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:46.598935 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-144d1702-1d48-4271-bd0a-23c61c5ab81b tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.040182 Aug 18 11:25:46.599790 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 172/305] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:25:46 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:46.608410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a3c44b64-4103-4e1e-80f7-32f8c3c8e114 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:46.612944 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:46.612944 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:46.614626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3c44b64-4103-4e1e-80f7-32f8c3c8e114 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.626693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3c44b64-4103-4e1e-80f7-32f8c3c8e114 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.627534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3c44b64-4103-4e1e-80f7-32f8c3c8e114 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.632358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3c44b64-4103-4e1e-80f7-32f8c3c8e114 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.633147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3c44b64-4103-4e1e-80f7-32f8c3c8e114 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.633809 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3c44b64-4103-4e1e-80f7-32f8c3c8e114 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.685336 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b070aa9-f919-460a-9d07-a6c8ee125a64 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.277203 Aug 18 11:25:46.686409 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 134/306] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:25:46 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c/os-interface => generated 284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:46.699524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-19eb7850-0cc9-4cc0-aaee-8b719bb7cb2a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:46.702322 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:46.702322 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:46.705120 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a3c44b64-4103-4e1e-80f7-32f8c3c8e114 tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.103101 Aug 18 11:25:46.711109 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 173/307] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:25:46 2022] GET /compute/v2.1/os-services => generated 944 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:46.723405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-66608f9d-2049-46d4-a604-439fd5dcf63d tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:46.726002 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:46.726002 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:46.727200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66608f9d-2049-46d4-a604-439fd5dcf63d tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.750087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66608f9d-2049-46d4-a604-439fd5dcf63d tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.750630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66608f9d-2049-46d4-a604-439fd5dcf63d tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.751462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66608f9d-2049-46d4-a604-439fd5dcf63d tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.751952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66608f9d-2049-46d4-a604-439fd5dcf63d tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.752379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66608f9d-2049-46d4-a604-439fd5dcf63d tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.776829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:46.794957 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-19eb7850-0cc9-4cc0-aaee-8b719bb7cb2a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.099998 Aug 18 11:25:46.804348 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 135/308] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:25:46 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:46.815024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b36d1d1-40c9-4040-88eb-f9297b6cd001 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2010279320", "availability_zone": "tempest-test_az-307424438"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:46.822420 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-66608f9d-2049-46d4-a604-439fd5dcf63d tempest-ServicesAdminNegativeTestJSON-1240412099 tempest-ServicesAdminNegativeTestJSON-1240412099-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.108411 Aug 18 11:25:46.823409 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 174/309] 10.222.0.73 () {58 vars in 1198 bytes} [Thu Aug 18 11:25:46 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:25:46.832765 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:46.832765 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:46.833904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.aggregate [None req-0b36d1d1-40c9-4040-88eb-f9297b6cd001 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Generated uuid 5241b4f0-533c-4fe5-bfb0-cbd78d0fc824 for aggregate {{(pid=122210) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:46.897856 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b36d1d1-40c9-4040-88eb-f9297b6cd001 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.089200 Aug 18 11:25:46.899143 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 136/310] 10.222.0.73 () {60 vars in 1165 bytes} [Thu Aug 18 11:25:46 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:46.912035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-25a0723c-bc39-424c-9fae-a5937c0c2917 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:46.912658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-25a0723c-bc39-424c-9fae-a5937c0c2917 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:46.922866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25a0723c-bc39-424c-9fae-a5937c0c2917 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.923376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25a0723c-bc39-424c-9fae-a5937c0c2917 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.923824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25a0723c-bc39-424c-9fae-a5937c0c2917 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:46.924551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25a0723c-bc39-424c-9fae-a5937c0c2917 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:46.925176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25a0723c-bc39-424c-9fae-a5937c0c2917 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:46.925617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25a0723c-bc39-424c-9fae-a5937c0c2917 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:47.344123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fea20a60-b561-4679-8084-a86a98798646 tempest-ServicesAdminNegativeTestJSON-2122435979 tempest-ServicesAdminNegativeTestJSON-2122435979-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:47.350281 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:47.350281 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:47.352137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fea20a60-b561-4679-8084-a86a98798646 tempest-ServicesAdminNegativeTestJSON-2122435979 tempest-ServicesAdminNegativeTestJSON-2122435979-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a1f7b858be9b4ee9a28d2c63c188ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37cc56d876843a7ba5b72d74d407052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fea20a60-b561-4679-8084-a86a98798646 tempest-ServicesAdminNegativeTestJSON-2122435979 tempest-ServicesAdminNegativeTestJSON-2122435979-project] Request method failure captured: Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iG4y1OzzC7Tn4GZxfwDoONrW8cUD_kYBKIZZMKE0K2-mfr_fyhS_raTQ3lmtX-c345beirH-GkU8-3PA_6ilp6CzSOh430ECIbyPtQFQEUo5Ri0zKagC-3YmbhSzRKae8kzH7EaJ1Ab9jsvyjLVg6wVLSPk7qG0ZQqo8wo5iyT-g6Q Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: c37cc56d876843a7ba5b72d74d407052 Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-2122435979 Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:25:47.354892 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:25:47.356437 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c37cc56d876843a7ba5b72d74d407052"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c37cc56d876843a7ba5b72d74d407052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c37cc56d876843a7ba5b72d74d407052"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c37cc56d876843a7ba5b72d74d407052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:47.356437 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-2122435979 Aug 18 11:25:47.356437 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: c37cc56d876843a7ba5b72d74d407052 Aug 18 11:25:47.356437 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-2122435979 Aug 18 11:25:47.356437 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServicesAdminNegativeTestJSON-2122435979-project Aug 18 11:25:47.356437 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:47.356437 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:47.356437 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: a1f7b858be9b4ee9a28d2c63c188ad24 Aug 18 11:25:47.356437 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-2122435979-project Aug 18 11:25:47.356437 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:47.356437 n-d-853611-3 devstack@n-api.service[122209]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 18 11:25:47.356437 n-d-853611-3 devstack@n-api.service[122209]: action_args: {} Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:25:47.357581 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 18 11:25:47.358647 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:47.359751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fea20a60-b561-4679-8084-a86a98798646 tempest-ServicesAdminNegativeTestJSON-2122435979 tempest-ServicesAdminNegativeTestJSON-2122435979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:47.359751 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fea20a60-b561-4679-8084-a86a98798646 tempest-ServicesAdminNegativeTestJSON-2122435979 tempest-ServicesAdminNegativeTestJSON-2122435979-project] 10.222.0.73 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.524591 Aug 18 11:25:47.359751 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 175/311] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:25:46 2022] GET /compute/v2.1/os-services => generated 112 bytes in 527 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:47.379757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2a3933f1-d09e-4044-b8ba-94df04967dab tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2010279320_new", "availability_zone": "tempest-test_az-307424438_new"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:47.382512 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:47.382512 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:47.430656 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3933f1-d09e-4044-b8ba-94df04967dab tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:47.431516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3933f1-d09e-4044-b8ba-94df04967dab tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:47.436006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3933f1-d09e-4044-b8ba-94df04967dab tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:47.485673 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2a3933f1-d09e-4044-b8ba-94df04967dab tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.124650 Aug 18 11:25:47.487090 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 176/312] 10.222.0.73 () {60 vars in 1173 bytes} [Thu Aug 18 11:25:47 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:47.502286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-a39820fb-a82e-4b77-9650-2e3fba6f2469 req-50a71332-45cf-44bc-a745-bc410fd4649d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294a7aa1-4490-4569-b325-24ca4c1dde28", "name": "network-vif-plugged", "status": "completed", "tag": "2ecc822a-3334-4712-967b-24e6ce852509"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:47.526052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a39820fb-a82e-4b77-9650-2e3fba6f2469 req-50a71332-45cf-44bc-a745-bc410fd4649d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:47.528663 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a39820fb-a82e-4b77-9650-2e3fba6f2469 req-50a71332-45cf-44bc-a745-bc410fd4649d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:47.529267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a39820fb-a82e-4b77-9650-2e3fba6f2469 req-50a71332-45cf-44bc-a745-bc410fd4649d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:47.548562 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-a39820fb-a82e-4b77-9650-2e3fba6f2469 req-50a71332-45cf-44bc-a745-bc410fd4649d service nova] Creating event network-vif-plugged:2ecc822a-3334-4712-967b-24e6ce852509 for instance 294a7aa1-4490-4569-b325-24ca4c1dde28 on n-h1-853611-3 Aug 18 11:25:47.555259 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-a39820fb-a82e-4b77-9650-2e3fba6f2469 req-50a71332-45cf-44bc-a745-bc410fd4649d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065863 Aug 18 11:25:47.557780 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 177/313] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:47.565292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-89891b46-9a7f-472f-b5dc-54b4467df1d9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:47.566149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-89891b46-9a7f-472f-b5dc-54b4467df1d9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:47.574276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89891b46-9a7f-472f-b5dc-54b4467df1d9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:47.575634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89891b46-9a7f-472f-b5dc-54b4467df1d9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:47.576201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89891b46-9a7f-472f-b5dc-54b4467df1d9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:47.577957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89891b46-9a7f-472f-b5dc-54b4467df1d9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:47.578560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89891b46-9a7f-472f-b5dc-54b4467df1d9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:47.579221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89891b46-9a7f-472f-b5dc-54b4467df1d9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:47.746009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-89891b46-9a7f-472f-b5dc-54b4467df1d9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:47.792579 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-89891b46-9a7f-472f-b5dc-54b4467df1d9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1277 microversion: 2.1 time: 0.232847 Aug 18 11:25:47.806454 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 178/314] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:47 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1277 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:47.832773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3b066d59-1d3b-4635-907c-7e2353d72e55 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:47.835215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3b066d59-1d3b-4635-907c-7e2353d72e55 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:47.858995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b066d59-1d3b-4635-907c-7e2353d72e55 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:47.861580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b066d59-1d3b-4635-907c-7e2353d72e55 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:47.862576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b066d59-1d3b-4635-907c-7e2353d72e55 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:47.864464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b066d59-1d3b-4635-907c-7e2353d72e55 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:47.866098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b066d59-1d3b-4635-907c-7e2353d72e55 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:47.867246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b066d59-1d3b-4635-907c-7e2353d72e55 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:47.916603 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-3b066d59-1d3b-4635-907c-7e2353d72e55 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] HTTP exception thrown: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3b066d59-1d3b-4635-907c-7e2353d72e55 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Request method failure captured: Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 HTTP/1.1 Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGjWzyfQFIIMKiuUEF2pLc0XXsp4vaWoPAGhl_z5XN7oPk-T3KSsyq2hU98xCNDMo2l3FUbq76QRmj_-5QoDCXBBB_p2rEDgcOq7ar200W-Ri9TulXdxHUd4TzixPnAqgRk2dO6jufdQRatxYlts8zPMZqNzIYbrFFMO-LTSjiC3Fs Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 89daeef39bfc4a6d9655a6adf698dcb3 Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:25:47.918384 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:25:47.920750 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:47.920750 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:25:47.920750 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 89daeef39bfc4a6d9655a6adf698dcb3 Aug 18 11:25:47.920750 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:25:47.920750 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersAdminTestJSON-1327442043-project Aug 18 11:25:47.920750 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:47.920750 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:47.920750 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4888e1219d22476b8767e9fcef0bd6e0 Aug 18 11:25:47.920750 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersAdminTestJSON-1327442043-project Aug 18 11:25:47.920750 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:47.920750 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:25:47.920750 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'f5de87cb-7296-4818-98c3-8ef54eaae832'} Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:47.921434 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:25:47.923732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:47.924912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3b066d59-1d3b-4635-907c-7e2353d72e55 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Returning 404 to user: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:47.924912 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3b066d59-1d3b-4635-907c-7e2353d72e55 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 404 len: 111 microversion: 2.1 time: 0.122504 Aug 18 11:25:47.924912 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 179/315] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:47 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:47.943805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3aa9c07a-2e64-4dca-8b58-71cff43f506a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:47.948866 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:47.948866 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:47.957381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-25a0723c-bc39-424c-9fae-a5937c0c2917 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc840057087743e2b23eaf6da3997b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582d4d6dc459486cbfb696c35cc814f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:47.959010 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3aa9c07a-2e64-4dca-8b58-71cff43f506a tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.028711 Aug 18 11:25:47.960156 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 180/316] 10.222.0.73 () {58 vars in 1143 bytes} [Thu Aug 18 11:25:47 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:47.972582 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-25a0723c-bc39-424c-9fae-a5937c0c2917 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 200 len: 1323 microversion: 2.1 time: 1.065447 Aug 18 11:25:47.973203 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 137/317] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:46 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 1323 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:47.977299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-62e637b9-daf1-4403-b568-222031b9b146 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:47.978168 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:47.978168 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:48.023703 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-62e637b9-daf1-4403-b568-222031b9b146 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.055171 Aug 18 11:25:48.024685 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 181/318] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:25:47 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:48.036039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ca709813-0ebe-4570-86a2-62c5d04ecab4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-671467578"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:48.039219 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:48.039219 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:48.041139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.aggregate [None req-ca709813-0ebe-4570-86a2-62c5d04ecab4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Generated uuid 5c031f68-db94-49d4-a1e6-29ba8c804277 for aggregate {{(pid=122210) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 11:25:48.070399 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ca709813-0ebe-4570-86a2-62c5d04ecab4 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038825 Aug 18 11:25:48.071736 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 138/319] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 11:25:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:48.084095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a370f5b4-a795-41cc-b9f6-8f3e046126a1 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:48.085040 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:48.085040 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:48.098596 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a370f5b4-a795-41cc-b9f6-8f3e046126a1 tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.019161 Aug 18 11:25:48.099274 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 182/320] 10.222.0.73 () {58 vars in 1143 bytes} [Thu Aug 18 11:25:48 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:48.111891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f926f800-8b22-4b71-ac94-db827bab32ca tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:48.113404 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:48.113404 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:48.157049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-744735772", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:48.158707 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f926f800-8b22-4b71-ac94-db827bab32ca tempest-AggregatesAdminTestJSON-1548551180 tempest-AggregatesAdminTestJSON-1548551180-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.052000 Aug 18 11:25:48.160816 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 139/321] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:25:48 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 11:25:48.177261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-62c60ad0-76b0-44f4-90b8-987d80de477b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:48.178232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-62c60ad0-76b0-44f4-90b8-987d80de477b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:48.192523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62c60ad0-76b0-44f4-90b8-987d80de477b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:48.193263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62c60ad0-76b0-44f4-90b8-987d80de477b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:48.198130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62c60ad0-76b0-44f4-90b8-987d80de477b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:48.201931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62c60ad0-76b0-44f4-90b8-987d80de477b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:48.204138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62c60ad0-76b0-44f4-90b8-987d80de477b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:48.205788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62c60ad0-76b0-44f4-90b8-987d80de477b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:48.236796 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-62c60ad0-76b0-44f4-90b8-987d80de477b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] HTTP exception thrown: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-62c60ad0-76b0-44f4-90b8-987d80de477b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Request method failure captured: Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e HTTP/1.1 Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGFJWwwobtXaB4o_UCF-ZhEmJ3Ubd4QPIjK-tNHGzAsrpB0zPLnblmZY3vy8sjyKJKe3errdoZqXeBvdV2kgyTe3_PWmfV3BdjL5k2H0SiJH-dJVUaOqtwesxPsTQJwjsQ79eRa-RXSx1U1RWVFHNZ9urNDHtdgxqB8GKY6veZmzkI Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 2f9f8e64f23b4d8583490483c4030f40 Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AggregatesAdminTestJSON-1273950221 Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:25:48.239992 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:25:48.241097 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2f9f8e64f23b4d8583490483c4030f40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/2f9f8e64f23b4d8583490483c4030f40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_2f9f8e64f23b4d8583490483c4030f40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2f9f8e64f23b4d8583490483c4030f40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:48.241097 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AggregatesAdminTestJSON-1273950221 Aug 18 11:25:48.241097 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 2f9f8e64f23b4d8583490483c4030f40 Aug 18 11:25:48.241097 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1273950221 Aug 18 11:25:48.241097 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AggregatesAdminTestJSON-1273950221-project Aug 18 11:25:48.241097 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:48.241097 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:48.241097 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: b935333d5dd84e61b99b5ea97050147a Aug 18 11:25:48.241097 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AggregatesAdminTestJSON-1273950221-project Aug 18 11:25:48.241097 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:25:48.241097 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:48.241097 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '86ca1ed8-935b-4952-b52c-21029f23af9e'} Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:48.241747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:48.243358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:48.244396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-62c60ad0-76b0-44f4-90b8-987d80de477b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Returning 404 to user: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:48.244396 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-62c60ad0-76b0-44f4-90b8-987d80de477b tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "DELETE /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 404 len: 111 microversion: 2.1 time: 0.074697 Aug 18 11:25:48.244396 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 140/322] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:25:48 2022] DELETE /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:25:48.253210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-33801d29-0312-45d6-b4fc-945d444ae5ce tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:48.253914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-33801d29-0312-45d6-b4fc-945d444ae5ce tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] [instance: 86ca1ed8-935b-4952-b52c-21029f23af9e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:48.261188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33801d29-0312-45d6-b4fc-945d444ae5ce tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:48.261768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33801d29-0312-45d6-b4fc-945d444ae5ce tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:48.262907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33801d29-0312-45d6-b4fc-945d444ae5ce tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:48.263692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33801d29-0312-45d6-b4fc-945d444ae5ce tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:48.264625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33801d29-0312-45d6-b4fc-945d444ae5ce tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:48.265169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33801d29-0312-45d6-b4fc-945d444ae5ce tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:48.286346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:25:48.304548 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-33801d29-0312-45d6-b4fc-945d444ae5ce tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] HTTP exception thrown: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-33801d29-0312-45d6-b4fc-945d444ae5ce tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Request method failure captured: Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e HTTP/1.1 Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGFJWwwobtXaB4o_UCF-ZhEmJ3Ubd4QPIjK-tNHGzAsrpB0zPLnblmZY3vy8sjyKJKe3errdoZqXeBvdV2kgyTe3_PWmfV3BdjL5k2H0SiJH-dJVUaOqtwesxPsTQJwjsQ79eRa-RXSx1U1RWVFHNZ9urNDHtdgxqB8GKY6veZmzkI Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 2f9f8e64f23b4d8583490483c4030f40 Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AggregatesAdminTestJSON-1273950221 Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:25:48.306186 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:25:48.307694 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2f9f8e64f23b4d8583490483c4030f40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/2f9f8e64f23b4d8583490483c4030f40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_2f9f8e64f23b4d8583490483c4030f40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2f9f8e64f23b4d8583490483c4030f40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:48.307694 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AggregatesAdminTestJSON-1273950221 Aug 18 11:25:48.307694 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 2f9f8e64f23b4d8583490483c4030f40 Aug 18 11:25:48.307694 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1273950221 Aug 18 11:25:48.307694 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AggregatesAdminTestJSON-1273950221-project Aug 18 11:25:48.307694 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:48.307694 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:48.307694 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: b935333d5dd84e61b99b5ea97050147a Aug 18 11:25:48.307694 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AggregatesAdminTestJSON-1273950221-project Aug 18 11:25:48.307694 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:25:48.307694 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:48.307694 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '86ca1ed8-935b-4952-b52c-21029f23af9e'} Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:48.308508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. Aug 18 11:25:48.310854 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:48.314801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-33801d29-0312-45d6-b4fc-945d444ae5ce tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] Returning 404 to user: Instance 86ca1ed8-935b-4952-b52c-21029f23af9e could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:48.316976 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-33801d29-0312-45d6-b4fc-945d444ae5ce tempest-AggregatesAdminTestJSON-1273950221 tempest-AggregatesAdminTestJSON-1273950221-project] 10.222.0.73 "GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e" status: 404 len: 111 microversion: 2.1 time: 0.069145 Aug 18 11:25:48.317880 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 141/323] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:48 2022] GET /compute/v2.1/servers/86ca1ed8-935b-4952-b52c-21029f23af9e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:48.720885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:25:48.721852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:25:48.723032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:25:48.724082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:25:48.725734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:25:48.742579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=69 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:48.749085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:48.750167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:48.756547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:48.758924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:48.760887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:48.762195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:48.795096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Getting quotas for project 89daeef39bfc4a6d9655a6adf698dcb3. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:25:48.801506 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Getting quotas for user 4888e1219d22476b8767e9fcef0bd6e0 and project 89daeef39bfc4a6d9655a6adf698dcb3. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:25:48.819159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dbc6ea70-e65f-4d85-ab98-3ba641808e0f tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:48.820124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dbc6ea70-e65f-4d85-ab98-3ba641808e0f tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:48.825731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:25:48.827794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbc6ea70-e65f-4d85-ab98-3ba641808e0f tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:48.828461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:25:48.828638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbc6ea70-e65f-4d85-ab98-3ba641808e0f tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:48.829145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbc6ea70-e65f-4d85-ab98-3ba641808e0f tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:48.830052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbc6ea70-e65f-4d85-ab98-3ba641808e0f tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:48.830813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbc6ea70-e65f-4d85-ab98-3ba641808e0f tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:48.831706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbc6ea70-e65f-4d85-ab98-3ba641808e0f tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:48.938233 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-45ceee27-04c5-4761-a8dc-395985e6ce0d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787029 Aug 18 11:25:48.940684 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 183/324] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:25:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:25:48.958653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b31473c6-8494-4fdd-aa01-8bca877bbf67 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:48.962491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b31473c6-8494-4fdd-aa01-8bca877bbf67 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:49.119584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b31473c6-8494-4fdd-aa01-8bca877bbf67 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:49.128330 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b31473c6-8494-4fdd-aa01-8bca877bbf67 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1219 microversion: 2.1 time: 0.180687 Aug 18 11:25:49.129400 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 184/325] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:48 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1219 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:49.134354 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f3a741ae-1799-44e9-b543-0da03f178712 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:49.134989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f3a741ae-1799-44e9-b543-0da03f178712 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:49.171846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3a741ae-1799-44e9-b543-0da03f178712 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:49.172352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3a741ae-1799-44e9-b543-0da03f178712 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:49.172789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3a741ae-1799-44e9-b543-0da03f178712 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:49.177008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3a741ae-1799-44e9-b543-0da03f178712 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:49.177470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3a741ae-1799-44e9-b543-0da03f178712 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:49.178133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3a741ae-1799-44e9-b543-0da03f178712 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:49.366239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dbc6ea70-e65f-4d85-ab98-3ba641808e0f tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:49.394114 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dbc6ea70-e65f-4d85-ab98-3ba641808e0f tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1319 microversion: 2.1 time: 0.578313 Aug 18 11:25:49.397235 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 142/326] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:48 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1319 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:49.616385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f3a741ae-1799-44e9-b543-0da03f178712 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc840057087743e2b23eaf6da3997b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582d4d6dc459486cbfb696c35cc814f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:49.629027 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f3a741ae-1799-44e9-b543-0da03f178712 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 200 len: 1472 microversion: 2.1 time: 0.498369 Aug 18 11:25:49.634720 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 185/327] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:49 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 1472 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:49.660760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b3fce69-909e-46f1-a96b-448d42df84d5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:49.663230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3b3fce69-909e-46f1-a96b-448d42df84d5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:49.676222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b3fce69-909e-46f1-a96b-448d42df84d5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:49.690024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b3fce69-909e-46f1-a96b-448d42df84d5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:49.691200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b3fce69-909e-46f1-a96b-448d42df84d5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:49.693704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b3fce69-909e-46f1-a96b-448d42df84d5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:49.695355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b3fce69-909e-46f1-a96b-448d42df84d5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:49.696888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b3fce69-909e-46f1-a96b-448d42df84d5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:49.785333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3b3fce69-909e-46f1-a96b-448d42df84d5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'cc840057087743e2b23eaf6da3997b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582d4d6dc459486cbfb696c35cc814f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b3fce69-909e-46f1-a96b-448d42df84d5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Request method failure captured: Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28/diagnostics HTTP/1.1 Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGqqKkAx8RIqeBN2ciuyn9sAJ2UqFAVO2wGZA5hct2c-LijVQjjWm6bUfO6pYEsR71As4nZgM4Rva7u8sPdBM6WZ3NwcxDmKIgAhWEs89PYfgJirkuit6CQ2utiEECnD_p7N66N-eyHSAEAgxnRV2NENxX9U5hOLq00llK5v62qr1E Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 582d4d6dc459486cbfb696c35cc814f4 Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1429158256 Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:25:49.788376 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:25:49.789566 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/582d4d6dc459486cbfb696c35cc814f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/582d4d6dc459486cbfb696c35cc814f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_582d4d6dc459486cbfb696c35cc814f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/582d4d6dc459486cbfb696c35cc814f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:49.789566 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1429158256 Aug 18 11:25:49.789566 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 582d4d6dc459486cbfb696c35cc814f4 Aug 18 11:25:49.789566 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1429158256 Aug 18 11:25:49.789566 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerDiagnosticsNegativeTest-1429158256-project Aug 18 11:25:49.789566 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:25:49.789566 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:25:49.789566 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: cc840057087743e2b23eaf6da3997b56 Aug 18 11:25:49.789566 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1429158256-project Aug 18 11:25:49.789566 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:25:49.789566 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': '294a7aa1-4490-4569-b325-24ca4c1dde28'} Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:25:49.790164 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:25:49.791229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b3fce69-909e-46f1-a96b-448d42df84d5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:49.792746 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3b3fce69-909e-46f1-a96b-448d42df84d5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.134691 Aug 18 11:25:49.800042 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 143/328] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:25:49 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28/diagnostics => generated 117 bytes in 145 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:49.808665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-04949fbb-fad2-4839-bb5f-4c6aa3e5df43 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:49.809331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-04949fbb-fad2-4839-bb5f-4c6aa3e5df43 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:49.824110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04949fbb-fad2-4839-bb5f-4c6aa3e5df43 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:49.831348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04949fbb-fad2-4839-bb5f-4c6aa3e5df43 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:49.832052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04949fbb-fad2-4839-bb5f-4c6aa3e5df43 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:49.832991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04949fbb-fad2-4839-bb5f-4c6aa3e5df43 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:49.833670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04949fbb-fad2-4839-bb5f-4c6aa3e5df43 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:49.834298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04949fbb-fad2-4839-bb5f-4c6aa3e5df43 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:49.860733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8e52e623-602b-4e90-8fbe-7ba64e922bc9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:49.861629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8e52e623-602b-4e90-8fbe-7ba64e922bc9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:49.884766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e52e623-602b-4e90-8fbe-7ba64e922bc9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:49.885799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e52e623-602b-4e90-8fbe-7ba64e922bc9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:49.886508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e52e623-602b-4e90-8fbe-7ba64e922bc9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:49.890560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e52e623-602b-4e90-8fbe-7ba64e922bc9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:49.892680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e52e623-602b-4e90-8fbe-7ba64e922bc9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:49.892680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e52e623-602b-4e90-8fbe-7ba64e922bc9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:49.901511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-04949fbb-fad2-4839-bb5f-4c6aa3e5df43 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:25:50.143248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8e52e623-602b-4e90-8fbe-7ba64e922bc9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:50.156816 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8e52e623-602b-4e90-8fbe-7ba64e922bc9 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 200 len: 1587 microversion: 2.1 time: 0.302757 Aug 18 11:25:50.158004 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 144/329] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:49 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 1587 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:50.164492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-06b7ccc4-3258-4347-8868-020479e0bd30 req-45443b35-9317-47b3-a8d0-401446507d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22337998-2a5d-4fdc-a5f7-6d1067a13c9c", "tag": "ba49d06a-552b-4db3-9851-132789c232c7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:50.177335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-06b7ccc4-3258-4347-8868-020479e0bd30 req-45443b35-9317-47b3-a8d0-401446507d97 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:50.178172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-06b7ccc4-3258-4347-8868-020479e0bd30 req-45443b35-9317-47b3-a8d0-401446507d97 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:50.178817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-06b7ccc4-3258-4347-8868-020479e0bd30 req-45443b35-9317-47b3-a8d0-401446507d97 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:50.196498 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-06b7ccc4-3258-4347-8868-020479e0bd30 req-45443b35-9317-47b3-a8d0-401446507d97 service nova] Creating event network-changed:ba49d06a-552b-4db3-9851-132789c232c7 for instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c on n-h1-853611-3 Aug 18 11:25:50.205184 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-06b7ccc4-3258-4347-8868-020479e0bd30 req-45443b35-9317-47b3-a8d0-401446507d97 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044271 Aug 18 11:25:50.205958 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 145/330] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:50.219387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a6bcf987-b8cd-44c5-91b3-a21233058e3a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:50.220297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a6bcf987-b8cd-44c5-91b3-a21233058e3a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:50.228385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6bcf987-b8cd-44c5-91b3-a21233058e3a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:50.229206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6bcf987-b8cd-44c5-91b3-a21233058e3a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:50.229904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6bcf987-b8cd-44c5-91b3-a21233058e3a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:50.231252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6bcf987-b8cd-44c5-91b3-a21233058e3a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:50.232112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6bcf987-b8cd-44c5-91b3-a21233058e3a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:50.232683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6bcf987-b8cd-44c5-91b3-a21233058e3a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:50.253894 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-04949fbb-fad2-4839-bb5f-4c6aa3e5df43 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "DELETE /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 204 len: 0 microversion: 2.1 time: 0.450444 Aug 18 11:25:50.254902 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 186/331] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:25:49 2022] DELETE /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:25:50.265863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-437f9d4b-48c8-48a3-a1fb-1c991fad2f0a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:50.267414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-437f9d4b-48c8-48a3-a1fb-1c991fad2f0a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:50.288682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437f9d4b-48c8-48a3-a1fb-1c991fad2f0a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:50.291614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437f9d4b-48c8-48a3-a1fb-1c991fad2f0a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:50.293294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437f9d4b-48c8-48a3-a1fb-1c991fad2f0a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:50.297135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437f9d4b-48c8-48a3-a1fb-1c991fad2f0a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:50.298172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437f9d4b-48c8-48a3-a1fb-1c991fad2f0a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:50.299930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-437f9d4b-48c8-48a3-a1fb-1c991fad2f0a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:50.316496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a6bcf987-b8cd-44c5-91b3-a21233058e3a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:50.326878 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a6bcf987-b8cd-44c5-91b3-a21233058e3a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1215 microversion: 2.1 time: 0.119324 Aug 18 11:25:50.329614 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 146/332] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:50 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:50.417167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-37558ebd-1855-4ce7-ac56-5f365a3e2935 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:50.419874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-37558ebd-1855-4ce7-ac56-5f365a3e2935 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:50.431141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37558ebd-1855-4ce7-ac56-5f365a3e2935 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:50.432274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37558ebd-1855-4ce7-ac56-5f365a3e2935 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:50.433765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37558ebd-1855-4ce7-ac56-5f365a3e2935 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:50.436875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37558ebd-1855-4ce7-ac56-5f365a3e2935 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:50.437588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37558ebd-1855-4ce7-ac56-5f365a3e2935 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:50.438205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37558ebd-1855-4ce7-ac56-5f365a3e2935 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:50.781870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=66 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:50.990233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-37558ebd-1855-4ce7-ac56-5f365a3e2935 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:51.000899 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-37558ebd-1855-4ce7-ac56-5f365a3e2935 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1319 microversion: 2.1 time: 0.587601 Aug 18 11:25:51.016351 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 147/333] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:50 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1319 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:25:51.027866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-15721f5b-c776-436c-830a-0a8c35b34fc0 req-0c520aba-1440-42e3-ad11-9a8dd26e6fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c93772-3966-4484-b45e-712ad8e4a0e7", "tag": "623c601b-a04a-4702-8337-83cb720444a3"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:51.034814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-437f9d4b-48c8-48a3-a1fb-1c991fad2f0a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc840057087743e2b23eaf6da3997b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582d4d6dc459486cbfb696c35cc814f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:51.047655 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-437f9d4b-48c8-48a3-a1fb-1c991fad2f0a tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 200 len: 1478 microversion: 2.1 time: 0.788708 Aug 18 11:25:51.048235 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 187/334] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:50 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 1478 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:25:51.066534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-15721f5b-c776-436c-830a-0a8c35b34fc0 req-0c520aba-1440-42e3-ad11-9a8dd26e6fe1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:51.067257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-15721f5b-c776-436c-830a-0a8c35b34fc0 req-0c520aba-1440-42e3-ad11-9a8dd26e6fe1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:51.068001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-15721f5b-c776-436c-830a-0a8c35b34fc0 req-0c520aba-1440-42e3-ad11-9a8dd26e6fe1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:51.093668 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-15721f5b-c776-436c-830a-0a8c35b34fc0 req-0c520aba-1440-42e3-ad11-9a8dd26e6fe1 service nova] Creating event network-changed:623c601b-a04a-4702-8337-83cb720444a3 for instance d5c93772-3966-4484-b45e-712ad8e4a0e7 on n-h2-853611-3 Aug 18 11:25:51.117505 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-15721f5b-c776-436c-830a-0a8c35b34fc0 req-0c520aba-1440-42e3-ad11-9a8dd26e6fe1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098043 Aug 18 11:25:51.118490 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 148/335] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:51.357988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1dd445a7-182b-4625-9708-c6f47c80b9fe tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:51.358877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1dd445a7-182b-4625-9708-c6f47c80b9fe tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:51.374508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dd445a7-182b-4625-9708-c6f47c80b9fe tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:51.376412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dd445a7-182b-4625-9708-c6f47c80b9fe tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:51.378623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dd445a7-182b-4625-9708-c6f47c80b9fe tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:51.380632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dd445a7-182b-4625-9708-c6f47c80b9fe tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:51.384431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dd445a7-182b-4625-9708-c6f47c80b9fe tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:51.385012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dd445a7-182b-4625-9708-c6f47c80b9fe tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:51.696881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ab68a9f7-6cb7-44a5-9b3f-b84aaaeef97b tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Calling method '.version_select at 0x7f51ac35a700>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:51.700361 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:51.700361 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:51.701739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab68a9f7-6cb7-44a5-9b3f-b84aaaeef97b tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:51.703607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab68a9f7-6cb7-44a5-9b3f-b84aaaeef97b tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:51.715840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab68a9f7-6cb7-44a5-9b3f-b84aaaeef97b tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:51.716927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab68a9f7-6cb7-44a5-9b3f-b84aaaeef97b tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:51.717627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab68a9f7-6cb7-44a5-9b3f-b84aaaeef97b tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:51.722309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab68a9f7-6cb7-44a5-9b3f-b84aaaeef97b tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:51.789050 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ab68a9f7-6cb7-44a5-9b3f-b84aaaeef97b tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.682675 Aug 18 11:25:51.794366 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 188/336] 10.222.0.73 () {58 vars in 1128 bytes} [Thu Aug 18 11:25:51 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:25:51.805894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-028eb870-00ce-4da0-8da6-1197eb11a6c8 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Calling method '.version_select at 0x7f51ac3ad9d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:51.813246 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:51.813246 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:51.816661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-028eb870-00ce-4da0-8da6-1197eb11a6c8 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:51.817340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-028eb870-00ce-4da0-8da6-1197eb11a6c8 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:51.820992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-028eb870-00ce-4da0-8da6-1197eb11a6c8 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:51.821984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-028eb870-00ce-4da0-8da6-1197eb11a6c8 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:51.822737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-028eb870-00ce-4da0-8da6-1197eb11a6c8 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:51.823311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-028eb870-00ce-4da0-8da6-1197eb11a6c8 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:51.879170 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-028eb870-00ce-4da0-8da6-1197eb11a6c8 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.079955 Aug 18 11:25:51.880337 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 189/337] 10.222.0.73 () {58 vars in 1139 bytes} [Thu Aug 18 11:25:51 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:25:51.892104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-be78e8a4-a0f3-4bdc-a644-c9a037278e99 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Calling method '.version_select at 0x7f51ac35ac10>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:51.895444 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:51.895444 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:51.902162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be78e8a4-a0f3-4bdc-a644-c9a037278e99 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:51.903680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be78e8a4-a0f3-4bdc-a644-c9a037278e99 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:51.904357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be78e8a4-a0f3-4bdc-a644-c9a037278e99 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:51.905318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be78e8a4-a0f3-4bdc-a644-c9a037278e99 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:51.905923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be78e8a4-a0f3-4bdc-a644-c9a037278e99 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:51.909100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be78e8a4-a0f3-4bdc-a644-c9a037278e99 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:51.965696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:51.972003 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-be78e8a4-a0f3-4bdc-a644-c9a037278e99 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.083792 Aug 18 11:25:51.972789 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 190/338] 10.222.0.73 () {58 vars in 1145 bytes} [Thu Aug 18 11:25:51 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 11:25:51.990489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-23a0d71d-7fa4-4541-9b8c-fa684f6c57a1 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Calling method '.version_select at 0x7f51ac3ad4c0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:51.993491 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:51.993491 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:51.995322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23a0d71d-7fa4-4541-9b8c-fa684f6c57a1 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:51.996038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23a0d71d-7fa4-4541-9b8c-fa684f6c57a1 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:51.996942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23a0d71d-7fa4-4541-9b8c-fa684f6c57a1 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:51.997845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23a0d71d-7fa4-4541-9b8c-fa684f6c57a1 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:51.998481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23a0d71d-7fa4-4541-9b8c-fa684f6c57a1 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:51.999056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23a0d71d-7fa4-4541-9b8c-fa684f6c57a1 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:52.008348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1dd445a7-182b-4625-9708-c6f47c80b9fe tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:52.031661 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1dd445a7-182b-4625-9708-c6f47c80b9fe tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1277 microversion: 2.1 time: 0.683085 Aug 18 11:25:52.031819 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-23a0d71d-7fa4-4541-9b8c-fa684f6c57a1 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.045285 Aug 18 11:25:52.032740 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 191/339] 10.222.0.73 () {58 vars in 1128 bytes} [Thu Aug 18 11:25:51 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:25:52.033772 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 149/340] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:51 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1277 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:25:52.037531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3526d6de-fe34-41ed-8e01-b4781d7fc139 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:52.038675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3526d6de-fe34-41ed-8e01-b4781d7fc139 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:52.046233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3526d6de-fe34-41ed-8e01-b4781d7fc139 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:52.046911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3526d6de-fe34-41ed-8e01-b4781d7fc139 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:52.047704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3526d6de-fe34-41ed-8e01-b4781d7fc139 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:52.048641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3526d6de-fe34-41ed-8e01-b4781d7fc139 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:52.049232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3526d6de-fe34-41ed-8e01-b4781d7fc139 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:52.049809 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3526d6de-fe34-41ed-8e01-b4781d7fc139 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:52.054773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d66dc17-8ef5-40ff-be84-2cda8589ee91 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Calling method '.version_select at 0x7f51ac905550>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:52.060037 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:52.060037 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:52.061249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d66dc17-8ef5-40ff-be84-2cda8589ee91 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:52.061741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d66dc17-8ef5-40ff-be84-2cda8589ee91 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:52.068797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d66dc17-8ef5-40ff-be84-2cda8589ee91 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:52.069613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d66dc17-8ef5-40ff-be84-2cda8589ee91 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:52.075513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d66dc17-8ef5-40ff-be84-2cda8589ee91 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:52.076044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d66dc17-8ef5-40ff-be84-2cda8589ee91 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:52.144158 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7d66dc17-8ef5-40ff-be84-2cda8589ee91 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.093567 Aug 18 11:25:52.154283 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 150/341] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:25:52 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:52.163903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0a55dcfa-2fc4-4644-b202-f5b6f4c8b973 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:52.165598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0a55dcfa-2fc4-4644-b202-f5b6f4c8b973 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:52.180402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a55dcfa-2fc4-4644-b202-f5b6f4c8b973 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:52.183714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a55dcfa-2fc4-4644-b202-f5b6f4c8b973 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:52.184409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a55dcfa-2fc4-4644-b202-f5b6f4c8b973 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:52.186356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a55dcfa-2fc4-4644-b202-f5b6f4c8b973 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:52.187051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a55dcfa-2fc4-4644-b202-f5b6f4c8b973 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:52.188024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a55dcfa-2fc4-4644-b202-f5b6f4c8b973 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:52.553633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3526d6de-fe34-41ed-8e01-b4781d7fc139 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:52.562739 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3526d6de-fe34-41ed-8e01-b4781d7fc139 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1319 microversion: 2.1 time: 0.528786 Aug 18 11:25:52.563316 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 192/342] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:52 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1319 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:52.587330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-236ac10c-bc02-4e6e-be85-cefc02f3e92d tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Calling method '.version_select at 0x7f51ac425820>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:52.590300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0a55dcfa-2fc4-4644-b202-f5b6f4c8b973 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc840057087743e2b23eaf6da3997b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582d4d6dc459486cbfb696c35cc814f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:52.592563 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:52.592563 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:52.600538 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0a55dcfa-2fc4-4644-b202-f5b6f4c8b973 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 200 len: 1478 microversion: 2.1 time: 0.444882 Aug 18 11:25:52.601115 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 151/343] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:52 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 1478 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:52.601992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-236ac10c-bc02-4e6e-be85-cefc02f3e92d tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:52.604792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-236ac10c-bc02-4e6e-be85-cefc02f3e92d tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:52.605639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-236ac10c-bc02-4e6e-be85-cefc02f3e92d tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:52.606893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-236ac10c-bc02-4e6e-be85-cefc02f3e92d tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:52.613202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-236ac10c-bc02-4e6e-be85-cefc02f3e92d tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:52.613833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-236ac10c-bc02-4e6e-be85-cefc02f3e92d tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:52.666175 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-236ac10c-bc02-4e6e-be85-cefc02f3e92d tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.089388 Aug 18 11:25:52.671346 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 193/344] 10.222.0.73 () {58 vars in 1128 bytes} [Thu Aug 18 11:25:52 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:52.688109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-52a565d8-c9c8-4e52-b0c8-b104cc325a3f tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Calling method '.version_select at 0x7f51ac44ef70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:52.689016 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:52.689016 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:52.697017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52a565d8-c9c8-4e52-b0c8-b104cc325a3f tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:52.697507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52a565d8-c9c8-4e52-b0c8-b104cc325a3f tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:52.697939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52a565d8-c9c8-4e52-b0c8-b104cc325a3f tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:52.723518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52a565d8-c9c8-4e52-b0c8-b104cc325a3f tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:52.724322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52a565d8-c9c8-4e52-b0c8-b104cc325a3f tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:52.725033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52a565d8-c9c8-4e52-b0c8-b104cc325a3f tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:52.748817 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-52a565d8-c9c8-4e52-b0c8-b104cc325a3f tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hosts/n-h2-853611-3" status: 200 len: 598 microversion: 2.1 time: 0.070855 Aug 18 11:25:52.749843 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 152/345] 10.222.0.73 () {58 vars in 1170 bytes} [Thu Aug 18 11:25:52 2022] GET /compute/v2.1/os-hosts/n-h2-853611-3 => generated 598 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:25:52.759299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f6d0e200-46fe-4a64-afe7-99b446ce8280 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Calling method '.version_select at 0x7f51ac35a940>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:52.760302 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:52.760302 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:25:52.767900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6d0e200-46fe-4a64-afe7-99b446ce8280 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:52.768664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6d0e200-46fe-4a64-afe7-99b446ce8280 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:52.769432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6d0e200-46fe-4a64-afe7-99b446ce8280 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:52.785263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6d0e200-46fe-4a64-afe7-99b446ce8280 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:52.786009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6d0e200-46fe-4a64-afe7-99b446ce8280 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:52.786636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6d0e200-46fe-4a64-afe7-99b446ce8280 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:52.819713 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f6d0e200-46fe-4a64-afe7-99b446ce8280 tempest-HostsAdminTestJSON-1827857047 tempest-HostsAdminTestJSON-1827857047-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hosts/n-h1-853611-3" status: 200 len: 598 microversion: 2.1 time: 0.064356 Aug 18 11:25:52.831345 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 194/346] 10.222.0.73 () {58 vars in 1170 bytes} [Thu Aug 18 11:25:52 2022] GET /compute/v2.1/os-hosts/n-h1-853611-3 => generated 598 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:53.079363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-786b05e2-d2c5-40da-9a17-49272755527b req-5385c497-e8ca-4a7e-9b1b-8264ef819d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294a7aa1-4490-4569-b325-24ca4c1dde28", "name": "network-vif-deleted", "tag": "2ecc822a-3334-4712-967b-24e6ce852509"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:53.082041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a5ca0a32-0e3e-460d-8dbc-500c13527e5d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:53.091172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a5ca0a32-0e3e-460d-8dbc-500c13527e5d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:53.109250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5ca0a32-0e3e-460d-8dbc-500c13527e5d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:53.109762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-786b05e2-d2c5-40da-9a17-49272755527b req-5385c497-e8ca-4a7e-9b1b-8264ef819d56 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:53.110470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-786b05e2-d2c5-40da-9a17-49272755527b req-5385c497-e8ca-4a7e-9b1b-8264ef819d56 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:53.114610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5ca0a32-0e3e-460d-8dbc-500c13527e5d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:53.114772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-786b05e2-d2c5-40da-9a17-49272755527b req-5385c497-e8ca-4a7e-9b1b-8264ef819d56 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:53.117664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5ca0a32-0e3e-460d-8dbc-500c13527e5d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:53.121930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5ca0a32-0e3e-460d-8dbc-500c13527e5d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:53.122693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5ca0a32-0e3e-460d-8dbc-500c13527e5d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:53.123469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5ca0a32-0e3e-460d-8dbc-500c13527e5d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:53.153330 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-786b05e2-d2c5-40da-9a17-49272755527b req-5385c497-e8ca-4a7e-9b1b-8264ef819d56 service nova] Creating event network-vif-deleted:2ecc822a-3334-4712-967b-24e6ce852509 for instance 294a7aa1-4490-4569-b325-24ca4c1dde28 on n-h1-853611-3 Aug 18 11:25:53.166468 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-786b05e2-d2c5-40da-9a17-49272755527b req-5385c497-e8ca-4a7e-9b1b-8264ef819d56 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095851 Aug 18 11:25:53.169180 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 195/347] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:53.360076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a5ca0a32-0e3e-460d-8dbc-500c13527e5d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:53.368211 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a5ca0a32-0e3e-460d-8dbc-500c13527e5d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1319 microversion: 2.1 time: 0.317510 Aug 18 11:25:53.368892 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 153/348] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:53 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:53.584060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f7852e66-0edd-4ace-8e39-4c1a4e4d7d10 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:53.585771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f7852e66-0edd-4ace-8e39-4c1a4e4d7d10 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:53.612346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f7852e66-0edd-4ace-8e39-4c1a4e4d7d10 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:53.613676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f7852e66-0edd-4ace-8e39-4c1a4e4d7d10 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:53.617249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f7852e66-0edd-4ace-8e39-4c1a4e4d7d10 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:53.621560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f7852e66-0edd-4ace-8e39-4c1a4e4d7d10 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:53.622944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f7852e66-0edd-4ace-8e39-4c1a4e4d7d10 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:53.624019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f7852e66-0edd-4ace-8e39-4c1a4e4d7d10 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:53.642860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d74ad552-8984-4ff6-9600-e7e6dbeaa195 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:53.646399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d74ad552-8984-4ff6-9600-e7e6dbeaa195 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:53.684632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d74ad552-8984-4ff6-9600-e7e6dbeaa195 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:53.686559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d74ad552-8984-4ff6-9600-e7e6dbeaa195 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:53.687267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d74ad552-8984-4ff6-9600-e7e6dbeaa195 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:53.688833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d74ad552-8984-4ff6-9600-e7e6dbeaa195 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:53.690634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d74ad552-8984-4ff6-9600-e7e6dbeaa195 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:53.694332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d74ad552-8984-4ff6-9600-e7e6dbeaa195 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:53.761008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d74ad552-8984-4ff6-9600-e7e6dbeaa195 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:53.762374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d74ad552-8984-4ff6-9600-e7e6dbeaa195 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:53.763083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d74ad552-8984-4ff6-9600-e7e6dbeaa195 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:53.763790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-d74ad552-8984-4ff6-9600-e7e6dbeaa195 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lazy-loading 'fault' on Instance uuid 294a7aa1-4490-4569-b325-24ca4c1dde28 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:25:53.770228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:53.870285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d74ad552-8984-4ff6-9600-e7e6dbeaa195 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc840057087743e2b23eaf6da3997b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '582d4d6dc459486cbfb696c35cc814f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:53.880322 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d74ad552-8984-4ff6-9600-e7e6dbeaa195 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 200 len: 1313 microversion: 2.1 time: 0.261885 Aug 18 11:25:53.881379 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 154/349] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:53 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:25:54.398388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aef5b22e-e62c-416b-811d-d48edcf28f6d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:54.399040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aef5b22e-e62c-416b-811d-d48edcf28f6d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:54.410447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aef5b22e-e62c-416b-811d-d48edcf28f6d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:54.410939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aef5b22e-e62c-416b-811d-d48edcf28f6d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:54.412716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aef5b22e-e62c-416b-811d-d48edcf28f6d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:54.413432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aef5b22e-e62c-416b-811d-d48edcf28f6d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:54.413887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aef5b22e-e62c-416b-811d-d48edcf28f6d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:54.414719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aef5b22e-e62c-416b-811d-d48edcf28f6d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:54.443464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f7852e66-0edd-4ace-8e39-4c1a4e4d7d10 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:54.452778 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f7852e66-0edd-4ace-8e39-4c1a4e4d7d10 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1319 microversion: 2.1 time: 0.872887 Aug 18 11:25:54.462767 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 196/350] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:53 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1319 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:54.658039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aef5b22e-e62c-416b-811d-d48edcf28f6d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:54.669991 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aef5b22e-e62c-416b-811d-d48edcf28f6d tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1319 microversion: 2.1 time: 0.281567 Aug 18 11:25:54.680795 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 155/351] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:54 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:25:54.903019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8d68498b-14c7-45e9-ac84-5bd3f5ba3ef5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:54.903658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8d68498b-14c7-45e9-ac84-5bd3f5ba3ef5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] [instance: 294a7aa1-4490-4569-b325-24ca4c1dde28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:54.909856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d68498b-14c7-45e9-ac84-5bd3f5ba3ef5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:54.910351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d68498b-14c7-45e9-ac84-5bd3f5ba3ef5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:54.910830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d68498b-14c7-45e9-ac84-5bd3f5ba3ef5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:54.911537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d68498b-14c7-45e9-ac84-5bd3f5ba3ef5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:54.912041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d68498b-14c7-45e9-ac84-5bd3f5ba3ef5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:54.912442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d68498b-14c7-45e9-ac84-5bd3f5ba3ef5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:54.926920 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-8d68498b-14c7-45e9-ac84-5bd3f5ba3ef5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] HTTP exception thrown: Instance 294a7aa1-4490-4569-b325-24ca4c1dde28 could not be found. Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8d68498b-14c7-45e9-ac84-5bd3f5ba3ef5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Request method failure captured: Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 HTTP/1.1 Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGqqKkAx8RIqeBN2ciuyn9sAJ2UqFAVO2wGZA5hct2c-LijVQjjWm6bUfO6pYEsR71As4nZgM4Rva7u8sPdBM6WZ3NwcxDmKIgAhWEs89PYfgJirkuit6CQ2utiEECnD_p7N66N-eyHSAEAgxnRV2NENxX9U5hOLq00llK5v62qr1E Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 582d4d6dc459486cbfb696c35cc814f4 Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1429158256 Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:25:54.929016 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:25:54.930619 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/582d4d6dc459486cbfb696c35cc814f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/582d4d6dc459486cbfb696c35cc814f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_582d4d6dc459486cbfb696c35cc814f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/582d4d6dc459486cbfb696c35cc814f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:25:54.930619 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1429158256 Aug 18 11:25:54.930619 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 582d4d6dc459486cbfb696c35cc814f4 Aug 18 11:25:54.930619 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1429158256 Aug 18 11:25:54.930619 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerDiagnosticsNegativeTest-1429158256-project Aug 18 11:25:54.930619 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:25:54.930619 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:25:54.930619 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: cc840057087743e2b23eaf6da3997b56 Aug 18 11:25:54.930619 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1429158256-project Aug 18 11:25:54.930619 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:25:54.930619 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 294a7aa1-4490-4569-b325-24ca4c1dde28 could not be found. Aug 18 11:25:54.930619 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '294a7aa1-4490-4569-b325-24ca4c1dde28'} Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 294a7aa1-4490-4569-b325-24ca4c1dde28 could not be found. Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:25:54.931465 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 294a7aa1-4490-4569-b325-24ca4c1dde28 could not be found. Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 294a7aa1-4490-4569-b325-24ca4c1dde28 could not be found. Aug 18 11:25:54.932797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:25:54.935709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8d68498b-14c7-45e9-ac84-5bd3f5ba3ef5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] Returning 404 to user: Instance 294a7aa1-4490-4569-b325-24ca4c1dde28 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:25:54.936022 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8d68498b-14c7-45e9-ac84-5bd3f5ba3ef5 tempest-ServerDiagnosticsNegativeTest-1429158256 tempest-ServerDiagnosticsNegativeTest-1429158256-project] 10.222.0.73 "GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28" status: 404 len: 111 microversion: 2.1 time: 0.036539 Aug 18 11:25:54.937162 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 197/352] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:54 2022] GET /compute/v2.1/servers/294a7aa1-4490-4569-b325-24ca4c1dde28 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:25:55.473783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fbb0d566-0235-4126-a577-62a4f66a7651 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:55.474770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fbb0d566-0235-4126-a577-62a4f66a7651 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:55.484566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbb0d566-0235-4126-a577-62a4f66a7651 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:55.488736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbb0d566-0235-4126-a577-62a4f66a7651 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:55.489922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbb0d566-0235-4126-a577-62a4f66a7651 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:55.490688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbb0d566-0235-4126-a577-62a4f66a7651 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:55.491150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbb0d566-0235-4126-a577-62a4f66a7651 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:55.499654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbb0d566-0235-4126-a577-62a4f66a7651 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:55.695066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-858a4da8-ae96-4e11-9a7b-cd93450a1ca3 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:55.696265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-858a4da8-ae96-4e11-9a7b-cd93450a1ca3 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:55.724858 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-858a4da8-ae96-4e11-9a7b-cd93450a1ca3 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:55.725360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-858a4da8-ae96-4e11-9a7b-cd93450a1ca3 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:55.725834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-858a4da8-ae96-4e11-9a7b-cd93450a1ca3 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:55.726682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-858a4da8-ae96-4e11-9a7b-cd93450a1ca3 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:55.727076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-858a4da8-ae96-4e11-9a7b-cd93450a1ca3 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:55.727500 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-858a4da8-ae96-4e11-9a7b-cd93450a1ca3 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:55.810835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fbb0d566-0235-4126-a577-62a4f66a7651 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:55.819555 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fbb0d566-0235-4126-a577-62a4f66a7651 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1319 microversion: 2.1 time: 0.349918 Aug 18 11:25:55.820954 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 156/353] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:55 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:56.217327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-858a4da8-ae96-4e11-9a7b-cd93450a1ca3 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:56.227437 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-858a4da8-ae96-4e11-9a7b-cd93450a1ca3 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1319 microversion: 2.1 time: 0.538542 Aug 18 11:25:56.229867 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 198/354] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:55 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1319 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:56.262213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4c4c4cd2-7465-4205-bd3e-c1ee835b69de req-b69a8ad2-86f2-440b-8238-1acbfb309628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3266e748-29b3-4cfb-b4eb-6f47a38546e7", "tag": "a8457969-ffb6-4e4a-af12-6ae69ea3cea5"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:56.282832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4c4c4cd2-7465-4205-bd3e-c1ee835b69de req-b69a8ad2-86f2-440b-8238-1acbfb309628 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:56.283641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4c4c4cd2-7465-4205-bd3e-c1ee835b69de req-b69a8ad2-86f2-440b-8238-1acbfb309628 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:56.289184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4c4c4cd2-7465-4205-bd3e-c1ee835b69de req-b69a8ad2-86f2-440b-8238-1acbfb309628 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:56.325487 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4c4c4cd2-7465-4205-bd3e-c1ee835b69de req-b69a8ad2-86f2-440b-8238-1acbfb309628 service nova] Creating event network-changed:a8457969-ffb6-4e4a-af12-6ae69ea3cea5 for instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 on n-h2-853611-3 Aug 18 11:25:56.336170 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4c4c4cd2-7465-4205-bd3e-c1ee835b69de req-b69a8ad2-86f2-440b-8238-1acbfb309628 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079301 Aug 18 11:25:56.337286 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 157/355] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:25:56.841791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2534dc37-9061-4dcc-b4e3-f3c927fa84e9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:56.842417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2534dc37-9061-4dcc-b4e3-f3c927fa84e9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:56.852480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2534dc37-9061-4dcc-b4e3-f3c927fa84e9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:56.853022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2534dc37-9061-4dcc-b4e3-f3c927fa84e9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:56.853470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2534dc37-9061-4dcc-b4e3-f3c927fa84e9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:56.854259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2534dc37-9061-4dcc-b4e3-f3c927fa84e9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:56.854692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2534dc37-9061-4dcc-b4e3-f3c927fa84e9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:56.871727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2534dc37-9061-4dcc-b4e3-f3c927fa84e9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:57.251189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4bdda8c7-3c1a-4f48-9e9c-0f4bc875bad9 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:57.252659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4bdda8c7-3c1a-4f48-9e9c-0f4bc875bad9 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:57.268505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bdda8c7-3c1a-4f48-9e9c-0f4bc875bad9 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:57.269388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bdda8c7-3c1a-4f48-9e9c-0f4bc875bad9 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:57.270057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bdda8c7-3c1a-4f48-9e9c-0f4bc875bad9 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:57.271027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bdda8c7-3c1a-4f48-9e9c-0f4bc875bad9 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:57.275148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bdda8c7-3c1a-4f48-9e9c-0f4bc875bad9 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:57.275971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bdda8c7-3c1a-4f48-9e9c-0f4bc875bad9 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:57.564504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2534dc37-9061-4dcc-b4e3-f3c927fa84e9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:57.582025 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2534dc37-9061-4dcc-b4e3-f3c927fa84e9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1319 microversion: 2.1 time: 0.744786 Aug 18 11:25:57.599302 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 199/356] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:56 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1319 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:57.662473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4bdda8c7-3c1a-4f48-9e9c-0f4bc875bad9 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:57.674921 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4bdda8c7-3c1a-4f48-9e9c-0f4bc875bad9 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1319 microversion: 2.1 time: 0.427951 Aug 18 11:25:57.679262 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 158/357] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:57 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:25:57.807097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-10e1a6f7-6c09-4f7c-b0be-4d654bc0ff8d req-7e266f41-5150-4004-b50b-e558a772bf80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c93772-3966-4484-b45e-712ad8e4a0e7", "name": "network-vif-plugged", "status": "completed", "tag": "623c601b-a04a-4702-8337-83cb720444a3"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:25:57.830707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-10e1a6f7-6c09-4f7c-b0be-4d654bc0ff8d req-7e266f41-5150-4004-b50b-e558a772bf80 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:57.832404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-10e1a6f7-6c09-4f7c-b0be-4d654bc0ff8d req-7e266f41-5150-4004-b50b-e558a772bf80 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:57.834358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-10e1a6f7-6c09-4f7c-b0be-4d654bc0ff8d req-7e266f41-5150-4004-b50b-e558a772bf80 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:57.869029 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-10e1a6f7-6c09-4f7c-b0be-4d654bc0ff8d req-7e266f41-5150-4004-b50b-e558a772bf80 service nova] Creating event network-vif-plugged:623c601b-a04a-4702-8337-83cb720444a3 for instance d5c93772-3966-4484-b45e-712ad8e4a0e7 on n-h2-853611-3 Aug 18 11:25:57.881904 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-10e1a6f7-6c09-4f7c-b0be-4d654bc0ff8d req-7e266f41-5150-4004-b50b-e558a772bf80 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078094 Aug 18 11:25:57.883374 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 200/358] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:58.604039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bc97b61c-c522-4f20-b73c-db12cc87baf1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:58.604721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bc97b61c-c522-4f20-b73c-db12cc87baf1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:58.630118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc97b61c-c522-4f20-b73c-db12cc87baf1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:58.632029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc97b61c-c522-4f20-b73c-db12cc87baf1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:58.633947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc97b61c-c522-4f20-b73c-db12cc87baf1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:58.634992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc97b61c-c522-4f20-b73c-db12cc87baf1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:58.636911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc97b61c-c522-4f20-b73c-db12cc87baf1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:58.640574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc97b61c-c522-4f20-b73c-db12cc87baf1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:58.708555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b3e93a86-6aa4-4f6c-b996-0faee82f3517 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:58.709361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b3e93a86-6aa4-4f6c-b996-0faee82f3517 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:25:58.720761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3e93a86-6aa4-4f6c-b996-0faee82f3517 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:58.725570 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3e93a86-6aa4-4f6c-b996-0faee82f3517 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:58.726056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3e93a86-6aa4-4f6c-b996-0faee82f3517 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:58.726845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3e93a86-6aa4-4f6c-b996-0faee82f3517 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:25:58.727321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3e93a86-6aa4-4f6c-b996-0faee82f3517 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:25:58.733342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3e93a86-6aa4-4f6c-b996-0faee82f3517 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:25:59.124573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=7 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:25:59.248559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bc97b61c-c522-4f20-b73c-db12cc87baf1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:59.297466 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bc97b61c-c522-4f20-b73c-db12cc87baf1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1319 microversion: 2.1 time: 0.697262 Aug 18 11:25:59.298533 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 159/359] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:58 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1319 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:25:59.748661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b3e93a86-6aa4-4f6c-b996-0faee82f3517 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:25:59.758698 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b3e93a86-6aa4-4f6c-b996-0faee82f3517 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1319 microversion: 2.1 time: 1.056428 Aug 18 11:25:59.759559 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 201/360] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:25:58 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1319 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:25:59.848779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9402926a-ce6c-4132-9007-a3c15f1fed34 tempest-InstanceUsageAuditLogTestJSON-756246514 tempest-InstanceUsageAuditLogTestJSON-756246514-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:59.849630 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:59.849630 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:59.906067 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9402926a-ce6c-4132-9007-a3c15f1fed34 tempest-InstanceUsageAuditLogTestJSON-756246514 tempest-InstanceUsageAuditLogTestJSON-756246514-project-admin] 10.222.0.73 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-18 11:25:59" status: 200 len: 318 microversion: 2.1 time: 0.606381 Aug 18 11:25:59.907314 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 160/361] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 11:25:59 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-18%2011%3A25%3A59 => generated 318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:25:59.922096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-168236bd-f370-4b4e-918f-54654ef36da8 tempest-InstanceUsageAuditLogTestJSON-756246514 tempest-InstanceUsageAuditLogTestJSON-756246514-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:25:59.923378 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:25:59.923378 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:25:59.951593 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-168236bd-f370-4b4e-918f-54654ef36da8 tempest-InstanceUsageAuditLogTestJSON-756246514 tempest-InstanceUsageAuditLogTestJSON-756246514-project-admin] 10.222.0.73 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.034256 Aug 18 11:25:59.953396 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 161/362] 10.222.0.73 () {58 vars in 1185 bytes} [Thu Aug 18 11:25:59 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:26:00.210119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-158f3c1c-d253-462a-9552-3acffc58d7f7 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Calling method '.version_select at 0x7f51ac29a8b0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:00.212317 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:00.212317 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:00.215768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-158f3c1c-d253-462a-9552-3acffc58d7f7 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.217205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-158f3c1c-d253-462a-9552-3acffc58d7f7 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.221920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-158f3c1c-d253-462a-9552-3acffc58d7f7 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:00.289119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-158f3c1c-d253-462a-9552-3acffc58d7f7 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.291244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-158f3c1c-d253-462a-9552-3acffc58d7f7 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.292726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-158f3c1c-d253-462a-9552-3acffc58d7f7 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:00.319321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b79a739-7ec4-4913-a826-d8b65f470b43 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:00.319969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b79a739-7ec4-4913-a826-d8b65f470b43 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:00.328300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-158f3c1c-d253-462a-9552-3acffc58d7f7 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.329137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-158f3c1c-d253-462a-9552-3acffc58d7f7 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.330981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-158f3c1c-d253-462a-9552-3acffc58d7f7 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:00.336320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b79a739-7ec4-4913-a826-d8b65f470b43 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.336782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b79a739-7ec4-4913-a826-d8b65f470b43 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.337220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b79a739-7ec4-4913-a826-d8b65f470b43 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:00.339293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b79a739-7ec4-4913-a826-d8b65f470b43 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.339756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b79a739-7ec4-4913-a826-d8b65f470b43 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.340186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b79a739-7ec4-4913-a826-d8b65f470b43 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:00.344958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:00.352579 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-158f3c1c-d253-462a-9552-3acffc58d7f7 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.465157 Aug 18 11:26:00.355750 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 202/363] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:25:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:00.388915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ce2b1856-d921-43d2-9261-e4b2c1adfd12 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Calling method '.version_select at 0x7f51ac35a9d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:00.392100 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:00.392100 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:00.394174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce2b1856-d921-43d2-9261-e4b2c1adfd12 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.396145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce2b1856-d921-43d2-9261-e4b2c1adfd12 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.396833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce2b1856-d921-43d2-9261-e4b2c1adfd12 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:00.424749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce2b1856-d921-43d2-9261-e4b2c1adfd12 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.426235 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce2b1856-d921-43d2-9261-e4b2c1adfd12 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.426947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce2b1856-d921-43d2-9261-e4b2c1adfd12 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:00.454604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce2b1856-d921-43d2-9261-e4b2c1adfd12 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.457355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce2b1856-d921-43d2-9261-e4b2c1adfd12 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.458044 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce2b1856-d921-43d2-9261-e4b2c1adfd12 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:00.472483 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ce2b1856-d921-43d2-9261-e4b2c1adfd12 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.108644 Aug 18 11:26:00.483092 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 203/364] 10.222.0.73 () {58 vars in 1167 bytes} [Thu Aug 18 11:26:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:00.496747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-38c8006f-ab88-458a-9167-2adbc3958cf1 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Calling method '.version_select at 0x7f51ac29a1f0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:00.497964 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:00.497964 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:00.499389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38c8006f-ab88-458a-9167-2adbc3958cf1 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.500165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38c8006f-ab88-458a-9167-2adbc3958cf1 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.500812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38c8006f-ab88-458a-9167-2adbc3958cf1 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:00.563792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38c8006f-ab88-458a-9167-2adbc3958cf1 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.580338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38c8006f-ab88-458a-9167-2adbc3958cf1 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.585416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38c8006f-ab88-458a-9167-2adbc3958cf1 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:00.641494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38c8006f-ab88-458a-9167-2adbc3958cf1 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.642258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38c8006f-ab88-458a-9167-2adbc3958cf1 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.642830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38c8006f-ab88-458a-9167-2adbc3958cf1 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:00.671353 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-38c8006f-ab88-458a-9167-2adbc3958cf1 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.178431 Aug 18 11:26:00.673150 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 204/365] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:26:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:00.691956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-18698de8-73b2-4723-9266-052fa5d7f731 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Calling method '.version_select at 0x7f51ac425c10>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:00.695780 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:00.695780 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:00.701564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18698de8-73b2-4723-9266-052fa5d7f731 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.709411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18698de8-73b2-4723-9266-052fa5d7f731 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.710283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18698de8-73b2-4723-9266-052fa5d7f731 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:00.752705 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18698de8-73b2-4723-9266-052fa5d7f731 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.755648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18698de8-73b2-4723-9266-052fa5d7f731 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.757182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18698de8-73b2-4723-9266-052fa5d7f731 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:00.791456 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-18698de8-73b2-4723-9266-052fa5d7f731 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.094137 Aug 18 11:26:00.797372 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 205/366] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:26:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:00.806519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3bb70052-6ee9-42f7-9b7d-f1fe11f83332 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:00.808776 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3bb70052-6ee9-42f7-9b7d-f1fe11f83332 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:00.820691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bb70052-6ee9-42f7-9b7d-f1fe11f83332 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.822385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bb70052-6ee9-42f7-9b7d-f1fe11f83332 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.824361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bb70052-6ee9-42f7-9b7d-f1fe11f83332 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:00.827261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bb70052-6ee9-42f7-9b7d-f1fe11f83332 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:00.828671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bb70052-6ee9-42f7-9b7d-f1fe11f83332 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:00.829323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bb70052-6ee9-42f7-9b7d-f1fe11f83332 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:01.170965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b79a739-7ec4-4913-a826-d8b65f470b43 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:01.182010 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b79a739-7ec4-4913-a826-d8b65f470b43 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1319 microversion: 2.1 time: 0.864646 Aug 18 11:26:01.184221 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 162/367] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:00 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1319 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:26:01.205695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2593eb09-b791-4be4-a6ec-cc6567ed5048 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Calling method '.version_select at 0x7f51ac5220d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:01.221094 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:01.221094 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:01.223846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2593eb09-b791-4be4-a6ec-cc6567ed5048 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:01.232658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2593eb09-b791-4be4-a6ec-cc6567ed5048 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:01.233500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2593eb09-b791-4be4-a6ec-cc6567ed5048 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:01.290338 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2593eb09-b791-4be4-a6ec-cc6567ed5048 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.103427 Aug 18 11:26:01.291153 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 163/368] 10.222.0.73 () {58 vars in 1179 bytes} [Thu Aug 18 11:26:01 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:01.305730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c5ffbc67-4af0-409e-842a-c342a997fad9 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Calling method '.version_select at 0x7f51ac44e0d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:01.311833 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:01.311833 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:01.318491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ffbc67-4af0-409e-842a-c342a997fad9 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:01.320429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ffbc67-4af0-409e-842a-c342a997fad9 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:01.324567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ffbc67-4af0-409e-842a-c342a997fad9 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:01.358367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ffbc67-4af0-409e-842a-c342a997fad9 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:01.359860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ffbc67-4af0-409e-842a-c342a997fad9 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:01.360661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ffbc67-4af0-409e-842a-c342a997fad9 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:01.385265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ffbc67-4af0-409e-842a-c342a997fad9 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:01.389313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ffbc67-4af0-409e-842a-c342a997fad9 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:01.390249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ffbc67-4af0-409e-842a-c342a997fad9 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:01.398396 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c5ffbc67-4af0-409e-842a-c342a997fad9 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.096256 Aug 18 11:26:01.408813 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 164/369] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:26:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:01.424861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3705c870-c103-4ed6-8573-16e24d2fdcc4 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Calling method '.version_select at 0x7f51ac522310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:01.427990 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:01.427990 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:01.432173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3705c870-c103-4ed6-8573-16e24d2fdcc4 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:01.437248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3705c870-c103-4ed6-8573-16e24d2fdcc4 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:01.438067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3705c870-c103-4ed6-8573-16e24d2fdcc4 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:01.501187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3705c870-c103-4ed6-8573-16e24d2fdcc4 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:01.502217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3705c870-c103-4ed6-8573-16e24d2fdcc4 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:01.503684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3705c870-c103-4ed6-8573-16e24d2fdcc4 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:01.509281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3bb70052-6ee9-42f7-9b7d-f1fe11f83332 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:01.521355 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3705c870-c103-4ed6-8573-16e24d2fdcc4 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.106440 Aug 18 11:26:01.522666 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 165/370] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:26:01 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:01.532532 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3bb70052-6ee9-42f7-9b7d-f1fe11f83332 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1319 microversion: 2.1 time: 0.733535 Aug 18 11:26:01.541159 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 206/371] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:00 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1319 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:01.544191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2a06f13a-53af-4499-9aaa-0f9cc6d51946 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Calling method '.version_select at 0x7f51ac44e0d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:01.545049 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:01.545049 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:01.546957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a06f13a-53af-4499-9aaa-0f9cc6d51946 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:01.549459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a06f13a-53af-4499-9aaa-0f9cc6d51946 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:01.552859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a06f13a-53af-4499-9aaa-0f9cc6d51946 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:01.581479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a06f13a-53af-4499-9aaa-0f9cc6d51946 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:01.582211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a06f13a-53af-4499-9aaa-0f9cc6d51946 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:01.583043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a06f13a-53af-4499-9aaa-0f9cc6d51946 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:01.590295 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2a06f13a-53af-4499-9aaa-0f9cc6d51946 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.054274 Aug 18 11:26:01.592101 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 166/372] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:26:01 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:26:01.607236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3990ade7-733d-4ddf-804f-da6cc7347718 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Calling method '.version_select at 0x7f51ac3f69d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:01.608448 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:01.608448 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:01.610005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3990ade7-733d-4ddf-804f-da6cc7347718 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:01.610832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3990ade7-733d-4ddf-804f-da6cc7347718 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:01.611454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3990ade7-733d-4ddf-804f-da6cc7347718 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:01.628087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3990ade7-733d-4ddf-804f-da6cc7347718 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:01.628847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3990ade7-733d-4ddf-804f-da6cc7347718 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:01.629434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3990ade7-733d-4ddf-804f-da6cc7347718 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:01.642550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3990ade7-733d-4ddf-804f-da6cc7347718 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:01.643199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3990ade7-733d-4ddf-804f-da6cc7347718 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:01.643769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3990ade7-733d-4ddf-804f-da6cc7347718 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:01.695175 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3990ade7-733d-4ddf-804f-da6cc7347718 tempest-HypervisorAdminTestJSON-1890442049 tempest-HypervisorAdminTestJSON-1890442049-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.093352 Aug 18 11:26:01.695806 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 207/373] 10.222.0.73 () {58 vars in 1173 bytes} [Thu Aug 18 11:26:01 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:02.206881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-699482f4-eca6-48df-a340-dbf8684f9791 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:02.207610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-699482f4-eca6-48df-a340-dbf8684f9791 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:02.223419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:02.231498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-699482f4-eca6-48df-a340-dbf8684f9791 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:02.234012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-699482f4-eca6-48df-a340-dbf8684f9791 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:02.234883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-699482f4-eca6-48df-a340-dbf8684f9791 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:02.244838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-699482f4-eca6-48df-a340-dbf8684f9791 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:02.244838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-699482f4-eca6-48df-a340-dbf8684f9791 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:02.244838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-699482f4-eca6-48df-a340-dbf8684f9791 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:02.622812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=23 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:02.673904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-435981316", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:02.776053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:26:02.852266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-699482f4-eca6-48df-a340-dbf8684f9791 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:02.868148 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-699482f4-eca6-48df-a340-dbf8684f9791 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1468 microversion: 2.1 time: 0.662899 Aug 18 11:26:02.872161 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 167/374] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:02 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1468 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:02.880470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aee814b4-c0be-4fb0-b2cd-fe85fccc15a5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:02.881473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aee814b4-c0be-4fb0-b2cd-fe85fccc15a5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:02.889845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aee814b4-c0be-4fb0-b2cd-fe85fccc15a5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:02.892145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aee814b4-c0be-4fb0-b2cd-fe85fccc15a5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:02.892985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aee814b4-c0be-4fb0-b2cd-fe85fccc15a5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:02.894486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aee814b4-c0be-4fb0-b2cd-fe85fccc15a5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:02.895287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aee814b4-c0be-4fb0-b2cd-fe85fccc15a5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:02.902988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aee814b4-c0be-4fb0-b2cd-fe85fccc15a5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:03.347295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aee814b4-c0be-4fb0-b2cd-fe85fccc15a5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:03.363628 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aee814b4-c0be-4fb0-b2cd-fe85fccc15a5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1319 microversion: 2.1 time: 0.489784 Aug 18 11:26:03.365636 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 168/375] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:02 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:03.784408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1c96df9-36d3-4724-b5f7-2d2eda940637 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1295879739", "block_migration": true, "disk_over_commit": false}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:03.787946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1c96df9-36d3-4724-b5f7-2d2eda940637 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:03.800879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1c96df9-36d3-4724-b5f7-2d2eda940637 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:03.801380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1c96df9-36d3-4724-b5f7-2d2eda940637 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:03.801837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1c96df9-36d3-4724-b5f7-2d2eda940637 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:03.806201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1c96df9-36d3-4724-b5f7-2d2eda940637 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:03.809699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1c96df9-36d3-4724-b5f7-2d2eda940637 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:03.809699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1c96df9-36d3-4724-b5f7-2d2eda940637 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:03.967431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-a1c96df9-36d3-4724-b5f7-2d2eda940637 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lazy-loading 'flavor' on Instance uuid d5c93772-3966-4484-b45e-712ad8e4a0e7 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:26:04.074724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1c96df9-36d3-4724-b5f7-2d2eda940637 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Going to try to live migrate instance to tempest-host-1295879739 {{(pid=122210) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 18 11:26:04.089494 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-a1c96df9-36d3-4724-b5f7-2d2eda940637 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] HTTP exception thrown: Compute host tempest-host-1295879739 could not be found. Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1c96df9-36d3-4724-b5f7-2d2eda940637 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Request method failure captured: Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7/action HTTP/1.1 Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 107 Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iG3BJWd4OjdQJPV23dAReDnCZEH3f6ZQopP3p1vl-QrXnmtKxIuE8r8aldxjUkJKOCZkKNGmFGHO8mt9qkHnOzxz7IeCEmxl0M8UtU8gT1nDNR9GIImpucAcg-eIX3UXP_gI-6YRDDU9CVT-mDHKL5IFpu0qw3dvb_VwTYdovEw2Fw Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 4b7481f89561450581bd6ee63a1b7937 Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-LiveMigrationNegativeTest-1826345176 Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:26:04.102668 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:26:04.103998 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b7481f89561450581bd6ee63a1b7937"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4b7481f89561450581bd6ee63a1b7937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4b7481f89561450581bd6ee63a1b7937"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b7481f89561450581bd6ee63a1b7937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:04.103998 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-LiveMigrationNegativeTest-1826345176 Aug 18 11:26:04.103998 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 4b7481f89561450581bd6ee63a1b7937 Aug 18 11:26:04.103998 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1826345176 Aug 18 11:26:04.103998 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-LiveMigrationNegativeTest-1826345176-project-admin Aug 18 11:26:04.103998 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:04.103998 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:04.103998 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 0a334cb0db354a8c9a6cda3a46b6d134 Aug 18 11:26:04.103998 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-LiveMigrationNegativeTest-1826345176-project-admin Aug 18 11:26:04.103998 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:26:04.103998 n-d-853611-3 devstack@n-api.service[122210]: {"os-migrateLive": {"host": "tempest-host-1295879739", "block_migration": true, "disk_over_commit": false}} Aug 18 11:26:04.103998 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: exception: Compute host tempest-host-1295879739 could not be found. Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'd5c93772-3966-4484-b45e-712ad8e4a0e7', 'body': {'os-migrateLive': {'host': 'tempest-host-1295879739', 'block_migration': True, 'disk_over_commit': False}}} Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:26:04.106328 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5449, in live_migrate Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1295879739 could not be found. Aug 18 11:26:04.107508 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1295879739 could not be found. Aug 18 11:26:04.108555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:04.109616 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:04.109616 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:04.109616 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:04.109616 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:04.109616 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:04.109616 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:04.109616 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:04.109616 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1295879739 could not be found. Aug 18 11:26:04.109616 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:04.109616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1c96df9-36d3-4724-b5f7-2d2eda940637 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Returning 400 to user: Compute host tempest-host-1295879739 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:04.109616 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1c96df9-36d3-4724-b5f7-2d2eda940637 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7/action" status: 400 len: 100 microversion: 2.1 time: 0.737660 Aug 18 11:26:04.110216 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 169/376] 10.222.0.73 () {60 vars in 1279 bytes} [Thu Aug 18 11:26:03 2022] POST /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7/action => generated 100 bytes in 743 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:26:04.117682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c10ea157-62ca-4818-ad82-4d1b182a9e73 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:04.118719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c10ea157-62ca-4818-ad82-4d1b182a9e73 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:04.127115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c10ea157-62ca-4818-ad82-4d1b182a9e73 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:04.127951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c10ea157-62ca-4818-ad82-4d1b182a9e73 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:04.128610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c10ea157-62ca-4818-ad82-4d1b182a9e73 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:04.129549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c10ea157-62ca-4818-ad82-4d1b182a9e73 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:04.130223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c10ea157-62ca-4818-ad82-4d1b182a9e73 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:04.130939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c10ea157-62ca-4818-ad82-4d1b182a9e73 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:04.276914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:26:04.277967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:26:04.278610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:26:04.279176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:26:04.279786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:26:04.298103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:04.300112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:04.301873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:04.302897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:04.304475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:04.305782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:04.361418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:26:04.374101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:26:04.401269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:26:04.417542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:26:04.482819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c10ea157-62ca-4818-ad82-4d1b182a9e73 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:04.500018 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c10ea157-62ca-4818-ad82-4d1b182a9e73 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1468 microversion: 2.1 time: 0.384221 Aug 18 11:26:04.500696 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 170/377] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:04 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1468 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:04.511849 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c3c5e94d-773b-4744-99c9-d431ffd14f49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.057680 Aug 18 11:26:04.522381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8744364e-285f-4a6d-bbec-ba013cd78e00 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:04.523364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8744364e-285f-4a6d-bbec-ba013cd78e00 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:04.528076 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 208/378] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:26:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:26:04.533954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b95aa7e3-09dd-49ea-bfae-09304a6a0e4f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:04.538519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b95aa7e3-09dd-49ea-bfae-09304a6a0e4f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:04.555400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8744364e-285f-4a6d-bbec-ba013cd78e00 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:04.559021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8744364e-285f-4a6d-bbec-ba013cd78e00 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:04.559733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8744364e-285f-4a6d-bbec-ba013cd78e00 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:04.561186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8744364e-285f-4a6d-bbec-ba013cd78e00 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:04.562098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8744364e-285f-4a6d-bbec-ba013cd78e00 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:04.577136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8744364e-285f-4a6d-bbec-ba013cd78e00 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:04.731167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b95aa7e3-09dd-49ea-bfae-09304a6a0e4f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:04.743024 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b95aa7e3-09dd-49ea-bfae-09304a6a0e4f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1216 microversion: 2.1 time: 0.213255 Aug 18 11:26:04.758588 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 209/379] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:04 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1216 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:04.793819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1743806294", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:04.878949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:26:05.525135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8744364e-285f-4a6d-bbec-ba013cd78e00 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:05.555425 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8744364e-285f-4a6d-bbec-ba013cd78e00 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1319 microversion: 2.1 time: 1.049023 Aug 18 11:26:05.557554 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 171/380] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:04 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1319 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:05.674537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:26:05.675681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:26:05.676545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:26:05.677385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:26:05.678522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:26:05.717436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:05.718214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:05.718783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:05.722568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:05.723394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:05.725042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:05.769096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f46b627a-0f8e-46ef-b710-88b4a1402bc1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:05.770148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f46b627a-0f8e-46ef-b710-88b4a1402bc1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:05.790938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f46b627a-0f8e-46ef-b710-88b4a1402bc1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:05.791291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Getting quotas for project 7543ea6a7a5d4831b185b45f59c6a31d. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:26:05.792669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f46b627a-0f8e-46ef-b710-88b4a1402bc1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:05.795434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f46b627a-0f8e-46ef-b710-88b4a1402bc1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:05.797253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f46b627a-0f8e-46ef-b710-88b4a1402bc1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:05.799641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f46b627a-0f8e-46ef-b710-88b4a1402bc1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:05.800867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f46b627a-0f8e-46ef-b710-88b4a1402bc1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:05.801870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Getting quotas for user 9ffb27f7ddc54fe59b815112f0601848 and project 7543ea6a7a5d4831b185b45f59c6a31d. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:26:05.832769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:26:05.838065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:26:05.992952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f46b627a-0f8e-46ef-b710-88b4a1402bc1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:05.998302 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a2c9e57a-5173-4d26-b79c-5fc2836dc639 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.209601 Aug 18 11:26:06.007340 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f46b627a-0f8e-46ef-b710-88b4a1402bc1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1212 microversion: 2.1 time: 0.244925 Aug 18 11:26:06.020035 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 210/381] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:26:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:26:06.027609 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 172/382] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:05 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1212 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:26:06.045668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-04ba82be-a71b-4873-af6d-cd8818b8688b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:06.046653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-04ba82be-a71b-4873-af6d-cd8818b8688b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:06.335724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-04ba82be-a71b-4873-af6d-cd8818b8688b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:06.351714 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-04ba82be-a71b-4873-af6d-cd8818b8688b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1219 microversion: 2.1 time: 0.330362 Aug 18 11:26:06.371917 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 211/383] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:06 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1219 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:06.580154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9719f85e-06df-47b9-b888-53b50b38a841 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:06.580783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9719f85e-06df-47b9-b888-53b50b38a841 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:06.596933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:06.609259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9719f85e-06df-47b9-b888-53b50b38a841 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:06.610480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9719f85e-06df-47b9-b888-53b50b38a841 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:06.616298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9719f85e-06df-47b9-b888-53b50b38a841 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:06.617148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9719f85e-06df-47b9-b888-53b50b38a841 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:06.617628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9719f85e-06df-47b9-b888-53b50b38a841 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:06.618060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9719f85e-06df-47b9-b888-53b50b38a841 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:06.922671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-8340b024-bc11-4bd3-873a-36f76f96548c req-28b8d9dd-7b4d-452d-a951-bececdc3deed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3266e748-29b3-4cfb-b4eb-6f47a38546e7", "name": "network-vif-plugged", "status": "completed", "tag": "a8457969-ffb6-4e4a-af12-6ae69ea3cea5"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:06.961425 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8340b024-bc11-4bd3-873a-36f76f96548c req-28b8d9dd-7b4d-452d-a951-bececdc3deed service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:06.964316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8340b024-bc11-4bd3-873a-36f76f96548c req-28b8d9dd-7b4d-452d-a951-bececdc3deed service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:06.965474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8340b024-bc11-4bd3-873a-36f76f96548c req-28b8d9dd-7b4d-452d-a951-bececdc3deed service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:07.025676 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-8340b024-bc11-4bd3-873a-36f76f96548c req-28b8d9dd-7b4d-452d-a951-bececdc3deed service nova] Creating event network-vif-plugged:a8457969-ffb6-4e4a-af12-6ae69ea3cea5 for instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 on n-h2-853611-3 Aug 18 11:26:07.051811 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-8340b024-bc11-4bd3-873a-36f76f96548c req-28b8d9dd-7b4d-452d-a951-bececdc3deed service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128761 Aug 18 11:26:07.054498 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 212/384] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:07.087157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0789fcf3-3a51-4f1a-9d6e-3d14a53b9ccd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:07.087893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0789fcf3-3a51-4f1a-9d6e-3d14a53b9ccd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:07.114252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0789fcf3-3a51-4f1a-9d6e-3d14a53b9ccd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:07.115284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0789fcf3-3a51-4f1a-9d6e-3d14a53b9ccd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:07.115911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0789fcf3-3a51-4f1a-9d6e-3d14a53b9ccd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:07.117800 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0789fcf3-3a51-4f1a-9d6e-3d14a53b9ccd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:07.118623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0789fcf3-3a51-4f1a-9d6e-3d14a53b9ccd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:07.120923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0789fcf3-3a51-4f1a-9d6e-3d14a53b9ccd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:07.464378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9719f85e-06df-47b9-b888-53b50b38a841 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:07.496371 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9719f85e-06df-47b9-b888-53b50b38a841 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1319 microversion: 2.1 time: 0.921958 Aug 18 11:26:07.496958 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 173/385] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:06 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1319 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:07.783214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1fa2998-5a0a-465d-95b9-2e3ac950726e tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] Action: 'create', calling method: .version_select at 0x7f51ac390d30>, body: {"pool": null} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:07.848026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0789fcf3-3a51-4f1a-9d6e-3d14a53b9ccd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:07.864175 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0789fcf3-3a51-4f1a-9d6e-3d14a53b9ccd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1274 microversion: 2.1 time: 0.805932 Aug 18 11:26:07.869049 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 213/386] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:07 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1274 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:07.893923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0d900c86-ce52-4ccb-a05a-4e09c7173e0a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:07.902002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0d900c86-ce52-4ccb-a05a-4e09c7173e0a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:07.910480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d900c86-ce52-4ccb-a05a-4e09c7173e0a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:07.910986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d900c86-ce52-4ccb-a05a-4e09c7173e0a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:07.911852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d900c86-ce52-4ccb-a05a-4e09c7173e0a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:07.914533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d900c86-ce52-4ccb-a05a-4e09c7173e0a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:07.915186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d900c86-ce52-4ccb-a05a-4e09c7173e0a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:07.917269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d900c86-ce52-4ccb-a05a-4e09c7173e0a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:08.153828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0d900c86-ce52-4ccb-a05a-4e09c7173e0a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:08.181457 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0d900c86-ce52-4ccb-a05a-4e09c7173e0a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1271 microversion: 2.1 time: 0.289372 Aug 18 11:26:08.185119 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 214/387] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:07 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1271 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:08.519697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f6d73e12-10e5-4fc7-982f-338397efc9c8 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:08.520711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f6d73e12-10e5-4fc7-982f-338397efc9c8 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:08.536237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6d73e12-10e5-4fc7-982f-338397efc9c8 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:08.537489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6d73e12-10e5-4fc7-982f-338397efc9c8 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:08.538260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6d73e12-10e5-4fc7-982f-338397efc9c8 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:08.539412 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6d73e12-10e5-4fc7-982f-338397efc9c8 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:08.540148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6d73e12-10e5-4fc7-982f-338397efc9c8 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:08.541018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6d73e12-10e5-4fc7-982f-338397efc9c8 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:09.506223 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f6d73e12-10e5-4fc7-982f-338397efc9c8 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:09.519049 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f6d73e12-10e5-4fc7-982f-338397efc9c8 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1319 microversion: 2.1 time: 1.005736 Aug 18 11:26:09.519979 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 215/388] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:08 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1319 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:26:09.537678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5adc5ccf-44ce-4832-8edb-ba187a388e98 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:09.539381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5adc5ccf-44ce-4832-8edb-ba187a388e98 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:09.546636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5adc5ccf-44ce-4832-8edb-ba187a388e98 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:09.548106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5adc5ccf-44ce-4832-8edb-ba187a388e98 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:09.548983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5adc5ccf-44ce-4832-8edb-ba187a388e98 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:09.564627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5adc5ccf-44ce-4832-8edb-ba187a388e98 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:09.565519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5adc5ccf-44ce-4832-8edb-ba187a388e98 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:09.566548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5adc5ccf-44ce-4832-8edb-ba187a388e98 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:09.756388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5adc5ccf-44ce-4832-8edb-ba187a388e98 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:09.767384 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5adc5ccf-44ce-4832-8edb-ba187a388e98 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1274 microversion: 2.1 time: 0.245310 Aug 18 11:26:09.774714 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 216/389] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:09 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1274 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:09.779986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-97c8c3ff-7503-4643-a339-7d333c484fb3 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:09.781726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-97c8c3ff-7503-4643-a339-7d333c484fb3 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:09.794079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:09.802692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97c8c3ff-7503-4643-a339-7d333c484fb3 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:09.803416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97c8c3ff-7503-4643-a339-7d333c484fb3 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:09.803806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97c8c3ff-7503-4643-a339-7d333c484fb3 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:09.804553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97c8c3ff-7503-4643-a339-7d333c484fb3 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:09.804990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97c8c3ff-7503-4643-a339-7d333c484fb3 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:09.805419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97c8c3ff-7503-4643-a339-7d333c484fb3 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:09.947499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:10.014522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-97c8c3ff-7503-4643-a339-7d333c484fb3 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:10.022211 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-97c8c3ff-7503-4643-a339-7d333c484fb3 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1277 microversion: 2.1 time: 0.246331 Aug 18 11:26:10.042472 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 217/390] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:09 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:10.554144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-69091cb3-0bf1-46a9-ad88-d7cdccabef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:10.558356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-69091cb3-0bf1-46a9-ad88-d7cdccabef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:10.585502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69091cb3-0bf1-46a9-ad88-d7cdccabef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:10.591589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69091cb3-0bf1-46a9-ad88-d7cdccabef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:10.592237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69091cb3-0bf1-46a9-ad88-d7cdccabef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:10.593137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69091cb3-0bf1-46a9-ad88-d7cdccabef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:10.594824 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69091cb3-0bf1-46a9-ad88-d7cdccabef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:10.595461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69091cb3-0bf1-46a9-ad88-d7cdccabef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:11.136331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-69091cb3-0bf1-46a9-ad88-d7cdccabef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:11.161482 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-69091cb3-0bf1-46a9-ad88-d7cdccabef0b tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1469 microversion: 2.1 time: 0.617989 Aug 18 11:26:11.163285 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 218/391] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:10 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1469 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:11.404461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2512edcb-85fa-4f84-8532-3801901afcae tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616 tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:11.405505 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:11.405505 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:11.408967 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-2512edcb-85fa-4f84-8532-3801901afcae tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616 tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2512edcb-85fa-4f84-8532-3801901afcae tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616 tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616-project-admin] Request method failure captured: Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iHSnn3qeAdx2ZI_ZYQN4cAfouIPXAZjT9LWqe38lu8lvR8d86iV6uAe9Jp_kOm87HtA09zXaSGauIqJlg60heZMcqu0_A0yY46f2bqpgA-pebF9omqFbQZvIySqjyuWwuiBg3D3fVfV7fLGa-BtwQDV5HpJ5SSn5RvlZnbGQQIq3rU Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 92de81777c61475bbfa2dafd7124cab6 Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616 Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:26:11.417191 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:26:11.420062 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/92de81777c61475bbfa2dafd7124cab6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/92de81777c61475bbfa2dafd7124cab6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_92de81777c61475bbfa2dafd7124cab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/92de81777c61475bbfa2dafd7124cab6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:11.420062 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616 Aug 18 11:26:11.420062 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 92de81777c61475bbfa2dafd7124cab6 Aug 18 11:26:11.420062 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616 Aug 18 11:26:11.420062 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616-project-admin Aug 18 11:26:11.420062 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:11.420062 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:11.420062 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 928a048b417e4fc3ad13cf61ea22fb6d Aug 18 11:26:11.420062 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616-project-admin Aug 18 11:26:11.420062 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:26:11.420062 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid timestamp for date invalid_time Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'invalid_time'} Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:11.420806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:11.421989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 18 11:26:11.421989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 18 11:26:11.421989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 18 11:26:11.421989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:11.421989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:11.421989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:11.421989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:11.421989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:11.421989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:11.421989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:11.421989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:11.421989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 18 11:26:11.421989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:11.433548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2512edcb-85fa-4f84-8532-3801901afcae tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616 tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:11.436162 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2512edcb-85fa-4f84-8532-3801901afcae tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616 tempest-InstanceUsageAuditLogNegativeTestJSON-2002327616-project-admin] 10.222.0.73 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.270813 Aug 18 11:26:11.445482 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 219/392] 10.222.0.73 () {58 vars in 1224 bytes} [Thu Aug 18 11:26:11 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 281 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:26:11.460418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6021ea29-14ab-4a72-95fd-9b6f601202fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:11.464422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6021ea29-14ab-4a72-95fd-9b6f601202fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:11.505214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6021ea29-14ab-4a72-95fd-9b6f601202fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:11.506320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6021ea29-14ab-4a72-95fd-9b6f601202fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:11.507817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6021ea29-14ab-4a72-95fd-9b6f601202fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:11.509843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6021ea29-14ab-4a72-95fd-9b6f601202fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:11.510612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6021ea29-14ab-4a72-95fd-9b6f601202fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:11.522560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6021ea29-14ab-4a72-95fd-9b6f601202fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:11.984675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6021ea29-14ab-4a72-95fd-9b6f601202fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:11.989527 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1fa2998-5a0a-465d-95b9-2e3ac950726e tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.486568 Aug 18 11:26:12.004646 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 174/393] 10.222.0.73 () {60 vars in 1170 bytes} [Thu Aug 18 11:26:07 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:12.009070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8a17cfdf-0c4a-48af-8ab1-e00672041c4c tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:12.009670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8a17cfdf-0c4a-48af-8ab1-e00672041c4c tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:12.014123 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6021ea29-14ab-4a72-95fd-9b6f601202fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1316 microversion: 2.1 time: 0.566500 Aug 18 11:26:12.021463 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 220/394] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:11 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1316 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:12.034380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-967f6885-3b53-4ccd-8458-1356ba42cea6 tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:12.042753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a17cfdf-0c4a-48af-8ab1-e00672041c4c tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:12.043562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a17cfdf-0c4a-48af-8ab1-e00672041c4c tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:12.044226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a17cfdf-0c4a-48af-8ab1-e00672041c4c tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:12.045174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a17cfdf-0c4a-48af-8ab1-e00672041c4c tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:12.045862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a17cfdf-0c4a-48af-8ab1-e00672041c4c tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:12.046523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a17cfdf-0c4a-48af-8ab1-e00672041c4c tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:12.050703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-967f6885-3b53-4ccd-8458-1356ba42cea6 tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:12.066959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-967f6885-3b53-4ccd-8458-1356ba42cea6 tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:12.068727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-967f6885-3b53-4ccd-8458-1356ba42cea6 tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:12.069342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-967f6885-3b53-4ccd-8458-1356ba42cea6 tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:12.070368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-967f6885-3b53-4ccd-8458-1356ba42cea6 tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:12.072005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-967f6885-3b53-4ccd-8458-1356ba42cea6 tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:12.073188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-967f6885-3b53-4ccd-8458-1356ba42cea6 tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:12.269862 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-967f6885-3b53-4ccd-8458-1356ba42cea6 tempest-DeleteServersAdminTestJSON-283107995 tempest-DeleteServersAdminTestJSON-283107995-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7/action" status: 202 len: 0 microversion: 2.1 time: 0.247392 Aug 18 11:26:12.270651 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 221/395] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:26:12 2022] POST /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:26:12.505061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8a17cfdf-0c4a-48af-8ab1-e00672041c4c tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:12.510833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:12.521536 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8a17cfdf-0c4a-48af-8ab1-e00672041c4c tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1319 microversion: 2.1 time: 0.516180 Aug 18 11:26:12.524684 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 175/396] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:12 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1319 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:12.534094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-64396444-2f07-413b-bd2e-bff88b01fea7 tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] Calling method '.version_select at 0x7f51ac37f1f0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:12.547480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ced2e945-1ef8-4cf1-9fd3-2ecfa5cd6707 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:12.548438 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:12.548438 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:12.549837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ced2e945-1ef8-4cf1-9fd3-2ecfa5cd6707 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '989c1ebde40844b988f5f24e43fe9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b95b09b9944c0f8c7476c284aea729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ced2e945-1ef8-4cf1-9fd3-2ecfa5cd6707 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289-project] Request method failure captured: Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iHRKLYR721OzpwEX_AEM2uaYhZT3RIQoO42aOIGUBLb2h1bUg-9wPs5jieHT5TuFO76DBUMr8VzT1NEzY2-1gTXXdn8nfjlRPsFVdqL5yD98WOP3GWyGhFocQF-xP1TpRA_WIJe6E5gBul0ex0W5BNrNPoPff0atxe5KxGIWO9_chY Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 19b95b09b9944c0f8c7476c284aea729 Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:26:12.552647 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:26:12.553833 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/19b95b09b9944c0f8c7476c284aea729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/19b95b09b9944c0f8c7476c284aea729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_19b95b09b9944c0f8c7476c284aea729"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/19b95b09b9944c0f8c7476c284aea729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:12.553833 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 Aug 18 11:26:12.553833 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 19b95b09b9944c0f8c7476c284aea729 Aug 18 11:26:12.553833 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 Aug 18 11:26:12.553833 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289-project Aug 18 11:26:12.553833 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:12.553833 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:12.553833 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 989c1ebde40844b988f5f24e43fe9be3 Aug 18 11:26:12.553833 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289-project Aug 18 11:26:12.553833 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: action_args: {} Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:26:12.554453 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 18 11:26:12.555612 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:12.560032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ced2e945-1ef8-4cf1-9fd3-2ecfa5cd6707 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:12.561398 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ced2e945-1ef8-4cf1-9fd3-2ecfa5cd6707 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289-project] 10.222.0.73 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.289494 Aug 18 11:26:12.562900 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 222/397] 10.222.0.73 () {58 vars in 1185 bytes} [Thu Aug 18 11:26:12 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 292 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:12.585321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7babfe3d-a6de-4b3d-9008-fa7d48dfe98e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:12.587531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7babfe3d-a6de-4b3d-9008-fa7d48dfe98e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:12.605079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7babfe3d-a6de-4b3d-9008-fa7d48dfe98e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:12.605846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7babfe3d-a6de-4b3d-9008-fa7d48dfe98e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:12.606314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7babfe3d-a6de-4b3d-9008-fa7d48dfe98e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:12.607090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7babfe3d-a6de-4b3d-9008-fa7d48dfe98e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:12.607684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7babfe3d-a6de-4b3d-9008-fa7d48dfe98e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:12.608123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7babfe3d-a6de-4b3d-9008-fa7d48dfe98e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:12.654630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7babfe3d-a6de-4b3d-9008-fa7d48dfe98e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:12.655171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7babfe3d-a6de-4b3d-9008-fa7d48dfe98e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:12.655614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7babfe3d-a6de-4b3d-9008-fa7d48dfe98e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:12.656537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-7babfe3d-a6de-4b3d-9008-fa7d48dfe98e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lazy-loading 'fault' on Instance uuid 3266e748-29b3-4cfb-b4eb-6f47a38546e7 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:26:13.450043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7babfe3d-a6de-4b3d-9008-fa7d48dfe98e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:13.454002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:13.485506 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-64396444-2f07-413b-bd2e-bff88b01fea7 tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] 10.222.0.73 "GET /compute/v2.1/os-floating-ips/48dca0eb-f001-4157-b714-1dd62b1c6518" status: 200 len: 141 microversion: 2.1 time: 0.953694 Aug 18 11:26:13.486126 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 176/398] 10.222.0.73 () {58 vars in 1260 bytes} [Thu Aug 18 11:26:12 2022] GET /compute/v2.1/os-floating-ips/48dca0eb-f001-4157-b714-1dd62b1c6518 => generated 141 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:13.493179 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7babfe3d-a6de-4b3d-9008-fa7d48dfe98e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1452 microversion: 2.1 time: 0.898116 Aug 18 11:26:13.497922 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 223/399] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:12 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1452 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:13.498292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ba45c7f4-ceff-477b-83f5-f20fb2146669 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:13.499281 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:13.499281 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:13.500605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ba45c7f4-ceff-477b-83f5-f20fb2146669 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '989c1ebde40844b988f5f24e43fe9be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b95b09b9944c0f8c7476c284aea729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ba45c7f4-ceff-477b-83f5-f20fb2146669 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289-project] Request method failure captured: Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-18%2011:26:12 HTTP/1.1 Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iHRKLYR721OzpwEX_AEM2uaYhZT3RIQoO42aOIGUBLb2h1bUg-9wPs5jieHT5TuFO76DBUMr8VzT1NEzY2-1gTXXdn8nfjlRPsFVdqL5yD98WOP3GWyGhFocQF-xP1TpRA_WIJe6E5gBul0ex0W5BNrNPoPff0atxe5KxGIWO9_chY Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 19b95b09b9944c0f8c7476c284aea729 Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:26:13.502733 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:26:13.504004 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/19b95b09b9944c0f8c7476c284aea729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/19b95b09b9944c0f8c7476c284aea729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_19b95b09b9944c0f8c7476c284aea729"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/19b95b09b9944c0f8c7476c284aea729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:13.504004 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 Aug 18 11:26:13.504004 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 19b95b09b9944c0f8c7476c284aea729 Aug 18 11:26:13.504004 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 Aug 18 11:26:13.504004 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289-project Aug 18 11:26:13.504004 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:13.504004 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:13.504004 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 989c1ebde40844b988f5f24e43fe9be3 Aug 18 11:26:13.504004 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289-project Aug 18 11:26:13.504004 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '2022-08-18 11:26:12'} Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:26:13.504536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 18 11:26:13.505581 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:13.508312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ba45c7f4-ceff-477b-83f5-f20fb2146669 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:13.510203 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ba45c7f4-ceff-477b-83f5-f20fb2146669 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289 tempest-InstanceUsageAuditLogNegativeTestJSON-1677742289-project] 10.222.0.73 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-18 11:26:12" status: 403 len: 128 microversion: 2.1 time: 0.015582 Aug 18 11:26:13.510998 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 177/400] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 11:26:13 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-18%2011%3A26%3A12 => generated 128 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:13.523648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-471bd28f-822e-4189-8c36-cd54303d0fca tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:13.524552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-471bd28f-822e-4189-8c36-cd54303d0fca tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:13.526561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-0fd7ef55-f28d-41c5-bf9f-92a75c9c507a req-3182ee02-7a4d-4f8b-8958-fa2db287aebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4373a5-07b8-4549-83a9-f38b2fd0369c", "tag": "101a2266-a8f2-44e2-bd99-3b422d800824"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:13.533608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-471bd28f-822e-4189-8c36-cd54303d0fca tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:13.534524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-471bd28f-822e-4189-8c36-cd54303d0fca tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:13.535187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-471bd28f-822e-4189-8c36-cd54303d0fca tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:13.536116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-471bd28f-822e-4189-8c36-cd54303d0fca tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:13.536784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-471bd28f-822e-4189-8c36-cd54303d0fca tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:13.537484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-471bd28f-822e-4189-8c36-cd54303d0fca tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:13.549027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0fd7ef55-f28d-41c5-bf9f-92a75c9c507a req-3182ee02-7a4d-4f8b-8958-fa2db287aebd service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:13.555642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0fd7ef55-f28d-41c5-bf9f-92a75c9c507a req-3182ee02-7a4d-4f8b-8958-fa2db287aebd service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:13.556519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0fd7ef55-f28d-41c5-bf9f-92a75c9c507a req-3182ee02-7a4d-4f8b-8958-fa2db287aebd service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:13.590183 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-0fd7ef55-f28d-41c5-bf9f-92a75c9c507a req-3182ee02-7a4d-4f8b-8958-fa2db287aebd service nova] Creating event network-changed:101a2266-a8f2-44e2-bd99-3b422d800824 for instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c on n-h2-853611-3 Aug 18 11:26:13.601987 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-0fd7ef55-f28d-41c5-bf9f-92a75c9c507a req-3182ee02-7a4d-4f8b-8958-fa2db287aebd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102378 Aug 18 11:26:13.603458 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 224/401] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:13.610225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c54f778d-ef4f-4e1f-a402-96a6fd51ac60 tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] Calling method '.version_select at 0x7f51ac22f280>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:14.089352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-471bd28f-822e-4189-8c36-cd54303d0fca tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:14.113421 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-471bd28f-822e-4189-8c36-cd54303d0fca tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1316 microversion: 2.1 time: 0.592405 Aug 18 11:26:14.117708 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 178/402] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:13 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1316 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:14.138379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0c6b31c7-6696-4ba7-81fa-4f377c2341be tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:14.140762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0c6b31c7-6696-4ba7-81fa-4f377c2341be tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:14.178242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c6b31c7-6696-4ba7-81fa-4f377c2341be tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:14.180787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c6b31c7-6696-4ba7-81fa-4f377c2341be tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:14.183215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c6b31c7-6696-4ba7-81fa-4f377c2341be tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:14.185545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c6b31c7-6696-4ba7-81fa-4f377c2341be tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:14.187030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c6b31c7-6696-4ba7-81fa-4f377c2341be tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:14.188786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c6b31c7-6696-4ba7-81fa-4f377c2341be tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:14.288630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0c6b31c7-6696-4ba7-81fa-4f377c2341be tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:26:14.296740 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c54f778d-ef4f-4e1f-a402-96a6fd51ac60 tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] 10.222.0.73 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.691847 Aug 18 11:26:14.305529 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 225/403] 10.222.0.73 () {58 vars in 1149 bytes} [Thu Aug 18 11:26:13 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:14.312330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e5f9b5a4-65e6-491b-bf37-474b487828e1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:14.313436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e5f9b5a4-65e6-491b-bf37-474b487828e1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:14.331850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5f9b5a4-65e6-491b-bf37-474b487828e1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:14.332706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5f9b5a4-65e6-491b-bf37-474b487828e1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:14.333355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5f9b5a4-65e6-491b-bf37-474b487828e1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:14.334323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5f9b5a4-65e6-491b-bf37-474b487828e1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:14.335128 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5f9b5a4-65e6-491b-bf37-474b487828e1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:14.335882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5f9b5a4-65e6-491b-bf37-474b487828e1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:14.460116 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0c6b31c7-6696-4ba7-81fa-4f377c2341be tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 204 len: 0 microversion: 2.1 time: 0.338583 Aug 18 11:26:14.461626 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 179/404] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:26:14 2022] DELETE /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:26:14.473709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bbfd7cef-8072-435d-a578-73b9954762e4 tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] Calling method '.version_select at 0x7f51ac255280>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:14.779114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e5f9b5a4-65e6-491b-bf37-474b487828e1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:14.813025 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e5f9b5a4-65e6-491b-bf37-474b487828e1 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1319 microversion: 2.1 time: 0.504737 Aug 18 11:26:14.816558 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 226/405] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:14 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1319 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:14.833807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3c1684c8-38ba-4193-9a53-3c61c769912a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:14.836497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3c1684c8-38ba-4193-9a53-3c61c769912a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:14.867805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c1684c8-38ba-4193-9a53-3c61c769912a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:14.869790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c1684c8-38ba-4193-9a53-3c61c769912a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:14.872218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c1684c8-38ba-4193-9a53-3c61c769912a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:14.874114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c1684c8-38ba-4193-9a53-3c61c769912a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:14.879446 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c1684c8-38ba-4193-9a53-3c61c769912a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:14.880671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c1684c8-38ba-4193-9a53-3c61c769912a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:14.968332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c1684c8-38ba-4193-9a53-3c61c769912a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:14.969042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c1684c8-38ba-4193-9a53-3c61c769912a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:14.969645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c1684c8-38ba-4193-9a53-3c61c769912a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:14.970150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-3c1684c8-38ba-4193-9a53-3c61c769912a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lazy-loading 'fault' on Instance uuid 3266e748-29b3-4cfb-b4eb-6f47a38546e7 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:26:15.190655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3c1684c8-38ba-4193-9a53-3c61c769912a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:15.200701 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3c1684c8-38ba-4193-9a53-3c61c769912a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1458 microversion: 2.1 time: 0.382222 Aug 18 11:26:15.204823 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 227/406] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:14 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1458 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:15.216105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-47a4aac3-7e92-424f-a201-54744de61c81 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:15.217400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-47a4aac3-7e92-424f-a201-54744de61c81 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:15.226716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47a4aac3-7e92-424f-a201-54744de61c81 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:15.227619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47a4aac3-7e92-424f-a201-54744de61c81 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:15.229012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47a4aac3-7e92-424f-a201-54744de61c81 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:15.230321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47a4aac3-7e92-424f-a201-54744de61c81 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:15.231423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47a4aac3-7e92-424f-a201-54744de61c81 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:15.232083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47a4aac3-7e92-424f-a201-54744de61c81 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:15.488537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-47a4aac3-7e92-424f-a201-54744de61c81 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:15.499420 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-47a4aac3-7e92-424f-a201-54744de61c81 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1316 microversion: 2.1 time: 0.293146 Aug 18 11:26:15.500355 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 228/407] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:15 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:15.641717 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-039d09a1-333d-4321-9059-034b7319a436 req-0ad9356b-8574-4c2c-9825-28fc61a7e35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3247ce04-df54-4bd8-a1e9-00a29d975b62", "tag": "177ae402-c6ae-4f07-8847-318571daf7b5"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:15.664744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-039d09a1-333d-4321-9059-034b7319a436 req-0ad9356b-8574-4c2c-9825-28fc61a7e35d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:15.665895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-039d09a1-333d-4321-9059-034b7319a436 req-0ad9356b-8574-4c2c-9825-28fc61a7e35d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:15.669974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-039d09a1-333d-4321-9059-034b7319a436 req-0ad9356b-8574-4c2c-9825-28fc61a7e35d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:15.716726 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-039d09a1-333d-4321-9059-034b7319a436 req-0ad9356b-8574-4c2c-9825-28fc61a7e35d service nova] Creating event network-changed:177ae402-c6ae-4f07-8847-318571daf7b5 for instance 3247ce04-df54-4bd8-a1e9-00a29d975b62 on n-h1-853611-3 Aug 18 11:26:15.729077 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-039d09a1-333d-4321-9059-034b7319a436 req-0ad9356b-8574-4c2c-9825-28fc61a7e35d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092700 Aug 18 11:26:15.731031 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 229/408] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:15.836568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:15.854301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4838e21f-4760-48b8-8896-ead2fc55e08d tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:15.864195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4838e21f-4760-48b8-8896-ead2fc55e08d tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:15.892100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4838e21f-4760-48b8-8896-ead2fc55e08d tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:15.899511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4838e21f-4760-48b8-8896-ead2fc55e08d tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:15.901092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4838e21f-4760-48b8-8896-ead2fc55e08d tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:15.903207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4838e21f-4760-48b8-8896-ead2fc55e08d tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:15.904361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4838e21f-4760-48b8-8896-ead2fc55e08d tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:15.905474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4838e21f-4760-48b8-8896-ead2fc55e08d tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:16.229124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4838e21f-4760-48b8-8896-ead2fc55e08d tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:16.238087 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4838e21f-4760-48b8-8896-ead2fc55e08d tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1319 microversion: 2.1 time: 0.403049 Aug 18 11:26:16.253856 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 230/409] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:15 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:26:16.290003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c087f26a-a1e5-4fd6-a916-bb959688b79e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:16.296129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c087f26a-a1e5-4fd6-a916-bb959688b79e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:16.319484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c087f26a-a1e5-4fd6-a916-bb959688b79e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:16.320244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c087f26a-a1e5-4fd6-a916-bb959688b79e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:16.320926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c087f26a-a1e5-4fd6-a916-bb959688b79e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:16.321990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c087f26a-a1e5-4fd6-a916-bb959688b79e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:16.322899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c087f26a-a1e5-4fd6-a916-bb959688b79e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:16.323556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c087f26a-a1e5-4fd6-a916-bb959688b79e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:16.354157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=16 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:16.401736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c087f26a-a1e5-4fd6-a916-bb959688b79e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:16.402631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c087f26a-a1e5-4fd6-a916-bb959688b79e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:16.403307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c087f26a-a1e5-4fd6-a916-bb959688b79e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:16.403975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-c087f26a-a1e5-4fd6-a916-bb959688b79e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lazy-loading 'fault' on Instance uuid 3266e748-29b3-4cfb-b4eb-6f47a38546e7 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:26:17.355795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c087f26a-a1e5-4fd6-a916-bb959688b79e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:17.382691 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c087f26a-a1e5-4fd6-a916-bb959688b79e tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1458 microversion: 2.1 time: 1.111607 Aug 18 11:26:17.384620 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 231/410] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:16 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1458 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:17.406595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f1f7fa25-7137-4b70-ab8d-0100e5b06686 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:17.409695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f1f7fa25-7137-4b70-ab8d-0100e5b06686 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:17.432301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1f7fa25-7137-4b70-ab8d-0100e5b06686 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:17.433177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1f7fa25-7137-4b70-ab8d-0100e5b06686 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:17.433764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1f7fa25-7137-4b70-ab8d-0100e5b06686 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:17.440400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1f7fa25-7137-4b70-ab8d-0100e5b06686 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:17.441679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1f7fa25-7137-4b70-ab8d-0100e5b06686 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:17.442306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1f7fa25-7137-4b70-ab8d-0100e5b06686 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:17.863010 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bbfd7cef-8072-435d-a578-73b9954762e4 tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/48dca0eb-f001-4157-b714-1dd62b1c6518" status: 202 len: 0 microversion: 2.1 time: 3.398642 Aug 18 11:26:17.863591 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 180/411] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:26:14 2022] DELETE /compute/v2.1/os-floating-ips/48dca0eb-f001-4157-b714-1dd62b1c6518 => generated 0 bytes in 3401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:26:17.868117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-935237a0-80ff-4800-a2bd-946d1086d3f6 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:17.871446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-935237a0-80ff-4800-a2bd-946d1086d3f6 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:17.888488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-935237a0-80ff-4800-a2bd-946d1086d3f6 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:17.890734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-935237a0-80ff-4800-a2bd-946d1086d3f6 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:17.892140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-935237a0-80ff-4800-a2bd-946d1086d3f6 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:17.896736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-935237a0-80ff-4800-a2bd-946d1086d3f6 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:17.898971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-935237a0-80ff-4800-a2bd-946d1086d3f6 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:17.900702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-935237a0-80ff-4800-a2bd-946d1086d3f6 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:18.251767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-935237a0-80ff-4800-a2bd-946d1086d3f6 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:18.262738 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-935237a0-80ff-4800-a2bd-946d1086d3f6 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1319 microversion: 2.1 time: 0.397939 Aug 18 11:26:18.263804 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 181/412] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:17 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:18.275633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1edc68c3-6ff2-4181-a416-22e9f9a6a33e tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] Action: 'create', calling method: .version_select at 0x7f51ac1ffee0>, body: {"pool": null} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:18.836396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f1f7fa25-7137-4b70-ab8d-0100e5b06686 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:18.848343 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f1f7fa25-7137-4b70-ab8d-0100e5b06686 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1316 microversion: 2.1 time: 1.454120 Aug 18 11:26:18.849443 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 232/413] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:17 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1316 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:18.861386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5dcb1974-bf99-4057-9ae2-d0d734c5f449 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:18.866635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5dcb1974-bf99-4057-9ae2-d0d734c5f449 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:18.878351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dcb1974-bf99-4057-9ae2-d0d734c5f449 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:18.879288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dcb1974-bf99-4057-9ae2-d0d734c5f449 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:18.879914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dcb1974-bf99-4057-9ae2-d0d734c5f449 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:18.881000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dcb1974-bf99-4057-9ae2-d0d734c5f449 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:18.881614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dcb1974-bf99-4057-9ae2-d0d734c5f449 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:18.882730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dcb1974-bf99-4057-9ae2-d0d734c5f449 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:18.933539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dcb1974-bf99-4057-9ae2-d0d734c5f449 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:18.934334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dcb1974-bf99-4057-9ae2-d0d734c5f449 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:18.934969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dcb1974-bf99-4057-9ae2-d0d734c5f449 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:18.935582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-5dcb1974-bf99-4057-9ae2-d0d734c5f449 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lazy-loading 'fault' on Instance uuid 3266e748-29b3-4cfb-b4eb-6f47a38546e7 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:26:20.412859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5dcb1974-bf99-4057-9ae2-d0d734c5f449 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4888e1219d22476b8767e9fcef0bd6e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89daeef39bfc4a6d9655a6adf698dcb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:20.427705 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5dcb1974-bf99-4057-9ae2-d0d734c5f449 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 200 len: 1458 microversion: 2.1 time: 1.576538 Aug 18 11:26:20.428303 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 233/414] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:18 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 1458 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:20.441176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7ef08e04-c6e6-487e-994d-e2113c872334 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:20.444339 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7ef08e04-c6e6-487e-994d-e2113c872334 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:20.461497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ef08e04-c6e6-487e-994d-e2113c872334 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:20.462782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ef08e04-c6e6-487e-994d-e2113c872334 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:20.463404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ef08e04-c6e6-487e-994d-e2113c872334 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:20.464302 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ef08e04-c6e6-487e-994d-e2113c872334 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:20.464902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ef08e04-c6e6-487e-994d-e2113c872334 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:20.465658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ef08e04-c6e6-487e-994d-e2113c872334 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:20.929703 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1edc68c3-6ff2-4181-a416-22e9f9a6a33e tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.664677 Aug 18 11:26:20.931602 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 182/415] 10.222.0.73 () {60 vars in 1170 bytes} [Thu Aug 18 11:26:18 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:20.937279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1541635b-01de-4774-80dc-ad7c9484acab tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:20.938015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1541635b-01de-4774-80dc-ad7c9484acab tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:20.957041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1541635b-01de-4774-80dc-ad7c9484acab tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:20.961954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1541635b-01de-4774-80dc-ad7c9484acab tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:20.965979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1541635b-01de-4774-80dc-ad7c9484acab tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:20.970745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1541635b-01de-4774-80dc-ad7c9484acab tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:20.971821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1541635b-01de-4774-80dc-ad7c9484acab tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:20.974372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1541635b-01de-4774-80dc-ad7c9484acab tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:21.215898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7ef08e04-c6e6-487e-994d-e2113c872334 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:21.227953 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7ef08e04-c6e6-487e-994d-e2113c872334 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1319 microversion: 2.1 time: 0.791056 Aug 18 11:26:21.230026 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 234/416] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:20 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1319 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:21.236764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-ca292597-ee8c-4355-bf10-b8b07831c8c4 req-bfa06f57-1fd8-4fe6-8caf-3343ad0fc8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3266e748-29b3-4cfb-b4eb-6f47a38546e7", "name": "network-vif-deleted", "tag": "a8457969-ffb6-4e4a-af12-6ae69ea3cea5"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:21.260339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1541635b-01de-4774-80dc-ad7c9484acab tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:21.267652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ca292597-ee8c-4355-bf10-b8b07831c8c4 req-bfa06f57-1fd8-4fe6-8caf-3343ad0fc8f1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:21.268877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ca292597-ee8c-4355-bf10-b8b07831c8c4 req-bfa06f57-1fd8-4fe6-8caf-3343ad0fc8f1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:21.270552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ca292597-ee8c-4355-bf10-b8b07831c8c4 req-bfa06f57-1fd8-4fe6-8caf-3343ad0fc8f1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:21.272661 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1541635b-01de-4774-80dc-ad7c9484acab tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1316 microversion: 2.1 time: 0.339694 Aug 18 11:26:21.273818 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 183/417] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:20 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:21.291043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34045d0a-ce54-438c-963d-91cf978c1a4a tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] Calling method '.version_select at 0x7f51ac2459d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:21.304700 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ca292597-ee8c-4355-bf10-b8b07831c8c4 req-bfa06f57-1fd8-4fe6-8caf-3343ad0fc8f1 service nova] Creating event network-vif-deleted:a8457969-ffb6-4e4a-af12-6ae69ea3cea5 for instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 on n-h2-853611-3 Aug 18 11:26:21.316207 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-ca292597-ee8c-4355-bf10-b8b07831c8c4 req-bfa06f57-1fd8-4fe6-8caf-3343ad0fc8f1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083966 Aug 18 11:26:21.317830 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 235/418] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:21.450841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a48f4b8-99a4-45bb-ad31-f371f387fd18 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:21.452569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0a48f4b8-99a4-45bb-ad31-f371f387fd18 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:21.459414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a48f4b8-99a4-45bb-ad31-f371f387fd18 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:21.460121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a48f4b8-99a4-45bb-ad31-f371f387fd18 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:21.460781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a48f4b8-99a4-45bb-ad31-f371f387fd18 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:21.461756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a48f4b8-99a4-45bb-ad31-f371f387fd18 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:21.462648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a48f4b8-99a4-45bb-ad31-f371f387fd18 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:21.463259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a48f4b8-99a4-45bb-ad31-f371f387fd18 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:21.483807 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-0a48f4b8-99a4-45bb-ad31-f371f387fd18 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] HTTP exception thrown: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a48f4b8-99a4-45bb-ad31-f371f387fd18 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Request method failure captured: Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 HTTP/1.1 Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGjWzyfQFIIMKiuUEF2pLc0XXsp4vaWoPAGhl_z5XN7oPk-T3KSsyq2hU98xCNDMo2l3FUbq76QRmj_-5QoDCXBBB_p2rEDgcOq7ar200W-Ri9TulXdxHUd4TzixPnAqgRk2dO6jufdQRatxYlts8zPMZqNzIYbrFFMO-LTSjiC3Fs Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 89daeef39bfc4a6d9655a6adf698dcb3 Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:26:21.485820 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:26:21.487504 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:21.487504 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.487504 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 89daeef39bfc4a6d9655a6adf698dcb3 Aug 18 11:26:21.487504 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.487504 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersAdminTestJSON-1327442043-project Aug 18 11:26:21.487504 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:21.487504 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:21.487504 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4888e1219d22476b8767e9fcef0bd6e0 Aug 18 11:26:21.487504 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersAdminTestJSON-1327442043-project Aug 18 11:26:21.487504 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:26:21.487504 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.487504 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3266e748-29b3-4cfb-b4eb-6f47a38546e7'} Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:21.488329 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.489899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.492729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a48f4b8-99a4-45bb-ad31-f371f387fd18 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Returning 404 to user: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:21.494563 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0a48f4b8-99a4-45bb-ad31-f371f387fd18 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 404 len: 111 microversion: 2.1 time: 0.048781 Aug 18 11:26:21.500662 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 236/419] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:21 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:26:21.506569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-db1be3a2-b82b-461e-82f8-a88266db4f08 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:21.507256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-db1be3a2-b82b-461e-82f8-a88266db4f08 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:21.514502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db1be3a2-b82b-461e-82f8-a88266db4f08 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:21.515209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db1be3a2-b82b-461e-82f8-a88266db4f08 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:21.515819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db1be3a2-b82b-461e-82f8-a88266db4f08 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:21.516716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db1be3a2-b82b-461e-82f8-a88266db4f08 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:21.517317 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db1be3a2-b82b-461e-82f8-a88266db4f08 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:21.517883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db1be3a2-b82b-461e-82f8-a88266db4f08 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:21.533337 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-db1be3a2-b82b-461e-82f8-a88266db4f08 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] HTTP exception thrown: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-db1be3a2-b82b-461e-82f8-a88266db4f08 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Request method failure captured: Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 HTTP/1.1 Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGjWzyfQFIIMKiuUEF2pLc0XXsp4vaWoPAGhl_z5XN7oPk-T3KSsyq2hU98xCNDMo2l3FUbq76QRmj_-5QoDCXBBB_p2rEDgcOq7ar200W-Ri9TulXdxHUd4TzixPnAqgRk2dO6jufdQRatxYlts8zPMZqNzIYbrFFMO-LTSjiC3Fs Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 89daeef39bfc4a6d9655a6adf698dcb3 Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:26:21.535233 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:26:21.536725 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:21.536725 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.536725 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 89daeef39bfc4a6d9655a6adf698dcb3 Aug 18 11:26:21.536725 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.536725 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersAdminTestJSON-1327442043-project Aug 18 11:26:21.536725 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:21.536725 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:21.536725 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4888e1219d22476b8767e9fcef0bd6e0 Aug 18 11:26:21.536725 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersAdminTestJSON-1327442043-project Aug 18 11:26:21.536725 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:26:21.536725 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.536725 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3266e748-29b3-4cfb-b4eb-6f47a38546e7'} Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:21.537541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.538912 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.541754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-db1be3a2-b82b-461e-82f8-a88266db4f08 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Returning 404 to user: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:21.543136 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-db1be3a2-b82b-461e-82f8-a88266db4f08 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 404 len: 111 microversion: 2.1 time: 0.040796 Aug 18 11:26:21.547197 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 237/420] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:26:21 2022] DELETE /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:21.552370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7c101889-9824-4a6c-8def-ace408b1888a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:21.553578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7c101889-9824-4a6c-8def-ace408b1888a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: 3266e748-29b3-4cfb-b4eb-6f47a38546e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:21.561634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c101889-9824-4a6c-8def-ace408b1888a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:21.562502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c101889-9824-4a6c-8def-ace408b1888a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:21.563902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c101889-9824-4a6c-8def-ace408b1888a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:21.564979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c101889-9824-4a6c-8def-ace408b1888a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:21.565731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c101889-9824-4a6c-8def-ace408b1888a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:21.566628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c101889-9824-4a6c-8def-ace408b1888a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:21.585713 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-7c101889-9824-4a6c-8def-ace408b1888a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] HTTP exception thrown: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7c101889-9824-4a6c-8def-ace408b1888a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Request method failure captured: Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 HTTP/1.1 Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGjWzyfQFIIMKiuUEF2pLc0XXsp4vaWoPAGhl_z5XN7oPk-T3KSsyq2hU98xCNDMo2l3FUbq76QRmj_-5QoDCXBBB_p2rEDgcOq7ar200W-Ri9TulXdxHUd4TzixPnAqgRk2dO6jufdQRatxYlts8zPMZqNzIYbrFFMO-LTSjiC3Fs Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 89daeef39bfc4a6d9655a6adf698dcb3 Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:26:21.588208 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:26:21.589526 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:21.589526 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.589526 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 89daeef39bfc4a6d9655a6adf698dcb3 Aug 18 11:26:21.589526 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.589526 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersAdminTestJSON-1327442043-project Aug 18 11:26:21.589526 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:21.589526 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:21.589526 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4888e1219d22476b8767e9fcef0bd6e0 Aug 18 11:26:21.589526 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersAdminTestJSON-1327442043-project Aug 18 11:26:21.589526 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:26:21.589526 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.589526 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3266e748-29b3-4cfb-b4eb-6f47a38546e7'} Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:21.590301 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. Aug 18 11:26:21.591507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.593355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7c101889-9824-4a6c-8def-ace408b1888a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Returning 404 to user: Instance 3266e748-29b3-4cfb-b4eb-6f47a38546e7 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:21.594767 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7c101889-9824-4a6c-8def-ace408b1888a tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7" status: 404 len: 111 microversion: 2.1 time: 0.046296 Aug 18 11:26:21.598914 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 238/421] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:21 2022] GET /compute/v2.1/servers/3266e748-29b3-4cfb-b4eb-6f47a38546e7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:21.605594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2853be15-2d8a-4a4f-83e8-b496275c19b5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:21.606337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2853be15-2d8a-4a4f-83e8-b496275c19b5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:21.613054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2853be15-2d8a-4a4f-83e8-b496275c19b5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:21.613772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2853be15-2d8a-4a4f-83e8-b496275c19b5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:21.614804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2853be15-2d8a-4a4f-83e8-b496275c19b5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:21.615756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2853be15-2d8a-4a4f-83e8-b496275c19b5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:21.616373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2853be15-2d8a-4a4f-83e8-b496275c19b5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:21.616954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2853be15-2d8a-4a4f-83e8-b496275c19b5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:21.635949 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-2853be15-2d8a-4a4f-83e8-b496275c19b5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] HTTP exception thrown: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2853be15-2d8a-4a4f-83e8-b496275c19b5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Request method failure captured: Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 HTTP/1.1 Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGjWzyfQFIIMKiuUEF2pLc0XXsp4vaWoPAGhl_z5XN7oPk-T3KSsyq2hU98xCNDMo2l3FUbq76QRmj_-5QoDCXBBB_p2rEDgcOq7ar200W-Ri9TulXdxHUd4TzixPnAqgRk2dO6jufdQRatxYlts8zPMZqNzIYbrFFMO-LTSjiC3Fs Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 89daeef39bfc4a6d9655a6adf698dcb3 Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:26:21.638045 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:26:21.639500 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:21.639500 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.639500 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 89daeef39bfc4a6d9655a6adf698dcb3 Aug 18 11:26:21.639500 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.639500 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersAdminTestJSON-1327442043-project Aug 18 11:26:21.639500 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:21.639500 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:21.639500 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4888e1219d22476b8767e9fcef0bd6e0 Aug 18 11:26:21.639500 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersAdminTestJSON-1327442043-project Aug 18 11:26:21.639500 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:26:21.639500 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:26:21.639500 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'f5de87cb-7296-4818-98c3-8ef54eaae832'} Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:21.640313 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:26:21.641428 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.644163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2853be15-2d8a-4a4f-83e8-b496275c19b5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Returning 404 to user: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:21.645538 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2853be15-2d8a-4a4f-83e8-b496275c19b5 tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 404 len: 111 microversion: 2.1 time: 0.045075 Aug 18 11:26:21.650250 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 239/422] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:26:21 2022] DELETE /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:21.668078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5710284d-0b79-4247-8d19-c90a1eb3e02c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:21.669140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5710284d-0b79-4247-8d19-c90a1eb3e02c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] [instance: f5de87cb-7296-4818-98c3-8ef54eaae832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:21.680353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5710284d-0b79-4247-8d19-c90a1eb3e02c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:21.682462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5710284d-0b79-4247-8d19-c90a1eb3e02c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:21.683239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5710284d-0b79-4247-8d19-c90a1eb3e02c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:21.684177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5710284d-0b79-4247-8d19-c90a1eb3e02c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:21.684790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5710284d-0b79-4247-8d19-c90a1eb3e02c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:21.685387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5710284d-0b79-4247-8d19-c90a1eb3e02c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:21.713234 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-5710284d-0b79-4247-8d19-c90a1eb3e02c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] HTTP exception thrown: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5710284d-0b79-4247-8d19-c90a1eb3e02c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Request method failure captured: Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 HTTP/1.1 Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGjWzyfQFIIMKiuUEF2pLc0XXsp4vaWoPAGhl_z5XN7oPk-T3KSsyq2hU98xCNDMo2l3FUbq76QRmj_-5QoDCXBBB_p2rEDgcOq7ar200W-Ri9TulXdxHUd4TzixPnAqgRk2dO6jufdQRatxYlts8zPMZqNzIYbrFFMO-LTSjiC3Fs Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 89daeef39bfc4a6d9655a6adf698dcb3 Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:26:21.716271 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:26:21.717605 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89daeef39bfc4a6d9655a6adf698dcb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:21.717605 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.717605 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 89daeef39bfc4a6d9655a6adf698dcb3 Aug 18 11:26:21.717605 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1327442043 Aug 18 11:26:21.717605 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersAdminTestJSON-1327442043-project Aug 18 11:26:21.717605 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:21.717605 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:21.717605 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4888e1219d22476b8767e9fcef0bd6e0 Aug 18 11:26:21.717605 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersAdminTestJSON-1327442043-project Aug 18 11:26:21.717605 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:26:21.717605 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:26:21.717605 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'f5de87cb-7296-4818-98c3-8ef54eaae832'} Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:21.718495 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. Aug 18 11:26:21.719638 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:21.720802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5710284d-0b79-4247-8d19-c90a1eb3e02c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] Returning 404 to user: Instance f5de87cb-7296-4818-98c3-8ef54eaae832 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:21.720802 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5710284d-0b79-4247-8d19-c90a1eb3e02c tempest-DeleteServersAdminTestJSON-1327442043 tempest-DeleteServersAdminTestJSON-1327442043-project] 10.222.0.73 "GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832" status: 404 len: 111 microversion: 2.1 time: 0.068294 Aug 18 11:26:21.729211 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 240/423] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:21 2022] GET /compute/v2.1/servers/f5de87cb-7296-4818-98c3-8ef54eaae832 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:22.254305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-84cfd96d-d324-4940-b274-e8573dabdd21 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:22.255230 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-84cfd96d-d324-4940-b274-e8573dabdd21 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:22.277649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84cfd96d-d324-4940-b274-e8573dabdd21 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:22.278390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84cfd96d-d324-4940-b274-e8573dabdd21 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:22.280883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84cfd96d-d324-4940-b274-e8573dabdd21 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:22.281837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84cfd96d-d324-4940-b274-e8573dabdd21 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:22.282649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84cfd96d-d324-4940-b274-e8573dabdd21 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:22.283216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84cfd96d-d324-4940-b274-e8573dabdd21 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:22.909698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-84cfd96d-d324-4940-b274-e8573dabdd21 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:22.924188 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-84cfd96d-d324-4940-b274-e8573dabdd21 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1319 microversion: 2.1 time: 0.673703 Aug 18 11:26:22.934851 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 241/424] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:22 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1319 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:22.947517 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c25119de-a981-47d4-bce9-621931988e18 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:22.952307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c25119de-a981-47d4-bce9-621931988e18 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:22.968048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c25119de-a981-47d4-bce9-621931988e18 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:22.971263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c25119de-a981-47d4-bce9-621931988e18 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:22.971888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c25119de-a981-47d4-bce9-621931988e18 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:22.975533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c25119de-a981-47d4-bce9-621931988e18 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:22.976161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c25119de-a981-47d4-bce9-621931988e18 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:22.977273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c25119de-a981-47d4-bce9-621931988e18 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:23.540287 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34045d0a-ce54-438c-963d-91cf978c1a4a tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/551cdfdc-b8de-4a2c-8d85-b90aa514963e" status: 202 len: 0 microversion: 2.1 time: 2.262272 Aug 18 11:26:23.541900 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 184/425] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:26:21 2022] DELETE /compute/v2.1/os-floating-ips/551cdfdc-b8de-4a2c-8d85-b90aa514963e => generated 0 bytes in 2268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:26:23.549231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f712ad04-618a-426f-842a-cc693e7ca40c req-3b4db29b-e1b7-4414-a7bd-0d63a74f2ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3247ce04-df54-4bd8-a1e9-00a29d975b62", "name": "network-vif-plugged", "status": "completed", "tag": "177ae402-c6ae-4f07-8847-318571daf7b5"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:23.594469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f712ad04-618a-426f-842a-cc693e7ca40c req-3b4db29b-e1b7-4414-a7bd-0d63a74f2ac1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:23.596168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f712ad04-618a-426f-842a-cc693e7ca40c req-3b4db29b-e1b7-4414-a7bd-0d63a74f2ac1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:23.597434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f712ad04-618a-426f-842a-cc693e7ca40c req-3b4db29b-e1b7-4414-a7bd-0d63a74f2ac1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:23.636774 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f712ad04-618a-426f-842a-cc693e7ca40c req-3b4db29b-e1b7-4414-a7bd-0d63a74f2ac1 service nova] Creating event network-vif-plugged:177ae402-c6ae-4f07-8847-318571daf7b5 for instance 3247ce04-df54-4bd8-a1e9-00a29d975b62 on n-h1-853611-3 Aug 18 11:26:23.653307 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f712ad04-618a-426f-842a-cc693e7ca40c req-3b4db29b-e1b7-4414-a7bd-0d63a74f2ac1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108242 Aug 18 11:26:23.656636 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 185/426] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:23.671157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b6a20bfb-ea28-462e-958c-26f485053324 tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] Calling method '.version_select at 0x7f51ac245670>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:23.784024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-b6a20bfb-ea28-462e-958c-26f485053324 tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 551cdfdc-b8de-4a2c-8d85-b90aa514963e could not be found", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:26:23.785091 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-b6a20bfb-ea28-462e-958c-26f485053324 tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] HTTP exception thrown: Floating IP not found for ID 551cdfdc-b8de-4a2c-8d85-b90aa514963e Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b6a20bfb-ea28-462e-958c-26f485053324 tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] Request method failure captured: Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-floating-ips/551cdfdc-b8de-4a2c-8d85-b90aa514963e HTTP/1.1 Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iHOMLAFc5hcviSFu8HSFlnn0qcgNhXHHSwii9K0o8YyhKCNdBuliTNhPe33G-XJiLWN-pPtG_SrbWs9kAD7WC2as8_oEmZqGyEs4h7sjCV0hT37r_uyxyRfhthwZymEEaiWSOmhud7FGJr9CktiPp2TwBNukKp7WlScLyHI0qfAcK0 Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: cde89a1d402f4e0ab5cd97bd8583cece Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FloatingIPsTestJSON-1692269738 Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:26:23.797123 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:26:23.798378 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cde89a1d402f4e0ab5cd97bd8583cece"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cde89a1d402f4e0ab5cd97bd8583cece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cde89a1d402f4e0ab5cd97bd8583cece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cde89a1d402f4e0ab5cd97bd8583cece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:23.798378 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FloatingIPsTestJSON-1692269738 Aug 18 11:26:23.798378 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: cde89a1d402f4e0ab5cd97bd8583cece Aug 18 11:26:23.798378 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1692269738 Aug 18 11:26:23.798378 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FloatingIPsTestJSON-1692269738-project Aug 18 11:26:23.798378 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:23.798378 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:23.798378 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c0fa60f899b044e884ba4ec7d90b3b7a Aug 18 11:26:23.798378 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FloatingIPsTestJSON-1692269738-project Aug 18 11:26:23.798378 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:26:23.798378 n-d-853611-3 devstack@n-api.service[122210]: exception: Floating IP not found for ID 551cdfdc-b8de-4a2c-8d85-b90aa514963e Aug 18 11:26:23.798378 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '551cdfdc-b8de-4a2c-8d85-b90aa514963e'} Aug 18 11:26:23.798378 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:26:23.799196 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 551cdfdc-b8de-4a2c-8d85-b90aa514963e could not be found Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df26ae60-f6eb-46f4-8c04-c288f1aa9860'] Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 551cdfdc-b8de-4a2c-8d85-b90aa514963e. Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:23.800226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 551cdfdc-b8de-4a2c-8d85-b90aa514963e Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:23.803820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:23.807499 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 551cdfdc-b8de-4a2c-8d85-b90aa514963e Aug 18 11:26:23.807499 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:23.807499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b6a20bfb-ea28-462e-958c-26f485053324 tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] Returning 404 to user: Floating IP not found for ID 551cdfdc-b8de-4a2c-8d85-b90aa514963e {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:23.807499 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b6a20bfb-ea28-462e-958c-26f485053324 tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] 10.222.0.73 "GET /compute/v2.1/os-floating-ips/551cdfdc-b8de-4a2c-8d85-b90aa514963e" status: 404 len: 111 microversion: 2.1 time: 0.139729 Aug 18 11:26:23.807499 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 186/427] 10.222.0.73 () {58 vars in 1260 bytes} [Thu Aug 18 11:26:23 2022] GET /compute/v2.1/os-floating-ips/551cdfdc-b8de-4a2c-8d85-b90aa514963e => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:23.813409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e9d3885b-0271-4d88-bf2c-82b7907b243a tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] Calling method '.version_select at 0x7f51ac148550>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:23.927746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-e9d3885b-0271-4d88-bf2c-82b7907b243a tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 551cdfdc-b8de-4a2c-8d85-b90aa514963e could not be found", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:26:23.928554 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-e9d3885b-0271-4d88-bf2c-82b7907b243a tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] HTTP exception thrown: Floating IP not found for ID 551cdfdc-b8de-4a2c-8d85-b90aa514963e Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e9d3885b-0271-4d88-bf2c-82b7907b243a tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] Request method failure captured: Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/os-floating-ips/551cdfdc-b8de-4a2c-8d85-b90aa514963e HTTP/1.1 Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iHOMLAFc5hcviSFu8HSFlnn0qcgNhXHHSwii9K0o8YyhKCNdBuliTNhPe33G-XJiLWN-pPtG_SrbWs9kAD7WC2as8_oEmZqGyEs4h7sjCV0hT37r_uyxyRfhthwZymEEaiWSOmhud7FGJr9CktiPp2TwBNukKp7WlScLyHI0qfAcK0 Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: cde89a1d402f4e0ab5cd97bd8583cece Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FloatingIPsTestJSON-1692269738 Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:26:23.931910 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:26:23.933319 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cde89a1d402f4e0ab5cd97bd8583cece"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cde89a1d402f4e0ab5cd97bd8583cece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cde89a1d402f4e0ab5cd97bd8583cece"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cde89a1d402f4e0ab5cd97bd8583cece"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:23.933319 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FloatingIPsTestJSON-1692269738 Aug 18 11:26:23.933319 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: cde89a1d402f4e0ab5cd97bd8583cece Aug 18 11:26:23.933319 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1692269738 Aug 18 11:26:23.933319 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FloatingIPsTestJSON-1692269738-project Aug 18 11:26:23.933319 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:23.933319 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:23.933319 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c0fa60f899b044e884ba4ec7d90b3b7a Aug 18 11:26:23.933319 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FloatingIPsTestJSON-1692269738-project Aug 18 11:26:23.933319 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:26:23.933319 n-d-853611-3 devstack@n-api.service[122210]: exception: Floating IP not found for ID 551cdfdc-b8de-4a2c-8d85-b90aa514963e Aug 18 11:26:23.933319 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '551cdfdc-b8de-4a2c-8d85-b90aa514963e'} Aug 18 11:26:23.933319 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:26:23.934129 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 551cdfdc-b8de-4a2c-8d85-b90aa514963e could not be found Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bfeb5397-c839-4a59-9438-ebfcc0cdc96d'] Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 551cdfdc-b8de-4a2c-8d85-b90aa514963e. Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:23.935315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 551cdfdc-b8de-4a2c-8d85-b90aa514963e Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:23.936583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:23.938450 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 551cdfdc-b8de-4a2c-8d85-b90aa514963e Aug 18 11:26:23.938450 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:23.938450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e9d3885b-0271-4d88-bf2c-82b7907b243a tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] Returning 404 to user: Floating IP not found for ID 551cdfdc-b8de-4a2c-8d85-b90aa514963e {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:23.942070 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e9d3885b-0271-4d88-bf2c-82b7907b243a tempest-FloatingIPsTestJSON-1692269738 tempest-FloatingIPsTestJSON-1692269738-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/551cdfdc-b8de-4a2c-8d85-b90aa514963e" status: 404 len: 111 microversion: 2.1 time: 0.134825 Aug 18 11:26:23.943074 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 187/428] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:26:23 2022] DELETE /compute/v2.1/os-floating-ips/551cdfdc-b8de-4a2c-8d85-b90aa514963e => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:23.952228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0a833c0b-0b2d-465d-ad2d-5fabdc05c73a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:23.960072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0a833c0b-0b2d-465d-ad2d-5fabdc05c73a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:23.969310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a833c0b-0b2d-465d-ad2d-5fabdc05c73a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:23.970180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a833c0b-0b2d-465d-ad2d-5fabdc05c73a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:23.970994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a833c0b-0b2d-465d-ad2d-5fabdc05c73a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:23.971931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a833c0b-0b2d-465d-ad2d-5fabdc05c73a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:23.972597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a833c0b-0b2d-465d-ad2d-5fabdc05c73a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:23.973856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a833c0b-0b2d-465d-ad2d-5fabdc05c73a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:24.184377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c25119de-a981-47d4-bce9-621931988e18 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:24.197166 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c25119de-a981-47d4-bce9-621931988e18 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1316 microversion: 2.1 time: 1.257410 Aug 18 11:26:24.200007 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 242/429] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:22 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1316 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:24.484781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0a833c0b-0b2d-465d-ad2d-5fabdc05c73a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:24.501306 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0a833c0b-0b2d-465d-ad2d-5fabdc05c73a tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1319 microversion: 2.1 time: 0.556799 Aug 18 11:26:24.507335 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 188/430] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:23 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:24.645576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3e8011e6-c722-44a3-b670-d53eadb4f35b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:24.646723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3e8011e6-c722-44a3-b670-d53eadb4f35b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:24.671932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e8011e6-c722-44a3-b670-d53eadb4f35b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:24.685828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e8011e6-c722-44a3-b670-d53eadb4f35b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:24.686310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e8011e6-c722-44a3-b670-d53eadb4f35b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:24.690351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e8011e6-c722-44a3-b670-d53eadb4f35b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:24.690869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e8011e6-c722-44a3-b670-d53eadb4f35b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:24.698915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e8011e6-c722-44a3-b670-d53eadb4f35b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:24.768918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3e8011e6-c722-44a3-b670-d53eadb4f35b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:26:25.018361 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3e8011e6-c722-44a3-b670-d53eadb4f35b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "DELETE /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 204 len: 0 microversion: 2.1 time: 0.373073 Aug 18 11:26:25.020177 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 243/431] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:26:24 2022] DELETE /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:26:25.233765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc9915aa-8880-468c-ad03-8e24ac95a20d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:25.234985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dc9915aa-8880-468c-ad03-8e24ac95a20d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:25.248618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc9915aa-8880-468c-ad03-8e24ac95a20d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:25.249440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc9915aa-8880-468c-ad03-8e24ac95a20d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:25.251106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc9915aa-8880-468c-ad03-8e24ac95a20d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:25.252002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc9915aa-8880-468c-ad03-8e24ac95a20d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:25.252606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc9915aa-8880-468c-ad03-8e24ac95a20d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:25.253177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc9915aa-8880-468c-ad03-8e24ac95a20d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:25.285321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1011275208", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "482198356", "adminPass": "***", "networks": [{"uuid": "0a2a7a12-5844-4901-b419-1481340e7ff7"}], "security_groups": [{"name": "tempest-securitygroup--1501895346"}], "key_name": "tempest-keypair-404870432", "user_data": "}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:25.966097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dc9915aa-8880-468c-ad03-8e24ac95a20d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:25.984696 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dc9915aa-8880-468c-ad03-8e24ac95a20d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1316 microversion: 2.1 time: 0.763230 Aug 18 11:26:25.988820 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 189/432] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:25 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1316 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:25.998723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-65578cb3-4514-4f02-a525-f4e0ad922a99 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:26.000783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-65578cb3-4514-4f02-a525-f4e0ad922a99 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:26.011739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] validate_networks() for [('0a2a7a12-5844-4901-b419-1481340e7ff7', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:26:26.022882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65578cb3-4514-4f02-a525-f4e0ad922a99 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:26.023629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65578cb3-4514-4f02-a525-f4e0ad922a99 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:26.024354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65578cb3-4514-4f02-a525-f4e0ad922a99 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:26.026352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65578cb3-4514-4f02-a525-f4e0ad922a99 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:26.027044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65578cb3-4514-4f02-a525-f4e0ad922a99 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:26.027764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65578cb3-4514-4f02-a525-f4e0ad922a99 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:26.615054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-65578cb3-4514-4f02-a525-f4e0ad922a99 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:26.626846 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-65578cb3-4514-4f02-a525-f4e0ad922a99 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1319 microversion: 2.1 time: 0.635622 Aug 18 11:26:26.631583 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 190/433] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:25 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1319 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:26.647870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-93224139-8056-47a9-9309-3bfccaff8c4f req-b5e63549-3c51-4f04-9688-370ff6e3e488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4373a5-07b8-4549-83a9-f38b2fd0369c", "name": "network-vif-plugged", "status": "completed", "tag": "101a2266-a8f2-44e2-bd99-3b422d800824"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:26.678423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-93224139-8056-47a9-9309-3bfccaff8c4f req-b5e63549-3c51-4f04-9688-370ff6e3e488 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:26.689769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-93224139-8056-47a9-9309-3bfccaff8c4f req-b5e63549-3c51-4f04-9688-370ff6e3e488 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:26.690486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-93224139-8056-47a9-9309-3bfccaff8c4f req-b5e63549-3c51-4f04-9688-370ff6e3e488 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:26.732247 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-93224139-8056-47a9-9309-3bfccaff8c4f req-b5e63549-3c51-4f04-9688-370ff6e3e488 service nova] Creating event network-vif-plugged:101a2266-a8f2-44e2-bd99-3b422d800824 for instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c on n-h2-853611-3 Aug 18 11:26:26.779717 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-93224139-8056-47a9-9309-3bfccaff8c4f req-b5e63549-3c51-4f04-9688-370ff6e3e488 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146297 Aug 18 11:26:26.780256 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 191/434] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:27.009909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7a03e414-0fa0-44bf-a48e-3fd5e2337ed5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:27.010714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7a03e414-0fa0-44bf-a48e-3fd5e2337ed5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:27.026323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a03e414-0fa0-44bf-a48e-3fd5e2337ed5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:27.026812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a03e414-0fa0-44bf-a48e-3fd5e2337ed5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:27.027447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a03e414-0fa0-44bf-a48e-3fd5e2337ed5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:27.028109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a03e414-0fa0-44bf-a48e-3fd5e2337ed5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:27.028575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a03e414-0fa0-44bf-a48e-3fd5e2337ed5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:27.029011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a03e414-0fa0-44bf-a48e-3fd5e2337ed5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:27.478104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7a03e414-0fa0-44bf-a48e-3fd5e2337ed5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:27.498386 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7a03e414-0fa0-44bf-a48e-3fd5e2337ed5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1466 microversion: 2.1 time: 0.494055 Aug 18 11:26:27.507144 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 192/435] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:27 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1466 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:26:28.005888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c325ad67-d8a9-44cb-be2f-34a931dd41d9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:28.006604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c325ad67-d8a9-44cb-be2f-34a931dd41d9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:28.015446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c325ad67-d8a9-44cb-be2f-34a931dd41d9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:28.015939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c325ad67-d8a9-44cb-be2f-34a931dd41d9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:28.019694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c325ad67-d8a9-44cb-be2f-34a931dd41d9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:28.020813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c325ad67-d8a9-44cb-be2f-34a931dd41d9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:28.021537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c325ad67-d8a9-44cb-be2f-34a931dd41d9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:28.022193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c325ad67-d8a9-44cb-be2f-34a931dd41d9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:28.768739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:26:28.769313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:26:28.769865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:26:28.770387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:26:28.771010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:26:28.791535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:28.792361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:28.799284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:28.800131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:28.800615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:28.801050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:28.819763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:28.870341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Getting quotas for project f4ef9f21efdd4ce1a61a905fec4ea89d. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:26:28.889051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Getting quotas for user d2cb8f009ae94e7199fd7153c87b099c and project f4ef9f21efdd4ce1a61a905fec4ea89d. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:26:28.913172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:26:28.938729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:26:29.047189 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c325ad67-d8a9-44cb-be2f-34a931dd41d9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1617 microversion: 2.1 time: 1.517269 Aug 18 11:26:29.051306 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 193/436] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:27 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1617 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:26:29.057997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0d0aa01-2120-4934-bf58-04334b22d667 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:29.063169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a0d0aa01-2120-4934-bf58-04334b22d667 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:29.082591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0d0aa01-2120-4934-bf58-04334b22d667 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:29.083423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0d0aa01-2120-4934-bf58-04334b22d667 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:29.084094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0d0aa01-2120-4934-bf58-04334b22d667 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:29.085313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0d0aa01-2120-4934-bf58-04334b22d667 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:29.085983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0d0aa01-2120-4934-bf58-04334b22d667 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:29.086820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0d0aa01-2120-4934-bf58-04334b22d667 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:29.153648 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6b4f0a7b-a6dc-44c1-9623-a67c75c1c274 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.873565 Aug 18 11:26:29.155517 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 244/437] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:26:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 3876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:26:29.167261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-68ca84f7-c204-4932-873f-e28fd6bddfb9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Action: 'create', calling method: .version_select at 0x7f51ac17c670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1999502664", "policies": ["affinity"]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:29.206875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-68ca84f7-c204-4932-873f-e28fd6bddfb9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:26:29.219668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-68ca84f7-c204-4932-873f-e28fd6bddfb9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:26:29.328033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:29.338389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-68ca84f7-c204-4932-873f-e28fd6bddfb9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:26:29.351190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-68ca84f7-c204-4932-873f-e28fd6bddfb9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:26:29.384715 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-68ca84f7-c204-4932-873f-e28fd6bddfb9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.226501 Aug 18 11:26:29.390122 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 245/438] 10.222.0.73 () {60 vars in 1174 bytes} [Thu Aug 18 11:26:29 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:29.399449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-acfc2843-87e4-461e-b6c1-17cf13d39494 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:29.400357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-acfc2843-87e4-461e-b6c1-17cf13d39494 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:30.100480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a0d0aa01-2120-4934-bf58-04334b22d667 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:30.174406 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a0d0aa01-2120-4934-bf58-04334b22d667 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1319 microversion: 2.1 time: 1.121572 Aug 18 11:26:30.202233 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 194/439] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:29 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1319 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:30.207656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1022819862", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "6932f290-c006-4781-8999-df22645b6c54"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:30.354847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:26:31.287600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-acfc2843-87e4-461e-b6c1-17cf13d39494 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:31.303015 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-acfc2843-87e4-461e-b6c1-17cf13d39494 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1262 microversion: 2.1 time: 1.908717 Aug 18 11:26:31.305251 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 246/440] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:29 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1262 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:31.320264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bd2b4ee2-f40d-49ab-83d7-9a7e82a40ff5 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:31.323904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bd2b4ee2-f40d-49ab-83d7-9a7e82a40ff5 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:31.348124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd2b4ee2-f40d-49ab-83d7-9a7e82a40ff5 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:31.350738 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd2b4ee2-f40d-49ab-83d7-9a7e82a40ff5 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:31.355636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd2b4ee2-f40d-49ab-83d7-9a7e82a40ff5 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:31.358613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd2b4ee2-f40d-49ab-83d7-9a7e82a40ff5 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:31.359883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd2b4ee2-f40d-49ab-83d7-9a7e82a40ff5 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:31.361333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd2b4ee2-f40d-49ab-83d7-9a7e82a40ff5 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:32.350466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:26:32.350961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:26:32.351342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:26:32.356509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:26:32.357043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:26:32.453888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:32.454391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:32.454883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:32.455741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:32.456200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:32.456627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:32.483110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:26:32.489182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:26:32.503418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Going to run 2 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:26:32.506522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: ea19ffc1-f486-4260-8188-6211809c953d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:26:32.557728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122210) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 18 11:26:32.601558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:26:32.625983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:26:32.783352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:26:32.792511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:26:32.818252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=ea19ffc1-f486-4260-8188-6211809c953d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:26:32.928496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:26:32.935673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:26:32.985508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bd2b4ee2-f40d-49ab-83d7-9a7e82a40ff5 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:32.998911 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bd2b4ee2-f40d-49ab-83d7-9a7e82a40ff5 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1469 microversion: 2.1 time: 1.691890 Aug 18 11:26:33.000116 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 247/441] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:31 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1469 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:33.035571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-244cadae-f172-4887-8c85-aa9bc668570b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:33.036172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-244cadae-f172-4887-8c85-aa9bc668570b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:33.039781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:26:33.051605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:33.056776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:26:33.064752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-244cadae-f172-4887-8c85-aa9bc668570b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:33.065245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-244cadae-f172-4887-8c85-aa9bc668570b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:33.065683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-244cadae-f172-4887-8c85-aa9bc668570b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:33.066390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-244cadae-f172-4887-8c85-aa9bc668570b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:33.076366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-244cadae-f172-4887-8c85-aa9bc668570b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:33.076827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-244cadae-f172-4887-8c85-aa9bc668570b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:33.193908 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a62ad991-67f8-482f-b9a5-77b81ae65f26 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.990051 Aug 18 11:26:33.194755 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 195/442] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:26:30 2022] POST /compute/v2.1/servers => generated 32 bytes in 2991 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 18 11:26:33.212026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0f805e7c-7fb2-4e4b-a3da-f667565d1bfe tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:33.212671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0f805e7c-7fb2-4e4b-a3da-f667565d1bfe tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:33.245131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f805e7c-7fb2-4e4b-a3da-f667565d1bfe tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:33.245648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f805e7c-7fb2-4e4b-a3da-f667565d1bfe tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:33.246095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f805e7c-7fb2-4e4b-a3da-f667565d1bfe tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:33.250524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f805e7c-7fb2-4e4b-a3da-f667565d1bfe tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:33.250524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f805e7c-7fb2-4e4b-a3da-f667565d1bfe tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:33.254600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f805e7c-7fb2-4e4b-a3da-f667565d1bfe tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:33.332021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-0f805e7c-7fb2-4e4b-a3da-f667565d1bfe tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lazy-loading 'flavor' on Instance uuid 9c4373a5-07b8-4549-83a9-f38b2fd0369c {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:26:33.428920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-244cadae-f172-4887-8c85-aa9bc668570b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:33.443692 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-244cadae-f172-4887-8c85-aa9bc668570b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1320 microversion: 2.1 time: 0.421229 Aug 18 11:26:33.454054 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 248/443] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:33 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1320 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:33.471604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bd88a052-b080-44a1-8ac5-2ead0f0359fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:33.479252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bd88a052-b080-44a1-8ac5-2ead0f0359fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:33.480040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bd88a052-b080-44a1-8ac5-2ead0f0359fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Searching by: {'deleted': False, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:26:33.545726 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0f805e7c-7fb2-4e4b-a3da-f667565d1bfe tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c/action" status: 202 len: 0 microversion: 2.1 time: 0.348404 Aug 18 11:26:33.566061 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 196/444] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:26:33 2022] POST /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:26:33.571331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd88a052-b080-44a1-8ac5-2ead0f0359fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:33.571841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd88a052-b080-44a1-8ac5-2ead0f0359fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:33.572285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd88a052-b080-44a1-8ac5-2ead0f0359fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:33.573023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd88a052-b080-44a1-8ac5-2ead0f0359fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:33.573487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd88a052-b080-44a1-8ac5-2ead0f0359fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:33.573934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd88a052-b080-44a1-8ac5-2ead0f0359fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:33.858543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-bd88a052-b080-44a1-8ac5-2ead0f0359fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:26:34.189071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9fc8d4d7-c6a6-4001-8846-49493c545a6a tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-327017683", "id": 1842969580, "os-flavor-access:is_public": "False"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:34.192426 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:34.192426 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:34.267875 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9fc8d4d7-c6a6-4001-8846-49493c545a6a tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.691763 Aug 18 11:26:34.268491 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 197/445] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:26:33 2022] POST /compute/v2.1/flavors => generated 438 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:34.272193 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bd88a052-b080-44a1-8ac5-2ead0f0359fe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.821421 Aug 18 11:26:34.281652 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 249/446] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 18 11:26:33 2022] GET /compute/v2.1/servers => generated 1003 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:34.302769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-b78a0020-3d8a-406d-ab5d-213fb4133c38 req-eaec0c4e-6f8b-43b5-bed3-46317843fd06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22337998-2a5d-4fdc-a5f7-6d1067a13c9c", "name": "network-vif-deleted", "tag": "ba49d06a-552b-4db3-9851-132789c232c7"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:34.312871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c3346edd-2424-4ac3-9ad1-73d2ff93e049 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:34.313715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c3346edd-2424-4ac3-9ad1-73d2ff93e049 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:34.355242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3346edd-2424-4ac3-9ad1-73d2ff93e049 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:34.355750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3346edd-2424-4ac3-9ad1-73d2ff93e049 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:34.374054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3346edd-2424-4ac3-9ad1-73d2ff93e049 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:34.374965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3346edd-2424-4ac3-9ad1-73d2ff93e049 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:34.375477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3346edd-2424-4ac3-9ad1-73d2ff93e049 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:34.375884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3346edd-2424-4ac3-9ad1-73d2ff93e049 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:34.382464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b78a0020-3d8a-406d-ab5d-213fb4133c38 req-eaec0c4e-6f8b-43b5-bed3-46317843fd06 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:34.384017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b78a0020-3d8a-406d-ab5d-213fb4133c38 req-eaec0c4e-6f8b-43b5-bed3-46317843fd06 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:34.384463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b78a0020-3d8a-406d-ab5d-213fb4133c38 req-eaec0c4e-6f8b-43b5-bed3-46317843fd06 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:34.440566 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-b78a0020-3d8a-406d-ab5d-213fb4133c38 req-eaec0c4e-6f8b-43b5-bed3-46317843fd06 service nova] Creating event network-vif-deleted:ba49d06a-552b-4db3-9851-132789c232c7 for instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c on n-h1-853611-3 Aug 18 11:26:34.488307 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-b78a0020-3d8a-406d-ab5d-213fb4133c38 req-eaec0c4e-6f8b-43b5-bed3-46317843fd06 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183237 Aug 18 11:26:34.493139 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 250/447] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:34.507944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-de1c1c81-ebe9-40e8-b731-917bc3beccb3 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f6ebb1ff5e87429292b48f541409e317"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:34.517469 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:34.517469 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:34.692625 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-de1c1c81-ebe9-40e8-b731-917bc3beccb3 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors/1842969580/action" status: 200 len: 97 microversion: 2.1 time: 0.198113 Aug 18 11:26:34.694075 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 251/448] 10.222.0.73 () {60 vars in 1200 bytes} [Thu Aug 18 11:26:34 2022] POST /compute/v2.1/flavors/1842969580/action => generated 97 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:26:34.700966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2b9b6771-6eca-4a8e-a985-ccdc613d0daf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:34.702017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2b9b6771-6eca-4a8e-a985-ccdc613d0daf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:34.945699 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2b9b6771-6eca-4a8e-a985-ccdc613d0daf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:34.973244 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2b9b6771-6eca-4a8e-a985-ccdc613d0daf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1219 microversion: 2.1 time: 0.273941 Aug 18 11:26:34.975853 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 252/449] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:34 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1219 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:34.993204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7596deb9-a25c-4fa3-8476-d3942ffb2b6f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:34.995212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7596deb9-a25c-4fa3-8476-d3942ffb2b6f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:35.006636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7596deb9-a25c-4fa3-8476-d3942ffb2b6f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:35.007362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7596deb9-a25c-4fa3-8476-d3942ffb2b6f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:35.009619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7596deb9-a25c-4fa3-8476-d3942ffb2b6f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:35.010746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7596deb9-a25c-4fa3-8476-d3942ffb2b6f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:35.011497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7596deb9-a25c-4fa3-8476-d3942ffb2b6f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:35.012510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7596deb9-a25c-4fa3-8476-d3942ffb2b6f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:35.221452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c3346edd-2424-4ac3-9ad1-73d2ff93e049 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:35.231454 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c3346edd-2424-4ac3-9ad1-73d2ff93e049 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1460 microversion: 2.1 time: 0.945149 Aug 18 11:26:35.232041 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 198/450] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:34 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1460 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:35.255363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f856a79-ca2a-41fd-9ec5-6a20389ed4cf tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f6ebb1ff5e87429292b48f541409e317"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:35.263911 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:35.263911 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:35.401266 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-7f856a79-ca2a-41fd-9ec5-6a20389ed4cf tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] HTTP exception thrown: Flavor access already exists for flavor 35 and project f6ebb1ff5e87429292b48f541409e317 combination. Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f856a79-ca2a-41fd-9ec5-6a20389ed4cf tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Request method failure captured: Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/flavors/1842969580/action HTTP/1.1 Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 67 Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iHomArOnj-M810qvwfa70a5ZN8MaMj71_NKjBMGZNTlZMMEJYhhGmachudbE9-AbU5dEZmKf_eNaJ0scsZc7Fr3h1nHjvP61u5kRj6ID8tCfjSylWM9vXfD_kGR_HKTiezA33d-rrMwb2J881ooyyPwjAYIEIWyZ6szKdMvDseIvYY Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 61270ee827184644ab2fbae9bb1ce143 Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1136461800 Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:26:35.430010 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:26:35.431695 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/61270ee827184644ab2fbae9bb1ce143"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/61270ee827184644ab2fbae9bb1ce143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_61270ee827184644ab2fbae9bb1ce143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/61270ee827184644ab2fbae9bb1ce143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:35.431695 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1136461800 Aug 18 11:26:35.431695 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 61270ee827184644ab2fbae9bb1ce143 Aug 18 11:26:35.431695 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1136461800 Aug 18 11:26:35.431695 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin Aug 18 11:26:35.431695 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:35.431695 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:35.431695 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e689e432b05f41e6ac9df9715346a5c0 Aug 18 11:26:35.431695 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin Aug 18 11:26:35.431695 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:26:35.431695 n-d-853611-3 devstack@n-api.service[122210]: {"addTenantAccess": {"tenant": "f6ebb1ff5e87429292b48f541409e317"}} Aug 18 11:26:35.431695 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: exception: Flavor access already exists for flavor 35 and project f6ebb1ff5e87429292b48f541409e317 combination. Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '1842969580', 'body': {'addTenantAccess': {'tenant': 'f6ebb1ff5e87429292b48f541409e317'}}} Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result.read() Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 11:26:35.432544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '35-f6ebb1ff5e87429292b48f541409e317' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi session.flush() Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 11:26:35.433869 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 11:26:35.435260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 11:26:35.436489 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result.read() Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '35-f6ebb1ff5e87429292b48f541409e317' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 18, 11, 26, 35, 392566), 'updated_at': None, 'flavor_id': 35, 'project_id': 'f6ebb1ff5e87429292b48f541409e317'}] Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:35.437781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 35 and project f6ebb1ff5e87429292b48f541409e317 combination. Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:35.440245 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 35 and project f6ebb1ff5e87429292b48f541409e317 combination. Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:35.441698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:35.443227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 35 and project f6ebb1ff5e87429292b48f541409e317 combination. Aug 18 11:26:35.443227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:35.443227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f856a79-ca2a-41fd-9ec5-6a20389ed4cf tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Returning 409 to user: Flavor access already exists for flavor 35 and project f6ebb1ff5e87429292b48f541409e317 combination. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:35.446960 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7f856a79-ca2a-41fd-9ec5-6a20389ed4cf tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors/1842969580/action" status: 409 len: 152 microversion: 2.1 time: 0.200216 Aug 18 11:26:35.448119 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 199/451] 10.222.0.73 () {60 vars in 1200 bytes} [Thu Aug 18 11:26:35 2022] POST /compute/v2.1/flavors/1842969580/action => generated 152 bytes in 208 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:26:35.455518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-edcc297b-dac1-4832-b27b-4ef232b15e6f tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:35.456431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-edcc297b-dac1-4832-b27b-4ef232b15e6f tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:35.475401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-edcc297b-dac1-4832-b27b-4ef232b15e6f tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:35.476075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-edcc297b-dac1-4832-b27b-4ef232b15e6f tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:35.487022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-edcc297b-dac1-4832-b27b-4ef232b15e6f tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:35.490935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-edcc297b-dac1-4832-b27b-4ef232b15e6f tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:35.492994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-edcc297b-dac1-4832-b27b-4ef232b15e6f tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:35.493737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-edcc297b-dac1-4832-b27b-4ef232b15e6f tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:35.501110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:35.660964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7596deb9-a25c-4fa3-8476-d3942ffb2b6f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:35.677603 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7596deb9-a25c-4fa3-8476-d3942ffb2b6f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1320 microversion: 2.1 time: 0.695504 Aug 18 11:26:35.681382 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 253/452] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:34 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1320 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:35.691293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e16ac612-b336-4343-bae0-4bd2eab6b575 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f6ebb1ff5e87429292b48f541409e317"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:35.703427 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:35.703427 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:35.905179 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e16ac612-b336-4343-bae0-4bd2eab6b575 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors/1842969580/action" status: 200 len: 21 microversion: 2.1 time: 0.222452 Aug 18 11:26:35.906064 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 254/453] 10.222.0.73 () {60 vars in 1200 bytes} [Thu Aug 18 11:26:35 2022] POST /compute/v2.1/flavors/1842969580/action => generated 21 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:26:35.917633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-39d24186-2c96-429c-a82b-8b210d79906e tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:35.918696 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:35.918696 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:35.940451 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-39d24186-2c96-429c-a82b-8b210d79906e tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/1842969580" status: 202 len: 0 microversion: 2.1 time: 0.027468 Aug 18 11:26:35.946614 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 255/454] 10.222.0.73 () {58 vars in 1161 bytes} [Thu Aug 18 11:26:35 2022] DELETE /compute/v2.1/flavors/1842969580 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:26:35.953527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fe33a678-9bd5-4c08-ad0a-a8804efc30d5 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:35.984198 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fe33a678-9bd5-4c08-ad0a-a8804efc30d5 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.035954 Aug 18 11:26:36.005840 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 256/455] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:26:35 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:36.013321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5d1e8085-b363-4808-be18-0e78b05b6acd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:36.014300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5d1e8085-b363-4808-be18-0e78b05b6acd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:36.022976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d1e8085-b363-4808-be18-0e78b05b6acd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:36.023808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d1e8085-b363-4808-be18-0e78b05b6acd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:36.024480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d1e8085-b363-4808-be18-0e78b05b6acd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:36.026919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d1e8085-b363-4808-be18-0e78b05b6acd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:36.027630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d1e8085-b363-4808-be18-0e78b05b6acd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:36.028991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d1e8085-b363-4808-be18-0e78b05b6acd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:36.266401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5d1e8085-b363-4808-be18-0e78b05b6acd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:36.290713 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5d1e8085-b363-4808-be18-0e78b05b6acd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1271 microversion: 2.1 time: 0.282742 Aug 18 11:26:36.291810 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 257/456] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:36 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1271 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:36.301666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bbe0e52e-9feb-4db0-8b55-bf8ced161252 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-28895090", "id": 805670769, "os-flavor-access:is_public": "True"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:36.313765 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:36.313765 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:36.350159 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bbe0e52e-9feb-4db0-8b55-bf8ced161252 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.057237 Aug 18 11:26:36.354517 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 258/457] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:26:36 2022] POST /compute/v2.1/flavors => generated 433 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:36.375638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5d14d335-4cf3-4c7b-8e72-a54c65decaf9 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:36.376552 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:36.376552 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:36.391822 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-5d14d335-4cf3-4c7b-8e72-a54c65decaf9 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5d14d335-4cf3-4c7b-8e72-a54c65decaf9 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Request method failure captured: Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/flavors/805670769/os-flavor-access HTTP/1.1 Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iHomArOnj-M810qvwfa70a5ZN8MaMj71_NKjBMGZNTlZMMEJYhhGmachudbE9-AbU5dEZmKf_eNaJ0scsZc7Fr3h1nHjvP61u5kRj6ID8tCfjSylWM9vXfD_kGR_HKTiezA33d-rrMwb2J881ooyyPwjAYIEIWyZ6szKdMvDseIvYY Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 61270ee827184644ab2fbae9bb1ce143 Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1136461800 Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:26:36.397426 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:26:36.399878 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/61270ee827184644ab2fbae9bb1ce143"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/61270ee827184644ab2fbae9bb1ce143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_61270ee827184644ab2fbae9bb1ce143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/61270ee827184644ab2fbae9bb1ce143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:36.399878 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1136461800 Aug 18 11:26:36.399878 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 61270ee827184644ab2fbae9bb1ce143 Aug 18 11:26:36.399878 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1136461800 Aug 18 11:26:36.399878 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin Aug 18 11:26:36.399878 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:36.399878 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:36.399878 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e689e432b05f41e6ac9df9715346a5c0 Aug 18 11:26:36.399878 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin Aug 18 11:26:36.399878 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:26:36.399878 n-d-853611-3 devstack@n-api.service[122209]: exception: Access list not available for public flavors. Aug 18 11:26:36.399878 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'flavor_id': '805670769'} Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 18 11:26:36.400752 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:36.402152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5d14d335-4cf3-4c7b-8e72-a54c65decaf9 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:36.403346 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5d14d335-4cf3-4c7b-8e72-a54c65decaf9 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/805670769/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.038580 Aug 18 11:26:36.407077 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 259/458] 10.222.0.73 () {58 vars in 1206 bytes} [Thu Aug 18 11:26:36 2022] GET /compute/v2.1/flavors/805670769/os-flavor-access => generated 91 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 18 11:26:36.414207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-52f3efc0-f275-451f-a977-2306db8443a3 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:36.425552 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:36.425552 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:36.484615 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-52f3efc0-f275-451f-a977-2306db8443a3 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/805670769" status: 202 len: 0 microversion: 2.1 time: 0.074229 Aug 18 11:26:36.485660 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 260/459] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:26:36 2022] DELETE /compute/v2.1/flavors/805670769 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:26:36.493787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-80adf15d-39b1-4a89-9663-745b59e634ce tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:36.574368 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-80adf15d-39b1-4a89-9663-745b59e634ce tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.084510 Aug 18 11:26:36.590314 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 261/460] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:26:36 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:26:36.600326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4e7ce48f-17f2-436b-9fea-d3c2216a9622 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1524430086", "id": 833728909, "os-flavor-access:is_public": "False"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:36.638643 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4e7ce48f-17f2-436b-9fea-d3c2216a9622 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.042300 Aug 18 11:26:36.645779 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 262/461] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:26:36 2022] POST /compute/v2.1/flavors => generated 436 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:36.914621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b8d1f1c-b95f-44d3-addc-e8f8a5b4a2aa tempest-FlavorsAccessNegativeTestJSON-507927629 tempest-FlavorsAccessNegativeTestJSON-507927629-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f6ebb1ff5e87429292b48f541409e317"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:36.917506 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:36.917506 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:36.918709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5b8d1f1c-b95f-44d3-addc-e8f8a5b4a2aa tempest-FlavorsAccessNegativeTestJSON-507927629 tempest-FlavorsAccessNegativeTestJSON-507927629-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '1f2d95e9b07b425295d7182bae2a62d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebb1ff5e87429292b48f541409e317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b8d1f1c-b95f-44d3-addc-e8f8a5b4a2aa tempest-FlavorsAccessNegativeTestJSON-507927629 tempest-FlavorsAccessNegativeTestJSON-507927629-project] Request method failure captured: Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/flavors/833728909/action HTTP/1.1 Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 67 Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iHmDVfcpMjDuPBmVyAQjTuga-GKWurtJTkDeV3h3bfENwCU1eo833Kd5FaJM-gfv1QRHqYQ7F2-ZASC_Rlc-ZOnEHsqr-i3B0y0oy8ws2xusNvQol7PJqJBjMCgkjJYapfP3lxszD-bkCyVMO_GszStiff5q3lGigFV1IK9TShK6vk Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: f6ebb1ff5e87429292b48f541409e317 Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-507927629 Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:26:36.920317 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:26:36.921788 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f6ebb1ff5e87429292b48f541409e317"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f6ebb1ff5e87429292b48f541409e317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f6ebb1ff5e87429292b48f541409e317"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f6ebb1ff5e87429292b48f541409e317"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:36.921788 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-507927629 Aug 18 11:26:36.921788 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: f6ebb1ff5e87429292b48f541409e317 Aug 18 11:26:36.921788 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-507927629 Aug 18 11:26:36.921788 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-FlavorsAccessNegativeTestJSON-507927629-project Aug 18 11:26:36.921788 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:36.921788 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:36.921788 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1f2d95e9b07b425295d7182bae2a62d9 Aug 18 11:26:36.921788 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-507927629-project Aug 18 11:26:36.921788 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:26:36.921788 n-d-853611-3 devstack@n-api.service[122209]: {"addTenantAccess": {"tenant": "f6ebb1ff5e87429292b48f541409e317"}} Aug 18 11:26:36.921788 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '833728909', 'body': {'addTenantAccess': {'tenant': 'f6ebb1ff5e87429292b48f541409e317'}}} Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:26:36.922646 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 18 11:26:36.923962 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:36.925311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b8d1f1c-b95f-44d3-addc-e8f8a5b4a2aa tempest-FlavorsAccessNegativeTestJSON-507927629 tempest-FlavorsAccessNegativeTestJSON-507927629-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:36.925311 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5b8d1f1c-b95f-44d3-addc-e8f8a5b4a2aa tempest-FlavorsAccessNegativeTestJSON-507927629 tempest-FlavorsAccessNegativeTestJSON-507927629-project] 10.222.0.73 "POST /compute/v2.1/flavors/833728909/action" status: 403 len: 130 microversion: 2.1 time: 0.274076 Aug 18 11:26:36.940175 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 263/462] 10.222.0.73 () {60 vars in 1197 bytes} [Thu Aug 18 11:26:36 2022] POST /compute/v2.1/flavors/833728909/action => generated 130 bytes in 292 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:36.947704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0443ab45-479d-457a-b77d-bd589434e93f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:36.948677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0443ab45-479d-457a-b77d-bd589434e93f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:36.955695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0443ab45-479d-457a-b77d-bd589434e93f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:36.964761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0443ab45-479d-457a-b77d-bd589434e93f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:36.965491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0443ab45-479d-457a-b77d-bd589434e93f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:36.966532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0443ab45-479d-457a-b77d-bd589434e93f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:36.967169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0443ab45-479d-457a-b77d-bd589434e93f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:36.967756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0443ab45-479d-457a-b77d-bd589434e93f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:37.509995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0443ab45-479d-457a-b77d-bd589434e93f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:37.536394 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0443ab45-479d-457a-b77d-bd589434e93f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1388 microversion: 2.1 time: 0.591690 Aug 18 11:26:37.538552 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 264/463] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:36 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1388 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:37.547934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-45018be1-7f80-418f-aa2a-aac1f03d78df tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:37.548999 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:37.548999 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:37.580396 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-45018be1-7f80-418f-aa2a-aac1f03d78df tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/833728909" status: 202 len: 0 microversion: 2.1 time: 0.037280 Aug 18 11:26:37.581527 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 265/464] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:26:37 2022] DELETE /compute/v2.1/flavors/833728909 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:26:37.592660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-09086f36-2cc5-496a-962c-f379bbe1759b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:37.596309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-09086f36-2cc5-496a-962c-f379bbe1759b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:37.610816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09086f36-2cc5-496a-962c-f379bbe1759b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:37.611494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09086f36-2cc5-496a-962c-f379bbe1759b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:37.611682 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-edcc297b-dac1-4832-b27b-4ef232b15e6f tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1611 microversion: 2.1 time: 2.162271 Aug 18 11:26:37.612693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09086f36-2cc5-496a-962c-f379bbe1759b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:37.612824 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 200/465] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:35 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1611 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:37.614051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09086f36-2cc5-496a-962c-f379bbe1759b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:37.614993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09086f36-2cc5-496a-962c-f379bbe1759b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:37.616160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09086f36-2cc5-496a-962c-f379bbe1759b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:37.636280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ed78809e-7a79-4996-86ce-5b14dd725afc tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:37.698958 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ed78809e-7a79-4996-86ce-5b14dd725afc tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.042005 Aug 18 11:26:37.716803 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 201/466] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:26:37 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:37.721887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-af3644ed-5906-4823-981a-9d938f23f935 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:37.724825 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:37.724825 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:37.726996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af3644ed-5906-4823-981a-9d938f23f935 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:37.727803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af3644ed-5906-4823-981a-9d938f23f935 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:37.728426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af3644ed-5906-4823-981a-9d938f23f935 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:37.730449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af3644ed-5906-4823-981a-9d938f23f935 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:37.731064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af3644ed-5906-4823-981a-9d938f23f935 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:37.731671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af3644ed-5906-4823-981a-9d938f23f935 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:37.771331 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-af3644ed-5906-4823-981a-9d938f23f935 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.053215 Aug 18 11:26:37.779173 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 202/467] 10.222.0.73 () {58 vars in 1176 bytes} [Thu Aug 18 11:26:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:37.792916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-86697275-f6c3-4b1e-aaae-1f293dc85292 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-699408864", "id": 280304267, "os-flavor-access:is_public": "False"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:37.799847 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:37.799847 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:37.831546 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-86697275-f6c3-4b1e-aaae-1f293dc85292 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.050329 Aug 18 11:26:37.833595 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 203/468] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:26:37 2022] POST /compute/v2.1/flavors => generated 435 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:37.845525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1f16ea9-a90f-4f19-b5e2-6d8de1121b81 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-853611-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:37.851880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1f16ea9-a90f-4f19-b5e2-6d8de1121b81 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:37.861091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1f16ea9-a90f-4f19-b5e2-6d8de1121b81 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:37.861770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1f16ea9-a90f-4f19-b5e2-6d8de1121b81 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:37.862409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1f16ea9-a90f-4f19-b5e2-6d8de1121b81 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:37.863351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1f16ea9-a90f-4f19-b5e2-6d8de1121b81 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:37.863957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1f16ea9-a90f-4f19-b5e2-6d8de1121b81 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:37.864588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1f16ea9-a90f-4f19-b5e2-6d8de1121b81 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:37.895825 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-09086f36-2cc5-496a-962c-f379bbe1759b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:37.906631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-a1f16ea9-a90f-4f19-b5e2-6d8de1121b81 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Lazy-loading 'flavor' on Instance uuid 9c4373a5-07b8-4549-83a9-f38b2fd0369c {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:26:37.909754 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-09086f36-2cc5-496a-962c-f379bbe1759b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1277 microversion: 2.1 time: 0.326167 Aug 18 11:26:37.912202 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 266/469] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:37 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1277 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:37.923583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-71cf34ca-8dfb-4f73-a121-3e35c0cdaf79 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f6ebb1ff5e87429292b48f541409e317"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:37.936697 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:37.936697 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:37.941480 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-a1f16ea9-a90f-4f19-b5e2-6d8de1121b81 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c while it is in vm_state suspended Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1f16ea9-a90f-4f19-b5e2-6d8de1121b81 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Request method failure captured: Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c/action HTTP/1.1 Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 97 Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iG3BJWd4OjdQJPV23dAReDnCZEH3f6ZQopP3p1vl-QrXnmtKxIuE8r8aldxjUkJKOCZkKNGmFGHO8mt9qkHnOzxz7IeCEmxl0M8UtU8gT1nDNR9GIImpucAcg-eIX3UXP_gI-6YRDDU9CVT-mDHKL5IFpu0qw3dvb_VwTYdovEw2Fw Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 4b7481f89561450581bd6ee63a1b7937 Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-LiveMigrationNegativeTest-1826345176 Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:26:37.943545 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:26:37.944768 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b7481f89561450581bd6ee63a1b7937"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4b7481f89561450581bd6ee63a1b7937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4b7481f89561450581bd6ee63a1b7937"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4b7481f89561450581bd6ee63a1b7937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:37.944768 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-LiveMigrationNegativeTest-1826345176 Aug 18 11:26:37.944768 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 4b7481f89561450581bd6ee63a1b7937 Aug 18 11:26:37.944768 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1826345176 Aug 18 11:26:37.944768 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-LiveMigrationNegativeTest-1826345176-project-admin Aug 18 11:26:37.944768 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:37.944768 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:37.944768 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 0a334cb0db354a8c9a6cda3a46b6d134 Aug 18 11:26:37.944768 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-LiveMigrationNegativeTest-1826345176-project-admin Aug 18 11:26:37.944768 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:26:37.944768 n-d-853611-3 devstack@n-api.service[122210]: {"os-migrateLive": {"host": "n-h1-853611-3", "block_migration": true, "disk_over_commit": false}} Aug 18 11:26:37.944768 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: exception: Cannot 'os-migrateLive' instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c while it is in vm_state suspended Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '9c4373a5-07b8-4549-83a9-f38b2fd0369c', 'body': {'os-migrateLive': {'host': 'n-h1-853611-3', 'block_migration': True, 'disk_over_commit': False}}} Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 18 11:26:37.946057 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:26:37.947283 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c while it is in vm_state suspended Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c while it is in vm_state suspended Aug 18 11:26:37.948461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:37.951156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1f16ea9-a90f-4f19-b5e2-6d8de1121b81 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c while it is in vm_state suspended {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:37.952300 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1f16ea9-a90f-4f19-b5e2-6d8de1121b81 tempest-LiveMigrationNegativeTest-1826345176 tempest-LiveMigrationNegativeTest-1826345176-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c/action" status: 409 len: 155 microversion: 2.1 time: 0.117541 Aug 18 11:26:37.953049 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 204/470] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:26:37 2022] POST /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c/action => generated 155 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:26:37.964429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f0e86c8-e97e-48a8-9b19-2a4312a37c81 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:37.965098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6f0e86c8-e97e-48a8-9b19-2a4312a37c81 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:37.973293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f0e86c8-e97e-48a8-9b19-2a4312a37c81 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:37.975774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f0e86c8-e97e-48a8-9b19-2a4312a37c81 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:37.977062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f0e86c8-e97e-48a8-9b19-2a4312a37c81 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:37.977993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f0e86c8-e97e-48a8-9b19-2a4312a37c81 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:37.981476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f0e86c8-e97e-48a8-9b19-2a4312a37c81 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:37.982301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f0e86c8-e97e-48a8-9b19-2a4312a37c81 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:38.017279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6f0e86c8-e97e-48a8-9b19-2a4312a37c81 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:26:38.057494 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-71cf34ca-8dfb-4f73-a121-3e35c0cdaf79 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors/280304267/action" status: 200 len: 96 microversion: 2.1 time: 0.140662 Aug 18 11:26:38.058634 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 267/471] 10.222.0.73 () {60 vars in 1197 bytes} [Thu Aug 18 11:26:37 2022] POST /compute/v2.1/flavors/280304267/action => generated 96 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:26:38.072098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bb7b2ed9-c05d-4768-a622-84d9784ba1f1 tempest-FlavorsAccessNegativeTestJSON-507927629 tempest-FlavorsAccessNegativeTestJSON-507927629-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f6ebb1ff5e87429292b48f541409e317"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:38.076633 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:38.076633 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:38.078870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bb7b2ed9-c05d-4768-a622-84d9784ba1f1 tempest-FlavorsAccessNegativeTestJSON-507927629 tempest-FlavorsAccessNegativeTestJSON-507927629-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '1f2d95e9b07b425295d7182bae2a62d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ebb1ff5e87429292b48f541409e317', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bb7b2ed9-c05d-4768-a622-84d9784ba1f1 tempest-FlavorsAccessNegativeTestJSON-507927629 tempest-FlavorsAccessNegativeTestJSON-507927629-project] Request method failure captured: Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/flavors/280304267/action HTTP/1.1 Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 70 Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iHmDVfcpMjDuPBmVyAQjTuga-GKWurtJTkDeV3h3bfENwCU1eo833Kd5FaJM-gfv1QRHqYQ7F2-ZASC_Rlc-ZOnEHsqr-i3B0y0oy8ws2xusNvQol7PJqJBjMCgkjJYapfP3lxszD-bkCyVMO_GszStiff5q3lGigFV1IK9TShK6vk Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: f6ebb1ff5e87429292b48f541409e317 Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-507927629 Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:26:38.083685 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:26:38.085009 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f6ebb1ff5e87429292b48f541409e317"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f6ebb1ff5e87429292b48f541409e317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f6ebb1ff5e87429292b48f541409e317"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f6ebb1ff5e87429292b48f541409e317"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:38.085009 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-507927629 Aug 18 11:26:38.085009 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: f6ebb1ff5e87429292b48f541409e317 Aug 18 11:26:38.085009 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-507927629 Aug 18 11:26:38.085009 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-FlavorsAccessNegativeTestJSON-507927629-project Aug 18 11:26:38.085009 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:38.085009 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:38.085009 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1f2d95e9b07b425295d7182bae2a62d9 Aug 18 11:26:38.085009 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-507927629-project Aug 18 11:26:38.085009 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:26:38.085009 n-d-853611-3 devstack@n-api.service[122209]: {"removeTenantAccess": {"tenant": "f6ebb1ff5e87429292b48f541409e317"}} Aug 18 11:26:38.085009 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '280304267', 'body': {'removeTenantAccess': {'tenant': 'f6ebb1ff5e87429292b48f541409e317'}}} Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi context.can( Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:26:38.086108 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 18 11:26:38.087590 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:38.095489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bb7b2ed9-c05d-4768-a622-84d9784ba1f1 tempest-FlavorsAccessNegativeTestJSON-507927629 tempest-FlavorsAccessNegativeTestJSON-507927629-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:38.096794 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bb7b2ed9-c05d-4768-a622-84d9784ba1f1 tempest-FlavorsAccessNegativeTestJSON-507927629 tempest-FlavorsAccessNegativeTestJSON-507927629-project] 10.222.0.73 "POST /compute/v2.1/flavors/280304267/action" status: 403 len: 133 microversion: 2.1 time: 0.030825 Aug 18 11:26:38.098101 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 268/472] 10.222.0.73 () {60 vars in 1197 bytes} [Thu Aug 18 11:26:38 2022] POST /compute/v2.1/flavors/280304267/action => generated 133 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:38.115087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-30ed7e6d-7371-40a4-b54c-fb573ce4d808 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f6ebb1ff5e87429292b48f541409e317"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:38.176223 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6f0e86c8-e97e-48a8-9b19-2a4312a37c81 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "DELETE /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 204 len: 0 microversion: 2.1 time: 0.216392 Aug 18 11:26:38.177372 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 205/473] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:26:37 2022] DELETE /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:26:38.186527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-733e30a3-d344-4711-858c-18be69e72b05 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:38.187454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-733e30a3-d344-4711-858c-18be69e72b05 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:38.200359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733e30a3-d344-4711-858c-18be69e72b05 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:38.201040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733e30a3-d344-4711-858c-18be69e72b05 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:38.201627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733e30a3-d344-4711-858c-18be69e72b05 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:38.202592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733e30a3-d344-4711-858c-18be69e72b05 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:38.206335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733e30a3-d344-4711-858c-18be69e72b05 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:38.207049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733e30a3-d344-4711-858c-18be69e72b05 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:38.276525 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-30ed7e6d-7371-40a4-b54c-fb573ce4d808 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors/280304267/action" status: 200 len: 21 microversion: 2.1 time: 0.171810 Aug 18 11:26:38.282226 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 269/474] 10.222.0.73 () {60 vars in 1197 bytes} [Thu Aug 18 11:26:38 2022] POST /compute/v2.1/flavors/280304267/action => generated 21 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 11:26:38.287610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e1d73d90-36f2-46a5-b296-9771f051caeb tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:38.293088 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:38.293088 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:38.322074 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e1d73d90-36f2-46a5-b296-9771f051caeb tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/280304267" status: 202 len: 0 microversion: 2.1 time: 0.038000 Aug 18 11:26:38.328882 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 270/475] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:26:38 2022] DELETE /compute/v2.1/flavors/280304267 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:26:38.334783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1b0633ba-1a49-45b8-a99e-02e07fa412f8 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:38.359819 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1b0633ba-1a49-45b8-a99e-02e07fa412f8 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.029443 Aug 18 11:26:38.361110 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 271/476] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:26:38 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:38.382634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b6b9cacb-1e6a-4193-9805-a26b3dec9e21 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1748292503", "id": 1348988700, "os-flavor-access:is_public": "False"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:38.388128 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:38.388128 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:38.393008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5,nova_api:DELETE=14 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:38.420729 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b6b9cacb-1e6a-4193-9805-a26b3dec9e21 tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.041436 Aug 18 11:26:38.423133 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 272/477] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:26:38 2022] POST /compute/v2.1/flavors => generated 439 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:26:38.439510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c16d463a-b15e-4149-ab36-7af0c556071e tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ff41d6ebf4ad439982b60540816f4fda"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:38.572116 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-c16d463a-b15e-4149-ab36-7af0c556071e tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] HTTP exception thrown: Flavor access not found for 39 / ff41d6ebf4ad439982b60540816f4fda combination. Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c16d463a-b15e-4149-ab36-7af0c556071e tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Request method failure captured: Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/flavors/1348988700/action HTTP/1.1 Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 70 Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iHomArOnj-M810qvwfa70a5ZN8MaMj71_NKjBMGZNTlZMMEJYhhGmachudbE9-AbU5dEZmKf_eNaJ0scsZc7Fr3h1nHjvP61u5kRj6ID8tCfjSylWM9vXfD_kGR_HKTiezA33d-rrMwb2J881ooyyPwjAYIEIWyZ6szKdMvDseIvYY Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 61270ee827184644ab2fbae9bb1ce143 Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1136461800 Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:26:38.574280 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:26:38.575761 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/61270ee827184644ab2fbae9bb1ce143"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/61270ee827184644ab2fbae9bb1ce143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_61270ee827184644ab2fbae9bb1ce143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/61270ee827184644ab2fbae9bb1ce143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:38.575761 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1136461800 Aug 18 11:26:38.575761 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 61270ee827184644ab2fbae9bb1ce143 Aug 18 11:26:38.575761 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1136461800 Aug 18 11:26:38.575761 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin Aug 18 11:26:38.575761 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:38.575761 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:38.575761 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e689e432b05f41e6ac9df9715346a5c0 Aug 18 11:26:38.575761 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin Aug 18 11:26:38.575761 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:26:38.575761 n-d-853611-3 devstack@n-api.service[122209]: {"removeTenantAccess": {"tenant": "ff41d6ebf4ad439982b60540816f4fda"}} Aug 18 11:26:38.575761 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: exception: Flavor access not found for 39 / ff41d6ebf4ad439982b60540816f4fda combination. Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '1348988700', 'body': {'removeTenantAccess': {'tenant': 'ff41d6ebf4ad439982b60540816f4fda'}}} Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 18 11:26:38.576534 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 39 / ff41d6ebf4ad439982b60540816f4fda combination. Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 39 / ff41d6ebf4ad439982b60540816f4fda combination. Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:38.577757 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:38.579843 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:38.579843 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:38.579843 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:38.579843 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:38.579843 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 39 / ff41d6ebf4ad439982b60540816f4fda combination. Aug 18 11:26:38.579843 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:38.582039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c16d463a-b15e-4149-ab36-7af0c556071e tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Returning 404 to user: Flavor access not found for 39 / ff41d6ebf4ad439982b60540816f4fda combination. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:38.583353 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c16d463a-b15e-4149-ab36-7af0c556071e tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors/1348988700/action" status: 404 len: 124 microversion: 2.1 time: 0.151723 Aug 18 11:26:38.584412 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 273/478] 10.222.0.73 () {60 vars in 1200 bytes} [Thu Aug 18 11:26:38 2022] POST /compute/v2.1/flavors/1348988700/action => generated 124 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:38.590618 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5f016582-208c-4e2a-ace4-cc8aa6f94e9e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:38.592175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5f016582-208c-4e2a-ace4-cc8aa6f94e9e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:38.605343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f016582-208c-4e2a-ace4-cc8aa6f94e9e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:38.605965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f016582-208c-4e2a-ace4-cc8aa6f94e9e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:38.606503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f016582-208c-4e2a-ace4-cc8aa6f94e9e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:38.607310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f016582-208c-4e2a-ace4-cc8aa6f94e9e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:38.607837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f016582-208c-4e2a-ace4-cc8aa6f94e9e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:38.608337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f016582-208c-4e2a-ace4-cc8aa6f94e9e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:38.995502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-733e30a3-d344-4711-858c-18be69e72b05 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:39.012886 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-733e30a3-d344-4711-858c-18be69e72b05 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1466 microversion: 2.1 time: 0.828610 Aug 18 11:26:39.014664 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 206/479] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:38 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1466 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:26:39.022558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f6707503-2d58-41bc-a620-af8d5339b7de tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:39.024643 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:39.024643 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:39.089404 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f6707503-2d58-41bc-a620-af8d5339b7de tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/1348988700" status: 202 len: 0 microversion: 2.1 time: 0.065340 Aug 18 11:26:39.090376 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 207/480] 10.222.0.73 () {58 vars in 1161 bytes} [Thu Aug 18 11:26:39 2022] DELETE /compute/v2.1/flavors/1348988700 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:26:39.136556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-853934f4-cfb3-4692-af51-68baacb72620 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:39.140346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-853934f4-cfb3-4692-af51-68baacb72620 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:39.184243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-853934f4-cfb3-4692-af51-68baacb72620 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:39.185565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-853934f4-cfb3-4692-af51-68baacb72620 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:39.188055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-853934f4-cfb3-4692-af51-68baacb72620 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:39.191496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-853934f4-cfb3-4692-af51-68baacb72620 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:39.192234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-853934f4-cfb3-4692-af51-68baacb72620 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:39.192793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-853934f4-cfb3-4692-af51-68baacb72620 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:39.414551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-853934f4-cfb3-4692-af51-68baacb72620 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:39.426344 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-853934f4-cfb3-4692-af51-68baacb72620 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1277 microversion: 2.1 time: 0.334041 Aug 18 11:26:39.427641 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 208/481] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:39 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1277 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:39.437413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-68737944-9af6-4118-a039-4c44ea0c66af tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:39.477942 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-68737944-9af6-4118-a039-4c44ea0c66af tempest-FlavorsAccessNegativeTestJSON-1136461800 tempest-FlavorsAccessNegativeTestJSON-1136461800-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.048333 Aug 18 11:26:39.480853 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 209/482] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:26:39 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:40.040779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c3916984-2ca6-4c9e-9aac-5bc2c9c9cd9b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:40.043436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c3916984-2ca6-4c9e-9aac-5bc2c9c9cd9b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:40.090305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3916984-2ca6-4c9e-9aac-5bc2c9c9cd9b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:40.090838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3916984-2ca6-4c9e-9aac-5bc2c9c9cd9b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:40.091284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3916984-2ca6-4c9e-9aac-5bc2c9c9cd9b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:40.092020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3916984-2ca6-4c9e-9aac-5bc2c9c9cd9b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:40.092484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3916984-2ca6-4c9e-9aac-5bc2c9c9cd9b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:40.092913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3916984-2ca6-4c9e-9aac-5bc2c9c9cd9b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:40.240529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5f016582-208c-4e2a-ace4-cc8aa6f94e9e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:40.254916 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5f016582-208c-4e2a-ace4-cc8aa6f94e9e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1388 microversion: 2.1 time: 1.669251 Aug 18 11:26:40.255505 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 274/483] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:38 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1388 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:40.450716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-546521a6-6ecd-4753-b30b-6732dce2b5db tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:40.451431 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-546521a6-6ecd-4753-b30b-6732dce2b5db tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:40.467965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-546521a6-6ecd-4753-b30b-6732dce2b5db tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:40.468428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-546521a6-6ecd-4753-b30b-6732dce2b5db tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:40.469053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-546521a6-6ecd-4753-b30b-6732dce2b5db tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:40.469999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-546521a6-6ecd-4753-b30b-6732dce2b5db tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:40.470788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-546521a6-6ecd-4753-b30b-6732dce2b5db tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:40.471519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-546521a6-6ecd-4753-b30b-6732dce2b5db tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:40.749999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-546521a6-6ecd-4753-b30b-6732dce2b5db tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:40.762626 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-546521a6-6ecd-4753-b30b-6732dce2b5db tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1277 microversion: 2.1 time: 0.318364 Aug 18 11:26:40.764092 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 275/484] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:40 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1277 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:40.856040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c3916984-2ca6-4c9e-9aac-5bc2c9c9cd9b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:40.880857 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c3916984-2ca6-4c9e-9aac-5bc2c9c9cd9b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1466 microversion: 2.1 time: 0.845913 Aug 18 11:26:40.881872 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 210/485] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:40 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1466 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:41.124143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-006003c6-5234-470e-9d04-65b6110fc170 req-8cfb254d-b547-4cb9-a32d-c82d5420c709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b", "tag": "df5c2bde-2e96-4148-91da-df8c38a12161"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:41.151301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-006003c6-5234-470e-9d04-65b6110fc170 req-8cfb254d-b547-4cb9-a32d-c82d5420c709 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:41.154934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-006003c6-5234-470e-9d04-65b6110fc170 req-8cfb254d-b547-4cb9-a32d-c82d5420c709 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:41.156382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-006003c6-5234-470e-9d04-65b6110fc170 req-8cfb254d-b547-4cb9-a32d-c82d5420c709 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:41.197076 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-006003c6-5234-470e-9d04-65b6110fc170 req-8cfb254d-b547-4cb9-a32d-c82d5420c709 service nova] Creating event network-changed:df5c2bde-2e96-4148-91da-df8c38a12161 for instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b on n-h2-853611-3 Aug 18 11:26:41.215074 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-006003c6-5234-470e-9d04-65b6110fc170 req-8cfb254d-b547-4cb9-a32d-c82d5420c709 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092393 Aug 18 11:26:41.216481 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 276/486] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:41.280607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b0573555-50d8-44f7-99a0-ff6cba6878e1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:41.281896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b0573555-50d8-44f7-99a0-ff6cba6878e1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:41.291151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0573555-50d8-44f7-99a0-ff6cba6878e1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:41.293926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0573555-50d8-44f7-99a0-ff6cba6878e1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:41.294593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0573555-50d8-44f7-99a0-ff6cba6878e1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:41.298132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0573555-50d8-44f7-99a0-ff6cba6878e1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:41.299538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0573555-50d8-44f7-99a0-ff6cba6878e1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:41.301049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0573555-50d8-44f7-99a0-ff6cba6878e1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:41.784523 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f52adc8c-db1d-4831-9599-66a047691d16 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:41.786168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f52adc8c-db1d-4831-9599-66a047691d16 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:41.800527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f52adc8c-db1d-4831-9599-66a047691d16 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:41.802125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f52adc8c-db1d-4831-9599-66a047691d16 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:41.802849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f52adc8c-db1d-4831-9599-66a047691d16 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:41.808268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f52adc8c-db1d-4831-9599-66a047691d16 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:41.808969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f52adc8c-db1d-4831-9599-66a047691d16 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:41.809573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f52adc8c-db1d-4831-9599-66a047691d16 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:42.267649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b0573555-50d8-44f7-99a0-ff6cba6878e1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:42.278872 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b0573555-50d8-44f7-99a0-ff6cba6878e1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1388 microversion: 2.1 time: 1.001813 Aug 18 11:26:42.293309 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 211/487] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:41 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1388 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:42.306162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3cf6b34b-1de7-48e2-ba31-562867bcbeac tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:42.306829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3cf6b34b-1de7-48e2-ba31-562867bcbeac tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:42.316478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cf6b34b-1de7-48e2-ba31-562867bcbeac tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:42.317061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cf6b34b-1de7-48e2-ba31-562867bcbeac tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:42.318298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cf6b34b-1de7-48e2-ba31-562867bcbeac tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:42.319567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cf6b34b-1de7-48e2-ba31-562867bcbeac tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:42.320892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cf6b34b-1de7-48e2-ba31-562867bcbeac tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:42.321589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cf6b34b-1de7-48e2-ba31-562867bcbeac tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:42.550099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3cf6b34b-1de7-48e2-ba31-562867bcbeac tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:42.564769 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3cf6b34b-1de7-48e2-ba31-562867bcbeac tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1466 microversion: 2.1 time: 0.269495 Aug 18 11:26:42.565616 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 212/488] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:42 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1466 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:42.987801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f52adc8c-db1d-4831-9599-66a047691d16 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:43.011414 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f52adc8c-db1d-4831-9599-66a047691d16 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1319 microversion: 2.1 time: 1.229032 Aug 18 11:26:43.012030 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 277/489] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:41 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1319 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:43.314162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df97ce9f-787c-4161-b7aa-c414c387a44b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:43.314752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df97ce9f-787c-4161-b7aa-c414c387a44b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:43.316856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=22 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:43.329311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df97ce9f-787c-4161-b7aa-c414c387a44b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:43.329813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df97ce9f-787c-4161-b7aa-c414c387a44b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:43.334737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df97ce9f-787c-4161-b7aa-c414c387a44b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:43.336200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df97ce9f-787c-4161-b7aa-c414c387a44b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:43.336966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df97ce9f-787c-4161-b7aa-c414c387a44b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:43.337595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df97ce9f-787c-4161-b7aa-c414c387a44b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:43.591411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-55ee36f5-bd9e-4936-8fa4-9c8cfcb6ab64 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:43.592390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-55ee36f5-bd9e-4936-8fa4-9c8cfcb6ab64 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:43.608172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55ee36f5-bd9e-4936-8fa4-9c8cfcb6ab64 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:43.610001 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55ee36f5-bd9e-4936-8fa4-9c8cfcb6ab64 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:43.610502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55ee36f5-bd9e-4936-8fa4-9c8cfcb6ab64 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:43.615385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55ee36f5-bd9e-4936-8fa4-9c8cfcb6ab64 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:43.615886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55ee36f5-bd9e-4936-8fa4-9c8cfcb6ab64 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:43.617008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55ee36f5-bd9e-4936-8fa4-9c8cfcb6ab64 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:43.742347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:43.940927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-55ee36f5-bd9e-4936-8fa4-9c8cfcb6ab64 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:43.996169 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-55ee36f5-bd9e-4936-8fa4-9c8cfcb6ab64 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 200 len: 1424 microversion: 2.1 time: 0.411298 Aug 18 11:26:44.022008 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 278/490] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:43 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 1424 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:26:44.046329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-c9b6fcd9-6b98-4430-8aac-f43a1f76e1cd req-13082000-1e44-4fc0-b380-aa3396ea898f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4373a5-07b8-4549-83a9-f38b2fd0369c", "name": "network-vif-deleted", "tag": "101a2266-a8f2-44e2-bd99-3b422d800824"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:44.066999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c9b6fcd9-6b98-4430-8aac-f43a1f76e1cd req-13082000-1e44-4fc0-b380-aa3396ea898f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:44.067379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c9b6fcd9-6b98-4430-8aac-f43a1f76e1cd req-13082000-1e44-4fc0-b380-aa3396ea898f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:44.076376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c9b6fcd9-6b98-4430-8aac-f43a1f76e1cd req-13082000-1e44-4fc0-b380-aa3396ea898f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:44.142356 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-c9b6fcd9-6b98-4430-8aac-f43a1f76e1cd req-13082000-1e44-4fc0-b380-aa3396ea898f service nova] Creating event network-vif-deleted:101a2266-a8f2-44e2-bd99-3b422d800824 for instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c on n-h2-853611-3 Aug 18 11:26:44.151037 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-c9b6fcd9-6b98-4430-8aac-f43a1f76e1cd req-13082000-1e44-4fc0-b380-aa3396ea898f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122150 Aug 18 11:26:44.152585 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 279/491] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:44.166053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-411c3c2b-5767-4b15-bcb1-d712d5dd5bdf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:44.167142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-411c3c2b-5767-4b15-bcb1-d712d5dd5bdf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:44.174694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-411c3c2b-5767-4b15-bcb1-d712d5dd5bdf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:44.175524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-411c3c2b-5767-4b15-bcb1-d712d5dd5bdf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:44.177263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-411c3c2b-5767-4b15-bcb1-d712d5dd5bdf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:44.178198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-411c3c2b-5767-4b15-bcb1-d712d5dd5bdf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:44.179847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-411c3c2b-5767-4b15-bcb1-d712d5dd5bdf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:44.180612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-411c3c2b-5767-4b15-bcb1-d712d5dd5bdf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:44.857399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df97ce9f-787c-4161-b7aa-c414c387a44b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:44.876593 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df97ce9f-787c-4161-b7aa-c414c387a44b tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1388 microversion: 2.1 time: 1.567289 Aug 18 11:26:44.877210 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 213/492] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:43 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1388 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:44.967497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=18 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:45.025247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4541bbe1-b8f5-42ce-9be2-75532b248358 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:45.026300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4541bbe1-b8f5-42ce-9be2-75532b248358 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: 9c4373a5-07b8-4549-83a9-f38b2fd0369c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:45.043405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4541bbe1-b8f5-42ce-9be2-75532b248358 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:45.044293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4541bbe1-b8f5-42ce-9be2-75532b248358 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:45.045089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4541bbe1-b8f5-42ce-9be2-75532b248358 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:45.046064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4541bbe1-b8f5-42ce-9be2-75532b248358 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:45.052691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4541bbe1-b8f5-42ce-9be2-75532b248358 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:45.053506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4541bbe1-b8f5-42ce-9be2-75532b248358 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:45.100500 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-4541bbe1-b8f5-42ce-9be2-75532b248358 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] HTTP exception thrown: Instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c could not be found. Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4541bbe1-b8f5-42ce-9be2-75532b248358 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Request method failure captured: Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c HTTP/1.1 Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iG1cEWuo6mQYh5T0mM0m6StnAkEWlp7y4woTcJynn08JSlshxgOESqYkfbKLxDtRK2wHqFUYPd2pZpTvxo9nxNOdeMTIo4cxFvtxZqOFYaU5O2_qXVTRCjEJfNwiYZc8KXerfuHkMdyi83Nw1OFk6OEB6z8fo-EoQqyifC28IbMcGA Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 7543ea6a7a5d4831b185b45f59c6a31d Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-LiveMigrationNegativeTest-1973583807 Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:26:45.103900 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:26:45.105251 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7543ea6a7a5d4831b185b45f59c6a31d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7543ea6a7a5d4831b185b45f59c6a31d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7543ea6a7a5d4831b185b45f59c6a31d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7543ea6a7a5d4831b185b45f59c6a31d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:45.105251 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-LiveMigrationNegativeTest-1973583807 Aug 18 11:26:45.105251 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 7543ea6a7a5d4831b185b45f59c6a31d Aug 18 11:26:45.105251 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1973583807 Aug 18 11:26:45.105251 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-LiveMigrationNegativeTest-1973583807-project Aug 18 11:26:45.105251 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:45.105251 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:45.105251 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 9ffb27f7ddc54fe59b815112f0601848 Aug 18 11:26:45.105251 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-LiveMigrationNegativeTest-1973583807-project Aug 18 11:26:45.105251 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:26:45.105251 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c could not be found. Aug 18 11:26:45.105251 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '9c4373a5-07b8-4549-83a9-f38b2fd0369c'} Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c could not be found. Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:45.105961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c could not be found. Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c could not be found. Aug 18 11:26:45.107222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:45.112234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4541bbe1-b8f5-42ce-9be2-75532b248358 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Returning 404 to user: Instance 9c4373a5-07b8-4549-83a9-f38b2fd0369c could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:45.115269 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4541bbe1-b8f5-42ce-9be2-75532b248358 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c" status: 404 len: 111 microversion: 2.1 time: 0.094172 Aug 18 11:26:45.116963 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 214/493] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:45 2022] GET /compute/v2.1/servers/9c4373a5-07b8-4549-83a9-f38b2fd0369c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:26:45.129765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cbf3048e-e935-4eac-a209-2e28d0ac6425 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:45.132779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cbf3048e-e935-4eac-a209-2e28d0ac6425 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:45.140017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf3048e-e935-4eac-a209-2e28d0ac6425 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:45.141082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf3048e-e935-4eac-a209-2e28d0ac6425 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:45.142337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf3048e-e935-4eac-a209-2e28d0ac6425 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:45.143345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf3048e-e935-4eac-a209-2e28d0ac6425 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:45.144172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf3048e-e935-4eac-a209-2e28d0ac6425 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:45.144841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf3048e-e935-4eac-a209-2e28d0ac6425 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:45.193281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cbf3048e-e935-4eac-a209-2e28d0ac6425 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:26:45.370820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cbf3048e-e935-4eac-a209-2e28d0ac6425 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 204 len: 0 microversion: 2.1 time: 0.248956 Aug 18 11:26:45.371713 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 215/494] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:26:45 2022] DELETE /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:26:45.617289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1396721069", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "c1e36b66-5ff9-448b-ae68-4d66745c4f5b"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:45.704211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] validate_networks() for [('c1e36b66-5ff9-448b-ae68-4d66745c4f5b', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:26:45.774929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-411c3c2b-5767-4b15-bcb1-d712d5dd5bdf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:45.783506 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-411c3c2b-5767-4b15-bcb1-d712d5dd5bdf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1319 microversion: 2.1 time: 1.629328 Aug 18 11:26:45.801839 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 280/495] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:44 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1319 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:45.805721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9a1e831f-362f-4c19-b769-a07fdddf3a01 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:45.806529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9a1e831f-362f-4c19-b769-a07fdddf3a01 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:45.814481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a1e831f-362f-4c19-b769-a07fdddf3a01 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:45.815019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a1e831f-362f-4c19-b769-a07fdddf3a01 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:45.817655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a1e831f-362f-4c19-b769-a07fdddf3a01 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:45.818902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a1e831f-362f-4c19-b769-a07fdddf3a01 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:45.820016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a1e831f-362f-4c19-b769-a07fdddf3a01 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:45.822460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a1e831f-362f-4c19-b769-a07fdddf3a01 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:46.516405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9a1e831f-362f-4c19-b769-a07fdddf3a01 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:46.559186 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9a1e831f-362f-4c19-b769-a07fdddf3a01 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1474 microversion: 2.1 time: 0.758628 Aug 18 11:26:46.577670 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 281/496] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:45 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1474 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:46.621603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-f967789b-dd9c-4be0-8614-009dafa81d10 req-72cad794-1b79-4551-8883-e6c5a6dbd3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adfe9b2a-b96c-408f-9381-d748f9ff7b5d", "tag": "b5ebddc2-4206-41b9-a9d9-575eda3136aa"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:46.644142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f967789b-dd9c-4be0-8614-009dafa81d10 req-72cad794-1b79-4551-8883-e6c5a6dbd3b1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:46.644700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f967789b-dd9c-4be0-8614-009dafa81d10 req-72cad794-1b79-4551-8883-e6c5a6dbd3b1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:46.645161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f967789b-dd9c-4be0-8614-009dafa81d10 req-72cad794-1b79-4551-8883-e6c5a6dbd3b1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:46.698893 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-f967789b-dd9c-4be0-8614-009dafa81d10 req-72cad794-1b79-4551-8883-e6c5a6dbd3b1 service nova] Creating event network-changed:b5ebddc2-4206-41b9-a9d9-575eda3136aa for instance adfe9b2a-b96c-408f-9381-d748f9ff7b5d on n-h1-853611-3 Aug 18 11:26:46.708280 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-f967789b-dd9c-4be0-8614-009dafa81d10 req-72cad794-1b79-4551-8883-e6c5a6dbd3b1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128886 Aug 18 11:26:46.713297 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 282/497] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:46.726581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bf63266d-c100-4ee4-ad26-d224e60de227 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:46.727665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bf63266d-c100-4ee4-ad26-d224e60de227 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:46.747680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf63266d-c100-4ee4-ad26-d224e60de227 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:46.748205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf63266d-c100-4ee4-ad26-d224e60de227 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:46.748658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf63266d-c100-4ee4-ad26-d224e60de227 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:46.749403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf63266d-c100-4ee4-ad26-d224e60de227 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:46.749909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf63266d-c100-4ee4-ad26-d224e60de227 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:46.750570 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf63266d-c100-4ee4-ad26-d224e60de227 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:47.240152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bf63266d-c100-4ee4-ad26-d224e60de227 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:47.260082 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bf63266d-c100-4ee4-ad26-d224e60de227 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1388 microversion: 2.1 time: 0.545187 Aug 18 11:26:47.261089 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 283/498] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:46 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1388 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:47.269773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-62b82c3c-8ddc-4673-b14e-1c7ce93c18b4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:47.270865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-62b82c3c-8ddc-4673-b14e-1c7ce93c18b4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:47.281708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-62b82c3c-8ddc-4673-b14e-1c7ce93c18b4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:47.282451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-62b82c3c-8ddc-4673-b14e-1c7ce93c18b4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:47.283132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-62b82c3c-8ddc-4673-b14e-1c7ce93c18b4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:47.284256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-62b82c3c-8ddc-4673-b14e-1c7ce93c18b4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:47.284956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-62b82c3c-8ddc-4673-b14e-1c7ce93c18b4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:47.285453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-62b82c3c-8ddc-4673-b14e-1c7ce93c18b4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:47.389182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:26:47.389721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:26:47.390210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:26:47.391105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:26:47.391893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:26:47.423924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:47.424634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:47.425223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:47.426145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:47.427172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:47.427857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:47.451550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Getting quotas for project d1fa95f956304a9bb1b34ddf82adac1a. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:26:47.456832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Getting quotas for user eb875d64a00b43448f7e3b7492e9086b and project d1fa95f956304a9bb1b34ddf82adac1a. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:26:47.470540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:26:47.474190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:26:47.553388 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-77db78a0-f6d0-496d-84b1-a3bb3cb13ba4 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.180205 Aug 18 11:26:47.555738 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 216/499] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:26:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:26:47.573115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dbfa758a-9e74-40f9-a1bb-13a5874bc1b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:47.574069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dbfa758a-9e74-40f9-a1bb-13a5874bc1b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:47.711075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dbfa758a-9e74-40f9-a1bb-13a5874bc1b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:47.721253 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dbfa758a-9e74-40f9-a1bb-13a5874bc1b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1224 microversion: 2.1 time: 0.158676 Aug 18 11:26:47.725082 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 217/500] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:47 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1224 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:47.758512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0389bcc7-9f03-42d8-b669-3c8564625db9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:47.759150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0389bcc7-9f03-42d8-b669-3c8564625db9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:47.776203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0389bcc7-9f03-42d8-b669-3c8564625db9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:47.780427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0389bcc7-9f03-42d8-b669-3c8564625db9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:47.781029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0389bcc7-9f03-42d8-b669-3c8564625db9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:47.781951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0389bcc7-9f03-42d8-b669-3c8564625db9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:47.782758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0389bcc7-9f03-42d8-b669-3c8564625db9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:47.783415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0389bcc7-9f03-42d8-b669-3c8564625db9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:48.651638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-62b82c3c-8ddc-4673-b14e-1c7ce93c18b4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:48.657059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:48.664597 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-62b82c3c-8ddc-4673-b14e-1c7ce93c18b4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1319 microversion: 2.1 time: 1.401486 Aug 18 11:26:48.688511 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 284/501] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:47 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1319 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:48.970482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1415797284", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "d0a3b2b0-b08b-4498-bc9d-af64e9bcff20"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:49.095962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] validate_networks() for [('d0a3b2b0-b08b-4498-bc9d-af64e9bcff20', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:26:49.138270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0389bcc7-9f03-42d8-b669-3c8564625db9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:49.188229 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0389bcc7-9f03-42d8-b669-3c8564625db9 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1474 microversion: 2.1 time: 1.436071 Aug 18 11:26:49.191761 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 218/502] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:47 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1474 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:49.207068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-38e796d1-23c0-43b2-b9ac-068f09dda3b2 req-e8890e51-dddf-4544-b426-71876cfe78fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea19ffc1-f486-4260-8188-6211809c953d", "tag": "5c3d5c21-11fa-4445-878a-2177d332905f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:49.237238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-38e796d1-23c0-43b2-b9ac-068f09dda3b2 req-e8890e51-dddf-4544-b426-71876cfe78fa service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:49.238545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-38e796d1-23c0-43b2-b9ac-068f09dda3b2 req-e8890e51-dddf-4544-b426-71876cfe78fa service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:49.240144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-38e796d1-23c0-43b2-b9ac-068f09dda3b2 req-e8890e51-dddf-4544-b426-71876cfe78fa service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:49.282485 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-38e796d1-23c0-43b2-b9ac-068f09dda3b2 req-e8890e51-dddf-4544-b426-71876cfe78fa service nova] Creating event network-changed:5c3d5c21-11fa-4445-878a-2177d332905f for instance ea19ffc1-f486-4260-8188-6211809c953d on n-h1-853611-3 Aug 18 11:26:49.306191 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-38e796d1-23c0-43b2-b9ac-068f09dda3b2 req-e8890e51-dddf-4544-b426-71876cfe78fa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107947 Aug 18 11:26:49.309522 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 219/503] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:49.324862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1a049d1-b21e-4f11-91b4-941cc77b254e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:49.326981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1a049d1-b21e-4f11-91b4-941cc77b254e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:49.336126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1a049d1-b21e-4f11-91b4-941cc77b254e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:49.338301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1a049d1-b21e-4f11-91b4-941cc77b254e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:49.339033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1a049d1-b21e-4f11-91b4-941cc77b254e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:49.341276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1a049d1-b21e-4f11-91b4-941cc77b254e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:49.342803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1a049d1-b21e-4f11-91b4-941cc77b254e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:49.343417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1a049d1-b21e-4f11-91b4-941cc77b254e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:49.969893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a1a049d1-b21e-4f11-91b4-941cc77b254e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:49.986192 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1a049d1-b21e-4f11-91b4-941cc77b254e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1388 microversion: 2.1 time: 0.673625 Aug 18 11:26:49.986738 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 220/504] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:49 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1388 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:49.992264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-50eb336f-f65f-43b9-b5ed-4b4e9ccb14a1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:49.992783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-50eb336f-f65f-43b9-b5ed-4b4e9ccb14a1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:50.008531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50eb336f-f65f-43b9-b5ed-4b4e9ccb14a1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:50.011319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50eb336f-f65f-43b9-b5ed-4b4e9ccb14a1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:50.012759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50eb336f-f65f-43b9-b5ed-4b4e9ccb14a1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:50.013632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50eb336f-f65f-43b9-b5ed-4b4e9ccb14a1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:50.014260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50eb336f-f65f-43b9-b5ed-4b4e9ccb14a1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:50.014996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50eb336f-f65f-43b9-b5ed-4b4e9ccb14a1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:50.020270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:50.149593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-50eb336f-f65f-43b9-b5ed-4b4e9ccb14a1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:50.158470 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-50eb336f-f65f-43b9-b5ed-4b4e9ccb14a1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1294 microversion: 2.1 time: 0.170360 Aug 18 11:26:50.163697 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 221/505] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:49 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1294 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:50.172248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0c782360-f0da-4e32-8cb4-d0ffef60eefa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:50.177695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0c782360-f0da-4e32-8cb4-d0ffef60eefa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:50.182618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:50.195538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c782360-f0da-4e32-8cb4-d0ffef60eefa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:50.197319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c782360-f0da-4e32-8cb4-d0ffef60eefa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:50.199925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c782360-f0da-4e32-8cb4-d0ffef60eefa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:50.200784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c782360-f0da-4e32-8cb4-d0ffef60eefa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:50.201329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c782360-f0da-4e32-8cb4-d0ffef60eefa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:50.207474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c782360-f0da-4e32-8cb4-d0ffef60eefa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:50.468538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0c782360-f0da-4e32-8cb4-d0ffef60eefa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:50.477903 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0c782360-f0da-4e32-8cb4-d0ffef60eefa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1319 microversion: 2.1 time: 0.312947 Aug 18 11:26:50.485364 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 222/506] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:50 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:50.493254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-00663cfb-8921-415c-824f-9ea8fc3e0d50 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:50.494261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-00663cfb-8921-415c-824f-9ea8fc3e0d50 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:50.513584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00663cfb-8921-415c-824f-9ea8fc3e0d50 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:50.514233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00663cfb-8921-415c-824f-9ea8fc3e0d50 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:50.514938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00663cfb-8921-415c-824f-9ea8fc3e0d50 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:50.515862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00663cfb-8921-415c-824f-9ea8fc3e0d50 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:50.516505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00663cfb-8921-415c-824f-9ea8fc3e0d50 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:50.518905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00663cfb-8921-415c-824f-9ea8fc3e0d50 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:50.940340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-00663cfb-8921-415c-824f-9ea8fc3e0d50 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:50.948136 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-00663cfb-8921-415c-824f-9ea8fc3e0d50 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1474 microversion: 2.1 time: 0.461665 Aug 18 11:26:50.952861 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 223/507] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:50 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1474 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:51.008734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-671e0a64-1626-4907-86d8-f3a6d9a4a9f2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:51.009488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-671e0a64-1626-4907-86d8-f3a6d9a4a9f2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:51.017939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-671e0a64-1626-4907-86d8-f3a6d9a4a9f2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:51.026652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-671e0a64-1626-4907-86d8-f3a6d9a4a9f2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:51.027624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-671e0a64-1626-4907-86d8-f3a6d9a4a9f2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:51.028813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-671e0a64-1626-4907-86d8-f3a6d9a4a9f2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:51.029451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-671e0a64-1626-4907-86d8-f3a6d9a4a9f2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:51.030038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-671e0a64-1626-4907-86d8-f3a6d9a4a9f2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:51.293314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-671e0a64-1626-4907-86d8-f3a6d9a4a9f2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:51.309469 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-671e0a64-1626-4907-86d8-f3a6d9a4a9f2 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1388 microversion: 2.1 time: 0.304116 Aug 18 11:26:51.322458 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 224/508] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:51 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1388 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:51.322458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6897fc91-3707-4262-ac29-9562fa251702 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:51.322458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6897fc91-3707-4262-ac29-9562fa251702 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:51.330740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6897fc91-3707-4262-ac29-9562fa251702 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:51.331241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6897fc91-3707-4262-ac29-9562fa251702 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:51.331679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6897fc91-3707-4262-ac29-9562fa251702 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:51.332561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6897fc91-3707-4262-ac29-9562fa251702 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:51.333030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6897fc91-3707-4262-ac29-9562fa251702 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:51.333726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6897fc91-3707-4262-ac29-9562fa251702 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:51.491534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6897fc91-3707-4262-ac29-9562fa251702 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:51.505014 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6897fc91-3707-4262-ac29-9562fa251702 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1282 microversion: 2.1 time: 0.191279 Aug 18 11:26:51.507629 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 225/509] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:51 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:51.697766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-853209c4-2ff2-4ed5-833a-f367a71596e8 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Calling method '.version_select at 0x7f519fee6700>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:51.700661 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:51.700661 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:51.702249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-853209c4-2ff2-4ed5-833a-f367a71596e8 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:51.707199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-853209c4-2ff2-4ed5-833a-f367a71596e8 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:51.707971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-853209c4-2ff2-4ed5-833a-f367a71596e8 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:51.709040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-853209c4-2ff2-4ed5-833a-f367a71596e8 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:51.710665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-853209c4-2ff2-4ed5-833a-f367a71596e8 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:51.711515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-853209c4-2ff2-4ed5-833a-f367a71596e8 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:51.779923 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-853209c4-2ff2-4ed5-833a-f367a71596e8 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.271040 Aug 18 11:26:51.788068 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 226/510] 10.222.0.73 () {58 vars in 1128 bytes} [Thu Aug 18 11:26:51 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:51.799737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-78181c15-b5d9-4e01-a589-7dc091736b59 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:51.807558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-78181c15-b5d9-4e01-a589-7dc091736b59 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:51.822453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78181c15-b5d9-4e01-a589-7dc091736b59 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:51.822969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78181c15-b5d9-4e01-a589-7dc091736b59 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:51.823410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78181c15-b5d9-4e01-a589-7dc091736b59 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:51.824136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78181c15-b5d9-4e01-a589-7dc091736b59 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:51.824659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78181c15-b5d9-4e01-a589-7dc091736b59 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:51.825105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78181c15-b5d9-4e01-a589-7dc091736b59 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:52.058626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:26:52.058626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:26:52.059265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:26:52.059579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:26:52.059880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:26:52.080440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:52.080862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:52.081307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:52.082091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:52.082601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:52.091996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:52.098075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-78181c15-b5d9-4e01-a589-7dc091736b59 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:52.109164 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-78181c15-b5d9-4e01-a589-7dc091736b59 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1319 microversion: 2.1 time: 0.316606 Aug 18 11:26:52.109840 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 227/511] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:51 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:52.160266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Getting quotas for project 51319140bae948cf873746a482aaf588. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:26:52.174969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Getting quotas for user 36162046d3d84db98ce76b19770f6322 and project 51319140bae948cf873746a482aaf588. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:26:52.199032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:26:52.207917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:26:52.327597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3236a405-4970-47a9-b6c5-4d97a823842d tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Calling method '.version_select at 0x7f519fed9310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:52.330258 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:52.330258 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:52.331500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3236a405-4970-47a9-b6c5-4d97a823842d tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'ae21d83e7dd24d7da915982431c9e01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52463bb6ed94e9096186fbeb93b4cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3236a405-4970-47a9-b6c5-4d97a823842d tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Request method failure captured: Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iH61EI83Aah-OT3ZiMZedPQW_quuY5mEI90d8WTrd510Vlk9Nw3ayC_pO7WeU1ERiyOq-W7kzaAfZYZ12SzJqYUytyMZt2O6v5bbAWj0ZV6WndMAxl40UpENNnuDuPEk1Tz3DSR5Cs4y_6UiV7Bt2Eju-6oxb9KTl0OtfZnSG0ptqs Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c52463bb6ed94e9096186fbeb93b4cb9 Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:26:52.341851 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:26:52.343581 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:52.343581 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:52.343581 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c52463bb6ed94e9096186fbeb93b4cb9 Aug 18 11:26:52.343581 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:52.343581 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-HostsAdminNegativeTestJSON-1358589411-project Aug 18 11:26:52.343581 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:52.343581 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:52.343581 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ae21d83e7dd24d7da915982431c9e01e Aug 18 11:26:52.343581 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1358589411-project Aug 18 11:26:52.343581 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:26:52.343581 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 18 11:26:52.343581 n-d-853611-3 devstack@n-api.service[122210]: action_args: {} Aug 18 11:26:52.343581 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:26:52.344585 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 18 11:26:52.345755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:52.346867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3236a405-4970-47a9-b6c5-4d97a823842d tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:52.346867 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3236a405-4970-47a9-b6c5-4d97a823842d tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] 10.222.0.73 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.231228 Aug 18 11:26:52.347672 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 228/512] 10.222.0.73 () {58 vars in 1128 bytes} [Thu Aug 18 11:26:52 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 237 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:52.359523 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a91c99a8-f07a-4ce1-ac5e-6b978f920c58 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.669749 Aug 18 11:26:52.364816 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 285/513] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:26:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3676 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 11:26:52.379305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5fbfa30f-1a33-4f39-954d-78616ab7ddb2 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:52.379931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5fbfa30f-1a33-4f39-954d-78616ab7ddb2 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:52.392677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d8a25540-80fb-4618-9928-766e417492b7 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:52.409013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d8a25540-80fb-4618-9928-766e417492b7 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:52.446986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8a25540-80fb-4618-9928-766e417492b7 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:52.447806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fbfa30f-1a33-4f39-954d-78616ab7ddb2 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:52.448536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fbfa30f-1a33-4f39-954d-78616ab7ddb2 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:52.448978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fbfa30f-1a33-4f39-954d-78616ab7ddb2 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:52.452186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fbfa30f-1a33-4f39-954d-78616ab7ddb2 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:52.452726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fbfa30f-1a33-4f39-954d-78616ab7ddb2 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:52.453159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fbfa30f-1a33-4f39-954d-78616ab7ddb2 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:52.453454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8a25540-80fb-4618-9928-766e417492b7 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:52.454311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8a25540-80fb-4618-9928-766e417492b7 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:52.457008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8a25540-80fb-4618-9928-766e417492b7 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:52.461193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8a25540-80fb-4618-9928-766e417492b7 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:52.462598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8a25540-80fb-4618-9928-766e417492b7 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:53.437698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5fbfa30f-1a33-4f39-954d-78616ab7ddb2 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffb27f7ddc54fe59b815112f0601848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7543ea6a7a5d4831b185b45f59c6a31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:53.446993 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5fbfa30f-1a33-4f39-954d-78616ab7ddb2 tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 200 len: 1432 microversion: 2.1 time: 1.086061 Aug 18 11:26:53.451803 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 229/514] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:52 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 1432 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:53.467194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b78cb53-b6b1-469b-bdab-d6587882d397 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Calling method '.version_select at 0x7f519fed9310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:53.468631 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:53.468631 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:53.470700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8b78cb53-b6b1-469b-bdab-d6587882d397 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'ae21d83e7dd24d7da915982431c9e01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52463bb6ed94e9096186fbeb93b4cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b78cb53-b6b1-469b-bdab-d6587882d397 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Request method failure captured: Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-hosts/n-d-853611-3/reboot HTTP/1.1 Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iH61EI83Aah-OT3ZiMZedPQW_quuY5mEI90d8WTrd510Vlk9Nw3ayC_pO7WeU1ERiyOq-W7kzaAfZYZ12SzJqYUytyMZt2O6v5bbAWj0ZV6WndMAxl40UpENNnuDuPEk1Tz3DSR5Cs4y_6UiV7Bt2Eju-6oxb9KTl0OtfZnSG0ptqs Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c52463bb6ed94e9096186fbeb93b4cb9 Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:26:53.479807 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:26:53.481671 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:53.481671 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:53.481671 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c52463bb6ed94e9096186fbeb93b4cb9 Aug 18 11:26:53.481671 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:53.481671 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-HostsAdminNegativeTestJSON-1358589411-project Aug 18 11:26:53.481671 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:53.481671 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:53.481671 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ae21d83e7dd24d7da915982431c9e01e Aug 18 11:26:53.481671 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1358589411-project Aug 18 11:26:53.481671 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:26:53.481671 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 18 11:26:53.481671 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'n-d-853611-3'} Aug 18 11:26:53.481671 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:26:53.482633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 18 11:26:53.484066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:53.486348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b78cb53-b6b1-469b-bdab-d6587882d397 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:53.486348 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8b78cb53-b6b1-469b-bdab-d6587882d397 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] 10.222.0.73 "GET /compute/v2.1/os-hosts/n-d-853611-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.029392 Aug 18 11:26:53.486348 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 230/515] 10.222.0.73 () {58 vars in 1188 bytes} [Thu Aug 18 11:26:53 2022] GET /compute/v2.1/os-hosts/n-d-853611-3/reboot => generated 111 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:53.494961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-969e1635-ae84-4c92-a7f6-77452aaf759a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:53.495620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-969e1635-ae84-4c92-a7f6-77452aaf759a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:53.639342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-969e1635-ae84-4c92-a7f6-77452aaf759a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:53.653113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-969e1635-ae84-4c92-a7f6-77452aaf759a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:53.655657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-969e1635-ae84-4c92-a7f6-77452aaf759a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:53.657299 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-969e1635-ae84-4c92-a7f6-77452aaf759a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1262 microversion: 2.25 time: 0.171622 Aug 18 11:26:53.675493 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 231/516] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:26:53 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1262 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:26:53.690798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fbc333be-701b-4c09-b9a8-5340c438c841 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:53.693778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fbc333be-701b-4c09-b9a8-5340c438c841 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:53.719163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbc333be-701b-4c09-b9a8-5340c438c841 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:53.720090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbc333be-701b-4c09-b9a8-5340c438c841 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:53.720713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbc333be-701b-4c09-b9a8-5340c438c841 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:53.721603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbc333be-701b-4c09-b9a8-5340c438c841 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:53.722225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbc333be-701b-4c09-b9a8-5340c438c841 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:53.722864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbc333be-701b-4c09-b9a8-5340c438c841 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:53.963162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d8a25540-80fb-4618-9928-766e417492b7 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:53.981054 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d8a25540-80fb-4618-9928-766e417492b7 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1388 microversion: 2.1 time: 1.615081 Aug 18 11:26:53.981839 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 286/517] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:52 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1388 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:53.991594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-c9e00a48-50d0-4472-8295-286ccd741154 req-eec51180-87e5-48d4-8b2f-39113a1d54e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c93772-3966-4484-b45e-712ad8e4a0e7", "name": "network-vif-deleted", "tag": "623c601b-a04a-4702-8337-83cb720444a3"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:54.012286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c9e00a48-50d0-4472-8295-286ccd741154 req-eec51180-87e5-48d4-8b2f-39113a1d54e3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:54.013006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c9e00a48-50d0-4472-8295-286ccd741154 req-eec51180-87e5-48d4-8b2f-39113a1d54e3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:54.013655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c9e00a48-50d0-4472-8295-286ccd741154 req-eec51180-87e5-48d4-8b2f-39113a1d54e3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:54.039591 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-c9e00a48-50d0-4472-8295-286ccd741154 req-eec51180-87e5-48d4-8b2f-39113a1d54e3 service nova] Creating event network-vif-deleted:623c601b-a04a-4702-8337-83cb720444a3 for instance d5c93772-3966-4484-b45e-712ad8e4a0e7 on n-h2-853611-3 Aug 18 11:26:54.049509 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-c9e00a48-50d0-4472-8295-286ccd741154 req-eec51180-87e5-48d4-8b2f-39113a1d54e3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065422 Aug 18 11:26:54.051578 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 287/518] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:54.064354 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a93d6d41-f715-4c3e-8eb6-3d474bb3092e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:54.065065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a93d6d41-f715-4c3e-8eb6-3d474bb3092e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:54.072952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a93d6d41-f715-4c3e-8eb6-3d474bb3092e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:54.074312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a93d6d41-f715-4c3e-8eb6-3d474bb3092e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:54.074969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a93d6d41-f715-4c3e-8eb6-3d474bb3092e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:54.076725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a93d6d41-f715-4c3e-8eb6-3d474bb3092e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:54.077364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a93d6d41-f715-4c3e-8eb6-3d474bb3092e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:54.077952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a93d6d41-f715-4c3e-8eb6-3d474bb3092e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:54.303546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fbc333be-701b-4c09-b9a8-5340c438c841 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:54.315541 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fbc333be-701b-4c09-b9a8-5340c438c841 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1324 microversion: 2.1 time: 0.633512 Aug 18 11:26:54.317134 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 232/519] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:53 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1324 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:54.333388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8bb60358-f2d9-4629-ac9f-f388254f2e35 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Calling method '.version_select at 0x7f519fed9790>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:54.340414 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:54.340414 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:54.362849 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-8bb60358-f2d9-4629-ac9f-f388254f2e35 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8bb60358-f2d9-4629-ac9f-f388254f2e35 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Request method failure captured: Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iH7UsmJutaMSy5NBtjJ7uxaQbMt7w8QpryqORsZPKGGAe61PCREXs2VC8oBUABrPGabW6H9ConOV3fAlTGU6PRErfOklhSP_Gn2ztd8SlygJyxrMuNj-osNuDKptHPLAtlJAvNkMgT0NC2Lsc9aGGzypgq-60wHB1m-uPh_r6pw78M Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:26:54.365100 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:26:54.367191 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4f8197ed3e9e45548061babb7010e131"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:54.367191 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:54.367191 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:54.367191 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:54.367191 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:54.367191 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:54.367191 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:54.367191 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ec20d925d9a64d51953a308faf1fa42c Aug 18 11:26:54.367191 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:54.367191 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:26:54.367191 n-d-853611-3 devstack@n-api.service[122210]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.367191 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'nonexistent_hostname'} Aug 18 11:26:54.367191 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:26:54.368070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 18 11:26:54.369371 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:26:54.370765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.370765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.370765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:54.370765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.370765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.370765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:54.370765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:54.370765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:54.370765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:54.370765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.370765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.372724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8bb60358-f2d9-4629-ac9f-f388254f2e35 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:54.373912 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8bb60358-f2d9-4629-ac9f-f388254f2e35 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.055427 Aug 18 11:26:54.375037 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 233/520] 10.222.0.73 () {58 vars in 1212 bytes} [Thu Aug 18 11:26:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:26:54.383916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5dfdcf18-05cc-4e7e-8472-ae92c0e2f3c1 req-8479856d-85f9-4b63-b827-fc262b540641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b", "name": "network-vif-plugged", "status": "completed", "tag": "df5c2bde-2e96-4148-91da-df8c38a12161"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:54.396748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5dfdcf18-05cc-4e7e-8472-ae92c0e2f3c1 req-8479856d-85f9-4b63-b827-fc262b540641 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:54.397717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5dfdcf18-05cc-4e7e-8472-ae92c0e2f3c1 req-8479856d-85f9-4b63-b827-fc262b540641 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:54.398386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5dfdcf18-05cc-4e7e-8472-ae92c0e2f3c1 req-8479856d-85f9-4b63-b827-fc262b540641 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:54.412618 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5dfdcf18-05cc-4e7e-8472-ae92c0e2f3c1 req-8479856d-85f9-4b63-b827-fc262b540641 service nova] Creating event network-vif-plugged:df5c2bde-2e96-4148-91da-df8c38a12161 for instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b on n-h2-853611-3 Aug 18 11:26:54.419482 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5dfdcf18-05cc-4e7e-8472-ae92c0e2f3c1 req-8479856d-85f9-4b63-b827-fc262b540641 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042978 Aug 18 11:26:54.420769 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 234/521] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:54.430031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb72525e-9420-4158-aa32-393763c88f6f tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Calling method '.version_select at 0x7f51ac245d30>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:54.431250 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:54.431250 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:54.432872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bb72525e-9420-4158-aa32-393763c88f6f tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'ae21d83e7dd24d7da915982431c9e01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52463bb6ed94e9096186fbeb93b4cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb72525e-9420-4158-aa32-393763c88f6f tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Request method failure captured: Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-hosts/n-d-853611-3 HTTP/1.1 Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iH61EI83Aah-OT3ZiMZedPQW_quuY5mEI90d8WTrd510Vlk9Nw3ayC_pO7WeU1ERiyOq-W7kzaAfZYZ12SzJqYUytyMZt2O6v5bbAWj0ZV6WndMAxl40UpENNnuDuPEk1Tz3DSR5Cs4y_6UiV7Bt2Eju-6oxb9KTl0OtfZnSG0ptqs Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c52463bb6ed94e9096186fbeb93b4cb9 Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:26:54.435303 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:26:54.436814 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:54.436814 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:54.436814 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c52463bb6ed94e9096186fbeb93b4cb9 Aug 18 11:26:54.436814 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:54.436814 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-HostsAdminNegativeTestJSON-1358589411-project Aug 18 11:26:54.436814 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:54.436814 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:54.436814 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ae21d83e7dd24d7da915982431c9e01e Aug 18 11:26:54.436814 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1358589411-project Aug 18 11:26:54.436814 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:26:54.436814 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 18 11:26:54.436814 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'n-d-853611-3'} Aug 18 11:26:54.436814 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:26:54.437701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 18 11:26:54.439464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.441507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb72525e-9420-4158-aa32-393763c88f6f tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:54.442562 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bb72525e-9420-4158-aa32-393763c88f6f tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] 10.222.0.73 "GET /compute/v2.1/os-hosts/n-d-853611-3" status: 403 len: 109 microversion: 2.1 time: 0.020547 Aug 18 11:26:54.444544 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 235/522] 10.222.0.73 () {58 vars in 1167 bytes} [Thu Aug 18 11:26:54 2022] GET /compute/v2.1/os-hosts/n-d-853611-3 => generated 109 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:54.463905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d1882245-31a5-4a64-a0b0-7a50915cee49 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Calling method '.version_select at 0x7f519fed9f70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:54.482417 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-d1882245-31a5-4a64-a0b0-7a50915cee49 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d1882245-31a5-4a64-a0b0-7a50915cee49 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Request method failure captured: Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iH7UsmJutaMSy5NBtjJ7uxaQbMt7w8QpryqORsZPKGGAe61PCREXs2VC8oBUABrPGabW6H9ConOV3fAlTGU6PRErfOklhSP_Gn2ztd8SlygJyxrMuNj-osNuDKptHPLAtlJAvNkMgT0NC2Lsc9aGGzypgq-60wHB1m-uPh_r6pw78M Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:26:54.484988 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:26:54.486593 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4f8197ed3e9e45548061babb7010e131"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:54.486593 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:54.486593 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:54.486593 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:54.486593 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:54.486593 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:54.486593 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:54.486593 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ec20d925d9a64d51953a308faf1fa42c Aug 18 11:26:54.486593 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:54.486593 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:26:54.486593 n-d-853611-3 devstack@n-api.service[122210]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.486593 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'nonexistent_hostname'} Aug 18 11:26:54.486593 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:54.487485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.488737 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.494510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d1882245-31a5-4a64-a0b0-7a50915cee49 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:54.499437 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d1882245-31a5-4a64-a0b0-7a50915cee49 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.045241 Aug 18 11:26:54.501662 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 236/523] 10.222.0.73 () {58 vars in 1191 bytes} [Thu Aug 18 11:26:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:26:54.513368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac4abc3f-fad8-4847-93ce-acfc1daf172b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:54.514120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ac4abc3f-fad8-4847-93ce-acfc1daf172b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] [instance: d5c93772-3966-4484-b45e-712ad8e4a0e7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:54.545710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac4abc3f-fad8-4847-93ce-acfc1daf172b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:54.548823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac4abc3f-fad8-4847-93ce-acfc1daf172b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:54.549518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac4abc3f-fad8-4847-93ce-acfc1daf172b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:54.551439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac4abc3f-fad8-4847-93ce-acfc1daf172b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:54.556685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac4abc3f-fad8-4847-93ce-acfc1daf172b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:54.558365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac4abc3f-fad8-4847-93ce-acfc1daf172b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:54.599978 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-ac4abc3f-fad8-4847-93ce-acfc1daf172b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] HTTP exception thrown: Instance d5c93772-3966-4484-b45e-712ad8e4a0e7 could not be found. Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac4abc3f-fad8-4847-93ce-acfc1daf172b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Request method failure captured: Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 HTTP/1.1 Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iG1cEWuo6mQYh5T0mM0m6StnAkEWlp7y4woTcJynn08JSlshxgOESqYkfbKLxDtRK2wHqFUYPd2pZpTvxo9nxNOdeMTIo4cxFvtxZqOFYaU5O2_qXVTRCjEJfNwiYZc8KXerfuHkMdyi83Nw1OFk6OEB6z8fo-EoQqyifC28IbMcGA Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 7543ea6a7a5d4831b185b45f59c6a31d Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-LiveMigrationNegativeTest-1973583807 Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:26:54.601363 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:26:54.603226 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7543ea6a7a5d4831b185b45f59c6a31d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7543ea6a7a5d4831b185b45f59c6a31d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7543ea6a7a5d4831b185b45f59c6a31d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7543ea6a7a5d4831b185b45f59c6a31d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:54.603226 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-LiveMigrationNegativeTest-1973583807 Aug 18 11:26:54.603226 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 7543ea6a7a5d4831b185b45f59c6a31d Aug 18 11:26:54.603226 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1973583807 Aug 18 11:26:54.603226 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-LiveMigrationNegativeTest-1973583807-project Aug 18 11:26:54.603226 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:54.603226 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:54.603226 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 9ffb27f7ddc54fe59b815112f0601848 Aug 18 11:26:54.603226 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-LiveMigrationNegativeTest-1973583807-project Aug 18 11:26:54.603226 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:26:54.603226 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance d5c93772-3966-4484-b45e-712ad8e4a0e7 could not be found. Aug 18 11:26:54.603226 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'd5c93772-3966-4484-b45e-712ad8e4a0e7'} Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c93772-3966-4484-b45e-712ad8e4a0e7 could not be found. Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:54.604066 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c93772-3966-4484-b45e-712ad8e4a0e7 could not be found. Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c93772-3966-4484-b45e-712ad8e4a0e7 could not be found. Aug 18 11:26:54.605405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.606517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac4abc3f-fad8-4847-93ce-acfc1daf172b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] Returning 404 to user: Instance d5c93772-3966-4484-b45e-712ad8e4a0e7 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:54.606517 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ac4abc3f-fad8-4847-93ce-acfc1daf172b tempest-LiveMigrationNegativeTest-1973583807 tempest-LiveMigrationNegativeTest-1973583807-project] 10.222.0.73 "GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7" status: 404 len: 111 microversion: 2.1 time: 0.099866 Aug 18 11:26:54.609720 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 237/524] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:54 2022] GET /compute/v2.1/servers/d5c93772-3966-4484-b45e-712ad8e4a0e7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:54.620470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cce72aec-269d-4293-aff0-b1d6cff7c27c tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Calling method '.version_select at 0x7f519fed90d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:54.623042 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:54.623042 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:54.627207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cce72aec-269d-4293-aff0-b1d6cff7c27c tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'ae21d83e7dd24d7da915982431c9e01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52463bb6ed94e9096186fbeb93b4cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cce72aec-269d-4293-aff0-b1d6cff7c27c tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Request method failure captured: Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-hosts/n-d-853611-3/shutdown HTTP/1.1 Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iH61EI83Aah-OT3ZiMZedPQW_quuY5mEI90d8WTrd510Vlk9Nw3ayC_pO7WeU1ERiyOq-W7kzaAfZYZ12SzJqYUytyMZt2O6v5bbAWj0ZV6WndMAxl40UpENNnuDuPEk1Tz3DSR5Cs4y_6UiV7Bt2Eju-6oxb9KTl0OtfZnSG0ptqs Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c52463bb6ed94e9096186fbeb93b4cb9 Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:26:54.632205 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:26:54.633654 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:54.633654 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:54.633654 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c52463bb6ed94e9096186fbeb93b4cb9 Aug 18 11:26:54.633654 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:54.633654 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-HostsAdminNegativeTestJSON-1358589411-project Aug 18 11:26:54.633654 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:54.633654 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:54.633654 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ae21d83e7dd24d7da915982431c9e01e Aug 18 11:26:54.633654 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1358589411-project Aug 18 11:26:54.633654 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:26:54.633654 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 18 11:26:54.633654 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'n-d-853611-3'} Aug 18 11:26:54.633654 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:26:54.641555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 18 11:26:54.642863 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.648649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cce72aec-269d-4293-aff0-b1d6cff7c27c tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:54.650103 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cce72aec-269d-4293-aff0-b1d6cff7c27c tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] 10.222.0.73 "GET /compute/v2.1/os-hosts/n-d-853611-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.039888 Aug 18 11:26:54.651966 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 238/525] 10.222.0.73 () {58 vars in 1194 bytes} [Thu Aug 18 11:26:54 2022] GET /compute/v2.1/os-hosts/n-d-853611-3/shutdown => generated 113 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:54.663021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-735d8432-28a0-4d9c-a591-7c38e767da5b tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Calling method '.version_select at 0x7f519fee64c0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:54.677009 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-735d8432-28a0-4d9c-a591-7c38e767da5b tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-735d8432-28a0-4d9c-a591-7c38e767da5b tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Request method failure captured: Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iH7UsmJutaMSy5NBtjJ7uxaQbMt7w8QpryqORsZPKGGAe61PCREXs2VC8oBUABrPGabW6H9ConOV3fAlTGU6PRErfOklhSP_Gn2ztd8SlygJyxrMuNj-osNuDKptHPLAtlJAvNkMgT0NC2Lsc9aGGzypgq-60wHB1m-uPh_r6pw78M Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:26:54.680168 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:26:54.681731 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4f8197ed3e9e45548061babb7010e131"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:54.681731 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:54.681731 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:54.681731 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:54.681731 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:54.681731 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:54.681731 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:54.681731 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ec20d925d9a64d51953a308faf1fa42c Aug 18 11:26:54.681731 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:54.681731 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:26:54.681731 n-d-853611-3 devstack@n-api.service[122210]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.681731 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'nonexistent_hostname'} Aug 18 11:26:54.681731 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:26:54.682692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 18 11:26:54.683969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:26:54.685264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.685264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.685264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:54.685264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.685264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.685264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:54.685264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:54.685264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:54.685264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:54.685264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:54.685264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.687217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-735d8432-28a0-4d9c-a591-7c38e767da5b tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:54.688239 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-735d8432-28a0-4d9c-a591-7c38e767da5b tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.031180 Aug 18 11:26:54.689268 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 239/526] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 18 11:26:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 18 11:26:54.709049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d2ffd3b3-63d7-4552-a159-65359839a9e8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:54.710193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d2ffd3b3-63d7-4552-a159-65359839a9e8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:54.719942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2ffd3b3-63d7-4552-a159-65359839a9e8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:54.720438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2ffd3b3-63d7-4552-a159-65359839a9e8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:54.720873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2ffd3b3-63d7-4552-a159-65359839a9e8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:54.721588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2ffd3b3-63d7-4552-a159-65359839a9e8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:54.722038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2ffd3b3-63d7-4552-a159-65359839a9e8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:54.722522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2ffd3b3-63d7-4552-a159-65359839a9e8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:54.907729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2ffd3b3-63d7-4552-a159-65359839a9e8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:54.922036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2ffd3b3-63d7-4552-a159-65359839a9e8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:54.925554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2ffd3b3-63d7-4552-a159-65359839a9e8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:54.929267 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d2ffd3b3-63d7-4552-a159-65359839a9e8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1332 microversion: 2.25 time: 0.238016 Aug 18 11:26:54.931390 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 240/527] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:26:54 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1332 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:26:54.940529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2813632e-1a81-4e69-a088-8f277b397b07 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Calling method '.version_select at 0x7f519fee6790>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:54.944840 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:54.944840 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:26:54.950011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2813632e-1a81-4e69-a088-8f277b397b07 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'ae21d83e7dd24d7da915982431c9e01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52463bb6ed94e9096186fbeb93b4cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2813632e-1a81-4e69-a088-8f277b397b07 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Request method failure captured: Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-hosts/n-d-853611-3/startup HTTP/1.1 Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iH61EI83Aah-OT3ZiMZedPQW_quuY5mEI90d8WTrd510Vlk9Nw3ayC_pO7WeU1ERiyOq-W7kzaAfZYZ12SzJqYUytyMZt2O6v5bbAWj0ZV6WndMAxl40UpENNnuDuPEk1Tz3DSR5Cs4y_6UiV7Bt2Eju-6oxb9KTl0OtfZnSG0ptqs Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c52463bb6ed94e9096186fbeb93b4cb9 Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:26:54.953189 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:26:54.956199 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:54.956199 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:54.956199 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c52463bb6ed94e9096186fbeb93b4cb9 Aug 18 11:26:54.956199 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:54.956199 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-HostsAdminNegativeTestJSON-1358589411-project Aug 18 11:26:54.956199 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:54.956199 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:54.956199 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ae21d83e7dd24d7da915982431c9e01e Aug 18 11:26:54.956199 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1358589411-project Aug 18 11:26:54.956199 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:26:54.956199 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 18 11:26:54.956199 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'n-d-853611-3'} Aug 18 11:26:54.956199 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:26:54.957074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 18 11:26:54.958481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:54.960746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2813632e-1a81-4e69-a088-8f277b397b07 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:54.962402 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2813632e-1a81-4e69-a088-8f277b397b07 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] 10.222.0.73 "GET /compute/v2.1/os-hosts/n-d-853611-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.029796 Aug 18 11:26:54.966905 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 241/528] 10.222.0.73 () {58 vars in 1191 bytes} [Thu Aug 18 11:26:54 2022] GET /compute/v2.1/os-hosts/n-d-853611-3/startup => generated 110 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:54.980156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24bb8e31-346d-496f-91de-dc90b875e937 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Calling method '.version_select at 0x7f519fed98b0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:55.003351 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-24bb8e31-346d-496f-91de-dc90b875e937 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24bb8e31-346d-496f-91de-dc90b875e937 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Request method failure captured: Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iH7UsmJutaMSy5NBtjJ7uxaQbMt7w8QpryqORsZPKGGAe61PCREXs2VC8oBUABrPGabW6H9ConOV3fAlTGU6PRErfOklhSP_Gn2ztd8SlygJyxrMuNj-osNuDKptHPLAtlJAvNkMgT0NC2Lsc9aGGzypgq-60wHB1m-uPh_r6pw78M Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:26:55.006509 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:26:55.008157 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4f8197ed3e9e45548061babb7010e131"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:55.008157 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.008157 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:55.008157 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.008157 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:55.008157 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:26:55.008157 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:26:55.008157 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ec20d925d9a64d51953a308faf1fa42c Aug 18 11:26:55.008157 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:55.008157 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:26:55.008157 n-d-853611-3 devstack@n-api.service[122210]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:55.008157 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'nonexistent_hostname'} Aug 18 11:26:55.008157 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:26:55.009223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 18 11:26:55.010500 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:26:55.012324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:55.012324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.012324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:55.012324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.012324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.012324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:55.012324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:55.012324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:55.012324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:55.012324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:55.012324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.019792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24bb8e31-346d-496f-91de-dc90b875e937 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:55.022039 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-24bb8e31-346d-496f-91de-dc90b875e937 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.049131 Aug 18 11:26:55.024851 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 242/529] 10.222.0.73 () {58 vars in 1215 bytes} [Thu Aug 18 11:26:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 18 11:26:55.043598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-385e5c71-116b-4aba-b610-1a1f73c1cee0 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:55.053367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-385e5c71-116b-4aba-b610-1a1f73c1cee0 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:55.061057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a93d6d41-f715-4c3e-8eb6-3d474bb3092e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:55.070103 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a93d6d41-f715-4c3e-8eb6-3d474bb3092e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1319 microversion: 2.1 time: 1.016104 Aug 18 11:26:55.073809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-385e5c71-116b-4aba-b610-1a1f73c1cee0 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:55.075490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-385e5c71-116b-4aba-b610-1a1f73c1cee0 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:55.077087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-385e5c71-116b-4aba-b610-1a1f73c1cee0 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:55.078445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-385e5c71-116b-4aba-b610-1a1f73c1cee0 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:55.079123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-385e5c71-116b-4aba-b610-1a1f73c1cee0 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:55.080572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-385e5c71-116b-4aba-b610-1a1f73c1cee0 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:55.088922 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 288/530] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:54 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1319 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:55.093996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c7551f35-71e4-46c7-a4d7-705bc8536939 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Action: 'update', calling method: .version_select at 0x7f51ac15e3a0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c7551f35-71e4-46c7-a4d7-705bc8536939 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Request method failure captured: Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: request: PUT /compute/v2.1/os-hosts/n-d-853611-3 HTTP/1.1 Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 51 Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iH7UsmJutaMSy5NBtjJ7uxaQbMt7w8QpryqORsZPKGGAe61PCREXs2VC8oBUABrPGabW6H9ConOV3fAlTGU6PRErfOklhSP_Gn2ztd8SlygJyxrMuNj-osNuDKptHPLAtlJAvNkMgT0NC2Lsc9aGGzypgq-60wHB1m-uPh_r6pw78M Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:26:55.098596 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:26:55.100524 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4f8197ed3e9e45548061babb7010e131"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:55.100524 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.100524 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:55.100524 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.100524 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:55.100524 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:55.100524 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:55.100524 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ec20d925d9a64d51953a308faf1fa42c Aug 18 11:26:55.100524 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:55.100524 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:26:55.100524 n-d-853611-3 devstack@n-api.service[122209]: {"status": "enable", "maintenance_mode": "invalid"} Aug 18 11:26:55.100524 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:26:55.100524 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'n-d-853611-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'disable', Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'Enable', Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'Disable', Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance: Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'invalid' Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.101559 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.103560 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:55.104856 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:55.104856 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:26:55.104856 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:26:55.104856 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 18 11:26:55.104856 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.112120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c7551f35-71e4-46c7-a4d7-705bc8536939 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:55.113301 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c7551f35-71e4-46c7-a4d7-705bc8536939 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-hosts/n-d-853611-3" status: 400 len: 199 microversion: 2.1 time: 0.023136 Aug 18 11:26:55.114093 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 289/531] 10.222.0.73 () {60 vars in 1187 bytes} [Thu Aug 18 11:26:55 2022] PUT /compute/v2.1/os-hosts/n-d-853611-3 => generated 199 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:26:55.124024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5fbbbc4f-66f0-4956-a164-aad39b73e53b tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Action: 'update', calling method: .version_select at 0x7f51ac0534c0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5fbbbc4f-66f0-4956-a164-aad39b73e53b tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Request method failure captured: Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: request: PUT /compute/v2.1/os-hosts/n-d-853611-3 HTTP/1.1 Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 51 Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iH7UsmJutaMSy5NBtjJ7uxaQbMt7w8QpryqORsZPKGGAe61PCREXs2VC8oBUABrPGabW6H9ConOV3fAlTGU6PRErfOklhSP_Gn2ztd8SlygJyxrMuNj-osNuDKptHPLAtlJAvNkMgT0NC2Lsc9aGGzypgq-60wHB1m-uPh_r6pw78M Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:26:55.128093 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:26:55.129693 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4f8197ed3e9e45548061babb7010e131"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:55.129693 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.129693 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:55.129693 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.129693 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:55.129693 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:55.129693 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:55.129693 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ec20d925d9a64d51953a308faf1fa42c Aug 18 11:26:55.129693 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:55.129693 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:26:55.129693 n-d-853611-3 devstack@n-api.service[122209]: {"status": "invalid", "maintenance_mode": "enable"} Aug 18 11:26:55.129693 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:26:55.129693 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'n-d-853611-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'disable', Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'Enable', Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'Disable', Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance: Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'invalid' Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.131007 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.133359 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:55.135124 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:55.135124 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:26:55.135124 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:26:55.135124 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 18 11:26:55.135124 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.140109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5fbbbc4f-66f0-4956-a164-aad39b73e53b tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:55.140109 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5fbbbc4f-66f0-4956-a164-aad39b73e53b tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-hosts/n-d-853611-3" status: 400 len: 189 microversion: 2.1 time: 0.019359 Aug 18 11:26:55.140109 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 290/532] 10.222.0.73 () {60 vars in 1187 bytes} [Thu Aug 18 11:26:55 2022] PUT /compute/v2.1/os-hosts/n-d-853611-3 => generated 189 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:26:55.163303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5503fa79-7cca-496c-a195-716782f26321 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Action: 'update', calling method: .version_select at 0x7f51ac166d30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:55.171870 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:26:55.171870 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:26:55.173276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5503fa79-7cca-496c-a195-716782f26321 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'ae21d83e7dd24d7da915982431c9e01e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c52463bb6ed94e9096186fbeb93b4cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5503fa79-7cca-496c-a195-716782f26321 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Request method failure captured: Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: request: PUT /compute/v2.1/os-hosts/n-d-853611-3 HTTP/1.1 Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 50 Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iH61EI83Aah-OT3ZiMZedPQW_quuY5mEI90d8WTrd510Vlk9Nw3ayC_pO7WeU1ERiyOq-W7kzaAfZYZ12SzJqYUytyMZt2O6v5bbAWj0ZV6WndMAxl40UpENNnuDuPEk1Tz3DSR5Cs4y_6UiV7Bt2Eju-6oxb9KTl0OtfZnSG0ptqs Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: c52463bb6ed94e9096186fbeb93b4cb9 Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:26:55.175355 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:26:55.176938 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c52463bb6ed94e9096186fbeb93b4cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:55.176938 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:55.176938 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: c52463bb6ed94e9096186fbeb93b4cb9 Aug 18 11:26:55.176938 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1358589411 Aug 18 11:26:55.176938 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-HostsAdminNegativeTestJSON-1358589411-project Aug 18 11:26:55.176938 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:55.176938 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:55.176938 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ae21d83e7dd24d7da915982431c9e01e Aug 18 11:26:55.176938 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1358589411-project Aug 18 11:26:55.176938 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:26:55.176938 n-d-853611-3 devstack@n-api.service[122209]: {"status": "enable", "maintenance_mode": "enable"} Aug 18 11:26:55.176938 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:26:55.176938 n-d-853611-3 devstack@n-api.service[122209]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 18 11:26:55.176938 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'n-d-853611-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:26:55.177872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 18 11:26:55.179964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.181018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5503fa79-7cca-496c-a195-716782f26321 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:55.181018 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5503fa79-7cca-496c-a195-716782f26321 tempest-HostsAdminNegativeTestJSON-1358589411 tempest-HostsAdminNegativeTestJSON-1358589411-project] 10.222.0.73 "PUT /compute/v2.1/os-hosts/n-d-853611-3" status: 403 len: 111 microversion: 2.1 time: 0.031792 Aug 18 11:26:55.181624 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 291/533] 10.222.0.73 () {60 vars in 1187 bytes} [Thu Aug 18 11:26:55 2022] PUT /compute/v2.1/os-hosts/n-d-853611-3 => generated 111 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:26:55.194999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-95d08eec-19ab-4dad-ae35-4e2599c2ac3b tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Action: 'update', calling method: .version_select at 0x7f51ac15e3a0>, body: {"status": null, "maintenance_mode": null} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-95d08eec-19ab-4dad-ae35-4e2599c2ac3b tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Request method failure captured: Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: request: PUT /compute/v2.1/os-hosts/n-d-853611-3 HTTP/1.1 Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 42 Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iH7UsmJutaMSy5NBtjJ7uxaQbMt7w8QpryqORsZPKGGAe61PCREXs2VC8oBUABrPGabW6H9ConOV3fAlTGU6PRErfOklhSP_Gn2ztd8SlygJyxrMuNj-osNuDKptHPLAtlJAvNkMgT0NC2Lsc9aGGzypgq-60wHB1m-uPh_r6pw78M Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:26:55.200464 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:26:55.201987 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4f8197ed3e9e45548061babb7010e131"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:55.201987 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.201987 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:55.201987 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.201987 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:55.201987 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:55.201987 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:55.201987 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ec20d925d9a64d51953a308faf1fa42c Aug 18 11:26:55.201987 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:55.201987 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:26:55.201987 n-d-853611-3 devstack@n-api.service[122209]: {"status": null, "maintenance_mode": null} Aug 18 11:26:55.201987 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:26:55.201987 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 18 11:26:55.201987 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'n-d-853611-3', 'body': {'status': None, 'maintenance_mode': None}} Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'disable', Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'Enable', Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'Disable', Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance: Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi None Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:55.203004 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:55.204672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:55.206288 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:26:55.206288 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:26:55.206288 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 18 11:26:55.206288 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.218229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-95d08eec-19ab-4dad-ae35-4e2599c2ac3b tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:55.219207 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-95d08eec-19ab-4dad-ae35-4e2599c2ac3b tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-hosts/n-d-853611-3" status: 400 len: 127 microversion: 2.1 time: 0.031220 Aug 18 11:26:55.224212 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 292/534] 10.222.0.73 () {60 vars in 1187 bytes} [Thu Aug 18 11:26:55 2022] PUT /compute/v2.1/os-hosts/n-d-853611-3 => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:26:55.230666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ebbbc044-c48a-404c-8217-3a759a679ca2 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Action: 'update', calling method: .version_select at 0x7f519fff05e0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:55.242070 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.hosts [None req-ebbbc044-c48a-404c-8217-3a759a679ca2 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Enabling host nonexistent_hostname. Aug 18 11:26:55.262983 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-ebbbc044-c48a-404c-8217-3a759a679ca2 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ebbbc044-c48a-404c-8217-3a759a679ca2 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Request method failure captured: Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 50 Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iH7UsmJutaMSy5NBtjJ7uxaQbMt7w8QpryqORsZPKGGAe61PCREXs2VC8oBUABrPGabW6H9ConOV3fAlTGU6PRErfOklhSP_Gn2ztd8SlygJyxrMuNj-osNuDKptHPLAtlJAvNkMgT0NC2Lsc9aGGzypgq-60wHB1m-uPh_r6pw78M Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:26:55.264790 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:26:55.266034 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4f8197ed3e9e45548061babb7010e131"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4f8197ed3e9e45548061babb7010e131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:26:55.266034 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.266034 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 4f8197ed3e9e45548061babb7010e131 Aug 18 11:26:55.266034 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1927811356 Aug 18 11:26:55.266034 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:55.266034 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:26:55.266034 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:26:55.266034 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ec20d925d9a64d51953a308faf1fa42c Aug 18 11:26:55.266034 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1927811356-project-admin Aug 18 11:26:55.266034 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:26:55.266034 n-d-853611-3 devstack@n-api.service[122209]: {"status": "enable", "maintenance_mode": "enable"} Aug 18 11:26:55.266034 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:26:55.266034 n-d-853611-3 devstack@n-api.service[122209]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:55.266034 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 18 11:26:55.266899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:26:55.267976 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:26:55.274486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ebbbc044-c48a-404c-8217-3a759a679ca2 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:26:55.276887 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ebbbc044-c48a-404c-8217-3a759a679ca2 tempest-HostsAdminNegativeTestJSON-1927811356 tempest-HostsAdminNegativeTestJSON-1927811356-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.040401 Aug 18 11:26:55.276887 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 293/535] 10.222.0.73 () {60 vars in 1211 bytes} [Thu Aug 18 11:26:55 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:26:55.338187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5dd4585b-9dd2-4e1d-84b5-91ac3e4d2c7f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:55.338845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5dd4585b-9dd2-4e1d-84b5-91ac3e4d2c7f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:55.357368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dd4585b-9dd2-4e1d-84b5-91ac3e4d2c7f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:55.358107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dd4585b-9dd2-4e1d-84b5-91ac3e4d2c7f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:55.358771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dd4585b-9dd2-4e1d-84b5-91ac3e4d2c7f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:55.360662 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dd4585b-9dd2-4e1d-84b5-91ac3e4d2c7f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:55.361180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dd4585b-9dd2-4e1d-84b5-91ac3e4d2c7f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:55.361620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5dd4585b-9dd2-4e1d-84b5-91ac3e4d2c7f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:55.559802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-385e5c71-116b-4aba-b610-1a1f73c1cee0 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:55.569746 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-385e5c71-116b-4aba-b610-1a1f73c1cee0 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1388 microversion: 2.1 time: 0.543417 Aug 18 11:26:55.570495 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 243/536] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:55 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1388 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:55.957098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7ecf4929-a778-4955-be3d-68afa3f5437b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:55.958099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7ecf4929-a778-4955-be3d-68afa3f5437b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:55.965501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ecf4929-a778-4955-be3d-68afa3f5437b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:55.966534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ecf4929-a778-4955-be3d-68afa3f5437b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:55.967216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ecf4929-a778-4955-be3d-68afa3f5437b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:55.968195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ecf4929-a778-4955-be3d-68afa3f5437b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:55.968887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ecf4929-a778-4955-be3d-68afa3f5437b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:55.969538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ecf4929-a778-4955-be3d-68afa3f5437b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:56.077236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7ecf4929-a778-4955-be3d-68afa3f5437b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:56.094800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7ecf4929-a778-4955-be3d-68afa3f5437b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:56.098179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7ecf4929-a778-4955-be3d-68afa3f5437b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:56.100442 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7ecf4929-a778-4955-be3d-68afa3f5437b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1320 microversion: 2.25 time: 0.146682 Aug 18 11:26:56.102209 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 244/537] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:26:55 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1320 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:26:56.116714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0cf89ce-8ced-4732-ac98-975bde72c949 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:56.119395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a0cf89ce-8ced-4732-ac98-975bde72c949 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:56.136212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0cf89ce-8ced-4732-ac98-975bde72c949 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:56.137236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0cf89ce-8ced-4732-ac98-975bde72c949 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:56.137941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0cf89ce-8ced-4732-ac98-975bde72c949 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:56.139114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0cf89ce-8ced-4732-ac98-975bde72c949 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:56.139874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0cf89ce-8ced-4732-ac98-975bde72c949 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:56.140526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0cf89ce-8ced-4732-ac98-975bde72c949 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:56.683261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a0cf89ce-8ced-4732-ac98-975bde72c949 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:56.700183 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a0cf89ce-8ced-4732-ac98-975bde72c949 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1319 microversion: 2.1 time: 0.594787 Aug 18 11:26:56.700787 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 245/538] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:56 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:56.720554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-b579ecc4-4fa5-4f49-ae3a-fd771d4502bc req-6bbc9a11-b733-4962-b620-98b30ad5dfcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adfe9b2a-b96c-408f-9381-d748f9ff7b5d", "name": "network-vif-plugged", "status": "completed", "tag": "b5ebddc2-4206-41b9-a9d9-575eda3136aa"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:56.748686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b579ecc4-4fa5-4f49-ae3a-fd771d4502bc req-6bbc9a11-b733-4962-b620-98b30ad5dfcc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:56.749637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b579ecc4-4fa5-4f49-ae3a-fd771d4502bc req-6bbc9a11-b733-4962-b620-98b30ad5dfcc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:56.750325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b579ecc4-4fa5-4f49-ae3a-fd771d4502bc req-6bbc9a11-b733-4962-b620-98b30ad5dfcc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:56.765052 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-b579ecc4-4fa5-4f49-ae3a-fd771d4502bc req-6bbc9a11-b733-4962-b620-98b30ad5dfcc service nova] Creating event network-vif-plugged:b5ebddc2-4206-41b9-a9d9-575eda3136aa for instance adfe9b2a-b96c-408f-9381-d748f9ff7b5d on n-h1-853611-3 Aug 18 11:26:56.771402 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-b579ecc4-4fa5-4f49-ae3a-fd771d4502bc req-6bbc9a11-b733-4962-b620-98b30ad5dfcc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069118 Aug 18 11:26:56.772359 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 246/539] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:56.779247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab5604af-4fca-4a99-983c-5c2a6fa59729 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:56.780836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ab5604af-4fca-4a99-983c-5c2a6fa59729 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:56.794276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab5604af-4fca-4a99-983c-5c2a6fa59729 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:56.794989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab5604af-4fca-4a99-983c-5c2a6fa59729 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:56.795552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab5604af-4fca-4a99-983c-5c2a6fa59729 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:56.796360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab5604af-4fca-4a99-983c-5c2a6fa59729 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:56.796892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab5604af-4fca-4a99-983c-5c2a6fa59729 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:56.797393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab5604af-4fca-4a99-983c-5c2a6fa59729 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:56.905079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5dd4585b-9dd2-4e1d-84b5-91ac3e4d2c7f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:56.920948 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5dd4585b-9dd2-4e1d-84b5-91ac3e4d2c7f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1324 microversion: 2.1 time: 1.586040 Aug 18 11:26:56.923147 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 294/540] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:55 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1324 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:26:57.044986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ab5604af-4fca-4a99-983c-5c2a6fa59729 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:57.063191 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab5604af-4fca-4a99-983c-5c2a6fa59729 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1388 microversion: 2.1 time: 0.284717 Aug 18 11:26:57.071525 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 247/541] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:56 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1388 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:57.135435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a64ae53e-e161-4974-97cc-7edd0c7e24e3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:57.136329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a64ae53e-e161-4974-97cc-7edd0c7e24e3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:57.160485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a64ae53e-e161-4974-97cc-7edd0c7e24e3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:57.164400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a64ae53e-e161-4974-97cc-7edd0c7e24e3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:57.166202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a64ae53e-e161-4974-97cc-7edd0c7e24e3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:57.168349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a64ae53e-e161-4974-97cc-7edd0c7e24e3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:57.170599 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a64ae53e-e161-4974-97cc-7edd0c7e24e3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:57.173436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a64ae53e-e161-4974-97cc-7edd0c7e24e3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:57.446407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a64ae53e-e161-4974-97cc-7edd0c7e24e3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:57.462615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a64ae53e-e161-4974-97cc-7edd0c7e24e3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:57.465882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a64ae53e-e161-4974-97cc-7edd0c7e24e3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:57.467298 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a64ae53e-e161-4974-97cc-7edd0c7e24e3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1320 microversion: 2.25 time: 0.344786 Aug 18 11:26:57.482597 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 295/542] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:26:57 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1320 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:26:57.721388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-351c2a95-4c43-44a2-990c-7da69df9ea2a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:57.722004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-351c2a95-4c43-44a2-990c-7da69df9ea2a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:57.741286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-351c2a95-4c43-44a2-990c-7da69df9ea2a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:57.741838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-351c2a95-4c43-44a2-990c-7da69df9ea2a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:57.742267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-351c2a95-4c43-44a2-990c-7da69df9ea2a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:57.743319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-351c2a95-4c43-44a2-990c-7da69df9ea2a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:57.743979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-351c2a95-4c43-44a2-990c-7da69df9ea2a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:57.744626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-351c2a95-4c43-44a2-990c-7da69df9ea2a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:57.944718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-12a04147-687a-4882-b767-32df4edf7754 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:57.945801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-12a04147-687a-4882-b767-32df4edf7754 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:57.961682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12a04147-687a-4882-b767-32df4edf7754 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:57.964893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12a04147-687a-4882-b767-32df4edf7754 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:57.965611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12a04147-687a-4882-b767-32df4edf7754 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:57.967615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12a04147-687a-4882-b767-32df4edf7754 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:57.969322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12a04147-687a-4882-b767-32df4edf7754 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:57.970410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12a04147-687a-4882-b767-32df4edf7754 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:57.983288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-351c2a95-4c43-44a2-990c-7da69df9ea2a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:57.995461 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-351c2a95-4c43-44a2-990c-7da69df9ea2a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1319 microversion: 2.1 time: 0.277861 Aug 18 11:26:57.997326 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 248/543] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:57 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:58.023761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-022ff45d-71d1-4707-ad3a-2ab2c283bd24 req-6076dab7-d264-4ac9-bd57-a0b82b5c89ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a472fced-51fc-469b-a37a-38f98e725169", "tag": "dbe58053-eed9-48a6-bec0-79d514d08be6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:58.039034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-022ff45d-71d1-4707-ad3a-2ab2c283bd24 req-6076dab7-d264-4ac9-bd57-a0b82b5c89ed service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:58.040533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-022ff45d-71d1-4707-ad3a-2ab2c283bd24 req-6076dab7-d264-4ac9-bd57-a0b82b5c89ed service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:58.041232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-022ff45d-71d1-4707-ad3a-2ab2c283bd24 req-6076dab7-d264-4ac9-bd57-a0b82b5c89ed service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:58.055828 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-022ff45d-71d1-4707-ad3a-2ab2c283bd24 req-6076dab7-d264-4ac9-bd57-a0b82b5c89ed service nova] Creating event network-changed:dbe58053-eed9-48a6-bec0-79d514d08be6 for instance a472fced-51fc-469b-a37a-38f98e725169 on n-h2-853611-3 Aug 18 11:26:58.061988 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-022ff45d-71d1-4707-ad3a-2ab2c283bd24 req-6076dab7-d264-4ac9-bd57-a0b82b5c89ed service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042994 Aug 18 11:26:58.063227 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 249/544] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:26:58.088455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f5157184-2867-422c-9252-d012752beed1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:58.091554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f5157184-2867-422c-9252-d012752beed1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:58.099339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5157184-2867-422c-9252-d012752beed1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:58.100382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5157184-2867-422c-9252-d012752beed1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:58.101278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5157184-2867-422c-9252-d012752beed1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:58.101996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5157184-2867-422c-9252-d012752beed1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:58.102469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5157184-2867-422c-9252-d012752beed1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:58.103737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5157184-2867-422c-9252-d012752beed1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:58.314302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f5157184-2867-422c-9252-d012752beed1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:58.323498 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f5157184-2867-422c-9252-d012752beed1 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1587 microversion: 2.1 time: 0.241940 Aug 18 11:26:58.339956 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 250/545] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:58 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1587 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:58.351931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-78849ef2-76de-445a-a9ab-53d499f1bf6e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:58.352536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-78849ef2-76de-445a-a9ab-53d499f1bf6e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:58.362472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78849ef2-76de-445a-a9ab-53d499f1bf6e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:58.363235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78849ef2-76de-445a-a9ab-53d499f1bf6e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:58.363871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78849ef2-76de-445a-a9ab-53d499f1bf6e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:58.364646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78849ef2-76de-445a-a9ab-53d499f1bf6e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:58.365584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78849ef2-76de-445a-a9ab-53d499f1bf6e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:58.366771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78849ef2-76de-445a-a9ab-53d499f1bf6e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:58.371149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:26:58.486947 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-78849ef2-76de-445a-a9ab-53d499f1bf6e tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145068 Aug 18 11:26:58.487546 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 251/546] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:26:58 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:26:58.503238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a111d54a-3045-4528-86f5-5b172cbe2c96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:58.504299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a111d54a-3045-4528-86f5-5b172cbe2c96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:58.516420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a111d54a-3045-4528-86f5-5b172cbe2c96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:58.517175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a111d54a-3045-4528-86f5-5b172cbe2c96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:58.517997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a111d54a-3045-4528-86f5-5b172cbe2c96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:58.519138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a111d54a-3045-4528-86f5-5b172cbe2c96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:58.519756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a111d54a-3045-4528-86f5-5b172cbe2c96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:58.520341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a111d54a-3045-4528-86f5-5b172cbe2c96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:58.616892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a111d54a-3045-4528-86f5-5b172cbe2c96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:58.632405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a111d54a-3045-4528-86f5-5b172cbe2c96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:58.638754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a111d54a-3045-4528-86f5-5b172cbe2c96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:58.640994 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a111d54a-3045-4528-86f5-5b172cbe2c96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1320 microversion: 2.25 time: 0.141481 Aug 18 11:26:58.642115 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 252/547] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:26:58 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1320 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:26:58.706922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-12a04147-687a-4882-b767-32df4edf7754 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:58.730890 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-12a04147-687a-4882-b767-32df4edf7754 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1324 microversion: 2.1 time: 0.790011 Aug 18 11:26:58.732304 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 296/548] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:57 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1324 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:59.018032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8f5c1279-17b7-4b3a-821f-a8ebdbc8b0da tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:59.018842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8f5c1279-17b7-4b3a-821f-a8ebdbc8b0da tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:59.031123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f5c1279-17b7-4b3a-821f-a8ebdbc8b0da tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:59.038760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-550feb2d-4758-4374-b8d9-f57c62925f33 req-e55cecdf-f03e-488f-8427-e1594578e0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea19ffc1-f486-4260-8188-6211809c953d", "name": "network-vif-plugged", "status": "completed", "tag": "5c3d5c21-11fa-4445-878a-2177d332905f"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:26:59.045773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f5c1279-17b7-4b3a-821f-a8ebdbc8b0da tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:59.046498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f5c1279-17b7-4b3a-821f-a8ebdbc8b0da tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:59.048282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f5c1279-17b7-4b3a-821f-a8ebdbc8b0da tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:59.057906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-550feb2d-4758-4374-b8d9-f57c62925f33 req-e55cecdf-f03e-488f-8427-e1594578e0f4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:59.059126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f5c1279-17b7-4b3a-821f-a8ebdbc8b0da tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:59.059603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f5c1279-17b7-4b3a-821f-a8ebdbc8b0da tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:59.065487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-550feb2d-4758-4374-b8d9-f57c62925f33 req-e55cecdf-f03e-488f-8427-e1594578e0f4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:59.068381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-550feb2d-4758-4374-b8d9-f57c62925f33 req-e55cecdf-f03e-488f-8427-e1594578e0f4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:59.108240 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-550feb2d-4758-4374-b8d9-f57c62925f33 req-e55cecdf-f03e-488f-8427-e1594578e0f4 service nova] Creating event network-vif-plugged:5c3d5c21-11fa-4445-878a-2177d332905f for instance ea19ffc1-f486-4260-8188-6211809c953d on n-h1-853611-3 Aug 18 11:26:59.132926 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-550feb2d-4758-4374-b8d9-f57c62925f33 req-e55cecdf-f03e-488f-8427-e1594578e0f4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099454 Aug 18 11:26:59.137598 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 297/549] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:26:59.325516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8f5c1279-17b7-4b3a-821f-a8ebdbc8b0da tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:26:59.336942 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8f5c1279-17b7-4b3a-821f-a8ebdbc8b0da tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1469 microversion: 2.1 time: 0.323508 Aug 18 11:26:59.337725 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 253/550] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:59 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1469 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:26:59.360011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b8271d48-2aa0-4ef2-977f-62f1af3a84c9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:59.360773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b8271d48-2aa0-4ef2-977f-62f1af3a84c9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: ea19ffc1-f486-4260-8188-6211809c953d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:59.374120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8271d48-2aa0-4ef2-977f-62f1af3a84c9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:59.374651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8271d48-2aa0-4ef2-977f-62f1af3a84c9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:59.375093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8271d48-2aa0-4ef2-977f-62f1af3a84c9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:59.375808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8271d48-2aa0-4ef2-977f-62f1af3a84c9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:59.376271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8271d48-2aa0-4ef2-977f-62f1af3a84c9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:59.376702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8271d48-2aa0-4ef2-977f-62f1af3a84c9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:59.667354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f01746dd-e4bc-4750-999e-6094375600d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:26:59.668320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f01746dd-e4bc-4750-999e-6094375600d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:26:59.684163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f01746dd-e4bc-4750-999e-6094375600d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:59.685359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f01746dd-e4bc-4750-999e-6094375600d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:59.687180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f01746dd-e4bc-4750-999e-6094375600d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:26:59.689209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f01746dd-e4bc-4750-999e-6094375600d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:26:59.691162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f01746dd-e4bc-4750-999e-6094375600d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:26:59.693942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f01746dd-e4bc-4750-999e-6094375600d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:00.043341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b8271d48-2aa0-4ef2-977f-62f1af3a84c9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:00.052313 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b8271d48-2aa0-4ef2-977f-62f1af3a84c9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d" status: 200 len: 1319 microversion: 2.1 time: 0.696677 Aug 18 11:27:00.060769 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 298/551] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:26:59 2022] GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d => generated 1319 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:00.066031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6c8179bc-099e-4da2-9965-195ce549a02c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:00.068841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6c8179bc-099e-4da2-9965-195ce549a02c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:00.084487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c8179bc-099e-4da2-9965-195ce549a02c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:00.085072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c8179bc-099e-4da2-9965-195ce549a02c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:00.085520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c8179bc-099e-4da2-9965-195ce549a02c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:00.086256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c8179bc-099e-4da2-9965-195ce549a02c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:00.086753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c8179bc-099e-4da2-9965-195ce549a02c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:00.087182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c8179bc-099e-4da2-9965-195ce549a02c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:00.149108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f01746dd-e4bc-4750-999e-6094375600d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:00.162597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f01746dd-e4bc-4750-999e-6094375600d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:00.169956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f01746dd-e4bc-4750-999e-6094375600d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:00.172676 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f01746dd-e4bc-4750-999e-6094375600d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1362 microversion: 2.25 time: 0.511142 Aug 18 11:27:00.176111 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 254/552] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:26:59 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1362 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:00.744276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6c8179bc-099e-4da2-9965-195ce549a02c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:00.762081 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6c8179bc-099e-4da2-9965-195ce549a02c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1324 microversion: 2.1 time: 0.699816 Aug 18 11:27:00.775930 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 299/553] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:00 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1324 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:01.082770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a811012f-8c3b-49b7-9904-a08133395aae tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:01.086310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a811012f-8c3b-49b7-9904-a08133395aae tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: ea19ffc1-f486-4260-8188-6211809c953d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:01.121650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a811012f-8c3b-49b7-9904-a08133395aae tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:01.126262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a811012f-8c3b-49b7-9904-a08133395aae tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:01.129310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a811012f-8c3b-49b7-9904-a08133395aae tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:01.138444 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a811012f-8c3b-49b7-9904-a08133395aae tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:01.139410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a811012f-8c3b-49b7-9904-a08133395aae tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:01.140551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a811012f-8c3b-49b7-9904-a08133395aae tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:01.493048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f1ca42a6-880a-4a4d-a6f7-bf00c870626e tempest-QuotaClassesAdminTestJSON-2142517068 tempest-QuotaClassesAdminTestJSON-2142517068-project-admin] Calling method '.version_select at 0x7f519fedc820>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:01.495053 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:27:01.495053 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:27:01.514222 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f1ca42a6-880a-4a4d-a6f7-bf00c870626e tempest-QuotaClassesAdminTestJSON-2142517068 tempest-QuotaClassesAdminTestJSON-2142517068-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.484813 Aug 18 11:27:01.515065 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 255/554] 10.222.0.73 () {58 vars in 1185 bytes} [Thu Aug 18 11:27:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:01.529299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0dbfdc70-7bc9-4255-92e4-0833195ed441 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:01.530421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0dbfdc70-7bc9-4255-92e4-0833195ed441 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:01.539805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dbfdc70-7bc9-4255-92e4-0833195ed441 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:01.540747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dbfdc70-7bc9-4255-92e4-0833195ed441 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:01.541546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dbfdc70-7bc9-4255-92e4-0833195ed441 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:01.542832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dbfdc70-7bc9-4255-92e4-0833195ed441 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:01.544734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dbfdc70-7bc9-4255-92e4-0833195ed441 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:01.545389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dbfdc70-7bc9-4255-92e4-0833195ed441 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:01.716373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a811012f-8c3b-49b7-9904-a08133395aae tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:01.726225 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a811012f-8c3b-49b7-9904-a08133395aae tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d" status: 200 len: 1319 microversion: 2.1 time: 0.653548 Aug 18 11:27:01.739900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:01.740563 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 300/555] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:01 2022] GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d => generated 1319 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:01.746132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f8ec350c-7706-4287-b86b-78d2254ea92c tempest-QuotaClassesAdminTestJSON-2142517068 tempest-QuotaClassesAdminTestJSON-2142517068-project-admin] Action: 'update', calling method: .version_select at 0x7f51ac053430>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:01.749796 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:27:01.749796 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:27:01.946843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=9,nova_api:UPDATE=7 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:01.958187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0dbfdc70-7bc9-4255-92e4-0833195ed441 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:01.980361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0dbfdc70-7bc9-4255-92e4-0833195ed441 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:01.984999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0dbfdc70-7bc9-4255-92e4-0833195ed441 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:01.987016 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0dbfdc70-7bc9-4255-92e4-0833195ed441 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1362 microversion: 2.25 time: 0.462034 Aug 18 11:27:01.988684 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 256/556] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:01 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1362 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:01.995381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-45b80144-8a86-46f7-8bba-f4316e67635f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:01.996184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-45b80144-8a86-46f7-8bba-f4316e67635f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:02.007857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45b80144-8a86-46f7-8bba-f4316e67635f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:02.009029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45b80144-8a86-46f7-8bba-f4316e67635f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:02.009731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45b80144-8a86-46f7-8bba-f4316e67635f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:02.010761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45b80144-8a86-46f7-8bba-f4316e67635f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:02.011434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45b80144-8a86-46f7-8bba-f4316e67635f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:02.013151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45b80144-8a86-46f7-8bba-f4316e67635f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:02.123485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:02.184027 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f8ec350c-7706-4287-b86b-78d2254ea92c tempest-QuotaClassesAdminTestJSON-2142517068 tempest-QuotaClassesAdminTestJSON-2142517068-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.442087 Aug 18 11:27:02.185199 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 301/557] 10.222.0.73 () {60 vars in 1206 bytes} [Thu Aug 18 11:27:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:02.218674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3452106a-3997-436f-8893-ed3ad11b0c41 tempest-QuotaClassesAdminTestJSON-2142517068 tempest-QuotaClassesAdminTestJSON-2142517068-project-admin] Calling method '.version_select at 0x7f519ffc5280>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:02.221471 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:27:02.221471 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:27:02.242167 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3452106a-3997-436f-8893-ed3ad11b0c41 tempest-QuotaClassesAdminTestJSON-2142517068 tempest-QuotaClassesAdminTestJSON-2142517068-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.049878 Aug 18 11:27:02.254021 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 302/558] 10.222.0.73 () {58 vars in 1185 bytes} [Thu Aug 18 11:27:02 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:27:02.271501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-950700c5-c710-4a12-a9b5-3a109e2a184c tempest-QuotaClassesAdminTestJSON-2142517068 tempest-QuotaClassesAdminTestJSON-2142517068-project-admin] Action: 'update', calling method: .version_select at 0x7f51ac0539d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:02.500941 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-950700c5-c710-4a12-a9b5-3a109e2a184c tempest-QuotaClassesAdminTestJSON-2142517068 tempest-QuotaClassesAdminTestJSON-2142517068-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.239278 Aug 18 11:27:02.502137 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 303/559] 10.222.0.73 () {60 vars in 1206 bytes} [Thu Aug 18 11:27:02 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:27:02.662342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-45b80144-8a86-46f7-8bba-f4316e67635f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:02.676213 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-45b80144-8a86-46f7-8bba-f4316e67635f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1324 microversion: 2.1 time: 0.686132 Aug 18 11:27:02.676803 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 257/560] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:01 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1324 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:02.751941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-af1441eb-2baf-4df9-8221-a24c71aafb93 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:02.752709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-af1441eb-2baf-4df9-8221-a24c71aafb93 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: ea19ffc1-f486-4260-8188-6211809c953d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:02.768952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af1441eb-2baf-4df9-8221-a24c71aafb93 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:02.769199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af1441eb-2baf-4df9-8221-a24c71aafb93 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:02.772028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af1441eb-2baf-4df9-8221-a24c71aafb93 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:02.775742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af1441eb-2baf-4df9-8221-a24c71aafb93 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:02.776354 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af1441eb-2baf-4df9-8221-a24c71aafb93 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:02.776913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af1441eb-2baf-4df9-8221-a24c71aafb93 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:02.949148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-73d02a0e-0afa-4146-863a-357f34329957 req-080d17c5-eda3-4ee8-afc1-41690364be54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ebd4b99-aee2-480b-b361-3bdc41f5a871", "tag": "c4f46619-40b4-4c76-b5f3-e22d33b57732"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:02.983722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-73d02a0e-0afa-4146-863a-357f34329957 req-080d17c5-eda3-4ee8-afc1-41690364be54 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:02.987149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-73d02a0e-0afa-4146-863a-357f34329957 req-080d17c5-eda3-4ee8-afc1-41690364be54 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:02.987777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-73d02a0e-0afa-4146-863a-357f34329957 req-080d17c5-eda3-4ee8-afc1-41690364be54 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:03.035052 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-73d02a0e-0afa-4146-863a-357f34329957 req-080d17c5-eda3-4ee8-afc1-41690364be54 service nova] Creating event network-changed:c4f46619-40b4-4c76-b5f3-e22d33b57732 for instance 6ebd4b99-aee2-480b-b361-3bdc41f5a871 on n-h2-853611-3 Aug 18 11:27:03.050060 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-73d02a0e-0afa-4146-863a-357f34329957 req-080d17c5-eda3-4ee8-afc1-41690364be54 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108134 Aug 18 11:27:03.051055 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 258/561] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:03.063019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4d94db3c-b5a1-4fa8-bb71-c7182698fd32 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:03.064114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4d94db3c-b5a1-4fa8-bb71-c7182698fd32 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:03.078735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d94db3c-b5a1-4fa8-bb71-c7182698fd32 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:03.086147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d94db3c-b5a1-4fa8-bb71-c7182698fd32 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:03.086963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d94db3c-b5a1-4fa8-bb71-c7182698fd32 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:03.087891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d94db3c-b5a1-4fa8-bb71-c7182698fd32 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:03.091152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d94db3c-b5a1-4fa8-bb71-c7182698fd32 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:03.091842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d94db3c-b5a1-4fa8-bb71-c7182698fd32 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:03.704482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-af1441eb-2baf-4df9-8221-a24c71aafb93 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:03.728601 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-af1441eb-2baf-4df9-8221-a24c71aafb93 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d" status: 200 len: 1469 microversion: 2.1 time: 0.983505 Aug 18 11:27:03.730045 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 304/562] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:02 2022] GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d => generated 1469 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:03.748374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8c3bc91a-69a6-44be-bec1-1bc940da6409 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:03.750963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8c3bc91a-69a6-44be-bec1-1bc940da6409 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:03.762898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c3bc91a-69a6-44be-bec1-1bc940da6409 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:03.763747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c3bc91a-69a6-44be-bec1-1bc940da6409 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:03.764376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c3bc91a-69a6-44be-bec1-1bc940da6409 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:03.766191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c3bc91a-69a6-44be-bec1-1bc940da6409 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:03.766885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c3bc91a-69a6-44be-bec1-1bc940da6409 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:03.767923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c3bc91a-69a6-44be-bec1-1bc940da6409 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:03.831571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4d94db3c-b5a1-4fa8-bb71-c7182698fd32 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:03.843531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4d94db3c-b5a1-4fa8-bb71-c7182698fd32 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:03.845576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4d94db3c-b5a1-4fa8-bb71-c7182698fd32 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:03.848107 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4d94db3c-b5a1-4fa8-bb71-c7182698fd32 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1362 microversion: 2.25 time: 0.795630 Aug 18 11:27:03.849633 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 259/563] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:03 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1362 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:03.870883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e81aeb9-75e5-4f13-b544-aaf4f184928e tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:03.871979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1e81aeb9-75e5-4f13-b544-aaf4f184928e tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:03.879842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e81aeb9-75e5-4f13-b544-aaf4f184928e tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:03.881686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e81aeb9-75e5-4f13-b544-aaf4f184928e tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:03.882533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e81aeb9-75e5-4f13-b544-aaf4f184928e tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:03.883493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e81aeb9-75e5-4f13-b544-aaf4f184928e tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:03.884175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e81aeb9-75e5-4f13-b544-aaf4f184928e tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:03.884839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e81aeb9-75e5-4f13-b544-aaf4f184928e tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:04.125522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8c3bc91a-69a6-44be-bec1-1bc940da6409 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:04.135468 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8c3bc91a-69a6-44be-bec1-1bc940da6409 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1587 microversion: 2.1 time: 0.403858 Aug 18 11:27:04.150174 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 305/564] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:03 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1587 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:04.150174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:04.154558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:04.156897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Searching by: {'reservation_id': 'r-s5m0tr0z', 'deleted': False, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:27:04.166320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:04.166925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:04.167371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:04.168310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:04.168813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:04.169239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:04.383240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1e81aeb9-75e5-4f13-b544-aaf4f184928e tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:04.384738 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:27:04.399611 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1e81aeb9-75e5-4f13-b544-aaf4f184928e tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1324 microversion: 2.1 time: 0.548504 Aug 18 11:27:04.400210 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 260/565] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:03 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1324 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:04.537541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:04.547216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:04.547711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:04.548244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:04.865038 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8bc8da02-1d3e-4ab3-995a-2192ce41e174 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/detail?reservation_id=r-s5m0tr0z" status: 200 len: 2931 microversion: 2.1 time: 0.727223 Aug 18 11:27:04.879087 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 306/566] 10.222.0.73 () {58 vars in 1197 bytes} [Thu Aug 18 11:27:04 2022] GET /compute/v2.1/servers/detail?reservation_id=r-s5m0tr0z => generated 2931 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:04.888272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-265ac3ce-9162-4ba3-b88b-348ce97c7d37 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:04.888482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e19a8f20-0295-4d5a-8235-f35a0b624912 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:04.889314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e19a8f20-0295-4d5a-8235-f35a0b624912 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:04.903997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e19a8f20-0295-4d5a-8235-f35a0b624912 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:04.905538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e19a8f20-0295-4d5a-8235-f35a0b624912 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:04.906009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e19a8f20-0295-4d5a-8235-f35a0b624912 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:04.907997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e19a8f20-0295-4d5a-8235-f35a0b624912 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:04.912738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e19a8f20-0295-4d5a-8235-f35a0b624912 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:04.913272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e19a8f20-0295-4d5a-8235-f35a0b624912 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:04.918873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.compute.server_groups [None req-265ac3ce-9162-4ba3-b88b-348ce97c7d37 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Querying cell 68989ef7-340f-4449-87c1-932f111c2bdb(cell1) for 2 instances {{(pid=122209) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 18 11:27:04.920042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-265ac3ce-9162-4ba3-b88b-348ce97c7d37 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:04.920741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-265ac3ce-9162-4ba3-b88b-348ce97c7d37 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:04.921433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-265ac3ce-9162-4ba3-b88b-348ce97c7d37 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:04.954320 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-265ac3ce-9162-4ba3-b88b-348ce97c7d37 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/os-server-groups/6932f290-c006-4781-8999-df22645b6c54" status: 200 len: 266 microversion: 2.1 time: 0.069685 Aug 18 11:27:04.962050 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 307/567] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:27:04 2022] GET /compute/v2.1/os-server-groups/6932f290-c006-4781-8999-df22645b6c54 => generated 266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:27:04.967065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-12be3256-2e70-46bc-a902-96d6105cb3c5 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:04.967685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-12be3256-2e70-46bc-a902-96d6105cb3c5 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:04.974820 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12be3256-2e70-46bc-a902-96d6105cb3c5 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:04.975645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12be3256-2e70-46bc-a902-96d6105cb3c5 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:04.976246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12be3256-2e70-46bc-a902-96d6105cb3c5 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:04.977137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12be3256-2e70-46bc-a902-96d6105cb3c5 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:04.978034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12be3256-2e70-46bc-a902-96d6105cb3c5 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:04.978664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12be3256-2e70-46bc-a902-96d6105cb3c5 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:05.328898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e19a8f20-0295-4d5a-8235-f35a0b624912 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:05.343161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e19a8f20-0295-4d5a-8235-f35a0b624912 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:05.347613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e19a8f20-0295-4d5a-8235-f35a0b624912 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:05.351514 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e19a8f20-0295-4d5a-8235-f35a0b624912 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1362 microversion: 2.25 time: 0.471126 Aug 18 11:27:05.353295 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 261/568] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:04 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1362 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:27:05.367913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-80d6b0a3-236c-4e66-823a-a6df49245601 req-2c795bcd-4b18-4581-9902-52fd4feabb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b", "tag": "df5c2bde-2e96-4148-91da-df8c38a12161"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:05.385662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-80d6b0a3-236c-4e66-823a-a6df49245601 req-2c795bcd-4b18-4581-9902-52fd4feabb99 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:05.386361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-80d6b0a3-236c-4e66-823a-a6df49245601 req-2c795bcd-4b18-4581-9902-52fd4feabb99 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:05.387061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-80d6b0a3-236c-4e66-823a-a6df49245601 req-2c795bcd-4b18-4581-9902-52fd4feabb99 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:05.401873 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-80d6b0a3-236c-4e66-823a-a6df49245601 req-2c795bcd-4b18-4581-9902-52fd4feabb99 service nova] Creating event network-changed:df5c2bde-2e96-4148-91da-df8c38a12161 for instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b on n-h2-853611-3 Aug 18 11:27:05.407628 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-80d6b0a3-236c-4e66-823a-a6df49245601 req-2c795bcd-4b18-4581-9902-52fd4feabb99 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050872 Aug 18 11:27:05.408871 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 262/569] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:05.424581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b40364a5-fdef-4049-b237-385c7036a96f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:05.425828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b40364a5-fdef-4049-b237-385c7036a96f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:05.440181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b40364a5-fdef-4049-b237-385c7036a96f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:05.440923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b40364a5-fdef-4049-b237-385c7036a96f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:05.441597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b40364a5-fdef-4049-b237-385c7036a96f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:05.443759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b40364a5-fdef-4049-b237-385c7036a96f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:05.444716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b40364a5-fdef-4049-b237-385c7036a96f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:05.445364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b40364a5-fdef-4049-b237-385c7036a96f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:05.731854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b40364a5-fdef-4049-b237-385c7036a96f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:05.746326 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b40364a5-fdef-4049-b237-385c7036a96f tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1324 microversion: 2.1 time: 0.328743 Aug 18 11:27:05.774781 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 263/570] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:05 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1324 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:27:05.984912 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-12be3256-2e70-46bc-a902-96d6105cb3c5 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 200 len: 1620 microversion: 2.1 time: 1.021549 Aug 18 11:27:05.998879 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 308/571] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:04 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 1620 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:06.006973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-451cc671-6bbd-48cc-b231-45f40ff2d6ca tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:06.007602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-451cc671-6bbd-48cc-b231-45f40ff2d6ca tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] [instance: ea19ffc1-f486-4260-8188-6211809c953d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:06.015132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-451cc671-6bbd-48cc-b231-45f40ff2d6ca tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:06.015630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-451cc671-6bbd-48cc-b231-45f40ff2d6ca tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:06.016074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-451cc671-6bbd-48cc-b231-45f40ff2d6ca tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:06.016798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-451cc671-6bbd-48cc-b231-45f40ff2d6ca tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:06.017258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-451cc671-6bbd-48cc-b231-45f40ff2d6ca tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:06.017695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-451cc671-6bbd-48cc-b231-45f40ff2d6ca tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:06.121690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1256600883", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "fdd58ab8-846e-466a-8c86-b730482bc074"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:06.184548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] validate_networks() for [('fdd58ab8-846e-466a-8c86-b730482bc074', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:27:06.706879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:27:06.717886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:27:06.718330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:27:06.722244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:27:06.723133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:27:06.740427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:06.741562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:06.742005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:06.742824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:06.743441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:06.743872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:06.768083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Getting quotas for project 05fb2484544849ab8ad1dbb6dec06f65. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:27:06.774829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Getting quotas for user 7308ed12063b4326942c235e39582be5 and project 05fb2484544849ab8ad1dbb6dec06f65. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:27:06.792473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:27:06.794618 n-d-853611-3 devstack@n-api.service[122210]: WARNING nova.utils [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1256600883 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-125660088 Aug 18 11:27:06.795566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:27:06.867539 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e933fbf2-430e-4a30-bbf6-fc676de43d7f tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053131 Aug 18 11:27:06.868969 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 264/572] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:27:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:27:06.876552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5447e97b-512d-4ffa-8765-ac5ef7763163 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:06.878353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5447e97b-512d-4ffa-8765-ac5ef7763163 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:06.886823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5447e97b-512d-4ffa-8765-ac5ef7763163 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:06.887890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5447e97b-512d-4ffa-8765-ac5ef7763163 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:06.888857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5447e97b-512d-4ffa-8765-ac5ef7763163 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:06.889881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5447e97b-512d-4ffa-8765-ac5ef7763163 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:06.890797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5447e97b-512d-4ffa-8765-ac5ef7763163 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:06.892093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5447e97b-512d-4ffa-8765-ac5ef7763163 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:07.143519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5447e97b-512d-4ffa-8765-ac5ef7763163 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:07.156783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5447e97b-512d-4ffa-8765-ac5ef7763163 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:07.159867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5447e97b-512d-4ffa-8765-ac5ef7763163 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:07.161937 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5447e97b-512d-4ffa-8765-ac5ef7763163 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1362 microversion: 2.25 time: 0.290963 Aug 18 11:27:07.163039 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 265/573] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:06 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:07.168830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e151adbb-322b-40fc-8e57-9557c25e83df tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:07.169868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e151adbb-322b-40fc-8e57-9557c25e83df tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:07.177701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e151adbb-322b-40fc-8e57-9557c25e83df tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:07.178372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e151adbb-322b-40fc-8e57-9557c25e83df tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:07.185940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e151adbb-322b-40fc-8e57-9557c25e83df tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:07.188646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e151adbb-322b-40fc-8e57-9557c25e83df tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:07.191969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e151adbb-322b-40fc-8e57-9557c25e83df tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:07.192809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e151adbb-322b-40fc-8e57-9557c25e83df tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:07.457871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e151adbb-322b-40fc-8e57-9557c25e83df tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:07.471424 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e151adbb-322b-40fc-8e57-9557c25e83df tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1324 microversion: 2.1 time: 0.303609 Aug 18 11:27:07.475899 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 266/574] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:07 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1324 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:07.486081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fceab558-90a4-46dd-af43-f5f777b5090b tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:07.487688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fceab558-90a4-46dd-af43-f5f777b5090b tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:07.521984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:07.710137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fceab558-90a4-46dd-af43-f5f777b5090b tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:07.723014 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fceab558-90a4-46dd-af43-f5f777b5090b tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1232 microversion: 2.1 time: 0.244787 Aug 18 11:27:07.724054 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 267/575] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:07 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1232 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:07.735401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-e937ae99-6496-48f2-94cb-b62c9d0a83d4 req-338d8eb9-0c29-4efc-bbae-efd3e0ff7c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a472fced-51fc-469b-a37a-38f98e725169", "name": "network-vif-plugged", "status": "completed", "tag": "dbe58053-eed9-48a6-bec0-79d514d08be6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:07.740984 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-451cc671-6bbd-48cc-b231-45f40ff2d6ca tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d" status: 200 len: 1620 microversion: 2.1 time: 1.735535 Aug 18 11:27:07.742598 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 309/576] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:06 2022] GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d => generated 1620 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:27:07.785232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-07c4b2e1-5107-4a80-83bb-23557ec37624 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Action: 'create', calling method: .version_select at 0x7f519fff03a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-3819071", "policies": ["anti-affinity"]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:07.803873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e937ae99-6496-48f2-94cb-b62c9d0a83d4 req-338d8eb9-0c29-4efc-bbae-efd3e0ff7c66 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:07.811271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e937ae99-6496-48f2-94cb-b62c9d0a83d4 req-338d8eb9-0c29-4efc-bbae-efd3e0ff7c66 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:07.812538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e937ae99-6496-48f2-94cb-b62c9d0a83d4 req-338d8eb9-0c29-4efc-bbae-efd3e0ff7c66 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:07.845877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-07c4b2e1-5107-4a80-83bb-23557ec37624 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:27:07.857408 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e937ae99-6496-48f2-94cb-b62c9d0a83d4 req-338d8eb9-0c29-4efc-bbae-efd3e0ff7c66 service nova] Creating event network-vif-plugged:dbe58053-eed9-48a6-bec0-79d514d08be6 for instance a472fced-51fc-469b-a37a-38f98e725169 on n-h2-853611-3 Aug 18 11:27:07.860241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-07c4b2e1-5107-4a80-83bb-23557ec37624 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:27:07.868254 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-e937ae99-6496-48f2-94cb-b62c9d0a83d4 req-338d8eb9-0c29-4efc-bbae-efd3e0ff7c66 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142243 Aug 18 11:27:07.869247 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 268/577] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:08.012065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-07c4b2e1-5107-4a80-83bb-23557ec37624 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:27:08.028139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-07c4b2e1-5107-4a80-83bb-23557ec37624 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:27:08.085436 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-07c4b2e1-5107-4a80-83bb-23557ec37624 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "POST /compute/v2.1/os-server-groups" status: 200 len: 190 microversion: 2.1 time: 0.315887 Aug 18 11:27:08.086777 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 310/578] 10.222.0.73 () {60 vars in 1174 bytes} [Thu Aug 18 11:27:07 2022] POST /compute/v2.1/os-server-groups => generated 190 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:08.191067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e5b81ba9-a30b-4268-994c-fed98e2fe315 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:08.191804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e5b81ba9-a30b-4268-994c-fed98e2fe315 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:08.215444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b81ba9-a30b-4268-994c-fed98e2fe315 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:08.217252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b81ba9-a30b-4268-994c-fed98e2fe315 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:08.221567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b81ba9-a30b-4268-994c-fed98e2fe315 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:08.225296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b81ba9-a30b-4268-994c-fed98e2fe315 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:08.226332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b81ba9-a30b-4268-994c-fed98e2fe315 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:08.244226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b81ba9-a30b-4268-994c-fed98e2fe315 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:08.300072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-355529517", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "33adfeb6-880c-4582-819a-f4dc2c458c41"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:08.329091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=75,nova_api:UPDATE=17 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:08.453392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:27:08.546879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e5b81ba9-a30b-4268-994c-fed98e2fe315 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:08.562235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e5b81ba9-a30b-4268-994c-fed98e2fe315 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:08.563701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e5b81ba9-a30b-4268-994c-fed98e2fe315 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:08.564865 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e5b81ba9-a30b-4268-994c-fed98e2fe315 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1362 microversion: 2.25 time: 0.379796 Aug 18 11:27:08.565817 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 269/579] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:08 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:08.593908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e5efe3ea-f38c-47f5-a167-f9e071e47803 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:08.594345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e5efe3ea-f38c-47f5-a167-f9e071e47803 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:08.615450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5efe3ea-f38c-47f5-a167-f9e071e47803 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:08.616254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5efe3ea-f38c-47f5-a167-f9e071e47803 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:08.616880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5efe3ea-f38c-47f5-a167-f9e071e47803 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:08.618189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5efe3ea-f38c-47f5-a167-f9e071e47803 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:08.620150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5efe3ea-f38c-47f5-a167-f9e071e47803 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:08.621294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5efe3ea-f38c-47f5-a167-f9e071e47803 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:09.023224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e5efe3ea-f38c-47f5-a167-f9e071e47803 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:09.035276 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e5efe3ea-f38c-47f5-a167-f9e071e47803 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1324 microversion: 2.1 time: 0.468354 Aug 18 11:27:09.064595 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 270/580] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:08 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1324 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:09.079121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-316da46a-294f-454c-92a3-cb3b868bb962 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:09.081991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-316da46a-294f-454c-92a3-cb3b868bb962 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:09.096103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-316da46a-294f-454c-92a3-cb3b868bb962 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:09.099431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-316da46a-294f-454c-92a3-cb3b868bb962 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:09.100180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-316da46a-294f-454c-92a3-cb3b868bb962 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:09.102999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-316da46a-294f-454c-92a3-cb3b868bb962 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:09.103636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-316da46a-294f-454c-92a3-cb3b868bb962 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:09.105352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-316da46a-294f-454c-92a3-cb3b868bb962 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:09.249247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-316da46a-294f-454c-92a3-cb3b868bb962 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:09.260387 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-316da46a-294f-454c-92a3-cb3b868bb962 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1302 microversion: 2.1 time: 0.191839 Aug 18 11:27:09.260992 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 271/581] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:09 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1302 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:09.580104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:27:09.581142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:27:09.581835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:27:09.582480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:27:09.583871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:27:09.606871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:09.607576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-420c288b-b0d2-48b0-8369-62b128d99d1a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:09.607833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:09.608197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-420c288b-b0d2-48b0-8369-62b128d99d1a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:09.608687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:09.609665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:09.610351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:09.611031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:09.622581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-420c288b-b0d2-48b0-8369-62b128d99d1a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:09.625049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-420c288b-b0d2-48b0-8369-62b128d99d1a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:09.627237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-420c288b-b0d2-48b0-8369-62b128d99d1a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:09.632093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-420c288b-b0d2-48b0-8369-62b128d99d1a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:09.632815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-420c288b-b0d2-48b0-8369-62b128d99d1a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:09.633439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-420c288b-b0d2-48b0-8369-62b128d99d1a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:09.639873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:27:09.666520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:27:09.699014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Going to run 2 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:27:09.702343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:27:09.814102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122209) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 18 11:27:09.853701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:27:09.865479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:27:09.928680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-420c288b-b0d2-48b0-8369-62b128d99d1a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:09.938808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:09.947494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-420c288b-b0d2-48b0-8369-62b128d99d1a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:09.958813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-420c288b-b0d2-48b0-8369-62b128d99d1a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:09.960049 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-420c288b-b0d2-48b0-8369-62b128d99d1a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1362 microversion: 2.25 time: 0.362097 Aug 18 11:27:09.960631 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 272/582] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:09 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:09.964430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:27:09.980390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:27:10.014154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 53f5ee39-045c-4250-a4b5-efdd3f7b590d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=dd3052f2-209e-43f1-a4a4-227ac5bc5f3d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:27:10.074513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e6fe641-8d6a-467e-b8b6-2d43352435a2 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:10.075482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e6fe641-8d6a-467e-b8b6-2d43352435a2 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:10.081372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:27:10.090089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:27:10.094453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e6fe641-8d6a-467e-b8b6-2d43352435a2 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:10.095435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e6fe641-8d6a-467e-b8b6-2d43352435a2 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:10.096158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e6fe641-8d6a-467e-b8b6-2d43352435a2 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:10.097027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e6fe641-8d6a-467e-b8b6-2d43352435a2 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:10.097720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e6fe641-8d6a-467e-b8b6-2d43352435a2 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:10.099242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e6fe641-8d6a-467e-b8b6-2d43352435a2 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:10.165681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:27:10.177625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'server_group_members'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:27:10.282731 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f69ac2a7-fae3-4151-9894-bb0b22892c6e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.986259 Aug 18 11:27:10.291612 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 311/583] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:27:08 2022] POST /compute/v2.1/servers => generated 32 bytes in 1997 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 18 11:27:10.296481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-678b6eef-1b78-4f0e-834b-2c9af0f73cd7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:10.324743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-678b6eef-1b78-4f0e-834b-2c9af0f73cd7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:10.327325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-678b6eef-1b78-4f0e-834b-2c9af0f73cd7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Searching by: {'deleted': False, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:27:10.377473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e6fe641-8d6a-467e-b8b6-2d43352435a2 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:10.401643 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e6fe641-8d6a-467e-b8b6-2d43352435a2 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1324 microversion: 2.1 time: 0.332689 Aug 18 11:27:10.403213 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 273/584] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:10 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:10.409740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-13d40e96-abb8-46dd-9216-25c39c30b078 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:10.411736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-13d40e96-abb8-46dd-9216-25c39c30b078 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:10.424260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-678b6eef-1b78-4f0e-834b-2c9af0f73cd7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:10.427374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-678b6eef-1b78-4f0e-834b-2c9af0f73cd7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:10.427903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-678b6eef-1b78-4f0e-834b-2c9af0f73cd7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:10.430882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-678b6eef-1b78-4f0e-834b-2c9af0f73cd7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:10.431937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-678b6eef-1b78-4f0e-834b-2c9af0f73cd7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:10.434327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-678b6eef-1b78-4f0e-834b-2c9af0f73cd7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:10.435898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13d40e96-abb8-46dd-9216-25c39c30b078 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:10.436715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13d40e96-abb8-46dd-9216-25c39c30b078 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:10.437329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13d40e96-abb8-46dd-9216-25c39c30b078 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:10.438858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13d40e96-abb8-46dd-9216-25c39c30b078 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:10.439489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13d40e96-abb8-46dd-9216-25c39c30b078 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:10.440121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13d40e96-abb8-46dd-9216-25c39c30b078 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:10.485216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-678b6eef-1b78-4f0e-834b-2c9af0f73cd7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:27:10.522457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:10.531185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-13d40e96-abb8-46dd-9216-25c39c30b078 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:10.541117 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-13d40e96-abb8-46dd-9216-25c39c30b078 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1290 microversion: 2.1 time: 0.135254 Aug 18 11:27:10.542329 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 274/585] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:10 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1290 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:10.558657 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-678b6eef-1b78-4f0e-834b-2c9af0f73cd7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.265789 Aug 18 11:27:10.560450 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 312/586] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 18 11:27:10 2022] GET /compute/v2.1/servers => generated 1663 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:10.572658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-475c8d36-c5b7-4961-8788-ce383ed92bd2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:10.573535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-475c8d36-c5b7-4961-8788-ce383ed92bd2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 53f5ee39-045c-4250-a4b5-efdd3f7b590d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:10.686830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-475c8d36-c5b7-4961-8788-ce383ed92bd2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:10.706881 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-475c8d36-c5b7-4961-8788-ce383ed92bd2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d" status: 200 len: 1218 microversion: 2.1 time: 0.137981 Aug 18 11:27:10.715978 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 275/587] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:10 2022] GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:10.991816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-13da06ae-935f-496d-aceb-badd27966420 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:10.996488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-13da06ae-935f-496d-aceb-badd27966420 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:11.013108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13da06ae-935f-496d-aceb-badd27966420 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:11.013931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13da06ae-935f-496d-aceb-badd27966420 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:11.014591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13da06ae-935f-496d-aceb-badd27966420 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:11.015894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13da06ae-935f-496d-aceb-badd27966420 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:11.016657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13da06ae-935f-496d-aceb-badd27966420 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:11.017245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13da06ae-935f-496d-aceb-badd27966420 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:11.441000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1350963924", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": "none"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:11.474454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-13da06ae-935f-496d-aceb-badd27966420 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:11.491224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-13da06ae-935f-496d-aceb-badd27966420 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:11.495314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-13da06ae-935f-496d-aceb-badd27966420 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:11.497103 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-13da06ae-935f-496d-aceb-badd27966420 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1362 microversion: 2.25 time: 0.516771 Aug 18 11:27:11.497617 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 313/588] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:10 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1362 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:11.507832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8225b1bb-1c1f-4e2c-b3cb-b473d0854167 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:11.508841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8225b1bb-1c1f-4e2c-b3cb-b473d0854167 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:11.515743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8225b1bb-1c1f-4e2c-b3cb-b473d0854167 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:11.516454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8225b1bb-1c1f-4e2c-b3cb-b473d0854167 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:11.517101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8225b1bb-1c1f-4e2c-b3cb-b473d0854167 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:11.518024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8225b1bb-1c1f-4e2c-b3cb-b473d0854167 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:11.519458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8225b1bb-1c1f-4e2c-b3cb-b473d0854167 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:11.520150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8225b1bb-1c1f-4e2c-b3cb-b473d0854167 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:11.522365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:27:11.523092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:27:11.524427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:27:11.525324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:27:11.526025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:27:11.540881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:11.541636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:11.542265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:11.543241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:11.544204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:11.544794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:11.586969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Getting quotas for project e76bbfd861bc4cf3883b953b17dded0d. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:27:11.604028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Getting quotas for user 7baeed1e70e94d3d8a85a8956e729b5b and project e76bbfd861bc4cf3883b953b17dded0d. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:27:11.623219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:27:11.625897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:27:11.708845 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d7cefada-d474-48ca-921c-8b84d8fab472 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.421677 Aug 18 11:27:11.711758 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 276/589] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:27:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 18 11:27:11.719116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d136c01-1b7e-4148-a784-6df11e7701c9 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:11.720306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7d136c01-1b7e-4148-a784-6df11e7701c9 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:11.733457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d136c01-1b7e-4148-a784-6df11e7701c9 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:11.734276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d136c01-1b7e-4148-a784-6df11e7701c9 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:11.735105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d136c01-1b7e-4148-a784-6df11e7701c9 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:11.736227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d136c01-1b7e-4148-a784-6df11e7701c9 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:11.736984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d136c01-1b7e-4148-a784-6df11e7701c9 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:11.737567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d136c01-1b7e-4148-a784-6df11e7701c9 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:11.896378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7d136c01-1b7e-4148-a784-6df11e7701c9 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:11.905668 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7d136c01-1b7e-4148-a784-6df11e7701c9 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1290 microversion: 2.1 time: 0.192559 Aug 18 11:27:11.906902 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 277/590] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:11 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1290 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:11.929082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-41d1fed8-c998-4035-b59e-8671732a2b1d tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:11.939126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-41d1fed8-c998-4035-b59e-8671732a2b1d tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:12.103294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-41d1fed8-c998-4035-b59e-8671732a2b1d tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:12.117283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-41d1fed8-c998-4035-b59e-8671732a2b1d tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:12.119901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-41d1fed8-c998-4035-b59e-8671732a2b1d tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:12.139039 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-41d1fed8-c998-4035-b59e-8671732a2b1d tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "PUT /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1359 microversion: 2.75 time: 0.228750 Aug 18 11:27:12.140256 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 278/591] 10.222.0.73 () {62 vars in 1297 bytes} [Thu Aug 18 11:27:11 2022] PUT /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:12.146135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26830339-1010-4445-a435-fdc8897ffed9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:12.147200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26830339-1010-4445-a435-fdc8897ffed9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 53f5ee39-045c-4250-a4b5-efdd3f7b590d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:12.154027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26830339-1010-4445-a435-fdc8897ffed9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:12.155893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26830339-1010-4445-a435-fdc8897ffed9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:12.157753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26830339-1010-4445-a435-fdc8897ffed9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:12.162038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26830339-1010-4445-a435-fdc8897ffed9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:12.162793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26830339-1010-4445-a435-fdc8897ffed9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:12.163736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26830339-1010-4445-a435-fdc8897ffed9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:12.274649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-26830339-1010-4445-a435-fdc8897ffed9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:12.283439 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-26830339-1010-4445-a435-fdc8897ffed9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d" status: 200 len: 1270 microversion: 2.1 time: 0.141823 Aug 18 11:27:12.289072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8225b1bb-1c1f-4e2c-b3cb-b473d0854167 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:12.297564 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 279/592] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:12 2022] GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:12.303721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5d900b56-25d0-4fbd-b145-3c65d6158a3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:12.304580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5d900b56-25d0-4fbd-b145-3c65d6158a3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:12.306047 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8225b1bb-1c1f-4e2c-b3cb-b473d0854167 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1519 microversion: 2.1 time: 0.801264 Aug 18 11:27:12.307321 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 314/593] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:11 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1519 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:12.333383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7f103026-4612-41aa-8bcd-5cf444e6b902 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Action: 'create', calling method: .version_select at 0x7f519fdebee0>, body: {"pool": null} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:12.419383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5d900b56-25d0-4fbd-b145-3c65d6158a3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:12.434389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5d900b56-25d0-4fbd-b145-3c65d6158a3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:12.438236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5d900b56-25d0-4fbd-b145-3c65d6158a3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:12.449376 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5d900b56-25d0-4fbd-b145-3c65d6158a3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1359 microversion: 2.75 time: 0.150219 Aug 18 11:27:12.450766 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 280/594] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:12 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:12.456221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f4868169-0147-46bc-aa8b-7fb5f0279527 req-9ff41312-148f-4a6c-b71e-7d435bd0adc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ebd4b99-aee2-480b-b361-3bdc41f5a871", "name": "network-vif-plugged", "status": "completed", "tag": "c4f46619-40b4-4c76-b5f3-e22d33b57732"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:12.469721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f4868169-0147-46bc-aa8b-7fb5f0279527 req-9ff41312-148f-4a6c-b71e-7d435bd0adc9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:12.470651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f4868169-0147-46bc-aa8b-7fb5f0279527 req-9ff41312-148f-4a6c-b71e-7d435bd0adc9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:12.471461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f4868169-0147-46bc-aa8b-7fb5f0279527 req-9ff41312-148f-4a6c-b71e-7d435bd0adc9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:12.492846 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f4868169-0147-46bc-aa8b-7fb5f0279527 req-9ff41312-148f-4a6c-b71e-7d435bd0adc9 service nova] Creating event network-vif-plugged:c4f46619-40b4-4c76-b5f3-e22d33b57732 for instance 6ebd4b99-aee2-480b-b361-3bdc41f5a871 on n-h2-853611-3 Aug 18 11:27:12.499978 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f4868169-0147-46bc-aa8b-7fb5f0279527 req-9ff41312-148f-4a6c-b71e-7d435bd0adc9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047791 Aug 18 11:27:12.500774 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 281/595] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:12.525044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c358bc51-368f-44b7-bfae-cbb2bc294298 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:12.526758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c358bc51-368f-44b7-bfae-cbb2bc294298 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:12.535191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c358bc51-368f-44b7-bfae-cbb2bc294298 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:12.537323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c358bc51-368f-44b7-bfae-cbb2bc294298 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:12.538074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c358bc51-368f-44b7-bfae-cbb2bc294298 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:12.539047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c358bc51-368f-44b7-bfae-cbb2bc294298 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:12.539743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c358bc51-368f-44b7-bfae-cbb2bc294298 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:12.540401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c358bc51-368f-44b7-bfae-cbb2bc294298 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:12.787108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c358bc51-368f-44b7-bfae-cbb2bc294298 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:12.797633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c358bc51-368f-44b7-bfae-cbb2bc294298 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:12.799503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c358bc51-368f-44b7-bfae-cbb2bc294298 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:12.800914 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c358bc51-368f-44b7-bfae-cbb2bc294298 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1362 microversion: 2.25 time: 0.281144 Aug 18 11:27:12.802481 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 282/596] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:12 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:27:12.930548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f928734e-4a08-4ea0-8e08-da8564ac1136 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:12.931328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f928734e-4a08-4ea0-8e08-da8564ac1136 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:12.939745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f928734e-4a08-4ea0-8e08-da8564ac1136 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:12.940542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f928734e-4a08-4ea0-8e08-da8564ac1136 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:12.941683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f928734e-4a08-4ea0-8e08-da8564ac1136 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:12.942772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f928734e-4a08-4ea0-8e08-da8564ac1136 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:12.943703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f928734e-4a08-4ea0-8e08-da8564ac1136 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:12.944528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f928734e-4a08-4ea0-8e08-da8564ac1136 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:13.035221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f928734e-4a08-4ea0-8e08-da8564ac1136 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:13.045960 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f928734e-4a08-4ea0-8e08-da8564ac1136 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1290 microversion: 2.1 time: 0.120775 Aug 18 11:27:13.046764 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 283/597] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:12 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1290 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:27:13.306600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f36b19c1-cfde-4f0d-82d3-9b86fb4d324a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:13.307743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f36b19c1-cfde-4f0d-82d3-9b86fb4d324a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 53f5ee39-045c-4250-a4b5-efdd3f7b590d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:13.314965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f36b19c1-cfde-4f0d-82d3-9b86fb4d324a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:13.315720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f36b19c1-cfde-4f0d-82d3-9b86fb4d324a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:13.316339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f36b19c1-cfde-4f0d-82d3-9b86fb4d324a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:13.317934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f36b19c1-cfde-4f0d-82d3-9b86fb4d324a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:13.318638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f36b19c1-cfde-4f0d-82d3-9b86fb4d324a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:13.319218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f36b19c1-cfde-4f0d-82d3-9b86fb4d324a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:13.429023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f36b19c1-cfde-4f0d-82d3-9b86fb4d324a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:13.437210 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f36b19c1-cfde-4f0d-82d3-9b86fb4d324a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d" status: 200 len: 1276 microversion: 2.1 time: 0.136261 Aug 18 11:27:13.438377 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 284/598] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:13 2022] GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:13.479913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d78715a1-f66a-42ad-a506-ff6a918bc6d6 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:13.480559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d78715a1-f66a-42ad-a506-ff6a918bc6d6 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:13.487058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d78715a1-f66a-42ad-a506-ff6a918bc6d6 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:13.487548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d78715a1-f66a-42ad-a506-ff6a918bc6d6 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:13.487975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d78715a1-f66a-42ad-a506-ff6a918bc6d6 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:13.489232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d78715a1-f66a-42ad-a506-ff6a918bc6d6 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:13.489687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d78715a1-f66a-42ad-a506-ff6a918bc6d6 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:13.490303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d78715a1-f66a-42ad-a506-ff6a918bc6d6 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:13.622884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d78715a1-f66a-42ad-a506-ff6a918bc6d6 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:13.638813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d78715a1-f66a-42ad-a506-ff6a918bc6d6 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:13.654866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d78715a1-f66a-42ad-a506-ff6a918bc6d6 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:13.671625 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d78715a1-f66a-42ad-a506-ff6a918bc6d6 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1417 microversion: 2.75 time: 0.196150 Aug 18 11:27:13.672515 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 285/599] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:13 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1417 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:13.830261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-42906d38-eeef-48b9-a024-a2a0861c2d52 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:13.832844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-42906d38-eeef-48b9-a024-a2a0861c2d52 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:13.845405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42906d38-eeef-48b9-a024-a2a0861c2d52 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:13.846250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42906d38-eeef-48b9-a024-a2a0861c2d52 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:13.846894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42906d38-eeef-48b9-a024-a2a0861c2d52 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:13.848702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42906d38-eeef-48b9-a024-a2a0861c2d52 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:13.851055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42906d38-eeef-48b9-a024-a2a0861c2d52 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:13.853694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42906d38-eeef-48b9-a024-a2a0861c2d52 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:14.186832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-42906d38-eeef-48b9-a024-a2a0861c2d52 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:14.203267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-42906d38-eeef-48b9-a024-a2a0861c2d52 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:14.205618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-42906d38-eeef-48b9-a024-a2a0861c2d52 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:14.207128 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-42906d38-eeef-48b9-a024-a2a0861c2d52 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1362 microversion: 2.25 time: 0.385289 Aug 18 11:27:14.208289 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 286/600] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:13 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:27:14.213826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-91a51a4d-d662-4f2e-a9c4-afc5bd94812b tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:14.214828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-91a51a4d-d662-4f2e-a9c4-afc5bd94812b tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:14.221352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91a51a4d-d662-4f2e-a9c4-afc5bd94812b tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:14.222188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91a51a4d-d662-4f2e-a9c4-afc5bd94812b tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:14.224075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91a51a4d-d662-4f2e-a9c4-afc5bd94812b tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:14.226096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91a51a4d-d662-4f2e-a9c4-afc5bd94812b tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:14.227126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91a51a4d-d662-4f2e-a9c4-afc5bd94812b tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:14.227927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91a51a4d-d662-4f2e-a9c4-afc5bd94812b tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:14.443520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-91a51a4d-d662-4f2e-a9c4-afc5bd94812b tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:14.455937 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-91a51a4d-d662-4f2e-a9c4-afc5bd94812b tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1332 microversion: 2.1 time: 0.243932 Aug 18 11:27:14.459051 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 287/601] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:14 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1332 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:14.468112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4f9ba358-9081-49e5-96a7-b0970b5e7a43 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:14.468723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4f9ba358-9081-49e5-96a7-b0970b5e7a43 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 53f5ee39-045c-4250-a4b5-efdd3f7b590d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:14.475422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f9ba358-9081-49e5-96a7-b0970b5e7a43 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:14.475915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f9ba358-9081-49e5-96a7-b0970b5e7a43 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:14.476353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f9ba358-9081-49e5-96a7-b0970b5e7a43 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:14.477549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f9ba358-9081-49e5-96a7-b0970b5e7a43 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:14.478007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f9ba358-9081-49e5-96a7-b0970b5e7a43 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:14.478469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f9ba358-9081-49e5-96a7-b0970b5e7a43 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:14.769969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4f9ba358-9081-49e5-96a7-b0970b5e7a43 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:14.783482 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4f9ba358-9081-49e5-96a7-b0970b5e7a43 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d" status: 200 len: 1318 microversion: 2.1 time: 0.319984 Aug 18 11:27:14.790697 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 288/602] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:14 2022] GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:14.803071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2ff6adf9-e032-4ea4-9cb6-1b87113aaaa4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:14.804527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2ff6adf9-e032-4ea4-9cb6-1b87113aaaa4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:14.813851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ff6adf9-e032-4ea4-9cb6-1b87113aaaa4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:14.814608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ff6adf9-e032-4ea4-9cb6-1b87113aaaa4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:14.819422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ff6adf9-e032-4ea4-9cb6-1b87113aaaa4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:14.823239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ff6adf9-e032-4ea4-9cb6-1b87113aaaa4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:14.823747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ff6adf9-e032-4ea4-9cb6-1b87113aaaa4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:14.824192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ff6adf9-e032-4ea4-9cb6-1b87113aaaa4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:14.935844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2ff6adf9-e032-4ea4-9cb6-1b87113aaaa4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:14.953651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2ff6adf9-e032-4ea4-9cb6-1b87113aaaa4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:14.956994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2ff6adf9-e032-4ea4-9cb6-1b87113aaaa4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:14.964135 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2ff6adf9-e032-4ea4-9cb6-1b87113aaaa4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1417 microversion: 2.75 time: 0.171604 Aug 18 11:27:14.965730 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 289/603] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:14 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1417 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:15.018108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-122781bc-d3c0-4af7-89b7-588661da3b4a req-b26a38c2-04db-4f29-89b6-32886bb661e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53f5ee39-045c-4250-a4b5-efdd3f7b590d", "tag": "8ee673f5-5824-4dea-baf9-28a95fa7787e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:15.031108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-122781bc-d3c0-4af7-89b7-588661da3b4a req-b26a38c2-04db-4f29-89b6-32886bb661e7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:15.032371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-122781bc-d3c0-4af7-89b7-588661da3b4a req-b26a38c2-04db-4f29-89b6-32886bb661e7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:15.033295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-122781bc-d3c0-4af7-89b7-588661da3b4a req-b26a38c2-04db-4f29-89b6-32886bb661e7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:15.055101 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-122781bc-d3c0-4af7-89b7-588661da3b4a req-b26a38c2-04db-4f29-89b6-32886bb661e7 service nova] Creating event network-changed:8ee673f5-5824-4dea-baf9-28a95fa7787e for instance 53f5ee39-045c-4250-a4b5-efdd3f7b590d on n-h1-853611-3 Aug 18 11:27:15.081129 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-122781bc-d3c0-4af7-89b7-588661da3b4a req-b26a38c2-04db-4f29-89b6-32886bb661e7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071162 Aug 18 11:27:15.084413 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 290/604] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:27:15.230264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8a2fe145-040d-4368-b2f9-38b9e75101e7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:15.231289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8a2fe145-040d-4368-b2f9-38b9e75101e7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:15.237791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a2fe145-040d-4368-b2f9-38b9e75101e7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:15.238815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a2fe145-040d-4368-b2f9-38b9e75101e7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:15.239440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a2fe145-040d-4368-b2f9-38b9e75101e7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:15.240162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a2fe145-040d-4368-b2f9-38b9e75101e7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:15.240615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a2fe145-040d-4368-b2f9-38b9e75101e7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:15.241033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a2fe145-040d-4368-b2f9-38b9e75101e7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:15.808254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8a2fe145-040d-4368-b2f9-38b9e75101e7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:15.818051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8a2fe145-040d-4368-b2f9-38b9e75101e7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:15.819982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8a2fe145-040d-4368-b2f9-38b9e75101e7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:15.821333 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8a2fe145-040d-4368-b2f9-38b9e75101e7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1362 microversion: 2.25 time: 0.595650 Aug 18 11:27:15.822461 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 291/605] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:15 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1362 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:27:15.827572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-720208b1-16b2-406a-a4e7-d193fb9e030c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:15.828430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-720208b1-16b2-406a-a4e7-d193fb9e030c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:15.835806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-720208b1-16b2-406a-a4e7-d193fb9e030c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:15.836643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-720208b1-16b2-406a-a4e7-d193fb9e030c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:15.837245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-720208b1-16b2-406a-a4e7-d193fb9e030c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:15.838220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-720208b1-16b2-406a-a4e7-d193fb9e030c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:15.840380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-720208b1-16b2-406a-a4e7-d193fb9e030c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:15.841034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-720208b1-16b2-406a-a4e7-d193fb9e030c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:16.054822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-720208b1-16b2-406a-a4e7-d193fb9e030c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:16.088820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-720208b1-16b2-406a-a4e7-d193fb9e030c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1332 microversion: 2.1 time: 0.250098 Aug 18 11:27:16.091467 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 292/606] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:15 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1332 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:16.105425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1543f8bd-9940-4222-be65-ea1f9689002e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:16.106145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1543f8bd-9940-4222-be65-ea1f9689002e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 53f5ee39-045c-4250-a4b5-efdd3f7b590d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:16.123138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1543f8bd-9940-4222-be65-ea1f9689002e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:16.124806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1543f8bd-9940-4222-be65-ea1f9689002e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:16.127100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1543f8bd-9940-4222-be65-ea1f9689002e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:16.128157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1543f8bd-9940-4222-be65-ea1f9689002e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:16.134653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1543f8bd-9940-4222-be65-ea1f9689002e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:16.137682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1543f8bd-9940-4222-be65-ea1f9689002e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:16.619596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1543f8bd-9940-4222-be65-ea1f9689002e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:16.650860 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1543f8bd-9940-4222-be65-ea1f9689002e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d" status: 200 len: 1318 microversion: 2.1 time: 0.545050 Aug 18 11:27:16.652714 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 293/607] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:16 2022] GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:16.657555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8dc8023b-1e9c-45e3-a6f3-939bb60fc0bc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:16.658408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8dc8023b-1e9c-45e3-a6f3-939bb60fc0bc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:16.670666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dc8023b-1e9c-45e3-a6f3-939bb60fc0bc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:16.671547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dc8023b-1e9c-45e3-a6f3-939bb60fc0bc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:16.679349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dc8023b-1e9c-45e3-a6f3-939bb60fc0bc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:16.680372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dc8023b-1e9c-45e3-a6f3-939bb60fc0bc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:16.681014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dc8023b-1e9c-45e3-a6f3-939bb60fc0bc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:16.681808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dc8023b-1e9c-45e3-a6f3-939bb60fc0bc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:16.753821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:16.958122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8dc8023b-1e9c-45e3-a6f3-939bb60fc0bc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:16.979328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8dc8023b-1e9c-45e3-a6f3-939bb60fc0bc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:16.984231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8dc8023b-1e9c-45e3-a6f3-939bb60fc0bc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:16.994991 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8dc8023b-1e9c-45e3-a6f3-939bb60fc0bc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1438 microversion: 2.75 time: 0.341064 Aug 18 11:27:16.995849 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 294/608] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:16 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1438 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:17.001541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6c4e00ef-ef01-44a6-8060-5333d3a5a5e0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:17.003955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6c4e00ef-ef01-44a6-8060-5333d3a5a5e0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:17.012590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c4e00ef-ef01-44a6-8060-5333d3a5a5e0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:17.013342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c4e00ef-ef01-44a6-8060-5333d3a5a5e0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:17.013947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c4e00ef-ef01-44a6-8060-5333d3a5a5e0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:17.014913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c4e00ef-ef01-44a6-8060-5333d3a5a5e0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:17.016386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c4e00ef-ef01-44a6-8060-5333d3a5a5e0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:17.017035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c4e00ef-ef01-44a6-8060-5333d3a5a5e0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:17.479972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6c4e00ef-ef01-44a6-8060-5333d3a5a5e0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:17.491354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6c4e00ef-ef01-44a6-8060-5333d3a5a5e0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:17.492914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6c4e00ef-ef01-44a6-8060-5333d3a5a5e0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:17.494106 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6c4e00ef-ef01-44a6-8060-5333d3a5a5e0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1559 microversion: 2.25 time: 0.497118 Aug 18 11:27:17.513300 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 295/609] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:16 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1559 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:17.531018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4fe2b6f8-50a6-4c98-a3aa-dc4d5b25f07a req-07bafc53-cfdf-4bde-8811-ba10cfaf4adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab517b76-7996-4c12-a108-d3fb97b955c4", "tag": "6d45270a-1cd6-41f0-9fa9-232d93d36b38"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:17.556498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4fe2b6f8-50a6-4c98-a3aa-dc4d5b25f07a req-07bafc53-cfdf-4bde-8811-ba10cfaf4adb service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:17.556979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4fe2b6f8-50a6-4c98-a3aa-dc4d5b25f07a req-07bafc53-cfdf-4bde-8811-ba10cfaf4adb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:17.559493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4fe2b6f8-50a6-4c98-a3aa-dc4d5b25f07a req-07bafc53-cfdf-4bde-8811-ba10cfaf4adb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:17.581353 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4fe2b6f8-50a6-4c98-a3aa-dc4d5b25f07a req-07bafc53-cfdf-4bde-8811-ba10cfaf4adb service nova] Creating event network-changed:6d45270a-1cd6-41f0-9fa9-232d93d36b38 for instance ab517b76-7996-4c12-a108-d3fb97b955c4 on n-h1-853611-3 Aug 18 11:27:17.598492 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4fe2b6f8-50a6-4c98-a3aa-dc4d5b25f07a req-07bafc53-cfdf-4bde-8811-ba10cfaf4adb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086949 Aug 18 11:27:17.607418 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 296/610] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:17.616911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:17.621906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:17.639428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:17.639924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:17.642246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:17.643532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:17.645308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:17.647781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:17.797921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:27:17.805562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:27:17.806236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:27:17.806840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:27:17.807434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:27:17.929418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:17.939854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:17.940238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:17.940860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:17.943147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:17.943957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:17.944797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:18.125876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:18.134513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:18.136549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:18.139997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:18.143636 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-33e61f1c-c866-4b14-8a8e-a3f6a17c5e3b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "POST /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4/action" status: 202 len: 1495 microversion: 2.75 time: 0.534254 Aug 18 11:27:18.145422 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 297/611] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 18 11:27:17 2022] POST /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4/action => generated 1495 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 18 11:27:18.150391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-49228c08-db3b-469c-962c-d85fd6c501d1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:18.151323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-49228c08-db3b-469c-962c-d85fd6c501d1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:18.159532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49228c08-db3b-469c-962c-d85fd6c501d1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:18.161194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49228c08-db3b-469c-962c-d85fd6c501d1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:18.162129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49228c08-db3b-469c-962c-d85fd6c501d1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:18.163037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49228c08-db3b-469c-962c-d85fd6c501d1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:18.163793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49228c08-db3b-469c-962c-d85fd6c501d1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:18.164486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49228c08-db3b-469c-962c-d85fd6c501d1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:18.503392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-49228c08-db3b-469c-962c-d85fd6c501d1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:18.503985 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7f103026-4612-41aa-8bcd-5cf444e6b902 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.175850 Aug 18 11:27:18.504952 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 315/612] 10.222.0.73 () {60 vars in 1170 bytes} [Thu Aug 18 11:27:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:27:18.517486 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-49228c08-db3b-469c-962c-d85fd6c501d1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1332 microversion: 2.1 time: 0.367987 Aug 18 11:27:18.518118 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 298/613] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:18 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1332 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:18.541641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-348852a5-94bb-46f0-aa23-01121b4dc04b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:18.542841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-348852a5-94bb-46f0-aa23-01121b4dc04b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 53f5ee39-045c-4250-a4b5-efdd3f7b590d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:18.554651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-348852a5-94bb-46f0-aa23-01121b4dc04b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:18.555721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-348852a5-94bb-46f0-aa23-01121b4dc04b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:18.556256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-348852a5-94bb-46f0-aa23-01121b4dc04b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:18.557909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-348852a5-94bb-46f0-aa23-01121b4dc04b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:18.559228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-348852a5-94bb-46f0-aa23-01121b4dc04b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:18.559880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-348852a5-94bb-46f0-aa23-01121b4dc04b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:18.797628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bc68fe36-9227-4fee-92fa-816f63422046 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:18.798290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bc68fe36-9227-4fee-92fa-816f63422046 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:18.814334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc68fe36-9227-4fee-92fa-816f63422046 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:18.815411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc68fe36-9227-4fee-92fa-816f63422046 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:18.816173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc68fe36-9227-4fee-92fa-816f63422046 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:18.817278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc68fe36-9227-4fee-92fa-816f63422046 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:18.818035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc68fe36-9227-4fee-92fa-816f63422046 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:18.818728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc68fe36-9227-4fee-92fa-816f63422046 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:18.894988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-348852a5-94bb-46f0-aa23-01121b4dc04b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:18.928135 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-348852a5-94bb-46f0-aa23-01121b4dc04b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d" status: 200 len: 1318 microversion: 2.1 time: 0.401753 Aug 18 11:27:18.945290 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 299/614] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:18 2022] GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:18.951848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-37e7e268-848f-4aa5-b4eb-97bf3d60a0bd tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:18.954250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-37e7e268-848f-4aa5-b4eb-97bf3d60a0bd tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:18.968111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37e7e268-848f-4aa5-b4eb-97bf3d60a0bd tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:18.968616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37e7e268-848f-4aa5-b4eb-97bf3d60a0bd tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:18.969073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37e7e268-848f-4aa5-b4eb-97bf3d60a0bd tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:18.973865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37e7e268-848f-4aa5-b4eb-97bf3d60a0bd tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:18.974487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37e7e268-848f-4aa5-b4eb-97bf3d60a0bd tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:18.974921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37e7e268-848f-4aa5-b4eb-97bf3d60a0bd tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:19.152033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-37e7e268-848f-4aa5-b4eb-97bf3d60a0bd tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:19.165701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-37e7e268-848f-4aa5-b4eb-97bf3d60a0bd tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:19.168991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-37e7e268-848f-4aa5-b4eb-97bf3d60a0bd tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:19.181859 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-37e7e268-848f-4aa5-b4eb-97bf3d60a0bd tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1447 microversion: 2.75 time: 0.235173 Aug 18 11:27:19.184803 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 300/615] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:18 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1447 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:19.204831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-59763568", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "c1e36b66-5ff9-448b-ae68-4d66745c4f5b"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:19.328901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] validate_networks() for [('c1e36b66-5ff9-448b-ae68-4d66745c4f5b', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:27:19.475368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-bc68fe36-9227-4fee-92fa-816f63422046 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 6ebd4b99-aee2-480b-b361-3bdc41f5a871 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:27:19.555249 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bc68fe36-9227-4fee-92fa-816f63422046 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 2052 microversion: 2.25 time: 1.049041 Aug 18 11:27:19.556587 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 316/616] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:18 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 2052 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:19.566606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-491c6d3b-6e1d-4ade-b239-5615ee8835ad tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:19.567248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-491c6d3b-6e1d-4ade-b239-5615ee8835ad tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:19.582883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-491c6d3b-6e1d-4ade-b239-5615ee8835ad tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:19.585044 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-491c6d3b-6e1d-4ade-b239-5615ee8835ad tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:19.585588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-491c6d3b-6e1d-4ade-b239-5615ee8835ad tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:19.586344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-491c6d3b-6e1d-4ade-b239-5615ee8835ad tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:19.586835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-491c6d3b-6e1d-4ade-b239-5615ee8835ad tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:19.587266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-491c6d3b-6e1d-4ade-b239-5615ee8835ad tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:20.123936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-491c6d3b-6e1d-4ade-b239-5615ee8835ad tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:20.135055 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-491c6d3b-6e1d-4ade-b239-5615ee8835ad tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1332 microversion: 2.1 time: 0.577166 Aug 18 11:27:20.135971 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 317/617] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:19 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1332 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:20.145168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aa26e863-f0df-4531-91bb-05e79fb39c9b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:20.149917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-aa26e863-f0df-4531-91bb-05e79fb39c9b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:20.165150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa26e863-f0df-4531-91bb-05e79fb39c9b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:20.165939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa26e863-f0df-4531-91bb-05e79fb39c9b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:20.166588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa26e863-f0df-4531-91bb-05e79fb39c9b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:20.167389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa26e863-f0df-4531-91bb-05e79fb39c9b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:20.168076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa26e863-f0df-4531-91bb-05e79fb39c9b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:20.168524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa26e863-f0df-4531-91bb-05e79fb39c9b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:20.218256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=80,nova_cell0:UPDATE=12 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:20.359433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:27:20.359934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:27:20.360281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:27:20.360909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:27:20.361315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:27:20.368116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=33 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:20.373943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:20.374417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:20.374883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:20.377717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:20.377717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:20.377717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:20.396328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Getting quotas for project d1fa95f956304a9bb1b34ddf82adac1a. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:27:20.401698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Getting quotas for user eb875d64a00b43448f7e3b7492e9086b and project d1fa95f956304a9bb1b34ddf82adac1a. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:27:20.415935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:27:20.418723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:27:20.461586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:20.497837 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-952e42b9-8510-4382-ba1a-b8de43941eec tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.308342 Aug 18 11:27:20.499352 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 301/618] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:27:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:27:20.505478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-736d81a2-2e5c-42b7-a36e-f9cdabb33fc2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:20.506295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-736d81a2-2e5c-42b7-a36e-f9cdabb33fc2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 53f5ee39-045c-4250-a4b5-efdd3f7b590d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:20.513654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-736d81a2-2e5c-42b7-a36e-f9cdabb33fc2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:20.514138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-736d81a2-2e5c-42b7-a36e-f9cdabb33fc2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:20.514618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-736d81a2-2e5c-42b7-a36e-f9cdabb33fc2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:20.515509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-736d81a2-2e5c-42b7-a36e-f9cdabb33fc2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:20.515957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-736d81a2-2e5c-42b7-a36e-f9cdabb33fc2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:20.516973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-736d81a2-2e5c-42b7-a36e-f9cdabb33fc2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:20.641730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-aa26e863-f0df-4531-91bb-05e79fb39c9b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 6ebd4b99-aee2-480b-b361-3bdc41f5a871 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:27:20.668772 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aa26e863-f0df-4531-91bb-05e79fb39c9b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 2052 microversion: 2.25 time: 0.531533 Aug 18 11:27:20.669380 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 318/619] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:20 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 2052 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:20.688005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-c539d983-ad4b-4b97-841e-6d593757d4cc req-2434aaee-fcb4-41d4-a155-41a6f0d2853d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3052f2-209e-43f1-a4a4-227ac5bc5f3d", "tag": "1687b236-5319-4914-8231-40725c72104a"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:20.723444 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c539d983-ad4b-4b97-841e-6d593757d4cc req-2434aaee-fcb4-41d4-a155-41a6f0d2853d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:20.724233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c539d983-ad4b-4b97-841e-6d593757d4cc req-2434aaee-fcb4-41d4-a155-41a6f0d2853d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:20.724898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c539d983-ad4b-4b97-841e-6d593757d4cc req-2434aaee-fcb4-41d4-a155-41a6f0d2853d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:20.758704 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-c539d983-ad4b-4b97-841e-6d593757d4cc req-2434aaee-fcb4-41d4-a155-41a6f0d2853d service nova] Creating event network-changed:1687b236-5319-4914-8231-40725c72104a for instance dd3052f2-209e-43f1-a4a4-227ac5bc5f3d on n-h2-853611-3 Aug 18 11:27:20.780881 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-c539d983-ad4b-4b97-841e-6d593757d4cc req-2434aaee-fcb4-41d4-a155-41a6f0d2853d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110220 Aug 18 11:27:20.781524 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 319/620] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:20.787875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-03b19cde-7fec-4ad9-963e-8b54ed1a64cc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:20.788588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-03b19cde-7fec-4ad9-963e-8b54ed1a64cc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:20.891074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03b19cde-7fec-4ad9-963e-8b54ed1a64cc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:20.897675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03b19cde-7fec-4ad9-963e-8b54ed1a64cc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:20.898228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03b19cde-7fec-4ad9-963e-8b54ed1a64cc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:20.899067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03b19cde-7fec-4ad9-963e-8b54ed1a64cc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:20.899564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03b19cde-7fec-4ad9-963e-8b54ed1a64cc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:20.899984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03b19cde-7fec-4ad9-963e-8b54ed1a64cc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:21.353126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-03b19cde-7fec-4ad9-963e-8b54ed1a64cc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:21.387524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-03b19cde-7fec-4ad9-963e-8b54ed1a64cc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:21.389368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-03b19cde-7fec-4ad9-963e-8b54ed1a64cc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:21.412226 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-03b19cde-7fec-4ad9-963e-8b54ed1a64cc tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1447 microversion: 2.75 time: 0.629296 Aug 18 11:27:21.426994 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 320/621] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:20 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1447 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:21.435397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7215f366-4c29-4236-9422-5a014a694895 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:21.436021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7215f366-4c29-4236-9422-5a014a694895 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:21.443110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7215f366-4c29-4236-9422-5a014a694895 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:21.443915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7215f366-4c29-4236-9422-5a014a694895 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:21.444549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7215f366-4c29-4236-9422-5a014a694895 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:21.445437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7215f366-4c29-4236-9422-5a014a694895 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:21.446085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7215f366-4c29-4236-9422-5a014a694895 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:21.446689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7215f366-4c29-4236-9422-5a014a694895 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:21.625337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7215f366-4c29-4236-9422-5a014a694895 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:21.637113 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7215f366-4c29-4236-9422-5a014a694895 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697" status: 200 len: 1226 microversion: 2.1 time: 0.208726 Aug 18 11:27:21.639750 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 321/622] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:21 2022] GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 => generated 1226 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:21.648981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d572a5e5-51e6-4681-bac5-922d5f0c73a9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:21.656702 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:27:21.656702 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:27:21.662818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d572a5e5-51e6-4681-bac5-922d5f0c73a9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:21.664551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d572a5e5-51e6-4681-bac5-922d5f0c73a9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:21.666368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d572a5e5-51e6-4681-bac5-922d5f0c73a9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:21.668697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d572a5e5-51e6-4681-bac5-922d5f0c73a9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:21.670851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d572a5e5-51e6-4681-bac5-922d5f0c73a9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:21.671668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d572a5e5-51e6-4681-bac5-922d5f0c73a9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:21.725947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-736d81a2-2e5c-42b7-a36e-f9cdabb33fc2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:21.769518 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-736d81a2-2e5c-42b7-a36e-f9cdabb33fc2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d" status: 200 len: 1318 microversion: 2.1 time: 1.268031 Aug 18 11:27:21.781697 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d572a5e5-51e6-4681-bac5-922d5f0c73a9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.133601 Aug 18 11:27:21.782694 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 322/623] 10.222.0.73 () {60 vars in 1217 bytes} [Thu Aug 18 11:27:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:27:21.784236 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 302/624] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:20 2022] GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d => generated 1318 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:21.796166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6e639184-a205-492d-a192-612feb2b53d0 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:21.797169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6e639184-a205-492d-a192-612feb2b53d0 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:21.806270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-3abb15dd-e4cd-42cf-895d-844a80b56818 req-47fa0ea0-f2c1-4c20-8883-8da8a6ec0efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53f5ee39-045c-4250-a4b5-efdd3f7b590d", "name": "network-vif-plugged", "status": "completed", "tag": "8ee673f5-5824-4dea-baf9-28a95fa7787e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:21.814850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6e639184-a205-492d-a192-612feb2b53d0 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:21.816869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6e639184-a205-492d-a192-612feb2b53d0 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:21.818965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6e639184-a205-492d-a192-612feb2b53d0 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:21.819838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6e639184-a205-492d-a192-612feb2b53d0 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:21.821281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6e639184-a205-492d-a192-612feb2b53d0 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:21.822680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6e639184-a205-492d-a192-612feb2b53d0 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:21.827755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3abb15dd-e4cd-42cf-895d-844a80b56818 req-47fa0ea0-f2c1-4c20-8883-8da8a6ec0efe service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:21.828764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3abb15dd-e4cd-42cf-895d-844a80b56818 req-47fa0ea0-f2c1-4c20-8883-8da8a6ec0efe service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:21.830006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3abb15dd-e4cd-42cf-895d-844a80b56818 req-47fa0ea0-f2c1-4c20-8883-8da8a6ec0efe service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:21.852427 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-3abb15dd-e4cd-42cf-895d-844a80b56818 req-47fa0ea0-f2c1-4c20-8883-8da8a6ec0efe service nova] Creating event network-vif-plugged:8ee673f5-5824-4dea-baf9-28a95fa7787e for instance 53f5ee39-045c-4250-a4b5-efdd3f7b590d on n-h1-853611-3 Aug 18 11:27:21.867819 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-3abb15dd-e4cd-42cf-895d-844a80b56818 req-47fa0ea0-f2c1-4c20-8883-8da8a6ec0efe service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080154 Aug 18 11:27:21.871158 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 303/625] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:21.892506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d01e0112-4222-4695-a544-5de4cf3ca09b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-853611-3", "block_migration": "auto"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:21.901737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d01e0112-4222-4695-a544-5de4cf3ca09b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:21.922111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d01e0112-4222-4695-a544-5de4cf3ca09b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:21.929735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d01e0112-4222-4695-a544-5de4cf3ca09b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:21.930779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d01e0112-4222-4695-a544-5de4cf3ca09b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:21.932242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d01e0112-4222-4695-a544-5de4cf3ca09b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:21.933503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d01e0112-4222-4695-a544-5de4cf3ca09b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:21.935321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d01e0112-4222-4695-a544-5de4cf3ca09b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:22.000185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-d01e0112-4222-4695-a544-5de4cf3ca09b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'flavor' on Instance uuid 6ebd4b99-aee2-480b-b361-3bdc41f5a871 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:27:22.043664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d01e0112-4222-4695-a544-5de4cf3ca09b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Going to try to live migrate instance to n-h1-853611-3 {{(pid=122210) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 18 11:27:22.173054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6e639184-a205-492d-a192-612feb2b53d0 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:22.200448 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6e639184-a205-492d-a192-612feb2b53d0 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1332 microversion: 2.1 time: 0.413344 Aug 18 11:27:22.201886 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 323/626] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:21 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1332 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:22.441677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a0479c7a-548b-447d-a98b-d35bdb1630e7 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:22.442301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a0479c7a-548b-447d-a98b-d35bdb1630e7 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:22.453872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0479c7a-548b-447d-a98b-d35bdb1630e7 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:22.454378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0479c7a-548b-447d-a98b-d35bdb1630e7 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:22.454856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0479c7a-548b-447d-a98b-d35bdb1630e7 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:22.455636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0479c7a-548b-447d-a98b-d35bdb1630e7 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:22.456096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0479c7a-548b-447d-a98b-d35bdb1630e7 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:22.457180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0479c7a-548b-447d-a98b-d35bdb1630e7 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:22.693298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a0479c7a-548b-447d-a98b-d35bdb1630e7 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:22.702274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a0479c7a-548b-447d-a98b-d35bdb1630e7 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:22.707987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a0479c7a-548b-447d-a98b-d35bdb1630e7 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:22.717772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:22.731778 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a0479c7a-548b-447d-a98b-d35bdb1630e7 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1447 microversion: 2.75 time: 0.294519 Aug 18 11:27:22.734207 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 324/627] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:22 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1447 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:27:22.763025 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f6adba20-4a42-48f9-86f7-4dce27095e76 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:22.763951 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f6adba20-4a42-48f9-86f7-4dce27095e76 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:22.775189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6adba20-4a42-48f9-86f7-4dce27095e76 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:22.776130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6adba20-4a42-48f9-86f7-4dce27095e76 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:22.776800 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6adba20-4a42-48f9-86f7-4dce27095e76 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:22.777740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6adba20-4a42-48f9-86f7-4dce27095e76 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:22.778408 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6adba20-4a42-48f9-86f7-4dce27095e76 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:22.779183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6adba20-4a42-48f9-86f7-4dce27095e76 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:22.897073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f6adba20-4a42-48f9-86f7-4dce27095e76 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:22.908693 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f6adba20-4a42-48f9-86f7-4dce27095e76 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697" status: 200 len: 1280 microversion: 2.1 time: 0.170764 Aug 18 11:27:22.944046 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 325/628] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:22 2022] GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 => generated 1280 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:22.962482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f3dad682-a920-49e7-bb6e-3b8a12d47667 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:22.963720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f3dad682-a920-49e7-bb6e-3b8a12d47667 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 53f5ee39-045c-4250-a4b5-efdd3f7b590d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:22.971495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3dad682-a920-49e7-bb6e-3b8a12d47667 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:22.972681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3dad682-a920-49e7-bb6e-3b8a12d47667 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:22.973301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3dad682-a920-49e7-bb6e-3b8a12d47667 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:22.974029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3dad682-a920-49e7-bb6e-3b8a12d47667 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:22.974513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3dad682-a920-49e7-bb6e-3b8a12d47667 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:22.975319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3dad682-a920-49e7-bb6e-3b8a12d47667 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:23.877675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f3dad682-a920-49e7-bb6e-3b8a12d47667 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:23.901539 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f3dad682-a920-49e7-bb6e-3b8a12d47667 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d" status: 200 len: 1318 microversion: 2.1 time: 0.941992 Aug 18 11:27:23.903384 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 326/629] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:22 2022] GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d => generated 1318 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:23.921420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-499fca5b-4ad2-4a59-b61b-01443950742a tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:23.938362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-499fca5b-4ad2-4a59-b61b-01443950742a tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:23.961458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-499fca5b-4ad2-4a59-b61b-01443950742a tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:23.965181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-499fca5b-4ad2-4a59-b61b-01443950742a tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:23.970636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-499fca5b-4ad2-4a59-b61b-01443950742a tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:23.974210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-499fca5b-4ad2-4a59-b61b-01443950742a tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:23.975179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-499fca5b-4ad2-4a59-b61b-01443950742a tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:23.975873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-499fca5b-4ad2-4a59-b61b-01443950742a tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:25.174539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-499fca5b-4ad2-4a59-b61b-01443950742a tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:25.196367 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-499fca5b-4ad2-4a59-b61b-01443950742a tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1332 microversion: 2.1 time: 1.287846 Aug 18 11:27:25.216531 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 327/630] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:23 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1332 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:25.240204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3b215f25-8ee6-4b57-a70a-b30ee7b569ab tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:25.264377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3b215f25-8ee6-4b57-a70a-b30ee7b569ab tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:25.276291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b215f25-8ee6-4b57-a70a-b30ee7b569ab tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:25.276817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b215f25-8ee6-4b57-a70a-b30ee7b569ab tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:25.277274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b215f25-8ee6-4b57-a70a-b30ee7b569ab tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:25.278064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b215f25-8ee6-4b57-a70a-b30ee7b569ab tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:25.278554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b215f25-8ee6-4b57-a70a-b30ee7b569ab tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:25.279007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b215f25-8ee6-4b57-a70a-b30ee7b569ab tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:25.488381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3b215f25-8ee6-4b57-a70a-b30ee7b569ab tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:25.501324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3b215f25-8ee6-4b57-a70a-b30ee7b569ab tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:25.503768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3b215f25-8ee6-4b57-a70a-b30ee7b569ab tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:25.513253 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3b215f25-8ee6-4b57-a70a-b30ee7b569ab tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1447 microversion: 2.75 time: 0.295423 Aug 18 11:27:25.514820 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 328/631] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:25 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1447 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:25.526373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3e11ae9-9f43-4080-a777-3e0697d900a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:25.527331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d3e11ae9-9f43-4080-a777-3e0697d900a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:25.543552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3e11ae9-9f43-4080-a777-3e0697d900a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:25.544424 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3e11ae9-9f43-4080-a777-3e0697d900a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:25.546572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3e11ae9-9f43-4080-a777-3e0697d900a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:25.549504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3e11ae9-9f43-4080-a777-3e0697d900a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:25.550135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3e11ae9-9f43-4080-a777-3e0697d900a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:25.550965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3e11ae9-9f43-4080-a777-3e0697d900a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:26.135628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d3e11ae9-9f43-4080-a777-3e0697d900a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:26.155158 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d3e11ae9-9f43-4080-a777-3e0697d900a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697" status: 200 len: 1322 microversion: 2.1 time: 0.631721 Aug 18 11:27:26.165571 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 329/632] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:25 2022] GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 => generated 1322 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:26.183797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-56be4fc8-f477-4867-9e1a-b3c6fcd9a56b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:26.184439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-56be4fc8-f477-4867-9e1a-b3c6fcd9a56b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 53f5ee39-045c-4250-a4b5-efdd3f7b590d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:26.201104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-56be4fc8-f477-4867-9e1a-b3c6fcd9a56b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:26.213358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-56be4fc8-f477-4867-9e1a-b3c6fcd9a56b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:26.213917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-56be4fc8-f477-4867-9e1a-b3c6fcd9a56b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:26.214827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-56be4fc8-f477-4867-9e1a-b3c6fcd9a56b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:26.215579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-56be4fc8-f477-4867-9e1a-b3c6fcd9a56b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:26.216814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-56be4fc8-f477-4867-9e1a-b3c6fcd9a56b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:26.662237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-56be4fc8-f477-4867-9e1a-b3c6fcd9a56b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:26.668912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:26.675192 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-56be4fc8-f477-4867-9e1a-b3c6fcd9a56b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d" status: 200 len: 1467 microversion: 2.1 time: 0.507897 Aug 18 11:27:26.723291 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 330/633] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:26 2022] GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d => generated 1467 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:26.728975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-21bd68f2-1fcc-4f98-8856-2b5167c656d5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:26.729624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-21bd68f2-1fcc-4f98-8856-2b5167c656d5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:26.742061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21bd68f2-1fcc-4f98-8856-2b5167c656d5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:26.742586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21bd68f2-1fcc-4f98-8856-2b5167c656d5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:26.743068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21bd68f2-1fcc-4f98-8856-2b5167c656d5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:26.743785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21bd68f2-1fcc-4f98-8856-2b5167c656d5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:26.745095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21bd68f2-1fcc-4f98-8856-2b5167c656d5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:26.745721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21bd68f2-1fcc-4f98-8856-2b5167c656d5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:26.791007 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d01e0112-4222-4695-a544-5de4cf3ca09b tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871/action" status: 202 len: 0 microversion: 2.25 time: 4.916092 Aug 18 11:27:26.797648 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 304/634] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 18 11:27:21 2022] POST /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871/action => generated 0 bytes in 4925 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:27:26.814758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df428180-a150-4b24-81df-3f3769f43047 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:26.815630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df428180-a150-4b24-81df-3f3769f43047 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:26.830989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df428180-a150-4b24-81df-3f3769f43047 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:26.832446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df428180-a150-4b24-81df-3f3769f43047 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:26.833429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df428180-a150-4b24-81df-3f3769f43047 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:26.834729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df428180-a150-4b24-81df-3f3769f43047 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:26.838239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df428180-a150-4b24-81df-3f3769f43047 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:26.843512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df428180-a150-4b24-81df-3f3769f43047 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:27.065034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df428180-a150-4b24-81df-3f3769f43047 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:27.084695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df428180-a150-4b24-81df-3f3769f43047 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:27.086636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df428180-a150-4b24-81df-3f3769f43047 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:27.094591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-21bd68f2-1fcc-4f98-8856-2b5167c656d5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:27.097060 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df428180-a150-4b24-81df-3f3769f43047 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1447 microversion: 2.75 time: 0.295233 Aug 18 11:27:27.098329 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 305/635] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:26 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1447 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:27.105971 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-21bd68f2-1fcc-4f98-8856-2b5167c656d5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1332 microversion: 2.1 time: 0.381233 Aug 18 11:27:27.106933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8ac43a47-392e-48be-b596-6375f6f49b6f req-b8c36b3d-bb1d-4785-8def-d6ee30898d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab517b76-7996-4c12-a108-d3fb97b955c4", "name": "network-vif-plugged", "status": "completed", "tag": "6d45270a-1cd6-41f0-9fa9-232d93d36b38"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:27.113650 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 331/636] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:26 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1332 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:27.118749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-71d660e6-b688-4dfc-b5c8-b98eaf83ece8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:27.120888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-71d660e6-b688-4dfc-b5c8-b98eaf83ece8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:27.132858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8ac43a47-392e-48be-b596-6375f6f49b6f req-b8c36b3d-bb1d-4785-8def-d6ee30898d93 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:27.133645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8ac43a47-392e-48be-b596-6375f6f49b6f req-b8c36b3d-bb1d-4785-8def-d6ee30898d93 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:27.134747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8ac43a47-392e-48be-b596-6375f6f49b6f req-b8c36b3d-bb1d-4785-8def-d6ee30898d93 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:27.137106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71d660e6-b688-4dfc-b5c8-b98eaf83ece8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:27.137595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71d660e6-b688-4dfc-b5c8-b98eaf83ece8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:27.143341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71d660e6-b688-4dfc-b5c8-b98eaf83ece8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:27.144397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71d660e6-b688-4dfc-b5c8-b98eaf83ece8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:27.144893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71d660e6-b688-4dfc-b5c8-b98eaf83ece8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:27.145319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71d660e6-b688-4dfc-b5c8-b98eaf83ece8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:27.164993 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8ac43a47-392e-48be-b596-6375f6f49b6f req-b8c36b3d-bb1d-4785-8def-d6ee30898d93 service nova] Creating event network-vif-plugged:6d45270a-1cd6-41f0-9fa9-232d93d36b38 for instance ab517b76-7996-4c12-a108-d3fb97b955c4 on n-h1-853611-3 Aug 18 11:27:27.177189 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8ac43a47-392e-48be-b596-6375f6f49b6f req-b8c36b3d-bb1d-4785-8def-d6ee30898d93 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075765 Aug 18 11:27:27.181908 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 306/637] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:27.203735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7969f71-7e0d-405d-931a-127d00665bd7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:27.204464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e7969f71-7e0d-405d-931a-127d00665bd7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:27.220110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7969f71-7e0d-405d-931a-127d00665bd7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:27.231793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7969f71-7e0d-405d-931a-127d00665bd7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:27.232427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7969f71-7e0d-405d-931a-127d00665bd7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:27.233328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7969f71-7e0d-405d-931a-127d00665bd7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:27.234045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7969f71-7e0d-405d-931a-127d00665bd7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:27.234660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7969f71-7e0d-405d-931a-127d00665bd7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:27.457438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-71d660e6-b688-4dfc-b5c8-b98eaf83ece8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:27.468050 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-71d660e6-b688-4dfc-b5c8-b98eaf83ece8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d" status: 200 len: 1318 microversion: 2.1 time: 0.352931 Aug 18 11:27:27.469396 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 332/638] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:27 2022] GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:27.482840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-66a0a84f-99aa-4260-8c48-7e6805e28530 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:27.483787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-66a0a84f-99aa-4260-8c48-7e6805e28530 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:27.508608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66a0a84f-99aa-4260-8c48-7e6805e28530 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:27.509437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66a0a84f-99aa-4260-8c48-7e6805e28530 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:27.510048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66a0a84f-99aa-4260-8c48-7e6805e28530 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:27.510982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66a0a84f-99aa-4260-8c48-7e6805e28530 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:27.511605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66a0a84f-99aa-4260-8c48-7e6805e28530 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:27.512195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66a0a84f-99aa-4260-8c48-7e6805e28530 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:27.792917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-66a0a84f-99aa-4260-8c48-7e6805e28530 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:27.801720 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-66a0a84f-99aa-4260-8c48-7e6805e28530 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697" status: 200 len: 1322 microversion: 2.1 time: 0.330961 Aug 18 11:27:27.806861 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 333/639] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:27 2022] GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:27.822765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-0aa36951-dc58-48e1-b3aa-0f8372345923 req-651f3e72-be87-4ef4-886a-e9ed9ad50897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42a8af3b-ff13-4c75-a982-d3910fe5c697", "tag": "05a28f8a-b1ca-45a0-aec4-aa88c71919a2"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:27.843080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0aa36951-dc58-48e1-b3aa-0f8372345923 req-651f3e72-be87-4ef4-886a-e9ed9ad50897 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:27.849540 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0aa36951-dc58-48e1-b3aa-0f8372345923 req-651f3e72-be87-4ef4-886a-e9ed9ad50897 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:27.850396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0aa36951-dc58-48e1-b3aa-0f8372345923 req-651f3e72-be87-4ef4-886a-e9ed9ad50897 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:27.869414 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-0aa36951-dc58-48e1-b3aa-0f8372345923 req-651f3e72-be87-4ef4-886a-e9ed9ad50897 service nova] Creating event network-changed:05a28f8a-b1ca-45a0-aec4-aa88c71919a2 for instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 on n-h1-853611-3 Aug 18 11:27:27.874525 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-0aa36951-dc58-48e1-b3aa-0f8372345923 req-651f3e72-be87-4ef4-886a-e9ed9ad50897 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066171 Aug 18 11:27:27.875332 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 334/640] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:28.125497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b8765921-f276-4cc0-88ab-0c65b004bbca tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:28.127003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b8765921-f276-4cc0-88ab-0c65b004bbca tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:28.141126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8765921-f276-4cc0-88ab-0c65b004bbca tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:28.142006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8765921-f276-4cc0-88ab-0c65b004bbca tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:28.142725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8765921-f276-4cc0-88ab-0c65b004bbca tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:28.143697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8765921-f276-4cc0-88ab-0c65b004bbca tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:28.144402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8765921-f276-4cc0-88ab-0c65b004bbca tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:28.150913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8765921-f276-4cc0-88ab-0c65b004bbca tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:28.216349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e7969f71-7e0d-405d-931a-127d00665bd7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:28.227491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e7969f71-7e0d-405d-931a-127d00665bd7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:28.230168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e7969f71-7e0d-405d-931a-127d00665bd7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:28.232067 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e7969f71-7e0d-405d-931a-127d00665bd7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1569 microversion: 2.25 time: 1.048093 Aug 18 11:27:28.233339 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 307/641] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:27 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1569 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:28.240246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-77d67723-0073-411e-8f46-379d57216035 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:28.241240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-77d67723-0073-411e-8f46-379d57216035 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:28.253851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77d67723-0073-411e-8f46-379d57216035 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:28.254715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77d67723-0073-411e-8f46-379d57216035 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:28.255402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77d67723-0073-411e-8f46-379d57216035 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:28.256343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77d67723-0073-411e-8f46-379d57216035 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:28.257221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77d67723-0073-411e-8f46-379d57216035 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:28.257861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77d67723-0073-411e-8f46-379d57216035 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:28.302747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b8765921-f276-4cc0-88ab-0c65b004bbca tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:28.320362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b8765921-f276-4cc0-88ab-0c65b004bbca tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:28.322021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b8765921-f276-4cc0-88ab-0c65b004bbca tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:28.336128 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b8765921-f276-4cc0-88ab-0c65b004bbca tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1447 microversion: 2.75 time: 0.215757 Aug 18 11:27:28.337072 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 335/642] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:28 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1447 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:27:28.493560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c4915036-95f6-4d08-9db3-b7e65cedcf48 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:28.494779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c4915036-95f6-4d08-9db3-b7e65cedcf48 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:28.501523 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4915036-95f6-4d08-9db3-b7e65cedcf48 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:28.502018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4915036-95f6-4d08-9db3-b7e65cedcf48 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:28.502477 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4915036-95f6-4d08-9db3-b7e65cedcf48 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:28.504688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4915036-95f6-4d08-9db3-b7e65cedcf48 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:28.505333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4915036-95f6-4d08-9db3-b7e65cedcf48 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:28.505766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4915036-95f6-4d08-9db3-b7e65cedcf48 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:28.662982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-77d67723-0073-411e-8f46-379d57216035 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:28.679056 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-77d67723-0073-411e-8f46-379d57216035 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1332 microversion: 2.1 time: 0.444388 Aug 18 11:27:28.680279 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 308/643] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:28 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1332 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:28.715139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c4915036-95f6-4d08-9db3-b7e65cedcf48 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:28.727266 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c4915036-95f6-4d08-9db3-b7e65cedcf48 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d" status: 200 len: 1318 microversion: 2.1 time: 0.238691 Aug 18 11:27:28.728649 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 336/644] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:28 2022] GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:28.845309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b3bce5e3-07eb-4502-a137-0395e6cbf0c1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:28.846810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b3bce5e3-07eb-4502-a137-0395e6cbf0c1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:28.855867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3bce5e3-07eb-4502-a137-0395e6cbf0c1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:28.857649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3bce5e3-07eb-4502-a137-0395e6cbf0c1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:28.858277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3bce5e3-07eb-4502-a137-0395e6cbf0c1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:28.859179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3bce5e3-07eb-4502-a137-0395e6cbf0c1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:28.859799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3bce5e3-07eb-4502-a137-0395e6cbf0c1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:28.860386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3bce5e3-07eb-4502-a137-0395e6cbf0c1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:28.893983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:29.259741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-78cb129d-39a5-48a1-99c2-bae8352b16d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:29.260363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-78cb129d-39a5-48a1-99c2-bae8352b16d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:29.270786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78cb129d-39a5-48a1-99c2-bae8352b16d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:29.271610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78cb129d-39a5-48a1-99c2-bae8352b16d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:29.272257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78cb129d-39a5-48a1-99c2-bae8352b16d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:29.273383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78cb129d-39a5-48a1-99c2-bae8352b16d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:29.274077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78cb129d-39a5-48a1-99c2-bae8352b16d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:29.274804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78cb129d-39a5-48a1-99c2-bae8352b16d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:29.453051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-78cb129d-39a5-48a1-99c2-bae8352b16d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:29.458930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b3bce5e3-07eb-4502-a137-0395e6cbf0c1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:29.469146 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b3bce5e3-07eb-4502-a137-0395e6cbf0c1 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697" status: 200 len: 1322 microversion: 2.1 time: 0.631929 Aug 18 11:27:29.471215 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 309/645] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:28 2022] GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 => generated 1322 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:29.482036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6b8ec959-9a38-4e50-b9b3-1d6c88091c21 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:29.487046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-78cb129d-39a5-48a1-99c2-bae8352b16d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:29.488375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6b8ec959-9a38-4e50-b9b3-1d6c88091c21 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:29.491174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-78cb129d-39a5-48a1-99c2-bae8352b16d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:29.493660 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-78cb129d-39a5-48a1-99c2-bae8352b16d3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1569 microversion: 2.25 time: 0.237543 Aug 18 11:27:29.496148 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 337/646] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:29 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:27:29.498978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b8ec959-9a38-4e50-b9b3-1d6c88091c21 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:29.500218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b8ec959-9a38-4e50-b9b3-1d6c88091c21 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:29.501121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b8ec959-9a38-4e50-b9b3-1d6c88091c21 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:29.502134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b8ec959-9a38-4e50-b9b3-1d6c88091c21 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:29.502939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b8ec959-9a38-4e50-b9b3-1d6c88091c21 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:29.504240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b8ec959-9a38-4e50-b9b3-1d6c88091c21 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:29.622542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6b8ec959-9a38-4e50-b9b3-1d6c88091c21 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:29.632198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6b8ec959-9a38-4e50-b9b3-1d6c88091c21 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:29.634726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6b8ec959-9a38-4e50-b9b3-1d6c88091c21 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:29.640868 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6b8ec959-9a38-4e50-b9b3-1d6c88091c21 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1447 microversion: 2.75 time: 0.167477 Aug 18 11:27:29.641721 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 310/647] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:29 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1447 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:29.701283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b540e5b6-f89b-41a0-bfb7-9b65b33c70a1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:29.702658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b540e5b6-f89b-41a0-bfb7-9b65b33c70a1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:29.715482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b540e5b6-f89b-41a0-bfb7-9b65b33c70a1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:29.717797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b540e5b6-f89b-41a0-bfb7-9b65b33c70a1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:29.719405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b540e5b6-f89b-41a0-bfb7-9b65b33c70a1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:29.724462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b540e5b6-f89b-41a0-bfb7-9b65b33c70a1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:29.726157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b540e5b6-f89b-41a0-bfb7-9b65b33c70a1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:29.727747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b540e5b6-f89b-41a0-bfb7-9b65b33c70a1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:29.749727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a735c696-841d-4bc9-a19d-81a8a35772b3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:29.750377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a735c696-841d-4bc9-a19d-81a8a35772b3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:29.765209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a735c696-841d-4bc9-a19d-81a8a35772b3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:29.765711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a735c696-841d-4bc9-a19d-81a8a35772b3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:29.771379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a735c696-841d-4bc9-a19d-81a8a35772b3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:29.772349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a735c696-841d-4bc9-a19d-81a8a35772b3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:29.772845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a735c696-841d-4bc9-a19d-81a8a35772b3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:29.773286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a735c696-841d-4bc9-a19d-81a8a35772b3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:29.956982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b540e5b6-f89b-41a0-bfb7-9b65b33c70a1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:30.002553 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b540e5b6-f89b-41a0-bfb7-9b65b33c70a1 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1332 microversion: 2.1 time: 0.301966 Aug 18 11:27:30.026278 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 338/648] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:29 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1332 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:27:30.386186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:30.409515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=5 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:30.470464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-a4c602bd-bf90-4fda-bc73-8c1bf6e7c9c5 req-cb54e31d-e701-4f6e-a1f6-97dbb61b5116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3052f2-209e-43f1-a4a4-227ac5bc5f3d", "name": "network-vif-plugged", "status": "completed", "tag": "1687b236-5319-4914-8231-40725c72104a"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:30.500527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a4c602bd-bf90-4fda-bc73-8c1bf6e7c9c5 req-cb54e31d-e701-4f6e-a1f6-97dbb61b5116 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:30.501193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a4c602bd-bf90-4fda-bc73-8c1bf6e7c9c5 req-cb54e31d-e701-4f6e-a1f6-97dbb61b5116 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:30.501465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a4c602bd-bf90-4fda-bc73-8c1bf6e7c9c5 req-cb54e31d-e701-4f6e-a1f6-97dbb61b5116 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:30.536821 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-a4c602bd-bf90-4fda-bc73-8c1bf6e7c9c5 req-cb54e31d-e701-4f6e-a1f6-97dbb61b5116 service nova] Creating event network-vif-plugged:1687b236-5319-4914-8231-40725c72104a for instance dd3052f2-209e-43f1-a4a4-227ac5bc5f3d on n-h2-853611-3 Aug 18 11:27:30.553651 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-a4c602bd-bf90-4fda-bc73-8c1bf6e7c9c5 req-cb54e31d-e701-4f6e-a1f6-97dbb61b5116 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087665 Aug 18 11:27:30.557460 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 339/649] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:27:30.571261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-181645ac-3633-4353-b296-f874686defef tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:30.577322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-181645ac-3633-4353-b296-f874686defef tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:30.593008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-181645ac-3633-4353-b296-f874686defef tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:30.594849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-181645ac-3633-4353-b296-f874686defef tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:30.595558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-181645ac-3633-4353-b296-f874686defef tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:30.597827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-181645ac-3633-4353-b296-f874686defef tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:30.599097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-181645ac-3633-4353-b296-f874686defef tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:30.599764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-181645ac-3633-4353-b296-f874686defef tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:30.643292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a735c696-841d-4bc9-a19d-81a8a35772b3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:30.655192 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a735c696-841d-4bc9-a19d-81a8a35772b3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d" status: 200 len: 1318 microversion: 2.1 time: 0.908940 Aug 18 11:27:30.656152 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 311/650] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:29 2022] GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d => generated 1318 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:27:30.675242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f197e032-5b08-40ce-b77a-75cc5571407f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:30.676541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f197e032-5b08-40ce-b77a-75cc5571407f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:30.702073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f197e032-5b08-40ce-b77a-75cc5571407f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:30.704425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f197e032-5b08-40ce-b77a-75cc5571407f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:30.705078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f197e032-5b08-40ce-b77a-75cc5571407f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:30.713712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f197e032-5b08-40ce-b77a-75cc5571407f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:30.715037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f197e032-5b08-40ce-b77a-75cc5571407f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:30.723507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f197e032-5b08-40ce-b77a-75cc5571407f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:31.189876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-181645ac-3633-4353-b296-f874686defef tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:31.207201 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-181645ac-3633-4353-b296-f874686defef tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697" status: 200 len: 1322 microversion: 2.1 time: 0.640602 Aug 18 11:27:31.210272 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 340/651] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:30 2022] GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 => generated 1322 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:31.219402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-be504e6f-9d84-4fba-9ff3-d3c87714fea3 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:31.220021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-be504e6f-9d84-4fba-9ff3-d3c87714fea3 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:31.267359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be504e6f-9d84-4fba-9ff3-d3c87714fea3 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:31.268236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be504e6f-9d84-4fba-9ff3-d3c87714fea3 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:31.271601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be504e6f-9d84-4fba-9ff3-d3c87714fea3 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:31.276184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be504e6f-9d84-4fba-9ff3-d3c87714fea3 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:31.279538 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be504e6f-9d84-4fba-9ff3-d3c87714fea3 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:31.281311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be504e6f-9d84-4fba-9ff3-d3c87714fea3 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:31.492582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-be504e6f-9d84-4fba-9ff3-d3c87714fea3 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:31.505097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-be504e6f-9d84-4fba-9ff3-d3c87714fea3 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:31.506831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-be504e6f-9d84-4fba-9ff3-d3c87714fea3 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:31.516021 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-be504e6f-9d84-4fba-9ff3-d3c87714fea3 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1447 microversion: 2.75 time: 0.304595 Aug 18 11:27:31.516683 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 341/652] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:31 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1447 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:31.538656 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-86262f95-f036-45ed-91f0-82f78c351b9c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:31.539492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-86262f95-f036-45ed-91f0-82f78c351b9c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:31.552815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-86262f95-f036-45ed-91f0-82f78c351b9c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:31.553330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-86262f95-f036-45ed-91f0-82f78c351b9c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:31.553775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-86262f95-f036-45ed-91f0-82f78c351b9c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:31.554521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-86262f95-f036-45ed-91f0-82f78c351b9c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:31.554981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-86262f95-f036-45ed-91f0-82f78c351b9c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:31.555409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-86262f95-f036-45ed-91f0-82f78c351b9c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:31.660855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f197e032-5b08-40ce-b77a-75cc5571407f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:31.670794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f197e032-5b08-40ce-b77a-75cc5571407f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:31.676808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f197e032-5b08-40ce-b77a-75cc5571407f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:31.678018 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f197e032-5b08-40ce-b77a-75cc5571407f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1569 microversion: 2.25 time: 1.020712 Aug 18 11:27:31.686776 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 312/653] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:30 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1569 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:31.691275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-e717982a-a246-40ad-bae0-a10b1c7c1628 req-178080d9-1b0f-49fb-ad75-bb7600ac4526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ebd4b99-aee2-480b-b361-3bdc41f5a871", "name": "network-vif-unplugged", "status": "completed", "tag": "c4f46619-40b4-4c76-b5f3-e22d33b57732"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:31.704393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:31.715634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e717982a-a246-40ad-bae0-a10b1c7c1628 req-178080d9-1b0f-49fb-ad75-bb7600ac4526 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:31.723365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e717982a-a246-40ad-bae0-a10b1c7c1628 req-178080d9-1b0f-49fb-ad75-bb7600ac4526 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:31.725654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e717982a-a246-40ad-bae0-a10b1c7c1628 req-178080d9-1b0f-49fb-ad75-bb7600ac4526 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:31.750575 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e717982a-a246-40ad-bae0-a10b1c7c1628 req-178080d9-1b0f-49fb-ad75-bb7600ac4526 service nova] Creating event network-vif-unplugged:c4f46619-40b4-4c76-b5f3-e22d33b57732 for instance 6ebd4b99-aee2-480b-b361-3bdc41f5a871 on n-h2-853611-3 Aug 18 11:27:31.766773 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-e717982a-a246-40ad-bae0-a10b1c7c1628 req-178080d9-1b0f-49fb-ad75-bb7600ac4526 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079164 Aug 18 11:27:31.767438 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 313/654] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:31.773122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-373453c2-af0a-4039-b10a-ebc66e57d2cd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:31.773827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-373453c2-af0a-4039-b10a-ebc66e57d2cd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:31.792353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-373453c2-af0a-4039-b10a-ebc66e57d2cd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:31.792849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-373453c2-af0a-4039-b10a-ebc66e57d2cd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:31.793274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-373453c2-af0a-4039-b10a-ebc66e57d2cd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:31.794178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-373453c2-af0a-4039-b10a-ebc66e57d2cd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:31.794819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-373453c2-af0a-4039-b10a-ebc66e57d2cd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:31.795394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-373453c2-af0a-4039-b10a-ebc66e57d2cd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:32.100423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-373453c2-af0a-4039-b10a-ebc66e57d2cd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:32.119642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-86262f95-f036-45ed-91f0-82f78c351b9c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:32.131835 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-373453c2-af0a-4039-b10a-ebc66e57d2cd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d" status: 200 len: 1318 microversion: 2.1 time: 0.360415 Aug 18 11:27:32.133199 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 314/655] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:31 2022] GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:32.135015 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-86262f95-f036-45ed-91f0-82f78c351b9c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1536 microversion: 2.1 time: 0.599688 Aug 18 11:27:32.136868 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 342/656] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:31 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1536 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:32.163416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7da88cb1-e6a8-410c-8aa4-a535553591ec tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Action: 'create', calling method: .version_select at 0x7f519fe7c160>, body: {"pool": "00ac6dac-3b97-4d4d-b1c0-f9ef06cd8cc0"} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:32.228905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-13d43bb0-2adf-437e-91f1-fb591c82f619 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:32.229803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-13d43bb0-2adf-437e-91f1-fb591c82f619 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:32.239682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13d43bb0-2adf-437e-91f1-fb591c82f619 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:32.242769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13d43bb0-2adf-437e-91f1-fb591c82f619 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:32.244132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13d43bb0-2adf-437e-91f1-fb591c82f619 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:32.247769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13d43bb0-2adf-437e-91f1-fb591c82f619 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:32.248459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13d43bb0-2adf-437e-91f1-fb591c82f619 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:32.252930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13d43bb0-2adf-437e-91f1-fb591c82f619 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:32.887615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-13d43bb0-2adf-437e-91f1-fb591c82f619 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:32.896567 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-13d43bb0-2adf-437e-91f1-fb591c82f619 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697" status: 200 len: 1322 microversion: 2.1 time: 0.671873 Aug 18 11:27:32.909978 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 343/657] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:32 2022] GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 => generated 1322 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:32.909978 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8087b83c-2b8e-462f-910e-f8bab0822c50 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:32.909978 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8087b83c-2b8e-462f-910e-f8bab0822c50 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:32.919369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8087b83c-2b8e-462f-910e-f8bab0822c50 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:32.920430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8087b83c-2b8e-462f-910e-f8bab0822c50 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:32.920943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8087b83c-2b8e-462f-910e-f8bab0822c50 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:32.921684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8087b83c-2b8e-462f-910e-f8bab0822c50 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:32.922368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8087b83c-2b8e-462f-910e-f8bab0822c50 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:32.922869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8087b83c-2b8e-462f-910e-f8bab0822c50 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:33.101685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8087b83c-2b8e-462f-910e-f8bab0822c50 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:33.119030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8087b83c-2b8e-462f-910e-f8bab0822c50 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:33.121043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8087b83c-2b8e-462f-910e-f8bab0822c50 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:33.144180 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8087b83c-2b8e-462f-910e-f8bab0822c50 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1447 microversion: 2.75 time: 0.241926 Aug 18 11:27:33.145024 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 344/658] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:32 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1447 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:33.160119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6480ebc8-4599-4676-a243-75d4d4a4183e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:33.166170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6480ebc8-4599-4676-a243-75d4d4a4183e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:33.182545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6480ebc8-4599-4676-a243-75d4d4a4183e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:33.183346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6480ebc8-4599-4676-a243-75d4d4a4183e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:33.183981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6480ebc8-4599-4676-a243-75d4d4a4183e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:33.184958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6480ebc8-4599-4676-a243-75d4d4a4183e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:33.186022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6480ebc8-4599-4676-a243-75d4d4a4183e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:33.186888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6480ebc8-4599-4676-a243-75d4d4a4183e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:34.154068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6480ebc8-4599-4676-a243-75d4d4a4183e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:34.169094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6480ebc8-4599-4676-a243-75d4d4a4183e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:34.172843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6480ebc8-4599-4676-a243-75d4d4a4183e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:34.174078 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6480ebc8-4599-4676-a243-75d4d4a4183e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1569 microversion: 2.25 time: 1.027971 Aug 18 11:27:34.178677 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 345/659] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:33 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1569 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:34.188392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c89fd061-5c77-4975-b895-4f27010be9fc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:34.189019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c89fd061-5c77-4975-b895-4f27010be9fc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:34.212612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c89fd061-5c77-4975-b895-4f27010be9fc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:34.213416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c89fd061-5c77-4975-b895-4f27010be9fc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:34.214031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c89fd061-5c77-4975-b895-4f27010be9fc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:34.214967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c89fd061-5c77-4975-b895-4f27010be9fc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:34.215614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c89fd061-5c77-4975-b895-4f27010be9fc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:34.216202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c89fd061-5c77-4975-b895-4f27010be9fc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:34.661504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c89fd061-5c77-4975-b895-4f27010be9fc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:34.670680 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c89fd061-5c77-4975-b895-4f27010be9fc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d" status: 200 len: 1467 microversion: 2.1 time: 0.490370 Aug 18 11:27:34.671918 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 346/660] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:34 2022] GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d => generated 1467 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:34.677577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-f5950452-5713-4806-b5ac-da0ef8edc93f req-78968708-d919-49b0-ab22-c2af938b8e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ebd4b99-aee2-480b-b361-3bdc41f5a871", "tag": "c4f46619-40b4-4c76-b5f3-e22d33b57732"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:34.708961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f5950452-5713-4806-b5ac-da0ef8edc93f req-78968708-d919-49b0-ab22-c2af938b8e2c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:34.709761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f5950452-5713-4806-b5ac-da0ef8edc93f req-78968708-d919-49b0-ab22-c2af938b8e2c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:34.710369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f5950452-5713-4806-b5ac-da0ef8edc93f req-78968708-d919-49b0-ab22-c2af938b8e2c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:34.728210 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-f5950452-5713-4806-b5ac-da0ef8edc93f req-78968708-d919-49b0-ab22-c2af938b8e2c service nova] Creating event network-changed:c4f46619-40b4-4c76-b5f3-e22d33b57732 for instance 6ebd4b99-aee2-480b-b361-3bdc41f5a871 on n-h2-853611-3 Aug 18 11:27:34.736357 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-f5950452-5713-4806-b5ac-da0ef8edc93f req-78968708-d919-49b0-ab22-c2af938b8e2c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062957 Aug 18 11:27:34.738294 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 347/661] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:34.751318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-92c7009a-5655-4570-850a-0a7890d171cc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:34.753016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-92c7009a-5655-4570-850a-0a7890d171cc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:34.768858 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92c7009a-5655-4570-850a-0a7890d171cc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:34.769356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92c7009a-5655-4570-850a-0a7890d171cc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:34.769798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92c7009a-5655-4570-850a-0a7890d171cc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:34.771032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92c7009a-5655-4570-850a-0a7890d171cc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:34.771500 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92c7009a-5655-4570-850a-0a7890d171cc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:34.772118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92c7009a-5655-4570-850a-0a7890d171cc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:35.501216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-92c7009a-5655-4570-850a-0a7890d171cc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:35.514225 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-92c7009a-5655-4570-850a-0a7890d171cc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697" status: 200 len: 1322 microversion: 2.1 time: 0.774328 Aug 18 11:27:35.519902 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 348/662] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:34 2022] GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 => generated 1322 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:35.525167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-446fdbc7-4e1e-4e60-9dbb-2eb8318b8abf tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:35.535613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-446fdbc7-4e1e-4e60-9dbb-2eb8318b8abf tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:35.565014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-446fdbc7-4e1e-4e60-9dbb-2eb8318b8abf tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:35.565993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-446fdbc7-4e1e-4e60-9dbb-2eb8318b8abf tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:35.569874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-446fdbc7-4e1e-4e60-9dbb-2eb8318b8abf tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:35.571578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-446fdbc7-4e1e-4e60-9dbb-2eb8318b8abf tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:35.572270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-446fdbc7-4e1e-4e60-9dbb-2eb8318b8abf tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:35.573061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-446fdbc7-4e1e-4e60-9dbb-2eb8318b8abf tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:35.618759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:35.729411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-446fdbc7-4e1e-4e60-9dbb-2eb8318b8abf tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:35.744547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-446fdbc7-4e1e-4e60-9dbb-2eb8318b8abf tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:35.748410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-446fdbc7-4e1e-4e60-9dbb-2eb8318b8abf tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:35.776258 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-446fdbc7-4e1e-4e60-9dbb-2eb8318b8abf tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1447 microversion: 2.75 time: 0.253740 Aug 18 11:27:35.781852 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 349/663] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:35 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1447 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:35.788996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:35.795594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:35.804789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Searching by: {'reservation_id': 'r-41hlnq1t', 'deleted': False, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:27:35.820302 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:35.822579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:35.823320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:35.824347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:35.825214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:35.825868 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:36.062421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:27:36.161282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:36.173623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:36.175193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:36.175924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:36.461895 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-147835c8-8e35-4e3b-9aac-c6975a322db3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/detail?reservation_id=r-41hlnq1t" status: 200 len: 2927 microversion: 2.1 time: 0.678079 Aug 18 11:27:36.463533 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 350/664] 10.222.0.73 () {58 vars in 1197 bytes} [Thu Aug 18 11:27:35 2022] GET /compute/v2.1/servers/detail?reservation_id=r-41hlnq1t => generated 2927 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:36.480055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b8bceb50-7c4b-4df8-9b35-afc6c6729c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:36.482169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b8bceb50-7c4b-4df8-9b35-afc6c6729c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:36.497697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8bceb50-7c4b-4df8-9b35-afc6c6729c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:36.498844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8bceb50-7c4b-4df8-9b35-afc6c6729c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:36.499729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8bceb50-7c4b-4df8-9b35-afc6c6729c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:36.500782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8bceb50-7c4b-4df8-9b35-afc6c6729c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:36.501626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8bceb50-7c4b-4df8-9b35-afc6c6729c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:36.503720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8bceb50-7c4b-4df8-9b35-afc6c6729c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:36.519738 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7da88cb1-e6a8-410c-8aa4-a535553591ec tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.363086 Aug 18 11:27:36.526693 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 315/665] 10.222.0.73 () {60 vars in 1170 bytes} [Thu Aug 18 11:27:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:36.691880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1154125485", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "e8f8f2ff-7601-4fd1-9ee3-58fd8a4e9af3"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:36.807559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] validate_networks() for [('e8f8f2ff-7601-4fd1-9ee3-58fd8a4e9af3', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:27:36.822460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b8bceb50-7c4b-4df8-9b35-afc6c6729c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:36.822460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b8bceb50-7c4b-4df8-9b35-afc6c6729c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:36.825844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b8bceb50-7c4b-4df8-9b35-afc6c6729c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:36.825844 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b8bceb50-7c4b-4df8-9b35-afc6c6729c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1569 microversion: 2.25 time: 0.360754 Aug 18 11:27:36.826095 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 351/666] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:36 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1569 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:36.834643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-133d5e05-b255-4469-ad5c-cee32a9197c5 req-09329aa1-5d45-4433-853a-c35cebd3a9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42a8af3b-ff13-4c75-a982-d3910fe5c697", "name": "network-vif-plugged", "status": "completed", "tag": "05a28f8a-b1ca-45a0-aec4-aa88c71919a2"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:36.844717 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-133d5e05-b255-4469-ad5c-cee32a9197c5 req-09329aa1-5d45-4433-853a-c35cebd3a9f8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:36.845217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-133d5e05-b255-4469-ad5c-cee32a9197c5 req-09329aa1-5d45-4433-853a-c35cebd3a9f8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:36.846332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-133d5e05-b255-4469-ad5c-cee32a9197c5 req-09329aa1-5d45-4433-853a-c35cebd3a9f8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:36.859648 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-133d5e05-b255-4469-ad5c-cee32a9197c5 req-09329aa1-5d45-4433-853a-c35cebd3a9f8 service nova] Creating event network-vif-plugged:05a28f8a-b1ca-45a0-aec4-aa88c71919a2 for instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 on n-h1-853611-3 Aug 18 11:27:36.872462 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-133d5e05-b255-4469-ad5c-cee32a9197c5 req-09329aa1-5d45-4433-853a-c35cebd3a9f8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041904 Aug 18 11:27:36.873562 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 352/667] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:36.879775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6ec678e5-f36c-4789-b505-c8f69b3d9f82 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:36.903980 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.compute.server_groups [None req-6ec678e5-f36c-4789-b505-c8f69b3d9f82 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Querying cell 68989ef7-340f-4449-87c1-932f111c2bdb(cell1) for 2 instances {{(pid=122209) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 18 11:27:36.905188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ec678e5-f36c-4789-b505-c8f69b3d9f82 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:36.905188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ec678e5-f36c-4789-b505-c8f69b3d9f82 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:36.906498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ec678e5-f36c-4789-b505-c8f69b3d9f82 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:36.949174 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6ec678e5-f36c-4789-b505-c8f69b3d9f82 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/os-server-groups/33adfeb6-880c-4582-819a-f4dc2c458c41" status: 200 len: 268 microversion: 2.1 time: 0.073927 Aug 18 11:27:36.950136 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 353/668] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:27:36 2022] GET /compute/v2.1/os-server-groups/33adfeb6-880c-4582-819a-f4dc2c458c41 => generated 268 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:36.956575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-125ed48d-0880-40ca-93d0-a4520063e52d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Action: 'action', calling method: .version_select at 0x7f51ae75ac10>, body: {"addFloatingIp": {"address": "172.25.0.204"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:36.959774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-125ed48d-0880-40ca-93d0-a4520063e52d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:36.988374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-125ed48d-0880-40ca-93d0-a4520063e52d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:36.989205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-125ed48d-0880-40ca-93d0-a4520063e52d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:36.989815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-125ed48d-0880-40ca-93d0-a4520063e52d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:36.990739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-125ed48d-0880-40ca-93d0-a4520063e52d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:36.991503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-125ed48d-0880-40ca-93d0-a4520063e52d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:36.997838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-125ed48d-0880-40ca-93d0-a4520063e52d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:37.200483 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-125ed48d-0880-40ca-93d0-a4520063e52d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "refresh_cache-ab517b76-7996-4c12-a108-d3fb97b955c4" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:27:37.200669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-125ed48d-0880-40ca-93d0-a4520063e52d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquired lock "refresh_cache-ab517b76-7996-4c12-a108-d3fb97b955c4" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:27:37.594381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:27:37.595839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:27:37.596687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:27:37.597331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:27:37.597961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:27:37.661166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:37.673512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:37.674978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:37.677150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:37.677851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:37.678622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:37.727603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Getting quotas for project 22660df6ec1a4f718a08cbeda2be364c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:27:37.751403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Getting quotas for user 0cf7fe4236764bea83c6560516441759 and project 22660df6ec1a4f718a08cbeda2be364c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:27:37.770235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:27:37.773631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:27:37.857840 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-264dce9c-379b-446f-82c2-4eef782d34c2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.336238 Aug 18 11:27:37.859351 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 316/669] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:27:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:27:37.865480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24696be1-443b-4447-ad37-6651533569a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:37.866912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-24696be1-443b-4447-ad37-6651533569a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:37.876623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24696be1-443b-4447-ad37-6651533569a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:37.877935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24696be1-443b-4447-ad37-6651533569a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:37.881583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24696be1-443b-4447-ad37-6651533569a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:37.882726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24696be1-443b-4447-ad37-6651533569a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:37.883669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24696be1-443b-4447-ad37-6651533569a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:37.884588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24696be1-443b-4447-ad37-6651533569a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:38.272660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-24696be1-443b-4447-ad37-6651533569a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:38.285531 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-24696be1-443b-4447-ad37-6651533569a0 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697" status: 200 len: 1322 microversion: 2.1 time: 0.424664 Aug 18 11:27:38.287256 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 317/670] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:37 2022] GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:38.301110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-da49590a-5cef-4a54-8844-08b6319c94a5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:38.304087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-da49590a-5cef-4a54-8844-08b6319c94a5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:38.317417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da49590a-5cef-4a54-8844-08b6319c94a5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:38.321486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da49590a-5cef-4a54-8844-08b6319c94a5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:38.324803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da49590a-5cef-4a54-8844-08b6319c94a5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:38.327254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da49590a-5cef-4a54-8844-08b6319c94a5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:38.332798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da49590a-5cef-4a54-8844-08b6319c94a5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:38.333884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da49590a-5cef-4a54-8844-08b6319c94a5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:38.563690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-da49590a-5cef-4a54-8844-08b6319c94a5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:38.576622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-da49590a-5cef-4a54-8844-08b6319c94a5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:38.584230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-da49590a-5cef-4a54-8844-08b6319c94a5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:38.599310 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-da49590a-5cef-4a54-8844-08b6319c94a5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1447 microversion: 2.75 time: 0.310053 Aug 18 11:27:38.603215 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 318/671] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:38 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1447 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:38.620528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5028199c-de7c-4ff3-aa5c-6f981fc1ae29 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:38.621648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5028199c-de7c-4ff3-aa5c-6f981fc1ae29 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] [instance: 53f5ee39-045c-4250-a4b5-efdd3f7b590d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:38.632060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5028199c-de7c-4ff3-aa5c-6f981fc1ae29 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:38.632914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5028199c-de7c-4ff3-aa5c-6f981fc1ae29 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:38.639516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5028199c-de7c-4ff3-aa5c-6f981fc1ae29 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:38.640767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5028199c-de7c-4ff3-aa5c-6f981fc1ae29 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:38.641535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5028199c-de7c-4ff3-aa5c-6f981fc1ae29 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:38.642230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5028199c-de7c-4ff3-aa5c-6f981fc1ae29 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:38.973336 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5028199c-de7c-4ff3-aa5c-6f981fc1ae29 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d" status: 200 len: 1618 microversion: 2.1 time: 0.368314 Aug 18 11:27:38.980573 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 319/672] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:38 2022] GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d => generated 1618 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:39.013584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f6fb0bd-1f6d-4f94-b66e-4c22f6fb0fe2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:39.015641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7f6fb0bd-1f6d-4f94-b66e-4c22f6fb0fe2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:39.031945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f6fb0bd-1f6d-4f94-b66e-4c22f6fb0fe2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:39.033585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f6fb0bd-1f6d-4f94-b66e-4c22f6fb0fe2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:39.034169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f6fb0bd-1f6d-4f94-b66e-4c22f6fb0fe2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:39.035709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f6fb0bd-1f6d-4f94-b66e-4c22f6fb0fe2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:39.036986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f6fb0bd-1f6d-4f94-b66e-4c22f6fb0fe2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:39.037702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f6fb0bd-1f6d-4f94-b66e-4c22f6fb0fe2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:39.545564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7f6fb0bd-1f6d-4f94-b66e-4c22f6fb0fe2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:39.559057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7f6fb0bd-1f6d-4f94-b66e-4c22f6fb0fe2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:39.563298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7f6fb0bd-1f6d-4f94-b66e-4c22f6fb0fe2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:39.567518 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7f6fb0bd-1f6d-4f94-b66e-4c22f6fb0fe2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1569 microversion: 2.25 time: 0.571538 Aug 18 11:27:39.586669 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 320/673] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:38 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1569 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:39.605579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c58043ab-0724-41aa-86a3-97ad4a76ac92 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:39.609653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c58043ab-0724-41aa-86a3-97ad4a76ac92 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:39.623976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c58043ab-0724-41aa-86a3-97ad4a76ac92 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:39.627409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c58043ab-0724-41aa-86a3-97ad4a76ac92 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:39.629002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c58043ab-0724-41aa-86a3-97ad4a76ac92 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:39.630635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c58043ab-0724-41aa-86a3-97ad4a76ac92 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:39.633147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c58043ab-0724-41aa-86a3-97ad4a76ac92 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:39.633755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c58043ab-0724-41aa-86a3-97ad4a76ac92 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:39.779179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c58043ab-0724-41aa-86a3-97ad4a76ac92 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:39.792221 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c58043ab-0724-41aa-86a3-97ad4a76ac92 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1263 microversion: 2.1 time: 0.204010 Aug 18 11:27:39.801440 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 321/674] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:39 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1263 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:39.820950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f42dcba3-8471-48ce-820a-521352d4bbad tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:39.822290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f42dcba3-8471-48ce-820a-521352d4bbad tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:39.841316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f42dcba3-8471-48ce-820a-521352d4bbad tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:39.842095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f42dcba3-8471-48ce-820a-521352d4bbad tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:39.843289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f42dcba3-8471-48ce-820a-521352d4bbad tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:39.844218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f42dcba3-8471-48ce-820a-521352d4bbad tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:39.844978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f42dcba3-8471-48ce-820a-521352d4bbad tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:39.846185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f42dcba3-8471-48ce-820a-521352d4bbad tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:40.093813 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f42dcba3-8471-48ce-820a-521352d4bbad tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d" status: 200 len: 1618 microversion: 2.1 time: 0.291079 Aug 18 11:27:40.145236 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 322/675] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:39 2022] GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d => generated 1618 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:40.156716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b6f17396-06c0-4880-9868-886875374076 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:40.161619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b6f17396-06c0-4880-9868-886875374076 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:40.176479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6f17396-06c0-4880-9868-886875374076 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:40.178650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6f17396-06c0-4880-9868-886875374076 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:40.179847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6f17396-06c0-4880-9868-886875374076 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:40.181629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6f17396-06c0-4880-9868-886875374076 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:40.183976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6f17396-06c0-4880-9868-886875374076 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:40.184737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6f17396-06c0-4880-9868-886875374076 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:40.560562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b6f17396-06c0-4880-9868-886875374076 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:40.569433 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b6f17396-06c0-4880-9868-886875374076 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697" status: 200 len: 1518 microversion: 2.1 time: 0.422651 Aug 18 11:27:40.570028 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 323/676] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:40 2022] GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 => generated 1518 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:40.628605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-71b7ec2c-2aad-4407-9e04-e700757dd8e5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:40.629333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-71b7ec2c-2aad-4407-9e04-e700757dd8e5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:40.668788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71b7ec2c-2aad-4407-9e04-e700757dd8e5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:40.669299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71b7ec2c-2aad-4407-9e04-e700757dd8e5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:40.669745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71b7ec2c-2aad-4407-9e04-e700757dd8e5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:40.685872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71b7ec2c-2aad-4407-9e04-e700757dd8e5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:40.698174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71b7ec2c-2aad-4407-9e04-e700757dd8e5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:40.702873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71b7ec2c-2aad-4407-9e04-e700757dd8e5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:40.940778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-71b7ec2c-2aad-4407-9e04-e700757dd8e5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:40.953839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-71b7ec2c-2aad-4407-9e04-e700757dd8e5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:40.961296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-71b7ec2c-2aad-4407-9e04-e700757dd8e5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:40.971509 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-71b7ec2c-2aad-4407-9e04-e700757dd8e5 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1447 microversion: 2.75 time: 0.374146 Aug 18 11:27:40.972147 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 324/677] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:40 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1447 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:40.999198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b259d694-c5d6-4d77-bfb8-3101dfe64a9d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:41.007452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b259d694-c5d6-4d77-bfb8-3101dfe64a9d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:41.017496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b259d694-c5d6-4d77-bfb8-3101dfe64a9d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:41.022552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b259d694-c5d6-4d77-bfb8-3101dfe64a9d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:41.023425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b259d694-c5d6-4d77-bfb8-3101dfe64a9d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:41.024444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b259d694-c5d6-4d77-bfb8-3101dfe64a9d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:41.025153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b259d694-c5d6-4d77-bfb8-3101dfe64a9d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:41.025768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b259d694-c5d6-4d77-bfb8-3101dfe64a9d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:41.091094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b259d694-c5d6-4d77-bfb8-3101dfe64a9d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:27:41.282280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-125ed48d-0880-40ca-93d0-a4520063e52d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Building network info cache for instance {{(pid=122209) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 18 11:27:41.293975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:41.326464 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b259d694-c5d6-4d77-bfb8-3101dfe64a9d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "DELETE /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 204 len: 0 microversion: 2.1 time: 0.336471 Aug 18 11:27:41.327109 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 325/678] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:27:40 2022] DELETE /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:27:41.356925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1882758774", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "3247ce04-df54-4bd8-a1e9-00a29d975b62"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:41.456250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:27:41.831859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:27:41.833066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:27:41.833696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:27:41.834421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:27:41.835013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:27:41.848398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:41.849307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:41.849921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:41.851133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:41.851753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:41.852356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:41.877245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:27:41.884487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:27:41.901451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:27:41.905655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:27:41.999625 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f9cb0a2a-52dc-4919-9234-0d97d5594f23 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661825 Aug 18 11:27:42.009265 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 326/679] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:27:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:27:42.014908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c7823db7-02bf-4900-8e17-81c25b8fa185 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:42.015871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c7823db7-02bf-4900-8e17-81c25b8fa185 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:42.025178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7823db7-02bf-4900-8e17-81c25b8fa185 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:42.026069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7823db7-02bf-4900-8e17-81c25b8fa185 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:42.026807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7823db7-02bf-4900-8e17-81c25b8fa185 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:42.027769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7823db7-02bf-4900-8e17-81c25b8fa185 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:42.028455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7823db7-02bf-4900-8e17-81c25b8fa185 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:42.029819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7823db7-02bf-4900-8e17-81c25b8fa185 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:42.056235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:42.330268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c7823db7-02bf-4900-8e17-81c25b8fa185 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:42.348593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c7823db7-02bf-4900-8e17-81c25b8fa185 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:42.352777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c7823db7-02bf-4900-8e17-81c25b8fa185 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:42.356044 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c7823db7-02bf-4900-8e17-81c25b8fa185 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1569 microversion: 2.25 time: 0.345241 Aug 18 11:27:42.358041 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 327/680] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:42 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1569 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:42.394900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f393772c-adca-48e3-bbc9-387f6f6028f5 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Action: 'action', calling method: .version_select at 0x7f51af1108b0>, body: {"addFloatingIp": {"address": "172.25.0.172"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:42.397430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f393772c-adca-48e3-bbc9-387f6f6028f5 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:42.430215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f393772c-adca-48e3-bbc9-387f6f6028f5 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:42.430769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f393772c-adca-48e3-bbc9-387f6f6028f5 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:42.431209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f393772c-adca-48e3-bbc9-387f6f6028f5 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:42.431998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f393772c-adca-48e3-bbc9-387f6f6028f5 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:42.432455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f393772c-adca-48e3-bbc9-387f6f6028f5 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:42.432874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f393772c-adca-48e3-bbc9-387f6f6028f5 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:42.526661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f393772c-adca-48e3-bbc9-387f6f6028f5 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "refresh_cache-a472fced-51fc-469b-a37a-38f98e725169" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:27:42.527622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f393772c-adca-48e3-bbc9-387f6f6028f5 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquired lock "refresh_cache-a472fced-51fc-469b-a37a-38f98e725169" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:27:44.277271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-125ed48d-0880-40ca-93d0-a4520063e52d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Updating instance_info_cache with network_info: [{"id": "6d45270a-1cd6-41f0-9fa9-232d93d36b38", "address": "fa:16:3e:b0:5e:4f", "network": {"id": "fdd58ab8-846e-466a-8c86-b730482bc074", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1517377389-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "05fb2484544849ab8ad1dbb6dec06f65", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6d45270a-1c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122209) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 18 11:27:44.317916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-125ed48d-0880-40ca-93d0-a4520063e52d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Releasing lock "refresh_cache-ab517b76-7996-4c12-a108-d3fb97b955c4" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:27:44.321572 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-125ed48d-0880-40ca-93d0-a4520063e52d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action" status: 202 len: 0 microversion: 2.1 time: 7.370086 Aug 18 11:27:44.326649 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 354/681] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:27:36 2022] POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action => generated 0 bytes in 7374 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 18 11:27:44.359525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f4394c4a-0a54-4f58-8477-7181cdafeee9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:44.363156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f4394c4a-0a54-4f58-8477-7181cdafeee9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:44.391035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4394c4a-0a54-4f58-8477-7181cdafeee9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:44.391651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4394c4a-0a54-4f58-8477-7181cdafeee9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:44.393040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4394c4a-0a54-4f58-8477-7181cdafeee9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:44.395095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4394c4a-0a54-4f58-8477-7181cdafeee9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:44.399165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4394c4a-0a54-4f58-8477-7181cdafeee9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:44.399844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4394c4a-0a54-4f58-8477-7181cdafeee9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:45.909277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:46.167018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:46.650455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f4394c4a-0a54-4f58-8477-7181cdafeee9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:46.665202 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f4394c4a-0a54-4f58-8477-7181cdafeee9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1311 microversion: 2.1 time: 2.335325 Aug 18 11:27:46.693511 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 355/682] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:44 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1311 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:46.700843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-a1b3085e-89ea-4d21-b7ee-e4c98cfacdd7 req-c4400af3-4c5c-49be-8ff2-034d2df9c3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab517b76-7996-4c12-a108-d3fb97b955c4", "tag": "6d45270a-1cd6-41f0-9fa9-232d93d36b38"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:46.750714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a1b3085e-89ea-4d21-b7ee-e4c98cfacdd7 req-c4400af3-4c5c-49be-8ff2-034d2df9c3c0 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:46.755920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a1b3085e-89ea-4d21-b7ee-e4c98cfacdd7 req-c4400af3-4c5c-49be-8ff2-034d2df9c3c0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:46.757142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a1b3085e-89ea-4d21-b7ee-e4c98cfacdd7 req-c4400af3-4c5c-49be-8ff2-034d2df9c3c0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:46.788085 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-a1b3085e-89ea-4d21-b7ee-e4c98cfacdd7 req-c4400af3-4c5c-49be-8ff2-034d2df9c3c0 service nova] Creating event network-changed:6d45270a-1cd6-41f0-9fa9-232d93d36b38 for instance ab517b76-7996-4c12-a108-d3fb97b955c4 on n-h1-853611-3 Aug 18 11:27:46.799814 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-a1b3085e-89ea-4d21-b7ee-e4c98cfacdd7 req-c4400af3-4c5c-49be-8ff2-034d2df9c3c0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104386 Aug 18 11:27:46.803620 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 356/683] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:46.812348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-950045c1-2312-4c79-b5cc-873bf246d01d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:46.813524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-950045c1-2312-4c79-b5cc-873bf246d01d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:46.832402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-950045c1-2312-4c79-b5cc-873bf246d01d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:46.833175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-950045c1-2312-4c79-b5cc-873bf246d01d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:46.833785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-950045c1-2312-4c79-b5cc-873bf246d01d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:46.834701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-950045c1-2312-4c79-b5cc-873bf246d01d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:46.835315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-950045c1-2312-4c79-b5cc-873bf246d01d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:46.835925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-950045c1-2312-4c79-b5cc-873bf246d01d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:47.321715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-f393772c-adca-48e3-bbc9-387f6f6028f5 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Building network info cache for instance {{(pid=122210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 18 11:27:47.537984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-950045c1-2312-4c79-b5cc-873bf246d01d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:47.565152 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-950045c1-2312-4c79-b5cc-873bf246d01d tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1711 microversion: 2.1 time: 0.753731 Aug 18 11:27:47.566005 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 357/684] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:46 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1711 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:47.588914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8555c711-b8dd-4a06-a62e-3983d0dfe14f tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:47.591197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8555c711-b8dd-4a06-a62e-3983d0dfe14f tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:47.628368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8555c711-b8dd-4a06-a62e-3983d0dfe14f tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:47.629327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8555c711-b8dd-4a06-a62e-3983d0dfe14f tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:47.629952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8555c711-b8dd-4a06-a62e-3983d0dfe14f tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:47.630990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8555c711-b8dd-4a06-a62e-3983d0dfe14f tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:47.631942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8555c711-b8dd-4a06-a62e-3983d0dfe14f tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:47.632536 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8555c711-b8dd-4a06-a62e-3983d0dfe14f tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:47.836792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8555c711-b8dd-4a06-a62e-3983d0dfe14f tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:47.851056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8555c711-b8dd-4a06-a62e-3983d0dfe14f tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:47.855053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8555c711-b8dd-4a06-a62e-3983d0dfe14f tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:47.865376 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8555c711-b8dd-4a06-a62e-3983d0dfe14f tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1447 microversion: 2.75 time: 0.295141 Aug 18 11:27:47.870345 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 358/685] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:47 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1447 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:47.878976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e30d49ef-7bf3-4c8a-aa2c-a8f3ee13eb27 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:47.882404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e30d49ef-7bf3-4c8a-aa2c-a8f3ee13eb27 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:47.894545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e30d49ef-7bf3-4c8a-aa2c-a8f3ee13eb27 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:47.895428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e30d49ef-7bf3-4c8a-aa2c-a8f3ee13eb27 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:47.898116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e30d49ef-7bf3-4c8a-aa2c-a8f3ee13eb27 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:47.899155 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e30d49ef-7bf3-4c8a-aa2c-a8f3ee13eb27 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:47.902636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e30d49ef-7bf3-4c8a-aa2c-a8f3ee13eb27 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:47.903378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e30d49ef-7bf3-4c8a-aa2c-a8f3ee13eb27 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:48.146370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e30d49ef-7bf3-4c8a-aa2c-a8f3ee13eb27 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:48.169684 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e30d49ef-7bf3-4c8a-aa2c-a8f3ee13eb27 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 200 len: 1275 microversion: 2.1 time: 0.297850 Aug 18 11:27:48.197456 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 359/686] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:47 2022] GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:48.216778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-42760467-47ae-4a14-9a18-e0051af77392 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:48.223533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-42760467-47ae-4a14-9a18-e0051af77392 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:48.269947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42760467-47ae-4a14-9a18-e0051af77392 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:48.271794 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42760467-47ae-4a14-9a18-e0051af77392 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:48.274248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42760467-47ae-4a14-9a18-e0051af77392 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:48.285804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42760467-47ae-4a14-9a18-e0051af77392 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:48.287100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42760467-47ae-4a14-9a18-e0051af77392 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:48.288075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42760467-47ae-4a14-9a18-e0051af77392 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:49.099289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-42760467-47ae-4a14-9a18-e0051af77392 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:49.115712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-42760467-47ae-4a14-9a18-e0051af77392 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:49.120078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-42760467-47ae-4a14-9a18-e0051af77392 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:49.121938 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-42760467-47ae-4a14-9a18-e0051af77392 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1569 microversion: 2.25 time: 0.922972 Aug 18 11:27:49.134667 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 360/687] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:48 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1569 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:49.151453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b1167463-0080-41c5-baab-bf1a0ef3be47 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Action: 'create', calling method: .version_select at 0x7f51ac1660d0>, body: {"pool": "00ac6dac-3b97-4d4d-b1c0-f9ef06cd8cc0"} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:49.213068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-f393772c-adca-48e3-bbc9-387f6f6028f5 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Updating instance_info_cache with network_info: [{"id": "dbe58053-eed9-48a6-bec0-79d514d08be6", "address": "fa:16:3e:1b:bf:bc", "network": {"id": "c1e36b66-5ff9-448b-ae68-4d66745c4f5b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-529460581-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d1fa95f956304a9bb1b34ddf82adac1a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdbe58053-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 18 11:27:49.241605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f393772c-adca-48e3-bbc9-387f6f6028f5 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Releasing lock "refresh_cache-a472fced-51fc-469b-a37a-38f98e725169" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:27:49.242814 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f393772c-adca-48e3-bbc9-387f6f6028f5 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "POST /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169/action" status: 202 len: 0 microversion: 2.1 time: 6.874121 Aug 18 11:27:49.248432 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 328/688] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:27:42 2022] POST /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169/action => generated 0 bytes in 6890 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 18 11:27:49.256017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-417a8f54-8337-428f-a793-014ac64c67ae req-acdcadb7-010b-4332-af8e-dacb6e9c60fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a472fced-51fc-469b-a37a-38f98e725169", "tag": "dbe58053-eed9-48a6-bec0-79d514d08be6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:49.268666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-417a8f54-8337-428f-a793-014ac64c67ae req-acdcadb7-010b-4332-af8e-dacb6e9c60fc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:49.269494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-417a8f54-8337-428f-a793-014ac64c67ae req-acdcadb7-010b-4332-af8e-dacb6e9c60fc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:49.270011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-417a8f54-8337-428f-a793-014ac64c67ae req-acdcadb7-010b-4332-af8e-dacb6e9c60fc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:49.287487 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-417a8f54-8337-428f-a793-014ac64c67ae req-acdcadb7-010b-4332-af8e-dacb6e9c60fc service nova] Creating event network-changed:dbe58053-eed9-48a6-bec0-79d514d08be6 for instance a472fced-51fc-469b-a37a-38f98e725169 on n-h2-853611-3 Aug 18 11:27:49.296527 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-417a8f54-8337-428f-a793-014ac64c67ae req-acdcadb7-010b-4332-af8e-dacb6e9c60fc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046033 Aug 18 11:27:49.297150 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 329/689] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:49.306643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d4fd34f3-872a-449c-94fa-268e22ec48a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:49.307534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d4fd34f3-872a-449c-94fa-268e22ec48a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:49.316754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4fd34f3-872a-449c-94fa-268e22ec48a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:49.317588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4fd34f3-872a-449c-94fa-268e22ec48a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:49.318022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4fd34f3-872a-449c-94fa-268e22ec48a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:49.319846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4fd34f3-872a-449c-94fa-268e22ec48a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:49.320578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4fd34f3-872a-449c-94fa-268e22ec48a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:49.321284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4fd34f3-872a-449c-94fa-268e22ec48a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:49.787995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d4fd34f3-872a-449c-94fa-268e22ec48a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:49.802015 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d4fd34f3-872a-449c-94fa-268e22ec48a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1311 microversion: 2.1 time: 0.499948 Aug 18 11:27:49.807855 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 330/690] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:49 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1311 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:49.813544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b186cd40-1445-4fce-9062-b622c8015e4c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:49.816136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b186cd40-1445-4fce-9062-b622c8015e4c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:49.833941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b186cd40-1445-4fce-9062-b622c8015e4c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:49.836364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b186cd40-1445-4fce-9062-b622c8015e4c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:49.836869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b186cd40-1445-4fce-9062-b622c8015e4c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:49.837853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b186cd40-1445-4fce-9062-b622c8015e4c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:49.842164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b186cd40-1445-4fce-9062-b622c8015e4c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:49.842926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b186cd40-1445-4fce-9062-b622c8015e4c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:50.061015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b186cd40-1445-4fce-9062-b622c8015e4c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb8f009ae94e7199fd7153c87b099c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef9f21efdd4ce1a61a905fec4ea89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:50.089758 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b186cd40-1445-4fce-9062-b622c8015e4c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 200 len: 1643 microversion: 2.1 time: 0.279877 Aug 18 11:27:50.097155 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 331/691] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:49 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 1643 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:50.135849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8e9417b8-6d91-437b-8ee2-6cc0c0268a94 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:50.136543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8e9417b8-6d91-437b-8ee2-6cc0c0268a94 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:50.159304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e9417b8-6d91-437b-8ee2-6cc0c0268a94 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:50.159863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e9417b8-6d91-437b-8ee2-6cc0c0268a94 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:50.160399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e9417b8-6d91-437b-8ee2-6cc0c0268a94 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:50.161300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e9417b8-6d91-437b-8ee2-6cc0c0268a94 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:50.161814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e9417b8-6d91-437b-8ee2-6cc0c0268a94 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:50.162231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e9417b8-6d91-437b-8ee2-6cc0c0268a94 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:50.302061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8e9417b8-6d91-437b-8ee2-6cc0c0268a94 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:50.317119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8e9417b8-6d91-437b-8ee2-6cc0c0268a94 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:50.319064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8e9417b8-6d91-437b-8ee2-6cc0c0268a94 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:50.326605 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8e9417b8-6d91-437b-8ee2-6cc0c0268a94 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1465 microversion: 2.75 time: 0.228179 Aug 18 11:27:50.350331 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 332/692] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:50 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1465 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:50.356983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d5295be8-1206-4a76-8202-2ad4d7cb63a6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:50.359106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d5295be8-1206-4a76-8202-2ad4d7cb63a6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:50.396791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5295be8-1206-4a76-8202-2ad4d7cb63a6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:50.397664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5295be8-1206-4a76-8202-2ad4d7cb63a6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:50.399399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5295be8-1206-4a76-8202-2ad4d7cb63a6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:50.401796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5295be8-1206-4a76-8202-2ad4d7cb63a6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:50.405560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5295be8-1206-4a76-8202-2ad4d7cb63a6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:50.406348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5295be8-1206-4a76-8202-2ad4d7cb63a6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:50.699613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d5295be8-1206-4a76-8202-2ad4d7cb63a6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:50.718743 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d5295be8-1206-4a76-8202-2ad4d7cb63a6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 200 len: 1317 microversion: 2.1 time: 0.363914 Aug 18 11:27:50.720651 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 333/693] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:50 2022] GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:50.728235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.172"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:50.734376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:50.742919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:50.744059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:50.744748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:50.746200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:50.746986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:50.747626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:50.788048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "refresh_cache-42a8af3b-ff13-4c75-a982-d3910fe5c697" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:27:50.788983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquired lock "refresh_cache-42a8af3b-ff13-4c75-a982-d3910fe5c697" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:27:51.865333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:51.894868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:53.175408 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b1167463-0080-41c5-baab-bf1a0ef3be47 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.039125 Aug 18 11:27:53.177319 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 361/694] 10.222.0.73 () {60 vars in 1170 bytes} [Thu Aug 18 11:27:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:53.188349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-ac400ded-9c11-4fd4-b09d-b20ebdc3da5c req-a1cf7a6d-0415-40d4-bd9f-09a633dc7019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe68694-3a7c-41cb-b2f2-1f25d8648218", "tag": "ed0c5302-2b34-44c1-a1e3-e5121abc35f0"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:53.209893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=90 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:53.245574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ac400ded-9c11-4fd4-b09d-b20ebdc3da5c req-a1cf7a6d-0415-40d4-bd9f-09a633dc7019 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:53.247836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ac400ded-9c11-4fd4-b09d-b20ebdc3da5c req-a1cf7a6d-0415-40d4-bd9f-09a633dc7019 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:53.251070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ac400ded-9c11-4fd4-b09d-b20ebdc3da5c req-a1cf7a6d-0415-40d4-bd9f-09a633dc7019 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:53.299473 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ac400ded-9c11-4fd4-b09d-b20ebdc3da5c req-a1cf7a6d-0415-40d4-bd9f-09a633dc7019 service nova] Creating event network-changed:ed0c5302-2b34-44c1-a1e3-e5121abc35f0 for instance ffe68694-3a7c-41cb-b2f2-1f25d8648218 on n-h2-853611-3 Aug 18 11:27:53.312343 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-ac400ded-9c11-4fd4-b09d-b20ebdc3da5c req-a1cf7a6d-0415-40d4-bd9f-09a633dc7019 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131629 Aug 18 11:27:53.315725 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 362/695] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:53.326842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3759c909-381d-4809-b663-e8bb82184ba7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:53.336478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3759c909-381d-4809-b663-e8bb82184ba7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:53.345684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3759c909-381d-4809-b663-e8bb82184ba7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:53.346523 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3759c909-381d-4809-b663-e8bb82184ba7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:53.347144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3759c909-381d-4809-b663-e8bb82184ba7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:53.348060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3759c909-381d-4809-b663-e8bb82184ba7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:53.348832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3759c909-381d-4809-b663-e8bb82184ba7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:53.349451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3759c909-381d-4809-b663-e8bb82184ba7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:53.616679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3759c909-381d-4809-b663-e8bb82184ba7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:53.632991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3759c909-381d-4809-b663-e8bb82184ba7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:53.638996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3759c909-381d-4809-b663-e8bb82184ba7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:53.640228 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3759c909-381d-4809-b663-e8bb82184ba7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1559 microversion: 2.25 time: 0.323057 Aug 18 11:27:53.653182 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 363/696] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:53 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1559 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:53.653182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bb96f1a2-03d2-40c8-b929-1db74d62fc04 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:53.653182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bb96f1a2-03d2-40c8-b929-1db74d62fc04 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:53.664891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bb96f1a2-03d2-40c8-b929-1db74d62fc04 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:53.665388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bb96f1a2-03d2-40c8-b929-1db74d62fc04 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:53.666404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bb96f1a2-03d2-40c8-b929-1db74d62fc04 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:53.667175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bb96f1a2-03d2-40c8-b929-1db74d62fc04 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:53.667648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bb96f1a2-03d2-40c8-b929-1db74d62fc04 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:53.668736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bb96f1a2-03d2-40c8-b929-1db74d62fc04 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:53.895850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bb96f1a2-03d2-40c8-b929-1db74d62fc04 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:53.905138 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bb96f1a2-03d2-40c8-b929-1db74d62fc04 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1311 microversion: 2.1 time: 0.258578 Aug 18 11:27:53.918093 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 364/697] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:53 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1311 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:53.923753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-76e7821b-1f6f-4b5f-95bf-38e15e2ce0af tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:53.932372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-76e7821b-1f6f-4b5f-95bf-38e15e2ce0af tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:53.951916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76e7821b-1f6f-4b5f-95bf-38e15e2ce0af tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:53.952413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76e7821b-1f6f-4b5f-95bf-38e15e2ce0af tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:53.952859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76e7821b-1f6f-4b5f-95bf-38e15e2ce0af tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:53.953746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76e7821b-1f6f-4b5f-95bf-38e15e2ce0af tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:53.954386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76e7821b-1f6f-4b5f-95bf-38e15e2ce0af tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:53.954861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76e7821b-1f6f-4b5f-95bf-38e15e2ce0af tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:53.972400 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-76e7821b-1f6f-4b5f-95bf-38e15e2ce0af tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] HTTP exception thrown: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-76e7821b-1f6f-4b5f-95bf-38e15e2ce0af tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Request method failure captured: Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b HTTP/1.1 Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iGNPnhVG8yqxCZ8t2Ch9l0DF8T5HTp7toHQ7J7Qr5mo9aiSYLvowQxukHRgH3usajHTEaa4D6_67HvmsRv7QREGR1O5WeoFz0e5LWzt6Wr6kgUYTeYUwO7JjXYfSC-CU-3MmagFzxKUZ7V0PV3ggqYAjy3Tf0uc7sQaEiohTZcfgnA Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: f4ef9f21efdd4ce1a61a905fec4ea89d Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:27:53.976906 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:27:53.978704 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:27:53.978704 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:27:53.978704 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: f4ef9f21efdd4ce1a61a905fec4ea89d Aug 18 11:27:53.978704 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:27:53.978704 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1568300491-project Aug 18 11:27:53.978704 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:27:53.978704 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:27:53.978704 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: d2cb8f009ae94e7199fd7153c87b099c Aug 18 11:27:53.978704 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491-project Aug 18 11:27:53.978704 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:27:53.978704 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:27:53.978704 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b'} Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:27:53.979596 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:27:53.981054 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:53.982316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-76e7821b-1f6f-4b5f-95bf-38e15e2ce0af tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Returning 404 to user: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:27:53.982316 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-76e7821b-1f6f-4b5f-95bf-38e15e2ce0af tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 404 len: 111 microversion: 2.1 time: 0.059342 Aug 18 11:27:53.982316 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 365/698] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:53 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:27:53.984569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cc817ce4-4078-4cfa-a3fe-d89732af2191 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:53.985764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cc817ce4-4078-4cfa-a3fe-d89732af2191 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:53.992709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc817ce4-4078-4cfa-a3fe-d89732af2191 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:53.993209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc817ce4-4078-4cfa-a3fe-d89732af2191 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:53.993645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc817ce4-4078-4cfa-a3fe-d89732af2191 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:53.994357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc817ce4-4078-4cfa-a3fe-d89732af2191 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:53.994854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc817ce4-4078-4cfa-a3fe-d89732af2191 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:53.995281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc817ce4-4078-4cfa-a3fe-d89732af2191 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:54.021180 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.network.neutron [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] re-assign floating IP 172.25.0.172 from instance a472fced-51fc-469b-a37a-38f98e725169 Aug 18 11:27:54.095346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cc817ce4-4078-4cfa-a3fe-d89732af2191 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:54.098939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Building network info cache for instance {{(pid=122210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 18 11:27:54.106387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cc817ce4-4078-4cfa-a3fe-d89732af2191 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:54.109111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cc817ce4-4078-4cfa-a3fe-d89732af2191 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:54.132362 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cc817ce4-4078-4cfa-a3fe-d89732af2191 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1438 microversion: 2.75 time: 0.149208 Aug 18 11:27:54.152579 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 366/699] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:53 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1438 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:54.176930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5ddfedee-af73-46d1-baf2-c8abcbce6350 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:54.180070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5ddfedee-af73-46d1-baf2-c8abcbce6350 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:54.187357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ddfedee-af73-46d1-baf2-c8abcbce6350 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:54.187886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ddfedee-af73-46d1-baf2-c8abcbce6350 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:54.188359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ddfedee-af73-46d1-baf2-c8abcbce6350 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:54.189223 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ddfedee-af73-46d1-baf2-c8abcbce6350 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:54.189691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ddfedee-af73-46d1-baf2-c8abcbce6350 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:54.190126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ddfedee-af73-46d1-baf2-c8abcbce6350 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:54.369116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5ddfedee-af73-46d1-baf2-c8abcbce6350 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:54.381547 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5ddfedee-af73-46d1-baf2-c8abcbce6350 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 200 len: 1317 microversion: 2.1 time: 0.226697 Aug 18 11:27:54.382658 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 367/700] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:54 2022] GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:54.389873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.193"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:54.393515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:54.401786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:54.402328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:54.402827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:54.415957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:54.416434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:54.416923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:54.493063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "refresh_cache-ab517b76-7996-4c12-a108-d3fb97b955c4" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:27:54.493289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquired lock "refresh_cache-ab517b76-7996-4c12-a108-d3fb97b955c4" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:27:54.877443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Updating instance_info_cache with network_info: [{"id": "dbe58053-eed9-48a6-bec0-79d514d08be6", "address": "fa:16:3e:1b:bf:bc", "network": {"id": "c1e36b66-5ff9-448b-ae68-4d66745c4f5b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-529460581-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d1fa95f956304a9bb1b34ddf82adac1a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdbe58053-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 18 11:27:54.897296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Building network info cache for instance {{(pid=122210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 18 11:27:55.758846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Updating instance_info_cache with network_info: [{"id": "05a28f8a-b1ca-45a0-aec4-aa88c71919a2", "address": "fa:16:3e:ef:a9:fe", "network": {"id": "c1e36b66-5ff9-448b-ae68-4d66745c4f5b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-529460581-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d1fa95f956304a9bb1b34ddf82adac1a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap05a28f8a-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 18 11:27:55.775858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Releasing lock "refresh_cache-42a8af3b-ff13-4c75-a982-d3910fe5c697" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:27:55.778146 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-97909015-d463-4442-a11f-631a192cfed3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "POST /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697/action" status: 202 len: 0 microversion: 2.1 time: 5.054977 Aug 18 11:27:55.779381 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 334/701] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:27:50 2022] POST /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697/action => generated 0 bytes in 5058 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 18 11:27:55.784317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a25e1650-3698-4509-9f1c-9c99d51d3250 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '.version_select at 0x7f519fee6ee0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:55.788434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a25e1650-3698-4509-9f1c-9c99d51d3250 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:55.789229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a25e1650-3698-4509-9f1c-9c99d51d3250 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:55.790372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a25e1650-3698-4509-9f1c-9c99d51d3250 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:55.808418 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a25e1650-3698-4509-9f1c-9c99d51d3250 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/os-migrations" status: 200 len: 436 microversion: 2.25 time: 0.027755 Aug 18 11:27:55.814553 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 335/702] 10.222.0.73 () {60 vars in 1184 bytes} [Thu Aug 18 11:27:55 2022] GET /compute/v2.1/os-migrations => generated 436 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:27:55.820178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2d0045e9-cfac-4deb-af0d-ce1e8207e131 req-ecb33727-ec2c-4520-abb9-dd1da81e8b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a472fced-51fc-469b-a37a-38f98e725169", "tag": "dbe58053-eed9-48a6-bec0-79d514d08be6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:55.834854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2d0045e9-cfac-4deb-af0d-ce1e8207e131 req-ecb33727-ec2c-4520-abb9-dd1da81e8b9a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:55.835691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2d0045e9-cfac-4deb-af0d-ce1e8207e131 req-ecb33727-ec2c-4520-abb9-dd1da81e8b9a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:55.836421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2d0045e9-cfac-4deb-af0d-ce1e8207e131 req-ecb33727-ec2c-4520-abb9-dd1da81e8b9a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:55.851131 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2d0045e9-cfac-4deb-af0d-ce1e8207e131 req-ecb33727-ec2c-4520-abb9-dd1da81e8b9a service nova] Creating event network-changed:dbe58053-eed9-48a6-bec0-79d514d08be6 for instance a472fced-51fc-469b-a37a-38f98e725169 on n-h2-853611-3 Aug 18 11:27:55.856848 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2d0045e9-cfac-4deb-af0d-ce1e8207e131 req-ecb33727-ec2c-4520-abb9-dd1da81e8b9a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040160 Aug 18 11:27:55.858121 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 336/703] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:55.868068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ff1f4f6-406b-40b1-8a03-b1ca596c073a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:55.868662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6ff1f4f6-406b-40b1-8a03-b1ca596c073a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:55.880605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ff1f4f6-406b-40b1-8a03-b1ca596c073a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:55.881602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ff1f4f6-406b-40b1-8a03-b1ca596c073a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:55.882291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ff1f4f6-406b-40b1-8a03-b1ca596c073a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:55.883273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ff1f4f6-406b-40b1-8a03-b1ca596c073a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:55.884206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ff1f4f6-406b-40b1-8a03-b1ca596c073a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:55.884882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ff1f4f6-406b-40b1-8a03-b1ca596c073a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:55.900430 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-6ff1f4f6-406b-40b1-8a03-b1ca596c073a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] HTTP exception thrown: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ff1f4f6-406b-40b1-8a03-b1ca596c073a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Request method failure captured: Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c HTTP/1.1 Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGNPnhVG8yqxCZ8t2Ch9l0DF8T5HTp7toHQ7J7Qr5mo9aiSYLvowQxukHRgH3usajHTEaa4D6_67HvmsRv7QREGR1O5WeoFz0e5LWzt6Wr6kgUYTeYUwO7JjXYfSC-CU-3MmagFzxKUZ7V0PV3ggqYAjy3Tf0uc7sQaEiohTZcfgnA Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f4ef9f21efdd4ce1a61a905fec4ea89d Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:27:55.902532 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:27:55.903798 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:27:55.903798 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:27:55.903798 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f4ef9f21efdd4ce1a61a905fec4ea89d Aug 18 11:27:55.903798 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:27:55.903798 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1568300491-project Aug 18 11:27:55.903798 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:27:55.903798 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:27:55.903798 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d2cb8f009ae94e7199fd7153c87b099c Aug 18 11:27:55.903798 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491-project Aug 18 11:27:55.903798 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:27:55.903798 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:27:55.903798 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '22337998-2a5d-4fdc-a5f7-6d1067a13c9c'} Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:27:55.904536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:27:55.905672 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:27:55.913083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ff1f4f6-406b-40b1-8a03-b1ca596c073a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Returning 404 to user: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:27:55.914111 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6ff1f4f6-406b-40b1-8a03-b1ca596c073a tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "DELETE /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 404 len: 111 microversion: 2.1 time: 0.054598 Aug 18 11:27:55.914964 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 337/704] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:27:55 2022] DELETE /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:27:56.097480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:56.109558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:56.127182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:56.128031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:56.137860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:56.138989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:56.139735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:56.140375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:56.232380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG neutronclient.v2_0.client [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.0.193 (0fa16e52-c539-4f32-b5e0-be015263c1e3) with port 6d45270a-1cd6-41f0-9fa9-232d93d36b38 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 00ac6dac-3b97-4d4d-b1c0-f9ef06cd8cc0.", "detail": ""}} {{(pid=122209) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:27:56.232961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Releasing lock "refresh_cache-ab517b76-7996-4c12-a108-d3fb97b955c4" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:27:56.233718 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] HTTP exception thrown: Cannot associate floating IP 172.25.0.193 (0fa16e52-c539-4f32-b5e0-be015263c1e3) with port 6d45270a-1cd6-41f0-9fa9-232d93d36b38 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 00ac6dac-3b97-4d4d-b1c0-f9ef06cd8cc0. Aug 18 11:27:56.233718 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-606c3b4e-26dd-466b-ab4a-d88fe232c3ee'] Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Request method failure captured: Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action HTTP/1.1 Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 46 Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iIJ-gC8YzQZA0Tvzm09uQMCaMsu9Opx0YTbWPe8pItpq9BQxn0eE2rjmTGpdW8fbqateCwqfeuXj5dEUWWov-y1dlx55irBOLN7e9mjmIZ564qlHDqOM8JiYJz9PW8yPm9vkp0D8zvg-21Lk2pvDig6-1QNtb-FPt30UmnhcyM0UuI Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 05fb2484544849ab8ad1dbb6dec06f65 Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:27:56.238953 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:27:56.240289 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:27:56.240289 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:27:56.240289 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 05fb2484544849ab8ad1dbb6dec06f65 Aug 18 11:27:56.240289 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:27:56.240289 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project Aug 18 11:27:56.240289 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:27:56.240289 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:27:56.240289 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7308ed12063b4326942c235e39582be5 Aug 18 11:27:56.240289 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project Aug 18 11:27:56.240289 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:27:56.240289 n-d-853611-3 devstack@n-api.service[122209]: {"addFloatingIp": {"address": "172.25.0.193"}} Aug 18 11:27:56.240289 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: exception: Cannot associate floating IP 172.25.0.193 (0fa16e52-c539-4f32-b5e0-be015263c1e3) with port 6d45270a-1cd6-41f0-9fa9-232d93d36b38 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 00ac6dac-3b97-4d4d-b1c0-f9ef06cd8cc0. Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-606c3b4e-26dd-466b-ab4a-d88fe232c3ee'] Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'ab517b76-7996-4c12-a108-d3fb97b955c4', 'body': {'addFloatingIp': {'address': '172.25.0.193'}}} Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:27:56.241208 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:27:56.242367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.0.193 (0fa16e52-c539-4f32-b5e0-be015263c1e3) with port 6d45270a-1cd6-41f0-9fa9-232d93d36b38 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 00ac6dac-3b97-4d4d-b1c0-f9ef06cd8cc0. Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-606c3b4e-26dd-466b-ab4a-d88fe232c3ee'] Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.0.193 (0fa16e52-c539-4f32-b5e0-be015263c1e3) with port 6d45270a-1cd6-41f0-9fa9-232d93d36b38 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 00ac6dac-3b97-4d4d-b1c0-f9ef06cd8cc0. Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-606c3b4e-26dd-466b-ab4a-d88fe232c3ee'] Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:56.243395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.0.193 (0fa16e52-c539-4f32-b5e0-be015263c1e3) with port 6d45270a-1cd6-41f0-9fa9-232d93d36b38 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 00ac6dac-3b97-4d4d-b1c0-f9ef06cd8cc0. Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-606c3b4e-26dd-466b-ab4a-d88fe232c3ee'] Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:56.244468 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:27:56.245716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:56.245716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:56.245716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:27:56.245716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:27:56.245716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:27:56.245716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:27:56.245716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.0.193 (0fa16e52-c539-4f32-b5e0-be015263c1e3) with port 6d45270a-1cd6-41f0-9fa9-232d93d36b38 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 00ac6dac-3b97-4d4d-b1c0-f9ef06cd8cc0. Aug 18 11:27:56.245716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-606c3b4e-26dd-466b-ab4a-d88fe232c3ee'] Aug 18 11:27:56.245716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:56.246329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:27:56.246329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:27:56.248884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:27:56.248884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:27:56.249088 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Returning 400 to user: Cannot associate floating IP 172.25.0.193 (0fa16e52-c539-4f32-b5e0-be015263c1e3) with port 6d45270a-1cd6-41f0-9fa9-232d93d36b38 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 00ac6dac-3b97-4d4d-b1c0-f9ef06cd8cc0. Aug 18 11:27:56.249088 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-606c3b4e-26dd-466b-ab4a-d88fe232c3ee'] {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:27:56.249242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:27:56.249319 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fc2340ae-6d74-44d8-b7af-eae5e46e5714 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action" status: 400 len: 381 microversion: 2.1 time: 1.864325 Aug 18 11:27:56.249319 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 368/705] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:27:54 2022] POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action => generated 381 bytes in 1866 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:27:56.261038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c1a83ea8-2e6a-43c4-9232-4ab391811070 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:56.261656 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c1a83ea8-2e6a-43c4-9232-4ab391811070 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:56.280662 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1a83ea8-2e6a-43c4-9232-4ab391811070 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:56.281817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1a83ea8-2e6a-43c4-9232-4ab391811070 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:56.282265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1a83ea8-2e6a-43c4-9232-4ab391811070 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:56.283008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1a83ea8-2e6a-43c4-9232-4ab391811070 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:56.283472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1a83ea8-2e6a-43c4-9232-4ab391811070 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:56.283897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1a83ea8-2e6a-43c4-9232-4ab391811070 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:56.288313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:56.362934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:56.374504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:56.376768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:56.378174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:56.379137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:56.379854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:56.380513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:56.608029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:27:56.708098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c1a83ea8-2e6a-43c4-9232-4ab391811070 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:56.717924 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c1a83ea8-2e6a-43c4-9232-4ab391811070 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1311 microversion: 2.1 time: 0.464815 Aug 18 11:27:56.721832 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 369/706] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:56 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1311 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:56.746098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-9a8dc138-2919-4c0b-9764-ea4cee39c2d6 req-09f61608-a7f9-487c-a60d-389edfd0ccee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b", "name": "network-vif-deleted", "tag": "df5c2bde-2e96-4148-91da-df8c38a12161"}, {"name": "network-changed", "server_uuid": "403202c1-4021-4975-82bc-2202975dd6c4", "tag": "dc6f474f-ac9d-40d6-b8a7-dfa73d80efdf"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:56.760052 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6e671eb1-57b2-4a42-8e0d-32a72925f2d4 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4/action" status: 202 len: 1942 microversion: 2.75 time: 0.843792 Aug 18 11:27:56.761018 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 338/707] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 18 11:27:55 2022] POST /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4/action => generated 1942 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 18 11:27:56.766538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8531835-5e00-4be3-bc1a-17291b3f4dc5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:56.767351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f8531835-5e00-4be3-bc1a-17291b3f4dc5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:56.773418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8531835-5e00-4be3-bc1a-17291b3f4dc5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:56.773570 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9a8dc138-2919-4c0b-9764-ea4cee39c2d6 req-09f61608-a7f9-487c-a60d-389edfd0ccee service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:56.773913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8531835-5e00-4be3-bc1a-17291b3f4dc5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:56.774348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8531835-5e00-4be3-bc1a-17291b3f4dc5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:56.774965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9a8dc138-2919-4c0b-9764-ea4cee39c2d6 req-09f61608-a7f9-487c-a60d-389edfd0ccee service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:56.775082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8531835-5e00-4be3-bc1a-17291b3f4dc5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:56.775598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8531835-5e00-4be3-bc1a-17291b3f4dc5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:56.776016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8531835-5e00-4be3-bc1a-17291b3f4dc5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:56.778483 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9a8dc138-2919-4c0b-9764-ea4cee39c2d6 req-09f61608-a7f9-487c-a60d-389edfd0ccee service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:56.801349 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-9a8dc138-2919-4c0b-9764-ea4cee39c2d6 req-09f61608-a7f9-487c-a60d-389edfd0ccee service nova] Creating event network-vif-deleted:df5c2bde-2e96-4148-91da-df8c38a12161 for instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b on n-h2-853611-3 Aug 18 11:27:56.810617 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-9a8dc138-2919-4c0b-9764-ea4cee39c2d6 req-09f61608-a7f9-487c-a60d-389edfd0ccee service nova] Creating event network-changed:dc6f474f-ac9d-40d6-b8a7-dfa73d80efdf for instance 403202c1-4021-4975-82bc-2202975dd6c4 on n-h2-853611-3 Aug 18 11:27:56.817908 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-9a8dc138-2919-4c0b-9764-ea4cee39c2d6 req-09f61608-a7f9-487c-a60d-389edfd0ccee service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.094156 Aug 18 11:27:56.819750 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 370/708] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:27:56.829387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6ba68490-7df3-4bc1-b631-17d6d177be16 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Action: 'action', calling method: .version_select at 0x7f51ae75aa60>, body: {"removeFloatingIp": {"address": "172.25.0.172"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:56.952713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f8531835-5e00-4be3-bc1a-17291b3f4dc5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:27:56.962057 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8531835-5e00-4be3-bc1a-17291b3f4dc5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 200 len: 1317 microversion: 2.1 time: 0.199975 Aug 18 11:27:56.962977 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 339/709] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:56 2022] GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:27:56.967825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7dcb650b-f6cc-4e78-a016-c0a4978966f0 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:56.968433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dcb650b-f6cc-4e78-a016-c0a4978966f0 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:56.975351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dcb650b-f6cc-4e78-a016-c0a4978966f0 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:56.975844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dcb650b-f6cc-4e78-a016-c0a4978966f0 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:56.976278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dcb650b-f6cc-4e78-a016-c0a4978966f0 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:56.976974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dcb650b-f6cc-4e78-a016-c0a4978966f0 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:56.977426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dcb650b-f6cc-4e78-a016-c0a4978966f0 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:56.978161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dcb650b-f6cc-4e78-a016-c0a4978966f0 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:57.016348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6ba68490-7df3-4bc1-b631-17d6d177be16 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:57.023745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ba68490-7df3-4bc1-b631-17d6d177be16 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:57.024577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ba68490-7df3-4bc1-b631-17d6d177be16 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:57.025235 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ba68490-7df3-4bc1-b631-17d6d177be16 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:57.026178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ba68490-7df3-4bc1-b631-17d6d177be16 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:57.028046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ba68490-7df3-4bc1-b631-17d6d177be16 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:57.028716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ba68490-7df3-4bc1-b631-17d6d177be16 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:57.155323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:27:57.161211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-7dcb650b-f6cc-4e78-a016-c0a4978966f0 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 6ebd4b99-aee2-480b-b361-3bdc41f5a871 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:27:57.188931 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7dcb650b-f6cc-4e78-a016-c0a4978966f0 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 2052 microversion: 2.25 time: 0.223613 Aug 18 11:27:57.202990 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 340/710] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:56 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 2052 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:57.214081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7eeb051b-4d00-4c0e-876a-e0b3f958ef88 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:57.215063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7eeb051b-4d00-4c0e-876a-e0b3f958ef88 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:57.233136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eeb051b-4d00-4c0e-876a-e0b3f958ef88 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:57.235601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eeb051b-4d00-4c0e-876a-e0b3f958ef88 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:57.238477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eeb051b-4d00-4c0e-876a-e0b3f958ef88 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:57.242987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eeb051b-4d00-4c0e-876a-e0b3f958ef88 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:57.244661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eeb051b-4d00-4c0e-876a-e0b3f958ef88 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:57.245273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eeb051b-4d00-4c0e-876a-e0b3f958ef88 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:57.278350 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-7eeb051b-4d00-4c0e-876a-e0b3f958ef88 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] HTTP exception thrown: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7eeb051b-4d00-4c0e-876a-e0b3f958ef88 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Request method failure captured: Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c HTTP/1.1 Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGNPnhVG8yqxCZ8t2Ch9l0DF8T5HTp7toHQ7J7Qr5mo9aiSYLvowQxukHRgH3usajHTEaa4D6_67HvmsRv7QREGR1O5WeoFz0e5LWzt6Wr6kgUYTeYUwO7JjXYfSC-CU-3MmagFzxKUZ7V0PV3ggqYAjy3Tf0uc7sQaEiohTZcfgnA Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f4ef9f21efdd4ce1a61a905fec4ea89d Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:27:57.284702 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:27:57.286343 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:27:57.286343 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:27:57.286343 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f4ef9f21efdd4ce1a61a905fec4ea89d Aug 18 11:27:57.286343 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:27:57.286343 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1568300491-project Aug 18 11:27:57.286343 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:27:57.286343 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:27:57.286343 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d2cb8f009ae94e7199fd7153c87b099c Aug 18 11:27:57.286343 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491-project Aug 18 11:27:57.286343 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:27:57.286343 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:27:57.286343 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '22337998-2a5d-4fdc-a5f7-6d1067a13c9c'} Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:27:57.287344 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:27:57.288841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:27:57.291127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7eeb051b-4d00-4c0e-876a-e0b3f958ef88 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Returning 404 to user: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:27:57.292317 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7eeb051b-4d00-4c0e-876a-e0b3f958ef88 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 404 len: 111 microversion: 2.1 time: 0.087909 Aug 18 11:27:57.295225 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 341/711] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:27:57 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:27:57.301838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-25a64d6a-c998-436d-a191-3486fdd729fc tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '.version_select at 0x7f519fcb9dc0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:57.311851 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-6ba68490-7df3-4bc1-b631-17d6d177be16 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] HTTP exception thrown: Floating IP 172.25.0.172 is not associated with instance a472fced-51fc-469b-a37a-38f98e725169. Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6ba68490-7df3-4bc1-b631-17d6d177be16 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Request method failure captured: Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169/action HTTP/1.1 Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 49 Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iH1HzuxqQ6j0uhKbmg3JejqPZd4bkgpQKgMhaLXOzaPQXnR4TiIXmbC6NxQBI3FJTSo34hMYCGF_o04GCcf6uq9Qe1GjhvYX9PKvpvDYzToKaqgpwH2E_Ialg9v7epSrEyjNDa-_-8xwAIHx-urMgnMMJA5da75Idxuy39tiu52IGY Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: d1fa95f956304a9bb1b34ddf82adac1a Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-330777573 Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:27:57.314465 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:27:57.316200 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:27:57.316200 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-330777573 Aug 18 11:27:57.316200 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: d1fa95f956304a9bb1b34ddf82adac1a Aug 18 11:27:57.316200 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-330777573 Aug 18 11:27:57.316200 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-FloatingIPsAssociationTestJSON-330777573-project Aug 18 11:27:57.316200 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:27:57.316200 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:27:57.316200 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: eb875d64a00b43448f7e3b7492e9086b Aug 18 11:27:57.316200 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-330777573-project Aug 18 11:27:57.316200 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:27:57.316200 n-d-853611-3 devstack@n-api.service[122209]: {"removeFloatingIp": {"address": "172.25.0.172"}} Aug 18 11:27:57.316200 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:27:57.316200 n-d-853611-3 devstack@n-api.service[122209]: exception: Floating IP 172.25.0.172 is not associated with instance a472fced-51fc-469b-a37a-38f98e725169. Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'a472fced-51fc-469b-a37a-38f98e725169', 'body': {'removeFloatingIp': {'address': '172.25.0.172'}}} Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.0.172 is not associated with instance a472fced-51fc-469b-a37a-38f98e725169. Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:57.317229 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:27:57.318713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:27:57.318713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:27:57.318713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:27:57.318713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:27:57.318713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.0.172 is not associated with instance a472fced-51fc-469b-a37a-38f98e725169. Aug 18 11:27:57.318713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:27:57.319708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6ba68490-7df3-4bc1-b631-17d6d177be16 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Returning 409 to user: Floating IP 172.25.0.172 is not associated with instance a472fced-51fc-469b-a37a-38f98e725169. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:27:57.321346 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6ba68490-7df3-4bc1-b631-17d6d177be16 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "POST /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169/action" status: 409 len: 146 microversion: 2.1 time: 0.497411 Aug 18 11:27:57.326181 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 371/712] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:27:56 2022] POST /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169/action => generated 146 bytes in 504 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:27:57.333873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa24cc66-618b-4944-9602-cef55408132d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:57.337015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fa24cc66-618b-4944-9602-cef55408132d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:57.354244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa24cc66-618b-4944-9602-cef55408132d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:57.354893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa24cc66-618b-4944-9602-cef55408132d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:57.355522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa24cc66-618b-4944-9602-cef55408132d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:57.356350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa24cc66-618b-4944-9602-cef55408132d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:57.357209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa24cc66-618b-4944-9602-cef55408132d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:57.358944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa24cc66-618b-4944-9602-cef55408132d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:57.608643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-fa24cc66-618b-4944-9602-cef55408132d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:27:57.648583 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fa24cc66-618b-4944-9602-cef55408132d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.320874 Aug 18 11:27:57.649587 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 372/713] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:27:57 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:27:57.654730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3e59def2-1178-4c2a-8acc-8765c30c9522 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '.version_select at 0x7f51ac3f6f70>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:27:57.689228 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3e59def2-1178-4c2a-8acc-8765c30c9522 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-404870432" status: 202 len: 0 microversion: 2.1 time: 0.035020 Aug 18 11:27:57.699724 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 373/714] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 18 11:27:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-404870432 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:27:57.710535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-004af42c-d362-4b06-8afb-684c788ed400 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.172"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:58.121063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-004af42c-d362-4b06-8afb-684c788ed400 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:27:58.128918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-004af42c-d362-4b06-8afb-684c788ed400 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:58.129418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-004af42c-d362-4b06-8afb-684c788ed400 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:58.129853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-004af42c-d362-4b06-8afb-684c788ed400 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:58.134877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-004af42c-d362-4b06-8afb-684c788ed400 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:58.135557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-004af42c-d362-4b06-8afb-684c788ed400 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:58.136170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-004af42c-d362-4b06-8afb-684c788ed400 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:58.899400 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-25a64d6a-c998-436d-a191-3486fdd729fc tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/0fa16e52-c539-4f32-b5e0-be015263c1e3" status: 202 len: 0 microversion: 2.1 time: 1.601854 Aug 18 11:27:58.900618 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 342/715] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:27:57 2022] DELETE /compute/v2.1/os-floating-ips/0fa16e52-c539-4f32-b5e0-be015263c1e3 => generated 0 bytes in 1605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:27:58.905798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2027286514", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "d0a3b2b0-b08b-4498-bc9d-af64e9bcff20"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:27:58.986501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] validate_networks() for [('d0a3b2b0-b08b-4498-bc9d-af64e9bcff20', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:27:59.031703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-004af42c-d362-4b06-8afb-684c788ed400 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "refresh_cache-42a8af3b-ff13-4c75-a982-d3910fe5c697" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:27:59.034473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-004af42c-d362-4b06-8afb-684c788ed400 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquired lock "refresh_cache-42a8af3b-ff13-4c75-a982-d3910fe5c697" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:27:59.941895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-004af42c-d362-4b06-8afb-684c788ed400 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Building network info cache for instance {{(pid=122209) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 18 11:27:59.943078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:27:59.943524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:27:59.944004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:27:59.944671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:27:59.945238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:27:59.969890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:59.970454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:59.971010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:27:59.971759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:27:59.972221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:27:59.972655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:00.014933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Getting quotas for project 51319140bae948cf873746a482aaf588. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:28:00.027053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Getting quotas for user 36162046d3d84db98ce76b19770f6322 and project 51319140bae948cf873746a482aaf588. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:28:00.045056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:28:00.048398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:28:00.110659 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-93e616d7-e0fd-4e0a-83cc-8b5400d56950 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.208762 Aug 18 11:28:00.111501 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 343/716] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:27:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 11:28:00.116354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab908077-7cec-475a-b99f-2b70a2d4df59 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:00.117263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ab908077-7cec-475a-b99f-2b70a2d4df59 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:00.123909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab908077-7cec-475a-b99f-2b70a2d4df59 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:00.124805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab908077-7cec-475a-b99f-2b70a2d4df59 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:00.125465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab908077-7cec-475a-b99f-2b70a2d4df59 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:00.126394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab908077-7cec-475a-b99f-2b70a2d4df59 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:00.127128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab908077-7cec-475a-b99f-2b70a2d4df59 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:00.127794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab908077-7cec-475a-b99f-2b70a2d4df59 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:00.363892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ab908077-7cec-475a-b99f-2b70a2d4df59 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:00.377405 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab908077-7cec-475a-b99f-2b70a2d4df59 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1311 microversion: 2.1 time: 0.264468 Aug 18 11:28:00.390111 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 344/717] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:00 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1311 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:00.390111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2534769b-6f76-4a59-981d-844030dabdbf req-69752bae-243d-4bf7-b409-51f5b9cd0267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42a8af3b-ff13-4c75-a982-d3910fe5c697", "tag": "05a28f8a-b1ca-45a0-aec4-aa88c71919a2"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:00.411128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2534769b-6f76-4a59-981d-844030dabdbf req-69752bae-243d-4bf7-b409-51f5b9cd0267 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:00.413791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2534769b-6f76-4a59-981d-844030dabdbf req-69752bae-243d-4bf7-b409-51f5b9cd0267 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:00.414285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2534769b-6f76-4a59-981d-844030dabdbf req-69752bae-243d-4bf7-b409-51f5b9cd0267 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:00.441029 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2534769b-6f76-4a59-981d-844030dabdbf req-69752bae-243d-4bf7-b409-51f5b9cd0267 service nova] Creating event network-changed:05a28f8a-b1ca-45a0-aec4-aa88c71919a2 for instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 on n-h1-853611-3 Aug 18 11:28:00.457695 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2534769b-6f76-4a59-981d-844030dabdbf req-69752bae-243d-4bf7-b409-51f5b9cd0267 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075210 Aug 18 11:28:00.462912 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 345/718] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:00.485714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b8e2ee6b-e9b6-4778-a873-c9b1576d52f1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:00.486287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b8e2ee6b-e9b6-4778-a873-c9b1576d52f1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:00.507235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8e2ee6b-e9b6-4778-a873-c9b1576d52f1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:00.508112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8e2ee6b-e9b6-4778-a873-c9b1576d52f1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:00.508469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8e2ee6b-e9b6-4778-a873-c9b1576d52f1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:00.509294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8e2ee6b-e9b6-4778-a873-c9b1576d52f1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:00.509755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8e2ee6b-e9b6-4778-a873-c9b1576d52f1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:00.510376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8e2ee6b-e9b6-4778-a873-c9b1576d52f1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:00.891429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8e2ee6b-e9b6-4778-a873-c9b1576d52f1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:00.899563 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b8e2ee6b-e9b6-4778-a873-c9b1576d52f1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 200 len: 1317 microversion: 2.1 time: 0.420868 Aug 18 11:28:00.904519 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 346/719] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:00 2022] GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:00.915117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8a9bed09-f8d0-4029-a071-927b0b87cad2 req-38829e3a-2ca5-478a-901a-1fd71c95091a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe68694-3a7c-41cb-b2f2-1f25d8648218", "name": "network-vif-plugged", "status": "completed", "tag": "ed0c5302-2b34-44c1-a1e3-e5121abc35f0"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:00.944356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8a9bed09-f8d0-4029-a071-927b0b87cad2 req-38829e3a-2ca5-478a-901a-1fd71c95091a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:00.949734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8a9bed09-f8d0-4029-a071-927b0b87cad2 req-38829e3a-2ca5-478a-901a-1fd71c95091a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:00.950607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8a9bed09-f8d0-4029-a071-927b0b87cad2 req-38829e3a-2ca5-478a-901a-1fd71c95091a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:00.973656 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8a9bed09-f8d0-4029-a071-927b0b87cad2 req-38829e3a-2ca5-478a-901a-1fd71c95091a service nova] Creating event network-vif-plugged:ed0c5302-2b34-44c1-a1e3-e5121abc35f0 for instance ffe68694-3a7c-41cb-b2f2-1f25d8648218 on n-h2-853611-3 Aug 18 11:28:00.983434 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8a9bed09-f8d0-4029-a071-927b0b87cad2 req-38829e3a-2ca5-478a-901a-1fd71c95091a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077420 Aug 18 11:28:00.985188 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 347/720] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:01.003491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-165ac9e5-1492-4754-981c-a4bf93266c68 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:01.004827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-165ac9e5-1492-4754-981c-a4bf93266c68 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:01.006555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-004af42c-d362-4b06-8afb-684c788ed400 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Updating instance_info_cache with network_info: [{"id": "05a28f8a-b1ca-45a0-aec4-aa88c71919a2", "address": "fa:16:3e:ef:a9:fe", "network": {"id": "c1e36b66-5ff9-448b-ae68-4d66745c4f5b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-529460581-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d1fa95f956304a9bb1b34ddf82adac1a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap05a28f8a-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122209) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 18 11:28:01.022951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165ac9e5-1492-4754-981c-a4bf93266c68 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:01.024400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-004af42c-d362-4b06-8afb-684c788ed400 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Releasing lock "refresh_cache-42a8af3b-ff13-4c75-a982-d3910fe5c697" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:28:01.026279 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-004af42c-d362-4b06-8afb-684c788ed400 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "POST /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697/action" status: 202 len: 0 microversion: 2.1 time: 3.324872 Aug 18 11:28:01.026982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165ac9e5-1492-4754-981c-a4bf93266c68 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:01.031018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165ac9e5-1492-4754-981c-a4bf93266c68 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:01.032174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165ac9e5-1492-4754-981c-a4bf93266c68 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:01.034682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165ac9e5-1492-4754-981c-a4bf93266c68 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:01.035391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165ac9e5-1492-4754-981c-a4bf93266c68 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:01.037003 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 374/721] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:27:57 2022] POST /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697/action => generated 0 bytes in 3336 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 18 11:28:01.051612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e9735e5c-be3d-4aaf-ab72-ded4aea86ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.204"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:01.208181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-165ac9e5-1492-4754-981c-a4bf93266c68 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:01.233409 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-165ac9e5-1492-4754-981c-a4bf93266c68 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.246526 Aug 18 11:28:01.236611 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 348/722] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:00 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:01.265201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-58b9e43a-0bc0-4e41-8779-34062d4a42fc tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:01.266421 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:01.266421 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:28:01.316340 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-58b9e43a-0bc0-4e41-8779-34062d4a42fc tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/215349971" status: 202 len: 0 microversion: 2.1 time: 0.078109 Aug 18 11:28:01.318966 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 349/723] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:28:01 2022] DELETE /compute/v2.1/flavors/215349971 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:28:01.334287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-e4830a3f-e0ea-4128-861d-84adb0caaa45 req-113cd430-62b3-439d-a42b-ae181d52e49f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42a8af3b-ff13-4c75-a982-d3910fe5c697", "tag": "05a28f8a-b1ca-45a0-aec4-aa88c71919a2"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:01.369008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e4830a3f-e0ea-4128-861d-84adb0caaa45 req-113cd430-62b3-439d-a42b-ae181d52e49f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:01.369864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e4830a3f-e0ea-4128-861d-84adb0caaa45 req-113cd430-62b3-439d-a42b-ae181d52e49f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:01.373378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e4830a3f-e0ea-4128-861d-84adb0caaa45 req-113cd430-62b3-439d-a42b-ae181d52e49f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:01.400459 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e4830a3f-e0ea-4128-861d-84adb0caaa45 req-113cd430-62b3-439d-a42b-ae181d52e49f service nova] Creating event network-changed:05a28f8a-b1ca-45a0-aec4-aa88c71919a2 for instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 on n-h1-853611-3 Aug 18 11:28:01.424266 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-e4830a3f-e0ea-4128-861d-84adb0caaa45 req-113cd430-62b3-439d-a42b-ae181d52e49f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103049 Aug 18 11:28:01.429835 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 350/724] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:01.443750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-12c3ee72-c820-46d5-9f49-180bdba5b8be tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:01.444525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-12c3ee72-c820-46d5-9f49-180bdba5b8be tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:01.452787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e9735e5c-be3d-4aaf-ab72-ded4aea86ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:01.463124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12c3ee72-c820-46d5-9f49-180bdba5b8be tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:01.479186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12c3ee72-c820-46d5-9f49-180bdba5b8be tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:01.479817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12c3ee72-c820-46d5-9f49-180bdba5b8be tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:01.481744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12c3ee72-c820-46d5-9f49-180bdba5b8be tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:01.482567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12c3ee72-c820-46d5-9f49-180bdba5b8be tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:01.483350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12c3ee72-c820-46d5-9f49-180bdba5b8be tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:01.497328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9735e5c-be3d-4aaf-ab72-ded4aea86ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:01.499045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9735e5c-be3d-4aaf-ab72-ded4aea86ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:01.501527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9735e5c-be3d-4aaf-ab72-ded4aea86ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:01.502812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9735e5c-be3d-4aaf-ab72-ded4aea86ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:01.504168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9735e5c-be3d-4aaf-ab72-ded4aea86ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:01.504922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9735e5c-be3d-4aaf-ab72-ded4aea86ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:01.737124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-12c3ee72-c820-46d5-9f49-180bdba5b8be tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:01.752999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-12c3ee72-c820-46d5-9f49-180bdba5b8be tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:01.760031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-12c3ee72-c820-46d5-9f49-180bdba5b8be tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:01.763253 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-12c3ee72-c820-46d5-9f49-180bdba5b8be tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1258 microversion: 2.25 time: 0.330684 Aug 18 11:28:01.765386 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 351/725] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:01 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1258 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:01.771333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b97f44d3-17c1-4cd7-9133-a16e9d1d2dbc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:01.774461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b97f44d3-17c1-4cd7-9133-a16e9d1d2dbc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:01.791744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b97f44d3-17c1-4cd7-9133-a16e9d1d2dbc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:01.792545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b97f44d3-17c1-4cd7-9133-a16e9d1d2dbc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:01.793040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b97f44d3-17c1-4cd7-9133-a16e9d1d2dbc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:01.793801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b97f44d3-17c1-4cd7-9133-a16e9d1d2dbc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:01.794831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b97f44d3-17c1-4cd7-9133-a16e9d1d2dbc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:01.795320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b97f44d3-17c1-4cd7-9133-a16e9d1d2dbc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:01.843896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b97f44d3-17c1-4cd7-9133-a16e9d1d2dbc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:28:01.901545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9735e5c-be3d-4aaf-ab72-ded4aea86ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "refresh_cache-ab517b76-7996-4c12-a108-d3fb97b955c4" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:28:01.902360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9735e5c-be3d-4aaf-ab72-ded4aea86ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquired lock "refresh_cache-ab517b76-7996-4c12-a108-d3fb97b955c4" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:28:01.939957 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b97f44d3-17c1-4cd7-9133-a16e9d1d2dbc tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "DELETE /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697" status: 204 len: 0 microversion: 2.1 time: 0.172153 Aug 18 11:28:01.940919 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 352/726] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:28:01 2022] DELETE /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:28:01.945969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8e46e10-4998-419c-bcb0-3f4a6dd94e70 tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:01.964461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:01.977844 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8e46e10-4998-419c-bcb0-3f4a6dd94e70 tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.035511 Aug 18 11:28:01.978975 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 353/727] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:28:01 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:01.987264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0f2cc075-2aed-4139-9e80-27cc4691745b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:01.988652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0f2cc075-2aed-4139-9e80-27cc4691745b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:02.019030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2cc075-2aed-4139-9e80-27cc4691745b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:02.019534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2cc075-2aed-4139-9e80-27cc4691745b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:02.019972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2cc075-2aed-4139-9e80-27cc4691745b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:02.020675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2cc075-2aed-4139-9e80-27cc4691745b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:02.021127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2cc075-2aed-4139-9e80-27cc4691745b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:02.023228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2cc075-2aed-4139-9e80-27cc4691745b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:02.264437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0f2cc075-2aed-4139-9e80-27cc4691745b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:02.291432 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0f2cc075-2aed-4139-9e80-27cc4691745b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1311 microversion: 2.1 time: 0.307871 Aug 18 11:28:02.307633 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 354/728] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:01 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1311 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:02.320947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8bdca499-f1f2-42b9-9f3c-5d03ab46ee41 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:02.324265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8bdca499-f1f2-42b9-9f3c-5d03ab46ee41 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:02.336252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bdca499-f1f2-42b9-9f3c-5d03ab46ee41 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:02.338142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bdca499-f1f2-42b9-9f3c-5d03ab46ee41 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:02.338843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bdca499-f1f2-42b9-9f3c-5d03ab46ee41 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:02.339767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bdca499-f1f2-42b9-9f3c-5d03ab46ee41 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:02.340445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bdca499-f1f2-42b9-9f3c-5d03ab46ee41 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:02.341072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bdca499-f1f2-42b9-9f3c-5d03ab46ee41 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:02.550981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8bdca499-f1f2-42b9-9f3c-5d03ab46ee41 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:02.560847 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8bdca499-f1f2-42b9-9f3c-5d03ab46ee41 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 200 len: 1317 microversion: 2.1 time: 0.248886 Aug 18 11:28:02.571274 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 355/729] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:02 2022] GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:02.582990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7dd7f21c-ccda-4bb7-8bea-16ff97cdf432 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.172"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:02.586162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dd7f21c-ccda-4bb7-8bea-16ff97cdf432 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:02.599472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd7f21c-ccda-4bb7-8bea-16ff97cdf432 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:02.601916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd7f21c-ccda-4bb7-8bea-16ff97cdf432 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:02.602572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd7f21c-ccda-4bb7-8bea-16ff97cdf432 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:02.603431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd7f21c-ccda-4bb7-8bea-16ff97cdf432 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:02.604501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd7f21c-ccda-4bb7-8bea-16ff97cdf432 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:02.605044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd7f21c-ccda-4bb7-8bea-16ff97cdf432 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:02.661202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd7f21c-ccda-4bb7-8bea-16ff97cdf432 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "refresh_cache-a472fced-51fc-469b-a37a-38f98e725169" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:28:02.661901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd7f21c-ccda-4bb7-8bea-16ff97cdf432 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquired lock "refresh_cache-a472fced-51fc-469b-a37a-38f98e725169" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:28:02.942481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-e9735e5c-be3d-4aaf-ab72-ded4aea86ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Building network info cache for instance {{(pid=122209) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 18 11:28:03.634466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-e9735e5c-be3d-4aaf-ab72-ded4aea86ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Updating instance_info_cache with network_info: [{"id": "6d45270a-1cd6-41f0-9fa9-232d93d36b38", "address": "fa:16:3e:b0:5e:4f", "network": {"id": "fdd58ab8-846e-466a-8c86-b730482bc074", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1517377389-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "05fb2484544849ab8ad1dbb6dec06f65", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6d45270a-1c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122209) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 18 11:28:03.648890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9735e5c-be3d-4aaf-ab72-ded4aea86ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Releasing lock "refresh_cache-ab517b76-7996-4c12-a108-d3fb97b955c4" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:28:03.650111 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e9735e5c-be3d-4aaf-ab72-ded4aea86ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action" status: 202 len: 0 microversion: 2.1 time: 2.611825 Aug 18 11:28:03.651052 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 375/730] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:28:01 2022] POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action => generated 0 bytes in 2613 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 18 11:28:03.663886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-05cdabd9-e5eb-49ab-8dc7-1a7d00983c5b tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:03.665798 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:03.665798 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:28:03.717121 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-05cdabd9-e5eb-49ab-8dc7-1a7d00983c5b tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/482198356" status: 202 len: 0 microversion: 2.1 time: 0.062502 Aug 18 11:28:03.717980 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 376/731] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:28:03 2022] DELETE /compute/v2.1/flavors/482198356 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:28:03.727860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-22a856e1-97c4-4f56-8f66-34e8fea6827f tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:03.730777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-22a856e1-97c4-4f56-8f66-34e8fea6827f tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:03.746347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22a856e1-97c4-4f56-8f66-34e8fea6827f tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:03.747109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22a856e1-97c4-4f56-8f66-34e8fea6827f tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:03.747765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22a856e1-97c4-4f56-8f66-34e8fea6827f tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:03.748634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22a856e1-97c4-4f56-8f66-34e8fea6827f tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:03.753069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22a856e1-97c4-4f56-8f66-34e8fea6827f tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:03.753696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22a856e1-97c4-4f56-8f66-34e8fea6827f tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:03.914635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-22a856e1-97c4-4f56-8f66-34e8fea6827f tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:03.954172 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-22a856e1-97c4-4f56-8f66-34e8fea6827f tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.234381 Aug 18 11:28:03.955538 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 377/732] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:03 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:03.967622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-96be78de-f854-4275-b226-86a543a44ca6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:03.968783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-96be78de-f854-4275-b226-86a543a44ca6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:03.981522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96be78de-f854-4275-b226-86a543a44ca6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:03.983274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96be78de-f854-4275-b226-86a543a44ca6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:03.985064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96be78de-f854-4275-b226-86a543a44ca6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:03.987919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96be78de-f854-4275-b226-86a543a44ca6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:03.990545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96be78de-f854-4275-b226-86a543a44ca6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:03.991243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96be78de-f854-4275-b226-86a543a44ca6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:04.219125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-96be78de-f854-4275-b226-86a543a44ca6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:04.233352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-96be78de-f854-4275-b226-86a543a44ca6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:04.240799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-96be78de-f854-4275-b226-86a543a44ca6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:04.243750 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-96be78de-f854-4275-b226-86a543a44ca6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1320 microversion: 2.25 time: 0.285451 Aug 18 11:28:04.245749 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 378/733] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:03 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1320 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:04.282322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-f5e1d7a1-5ae8-4540-ba62-d0cbd7b6abc4 req-a7b8dd69-92c7-43b2-b900-90eb79cf8200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403202c1-4021-4975-82bc-2202975dd6c4", "name": "network-vif-plugged", "status": "completed", "tag": "dc6f474f-ac9d-40d6-b8a7-dfa73d80efdf"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:04.319290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f5e1d7a1-5ae8-4540-ba62-d0cbd7b6abc4 req-a7b8dd69-92c7-43b2-b900-90eb79cf8200 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:04.319753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f5e1d7a1-5ae8-4540-ba62-d0cbd7b6abc4 req-a7b8dd69-92c7-43b2-b900-90eb79cf8200 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:04.320588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f5e1d7a1-5ae8-4540-ba62-d0cbd7b6abc4 req-a7b8dd69-92c7-43b2-b900-90eb79cf8200 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:04.363568 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-f5e1d7a1-5ae8-4540-ba62-d0cbd7b6abc4 req-a7b8dd69-92c7-43b2-b900-90eb79cf8200 service nova] Creating event network-vif-plugged:dc6f474f-ac9d-40d6-b8a7-dfa73d80efdf for instance 403202c1-4021-4975-82bc-2202975dd6c4 on n-h2-853611-3 Aug 18 11:28:04.370061 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-f5e1d7a1-5ae8-4540-ba62-d0cbd7b6abc4 req-a7b8dd69-92c7-43b2-b900-90eb79cf8200 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120785 Aug 18 11:28:04.371368 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 379/734] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:04.383686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b3a64c59-aabd-4b31-9f3d-064f83179b43 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:04.384766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b3a64c59-aabd-4b31-9f3d-064f83179b43 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:04.397542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3a64c59-aabd-4b31-9f3d-064f83179b43 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:04.398537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3a64c59-aabd-4b31-9f3d-064f83179b43 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:04.399195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3a64c59-aabd-4b31-9f3d-064f83179b43 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:04.400142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3a64c59-aabd-4b31-9f3d-064f83179b43 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:04.400804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3a64c59-aabd-4b31-9f3d-064f83179b43 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:04.401463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3a64c59-aabd-4b31-9f3d-064f83179b43 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:05.129853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b3a64c59-aabd-4b31-9f3d-064f83179b43 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:05.138895 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b3a64c59-aabd-4b31-9f3d-064f83179b43 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1494 microversion: 2.1 time: 0.765963 Aug 18 11:28:05.142632 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 380/735] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:04 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1494 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:05.147243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-63efef47-285a-4860-be99-50f312c458df req-d5ac311e-bb50-410d-a6c9-6da789bc6966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab517b76-7996-4c12-a108-d3fb97b955c4", "tag": "6d45270a-1cd6-41f0-9fa9-232d93d36b38"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:05.175907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-63efef47-285a-4860-be99-50f312c458df req-d5ac311e-bb50-410d-a6c9-6da789bc6966 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:05.176657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-63efef47-285a-4860-be99-50f312c458df req-d5ac311e-bb50-410d-a6c9-6da789bc6966 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:05.177433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-63efef47-285a-4860-be99-50f312c458df req-d5ac311e-bb50-410d-a6c9-6da789bc6966 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:05.201958 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-63efef47-285a-4860-be99-50f312c458df req-d5ac311e-bb50-410d-a6c9-6da789bc6966 service nova] Creating event network-changed:6d45270a-1cd6-41f0-9fa9-232d93d36b38 for instance ab517b76-7996-4c12-a108-d3fb97b955c4 on n-h1-853611-3 Aug 18 11:28:05.208724 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-63efef47-285a-4860-be99-50f312c458df req-d5ac311e-bb50-410d-a6c9-6da789bc6966 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064750 Aug 18 11:28:05.211325 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 381/736] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:05.222947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dbce96a5-ab66-4171-986c-530284639507 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:05.224363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dbce96a5-ab66-4171-986c-530284639507 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:05.253191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dbce96a5-ab66-4171-986c-530284639507 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:05.255721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dbce96a5-ab66-4171-986c-530284639507 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:05.257075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dbce96a5-ab66-4171-986c-530284639507 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:05.258580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dbce96a5-ab66-4171-986c-530284639507 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:05.265380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dbce96a5-ab66-4171-986c-530284639507 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:05.266580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dbce96a5-ab66-4171-986c-530284639507 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:05.363591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-7dd7f21c-ccda-4bb7-8bea-16ff97cdf432 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Building network info cache for instance {{(pid=122210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 18 11:28:05.613835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dbce96a5-ab66-4171-986c-530284639507 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:05.622845 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dbce96a5-ab66-4171-986c-530284639507 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 200 len: 1317 microversion: 2.1 time: 0.405850 Aug 18 11:28:05.623443 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 382/737] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:05 2022] GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:05.641764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6f92d458-e4fd-46de-bcd8-777f12f1bc28 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '.version_select at 0x7f519fd95dc0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:07.037591 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6f92d458-e4fd-46de-bcd8-777f12f1bc28 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/77c6ec84-f111-47f0-a7ed-356d20396cb2" status: 202 len: 0 microversion: 2.1 time: 1.412786 Aug 18 11:28:07.039124 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 383/738] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:28:05 2022] DELETE /compute/v2.1/os-floating-ips/77c6ec84-f111-47f0-a7ed-356d20396cb2 => generated 0 bytes in 1415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:28:07.044946 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1f810b09-fbc7-41ce-9339-c8f1dbaa557a tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:07.078861 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1f810b09-fbc7-41ce-9339-c8f1dbaa557a tempest-ServersWithSpecificFlavorTestJSON-1897107920 tempest-ServersWithSpecificFlavorTestJSON-1897107920-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038357 Aug 18 11:28:07.094379 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 384/739] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:28:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:07.112535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e3e7683c-a884-423c-8f34-06b5585f53e3 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:07.113583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e3e7683c-a884-423c-8f34-06b5585f53e3 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:07.120080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3e7683c-a884-423c-8f34-06b5585f53e3 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:07.120815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3e7683c-a884-423c-8f34-06b5585f53e3 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:07.121423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3e7683c-a884-423c-8f34-06b5585f53e3 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:07.128860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3e7683c-a884-423c-8f34-06b5585f53e3 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:07.129668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3e7683c-a884-423c-8f34-06b5585f53e3 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:07.130113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3e7683c-a884-423c-8f34-06b5585f53e3 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:07.184509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-7dd7f21c-ccda-4bb7-8bea-16ff97cdf432 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Updating instance_info_cache with network_info: [{"id": "dbe58053-eed9-48a6-bec0-79d514d08be6", "address": "fa:16:3e:1b:bf:bc", "network": {"id": "c1e36b66-5ff9-448b-ae68-4d66745c4f5b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-529460581-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d1fa95f956304a9bb1b34ddf82adac1a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdbe58053-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 18 11:28:07.207625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd7f21c-ccda-4bb7-8bea-16ff97cdf432 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Releasing lock "refresh_cache-a472fced-51fc-469b-a37a-38f98e725169" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:28:07.209088 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7dd7f21c-ccda-4bb7-8bea-16ff97cdf432 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "POST /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169/action" status: 202 len: 0 microversion: 2.1 time: 4.631385 Aug 18 11:28:07.209948 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 356/740] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:28:02 2022] POST /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169/action => generated 0 bytes in 4638 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 18 11:28:07.271606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-e3e7683c-a884-423c-8f34-06b5585f53e3 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:07.292954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2eb0f0f0-1422-4aa3-a89d-2b69c836ef69 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:07.293655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2eb0f0f0-1422-4aa3-a89d-2b69c836ef69 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:07.305493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2eb0f0f0-1422-4aa3-a89d-2b69c836ef69 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:07.307058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2eb0f0f0-1422-4aa3-a89d-2b69c836ef69 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:07.308196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2eb0f0f0-1422-4aa3-a89d-2b69c836ef69 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:07.309244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2eb0f0f0-1422-4aa3-a89d-2b69c836ef69 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:07.310040 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e3e7683c-a884-423c-8f34-06b5585f53e3 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.214103 Aug 18 11:28:07.310179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2eb0f0f0-1422-4aa3-a89d-2b69c836ef69 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:07.310829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2eb0f0f0-1422-4aa3-a89d-2b69c836ef69 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:07.311139 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 385/741] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:07 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:07.316665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-30bde2fb-7bf0-4cf7-bbc8-f393f56bc287 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:07.317493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-30bde2fb-7bf0-4cf7-bbc8-f393f56bc287 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:07.325565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-30bde2fb-7bf0-4cf7-bbc8-f393f56bc287 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:07.326420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-30bde2fb-7bf0-4cf7-bbc8-f393f56bc287 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:07.327762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-30bde2fb-7bf0-4cf7-bbc8-f393f56bc287 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:07.328910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-30bde2fb-7bf0-4cf7-bbc8-f393f56bc287 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:07.330055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-30bde2fb-7bf0-4cf7-bbc8-f393f56bc287 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:07.333806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-30bde2fb-7bf0-4cf7-bbc8-f393f56bc287 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:07.544373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-30bde2fb-7bf0-4cf7-bbc8-f393f56bc287 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:07.557509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-30bde2fb-7bf0-4cf7-bbc8-f393f56bc287 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:07.559221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-30bde2fb-7bf0-4cf7-bbc8-f393f56bc287 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:07.560653 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-30bde2fb-7bf0-4cf7-bbc8-f393f56bc287 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1362 microversion: 2.25 time: 0.248323 Aug 18 11:28:07.574999 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 386/742] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:07 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:07.582695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-08cdbc03-32f7-433f-b9ba-ec372b363559 req-2193e18b-c55c-425d-8e0e-820adc458413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a472fced-51fc-469b-a37a-38f98e725169", "tag": "dbe58053-eed9-48a6-bec0-79d514d08be6"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:07.592527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-08cdbc03-32f7-433f-b9ba-ec372b363559 req-2193e18b-c55c-425d-8e0e-820adc458413 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:07.593240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-08cdbc03-32f7-433f-b9ba-ec372b363559 req-2193e18b-c55c-425d-8e0e-820adc458413 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:07.593691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-08cdbc03-32f7-433f-b9ba-ec372b363559 req-2193e18b-c55c-425d-8e0e-820adc458413 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:07.606101 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-08cdbc03-32f7-433f-b9ba-ec372b363559 req-2193e18b-c55c-425d-8e0e-820adc458413 service nova] Creating event network-changed:dbe58053-eed9-48a6-bec0-79d514d08be6 for instance a472fced-51fc-469b-a37a-38f98e725169 on n-h2-853611-3 Aug 18 11:28:07.612216 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-08cdbc03-32f7-433f-b9ba-ec372b363559 req-2193e18b-c55c-425d-8e0e-820adc458413 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035816 Aug 18 11:28:07.612846 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 387/743] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:07.618094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a1edff8a-fab2-48ed-b7fe-fd5e896c2775 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:07.618838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a1edff8a-fab2-48ed-b7fe-fd5e896c2775 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:07.626056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1edff8a-fab2-48ed-b7fe-fd5e896c2775 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:07.626574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1edff8a-fab2-48ed-b7fe-fd5e896c2775 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:07.627014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1edff8a-fab2-48ed-b7fe-fd5e896c2775 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:07.627736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1edff8a-fab2-48ed-b7fe-fd5e896c2775 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:07.628189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1edff8a-fab2-48ed-b7fe-fd5e896c2775 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:07.628612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1edff8a-fab2-48ed-b7fe-fd5e896c2775 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:07.645109 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2eb0f0f0-1422-4aa3-a89d-2b69c836ef69 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1645 microversion: 2.1 time: 0.432717 Aug 18 11:28:07.668065 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 357/744] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:07 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1645 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:07.675969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b76b251-2b55-40cd-9236-1a856c93a09c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b76b251-2b55-40cd-9236-1a856c93a09c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Request method failure captured: Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action HTTP/1.1 Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 34 Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iIJ-gC8YzQZA0Tvzm09uQMCaMsu9Opx0YTbWPe8pItpq9BQxn0eE2rjmTGpdW8fbqateCwqfeuXj5dEUWWov-y1dlx55irBOLN7e9mjmIZ564qlHDqOM8JiYJz9PW8yPm9vkp0D8zvg-21Lk2pvDig6-1QNtb-FPt30UmnhcyM0UuI Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 05fb2484544849ab8ad1dbb6dec06f65 Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:28:07.686301 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:28:07.688424 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:07.688424 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:28:07.688424 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 05fb2484544849ab8ad1dbb6dec06f65 Aug 18 11:28:07.688424 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:28:07.688424 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project Aug 18 11:28:07.688424 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:28:07.688424 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:28:07.688424 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7308ed12063b4326942c235e39582be5 Aug 18 11:28:07.688424 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project Aug 18 11:28:07.688424 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:28:07.688424 n-d-853611-3 devstack@n-api.service[122210]: {"addFloatingIp": {"address": ""}} Aug 18 11:28:07.688424 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:28:07.688424 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'ab517b76-7996-4c12-a108-d3fb97b955c4', 'body': {'addFloatingIp': {'address': ''}}} Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi '' Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:07.689331 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:28:07.691536 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:28:07.693059 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 18 11:28:07.693059 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:07.693059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b76b251-2b55-40cd-9236-1a856c93a09c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:07.693059 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1b76b251-2b55-40cd-9236-1a856c93a09c tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action" status: 400 len: 142 microversion: 2.1 time: 0.018378 Aug 18 11:28:07.693059 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 358/745] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:28:07 2022] POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action => generated 142 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:28:07.717593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5ecf740a-7648-491b-900b-19ecba49ede4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:07.722595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5ecf740a-7648-491b-900b-19ecba49ede4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:07.740770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ecf740a-7648-491b-900b-19ecba49ede4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:07.741443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ecf740a-7648-491b-900b-19ecba49ede4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:07.741886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ecf740a-7648-491b-900b-19ecba49ede4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:07.742622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ecf740a-7648-491b-900b-19ecba49ede4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:07.743457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ecf740a-7648-491b-900b-19ecba49ede4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:07.743897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ecf740a-7648-491b-900b-19ecba49ede4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:07.762706 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-5ecf740a-7648-491b-900b-19ecba49ede4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] HTTP exception thrown: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5ecf740a-7648-491b-900b-19ecba49ede4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Request method failure captured: Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b HTTP/1.1 Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGNPnhVG8yqxCZ8t2Ch9l0DF8T5HTp7toHQ7J7Qr5mo9aiSYLvowQxukHRgH3usajHTEaa4D6_67HvmsRv7QREGR1O5WeoFz0e5LWzt6Wr6kgUYTeYUwO7JjXYfSC-CU-3MmagFzxKUZ7V0PV3ggqYAjy3Tf0uc7sQaEiohTZcfgnA Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f4ef9f21efdd4ce1a61a905fec4ea89d Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:28:07.765264 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:28:07.766774 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:07.766774 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:28:07.766774 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f4ef9f21efdd4ce1a61a905fec4ea89d Aug 18 11:28:07.766774 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:28:07.766774 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1568300491-project Aug 18 11:28:07.766774 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:28:07.766774 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:28:07.766774 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d2cb8f009ae94e7199fd7153c87b099c Aug 18 11:28:07.766774 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491-project Aug 18 11:28:07.766774 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:28:07.766774 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:28:07.766774 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b'} Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:07.767601 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:28:07.769002 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:07.770486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5ecf740a-7648-491b-900b-19ecba49ede4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Returning 404 to user: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:07.770486 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5ecf740a-7648-491b-900b-19ecba49ede4 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "DELETE /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 404 len: 111 microversion: 2.1 time: 0.077294 Aug 18 11:28:07.771397 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 359/746] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:28:07 2022] DELETE /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:07.782480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1c8770cb-0cda-4d40-91bf-a4686cd9a903 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '.version_select at 0x7f519fbc7280>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:07.976683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a1edff8a-fab2-48ed-b7fe-fd5e896c2775 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:07.987907 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a1edff8a-fab2-48ed-b7fe-fd5e896c2775 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 200 len: 1466 microversion: 2.1 time: 0.373871 Aug 18 11:28:07.988807 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 388/747] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:07 2022] GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 1466 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:07.994455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-b149ea76-79eb-41b5-9a6d-321704cff5c4 req-4feb07f4-9350-419d-b680-0a71473ff682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42a8af3b-ff13-4c75-a982-d3910fe5c697", "name": "network-vif-deleted", "tag": "05a28f8a-b1ca-45a0-aec4-aa88c71919a2"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:08.006194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b149ea76-79eb-41b5-9a6d-321704cff5c4 req-4feb07f4-9350-419d-b680-0a71473ff682 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.006990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b149ea76-79eb-41b5-9a6d-321704cff5c4 req-4feb07f4-9350-419d-b680-0a71473ff682 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.007480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b149ea76-79eb-41b5-9a6d-321704cff5c4 req-4feb07f4-9350-419d-b680-0a71473ff682 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.019816 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-b149ea76-79eb-41b5-9a6d-321704cff5c4 req-4feb07f4-9350-419d-b680-0a71473ff682 service nova] Creating event network-vif-deleted:05a28f8a-b1ca-45a0-aec4-aa88c71919a2 for instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 on n-h1-853611-3 Aug 18 11:28:08.024865 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-b149ea76-79eb-41b5-9a6d-321704cff5c4 req-4feb07f4-9350-419d-b680-0a71473ff682 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034163 Aug 18 11:28:08.026231 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 389/748] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:08.034274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-37b7fba4-9987-48d1-8714-ef1843d89cf6 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:08.035198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-37b7fba4-9987-48d1-8714-ef1843d89cf6 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:08.044207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37b7fba4-9987-48d1-8714-ef1843d89cf6 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.045362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37b7fba4-9987-48d1-8714-ef1843d89cf6 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.046023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37b7fba4-9987-48d1-8714-ef1843d89cf6 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.047793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37b7fba4-9987-48d1-8714-ef1843d89cf6 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.048408 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37b7fba4-9987-48d1-8714-ef1843d89cf6 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.049224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37b7fba4-9987-48d1-8714-ef1843d89cf6 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.244002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:08.259571 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-37b7fba4-9987-48d1-8714-ef1843d89cf6 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1645 microversion: 2.1 time: 0.230295 Aug 18 11:28:08.262892 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1c8770cb-0cda-4d40-91bf-a4686cd9a903 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/os-floating-ips/c2ba0444-fcd6-4fe8-a373-1a024950f810" status: 200 len: 184 microversion: 2.1 time: 0.489715 Aug 18 11:28:08.263550 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 390/749] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:08 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1645 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:08.264278 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 360/750] 10.222.0.73 () {58 vars in 1260 bytes} [Thu Aug 18 11:28:07 2022] GET /compute/v2.1/os-floating-ips/c2ba0444-fcd6-4fe8-a373-1a024950f810 => generated 184 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:08.269439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:08.270020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02c72ac2-1395-4d60-9557-5a0224cc116c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:08.270665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-02c72ac2-1395-4d60-9557-5a0224cc116c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:08.272689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:08.282763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c72ac2-1395-4d60-9557-5a0224cc116c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.283260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c72ac2-1395-4d60-9557-5a0224cc116c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.285164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.285638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c72ac2-1395-4d60-9557-5a0224cc116c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.286080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.286373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c72ac2-1395-4d60-9557-5a0224cc116c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.287167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c72ac2-1395-4d60-9557-5a0224cc116c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.287284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c72ac2-1395-4d60-9557-5a0224cc116c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.289382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.290131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.291327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.291930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.304958 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-02c72ac2-1395-4d60-9557-5a0224cc116c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] HTTP exception thrown: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02c72ac2-1395-4d60-9557-5a0224cc116c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Request method failure captured: Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b HTTP/1.1 Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGNPnhVG8yqxCZ8t2Ch9l0DF8T5HTp7toHQ7J7Qr5mo9aiSYLvowQxukHRgH3usajHTEaa4D6_67HvmsRv7QREGR1O5WeoFz0e5LWzt6Wr6kgUYTeYUwO7JjXYfSC-CU-3MmagFzxKUZ7V0PV3ggqYAjy3Tf0uc7sQaEiohTZcfgnA Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f4ef9f21efdd4ce1a61a905fec4ea89d Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:28:08.306410 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:28:08.307928 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:08.307928 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:28:08.307928 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f4ef9f21efdd4ce1a61a905fec4ea89d Aug 18 11:28:08.307928 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:28:08.307928 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1568300491-project Aug 18 11:28:08.307928 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:28:08.307928 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:28:08.307928 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d2cb8f009ae94e7199fd7153c87b099c Aug 18 11:28:08.307928 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491-project Aug 18 11:28:08.307928 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:28:08.307928 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:28:08.307928 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b'} Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:08.308755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. Aug 18 11:28:08.310016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.312101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02c72ac2-1395-4d60-9557-5a0224cc116c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Returning 404 to user: Instance 91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:08.314231 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-02c72ac2-1395-4d60-9557-5a0224cc116c tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b" status: 404 len: 111 microversion: 2.1 time: 0.047805 Aug 18 11:28:08.315344 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 361/751] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:08 2022] GET /compute/v2.1/servers/91e4fc3c-c9a9-42e2-9ab8-a445c6be9b7b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:08.320946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-75dc9cd5-b124-4975-a02c-36d32007d1d4 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:08.321760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-75dc9cd5-b124-4975-a02c-36d32007d1d4 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:08.329010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75dc9cd5-b124-4975-a02c-36d32007d1d4 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.329763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75dc9cd5-b124-4975-a02c-36d32007d1d4 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.330496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75dc9cd5-b124-4975-a02c-36d32007d1d4 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.331362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75dc9cd5-b124-4975-a02c-36d32007d1d4 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.331994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75dc9cd5-b124-4975-a02c-36d32007d1d4 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.332574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75dc9cd5-b124-4975-a02c-36d32007d1d4 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.335710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "refresh_cache-ab517b76-7996-4c12-a108-d3fb97b955c4" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:28:08.336129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquired lock "refresh_cache-ab517b76-7996-4c12-a108-d3fb97b955c4" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Releasing lock "refresh_cache-ab517b76-7996-4c12-a108-d3fb97b955c4" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] HTTP exception thrown: floating IP not found Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Request method failure captured: Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action HTTP/1.1 Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 41 Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iIJ-gC8YzQZA0Tvzm09uQMCaMsu9Opx0YTbWPe8pItpq9BQxn0eE2rjmTGpdW8fbqateCwqfeuXj5dEUWWov-y1dlx55irBOLN7e9mjmIZ564qlHDqOM8JiYJz9PW8yPm9vkp0D8zvg-21Lk2pvDig6-1QNtb-FPt30UmnhcyM0UuI Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 05fb2484544849ab8ad1dbb6dec06f65 Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:28:08.562347 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:28:08.564081 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:08.564081 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:28:08.564081 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 05fb2484544849ab8ad1dbb6dec06f65 Aug 18 11:28:08.564081 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:28:08.564081 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project Aug 18 11:28:08.564081 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:28:08.564081 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:28:08.564081 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7308ed12063b4326942c235e39582be5 Aug 18 11:28:08.564081 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project Aug 18 11:28:08.564081 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:28:08.564081 n-d-853611-3 devstack@n-api.service[122209]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 18 11:28:08.564081 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:28:08.564081 n-d-853611-3 devstack@n-api.service[122209]: exception: floating IP not found Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'ab517b76-7996-4c12-a108-d3fb97b955c4', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:08.565006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 18 11:28:08.566348 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.567843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Returning 404 to user: floating IP not found {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:08.567843 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5b2c190d-c8df-40e9-aa48-493e84462eca tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action" status: 404 len: 67 microversion: 2.1 time: 0.274395 Aug 18 11:28:08.567843 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 391/752] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:28:08 2022] POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action => generated 67 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:28:08.567843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d8076336-e605-4d4b-804e-9418968aa7b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.172"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:08.573695 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-75dc9cd5-b124-4975-a02c-36d32007d1d4 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 200 len: 1617 microversion: 2.1 time: 0.257036 Aug 18 11:28:08.574572 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 362/753] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:08 2022] GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 1617 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:08.579582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-68779708-f24d-4fea-9684-aa6b5f816c1f tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:08.582192 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:08.582192 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:28:08.583901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68779708-f24d-4fea-9684-aa6b5f816c1f tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.584379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68779708-f24d-4fea-9684-aa6b5f816c1f tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.584808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68779708-f24d-4fea-9684-aa6b5f816c1f tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.585534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68779708-f24d-4fea-9684-aa6b5f816c1f tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.585983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68779708-f24d-4fea-9684-aa6b5f816c1f tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.586403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68779708-f24d-4fea-9684-aa6b5f816c1f tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.629353 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-68779708-f24d-4fea-9684-aa6b5f816c1f tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.053925 Aug 18 11:28:08.631584 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 363/754] 10.222.0.73 () {58 vars in 1176 bytes} [Thu Aug 18 11:28:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:08.635014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1d614be4-b013-4784-a3a6-d4650a3218d5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:08.635630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1d614be4-b013-4784-a3a6-d4650a3218d5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:08.643476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d614be4-b013-4784-a3a6-d4650a3218d5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.647844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d614be4-b013-4784-a3a6-d4650a3218d5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.648666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d614be4-b013-4784-a3a6-d4650a3218d5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.649599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d614be4-b013-4784-a3a6-d4650a3218d5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.650183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d614be4-b013-4784-a3a6-d4650a3218d5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.650705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d614be4-b013-4784-a3a6-d4650a3218d5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.695855 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-1d614be4-b013-4784-a3a6-d4650a3218d5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] HTTP exception thrown: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1d614be4-b013-4784-a3a6-d4650a3218d5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Request method failure captured: Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c HTTP/1.1 Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGNPnhVG8yqxCZ8t2Ch9l0DF8T5HTp7toHQ7J7Qr5mo9aiSYLvowQxukHRgH3usajHTEaa4D6_67HvmsRv7QREGR1O5WeoFz0e5LWzt6Wr6kgUYTeYUwO7JjXYfSC-CU-3MmagFzxKUZ7V0PV3ggqYAjy3Tf0uc7sQaEiohTZcfgnA Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f4ef9f21efdd4ce1a61a905fec4ea89d Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:28:08.697881 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:28:08.699273 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:08.699273 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:28:08.699273 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f4ef9f21efdd4ce1a61a905fec4ea89d Aug 18 11:28:08.699273 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:28:08.699273 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1568300491-project Aug 18 11:28:08.699273 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:28:08.699273 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:28:08.699273 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d2cb8f009ae94e7199fd7153c87b099c Aug 18 11:28:08.699273 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491-project Aug 18 11:28:08.699273 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:28:08.699273 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:28:08.699273 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '22337998-2a5d-4fdc-a5f7-6d1067a13c9c'} Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:08.700091 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:28:08.701414 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.707694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1d614be4-b013-4784-a3a6-d4650a3218d5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Returning 404 to user: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:08.709460 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1d614be4-b013-4784-a3a6-d4650a3218d5 tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "DELETE /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 404 len: 111 microversion: 2.1 time: 0.078004 Aug 18 11:28:08.713730 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 364/755] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:28:08 2022] DELETE /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:08.721805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ba18730d-812c-4599-93ec-8cb642e0a9e5 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:08.722878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ba18730d-812c-4599-93ec-8cb642e0a9e5 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:08.738871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba18730d-812c-4599-93ec-8cb642e0a9e5 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.739374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba18730d-812c-4599-93ec-8cb642e0a9e5 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.739804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba18730d-812c-4599-93ec-8cb642e0a9e5 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.741089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba18730d-812c-4599-93ec-8cb642e0a9e5 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.742049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba18730d-812c-4599-93ec-8cb642e0a9e5 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.742963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba18730d-812c-4599-93ec-8cb642e0a9e5 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.775189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d8076336-e605-4d4b-804e-9418968aa7b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:08.782021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8076336-e605-4d4b-804e-9418968aa7b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.782604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8076336-e605-4d4b-804e-9418968aa7b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.783101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8076336-e605-4d4b-804e-9418968aa7b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.783824 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8076336-e605-4d4b-804e-9418968aa7b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.784347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8076336-e605-4d4b-804e-9418968aa7b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.784776 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8076336-e605-4d4b-804e-9418968aa7b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.808419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:08.878462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-ba18730d-812c-4599-93ec-8cb642e0a9e5 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:08.897175 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ba18730d-812c-4599-93ec-8cb642e0a9e5 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.183686 Aug 18 11:28:08.897747 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 365/756] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:08 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:08.902567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-244c2854-afd4-440f-b43c-66714ddf470d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Action: 'action', calling method: .version_select at 0x7f51af110700>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:08.950957 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-244c2854-afd4-440f-b43c-66714ddf470d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-244c2854-afd4-440f-b43c-66714ddf470d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Request method failure captured: Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action HTTP/1.1 Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 44 Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iIJ-gC8YzQZA0Tvzm09uQMCaMsu9Opx0YTbWPe8pItpq9BQxn0eE2rjmTGpdW8fbqateCwqfeuXj5dEUWWov-y1dlx55irBOLN7e9mjmIZ564qlHDqOM8JiYJz9PW8yPm9vkp0D8zvg-21Lk2pvDig6-1QNtb-FPt30UmnhcyM0UuI Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 05fb2484544849ab8ad1dbb6dec06f65 Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:28:08.952990 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:28:08.954266 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:08.954266 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:28:08.954266 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 05fb2484544849ab8ad1dbb6dec06f65 Aug 18 11:28:08.954266 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:28:08.954266 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project Aug 18 11:28:08.954266 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:28:08.954266 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:28:08.954266 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7308ed12063b4326942c235e39582be5 Aug 18 11:28:08.954266 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project Aug 18 11:28:08.954266 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:28:08.954266 n-d-853611-3 devstack@n-api.service[122210]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 18 11:28:08.954266 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:28:08.954266 n-d-853611-3 devstack@n-api.service[122210]: exception: Floating IP not found for address 0.0.0.0. Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'ab517b76-7996-4c12-a108-d3fb97b955c4', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:08.955054 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 18 11:28:08.956131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:08.957414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-244c2854-afd4-440f-b43c-66714ddf470d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:08.957414 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-244c2854-afd4-440f-b43c-66714ddf470d tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action" status: 404 len: 88 microversion: 2.1 time: 0.055535 Aug 18 11:28:08.957414 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 366/757] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:28:08 2022] POST /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4/action => generated 88 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:28:08.960321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c2c4e152-f2f8-40ab-b0b1-a5502ffc45df tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:08.960515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c2c4e152-f2f8-40ab-b0b1-a5502ffc45df tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:08.967446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c4e152-f2f8-40ab-b0b1-a5502ffc45df tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.968451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c4e152-f2f8-40ab-b0b1-a5502ffc45df tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.969243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c4e152-f2f8-40ab-b0b1-a5502ffc45df tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:08.969602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c4e152-f2f8-40ab-b0b1-a5502ffc45df tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:08.970050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c4e152-f2f8-40ab-b0b1-a5502ffc45df tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:08.970494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c4e152-f2f8-40ab-b0b1-a5502ffc45df tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:09.009644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8076336-e605-4d4b-804e-9418968aa7b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "refresh_cache-a472fced-51fc-469b-a37a-38f98e725169" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:28:09.010056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8076336-e605-4d4b-804e-9418968aa7b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquired lock "refresh_cache-a472fced-51fc-469b-a37a-38f98e725169" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:28:09.104769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c2c4e152-f2f8-40ab-b0b1-a5502ffc45df tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:09.114248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c2c4e152-f2f8-40ab-b0b1-a5502ffc45df tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:09.116227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c2c4e152-f2f8-40ab-b0b1-a5502ffc45df tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:09.117380 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c2c4e152-f2f8-40ab-b0b1-a5502ffc45df tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1362 microversion: 2.25 time: 0.160906 Aug 18 11:28:09.127508 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 367/758] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:08 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:09.127508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7dbabdd9-f613-47d0-8774-4df911861527 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-853611-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:09.127508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dbabdd9-f613-47d0-8774-4df911861527 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:09.131013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dbabdd9-f613-47d0-8774-4df911861527 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:09.131483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dbabdd9-f613-47d0-8774-4df911861527 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:09.131917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dbabdd9-f613-47d0-8774-4df911861527 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:09.132605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dbabdd9-f613-47d0-8774-4df911861527 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:09.133047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dbabdd9-f613-47d0-8774-4df911861527 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:09.133463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dbabdd9-f613-47d0-8774-4df911861527 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:09.158414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-7dbabdd9-f613-47d0-8774-4df911861527 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lazy-loading 'flavor' on Instance uuid ffe68694-3a7c-41cb-b2f2-1f25d8648218 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:09.170667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dbabdd9-f613-47d0-8774-4df911861527 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Going to try to live migrate instance to n-h1-853611-3 {{(pid=122210) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 18 11:28:09.646055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-d8076336-e605-4d4b-804e-9418968aa7b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Building network info cache for instance {{(pid=122209) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 18 11:28:10.036534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:10.212754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-d8076336-e605-4d4b-804e-9418968aa7b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Updating instance_info_cache with network_info: [{"id": "dbe58053-eed9-48a6-bec0-79d514d08be6", "address": "fa:16:3e:1b:bf:bc", "network": {"id": "c1e36b66-5ff9-448b-ae68-4d66745c4f5b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-529460581-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d1fa95f956304a9bb1b34ddf82adac1a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdbe58053-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122209) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 18 11:28:10.228000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8076336-e605-4d4b-804e-9418968aa7b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Releasing lock "refresh_cache-a472fced-51fc-469b-a37a-38f98e725169" {{(pid=122209) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:28:10.229472 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d8076336-e605-4d4b-804e-9418968aa7b3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "POST /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169/action" status: 202 len: 0 microversion: 2.1 time: 1.689398 Aug 18 11:28:10.230344 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 392/759] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:28:08 2022] POST /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169/action => generated 0 bytes in 1691 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 18 11:28:10.237782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1271954672", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["3247ce04-df54-4bd8-a1e9-00a29d975b62"]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:10.302880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:28:10.560918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:28:10.561915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:28:10.562673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:28:10.563062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:28:10.563468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:28:10.572797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:10.573266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:10.573695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:10.574420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:10.574889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:10.575313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:10.604747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:28:10.612223 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:28:10.623533 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7dbabdd9-f613-47d0-8774-4df911861527 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218/action" status: 202 len: 0 microversion: 2.1 time: 1.504291 Aug 18 11:28:10.625397 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 368/760] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:28:09 2022] POST /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218/action => generated 0 bytes in 1507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:28:10.630685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:28:10.632095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c20ac8cd-16f0-4798-b100-50158051dc2f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:10.632731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c20ac8cd-16f0-4798-b100-50158051dc2f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] [instance: 22337998-2a5d-4fdc-a5f7-6d1067a13c9c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:10.633091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:28:10.647109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c20ac8cd-16f0-4798-b100-50158051dc2f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:10.647605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c20ac8cd-16f0-4798-b100-50158051dc2f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:10.648193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c20ac8cd-16f0-4798-b100-50158051dc2f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:10.649096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c20ac8cd-16f0-4798-b100-50158051dc2f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:10.649556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c20ac8cd-16f0-4798-b100-50158051dc2f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:10.649995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c20ac8cd-16f0-4798-b100-50158051dc2f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:10.670375 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-c20ac8cd-16f0-4798-b100-50158051dc2f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] HTTP exception thrown: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c20ac8cd-16f0-4798-b100-50158051dc2f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Request method failure captured: Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c HTTP/1.1 Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iGNPnhVG8yqxCZ8t2Ch9l0DF8T5HTp7toHQ7J7Qr5mo9aiSYLvowQxukHRgH3usajHTEaa4D6_67HvmsRv7QREGR1O5WeoFz0e5LWzt6Wr6kgUYTeYUwO7JjXYfSC-CU-3MmagFzxKUZ7V0PV3ggqYAjy3Tf0uc7sQaEiohTZcfgnA Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f4ef9f21efdd4ce1a61a905fec4ea89d Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:28:10.673206 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:28:10.674734 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ef9f21efdd4ce1a61a905fec4ea89d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:10.674734 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:28:10.674734 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f4ef9f21efdd4ce1a61a905fec4ea89d Aug 18 11:28:10.674734 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491 Aug 18 11:28:10.674734 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1568300491-project Aug 18 11:28:10.674734 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:28:10.674734 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:28:10.674734 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d2cb8f009ae94e7199fd7153c87b099c Aug 18 11:28:10.674734 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1568300491-project Aug 18 11:28:10.674734 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:28:10.674734 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:28:10.674734 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '22337998-2a5d-4fdc-a5f7-6d1067a13c9c'} Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:10.675598 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. Aug 18 11:28:10.677075 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:10.680483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c20ac8cd-16f0-4798-b100-50158051dc2f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] Returning 404 to user: Instance 22337998-2a5d-4fdc-a5f7-6d1067a13c9c could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:10.681587 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c20ac8cd-16f0-4798-b100-50158051dc2f tempest-ServersWithSpecificFlavorTestJSON-1568300491 tempest-ServersWithSpecificFlavorTestJSON-1568300491-project] 10.222.0.73 "GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c" status: 404 len: 111 microversion: 2.1 time: 0.054918 Aug 18 11:28:10.686991 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 369/761] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:10 2022] GET /compute/v2.1/servers/22337998-2a5d-4fdc-a5f7-6d1067a13c9c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:10.716745 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-36a076c3-e96a-44f3-8620-6be8b6bdd498 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.484696 Aug 18 11:28:10.724040 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 393/762] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:28:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:28:10.724303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-de01ef78-1868-426e-908e-266efb3e5aac tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:10.724815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-de01ef78-1868-426e-908e-266efb3e5aac tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:10.731518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de01ef78-1868-426e-908e-266efb3e5aac tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:10.732012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de01ef78-1868-426e-908e-266efb3e5aac tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:10.732563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de01ef78-1868-426e-908e-266efb3e5aac tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:10.733781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de01ef78-1868-426e-908e-266efb3e5aac tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:10.734248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de01ef78-1868-426e-908e-266efb3e5aac tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:10.734720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de01ef78-1868-426e-908e-266efb3e5aac tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:10.781688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-de01ef78-1868-426e-908e-266efb3e5aac tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:28:10.847479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d26102fe-b265-4773-a1b0-91e6482da499 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Action: 'create', calling method: .version_select at 0x7f519fbc7a60>, body: {"keypair": {"name": "tempest-keypair-1145292547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj/r1m+V+vk9RtFm9QrRpb4FFN6VRBMNDlyFO0HZvwdpJWfWId7jXZ9/W6wXXX7jRjnAUgSrm3lAMxIjKHRfp+rjo/Wx6zl3js8J/CmUIHAzxGM6HwqJzbzvYhY7xiwWQ=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:10.894884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d26102fe-b265-4773-a1b0-91e6482da499 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Getting quotas for project ccfa07bf92894fb0918418f997c3c149. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:28:10.901523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d26102fe-b265-4773-a1b0-91e6482da499 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Getting quotas for user 82883babd8814c4283e80c11881a67fd and project ccfa07bf92894fb0918418f997c3c149. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:28:10.925390 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-de01ef78-1868-426e-908e-266efb3e5aac tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 204 len: 0 microversion: 2.1 time: 0.204746 Aug 18 11:28:10.926715 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 394/763] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:28:10 2022] DELETE /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:28:10.936173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-6fcb13ad-81de-44a3-8508-11994ac46101 req-87c2a480-52d5-46f9-94d0-8424c906fd8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e802eca-675c-4376-8bdb-666b223637db", "tag": "ac380441-814b-46b7-aff6-6a2c1648907c"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:10.946898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:10.948534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6fcb13ad-81de-44a3-8508-11994ac46101 req-87c2a480-52d5-46f9-94d0-8424c906fd8c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:10.949023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6fcb13ad-81de-44a3-8508-11994ac46101 req-87c2a480-52d5-46f9-94d0-8424c906fd8c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:10.949466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6fcb13ad-81de-44a3-8508-11994ac46101 req-87c2a480-52d5-46f9-94d0-8424c906fd8c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:10.962479 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d26102fe-b265-4773-a1b0-91e6482da499 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.277681 Aug 18 11:28:10.964417 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 370/764] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:28:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:10.968418 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-6fcb13ad-81de-44a3-8508-11994ac46101 req-87c2a480-52d5-46f9-94d0-8424c906fd8c service nova] Creating event network-changed:ac380441-814b-46b7-aff6-6a2c1648907c for instance 2e802eca-675c-4376-8bdb-666b223637db on n-h1-853611-3 Aug 18 11:28:10.972797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cf480b76-15f5-4139-bf2c-361ca5002a04 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:10.974198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cf480b76-15f5-4139-bf2c-361ca5002a04 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:10.982350 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-6fcb13ad-81de-44a3-8508-11994ac46101 req-87c2a480-52d5-46f9-94d0-8424c906fd8c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050968 Aug 18 11:28:10.983602 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 395/765] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:10.989028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf480b76-15f5-4139-bf2c-361ca5002a04 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:10.989873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf480b76-15f5-4139-bf2c-361ca5002a04 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:10.992557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf480b76-15f5-4139-bf2c-361ca5002a04 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:10.993506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf480b76-15f5-4139-bf2c-361ca5002a04 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:10.994201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf480b76-15f5-4139-bf2c-361ca5002a04 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:10.994661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf480b76-15f5-4139-bf2c-361ca5002a04 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:10.995576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-71048444-ccd1-45b4-bbab-3ff764cde9e3 req-3d1124d7-2ece-4a53-aec8-d38a37d16fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a472fced-51fc-469b-a37a-38f98e725169", "tag": "dbe58053-eed9-48a6-bec0-79d514d08be6"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:11.011214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-71048444-ccd1-45b4-bbab-3ff764cde9e3 req-3d1124d7-2ece-4a53-aec8-d38a37d16fb9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:11.011710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-71048444-ccd1-45b4-bbab-3ff764cde9e3 req-3d1124d7-2ece-4a53-aec8-d38a37d16fb9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:11.012148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-71048444-ccd1-45b4-bbab-3ff764cde9e3 req-3d1124d7-2ece-4a53-aec8-d38a37d16fb9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:11.026925 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-71048444-ccd1-45b4-bbab-3ff764cde9e3 req-3d1124d7-2ece-4a53-aec8-d38a37d16fb9 service nova] Creating event network-changed:dbe58053-eed9-48a6-bec0-79d514d08be6 for instance a472fced-51fc-469b-a37a-38f98e725169 on n-h2-853611-3 Aug 18 11:28:11.033382 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-71048444-ccd1-45b4-bbab-3ff764cde9e3 req-3d1124d7-2ece-4a53-aec8-d38a37d16fb9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047890 Aug 18 11:28:11.033999 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 396/766] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:11.039939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d68f1f3d-dcaf-4e2a-b964-1167bf1ddd55 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:11.040686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d68f1f3d-dcaf-4e2a-b964-1167bf1ddd55 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:11.070992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d68f1f3d-dcaf-4e2a-b964-1167bf1ddd55 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:11.071502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d68f1f3d-dcaf-4e2a-b964-1167bf1ddd55 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:11.071950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d68f1f3d-dcaf-4e2a-b964-1167bf1ddd55 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:11.074614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d68f1f3d-dcaf-4e2a-b964-1167bf1ddd55 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:11.075109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d68f1f3d-dcaf-4e2a-b964-1167bf1ddd55 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:11.075552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d68f1f3d-dcaf-4e2a-b964-1167bf1ddd55 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:11.109565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-cf480b76-15f5-4139-bf2c-361ca5002a04 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:11.167903 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cf480b76-15f5-4139-bf2c-361ca5002a04 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.200658 Aug 18 11:28:11.170290 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 371/767] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:10 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:11.183617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a79ead29-ff2e-4ead-86ca-86181585b687 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:11.184525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a79ead29-ff2e-4ead-86ca-86181585b687 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:11.206187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a79ead29-ff2e-4ead-86ca-86181585b687 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:11.209091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a79ead29-ff2e-4ead-86ca-86181585b687 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:11.211493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a79ead29-ff2e-4ead-86ca-86181585b687 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:11.213290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a79ead29-ff2e-4ead-86ca-86181585b687 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:11.214464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a79ead29-ff2e-4ead-86ca-86181585b687 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:11.215204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a79ead29-ff2e-4ead-86ca-86181585b687 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:11.498233 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-a79ead29-ff2e-4ead-86ca-86181585b687 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] HTTP exception thrown: Instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 could not be found. Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a79ead29-ff2e-4ead-86ca-86181585b687 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Request method failure captured: Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 HTTP/1.1 Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iH1HzuxqQ6j0uhKbmg3JejqPZd4bkgpQKgMhaLXOzaPQXnR4TiIXmbC6NxQBI3FJTSo34hMYCGF_o04GCcf6uq9Qe1GjhvYX9PKvpvDYzToKaqgpwH2E_Ialg9v7epSrEyjNDa-_-8xwAIHx-urMgnMMJA5da75Idxuy39tiu52IGY Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: d1fa95f956304a9bb1b34ddf82adac1a Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-330777573 Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:28:11.500600 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:28:11.501964 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:11.501964 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-330777573 Aug 18 11:28:11.501964 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: d1fa95f956304a9bb1b34ddf82adac1a Aug 18 11:28:11.501964 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-330777573 Aug 18 11:28:11.501964 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FloatingIPsAssociationTestJSON-330777573-project Aug 18 11:28:11.501964 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:28:11.501964 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:28:11.501964 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: eb875d64a00b43448f7e3b7492e9086b Aug 18 11:28:11.501964 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-330777573-project Aug 18 11:28:11.501964 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:28:11.501964 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 could not be found. Aug 18 11:28:11.501964 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '42a8af3b-ff13-4c75-a982-d3910fe5c697'} Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 could not be found. Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:11.502895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 could not be found. Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 could not be found. Aug 18 11:28:11.504405 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:11.507423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a79ead29-ff2e-4ead-86ca-86181585b687 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Returning 404 to user: Instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:11.507423 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a79ead29-ff2e-4ead-86ca-86181585b687 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "DELETE /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697" status: 404 len: 111 microversion: 2.1 time: 0.330514 Aug 18 11:28:11.507423 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 372/768] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:28:11 2022] DELETE /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 => generated 111 bytes in 335 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:11.510859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-14eb6eb2-2d9a-4d0e-93a9-90bda4d938bb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:11.511511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-14eb6eb2-2d9a-4d0e-93a9-90bda4d938bb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:11.519729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14eb6eb2-2d9a-4d0e-93a9-90bda4d938bb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:11.520370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14eb6eb2-2d9a-4d0e-93a9-90bda4d938bb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:11.520670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14eb6eb2-2d9a-4d0e-93a9-90bda4d938bb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:11.521908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14eb6eb2-2d9a-4d0e-93a9-90bda4d938bb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:11.521908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14eb6eb2-2d9a-4d0e-93a9-90bda4d938bb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:11.522392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14eb6eb2-2d9a-4d0e-93a9-90bda4d938bb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:11.645386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d68f1f3d-dcaf-4e2a-b964-1167bf1ddd55 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:11.660673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d68f1f3d-dcaf-4e2a-b964-1167bf1ddd55 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:11.664636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d68f1f3d-dcaf-4e2a-b964-1167bf1ddd55 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:11.666040 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d68f1f3d-dcaf-4e2a-b964-1167bf1ddd55 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1362 microversion: 2.25 time: 0.630718 Aug 18 11:28:11.666833 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 397/769] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:11 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1362 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:11.673438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b0e9a53d-5cdd-40ba-827c-11cea36b66f4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:11.675220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b0e9a53d-5cdd-40ba-827c-11cea36b66f4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:11.690756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0e9a53d-5cdd-40ba-827c-11cea36b66f4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:11.691566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0e9a53d-5cdd-40ba-827c-11cea36b66f4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:11.692246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0e9a53d-5cdd-40ba-827c-11cea36b66f4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:11.693283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0e9a53d-5cdd-40ba-827c-11cea36b66f4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:11.694753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0e9a53d-5cdd-40ba-827c-11cea36b66f4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:11.695524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0e9a53d-5cdd-40ba-827c-11cea36b66f4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:11.754688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-14eb6eb2-2d9a-4d0e-93a9-90bda4d938bb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:11.764234 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-14eb6eb2-2d9a-4d0e-93a9-90bda4d938bb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1504 microversion: 2.1 time: 0.257093 Aug 18 11:28:11.766094 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 373/770] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:11 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1504 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:11.771638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-95e40509-53d5-4ad4-9010-365e5baaac0e tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:11.772258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-95e40509-53d5-4ad4-9010-365e5baaac0e tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:11.782869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95e40509-53d5-4ad4-9010-365e5baaac0e tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:11.783552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95e40509-53d5-4ad4-9010-365e5baaac0e tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:11.784120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95e40509-53d5-4ad4-9010-365e5baaac0e tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:11.785209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95e40509-53d5-4ad4-9010-365e5baaac0e tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:11.786592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95e40509-53d5-4ad4-9010-365e5baaac0e tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:11.787244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95e40509-53d5-4ad4-9010-365e5baaac0e tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:11.864179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b0e9a53d-5cdd-40ba-827c-11cea36b66f4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:11.872827 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b0e9a53d-5cdd-40ba-827c-11cea36b66f4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1213 microversion: 2.1 time: 0.204693 Aug 18 11:28:11.879317 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 398/771] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:11 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1213 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:11.884505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ad442041-146e-4732-965b-13227775395c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:11.885107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ad442041-146e-4732-965b-13227775395c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: 42a8af3b-ff13-4c75-a982-d3910fe5c697] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:11.903353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad442041-146e-4732-965b-13227775395c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:11.907253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad442041-146e-4732-965b-13227775395c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:11.907788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad442041-146e-4732-965b-13227775395c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:11.908550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad442041-146e-4732-965b-13227775395c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:11.909424 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad442041-146e-4732-965b-13227775395c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:11.909853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad442041-146e-4732-965b-13227775395c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:11.935120 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-ad442041-146e-4732-965b-13227775395c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] HTTP exception thrown: Instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 could not be found. Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ad442041-146e-4732-965b-13227775395c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Request method failure captured: Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 HTTP/1.1 Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iH1HzuxqQ6j0uhKbmg3JejqPZd4bkgpQKgMhaLXOzaPQXnR4TiIXmbC6NxQBI3FJTSo34hMYCGF_o04GCcf6uq9Qe1GjhvYX9PKvpvDYzToKaqgpwH2E_Ialg9v7epSrEyjNDa-_-8xwAIHx-urMgnMMJA5da75Idxuy39tiu52IGY Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: d1fa95f956304a9bb1b34ddf82adac1a Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-330777573 Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:28:11.937682 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:28:11.939048 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:11.939048 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-330777573 Aug 18 11:28:11.939048 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: d1fa95f956304a9bb1b34ddf82adac1a Aug 18 11:28:11.939048 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-330777573 Aug 18 11:28:11.939048 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-FloatingIPsAssociationTestJSON-330777573-project Aug 18 11:28:11.939048 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:28:11.939048 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:28:11.939048 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: eb875d64a00b43448f7e3b7492e9086b Aug 18 11:28:11.939048 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-330777573-project Aug 18 11:28:11.939048 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:28:11.939048 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 could not be found. Aug 18 11:28:11.939048 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '42a8af3b-ff13-4c75-a982-d3910fe5c697'} Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 could not be found. Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:11.939751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 could not be found. Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 could not be found. Aug 18 11:28:11.940922 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:11.944384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ad442041-146e-4732-965b-13227775395c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Returning 404 to user: Instance 42a8af3b-ff13-4c75-a982-d3910fe5c697 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:11.945502 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ad442041-146e-4732-965b-13227775395c tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697" status: 404 len: 111 microversion: 2.1 time: 0.064895 Aug 18 11:28:11.950501 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 399/772] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:11 2022] GET /compute/v2.1/servers/42a8af3b-ff13-4c75-a982-d3910fe5c697 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:11.958080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bd367b63-4b17-47a2-92fb-ca32d60dfb03 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '.version_select at 0x7f51ac166a60>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:11.980859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-95e40509-53d5-4ad4-9010-365e5baaac0e tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:11.989987 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-95e40509-53d5-4ad4-9010-365e5baaac0e tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1542 microversion: 2.1 time: 0.222722 Aug 18 11:28:11.990591 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 374/773] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:11 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1542 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:12.200473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cc5cfa4c-1a7d-45fb-b158-2a99f94b1f06 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:12.202496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cc5cfa4c-1a7d-45fb-b158-2a99f94b1f06 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:12.209689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc5cfa4c-1a7d-45fb-b158-2a99f94b1f06 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:12.211505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc5cfa4c-1a7d-45fb-b158-2a99f94b1f06 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:12.212108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc5cfa4c-1a7d-45fb-b158-2a99f94b1f06 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:12.213020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc5cfa4c-1a7d-45fb-b158-2a99f94b1f06 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:12.213636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc5cfa4c-1a7d-45fb-b158-2a99f94b1f06 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:12.214218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc5cfa4c-1a7d-45fb-b158-2a99f94b1f06 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:12.313661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-cc5cfa4c-1a7d-45fb-b158-2a99f94b1f06 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:12.346120 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cc5cfa4c-1a7d-45fb-b158-2a99f94b1f06 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.150450 Aug 18 11:28:12.347424 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 375/774] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:12 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:12.691579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1f8c0ce8-a55f-43a1-a218-8871192e02dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:12.692560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1f8c0ce8-a55f-43a1-a218-8871192e02dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:12.700482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f8c0ce8-a55f-43a1-a218-8871192e02dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:12.701271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f8c0ce8-a55f-43a1-a218-8871192e02dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:12.702725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f8c0ce8-a55f-43a1-a218-8871192e02dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:12.703828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f8c0ce8-a55f-43a1-a218-8871192e02dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:12.704627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f8c0ce8-a55f-43a1-a218-8871192e02dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:12.705124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f8c0ce8-a55f-43a1-a218-8871192e02dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:13.032034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1f8c0ce8-a55f-43a1-a218-8871192e02dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:13.042608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1f8c0ce8-a55f-43a1-a218-8871192e02dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:13.044114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1f8c0ce8-a55f-43a1-a218-8871192e02dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:13.045230 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1f8c0ce8-a55f-43a1-a218-8871192e02dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1362 microversion: 2.25 time: 0.359841 Aug 18 11:28:13.046856 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 376/775] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:12 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:28:13.053027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0c28e926-ff94-466f-a586-1820d55d365e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:13.057202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0c28e926-ff94-466f-a586-1820d55d365e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:13.067375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c28e926-ff94-466f-a586-1820d55d365e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:13.067892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c28e926-ff94-466f-a586-1820d55d365e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:13.068323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c28e926-ff94-466f-a586-1820d55d365e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:13.069022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c28e926-ff94-466f-a586-1820d55d365e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:13.069473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c28e926-ff94-466f-a586-1820d55d365e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:13.069892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c28e926-ff94-466f-a586-1820d55d365e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:13.330163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0c28e926-ff94-466f-a586-1820d55d365e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:13.344089 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0c28e926-ff94-466f-a586-1820d55d365e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1504 microversion: 2.1 time: 0.295445 Aug 18 11:28:13.344718 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 377/776] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:13 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:13.350311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d52ab9d-3aa7-4963-8abd-af99d7fa2d42 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:13.351468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9d52ab9d-3aa7-4963-8abd-af99d7fa2d42 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:13.360563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d52ab9d-3aa7-4963-8abd-af99d7fa2d42 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:13.361240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d52ab9d-3aa7-4963-8abd-af99d7fa2d42 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:13.361779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d52ab9d-3aa7-4963-8abd-af99d7fa2d42 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:13.362652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d52ab9d-3aa7-4963-8abd-af99d7fa2d42 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:13.363419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d52ab9d-3aa7-4963-8abd-af99d7fa2d42 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:13.364935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d52ab9d-3aa7-4963-8abd-af99d7fa2d42 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:13.703775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9d52ab9d-3aa7-4963-8abd-af99d7fa2d42 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:13.717430 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9d52ab9d-3aa7-4963-8abd-af99d7fa2d42 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1275 microversion: 2.1 time: 0.371394 Aug 18 11:28:13.718976 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 378/777] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:13 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1275 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:13.733762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-92583514-db5d-4d02-86b3-c246255b4c62 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:13.735983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-92583514-db5d-4d02-86b3-c246255b4c62 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:13.743639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-92583514-db5d-4d02-86b3-c246255b4c62 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:13.744265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-92583514-db5d-4d02-86b3-c246255b4c62 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:13.744765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-92583514-db5d-4d02-86b3-c246255b4c62 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:13.745690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-92583514-db5d-4d02-86b3-c246255b4c62 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:13.746353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-92583514-db5d-4d02-86b3-c246255b4c62 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:13.747381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-92583514-db5d-4d02-86b3-c246255b4c62 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:13.948159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-92583514-db5d-4d02-86b3-c246255b4c62 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:13.963299 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-92583514-db5d-4d02-86b3-c246255b4c62 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1542 microversion: 2.1 time: 0.242697 Aug 18 11:28:13.964147 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 379/778] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:13 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1542 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:13.968935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4323a012-9fdb-4368-b622-f4bdb4610fdb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:13.969730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4323a012-9fdb-4368-b622-f4bdb4610fdb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:13.976262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4323a012-9fdb-4368-b622-f4bdb4610fdb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:13.976922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4323a012-9fdb-4368-b622-f4bdb4610fdb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:13.977512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4323a012-9fdb-4368-b622-f4bdb4610fdb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:13.978383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4323a012-9fdb-4368-b622-f4bdb4610fdb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:13.979019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4323a012-9fdb-4368-b622-f4bdb4610fdb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:13.979622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4323a012-9fdb-4368-b622-f4bdb4610fdb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:14.076166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-4323a012-9fdb-4368-b622-f4bdb4610fdb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:14.099852 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4323a012-9fdb-4368-b622-f4bdb4610fdb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.134475 Aug 18 11:28:14.115392 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 380/779] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:13 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:14.128572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-3beb09d1-f4bf-43b1-9ab7-f57285c7762e req-3e463b0a-bfbe-42ff-afaa-bb4e245aaf90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe68694-3a7c-41cb-b2f2-1f25d8648218", "name": "network-vif-unplugged", "status": "completed", "tag": "ed0c5302-2b34-44c1-a1e3-e5121abc35f0"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:14.140071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3beb09d1-f4bf-43b1-9ab7-f57285c7762e req-3e463b0a-bfbe-42ff-afaa-bb4e245aaf90 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:14.141043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3beb09d1-f4bf-43b1-9ab7-f57285c7762e req-3e463b0a-bfbe-42ff-afaa-bb4e245aaf90 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:14.141662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3beb09d1-f4bf-43b1-9ab7-f57285c7762e req-3e463b0a-bfbe-42ff-afaa-bb4e245aaf90 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:14.157194 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-3beb09d1-f4bf-43b1-9ab7-f57285c7762e req-3e463b0a-bfbe-42ff-afaa-bb4e245aaf90 service nova] Creating event network-vif-unplugged:ed0c5302-2b34-44c1-a1e3-e5121abc35f0 for instance ffe68694-3a7c-41cb-b2f2-1f25d8648218 on n-h2-853611-3 Aug 18 11:28:14.164920 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-3beb09d1-f4bf-43b1-9ab7-f57285c7762e req-3e463b0a-bfbe-42ff-afaa-bb4e245aaf90 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047053 Aug 18 11:28:14.166602 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 381/780] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:14.175583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b514554-7678-45ca-a6fe-e4b44282207f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:14.176614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3b514554-7678-45ca-a6fe-e4b44282207f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:14.184650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b514554-7678-45ca-a6fe-e4b44282207f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:14.187400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b514554-7678-45ca-a6fe-e4b44282207f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:14.188317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b514554-7678-45ca-a6fe-e4b44282207f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:14.189589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b514554-7678-45ca-a6fe-e4b44282207f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:14.190496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b514554-7678-45ca-a6fe-e4b44282207f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:14.191152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b514554-7678-45ca-a6fe-e4b44282207f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:14.447295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3b514554-7678-45ca-a6fe-e4b44282207f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:14.452122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:14.468591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3b514554-7678-45ca-a6fe-e4b44282207f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:14.470317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3b514554-7678-45ca-a6fe-e4b44282207f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:14.475154 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3b514554-7678-45ca-a6fe-e4b44282207f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1362 microversion: 2.25 time: 0.306376 Aug 18 11:28:14.476839 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 382/781] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:14 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:14.497687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9071fe95-e975-4fb6-88ae-e92bd1e2c5e4 req-735b66bf-27c2-4c24-8c13-9afc7594243a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e802eca-675c-4376-8bdb-666b223637db", "name": "network-vif-plugged", "status": "completed", "tag": "ac380441-814b-46b7-aff6-6a2c1648907c"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:14.511324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9071fe95-e975-4fb6-88ae-e92bd1e2c5e4 req-735b66bf-27c2-4c24-8c13-9afc7594243a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:14.511907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9071fe95-e975-4fb6-88ae-e92bd1e2c5e4 req-735b66bf-27c2-4c24-8c13-9afc7594243a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:14.512417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9071fe95-e975-4fb6-88ae-e92bd1e2c5e4 req-735b66bf-27c2-4c24-8c13-9afc7594243a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:14.524483 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9071fe95-e975-4fb6-88ae-e92bd1e2c5e4 req-735b66bf-27c2-4c24-8c13-9afc7594243a service nova] Creating event network-vif-plugged:ac380441-814b-46b7-aff6-6a2c1648907c for instance 2e802eca-675c-4376-8bdb-666b223637db on n-h1-853611-3 Aug 18 11:28:14.532392 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9071fe95-e975-4fb6-88ae-e92bd1e2c5e4 req-735b66bf-27c2-4c24-8c13-9afc7594243a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053950 Aug 18 11:28:14.533432 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 383/782] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:14.539153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-29fd3bf7-5561-43b3-9f6d-004244bb122f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:14.540054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-29fd3bf7-5561-43b3-9f6d-004244bb122f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:14.547925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29fd3bf7-5561-43b3-9f6d-004244bb122f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:14.548704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29fd3bf7-5561-43b3-9f6d-004244bb122f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:14.549504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29fd3bf7-5561-43b3-9f6d-004244bb122f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:14.551580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29fd3bf7-5561-43b3-9f6d-004244bb122f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:14.553017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29fd3bf7-5561-43b3-9f6d-004244bb122f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:14.553994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29fd3bf7-5561-43b3-9f6d-004244bb122f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:14.803723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-29fd3bf7-5561-43b3-9f6d-004244bb122f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:14.811342 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-29fd3bf7-5561-43b3-9f6d-004244bb122f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1504 microversion: 2.1 time: 0.276569 Aug 18 11:28:14.811934 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 384/783] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:14 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:14.816653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0f40dfe9-9860-471b-9f1e-65f023ca094e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:14.817814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0f40dfe9-9860-471b-9f1e-65f023ca094e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:14.823884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f40dfe9-9860-471b-9f1e-65f023ca094e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:14.824552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f40dfe9-9860-471b-9f1e-65f023ca094e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:14.824989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f40dfe9-9860-471b-9f1e-65f023ca094e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:14.825685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f40dfe9-9860-471b-9f1e-65f023ca094e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:14.826131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f40dfe9-9860-471b-9f1e-65f023ca094e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:14.826771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f40dfe9-9860-471b-9f1e-65f023ca094e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:14.909524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0f40dfe9-9860-471b-9f1e-65f023ca094e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:14.917725 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0f40dfe9-9860-471b-9f1e-65f023ca094e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1275 microversion: 2.1 time: 0.104557 Aug 18 11:28:14.918952 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 385/784] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:14 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1275 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:14.931011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f2edaead-d2ab-45ec-929d-4acd88a26e8f req-647abd99-10e1-4e72-91b9-8f33c9c3c42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab517b76-7996-4c12-a108-d3fb97b955c4", "name": "network-vif-deleted", "tag": "6d45270a-1cd6-41f0-9fa9-232d93d36b38"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:14.945042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f2edaead-d2ab-45ec-929d-4acd88a26e8f req-647abd99-10e1-4e72-91b9-8f33c9c3c42f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:14.945517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f2edaead-d2ab-45ec-929d-4acd88a26e8f req-647abd99-10e1-4e72-91b9-8f33c9c3c42f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:14.946130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f2edaead-d2ab-45ec-929d-4acd88a26e8f req-647abd99-10e1-4e72-91b9-8f33c9c3c42f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:14.961053 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f2edaead-d2ab-45ec-929d-4acd88a26e8f req-647abd99-10e1-4e72-91b9-8f33c9c3c42f service nova] Creating event network-vif-deleted:6d45270a-1cd6-41f0-9fa9-232d93d36b38 for instance ab517b76-7996-4c12-a108-d3fb97b955c4 on n-h1-853611-3 Aug 18 11:28:14.966219 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f2edaead-d2ab-45ec-929d-4acd88a26e8f req-647abd99-10e1-4e72-91b9-8f33c9c3c42f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038755 Aug 18 11:28:14.967385 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 386/785] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:14.987293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-501aa1fb-ae55-42f1-bd87-5c67c7ccf758 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:14.988178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-501aa1fb-ae55-42f1-bd87-5c67c7ccf758 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:14.995686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501aa1fb-ae55-42f1-bd87-5c67c7ccf758 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:14.996237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501aa1fb-ae55-42f1-bd87-5c67c7ccf758 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:14.996670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501aa1fb-ae55-42f1-bd87-5c67c7ccf758 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:14.997367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501aa1fb-ae55-42f1-bd87-5c67c7ccf758 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:14.998146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501aa1fb-ae55-42f1-bd87-5c67c7ccf758 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:14.999388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501aa1fb-ae55-42f1-bd87-5c67c7ccf758 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:15.054351 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bd367b63-4b17-47a2-92fb-ca32d60dfb03 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/c2ba0444-fcd6-4fe8-a373-1a024950f810" status: 202 len: 0 microversion: 2.1 time: 3.102316 Aug 18 11:28:15.058556 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 400/786] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:28:11 2022] DELETE /compute/v2.1/os-floating-ips/c2ba0444-fcd6-4fe8-a373-1a024950f810 => generated 0 bytes in 3104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:28:15.064774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2989b809-168f-4136-af36-633c06a62436 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:15.065282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2989b809-168f-4136-af36-633c06a62436 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:15.073804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2989b809-168f-4136-af36-633c06a62436 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:15.074336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2989b809-168f-4136-af36-633c06a62436 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:15.074816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2989b809-168f-4136-af36-633c06a62436 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:15.075523 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2989b809-168f-4136-af36-633c06a62436 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:15.075982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2989b809-168f-4136-af36-633c06a62436 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:15.076611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2989b809-168f-4136-af36-633c06a62436 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:15.099894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-501aa1fb-ae55-42f1-bd87-5c67c7ccf758 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7308ed12063b4326942c235e39582be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fb2484544849ab8ad1dbb6dec06f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:15.118603 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-501aa1fb-ae55-42f1-bd87-5c67c7ccf758 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 200 len: 1500 microversion: 2.1 time: 0.137033 Aug 18 11:28:15.134722 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 387/787] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:14 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 1500 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:28:15.134952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2989b809-168f-4136-af36-633c06a62436 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:28:15.139741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-152da9b6-fa17-4211-926f-7c9e546b208d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:15.140380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-152da9b6-fa17-4211-926f-7c9e546b208d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:15.154239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-152da9b6-fa17-4211-926f-7c9e546b208d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:15.155514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-152da9b6-fa17-4211-926f-7c9e546b208d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:15.156083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-152da9b6-fa17-4211-926f-7c9e546b208d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:15.157449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-152da9b6-fa17-4211-926f-7c9e546b208d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:15.157449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-152da9b6-fa17-4211-926f-7c9e546b208d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:15.157782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-152da9b6-fa17-4211-926f-7c9e546b208d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:15.277003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-152da9b6-fa17-4211-926f-7c9e546b208d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:15.287681 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2989b809-168f-4136-af36-633c06a62436 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 204 len: 0 microversion: 2.1 time: 0.226608 Aug 18 11:28:15.288284 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 401/788] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:28:15 2022] DELETE /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:28:15.298100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c75ac616-da81-4421-8198-82c91c92c3c6 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:15.298822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c75ac616-da81-4421-8198-82c91c92c3c6 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:15.300249 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-152da9b6-fa17-4211-926f-7c9e546b208d tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.171873 Aug 18 11:28:15.314535 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 388/789] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:15 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:15.315027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c75ac616-da81-4421-8198-82c91c92c3c6 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:15.315027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c75ac616-da81-4421-8198-82c91c92c3c6 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:15.315027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c75ac616-da81-4421-8198-82c91c92c3c6 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:15.315027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c75ac616-da81-4421-8198-82c91c92c3c6 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:15.315364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c75ac616-da81-4421-8198-82c91c92c3c6 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:15.315364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c75ac616-da81-4421-8198-82c91c92c3c6 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:15.445018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1245238192", "imageRef": "de6f0d03-de68-4a40-8619-d603573779fb", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8205b2e9-2897-4b9b-aaa8-3bb35eca89ae"}], "security_groups": [{"name": "tempest-securitygroup--1181945865"}], "key_name": "tempest-keypair-1145292547", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:15.609942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] validate_networks() for [('8205b2e9-2897-4b9b-aaa8-3bb35eca89ae', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:28:15.690843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c75ac616-da81-4421-8198-82c91c92c3c6 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:15.708849 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c75ac616-da81-4421-8198-82c91c92c3c6 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1525 microversion: 2.1 time: 0.415662 Aug 18 11:28:15.709821 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 402/790] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:15 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1525 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:15.730679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e7b11d95-c487-4b07-b66c-df017190f3ee tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:15.731846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e7b11d95-c487-4b07-b66c-df017190f3ee tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:15.739327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7b11d95-c487-4b07-b66c-df017190f3ee tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:15.739831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7b11d95-c487-4b07-b66c-df017190f3ee tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:15.740278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7b11d95-c487-4b07-b66c-df017190f3ee tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:15.740993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7b11d95-c487-4b07-b66c-df017190f3ee tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:15.741752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7b11d95-c487-4b07-b66c-df017190f3ee tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:15.742349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7b11d95-c487-4b07-b66c-df017190f3ee tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:16.066998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e7b11d95-c487-4b07-b66c-df017190f3ee tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:16.085950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e7b11d95-c487-4b07-b66c-df017190f3ee tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:16.101587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e7b11d95-c487-4b07-b66c-df017190f3ee tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:16.104796 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e7b11d95-c487-4b07-b66c-df017190f3ee tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1362 microversion: 2.25 time: 0.393192 Aug 18 11:28:16.107252 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 403/791] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:15 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1362 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:16.127465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e8ec248b-724e-4cbe-9c1c-ce35fa98b4b5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:16.128448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e8ec248b-724e-4cbe-9c1c-ce35fa98b4b5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:16.140639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8ec248b-724e-4cbe-9c1c-ce35fa98b4b5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:16.141413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8ec248b-724e-4cbe-9c1c-ce35fa98b4b5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:16.142986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8ec248b-724e-4cbe-9c1c-ce35fa98b4b5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:16.145066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8ec248b-724e-4cbe-9c1c-ce35fa98b4b5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:16.145703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8ec248b-724e-4cbe-9c1c-ce35fa98b4b5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:16.146287 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8ec248b-724e-4cbe-9c1c-ce35fa98b4b5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:16.358563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e8ec248b-724e-4cbe-9c1c-ce35fa98b4b5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:16.369465 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e8ec248b-724e-4cbe-9c1c-ce35fa98b4b5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1504 microversion: 2.1 time: 0.255107 Aug 18 11:28:16.370616 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 404/792] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:16 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:16.376410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-08355ad5-414e-40ab-9f81-4fb9e4a312be tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:16.377240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-08355ad5-414e-40ab-9f81-4fb9e4a312be tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:16.388031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08355ad5-414e-40ab-9f81-4fb9e4a312be tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:16.388519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08355ad5-414e-40ab-9f81-4fb9e4a312be tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:16.388983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08355ad5-414e-40ab-9f81-4fb9e4a312be tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:16.389717 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08355ad5-414e-40ab-9f81-4fb9e4a312be tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:16.390315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08355ad5-414e-40ab-9f81-4fb9e4a312be tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:16.390927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08355ad5-414e-40ab-9f81-4fb9e4a312be tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:16.428808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:28:16.429491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:28:16.430122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:28:16.430766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:28:16.431173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:28:16.443617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:16.444392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:16.445126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:16.446013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:16.446669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:16.447254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:16.469728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Getting quotas for project ccfa07bf92894fb0918418f997c3c149. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:28:16.477361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Getting quotas for user 82883babd8814c4283e80c11881a67fd and project ccfa07bf92894fb0918418f997c3c149. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:28:16.481005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:16.502711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:28:16.505176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de6f0d03-de68-4a40-8619-d603573779fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:28:16.556422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-08355ad5-414e-40ab-9f81-4fb9e4a312be tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:16.565914 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-08355ad5-414e-40ab-9f81-4fb9e4a312be tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1317 microversion: 2.1 time: 0.194062 Aug 18 11:28:16.567336 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 405/793] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:16 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:16.573641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5540bd40-a028-453b-8c53-fe194dc46aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:16.574621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5540bd40-a028-453b-8c53-fe194dc46aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] [instance: ab517b76-7996-4c12-a108-d3fb97b955c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:16.582573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5540bd40-a028-453b-8c53-fe194dc46aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:16.584015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5540bd40-a028-453b-8c53-fe194dc46aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:16.584716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5540bd40-a028-453b-8c53-fe194dc46aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:16.586120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5540bd40-a028-453b-8c53-fe194dc46aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:16.586366 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-25d7a3c8-28ba-4b1e-897f-8261bc26b3f4 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.142846 Aug 18 11:28:16.587071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5540bd40-a028-453b-8c53-fe194dc46aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:16.587848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5540bd40-a028-453b-8c53-fe194dc46aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:16.590520 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 389/794] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:28:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:28:16.609053 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-5540bd40-a028-453b-8c53-fe194dc46aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] HTTP exception thrown: Instance ab517b76-7996-4c12-a108-d3fb97b955c4 could not be found. Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5540bd40-a028-453b-8c53-fe194dc46aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Request method failure captured: Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 HTTP/1.1 Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iIJ-gC8YzQZA0Tvzm09uQMCaMsu9Opx0YTbWPe8pItpq9BQxn0eE2rjmTGpdW8fbqateCwqfeuXj5dEUWWov-y1dlx55irBOLN7e9mjmIZ564qlHDqOM8JiYJz9PW8yPm9vkp0D8zvg-21Lk2pvDig6-1QNtb-FPt30UmnhcyM0UuI Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 05fb2484544849ab8ad1dbb6dec06f65 Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:28:16.611220 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:28:16.612620 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/05fb2484544849ab8ad1dbb6dec06f65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:16.612620 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:28:16.612620 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 05fb2484544849ab8ad1dbb6dec06f65 Aug 18 11:28:16.612620 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 Aug 18 11:28:16.612620 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project Aug 18 11:28:16.612620 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:28:16.612620 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:28:16.612620 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7308ed12063b4326942c235e39582be5 Aug 18 11:28:16.612620 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project Aug 18 11:28:16.612620 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:28:16.612620 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance ab517b76-7996-4c12-a108-d3fb97b955c4 could not be found. Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'ab517b76-7996-4c12-a108-d3fb97b955c4'} Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab517b76-7996-4c12-a108-d3fb97b955c4 could not be found. Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:16.613741 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab517b76-7996-4c12-a108-d3fb97b955c4 could not be found. Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab517b76-7996-4c12-a108-d3fb97b955c4 could not be found. Aug 18 11:28:16.615033 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:16.616185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-b0ce7666-35e1-4713-8847-eef311ac26cb req-92e04c44-ff4b-45da-8eeb-c29dc2807fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe68694-3a7c-41cb-b2f2-1f25d8648218", "tag": "ed0c5302-2b34-44c1-a1e3-e5121abc35f0"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:16.618190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5540bd40-a028-453b-8c53-fe194dc46aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] Returning 404 to user: Instance ab517b76-7996-4c12-a108-d3fb97b955c4 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:16.627586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b0ce7666-35e1-4713-8847-eef311ac26cb req-92e04c44-ff4b-45da-8eeb-c29dc2807fee service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:16.628284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b0ce7666-35e1-4713-8847-eef311ac26cb req-92e04c44-ff4b-45da-8eeb-c29dc2807fee service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:16.630097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b0ce7666-35e1-4713-8847-eef311ac26cb req-92e04c44-ff4b-45da-8eeb-c29dc2807fee service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:16.634584 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5540bd40-a028-453b-8c53-fe194dc46aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374 tempest-FloatingIPsAssociationNegativeTestJSON-1764798374-project] 10.222.0.73 "GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4" status: 404 len: 111 microversion: 2.1 time: 0.062635 Aug 18 11:28:16.635633 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 406/795] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:16 2022] GET /compute/v2.1/servers/ab517b76-7996-4c12-a108-d3fb97b955c4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:16.644069 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-b0ce7666-35e1-4713-8847-eef311ac26cb req-92e04c44-ff4b-45da-8eeb-c29dc2807fee service nova] Creating event network-changed:ed0c5302-2b34-44c1-a1e3-e5121abc35f0 for instance ffe68694-3a7c-41cb-b2f2-1f25d8648218 on n-h2-853611-3 Aug 18 11:28:16.646628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-53fdb900-be06-432a-bda3-973b9da9deef tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:16.647369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-53fdb900-be06-432a-bda3-973b9da9deef tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:16.650849 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-b0ce7666-35e1-4713-8847-eef311ac26cb req-92e04c44-ff4b-45da-8eeb-c29dc2807fee service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059083 Aug 18 11:28:16.651944 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 390/796] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:16.660251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7c200af2-e5f4-45c9-a1d0-ffba2d067aa6 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:16.661145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7c200af2-e5f4-45c9-a1d0-ffba2d067aa6 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:16.662812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53fdb900-be06-432a-bda3-973b9da9deef tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:16.665834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53fdb900-be06-432a-bda3-973b9da9deef tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:16.666415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53fdb900-be06-432a-bda3-973b9da9deef tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:16.667264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53fdb900-be06-432a-bda3-973b9da9deef tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:16.669744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53fdb900-be06-432a-bda3-973b9da9deef tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:16.671054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53fdb900-be06-432a-bda3-973b9da9deef tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:16.777002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c200af2-e5f4-45c9-a1d0-ffba2d067aa6 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:16.788643 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7c200af2-e5f4-45c9-a1d0-ffba2d067aa6 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1246 microversion: 2.1 time: 0.133778 Aug 18 11:28:16.789244 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 391/797] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:16 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1246 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:16.802357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-68902d20-d4fa-4984-948e-78250fddeb2b tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:16.802357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-68902d20-d4fa-4984-948e-78250fddeb2b tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:16.830977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68902d20-d4fa-4984-948e-78250fddeb2b tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:16.834725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68902d20-d4fa-4984-948e-78250fddeb2b tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:16.834972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68902d20-d4fa-4984-948e-78250fddeb2b tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:16.835719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68902d20-d4fa-4984-948e-78250fddeb2b tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:16.836177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68902d20-d4fa-4984-948e-78250fddeb2b tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:16.847137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68902d20-d4fa-4984-948e-78250fddeb2b tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:17.175806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:17.192108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-68902d20-d4fa-4984-948e-78250fddeb2b tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:17.194981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-53fdb900-be06-432a-bda3-973b9da9deef tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:17.203502 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-68902d20-d4fa-4984-948e-78250fddeb2b tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1525 microversion: 2.1 time: 0.413187 Aug 18 11:28:17.205401 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 392/798] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:16 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1525 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:17.221883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8bbf76e3-ed36-4fcf-b15e-1a84c05a4596 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:17.222527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8bbf76e3-ed36-4fcf-b15e-1a84c05a4596 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:17.226653 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-53fdb900-be06-432a-bda3-973b9da9deef tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.589732 Aug 18 11:28:17.239041 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 407/799] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:16 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:17.243100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bbf76e3-ed36-4fcf-b15e-1a84c05a4596 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:17.243521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bbf76e3-ed36-4fcf-b15e-1a84c05a4596 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:17.244156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bbf76e3-ed36-4fcf-b15e-1a84c05a4596 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:17.244872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bbf76e3-ed36-4fcf-b15e-1a84c05a4596 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:17.249782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bbf76e3-ed36-4fcf-b15e-1a84c05a4596 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:17.250565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bbf76e3-ed36-4fcf-b15e-1a84c05a4596 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:17.395990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3d9da057-e217-4f1e-b913-68e3f0cf7052 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:17.396914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3d9da057-e217-4f1e-b913-68e3f0cf7052 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:17.424153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d9da057-e217-4f1e-b913-68e3f0cf7052 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:17.424682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d9da057-e217-4f1e-b913-68e3f0cf7052 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:17.425128 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d9da057-e217-4f1e-b913-68e3f0cf7052 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:17.425927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d9da057-e217-4f1e-b913-68e3f0cf7052 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:17.426398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d9da057-e217-4f1e-b913-68e3f0cf7052 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:17.426870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d9da057-e217-4f1e-b913-68e3f0cf7052 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:17.626919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8bbf76e3-ed36-4fcf-b15e-1a84c05a4596 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:17.639306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8bbf76e3-ed36-4fcf-b15e-1a84c05a4596 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:17.643097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8bbf76e3-ed36-4fcf-b15e-1a84c05a4596 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:17.645356 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8bbf76e3-ed36-4fcf-b15e-1a84c05a4596 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1559 microversion: 2.25 time: 0.439828 Aug 18 11:28:17.658233 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 393/800] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:17 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1559 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:17.669368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b3498af0-7b76-4c0f-bb8e-646016b4467d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:17.671023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b3498af0-7b76-4c0f-bb8e-646016b4467d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:17.679387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3498af0-7b76-4c0f-bb8e-646016b4467d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:17.680975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3498af0-7b76-4c0f-bb8e-646016b4467d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:17.681670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3498af0-7b76-4c0f-bb8e-646016b4467d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:17.682679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3498af0-7b76-4c0f-bb8e-646016b4467d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:17.683412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3498af0-7b76-4c0f-bb8e-646016b4467d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:17.685256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3498af0-7b76-4c0f-bb8e-646016b4467d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:17.875361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3d9da057-e217-4f1e-b913-68e3f0cf7052 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:17.898637 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3d9da057-e217-4f1e-b913-68e3f0cf7052 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1504 microversion: 2.1 time: 0.498493 Aug 18 11:28:17.900273 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 408/801] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:17 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1504 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:17.904015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2d38dd2b-f399-40b2-b3b6-2d54c69c4e1a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:17.905400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2d38dd2b-f399-40b2-b3b6-2d54c69c4e1a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:17.920135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d38dd2b-f399-40b2-b3b6-2d54c69c4e1a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:17.920658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d38dd2b-f399-40b2-b3b6-2d54c69c4e1a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:17.921125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d38dd2b-f399-40b2-b3b6-2d54c69c4e1a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:17.921802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d38dd2b-f399-40b2-b3b6-2d54c69c4e1a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:17.922257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d38dd2b-f399-40b2-b3b6-2d54c69c4e1a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:17.922718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d38dd2b-f399-40b2-b3b6-2d54c69c4e1a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:18.388425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b3498af0-7b76-4c0f-bb8e-646016b4467d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:18.406565 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b3498af0-7b76-4c0f-bb8e-646016b4467d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1317 microversion: 2.1 time: 0.740830 Aug 18 11:28:18.410619 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 394/802] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:17 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:18.415688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c7023b2e-f77f-4699-b860-e3fb0aaee9c3 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:18.428802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c7023b2e-f77f-4699-b860-e3fb0aaee9c3 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:18.437569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7023b2e-f77f-4699-b860-e3fb0aaee9c3 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:18.438530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7023b2e-f77f-4699-b860-e3fb0aaee9c3 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:18.439899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7023b2e-f77f-4699-b860-e3fb0aaee9c3 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:18.441281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7023b2e-f77f-4699-b860-e3fb0aaee9c3 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:18.442011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7023b2e-f77f-4699-b860-e3fb0aaee9c3 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:18.442648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7023b2e-f77f-4699-b860-e3fb0aaee9c3 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:18.528820 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-2d38dd2b-f399-40b2-b3b6-2d54c69c4e1a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 2e802eca-675c-4376-8bdb-666b223637db {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:18.552600 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2d38dd2b-f399-40b2-b3b6-2d54c69c4e1a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 2052 microversion: 2.25 time: 0.652014 Aug 18 11:28:18.553366 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 409/803] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:17 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 2052 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:18.559444 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1d5b4053-79b6-4686-982f-24b729fe31e3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:18.560442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1d5b4053-79b6-4686-982f-24b729fe31e3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:18.567600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d5b4053-79b6-4686-982f-24b729fe31e3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:18.568428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d5b4053-79b6-4686-982f-24b729fe31e3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:18.569108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d5b4053-79b6-4686-982f-24b729fe31e3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:18.572901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d5b4053-79b6-4686-982f-24b729fe31e3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:18.573801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d5b4053-79b6-4686-982f-24b729fe31e3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:18.574469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d5b4053-79b6-4686-982f-24b729fe31e3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:18.579185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c7023b2e-f77f-4699-b860-e3fb0aaee9c3 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:18.595449 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c7023b2e-f77f-4699-b860-e3fb0aaee9c3 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1316 microversion: 2.1 time: 0.183347 Aug 18 11:28:18.598050 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 395/804] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:18 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:18.609627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb509ea6-76ee-444a-80ef-c4012712a481 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:18.609627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bb509ea6-76ee-444a-80ef-c4012712a481 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:18.617944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb509ea6-76ee-444a-80ef-c4012712a481 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:18.618691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb509ea6-76ee-444a-80ef-c4012712a481 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:18.619306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb509ea6-76ee-444a-80ef-c4012712a481 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:18.620442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb509ea6-76ee-444a-80ef-c4012712a481 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:18.621200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb509ea6-76ee-444a-80ef-c4012712a481 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:18.621765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb509ea6-76ee-444a-80ef-c4012712a481 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:18.738739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-bb509ea6-76ee-444a-80ef-c4012712a481 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:18.763415 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bb509ea6-76ee-444a-80ef-c4012712a481 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.163993 Aug 18 11:28:18.764348 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 396/805] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:18 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:18.783582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d24984e-a29f-41ac-9deb-0b1feef3e10a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:18.784223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2d24984e-a29f-41ac-9deb-0b1feef3e10a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:18.792956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d24984e-a29f-41ac-9deb-0b1feef3e10a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:18.795642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d24984e-a29f-41ac-9deb-0b1feef3e10a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:18.797049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d24984e-a29f-41ac-9deb-0b1feef3e10a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:18.798581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d24984e-a29f-41ac-9deb-0b1feef3e10a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:18.799785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d24984e-a29f-41ac-9deb-0b1feef3e10a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:18.800732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d24984e-a29f-41ac-9deb-0b1feef3e10a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:19.103183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1d5b4053-79b6-4686-982f-24b729fe31e3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb875d64a00b43448f7e3b7492e9086b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fa95f956304a9bb1b34ddf82adac1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:19.121986 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1d5b4053-79b6-4686-982f-24b729fe31e3 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 200 len: 1525 microversion: 2.1 time: 0.567021 Aug 18 11:28:19.122994 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 410/806] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:18 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 1525 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:19.145683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2099892e-f76a-4e64-aa2a-91e630b5e828 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:19.147406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2099892e-f76a-4e64-aa2a-91e630b5e828 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:19.171374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2099892e-f76a-4e64-aa2a-91e630b5e828 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:19.172274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2099892e-f76a-4e64-aa2a-91e630b5e828 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:19.183381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2099892e-f76a-4e64-aa2a-91e630b5e828 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:19.184496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2099892e-f76a-4e64-aa2a-91e630b5e828 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:19.185161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2099892e-f76a-4e64-aa2a-91e630b5e828 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:19.186070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2099892e-f76a-4e64-aa2a-91e630b5e828 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:19.578903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-2d24984e-a29f-41ac-9deb-0b1feef3e10a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 2e802eca-675c-4376-8bdb-666b223637db {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:19.613444 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d24984e-a29f-41ac-9deb-0b1feef3e10a tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 2052 microversion: 2.25 time: 0.847642 Aug 18 11:28:19.627038 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 397/807] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:18 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 2052 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:19.639281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-316dbf76-a363-4517-a7bd-59f317a0f449 req-1ad8c75b-4961-4519-b2e0-3daa61618133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a472fced-51fc-469b-a37a-38f98e725169", "name": "network-vif-deleted", "tag": "dbe58053-eed9-48a6-bec0-79d514d08be6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:19.701869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-316dbf76-a363-4517-a7bd-59f317a0f449 req-1ad8c75b-4961-4519-b2e0-3daa61618133 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:19.703086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-316dbf76-a363-4517-a7bd-59f317a0f449 req-1ad8c75b-4961-4519-b2e0-3daa61618133 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:19.703754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-316dbf76-a363-4517-a7bd-59f317a0f449 req-1ad8c75b-4961-4519-b2e0-3daa61618133 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:19.761038 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-316dbf76-a363-4517-a7bd-59f317a0f449 req-1ad8c75b-4961-4519-b2e0-3daa61618133 service nova] Creating event network-vif-deleted:dbe58053-eed9-48a6-bec0-79d514d08be6 for instance a472fced-51fc-469b-a37a-38f98e725169 on n-h2-853611-3 Aug 18 11:28:19.780316 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-316dbf76-a363-4517-a7bd-59f317a0f449 req-1ad8c75b-4961-4519-b2e0-3daa61618133 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148057 Aug 18 11:28:19.781953 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 398/808] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:19.792224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac19dff0-c07f-41dc-94ff-cebb262ad17e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:19.797159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ac19dff0-c07f-41dc-94ff-cebb262ad17e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:19.823367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac19dff0-c07f-41dc-94ff-cebb262ad17e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:19.826049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2099892e-f76a-4e64-aa2a-91e630b5e828 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:19.830464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac19dff0-c07f-41dc-94ff-cebb262ad17e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:19.836955 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2099892e-f76a-4e64-aa2a-91e630b5e828 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1504 microversion: 2.1 time: 0.712288 Aug 18 11:28:19.838297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac19dff0-c07f-41dc-94ff-cebb262ad17e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:19.843199 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 411/809] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:19 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1504 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:19.844259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac19dff0-c07f-41dc-94ff-cebb262ad17e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:19.844993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac19dff0-c07f-41dc-94ff-cebb262ad17e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:19.845441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac19dff0-c07f-41dc-94ff-cebb262ad17e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:19.855150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4edd9b9f-c602-424c-a2f2-cbfd931dc788 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:19.866474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4edd9b9f-c602-424c-a2f2-cbfd931dc788 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:19.897576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4edd9b9f-c602-424c-a2f2-cbfd931dc788 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:19.906564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4edd9b9f-c602-424c-a2f2-cbfd931dc788 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:19.911058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4edd9b9f-c602-424c-a2f2-cbfd931dc788 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:19.911944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4edd9b9f-c602-424c-a2f2-cbfd931dc788 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:19.912567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4edd9b9f-c602-424c-a2f2-cbfd931dc788 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:19.913096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4edd9b9f-c602-424c-a2f2-cbfd931dc788 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:20.477175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ac19dff0-c07f-41dc-94ff-cebb262ad17e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:20.500524 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ac19dff0-c07f-41dc-94ff-cebb262ad17e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1317 microversion: 2.1 time: 0.715934 Aug 18 11:28:20.517995 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 399/810] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:19 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1317 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:20.528117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-267aaa39-1b84-43aa-b5b8-187e0f013ccb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:20.532050 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:20.532050 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:28:20.534456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-267aaa39-1b84-43aa-b5b8-187e0f013ccb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:20.535190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-267aaa39-1b84-43aa-b5b8-187e0f013ccb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:20.536150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-267aaa39-1b84-43aa-b5b8-187e0f013ccb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:20.540485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-267aaa39-1b84-43aa-b5b8-187e0f013ccb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:20.541813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-267aaa39-1b84-43aa-b5b8-187e0f013ccb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:20.542613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-267aaa39-1b84-43aa-b5b8-187e0f013ccb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:20.550986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4edd9b9f-c602-424c-a2f2-cbfd931dc788 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:20.560836 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4edd9b9f-c602-424c-a2f2-cbfd931dc788 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1304 microversion: 2.1 time: 0.716097 Aug 18 11:28:20.564144 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 412/811] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:19 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1304 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:20.569908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d27250ff-f2fc-4c35-ba32-246bb1d0d0fb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:20.578788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d27250ff-f2fc-4c35-ba32-246bb1d0d0fb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:20.595791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d27250ff-f2fc-4c35-ba32-246bb1d0d0fb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:20.596555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d27250ff-f2fc-4c35-ba32-246bb1d0d0fb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:20.597174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d27250ff-f2fc-4c35-ba32-246bb1d0d0fb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:20.598542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d27250ff-f2fc-4c35-ba32-246bb1d0d0fb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:20.599269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d27250ff-f2fc-4c35-ba32-246bb1d0d0fb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:20.601080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d27250ff-f2fc-4c35-ba32-246bb1d0d0fb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:20.601746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:20.604216 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-267aaa39-1b84-43aa-b5b8-187e0f013ccb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.084327 Aug 18 11:28:20.605484 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 400/812] 10.222.0.73 () {60 vars in 1217 bytes} [Thu Aug 18 11:28:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:28:20.612211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59a2602c-18b3-4b61-bf1a-6279c10c5523 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:20.613965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59a2602c-18b3-4b61-bf1a-6279c10c5523 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] [instance: a472fced-51fc-469b-a37a-38f98e725169] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:20.629864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59a2602c-18b3-4b61-bf1a-6279c10c5523 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:20.630688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59a2602c-18b3-4b61-bf1a-6279c10c5523 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:20.631388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59a2602c-18b3-4b61-bf1a-6279c10c5523 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:20.632880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59a2602c-18b3-4b61-bf1a-6279c10c5523 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:20.633565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59a2602c-18b3-4b61-bf1a-6279c10c5523 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:20.634154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59a2602c-18b3-4b61-bf1a-6279c10c5523 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:20.662125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:20.665639 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-59a2602c-18b3-4b61-bf1a-6279c10c5523 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] HTTP exception thrown: Instance a472fced-51fc-469b-a37a-38f98e725169 could not be found. Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59a2602c-18b3-4b61-bf1a-6279c10c5523 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Request method failure captured: Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 HTTP/1.1 Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iH1HzuxqQ6j0uhKbmg3JejqPZd4bkgpQKgMhaLXOzaPQXnR4TiIXmbC6NxQBI3FJTSo34hMYCGF_o04GCcf6uq9Qe1GjhvYX9PKvpvDYzToKaqgpwH2E_Ialg9v7epSrEyjNDa-_-8xwAIHx-urMgnMMJA5da75Idxuy39tiu52IGY Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: d1fa95f956304a9bb1b34ddf82adac1a Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-330777573 Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:28:20.667513 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:28:20.669075 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d1fa95f956304a9bb1b34ddf82adac1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:20.669075 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-330777573 Aug 18 11:28:20.669075 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: d1fa95f956304a9bb1b34ddf82adac1a Aug 18 11:28:20.669075 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-330777573 Aug 18 11:28:20.669075 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FloatingIPsAssociationTestJSON-330777573-project Aug 18 11:28:20.669075 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:28:20.669075 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:28:20.669075 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: eb875d64a00b43448f7e3b7492e9086b Aug 18 11:28:20.669075 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-330777573-project Aug 18 11:28:20.669075 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:28:20.669075 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance a472fced-51fc-469b-a37a-38f98e725169 could not be found. Aug 18 11:28:20.669075 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'a472fced-51fc-469b-a37a-38f98e725169'} Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a472fced-51fc-469b-a37a-38f98e725169 could not be found. Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:20.670569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a472fced-51fc-469b-a37a-38f98e725169 could not be found. Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a472fced-51fc-469b-a37a-38f98e725169 could not be found. Aug 18 11:28:20.671820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:20.679747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59a2602c-18b3-4b61-bf1a-6279c10c5523 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] Returning 404 to user: Instance a472fced-51fc-469b-a37a-38f98e725169 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:20.681326 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59a2602c-18b3-4b61-bf1a-6279c10c5523 tempest-FloatingIPsAssociationTestJSON-330777573 tempest-FloatingIPsAssociationTestJSON-330777573-project] 10.222.0.73 "GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169" status: 404 len: 111 microversion: 2.1 time: 0.074661 Aug 18 11:28:20.688506 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 401/813] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:20 2022] GET /compute/v2.1/servers/a472fced-51fc-469b-a37a-38f98e725169 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:20.694056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b644c39-492a-4ca8-9f4f-be3093552b29 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:20.695612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1b644c39-492a-4ca8-9f4f-be3093552b29 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:20.704445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b644c39-492a-4ca8-9f4f-be3093552b29 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:20.705241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b644c39-492a-4ca8-9f4f-be3093552b29 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:20.706159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b644c39-492a-4ca8-9f4f-be3093552b29 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:20.707366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b644c39-492a-4ca8-9f4f-be3093552b29 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:20.708046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b644c39-492a-4ca8-9f4f-be3093552b29 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:20.708904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b644c39-492a-4ca8-9f4f-be3093552b29 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:20.805934 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1b644c39-492a-4ca8-9f4f-be3093552b29 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db/action" status: 202 len: 0 microversion: 2.25 time: 0.113944 Aug 18 11:28:20.808202 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 402/814] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 18 11:28:20 2022] POST /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:28:20.824401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c00abc8-47b5-43f6-9a82-0dfdf1fadebb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:20.826201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c00abc8-47b5-43f6-9a82-0dfdf1fadebb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:20.847365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c00abc8-47b5-43f6-9a82-0dfdf1fadebb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:20.850475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c00abc8-47b5-43f6-9a82-0dfdf1fadebb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:20.851134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c00abc8-47b5-43f6-9a82-0dfdf1fadebb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:20.853311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c00abc8-47b5-43f6-9a82-0dfdf1fadebb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:20.855410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c00abc8-47b5-43f6-9a82-0dfdf1fadebb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:20.856700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c00abc8-47b5-43f6-9a82-0dfdf1fadebb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:20.870710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-d27250ff-f2fc-4c35-ba32-246bb1d0d0fb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:20.921876 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d27250ff-f2fc-4c35-ba32-246bb1d0d0fb tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.356420 Aug 18 11:28:20.927292 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 413/815] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:20 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:20.932721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4d4a48d6-cc54-4eeb-88ea-6d67d0e91d21 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:20.935170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:20.941519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4d4a48d6-cc54-4eeb-88ea-6d67d0e91d21 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:20.948760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d4a48d6-cc54-4eeb-88ea-6d67d0e91d21 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:20.962476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d4a48d6-cc54-4eeb-88ea-6d67d0e91d21 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:20.963353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d4a48d6-cc54-4eeb-88ea-6d67d0e91d21 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:20.964446 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d4a48d6-cc54-4eeb-88ea-6d67d0e91d21 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:20.966328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d4a48d6-cc54-4eeb-88ea-6d67d0e91d21 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:20.967958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d4a48d6-cc54-4eeb-88ea-6d67d0e91d21 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:21.695200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-9c00abc8-47b5-43f6-9a82-0dfdf1fadebb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 2e802eca-675c-4376-8bdb-666b223637db {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:21.757855 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c00abc8-47b5-43f6-9a82-0dfdf1fadebb tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 2057 microversion: 2.25 time: 0.942140 Aug 18 11:28:21.776996 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 403/816] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:20 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 2057 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:21.789418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cafb195f-09b7-44fa-956d-96c1ea162679 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:21.790348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cafb195f-09b7-44fa-956d-96c1ea162679 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:21.819124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cafb195f-09b7-44fa-956d-96c1ea162679 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:21.822561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cafb195f-09b7-44fa-956d-96c1ea162679 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:21.823212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cafb195f-09b7-44fa-956d-96c1ea162679 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:21.826783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cafb195f-09b7-44fa-956d-96c1ea162679 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:21.827794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cafb195f-09b7-44fa-956d-96c1ea162679 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:21.828470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cafb195f-09b7-44fa-956d-96c1ea162679 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:22.305911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cafb195f-09b7-44fa-956d-96c1ea162679 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:22.318462 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cafb195f-09b7-44fa-956d-96c1ea162679 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1317 microversion: 2.1 time: 0.539939 Aug 18 11:28:22.326414 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 404/817] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:21 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1317 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:22.332881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-81e79ea6-1c6a-4416-94a7-6110775a4419 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:22.336942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-81e79ea6-1c6a-4416-94a7-6110775a4419 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:22.352975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81e79ea6-1c6a-4416-94a7-6110775a4419 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:22.353475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81e79ea6-1c6a-4416-94a7-6110775a4419 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:22.353925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81e79ea6-1c6a-4416-94a7-6110775a4419 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:22.354675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81e79ea6-1c6a-4416-94a7-6110775a4419 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:22.355142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81e79ea6-1c6a-4416-94a7-6110775a4419 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:22.355573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81e79ea6-1c6a-4416-94a7-6110775a4419 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:22.777159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4d4a48d6-cc54-4eeb-88ea-6d67d0e91d21 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:22.804065 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4d4a48d6-cc54-4eeb-88ea-6d67d0e91d21 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1504 microversion: 2.1 time: 1.874876 Aug 18 11:28:22.805522 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 414/818] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:20 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1504 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:22.813229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-e39b9c1d-e891-41d5-9d74-a214fe8883e2 req-28d54171-9aa7-41f8-a3b5-0f18b1094ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "818423b1-1334-4de8-8565-99bdd45f4b98", "tag": "ce7cab84-d1c6-479e-93a0-1485bcbbe863"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:22.840075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e39b9c1d-e891-41d5-9d74-a214fe8883e2 req-28d54171-9aa7-41f8-a3b5-0f18b1094ba8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:22.840478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e39b9c1d-e891-41d5-9d74-a214fe8883e2 req-28d54171-9aa7-41f8-a3b5-0f18b1094ba8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:22.840913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e39b9c1d-e891-41d5-9d74-a214fe8883e2 req-28d54171-9aa7-41f8-a3b5-0f18b1094ba8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:22.855335 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-e39b9c1d-e891-41d5-9d74-a214fe8883e2 req-28d54171-9aa7-41f8-a3b5-0f18b1094ba8 service nova] Creating event network-changed:ce7cab84-d1c6-479e-93a0-1485bcbbe863 for instance 818423b1-1334-4de8-8565-99bdd45f4b98 on n-h2-853611-3 Aug 18 11:28:22.862795 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-e39b9c1d-e891-41d5-9d74-a214fe8883e2 req-28d54171-9aa7-41f8-a3b5-0f18b1094ba8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054934 Aug 18 11:28:22.864226 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 415/819] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:22.873913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c3e4addc-5557-406b-ac55-8c22f6f2fc6e tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:22.876885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c3e4addc-5557-406b-ac55-8c22f6f2fc6e tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:22.886134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3e4addc-5557-406b-ac55-8c22f6f2fc6e tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:22.887061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3e4addc-5557-406b-ac55-8c22f6f2fc6e tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:22.887886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3e4addc-5557-406b-ac55-8c22f6f2fc6e tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:22.889631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3e4addc-5557-406b-ac55-8c22f6f2fc6e tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:22.890359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3e4addc-5557-406b-ac55-8c22f6f2fc6e tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:22.891062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c3e4addc-5557-406b-ac55-8c22f6f2fc6e tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:23.063903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-c3e4addc-5557-406b-ac55-8c22f6f2fc6e tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:23.109509 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c3e4addc-5557-406b-ac55-8c22f6f2fc6e tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.242644 Aug 18 11:28:23.112014 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 416/820] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:22 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:23.117649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-46dd8bce-efa4-4483-a660-2f1b21f1fd35 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:23.118620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-46dd8bce-efa4-4483-a660-2f1b21f1fd35 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:23.128645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46dd8bce-efa4-4483-a660-2f1b21f1fd35 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:23.129720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46dd8bce-efa4-4483-a660-2f1b21f1fd35 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:23.130635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46dd8bce-efa4-4483-a660-2f1b21f1fd35 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:23.131840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46dd8bce-efa4-4483-a660-2f1b21f1fd35 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:23.132608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46dd8bce-efa4-4483-a660-2f1b21f1fd35 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:23.133309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46dd8bce-efa4-4483-a660-2f1b21f1fd35 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:23.369885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-81e79ea6-1c6a-4416-94a7-6110775a4419 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:23.378813 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-81e79ea6-1c6a-4416-94a7-6110775a4419 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1372 microversion: 2.1 time: 1.050927 Aug 18 11:28:23.379481 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 405/821] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:22 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1372 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:23.401556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f192c4c8-5bc1-4ffb-a7e3-9086a3f13bba tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:23.402182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f192c4c8-5bc1-4ffb-a7e3-9086a3f13bba tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:23.409842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f192c4c8-5bc1-4ffb-a7e3-9086a3f13bba tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:23.410394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f192c4c8-5bc1-4ffb-a7e3-9086a3f13bba tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:23.411454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f192c4c8-5bc1-4ffb-a7e3-9086a3f13bba tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:23.412326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f192c4c8-5bc1-4ffb-a7e3-9086a3f13bba tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:23.412794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f192c4c8-5bc1-4ffb-a7e3-9086a3f13bba tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:23.413987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f192c4c8-5bc1-4ffb-a7e3-9086a3f13bba tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:23.789536 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-46dd8bce-efa4-4483-a660-2f1b21f1fd35 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 2e802eca-675c-4376-8bdb-666b223637db {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:23.826406 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-46dd8bce-efa4-4483-a660-2f1b21f1fd35 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 2037 microversion: 2.25 time: 0.712828 Aug 18 11:28:23.829624 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 417/822] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:23 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 2037 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:23.870863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1b41b045-6985-4042-a7ee-71719a17269c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:23.871992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1b41b045-6985-4042-a7ee-71719a17269c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:23.882388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b41b045-6985-4042-a7ee-71719a17269c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:23.883169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b41b045-6985-4042-a7ee-71719a17269c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:23.883761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b41b045-6985-4042-a7ee-71719a17269c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:23.884623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b41b045-6985-4042-a7ee-71719a17269c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:23.885677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b41b045-6985-4042-a7ee-71719a17269c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:23.886260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b41b045-6985-4042-a7ee-71719a17269c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:23.938383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f192c4c8-5bc1-4ffb-a7e3-9086a3f13bba tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:23.949040 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f192c4c8-5bc1-4ffb-a7e3-9086a3f13bba tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1317 microversion: 2.1 time: 0.556881 Aug 18 11:28:23.949839 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 406/823] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:23 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:23.979381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7e0b011-32b7-4b98-b8bf-f9d4d52a38d2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-853611-3", "block_migration": "auto"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:23.982514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e7e0b011-32b7-4b98-b8bf-f9d4d52a38d2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:23.998938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7e0b011-32b7-4b98-b8bf-f9d4d52a38d2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:23.999438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7e0b011-32b7-4b98-b8bf-f9d4d52a38d2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:24.000146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7e0b011-32b7-4b98-b8bf-f9d4d52a38d2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:24.000666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7e0b011-32b7-4b98-b8bf-f9d4d52a38d2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:24.001161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7e0b011-32b7-4b98-b8bf-f9d4d52a38d2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:24.001594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7e0b011-32b7-4b98-b8bf-f9d4d52a38d2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:24.046767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-e7e0b011-32b7-4b98-b8bf-f9d4d52a38d2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'flavor' on Instance uuid 2e802eca-675c-4376-8bdb-666b223637db {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:24.063339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e7e0b011-32b7-4b98-b8bf-f9d4d52a38d2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Going to try to live migrate instance to n-h2-853611-3 {{(pid=122210) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 18 11:28:24.778445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1b41b045-6985-4042-a7ee-71719a17269c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:24.827315 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1b41b045-6985-4042-a7ee-71719a17269c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1504 microversion: 2.1 time: 0.972656 Aug 18 11:28:24.839181 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 418/824] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:23 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1504 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:24.846122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-766058ae-d05b-4247-a092-3d9ed1af1cfa tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:24.854926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-766058ae-d05b-4247-a092-3d9ed1af1cfa tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:24.871917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-766058ae-d05b-4247-a092-3d9ed1af1cfa tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:24.879018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-766058ae-d05b-4247-a092-3d9ed1af1cfa tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:24.879516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-766058ae-d05b-4247-a092-3d9ed1af1cfa tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:24.887430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-766058ae-d05b-4247-a092-3d9ed1af1cfa tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:24.888595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-766058ae-d05b-4247-a092-3d9ed1af1cfa tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:24.888595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-766058ae-d05b-4247-a092-3d9ed1af1cfa tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:25.394530 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-766058ae-d05b-4247-a092-3d9ed1af1cfa tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:25.473823 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-766058ae-d05b-4247-a092-3d9ed1af1cfa tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.641715 Aug 18 11:28:25.475215 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 419/825] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:24 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:25.501033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3e37de7f-0908-4387-81f5-ad9df40c0966 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:25.506592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3e37de7f-0908-4387-81f5-ad9df40c0966 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:25.551365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e37de7f-0908-4387-81f5-ad9df40c0966 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:25.553059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e37de7f-0908-4387-81f5-ad9df40c0966 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:25.559225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e37de7f-0908-4387-81f5-ad9df40c0966 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:25.564838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e37de7f-0908-4387-81f5-ad9df40c0966 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:25.569720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e37de7f-0908-4387-81f5-ad9df40c0966 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:25.570806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e37de7f-0908-4387-81f5-ad9df40c0966 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:26.781722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:26.895295 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3e37de7f-0908-4387-81f5-ad9df40c0966 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:26.924996 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3e37de7f-0908-4387-81f5-ad9df40c0966 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1372 microversion: 2.1 time: 1.430873 Aug 18 11:28:26.927119 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 420/826] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:25 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1372 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:26.946799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c11ffff8-4b6c-4be9-b23d-e5f1be1e4778 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:26.951198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c11ffff8-4b6c-4be9-b23d-e5f1be1e4778 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:26.975547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c11ffff8-4b6c-4be9-b23d-e5f1be1e4778 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:26.976613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c11ffff8-4b6c-4be9-b23d-e5f1be1e4778 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:26.984457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c11ffff8-4b6c-4be9-b23d-e5f1be1e4778 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:26.987919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c11ffff8-4b6c-4be9-b23d-e5f1be1e4778 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:26.994720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c11ffff8-4b6c-4be9-b23d-e5f1be1e4778 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:26.997206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c11ffff8-4b6c-4be9-b23d-e5f1be1e4778 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:27.955698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c11ffff8-4b6c-4be9-b23d-e5f1be1e4778 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:27.963872 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c11ffff8-4b6c-4be9-b23d-e5f1be1e4778 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1317 microversion: 2.1 time: 1.035100 Aug 18 11:28:27.964465 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 421/827] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:26 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1317 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:27.998874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-75426062-07db-4d8b-a7be-82b7454400dc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:28.008176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-75426062-07db-4d8b-a7be-82b7454400dc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:28.036244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75426062-07db-4d8b-a7be-82b7454400dc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:28.037141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75426062-07db-4d8b-a7be-82b7454400dc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:28.040418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75426062-07db-4d8b-a7be-82b7454400dc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:28.041426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75426062-07db-4d8b-a7be-82b7454400dc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:28.042837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75426062-07db-4d8b-a7be-82b7454400dc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:28.043468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75426062-07db-4d8b-a7be-82b7454400dc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:28.411525 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e7e0b011-32b7-4b98-b8bf-f9d4d52a38d2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db/action" status: 202 len: 0 microversion: 2.25 time: 4.442344 Aug 18 11:28:28.416126 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 407/828] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 18 11:28:23 2022] POST /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db/action => generated 0 bytes in 4466 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:28:28.422941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-31e679b6-9e63-4ca6-8bc6-edbd5a22b6ae tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:28.443124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-31e679b6-9e63-4ca6-8bc6-edbd5a22b6ae tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:28.477498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e679b6-9e63-4ca6-8bc6-edbd5a22b6ae tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:28.480162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e679b6-9e63-4ca6-8bc6-edbd5a22b6ae tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:28.481016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e679b6-9e63-4ca6-8bc6-edbd5a22b6ae tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:28.483369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e679b6-9e63-4ca6-8bc6-edbd5a22b6ae tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:28.486655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e679b6-9e63-4ca6-8bc6-edbd5a22b6ae tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:28.487389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e679b6-9e63-4ca6-8bc6-edbd5a22b6ae tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:28.644106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-75426062-07db-4d8b-a7be-82b7454400dc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:28.657091 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-75426062-07db-4d8b-a7be-82b7454400dc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1504 microversion: 2.1 time: 0.676056 Aug 18 11:28:28.657991 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 422/829] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:27 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1504 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:28.669895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-5ec7ef8b-5ac1-41f2-8ef3-b694416c0c7f req-63a933a4-3e4a-48f8-90f0-72b86bfc44f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c90c1672-67f6-4f31-84b5-695115309d3d", "tag": "e16903bb-2ff8-4682-86db-5e9d462b751b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:28.690323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5ec7ef8b-5ac1-41f2-8ef3-b694416c0c7f req-63a933a4-3e4a-48f8-90f0-72b86bfc44f8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:28.691113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5ec7ef8b-5ac1-41f2-8ef3-b694416c0c7f req-63a933a4-3e4a-48f8-90f0-72b86bfc44f8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:28.691726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5ec7ef8b-5ac1-41f2-8ef3-b694416c0c7f req-63a933a4-3e4a-48f8-90f0-72b86bfc44f8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:28.696141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:28.717652 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5ec7ef8b-5ac1-41f2-8ef3-b694416c0c7f req-63a933a4-3e4a-48f8-90f0-72b86bfc44f8 service nova] Creating event network-changed:e16903bb-2ff8-4682-86db-5e9d462b751b for instance c90c1672-67f6-4f31-84b5-695115309d3d on n-h1-853611-3 Aug 18 11:28:28.736289 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-5ec7ef8b-5ac1-41f2-8ef3-b694416c0c7f req-63a933a4-3e4a-48f8-90f0-72b86bfc44f8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076766 Aug 18 11:28:28.737529 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 423/830] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:28.742890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-de0eed78-38bf-42e9-af72-34e51adce45c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:28.744361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-de0eed78-38bf-42e9-af72-34e51adce45c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:28.757938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de0eed78-38bf-42e9-af72-34e51adce45c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:28.768147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de0eed78-38bf-42e9-af72-34e51adce45c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:28.768904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de0eed78-38bf-42e9-af72-34e51adce45c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:28.769834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de0eed78-38bf-42e9-af72-34e51adce45c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:28.770474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de0eed78-38bf-42e9-af72-34e51adce45c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:28.771106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de0eed78-38bf-42e9-af72-34e51adce45c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:28.848644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-31e679b6-9e63-4ca6-8bc6-edbd5a22b6ae tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:28.970070 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-31e679b6-9e63-4ca6-8bc6-edbd5a22b6ae tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1929 microversion: 2.75 time: 0.550490 Aug 18 11:28:28.975062 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 408/831] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:28 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1929 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:28.994997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-639e9346-83e5-4cb8-87ab-0d7304b9e447 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:28.995647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-639e9346-83e5-4cb8-87ab-0d7304b9e447 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:29.030754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-639e9346-83e5-4cb8-87ab-0d7304b9e447 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:29.032361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-639e9346-83e5-4cb8-87ab-0d7304b9e447 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:29.033974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-639e9346-83e5-4cb8-87ab-0d7304b9e447 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:29.037981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-639e9346-83e5-4cb8-87ab-0d7304b9e447 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:29.038817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-639e9346-83e5-4cb8-87ab-0d7304b9e447 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:29.039458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-639e9346-83e5-4cb8-87ab-0d7304b9e447 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:29.160073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-de0eed78-38bf-42e9-af72-34e51adce45c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:29.173216 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-de0eed78-38bf-42e9-af72-34e51adce45c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1372 microversion: 2.1 time: 0.434281 Aug 18 11:28:29.186934 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 424/832] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:28 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1372 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:29.192058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-58ec7dcf-f222-4220-a53a-3d9dad01948e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:29.192887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-58ec7dcf-f222-4220-a53a-3d9dad01948e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:29.199293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58ec7dcf-f222-4220-a53a-3d9dad01948e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:29.200101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58ec7dcf-f222-4220-a53a-3d9dad01948e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:29.201280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58ec7dcf-f222-4220-a53a-3d9dad01948e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:29.202332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58ec7dcf-f222-4220-a53a-3d9dad01948e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:29.203082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58ec7dcf-f222-4220-a53a-3d9dad01948e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:29.203650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58ec7dcf-f222-4220-a53a-3d9dad01948e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:29.729826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-58ec7dcf-f222-4220-a53a-3d9dad01948e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:29.745020 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-58ec7dcf-f222-4220-a53a-3d9dad01948e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1317 microversion: 2.1 time: 0.556625 Aug 18 11:28:29.764113 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 425/833] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:29 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:29.776010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-80d61cc1-f4e5-4a30-9d7f-6266c765dfd5 req-ccfda9ec-d8c9-4b9b-b6b9-5b55f2c5add7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818423b1-1334-4de8-8565-99bdd45f4b98", "name": "network-vif-plugged", "status": "completed", "tag": "ce7cab84-d1c6-479e-93a0-1485bcbbe863"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:29.795269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-80d61cc1-f4e5-4a30-9d7f-6266c765dfd5 req-ccfda9ec-d8c9-4b9b-b6b9-5b55f2c5add7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:29.796057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-80d61cc1-f4e5-4a30-9d7f-6266c765dfd5 req-ccfda9ec-d8c9-4b9b-b6b9-5b55f2c5add7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:29.796664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-80d61cc1-f4e5-4a30-9d7f-6266c765dfd5 req-ccfda9ec-d8c9-4b9b-b6b9-5b55f2c5add7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:29.815107 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-80d61cc1-f4e5-4a30-9d7f-6266c765dfd5 req-ccfda9ec-d8c9-4b9b-b6b9-5b55f2c5add7 service nova] Creating event network-vif-plugged:ce7cab84-d1c6-479e-93a0-1485bcbbe863 for instance 818423b1-1334-4de8-8565-99bdd45f4b98 on n-h2-853611-3 Aug 18 11:28:29.840687 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-80d61cc1-f4e5-4a30-9d7f-6266c765dfd5 req-ccfda9ec-d8c9-4b9b-b6b9-5b55f2c5add7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074767 Aug 18 11:28:29.841865 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 426/834] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:29.873462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f6ea8d58-1d2c-4bec-8247-3473dcc7314a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:29.874209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f6ea8d58-1d2c-4bec-8247-3473dcc7314a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:29.888662 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6ea8d58-1d2c-4bec-8247-3473dcc7314a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:29.889176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6ea8d58-1d2c-4bec-8247-3473dcc7314a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:29.889703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6ea8d58-1d2c-4bec-8247-3473dcc7314a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:29.890509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6ea8d58-1d2c-4bec-8247-3473dcc7314a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:29.890952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6ea8d58-1d2c-4bec-8247-3473dcc7314a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:29.891380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6ea8d58-1d2c-4bec-8247-3473dcc7314a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:30.043748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-639e9346-83e5-4cb8-87ab-0d7304b9e447 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:30.054649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-639e9346-83e5-4cb8-87ab-0d7304b9e447 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:30.061253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-639e9346-83e5-4cb8-87ab-0d7304b9e447 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:30.067204 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-639e9346-83e5-4cb8-87ab-0d7304b9e447 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1569 microversion: 2.25 time: 1.090792 Aug 18 11:28:30.069206 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 409/835] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:28 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1569 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:30.081357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-681ab666-e079-4a8c-a8c5-b034bfd88113 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:30.082470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-681ab666-e079-4a8c-a8c5-b034bfd88113 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:30.099644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-681ab666-e079-4a8c-a8c5-b034bfd88113 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:30.101281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-681ab666-e079-4a8c-a8c5-b034bfd88113 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:30.105604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-681ab666-e079-4a8c-a8c5-b034bfd88113 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:30.107469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-681ab666-e079-4a8c-a8c5-b034bfd88113 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:30.108140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-681ab666-e079-4a8c-a8c5-b034bfd88113 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:30.108739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-681ab666-e079-4a8c-a8c5-b034bfd88113 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:30.410460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-681ab666-e079-4a8c-a8c5-b034bfd88113 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:30.470393 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-681ab666-e079-4a8c-a8c5-b034bfd88113 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1935 microversion: 2.75 time: 0.399087 Aug 18 11:28:30.471716 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 410/836] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:30 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1935 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:30.477667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0cba022d-88a2-4ec0-892d-655a76b38125 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:30.478641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0cba022d-88a2-4ec0-892d-655a76b38125 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:30.508438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cba022d-88a2-4ec0-892d-655a76b38125 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:30.510362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cba022d-88a2-4ec0-892d-655a76b38125 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:30.511378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cba022d-88a2-4ec0-892d-655a76b38125 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:30.514731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cba022d-88a2-4ec0-892d-655a76b38125 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:30.516643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cba022d-88a2-4ec0-892d-655a76b38125 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:30.517460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cba022d-88a2-4ec0-892d-655a76b38125 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:30.559047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:30.564497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f6ea8d58-1d2c-4bec-8247-3473dcc7314a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:30.576191 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f6ea8d58-1d2c-4bec-8247-3473dcc7314a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1494 microversion: 2.1 time: 0.716495 Aug 18 11:28:30.602278 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 427/837] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:29 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1494 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:30.628627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-87e12c43-67a8-444c-b3c6-1ac6470358af tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '.version_select at 0x7f51ac166040>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:30.641401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87e12c43-67a8-444c-b3c6-1ac6470358af tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:30.642614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87e12c43-67a8-444c-b3c6-1ac6470358af tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:30.643657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87e12c43-67a8-444c-b3c6-1ac6470358af tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:30.672997 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-87e12c43-67a8-444c-b3c6-1ac6470358af tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.062177 Aug 18 11:28:30.686776 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 428/838] 10.222.0.73 () {58 vars in 1143 bytes} [Thu Aug 18 11:28:30 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:30.692401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ca99d228-25c5-49c3-b0be-0d835e5e958a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:30.693360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ca99d228-25c5-49c3-b0be-0d835e5e958a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:30.705117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca99d228-25c5-49c3-b0be-0d835e5e958a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:30.705979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca99d228-25c5-49c3-b0be-0d835e5e958a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:30.706649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca99d228-25c5-49c3-b0be-0d835e5e958a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:30.708398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca99d228-25c5-49c3-b0be-0d835e5e958a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:30.709166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca99d228-25c5-49c3-b0be-0d835e5e958a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:30.709824 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca99d228-25c5-49c3-b0be-0d835e5e958a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:31.053750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0cba022d-88a2-4ec0-892d-655a76b38125 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:31.072740 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0cba022d-88a2-4ec0-892d-655a76b38125 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1372 microversion: 2.1 time: 0.599680 Aug 18 11:28:31.086965 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 411/839] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:30 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1372 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:31.093341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d6b192c2-2f60-4b77-8b81-a3e1b5b47ffa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:31.094165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d6b192c2-2f60-4b77-8b81-a3e1b5b47ffa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:31.112665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6b192c2-2f60-4b77-8b81-a3e1b5b47ffa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:31.118019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6b192c2-2f60-4b77-8b81-a3e1b5b47ffa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:31.118780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6b192c2-2f60-4b77-8b81-a3e1b5b47ffa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:31.119717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6b192c2-2f60-4b77-8b81-a3e1b5b47ffa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:31.120506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6b192c2-2f60-4b77-8b81-a3e1b5b47ffa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:31.121137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6b192c2-2f60-4b77-8b81-a3e1b5b47ffa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:31.594512 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ca99d228-25c5-49c3-b0be-0d835e5e958a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1645 microversion: 2.1 time: 0.906167 Aug 18 11:28:31.598747 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 429/840] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:30 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1645 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:31.609484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-28011ff9-8013-4f56-a5b6-ff3ba828e94f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:31.621034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-28011ff9-8013-4f56-a5b6-ff3ba828e94f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:31.629051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28011ff9-8013-4f56-a5b6-ff3ba828e94f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:31.630224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28011ff9-8013-4f56-a5b6-ff3ba828e94f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:31.630941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28011ff9-8013-4f56-a5b6-ff3ba828e94f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:31.631919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28011ff9-8013-4f56-a5b6-ff3ba828e94f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:31.632920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28011ff9-8013-4f56-a5b6-ff3ba828e94f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:31.633791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28011ff9-8013-4f56-a5b6-ff3ba828e94f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:31.644012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d6b192c2-2f60-4b77-8b81-a3e1b5b47ffa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:31.652909 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d6b192c2-2f60-4b77-8b81-a3e1b5b47ffa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1317 microversion: 2.1 time: 0.564477 Aug 18 11:28:31.654247 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 412/841] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:31 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:31.706294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ad56ab4e-a8ad-4a65-b1b1-efd2df4f9524 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:31.707567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ad56ab4e-a8ad-4a65-b1b1-efd2df4f9524 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:31.728853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad56ab4e-a8ad-4a65-b1b1-efd2df4f9524 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:31.729459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad56ab4e-a8ad-4a65-b1b1-efd2df4f9524 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:31.730261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad56ab4e-a8ad-4a65-b1b1-efd2df4f9524 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:31.733815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad56ab4e-a8ad-4a65-b1b1-efd2df4f9524 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:31.734580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad56ab4e-a8ad-4a65-b1b1-efd2df4f9524 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:31.735207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad56ab4e-a8ad-4a65-b1b1-efd2df4f9524 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:31.923178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-ad56ab4e-a8ad-4a65-b1b1-efd2df4f9524 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:31.958248 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ad56ab4e-a8ad-4a65-b1b1-efd2df4f9524 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1935 microversion: 2.75 time: 0.302883 Aug 18 11:28:31.959259 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 413/842] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:31 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1935 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:31.964287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1365490475", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "e8f8f2ff-7601-4fd1-9ee3-58fd8a4e9af3"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:32.047328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] validate_networks() for [('e8f8f2ff-7601-4fd1-9ee3-58fd8a4e9af3', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:28:32.389629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-28011ff9-8013-4f56-a5b6-ff3ba828e94f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:32.405248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-28011ff9-8013-4f56-a5b6-ff3ba828e94f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:32.407777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-28011ff9-8013-4f56-a5b6-ff3ba828e94f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:32.409225 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-28011ff9-8013-4f56-a5b6-ff3ba828e94f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1569 microversion: 2.25 time: 0.809369 Aug 18 11:28:32.412179 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 430/843] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:31 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1569 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:32.428784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-09748338-5482-4405-9c21-46ec415fc557 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:32.429676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-09748338-5482-4405-9c21-46ec415fc557 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:32.439765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09748338-5482-4405-9c21-46ec415fc557 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:32.440640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09748338-5482-4405-9c21-46ec415fc557 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:32.441313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09748338-5482-4405-9c21-46ec415fc557 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:32.443039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09748338-5482-4405-9c21-46ec415fc557 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:32.443725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09748338-5482-4405-9c21-46ec415fc557 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:32.444431 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09748338-5482-4405-9c21-46ec415fc557 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:33.109745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:28:33.110761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:28:33.111423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:28:33.111887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:28:33.112242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:28:33.121438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:33.123278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:33.123910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:33.124849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:33.125461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:33.126059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:33.134601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-09748338-5482-4405-9c21-46ec415fc557 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:33.147815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Getting quotas for project 22660df6ec1a4f718a08cbeda2be364c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:28:33.154657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Getting quotas for user 0cf7fe4236764bea83c6560516441759 and project 22660df6ec1a4f718a08cbeda2be364c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:28:33.169906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:28:33.172590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:28:33.188159 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-09748338-5482-4405-9c21-46ec415fc557 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1372 microversion: 2.1 time: 0.768442 Aug 18 11:28:33.189484 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 431/844] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:32 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1372 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:33.212383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5aebd7ba-e15c-440d-be2f-f359d207ab5e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:33.214357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5aebd7ba-e15c-440d-be2f-f359d207ab5e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:33.225979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5aebd7ba-e15c-440d-be2f-f359d207ab5e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:33.226877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5aebd7ba-e15c-440d-be2f-f359d207ab5e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:33.228302 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5aebd7ba-e15c-440d-be2f-f359d207ab5e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:33.229364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5aebd7ba-e15c-440d-be2f-f359d207ab5e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:33.230058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5aebd7ba-e15c-440d-be2f-f359d207ab5e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:33.230737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5aebd7ba-e15c-440d-be2f-f359d207ab5e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:33.269398 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cf95a1f2-c86f-40e6-897d-5c5703a6440f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.308872 Aug 18 11:28:33.276318 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 414/845] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:28:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:28:33.281437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-42bd0b53-3eb0-4b77-8427-72e2629b4805 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:33.282060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-42bd0b53-3eb0-4b77-8427-72e2629b4805 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:33.306756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42bd0b53-3eb0-4b77-8427-72e2629b4805 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:33.307320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42bd0b53-3eb0-4b77-8427-72e2629b4805 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:33.307981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42bd0b53-3eb0-4b77-8427-72e2629b4805 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:33.309191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42bd0b53-3eb0-4b77-8427-72e2629b4805 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:33.310993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42bd0b53-3eb0-4b77-8427-72e2629b4805 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:33.311619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42bd0b53-3eb0-4b77-8427-72e2629b4805 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:33.591127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-42bd0b53-3eb0-4b77-8427-72e2629b4805 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] Lazy-loading 'services' on Instance uuid cac86391-bd27-4b0c-96d0-ee8f67c516b4 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:33.652158 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-42bd0b53-3eb0-4b77-8427-72e2629b4805 tempest-ServersAdmin275Test-1515724354 tempest-ServersAdmin275Test-1515724354-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1920 microversion: 2.75 time: 0.374618 Aug 18 11:28:33.655044 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 415/846] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:33 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1920 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:33.669979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8dfcef26-ebe3-4adc-9dd3-557ca698ca09 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:33.670790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8dfcef26-ebe3-4adc-9dd3-557ca698ca09 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:33.724984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5aebd7ba-e15c-440d-be2f-f359d207ab5e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:33.740318 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5aebd7ba-e15c-440d-be2f-f359d207ab5e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1317 microversion: 2.1 time: 0.530616 Aug 18 11:28:33.742569 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 432/847] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:33 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:33.754418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ab3ce506-8acf-4be9-bf22-577a628ebc83 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:33.756627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ab3ce506-8acf-4be9-bf22-577a628ebc83 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:33.769765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab3ce506-8acf-4be9-bf22-577a628ebc83 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:33.791202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab3ce506-8acf-4be9-bf22-577a628ebc83 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:33.791784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab3ce506-8acf-4be9-bf22-577a628ebc83 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:33.795581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab3ce506-8acf-4be9-bf22-577a628ebc83 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:33.799548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab3ce506-8acf-4be9-bf22-577a628ebc83 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:33.801571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab3ce506-8acf-4be9-bf22-577a628ebc83 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:33.872227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8dfcef26-ebe3-4adc-9dd3-557ca698ca09 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:33.879696 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8dfcef26-ebe3-4adc-9dd3-557ca698ca09 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1211 microversion: 2.1 time: 0.223386 Aug 18 11:28:33.880752 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 416/848] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:33 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1211 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:33.904064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d91a00ab-73a5-4ba0-ba0c-8665c6f0a00b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:33.904832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d91a00ab-73a5-4ba0-ba0c-8665c6f0a00b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:33.913157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d91a00ab-73a5-4ba0-ba0c-8665c6f0a00b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:33.914190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d91a00ab-73a5-4ba0-ba0c-8665c6f0a00b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:33.914893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d91a00ab-73a5-4ba0-ba0c-8665c6f0a00b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:33.915872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d91a00ab-73a5-4ba0-ba0c-8665c6f0a00b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:33.916871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d91a00ab-73a5-4ba0-ba0c-8665c6f0a00b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:33.917600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d91a00ab-73a5-4ba0-ba0c-8665c6f0a00b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:33.973328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d91a00ab-73a5-4ba0-ba0c-8665c6f0a00b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:28:33.977372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:34.147405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:34.194563 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d91a00ab-73a5-4ba0-ba0c-8665c6f0a00b tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "DELETE /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 204 len: 0 microversion: 2.75 time: 0.298061 Aug 18 11:28:34.201157 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 417/849] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:28:33 2022] DELETE /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:28:34.211155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-38803c5c-dd34-414a-bb52-65033ff52847 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:34.211819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-38803c5c-dd34-414a-bb52-65033ff52847 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:34.264044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38803c5c-dd34-414a-bb52-65033ff52847 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:34.272469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38803c5c-dd34-414a-bb52-65033ff52847 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:34.275085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38803c5c-dd34-414a-bb52-65033ff52847 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:34.275860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38803c5c-dd34-414a-bb52-65033ff52847 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:34.276344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38803c5c-dd34-414a-bb52-65033ff52847 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:34.276781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38803c5c-dd34-414a-bb52-65033ff52847 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:34.332581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ab3ce506-8acf-4be9-bf22-577a628ebc83 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:34.343902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ab3ce506-8acf-4be9-bf22-577a628ebc83 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:34.352062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ab3ce506-8acf-4be9-bf22-577a628ebc83 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:34.355508 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ab3ce506-8acf-4be9-bf22-577a628ebc83 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1569 microversion: 2.25 time: 0.611457 Aug 18 11:28:34.360059 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 433/850] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:33 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1569 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:34.365489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-246fd63b-8117-4e3e-a4e8-8a1daa88cb42 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:34.371493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-246fd63b-8117-4e3e-a4e8-8a1daa88cb42 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:34.388813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-246fd63b-8117-4e3e-a4e8-8a1daa88cb42 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:34.389324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-246fd63b-8117-4e3e-a4e8-8a1daa88cb42 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:34.389767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-246fd63b-8117-4e3e-a4e8-8a1daa88cb42 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:34.390703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-246fd63b-8117-4e3e-a4e8-8a1daa88cb42 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:34.395085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-246fd63b-8117-4e3e-a4e8-8a1daa88cb42 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:34.395764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-246fd63b-8117-4e3e-a4e8-8a1daa88cb42 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:34.658127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-38803c5c-dd34-414a-bb52-65033ff52847 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:34.666821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-38803c5c-dd34-414a-bb52-65033ff52847 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:34.668338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-38803c5c-dd34-414a-bb52-65033ff52847 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:34.716383 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-38803c5c-dd34-414a-bb52-65033ff52847 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1444 microversion: 2.75 time: 0.513424 Aug 18 11:28:34.734971 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 418/851] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:34 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1444 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:34.766287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5077d149-51b0-449b-bc90-22ddd4c9807a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:34.767306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5077d149-51b0-449b-bc90-22ddd4c9807a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:34.780583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5077d149-51b0-449b-bc90-22ddd4c9807a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:34.782406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5077d149-51b0-449b-bc90-22ddd4c9807a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:34.783107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5077d149-51b0-449b-bc90-22ddd4c9807a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:34.785031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5077d149-51b0-449b-bc90-22ddd4c9807a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:34.786416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5077d149-51b0-449b-bc90-22ddd4c9807a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:34.788575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5077d149-51b0-449b-bc90-22ddd4c9807a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:35.068730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-246fd63b-8117-4e3e-a4e8-8a1daa88cb42 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:35.079320 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-246fd63b-8117-4e3e-a4e8-8a1daa88cb42 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1372 microversion: 2.1 time: 0.717694 Aug 18 11:28:35.080139 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 434/852] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:34 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1372 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:35.094398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4ebfd253-c911-4cb4-a43b-edd7a4712172 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:35.096319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4ebfd253-c911-4cb4-a43b-edd7a4712172 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:35.111058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ebfd253-c911-4cb4-a43b-edd7a4712172 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:35.111952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ebfd253-c911-4cb4-a43b-edd7a4712172 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:35.112778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ebfd253-c911-4cb4-a43b-edd7a4712172 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:35.115406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ebfd253-c911-4cb4-a43b-edd7a4712172 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:35.116587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ebfd253-c911-4cb4-a43b-edd7a4712172 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:35.118628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ebfd253-c911-4cb4-a43b-edd7a4712172 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:35.243313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5077d149-51b0-449b-bc90-22ddd4c9807a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:35.259287 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5077d149-51b0-449b-bc90-22ddd4c9807a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1467 microversion: 2.1 time: 0.498080 Aug 18 11:28:35.267095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4ebfd253-c911-4cb4-a43b-edd7a4712172 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:35.274053 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 419/853] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:34 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1467 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:28:35.279512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-aff4fc8e-9902-444c-bb6d-6d2b32194804 req-38d94bb2-02d5-4339-9855-cc1245c616ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e802eca-675c-4376-8bdb-666b223637db", "name": "network-vif-unplugged", "status": "completed", "tag": "ac380441-814b-46b7-aff6-6a2c1648907c"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:35.289273 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4ebfd253-c911-4cb4-a43b-edd7a4712172 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1263 microversion: 2.1 time: 0.208056 Aug 18 11:28:35.289852 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 435/854] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:35 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1263 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:35.294748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-582ebaed-5386-429d-a4c8-c06a1ef8d69d tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:35.296728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-582ebaed-5386-429d-a4c8-c06a1ef8d69d tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:35.315786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aff4fc8e-9902-444c-bb6d-6d2b32194804 req-38d94bb2-02d5-4339-9855-cc1245c616ed service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:35.316270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aff4fc8e-9902-444c-bb6d-6d2b32194804 req-38d94bb2-02d5-4339-9855-cc1245c616ed service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:35.316701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aff4fc8e-9902-444c-bb6d-6d2b32194804 req-38d94bb2-02d5-4339-9855-cc1245c616ed service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:35.320257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-582ebaed-5386-429d-a4c8-c06a1ef8d69d tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:35.320757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-582ebaed-5386-429d-a4c8-c06a1ef8d69d tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:35.321195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-582ebaed-5386-429d-a4c8-c06a1ef8d69d tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:35.321913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-582ebaed-5386-429d-a4c8-c06a1ef8d69d tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:35.322368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-582ebaed-5386-429d-a4c8-c06a1ef8d69d tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:35.322819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-582ebaed-5386-429d-a4c8-c06a1ef8d69d tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:35.365304 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-aff4fc8e-9902-444c-bb6d-6d2b32194804 req-38d94bb2-02d5-4339-9855-cc1245c616ed service nova] Creating event network-vif-unplugged:ac380441-814b-46b7-aff6-6a2c1648907c for instance 2e802eca-675c-4376-8bdb-666b223637db on n-h1-853611-3 Aug 18 11:28:35.385731 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-aff4fc8e-9902-444c-bb6d-6d2b32194804 req-38d94bb2-02d5-4339-9855-cc1245c616ed service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101283 Aug 18 11:28:35.386719 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 420/855] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:35.392512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a17c4a6-04c1-499f-9417-6d720852a6c9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:35.393204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a17c4a6-04c1-499f-9417-6d720852a6c9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:35.427415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a17c4a6-04c1-499f-9417-6d720852a6c9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:35.428231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a17c4a6-04c1-499f-9417-6d720852a6c9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:35.430771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a17c4a6-04c1-499f-9417-6d720852a6c9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:35.431741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a17c4a6-04c1-499f-9417-6d720852a6c9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:35.434710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a17c4a6-04c1-499f-9417-6d720852a6c9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:35.435998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a17c4a6-04c1-499f-9417-6d720852a6c9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:36.170962 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-582ebaed-5386-429d-a4c8-c06a1ef8d69d tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1618 microversion: 2.1 time: 0.877271 Aug 18 11:28:36.172163 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 436/856] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:35 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1618 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:36.182258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-04f39c2b-e812-4a31-8679-a4132dc03ede tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:36.187295 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-04f39c2b-e812-4a31-8679-a4132dc03ede tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:36.196061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04f39c2b-e812-4a31-8679-a4132dc03ede tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:36.202196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04f39c2b-e812-4a31-8679-a4132dc03ede tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:36.202854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04f39c2b-e812-4a31-8679-a4132dc03ede tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:36.216390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04f39c2b-e812-4a31-8679-a4132dc03ede tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:36.217133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04f39c2b-e812-4a31-8679-a4132dc03ede tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:36.217748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04f39c2b-e812-4a31-8679-a4132dc03ede tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:36.369690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a17c4a6-04c1-499f-9417-6d720852a6c9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:36.384671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a17c4a6-04c1-499f-9417-6d720852a6c9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:36.391928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a17c4a6-04c1-499f-9417-6d720852a6c9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:36.393769 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a17c4a6-04c1-499f-9417-6d720852a6c9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1569 microversion: 2.25 time: 1.005247 Aug 18 11:28:36.393917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-04f39c2b-e812-4a31-8679-a4132dc03ede tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:36.394862 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 421/857] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:35 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1569 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:36.402105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-04f39c2b-e812-4a31-8679-a4132dc03ede tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:36.409949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9463c82c-edc0-482c-8140-c71db1b05e62 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:36.412253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9463c82c-edc0-482c-8140-c71db1b05e62 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:36.412798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-04f39c2b-e812-4a31-8679-a4132dc03ede tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7baeed1e70e94d3d8a85a8956e729b5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e76bbfd861bc4cf3883b953b17dded0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:36.419032 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-04f39c2b-e812-4a31-8679-a4132dc03ede tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 200 len: 1444 microversion: 2.75 time: 0.245380 Aug 18 11:28:36.419844 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 437/858] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:36 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 1444 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:36.428716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9463c82c-edc0-482c-8140-c71db1b05e62 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:36.428926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-675aea3d-7466-4fc3-9733-cce7e256f697 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:36.429415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-675aea3d-7466-4fc3-9733-cce7e256f697 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:36.431309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9463c82c-edc0-482c-8140-c71db1b05e62 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:36.431961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9463c82c-edc0-482c-8140-c71db1b05e62 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:36.437473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9463c82c-edc0-482c-8140-c71db1b05e62 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:36.438309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9463c82c-edc0-482c-8140-c71db1b05e62 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:36.439482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9463c82c-edc0-482c-8140-c71db1b05e62 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:36.439599 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-675aea3d-7466-4fc3-9733-cce7e256f697 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:36.451534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-675aea3d-7466-4fc3-9733-cce7e256f697 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:36.452069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-675aea3d-7466-4fc3-9733-cce7e256f697 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:36.454195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-675aea3d-7466-4fc3-9733-cce7e256f697 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:36.454850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-675aea3d-7466-4fc3-9733-cce7e256f697 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:36.455293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-675aea3d-7466-4fc3-9733-cce7e256f697 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:36.595443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-675aea3d-7466-4fc3-9733-cce7e256f697 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:36.605601 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-675aea3d-7466-4fc3-9733-cce7e256f697 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1281 microversion: 2.1 time: 0.184695 Aug 18 11:28:36.609541 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 438/859] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:36 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:36.692900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-582827678", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "3247ce04-df54-4bd8-a1e9-00a29d975b62"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:36.720344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:36.765112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9463c82c-edc0-482c-8140-c71db1b05e62 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:36.782735 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9463c82c-edc0-482c-8140-c71db1b05e62 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1372 microversion: 2.1 time: 0.381251 Aug 18 11:28:36.783370 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 422/860] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:36 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1372 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:36.807556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:28:36.997273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8cb60974-2a2f-4296-aec7-3b4f8050cb56 req-8ae0fdda-f320-4add-a1ba-3d40fc758d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90c1672-67f6-4f31-84b5-695115309d3d", "name": "network-vif-plugged", "status": "completed", "tag": "e16903bb-2ff8-4682-86db-5e9d462b751b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:37.023095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8cb60974-2a2f-4296-aec7-3b4f8050cb56 req-8ae0fdda-f320-4add-a1ba-3d40fc758d42 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:37.023698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8cb60974-2a2f-4296-aec7-3b4f8050cb56 req-8ae0fdda-f320-4add-a1ba-3d40fc758d42 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:37.025338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8cb60974-2a2f-4296-aec7-3b4f8050cb56 req-8ae0fdda-f320-4add-a1ba-3d40fc758d42 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:37.060371 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8cb60974-2a2f-4296-aec7-3b4f8050cb56 req-8ae0fdda-f320-4add-a1ba-3d40fc758d42 service nova] Creating event network-vif-plugged:e16903bb-2ff8-4682-86db-5e9d462b751b for instance c90c1672-67f6-4f31-84b5-695115309d3d on n-h1-853611-3 Aug 18 11:28:37.072250 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8cb60974-2a2f-4296-aec7-3b4f8050cb56 req-8ae0fdda-f320-4add-a1ba-3d40fc758d42 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084044 Aug 18 11:28:37.073275 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 423/861] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:28:37.401020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:28:37.402109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:28:37.403221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:28:37.403799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:28:37.404497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:28:37.419166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1762b42c-6373-4d3d-b8fe-1cb3d5364fb1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:37.419906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1762b42c-6373-4d3d-b8fe-1cb3d5364fb1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:37.438603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1762b42c-6373-4d3d-b8fe-1cb3d5364fb1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:37.439125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1762b42c-6373-4d3d-b8fe-1cb3d5364fb1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:37.439722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1762b42c-6373-4d3d-b8fe-1cb3d5364fb1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:37.442702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:37.442878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1762b42c-6373-4d3d-b8fe-1cb3d5364fb1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:37.443698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1762b42c-6373-4d3d-b8fe-1cb3d5364fb1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:37.444214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1762b42c-6373-4d3d-b8fe-1cb3d5364fb1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:37.447475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:37.447923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:37.448891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:37.450138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:37.450810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:37.470700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:28:37.477405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Getting quotas for user b75d06aa767c4f7799209c7d0fe23d2c and project b78bc9a4c5234460bfbe654bb068f79f. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:28:37.494817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:28:37.499367 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:28:37.565079 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2610f497-08f2-4038-ac51-32eb0e5fc73d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876016 Aug 18 11:28:37.566125 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 439/862] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:28:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:28:37.571847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fcb9dd28-d77a-417f-babe-55c9ae4b3fc4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:37.572754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fcb9dd28-d77a-417f-babe-55c9ae4b3fc4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] [instance: cac86391-bd27-4b0c-96d0-ee8f67c516b4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:37.580750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fcb9dd28-d77a-417f-babe-55c9ae4b3fc4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:37.581816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fcb9dd28-d77a-417f-babe-55c9ae4b3fc4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:37.582657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fcb9dd28-d77a-417f-babe-55c9ae4b3fc4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:37.583613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fcb9dd28-d77a-417f-babe-55c9ae4b3fc4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:37.584329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fcb9dd28-d77a-417f-babe-55c9ae4b3fc4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:37.584981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fcb9dd28-d77a-417f-babe-55c9ae4b3fc4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:37.604363 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-fcb9dd28-d77a-417f-babe-55c9ae4b3fc4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] HTTP exception thrown: Instance cac86391-bd27-4b0c-96d0-ee8f67c516b4 could not be found. Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fcb9dd28-d77a-417f-babe-55c9ae4b3fc4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Request method failure captured: Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 HTTP/1.1 Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iINwuCqTHdEtYnWATWM9Wevly8SpTqShgRi6RglcwO19P9sGVrRLDInW6ZFFKV2gPw1u8czMAzdpTUySjaqEKGXUISRtGMpvD24IQrcY3C2oyvqRMNS4GtTmcrts_T3tuxYDxd68z7vBHnq9K4YWkP9fAQXJsXXeXOxmKfN6urQKaI Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: X-Openstack-Nova-Api-Version: 2.75 Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: e76bbfd861bc4cf3883b953b17dded0d Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersAdmin275Test-1363047250 Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:28:37.606990 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:28:37.608586 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/e76bbfd861bc4cf3883b953b17dded0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/e76bbfd861bc4cf3883b953b17dded0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_e76bbfd861bc4cf3883b953b17dded0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/e76bbfd861bc4cf3883b953b17dded0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:37.608586 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersAdmin275Test-1363047250 Aug 18 11:28:37.608586 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: e76bbfd861bc4cf3883b953b17dded0d Aug 18 11:28:37.608586 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersAdmin275Test-1363047250 Aug 18 11:28:37.608586 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersAdmin275Test-1363047250-project Aug 18 11:28:37.608586 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:28:37.608586 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:28:37.608586 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7baeed1e70e94d3d8a85a8956e729b5b Aug 18 11:28:37.608586 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersAdmin275Test-1363047250-project Aug 18 11:28:37.608586 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:28:37.608586 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance cac86391-bd27-4b0c-96d0-ee8f67c516b4 could not be found. Aug 18 11:28:37.608586 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'cac86391-bd27-4b0c-96d0-ee8f67c516b4'} Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cac86391-bd27-4b0c-96d0-ee8f67c516b4 could not be found. Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:37.609433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cac86391-bd27-4b0c-96d0-ee8f67c516b4 could not be found. Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cac86391-bd27-4b0c-96d0-ee8f67c516b4 could not be found. Aug 18 11:28:37.610716 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:37.613700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fcb9dd28-d77a-417f-babe-55c9ae4b3fc4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] Returning 404 to user: Instance cac86391-bd27-4b0c-96d0-ee8f67c516b4 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:37.613700 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fcb9dd28-d77a-417f-babe-55c9ae4b3fc4 tempest-ServersAdmin275Test-1363047250 tempest-ServersAdmin275Test-1363047250-project] 10.222.0.73 "GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4" status: 404 len: 111 microversion: 2.75 time: 0.045560 Aug 18 11:28:37.615449 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 440/863] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:37 2022] GET /compute/v2.1/servers/cac86391-bd27-4b0c-96d0-ee8f67c516b4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:28:37.627732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-5004fc6c-5ddd-4374-9dc7-a61f5cb87bb1 req-e3b960cd-f7dd-4565-bb74-16e76bdfdeb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e802eca-675c-4376-8bdb-666b223637db", "tag": "ac380441-814b-46b7-aff6-6a2c1648907c"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:37.655959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5004fc6c-5ddd-4374-9dc7-a61f5cb87bb1 req-e3b960cd-f7dd-4565-bb74-16e76bdfdeb6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:37.656793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5004fc6c-5ddd-4374-9dc7-a61f5cb87bb1 req-e3b960cd-f7dd-4565-bb74-16e76bdfdeb6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:37.657469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5004fc6c-5ddd-4374-9dc7-a61f5cb87bb1 req-e3b960cd-f7dd-4565-bb74-16e76bdfdeb6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:37.677744 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5004fc6c-5ddd-4374-9dc7-a61f5cb87bb1 req-e3b960cd-f7dd-4565-bb74-16e76bdfdeb6 service nova] Creating event network-changed:ac380441-814b-46b7-aff6-6a2c1648907c for instance 2e802eca-675c-4376-8bdb-666b223637db on n-h1-853611-3 Aug 18 11:28:37.694749 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-5004fc6c-5ddd-4374-9dc7-a61f5cb87bb1 req-e3b960cd-f7dd-4565-bb74-16e76bdfdeb6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077840 Aug 18 11:28:37.696091 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 441/864] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:37.705981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-50550256-d5b8-44a7-b633-de0c740b6013 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:37.712974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-50550256-d5b8-44a7-b633-de0c740b6013 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:37.818818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-50550256-d5b8-44a7-b633-de0c740b6013 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:37.821868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1762b42c-6373-4d3d-b8fe-1cb3d5364fb1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:37.835516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1762b42c-6373-4d3d-b8fe-1cb3d5364fb1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:37.836321 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-50550256-d5b8-44a7-b633-de0c740b6013 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1216 microversion: 2.1 time: 0.138043 Aug 18 11:28:37.837034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1762b42c-6373-4d3d-b8fe-1cb3d5364fb1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:37.837663 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 442/865] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:37 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1216 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:37.851579 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1762b42c-6373-4d3d-b8fe-1cb3d5364fb1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1569 microversion: 2.25 time: 0.436592 Aug 18 11:28:37.855388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-94f1df4b-134e-4da1-b45e-7ffadf3e4893 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:37.859137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-94f1df4b-134e-4da1-b45e-7ffadf3e4893 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:37.866835 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 424/866] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:37 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1569 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:37.875087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ae5b168c-24ef-4a21-af0f-2d44d6a04e36 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:37.876029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ae5b168c-24ef-4a21-af0f-2d44d6a04e36 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:37.880583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94f1df4b-134e-4da1-b45e-7ffadf3e4893 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:37.881113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94f1df4b-134e-4da1-b45e-7ffadf3e4893 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:37.883402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94f1df4b-134e-4da1-b45e-7ffadf3e4893 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:37.884146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae5b168c-24ef-4a21-af0f-2d44d6a04e36 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:37.884986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae5b168c-24ef-4a21-af0f-2d44d6a04e36 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:37.887856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94f1df4b-134e-4da1-b45e-7ffadf3e4893 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:37.888923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94f1df4b-134e-4da1-b45e-7ffadf3e4893 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:37.890754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94f1df4b-134e-4da1-b45e-7ffadf3e4893 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:37.897285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae5b168c-24ef-4a21-af0f-2d44d6a04e36 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:37.900130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae5b168c-24ef-4a21-af0f-2d44d6a04e36 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:37.903245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae5b168c-24ef-4a21-af0f-2d44d6a04e36 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:37.904564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae5b168c-24ef-4a21-af0f-2d44d6a04e36 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:38.164487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ae5b168c-24ef-4a21-af0f-2d44d6a04e36 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:38.176280 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ae5b168c-24ef-4a21-af0f-2d44d6a04e36 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1372 microversion: 2.1 time: 0.308220 Aug 18 11:28:38.177908 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 425/867] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:37 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1372 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:38.535332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-94f1df4b-134e-4da1-b45e-7ffadf3e4893 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:38.554347 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-94f1df4b-134e-4da1-b45e-7ffadf3e4893 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1311 microversion: 2.1 time: 0.713726 Aug 18 11:28:38.555652 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 443/868] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:37 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1311 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:38.872059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-815f315f-b1b5-4d6d-8d65-31c5d6c1e4e4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:38.872817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-815f315f-b1b5-4d6d-8d65-31c5d6c1e4e4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:38.883178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-75f660f8-dd28-4390-9467-05057e3db93e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:38.883856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-75f660f8-dd28-4390-9467-05057e3db93e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:38.889148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-815f315f-b1b5-4d6d-8d65-31c5d6c1e4e4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:38.890036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-815f315f-b1b5-4d6d-8d65-31c5d6c1e4e4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:38.893130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-815f315f-b1b5-4d6d-8d65-31c5d6c1e4e4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:38.893661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75f660f8-dd28-4390-9467-05057e3db93e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:38.899012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75f660f8-dd28-4390-9467-05057e3db93e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:38.899744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-815f315f-b1b5-4d6d-8d65-31c5d6c1e4e4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:38.899872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75f660f8-dd28-4390-9467-05057e3db93e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:38.900770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75f660f8-dd28-4390-9467-05057e3db93e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:38.901518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-815f315f-b1b5-4d6d-8d65-31c5d6c1e4e4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:38.902310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-815f315f-b1b5-4d6d-8d65-31c5d6c1e4e4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:38.903055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75f660f8-dd28-4390-9467-05057e3db93e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:38.907236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75f660f8-dd28-4390-9467-05057e3db93e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:39.130413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-815f315f-b1b5-4d6d-8d65-31c5d6c1e4e4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:39.145393 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-815f315f-b1b5-4d6d-8d65-31c5d6c1e4e4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1212 microversion: 2.1 time: 0.278615 Aug 18 11:28:39.150349 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 426/869] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:38 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1212 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:39.202551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-212e2b5f-6647-4c5e-9f50-0e4c98d6d8bc tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:39.203419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-212e2b5f-6647-4c5e-9f50-0e4c98d6d8bc tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:39.210918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212e2b5f-6647-4c5e-9f50-0e4c98d6d8bc tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:39.211769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212e2b5f-6647-4c5e-9f50-0e4c98d6d8bc tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:39.212953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212e2b5f-6647-4c5e-9f50-0e4c98d6d8bc tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:39.215014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212e2b5f-6647-4c5e-9f50-0e4c98d6d8bc tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:39.216518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212e2b5f-6647-4c5e-9f50-0e4c98d6d8bc tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:39.217190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212e2b5f-6647-4c5e-9f50-0e4c98d6d8bc tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:39.439374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-212e2b5f-6647-4c5e-9f50-0e4c98d6d8bc tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:39.453764 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-212e2b5f-6647-4c5e-9f50-0e4c98d6d8bc tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1557 microversion: 2.1 time: 0.256239 Aug 18 11:28:39.471011 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 427/870] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:39 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1557 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:39.499574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7c3a8fef-3355-4d66-9c37-006a1a63b30b tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:39.502273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7c3a8fef-3355-4d66-9c37-006a1a63b30b tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:39.517328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c3a8fef-3355-4d66-9c37-006a1a63b30b tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:39.518385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c3a8fef-3355-4d66-9c37-006a1a63b30b tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:39.519022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c3a8fef-3355-4d66-9c37-006a1a63b30b tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:39.519913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c3a8fef-3355-4d66-9c37-006a1a63b30b tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:39.520526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c3a8fef-3355-4d66-9c37-006a1a63b30b tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:39.521111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c3a8fef-3355-4d66-9c37-006a1a63b30b tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:39.602276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-75f660f8-dd28-4390-9467-05057e3db93e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:39.615097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:39.621511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-75f660f8-dd28-4390-9467-05057e3db93e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:39.631385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-75f660f8-dd28-4390-9467-05057e3db93e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:39.637122 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-75f660f8-dd28-4390-9467-05057e3db93e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1569 microversion: 2.25 time: 0.757727 Aug 18 11:28:39.642307 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 444/871] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:38 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1569 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:28:39.660283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1e0afe5c-da26-417a-bfdc-72d6a7924945 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:39.661877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1e0afe5c-da26-417a-bfdc-72d6a7924945 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:39.680574 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7c3a8fef-3355-4d66-9c37-006a1a63b30b tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196548 Aug 18 11:28:39.681565 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 428/872] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:28:39 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:39.685490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e0afe5c-da26-417a-bfdc-72d6a7924945 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:39.689993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e0afe5c-da26-417a-bfdc-72d6a7924945 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:39.691183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e0afe5c-da26-417a-bfdc-72d6a7924945 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:39.694318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e0afe5c-da26-417a-bfdc-72d6a7924945 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:39.701583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e0afe5c-da26-417a-bfdc-72d6a7924945 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:39.702419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e0afe5c-da26-417a-bfdc-72d6a7924945 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:40.180391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ed4cdaa4-814f-4e89-8daf-7bc21a9bb521 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:40.181014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ed4cdaa4-814f-4e89-8daf-7bc21a9bb521 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:40.192337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed4cdaa4-814f-4e89-8daf-7bc21a9bb521 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:40.196110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed4cdaa4-814f-4e89-8daf-7bc21a9bb521 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:40.196917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed4cdaa4-814f-4e89-8daf-7bc21a9bb521 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:40.197836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed4cdaa4-814f-4e89-8daf-7bc21a9bb521 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:40.201500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed4cdaa4-814f-4e89-8daf-7bc21a9bb521 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:40.202105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed4cdaa4-814f-4e89-8daf-7bc21a9bb521 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:40.360482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ed4cdaa4-814f-4e89-8daf-7bc21a9bb521 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:40.376004 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ed4cdaa4-814f-4e89-8daf-7bc21a9bb521 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1274 microversion: 2.1 time: 0.201511 Aug 18 11:28:40.386065 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 429/873] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:40 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:28:40.665476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1e0afe5c-da26-417a-bfdc-72d6a7924945 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:40.677001 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1e0afe5c-da26-417a-bfdc-72d6a7924945 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1311 microversion: 2.1 time: 1.031939 Aug 18 11:28:40.684845 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 445/874] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:39 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1311 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:40.699881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-71b1582f-90b8-4b1a-9596-27ccac0708f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:40.700680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-71b1582f-90b8-4b1a-9596-27ccac0708f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:40.714653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71b1582f-90b8-4b1a-9596-27ccac0708f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:40.715468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71b1582f-90b8-4b1a-9596-27ccac0708f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:40.715872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71b1582f-90b8-4b1a-9596-27ccac0708f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:40.716593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71b1582f-90b8-4b1a-9596-27ccac0708f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:40.717849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71b1582f-90b8-4b1a-9596-27ccac0708f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:40.718472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71b1582f-90b8-4b1a-9596-27ccac0708f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:40.996970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Calling method '.version_select at 0x7f51ac3bef70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:41.000407 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:41.000407 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:28:41.001731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.002083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.002605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.019907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.020271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.020708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.052610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.053509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.053509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.066502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.066991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.067603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.108124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.108610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.109265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.116490 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0f2e5a1e-925b-4c5b-a94c-25e44c7d78f1 tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2625 microversion: 2.53 time: 0.532909 Aug 18 11:28:41.117074 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 430/875] 10.222.0.73 () {60 vars in 1243 bytes} [Thu Aug 18 11:28:40 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2625 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:28:41.133756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Calling method '.version_select at 0x7f51ac255f70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:41.136716 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:41.136716 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:28:41.137975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.138490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.139112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.156733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.157518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.157955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.188602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.189967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.190707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.203710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.204505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.205240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.247131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.247644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.248083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.251636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:41.255524 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c662dcbc-2ab0-424a-812e-cd382e4c00ad tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1318 microversion: 2.53 time: 0.125415 Aug 18 11:28:41.263940 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 431/876] 10.222.0.73 () {60 vars in 1222 bytes} [Thu Aug 18 11:28:41 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1318 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:28:41.269503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8fa08fdf-eee5-4ae8-a1e8-14b7ed561b2a tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Calling method '.version_select at 0x7f519fcd6f70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:41.272522 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:41.272522 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:28:41.273696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fa08fdf-eee5-4ae8-a1e8-14b7ed561b2a tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.274385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fa08fdf-eee5-4ae8-a1e8-14b7ed561b2a tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.274847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fa08fdf-eee5-4ae8-a1e8-14b7ed561b2a tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.294552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fa08fdf-eee5-4ae8-a1e8-14b7ed561b2a tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.295055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fa08fdf-eee5-4ae8-a1e8-14b7ed561b2a tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.295684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fa08fdf-eee5-4ae8-a1e8-14b7ed561b2a tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.305478 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8fa08fdf-eee5-4ae8-a1e8-14b7ed561b2a tempest-HypervisorAdminV253TestBase-1931956637 tempest-HypervisorAdminV253TestBase-1931956637-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/99698492-165b-4cdb-b187-2205df54903a" status: 200 len: 792 microversion: 2.53 time: 0.039907 Aug 18 11:28:41.316603 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 432/877] 10.222.0.73 () {60 vars in 1298 bytes} [Thu Aug 18 11:28:41 2022] GET /compute/v2.1/os-hypervisors/99698492-165b-4cdb-b187-2205df54903a => generated 792 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:28:41.403354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-565577a4-b7b8-42f6-b974-c95df514e0f3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:41.404515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-565577a4-b7b8-42f6-b974-c95df514e0f3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:41.412524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-565577a4-b7b8-42f6-b974-c95df514e0f3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.413348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-565577a4-b7b8-42f6-b974-c95df514e0f3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.414149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-565577a4-b7b8-42f6-b974-c95df514e0f3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.415106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-565577a4-b7b8-42f6-b974-c95df514e0f3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.420647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-565577a4-b7b8-42f6-b974-c95df514e0f3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.421440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-565577a4-b7b8-42f6-b974-c95df514e0f3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.610602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-565577a4-b7b8-42f6-b974-c95df514e0f3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:41.619638 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-565577a4-b7b8-42f6-b974-c95df514e0f3 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1274 microversion: 2.1 time: 0.221414 Aug 18 11:28:41.622204 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 433/878] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:41 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1274 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:28:41.723245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b3c6631-a925-479e-b0ce-89c71e327dae tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:41.725416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9b3c6631-a925-479e-b0ce-89c71e327dae tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:41.743790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b3c6631-a925-479e-b0ce-89c71e327dae tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.745339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b3c6631-a925-479e-b0ce-89c71e327dae tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.746595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b3c6631-a925-479e-b0ce-89c71e327dae tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:41.747785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b3c6631-a925-479e-b0ce-89c71e327dae tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:41.748532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b3c6631-a925-479e-b0ce-89c71e327dae tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:41.749334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b3c6631-a925-479e-b0ce-89c71e327dae tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:42.041922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-71b1582f-90b8-4b1a-9596-27ccac0708f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:42.057581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-71b1582f-90b8-4b1a-9596-27ccac0708f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:42.059488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-71b1582f-90b8-4b1a-9596-27ccac0708f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:42.060942 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-71b1582f-90b8-4b1a-9596-27ccac0708f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1569 microversion: 2.25 time: 1.374807 Aug 18 11:28:42.079191 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 446/879] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:40 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1569 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:42.084555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-546f450a-c52a-446d-8cc0-d94887c6f8b1 req-70529551-73e2-463c-bafc-ee475cafb2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "995b6878-0830-4d2c-87ca-d3eed8a35f22", "tag": "a724a63e-95c2-4d42-8094-45a0c52650a9"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:42.099262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-546f450a-c52a-446d-8cc0-d94887c6f8b1 req-70529551-73e2-463c-bafc-ee475cafb2e4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:42.101446 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-546f450a-c52a-446d-8cc0-d94887c6f8b1 req-70529551-73e2-463c-bafc-ee475cafb2e4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:42.102382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-546f450a-c52a-446d-8cc0-d94887c6f8b1 req-70529551-73e2-463c-bafc-ee475cafb2e4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:42.118768 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-546f450a-c52a-446d-8cc0-d94887c6f8b1 req-70529551-73e2-463c-bafc-ee475cafb2e4 service nova] Creating event network-changed:a724a63e-95c2-4d42-8094-45a0c52650a9 for instance 995b6878-0830-4d2c-87ca-d3eed8a35f22 on n-h2-853611-3 Aug 18 11:28:42.125920 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-546f450a-c52a-446d-8cc0-d94887c6f8b1 req-70529551-73e2-463c-bafc-ee475cafb2e4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044604 Aug 18 11:28:42.126964 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 447/880] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:42.648892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e19c3e3b-02fc-447b-b0ec-c6bb8b256cc7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:42.649883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e19c3e3b-02fc-447b-b0ec-c6bb8b256cc7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:42.665640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e19c3e3b-02fc-447b-b0ec-c6bb8b256cc7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:42.666643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e19c3e3b-02fc-447b-b0ec-c6bb8b256cc7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:42.667300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e19c3e3b-02fc-447b-b0ec-c6bb8b256cc7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:42.668580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e19c3e3b-02fc-447b-b0ec-c6bb8b256cc7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:42.669422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e19c3e3b-02fc-447b-b0ec-c6bb8b256cc7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:42.670267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e19c3e3b-02fc-447b-b0ec-c6bb8b256cc7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:42.939079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e19c3e3b-02fc-447b-b0ec-c6bb8b256cc7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:42.956677 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e19c3e3b-02fc-447b-b0ec-c6bb8b256cc7 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1274 microversion: 2.1 time: 0.314428 Aug 18 11:28:42.958464 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 448/881] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:42 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1274 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:43.070617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9b3c6631-a925-479e-b0ce-89c71e327dae tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:43.079038 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b3c6631-a925-479e-b0ce-89c71e327dae tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1311 microversion: 2.1 time: 1.374161 Aug 18 11:28:43.085442 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 434/882] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:41 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1311 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:43.086038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-84a987e3-acdc-43b1-bd38-50f54e0ca0a7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:43.086761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-84a987e3-acdc-43b1-bd38-50f54e0ca0a7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:43.103912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84a987e3-acdc-43b1-bd38-50f54e0ca0a7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:43.104480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84a987e3-acdc-43b1-bd38-50f54e0ca0a7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:43.104982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84a987e3-acdc-43b1-bd38-50f54e0ca0a7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:43.106383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84a987e3-acdc-43b1-bd38-50f54e0ca0a7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:43.107194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84a987e3-acdc-43b1-bd38-50f54e0ca0a7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:43.111094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84a987e3-acdc-43b1-bd38-50f54e0ca0a7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:43.489334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-84a987e3-acdc-43b1-bd38-50f54e0ca0a7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:43.508818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-84a987e3-acdc-43b1-bd38-50f54e0ca0a7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:43.513322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-84a987e3-acdc-43b1-bd38-50f54e0ca0a7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:43.516200 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-84a987e3-acdc-43b1-bd38-50f54e0ca0a7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1569 microversion: 2.25 time: 0.434619 Aug 18 11:28:43.517654 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 449/883] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:43 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1569 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:28:43.979913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-13025a55-b62e-43d6-805e-ad8c55e64954 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:43.983015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-13025a55-b62e-43d6-805e-ad8c55e64954 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:43.997311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:43.998993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:44.003867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13025a55-b62e-43d6-805e-ad8c55e64954 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:44.004378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13025a55-b62e-43d6-805e-ad8c55e64954 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:44.004825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13025a55-b62e-43d6-805e-ad8c55e64954 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:44.005554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13025a55-b62e-43d6-805e-ad8c55e64954 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:44.006015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13025a55-b62e-43d6-805e-ad8c55e64954 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:44.006463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13025a55-b62e-43d6-805e-ad8c55e64954 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:44.115062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ba724217-6f27-43ab-9604-42fd8fd3c56b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:44.115687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ba724217-6f27-43ab-9604-42fd8fd3c56b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:44.125768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba724217-6f27-43ab-9604-42fd8fd3c56b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:44.127055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba724217-6f27-43ab-9604-42fd8fd3c56b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:44.127942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba724217-6f27-43ab-9604-42fd8fd3c56b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:44.128984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba724217-6f27-43ab-9604-42fd8fd3c56b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:44.129792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba724217-6f27-43ab-9604-42fd8fd3c56b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:44.130584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba724217-6f27-43ab-9604-42fd8fd3c56b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:44.544391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ba724217-6f27-43ab-9604-42fd8fd3c56b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:44.557611 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ba724217-6f27-43ab-9604-42fd8fd3c56b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1311 microversion: 2.1 time: 0.451547 Aug 18 11:28:44.560956 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 450/884] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:44 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1311 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:44.570735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e650dcca-a5a3-4069-acb3-bebcb70e020d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:44.571623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e650dcca-a5a3-4069-acb3-bebcb70e020d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:44.584852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e650dcca-a5a3-4069-acb3-bebcb70e020d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:44.585706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e650dcca-a5a3-4069-acb3-bebcb70e020d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:44.586566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e650dcca-a5a3-4069-acb3-bebcb70e020d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:44.587854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e650dcca-a5a3-4069-acb3-bebcb70e020d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:44.588592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e650dcca-a5a3-4069-acb3-bebcb70e020d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:44.589286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e650dcca-a5a3-4069-acb3-bebcb70e020d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:44.691872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-13025a55-b62e-43d6-805e-ad8c55e64954 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:44.710194 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-13025a55-b62e-43d6-805e-ad8c55e64954 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1316 microversion: 2.1 time: 0.734352 Aug 18 11:28:44.718557 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 435/885] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:43 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1316 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:45.005134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1593310758", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:45.077083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:28:45.121335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e650dcca-a5a3-4069-acb3-bebcb70e020d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:45.141481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e650dcca-a5a3-4069-acb3-bebcb70e020d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:45.145631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e650dcca-a5a3-4069-acb3-bebcb70e020d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:45.151350 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e650dcca-a5a3-4069-acb3-bebcb70e020d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1569 microversion: 2.25 time: 0.587875 Aug 18 11:28:45.156587 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 451/886] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:44 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1569 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:45.176411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-de9e9bb0-420d-4122-b593-5973f49652f9 req-67ebf64e-09b6-468b-81a0-12d81dc49f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c90c1672-67f6-4f31-84b5-695115309d3d", "tag": "e16903bb-2ff8-4682-86db-5e9d462b751b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:45.233331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-de9e9bb0-420d-4122-b593-5973f49652f9 req-67ebf64e-09b6-468b-81a0-12d81dc49f0a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:45.233946 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-de9e9bb0-420d-4122-b593-5973f49652f9 req-67ebf64e-09b6-468b-81a0-12d81dc49f0a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:45.234476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-de9e9bb0-420d-4122-b593-5973f49652f9 req-67ebf64e-09b6-468b-81a0-12d81dc49f0a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:45.251471 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-de9e9bb0-420d-4122-b593-5973f49652f9 req-67ebf64e-09b6-468b-81a0-12d81dc49f0a service nova] Creating event network-changed:e16903bb-2ff8-4682-86db-5e9d462b751b for instance c90c1672-67f6-4f31-84b5-695115309d3d on n-h1-853611-3 Aug 18 11:28:45.256843 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-de9e9bb0-420d-4122-b593-5973f49652f9 req-67ebf64e-09b6-468b-81a0-12d81dc49f0a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098321 Aug 18 11:28:45.257578 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 452/887] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:45.584158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-df8029fe-6237-4979-832e-327284ab71c1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:45.585361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-df8029fe-6237-4979-832e-327284ab71c1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:45.603432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df8029fe-6237-4979-832e-327284ab71c1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:45.604398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df8029fe-6237-4979-832e-327284ab71c1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:45.605316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df8029fe-6237-4979-832e-327284ab71c1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:45.606393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df8029fe-6237-4979-832e-327284ab71c1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:45.608507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df8029fe-6237-4979-832e-327284ab71c1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:45.610392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df8029fe-6237-4979-832e-327284ab71c1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:45.725069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:28:45.726416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:28:45.727275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:28:45.728084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:28:45.728965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:28:45.776325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:45.778585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:45.796745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:45.801228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:45.802973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:45.804497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:45.874332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Getting quotas for project 0718d83ed8e34cdc828f9de773a3515d. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:28:45.893541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Getting quotas for user b2b3b1bcd12841858b3fbe6cb358435a and project 0718d83ed8e34cdc828f9de773a3515d. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:28:45.914082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:28:45.916937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:28:46.009910 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-133cd247-a0fa-40a3-87b2-8a6c478d9c7a tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.218393 Aug 18 11:28:46.024397 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 436/888] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:28:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:28:46.044351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1292ecd4-26ee-44f3-a63a-b3d00a140314 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:46.045743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1292ecd4-26ee-44f3-a63a-b3d00a140314 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:46.087780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1292ecd4-26ee-44f3-a63a-b3d00a140314 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:46.088555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1292ecd4-26ee-44f3-a63a-b3d00a140314 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:46.090682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1292ecd4-26ee-44f3-a63a-b3d00a140314 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:46.091819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1292ecd4-26ee-44f3-a63a-b3d00a140314 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:46.092776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1292ecd4-26ee-44f3-a63a-b3d00a140314 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:46.093739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1292ecd4-26ee-44f3-a63a-b3d00a140314 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:46.788625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-df8029fe-6237-4979-832e-327284ab71c1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:46.802585 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-df8029fe-6237-4979-832e-327284ab71c1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1311 microversion: 2.1 time: 1.224750 Aug 18 11:28:46.819014 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 453/889] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:45 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1311 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:28:46.819014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a62293a8-7a86-4bf9-ad89-a8a1c9976fec tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:46.819014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a62293a8-7a86-4bf9-ad89-a8a1c9976fec tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:47.095312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a62293a8-7a86-4bf9-ad89-a8a1c9976fec tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:47.112623 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a62293a8-7a86-4bf9-ad89-a8a1c9976fec tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1222 microversion: 2.1 time: 0.305383 Aug 18 11:28:47.115789 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 454/890] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:46 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1222 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:47.121907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1fce3331-480b-4fe1-91d7-5159cd372e7e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:47.132888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1fce3331-480b-4fe1-91d7-5159cd372e7e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:47.148720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fce3331-480b-4fe1-91d7-5159cd372e7e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:47.150567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fce3331-480b-4fe1-91d7-5159cd372e7e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:47.152532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fce3331-480b-4fe1-91d7-5159cd372e7e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:47.155776 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fce3331-480b-4fe1-91d7-5159cd372e7e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:47.156565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fce3331-480b-4fe1-91d7-5159cd372e7e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:47.157336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fce3331-480b-4fe1-91d7-5159cd372e7e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:47.437602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1292ecd4-26ee-44f3-a63a-b3d00a140314 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:47.460178 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1292ecd4-26ee-44f3-a63a-b3d00a140314 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1316 microversion: 2.1 time: 1.429064 Aug 18 11:28:47.460794 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 437/891] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:46 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1316 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:47.466483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-47929e14-1c79-4c85-b8f6-d5d76f49b2ce req-5f736ebf-c075-4877-8c52-97c00b16bbbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eefaa19-3ae6-470b-95fd-67dd4755f155", "tag": "a489dc0f-db2f-482f-842e-a4db6946ed64"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:47.482548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-47929e14-1c79-4c85-b8f6-d5d76f49b2ce req-5f736ebf-c075-4877-8c52-97c00b16bbbc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:47.483288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-47929e14-1c79-4c85-b8f6-d5d76f49b2ce req-5f736ebf-c075-4877-8c52-97c00b16bbbc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:47.483441 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1fce3331-480b-4fe1-91d7-5159cd372e7e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:47.484174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-47929e14-1c79-4c85-b8f6-d5d76f49b2ce req-5f736ebf-c075-4877-8c52-97c00b16bbbc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:47.488888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:47.499903 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-47929e14-1c79-4c85-b8f6-d5d76f49b2ce req-5f736ebf-c075-4877-8c52-97c00b16bbbc service nova] Creating event network-changed:a489dc0f-db2f-482f-842e-a4db6946ed64 for instance 7eefaa19-3ae6-470b-95fd-67dd4755f155 on n-h1-853611-3 Aug 18 11:28:47.505088 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-47929e14-1c79-4c85-b8f6-d5d76f49b2ce req-5f736ebf-c075-4877-8c52-97c00b16bbbc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042938 Aug 18 11:28:47.505987 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 438/892] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:47.509132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1fce3331-480b-4fe1-91d7-5159cd372e7e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:47.511933 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1fce3331-480b-4fe1-91d7-5159cd372e7e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:47.514075 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1fce3331-480b-4fe1-91d7-5159cd372e7e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1569 microversion: 2.25 time: 0.397094 Aug 18 11:28:47.526459 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 455/893] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:47 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1569 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:47.826826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-77e8c768-4404-4c33-ae93-4c649036f2a4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:47.827512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-77e8c768-4404-4c33-ae93-4c649036f2a4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:47.847445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77e8c768-4404-4c33-ae93-4c649036f2a4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:47.848314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77e8c768-4404-4c33-ae93-4c649036f2a4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:47.850697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77e8c768-4404-4c33-ae93-4c649036f2a4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:47.851882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77e8c768-4404-4c33-ae93-4c649036f2a4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:47.852756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77e8c768-4404-4c33-ae93-4c649036f2a4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:47.853384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77e8c768-4404-4c33-ae93-4c649036f2a4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:48.138012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c01a4413-64a3-418e-8bcc-6a4d1e79874d tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:48.138684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c01a4413-64a3-418e-8bcc-6a4d1e79874d tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:48.150281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c01a4413-64a3-418e-8bcc-6a4d1e79874d tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:48.150804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c01a4413-64a3-418e-8bcc-6a4d1e79874d tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:48.151247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c01a4413-64a3-418e-8bcc-6a4d1e79874d tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:48.152573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c01a4413-64a3-418e-8bcc-6a4d1e79874d tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:48.152996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c01a4413-64a3-418e-8bcc-6a4d1e79874d tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:48.153424 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c01a4413-64a3-418e-8bcc-6a4d1e79874d tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:48.430298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-77e8c768-4404-4c33-ae93-4c649036f2a4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:48.453259 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-77e8c768-4404-4c33-ae93-4c649036f2a4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1311 microversion: 2.1 time: 0.629900 Aug 18 11:28:48.455561 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 439/894] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:47 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1311 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:48.489489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c01a4413-64a3-418e-8bcc-6a4d1e79874d tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:48.502954 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c01a4413-64a3-418e-8bcc-6a4d1e79874d tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1280 microversion: 2.1 time: 0.369156 Aug 18 11:28:48.503733 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 456/895] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:48 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1280 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:28:48.515763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dff507d1-a039-4202-bb64-c3108c0a7875 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:48.519340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dff507d1-a039-4202-bb64-c3108c0a7875 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:48.531372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dff507d1-a039-4202-bb64-c3108c0a7875 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:48.541646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-16f04357-2b84-4a39-82ea-b3e29b8addca tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:48.543577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-16f04357-2b84-4a39-82ea-b3e29b8addca tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:48.550894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dff507d1-a039-4202-bb64-c3108c0a7875 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:48.551542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dff507d1-a039-4202-bb64-c3108c0a7875 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:48.552298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dff507d1-a039-4202-bb64-c3108c0a7875 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:48.556392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16f04357-2b84-4a39-82ea-b3e29b8addca tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:48.556909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16f04357-2b84-4a39-82ea-b3e29b8addca tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:48.557358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16f04357-2b84-4a39-82ea-b3e29b8addca tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:48.557653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dff507d1-a039-4202-bb64-c3108c0a7875 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:48.558703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16f04357-2b84-4a39-82ea-b3e29b8addca tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:48.559175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16f04357-2b84-4a39-82ea-b3e29b8addca tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:48.559297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dff507d1-a039-4202-bb64-c3108c0a7875 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:48.559790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16f04357-2b84-4a39-82ea-b3e29b8addca tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:48.912212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dff507d1-a039-4202-bb64-c3108c0a7875 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:48.927076 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dff507d1-a039-4202-bb64-c3108c0a7875 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1316 microversion: 2.1 time: 0.432624 Aug 18 11:28:48.927683 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 440/896] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:48 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:49.479201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-79172725-2a0d-4313-af8a-13056d43966c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:49.481553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-79172725-2a0d-4313-af8a-13056d43966c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:49.492387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79172725-2a0d-4313-af8a-13056d43966c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:49.493390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79172725-2a0d-4313-af8a-13056d43966c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:49.494022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79172725-2a0d-4313-af8a-13056d43966c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:49.494936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79172725-2a0d-4313-af8a-13056d43966c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:49.496263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79172725-2a0d-4313-af8a-13056d43966c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:49.497853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79172725-2a0d-4313-af8a-13056d43966c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:49.594379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-16f04357-2b84-4a39-82ea-b3e29b8addca tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:49.604140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-16f04357-2b84-4a39-82ea-b3e29b8addca tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:49.617096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-16f04357-2b84-4a39-82ea-b3e29b8addca tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:49.618821 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-16f04357-2b84-4a39-82ea-b3e29b8addca tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1569 microversion: 2.25 time: 1.080910 Aug 18 11:28:49.634082 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 457/897] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:48 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1569 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:49.644633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa4b8390-b701-4622-aeae-3ab50c0023a3 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:49.644633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fa4b8390-b701-4622-aeae-3ab50c0023a3 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:49.650648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa4b8390-b701-4622-aeae-3ab50c0023a3 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:49.651138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa4b8390-b701-4622-aeae-3ab50c0023a3 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:49.652412 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa4b8390-b701-4622-aeae-3ab50c0023a3 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:49.653300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa4b8390-b701-4622-aeae-3ab50c0023a3 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:49.659122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa4b8390-b701-4622-aeae-3ab50c0023a3 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:49.659868 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa4b8390-b701-4622-aeae-3ab50c0023a3 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:49.875566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-79172725-2a0d-4313-af8a-13056d43966c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:49.887448 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-79172725-2a0d-4313-af8a-13056d43966c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1311 microversion: 2.1 time: 0.413803 Aug 18 11:28:49.891828 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 441/898] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:49 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1311 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:49.911393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fa4b8390-b701-4622-aeae-3ab50c0023a3 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:49.937236 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fa4b8390-b701-4622-aeae-3ab50c0023a3 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1280 microversion: 2.1 time: 0.316341 Aug 18 11:28:49.949152 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 458/899] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:49 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:49.953162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e726e8ae-c3a4-462f-bd38-697488a75dac tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:49.953997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e726e8ae-c3a4-462f-bd38-697488a75dac tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:49.968614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e726e8ae-c3a4-462f-bd38-697488a75dac tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:49.977410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e726e8ae-c3a4-462f-bd38-697488a75dac tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:49.978638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e726e8ae-c3a4-462f-bd38-697488a75dac tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:49.983872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e726e8ae-c3a4-462f-bd38-697488a75dac tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:49.985245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e726e8ae-c3a4-462f-bd38-697488a75dac tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:49.986819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e726e8ae-c3a4-462f-bd38-697488a75dac tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:50.655229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0112dd85-8c3a-4a86-82df-d97de021e498 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:50.655707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0112dd85-8c3a-4a86-82df-d97de021e498 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:50.678211 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0112dd85-8c3a-4a86-82df-d97de021e498 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:50.678760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0112dd85-8c3a-4a86-82df-d97de021e498 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:50.679390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0112dd85-8c3a-4a86-82df-d97de021e498 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:50.680296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0112dd85-8c3a-4a86-82df-d97de021e498 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:50.685251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0112dd85-8c3a-4a86-82df-d97de021e498 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:50.685939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0112dd85-8c3a-4a86-82df-d97de021e498 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:50.787560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e726e8ae-c3a4-462f-bd38-697488a75dac tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:50.801424 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e726e8ae-c3a4-462f-bd38-697488a75dac tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1316 microversion: 2.1 time: 0.852954 Aug 18 11:28:50.815064 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 442/900] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:49 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1316 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:28:50.920651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8dbf0c49-f77d-4c37-acb0-0df1d74e27b9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:50.921294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8dbf0c49-f77d-4c37-acb0-0df1d74e27b9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:50.948060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dbf0c49-f77d-4c37-acb0-0df1d74e27b9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:50.950358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dbf0c49-f77d-4c37-acb0-0df1d74e27b9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:50.961369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dbf0c49-f77d-4c37-acb0-0df1d74e27b9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:50.962241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dbf0c49-f77d-4c37-acb0-0df1d74e27b9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:50.962765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dbf0c49-f77d-4c37-acb0-0df1d74e27b9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:50.963414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dbf0c49-f77d-4c37-acb0-0df1d74e27b9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:51.369406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8dbf0c49-f77d-4c37-acb0-0df1d74e27b9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:51.379120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0112dd85-8c3a-4a86-82df-d97de021e498 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:51.387653 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8dbf0c49-f77d-4c37-acb0-0df1d74e27b9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1311 microversion: 2.1 time: 0.476210 Aug 18 11:28:51.401206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0112dd85-8c3a-4a86-82df-d97de021e498 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:51.402961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0112dd85-8c3a-4a86-82df-d97de021e498 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:51.404174 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0112dd85-8c3a-4a86-82df-d97de021e498 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1544 microversion: 2.25 time: 0.755586 Aug 18 11:28:51.405053 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 443/901] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:50 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1311 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:51.407404 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 459/902] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:50 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1544 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:28:51.430385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0c515ad0-63e6-4861-ad2a-a979fb2d7832 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:51.431273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0c515ad0-63e6-4861-ad2a-a979fb2d7832 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:51.446228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-23940072-d12a-43ee-af6f-83efe1b3db57 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '.version_select at 0x7f519fa94040>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:51.459079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c515ad0-63e6-4861-ad2a-a979fb2d7832 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:51.459592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c515ad0-63e6-4861-ad2a-a979fb2d7832 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:51.460032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c515ad0-63e6-4861-ad2a-a979fb2d7832 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:51.460741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c515ad0-63e6-4861-ad2a-a979fb2d7832 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:51.461362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c515ad0-63e6-4861-ad2a-a979fb2d7832 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:51.461957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23940072-d12a-43ee-af6f-83efe1b3db57 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:51.462119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c515ad0-63e6-4861-ad2a-a979fb2d7832 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:51.465730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23940072-d12a-43ee-af6f-83efe1b3db57 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:51.466765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23940072-d12a-43ee-af6f-83efe1b3db57 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:51.486210 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-23940072-d12a-43ee-af6f-83efe1b3db57 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.045680 Aug 18 11:28:51.505494 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 460/903] 10.222.0.73 () {60 vars in 1184 bytes} [Thu Aug 18 11:28:51 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:51.518292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a7436b08-66fb-4594-b05c-b81559e198a7 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:51.520237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a7436b08-66fb-4594-b05c-b81559e198a7 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:51.536294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7436b08-66fb-4594-b05c-b81559e198a7 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:51.536789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7436b08-66fb-4594-b05c-b81559e198a7 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:51.537232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7436b08-66fb-4594-b05c-b81559e198a7 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:51.537948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7436b08-66fb-4594-b05c-b81559e198a7 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:51.543763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7436b08-66fb-4594-b05c-b81559e198a7 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:51.544435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7436b08-66fb-4594-b05c-b81559e198a7 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:51.722190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0c515ad0-63e6-4861-ad2a-a979fb2d7832 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:51.735074 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0c515ad0-63e6-4861-ad2a-a979fb2d7832 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1280 microversion: 2.1 time: 0.328746 Aug 18 11:28:51.742168 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 444/904] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:51 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1280 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:51.827198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a35385bc-858d-453c-9cd2-37acf5dee9cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:51.828025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a35385bc-858d-453c-9cd2-37acf5dee9cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:51.842637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a35385bc-858d-453c-9cd2-37acf5dee9cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:51.844488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a35385bc-858d-453c-9cd2-37acf5dee9cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:51.847713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a35385bc-858d-453c-9cd2-37acf5dee9cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:51.849281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a35385bc-858d-453c-9cd2-37acf5dee9cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:51.850871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a35385bc-858d-453c-9cd2-37acf5dee9cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:51.853163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a35385bc-858d-453c-9cd2-37acf5dee9cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:52.266668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-a7436b08-66fb-4594-b05c-b81559e198a7 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 2e802eca-675c-4376-8bdb-666b223637db {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:28:52.306859 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a7436b08-66fb-4594-b05c-b81559e198a7 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 2037 microversion: 2.25 time: 0.798523 Aug 18 11:28:52.310660 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 461/905] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:28:51 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 2037 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:28:52.340345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cc5beb8d-cb1a-41b3-811f-63c70d3519f4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Action: 'create', calling method: .version_select at 0x7f519fa4d040>, body: {"keypair": {"name": "tempest-keypair-58552124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsUMOj4nZpSzGj7F0/w3fIwcb0P18kZ4UYXItJBWHTowDfDxVDuQcL79asz6okKNPEp/mc76ffF4WohAwIsU52bNbdOkNaVS1FRhMHcdVLS9TcKoULW2OFxtJrzoxqDZg=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:52.380835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-cc5beb8d-cb1a-41b3-811f-63c70d3519f4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Getting quotas for project 51319140bae948cf873746a482aaf588. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:28:52.391977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-cc5beb8d-cb1a-41b3-811f-63c70d3519f4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Getting quotas for user 36162046d3d84db98ce76b19770f6322 and project 51319140bae948cf873746a482aaf588. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:28:52.453427 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cc5beb8d-cb1a-41b3-811f-63c70d3519f4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.25 time: 0.120396 Aug 18 11:28:52.454718 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 462/906] 10.222.0.73 () {62 vars in 1200 bytes} [Thu Aug 18 11:28:52 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 11:28:52.467236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-5123de7c-d434-4ef7-9e66-0df1b52e5d81 req-60d9559e-6252-4c5f-b80f-9750f1dd8488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "995b6878-0830-4d2c-87ca-d3eed8a35f22", "name": "network-vif-plugged", "status": "completed", "tag": "a724a63e-95c2-4d42-8094-45a0c52650a9"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:52.489926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5123de7c-d434-4ef7-9e66-0df1b52e5d81 req-60d9559e-6252-4c5f-b80f-9750f1dd8488 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:52.490644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5123de7c-d434-4ef7-9e66-0df1b52e5d81 req-60d9559e-6252-4c5f-b80f-9750f1dd8488 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:52.491580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5123de7c-d434-4ef7-9e66-0df1b52e5d81 req-60d9559e-6252-4c5f-b80f-9750f1dd8488 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:52.524668 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5123de7c-d434-4ef7-9e66-0df1b52e5d81 req-60d9559e-6252-4c5f-b80f-9750f1dd8488 service nova] Creating event network-vif-plugged:a724a63e-95c2-4d42-8094-45a0c52650a9 for instance 995b6878-0830-4d2c-87ca-d3eed8a35f22 on n-h2-853611-3 Aug 18 11:28:52.540166 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-5123de7c-d434-4ef7-9e66-0df1b52e5d81 req-60d9559e-6252-4c5f-b80f-9750f1dd8488 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082908 Aug 18 11:28:52.552644 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 463/907] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:52.560889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ad668d87-bd8c-4395-b855-f36130eac54f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:52.561921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ad668d87-bd8c-4395-b855-f36130eac54f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:52.571260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad668d87-bd8c-4395-b855-f36130eac54f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:52.572066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad668d87-bd8c-4395-b855-f36130eac54f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:52.572675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad668d87-bd8c-4395-b855-f36130eac54f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:52.574222 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad668d87-bd8c-4395-b855-f36130eac54f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:52.577429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad668d87-bd8c-4395-b855-f36130eac54f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:52.578635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad668d87-bd8c-4395-b855-f36130eac54f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:52.768330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a35385bc-858d-453c-9cd2-37acf5dee9cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:52.780409 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a35385bc-858d-453c-9cd2-37acf5dee9cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1316 microversion: 2.1 time: 0.958346 Aug 18 11:28:52.783726 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 445/908] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:51 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1316 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:53.162273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b9914d84-8c7b-4a81-b07b-0bcaec356d0a tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Calling method '.version_select at 0x7f519fd5bc10>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:53.164368 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:53.164368 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:28:53.165746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b9914d84-8c7b-4a81-b07b-0bcaec356d0a tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'b4363ae81b714cf9b6c44db98e77514b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c52dc953594d1d937bdb8737ea5790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b9914d84-8c7b-4a81-b07b-0bcaec356d0a tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Request method failure captured: Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iJykpFT397v7wm8hVb7S73-2yWBn-0kc2jthfeOS_nn0R5WbazL1B9xdjoJN9JS2JLR-NiRVBCQ-9wNYCPW0p1O4k-jqrfl9jXrb6mNC0d0AB-YkJLgqJ_3INy8jIjaQ-XRrQDrKr4XelVgZXaE9g-mAYS8rJojXcp5ewKHg4YWWCg Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 06c52dc953594d1d937bdb8737ea5790 Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:28:53.170777 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:28:53.172452 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:53.172452 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.172452 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 06c52dc953594d1d937bdb8737ea5790 Aug 18 11:28:53.172452 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.172452 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-HypervisorAdminNegativeTestJSON-1190952736-project Aug 18 11:28:53.172452 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:28:53.172452 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:28:53.172452 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: b4363ae81b714cf9b6c44db98e77514b Aug 18 11:28:53.172452 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736-project Aug 18 11:28:53.172452 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:28:53.172452 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 18 11:28:53.172452 n-d-853611-3 devstack@n-api.service[122210]: action_args: {} Aug 18 11:28:53.172452 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:28:53.173413 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 18 11:28:53.175020 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.177316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b9914d84-8c7b-4a81-b07b-0bcaec356d0a tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:53.178883 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b9914d84-8c7b-4a81-b07b-0bcaec356d0a tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.393721 Aug 18 11:28:53.179830 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 446/909] 10.222.0.73 () {58 vars in 1167 bytes} [Thu Aug 18 11:28:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 395 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:53.193595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8d443519-dfed-4712-a2f8-3ade094cf303 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:53.194590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8d443519-dfed-4712-a2f8-3ade094cf303 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:53.205085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d443519-dfed-4712-a2f8-3ade094cf303 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:53.207453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d443519-dfed-4712-a2f8-3ade094cf303 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:53.208292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d443519-dfed-4712-a2f8-3ade094cf303 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:53.209207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d443519-dfed-4712-a2f8-3ade094cf303 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:53.209818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d443519-dfed-4712-a2f8-3ade094cf303 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:53.210269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d443519-dfed-4712-a2f8-3ade094cf303 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:53.271156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ad668d87-bd8c-4395-b855-f36130eac54f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:53.281231 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ad668d87-bd8c-4395-b855-f36130eac54f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1311 microversion: 2.1 time: 0.727038 Aug 18 11:28:53.281820 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 464/910] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:52 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1311 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:53.287050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-397bc363-fc36-46e4-a2e9-ba05148fd252 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Calling method '.version_select at 0x7f519ffc5af0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:53.288073 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:53.288073 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:28:53.289645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-397bc363-fc36-46e4-a2e9-ba05148fd252 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'b4363ae81b714cf9b6c44db98e77514b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c52dc953594d1d937bdb8737ea5790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-397bc363-fc36-46e4-a2e9-ba05148fd252 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Request method failure captured: Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iJykpFT397v7wm8hVb7S73-2yWBn-0kc2jthfeOS_nn0R5WbazL1B9xdjoJN9JS2JLR-NiRVBCQ-9wNYCPW0p1O4k-jqrfl9jXrb6mNC0d0AB-YkJLgqJ_3INy8jIjaQ-XRrQDrKr4XelVgZXaE9g-mAYS8rJojXcp5ewKHg4YWWCg Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 06c52dc953594d1d937bdb8737ea5790 Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:28:53.291518 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:28:53.292863 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:53.292863 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.292863 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 06c52dc953594d1d937bdb8737ea5790 Aug 18 11:28:53.292863 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.292863 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-HypervisorAdminNegativeTestJSON-1190952736-project Aug 18 11:28:53.292863 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:28:53.292863 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:28:53.292863 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b4363ae81b714cf9b6c44db98e77514b Aug 18 11:28:53.292863 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736-project Aug 18 11:28:53.292863 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:28:53.292863 n-d-853611-3 devstack@n-api.service[122209]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 18 11:28:53.292863 n-d-853611-3 devstack@n-api.service[122209]: action_args: {} Aug 18 11:28:53.292863 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:28:53.293633 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 18 11:28:53.294771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.295956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-397bc363-fc36-46e4-a2e9-ba05148fd252 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:53.295956 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-397bc363-fc36-46e4-a2e9-ba05148fd252 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] 10.222.0.73 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.010543 Aug 18 11:28:53.300764 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 465/911] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:28:53 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:53.307093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-21e78fcf-5131-438f-93ae-f577e4e3a2c7 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Calling method '.version_select at 0x7f519fa4d1f0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:53.308521 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:53.308521 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:28:53.311676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-21e78fcf-5131-438f-93ae-f577e4e3a2c7 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'b4363ae81b714cf9b6c44db98e77514b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c52dc953594d1d937bdb8737ea5790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-21e78fcf-5131-438f-93ae-f577e4e3a2c7 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Request method failure captured: Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iJykpFT397v7wm8hVb7S73-2yWBn-0kc2jthfeOS_nn0R5WbazL1B9xdjoJN9JS2JLR-NiRVBCQ-9wNYCPW0p1O4k-jqrfl9jXrb6mNC0d0AB-YkJLgqJ_3INy8jIjaQ-XRrQDrKr4XelVgZXaE9g-mAYS8rJojXcp5ewKHg4YWWCg Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 06c52dc953594d1d937bdb8737ea5790 Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:28:53.314838 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:28:53.316126 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:53.316126 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.316126 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 06c52dc953594d1d937bdb8737ea5790 Aug 18 11:28:53.316126 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.316126 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-HypervisorAdminNegativeTestJSON-1190952736-project Aug 18 11:28:53.316126 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:28:53.316126 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:28:53.316126 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b4363ae81b714cf9b6c44db98e77514b Aug 18 11:28:53.316126 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736-project Aug 18 11:28:53.316126 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:28:53.316126 n-d-853611-3 devstack@n-api.service[122209]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 18 11:28:53.316126 n-d-853611-3 devstack@n-api.service[122209]: action_args: {} Aug 18 11:28:53.316126 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:28:53.316893 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 18 11:28:53.317995 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.320651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-21e78fcf-5131-438f-93ae-f577e4e3a2c7 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:53.320651 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-21e78fcf-5131-438f-93ae-f577e4e3a2c7 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.015753 Aug 18 11:28:53.320651 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 466/912] 10.222.0.73 () {58 vars in 1179 bytes} [Thu Aug 18 11:28:53 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:53.421456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d16ad347-f31d-4680-b169-50957afd2598 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Calling method '.version_select at 0x7f51ac741430>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:53.423954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d16ad347-f31d-4680-b169-50957afd2598 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:53.425028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d16ad347-f31d-4680-b169-50957afd2598 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:53.425773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d16ad347-f31d-4680-b169-50957afd2598 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:53.447502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d16ad347-f31d-4680-b169-50957afd2598 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:53.448955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d16ad347-f31d-4680-b169-50957afd2598 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:53.449807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d16ad347-f31d-4680-b169-50957afd2598 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:53.465934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d16ad347-f31d-4680-b169-50957afd2598 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:53.467148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d16ad347-f31d-4680-b169-50957afd2598 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:53.468003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d16ad347-f31d-4680-b169-50957afd2598 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:53.476360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:53.480922 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d16ad347-f31d-4680-b169-50957afd2598 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.152903 Aug 18 11:28:53.481872 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 467/913] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:28:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:53.496296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-46a13dcb-da82-4d84-8fd0-d49c5bcaffb7 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Calling method '.version_select at 0x7f519fa4ddc0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:53.497596 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:53.497596 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:28:53.499473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-46a13dcb-da82-4d84-8fd0-d49c5bcaffb7 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'b4363ae81b714cf9b6c44db98e77514b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c52dc953594d1d937bdb8737ea5790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-46a13dcb-da82-4d84-8fd0-d49c5bcaffb7 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Request method failure captured: Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iJykpFT397v7wm8hVb7S73-2yWBn-0kc2jthfeOS_nn0R5WbazL1B9xdjoJN9JS2JLR-NiRVBCQ-9wNYCPW0p1O4k-jqrfl9jXrb6mNC0d0AB-YkJLgqJ_3INy8jIjaQ-XRrQDrKr4XelVgZXaE9g-mAYS8rJojXcp5ewKHg4YWWCg Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 06c52dc953594d1d937bdb8737ea5790 Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:28:53.501973 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:28:53.503645 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:53.503645 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.503645 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 06c52dc953594d1d937bdb8737ea5790 Aug 18 11:28:53.503645 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.503645 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-HypervisorAdminNegativeTestJSON-1190952736-project Aug 18 11:28:53.503645 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:28:53.503645 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:28:53.503645 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b4363ae81b714cf9b6c44db98e77514b Aug 18 11:28:53.503645 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736-project Aug 18 11:28:53.503645 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:28:53.503645 n-d-853611-3 devstack@n-api.service[122209]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 18 11:28:53.503645 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '1'} Aug 18 11:28:53.503645 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:28:53.504415 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 18 11:28:53.505543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.515575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-46a13dcb-da82-4d84-8fd0-d49c5bcaffb7 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:53.515575 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-46a13dcb-da82-4d84-8fd0-d49c5bcaffb7 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.017677 Aug 18 11:28:53.515575 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 468/914] 10.222.0.73 () {58 vars in 1173 bytes} [Thu Aug 18 11:28:53 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:53.519684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fae6edba-988d-4256-87b4-e7dc8cfc0f3b tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Calling method '.version_select at 0x7f519fabf550>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:53.521269 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-fae6edba-988d-4256-87b4-e7dc8cfc0f3b tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] HTTP exception thrown: Hypervisor with ID '4e22a050-da2c-4a5a-93de-4261e77784d5' could not be found. Aug 18 11:28:53.543044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8d443519-dfed-4712-a2f8-3ade094cf303 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:53.554576 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8d443519-dfed-4712-a2f8-3ade094cf303 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1322 microversion: 2.1 time: 0.364647 Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fae6edba-988d-4256-87b4-e7dc8cfc0f3b tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Request method failure captured: Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-hypervisors/4e22a050-da2c-4a5a-93de-4261e77784d5/uptime HTTP/1.1 Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iJ02mKvFUDh_KzULpDTabVKwgTRcfvSskzLPD8nJTUQrqNMdo7PQG7HMTwqMzwPc6S1996d5rYOn11mZ_aZ5yioR8728tooGtuglXl5WdSUvhbZKA_qpCPROwtCTu-7VFBZ65Qexpw0pvGMw12a_97QP6Zp5OLozW6s2IymzmEfKfc Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 5f80927f40f04309b9c54fea7e9d0485 Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-322509164 Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:28:53.555819 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:28:53.557180 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5f80927f40f04309b9c54fea7e9d0485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5f80927f40f04309b9c54fea7e9d0485"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5f80927f40f04309b9c54fea7e9d0485"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5f80927f40f04309b9c54fea7e9d0485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:53.557180 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-322509164 Aug 18 11:28:53.557180 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 5f80927f40f04309b9c54fea7e9d0485 Aug 18 11:28:53.557180 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-322509164 Aug 18 11:28:53.557180 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin Aug 18 11:28:53.557180 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:28:53.557180 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:28:53.557180 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 03041391d4ca4ba99e53b679651417d6 Aug 18 11:28:53.557180 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin Aug 18 11:28:53.557180 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:28:53.557180 n-d-853611-3 devstack@n-api.service[122209]: exception: Hypervisor with ID '4e22a050-da2c-4a5a-93de-4261e77784d5' could not be found. Aug 18 11:28:53.557180 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '4e22a050-da2c-4a5a-93de-4261e77784d5'} Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '4e22a050-da2c-4a5a-93de-4261e77784d5' Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 18 11:28:53.558823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '4e22a050-da2c-4a5a-93de-4261e77784d5' could not be found. Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:53.560226 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.561436 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.561436 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:53.561436 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:53.561436 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:53.561436 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:53.561436 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '4e22a050-da2c-4a5a-93de-4261e77784d5' could not be found. Aug 18 11:28:53.561436 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.565419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fae6edba-988d-4256-87b4-e7dc8cfc0f3b tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Returning 404 to user: Hypervisor with ID '4e22a050-da2c-4a5a-93de-4261e77784d5' could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:53.565419 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fae6edba-988d-4256-87b4-e7dc8cfc0f3b tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/4e22a050-da2c-4a5a-93de-4261e77784d5/uptime" status: 404 len: 123 microversion: 2.1 time: 0.048993 Aug 18 11:28:53.565965 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 469/915] 10.222.0.73 () {58 vars in 1278 bytes} [Thu Aug 18 11:28:53 2022] GET /compute/v2.1/os-hypervisors/4e22a050-da2c-4a5a-93de-4261e77784d5/uptime => generated 123 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:53.570347 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 447/916] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:53 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:53.578056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5f6627e9-6ad8-4a1c-98d2-3d2ad9feb8fb tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Calling method '.version_select at 0x7f519fa4dee0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:53.579354 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:53.579354 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:28:53.582831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6627e9-6ad8-4a1c-98d2-3d2ad9feb8fb tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:53.583438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6627e9-6ad8-4a1c-98d2-3d2ad9feb8fb tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:53.584037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6627e9-6ad8-4a1c-98d2-3d2ad9feb8fb tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:53.610353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6627e9-6ad8-4a1c-98d2-3d2ad9feb8fb tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:53.611513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6627e9-6ad8-4a1c-98d2-3d2ad9feb8fb tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:53.612875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6627e9-6ad8-4a1c-98d2-3d2ad9feb8fb tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:53.627242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6627e9-6ad8-4a1c-98d2-3d2ad9feb8fb tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:53.628274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6627e9-6ad8-4a1c-98d2-3d2ad9feb8fb tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:53.629633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6627e9-6ad8-4a1c-98d2-3d2ad9feb8fb tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:53.648944 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5f6627e9-6ad8-4a1c-98d2-3d2ad9feb8fb tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.068724 Aug 18 11:28:53.650133 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 470/917] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:28:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:53.662296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e50d047f-e97c-4a13-b921-2b8a0a1bd321 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Calling method '.version_select at 0x7f519fcd6040>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:53.663164 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:53.663164 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:28:53.664726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e50d047f-e97c-4a13-b921-2b8a0a1bd321 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'b4363ae81b714cf9b6c44db98e77514b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c52dc953594d1d937bdb8737ea5790', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e50d047f-e97c-4a13-b921-2b8a0a1bd321 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Request method failure captured: Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iJykpFT397v7wm8hVb7S73-2yWBn-0kc2jthfeOS_nn0R5WbazL1B9xdjoJN9JS2JLR-NiRVBCQ-9wNYCPW0p1O4k-jqrfl9jXrb6mNC0d0AB-YkJLgqJ_3INy8jIjaQ-XRrQDrKr4XelVgZXaE9g-mAYS8rJojXcp5ewKHg4YWWCg Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 06c52dc953594d1d937bdb8737ea5790 Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:28:53.668470 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:28:53.669823 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/06c52dc953594d1d937bdb8737ea5790"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:53.669823 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.669823 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 06c52dc953594d1d937bdb8737ea5790 Aug 18 11:28:53.669823 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736 Aug 18 11:28:53.669823 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-HypervisorAdminNegativeTestJSON-1190952736-project Aug 18 11:28:53.669823 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:28:53.669823 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:28:53.669823 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: b4363ae81b714cf9b6c44db98e77514b Aug 18 11:28:53.669823 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1190952736-project Aug 18 11:28:53.669823 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:28:53.669823 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 18 11:28:53.669823 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '1'} Aug 18 11:28:53.669823 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:28:53.670725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 18 11:28:53.671881 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.675103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e50d047f-e97c-4a13-b921-2b8a0a1bd321 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:53.675103 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e50d047f-e97c-4a13-b921-2b8a0a1bd321 tempest-HypervisorAdminNegativeTestJSON-1190952736 tempest-HypervisorAdminNegativeTestJSON-1190952736-project] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.013506 Aug 18 11:28:53.675545 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 448/918] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:28:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:53.700701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7435aa5c-e403-41fa-8d8c-6423baae5ac9 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Calling method '.version_select at 0x7f51ac166ca0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:53.702009 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:53.702009 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:28:53.704050 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-7435aa5c-e403-41fa-8d8c-6423baae5ac9 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] HTTP exception thrown: Hypervisor with ID '73b7659d-8d0a-4674-9038-368e7f8be7ab' could not be found. Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7435aa5c-e403-41fa-8d8c-6423baae5ac9 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Request method failure captured: Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-hypervisors/73b7659d-8d0a-4674-9038-368e7f8be7ab HTTP/1.1 Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iJ02mKvFUDh_KzULpDTabVKwgTRcfvSskzLPD8nJTUQrqNMdo7PQG7HMTwqMzwPc6S1996d5rYOn11mZ_aZ5yioR8728tooGtuglXl5WdSUvhbZKA_qpCPROwtCTu-7VFBZ65Qexpw0pvGMw12a_97QP6Zp5OLozW6s2IymzmEfKfc Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 5f80927f40f04309b9c54fea7e9d0485 Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-322509164 Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:28:53.706250 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:28:53.707578 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5f80927f40f04309b9c54fea7e9d0485"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5f80927f40f04309b9c54fea7e9d0485"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5f80927f40f04309b9c54fea7e9d0485"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5f80927f40f04309b9c54fea7e9d0485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:53.707578 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-322509164 Aug 18 11:28:53.707578 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 5f80927f40f04309b9c54fea7e9d0485 Aug 18 11:28:53.707578 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-322509164 Aug 18 11:28:53.707578 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin Aug 18 11:28:53.707578 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:28:53.707578 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:28:53.707578 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 03041391d4ca4ba99e53b679651417d6 Aug 18 11:28:53.707578 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin Aug 18 11:28:53.707578 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:28:53.707578 n-d-853611-3 devstack@n-api.service[122209]: exception: Hypervisor with ID '73b7659d-8d0a-4674-9038-368e7f8be7ab' could not be found. Aug 18 11:28:53.707578 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '73b7659d-8d0a-4674-9038-368e7f8be7ab'} Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '73b7659d-8d0a-4674-9038-368e7f8be7ab' Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 18 11:28:53.708295 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 18 11:28:53.718627 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '73b7659d-8d0a-4674-9038-368e7f8be7ab' could not be found. Aug 18 11:28:53.720975 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.720975 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:53.720975 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.720975 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:53.720975 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:53.720975 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:53.720975 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:53.720975 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:53.720975 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '73b7659d-8d0a-4674-9038-368e7f8be7ab' could not be found. Aug 18 11:28:53.720975 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:53.739960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7435aa5c-e403-41fa-8d8c-6423baae5ac9 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] Returning 404 to user: Hypervisor with ID '73b7659d-8d0a-4674-9038-368e7f8be7ab' could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:53.750799 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7435aa5c-e403-41fa-8d8c-6423baae5ac9 tempest-HypervisorAdminNegativeTestJSON-322509164 tempest-HypervisorAdminNegativeTestJSON-322509164-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors/73b7659d-8d0a-4674-9038-368e7f8be7ab" status: 404 len: 123 microversion: 2.1 time: 0.052514 Aug 18 11:28:53.762190 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 471/919] 10.222.0.73 () {58 vars in 1257 bytes} [Thu Aug 18 11:28:53 2022] GET /compute/v2.1/os-hypervisors/73b7659d-8d0a-4674-9038-368e7f8be7ab => generated 123 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:53.807559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c3c4f2f0-c0ea-47ba-a240-35a03588221d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:53.808368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c3c4f2f0-c0ea-47ba-a240-35a03588221d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:53.820268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3c4f2f0-c0ea-47ba-a240-35a03588221d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:53.823494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3c4f2f0-c0ea-47ba-a240-35a03588221d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:53.826460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3c4f2f0-c0ea-47ba-a240-35a03588221d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:53.827512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3c4f2f0-c0ea-47ba-a240-35a03588221d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:53.828293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3c4f2f0-c0ea-47ba-a240-35a03588221d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:53.829547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3c4f2f0-c0ea-47ba-a240-35a03588221d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:54.081253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-44e336b5-6658-4109-bb11-bde7681e7bc5 tempest-FloatingIPDetailsNegativeTestJSON-166204712 tempest-FloatingIPDetailsNegativeTestJSON-166204712-project] Calling method '.version_select at 0x7f51ac22fee0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:54.235941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG neutronclient.v2_0.client [None req-44e336b5-6658-4109-bb11-bde7681e7bc5 tempest-FloatingIPDetailsNegativeTestJSON-166204712 tempest-FloatingIPDetailsNegativeTestJSON-166204712-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3a42804e-2cd5-4c02-ba37-5c91d390c782 could not be found", "detail": ""}} {{(pid=122209) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:28:54.236832 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-44e336b5-6658-4109-bb11-bde7681e7bc5 tempest-FloatingIPDetailsNegativeTestJSON-166204712 tempest-FloatingIPDetailsNegativeTestJSON-166204712-project] HTTP exception thrown: Floating IP not found for ID 3a42804e-2cd5-4c02-ba37-5c91d390c782 Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-44e336b5-6658-4109-bb11-bde7681e7bc5 tempest-FloatingIPDetailsNegativeTestJSON-166204712 tempest-FloatingIPDetailsNegativeTestJSON-166204712-project] Request method failure captured: Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-floating-ips/3a42804e-2cd5-4c02-ba37-5c91d390c782 HTTP/1.1 Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iJ17jvThWUgK7GzalFdwgyn2iF61_gMpEfCxEyizcevVScmH8PCvcbWYbpKrQg-JO4V4RdPBFrfsvXtQ98r-xEjVqMRYSlOKl2rK9l8aeSJniLyG0_P2s8xMd9lqRN-N6ecdutCLY54w-PYkT9Ew-0jUbduqSvW9_kO4Sr4QfrxBI4 Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 38536031d71d42f7a423d00c534819e7 Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-166204712 Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:28:54.239737 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:28:54.241067 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/38536031d71d42f7a423d00c534819e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/38536031d71d42f7a423d00c534819e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_38536031d71d42f7a423d00c534819e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/38536031d71d42f7a423d00c534819e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:54.241067 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-166204712 Aug 18 11:28:54.241067 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 38536031d71d42f7a423d00c534819e7 Aug 18 11:28:54.241067 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-166204712 Aug 18 11:28:54.241067 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-166204712-project Aug 18 11:28:54.241067 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:28:54.241067 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:28:54.241067 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 044909e197ad4c668b5a98dfed8e98cf Aug 18 11:28:54.241067 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-166204712-project Aug 18 11:28:54.241067 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:28:54.241067 n-d-853611-3 devstack@n-api.service[122209]: exception: Floating IP not found for ID 3a42804e-2cd5-4c02-ba37-5c91d390c782 Aug 18 11:28:54.241067 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3a42804e-2cd5-4c02-ba37-5c91d390c782'} Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:28:54.241854 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3a42804e-2cd5-4c02-ba37-5c91d390c782 could not be found Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9dc1f5c-1971-4ae4-b257-9dc1c951ead1'] Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3a42804e-2cd5-4c02-ba37-5c91d390c782. Aug 18 11:28:54.243071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3a42804e-2cd5-4c02-ba37-5c91d390c782 Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:54.246584 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:54.249781 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:54.249781 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3a42804e-2cd5-4c02-ba37-5c91d390c782 Aug 18 11:28:54.249781 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:28:54.249781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-44e336b5-6658-4109-bb11-bde7681e7bc5 tempest-FloatingIPDetailsNegativeTestJSON-166204712 tempest-FloatingIPDetailsNegativeTestJSON-166204712-project] Returning 404 to user: Floating IP not found for ID 3a42804e-2cd5-4c02-ba37-5c91d390c782 {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:54.249781 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-44e336b5-6658-4109-bb11-bde7681e7bc5 tempest-FloatingIPDetailsNegativeTestJSON-166204712 tempest-FloatingIPDetailsNegativeTestJSON-166204712-project] 10.222.0.73 "GET /compute/v2.1/os-floating-ips/3a42804e-2cd5-4c02-ba37-5c91d390c782" status: 404 len: 111 microversion: 2.1 time: 0.274359 Aug 18 11:28:54.249781 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 472/920] 10.222.0.73 () {58 vars in 1260 bytes} [Thu Aug 18 11:28:53 2022] GET /compute/v2.1/os-floating-ips/3a42804e-2cd5-4c02-ba37-5c91d390c782 => generated 111 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:54.308073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-60464ca4-d515-4987-b7a0-0cbe0d6f1c8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:54.308882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-60464ca4-d515-4987-b7a0-0cbe0d6f1c8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:54.351187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60464ca4-d515-4987-b7a0-0cbe0d6f1c8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:54.353457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60464ca4-d515-4987-b7a0-0cbe0d6f1c8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:54.358465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60464ca4-d515-4987-b7a0-0cbe0d6f1c8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:54.363478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60464ca4-d515-4987-b7a0-0cbe0d6f1c8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:54.366409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60464ca4-d515-4987-b7a0-0cbe0d6f1c8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:54.368805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60464ca4-d515-4987-b7a0-0cbe0d6f1c8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:54.552232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c3c4f2f0-c0ea-47ba-a240-35a03588221d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:54.577550 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c3c4f2f0-c0ea-47ba-a240-35a03588221d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1316 microversion: 2.1 time: 0.774360 Aug 18 11:28:54.581413 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 449/921] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:53 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1316 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:54.597768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd9fd801-50e8-4376-bc9f-e6d06dee4dc6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:54.598759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dd9fd801-50e8-4376-bc9f-e6d06dee4dc6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:54.622330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd9fd801-50e8-4376-bc9f-e6d06dee4dc6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:54.623450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd9fd801-50e8-4376-bc9f-e6d06dee4dc6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:54.624075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd9fd801-50e8-4376-bc9f-e6d06dee4dc6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:54.625023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd9fd801-50e8-4376-bc9f-e6d06dee4dc6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:54.625643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd9fd801-50e8-4376-bc9f-e6d06dee4dc6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:54.626232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd9fd801-50e8-4376-bc9f-e6d06dee4dc6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:55.160947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-60464ca4-d515-4987-b7a0-0cbe0d6f1c8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:55.165212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd9fd801-50e8-4376-bc9f-e6d06dee4dc6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:55.178831 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-60464ca4-d515-4987-b7a0-0cbe0d6f1c8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1311 microversion: 2.1 time: 0.873905 Aug 18 11:28:55.182627 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 473/922] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:54 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1311 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:28:55.182991 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd9fd801-50e8-4376-bc9f-e6d06dee4dc6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1322 microversion: 2.1 time: 0.598353 Aug 18 11:28:55.189618 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 450/923] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:54 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1322 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:55.191080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-10993ae5-2e51-4b5a-87aa-0fd0395db2d5 req-4e752acc-6980-492e-acf8-89e37d51dde8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eefaa19-3ae6-470b-95fd-67dd4755f155", "name": "network-vif-plugged", "status": "completed", "tag": "a489dc0f-db2f-482f-842e-a4db6946ed64"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:55.217995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-10993ae5-2e51-4b5a-87aa-0fd0395db2d5 req-4e752acc-6980-492e-acf8-89e37d51dde8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:55.218542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-10993ae5-2e51-4b5a-87aa-0fd0395db2d5 req-4e752acc-6980-492e-acf8-89e37d51dde8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:55.218985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-10993ae5-2e51-4b5a-87aa-0fd0395db2d5 req-4e752acc-6980-492e-acf8-89e37d51dde8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:55.237441 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-10993ae5-2e51-4b5a-87aa-0fd0395db2d5 req-4e752acc-6980-492e-acf8-89e37d51dde8 service nova] Creating event network-vif-plugged:a489dc0f-db2f-482f-842e-a4db6946ed64 for instance 7eefaa19-3ae6-470b-95fd-67dd4755f155 on n-h1-853611-3 Aug 18 11:28:55.245157 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-10993ae5-2e51-4b5a-87aa-0fd0395db2d5 req-4e752acc-6980-492e-acf8-89e37d51dde8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061009 Aug 18 11:28:55.246215 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 474/924] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:55.389448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-dd09f4a1-a1d3-467b-9776-1e775aa7d825 req-ba36e5eb-4e33-4e41-9d36-827f344af241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ed1e63-d1e3-4419-adcf-2271d73bc72c", "tag": "8ab222ae-f9c9-4f5a-b5b2-e5224f8e7809"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:55.445794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-dd09f4a1-a1d3-467b-9776-1e775aa7d825 req-ba36e5eb-4e33-4e41-9d36-827f344af241 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:55.454654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-dd09f4a1-a1d3-467b-9776-1e775aa7d825 req-ba36e5eb-4e33-4e41-9d36-827f344af241 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:55.456326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-dd09f4a1-a1d3-467b-9776-1e775aa7d825 req-ba36e5eb-4e33-4e41-9d36-827f344af241 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:55.487865 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-dd09f4a1-a1d3-467b-9776-1e775aa7d825 req-ba36e5eb-4e33-4e41-9d36-827f344af241 service nova] Creating event network-changed:8ab222ae-f9c9-4f5a-b5b2-e5224f8e7809 for instance d9ed1e63-d1e3-4419-adcf-2271d73bc72c on n-h2-853611-3 Aug 18 11:28:55.503573 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-dd09f4a1-a1d3-467b-9776-1e775aa7d825 req-ba36e5eb-4e33-4e41-9d36-827f344af241 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152526 Aug 18 11:28:55.507958 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 451/925] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:28:55.609190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aa810c3f-1756-44cf-80a2-07861118243a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:55.609989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-aa810c3f-1756-44cf-80a2-07861118243a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:55.621189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa810c3f-1756-44cf-80a2-07861118243a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:55.621189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa810c3f-1756-44cf-80a2-07861118243a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:55.625909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa810c3f-1756-44cf-80a2-07861118243a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:55.627543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa810c3f-1756-44cf-80a2-07861118243a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:55.630509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa810c3f-1756-44cf-80a2-07861118243a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:55.632028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa810c3f-1756-44cf-80a2-07861118243a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:56.206120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cea26a55-619b-45ec-8df0-1c25bab3991d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:56.206911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cea26a55-619b-45ec-8df0-1c25bab3991d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:56.209621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:56.210324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:56.228405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cea26a55-619b-45ec-8df0-1c25bab3991d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:56.231566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cea26a55-619b-45ec-8df0-1c25bab3991d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:56.243148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cea26a55-619b-45ec-8df0-1c25bab3991d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:56.246031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cea26a55-619b-45ec-8df0-1c25bab3991d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:56.246605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cea26a55-619b-45ec-8df0-1c25bab3991d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:56.251926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cea26a55-619b-45ec-8df0-1c25bab3991d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:56.381384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aa810c3f-1756-44cf-80a2-07861118243a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:56.399658 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aa810c3f-1756-44cf-80a2-07861118243a tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1316 microversion: 2.1 time: 0.795965 Aug 18 11:28:56.405061 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 475/926] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:55 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1316 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:56.430919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cc5bb713-addd-4470-9a27-4e9f01eae12c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:56.440384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cc5bb713-addd-4470-9a27-4e9f01eae12c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:56.459326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc5bb713-addd-4470-9a27-4e9f01eae12c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:56.459905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc5bb713-addd-4470-9a27-4e9f01eae12c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:56.460489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc5bb713-addd-4470-9a27-4e9f01eae12c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:56.464750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc5bb713-addd-4470-9a27-4e9f01eae12c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:56.465505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc5bb713-addd-4470-9a27-4e9f01eae12c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:56.466250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc5bb713-addd-4470-9a27-4e9f01eae12c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:56.556547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cea26a55-619b-45ec-8df0-1c25bab3991d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:56.559439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:56.570944 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cea26a55-619b-45ec-8df0-1c25bab3991d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1494 microversion: 2.1 time: 0.370077 Aug 18 11:28:56.571789 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 452/927] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:56 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1494 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:56.598386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b478159-94ad-4dfe-a4d8-add23bc9af3b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:56.599611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b478159-94ad-4dfe-a4d8-add23bc9af3b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:56.614310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b478159-94ad-4dfe-a4d8-add23bc9af3b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:56.618974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b478159-94ad-4dfe-a4d8-add23bc9af3b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:56.622694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b478159-94ad-4dfe-a4d8-add23bc9af3b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:56.625400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b478159-94ad-4dfe-a4d8-add23bc9af3b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:56.627009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b478159-94ad-4dfe-a4d8-add23bc9af3b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:56.627584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b478159-94ad-4dfe-a4d8-add23bc9af3b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:57.034206 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b478159-94ad-4dfe-a4d8-add23bc9af3b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1645 microversion: 2.1 time: 0.440791 Aug 18 11:28:57.035575 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 453/928] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:56 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1645 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:57.249989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cc5bb713-addd-4470-9a27-4e9f01eae12c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:57.260736 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cc5bb713-addd-4470-9a27-4e9f01eae12c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1322 microversion: 2.1 time: 0.853441 Aug 18 11:28:57.261893 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 476/929] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:56 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1322 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:57.269748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-06ec86a2-d90c-443a-8342-40c489614437 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:57.275214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-06ec86a2-d90c-443a-8342-40c489614437 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:57.285857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-06ec86a2-d90c-443a-8342-40c489614437 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:57.288392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-06ec86a2-d90c-443a-8342-40c489614437 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:57.291045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-06ec86a2-d90c-443a-8342-40c489614437 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:57.294209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-06ec86a2-d90c-443a-8342-40c489614437 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:57.294737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-06ec86a2-d90c-443a-8342-40c489614437 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:57.296327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-06ec86a2-d90c-443a-8342-40c489614437 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:57.377986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab46116c-031a-449f-8c5a-4531ef96bc9c tempest-FloatingIPsNegativeTestJSON-1865373604 tempest-FloatingIPsNegativeTestJSON-1865373604-project] Calling method '.version_select at 0x7f519fc2dd30>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:57.487865 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab46116c-031a-449f-8c5a-4531ef96bc9c tempest-FloatingIPsNegativeTestJSON-1865373604 tempest-FloatingIPsNegativeTestJSON-1865373604-project] 10.222.0.73 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.450586 Aug 18 11:28:57.502589 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 454/930] 10.222.0.73 () {58 vars in 1149 bytes} [Thu Aug 18 11:28:57 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:28:57.502589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-10ddd09f-2822-420f-80e8-96e44febcc9c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:57.503357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-10ddd09f-2822-420f-80e8-96e44febcc9c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:57.545138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10ddd09f-2822-420f-80e8-96e44febcc9c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:57.548185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10ddd09f-2822-420f-80e8-96e44febcc9c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:57.551217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10ddd09f-2822-420f-80e8-96e44febcc9c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:57.551979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10ddd09f-2822-420f-80e8-96e44febcc9c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:57.552445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10ddd09f-2822-420f-80e8-96e44febcc9c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:57.552873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10ddd09f-2822-420f-80e8-96e44febcc9c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:57.772595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-10ddd09f-2822-420f-80e8-96e44febcc9c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:57.784267 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-10ddd09f-2822-420f-80e8-96e44febcc9c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1316 microversion: 2.1 time: 0.288247 Aug 18 11:28:57.785882 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 455/931] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:57 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:57.793439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c61df407-4cb5-4a83-8a64-927100a8f300 tempest-FloatingIPsNegativeTestJSON-1865373604 tempest-FloatingIPsNegativeTestJSON-1865373604-project] Action: 'create', calling method: .version_select at 0x7f519fd83550>, body: {"pool": "non_exist_pool"} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:57.839562 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-c61df407-4cb5-4a83-8a64-927100a8f300 tempest-FloatingIPsNegativeTestJSON-1865373604 tempest-FloatingIPsNegativeTestJSON-1865373604-project] HTTP exception thrown: Floating IP pool not found. Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c61df407-4cb5-4a83-8a64-927100a8f300 tempest-FloatingIPsNegativeTestJSON-1865373604 tempest-FloatingIPsNegativeTestJSON-1865373604-project] Request method failure captured: Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 26 Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iJ4EZD5AQcI6MfM9IvUYzh1y_yF01cPI8TjPZTDMRxUiqk1LkjfQunBN5kxQ7GKzgXKh5peVBgXf_WpVIM66YJwEJ8X2DvGXtixui_7stgnu1j127ni_kzWWza8E4U4GVsck_0lU-oGfSNmcfPfMcSAJbi5oT_2IRUfpXA1q6eWvVI Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 89fe4bfcfbb844a897c392d2d9263c17 Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1865373604 Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:28:57.841758 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89fe4bfcfbb844a897c392d2d9263c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/89fe4bfcfbb844a897c392d2d9263c17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_89fe4bfcfbb844a897c392d2d9263c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89fe4bfcfbb844a897c392d2d9263c17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1865373604 Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 89fe4bfcfbb844a897c392d2d9263c17 Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1865373604 Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FloatingIPsNegativeTestJSON-1865373604-project Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 35a7e15f4d744c29a569520802ccb045 Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1865373604-project Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: {"pool": "non_exist_pool"} Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: exception: Floating IP pool not found. Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 18 11:28:57.843325 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:57.844287 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c61df407-4cb5-4a83-8a64-927100a8f300 tempest-FloatingIPsNegativeTestJSON-1865373604 tempest-FloatingIPsNegativeTestJSON-1865373604-project] Returning 404 to user: Floating IP pool not found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:57.845465 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c61df407-4cb5-4a83-8a64-927100a8f300 tempest-FloatingIPsNegativeTestJSON-1865373604 tempest-FloatingIPsNegativeTestJSON-1865373604-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.055588 Aug 18 11:28:57.846768 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 456/932] 10.222.0.73 () {60 vars in 1170 bytes} [Thu Aug 18 11:28:57 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:28:57.853707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7de39be2-5d86-42d9-b2a5-1c0df8385df1 tempest-FloatingIPsNegativeTestJSON-1865373604 tempest-FloatingIPsNegativeTestJSON-1865373604-project] Calling method '.version_select at 0x7f519fe49b80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:57.875244 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-06ec86a2-d90c-443a-8342-40c489614437 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1645 microversion: 2.1 time: 0.611944 Aug 18 11:28:57.875740 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 477/933] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:57 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1645 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:57.899935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-89229370-5c77-4152-b379-1e1862378b43 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:57.903818 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:28:57.903818 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:28:57.906752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89229370-5c77-4152-b379-1e1862378b43 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:57.907434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89229370-5c77-4152-b379-1e1862378b43 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:57.908995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89229370-5c77-4152-b379-1e1862378b43 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:57.909934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89229370-5c77-4152-b379-1e1862378b43 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:57.913258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-7de39be2-5d86-42d9-b2a5-1c0df8385df1 tempest-FloatingIPsNegativeTestJSON-1865373604 tempest-FloatingIPsNegativeTestJSON-1865373604-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4f45584e-60f2-4b95-80ff-13d608341c68 could not be found", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:28:57.913680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89229370-5c77-4152-b379-1e1862378b43 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:57.914145 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-7de39be2-5d86-42d9-b2a5-1c0df8385df1 tempest-FloatingIPsNegativeTestJSON-1865373604 tempest-FloatingIPsNegativeTestJSON-1865373604-project] HTTP exception thrown: Floating IP not found for ID 4f45584e-60f2-4b95-80ff-13d608341c68 Aug 18 11:28:57.914519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89229370-5c77-4152-b379-1e1862378b43 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7de39be2-5d86-42d9-b2a5-1c0df8385df1 tempest-FloatingIPsNegativeTestJSON-1865373604 tempest-FloatingIPsNegativeTestJSON-1865373604-project] Request method failure captured: Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/os-floating-ips/4f45584e-60f2-4b95-80ff-13d608341c68 HTTP/1.1 Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iJ4EZD5AQcI6MfM9IvUYzh1y_yF01cPI8TjPZTDMRxUiqk1LkjfQunBN5kxQ7GKzgXKh5peVBgXf_WpVIM66YJwEJ8X2DvGXtixui_7stgnu1j127ni_kzWWza8E4U4GVsck_0lU-oGfSNmcfPfMcSAJbi5oT_2IRUfpXA1q6eWvVI Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 89fe4bfcfbb844a897c392d2d9263c17 Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1865373604 Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:28:57.920520 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:28:57.922198 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89fe4bfcfbb844a897c392d2d9263c17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/89fe4bfcfbb844a897c392d2d9263c17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_89fe4bfcfbb844a897c392d2d9263c17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/89fe4bfcfbb844a897c392d2d9263c17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:28:57.922198 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1865373604 Aug 18 11:28:57.922198 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 89fe4bfcfbb844a897c392d2d9263c17 Aug 18 11:28:57.922198 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1865373604 Aug 18 11:28:57.922198 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FloatingIPsNegativeTestJSON-1865373604-project Aug 18 11:28:57.922198 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:28:57.922198 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:28:57.922198 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 35a7e15f4d744c29a569520802ccb045 Aug 18 11:28:57.922198 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1865373604-project Aug 18 11:28:57.922198 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:28:57.922198 n-d-853611-3 devstack@n-api.service[122210]: exception: Floating IP not found for ID 4f45584e-60f2-4b95-80ff-13d608341c68 Aug 18 11:28:57.922198 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '4f45584e-60f2-4b95-80ff-13d608341c68'} Aug 18 11:28:57.922198 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:28:57.923309 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 4f45584e-60f2-4b95-80ff-13d608341c68 could not be found Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-17e3702d-8b52-408e-9903-8f2aae51c9c0'] Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 4f45584e-60f2-4b95-80ff-13d608341c68. Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:57.924428 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 4f45584e-60f2-4b95-80ff-13d608341c68 Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:28:57.927444 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:28:57.930323 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 4f45584e-60f2-4b95-80ff-13d608341c68 Aug 18 11:28:57.930323 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:28:57.932308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7de39be2-5d86-42d9-b2a5-1c0df8385df1 tempest-FloatingIPsNegativeTestJSON-1865373604 tempest-FloatingIPsNegativeTestJSON-1865373604-project] Returning 404 to user: Floating IP not found for ID 4f45584e-60f2-4b95-80ff-13d608341c68 {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:28:57.933679 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7de39be2-5d86-42d9-b2a5-1c0df8385df1 tempest-FloatingIPsNegativeTestJSON-1865373604 tempest-FloatingIPsNegativeTestJSON-1865373604-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/4f45584e-60f2-4b95-80ff-13d608341c68" status: 404 len: 111 microversion: 2.1 time: 0.084492 Aug 18 11:28:57.939676 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 457/934] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:28:57 2022] DELETE /compute/v2.1/os-floating-ips/4f45584e-60f2-4b95-80ff-13d608341c68 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:28:57.977957 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-89229370-5c77-4152-b379-1e1862378b43 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.081625 Aug 18 11:28:57.979478 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 478/935] 10.222.0.73 () {58 vars in 1176 bytes} [Thu Aug 18 11:28:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:28:57.995558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e749193f-7fc4-4e2c-aa71-1cfdc8ca13cc tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:28:57.996375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e749193f-7fc4-4e2c-aa71-1cfdc8ca13cc tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:58.009927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:58.014966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e749193f-7fc4-4e2c-aa71-1cfdc8ca13cc tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:58.015773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e749193f-7fc4-4e2c-aa71-1cfdc8ca13cc tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:58.016436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e749193f-7fc4-4e2c-aa71-1cfdc8ca13cc tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:58.018900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e749193f-7fc4-4e2c-aa71-1cfdc8ca13cc tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:58.019786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e749193f-7fc4-4e2c-aa71-1cfdc8ca13cc tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:58.023796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e749193f-7fc4-4e2c-aa71-1cfdc8ca13cc tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:58.198168 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e749193f-7fc4-4e2c-aa71-1cfdc8ca13cc tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22/action" status: 202 len: 0 microversion: 2.1 time: 0.209726 Aug 18 11:28:58.203908 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 458/936] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:28:57 2022] POST /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:28:58.211709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7f858d2b-0c8a-4618-a537-adc8f4d33476 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:58.211709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7f858d2b-0c8a-4618-a537-adc8f4d33476 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:58.222202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:28:58.226335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f858d2b-0c8a-4618-a537-adc8f4d33476 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:58.226926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f858d2b-0c8a-4618-a537-adc8f4d33476 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:58.227378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f858d2b-0c8a-4618-a537-adc8f4d33476 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:58.228116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f858d2b-0c8a-4618-a537-adc8f4d33476 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:58.228575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f858d2b-0c8a-4618-a537-adc8f4d33476 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:58.237844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f858d2b-0c8a-4618-a537-adc8f4d33476 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:58.288519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8c27df4e-cfbc-4553-b8b9-826ae806702e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:58.289231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8c27df4e-cfbc-4553-b8b9-826ae806702e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:58.306278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c27df4e-cfbc-4553-b8b9-826ae806702e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:58.312766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c27df4e-cfbc-4553-b8b9-826ae806702e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:58.315379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c27df4e-cfbc-4553-b8b9-826ae806702e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:58.316490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c27df4e-cfbc-4553-b8b9-826ae806702e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:58.318314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c27df4e-cfbc-4553-b8b9-826ae806702e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:58.320158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c27df4e-cfbc-4553-b8b9-826ae806702e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:58.773253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8c27df4e-cfbc-4553-b8b9-826ae806702e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:58.788208 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8c27df4e-cfbc-4553-b8b9-826ae806702e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1322 microversion: 2.1 time: 0.500316 Aug 18 11:28:58.788987 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 459/937] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:58 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:28:58.813384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fffb0b77-b796-47c6-bacc-ce9bd7705abb tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:58.815969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fffb0b77-b796-47c6-bacc-ce9bd7705abb tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:58.835565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fffb0b77-b796-47c6-bacc-ce9bd7705abb tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:58.838646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fffb0b77-b796-47c6-bacc-ce9bd7705abb tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:58.839232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fffb0b77-b796-47c6-bacc-ce9bd7705abb tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:58.841242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fffb0b77-b796-47c6-bacc-ce9bd7705abb tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:58.843562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fffb0b77-b796-47c6-bacc-ce9bd7705abb tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:58.845591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fffb0b77-b796-47c6-bacc-ce9bd7705abb tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:58.890088 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7f858d2b-0c8a-4618-a537-adc8f4d33476 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1650 microversion: 2.1 time: 0.683041 Aug 18 11:28:58.892755 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 479/938] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:58 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1650 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:28:59.200739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fffb0b77-b796-47c6-bacc-ce9bd7705abb tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:28:59.210726 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fffb0b77-b796-47c6-bacc-ce9bd7705abb tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1465 microversion: 2.1 time: 0.408646 Aug 18 11:28:59.216556 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 460/939] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:58 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1465 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:28:59.239046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-61e2a7f3-a786-4af2-b267-90558e80bee9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:59.239684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-61e2a7f3-a786-4af2-b267-90558e80bee9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:59.248602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61e2a7f3-a786-4af2-b267-90558e80bee9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:59.249103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61e2a7f3-a786-4af2-b267-90558e80bee9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:59.249550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61e2a7f3-a786-4af2-b267-90558e80bee9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:59.250264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61e2a7f3-a786-4af2-b267-90558e80bee9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:59.250753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61e2a7f3-a786-4af2-b267-90558e80bee9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:59.251180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61e2a7f3-a786-4af2-b267-90558e80bee9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:59.811709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2bbf005f-4252-4722-881c-76b48ed4e327 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:28:59.813789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2bbf005f-4252-4722-881c-76b48ed4e327 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:28:59.827827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bbf005f-4252-4722-881c-76b48ed4e327 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:59.829022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bbf005f-4252-4722-881c-76b48ed4e327 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:59.833714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bbf005f-4252-4722-881c-76b48ed4e327 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:28:59.834909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bbf005f-4252-4722-881c-76b48ed4e327 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:28:59.835595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bbf005f-4252-4722-881c-76b48ed4e327 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:28:59.836182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bbf005f-4252-4722-881c-76b48ed4e327 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:00.196878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2bbf005f-4252-4722-881c-76b48ed4e327 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:00.206108 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2bbf005f-4252-4722-881c-76b48ed4e327 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1322 microversion: 2.1 time: 0.400399 Aug 18 11:29:00.206924 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 461/940] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:59 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:00.213128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1738001411", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "d0a3b2b0-b08b-4498-bc9d-af64e9bcff20"}], "security_groups": [{"name": "tempest-securitygroup--149805058"}], "key_name": "tempest-keypair-58552124", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:00.281002 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-61e2a7f3-a786-4af2-b267-90558e80bee9 tempest-ServersOnMultiNodesTest-1409902096 tempest-ServersOnMultiNodesTest-1409902096-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1616 microversion: 2.1 time: 1.046365 Aug 18 11:29:00.295422 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 480/941] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:28:59 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1616 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:00.302357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e8801346-f63d-4fed-8821-bbe2fbb2921e tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:00.303677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e8801346-f63d-4fed-8821-bbe2fbb2921e tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:00.311442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8801346-f63d-4fed-8821-bbe2fbb2921e tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:00.312086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8801346-f63d-4fed-8821-bbe2fbb2921e tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:00.312862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8801346-f63d-4fed-8821-bbe2fbb2921e tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:00.313689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8801346-f63d-4fed-8821-bbe2fbb2921e tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:00.314380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8801346-f63d-4fed-8821-bbe2fbb2921e tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:00.314877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8801346-f63d-4fed-8821-bbe2fbb2921e tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:00.678691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] validate_networks() for [('d0a3b2b0-b08b-4498-bc9d-af64e9bcff20', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:29:00.681222 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e8801346-f63d-4fed-8821-bbe2fbb2921e tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1630 microversion: 2.1 time: 0.383518 Aug 18 11:29:00.702542 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 481/942] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:00 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1630 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:00.936762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6092e079-0c49-4f05-a655-159226c9f450 tempest-NetworksTest-303755315 tempest-NetworksTest-303755315-project-admin] Calling method '.version_select at 0x7f519ffc59d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:01.657770 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6092e079-0c49-4f05-a655-159226c9f450 tempest-NetworksTest-303755315 tempest-NetworksTest-303755315-project-admin] 10.222.0.73 "GET /compute/v2.1/os-networks" status: 200 len: 7431 microversion: 2.1 time: 0.953402 Aug 18 11:29:01.662230 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 482/943] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:29:00 2022] GET /compute/v2.1/os-networks => generated 7431 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:01.670521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a6c65b88-21ca-46b4-bba6-9efdad361c5c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:01.671177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a6c65b88-21ca-46b4-bba6-9efdad361c5c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:01.704110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6c65b88-21ca-46b4-bba6-9efdad361c5c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:01.705087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6c65b88-21ca-46b4-bba6-9efdad361c5c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:01.720275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:29:01.723631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6c65b88-21ca-46b4-bba6-9efdad361c5c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:01.724653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:29:01.724958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6c65b88-21ca-46b4-bba6-9efdad361c5c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:01.725515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6c65b88-21ca-46b4-bba6-9efdad361c5c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:01.725707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:29:01.726284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:29:01.726903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:29:01.729125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6c65b88-21ca-46b4-bba6-9efdad361c5c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:01.739583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:01.740065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:01.740708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:01.741631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:01.742252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:01.743122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:01.794080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a6c65b88-21ca-46b4-bba6-9efdad361c5c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:29:01.798886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Getting quotas for project 51319140bae948cf873746a482aaf588. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:01.811453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Getting quotas for user 36162046d3d84db98ce76b19770f6322 and project 51319140bae948cf873746a482aaf588. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:01.846782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:29:01.852232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:29:01.959554 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a6c65b88-21ca-46b4-bba6-9efdad361c5c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 204 len: 0 microversion: 2.1 time: 0.292003 Aug 18 11:29:01.960510 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 483/944] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:29:01 2022] DELETE /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:01.970043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9f0efaa3-c868-4608-b4a2-4d259be9bc9d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-853611-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:01.973682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9f0efaa3-c868-4608-b4a2-4d259be9bc9d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:01.983784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f0efaa3-c868-4608-b4a2-4d259be9bc9d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:01.987931 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4863956b-0dce-4814-82ea-b06ef73a9bf7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.778590 Aug 18 11:29:01.988197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f0efaa3-c868-4608-b4a2-4d259be9bc9d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:01.990277 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 462/945] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:29:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 11:29:01.998930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f0efaa3-c868-4608-b4a2-4d259be9bc9d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:02.000158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f0efaa3-c868-4608-b4a2-4d259be9bc9d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:02.002883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f0efaa3-c868-4608-b4a2-4d259be9bc9d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:02.003544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f0efaa3-c868-4608-b4a2-4d259be9bc9d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:02.015312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-514f118a-f4e7-4392-97bd-152ba9fbceae tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:02.019055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-514f118a-f4e7-4392-97bd-152ba9fbceae tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:02.037808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-514f118a-f4e7-4392-97bd-152ba9fbceae tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:02.039376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-514f118a-f4e7-4392-97bd-152ba9fbceae tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:02.042296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-514f118a-f4e7-4392-97bd-152ba9fbceae tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:02.043978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-514f118a-f4e7-4392-97bd-152ba9fbceae tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:02.045090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-514f118a-f4e7-4392-97bd-152ba9fbceae tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:02.046722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-514f118a-f4e7-4392-97bd-152ba9fbceae tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:02.230297 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-9f0efaa3-c868-4608-b4a2-4d259be9bc9d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lazy-loading 'flavor' on Instance uuid 995b6878-0830-4d2c-87ca-d3eed8a35f22 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:29:02.344245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9f0efaa3-c868-4608-b4a2-4d259be9bc9d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Going to try to live migrate instance to n-h1-853611-3 {{(pid=122209) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 18 11:29:02.412280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=14 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:02.418850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-514f118a-f4e7-4392-97bd-152ba9fbceae tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:02.442077 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-514f118a-f4e7-4392-97bd-152ba9fbceae tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1322 microversion: 2.1 time: 0.447441 Aug 18 11:29:02.443078 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 463/946] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:01 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:02.460486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-67471d88-20a5-4c76-a390-e6c04376025d tempest-NetworksTest-303755315 tempest-NetworksTest-303755315-project-admin] Calling method '.version_select at 0x7f51ac37f940>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:02.754617 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-67471d88-20a5-4c76-a390-e6c04376025d tempest-NetworksTest-303755315 tempest-NetworksTest-303755315-project-admin] 10.222.0.73 "GET /compute/v2.1/os-networks/00ac6dac-3b97-4d4d-b1c0-f9ef06cd8cc0" status: 200 len: 652 microversion: 2.1 time: 0.310136 Aug 18 11:29:02.755242 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 464/947] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:29:02 2022] GET /compute/v2.1/os-networks/00ac6dac-3b97-4d4d-b1c0-f9ef06cd8cc0 => generated 652 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:02.766312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0dca1e47-0fd2-4355-abf4-f9d85d387df5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:02.767037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0dca1e47-0fd2-4355-abf4-f9d85d387df5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:02.783116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dca1e47-0fd2-4355-abf4-f9d85d387df5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:02.783557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dca1e47-0fd2-4355-abf4-f9d85d387df5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:02.786995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dca1e47-0fd2-4355-abf4-f9d85d387df5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:02.787742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dca1e47-0fd2-4355-abf4-f9d85d387df5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:02.788786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dca1e47-0fd2-4355-abf4-f9d85d387df5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:02.789438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dca1e47-0fd2-4355-abf4-f9d85d387df5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:03.293791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0dca1e47-0fd2-4355-abf4-f9d85d387df5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:03.310779 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0dca1e47-0fd2-4355-abf4-f9d85d387df5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1471 microversion: 2.1 time: 0.548439 Aug 18 11:29:03.311705 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 465/948] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:02 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1471 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:03.334652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b9185651-60f9-4391-a43f-4f279b265a2d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:03.336755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b9185651-60f9-4391-a43f-4f279b265a2d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:03.349931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9185651-60f9-4391-a43f-4f279b265a2d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:03.350927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9185651-60f9-4391-a43f-4f279b265a2d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:03.352216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9185651-60f9-4391-a43f-4f279b265a2d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:03.353207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9185651-60f9-4391-a43f-4f279b265a2d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:03.354659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9185651-60f9-4391-a43f-4f279b265a2d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:03.355460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9185651-60f9-4391-a43f-4f279b265a2d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:03.571300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b9185651-60f9-4391-a43f-4f279b265a2d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:03.586641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b9185651-60f9-4391-a43f-4f279b265a2d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:03.595008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b9185651-60f9-4391-a43f-4f279b265a2d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:03.603157 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b9185651-60f9-4391-a43f-4f279b265a2d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1288 microversion: 2.25 time: 0.286097 Aug 18 11:29:03.606225 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 466/949] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:29:03 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1288 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:03.618337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eb0eb858-c853-4db5-9eba-355ef14dade1 tempest-NetworksTest-303755315 tempest-NetworksTest-303755315-project-admin] Calling method '.version_select at 0x7f51ac1ffdc0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:04.099087 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eb0eb858-c853-4db5-9eba-355ef14dade1 tempest-NetworksTest-303755315 tempest-NetworksTest-303755315-project-admin] 10.222.0.73 "GET /compute/v2.1/os-networks" status: 200 len: 7431 microversion: 2.1 time: 0.491528 Aug 18 11:29:04.106535 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 467/950] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:29:03 2022] GET /compute/v2.1/os-networks => generated 7431 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:04.111735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-6e0c1dd8-dc22-44c2-a769-1e10809af66c req-5afd58d2-9e41-45be-b4b3-85b4427f1560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ed1e63-d1e3-4419-adcf-2271d73bc72c", "name": "network-vif-plugged", "status": "completed", "tag": "8ab222ae-f9c9-4f5a-b5b2-e5224f8e7809"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:04.147887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6e0c1dd8-dc22-44c2-a769-1e10809af66c req-5afd58d2-9e41-45be-b4b3-85b4427f1560 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:04.148645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6e0c1dd8-dc22-44c2-a769-1e10809af66c req-5afd58d2-9e41-45be-b4b3-85b4427f1560 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:04.151594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6e0c1dd8-dc22-44c2-a769-1e10809af66c req-5afd58d2-9e41-45be-b4b3-85b4427f1560 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:04.189029 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6e0c1dd8-dc22-44c2-a769-1e10809af66c req-5afd58d2-9e41-45be-b4b3-85b4427f1560 service nova] Creating event network-vif-plugged:8ab222ae-f9c9-4f5a-b5b2-e5224f8e7809 for instance d9ed1e63-d1e3-4419-adcf-2271d73bc72c on n-h2-853611-3 Aug 18 11:29:04.196330 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-6e0c1dd8-dc22-44c2-a769-1e10809af66c req-5afd58d2-9e41-45be-b4b3-85b4427f1560 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088472 Aug 18 11:29:04.198563 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 468/951] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:04.213560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f1a68e58-9308-4cee-b146-05b507c22b7f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:04.215741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f1a68e58-9308-4cee-b146-05b507c22b7f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:04.241616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1a68e58-9308-4cee-b146-05b507c22b7f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:04.242156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1a68e58-9308-4cee-b146-05b507c22b7f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:04.242610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1a68e58-9308-4cee-b146-05b507c22b7f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:04.243321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1a68e58-9308-4cee-b146-05b507c22b7f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:04.243815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1a68e58-9308-4cee-b146-05b507c22b7f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:04.248191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1a68e58-9308-4cee-b146-05b507c22b7f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:04.793695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f1a68e58-9308-4cee-b146-05b507c22b7f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:04.802423 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f1a68e58-9308-4cee-b146-05b507c22b7f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1322 microversion: 2.1 time: 0.600816 Aug 18 11:29:04.803079 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 469/952] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:04 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1322 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:04.808784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e2c9d44-f3f4-4f74-828e-0b8bc96addee tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:04.809391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e2c9d44-f3f4-4f74-828e-0b8bc96addee tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:04.817638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2c9d44-f3f4-4f74-828e-0b8bc96addee tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:04.818353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2c9d44-f3f4-4f74-828e-0b8bc96addee tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:04.818956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2c9d44-f3f4-4f74-828e-0b8bc96addee tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:04.819815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2c9d44-f3f4-4f74-828e-0b8bc96addee tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:04.820409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2c9d44-f3f4-4f74-828e-0b8bc96addee tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:04.820970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2c9d44-f3f4-4f74-828e-0b8bc96addee tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:05.199778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e2c9d44-f3f4-4f74-828e-0b8bc96addee tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:05.219479 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e2c9d44-f3f4-4f74-828e-0b8bc96addee tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1471 microversion: 2.1 time: 0.415067 Aug 18 11:29:05.220054 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 470/953] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:04 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1471 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:05.225041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4031f533-5047-4b1e-9688-42083989b987 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:05.225650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4031f533-5047-4b1e-9688-42083989b987 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:05.238694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4031f533-5047-4b1e-9688-42083989b987 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:05.239186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4031f533-5047-4b1e-9688-42083989b987 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:05.239618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4031f533-5047-4b1e-9688-42083989b987 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:05.240519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4031f533-5047-4b1e-9688-42083989b987 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:05.241148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4031f533-5047-4b1e-9688-42083989b987 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:05.241729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4031f533-5047-4b1e-9688-42083989b987 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:05.443440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4031f533-5047-4b1e-9688-42083989b987 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:05.454067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4031f533-5047-4b1e-9688-42083989b987 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:05.455589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4031f533-5047-4b1e-9688-42083989b987 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:05.459928 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4031f533-5047-4b1e-9688-42083989b987 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1342 microversion: 2.25 time: 0.238868 Aug 18 11:29:05.460484 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 471/954] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:29:05 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1342 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:05.663851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7eaecf3f-e89c-4786-85c2-b848c35b5991 req-cb999d5f-bda5-4f28-b8a5-e1b959b5e763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eefaa19-3ae6-470b-95fd-67dd4755f155", "name": "network-vif-deleted", "tag": "a489dc0f-db2f-482f-842e-a4db6946ed64"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:05.685094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7eaecf3f-e89c-4786-85c2-b848c35b5991 req-cb999d5f-bda5-4f28-b8a5-e1b959b5e763 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:05.685589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7eaecf3f-e89c-4786-85c2-b848c35b5991 req-cb999d5f-bda5-4f28-b8a5-e1b959b5e763 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:05.686015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7eaecf3f-e89c-4786-85c2-b848c35b5991 req-cb999d5f-bda5-4f28-b8a5-e1b959b5e763 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:05.728608 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7eaecf3f-e89c-4786-85c2-b848c35b5991 req-cb999d5f-bda5-4f28-b8a5-e1b959b5e763 service nova] Creating event network-vif-deleted:a489dc0f-db2f-482f-842e-a4db6946ed64 for instance 7eefaa19-3ae6-470b-95fd-67dd4755f155 on n-h1-853611-3 Aug 18 11:29:05.745205 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7eaecf3f-e89c-4786-85c2-b848c35b5991 req-cb999d5f-bda5-4f28-b8a5-e1b959b5e763 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085975 Aug 18 11:29:05.745833 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 472/955] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:29:05.833312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fc2ca171-022d-419c-b738-8bcf70a113e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:05.834953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fc2ca171-022d-419c-b738-8bcf70a113e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:05.861905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc2ca171-022d-419c-b738-8bcf70a113e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:05.863165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc2ca171-022d-419c-b738-8bcf70a113e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:05.863958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc2ca171-022d-419c-b738-8bcf70a113e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:05.865236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc2ca171-022d-419c-b738-8bcf70a113e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:05.866044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc2ca171-022d-419c-b738-8bcf70a113e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:05.866793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc2ca171-022d-419c-b738-8bcf70a113e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:06.278941 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9f0efaa3-c868-4608-b4a2-4d259be9bc9d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22/action" status: 202 len: 0 microversion: 2.1 time: 4.313659 Aug 18 11:29:06.280188 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 484/956] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:29:01 2022] POST /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22/action => generated 0 bytes in 4319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:29:06.289556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2a3771be-4964-4ca1-9883-b9cf560c9c0d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:06.291230 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2a3771be-4964-4ca1-9883-b9cf560c9c0d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:06.318581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3771be-4964-4ca1-9883-b9cf560c9c0d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:06.320199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3771be-4964-4ca1-9883-b9cf560c9c0d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:06.321766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3771be-4964-4ca1-9883-b9cf560c9c0d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:06.326334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3771be-4964-4ca1-9883-b9cf560c9c0d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:06.328263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3771be-4964-4ca1-9883-b9cf560c9c0d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:06.330886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3771be-4964-4ca1-9883-b9cf560c9c0d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:06.420793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3771be-4964-4ca1-9883-b9cf560c9c0d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:06.421828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3771be-4964-4ca1-9883-b9cf560c9c0d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:06.422497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3771be-4964-4ca1-9883-b9cf560c9c0d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:06.423157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-2a3771be-4964-4ca1-9883-b9cf560c9c0d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lazy-loading 'fault' on Instance uuid 7eefaa19-3ae6-470b-95fd-67dd4755f155 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:29:06.477681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2a3771be-4964-4ca1-9883-b9cf560c9c0d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:06.501445 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2a3771be-4964-4ca1-9883-b9cf560c9c0d tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 200 len: 1306 microversion: 2.1 time: 0.219810 Aug 18 11:29:06.504031 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 485/957] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:06 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 1306 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:06.518600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d83da093-9ede-4c4a-a8a4-b69cd6439b97 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:06.520364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d83da093-9ede-4c4a-a8a4-b69cd6439b97 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:06.530673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d83da093-9ede-4c4a-a8a4-b69cd6439b97 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:06.531664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d83da093-9ede-4c4a-a8a4-b69cd6439b97 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:06.532322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d83da093-9ede-4c4a-a8a4-b69cd6439b97 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:06.533462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d83da093-9ede-4c4a-a8a4-b69cd6439b97 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:06.534650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d83da093-9ede-4c4a-a8a4-b69cd6439b97 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:06.535314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d83da093-9ede-4c4a-a8a4-b69cd6439b97 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:06.865301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d83da093-9ede-4c4a-a8a4-b69cd6439b97 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:06.868855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:06.878147 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d83da093-9ede-4c4a-a8a4-b69cd6439b97 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1504 microversion: 2.1 time: 0.368906 Aug 18 11:29:06.879269 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 486/958] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:06 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:06.884282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d5f6b4ff-5cfe-4252-b04a-7872ed73a155 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:06.885294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d5f6b4ff-5cfe-4252-b04a-7872ed73a155 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:06.898053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5f6b4ff-5cfe-4252-b04a-7872ed73a155 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:06.898957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5f6b4ff-5cfe-4252-b04a-7872ed73a155 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:06.901564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5f6b4ff-5cfe-4252-b04a-7872ed73a155 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:06.902659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5f6b4ff-5cfe-4252-b04a-7872ed73a155 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:06.903326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5f6b4ff-5cfe-4252-b04a-7872ed73a155 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:06.903984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5f6b4ff-5cfe-4252-b04a-7872ed73a155 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:06.959620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fc2ca171-022d-419c-b738-8bcf70a113e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:06.968789 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fc2ca171-022d-419c-b738-8bcf70a113e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1322 microversion: 2.1 time: 1.142393 Aug 18 11:29:06.969299 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 473/959] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:05 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1322 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:07.020935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d5f6b4ff-5cfe-4252-b04a-7872ed73a155 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:07.030357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d5f6b4ff-5cfe-4252-b04a-7872ed73a155 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:07.032156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d5f6b4ff-5cfe-4252-b04a-7872ed73a155 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:07.033521 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d5f6b4ff-5cfe-4252-b04a-7872ed73a155 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1342 microversion: 2.25 time: 0.153100 Aug 18 11:29:07.046917 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 487/960] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:29:06 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:07.536544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94baaf47-3ac0-45fc-8041-1253d6cf30b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:07.537455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-94baaf47-3ac0-45fc-8041-1253d6cf30b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 7eefaa19-3ae6-470b-95fd-67dd4755f155] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:07.549908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94baaf47-3ac0-45fc-8041-1253d6cf30b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:07.553732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94baaf47-3ac0-45fc-8041-1253d6cf30b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:07.554464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94baaf47-3ac0-45fc-8041-1253d6cf30b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:07.555847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94baaf47-3ac0-45fc-8041-1253d6cf30b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:07.557375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94baaf47-3ac0-45fc-8041-1253d6cf30b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:07.558411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94baaf47-3ac0-45fc-8041-1253d6cf30b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:07.659967 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-94baaf47-3ac0-45fc-8041-1253d6cf30b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] HTTP exception thrown: Instance 7eefaa19-3ae6-470b-95fd-67dd4755f155 could not be found. Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94baaf47-3ac0-45fc-8041-1253d6cf30b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Request method failure captured: Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 HTTP/1.1 Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iHIwwevFwKV8xm18kbPD3Ciy8CvScg1fDfl7wNmdQTnBTrBT97kbGF3NuiwyTQZfFarL5ZQ_ovW6qJoZzgynXj2UZuYP-JiihvsYTyFfdjisb-mFUTjTlzA9uSeEs_Ej_djUg_OyBjwyPw77sh7iTNOfHkUZhc2sk4s13i0I8-Szeo Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:29:07.665748 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:29:07.667535 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:07.667535 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:07.667535 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:07.667535 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:07.667535 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:07.667535 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:29:07.667535 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:29:07.667535 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: b75d06aa767c4f7799209c7d0fe23d2c Aug 18 11:29:07.667535 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:07.667535 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:29:07.667535 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 7eefaa19-3ae6-470b-95fd-67dd4755f155 could not be found. Aug 18 11:29:07.667535 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '7eefaa19-3ae6-470b-95fd-67dd4755f155'} Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eefaa19-3ae6-470b-95fd-67dd4755f155 could not be found. Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:07.668410 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eefaa19-3ae6-470b-95fd-67dd4755f155 could not be found. Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eefaa19-3ae6-470b-95fd-67dd4755f155 could not be found. Aug 18 11:29:07.669951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:07.672815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94baaf47-3ac0-45fc-8041-1253d6cf30b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Returning 404 to user: Instance 7eefaa19-3ae6-470b-95fd-67dd4755f155 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:07.672815 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-94baaf47-3ac0-45fc-8041-1253d6cf30b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155" status: 404 len: 111 microversion: 2.1 time: 0.147975 Aug 18 11:29:07.672815 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 474/961] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:07 2022] GET /compute/v2.1/servers/7eefaa19-3ae6-470b-95fd-67dd4755f155 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:29:07.682085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-76cb4065-571f-48db-b20d-8ecae96b8dcd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:07.682823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-76cb4065-571f-48db-b20d-8ecae96b8dcd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:07.695314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76cb4065-571f-48db-b20d-8ecae96b8dcd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:07.696062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76cb4065-571f-48db-b20d-8ecae96b8dcd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:07.699374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76cb4065-571f-48db-b20d-8ecae96b8dcd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:07.700586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76cb4065-571f-48db-b20d-8ecae96b8dcd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:07.701944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76cb4065-571f-48db-b20d-8ecae96b8dcd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:07.705271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76cb4065-571f-48db-b20d-8ecae96b8dcd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:07.778928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-76cb4065-571f-48db-b20d-8ecae96b8dcd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:29:07.906950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-745dc953-ef0e-46e8-9a39-a18397399d63 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:07.910114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-745dc953-ef0e-46e8-9a39-a18397399d63 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:07.931805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:07.936723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-745dc953-ef0e-46e8-9a39-a18397399d63 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:07.940307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-745dc953-ef0e-46e8-9a39-a18397399d63 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:07.940843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-745dc953-ef0e-46e8-9a39-a18397399d63 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:07.941597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-745dc953-ef0e-46e8-9a39-a18397399d63 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:07.942091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-745dc953-ef0e-46e8-9a39-a18397399d63 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:07.945368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-745dc953-ef0e-46e8-9a39-a18397399d63 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:08.032220 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-76cb4065-571f-48db-b20d-8ecae96b8dcd tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "DELETE /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 204 len: 0 microversion: 2.1 time: 0.355497 Aug 18 11:29:08.037212 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 488/962] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:29:07 2022] DELETE /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:08.090986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-311d023e-3145-4bf5-86d7-4aa328ec75e2 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:08.094988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-311d023e-3145-4bf5-86d7-4aa328ec75e2 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:08.111205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-311d023e-3145-4bf5-86d7-4aa328ec75e2 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:08.112536 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-311d023e-3145-4bf5-86d7-4aa328ec75e2 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:08.113003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-311d023e-3145-4bf5-86d7-4aa328ec75e2 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:08.116026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-311d023e-3145-4bf5-86d7-4aa328ec75e2 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:08.120746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-311d023e-3145-4bf5-86d7-4aa328ec75e2 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:08.120746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-311d023e-3145-4bf5-86d7-4aa328ec75e2 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:08.421651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-311d023e-3145-4bf5-86d7-4aa328ec75e2 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:08.430853 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-311d023e-3145-4bf5-86d7-4aa328ec75e2 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1472 microversion: 2.1 time: 0.391112 Aug 18 11:29:08.443677 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 489/963] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:08 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1472 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:08.456908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-25e1558e-64f2-4582-b7f3-f35dcf18b0ad tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:08.457789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-25e1558e-64f2-4582-b7f3-f35dcf18b0ad tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:08.464994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25e1558e-64f2-4582-b7f3-f35dcf18b0ad tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:08.465912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25e1558e-64f2-4582-b7f3-f35dcf18b0ad tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:08.466349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25e1558e-64f2-4582-b7f3-f35dcf18b0ad tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:08.467092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25e1558e-64f2-4582-b7f3-f35dcf18b0ad tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:08.467610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25e1558e-64f2-4582-b7f3-f35dcf18b0ad tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:08.468036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25e1558e-64f2-4582-b7f3-f35dcf18b0ad tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:08.537529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-745dc953-ef0e-46e8-9a39-a18397399d63 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:08.546156 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-745dc953-ef0e-46e8-9a39-a18397399d63 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1504 microversion: 2.1 time: 0.649930 Aug 18 11:29:08.549707 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 475/964] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:07 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1504 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:08.560511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-42f23c27-9e25-4cf4-acdf-b588629ba781 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:08.563787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-42f23c27-9e25-4cf4-acdf-b588629ba781 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:08.578796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42f23c27-9e25-4cf4-acdf-b588629ba781 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:08.591223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42f23c27-9e25-4cf4-acdf-b588629ba781 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:08.591668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42f23c27-9e25-4cf4-acdf-b588629ba781 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:08.592413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42f23c27-9e25-4cf4-acdf-b588629ba781 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:08.592872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42f23c27-9e25-4cf4-acdf-b588629ba781 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:08.593292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42f23c27-9e25-4cf4-acdf-b588629ba781 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:08.638997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:08.746024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-25e1558e-64f2-4582-b7f3-f35dcf18b0ad tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:08.761145 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-25e1558e-64f2-4582-b7f3-f35dcf18b0ad tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1473 microversion: 2.1 time: 0.316066 Aug 18 11:29:08.764332 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 490/965] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:08 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1473 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:08.785551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-bd8d98e2-78dd-4f2b-bf33-33e49d165bd1 req-6a03d542-1efd-4070-80c9-fa6a9ce24951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "995b6878-0830-4d2c-87ca-d3eed8a35f22", "name": "network-vif-unplugged", "status": "completed", "tag": "a724a63e-95c2-4d42-8094-45a0c52650a9"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:08.829952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bd8d98e2-78dd-4f2b-bf33-33e49d165bd1 req-6a03d542-1efd-4070-80c9-fa6a9ce24951 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:08.832288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bd8d98e2-78dd-4f2b-bf33-33e49d165bd1 req-6a03d542-1efd-4070-80c9-fa6a9ce24951 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:08.834765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bd8d98e2-78dd-4f2b-bf33-33e49d165bd1 req-6a03d542-1efd-4070-80c9-fa6a9ce24951 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:08.857085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-42f23c27-9e25-4cf4-acdf-b588629ba781 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:08.865358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-42f23c27-9e25-4cf4-acdf-b588629ba781 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:08.869551 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-bd8d98e2-78dd-4f2b-bf33-33e49d165bd1 req-6a03d542-1efd-4070-80c9-fa6a9ce24951 service nova] Creating event network-vif-unplugged:a724a63e-95c2-4d42-8094-45a0c52650a9 for instance 995b6878-0830-4d2c-87ca-d3eed8a35f22 on n-h2-853611-3 Aug 18 11:29:08.869735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-42f23c27-9e25-4cf4-acdf-b588629ba781 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:08.870837 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-42f23c27-9e25-4cf4-acdf-b588629ba781 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1409 microversion: 2.25 time: 0.319232 Aug 18 11:29:08.880038 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-bd8d98e2-78dd-4f2b-bf33-33e49d165bd1 req-6a03d542-1efd-4070-80c9-fa6a9ce24951 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114236 Aug 18 11:29:08.881409 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 491/966] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:08.886563 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 476/967] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:29:08 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1409 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:09.050627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5b865ac5-91a1-4dd9-8c7d-cd14a010f1ff req-7e1fbf09-35dc-411c-8568-83ca6a50f44c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18b9b772-9949-4239-a522-78ea800d8223", "tag": "1e4bf72d-8bb8-436e-91c5-02acd25d351b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:09.093566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5b865ac5-91a1-4dd9-8c7d-cd14a010f1ff req-7e1fbf09-35dc-411c-8568-83ca6a50f44c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:09.094230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5b865ac5-91a1-4dd9-8c7d-cd14a010f1ff req-7e1fbf09-35dc-411c-8568-83ca6a50f44c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:09.095050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5b865ac5-91a1-4dd9-8c7d-cd14a010f1ff req-7e1fbf09-35dc-411c-8568-83ca6a50f44c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:09.113664 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5b865ac5-91a1-4dd9-8c7d-cd14a010f1ff req-7e1fbf09-35dc-411c-8568-83ca6a50f44c service nova] Creating event network-changed:1e4bf72d-8bb8-436e-91c5-02acd25d351b for instance 18b9b772-9949-4239-a522-78ea800d8223 on n-h1-853611-3 Aug 18 11:29:09.141551 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5b865ac5-91a1-4dd9-8c7d-cd14a010f1ff req-7e1fbf09-35dc-411c-8568-83ca6a50f44c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105550 Aug 18 11:29:09.143471 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 477/968] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:09.231546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fef6b0f3-c9e9-4f5c-bf64-efbdf17aca76 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:09.232814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fef6b0f3-c9e9-4f5c-bf64-efbdf17aca76 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] [instance: 378fceb1-b911-48aa-8fa9-2f358e47dbde] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:09.239746 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-fef6b0f3-c9e9-4f5c-bf64-efbdf17aca76 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] HTTP exception thrown: Instance 378fceb1-b911-48aa-8fa9-2f358e47dbde could not be found. Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fef6b0f3-c9e9-4f5c-bf64-efbdf17aca76 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Request method failure captured: Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/378fceb1-b911-48aa-8fa9-2f358e47dbde/action HTTP/1.1 Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 15 Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iJsMrIGGsTUNpJOZoELhJSh-A8Dzn0cn32FhcQlU4saForJP1EPS3ONwVxMFCtQzqOIzZYhvymzBCs-AXv83RM6IuLFo5kpfHdFQa--JakreFcQE8TrPVTRqxDSR1RZWGGWKB2Nmib42tvj3h25AehF5FYeA_qBCijlIMjy3VUz2E8 Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 00026443c73e4b388058bbe134f87fbe Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:29:09.244115 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:29:09.245739 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_00026443c73e4b388058bbe134f87fbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:09.245739 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:09.245739 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 00026443c73e4b388058bbe134f87fbe Aug 18 11:29:09.245739 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:09.245739 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersAdminNegativeTestJSON-599441481-project-admin Aug 18 11:29:09.245739 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:29:09.245739 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:29:09.245739 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 78aeaba0252047dfb77e6efd1751eeb8 Aug 18 11:29:09.245739 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersAdminNegativeTestJSON-599441481-project-admin Aug 18 11:29:09.245739 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:29:09.245739 n-d-853611-3 devstack@n-api.service[122209]: {"migrate": {}} Aug 18 11:29:09.245739 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:29:09.245739 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 378fceb1-b911-48aa-8fa9-2f358e47dbde could not be found. Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '378fceb1-b911-48aa-8fa9-2f358e47dbde', 'body': {'migrate': {}}} Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 378fceb1-b911-48aa-8fa9-2f358e47dbde could not be found. Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:09.246753 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 378fceb1-b911-48aa-8fa9-2f358e47dbde could not be found. Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 378fceb1-b911-48aa-8fa9-2f358e47dbde could not be found. Aug 18 11:29:09.248268 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:09.251511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fef6b0f3-c9e9-4f5c-bf64-efbdf17aca76 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Returning 404 to user: Instance 378fceb1-b911-48aa-8fa9-2f358e47dbde could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:09.253130 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fef6b0f3-c9e9-4f5c-bf64-efbdf17aca76 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/378fceb1-b911-48aa-8fa9-2f358e47dbde/action" status: 404 len: 111 microversion: 2.1 time: 0.370383 Aug 18 11:29:09.264527 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 492/969] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:29:08 2022] POST /compute/v2.1/servers/378fceb1-b911-48aa-8fa9-2f358e47dbde/action => generated 111 bytes in 382 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:29:09.468605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2161538e-5d82-41d1-beb4-d943bb2b65f1 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Action: 'create', calling method: .version_select at 0x7f519fc2d040>, body: {"keypair": {"name": "tempest-keypair-1511673076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHw2Uo3u3Ol1k4C4T1AhBiwejzfvJrFKCYmA+5MFzx4n4HvyFwpQR39ekQBSgYQNVIo3HwFhOYZtX5Ns+Lqe11xD6BN9WJ+Hk5qAoLhimCBJfQgxHzF/SsNAsuuWr5j8Q=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:09.487382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-2161538e-5d82-41d1-beb4-d943bb2b65f1 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Getting quotas for project 296b323334854026ac098bd8446ec860. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:09.493615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-2161538e-5d82-41d1-beb4-d943bb2b65f1 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Getting quotas for user 1afe10dff0ca491cb549201b2749e1a2 and project 296b323334854026ac098bd8446ec860. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:09.522186 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2161538e-5d82-41d1-beb4-d943bb2b65f1 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.376693 Aug 18 11:29:09.523506 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 478/970] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:29:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:09.541937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-54c6d77c-4f0a-4bde-92b5-955534c13ab7 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Calling method '.version_select at 0x7f519fabfca0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:09.559012 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-54c6d77c-4f0a-4bde-92b5-955534c13ab7 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] 10.222.0.73 "GET /compute/v2.1/os-keypairs/tempest-keypair-1511673076" status: 200 len: 497 microversion: 2.1 time: 0.025932 Aug 18 11:29:09.560871 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 493/971] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 18 11:29:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1511673076 => generated 497 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:09.573031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-085e144c-429e-4201-83c3-5c66a6ae846d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:09.579229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-085e144c-429e-4201-83c3-5c66a6ae846d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:09.586942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e0a2e98d-892e-41e5-a4a3-b90f013304cf tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Calling method '.version_select at 0x7f519f970430>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:09.597011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-085e144c-429e-4201-83c3-5c66a6ae846d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:09.597754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-085e144c-429e-4201-83c3-5c66a6ae846d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:09.598476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-085e144c-429e-4201-83c3-5c66a6ae846d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:09.600168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-085e144c-429e-4201-83c3-5c66a6ae846d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:09.601818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-085e144c-429e-4201-83c3-5c66a6ae846d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:09.604515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-085e144c-429e-4201-83c3-5c66a6ae846d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:09.630361 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e0a2e98d-892e-41e5-a4a3-b90f013304cf tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1511673076" status: 202 len: 0 microversion: 2.1 time: 0.055669 Aug 18 11:29:09.631276 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 494/972] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 11:29:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1511673076 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:29:09.638892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1240939498", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:09.733265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:29:09.819468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-085e144c-429e-4201-83c3-5c66a6ae846d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:09.830787 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-085e144c-429e-4201-83c3-5c66a6ae846d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1504 microversion: 2.1 time: 0.262284 Aug 18 11:29:09.847491 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 479/973] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:09 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1504 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:09.854885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-42c6e781-9d97-4ad6-a525-68119cee10d3 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Action: 'create', calling method: .version_select at 0x7f519fbc7430>, body: {"keypair": {"name": "tempest-keypair-1386258036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOdo2YjQeFVllLvVlPxnY+C275t6idElY5ZQB/vBBM3YVk8Zq7TBxf0b8AH1sAJTjjuezGUyF3m1w5ORTUmIn466k0iqCV4lHrHWNauEUWT0tqCT5RDZHoI+e0pFkvlzQ=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:09.876815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-42c6e781-9d97-4ad6-a525-68119cee10d3 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Getting quotas for project 296b323334854026ac098bd8446ec860. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:09.882273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-42c6e781-9d97-4ad6-a525-68119cee10d3 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Getting quotas for user 1afe10dff0ca491cb549201b2749e1a2 and project 296b323334854026ac098bd8446ec860. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:09.913898 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-42c6e781-9d97-4ad6-a525-68119cee10d3 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064886 Aug 18 11:29:09.918919 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 480/974] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:29:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:09.930707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cd3d48bd-5423-4d10-815b-34742f2132a2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:09.933061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cd3d48bd-5423-4d10-815b-34742f2132a2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:09.940211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd3d48bd-5423-4d10-815b-34742f2132a2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:09.940937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd3d48bd-5423-4d10-815b-34742f2132a2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:09.941518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd3d48bd-5423-4d10-815b-34742f2132a2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:09.942386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd3d48bd-5423-4d10-815b-34742f2132a2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:09.942868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd3d48bd-5423-4d10-815b-34742f2132a2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:09.943306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd3d48bd-5423-4d10-815b-34742f2132a2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:10.106054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cd3d48bd-5423-4d10-815b-34742f2132a2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:10.114339 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cd3d48bd-5423-4d10-815b-34742f2132a2 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1473 microversion: 2.1 time: 0.194149 Aug 18 11:29:10.115211 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 481/975] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:09 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1473 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:10.120396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-86ae7e90-dbae-443a-8fc5-9049cd29c9ae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:10.121007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-86ae7e90-dbae-443a-8fc5-9049cd29c9ae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:10.127065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86ae7e90-dbae-443a-8fc5-9049cd29c9ae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:10.127754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86ae7e90-dbae-443a-8fc5-9049cd29c9ae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:10.128355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86ae7e90-dbae-443a-8fc5-9049cd29c9ae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:10.129247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86ae7e90-dbae-443a-8fc5-9049cd29c9ae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:10.130010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86ae7e90-dbae-443a-8fc5-9049cd29c9ae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:10.130661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86ae7e90-dbae-443a-8fc5-9049cd29c9ae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:10.137070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:29:10.137591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:29:10.137955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:29:10.138363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:29:10.138866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:29:10.156906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:10.157513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:10.157951 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:10.159183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:10.159183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:10.159568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:10.202069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Getting quotas for project 0718d83ed8e34cdc828f9de773a3515d. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:10.207873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Getting quotas for user b2b3b1bcd12841858b3fbe6cb358435a and project 0718d83ed8e34cdc828f9de773a3515d. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:10.223786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:29:10.226128 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:29:10.281309 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ee2ed6ee-5d71-435f-be87-567a4d84d2b7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648649 Aug 18 11:29:10.292789 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 495/976] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:29:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:29:10.302044 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d31091cc-bafb-4860-baa2-d7c17f2e2081 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Calling method '.version_select at 0x7f519fa9caf0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:10.341442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-86ae7e90-dbae-443a-8fc5-9049cd29c9ae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:10.347766 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d31091cc-bafb-4860-baa2-d7c17f2e2081 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386258036" status: 202 len: 0 microversion: 2.1 time: 0.053738 Aug 18 11:29:10.348355 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 496/977] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 11:29:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386258036 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:29:10.351902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-86ae7e90-dbae-443a-8fc5-9049cd29c9ae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:10.354739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-86ae7e90-dbae-443a-8fc5-9049cd29c9ae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:10.355204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f56addfc-0825-4853-a562-7da9e3254439 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:10.355822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f56addfc-0825-4853-a562-7da9e3254439 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:10.357028 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-86ae7e90-dbae-443a-8fc5-9049cd29c9ae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1409 microversion: 2.25 time: 0.240540 Aug 18 11:29:10.371388 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 482/978] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:29:10 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1409 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:10.378613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03ae4e5d-7976-40c4-ba93-d6217b33d0c7 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Action: 'create', calling method: .version_select at 0x7f519fc1e280>, body: {"keypair": {"name": "tempest-keypair-1833565253", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:10.396926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-03ae4e5d-7976-40c4-ba93-d6217b33d0c7 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Getting quotas for project 296b323334854026ac098bd8446ec860. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:10.403863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-03ae4e5d-7976-40c4-ba93-d6217b33d0c7 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Getting quotas for user 1afe10dff0ca491cb549201b2749e1a2 and project 296b323334854026ac098bd8446ec860. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:10.437591 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-03ae4e5d-7976-40c4-ba93-d6217b33d0c7 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.064183 Aug 18 11:29:10.437975 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 483/979] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:29:10 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:10.449146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-454b8bf9-12bb-41f1-a973-dbf4a5681d37 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Calling method '.version_select at 0x7f519fc30c10>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:10.475634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f56addfc-0825-4853-a562-7da9e3254439 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:10.478528 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-454b8bf9-12bb-41f1-a973-dbf4a5681d37 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1833565253" status: 202 len: 0 microversion: 2.1 time: 0.032465 Aug 18 11:29:10.487532 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 484/980] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 11:29:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1833565253 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:29:10.488274 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f56addfc-0825-4853-a562-7da9e3254439 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1222 microversion: 2.1 time: 0.135005 Aug 18 11:29:10.488274 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 497/981] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:10 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:10.501752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-92378bcf-c0f8-42a2-a731-2d1e25e2b780 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Action: 'create', calling method: .version_select at 0x7f519fe7ca60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1479373952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3GbcGIxzI9rgFwzcX0NoqITsYZBH792WaYe5n9AqlnCX+RAfgcsAqpSYHbkhc9rpmJTN5eaYt8a3XqcsOdswGWIuUD0WUlp/1NbTD3cM5xp9AjuhruI7thHmd+LSguLQ=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:10.520377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:10.529800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-92378bcf-c0f8-42a2-a731-2d1e25e2b780 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Getting quotas for project 296b323334854026ac098bd8446ec860. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:10.541134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-92378bcf-c0f8-42a2-a731-2d1e25e2b780 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Getting quotas for user 1afe10dff0ca491cb549201b2749e1a2 and project 296b323334854026ac098bd8446ec860. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:10.576106 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-92378bcf-c0f8-42a2-a731-2d1e25e2b780 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.084959 Aug 18 11:29:10.577803 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 485/982] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:29:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:29:10.592603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-240c2911-844b-4b03-ab98-ca2cf05448db tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Action: 'create', calling method: .version_select at 0x7f519ff969d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-718453076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQcr2Zqle+zNsnCaQgCmNYHTXBjFnK1ZHoZ5OTpCPeikrEQPb+xGaN5IT5f7HzVTvPE/8npPQAPjw2vKyxrYZSu8ZxneASVmJbaBH+bP9cOfYFozry1Gi/3WbvtfdtAHg=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:10.611135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-240c2911-844b-4b03-ab98-ca2cf05448db tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Getting quotas for project 296b323334854026ac098bd8446ec860. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:10.618736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-240c2911-844b-4b03-ab98-ca2cf05448db tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Getting quotas for user 1afe10dff0ca491cb549201b2749e1a2 and project 296b323334854026ac098bd8446ec860. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:10.660292 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-240c2911-844b-4b03-ab98-ca2cf05448db tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.073150 Aug 18 11:29:10.662761 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 498/983] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:29:10 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:10.679992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e00140a-1fa3-4b8c-81fb-df83a1a9ea53 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Action: 'create', calling method: .version_select at 0x7f519fc05940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1256611760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvuPj+idEot4DTYks12WL51RJm40VKUKCE6mxf5uKfgsuM73vNQM9u1e/Ai+ymKY3DAUXNGCRvvfHv93p95VgiyS6GyGb7YIwXBo9bcd4MthPgXVd7NUXjHxhXGbMpt5A=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:10.719017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7e00140a-1fa3-4b8c-81fb-df83a1a9ea53 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Getting quotas for project 296b323334854026ac098bd8446ec860. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:10.725005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7e00140a-1fa3-4b8c-81fb-df83a1a9ea53 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Getting quotas for user 1afe10dff0ca491cb549201b2749e1a2 and project 296b323334854026ac098bd8446ec860. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:10.754841 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e00140a-1fa3-4b8c-81fb-df83a1a9ea53 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.081912 Aug 18 11:29:10.755997 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 486/984] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:29:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:10.768935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-081e15c3-15f3-45b3-8999-f7fcfc6adfe8 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Calling method '.version_select at 0x7f519fabf790>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:10.774058 n-d-853611-3 devstack@n-api.service[122209]: WARNING oslo_db.sqlalchemy.utils [None req-081e15c3-15f3-45b3-8999-f7fcfc6adfe8 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 18 11:29:10.789849 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-081e15c3-15f3-45b3-8999-f7fcfc6adfe8 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] 10.222.0.73 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.020820 Aug 18 11:29:10.797211 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 499/985] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:29:10 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:10.803495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-640e654d-413b-491c-b3d8-3d14f8c4e6ff tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Calling method '.version_select at 0x7f519fa5b280>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:10.841963 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-640e654d-413b-491c-b3d8-3d14f8c4e6ff tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1256611760" status: 202 len: 0 microversion: 2.1 time: 0.042662 Aug 18 11:29:10.842970 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 500/986] 10.222.0.73 () {58 vars in 1278 bytes} [Thu Aug 18 11:29:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1256611760 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:29:10.858140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4ca81e64-52e1-4712-ae73-54922de87274 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Calling method '.version_select at 0x7f519f9b99d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:10.918518 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4ca81e64-52e1-4712-ae73-54922de87274 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-718453076" status: 202 len: 0 microversion: 2.1 time: 0.061984 Aug 18 11:29:10.921350 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 501/987] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:29:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-718453076 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:29:10.940520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-992fca07-8637-47f5-874f-5f59212ea5db tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:10.942301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-992fca07-8637-47f5-874f-5f59212ea5db tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:10.954200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-992fca07-8637-47f5-874f-5f59212ea5db tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:10.956432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-992fca07-8637-47f5-874f-5f59212ea5db tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:10.956886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-992fca07-8637-47f5-874f-5f59212ea5db tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:10.957618 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-992fca07-8637-47f5-874f-5f59212ea5db tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:10.958083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-992fca07-8637-47f5-874f-5f59212ea5db tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:10.958544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-992fca07-8637-47f5-874f-5f59212ea5db tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:11.061617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3a581da4-2847-44ed-a40e-058ecd3912fb tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Calling method '.version_select at 0x7f519fc309d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:11.201300 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3a581da4-2847-44ed-a40e-058ecd3912fb tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/07fafbce862749338e809506b22e91ec" status: 200 len: 371 microversion: 2.1 time: 0.415395 Aug 18 11:29:11.204020 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 487/988] 10.222.0.73 () {58 vars in 1242 bytes} [Thu Aug 18 11:29:10 2022] GET /compute/v2.1/os-quota-sets/07fafbce862749338e809506b22e91ec => generated 371 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:11.218889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8fa1f946-4fbf-4524-b07a-af118cd31ea5 req-34445ccf-09cb-4589-be3b-7d27b32d446e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "995b6878-0830-4d2c-87ca-d3eed8a35f22", "tag": "a724a63e-95c2-4d42-8094-45a0c52650a9"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:11.248373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8fa1f946-4fbf-4524-b07a-af118cd31ea5 req-34445ccf-09cb-4589-be3b-7d27b32d446e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:11.251590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8fa1f946-4fbf-4524-b07a-af118cd31ea5 req-34445ccf-09cb-4589-be3b-7d27b32d446e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:11.252120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8fa1f946-4fbf-4524-b07a-af118cd31ea5 req-34445ccf-09cb-4589-be3b-7d27b32d446e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:11.307770 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8fa1f946-4fbf-4524-b07a-af118cd31ea5 req-34445ccf-09cb-4589-be3b-7d27b32d446e service nova] Creating event network-changed:a724a63e-95c2-4d42-8094-45a0c52650a9 for instance 995b6878-0830-4d2c-87ca-d3eed8a35f22 on n-h2-853611-3 Aug 18 11:29:11.319876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-992fca07-8637-47f5-874f-5f59212ea5db tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:11.321227 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8fa1f946-4fbf-4524-b07a-af118cd31ea5 req-34445ccf-09cb-4589-be3b-7d27b32d446e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113614 Aug 18 11:29:11.323787 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 488/989] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:11.330670 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-992fca07-8637-47f5-874f-5f59212ea5db tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1504 microversion: 2.1 time: 0.402185 Aug 18 11:29:11.344940 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 502/990] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:10 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:11.345049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-deca6fe8-4979-448f-aacc-a8a73a92e661 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] Calling method '.version_select at 0x7f519fc1e0d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:11.345145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e6963e18-6218-40d0-b071-4b25110ef0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:11.345145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e6963e18-6218-40d0-b071-4b25110ef0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:11.366270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6963e18-6218-40d0-b071-4b25110ef0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:11.370406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6963e18-6218-40d0-b071-4b25110ef0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:11.372404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6963e18-6218-40d0-b071-4b25110ef0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:11.373353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6963e18-6218-40d0-b071-4b25110ef0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:11.376504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6963e18-6218-40d0-b071-4b25110ef0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:11.377643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6963e18-6218-40d0-b071-4b25110ef0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:11.384610 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-deca6fe8-4979-448f-aacc-a8a73a92e661 tempest-KeyPairsV2TestJSON-1851948321 tempest-KeyPairsV2TestJSON-1851948321-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1479373952" status: 202 len: 0 microversion: 2.1 time: 0.059276 Aug 18 11:29:11.392248 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 489/991] 10.222.0.73 () {58 vars in 1278 bytes} [Thu Aug 18 11:29:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1479373952 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:29:11.399732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-193dba62-f699-45de-97d7-701fec56e938 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Action: 'update', calling method: .version_select at 0x7f519fc30af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:11.538061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-193dba62-f699-45de-97d7-701fec56e938 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:11.538754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-193dba62-f699-45de-97d7-701fec56e938 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:11.539292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-193dba62-f699-45de-97d7-701fec56e938 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:11.540172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-193dba62-f699-45de-97d7-701fec56e938 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:11.540749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-193dba62-f699-45de-97d7-701fec56e938 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:11.541273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-193dba62-f699-45de-97d7-701fec56e938 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:11.676151 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-193dba62-f699-45de-97d7-701fec56e938 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/07fafbce862749338e809506b22e91ec" status: 200 len: 328 microversion: 2.1 time: 0.289248 Aug 18 11:29:11.694795 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 490/992] 10.222.0.73 () {60 vars in 1262 bytes} [Thu Aug 18 11:29:11 2022] PUT /compute/v2.1/os-quota-sets/07fafbce862749338e809506b22e91ec => generated 328 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:11.706480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec2b8ca4-c6fe-47ca-a5b1-6a052cff7605 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:11.716106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ec2b8ca4-c6fe-47ca-a5b1-6a052cff7605 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:11.737494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec2b8ca4-c6fe-47ca-a5b1-6a052cff7605 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:11.738160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec2b8ca4-c6fe-47ca-a5b1-6a052cff7605 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:11.738803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec2b8ca4-c6fe-47ca-a5b1-6a052cff7605 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:11.739636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec2b8ca4-c6fe-47ca-a5b1-6a052cff7605 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:11.740200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec2b8ca4-c6fe-47ca-a5b1-6a052cff7605 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:11.740794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec2b8ca4-c6fe-47ca-a5b1-6a052cff7605 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:11.769409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e6963e18-6218-40d0-b071-4b25110ef0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:11.783797 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e6963e18-6218-40d0-b071-4b25110ef0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 200 len: 1431 microversion: 2.1 time: 0.449621 Aug 18 11:29:11.799529 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 503/993] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:11 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 1431 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:11.818282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f7336b16-acf4-48fc-99bd-9d8839563e33 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:11.819450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f7336b16-acf4-48fc-99bd-9d8839563e33 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:11.833428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f7336b16-acf4-48fc-99bd-9d8839563e33 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:11.836520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f7336b16-acf4-48fc-99bd-9d8839563e33 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:11.843102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f7336b16-acf4-48fc-99bd-9d8839563e33 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:11.844030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f7336b16-acf4-48fc-99bd-9d8839563e33 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:11.844513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f7336b16-acf4-48fc-99bd-9d8839563e33 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:11.845032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f7336b16-acf4-48fc-99bd-9d8839563e33 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:11.967013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f7336b16-acf4-48fc-99bd-9d8839563e33 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:11.982821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ec2b8ca4-c6fe-47ca-a5b1-6a052cff7605 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:11.994001 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f7336b16-acf4-48fc-99bd-9d8839563e33 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1274 microversion: 2.1 time: 0.188326 Aug 18 11:29:11.994205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ec2b8ca4-c6fe-47ca-a5b1-6a052cff7605 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:11.996037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ec2b8ca4-c6fe-47ca-a5b1-6a052cff7605 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:11.997374 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ec2b8ca4-c6fe-47ca-a5b1-6a052cff7605 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1409 microversion: 2.25 time: 0.301185 Aug 18 11:29:11.998456 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 491/994] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:29:11 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1409 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:12.015079 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 504/995] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:11 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1274 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:12.019619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e2840d59-18a9-42a3-a9f7-63caecb58051 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:12.053046 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e2840d59-18a9-42a3-a9f7-63caecb58051 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-quota-sets/07fafbce862749338e809506b22e91ec" status: 202 len: 0 microversion: 2.1 time: 0.053174 Aug 18 11:29:12.053632 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 492/996] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 11:29:11 2022] DELETE /compute/v2.1/os-quota-sets/07fafbce862749338e809506b22e91ec => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:29:12.074203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3989e854-4ff7-4b11-8618-3130fcccc3c4 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Calling method '.version_select at 0x7f519f970b80>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:12.354884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d33981aa-e128-45f9-b6c8-64a19e7e74a3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:12.355502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d33981aa-e128-45f9-b6c8-64a19e7e74a3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:12.380126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d33981aa-e128-45f9-b6c8-64a19e7e74a3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:12.380921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d33981aa-e128-45f9-b6c8-64a19e7e74a3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:12.381519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d33981aa-e128-45f9-b6c8-64a19e7e74a3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:12.382396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d33981aa-e128-45f9-b6c8-64a19e7e74a3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:12.383072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d33981aa-e128-45f9-b6c8-64a19e7e74a3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:12.383690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d33981aa-e128-45f9-b6c8-64a19e7e74a3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:12.569154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=4,nova_api:INSERT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:12.596626 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3989e854-4ff7-4b11-8618-3130fcccc3c4 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/07fafbce862749338e809506b22e91ec" status: 200 len: 371 microversion: 2.1 time: 0.535203 Aug 18 11:29:12.607373 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 505/997] 10.222.0.73 () {58 vars in 1242 bytes} [Thu Aug 18 11:29:12 2022] GET /compute/v2.1/os-quota-sets/07fafbce862749338e809506b22e91ec => generated 371 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:12.658016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d33981aa-e128-45f9-b6c8-64a19e7e74a3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:12.668014 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d33981aa-e128-45f9-b6c8-64a19e7e74a3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1504 microversion: 2.1 time: 0.318741 Aug 18 11:29:12.676063 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 493/998] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:12 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:12.811315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-79ecc776-8981-456d-b628-d62eb66f2d77 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:12.812661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-79ecc776-8981-456d-b628-d62eb66f2d77 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 818423b1-1334-4de8-8565-99bdd45f4b98] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:12.825767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-79ecc776-8981-456d-b628-d62eb66f2d77 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:12.827035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-79ecc776-8981-456d-b628-d62eb66f2d77 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:12.827637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-79ecc776-8981-456d-b628-d62eb66f2d77 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:12.828515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-79ecc776-8981-456d-b628-d62eb66f2d77 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:12.829126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-79ecc776-8981-456d-b628-d62eb66f2d77 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:12.830413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e6948de-20de-4b61-a9cf-54a010ee2273 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Calling method '.version_select at 0x7f519fc30820>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:12.831596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-79ecc776-8981-456d-b628-d62eb66f2d77 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:12.871068 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-79ecc776-8981-456d-b628-d62eb66f2d77 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] HTTP exception thrown: Instance 818423b1-1334-4de8-8565-99bdd45f4b98 could not be found. Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-79ecc776-8981-456d-b628-d62eb66f2d77 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Request method failure captured: Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 HTTP/1.1 Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iHIwwevFwKV8xm18kbPD3Ciy8CvScg1fDfl7wNmdQTnBTrBT97kbGF3NuiwyTQZfFarL5ZQ_ovW6qJoZzgynXj2UZuYP-JiihvsYTyFfdjisb-mFUTjTlzA9uSeEs_Ej_djUg_OyBjwyPw77sh7iTNOfHkUZhc2sk4s13i0I8-Szeo Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:29:12.872654 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:29:12.874702 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:12.874702 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:12.874702 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:12.874702 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:12.874702 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:12.874702 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:29:12.874702 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:29:12.874702 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b75d06aa767c4f7799209c7d0fe23d2c Aug 18 11:29:12.874702 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:12.874702 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:29:12.874702 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 818423b1-1334-4de8-8565-99bdd45f4b98 could not be found. Aug 18 11:29:12.874702 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '818423b1-1334-4de8-8565-99bdd45f4b98'} Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818423b1-1334-4de8-8565-99bdd45f4b98 could not be found. Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:12.875842 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818423b1-1334-4de8-8565-99bdd45f4b98 could not be found. Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818423b1-1334-4de8-8565-99bdd45f4b98 could not be found. Aug 18 11:29:12.877672 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:12.880001 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-79ecc776-8981-456d-b628-d62eb66f2d77 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Returning 404 to user: Instance 818423b1-1334-4de8-8565-99bdd45f4b98 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:12.880001 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-79ecc776-8981-456d-b628-d62eb66f2d77 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98" status: 404 len: 111 microversion: 2.1 time: 0.066942 Aug 18 11:29:12.886806 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 506/999] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:12 2022] GET /compute/v2.1/servers/818423b1-1334-4de8-8565-99bdd45f4b98 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:29:12.904305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-76ea77b0-e159-4f2b-a811-a7ec1acf786c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:12.904808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-76ea77b0-e159-4f2b-a811-a7ec1acf786c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:12.918348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76ea77b0-e159-4f2b-a811-a7ec1acf786c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:12.918868 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76ea77b0-e159-4f2b-a811-a7ec1acf786c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:12.919306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76ea77b0-e159-4f2b-a811-a7ec1acf786c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:12.920035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76ea77b0-e159-4f2b-a811-a7ec1acf786c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:12.920481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76ea77b0-e159-4f2b-a811-a7ec1acf786c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:12.921129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76ea77b0-e159-4f2b-a811-a7ec1acf786c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:12.975149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-76ea77b0-e159-4f2b-a811-a7ec1acf786c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:29:13.168864 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-76ea77b0-e159-4f2b-a811-a7ec1acf786c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "DELETE /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 204 len: 0 microversion: 2.1 time: 0.268926 Aug 18 11:29:13.170926 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 507/1000] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:29:12 2022] DELETE /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:13.179906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1de3f173-3835-48fa-9877-1e9ab4c209e9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:13.183441 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1de3f173-3835-48fa-9877-1e9ab4c209e9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:13.193526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1de3f173-3835-48fa-9877-1e9ab4c209e9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:13.194612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1de3f173-3835-48fa-9877-1e9ab4c209e9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:13.195497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1de3f173-3835-48fa-9877-1e9ab4c209e9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:13.197553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1de3f173-3835-48fa-9877-1e9ab4c209e9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:13.198377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1de3f173-3835-48fa-9877-1e9ab4c209e9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:13.199567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1de3f173-3835-48fa-9877-1e9ab4c209e9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:13.226712 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e6948de-20de-4b61-a9cf-54a010ee2273 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/a5ccd93e9f9f4ce485b8d2a4c15394bd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.401902 Aug 18 11:29:13.229403 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 494/1001] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:29:12 2022] GET /compute/v2.1/os-quota-sets/a5ccd93e9f9f4ce485b8d2a4c15394bd/defaults => generated 371 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:13.246579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5fa68af1-ef5d-40e0-bb9f-fdb74390c0e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:13.251203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5fa68af1-ef5d-40e0-bb9f-fdb74390c0e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:13.266858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fa68af1-ef5d-40e0-bb9f-fdb74390c0e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:13.267990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fa68af1-ef5d-40e0-bb9f-fdb74390c0e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:13.267990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fa68af1-ef5d-40e0-bb9f-fdb74390c0e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:13.268678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fa68af1-ef5d-40e0-bb9f-fdb74390c0e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:13.269141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fa68af1-ef5d-40e0-bb9f-fdb74390c0e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:13.271674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fa68af1-ef5d-40e0-bb9f-fdb74390c0e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:13.434421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5fa68af1-ef5d-40e0-bb9f-fdb74390c0e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:13.452195 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5fa68af1-ef5d-40e0-bb9f-fdb74390c0e7 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1280 microversion: 2.1 time: 0.221276 Aug 18 11:29:13.464188 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 495/1002] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:13 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1280 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:13.477079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b656a98a-ae7c-4241-b822-b1520a5e25e8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:13.479040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b656a98a-ae7c-4241-b822-b1520a5e25e8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:13.487869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b656a98a-ae7c-4241-b822-b1520a5e25e8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:13.488728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b656a98a-ae7c-4241-b822-b1520a5e25e8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:13.489435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b656a98a-ae7c-4241-b822-b1520a5e25e8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:13.490394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b656a98a-ae7c-4241-b822-b1520a5e25e8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:13.491101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b656a98a-ae7c-4241-b822-b1520a5e25e8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:13.491753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b656a98a-ae7c-4241-b822-b1520a5e25e8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:13.776936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1de3f173-3835-48fa-9877-1e9ab4c209e9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:13.789913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1de3f173-3835-48fa-9877-1e9ab4c209e9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:13.791478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1de3f173-3835-48fa-9877-1e9ab4c209e9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:13.795517 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1de3f173-3835-48fa-9877-1e9ab4c209e9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1409 microversion: 2.25 time: 0.622995 Aug 18 11:29:13.798921 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 508/1003] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:29:13 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1409 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:13.802029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b656a98a-ae7c-4241-b822-b1520a5e25e8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:13.803506 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-aa9fb766-376c-4615-99e0-ac0bb8dba01f req-221dd2f8-a6b0-49ee-a2fe-9d84fb76ebf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818423b1-1334-4de8-8565-99bdd45f4b98", "name": "network-vif-deleted", "tag": "ce7cab84-d1c6-479e-93a0-1485bcbbe863"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:13.818275 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b656a98a-ae7c-4241-b822-b1520a5e25e8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 200 len: 1472 microversion: 2.1 time: 0.345421 Aug 18 11:29:13.819117 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 496/1004] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:13 2022] GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 1472 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:13.820382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-aa9fb766-376c-4615-99e0-ac0bb8dba01f req-221dd2f8-a6b0-49ee-a2fe-9d84fb76ebf8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:13.821972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-aa9fb766-376c-4615-99e0-ac0bb8dba01f req-221dd2f8-a6b0-49ee-a2fe-9d84fb76ebf8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:13.822687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-aa9fb766-376c-4615-99e0-ac0bb8dba01f req-221dd2f8-a6b0-49ee-a2fe-9d84fb76ebf8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:13.826071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-73d61d33-b046-4508-927b-07b0f573d481 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Action: 'update', calling method: .version_select at 0x7f519fd83670>, body: {"quota_set": {"ram": "5120"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:13.835480 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-aa9fb766-376c-4615-99e0-ac0bb8dba01f req-221dd2f8-a6b0-49ee-a2fe-9d84fb76ebf8 service nova] Creating event network-vif-deleted:ce7cab84-d1c6-479e-93a0-1485bcbbe863 for instance 818423b1-1334-4de8-8565-99bdd45f4b98 on n-h2-853611-3 Aug 18 11:29:13.842936 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-aa9fb766-376c-4615-99e0-ac0bb8dba01f req-221dd2f8-a6b0-49ee-a2fe-9d84fb76ebf8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042737 Aug 18 11:29:13.844158 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 509/1005] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:13.850804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b68fe519-3a6f-4854-b8c0-0f73a1f8df7e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:13.851914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b68fe519-3a6f-4854-b8c0-0f73a1f8df7e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:13.861040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b68fe519-3a6f-4854-b8c0-0f73a1f8df7e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:13.862038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b68fe519-3a6f-4854-b8c0-0f73a1f8df7e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:13.862731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b68fe519-3a6f-4854-b8c0-0f73a1f8df7e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:13.863667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b68fe519-3a6f-4854-b8c0-0f73a1f8df7e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:13.864341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b68fe519-3a6f-4854-b8c0-0f73a1f8df7e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:13.865013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b68fe519-3a6f-4854-b8c0-0f73a1f8df7e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:14.142378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73d61d33-b046-4508-927b-07b0f573d481 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:14.142948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73d61d33-b046-4508-927b-07b0f573d481 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:14.143508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73d61d33-b046-4508-927b-07b0f573d481 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:14.144253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73d61d33-b046-4508-927b-07b0f573d481 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:14.144719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73d61d33-b046-4508-927b-07b0f573d481 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:14.145155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73d61d33-b046-4508-927b-07b0f573d481 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:14.225236 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-73d61d33-b046-4508-927b-07b0f573d481 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/27c06c6a1d3c4d33b4c8ac511d8738ed" status: 200 len: 328 microversion: 2.1 time: 0.404608 Aug 18 11:29:14.234369 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 497/1006] 10.222.0.73 () {60 vars in 1262 bytes} [Thu Aug 18 11:29:13 2022] PUT /compute/v2.1/os-quota-sets/27c06c6a1d3c4d33b4c8ac511d8738ed => generated 328 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:14.239290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fffede04-5452-4ee6-96d3-3b4453eef34f tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Calling method '.version_select at 0x7f519fdec040>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:14.282741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b68fe519-3a6f-4854-b8c0-0f73a1f8df7e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:14.295572 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b68fe519-3a6f-4854-b8c0-0f73a1f8df7e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1504 microversion: 2.1 time: 0.449433 Aug 18 11:29:14.315426 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 510/1007] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:13 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1504 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:14.476333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-11bb1375-f009-4945-95ea-4309f3e2cc19 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:14.476948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-11bb1375-f009-4945-95ea-4309f3e2cc19 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:14.484648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11bb1375-f009-4945-95ea-4309f3e2cc19 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:14.485138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11bb1375-f009-4945-95ea-4309f3e2cc19 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:14.486947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11bb1375-f009-4945-95ea-4309f3e2cc19 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:14.487894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11bb1375-f009-4945-95ea-4309f3e2cc19 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:14.491071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11bb1375-f009-4945-95ea-4309f3e2cc19 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:14.492497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11bb1375-f009-4945-95ea-4309f3e2cc19 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:14.552308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fffede04-5452-4ee6-96d3-3b4453eef34f tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:14.552796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fffede04-5452-4ee6-96d3-3b4453eef34f tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:14.553227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fffede04-5452-4ee6-96d3-3b4453eef34f tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:14.553946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fffede04-5452-4ee6-96d3-3b4453eef34f tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:14.555607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fffede04-5452-4ee6-96d3-3b4453eef34f tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:14.556082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fffede04-5452-4ee6-96d3-3b4453eef34f tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:14.580399 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fffede04-5452-4ee6-96d3-3b4453eef34f tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/27c06c6a1d3c4d33b4c8ac511d8738ed/detail" status: 200 len: 916 microversion: 2.1 time: 0.344727 Aug 18 11:29:14.580989 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 498/1008] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:29:14 2022] GET /compute/v2.1/os-quota-sets/27c06c6a1d3c4d33b4c8ac511d8738ed/detail => generated 916 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:14.644891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b95e6fc2-2076-4f48-ba35-addc440de98d tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Action: 'create', calling method: .version_select at 0x7f519fc301f0>, body: {"keypair": {"name": "tempest-keypair-768072401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdhgB5ArF+x6147amdpMSDv/Awimpa3IgQObEQHaQbTYgzKht8/mCvs1AxHTI50gXGntha1rwUgW4WTjSGf1gvnGbJK6BAGBfU8F3dVZFdrkdav1djeXiLw4/jPHv53eA=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:14.664370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-11bb1375-f009-4945-95ea-4309f3e2cc19 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:14.672924 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-11bb1375-f009-4945-95ea-4309f3e2cc19 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1280 microversion: 2.1 time: 0.200576 Aug 18 11:29:14.674081 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 511/1009] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:14 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1280 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:14.675187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-b95e6fc2-2076-4f48-ba35-addc440de98d tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:14.685877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-b95e6fc2-2076-4f48-ba35-addc440de98d tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for user dd3956cb006d428a9f6063c23fc6f134 and project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:14.728880 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b95e6fc2-2076-4f48-ba35-addc440de98d tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.145206 Aug 18 11:29:14.730133 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 499/1010] 10.222.0.73 () {62 vars in 1199 bytes} [Thu Aug 18 11:29:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 18 11:29:14.743611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-648329bf-1564-4d68-897b-7d4f30e9c28b tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Calling method '.version_select at 0x7f519f970280>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:14.756092 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-648329bf-1564-4d68-897b-7d4f30e9c28b tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "GET /compute/v2.1/os-keypairs/tempest-keypair-768072401" status: 200 len: 512 microversion: 2.2 time: 0.018169 Aug 18 11:29:14.773894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-16a99f06-ddaa-47be-81d9-f05efd932c75 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Calling method '.version_select at 0x7f519fe8fee0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:14.777621 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 512/1011] 10.222.0.73 () {60 vars in 1255 bytes} [Thu Aug 18 11:29:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-768072401 => generated 512 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:29:14.810461 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-16a99f06-ddaa-47be-81d9-f05efd932c75 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-768072401" status: 204 len: 0 microversion: 2.2 time: 0.044494 Aug 18 11:29:14.824739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2c418f02-18bd-46b3-b909-89597e07fe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:14.826113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2c418f02-18bd-46b3-b909-89597e07fe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:14.831316 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 500/1012] 10.222.0.73 () {60 vars in 1258 bytes} [Thu Aug 18 11:29:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-768072401 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:14.841942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c418f02-18bd-46b3-b909-89597e07fe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:14.844723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c418f02-18bd-46b3-b909-89597e07fe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:14.845467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c418f02-18bd-46b3-b909-89597e07fe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:14.846207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c418f02-18bd-46b3-b909-89597e07fe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:14.847406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6d85fed0-1ccc-4667-a5ab-1fddc705b7a7 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Action: 'create', calling method: .version_select at 0x7f519fc2d670>, body: {"keypair": {"name": "tempest-keypair-861334539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYRayvvi5PxOh2DYYVhiJ6NRYm5N48IyvnQU+lwFTGMwzOG2YYeICuSi9lksWUT2f2lkF9dhbY8cdy77KUrUoK2DEC/y+YvVid/Ql+4LmLpHh64dcROiNyoW7dlpdCqXQ=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:14.847789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c418f02-18bd-46b3-b909-89597e07fe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:14.851106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c418f02-18bd-46b3-b909-89597e07fe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:14.877081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-6d85fed0-1ccc-4667-a5ab-1fddc705b7a7 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:14.880083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:14.890851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-6d85fed0-1ccc-4667-a5ab-1fddc705b7a7 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for user dd3956cb006d428a9f6063c23fc6f134 and project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:14.939442 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6d85fed0-1ccc-4667-a5ab-1fddc705b7a7 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.106815 Aug 18 11:29:14.940804 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 501/1013] 10.222.0.73 () {62 vars in 1199 bytes} [Thu Aug 18 11:29:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 18 11:29:14.946003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b125488-70cc-47e7-985d-b33cfd5ad074 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:14.947175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9b125488-70cc-47e7-985d-b33cfd5ad074 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:14.953685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b125488-70cc-47e7-985d-b33cfd5ad074 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:14.954491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b125488-70cc-47e7-985d-b33cfd5ad074 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:14.955121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b125488-70cc-47e7-985d-b33cfd5ad074 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:14.956020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b125488-70cc-47e7-985d-b33cfd5ad074 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:14.956749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b125488-70cc-47e7-985d-b33cfd5ad074 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:14.957387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b125488-70cc-47e7-985d-b33cfd5ad074 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:15.114665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9b125488-70cc-47e7-985d-b33cfd5ad074 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:15.123089 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b125488-70cc-47e7-985d-b33cfd5ad074 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 200 len: 1472 microversion: 2.1 time: 0.180887 Aug 18 11:29:15.124670 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 502/1014] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:14 2022] GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:15.130055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-019f51e9-d1f0-4e58-97cc-024428a2cce8 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Action: 'update', calling method: .version_select at 0x7f519fbc7430>, body: {"quota_set": {"ram": "2048"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:15.217853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-019f51e9-d1f0-4e58-97cc-024428a2cce8 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:15.219087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-019f51e9-d1f0-4e58-97cc-024428a2cce8 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:15.219746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-019f51e9-d1f0-4e58-97cc-024428a2cce8 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:15.221036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-019f51e9-d1f0-4e58-97cc-024428a2cce8 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:15.221986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-019f51e9-d1f0-4e58-97cc-024428a2cce8 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:15.222649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-019f51e9-d1f0-4e58-97cc-024428a2cce8 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:15.272864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-019f51e9-d1f0-4e58-97cc-024428a2cce8 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:15.274056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-019f51e9-d1f0-4e58-97cc-024428a2cce8 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:15.275073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-019f51e9-d1f0-4e58-97cc-024428a2cce8 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:15.276124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-019f51e9-d1f0-4e58-97cc-024428a2cce8 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:15.276676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-019f51e9-d1f0-4e58-97cc-024428a2cce8 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:15.277295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-019f51e9-d1f0-4e58-97cc-024428a2cce8 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:15.362920 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-019f51e9-d1f0-4e58-97cc-024428a2cce8 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/27c06c6a1d3c4d33b4c8ac511d8738ed?user_id=67ebe591066549599e8c822ab22fadd7" status: 200 len: 328 microversion: 2.1 time: 0.236894 Aug 18 11:29:15.371741 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 503/1015] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:29:15 2022] PUT /compute/v2.1/os-quota-sets/27c06c6a1d3c4d33b4c8ac511d8738ed?user_id=67ebe591066549599e8c822ab22fadd7 => generated 328 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:15.377004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ae70a656-0ec7-44f8-8ced-9bd2749ee60c tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Calling method '.version_select at 0x7f519fed9160>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:15.408282 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ae70a656-0ec7-44f8-8ced-9bd2749ee60c tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-861334539" status: 204 len: 0 microversion: 2.2 time: 0.034716 Aug 18 11:29:15.412982 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 504/1016] 10.222.0.73 () {60 vars in 1258 bytes} [Thu Aug 18 11:29:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-861334539 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:15.418603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e55e2613-e6c5-4616-80f8-423f69575989 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:15.419346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e55e2613-e6c5-4616-80f8-423f69575989 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:15.429097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e55e2613-e6c5-4616-80f8-423f69575989 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:15.429717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e55e2613-e6c5-4616-80f8-423f69575989 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:15.430142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e55e2613-e6c5-4616-80f8-423f69575989 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:15.431490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e55e2613-e6c5-4616-80f8-423f69575989 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:15.431985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e55e2613-e6c5-4616-80f8-423f69575989 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:15.432617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e55e2613-e6c5-4616-80f8-423f69575989 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:15.599243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e55e2613-e6c5-4616-80f8-423f69575989 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:15.617020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2c418f02-18bd-46b3-b909-89597e07fe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:15.619166 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e55e2613-e6c5-4616-80f8-423f69575989 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1504 microversion: 2.1 time: 0.209053 Aug 18 11:29:15.620619 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 505/1017] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:15 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:15.625848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:15.627392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f1fbc749-3cd4-4ccf-a928-1f311f221a80 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Calling method '.version_select at 0x7f519fbfd700>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:15.635820 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2c418f02-18bd-46b3-b909-89597e07fe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:15.639493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2c418f02-18bd-46b3-b909-89597e07fe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:15.643359 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2c418f02-18bd-46b3-b909-89597e07fe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1409 microversion: 2.25 time: 0.823095 Aug 18 11:29:15.645012 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 513/1018] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:29:14 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1409 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:15.661148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b48997c3-9036-4065-8b01-78023a7f5e73 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Action: 'create', calling method: .version_select at 0x7f519f97a040>, body: {"keypair": {"name": "tempest-keypair-2076516780", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:15.705315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-b48997c3-9036-4065-8b01-78023a7f5e73 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:15.732252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-b48997c3-9036-4065-8b01-78023a7f5e73 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for user dd3956cb006d428a9f6063c23fc6f134 and project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:15.783520 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b48997c3-9036-4065-8b01-78023a7f5e73 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.136675 Aug 18 11:29:15.789934 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 514/1019] 10.222.0.73 () {62 vars in 1199 bytes} [Thu Aug 18 11:29:15 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 18 11:29:15.793823 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f1fbc749-3cd4-4ccf-a928-1f311f221a80 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/27c06c6a1d3c4d33b4c8ac511d8738ed?user_id=67ebe591066549599e8c822ab22fadd7" status: 200 len: 370 microversion: 2.1 time: 0.171839 Aug 18 11:29:15.794411 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 506/1020] 10.222.0.73 () {58 vars in 1323 bytes} [Thu Aug 18 11:29:15 2022] GET /compute/v2.1/os-quota-sets/27c06c6a1d3c4d33b4c8ac511d8738ed?user_id=67ebe591066549599e8c822ab22fadd7 => generated 370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:15.798914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bf1e884f-b082-46a9-96a7-4eb9971512be tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:15.799771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bf1e884f-b082-46a9-96a7-4eb9971512be tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:15.815591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-27795fc7-f7ce-4a35-a109-ffc4361bdc73 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Calling method '.version_select at 0x7f519fe49820>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:15.823283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf1e884f-b082-46a9-96a7-4eb9971512be tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:15.824249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf1e884f-b082-46a9-96a7-4eb9971512be tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:15.825102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf1e884f-b082-46a9-96a7-4eb9971512be tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:15.826015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf1e884f-b082-46a9-96a7-4eb9971512be tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:15.826655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf1e884f-b082-46a9-96a7-4eb9971512be tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:15.828274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf1e884f-b082-46a9-96a7-4eb9971512be tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:15.865009 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-27795fc7-f7ce-4a35-a109-ffc4361bdc73 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076516780" status: 204 len: 0 microversion: 2.2 time: 0.065265 Aug 18 11:29:15.867261 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 507/1021] 10.222.0.73 () {60 vars in 1261 bytes} [Thu Aug 18 11:29:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076516780 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:15.889643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d1335ce-74d7-4146-9c2b-7a8499263971 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Action: 'create', calling method: .version_select at 0x7f519fb82670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-163039590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHfDCAfy+CXb3kF0m22r9dA+YpC/95x0cPnQVzshi2Z3qYmFSpjnD60oZAceCuV5fSNfGuYyT4GHUlRR5YdFieru5U7Gra9i3dDm+iWOeXx6SQCJiNvsU6v1v9oR5//xQ=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:15.912817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-2d1335ce-74d7-4146-9c2b-7a8499263971 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:15.919987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-2d1335ce-74d7-4146-9c2b-7a8499263971 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for user dd3956cb006d428a9f6063c23fc6f134 and project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:15.948742 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d1335ce-74d7-4146-9c2b-7a8499263971 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.073331 Aug 18 11:29:15.950991 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 508/1022] 10.222.0.73 () {62 vars in 1199 bytes} [Thu Aug 18 11:29:15 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 18 11:29:15.965393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-77d55286-690d-4608-b5a3-884a6ee08724 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Action: 'create', calling method: .version_select at 0x7f519fb82160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-635177689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmv5s5yqvl0v/t8vOwvqgm2XIEDHbpDGIOsGPusohswbRlrfQTbrRBbpXhp0ydF83mSSHnw2l+hSXKCmA3YG36BIYWt26VfKVP2o4YA86Y1syRMZkyF1Rf2xgbsi3U13g=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:15.982782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-77d55286-690d-4608-b5a3-884a6ee08724 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:15.988156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-77d55286-690d-4608-b5a3-884a6ee08724 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for user dd3956cb006d428a9f6063c23fc6f134 and project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:16.032861 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-77d55286-690d-4608-b5a3-884a6ee08724 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.072178 Aug 18 11:29:16.044187 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 509/1023] 10.222.0.73 () {62 vars in 1199 bytes} [Thu Aug 18 11:29:15 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 18 11:29:16.053432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f74fb58f-4cd8-4f83-b6d7-642231e08d12 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Action: 'create', calling method: .version_select at 0x7f519fe8f550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-427769490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvFlS3A10JRMn2KKYRFhwrX7Cmg3nmaThG26wDtzVDVAN7EkIdZqnDfjozcND7yH0PnC2sY1huAc4HSe9etLEKqidM636LIngELc0IgZapCPZ9fRZP1AtOhFN9PnvRAgA=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:16.077456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-f74fb58f-4cd8-4f83-b6d7-642231e08d12 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:16.084133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-f74fb58f-4cd8-4f83-b6d7-642231e08d12 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for user dd3956cb006d428a9f6063c23fc6f134 and project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:16.123255 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f74fb58f-4cd8-4f83-b6d7-642231e08d12 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.078979 Aug 18 11:29:16.126852 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 510/1024] 10.222.0.73 () {62 vars in 1199 bytes} [Thu Aug 18 11:29:16 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 82 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 18 11:29:16.137398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-15ec8399-81ed-4987-8cbe-5f66d7381698 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Calling method '.version_select at 0x7f519fc1e5e0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:16.151793 n-d-853611-3 devstack@n-api.service[122210]: WARNING oslo_db.sqlalchemy.utils [None req-15ec8399-81ed-4987-8cbe-5f66d7381698 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 18 11:29:16.164438 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-15ec8399-81ed-4987-8cbe-5f66d7381698 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.031415 Aug 18 11:29:16.166375 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 511/1025] 10.222.0.73 () {60 vars in 1177 bytes} [Thu Aug 18 11:29:16 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:16.179110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb6215a2-eddc-479e-a8ce-87bfb4c35ffe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:16.179723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bb6215a2-eddc-479e-a8ce-87bfb4c35ffe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:16.187175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb6215a2-eddc-479e-a8ce-87bfb4c35ffe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:16.187856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb6215a2-eddc-479e-a8ce-87bfb4c35ffe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:16.188383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb6215a2-eddc-479e-a8ce-87bfb4c35ffe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:16.189099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb6215a2-eddc-479e-a8ce-87bfb4c35ffe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:16.189555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb6215a2-eddc-479e-a8ce-87bfb4c35ffe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:16.189979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb6215a2-eddc-479e-a8ce-87bfb4c35ffe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:16.358145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bf1e884f-b082-46a9-96a7-4eb9971512be tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:16.370645 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bf1e884f-b082-46a9-96a7-4eb9971512be tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1322 microversion: 2.1 time: 0.582551 Aug 18 11:29:16.371903 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 515/1026] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:15 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1322 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:16.377194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-30b12c95-3175-4fb6-b5ba-500b7ea7c090 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Calling method '.version_select at 0x7f519f97adc0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:16.401111 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-30b12c95-3175-4fb6-b5ba-500b7ea7c090 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-427769490" status: 204 len: 0 microversion: 2.2 time: 0.027913 Aug 18 11:29:16.402617 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 516/1027] 10.222.0.73 () {60 vars in 1318 bytes} [Thu Aug 18 11:29:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-427769490 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:16.408053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ae910663-3f0b-4bc2-8db7-0ce6e1c9e69a tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Calling method '.version_select at 0x7f519f9b4af0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:16.422645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bb6215a2-eddc-479e-a8ce-87bfb4c35ffe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:16.431881 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bb6215a2-eddc-479e-a8ce-87bfb4c35ffe tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 200 len: 1472 microversion: 2.1 time: 0.265069 Aug 18 11:29:16.445983 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 512/1028] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:16 2022] GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 1472 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:16.451597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-659230e3-9947-4b31-adfd-45bff37eae36 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Calling method '.version_select at 0x7f51ac3d8d30>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:16.477813 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-659230e3-9947-4b31-adfd-45bff37eae36 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-635177689" status: 204 len: 0 microversion: 2.2 time: 0.029459 Aug 18 11:29:16.479498 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 513/1029] 10.222.0.73 () {60 vars in 1318 bytes} [Thu Aug 18 11:29:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-635177689 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:16.488997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2454b0c0-65fb-483d-afb4-83194b636696 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Calling method '.version_select at 0x7f519fb88d30>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:16.516547 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2454b0c0-65fb-483d-afb4-83194b636696 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-163039590" status: 204 len: 0 microversion: 2.2 time: 0.032499 Aug 18 11:29:16.517189 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 514/1030] 10.222.0.73 () {60 vars in 1318 bytes} [Thu Aug 18 11:29:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-163039590 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:16.530276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c98a095e-13fd-47f9-b42a-98bf58d95e8f tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Action: 'create', calling method: .version_select at 0x7f519fd835e0>, body: {"keypair": {"name": "tempest-keypair-146839306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcbgyZQ0KWGo0jKk9pKYvsvZzLrktrETXmAd2ItNR7GbL3KSeyDylYd9j+lwe3RrxbgcdYZ5DwC4im2SwpdPz32OsRaiN8J5zFoijnYxqPOMnbshzBXenzyexNuG8eqDQ=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:16.548034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c98a095e-13fd-47f9-b42a-98bf58d95e8f tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:16.550671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:16.554749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c98a095e-13fd-47f9-b42a-98bf58d95e8f tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for user dd3956cb006d428a9f6063c23fc6f134 and project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:16.584658 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c98a095e-13fd-47f9-b42a-98bf58d95e8f tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.059097 Aug 18 11:29:16.585770 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 515/1031] 10.222.0.73 () {62 vars in 1199 bytes} [Thu Aug 18 11:29:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 18 11:29:16.596507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-31941b50-72a3-4dcb-b0b9-b26df9e6fd5f tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Calling method '.version_select at 0x7f519fc1ea60>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:16.606568 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-31941b50-72a3-4dcb-b0b9-b26df9e6fd5f tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "GET /compute/v2.1/os-keypairs/tempest-keypair-146839306" status: 200 len: 512 microversion: 2.2 time: 0.014216 Aug 18 11:29:16.607163 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 516/1032] 10.222.0.73 () {60 vars in 1255 bytes} [Thu Aug 18 11:29:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-146839306 => generated 512 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:29:16.619022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7a813878-93d6-4d4c-b100-81fde47d90c7 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Calling method '.version_select at 0x7f519fc2dd30>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:16.623008 n-d-853611-3 devstack@n-api.service[122210]: WARNING oslo_db.sqlalchemy.utils [None req-7a813878-93d6-4d4c-b100-81fde47d90c7 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 18 11:29:16.629043 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7a813878-93d6-4d4c-b100-81fde47d90c7 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.014357 Aug 18 11:29:16.630706 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 517/1033] 10.222.0.73 () {60 vars in 1177 bytes} [Thu Aug 18 11:29:16 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:29:16.643711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f91fdd38-e078-466d-82f5-07ba52f2a1c9 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Calling method '.version_select at 0x7f519fb82790>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:16.690018 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f91fdd38-e078-466d-82f5-07ba52f2a1c9 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-146839306" status: 204 len: 0 microversion: 2.2 time: 0.051033 Aug 18 11:29:16.691112 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 518/1034] 10.222.0.73 () {60 vars in 1258 bytes} [Thu Aug 18 11:29:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-146839306 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:16.700686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2765523a-929c-492e-add3-d0ed786355b7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:16.701484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2765523a-929c-492e-add3-d0ed786355b7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:16.717510 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ae910663-3f0b-4bc2-8db7-0ce6e1c9e69a tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/a5ccd93e9f9f4ce485b8d2a4c15394bd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.313586 Aug 18 11:29:16.718115 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 517/1035] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:29:16 2022] GET /compute/v2.1/os-quota-sets/a5ccd93e9f9f4ce485b8d2a4c15394bd/defaults => generated 371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:16.722645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2765523a-929c-492e-add3-d0ed786355b7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:16.723430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2765523a-929c-492e-add3-d0ed786355b7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:16.724512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2765523a-929c-492e-add3-d0ed786355b7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:16.725820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2765523a-929c-492e-add3-d0ed786355b7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:16.726382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2765523a-929c-492e-add3-d0ed786355b7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:16.726984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2765523a-929c-492e-add3-d0ed786355b7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:16.738166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4f494a0c-d533-41b4-ad25-86d500937cd0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:16.739293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4f494a0c-d533-41b4-ad25-86d500937cd0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:16.748245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f494a0c-d533-41b4-ad25-86d500937cd0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:16.749031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f494a0c-d533-41b4-ad25-86d500937cd0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:16.750243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f494a0c-d533-41b4-ad25-86d500937cd0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:16.752258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f494a0c-d533-41b4-ad25-86d500937cd0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:16.752931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f494a0c-d533-41b4-ad25-86d500937cd0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:16.754372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f494a0c-d533-41b4-ad25-86d500937cd0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:16.885465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2765523a-929c-492e-add3-d0ed786355b7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:16.896354 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2765523a-929c-492e-add3-d0ed786355b7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1504 microversion: 2.1 time: 0.203013 Aug 18 11:29:16.910120 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 519/1036] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:16 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:16.910120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-082abca1-4bd8-4233-bd56-52f67e9b87ca tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Action: 'create', calling method: .version_select at 0x7f519fb829d0>, body: {"keypair": {"name": "tempest-keypair-1397234946", "type": "x509"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:16.919798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-082abca1-4bd8-4233-bd56-52f67e9b87ca tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:16.925806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-082abca1-4bd8-4233-bd56-52f67e9b87ca tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for user dd3956cb006d428a9f6063c23fc6f134 and project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:16.942403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.processutils [None req-082abca1-4bd8-4233-bd56-52f67e9b87ca tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpbdq_jr_m/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpbdq_jr_m/temp.key -subj /CN=dd3956cb006d428a9f6063c23fc6f134 -extensions v3_req_client {{(pid=122210) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 18 11:29:17.245300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.processutils [None req-082abca1-4bd8-4233-bd56-52f67e9b87ca tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpbdq_jr_m/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpbdq_jr_m/temp.key -subj /CN=dd3956cb006d428a9f6063c23fc6f134 -extensions v3_req_client" returned: 0 in 0.302s {{(pid=122210) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 18 11:29:17.248132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.processutils [None req-082abca1-4bd8-4233-bd56-52f67e9b87ca tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpbdq_jr_m/temp.key -password pass: {{(pid=122210) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 18 11:29:17.280580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.processutils [None req-082abca1-4bd8-4233-bd56-52f67e9b87ca tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpbdq_jr_m/temp.key -password pass:" returned: 0 in 0.032s {{(pid=122210) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 18 11:29:17.327503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-082abca1-4bd8-4233-bd56-52f67e9b87ca tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:17.334877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-082abca1-4bd8-4233-bd56-52f67e9b87ca tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Getting quotas for user dd3956cb006d428a9f6063c23fc6f134 and project f601c99cdcb64dbb9bd58a9635d89464. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:17.354697 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-082abca1-4bd8-4233-bd56-52f67e9b87ca tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.456043 Aug 18 11:29:17.362871 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 520/1037] 10.222.0.73 () {62 vars in 1198 bytes} [Thu Aug 18 11:29:16 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 458 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:17.362871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cd4fec91-545c-4a93-8d49-dfefe070a545 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Action: 'update', calling method: .version_select at 0x7f519fbfd790>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:17.410826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4f494a0c-d533-41b4-ad25-86d500937cd0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:17.425298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4f494a0c-d533-41b4-ad25-86d500937cd0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:17.437803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4f494a0c-d533-41b4-ad25-86d500937cd0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:17.441905 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4f494a0c-d533-41b4-ad25-86d500937cd0 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1409 microversion: 2.25 time: 0.718902 Aug 18 11:29:17.464091 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 518/1038] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:29:16 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1409 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:17.472308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-335e0682-0210-4a3d-b819-6affed1fe273 req-c6ed6331-810c-4433-a83b-c1e539e25ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18b9b772-9949-4239-a522-78ea800d8223", "name": "network-vif-plugged", "status": "completed", "tag": "1e4bf72d-8bb8-436e-91c5-02acd25d351b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:17.487987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd4fec91-545c-4a93-8d49-dfefe070a545 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:17.489259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd4fec91-545c-4a93-8d49-dfefe070a545 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:17.490093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd4fec91-545c-4a93-8d49-dfefe070a545 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:17.491087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd4fec91-545c-4a93-8d49-dfefe070a545 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:17.491800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd4fec91-545c-4a93-8d49-dfefe070a545 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:17.492435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd4fec91-545c-4a93-8d49-dfefe070a545 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:17.521016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-335e0682-0210-4a3d-b819-6affed1fe273 req-c6ed6331-810c-4433-a83b-c1e539e25ccb service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:17.522061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-335e0682-0210-4a3d-b819-6affed1fe273 req-c6ed6331-810c-4433-a83b-c1e539e25ccb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:17.524867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-335e0682-0210-4a3d-b819-6affed1fe273 req-c6ed6331-810c-4433-a83b-c1e539e25ccb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:17.537363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:17.577260 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-335e0682-0210-4a3d-b819-6affed1fe273 req-c6ed6331-810c-4433-a83b-c1e539e25ccb service nova] Creating event network-vif-plugged:1e4bf72d-8bb8-436e-91c5-02acd25d351b for instance 18b9b772-9949-4239-a522-78ea800d8223 on n-h1-853611-3 Aug 18 11:29:17.590494 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-335e0682-0210-4a3d-b819-6affed1fe273 req-c6ed6331-810c-4433-a83b-c1e539e25ccb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123935 Aug 18 11:29:17.592299 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 519/1039] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:17.603911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a82a06bb-b492-44a4-9edb-042af29ec865 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Calling method '.version_select at 0x7f519f97af70>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:17.629040 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a82a06bb-b492-44a4-9edb-042af29ec865 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "GET /compute/v2.1/os-keypairs/tempest-keypair-1397234946" status: 200 len: 1534 microversion: 2.2 time: 0.033859 Aug 18 11:29:17.640944 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 520/1040] 10.222.0.73 () {60 vars in 1258 bytes} [Thu Aug 18 11:29:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1397234946 => generated 1534 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:17.648387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-884487f3-c9ed-4046-81ea-3e2131f8bbde tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:17.649422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-884487f3-c9ed-4046-81ea-3e2131f8bbde tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:17.656163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-884487f3-c9ed-4046-81ea-3e2131f8bbde tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:17.656836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-884487f3-c9ed-4046-81ea-3e2131f8bbde tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:17.657280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-884487f3-c9ed-4046-81ea-3e2131f8bbde tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:17.658196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-884487f3-c9ed-4046-81ea-3e2131f8bbde tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:17.658883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-884487f3-c9ed-4046-81ea-3e2131f8bbde tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:17.660317 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-884487f3-c9ed-4046-81ea-3e2131f8bbde tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:17.983731 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cd4fec91-545c-4a93-8d49-dfefe070a545 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/a5ccd93e9f9f4ce485b8d2a4c15394bd" status: 200 len: 329 microversion: 2.1 time: 0.626538 Aug 18 11:29:17.990670 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 521/1041] 10.222.0.73 () {60 vars in 1263 bytes} [Thu Aug 18 11:29:17 2022] PUT /compute/v2.1/os-quota-sets/a5ccd93e9f9f4ce485b8d2a4c15394bd => generated 329 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:17.991130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4526b138-ec94-40bb-becf-9af84787b83f req-83f2983f-1c05-48ad-b51c-8eee67229f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403202c1-4021-4975-82bc-2202975dd6c4", "name": "network-vif-deleted", "tag": "dc6f474f-ac9d-40d6-b8a7-dfa73d80efdf"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:18.006374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4526b138-ec94-40bb-becf-9af84787b83f req-83f2983f-1c05-48ad-b51c-8eee67229f2f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:18.006917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4526b138-ec94-40bb-becf-9af84787b83f req-83f2983f-1c05-48ad-b51c-8eee67229f2f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:18.007987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4526b138-ec94-40bb-becf-9af84787b83f req-83f2983f-1c05-48ad-b51c-8eee67229f2f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:18.021806 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4526b138-ec94-40bb-becf-9af84787b83f req-83f2983f-1c05-48ad-b51c-8eee67229f2f service nova] Creating event network-vif-deleted:dc6f474f-ac9d-40d6-b8a7-dfa73d80efdf for instance 403202c1-4021-4975-82bc-2202975dd6c4 on n-h2-853611-3 Aug 18 11:29:18.027984 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4526b138-ec94-40bb-becf-9af84787b83f req-83f2983f-1c05-48ad-b51c-8eee67229f2f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041700 Aug 18 11:29:18.029057 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 522/1042] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:18.034474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d9d31d7-1891-4544-9f2a-932fe6f1621b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:18.035291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9d9d31d7-1891-4544-9f2a-932fe6f1621b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:18.042464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d9d31d7-1891-4544-9f2a-932fe6f1621b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:18.042972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d9d31d7-1891-4544-9f2a-932fe6f1621b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:18.050940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d9d31d7-1891-4544-9f2a-932fe6f1621b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:18.052199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d9d31d7-1891-4544-9f2a-932fe6f1621b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:18.053451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d9d31d7-1891-4544-9f2a-932fe6f1621b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:18.054061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d9d31d7-1891-4544-9f2a-932fe6f1621b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:18.104474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d9d31d7-1891-4544-9f2a-932fe6f1621b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:18.104964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d9d31d7-1891-4544-9f2a-932fe6f1621b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:18.106281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d9d31d7-1891-4544-9f2a-932fe6f1621b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:18.106281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-9d9d31d7-1891-4544-9f2a-932fe6f1621b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lazy-loading 'fault' on Instance uuid 403202c1-4021-4975-82bc-2202975dd6c4 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:29:18.161087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-884487f3-c9ed-4046-81ea-3e2131f8bbde tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:18.169986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9d9d31d7-1891-4544-9f2a-932fe6f1621b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:18.170153 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-884487f3-c9ed-4046-81ea-3e2131f8bbde tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1322 microversion: 2.1 time: 0.527316 Aug 18 11:29:18.170959 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 521/1043] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:17 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:18.176110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-54debc9f-3f00-4592-bb61-ab8985ae6099 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Calling method '.version_select at 0x7f519f92cf70>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:18.178352 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9d9d31d7-1891-4544-9f2a-932fe6f1621b tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 200 len: 1307 microversion: 2.1 time: 0.147984 Aug 18 11:29:18.179461 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 523/1044] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:18 2022] GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 1307 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:18.181119 n-d-853611-3 devstack@n-api.service[122209]: WARNING oslo_db.sqlalchemy.utils [None req-54debc9f-3f00-4592-bb61-ab8985ae6099 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 18 11:29:18.185120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11d30c30-7a82-4a06-9ac6-f999bd27133a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:18.185737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-11d30c30-7a82-4a06-9ac6-f999bd27133a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:18.192641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11d30c30-7a82-4a06-9ac6-f999bd27133a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:18.193130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11d30c30-7a82-4a06-9ac6-f999bd27133a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:18.193566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11d30c30-7a82-4a06-9ac6-f999bd27133a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:18.194338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11d30c30-7a82-4a06-9ac6-f999bd27133a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:18.195007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11d30c30-7a82-4a06-9ac6-f999bd27133a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:18.195438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11d30c30-7a82-4a06-9ac6-f999bd27133a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:18.197223 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-54debc9f-3f00-4592-bb61-ab8985ae6099 tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.025210 Aug 18 11:29:18.198042 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 522/1045] 10.222.0.73 () {60 vars in 1177 bytes} [Thu Aug 18 11:29:18 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:18.202024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:18.205768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-614bada5-100b-428b-bca6-6f0009c4efe1 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Action: 'update', calling method: .version_select at 0x7f519f929700>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:18.308003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-614bada5-100b-428b-bca6-6f0009c4efe1 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:18.308500 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-614bada5-100b-428b-bca6-6f0009c4efe1 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:18.308937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-614bada5-100b-428b-bca6-6f0009c4efe1 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:18.309674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-614bada5-100b-428b-bca6-6f0009c4efe1 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:18.310137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-614bada5-100b-428b-bca6-6f0009c4efe1 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:18.310595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-614bada5-100b-428b-bca6-6f0009c4efe1 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:18.468806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11d30c30-7a82-4a06-9ac6-f999bd27133a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:18.478823 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-11d30c30-7a82-4a06-9ac6-f999bd27133a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1504 microversion: 2.1 time: 0.297644 Aug 18 11:29:18.479726 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 524/1046] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:18 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1504 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:18.484861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f1ed08f-31fb-4945-9dbe-b51f14aff90b tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] Calling method '.version_select at 0x7f519fb82e50>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:18.521249 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7f1ed08f-31fb-4945-9dbe-b51f14aff90b tempest-KeyPairsV22TestJSON-172498341 tempest-KeyPairsV22TestJSON-172498341-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397234946" status: 204 len: 0 microversion: 2.2 time: 0.040179 Aug 18 11:29:18.526549 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 525/1047] 10.222.0.73 () {60 vars in 1261 bytes} [Thu Aug 18 11:29:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397234946 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:18.535380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0ed0226d-4683-41f4-898b-9d5637c589d9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:18.536336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0ed0226d-4683-41f4-898b-9d5637c589d9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:18.544663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ed0226d-4683-41f4-898b-9d5637c589d9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:18.545412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ed0226d-4683-41f4-898b-9d5637c589d9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:18.546081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ed0226d-4683-41f4-898b-9d5637c589d9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:18.547185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ed0226d-4683-41f4-898b-9d5637c589d9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:18.547832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ed0226d-4683-41f4-898b-9d5637c589d9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:18.548619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ed0226d-4683-41f4-898b-9d5637c589d9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:18.569366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=10,nova_api:INSERT=11,nova_api:DELETE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:18.712373 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-614bada5-100b-428b-bca6-6f0009c4efe1 tempest-QuotasAdminTestJSON-1768360107 tempest-QuotasAdminTestJSON-1768360107-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/a5ccd93e9f9f4ce485b8d2a4c15394bd" status: 200 len: 329 microversion: 2.1 time: 0.512789 Aug 18 11:29:18.713388 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 523/1048] 10.222.0.73 () {60 vars in 1263 bytes} [Thu Aug 18 11:29:18 2022] PUT /compute/v2.1/os-quota-sets/a5ccd93e9f9f4ce485b8d2a4c15394bd => generated 329 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:18.838819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0ed0226d-4683-41f4-898b-9d5637c589d9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:18.851535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0ed0226d-4683-41f4-898b-9d5637c589d9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:18.857033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0ed0226d-4683-41f4-898b-9d5637c589d9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:18.861670 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0ed0226d-4683-41f4-898b-9d5637c589d9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1409 microversion: 2.25 time: 0.333318 Aug 18 11:29:18.862515 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 526/1049] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:29:18 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1409 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:19.203727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d46bacfb-aa5d-4054-b5c7-39f1aa90b0aa tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:19.204362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d46bacfb-aa5d-4054-b5c7-39f1aa90b0aa tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:19.227950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-85596092-ccf3-4fb1-9a46-848d27617fd6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:19.228629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-85596092-ccf3-4fb1-9a46-848d27617fd6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 403202c1-4021-4975-82bc-2202975dd6c4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:19.245999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d46bacfb-aa5d-4054-b5c7-39f1aa90b0aa tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:19.246537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d46bacfb-aa5d-4054-b5c7-39f1aa90b0aa tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:19.246982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d46bacfb-aa5d-4054-b5c7-39f1aa90b0aa tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:19.251103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85596092-ccf3-4fb1-9a46-848d27617fd6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:19.253570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85596092-ccf3-4fb1-9a46-848d27617fd6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:19.254026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85596092-ccf3-4fb1-9a46-848d27617fd6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:19.255236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85596092-ccf3-4fb1-9a46-848d27617fd6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:19.255904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d46bacfb-aa5d-4054-b5c7-39f1aa90b0aa tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:19.257021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d46bacfb-aa5d-4054-b5c7-39f1aa90b0aa tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:19.257899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85596092-ccf3-4fb1-9a46-848d27617fd6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:19.261338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85596092-ccf3-4fb1-9a46-848d27617fd6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:19.261918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d46bacfb-aa5d-4054-b5c7-39f1aa90b0aa tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:19.296080 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-85596092-ccf3-4fb1-9a46-848d27617fd6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] HTTP exception thrown: Instance 403202c1-4021-4975-82bc-2202975dd6c4 could not be found. Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-85596092-ccf3-4fb1-9a46-848d27617fd6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Request method failure captured: Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 HTTP/1.1 Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iHIwwevFwKV8xm18kbPD3Ciy8CvScg1fDfl7wNmdQTnBTrBT97kbGF3NuiwyTQZfFarL5ZQ_ovW6qJoZzgynXj2UZuYP-JiihvsYTyFfdjisb-mFUTjTlzA9uSeEs_Ej_djUg_OyBjwyPw77sh7iTNOfHkUZhc2sk4s13i0I8-Szeo Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:29:19.297949 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:29:19.301007 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:19.301007 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:19.301007 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:19.301007 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:19.301007 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:19.301007 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:29:19.301007 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:29:19.301007 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: b75d06aa767c4f7799209c7d0fe23d2c Aug 18 11:29:19.301007 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:19.301007 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:29:19.301007 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 403202c1-4021-4975-82bc-2202975dd6c4 could not be found. Aug 18 11:29:19.301007 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '403202c1-4021-4975-82bc-2202975dd6c4'} Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403202c1-4021-4975-82bc-2202975dd6c4 could not be found. Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:19.302832 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403202c1-4021-4975-82bc-2202975dd6c4 could not be found. Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403202c1-4021-4975-82bc-2202975dd6c4 could not be found. Aug 18 11:29:19.305587 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:19.308181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-85596092-ccf3-4fb1-9a46-848d27617fd6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Returning 404 to user: Instance 403202c1-4021-4975-82bc-2202975dd6c4 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:19.308181 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-85596092-ccf3-4fb1-9a46-848d27617fd6 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4" status: 404 len: 111 microversion: 2.1 time: 0.085712 Aug 18 11:29:19.308181 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 527/1050] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:19 2022] GET /compute/v2.1/servers/403202c1-4021-4975-82bc-2202975dd6c4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:29:19.317213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-725ac720-c59f-49b4-971c-1703c94cc2fa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:19.317730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-725ac720-c59f-49b4-971c-1703c94cc2fa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:19.329222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-725ac720-c59f-49b4-971c-1703c94cc2fa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:19.329732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-725ac720-c59f-49b4-971c-1703c94cc2fa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:19.330159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-725ac720-c59f-49b4-971c-1703c94cc2fa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:19.330903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-725ac720-c59f-49b4-971c-1703c94cc2fa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:19.331357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-725ac720-c59f-49b4-971c-1703c94cc2fa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:19.331791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-725ac720-c59f-49b4-971c-1703c94cc2fa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:19.390152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-725ac720-c59f-49b4-971c-1703c94cc2fa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:29:19.520106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=16,nova_api:DELETE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:19.543089 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-725ac720-c59f-49b4-971c-1703c94cc2fa tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d" status: 204 len: 0 microversion: 2.1 time: 0.234241 Aug 18 11:29:19.549002 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 528/1051] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:29:19 2022] DELETE /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:19.576968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e3bf02e9-466e-4c88-b1dc-d8fb65b04bc4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:19.580222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e3bf02e9-466e-4c88-b1dc-d8fb65b04bc4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:19.606782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3bf02e9-466e-4c88-b1dc-d8fb65b04bc4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:19.607309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3bf02e9-466e-4c88-b1dc-d8fb65b04bc4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:19.609725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3bf02e9-466e-4c88-b1dc-d8fb65b04bc4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:19.611309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3bf02e9-466e-4c88-b1dc-d8fb65b04bc4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:19.613158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3bf02e9-466e-4c88-b1dc-d8fb65b04bc4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:19.614470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3bf02e9-466e-4c88-b1dc-d8fb65b04bc4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:19.697154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d46bacfb-aa5d-4054-b5c7-39f1aa90b0aa tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:19.706323 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d46bacfb-aa5d-4054-b5c7-39f1aa90b0aa tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1322 microversion: 2.1 time: 0.507682 Aug 18 11:29:19.707162 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 524/1052] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:19 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:19.719361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1e73e0c0-fe84-4f5d-afc9-fcc57b5cc0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:19.722308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1e73e0c0-fe84-4f5d-afc9-fcc57b5cc0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 53f5ee39-045c-4250-a4b5-efdd3f7b590d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:19.753838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e73e0c0-fe84-4f5d-afc9-fcc57b5cc0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:19.754470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e73e0c0-fe84-4f5d-afc9-fcc57b5cc0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:19.755157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e73e0c0-fe84-4f5d-afc9-fcc57b5cc0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:19.756692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e73e0c0-fe84-4f5d-afc9-fcc57b5cc0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:19.757913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e73e0c0-fe84-4f5d-afc9-fcc57b5cc0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:19.759311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e73e0c0-fe84-4f5d-afc9-fcc57b5cc0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:19.838245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1e73e0c0-fe84-4f5d-afc9-fcc57b5cc0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 53f5ee39-045c-4250-a4b5-efdd3f7b590d] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:29:20.013203 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1e73e0c0-fe84-4f5d-afc9-fcc57b5cc0a4 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "DELETE /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d" status: 204 len: 0 microversion: 2.1 time: 0.304627 Aug 18 11:29:20.014011 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 525/1053] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:29:19 2022] DELETE /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:20.022163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0ece73c7-b97d-44b0-9524-6577a15d66f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:20.022926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0ece73c7-b97d-44b0-9524-6577a15d66f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:20.044423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e3bf02e9-466e-4c88-b1dc-d8fb65b04bc4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:20.048901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ece73c7-b97d-44b0-9524-6577a15d66f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:20.053017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ece73c7-b97d-44b0-9524-6577a15d66f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:20.057508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ece73c7-b97d-44b0-9524-6577a15d66f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:20.060036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ece73c7-b97d-44b0-9524-6577a15d66f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:20.060862 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e3bf02e9-466e-4c88-b1dc-d8fb65b04bc4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1504 microversion: 2.1 time: 0.504542 Aug 18 11:29:20.061946 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 529/1054] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:19 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1504 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:20.062972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ece73c7-b97d-44b0-9524-6577a15d66f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:20.064721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ece73c7-b97d-44b0-9524-6577a15d66f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:20.072995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8dff8071-dc24-4c74-a0ef-e2a80f7fbe49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:20.073965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8dff8071-dc24-4c74-a0ef-e2a80f7fbe49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:20.095645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dff8071-dc24-4c74-a0ef-e2a80f7fbe49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:20.096600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dff8071-dc24-4c74-a0ef-e2a80f7fbe49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:20.097320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dff8071-dc24-4c74-a0ef-e2a80f7fbe49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:20.099336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dff8071-dc24-4c74-a0ef-e2a80f7fbe49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:20.100186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dff8071-dc24-4c74-a0ef-e2a80f7fbe49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:20.100779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dff8071-dc24-4c74-a0ef-e2a80f7fbe49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:20.373096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0ece73c7-b97d-44b0-9524-6577a15d66f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:20.386885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0ece73c7-b97d-44b0-9524-6577a15d66f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:20.388602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0ece73c7-b97d-44b0-9524-6577a15d66f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:20.389803 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0ece73c7-b97d-44b0-9524-6577a15d66f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1605 microversion: 2.25 time: 0.371988 Aug 18 11:29:20.390373 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 526/1055] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:29:20 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1605 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:20.412339 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-85254ca7-1e30-4934-a9da-95225222c64c req-49b3e10a-145e-48f0-be15-15dd10a834d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6806735a-b820-48c6-a1bb-917e42fb801e", "tag": "dc3abf7a-7b1a-45a4-8efc-335d557a21d9"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:20.416770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8dff8071-dc24-4c74-a0ef-e2a80f7fbe49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:20.426108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-85254ca7-1e30-4934-a9da-95225222c64c req-49b3e10a-145e-48f0-be15-15dd10a834d5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:20.426934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-85254ca7-1e30-4934-a9da-95225222c64c req-49b3e10a-145e-48f0-be15-15dd10a834d5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:20.427059 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8dff8071-dc24-4c74-a0ef-e2a80f7fbe49 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d" status: 200 len: 1473 microversion: 2.1 time: 0.357289 Aug 18 11:29:20.427640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-85254ca7-1e30-4934-a9da-95225222c64c req-49b3e10a-145e-48f0-be15-15dd10a834d5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:20.428380 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 530/1056] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:20 2022] GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d => generated 1473 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:20.434273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d17ca4c-64c7-433b-9756-548debf6ad02 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:20.439415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9d17ca4c-64c7-433b-9756-548debf6ad02 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:20.444878 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-85254ca7-1e30-4934-a9da-95225222c64c req-49b3e10a-145e-48f0-be15-15dd10a834d5 service nova] Creating event network-changed:dc3abf7a-7b1a-45a4-8efc-335d557a21d9 for instance 6806735a-b820-48c6-a1bb-917e42fb801e on n-h1-853611-3 Aug 18 11:29:20.447706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d17ca4c-64c7-433b-9756-548debf6ad02 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:20.448333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d17ca4c-64c7-433b-9756-548debf6ad02 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:20.448882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d17ca4c-64c7-433b-9756-548debf6ad02 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:20.449706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d17ca4c-64c7-433b-9756-548debf6ad02 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:20.450276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d17ca4c-64c7-433b-9756-548debf6ad02 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:20.450851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d17ca4c-64c7-433b-9756-548debf6ad02 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:20.453972 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-85254ca7-1e30-4934-a9da-95225222c64c req-49b3e10a-145e-48f0-be15-15dd10a834d5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050836 Aug 18 11:29:20.455742 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 527/1057] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:20.648257 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9d17ca4c-64c7-433b-9756-548debf6ad02 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.218104 Aug 18 11:29:20.648961 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 531/1058] 10.222.0.73 () {60 vars in 1316 bytes} [Thu Aug 18 11:29:20 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-interface => generated 284 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:29:20.733313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2de7fb8d-9b51-433e-bfe8-500bfd44bbf0 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:20.734137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2de7fb8d-9b51-433e-bfe8-500bfd44bbf0 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:20.752773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2de7fb8d-9b51-433e-bfe8-500bfd44bbf0 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:20.753846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2de7fb8d-9b51-433e-bfe8-500bfd44bbf0 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:20.754945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2de7fb8d-9b51-433e-bfe8-500bfd44bbf0 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:20.756242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2de7fb8d-9b51-433e-bfe8-500bfd44bbf0 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:20.756900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2de7fb8d-9b51-433e-bfe8-500bfd44bbf0 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:20.757660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2de7fb8d-9b51-433e-bfe8-500bfd44bbf0 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:21.108768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f558af8d-6bfb-4980-94b2-a9aaacd45f26 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:21.110244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f558af8d-6bfb-4980-94b2-a9aaacd45f26 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:21.127373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f558af8d-6bfb-4980-94b2-a9aaacd45f26 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:21.131005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f558af8d-6bfb-4980-94b2-a9aaacd45f26 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:21.132107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f558af8d-6bfb-4980-94b2-a9aaacd45f26 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:21.136590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f558af8d-6bfb-4980-94b2-a9aaacd45f26 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:21.139345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f558af8d-6bfb-4980-94b2-a9aaacd45f26 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:21.141302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f558af8d-6bfb-4980-94b2-a9aaacd45f26 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:21.892752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f558af8d-6bfb-4980-94b2-a9aaacd45f26 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:21.930905 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f558af8d-6bfb-4980-94b2-a9aaacd45f26 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1504 microversion: 2.1 time: 0.825971 Aug 18 11:29:21.933081 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 532/1059] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:21 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1504 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:21.938779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-882ecb65-5d17-4af3-8faf-9c114513968c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:21.939576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-882ecb65-5d17-4af3-8faf-9c114513968c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:21.951475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-882ecb65-5d17-4af3-8faf-9c114513968c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:21.952633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-882ecb65-5d17-4af3-8faf-9c114513968c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:21.953295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-882ecb65-5d17-4af3-8faf-9c114513968c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:21.954367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-882ecb65-5d17-4af3-8faf-9c114513968c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:21.955052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-882ecb65-5d17-4af3-8faf-9c114513968c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:21.955763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-882ecb65-5d17-4af3-8faf-9c114513968c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:22.366646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-882ecb65-5d17-4af3-8faf-9c114513968c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:22.377892 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-882ecb65-5d17-4af3-8faf-9c114513968c tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d" status: 200 len: 1473 microversion: 2.1 time: 0.443387 Aug 18 11:29:22.402851 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 533/1060] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:21 2022] GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d => generated 1473 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:22.923113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2de7fb8d-9b51-433e-bfe8-500bfd44bbf0 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:22.939734 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2de7fb8d-9b51-433e-bfe8-500bfd44bbf0 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1322 microversion: 2.1 time: 2.208785 Aug 18 11:29:22.940519 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 528/1061] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:20 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1322 bytes in 2213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:22.958963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-265e8cd1-adc8-4b92-acef-30593e031a00 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:22.959872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-265e8cd1-adc8-4b92-acef-30593e031a00 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:22.979962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-265e8cd1-adc8-4b92-acef-30593e031a00 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:22.982116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-265e8cd1-adc8-4b92-acef-30593e031a00 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:22.982644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-265e8cd1-adc8-4b92-acef-30593e031a00 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:22.984487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-265e8cd1-adc8-4b92-acef-30593e031a00 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:22.987638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-265e8cd1-adc8-4b92-acef-30593e031a00 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:22.989132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-265e8cd1-adc8-4b92-acef-30593e031a00 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:23.302210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1557786024", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "a030fd0a-f8f2-42d5-b02a-6604a919b9da"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:23.389497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] validate_networks() for [('a030fd0a-f8f2-42d5-b02a-6604a919b9da', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:29:23.427763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-265e8cd1-adc8-4b92-acef-30593e031a00 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:23.439572 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-265e8cd1-adc8-4b92-acef-30593e031a00 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1479 microversion: 2.1 time: 0.483341 Aug 18 11:29:23.458613 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 534/1062] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:22 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1479 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:23.486494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0d0fd8f3-95d4-49fd-9b0a-8405e0488894 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:23.490364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0d0fd8f3-95d4-49fd-9b0a-8405e0488894 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:23.512424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d0fd8f3-95d4-49fd-9b0a-8405e0488894 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:23.513018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d0fd8f3-95d4-49fd-9b0a-8405e0488894 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:23.513471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d0fd8f3-95d4-49fd-9b0a-8405e0488894 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:23.514216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d0fd8f3-95d4-49fd-9b0a-8405e0488894 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:23.518720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d0fd8f3-95d4-49fd-9b0a-8405e0488894 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:23.519182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d0fd8f3-95d4-49fd-9b0a-8405e0488894 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:23.864805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0d0fd8f3-95d4-49fd-9b0a-8405e0488894 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:23.875698 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0d0fd8f3-95d4-49fd-9b0a-8405e0488894 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d" status: 200 len: 1473 microversion: 2.1 time: 0.414811 Aug 18 11:29:23.879050 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 535/1063] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:23 2022] GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d => generated 1473 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:23.895484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-15ff317a-8532-473b-9312-774016fc9b2d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '.version_select at 0x7f519fb8b550>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:23.901294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15ff317a-8532-473b-9312-774016fc9b2d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:23.901781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15ff317a-8532-473b-9312-774016fc9b2d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:23.902218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15ff317a-8532-473b-9312-774016fc9b2d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:23.922556 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-15ff317a-8532-473b-9312-774016fc9b2d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.042261 Aug 18 11:29:23.943752 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 536/1064] 10.222.0.73 () {58 vars in 1143 bytes} [Thu Aug 18 11:29:23 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:23.954790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0be9ea51-b334-4422-822e-632c37c8e11d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:23.955518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0be9ea51-b334-4422-822e-632c37c8e11d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:23.975783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0be9ea51-b334-4422-822e-632c37c8e11d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:23.977201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0be9ea51-b334-4422-822e-632c37c8e11d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:23.979031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0be9ea51-b334-4422-822e-632c37c8e11d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:23.979783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0be9ea51-b334-4422-822e-632c37c8e11d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:23.981415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0be9ea51-b334-4422-822e-632c37c8e11d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:23.981865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0be9ea51-b334-4422-822e-632c37c8e11d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:24.259644 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0be9ea51-b334-4422-822e-632c37c8e11d tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1630 microversion: 2.1 time: 0.314461 Aug 18 11:29:24.275587 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 537/1065] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:23 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1630 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:24.291131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ca1d7c71-98da-45ad-ae3b-bbf90d7bb3e6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:24.292010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ca1d7c71-98da-45ad-ae3b-bbf90d7bb3e6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:24.304058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca1d7c71-98da-45ad-ae3b-bbf90d7bb3e6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:24.305755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca1d7c71-98da-45ad-ae3b-bbf90d7bb3e6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:24.306860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca1d7c71-98da-45ad-ae3b-bbf90d7bb3e6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:24.308863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca1d7c71-98da-45ad-ae3b-bbf90d7bb3e6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:24.309610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca1d7c71-98da-45ad-ae3b-bbf90d7bb3e6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:24.310239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca1d7c71-98da-45ad-ae3b-bbf90d7bb3e6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:24.549239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ca1d7c71-98da-45ad-ae3b-bbf90d7bb3e6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:24.561844 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ca1d7c71-98da-45ad-ae3b-bbf90d7bb3e6 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1322 microversion: 2.1 time: 0.284777 Aug 18 11:29:24.563058 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 538/1066] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:24 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:24.570441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55d76143-3da8-4d3a-97a5-fe607a712ccf tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Action: 'create', calling method: .version_select at 0x7f519fc30040>, body: {"keypair": {"name": "tempest-keypair-2083530406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxgiv6/LPEGLkms+qStPLNJMC+xzyMnaM0iIRIOt6DYrBapU0jYSYtT9i9jVxlIchUekO1RHoO/TpTx4wCGRBwz8SWG/vq8Snhau+iGehtR1+U3GDgXNF0tl5UYmvLvmQ=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:24.610814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-55d76143-3da8-4d3a-97a5-fe607a712ccf tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Getting quotas for project 22660df6ec1a4f718a08cbeda2be364c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:24.627197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-55d76143-3da8-4d3a-97a5-fe607a712ccf tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Getting quotas for user 0cf7fe4236764bea83c6560516441759 and project 22660df6ec1a4f718a08cbeda2be364c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:24.705491 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-55d76143-3da8-4d3a-97a5-fe607a712ccf tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141076 Aug 18 11:29:24.706577 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 539/1067] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:29:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:24.923113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-14f56949-fb48-4d03-a9cc-cd50aaad4256 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:24.926300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-14f56949-fb48-4d03-a9cc-cd50aaad4256 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:24.944623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14f56949-fb48-4d03-a9cc-cd50aaad4256 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:24.948893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14f56949-fb48-4d03-a9cc-cd50aaad4256 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:24.949722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14f56949-fb48-4d03-a9cc-cd50aaad4256 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:24.951453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14f56949-fb48-4d03-a9cc-cd50aaad4256 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:24.953301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14f56949-fb48-4d03-a9cc-cd50aaad4256 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:24.954028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14f56949-fb48-4d03-a9cc-cd50aaad4256 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:25.322545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-14f56949-fb48-4d03-a9cc-cd50aaad4256 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:25.337059 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-14f56949-fb48-4d03-a9cc-cd50aaad4256 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d" status: 200 len: 1473 microversion: 2.1 time: 0.429135 Aug 18 11:29:25.350763 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 540/1068] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:24 2022] GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d => generated 1473 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:25.584843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0fe8b247-ef8b-42ff-a503-3da6c2dcec5c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:25.585987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0fe8b247-ef8b-42ff-a503-3da6c2dcec5c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:25.599231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fe8b247-ef8b-42ff-a503-3da6c2dcec5c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:25.602799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fe8b247-ef8b-42ff-a503-3da6c2dcec5c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:25.604603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fe8b247-ef8b-42ff-a503-3da6c2dcec5c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:25.607293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fe8b247-ef8b-42ff-a503-3da6c2dcec5c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:25.608992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fe8b247-ef8b-42ff-a503-3da6c2dcec5c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:25.609667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fe8b247-ef8b-42ff-a503-3da6c2dcec5c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:25.962821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0fe8b247-ef8b-42ff-a503-3da6c2dcec5c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:25.976431 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0fe8b247-ef8b-42ff-a503-3da6c2dcec5c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1322 microversion: 2.1 time: 0.396534 Aug 18 11:29:25.991666 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 541/1069] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:25 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:29:26.019024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7a87e5f7-fed0-450d-87c5-3bab305157c2 req-eeaeac6d-12e4-4bb3-9669-b6218c495c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18b9b772-9949-4239-a522-78ea800d8223", "tag": "1e4bf72d-8bb8-436e-91c5-02acd25d351b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:26.057112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a87e5f7-fed0-450d-87c5-3bab305157c2 req-eeaeac6d-12e4-4bb3-9669-b6218c495c75 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:26.057608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a87e5f7-fed0-450d-87c5-3bab305157c2 req-eeaeac6d-12e4-4bb3-9669-b6218c495c75 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:26.058048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a87e5f7-fed0-450d-87c5-3bab305157c2 req-eeaeac6d-12e4-4bb3-9669-b6218c495c75 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:26.127473 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7a87e5f7-fed0-450d-87c5-3bab305157c2 req-eeaeac6d-12e4-4bb3-9669-b6218c495c75 service nova] Creating event network-changed:1e4bf72d-8bb8-436e-91c5-02acd25d351b for instance 18b9b772-9949-4239-a522-78ea800d8223 on n-h1-853611-3 Aug 18 11:29:26.145122 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7a87e5f7-fed0-450d-87c5-3bab305157c2 req-eeaeac6d-12e4-4bb3-9669-b6218c495c75 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147551 Aug 18 11:29:26.148868 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 542/1070] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:26.158393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ddb6a625-20b0-4f7e-8ff6-c8d9726e8d98 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0860583-e541-432b-b188-030557fdaec4"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:26.180514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ddb6a625-20b0-4f7e-8ff6-c8d9726e8d98 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:26.199103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddb6a625-20b0-4f7e-8ff6-c8d9726e8d98 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:26.200242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddb6a625-20b0-4f7e-8ff6-c8d9726e8d98 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:26.202685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddb6a625-20b0-4f7e-8ff6-c8d9726e8d98 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:26.208050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddb6a625-20b0-4f7e-8ff6-c8d9726e8d98 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:26.209205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddb6a625-20b0-4f7e-8ff6-c8d9726e8d98 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:26.210711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddb6a625-20b0-4f7e-8ff6-c8d9726e8d98 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:26.265588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:26.424960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:29:26.426684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:29:26.428991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:29:26.431604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:29:26.432229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:29:26.495962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:26.499849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:26.505418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:26.509984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:26.510894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:26.511615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:26.593855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Getting quotas for project 8064d9cbfe6a4a96944cc1d7a1817ed8. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:26.613038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Getting quotas for user ed6ed454654f4ce0a01d407f18524a52 and project 8064d9cbfe6a4a96944cc1d7a1817ed8. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:26.659621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:29:26.665216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:29:26.853750 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ed0c0631-7123-4b0b-94b4-468104b31afe tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.714800 Aug 18 11:29:26.861239 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 529/1071] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:29:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:29:26.870385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f3994944-739d-46a8-ba10-f16127d6b8d5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:26.871299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f3994944-739d-46a8-ba10-f16127d6b8d5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:26.881582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3994944-739d-46a8-ba10-f16127d6b8d5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:26.882507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3994944-739d-46a8-ba10-f16127d6b8d5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:26.883319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3994944-739d-46a8-ba10-f16127d6b8d5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:26.884309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3994944-739d-46a8-ba10-f16127d6b8d5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:26.884934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3994944-739d-46a8-ba10-f16127d6b8d5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:26.885673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3994944-739d-46a8-ba10-f16127d6b8d5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:26.959564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3994944-739d-46a8-ba10-f16127d6b8d5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:26.960291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3994944-739d-46a8-ba10-f16127d6b8d5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:26.961549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3994944-739d-46a8-ba10-f16127d6b8d5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:26.962214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-f3994944-739d-46a8-ba10-f16127d6b8d5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lazy-loading 'fault' on Instance uuid dd3052f2-209e-43f1-a4a4-227ac5bc5f3d {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:29:27.157292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f3994944-739d-46a8-ba10-f16127d6b8d5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:27.198407 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f3994944-739d-46a8-ba10-f16127d6b8d5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d" status: 200 len: 1308 microversion: 2.1 time: 0.327852 Aug 18 11:29:27.201941 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 530/1072] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:26 2022] GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:27.212575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6e82adec-b955-434f-922a-e08a3efef97e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:27.233730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6e82adec-b955-434f-922a-e08a3efef97e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:27.403812 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ddb6a625-20b0-4f7e-8ff6-c8d9726e8d98 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "POST /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.253283 Aug 18 11:29:27.410223 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 543/1073] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:29:26 2022] POST /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d/os-volume_attachments => generated 194 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:27.417420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e1033a94-f1ac-449b-b6f9-b7fe26bd6b2c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:27.427281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e1033a94-f1ac-449b-b6f9-b7fe26bd6b2c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:27.455438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1033a94-f1ac-449b-b6f9-b7fe26bd6b2c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:27.479536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1033a94-f1ac-449b-b6f9-b7fe26bd6b2c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:27.480034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1033a94-f1ac-449b-b6f9-b7fe26bd6b2c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:27.481958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1033a94-f1ac-449b-b6f9-b7fe26bd6b2c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:27.484423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1033a94-f1ac-449b-b6f9-b7fe26bd6b2c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:27.485028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1033a94-f1ac-449b-b6f9-b7fe26bd6b2c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:27.506765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6e82adec-b955-434f-922a-e08a3efef97e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:27.521073 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6e82adec-b955-434f-922a-e08a3efef97e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1225 microversion: 2.1 time: 0.315633 Aug 18 11:29:27.521674 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 531/1074] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:27 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1225 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:27.534796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=15 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:28.227453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c6ef51f4-9d96-4957-9d00-dfba255cb99e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:28.228198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c6ef51f4-9d96-4957-9d00-dfba255cb99e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: dd3052f2-209e-43f1-a4a4-227ac5bc5f3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:28.240782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6ef51f4-9d96-4957-9d00-dfba255cb99e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:28.244446 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6ef51f4-9d96-4957-9d00-dfba255cb99e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:28.245452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6ef51f4-9d96-4957-9d00-dfba255cb99e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:28.251157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6ef51f4-9d96-4957-9d00-dfba255cb99e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:28.255096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6ef51f4-9d96-4957-9d00-dfba255cb99e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:28.256121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6ef51f4-9d96-4957-9d00-dfba255cb99e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:28.293112 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-c6ef51f4-9d96-4957-9d00-dfba255cb99e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] HTTP exception thrown: Instance dd3052f2-209e-43f1-a4a4-227ac5bc5f3d could not be found. Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c6ef51f4-9d96-4957-9d00-dfba255cb99e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Request method failure captured: Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d HTTP/1.1 Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iHIwwevFwKV8xm18kbPD3Ciy8CvScg1fDfl7wNmdQTnBTrBT97kbGF3NuiwyTQZfFarL5ZQ_ovW6qJoZzgynXj2UZuYP-JiihvsYTyFfdjisb-mFUTjTlzA9uSeEs_Ej_djUg_OyBjwyPw77sh7iTNOfHkUZhc2sk4s13i0I8-Szeo Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:29:28.305117 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:29:28.306662 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:28.306662 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:28.306662 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:28.306662 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:28.306662 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:28.306662 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:29:28.306662 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:29:28.306662 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b75d06aa767c4f7799209c7d0fe23d2c Aug 18 11:29:28.306662 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:28.306662 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:29:28.306662 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance dd3052f2-209e-43f1-a4a4-227ac5bc5f3d could not be found. Aug 18 11:29:28.306662 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'dd3052f2-209e-43f1-a4a4-227ac5bc5f3d'} Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd3052f2-209e-43f1-a4a4-227ac5bc5f3d could not be found. Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:28.307402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd3052f2-209e-43f1-a4a4-227ac5bc5f3d could not be found. Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd3052f2-209e-43f1-a4a4-227ac5bc5f3d could not be found. Aug 18 11:29:28.308603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:28.311219 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c6ef51f4-9d96-4957-9d00-dfba255cb99e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Returning 404 to user: Instance dd3052f2-209e-43f1-a4a4-227ac5bc5f3d could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:28.312357 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c6ef51f4-9d96-4957-9d00-dfba255cb99e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d" status: 404 len: 111 microversion: 2.1 time: 0.089959 Aug 18 11:29:28.313073 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 532/1075] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:28 2022] GET /compute/v2.1/servers/dd3052f2-209e-43f1-a4a4-227ac5bc5f3d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:29:28.331890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b5103345-43e0-46bc-a71d-dd2ffa7409a9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:28.332675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b5103345-43e0-46bc-a71d-dd2ffa7409a9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 53f5ee39-045c-4250-a4b5-efdd3f7b590d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:28.339503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5103345-43e0-46bc-a71d-dd2ffa7409a9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:28.343114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5103345-43e0-46bc-a71d-dd2ffa7409a9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:28.343744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5103345-43e0-46bc-a71d-dd2ffa7409a9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:28.354723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5103345-43e0-46bc-a71d-dd2ffa7409a9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:28.355542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5103345-43e0-46bc-a71d-dd2ffa7409a9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:28.356115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5103345-43e0-46bc-a71d-dd2ffa7409a9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:28.381122 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-b5103345-43e0-46bc-a71d-dd2ffa7409a9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] HTTP exception thrown: Instance 53f5ee39-045c-4250-a4b5-efdd3f7b590d could not be found. Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b5103345-43e0-46bc-a71d-dd2ffa7409a9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Request method failure captured: Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d HTTP/1.1 Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iHIwwevFwKV8xm18kbPD3Ciy8CvScg1fDfl7wNmdQTnBTrBT97kbGF3NuiwyTQZfFarL5ZQ_ovW6qJoZzgynXj2UZuYP-JiihvsYTyFfdjisb-mFUTjTlzA9uSeEs_Ej_djUg_OyBjwyPw77sh7iTNOfHkUZhc2sk4s13i0I8-Szeo Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:29:28.383483 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:29:28.384915 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:28.384915 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:28.384915 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:28.384915 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:28.384915 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:28.384915 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:29:28.384915 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:29:28.384915 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b75d06aa767c4f7799209c7d0fe23d2c Aug 18 11:29:28.384915 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:28.384915 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:29:28.384915 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 53f5ee39-045c-4250-a4b5-efdd3f7b590d could not be found. Aug 18 11:29:28.384915 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '53f5ee39-045c-4250-a4b5-efdd3f7b590d'} Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53f5ee39-045c-4250-a4b5-efdd3f7b590d could not be found. Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:28.385648 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53f5ee39-045c-4250-a4b5-efdd3f7b590d could not be found. Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53f5ee39-045c-4250-a4b5-efdd3f7b590d could not be found. Aug 18 11:29:28.386886 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:28.391300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b5103345-43e0-46bc-a71d-dd2ffa7409a9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Returning 404 to user: Instance 53f5ee39-045c-4250-a4b5-efdd3f7b590d could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:28.392655 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b5103345-43e0-46bc-a71d-dd2ffa7409a9 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d" status: 404 len: 111 microversion: 2.1 time: 0.073911 Aug 18 11:29:28.395630 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 533/1076] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:28 2022] GET /compute/v2.1/servers/53f5ee39-045c-4250-a4b5-efdd3f7b590d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:29:28.406422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-a4d69d5b-880b-4217-9336-06a67c82e339 req-90192727-ff56-4d4a-a267-d6f17fbf6e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3052f2-209e-43f1-a4a4-227ac5bc5f3d", "name": "network-vif-deleted", "tag": "1687b236-5319-4914-8231-40725c72104a"}, {"server_uuid": "53f5ee39-045c-4250-a4b5-efdd3f7b590d", "name": "network-vif-deleted", "tag": "8ee673f5-5824-4dea-baf9-28a95fa7787e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:28.437413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a4d69d5b-880b-4217-9336-06a67c82e339 req-90192727-ff56-4d4a-a267-d6f17fbf6e03 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:28.438321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a4d69d5b-880b-4217-9336-06a67c82e339 req-90192727-ff56-4d4a-a267-d6f17fbf6e03 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:28.439019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a4d69d5b-880b-4217-9336-06a67c82e339 req-90192727-ff56-4d4a-a267-d6f17fbf6e03 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:28.463982 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-a4d69d5b-880b-4217-9336-06a67c82e339 req-90192727-ff56-4d4a-a267-d6f17fbf6e03 service nova] Creating event network-vif-deleted:1687b236-5319-4914-8231-40725c72104a for instance dd3052f2-209e-43f1-a4a4-227ac5bc5f3d on n-h2-853611-3 Aug 18 11:29:28.465099 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-a4d69d5b-880b-4217-9336-06a67c82e339 req-90192727-ff56-4d4a-a267-d6f17fbf6e03 service nova] Creating event network-vif-deleted:8ee673f5-5824-4dea-baf9-28a95fa7787e for instance 53f5ee39-045c-4250-a4b5-efdd3f7b590d on n-h1-853611-3 Aug 18 11:29:28.481668 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-a4d69d5b-880b-4217-9336-06a67c82e339 req-90192727-ff56-4d4a-a267-d6f17fbf6e03 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.084398 Aug 18 11:29:28.486737 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 534/1077] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:28.498361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-54cb1462-6d79-45bc-919d-af6338913649 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:28.573950 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-54cb1462-6d79-45bc-919d-af6338913649 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "DELETE /compute/v2.1/os-server-groups/33adfeb6-880c-4582-819a-f4dc2c458c41" status: 204 len: 0 microversion: 2.1 time: 0.085153 Aug 18 11:29:28.575386 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 535/1078] 10.222.0.73 () {58 vars in 1266 bytes} [Thu Aug 18 11:29:28 2022] DELETE /compute/v2.1/os-server-groups/33adfeb6-880c-4582-819a-f4dc2c458c41 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:28.580652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f0586903-c7c8-4011-aa39-e53058278958 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:28.586172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f0586903-c7c8-4011-aa39-e53058278958 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:28.592869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0586903-c7c8-4011-aa39-e53058278958 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:28.593732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0586903-c7c8-4011-aa39-e53058278958 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:28.594676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0586903-c7c8-4011-aa39-e53058278958 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:28.595797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0586903-c7c8-4011-aa39-e53058278958 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:28.596478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0586903-c7c8-4011-aa39-e53058278958 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:28.597130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0586903-c7c8-4011-aa39-e53058278958 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:28.825681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f0586903-c7c8-4011-aa39-e53058278958 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:28.837970 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f0586903-c7c8-4011-aa39-e53058278958 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1221 microversion: 2.1 time: 0.261121 Aug 18 11:29:28.842652 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 536/1079] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:28 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1221 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:28.852682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e1033a94-f1ac-449b-b6f9-b7fe26bd6b2c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:28.860845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ac5178ed-c002-4ccb-aa28-c96d095eecb5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:28.861706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ac5178ed-c002-4ccb-aa28-c96d095eecb5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: ea19ffc1-f486-4260-8188-6211809c953d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:28.875360 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e1033a94-f1ac-449b-b6f9-b7fe26bd6b2c tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1322 microversion: 2.1 time: 1.469286 Aug 18 11:29:28.875959 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 544/1080] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:27 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1322 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:28.903350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ac5178ed-c002-4ccb-aa28-c96d095eecb5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:28.904177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ac5178ed-c002-4ccb-aa28-c96d095eecb5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:28.908599 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ac5178ed-c002-4ccb-aa28-c96d095eecb5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:28.909477 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ac5178ed-c002-4ccb-aa28-c96d095eecb5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:28.912982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ac5178ed-c002-4ccb-aa28-c96d095eecb5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:28.914170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ac5178ed-c002-4ccb-aa28-c96d095eecb5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:28.997776 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ac5178ed-c002-4ccb-aa28-c96d095eecb5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: ea19ffc1-f486-4260-8188-6211809c953d] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:29:29.215849 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ac5178ed-c002-4ccb-aa28-c96d095eecb5 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d" status: 204 len: 0 microversion: 2.1 time: 0.369320 Aug 18 11:29:29.216831 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 537/1081] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:29:28 2022] DELETE /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:29.225066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f84acee5-c71b-4332-8f73-80377b505b74 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:29.225638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f84acee5-c71b-4332-8f73-80377b505b74 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:29.246904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f84acee5-c71b-4332-8f73-80377b505b74 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:29.248518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f84acee5-c71b-4332-8f73-80377b505b74 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:29.261489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f84acee5-c71b-4332-8f73-80377b505b74 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:29.262268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f84acee5-c71b-4332-8f73-80377b505b74 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:29.262786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f84acee5-c71b-4332-8f73-80377b505b74 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:29.263221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f84acee5-c71b-4332-8f73-80377b505b74 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:29.318538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f84acee5-c71b-4332-8f73-80377b505b74 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:29:29.440592 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f84acee5-c71b-4332-8f73-80377b505b74 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "DELETE /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 204 len: 0 microversion: 2.1 time: 0.217213 Aug 18 11:29:29.442159 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 545/1082] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:29:29 2022] DELETE /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:29.458485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4629143a-6865-40c2-aa77-972ebb4be558 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:29.459221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4629143a-6865-40c2-aa77-972ebb4be558 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: ea19ffc1-f486-4260-8188-6211809c953d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:29.474276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4629143a-6865-40c2-aa77-972ebb4be558 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:29.474932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4629143a-6865-40c2-aa77-972ebb4be558 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:29.475684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4629143a-6865-40c2-aa77-972ebb4be558 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:29.477698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4629143a-6865-40c2-aa77-972ebb4be558 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:29.479911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4629143a-6865-40c2-aa77-972ebb4be558 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:29.480604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4629143a-6865-40c2-aa77-972ebb4be558 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:29.497919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-667189699", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "e8f8f2ff-7601-4fd1-9ee3-58fd8a4e9af3"}], "security_groups": [{"name": "tempest-securitygroup--799834326"}], "key_name": "tempest-keypair-2083530406", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:29.541078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:29.692501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] validate_networks() for [('e8f8f2ff-7601-4fd1-9ee3-58fd8a4e9af3', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:29:30.620957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:29:30.622192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:29:30.623100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:29:30.623726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:29:30.624371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:29:30.641770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:30.646963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:30.651261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:30.652432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:30.653732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:30.655210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:30.689898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4629143a-6865-40c2-aa77-972ebb4be558 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:30.698971 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4629143a-6865-40c2-aa77-972ebb4be558 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d" status: 200 len: 1475 microversion: 2.1 time: 1.251327 Aug 18 11:29:30.705058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Getting quotas for project 22660df6ec1a4f718a08cbeda2be364c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:30.719528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Getting quotas for user 0cf7fe4236764bea83c6560516441759 and project 22660df6ec1a4f718a08cbeda2be364c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:30.720044 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 538/1083] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:29 2022] GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d => generated 1475 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:30.738736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d84f4066-0605-4221-a089-f690947b07e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:30.740508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d84f4066-0605-4221-a089-f690947b07e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:30.744820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:29:30.753731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:29:30.797458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d84f4066-0605-4221-a089-f690947b07e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:30.798127 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d84f4066-0605-4221-a089-f690947b07e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:30.798627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d84f4066-0605-4221-a089-f690947b07e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:30.801310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d84f4066-0605-4221-a089-f690947b07e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:30.802953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d84f4066-0605-4221-a089-f690947b07e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:30.803407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d84f4066-0605-4221-a089-f690947b07e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:30.896611 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-724ee061-df1b-4c57-b171-d269a84dd023 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.405692 Aug 18 11:29:30.907232 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 546/1084] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:29:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:29:30.926260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b4997595-779a-4481-807f-086887af7ed5 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:30.926897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b4997595-779a-4481-807f-086887af7ed5 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:30.953411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4997595-779a-4481-807f-086887af7ed5 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:30.954198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4997595-779a-4481-807f-086887af7ed5 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:30.956790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4997595-779a-4481-807f-086887af7ed5 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:30.962683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4997595-779a-4481-807f-086887af7ed5 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:30.966489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4997595-779a-4481-807f-086887af7ed5 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:30.968390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4997595-779a-4481-807f-086887af7ed5 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:31.032613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d84f4066-0605-4221-a089-f690947b07e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:31.053483 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d84f4066-0605-4221-a089-f690947b07e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1283 microversion: 2.1 time: 0.328876 Aug 18 11:29:31.057241 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 539/1085] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:30 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1283 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:31.095998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-efe67bc0-f395-4131-a6d4-f1d298e8e0dc req-cecff77b-2683-4b9f-949e-c095447ca228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6806735a-b820-48c6-a1bb-917e42fb801e", "name": "network-vif-plugged", "status": "completed", "tag": "dc3abf7a-7b1a-45a4-8efc-335d557a21d9"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:31.155560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-efe67bc0-f395-4131-a6d4-f1d298e8e0dc req-cecff77b-2683-4b9f-949e-c095447ca228 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:31.158402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-efe67bc0-f395-4131-a6d4-f1d298e8e0dc req-cecff77b-2683-4b9f-949e-c095447ca228 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:31.165834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-efe67bc0-f395-4131-a6d4-f1d298e8e0dc req-cecff77b-2683-4b9f-949e-c095447ca228 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:31.217857 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-efe67bc0-f395-4131-a6d4-f1d298e8e0dc req-cecff77b-2683-4b9f-949e-c095447ca228 service nova] Creating event network-vif-plugged:dc3abf7a-7b1a-45a4-8efc-335d557a21d9 for instance 6806735a-b820-48c6-a1bb-917e42fb801e on n-h1-853611-3 Aug 18 11:29:31.228511 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-efe67bc0-f395-4131-a6d4-f1d298e8e0dc req-cecff77b-2683-4b9f-949e-c095447ca228 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167063 Aug 18 11:29:31.229582 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 540/1086] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:31.250335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4802ef26-8bbe-4645-93ae-6069cb82056c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:31.251909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4802ef26-8bbe-4645-93ae-6069cb82056c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:31.349092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b4997595-779a-4481-807f-086887af7ed5 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:31.361742 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b4997595-779a-4481-807f-086887af7ed5 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1322 microversion: 2.1 time: 0.453220 Aug 18 11:29:31.365102 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 547/1087] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:30 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1322 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:31.416555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4802ef26-8bbe-4645-93ae-6069cb82056c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:31.427819 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4802ef26-8bbe-4645-93ae-6069cb82056c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1234 microversion: 2.1 time: 0.188658 Aug 18 11:29:31.440735 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 541/1088] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:31 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1234 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:31.732470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b4a37b73-5060-432e-bb77-a5c812529370 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:31.733112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b4a37b73-5060-432e-bb77-a5c812529370 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: ea19ffc1-f486-4260-8188-6211809c953d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:31.743874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4a37b73-5060-432e-bb77-a5c812529370 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:31.747854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4a37b73-5060-432e-bb77-a5c812529370 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:31.748859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4a37b73-5060-432e-bb77-a5c812529370 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:31.750720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4a37b73-5060-432e-bb77-a5c812529370 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:31.751241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4a37b73-5060-432e-bb77-a5c812529370 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:31.753835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4a37b73-5060-432e-bb77-a5c812529370 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:32.080394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f9747f93-96d5-453b-b7cb-668e6cd04d1e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:32.081712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f9747f93-96d5-453b-b7cb-668e6cd04d1e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:32.103491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9747f93-96d5-453b-b7cb-668e6cd04d1e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:32.105008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9747f93-96d5-453b-b7cb-668e6cd04d1e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:32.105679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9747f93-96d5-453b-b7cb-668e6cd04d1e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:32.106805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9747f93-96d5-453b-b7cb-668e6cd04d1e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:32.107701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9747f93-96d5-453b-b7cb-668e6cd04d1e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:32.108400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9747f93-96d5-453b-b7cb-668e6cd04d1e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:32.371313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f9747f93-96d5-453b-b7cb-668e6cd04d1e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:32.384972 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f9747f93-96d5-453b-b7cb-668e6cd04d1e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1283 microversion: 2.1 time: 0.309792 Aug 18 11:29:32.385864 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 542/1089] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:32 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1283 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:32.403224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e25b9976-7f94-4ecb-b273-38f2edd99af4 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:32.404777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e25b9976-7f94-4ecb-b273-38f2edd99af4 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:32.414601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=7,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:32.427736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e25b9976-7f94-4ecb-b273-38f2edd99af4 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:32.430820 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e25b9976-7f94-4ecb-b273-38f2edd99af4 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:32.431982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e25b9976-7f94-4ecb-b273-38f2edd99af4 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:32.433234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e25b9976-7f94-4ecb-b273-38f2edd99af4 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:32.433769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e25b9976-7f94-4ecb-b273-38f2edd99af4 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:32.434407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e25b9976-7f94-4ecb-b273-38f2edd99af4 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:32.608262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b4a37b73-5060-432e-bb77-a5c812529370 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:32.624574 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b4a37b73-5060-432e-bb77-a5c812529370 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d" status: 200 len: 1475 microversion: 2.1 time: 0.897883 Aug 18 11:29:32.624574 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 548/1090] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:31 2022] GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d => generated 1475 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:32.636744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e6111f6-ac51-4801-9dd1-25bcb6b8ddc5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:32.637376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9e6111f6-ac51-4801-9dd1-25bcb6b8ddc5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:32.653307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e6111f6-ac51-4801-9dd1-25bcb6b8ddc5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:32.654242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e6111f6-ac51-4801-9dd1-25bcb6b8ddc5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:32.656112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e6111f6-ac51-4801-9dd1-25bcb6b8ddc5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:32.659873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e6111f6-ac51-4801-9dd1-25bcb6b8ddc5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:32.660402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e6111f6-ac51-4801-9dd1-25bcb6b8ddc5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:32.660846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e6111f6-ac51-4801-9dd1-25bcb6b8ddc5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:33.104825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9e6111f6-ac51-4801-9dd1-25bcb6b8ddc5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:33.120638 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9e6111f6-ac51-4801-9dd1-25bcb6b8ddc5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1286 microversion: 2.1 time: 0.494852 Aug 18 11:29:33.124165 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 549/1091] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:32 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1286 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:33.407796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-53f3db94-11ff-4151-a3bb-e57379587286 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:33.408804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-53f3db94-11ff-4151-a3bb-e57379587286 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:33.431868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53f3db94-11ff-4151-a3bb-e57379587286 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:33.431868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53f3db94-11ff-4151-a3bb-e57379587286 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:33.431868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53f3db94-11ff-4151-a3bb-e57379587286 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:33.431868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53f3db94-11ff-4151-a3bb-e57379587286 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:33.432209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53f3db94-11ff-4151-a3bb-e57379587286 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:33.435056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53f3db94-11ff-4151-a3bb-e57379587286 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:33.578250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e25b9976-7f94-4ecb-b273-38f2edd99af4 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:33.595695 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e25b9976-7f94-4ecb-b273-38f2edd99af4 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1322 microversion: 2.1 time: 1.193101 Aug 18 11:29:33.604171 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 543/1092] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:32 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1322 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:33.650123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f75e57d7-190a-485e-9d72-d9b622381f0e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:33.651565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f75e57d7-190a-485e-9d72-d9b622381f0e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: ea19ffc1-f486-4260-8188-6211809c953d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:33.663787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f75e57d7-190a-485e-9d72-d9b622381f0e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:33.667084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f75e57d7-190a-485e-9d72-d9b622381f0e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:33.671052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f75e57d7-190a-485e-9d72-d9b622381f0e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:33.672024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f75e57d7-190a-485e-9d72-d9b622381f0e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:33.674920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f75e57d7-190a-485e-9d72-d9b622381f0e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:33.679756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f75e57d7-190a-485e-9d72-d9b622381f0e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:34.482540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-53f3db94-11ff-4151-a3bb-e57379587286 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:34.493170 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-53f3db94-11ff-4151-a3bb-e57379587286 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1325 microversion: 2.1 time: 1.090921 Aug 18 11:29:34.493778 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 550/1093] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:33 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1325 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:34.534364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d4d044ce-1ed0-4c77-827c-94a61415df03 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:34.546601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d4d044ce-1ed0-4c77-827c-94a61415df03 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:34.576076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4d044ce-1ed0-4c77-827c-94a61415df03 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:34.577009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4d044ce-1ed0-4c77-827c-94a61415df03 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:34.578147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4d044ce-1ed0-4c77-827c-94a61415df03 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:34.580971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4d044ce-1ed0-4c77-827c-94a61415df03 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:34.581863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4d044ce-1ed0-4c77-827c-94a61415df03 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:34.584367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4d044ce-1ed0-4c77-827c-94a61415df03 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:34.704189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f75e57d7-190a-485e-9d72-d9b622381f0e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:34.730604 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f75e57d7-190a-485e-9d72-d9b622381f0e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d" status: 200 len: 1475 microversion: 2.1 time: 1.084894 Aug 18 11:29:34.735168 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 544/1094] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:33 2022] GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d => generated 1475 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:29:34.752418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2cdf805b-5fdf-4855-9251-a8e23c99ca54 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:34.753363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2cdf805b-5fdf-4855-9251-a8e23c99ca54 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:34.763058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cdf805b-5fdf-4855-9251-a8e23c99ca54 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:34.764074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cdf805b-5fdf-4855-9251-a8e23c99ca54 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:34.764758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cdf805b-5fdf-4855-9251-a8e23c99ca54 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:34.766105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cdf805b-5fdf-4855-9251-a8e23c99ca54 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:34.767615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cdf805b-5fdf-4855-9251-a8e23c99ca54 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:34.770208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cdf805b-5fdf-4855-9251-a8e23c99ca54 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:35.003295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d4d044ce-1ed0-4c77-827c-94a61415df03 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:35.026135 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d4d044ce-1ed0-4c77-827c-94a61415df03 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1292 microversion: 2.1 time: 0.506874 Aug 18 11:29:35.028636 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 551/1095] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:34 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1292 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:35.320943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2cdf805b-5fdf-4855-9251-a8e23c99ca54 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:35.336326 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2cdf805b-5fdf-4855-9251-a8e23c99ca54 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1471 microversion: 2.1 time: 0.597819 Aug 18 11:29:35.338802 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 545/1096] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:34 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1471 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:35.371801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e3baf69-a120-4dc6-aa64-1985057512c9 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:35.372384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2e3baf69-a120-4dc6-aa64-1985057512c9 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:35.400174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e3baf69-a120-4dc6-aa64-1985057512c9 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:35.400693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e3baf69-a120-4dc6-aa64-1985057512c9 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:35.401140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e3baf69-a120-4dc6-aa64-1985057512c9 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:35.401866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e3baf69-a120-4dc6-aa64-1985057512c9 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:35.402330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e3baf69-a120-4dc6-aa64-1985057512c9 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:35.403593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-c0bc2380-c2a4-4971-9a6c-f1ff40feb2dd req-7a628eb7-e06f-4574-a3b2-f7d16d335123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea19ffc1-f486-4260-8188-6211809c953d", "name": "network-vif-deleted", "tag": "5c3d5c21-11fa-4445-878a-2177d332905f"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:35.418407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e3baf69-a120-4dc6-aa64-1985057512c9 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:35.447478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c0bc2380-c2a4-4971-9a6c-f1ff40feb2dd req-7a628eb7-e06f-4574-a3b2-f7d16d335123 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:35.447720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c0bc2380-c2a4-4971-9a6c-f1ff40feb2dd req-7a628eb7-e06f-4574-a3b2-f7d16d335123 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:35.448000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c0bc2380-c2a4-4971-9a6c-f1ff40feb2dd req-7a628eb7-e06f-4574-a3b2-f7d16d335123 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:35.498895 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-c0bc2380-c2a4-4971-9a6c-f1ff40feb2dd req-7a628eb7-e06f-4574-a3b2-f7d16d335123 service nova] Creating event network-vif-deleted:5c3d5c21-11fa-4445-878a-2177d332905f for instance ea19ffc1-f486-4260-8188-6211809c953d on n-h1-853611-3 Aug 18 11:29:35.512508 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-c0bc2380-c2a4-4971-9a6c-f1ff40feb2dd req-7a628eb7-e06f-4574-a3b2-f7d16d335123 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112729 Aug 18 11:29:35.519661 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 546/1097] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:35.537602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-61b1fe1d-f421-483e-817e-3d48ba686694 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:35.544948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-61b1fe1d-f421-483e-817e-3d48ba686694 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:35.568993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61b1fe1d-f421-483e-817e-3d48ba686694 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:35.572575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61b1fe1d-f421-483e-817e-3d48ba686694 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:35.574695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61b1fe1d-f421-483e-817e-3d48ba686694 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:35.584014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61b1fe1d-f421-483e-817e-3d48ba686694 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:35.585030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61b1fe1d-f421-483e-817e-3d48ba686694 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:35.588484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61b1fe1d-f421-483e-817e-3d48ba686694 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:35.603156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-2e3baf69-a120-4dc6-aa64-1985057512c9 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lazy-loading 'flavor' on Instance uuid 6806735a-b820-48c6-a1bb-917e42fb801e {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:29:35.797673 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2e3baf69-a120-4dc6-aa64-1985057512c9 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e/action" status: 202 len: 0 microversion: 2.1 time: 0.438010 Aug 18 11:29:35.799158 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 552/1098] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:29:35 2022] POST /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:29:35.825722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-22cef304-1a0c-425b-ae9b-a94e0eebb8bf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:35.828481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-22cef304-1a0c-425b-ae9b-a94e0eebb8bf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: ea19ffc1-f486-4260-8188-6211809c953d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:35.841988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22cef304-1a0c-425b-ae9b-a94e0eebb8bf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:35.844340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22cef304-1a0c-425b-ae9b-a94e0eebb8bf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:35.845870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22cef304-1a0c-425b-ae9b-a94e0eebb8bf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:35.846276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22cef304-1a0c-425b-ae9b-a94e0eebb8bf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:35.847130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22cef304-1a0c-425b-ae9b-a94e0eebb8bf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:35.847734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22cef304-1a0c-425b-ae9b-a94e0eebb8bf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:35.902196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22cef304-1a0c-425b-ae9b-a94e0eebb8bf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:35.903061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22cef304-1a0c-425b-ae9b-a94e0eebb8bf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:35.903687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22cef304-1a0c-425b-ae9b-a94e0eebb8bf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:35.904336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-22cef304-1a0c-425b-ae9b-a94e0eebb8bf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lazy-loading 'fault' on Instance uuid ea19ffc1-f486-4260-8188-6211809c953d {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:29:36.060437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-22cef304-1a0c-425b-ae9b-a94e0eebb8bf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:36.075651 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-22cef304-1a0c-425b-ae9b-a94e0eebb8bf tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d" status: 200 len: 1309 microversion: 2.1 time: 0.274205 Aug 18 11:29:36.076849 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 553/1099] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:35 2022] GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d => generated 1309 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:36.084725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99d13e6a-37c4-410e-be84-fbf134bd72dd tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:36.087723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-99d13e6a-37c4-410e-be84-fbf134bd72dd tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:36.104839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99d13e6a-37c4-410e-be84-fbf134bd72dd tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:36.105857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99d13e6a-37c4-410e-be84-fbf134bd72dd tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:36.108191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99d13e6a-37c4-410e-be84-fbf134bd72dd tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:36.109139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99d13e6a-37c4-410e-be84-fbf134bd72dd tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:36.137825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99d13e6a-37c4-410e-be84-fbf134bd72dd tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:36.142408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99d13e6a-37c4-410e-be84-fbf134bd72dd tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:36.414581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-61b1fe1d-f421-483e-817e-3d48ba686694 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:36.430019 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-61b1fe1d-f421-483e-817e-3d48ba686694 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1325 microversion: 2.1 time: 0.908989 Aug 18 11:29:36.433040 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 547/1100] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:35 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1325 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:36.451423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-05104a2c-dbb9-488f-97ef-2df5e3a0efeb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:36.457446 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-05104a2c-dbb9-488f-97ef-2df5e3a0efeb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:36.489324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05104a2c-dbb9-488f-97ef-2df5e3a0efeb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:36.489947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05104a2c-dbb9-488f-97ef-2df5e3a0efeb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:36.490403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05104a2c-dbb9-488f-97ef-2df5e3a0efeb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:36.494722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05104a2c-dbb9-488f-97ef-2df5e3a0efeb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:36.496122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05104a2c-dbb9-488f-97ef-2df5e3a0efeb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:36.499352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05104a2c-dbb9-488f-97ef-2df5e3a0efeb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:36.543435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:37.159365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-05104a2c-dbb9-488f-97ef-2df5e3a0efeb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:37.179433 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-05104a2c-dbb9-488f-97ef-2df5e3a0efeb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1359 microversion: 2.1 time: 0.738852 Aug 18 11:29:37.203850 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 548/1101] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:36 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1359 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:37.216680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-39933241-f768-42e4-8e22-1cc17c0117cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:37.217303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-39933241-f768-42e4-8e22-1cc17c0117cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: ea19ffc1-f486-4260-8188-6211809c953d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:37.244797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-39933241-f768-42e4-8e22-1cc17c0117cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:37.248270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-39933241-f768-42e4-8e22-1cc17c0117cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:37.249014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-39933241-f768-42e4-8e22-1cc17c0117cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:37.259322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-39933241-f768-42e4-8e22-1cc17c0117cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:37.260234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-39933241-f768-42e4-8e22-1cc17c0117cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:37.260714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-39933241-f768-42e4-8e22-1cc17c0117cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:37.300055 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-39933241-f768-42e4-8e22-1cc17c0117cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] HTTP exception thrown: Instance ea19ffc1-f486-4260-8188-6211809c953d could not be found. Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-39933241-f768-42e4-8e22-1cc17c0117cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Request method failure captured: Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d HTTP/1.1 Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iHIwwevFwKV8xm18kbPD3Ciy8CvScg1fDfl7wNmdQTnBTrBT97kbGF3NuiwyTQZfFarL5ZQ_ovW6qJoZzgynXj2UZuYP-JiihvsYTyFfdjisb-mFUTjTlzA9uSeEs_Ej_djUg_OyBjwyPw77sh7iTNOfHkUZhc2sk4s13i0I8-Szeo Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:29:37.301976 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:29:37.303468 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:37.303468 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:37.303468 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:37.303468 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:37.303468 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:37.303468 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:29:37.303468 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:29:37.303468 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b75d06aa767c4f7799209c7d0fe23d2c Aug 18 11:29:37.303468 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:37.303468 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:29:37.303468 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance ea19ffc1-f486-4260-8188-6211809c953d could not be found. Aug 18 11:29:37.303468 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'ea19ffc1-f486-4260-8188-6211809c953d'} Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea19ffc1-f486-4260-8188-6211809c953d could not be found. Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:37.304292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea19ffc1-f486-4260-8188-6211809c953d could not be found. Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea19ffc1-f486-4260-8188-6211809c953d could not be found. Aug 18 11:29:37.305607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:37.310045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-39933241-f768-42e4-8e22-1cc17c0117cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Returning 404 to user: Instance ea19ffc1-f486-4260-8188-6211809c953d could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:37.310045 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-39933241-f768-42e4-8e22-1cc17c0117cc tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d" status: 404 len: 111 microversion: 2.1 time: 0.094928 Aug 18 11:29:37.310045 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 549/1102] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:37 2022] GET /compute/v2.1/servers/ea19ffc1-f486-4260-8188-6211809c953d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:29:37.317010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ded23e0b-d9e3-4de1-a7e3-26821f42c201 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:37.329093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ded23e0b-d9e3-4de1-a7e3-26821f42c201 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: adfe9b2a-b96c-408f-9381-d748f9ff7b5d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:37.351867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ded23e0b-d9e3-4de1-a7e3-26821f42c201 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:37.353983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ded23e0b-d9e3-4de1-a7e3-26821f42c201 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:37.361270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ded23e0b-d9e3-4de1-a7e3-26821f42c201 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:37.362624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ded23e0b-d9e3-4de1-a7e3-26821f42c201 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:37.364728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ded23e0b-d9e3-4de1-a7e3-26821f42c201 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:37.365667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ded23e0b-d9e3-4de1-a7e3-26821f42c201 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:37.402771 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-ded23e0b-d9e3-4de1-a7e3-26821f42c201 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] HTTP exception thrown: Instance adfe9b2a-b96c-408f-9381-d748f9ff7b5d could not be found. Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ded23e0b-d9e3-4de1-a7e3-26821f42c201 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Request method failure captured: Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d HTTP/1.1 Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iHIwwevFwKV8xm18kbPD3Ciy8CvScg1fDfl7wNmdQTnBTrBT97kbGF3NuiwyTQZfFarL5ZQ_ovW6qJoZzgynXj2UZuYP-JiihvsYTyFfdjisb-mFUTjTlzA9uSeEs_Ej_djUg_OyBjwyPw77sh7iTNOfHkUZhc2sk4s13i0I8-Szeo Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:29:37.404644 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:29:37.405999 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:37.405999 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:37.405999 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:37.405999 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:37.405999 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:37.405999 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:29:37.405999 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:29:37.405999 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b75d06aa767c4f7799209c7d0fe23d2c Aug 18 11:29:37.405999 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:37.405999 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:29:37.405999 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance adfe9b2a-b96c-408f-9381-d748f9ff7b5d could not be found. Aug 18 11:29:37.405999 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'adfe9b2a-b96c-408f-9381-d748f9ff7b5d'} Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adfe9b2a-b96c-408f-9381-d748f9ff7b5d could not be found. Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:37.407820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adfe9b2a-b96c-408f-9381-d748f9ff7b5d could not be found. Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adfe9b2a-b96c-408f-9381-d748f9ff7b5d could not be found. Aug 18 11:29:37.409050 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:37.410219 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ded23e0b-d9e3-4de1-a7e3-26821f42c201 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Returning 404 to user: Instance adfe9b2a-b96c-408f-9381-d748f9ff7b5d could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:37.410219 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ded23e0b-d9e3-4de1-a7e3-26821f42c201 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d" status: 404 len: 111 microversion: 2.1 time: 0.095733 Aug 18 11:29:37.410857 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 550/1103] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:37 2022] GET /compute/v2.1/servers/adfe9b2a-b96c-408f-9381-d748f9ff7b5d => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:29:37.423724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ee888ed1-2687-442f-9a6f-86e97c5e9b1e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:37.481325 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ee888ed1-2687-442f-9a6f-86e97c5e9b1e tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "DELETE /compute/v2.1/os-server-groups/6932f290-c006-4781-8999-df22645b6c54" status: 204 len: 0 microversion: 2.1 time: 0.065650 Aug 18 11:29:37.482244 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 551/1104] 10.222.0.73 () {58 vars in 1266 bytes} [Thu Aug 18 11:29:37 2022] DELETE /compute/v2.1/os-server-groups/6932f290-c006-4781-8999-df22645b6c54 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:37.492469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-94afb305-3171-45f9-9f7f-e2370b0aefcf req-bca00a78-38aa-4409-b144-52a3dcff1932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f688dc84-1bfc-4f87-a2ed-0b196d40e86f", "tag": "db295dd6-2301-47bd-9a90-1c3544856223"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:37.519790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-94afb305-3171-45f9-9f7f-e2370b0aefcf req-bca00a78-38aa-4409-b144-52a3dcff1932 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:37.520276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-94afb305-3171-45f9-9f7f-e2370b0aefcf req-bca00a78-38aa-4409-b144-52a3dcff1932 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:37.520714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-94afb305-3171-45f9-9f7f-e2370b0aefcf req-bca00a78-38aa-4409-b144-52a3dcff1932 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:37.542448 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-94afb305-3171-45f9-9f7f-e2370b0aefcf req-bca00a78-38aa-4409-b144-52a3dcff1932 service nova] Creating event network-changed:db295dd6-2301-47bd-9a90-1c3544856223 for instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f on n-h2-853611-3 Aug 18 11:29:37.551765 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-94afb305-3171-45f9-9f7f-e2370b0aefcf req-bca00a78-38aa-4409-b144-52a3dcff1932 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068042 Aug 18 11:29:37.558529 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 552/1105] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:37.564322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fe274807-aa06-4a3a-bbc2-2139e21090ee tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:37.565257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fe274807-aa06-4a3a-bbc2-2139e21090ee tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:37.576587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe274807-aa06-4a3a-bbc2-2139e21090ee tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:37.577345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe274807-aa06-4a3a-bbc2-2139e21090ee tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:37.577958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe274807-aa06-4a3a-bbc2-2139e21090ee tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:37.578965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe274807-aa06-4a3a-bbc2-2139e21090ee tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:37.579680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe274807-aa06-4a3a-bbc2-2139e21090ee tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:37.580301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe274807-aa06-4a3a-bbc2-2139e21090ee tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:37.601588 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-99d13e6a-37c4-410e-be84-fbf134bd72dd tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1630 microversion: 2.1 time: 1.522897 Aug 18 11:29:37.604338 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 554/1106] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:36 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1630 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:37.614920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cf3a2ac8-5977-4912-b791-eb735c0252b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:37.615435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cf3a2ac8-5977-4912-b791-eb735c0252b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:37.634017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3a2ac8-5977-4912-b791-eb735c0252b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:37.634709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3a2ac8-5977-4912-b791-eb735c0252b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:37.635199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3a2ac8-5977-4912-b791-eb735c0252b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:37.637212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3a2ac8-5977-4912-b791-eb735c0252b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:37.637897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3a2ac8-5977-4912-b791-eb735c0252b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:37.640170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3a2ac8-5977-4912-b791-eb735c0252b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:37.702737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cf3a2ac8-5977-4912-b791-eb735c0252b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:29:37.710765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:37.870273 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cf3a2ac8-5977-4912-b791-eb735c0252b1 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 204 len: 0 microversion: 2.1 time: 0.262191 Aug 18 11:29:37.873338 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 555/1107] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:29:37 2022] DELETE /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:38.273806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-decb1092-b7c8-46f6-b6d6-91bd53f88f26 tempest-SecurityGroupsTestAdminJSON-1713173969 tempest-SecurityGroupsTestAdminJSON-1713173969-project] Action: 'create', calling method: .version_select at 0x7f519fc2d5e0>, body: {"security_group": {"name": "tempest-securitygroup-1704199847", "description": "tempest-description-1864741647"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:38.536344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fe274807-aa06-4a3a-bbc2-2139e21090ee tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:38.553038 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fe274807-aa06-4a3a-bbc2-2139e21090ee tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1325 microversion: 2.1 time: 0.992836 Aug 18 11:29:38.554227 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 553/1108] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:37 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1325 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:38.567319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-995ef876-49ee-415d-bdbf-a85bf67e1663 req-d055600a-ebd4-409f-bf27-91fc4a0fee34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adfe9b2a-b96c-408f-9381-d748f9ff7b5d", "name": "network-vif-deleted", "tag": "b5ebddc2-4206-41b9-a9d9-575eda3136aa"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:38.602553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-995ef876-49ee-415d-bdbf-a85bf67e1663 req-d055600a-ebd4-409f-bf27-91fc4a0fee34 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:38.602932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-995ef876-49ee-415d-bdbf-a85bf67e1663 req-d055600a-ebd4-409f-bf27-91fc4a0fee34 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:38.606295 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-995ef876-49ee-415d-bdbf-a85bf67e1663 req-d055600a-ebd4-409f-bf27-91fc4a0fee34 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:38.648503 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-995ef876-49ee-415d-bdbf-a85bf67e1663 req-d055600a-ebd4-409f-bf27-91fc4a0fee34 service nova] Creating event network-vif-deleted:b5ebddc2-4206-41b9-a9d9-575eda3136aa for instance adfe9b2a-b96c-408f-9381-d748f9ff7b5d on n-h1-853611-3 Aug 18 11:29:38.653920 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-995ef876-49ee-415d-bdbf-a85bf67e1663 req-d055600a-ebd4-409f-bf27-91fc4a0fee34 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094887 Aug 18 11:29:38.657609 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 554/1109] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:38.676534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-61f3b7ca-dc78-421c-bf9b-c78392dd42a8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:38.678445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-61f3b7ca-dc78-421c-bf9b-c78392dd42a8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:38.703746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61f3b7ca-dc78-421c-bf9b-c78392dd42a8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:38.705885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61f3b7ca-dc78-421c-bf9b-c78392dd42a8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:38.706353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61f3b7ca-dc78-421c-bf9b-c78392dd42a8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:38.709028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61f3b7ca-dc78-421c-bf9b-c78392dd42a8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:38.710710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61f3b7ca-dc78-421c-bf9b-c78392dd42a8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:38.712309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61f3b7ca-dc78-421c-bf9b-c78392dd42a8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:39.117112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-61f3b7ca-dc78-421c-bf9b-c78392dd42a8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:39.157960 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-61f3b7ca-dc78-421c-bf9b-c78392dd42a8 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1472 microversion: 2.1 time: 0.497278 Aug 18 11:29:39.182949 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 555/1110] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:38 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1472 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:39.206071 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-decb1092-b7c8-46f6-b6d6-91bd53f88f26 tempest-SecurityGroupsTestAdminJSON-1713173969 tempest-SecurityGroupsTestAdminJSON-1713173969-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.330972 Aug 18 11:29:39.206892 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 556/1111] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:29:37 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:39.211842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-04535de2-2065-442a-81d1-712691add463 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:39.212625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-04535de2-2065-442a-81d1-712691add463 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:39.218283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3fcd2053-e1e0-4e99-974e-68c57397ce08 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:39.223980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04535de2-2065-442a-81d1-712691add463 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:39.224346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3fcd2053-e1e0-4e99-974e-68c57397ce08 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:39.224641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04535de2-2065-442a-81d1-712691add463 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:39.225772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04535de2-2065-442a-81d1-712691add463 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:39.226923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04535de2-2065-442a-81d1-712691add463 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:39.227398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04535de2-2065-442a-81d1-712691add463 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:39.227916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04535de2-2065-442a-81d1-712691add463 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:39.247930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3fcd2053-e1e0-4e99-974e-68c57397ce08 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:39.249209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3fcd2053-e1e0-4e99-974e-68c57397ce08 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:39.250132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3fcd2053-e1e0-4e99-974e-68c57397ce08 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:39.251722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3fcd2053-e1e0-4e99-974e-68c57397ce08 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:39.252707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3fcd2053-e1e0-4e99-974e-68c57397ce08 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:39.253624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3fcd2053-e1e0-4e99-974e-68c57397ce08 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:39.418166 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-04535de2-2065-442a-81d1-712691add463 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1613 microversion: 2.1 time: 0.210206 Aug 18 11:29:39.418830 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 557/1112] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:39 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1613 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:39.423346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76941206-8823-4051-8130-ee74942a45b5 tempest-SecurityGroupsTestAdminJSON-1713173969 tempest-SecurityGroupsTestAdminJSON-1713173969-project] Action: 'create', calling method: .version_select at 0x7f519faf1f70>, body: {"security_group": {"name": "tempest-securitygroup-1323471130", "description": "tempest-description-413003975"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:39.440691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3fcd2053-e1e0-4e99-974e-68c57397ce08 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:39.448737 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3fcd2053-e1e0-4e99-974e-68c57397ce08 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1359 microversion: 2.1 time: 0.264333 Aug 18 11:29:39.449309 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 556/1113] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:39 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:39.516866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a42e49dd-53fa-4f7a-a142-30bf0c1da88b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Action: 'create', calling method: .version_select at 0x7f519f882700>, body: {"keypair": {"name": "tempest-keypair-676045141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/84ms6ar6VU1MAVbbyZ4EWUtnybcqjKr0OREnsK8pt8/c0B+vqTZF+wd9GavCvc+CjHzGsWgpJp6bTV6k7pVbxLyYM7rZknC6K5q+/qyptq6EypUxibnqNvX8tB2nW2g=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:39.531019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=63 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:39.535020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a42e49dd-53fa-4f7a-a142-30bf0c1da88b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Getting quotas for project 9e395c10cbfd4c12ad0f5c0018620c9e. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:29:39.541719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a42e49dd-53fa-4f7a-a142-30bf0c1da88b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Getting quotas for user a6e9baff3c0f442586f217e007138a39 and project 9e395c10cbfd4c12ad0f5c0018620c9e. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:29:39.587394 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a42e49dd-53fa-4f7a-a142-30bf0c1da88b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.137031 Aug 18 11:29:39.588183 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 557/1114] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:29:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:39.601281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b0e665ff-b37f-4bcf-b9bf-28ce95714de8 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:39.601927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b0e665ff-b37f-4bcf-b9bf-28ce95714de8 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:39.611561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0e665ff-b37f-4bcf-b9bf-28ce95714de8 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:39.613195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0e665ff-b37f-4bcf-b9bf-28ce95714de8 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:39.613644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0e665ff-b37f-4bcf-b9bf-28ce95714de8 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:39.615438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0e665ff-b37f-4bcf-b9bf-28ce95714de8 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:39.616620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0e665ff-b37f-4bcf-b9bf-28ce95714de8 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:39.617341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0e665ff-b37f-4bcf-b9bf-28ce95714de8 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:39.719257 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-b0e665ff-b37f-4bcf-b9bf-28ce95714de8 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] HTTP exception thrown: Cannot 'migrate' instance 6806735a-b820-48c6-a1bb-917e42fb801e while it is in vm_state suspended Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b0e665ff-b37f-4bcf-b9bf-28ce95714de8 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Request method failure captured: Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e/action HTTP/1.1 Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 15 Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iJsMrIGGsTUNpJOZoELhJSh-A8Dzn0cn32FhcQlU4saForJP1EPS3ONwVxMFCtQzqOIzZYhvymzBCs-AXv83RM6IuLFo5kpfHdFQa--JakreFcQE8TrPVTRqxDSR1RZWGGWKB2Nmib42tvj3h25AehF5FYeA_qBCijlIMjy3VUz2E8 Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 00026443c73e4b388058bbe134f87fbe Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:29:39.721195 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:29:39.722695 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_00026443c73e4b388058bbe134f87fbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:39.722695 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:39.722695 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 00026443c73e4b388058bbe134f87fbe Aug 18 11:29:39.722695 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:39.722695 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersAdminNegativeTestJSON-599441481-project-admin Aug 18 11:29:39.722695 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:29:39.722695 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:29:39.722695 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 78aeaba0252047dfb77e6efd1751eeb8 Aug 18 11:29:39.722695 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersAdminNegativeTestJSON-599441481-project-admin Aug 18 11:29:39.722695 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:29:39.722695 n-d-853611-3 devstack@n-api.service[122209]: {"migrate": {}} Aug 18 11:29:39.722695 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:29:39.722695 n-d-853611-3 devstack@n-api.service[122209]: exception: Cannot 'migrate' instance 6806735a-b820-48c6-a1bb-917e42fb801e while it is in vm_state suspended Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '6806735a-b820-48c6-a1bb-917e42fb801e', 'body': {'migrate': {}}} Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6806735a-b820-48c6-a1bb-917e42fb801e in vm_state suspended. Cannot resize while the instance is in this state. Aug 18 11:29:39.723722 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 6806735a-b820-48c6-a1bb-917e42fb801e while it is in vm_state suspended Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:39.725810 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:39.727189 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:39.727189 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:39.727189 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:39.727189 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:39.727189 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 6806735a-b820-48c6-a1bb-917e42fb801e while it is in vm_state suspended Aug 18 11:29:39.727189 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:39.727189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b0e665ff-b37f-4bcf-b9bf-28ce95714de8 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Returning 409 to user: Cannot 'migrate' instance 6806735a-b820-48c6-a1bb-917e42fb801e while it is in vm_state suspended {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:39.727189 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b0e665ff-b37f-4bcf-b9bf-28ce95714de8 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e/action" status: 409 len: 148 microversion: 2.1 time: 0.127633 Aug 18 11:29:39.727189 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 558/1115] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:29:39 2022] POST /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e/action => generated 148 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:29:39.737731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9ec8e0c4-637c-4bad-98f5-089d0ca0b23e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:39.743285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9ec8e0c4-637c-4bad-98f5-089d0ca0b23e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:39.754788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9ec8e0c4-637c-4bad-98f5-089d0ca0b23e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:39.755396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9ec8e0c4-637c-4bad-98f5-089d0ca0b23e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:39.755804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9ec8e0c4-637c-4bad-98f5-089d0ca0b23e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:39.756597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9ec8e0c4-637c-4bad-98f5-089d0ca0b23e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:39.757107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9ec8e0c4-637c-4bad-98f5-089d0ca0b23e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:39.757685 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76941206-8823-4051-8130-ee74942a45b5 tempest-SecurityGroupsTestAdminJSON-1713173969 tempest-SecurityGroupsTestAdminJSON-1713173969-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.337649 Aug 18 11:29:39.757822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9ec8e0c4-637c-4bad-98f5-089d0ca0b23e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:39.758302 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 558/1116] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:29:39 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:39.765324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-902c2555-d600-4771-9463-d91710d6b67d req-1af42b91-6558-475d-b385-1c5d19f90dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea", "tag": "6f0d24ce-a546-4261-8582-706023203b8e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:39.792546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-902c2555-d600-4771-9463-d91710d6b67d req-1af42b91-6558-475d-b385-1c5d19f90dac service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:39.793109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-902c2555-d600-4771-9463-d91710d6b67d req-1af42b91-6558-475d-b385-1c5d19f90dac service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:39.793758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-902c2555-d600-4771-9463-d91710d6b67d req-1af42b91-6558-475d-b385-1c5d19f90dac service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:39.817305 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-902c2555-d600-4771-9463-d91710d6b67d req-1af42b91-6558-475d-b385-1c5d19f90dac service nova] Creating event network-changed:6f0d24ce-a546-4261-8582-706023203b8e for instance 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea on n-h2-853611-3 Aug 18 11:29:39.822801 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-902c2555-d600-4771-9463-d91710d6b67d req-1af42b91-6558-475d-b385-1c5d19f90dac service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062730 Aug 18 11:29:39.824054 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 559/1117] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:39.829680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5af39437-5280-4170-a262-397bf28ded8d tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5af39437-5280-4170-a262-397bf28ded8d tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Request method failure captured: Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c/action HTTP/1.1 Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 39 Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iJsMrIGGsTUNpJOZoELhJSh-A8Dzn0cn32FhcQlU4saForJP1EPS3ONwVxMFCtQzqOIzZYhvymzBCs-AXv83RM6IuLFo5kpfHdFQa--JakreFcQE8TrPVTRqxDSR1RZWGGWKB2Nmib42tvj3h25AehF5FYeA_qBCijlIMjy3VUz2E8 Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 00026443c73e4b388058bbe134f87fbe Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:29:39.836198 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:29:39.837728 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_00026443c73e4b388058bbe134f87fbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:39.837728 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:39.837728 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 00026443c73e4b388058bbe134f87fbe Aug 18 11:29:39.837728 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:39.837728 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersAdminNegativeTestJSON-599441481-project-admin Aug 18 11:29:39.837728 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:29:39.837728 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:29:39.837728 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 78aeaba0252047dfb77e6efd1751eeb8 Aug 18 11:29:39.837728 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersAdminNegativeTestJSON-599441481-project-admin Aug 18 11:29:39.837728 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:29:39.837728 n-d-853611-3 devstack@n-api.service[122210]: {"os-resetState": {"state": "invalid"}} Aug 18 11:29:39.837728 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'd9ed1e63-d1e3-4419-adcf-2271d73bc72c', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'invalid' Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:39.839263 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:29:39.840975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 18 11:29:39.842361 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:39.844475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5af39437-5280-4170-a262-397bf28ded8d tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:39.845516 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5af39437-5280-4170-a262-397bf28ded8d tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c/action" status: 400 len: 144 microversion: 2.1 time: 0.020144 Aug 18 11:29:39.846237 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 560/1118] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:29:39 2022] POST /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c/action => generated 144 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:29:39.948095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1fde086c-107a-4072-97f7-91ca1eebace9 tempest-SecurityGroupsTestAdminJSON-1043005869 tempest-SecurityGroupsTestAdminJSON-1043005869-project-admin] Action: 'create', calling method: .version_select at 0x7f519faf13a0>, body: {"security_group": {"name": "tempest-securitygroup-1787409280", "description": "tempest-description-2050018678"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:39.970972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9ec8e0c4-637c-4bad-98f5-089d0ca0b23e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:39.980302 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9ec8e0c4-637c-4bad-98f5-089d0ca0b23e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1325 microversion: 2.1 time: 0.255432 Aug 18 11:29:39.997400 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 559/1119] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:39 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:40.003490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-95cffd72-70b9-4de2-b932-29ae70f70733 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-95cffd72-70b9-4de2-b932-29ae70f70733 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Request method failure captured: Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c/action HTTP/1.1 Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 31 Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iJsMrIGGsTUNpJOZoELhJSh-A8Dzn0cn32FhcQlU4saForJP1EPS3ONwVxMFCtQzqOIzZYhvymzBCs-AXv83RM6IuLFo5kpfHdFQa--JakreFcQE8TrPVTRqxDSR1RZWGGWKB2Nmib42tvj3h25AehF5FYeA_qBCijlIMjy3VUz2E8 Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 00026443c73e4b388058bbe134f87fbe Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:29:40.010837 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:29:40.012311 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_00026443c73e4b388058bbe134f87fbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:40.012311 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:40.012311 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 00026443c73e4b388058bbe134f87fbe Aug 18 11:29:40.012311 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:40.012311 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersAdminNegativeTestJSON-599441481-project-admin Aug 18 11:29:40.012311 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:29:40.012311 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:29:40.012311 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 78aeaba0252047dfb77e6efd1751eeb8 Aug 18 11:29:40.012311 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersAdminNegativeTestJSON-599441481-project-admin Aug 18 11:29:40.012311 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:29:40.012311 n-d-853611-3 devstack@n-api.service[122209]: {"os-resetState": {"state": 1}} Aug 18 11:29:40.012311 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:29:40.012311 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'd9ed1e63-d1e3-4419-adcf-2271d73bc72c', 'body': {'os-resetState': {'state': 1}}} Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 1 Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:40.013224 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 18 11:29:40.014607 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:40.015789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-95cffd72-70b9-4de2-b932-29ae70f70733 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:40.015789 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-95cffd72-70b9-4de2-b932-29ae70f70733 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c/action" status: 400 len: 120 microversion: 2.1 time: 0.013722 Aug 18 11:29:40.019694 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 560/1120] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:29:39 2022] POST /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c/action => generated 120 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:29:40.024754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-58ed4597-f85e-4408-b131-d4b09e93c1c0 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:40.027518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-58ed4597-f85e-4408-b131-d4b09e93c1c0 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Failed to fetch instance by id 999 {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 18 11:29:40.028222 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-58ed4597-f85e-4408-b131-d4b09e93c1c0 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-58ed4597-f85e-4408-b131-d4b09e93c1c0 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Request method failure captured: Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 37 Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iJsMrIGGsTUNpJOZoELhJSh-A8Dzn0cn32FhcQlU4saForJP1EPS3ONwVxMFCtQzqOIzZYhvymzBCs-AXv83RM6IuLFo5kpfHdFQa--JakreFcQE8TrPVTRqxDSR1RZWGGWKB2Nmib42tvj3h25AehF5FYeA_qBCijlIMjy3VUz2E8 Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 00026443c73e4b388058bbe134f87fbe Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:29:40.038514 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:29:40.040008 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_00026443c73e4b388058bbe134f87fbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00026443c73e4b388058bbe134f87fbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:40.040008 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:40.040008 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 00026443c73e4b388058bbe134f87fbe Aug 18 11:29:40.040008 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-599441481 Aug 18 11:29:40.040008 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersAdminNegativeTestJSON-599441481-project-admin Aug 18 11:29:40.040008 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:29:40.040008 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:29:40.040008 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 78aeaba0252047dfb77e6efd1751eeb8 Aug 18 11:29:40.040008 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersAdminNegativeTestJSON-599441481-project-admin Aug 18 11:29:40.040008 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:29:40.040008 n-d-853611-3 devstack@n-api.service[122209]: {"os-resetState": {"state": "error"}} Aug 18 11:29:40.040008 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:29:40.040008 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 999 could not be found. Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:40.040818 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 18 11:29:40.042111 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 18 11:29:40.042111 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:29:40.042111 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:40.042111 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 18 11:29:40.042111 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:40.042111 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:40.042111 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:40.042111 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:40.042111 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:40.042111 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:40.042111 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:40.042111 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:40.042111 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 18 11:29:40.042111 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:40.044845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-58ed4597-f85e-4408-b131-d4b09e93c1c0 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:40.045902 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-58ed4597-f85e-4408-b131-d4b09e93c1c0 tempest-ServersAdminNegativeTestJSON-599441481 tempest-ServersAdminNegativeTestJSON-599441481-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.025119 Aug 18 11:29:40.050839 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 561/1121] 10.222.0.73 () {60 vars in 1179 bytes} [Thu Aug 18 11:29:40 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:29:40.063527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c74c4413-1708-4640-938c-f5651ab48381 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:40.064184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c74c4413-1708-4640-938c-f5651ab48381 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:40.073901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c74c4413-1708-4640-938c-f5651ab48381 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:40.074614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c74c4413-1708-4640-938c-f5651ab48381 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:40.075328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c74c4413-1708-4640-938c-f5651ab48381 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:40.076157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c74c4413-1708-4640-938c-f5651ab48381 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:40.076722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c74c4413-1708-4640-938c-f5651ab48381 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:40.077422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c74c4413-1708-4640-938c-f5651ab48381 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:40.112028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c74c4413-1708-4640-938c-f5651ab48381 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:29:40.197684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:40.277743 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c74c4413-1708-4640-938c-f5651ab48381 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 204 len: 0 microversion: 2.1 time: 0.223661 Aug 18 11:29:40.278375 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 562/1122] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:29:40 2022] DELETE /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:40.295733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c565e50a-e20c-4657-b4b6-d85d2352e211 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:40.296712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c565e50a-e20c-4657-b4b6-d85d2352e211 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:40.303379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c565e50a-e20c-4657-b4b6-d85d2352e211 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:40.304199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c565e50a-e20c-4657-b4b6-d85d2352e211 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:40.304887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c565e50a-e20c-4657-b4b6-d85d2352e211 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:40.305856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c565e50a-e20c-4657-b4b6-d85d2352e211 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:40.306592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c565e50a-e20c-4657-b4b6-d85d2352e211 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:40.307264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c565e50a-e20c-4657-b4b6-d85d2352e211 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:40.685387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:40.731729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=38 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:40.860946 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1fde086c-107a-4072-97f7-91ca1eebace9 tempest-SecurityGroupsTestAdminJSON-1043005869 tempest-SecurityGroupsTestAdminJSON-1043005869-project-admin] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.012833 Aug 18 11:29:40.871637 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 561/1123] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:29:39 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:40.879678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-52fa4bb4-4ad3-478e-914f-311a695dd813 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:40.880541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-52fa4bb4-4ad3-478e-914f-311a695dd813 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:40.884455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:40.896663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52fa4bb4-4ad3-478e-914f-311a695dd813 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:40.898627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52fa4bb4-4ad3-478e-914f-311a695dd813 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:40.900206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52fa4bb4-4ad3-478e-914f-311a695dd813 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:40.900997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52fa4bb4-4ad3-478e-914f-311a695dd813 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:40.904295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52fa4bb4-4ad3-478e-914f-311a695dd813 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:40.904789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52fa4bb4-4ad3-478e-914f-311a695dd813 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:40.947089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c565e50a-e20c-4657-b4b6-d85d2352e211 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:40.958128 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c565e50a-e20c-4657-b4b6-d85d2352e211 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1472 microversion: 2.1 time: 0.674146 Aug 18 11:29:40.963079 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 563/1124] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:40 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1472 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:40.977649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c5f5cb64-377e-4ab5-970b-78c65f93e05c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:40.981798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c5f5cb64-377e-4ab5-970b-78c65f93e05c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:40.988598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c5f5cb64-377e-4ab5-970b-78c65f93e05c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:40.989101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c5f5cb64-377e-4ab5-970b-78c65f93e05c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:40.989546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c5f5cb64-377e-4ab5-970b-78c65f93e05c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:40.990274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c5f5cb64-377e-4ab5-970b-78c65f93e05c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:40.991348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c5f5cb64-377e-4ab5-970b-78c65f93e05c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:40.992136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c5f5cb64-377e-4ab5-970b-78c65f93e05c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:41.265915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-52fa4bb4-4ad3-478e-914f-311a695dd813 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:41.279066 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-52fa4bb4-4ad3-478e-914f-311a695dd813 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1468 microversion: 2.1 time: 0.404347 Aug 18 11:29:41.280167 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 562/1125] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:40 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1468 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:41.289143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-378714f5-b9f6-447d-af0e-4fd71176afcc req-0b65b295-cfb3-43e6-b085-80f0c53c3a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3247ce04-df54-4bd8-a1e9-00a29d975b62", "name": "network-vif-deleted", "tag": "177ae402-c6ae-4f07-8847-318571daf7b5"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:41.307624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-378714f5-b9f6-447d-af0e-4fd71176afcc req-0b65b295-cfb3-43e6-b085-80f0c53c3a79 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:41.308437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-378714f5-b9f6-447d-af0e-4fd71176afcc req-0b65b295-cfb3-43e6-b085-80f0c53c3a79 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:41.309309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-378714f5-b9f6-447d-af0e-4fd71176afcc req-0b65b295-cfb3-43e6-b085-80f0c53c3a79 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:41.330823 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-378714f5-b9f6-447d-af0e-4fd71176afcc req-0b65b295-cfb3-43e6-b085-80f0c53c3a79 service nova] Creating event network-vif-deleted:177ae402-c6ae-4f07-8847-318571daf7b5 for instance 3247ce04-df54-4bd8-a1e9-00a29d975b62 on n-h1-853611-3 Aug 18 11:29:41.338407 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-378714f5-b9f6-447d-af0e-4fd71176afcc req-0b65b295-cfb3-43e6-b085-80f0c53c3a79 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055849 Aug 18 11:29:41.339399 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 563/1126] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:41.346210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e57bca2c-1b16-4e38-90a3-5952c1ca5d23 tempest-SecurityGroupsTestAdminJSON-1043005869 tempest-SecurityGroupsTestAdminJSON-1043005869-project-admin] Action: 'create', calling method: .version_select at 0x7f519faf1280>, body: {"security_group": {"name": "tempest-securitygroup-1203402973", "description": "tempest-description-404602889"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:41.474693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c5f5cb64-377e-4ab5-970b-78c65f93e05c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:41.498110 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c5f5cb64-377e-4ab5-970b-78c65f93e05c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1359 microversion: 2.1 time: 0.532549 Aug 18 11:29:41.506131 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 564/1127] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:40 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1359 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:41.521018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9728b433-906f-4d3c-bbd5-bc7acdd87c98 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:41.524923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9728b433-906f-4d3c-bbd5-bc7acdd87c98 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:41.541443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9728b433-906f-4d3c-bbd5-bc7acdd87c98 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:41.542893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9728b433-906f-4d3c-bbd5-bc7acdd87c98 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:41.543682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9728b433-906f-4d3c-bbd5-bc7acdd87c98 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:41.545900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9728b433-906f-4d3c-bbd5-bc7acdd87c98 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:41.547020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9728b433-906f-4d3c-bbd5-bc7acdd87c98 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:41.550655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9728b433-906f-4d3c-bbd5-bc7acdd87c98 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:41.703191 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e57bca2c-1b16-4e38-90a3-5952c1ca5d23 tempest-SecurityGroupsTestAdminJSON-1043005869 tempest-SecurityGroupsTestAdminJSON-1043005869-project-admin] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.362129 Aug 18 11:29:41.705092 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 564/1128] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:29:41 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:41.720171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24777f2a-c621-4786-a991-c0bdc9aafd5a tempest-SecurityGroupsTestAdminJSON-1043005869 tempest-SecurityGroupsTestAdminJSON-1043005869-project-admin] Calling method '.version_select at 0x7f519faf6940>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:41.883700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9728b433-906f-4d3c-bbd5-bc7acdd87c98 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:41.892700 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9728b433-906f-4d3c-bbd5-bc7acdd87c98 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1325 microversion: 2.1 time: 0.383696 Aug 18 11:29:41.893370 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 565/1129] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:41 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1325 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:41.993928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-90d0632e-6d8a-4be4-bfee-c0fce0d7245f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:41.994775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-90d0632e-6d8a-4be4-bfee-c0fce0d7245f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:42.011576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90d0632e-6d8a-4be4-bfee-c0fce0d7245f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:42.012034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90d0632e-6d8a-4be4-bfee-c0fce0d7245f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:42.012666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90d0632e-6d8a-4be4-bfee-c0fce0d7245f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:42.014795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90d0632e-6d8a-4be4-bfee-c0fce0d7245f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:42.014795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90d0632e-6d8a-4be4-bfee-c0fce0d7245f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:42.014795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90d0632e-6d8a-4be4-bfee-c0fce0d7245f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:42.099345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90d0632e-6d8a-4be4-bfee-c0fce0d7245f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:42.100747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90d0632e-6d8a-4be4-bfee-c0fce0d7245f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:42.101801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90d0632e-6d8a-4be4-bfee-c0fce0d7245f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:42.103915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-90d0632e-6d8a-4be4-bfee-c0fce0d7245f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lazy-loading 'fault' on Instance uuid 3247ce04-df54-4bd8-a1e9-00a29d975b62 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:29:42.195564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-90d0632e-6d8a-4be4-bfee-c0fce0d7245f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75d06aa767c4f7799209c7d0fe23d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bc9a4c5234460bfbe654bb068f79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:42.215148 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-90d0632e-6d8a-4be4-bfee-c0fce0d7245f tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 200 len: 1306 microversion: 2.1 time: 0.225787 Aug 18 11:29:42.216470 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 566/1130] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:41 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 1306 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:42.304230 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5964ec28-db0a-43f5-9e88-27484e8822b1 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:42.305256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5964ec28-db0a-43f5-9e88-27484e8822b1 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:42.311835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5964ec28-db0a-43f5-9e88-27484e8822b1 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:42.312599 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5964ec28-db0a-43f5-9e88-27484e8822b1 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:42.313220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5964ec28-db0a-43f5-9e88-27484e8822b1 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:42.314238 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5964ec28-db0a-43f5-9e88-27484e8822b1 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:42.315073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5964ec28-db0a-43f5-9e88-27484e8822b1 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:42.315752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5964ec28-db0a-43f5-9e88-27484e8822b1 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:42.528864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5964ec28-db0a-43f5-9e88-27484e8822b1 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:42.541398 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5964ec28-db0a-43f5-9e88-27484e8822b1 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1468 microversion: 2.1 time: 0.243609 Aug 18 11:29:42.542225 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 567/1131] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:42 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1468 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:42.547330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aeb4326d-51a7-474d-ab6b-603e5cfa74ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:42.548181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-aeb4326d-51a7-474d-ab6b-603e5cfa74ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:42.556030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb4326d-51a7-474d-ab6b-603e5cfa74ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:42.556782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb4326d-51a7-474d-ab6b-603e5cfa74ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:42.557373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb4326d-51a7-474d-ab6b-603e5cfa74ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:42.558243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb4326d-51a7-474d-ab6b-603e5cfa74ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:42.558873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb4326d-51a7-474d-ab6b-603e5cfa74ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:42.559452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb4326d-51a7-474d-ab6b-603e5cfa74ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:42.733425 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aeb4326d-51a7-474d-ab6b-603e5cfa74ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:42.742079 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aeb4326d-51a7-474d-ab6b-603e5cfa74ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1359 microversion: 2.1 time: 0.198708 Aug 18 11:29:42.742707 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 568/1132] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:42 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:42.917671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5ba7c9bc-078a-4e6a-b93b-2494d40fd5af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:42.918344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5ba7c9bc-078a-4e6a-b93b-2494d40fd5af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:42.927642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ba7c9bc-078a-4e6a-b93b-2494d40fd5af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:42.928229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ba7c9bc-078a-4e6a-b93b-2494d40fd5af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:42.928660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ba7c9bc-078a-4e6a-b93b-2494d40fd5af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:42.932174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ba7c9bc-078a-4e6a-b93b-2494d40fd5af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:42.932853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ba7c9bc-078a-4e6a-b93b-2494d40fd5af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:42.934862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ba7c9bc-078a-4e6a-b93b-2494d40fd5af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:43.201915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5ba7c9bc-078a-4e6a-b93b-2494d40fd5af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:43.213734 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5ba7c9bc-078a-4e6a-b93b-2494d40fd5af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1325 microversion: 2.1 time: 0.300473 Aug 18 11:29:43.237422 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 569/1133] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:42 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1325 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:29:43.246814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-93285d75-fb36-407c-bac0-2c36e1a87232 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:43.262366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-93285d75-fb36-407c-bac0-2c36e1a87232 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] [instance: 3247ce04-df54-4bd8-a1e9-00a29d975b62] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:43.275806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93285d75-fb36-407c-bac0-2c36e1a87232 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:43.279681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93285d75-fb36-407c-bac0-2c36e1a87232 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:43.293934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93285d75-fb36-407c-bac0-2c36e1a87232 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:43.294779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93285d75-fb36-407c-bac0-2c36e1a87232 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:43.295268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93285d75-fb36-407c-bac0-2c36e1a87232 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:43.295707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93285d75-fb36-407c-bac0-2c36e1a87232 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:43.330279 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-93285d75-fb36-407c-bac0-2c36e1a87232 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] HTTP exception thrown: Instance 3247ce04-df54-4bd8-a1e9-00a29d975b62 could not be found. Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-93285d75-fb36-407c-bac0-2c36e1a87232 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Request method failure captured: Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 HTTP/1.1 Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iHIwwevFwKV8xm18kbPD3Ciy8CvScg1fDfl7wNmdQTnBTrBT97kbGF3NuiwyTQZfFarL5ZQ_ovW6qJoZzgynXj2UZuYP-JiihvsYTyFfdjisb-mFUTjTlzA9uSeEs_Ej_djUg_OyBjwyPw77sh7iTNOfHkUZhc2sk4s13i0I8-Szeo Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:29:43.334836 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:29:43.336490 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b78bc9a4c5234460bfbe654bb068f79f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:43.336490 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:43.336490 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b78bc9a4c5234460bfbe654bb068f79f Aug 18 11:29:43.336490 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1698242133 Aug 18 11:29:43.336490 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:43.336490 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:29:43.336490 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:29:43.336490 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b75d06aa767c4f7799209c7d0fe23d2c Aug 18 11:29:43.336490 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersOnMultiNodesTest-1698242133-project Aug 18 11:29:43.336490 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:29:43.336490 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 3247ce04-df54-4bd8-a1e9-00a29d975b62 could not be found. Aug 18 11:29:43.336490 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3247ce04-df54-4bd8-a1e9-00a29d975b62'} Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3247ce04-df54-4bd8-a1e9-00a29d975b62 could not be found. Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:43.337385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3247ce04-df54-4bd8-a1e9-00a29d975b62 could not be found. Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3247ce04-df54-4bd8-a1e9-00a29d975b62 could not be found. Aug 18 11:29:43.338775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:43.342006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-93285d75-fb36-407c-bac0-2c36e1a87232 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] Returning 404 to user: Instance 3247ce04-df54-4bd8-a1e9-00a29d975b62 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:43.356315 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-93285d75-fb36-407c-bac0-2c36e1a87232 tempest-ServersOnMultiNodesTest-1698242133 tempest-ServersOnMultiNodesTest-1698242133-project] 10.222.0.73 "GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62" status: 404 len: 111 microversion: 2.1 time: 0.117910 Aug 18 11:29:43.361829 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 570/1134] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:43 2022] GET /compute/v2.1/servers/3247ce04-df54-4bd8-a1e9-00a29d975b62 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:29:43.390195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-4ab682e4-ecdf-4e84-b60b-b9ff7fbe2227 req-935c72f6-3731-42a0-9761-dcb3896db7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6806735a-b820-48c6-a1bb-917e42fb801e", "name": "network-vif-deleted", "tag": "dc3abf7a-7b1a-45a4-8efc-335d557a21d9"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:43.414297 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4ab682e4-ecdf-4e84-b60b-b9ff7fbe2227 req-935c72f6-3731-42a0-9761-dcb3896db7d2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:43.416723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4ab682e4-ecdf-4e84-b60b-b9ff7fbe2227 req-935c72f6-3731-42a0-9761-dcb3896db7d2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:43.420177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4ab682e4-ecdf-4e84-b60b-b9ff7fbe2227 req-935c72f6-3731-42a0-9761-dcb3896db7d2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:43.453454 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-4ab682e4-ecdf-4e84-b60b-b9ff7fbe2227 req-935c72f6-3731-42a0-9761-dcb3896db7d2 service nova] Creating event network-vif-deleted:dc3abf7a-7b1a-45a4-8efc-335d557a21d9 for instance 6806735a-b820-48c6-a1bb-917e42fb801e on n-h1-853611-3 Aug 18 11:29:43.465871 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-4ab682e4-ecdf-4e84-b60b-b9ff7fbe2227 req-935c72f6-3731-42a0-9761-dcb3896db7d2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089377 Aug 18 11:29:43.469313 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 571/1135] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:29:43.566690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-09f95051-1981-4c01-a150-dbb73fbab96f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:43.567968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-09f95051-1981-4c01-a150-dbb73fbab96f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:43.587094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09f95051-1981-4c01-a150-dbb73fbab96f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:43.592894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09f95051-1981-4c01-a150-dbb73fbab96f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:43.597467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09f95051-1981-4c01-a150-dbb73fbab96f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:43.600937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09f95051-1981-4c01-a150-dbb73fbab96f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:43.606201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09f95051-1981-4c01-a150-dbb73fbab96f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:43.607749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09f95051-1981-4c01-a150-dbb73fbab96f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:43.684073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09f95051-1981-4c01-a150-dbb73fbab96f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:43.684744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09f95051-1981-4c01-a150-dbb73fbab96f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:43.685270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09f95051-1981-4c01-a150-dbb73fbab96f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:43.685880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-09f95051-1981-4c01-a150-dbb73fbab96f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lazy-loading 'fault' on Instance uuid 6806735a-b820-48c6-a1bb-917e42fb801e {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:29:43.745491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-09f95051-1981-4c01-a150-dbb73fbab96f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:43.755156 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-09f95051-1981-4c01-a150-dbb73fbab96f tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 200 len: 1312 microversion: 2.1 time: 0.193603 Aug 18 11:29:43.756907 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 572/1136] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:43 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:43.765205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5ef6e131-01e7-4086-9dff-2f4a7c89973b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:43.766148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5ef6e131-01e7-4086-9dff-2f4a7c89973b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:43.774367 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ef6e131-01e7-4086-9dff-2f4a7c89973b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:43.775210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ef6e131-01e7-4086-9dff-2f4a7c89973b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:43.775887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ef6e131-01e7-4086-9dff-2f4a7c89973b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:43.776862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ef6e131-01e7-4086-9dff-2f4a7c89973b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:43.777820 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ef6e131-01e7-4086-9dff-2f4a7c89973b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:43.778906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ef6e131-01e7-4086-9dff-2f4a7c89973b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:43.980706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5ef6e131-01e7-4086-9dff-2f4a7c89973b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:43.993144 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5ef6e131-01e7-4086-9dff-2f4a7c89973b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1359 microversion: 2.1 time: 0.232922 Aug 18 11:29:43.994355 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 573/1137] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:43 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:44.235289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bab61dba-0a5c-4e08-a5d8-0dc1ce00e4ad tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:44.235905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bab61dba-0a5c-4e08-a5d8-0dc1ce00e4ad tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:44.246517 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bab61dba-0a5c-4e08-a5d8-0dc1ce00e4ad tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:44.247483 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bab61dba-0a5c-4e08-a5d8-0dc1ce00e4ad tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:44.248083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bab61dba-0a5c-4e08-a5d8-0dc1ce00e4ad tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:44.248974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bab61dba-0a5c-4e08-a5d8-0dc1ce00e4ad tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:44.250176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bab61dba-0a5c-4e08-a5d8-0dc1ce00e4ad tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:44.251310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bab61dba-0a5c-4e08-a5d8-0dc1ce00e4ad tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:44.558935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bab61dba-0a5c-4e08-a5d8-0dc1ce00e4ad tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:44.570235 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bab61dba-0a5c-4e08-a5d8-0dc1ce00e4ad tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1325 microversion: 2.1 time: 0.339051 Aug 18 11:29:44.585642 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 574/1138] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:44 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1325 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:29:44.781861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-63026a9d-06ea-40d1-9fd3-063dd9212b77 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:44.781861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-63026a9d-06ea-40d1-9fd3-063dd9212b77 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: 6806735a-b820-48c6-a1bb-917e42fb801e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:44.806807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-63026a9d-06ea-40d1-9fd3-063dd9212b77 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:44.807808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-63026a9d-06ea-40d1-9fd3-063dd9212b77 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:44.808597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-63026a9d-06ea-40d1-9fd3-063dd9212b77 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:44.810336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-63026a9d-06ea-40d1-9fd3-063dd9212b77 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:44.811216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-63026a9d-06ea-40d1-9fd3-063dd9212b77 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:44.812709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-63026a9d-06ea-40d1-9fd3-063dd9212b77 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:44.860742 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-63026a9d-06ea-40d1-9fd3-063dd9212b77 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] HTTP exception thrown: Instance 6806735a-b820-48c6-a1bb-917e42fb801e could not be found. Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-63026a9d-06ea-40d1-9fd3-063dd9212b77 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Request method failure captured: Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e HTTP/1.1 Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iJrW7oKfKbHxV573-hWu2DGDoi3YTPkT7X59isEurWRQ9RbwesV30yPBc96TeZg3qLQFmpPp94WsLOU4uZD8nBDSwnUzYCyqwy1LNGNjt33v3Llb3aNihz8nBESBVRX5t4OXT-Y8QDkcxnU4YRKLxVBi2YKJWyb0toL4muz-7mCqjs Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 0718d83ed8e34cdc828f9de773a3515d Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-39354076 Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:29:44.862540 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:29:44.864040 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0718d83ed8e34cdc828f9de773a3515d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0718d83ed8e34cdc828f9de773a3515d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0718d83ed8e34cdc828f9de773a3515d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0718d83ed8e34cdc828f9de773a3515d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:44.864040 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersAdminNegativeTestJSON-39354076 Aug 18 11:29:44.864040 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 0718d83ed8e34cdc828f9de773a3515d Aug 18 11:29:44.864040 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-39354076 Aug 18 11:29:44.864040 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersAdminNegativeTestJSON-39354076-project Aug 18 11:29:44.864040 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:29:44.864040 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:29:44.864040 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b2b3b1bcd12841858b3fbe6cb358435a Aug 18 11:29:44.864040 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersAdminNegativeTestJSON-39354076-project Aug 18 11:29:44.864040 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:29:44.864040 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 6806735a-b820-48c6-a1bb-917e42fb801e could not be found. Aug 18 11:29:44.864040 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '6806735a-b820-48c6-a1bb-917e42fb801e'} Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6806735a-b820-48c6-a1bb-917e42fb801e could not be found. Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:44.864869 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6806735a-b820-48c6-a1bb-917e42fb801e could not be found. Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6806735a-b820-48c6-a1bb-917e42fb801e could not be found. Aug 18 11:29:44.867063 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:44.868171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-63026a9d-06ea-40d1-9fd3-063dd9212b77 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Returning 404 to user: Instance 6806735a-b820-48c6-a1bb-917e42fb801e could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:44.868171 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-63026a9d-06ea-40d1-9fd3-063dd9212b77 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e" status: 404 len: 111 microversion: 2.1 time: 0.091044 Aug 18 11:29:44.872146 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 575/1139] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:44 2022] GET /compute/v2.1/servers/6806735a-b820-48c6-a1bb-917e42fb801e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:29:44.897337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e5363889-c785-4210-8d2e-9fc0cfba6481 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:44.898095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e5363889-c785-4210-8d2e-9fc0cfba6481 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:44.926674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5363889-c785-4210-8d2e-9fc0cfba6481 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:44.927417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5363889-c785-4210-8d2e-9fc0cfba6481 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:44.928213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5363889-c785-4210-8d2e-9fc0cfba6481 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:44.929113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5363889-c785-4210-8d2e-9fc0cfba6481 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:44.929570 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5363889-c785-4210-8d2e-9fc0cfba6481 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:44.930004 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5363889-c785-4210-8d2e-9fc0cfba6481 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:45.011328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e5363889-c785-4210-8d2e-9fc0cfba6481 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:29:45.145771 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e5363889-c785-4210-8d2e-9fc0cfba6481 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 204 len: 0 microversion: 2.1 time: 0.265363 Aug 18 11:29:45.149105 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 576/1140] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:29:44 2022] DELETE /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:45.178675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-505a589b-699d-4e44-88ac-c41716cd91c8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:45.184070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-505a589b-699d-4e44-88ac-c41716cd91c8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:45.200781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-505a589b-699d-4e44-88ac-c41716cd91c8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:45.203108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-505a589b-699d-4e44-88ac-c41716cd91c8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:45.205665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-505a589b-699d-4e44-88ac-c41716cd91c8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:45.208739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-505a589b-699d-4e44-88ac-c41716cd91c8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:45.210190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-505a589b-699d-4e44-88ac-c41716cd91c8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:45.212345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-505a589b-699d-4e44-88ac-c41716cd91c8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:45.516200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-505a589b-699d-4e44-88ac-c41716cd91c8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:45.524101 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-505a589b-699d-4e44-88ac-c41716cd91c8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1359 microversion: 2.1 time: 0.373626 Aug 18 11:29:45.538209 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 577/1141] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:45 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1359 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:45.546582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-894f8355-20ea-4487-9d08-b52ae07aa1da tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:45.547259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-894f8355-20ea-4487-9d08-b52ae07aa1da tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:45.556084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-894f8355-20ea-4487-9d08-b52ae07aa1da tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:45.556896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-894f8355-20ea-4487-9d08-b52ae07aa1da tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:45.557648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-894f8355-20ea-4487-9d08-b52ae07aa1da tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:45.558782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-894f8355-20ea-4487-9d08-b52ae07aa1da tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:45.559248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-894f8355-20ea-4487-9d08-b52ae07aa1da tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:45.559779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-894f8355-20ea-4487-9d08-b52ae07aa1da tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:45.870986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-894f8355-20ea-4487-9d08-b52ae07aa1da tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:45.883054 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-894f8355-20ea-4487-9d08-b52ae07aa1da tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1478 microversion: 2.1 time: 0.343525 Aug 18 11:29:45.883607 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 578/1142] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:45 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1478 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:45.901008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-153a7162-21ca-4d6b-9745-974fcc3bf2b0 req-d0776c39-b85e-4750-9cad-a867e8393034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f688dc84-1bfc-4f87-a2ed-0b196d40e86f", "name": "network-vif-plugged", "status": "completed", "tag": "db295dd6-2301-47bd-9a90-1c3544856223"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:45.907981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:45.915152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-153a7162-21ca-4d6b-9745-974fcc3bf2b0 req-d0776c39-b85e-4750-9cad-a867e8393034 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:45.916012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-153a7162-21ca-4d6b-9745-974fcc3bf2b0 req-d0776c39-b85e-4750-9cad-a867e8393034 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:45.916999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-153a7162-21ca-4d6b-9745-974fcc3bf2b0 req-d0776c39-b85e-4750-9cad-a867e8393034 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:45.925462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:45.938647 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-153a7162-21ca-4d6b-9745-974fcc3bf2b0 req-d0776c39-b85e-4750-9cad-a867e8393034 service nova] Creating event network-vif-plugged:db295dd6-2301-47bd-9a90-1c3544856223 for instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f on n-h2-853611-3 Aug 18 11:29:45.948373 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-153a7162-21ca-4d6b-9745-974fcc3bf2b0 req-d0776c39-b85e-4750-9cad-a867e8393034 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062518 Aug 18 11:29:45.952150 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-24777f2a-c621-4786-a991-c0bdc9aafd5a tempest-SecurityGroupsTestAdminJSON-1043005869 tempest-SecurityGroupsTestAdminJSON-1043005869-project-admin] 10.222.0.73 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 14977 microversion: 2.1 time: 4.237816 Aug 18 11:29:45.953588 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 565/1143] 10.222.0.73 () {58 vars in 1191 bytes} [Thu Aug 18 11:29:41 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 14977 bytes in 4240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:29:45.963928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d8607896-298f-45a0-9328-63ee4d77ce67 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:45.966521 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 579/1144] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:45.967073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d8607896-298f-45a0-9328-63ee4d77ce67 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:45.982314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-85a1a3a2-d280-44ea-a3c2-dbebd909272a tempest-SecurityGroupsTestAdminJSON-1713173969 tempest-SecurityGroupsTestAdminJSON-1713173969-project] Calling method '.version_select at 0x7f519f9311f0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:45.985148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8607896-298f-45a0-9328-63ee4d77ce67 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:45.985750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8607896-298f-45a0-9328-63ee4d77ce67 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:45.986216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8607896-298f-45a0-9328-63ee4d77ce67 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:45.986965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8607896-298f-45a0-9328-63ee4d77ce67 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:45.987425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8607896-298f-45a0-9328-63ee4d77ce67 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:45.987860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8607896-298f-45a0-9328-63ee4d77ce67 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:46.227240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d8607896-298f-45a0-9328-63ee4d77ce67 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:46.237548 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d8607896-298f-45a0-9328-63ee4d77ce67 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1325 microversion: 2.1 time: 0.281404 Aug 18 11:29:46.255617 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 566/1145] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:45 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1325 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:46.263644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d45d0bc-48b9-4ce6-8fa3-582a0cee5b12 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:46.266637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9d45d0bc-48b9-4ce6-8fa3-582a0cee5b12 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:46.275295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d45d0bc-48b9-4ce6-8fa3-582a0cee5b12 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:46.277606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d45d0bc-48b9-4ce6-8fa3-582a0cee5b12 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:46.277606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d45d0bc-48b9-4ce6-8fa3-582a0cee5b12 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:46.277606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d45d0bc-48b9-4ce6-8fa3-582a0cee5b12 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:46.277606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d45d0bc-48b9-4ce6-8fa3-582a0cee5b12 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:46.279499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d45d0bc-48b9-4ce6-8fa3-582a0cee5b12 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:46.289120 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-85a1a3a2-d280-44ea-a3c2-dbebd909272a tempest-SecurityGroupsTestAdminJSON-1713173969 tempest-SecurityGroupsTestAdminJSON-1713173969-project] 10.222.0.73 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.312077 Aug 18 11:29:46.290089 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 580/1146] 10.222.0.73 () {58 vars in 1191 bytes} [Thu Aug 18 11:29:45 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:46.304895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-decb653c-8208-4878-9f05-a34923837d22 tempest-SecurityGroupsTestAdminJSON-1043005869 tempest-SecurityGroupsTestAdminJSON-1043005869-project-admin] Calling method '.version_select at 0x7f519f882f70>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:46.316924 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9d45d0bc-48b9-4ce6-8fa3-582a0cee5b12 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059093 Aug 18 11:29:46.317619 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 567/1147] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:29:46 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:46.331646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d02b2b2a-7c2c-41e6-b3b6-a0ae19fde94d tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:46.332668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d02b2b2a-7c2c-41e6-b3b6-a0ae19fde94d tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:46.340455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d02b2b2a-7c2c-41e6-b3b6-a0ae19fde94d tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:46.341705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d02b2b2a-7c2c-41e6-b3b6-a0ae19fde94d tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:46.342361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d02b2b2a-7c2c-41e6-b3b6-a0ae19fde94d tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:46.343856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d02b2b2a-7c2c-41e6-b3b6-a0ae19fde94d tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:46.344535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d02b2b2a-7c2c-41e6-b3b6-a0ae19fde94d tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:46.345454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d02b2b2a-7c2c-41e6-b3b6-a0ae19fde94d tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:46.530754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-d02b2b2a-7c2c-41e6-b3b6-a0ae19fde94d tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lazy-loading 'services' on Instance uuid c90c1672-67f6-4f31-84b5-695115309d3d {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:29:46.756607 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d02b2b2a-7c2c-41e6-b3b6-a0ae19fde94d tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d/os-volume_attachments/e0860583-e541-432b-b188-030557fdaec4" status: 202 len: 0 microversion: 2.1 time: 0.427345 Aug 18 11:29:46.758779 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 568/1148] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 11:29:46 2022] DELETE /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d/os-volume_attachments/e0860583-e541-432b-b188-030557fdaec4 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:29:46.765381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-066eabda-3028-418c-874e-b65dad640370 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:46.767823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-066eabda-3028-418c-874e-b65dad640370 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:46.784274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-066eabda-3028-418c-874e-b65dad640370 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:46.787247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-066eabda-3028-418c-874e-b65dad640370 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:46.789260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-066eabda-3028-418c-874e-b65dad640370 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:46.790271 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-decb653c-8208-4878-9f05-a34923837d22 tempest-SecurityGroupsTestAdminJSON-1043005869 tempest-SecurityGroupsTestAdminJSON-1043005869-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/94d44310-4413-4eab-8ac8-5227c2dc6092" status: 202 len: 0 microversion: 2.1 time: 0.490085 Aug 18 11:29:46.790929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-066eabda-3028-418c-874e-b65dad640370 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:46.791737 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 581/1149] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:29:46 2022] DELETE /compute/v2.1/os-security-groups/94d44310-4413-4eab-8ac8-5227c2dc6092 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:29:46.793580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-066eabda-3028-418c-874e-b65dad640370 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:46.794025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-066eabda-3028-418c-874e-b65dad640370 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:46.801033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a402740c-cb15-4685-80c9-2894de543817 tempest-SecurityGroupsTestAdminJSON-1043005869 tempest-SecurityGroupsTestAdminJSON-1043005869-project-admin] Calling method '.version_select at 0x7f519f87fd30>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:47.048219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-066eabda-3028-418c-874e-b65dad640370 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:47.060829 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-066eabda-3028-418c-874e-b65dad640370 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1359 microversion: 2.1 time: 0.298951 Aug 18 11:29:47.063038 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 569/1150] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:46 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1359 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:47.072808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-790b09b9-f7ac-41e6-8fd8-a6def75e8c71 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:47.074224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-790b09b9-f7ac-41e6-8fd8-a6def75e8c71 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:47.082336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-790b09b9-f7ac-41e6-8fd8-a6def75e8c71 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:47.082863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-790b09b9-f7ac-41e6-8fd8-a6def75e8c71 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:47.083490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-790b09b9-f7ac-41e6-8fd8-a6def75e8c71 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:47.085340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-790b09b9-f7ac-41e6-8fd8-a6def75e8c71 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:47.085822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-790b09b9-f7ac-41e6-8fd8-a6def75e8c71 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:47.086259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-790b09b9-f7ac-41e6-8fd8-a6def75e8c71 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:47.329416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-790b09b9-f7ac-41e6-8fd8-a6def75e8c71 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:47.342383 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-790b09b9-f7ac-41e6-8fd8-a6def75e8c71 tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1478 microversion: 2.1 time: 0.277812 Aug 18 11:29:47.344683 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 570/1151] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:47 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1478 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:47.350468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-415a991f-6acc-4241-96e3-199001b1f152 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:47.351128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-415a991f-6acc-4241-96e3-199001b1f152 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:47.360856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-415a991f-6acc-4241-96e3-199001b1f152 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:47.361370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-415a991f-6acc-4241-96e3-199001b1f152 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:47.361836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-415a991f-6acc-4241-96e3-199001b1f152 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:47.362646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-415a991f-6acc-4241-96e3-199001b1f152 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:47.363568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-415a991f-6acc-4241-96e3-199001b1f152 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:47.364163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-415a991f-6acc-4241-96e3-199001b1f152 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:47.369542 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a402740c-cb15-4685-80c9-2894de543817 tempest-SecurityGroupsTestAdminJSON-1043005869 tempest-SecurityGroupsTestAdminJSON-1043005869-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/46296fae-a7db-41c3-98a0-334ccc82de3d" status: 202 len: 0 microversion: 2.1 time: 0.573072 Aug 18 11:29:47.370700 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 582/1152] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:29:46 2022] DELETE /compute/v2.1/os-security-groups/46296fae-a7db-41c3-98a0-334ccc82de3d => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:29:47.380921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ef21d46c-66f2-433c-b676-3bffe1c456a2 tempest-SecurityGroupsTestAdminJSON-1713173969 tempest-SecurityGroupsTestAdminJSON-1713173969-project] Calling method '.version_select at 0x7f519f87f700>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:47.609677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-415a991f-6acc-4241-96e3-199001b1f152 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:47.645110 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-415a991f-6acc-4241-96e3-199001b1f152 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1325 microversion: 2.1 time: 0.297639 Aug 18 11:29:47.667390 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 571/1153] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:47 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1325 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:47.933115 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ef21d46c-66f2-433c-b676-3bffe1c456a2 tempest-SecurityGroupsTestAdminJSON-1713173969 tempest-SecurityGroupsTestAdminJSON-1713173969-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/f0f04b8a-dd40-4f5d-a8a8-0de2b6ad0673" status: 202 len: 0 microversion: 2.1 time: 0.558731 Aug 18 11:29:47.936923 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 583/1154] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:29:47 2022] DELETE /compute/v2.1/os-security-groups/f0f04b8a-dd40-4f5d-a8a8-0de2b6ad0673 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:29:47.944047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b626c9b8-e5e7-4a28-a5bb-16455d57692b tempest-SecurityGroupsTestAdminJSON-1713173969 tempest-SecurityGroupsTestAdminJSON-1713173969-project] Calling method '.version_select at 0x7f519fab23a0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:47.989190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-5b97eedd-7d54-48da-8d7b-2f07c1321832 req-528f6e19-4355-4d35-8dbe-8a3eaca91448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ed1e63-d1e3-4419-adcf-2271d73bc72c", "name": "network-vif-deleted", "tag": "8ab222ae-f9c9-4f5a-b5b2-e5224f8e7809"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:48.016725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5b97eedd-7d54-48da-8d7b-2f07c1321832 req-528f6e19-4355-4d35-8dbe-8a3eaca91448 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:48.017132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5b97eedd-7d54-48da-8d7b-2f07c1321832 req-528f6e19-4355-4d35-8dbe-8a3eaca91448 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:48.017569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5b97eedd-7d54-48da-8d7b-2f07c1321832 req-528f6e19-4355-4d35-8dbe-8a3eaca91448 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:48.031573 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5b97eedd-7d54-48da-8d7b-2f07c1321832 req-528f6e19-4355-4d35-8dbe-8a3eaca91448 service nova] Creating event network-vif-deleted:8ab222ae-f9c9-4f5a-b5b2-e5224f8e7809 for instance d9ed1e63-d1e3-4419-adcf-2271d73bc72c on n-h2-853611-3 Aug 18 11:29:48.056216 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-5b97eedd-7d54-48da-8d7b-2f07c1321832 req-528f6e19-4355-4d35-8dbe-8a3eaca91448 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054734 Aug 18 11:29:48.056978 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 584/1155] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:48.074753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-2e664d8a-d668-49e6-8596-f91f7ee1039e req-6fa1b667-1118-460f-981f-44b0fa640f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea", "name": "network-vif-plugged", "status": "completed", "tag": "6f0d24ce-a546-4261-8582-706023203b8e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:48.102678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2e664d8a-d668-49e6-8596-f91f7ee1039e req-6fa1b667-1118-460f-981f-44b0fa640f44 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:48.103446 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2e664d8a-d668-49e6-8596-f91f7ee1039e req-6fa1b667-1118-460f-981f-44b0fa640f44 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:48.104044 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2e664d8a-d668-49e6-8596-f91f7ee1039e req-6fa1b667-1118-460f-981f-44b0fa640f44 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:48.143580 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-2e664d8a-d668-49e6-8596-f91f7ee1039e req-6fa1b667-1118-460f-981f-44b0fa640f44 service nova] Creating event network-vif-plugged:6f0d24ce-a546-4261-8582-706023203b8e for instance 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea on n-h2-853611-3 Aug 18 11:29:48.156772 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-2e664d8a-d668-49e6-8596-f91f7ee1039e req-6fa1b667-1118-460f-981f-44b0fa640f44 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092092 Aug 18 11:29:48.159366 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 585/1156] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:48.194864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-47713118-d8dd-4639-a15c-2accc56b4829 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:48.198289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-47713118-d8dd-4639-a15c-2accc56b4829 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:48.241962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47713118-d8dd-4639-a15c-2accc56b4829 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:48.245665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47713118-d8dd-4639-a15c-2accc56b4829 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:48.246262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47713118-d8dd-4639-a15c-2accc56b4829 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:48.250800 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47713118-d8dd-4639-a15c-2accc56b4829 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:48.251348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47713118-d8dd-4639-a15c-2accc56b4829 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:48.259891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47713118-d8dd-4639-a15c-2accc56b4829 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:48.484783 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b626c9b8-e5e7-4a28-a5bb-16455d57692b tempest-SecurityGroupsTestAdminJSON-1713173969 tempest-SecurityGroupsTestAdminJSON-1713173969-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/5acdd5f5-6fed-4aae-8766-2ce580d61c97" status: 202 len: 0 microversion: 2.1 time: 0.546525 Aug 18 11:29:48.494518 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 572/1157] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:29:47 2022] DELETE /compute/v2.1/os-security-groups/5acdd5f5-6fed-4aae-8766-2ce580d61c97 => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:29:48.501233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3341b11d-8336-4c60-98b4-9d3de989792e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:48.501863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3341b11d-8336-4c60-98b4-9d3de989792e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:48.519599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3341b11d-8336-4c60-98b4-9d3de989792e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:48.521936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3341b11d-8336-4c60-98b4-9d3de989792e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:48.522410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3341b11d-8336-4c60-98b4-9d3de989792e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:48.523184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3341b11d-8336-4c60-98b4-9d3de989792e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:48.523664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3341b11d-8336-4c60-98b4-9d3de989792e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:48.526778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3341b11d-8336-4c60-98b4-9d3de989792e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:48.598231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3341b11d-8336-4c60-98b4-9d3de989792e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:48.599146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3341b11d-8336-4c60-98b4-9d3de989792e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:48.601071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3341b11d-8336-4c60-98b4-9d3de989792e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:48.604605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-3341b11d-8336-4c60-98b4-9d3de989792e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lazy-loading 'fault' on Instance uuid d9ed1e63-d1e3-4419-adcf-2271d73bc72c {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:29:48.675941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3341b11d-8336-4c60-98b4-9d3de989792e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b3b1bcd12841858b3fbe6cb358435a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718d83ed8e34cdc828f9de773a3515d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:48.696870 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3341b11d-8336-4c60-98b4-9d3de989792e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 200 len: 1312 microversion: 2.1 time: 0.199573 Aug 18 11:29:48.698102 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 573/1158] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:48 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 1312 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:48.705532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8304d229-9987-4997-8328-267c4c9ad0d9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:48.706798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8304d229-9987-4997-8328-267c4c9ad0d9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:48.716324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8304d229-9987-4997-8328-267c4c9ad0d9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:48.717246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8304d229-9987-4997-8328-267c4c9ad0d9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:48.719307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8304d229-9987-4997-8328-267c4c9ad0d9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:48.721875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8304d229-9987-4997-8328-267c4c9ad0d9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:48.724883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8304d229-9987-4997-8328-267c4c9ad0d9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:48.727176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8304d229-9987-4997-8328-267c4c9ad0d9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:48.797273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-47713118-d8dd-4639-a15c-2accc56b4829 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:48.818777 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-47713118-d8dd-4639-a15c-2accc56b4829 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1359 microversion: 2.1 time: 0.655225 Aug 18 11:29:48.823484 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 586/1159] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:48 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1359 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:48.983813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8304d229-9987-4997-8328-267c4c9ad0d9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:49.000657 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8304d229-9987-4997-8328-267c4c9ad0d9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1522 microversion: 2.1 time: 0.299382 Aug 18 11:29:49.001544 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 574/1160] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:48 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:49.023999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3dce38c3-84e2-48a8-bcbd-17aabce6c0d6 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:49.024626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3dce38c3-84e2-48a8-bcbd-17aabce6c0d6 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:49.031238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3dce38c3-84e2-48a8-bcbd-17aabce6c0d6 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.032189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3dce38c3-84e2-48a8-bcbd-17aabce6c0d6 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.032837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3dce38c3-84e2-48a8-bcbd-17aabce6c0d6 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.034182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3dce38c3-84e2-48a8-bcbd-17aabce6c0d6 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.034857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3dce38c3-84e2-48a8-bcbd-17aabce6c0d6 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.035457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3dce38c3-84e2-48a8-bcbd-17aabce6c0d6 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.279109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3dce38c3-84e2-48a8-bcbd-17aabce6c0d6 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:49.288977 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3dce38c3-84e2-48a8-bcbd-17aabce6c0d6 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1522 microversion: 2.1 time: 0.269800 Aug 18 11:29:49.289818 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 575/1161] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:49 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:29:49.315448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f5e62458-fb67-4939-8c9f-e941ce1b8f6a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-466801689", "metadata": {"": ""}}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f5e62458-fb67-4939-8c9f-e941ce1b8f6a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Request method failure captured: Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f/action HTTP/1.1 Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 106 Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iKSlag_DyTRhHK9TqvjB3uaeJqTd30mOdcDQGSTKfo_1BiKJ_YVW1kKUDWBo3oX_2psn9QztObg-Czr0es9clWo5Gc0LlzQQSxBjjoX14p_m_VrrKtUvAek3sTjzCNUkm1K7bZ4E5tksWhtZBOj5XEF41miqv560I8D9uiLs9cmbSc Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:29:49.323853 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:29:49.325270 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:49.325270 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:29:49.325270 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:29:49.325270 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:29:49.325270 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:29:49.325270 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:29:49.325270 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:29:49.325270 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ed6ed454654f4ce0a01d407f18524a52 Aug 18 11:29:49.325270 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:29:49.325270 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:29:49.325270 n-d-853611-3 devstack@n-api.service[122210]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-466801689", "metadata": {"": ""}}} Aug 18 11:29:49.325270 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'f688dc84-1bfc-4f87-a2ed-0b196d40e86f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-466801689', 'metadata': {'': ''}}}} Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'': ''} Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:49.326062 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:49.327488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:49.329885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:49.329885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:49.329885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:29:49.329885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:29:49.329885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:29:49.329885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:49.332776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f5e62458-fb67-4939-8c9f-e941ce1b8f6a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:49.335217 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f5e62458-fb67-4939-8c9f-e941ce1b8f6a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "POST /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f/action" status: 400 len: 170 microversion: 2.1 time: 0.029665 Aug 18 11:29:49.336754 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 576/1162] 10.222.0.73 () {60 vars in 1279 bytes} [Thu Aug 18 11:29:49 2022] POST /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f/action => generated 170 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 11:29:49.348056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7c2d43e2-efe2-43fb-96db-fb0c8db0998e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:49.349864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7c2d43e2-efe2-43fb-96db-fb0c8db0998e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:49.358066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c2d43e2-efe2-43fb-96db-fb0c8db0998e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.359151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c2d43e2-efe2-43fb-96db-fb0c8db0998e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.360133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c2d43e2-efe2-43fb-96db-fb0c8db0998e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.362058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c2d43e2-efe2-43fb-96db-fb0c8db0998e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.362902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c2d43e2-efe2-43fb-96db-fb0c8db0998e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.364331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c2d43e2-efe2-43fb-96db-fb0c8db0998e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.385269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8e0e6824-3fc3-45f4-9317-dfc91d139ea9 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:49.388688 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:29:49.388688 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:29:49.389932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e0e6824-3fc3-45f4-9317-dfc91d139ea9 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.390464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e0e6824-3fc3-45f4-9317-dfc91d139ea9 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.390902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e0e6824-3fc3-45f4-9317-dfc91d139ea9 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.391650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e0e6824-3fc3-45f4-9317-dfc91d139ea9 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.392118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e0e6824-3fc3-45f4-9317-dfc91d139ea9 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.392545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e0e6824-3fc3-45f4-9317-dfc91d139ea9 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.432098 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8e0e6824-3fc3-45f4-9317-dfc91d139ea9 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.605915 Aug 18 11:29:49.440487 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 587/1163] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:29:48 2022] GET /compute/v2.1/os-services => generated 944 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:49.448027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1dd4e941-f15b-47d3-8a3d-b788cb1471a2 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:49.451542 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:29:49.451542 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:29:49.453062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dd4e941-f15b-47d3-8a3d-b788cb1471a2 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.453560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dd4e941-f15b-47d3-8a3d-b788cb1471a2 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.454010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dd4e941-f15b-47d3-8a3d-b788cb1471a2 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.455783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dd4e941-f15b-47d3-8a3d-b788cb1471a2 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.456490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dd4e941-f15b-47d3-8a3d-b788cb1471a2 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.458789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dd4e941-f15b-47d3-8a3d-b788cb1471a2 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.511472 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1dd4e941-f15b-47d3-8a3d-b788cb1471a2 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?host=n-d-853611-3" status: 200 len: 578 microversion: 2.1 time: 0.067318 Aug 18 11:29:49.515502 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 588/1164] 10.222.0.73 () {58 vars in 1172 bytes} [Thu Aug 18 11:29:49 2022] GET /compute/v2.1/os-services?host=n-d-853611-3 => generated 578 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:49.537176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b5feb170-7e20-4d94-b0c5-59bc8814b099 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:49.546292 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:29:49.546292 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:29:49.548005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5feb170-7e20-4d94-b0c5-59bc8814b099 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.548728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5feb170-7e20-4d94-b0c5-59bc8814b099 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.549427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5feb170-7e20-4d94-b0c5-59bc8814b099 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.550403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5feb170-7e20-4d94-b0c5-59bc8814b099 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.551346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5feb170-7e20-4d94-b0c5-59bc8814b099 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.552024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5feb170-7e20-4d94-b0c5-59bc8814b099 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.559064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:49.598415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c2d43e2-efe2-43fb-96db-fb0c8db0998e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:49.608314 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7c2d43e2-efe2-43fb-96db-fb0c8db0998e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1522 microversion: 2.1 time: 0.266993 Aug 18 11:29:49.608743 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 577/1165] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:49 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:49.616385 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b5feb170-7e20-4d94-b0c5-59bc8814b099 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.091509 Aug 18 11:29:49.617322 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 589/1166] 10.222.0.73 () {58 vars in 1176 bytes} [Thu Aug 18 11:29:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:49.640252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-77c05f31-e5c2-420f-b382-783e2085f5b7 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:49.643180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d79667fe-3e9e-4490-92e8-3d77c33e3d19 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:49.643884 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:29:49.643884 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:29:49.644094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d79667fe-3e9e-4490-92e8-3d77c33e3d19 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:49.646893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77c05f31-e5c2-420f-b382-783e2085f5b7 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.649503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77c05f31-e5c2-420f-b382-783e2085f5b7 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.650324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77c05f31-e5c2-420f-b382-783e2085f5b7 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.652011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d79667fe-3e9e-4490-92e8-3d77c33e3d19 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.652372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77c05f31-e5c2-420f-b382-783e2085f5b7 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.653032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d79667fe-3e9e-4490-92e8-3d77c33e3d19 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.653217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77c05f31-e5c2-420f-b382-783e2085f5b7 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.653793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d79667fe-3e9e-4490-92e8-3d77c33e3d19 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.654879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d79667fe-3e9e-4490-92e8-3d77c33e3d19 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.655451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d79667fe-3e9e-4490-92e8-3d77c33e3d19 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.656114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d79667fe-3e9e-4490-92e8-3d77c33e3d19 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.668775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77c05f31-e5c2-420f-b382-783e2085f5b7 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.736718 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-77c05f31-e5c2-420f-b382-783e2085f5b7 tempest-ServicesAdminTestJSON-25687412 tempest-ServicesAdminTestJSON-25687412-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.108821 Aug 18 11:29:49.737705 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 578/1167] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:29:49 2022] GET /compute/v2.1/os-services => generated 944 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:49.752293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ddf4808-20df-412d-8183-79dcb095bf4e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:49.753473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6ddf4808-20df-412d-8183-79dcb095bf4e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] [instance: d9ed1e63-d1e3-4419-adcf-2271d73bc72c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:49.768617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ddf4808-20df-412d-8183-79dcb095bf4e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.769375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ddf4808-20df-412d-8183-79dcb095bf4e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.770002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ddf4808-20df-412d-8183-79dcb095bf4e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.771663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ddf4808-20df-412d-8183-79dcb095bf4e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.778795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ddf4808-20df-412d-8183-79dcb095bf4e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.779549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ddf4808-20df-412d-8183-79dcb095bf4e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.804622 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-6ddf4808-20df-412d-8183-79dcb095bf4e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] HTTP exception thrown: Instance d9ed1e63-d1e3-4419-adcf-2271d73bc72c could not be found. Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ddf4808-20df-412d-8183-79dcb095bf4e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Request method failure captured: Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c HTTP/1.1 Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iJrW7oKfKbHxV573-hWu2DGDoi3YTPkT7X59isEurWRQ9RbwesV30yPBc96TeZg3qLQFmpPp94WsLOU4uZD8nBDSwnUzYCyqwy1LNGNjt33v3Llb3aNihz8nBESBVRX5t4OXT-Y8QDkcxnU4YRKLxVBi2YKJWyb0toL4muz-7mCqjs Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 0718d83ed8e34cdc828f9de773a3515d Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-39354076 Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:29:49.820784 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:29:49.822657 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0718d83ed8e34cdc828f9de773a3515d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0718d83ed8e34cdc828f9de773a3515d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0718d83ed8e34cdc828f9de773a3515d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0718d83ed8e34cdc828f9de773a3515d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:49.822657 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersAdminNegativeTestJSON-39354076 Aug 18 11:29:49.822657 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 0718d83ed8e34cdc828f9de773a3515d Aug 18 11:29:49.822657 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-39354076 Aug 18 11:29:49.822657 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersAdminNegativeTestJSON-39354076-project Aug 18 11:29:49.822657 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:29:49.822657 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:29:49.822657 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: b2b3b1bcd12841858b3fbe6cb358435a Aug 18 11:29:49.822657 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersAdminNegativeTestJSON-39354076-project Aug 18 11:29:49.822657 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:29:49.822657 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance d9ed1e63-d1e3-4419-adcf-2271d73bc72c could not be found. Aug 18 11:29:49.822657 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'd9ed1e63-d1e3-4419-adcf-2271d73bc72c'} Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9ed1e63-d1e3-4419-adcf-2271d73bc72c could not be found. Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:49.823455 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9ed1e63-d1e3-4419-adcf-2271d73bc72c could not be found. Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9ed1e63-d1e3-4419-adcf-2271d73bc72c could not be found. Aug 18 11:29:49.824659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:49.825758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ddf4808-20df-412d-8183-79dcb095bf4e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] Returning 404 to user: Instance d9ed1e63-d1e3-4419-adcf-2271d73bc72c could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:49.825758 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6ddf4808-20df-412d-8183-79dcb095bf4e tempest-ServersAdminNegativeTestJSON-39354076 tempest-ServersAdminNegativeTestJSON-39354076-project] 10.222.0.73 "GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c" status: 404 len: 111 microversion: 2.1 time: 0.077657 Aug 18 11:29:49.842763 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 579/1168] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:49 2022] GET /compute/v2.1/servers/d9ed1e63-d1e3-4419-adcf-2271d73bc72c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:29:49.850130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6e1487d2-1b6d-49e8-b795-105563c12ac4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:49.851005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6e1487d2-1b6d-49e8-b795-105563c12ac4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:49.858657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e1487d2-1b6d-49e8-b795-105563c12ac4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.861445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e1487d2-1b6d-49e8-b795-105563c12ac4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.862076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e1487d2-1b6d-49e8-b795-105563c12ac4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.868080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e1487d2-1b6d-49e8-b795-105563c12ac4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:49.868810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e1487d2-1b6d-49e8-b795-105563c12ac4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:49.869435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e1487d2-1b6d-49e8-b795-105563c12ac4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:49.910568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:49.979207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d79667fe-3e9e-4490-92e8-3d77c33e3d19 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:49.990324 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d79667fe-3e9e-4490-92e8-3d77c33e3d19 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1522 microversion: 2.1 time: 0.350529 Aug 18 11:29:49.991818 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 590/1169] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:49 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:50.018652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f05ef567-90d6-4ad5-bce8-99f19b04b70a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-799148479", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f05ef567-90d6-4ad5-bce8-99f19b04b70a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Request method failure captured: Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f/action HTTP/1.1 Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 618 Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iKSlag_DyTRhHK9TqvjB3uaeJqTd30mOdcDQGSTKfo_1BiKJ_YVW1kKUDWBo3oX_2psn9QztObg-Czr0es9clWo5Gc0LlzQQSxBjjoX14p_m_VrrKtUvAek3sTjzCNUkm1K7bZ4E5tksWhtZBOj5XEF41miqv560I8D9uiLs9cmbSc Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:29:50.032350 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:29:50.034102 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:50.034102 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:29:50.034102 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:29:50.034102 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:29:50.034102 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:29:50.034102 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:29:50.034102 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:29:50.034102 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ed6ed454654f4ce0a01d407f18524a52 Aug 18 11:29:50.034102 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:29:50.034102 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:29:50.040796 n-d-853611-3 devstack@n-api.service[122209]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-799148479", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 18 11:29:50.040796 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:29:50.040796 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:29:50.041062 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'f688dc84-1bfc-4f87-a2ed-0b196d40e86f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-799148479', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 18 11:29:50.041062 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:50.041062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:50.041062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:29:50.041062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:29:50.041062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:29:50.041062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:29:50.041062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:29:50.041062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:50.041062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 18 11:29:50.041062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:50.041896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:29:50.043219 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:50.043219 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:29:50.043219 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:29:50.043219 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:29:50.043219 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:29:50.043219 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:29:50.043219 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:29:50.043219 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:29:50.043219 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:50.043219 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:50.043219 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:50.043219 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:50.044087 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:50.044087 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:50.044087 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:29:50.044087 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:29:50.044087 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:29:50.044087 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:50.044549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f05ef567-90d6-4ad5-bce8-99f19b04b70a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:50.044549 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f05ef567-90d6-4ad5-bce8-99f19b04b70a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "POST /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f/action" status: 400 len: 938 microversion: 2.1 time: 0.023619 Aug 18 11:29:50.046775 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 591/1170] 10.222.0.73 () {60 vars in 1279 bytes} [Thu Aug 18 11:29:50 2022] POST /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f/action => generated 938 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 11:29:50.065686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6ef5520d-3655-457d-bead-bb45193c96e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:50.072955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6ef5520d-3655-457d-bead-bb45193c96e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:50.088528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ef5520d-3655-457d-bead-bb45193c96e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:50.091268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ef5520d-3655-457d-bead-bb45193c96e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:50.094840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ef5520d-3655-457d-bead-bb45193c96e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:50.095857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ef5520d-3655-457d-bead-bb45193c96e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:50.096628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ef5520d-3655-457d-bead-bb45193c96e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:50.097604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ef5520d-3655-457d-bead-bb45193c96e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:50.221877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6e1487d2-1b6d-49e8-b795-105563c12ac4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:50.232680 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6e1487d2-1b6d-49e8-b795-105563c12ac4 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1359 microversion: 2.1 time: 0.385868 Aug 18 11:29:50.234117 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 580/1171] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:49 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1359 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:29:50.374618 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6ef5520d-3655-457d-bead-bb45193c96e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:50.390360 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6ef5520d-3655-457d-bead-bb45193c96e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1522 microversion: 2.1 time: 0.342414 Aug 18 11:29:50.391018 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 592/1172] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:50 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:50.417984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5219e328-489b-4f34-bc1a-e35d252f17d0 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:50.418333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5219e328-489b-4f34-bc1a-e35d252f17d0 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:50.429240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5219e328-489b-4f34-bc1a-e35d252f17d0 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:50.429743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5219e328-489b-4f34-bc1a-e35d252f17d0 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:50.430462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5219e328-489b-4f34-bc1a-e35d252f17d0 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:50.431193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5219e328-489b-4f34-bc1a-e35d252f17d0 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:50.431656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5219e328-489b-4f34-bc1a-e35d252f17d0 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:50.432082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5219e328-489b-4f34-bc1a-e35d252f17d0 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:50.743367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5219e328-489b-4f34-bc1a-e35d252f17d0 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:50.773142 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5219e328-489b-4f34-bc1a-e35d252f17d0 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1522 microversion: 2.1 time: 0.355576 Aug 18 11:29:50.777582 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 581/1173] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:50 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:29:50.796337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0702a1f9-2671-4cb1-bd66-41fb0e7f8cae tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0702a1f9-2671-4cb1-bd66-41fb0e7f8cae tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Request method failure captured: Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f/action HTTP/1.1 Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 285 Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iKSlag_DyTRhHK9TqvjB3uaeJqTd30mOdcDQGSTKfo_1BiKJ_YVW1kKUDWBo3oX_2psn9QztObg-Czr0es9clWo5Gc0LlzQQSxBjjoX14p_m_VrrKtUvAek3sTjzCNUkm1K7bZ4E5tksWhtZBOj5XEF41miqv560I8D9uiLs9cmbSc Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:29:50.801448 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:29:50.804500 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:50.804500 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:29:50.804500 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:29:50.804500 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:29:50.804500 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:29:50.804500 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:29:50.804500 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:29:50.804500 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ed6ed454654f4ce0a01d407f18524a52 Aug 18 11:29:50.804500 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:29:50.804500 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:29:50.804500 n-d-853611-3 devstack@n-api.service[122209]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 18 11:29:50.808320 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:29:50.808320 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:29:50.808320 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'f688dc84-1bfc-4f87-a2ed-0b196d40e86f', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 18 11:29:50.808320 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:50.808320 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:50.808320 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:29:50.808320 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:29:50.808320 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:29:50.808320 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:29:50.808320 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:29:50.811085 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:29:50.816365 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:29:50.816365 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:29:50.816365 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:29:50.816365 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:29:50.816365 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:29:50.816365 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:50.816365 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:50.816365 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:50.816365 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:50.816365 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:50.816365 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:50.816365 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:29:50.816365 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:29:50.819272 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:29:50.819272 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:50.819272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0702a1f9-2671-4cb1-bd66-41fb0e7f8cae tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:50.819272 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0702a1f9-2671-4cb1-bd66-41fb0e7f8cae tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "POST /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f/action" status: 400 len: 619 microversion: 2.1 time: 0.021505 Aug 18 11:29:50.820368 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 593/1174] 10.222.0.73 () {60 vars in 1279 bytes} [Thu Aug 18 11:29:50 2022] POST /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f/action => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:29:50.825379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-591223bc-3cad-4857-919d-4ae8359d4f7f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:50.826035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-591223bc-3cad-4857-919d-4ae8359d4f7f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:50.837455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-591223bc-3cad-4857-919d-4ae8359d4f7f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:50.837960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-591223bc-3cad-4857-919d-4ae8359d4f7f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:50.838397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-591223bc-3cad-4857-919d-4ae8359d4f7f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:50.839157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-591223bc-3cad-4857-919d-4ae8359d4f7f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:50.839614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-591223bc-3cad-4857-919d-4ae8359d4f7f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:50.840039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-591223bc-3cad-4857-919d-4ae8359d4f7f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:51.133960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-591223bc-3cad-4857-919d-4ae8359d4f7f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:51.149160 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-591223bc-3cad-4857-919d-4ae8359d4f7f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1522 microversion: 2.1 time: 0.329488 Aug 18 11:29:51.149782 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 582/1175] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:50 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:51.176389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-47aa7ad1-021c-4b51-9386-f9415c01d788 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:51.178851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-47aa7ad1-021c-4b51-9386-f9415c01d788 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:51.191687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47aa7ad1-021c-4b51-9386-f9415c01d788 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:51.192479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47aa7ad1-021c-4b51-9386-f9415c01d788 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:51.193290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47aa7ad1-021c-4b51-9386-f9415c01d788 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:51.195572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47aa7ad1-021c-4b51-9386-f9415c01d788 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:51.196119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47aa7ad1-021c-4b51-9386-f9415c01d788 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:51.196567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47aa7ad1-021c-4b51-9386-f9415c01d788 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:51.258477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d75e7b2-7ed8-4eb8-a026-94d4e671a8a1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:51.259770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7d75e7b2-7ed8-4eb8-a026-94d4e671a8a1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:51.269527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d75e7b2-7ed8-4eb8-a026-94d4e671a8a1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:51.270607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d75e7b2-7ed8-4eb8-a026-94d4e671a8a1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:51.271677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d75e7b2-7ed8-4eb8-a026-94d4e671a8a1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:51.272779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d75e7b2-7ed8-4eb8-a026-94d4e671a8a1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:51.273480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d75e7b2-7ed8-4eb8-a026-94d4e671a8a1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:51.279015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d75e7b2-7ed8-4eb8-a026-94d4e671a8a1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:51.422516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-47aa7ad1-021c-4b51-9386-f9415c01d788 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:51.451490 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-47aa7ad1-021c-4b51-9386-f9415c01d788 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1522 microversion: 2.1 time: 0.280154 Aug 18 11:29:51.455087 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 594/1176] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:51 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:51.478413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f08f1293-72a5-414b-a8d5-826b76f78d0f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-359937014"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:51.491421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f08f1293-72a5-414b-a8d5-826b76f78d0f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:51.504400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f08f1293-72a5-414b-a8d5-826b76f78d0f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:51.505905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f08f1293-72a5-414b-a8d5-826b76f78d0f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:51.507359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f08f1293-72a5-414b-a8d5-826b76f78d0f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:51.509258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f08f1293-72a5-414b-a8d5-826b76f78d0f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:51.509745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f08f1293-72a5-414b-a8d5-826b76f78d0f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:51.510380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f08f1293-72a5-414b-a8d5-826b76f78d0f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:51.653281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7d75e7b2-7ed8-4eb8-a026-94d4e671a8a1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:51.673314 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7d75e7b2-7ed8-4eb8-a026-94d4e671a8a1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1541 microversion: 2.1 time: 0.420266 Aug 18 11:29:51.688532 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 583/1177] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:51 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1541 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:29:51.726817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-75d0d89a-666e-4774-92a0-5bf17483a59f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:51.727327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-75d0d89a-666e-4774-92a0-5bf17483a59f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:51.762622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75d0d89a-666e-4774-92a0-5bf17483a59f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:51.763311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75d0d89a-666e-4774-92a0-5bf17483a59f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:51.766652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75d0d89a-666e-4774-92a0-5bf17483a59f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:51.767817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75d0d89a-666e-4774-92a0-5bf17483a59f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:51.768322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75d0d89a-666e-4774-92a0-5bf17483a59f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:51.768774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75d0d89a-666e-4774-92a0-5bf17483a59f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:52.007688 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-75d0d89a-666e-4774-92a0-5bf17483a59f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.303910 Aug 18 11:29:52.008570 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 584/1178] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:29:51 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-interface => generated 284 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:52.112946 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f08f1293-72a5-414b-a8d5-826b76f78d0f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "POST /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f/action" status: 202 len: 0 microversion: 2.1 time: 0.639194 Aug 18 11:29:52.132383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c400f58d-69b2-4814-a641-bd1020265ca7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1728018798"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:52.135946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c400f58d-69b2-4814-a641-bd1020265ca7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:52.141766 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 595/1179] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:29:51 2022] POST /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f/action => generated 0 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 18 11:29:52.144085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c400f58d-69b2-4814-a641-bd1020265ca7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:52.144838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c400f58d-69b2-4814-a641-bd1020265ca7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:52.145661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c400f58d-69b2-4814-a641-bd1020265ca7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:52.147521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c400f58d-69b2-4814-a641-bd1020265ca7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:52.148931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c400f58d-69b2-4814-a641-bd1020265ca7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:52.150688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c400f58d-69b2-4814-a641-bd1020265ca7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:52.235732 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-c400f58d-69b2-4814-a641-bd1020265ca7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] HTTP exception thrown: Cannot 'createImage' instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f while it is in task_state image_snapshot_pending Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c400f58d-69b2-4814-a641-bd1020265ca7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Request method failure captured: Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f/action HTTP/1.1 Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 85 Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iKSlag_DyTRhHK9TqvjB3uaeJqTd30mOdcDQGSTKfo_1BiKJ_YVW1kKUDWBo3oX_2psn9QztObg-Czr0es9clWo5Gc0LlzQQSxBjjoX14p_m_VrrKtUvAek3sTjzCNUkm1K7bZ4E5tksWhtZBOj5XEF41miqv560I8D9uiLs9cmbSc Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:29:52.240317 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:29:52.241694 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:52.241694 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:29:52.241694 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:29:52.241694 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:29:52.241694 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:29:52.241694 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:29:52.241694 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:29:52.241694 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ed6ed454654f4ce0a01d407f18524a52 Aug 18 11:29:52.241694 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:29:52.241694 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:29:52.241694 n-d-853611-3 devstack@n-api.service[122210]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1728018798"}} Aug 18 11:29:52.241694 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: exception: Cannot 'createImage' instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f while it is in task_state image_snapshot_pending Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'f688dc84-1bfc-4f87-a2ed-0b196d40e86f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1728018798'}}} Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:52.242463 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f while it is in task_state image_snapshot_pending Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f while it is in task_state image_snapshot_pending Aug 18 11:29:52.243820 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:52.248782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c400f58d-69b2-4814-a641-bd1020265ca7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Returning 409 to user: Cannot 'createImage' instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f while it is in task_state image_snapshot_pending {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:52.248782 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c400f58d-69b2-4814-a641-bd1020265ca7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "POST /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f/action" status: 409 len: 167 microversion: 2.1 time: 0.121548 Aug 18 11:29:52.248782 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 585/1180] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:29:52 2022] POST /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f/action => generated 167 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 18 11:29:52.258782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0c854ba7-8483-4391-9953-8dcda9c2fe09 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '.version_select at 0x7f519f8119d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:52.561407 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0c854ba7-8483-4391-9953-8dcda9c2fe09 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "DELETE /compute/v2.1/images/f2173add-7c27-43b8-ae77-1a0fa710023f" status: 204 len: 0 microversion: 2.1 time: 0.310809 Aug 18 11:29:52.562243 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 596/1181] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:52 2022] DELETE /compute/v2.1/images/f2173add-7c27-43b8-ae77-1a0fa710023f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:52.571039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-93f24f3d-3731-45be-b3f0-43a3e58d41e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:52.572111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-93f24f3d-3731-45be-b3f0-43a3e58d41e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:52.583572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f24f3d-3731-45be-b3f0-43a3e58d41e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:52.585689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f24f3d-3731-45be-b3f0-43a3e58d41e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:52.587211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f24f3d-3731-45be-b3f0-43a3e58d41e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:52.589659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f24f3d-3731-45be-b3f0-43a3e58d41e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:52.591748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f24f3d-3731-45be-b3f0-43a3e58d41e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:52.592554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f24f3d-3731-45be-b3f0-43a3e58d41e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:53.327069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-93f24f3d-3731-45be-b3f0-43a3e58d41e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:53.335644 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-93f24f3d-3731-45be-b3f0-43a3e58d41e1 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1534 microversion: 2.1 time: 0.769110 Aug 18 11:29:53.336231 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 586/1182] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:52 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1534 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:54.361634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e890e5d8-0d5d-481a-988b-3ff8578fb942 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:54.363542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e890e5d8-0d5d-481a-988b-3ff8578fb942 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:54.382301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e890e5d8-0d5d-481a-988b-3ff8578fb942 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:54.386956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e890e5d8-0d5d-481a-988b-3ff8578fb942 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:54.387669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e890e5d8-0d5d-481a-988b-3ff8578fb942 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:54.390260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e890e5d8-0d5d-481a-988b-3ff8578fb942 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:54.392015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e890e5d8-0d5d-481a-988b-3ff8578fb942 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:54.392761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e890e5d8-0d5d-481a-988b-3ff8578fb942 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:54.458888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8fe35dc3-05a6-48d0-959e-ae185a6b7977 req-78429160-a218-43b8-8858-32d93b97a150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea", "tag": "6f0d24ce-a546-4261-8582-706023203b8e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:54.481227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8fe35dc3-05a6-48d0-959e-ae185a6b7977 req-78429160-a218-43b8-8858-32d93b97a150 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:54.482206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8fe35dc3-05a6-48d0-959e-ae185a6b7977 req-78429160-a218-43b8-8858-32d93b97a150 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:54.483472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8fe35dc3-05a6-48d0-959e-ae185a6b7977 req-78429160-a218-43b8-8858-32d93b97a150 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:54.510985 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8fe35dc3-05a6-48d0-959e-ae185a6b7977 req-78429160-a218-43b8-8858-32d93b97a150 service nova] Creating event network-changed:6f0d24ce-a546-4261-8582-706023203b8e for instance 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea on n-h2-853611-3 Aug 18 11:29:54.523374 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8fe35dc3-05a6-48d0-959e-ae185a6b7977 req-78429160-a218-43b8-8858-32d93b97a150 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069189 Aug 18 11:29:54.523990 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 587/1183] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:29:54.764924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e890e5d8-0d5d-481a-988b-3ff8578fb942 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:54.775313 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e890e5d8-0d5d-481a-988b-3ff8578fb942 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1540 microversion: 2.1 time: 0.417912 Aug 18 11:29:54.778612 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 597/1184] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:54 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1540 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:55.802047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fe335abf-7957-40ff-ac7e-d7a29575ebc4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:55.803515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fe335abf-7957-40ff-ac7e-d7a29575ebc4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:55.813449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe335abf-7957-40ff-ac7e-d7a29575ebc4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:55.814289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe335abf-7957-40ff-ac7e-d7a29575ebc4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:55.819965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe335abf-7957-40ff-ac7e-d7a29575ebc4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:55.821918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe335abf-7957-40ff-ac7e-d7a29575ebc4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:55.822788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe335abf-7957-40ff-ac7e-d7a29575ebc4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:55.824026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe335abf-7957-40ff-ac7e-d7a29575ebc4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:56.059481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fe335abf-7957-40ff-ac7e-d7a29575ebc4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:56.069669 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fe335abf-7957-40ff-ac7e-d7a29575ebc4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1522 microversion: 2.1 time: 0.273166 Aug 18 11:29:56.070805 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 598/1185] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:55 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:29:56.094758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e46f0990-d371-4f88-a8b1-5b664a20fe0d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:56.096249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e46f0990-d371-4f88-a8b1-5b664a20fe0d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:56.106880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e46f0990-d371-4f88-a8b1-5b664a20fe0d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:56.110995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e46f0990-d371-4f88-a8b1-5b664a20fe0d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:56.111564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e46f0990-d371-4f88-a8b1-5b664a20fe0d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:56.112328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e46f0990-d371-4f88-a8b1-5b664a20fe0d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:56.114963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e46f0990-d371-4f88-a8b1-5b664a20fe0d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:56.117086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e46f0990-d371-4f88-a8b1-5b664a20fe0d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:56.170809 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e46f0990-d371-4f88-a8b1-5b664a20fe0d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:29:56.223922 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8e42923a-42fb-4a1f-a035-c76b30bfd0a1 tempest-TenantUsagesNegativeTestJSON-296720328 tempest-TenantUsagesNegativeTestJSON-296720328-project-admin] 10.222.0.73 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-17T11%3A29%3A55.669525&end=2022-08-19T11%3A29%3A55.669525" status: 404 len: 112 microversion: - time: 0.550021 Aug 18 11:29:56.224811 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 588/1186] 10.222.0.73 () {58 vars in 1316 bytes} [Thu Aug 18 11:29:55 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-17T11%3A29%3A55.669525&end=2022-08-19T11%3A29%3A55.669525 => generated 112 bytes in 552 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 11:29:56.236767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e4850d0b-29ee-4afb-b74e-56e0dae5b49f tempest-TenantUsagesNegativeTestJSON-296720328 tempest-TenantUsagesNegativeTestJSON-296720328-project-admin] Calling method '.version_select at 0x7f51ac1484c0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:56.280367 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-e4850d0b-29ee-4afb-b74e-56e0dae5b49f tempest-TenantUsagesNegativeTestJSON-296720328 tempest-TenantUsagesNegativeTestJSON-296720328-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e4850d0b-29ee-4afb-b74e-56e0dae5b49f tempest-TenantUsagesNegativeTestJSON-296720328 tempest-TenantUsagesNegativeTestJSON-296720328-project-admin] Request method failure captured: Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-simple-tenant-usage/f4ac347e6eec4a0fb1eae811b5d79297?start=2022-08-19T11%3A29%3A55.669525&end=2022-08-17T11%3A29%3A55.669525 HTTP/1.1 Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iKzehHT4KDAwv32Nm2Gz6krnkDovrykXw4w5_ib8EpypySmxSFkbOK5MVanNKiPONMoCtLNZjifKPRvo0gLRBcGhNiBQmemvoyB-ISH-tRRxFX9LBh8fOsX_c2tP0PjAsutVNF7P5XaSLo70AIH_QHUJ9UgsomLb-8abMH3GV4_rAU Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 32044e315bc64f6a82010b1fd1899d09 Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-296720328 Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:29:56.288317 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:29:56.289905 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/32044e315bc64f6a82010b1fd1899d09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/32044e315bc64f6a82010b1fd1899d09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_32044e315bc64f6a82010b1fd1899d09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/32044e315bc64f6a82010b1fd1899d09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:56.289905 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-296720328 Aug 18 11:29:56.289905 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 32044e315bc64f6a82010b1fd1899d09 Aug 18 11:29:56.289905 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-296720328 Aug 18 11:29:56.289905 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TenantUsagesNegativeTestJSON-296720328-project-admin Aug 18 11:29:56.289905 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:29:56.289905 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:29:56.289905 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: dfcf5be41a534f7497af44d14df0e0f2 Aug 18 11:29:56.289905 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-296720328-project-admin Aug 18 11:29:56.289905 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:29:56.289905 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid start time. The start time cannot occur after the end time. Aug 18 11:29:56.289905 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'f4ac347e6eec4a0fb1eae811b5d79297'} Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 18 11:29:56.290885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 18 11:29:56.292131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:56.292131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:56.292131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:56.292131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:56.292131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:56.292131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:56.292131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:56.292131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:56.292131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 18 11:29:56.292131 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:56.292131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e4850d0b-29ee-4afb-b74e-56e0dae5b49f tempest-TenantUsagesNegativeTestJSON-296720328 tempest-TenantUsagesNegativeTestJSON-296720328-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:56.292131 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e4850d0b-29ee-4afb-b74e-56e0dae5b49f tempest-TenantUsagesNegativeTestJSON-296720328 tempest-TenantUsagesNegativeTestJSON-296720328-project-admin] 10.222.0.73 "GET /compute/v2.1/os-simple-tenant-usage/f4ac347e6eec4a0fb1eae811b5d79297?start=2022-08-19T11%3A29%3A55.669525&end=2022-08-17T11%3A29%3A55.669525" status: 400 len: 111 microversion: 2.1 time: 0.059515 Aug 18 11:29:56.293938 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 589/1187] 10.222.0.73 () {58 vars in 1412 bytes} [Thu Aug 18 11:29:56 2022] GET /compute/v2.1/os-simple-tenant-usage/f4ac347e6eec4a0fb1eae811b5d79297?start=2022-08-19T11%3A29%3A55.669525&end=2022-08-17T11%3A29%3A55.669525 => generated 111 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:29:56.324346 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e46f0990-d371-4f88-a8b1-5b664a20fe0d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 204 len: 0 microversion: 2.1 time: 0.232821 Aug 18 11:29:56.324900 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 599/1188] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:29:56 2022] DELETE /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:29:56.336679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5265db9a-b3d4-41d1-b218-baa922f0a094 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:56.340398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5265db9a-b3d4-41d1-b218-baa922f0a094 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:56.349126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5265db9a-b3d4-41d1-b218-baa922f0a094 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:56.349727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5265db9a-b3d4-41d1-b218-baa922f0a094 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:56.350521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5265db9a-b3d4-41d1-b218-baa922f0a094 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:56.352269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5265db9a-b3d4-41d1-b218-baa922f0a094 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:56.352269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5265db9a-b3d4-41d1-b218-baa922f0a094 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:56.352503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5265db9a-b3d4-41d1-b218-baa922f0a094 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:56.398912 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5265db9a-b3d4-41d1-b218-baa922f0a094 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072239 Aug 18 11:29:56.399591 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 600/1189] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:29:56 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:29:56.406480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-89a87af9-9779-4a7c-bcef-f8e6e3ff4e1c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:56.407696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-89a87af9-9779-4a7c-bcef-f8e6e3ff4e1c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:56.418233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89a87af9-9779-4a7c-bcef-f8e6e3ff4e1c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:56.418873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89a87af9-9779-4a7c-bcef-f8e6e3ff4e1c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:56.420078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89a87af9-9779-4a7c-bcef-f8e6e3ff4e1c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:56.421186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89a87af9-9779-4a7c-bcef-f8e6e3ff4e1c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:56.421900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89a87af9-9779-4a7c-bcef-f8e6e3ff4e1c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:56.422706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89a87af9-9779-4a7c-bcef-f8e6e3ff4e1c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:56.607679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-89a87af9-9779-4a7c-bcef-f8e6e3ff4e1c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:56.616638 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-89a87af9-9779-4a7c-bcef-f8e6e3ff4e1c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1528 microversion: 2.1 time: 0.215909 Aug 18 11:29:56.617412 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 601/1190] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:56 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1528 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:56.654740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8ff166c-b1c0-44fe-92d9-b2c8019af984 tempest-TenantUsagesNegativeTestJSON-848628813 tempest-TenantUsagesNegativeTestJSON-848628813-project] Calling method '.version_select at 0x7f519fa31ca0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:56.659278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f8ff166c-b1c0-44fe-92d9-b2c8019af984 tempest-TenantUsagesNegativeTestJSON-848628813 tempest-TenantUsagesNegativeTestJSON-848628813-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '5dd41e91018a413fa32c62ec6fc1fcf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ac347e6eec4a0fb1eae811b5d79297', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8ff166c-b1c0-44fe-92d9-b2c8019af984 tempest-TenantUsagesNegativeTestJSON-848628813 tempest-TenantUsagesNegativeTestJSON-848628813-project] Request method failure captured: Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-17T11%3A29%3A55.669525&end=2022-08-19T11%3A29%3A55.669525&detailed=1 HTTP/1.1 Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iKxm2JWo-APIBM0RZzKXI6QFqODPwVAlinzbgdUkDq42PQs4zz2E0cOXZmxiqDsqUGPxHSQyGQ7rzl_59sTihzE2sGj5kHbEaAUDSfxhSYaNelo9zLkUJEQAeSm6FcOPreE-KtU_Aji9zFOB69wEMs4g4baECudunrP4-qKfBO8c-M Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f4ac347e6eec4a0fb1eae811b5d79297 Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-848628813 Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:29:56.661588 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:29:56.663182 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ac347e6eec4a0fb1eae811b5d79297"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f4ac347e6eec4a0fb1eae811b5d79297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f4ac347e6eec4a0fb1eae811b5d79297"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4ac347e6eec4a0fb1eae811b5d79297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:56.663182 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-848628813 Aug 18 11:29:56.663182 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f4ac347e6eec4a0fb1eae811b5d79297 Aug 18 11:29:56.663182 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-848628813 Aug 18 11:29:56.663182 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TenantUsagesNegativeTestJSON-848628813-project Aug 18 11:29:56.663182 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:29:56.663182 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:29:56.663182 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 5dd41e91018a413fa32c62ec6fc1fcf3 Aug 18 11:29:56.663182 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-848628813-project Aug 18 11:29:56.663182 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:29:56.663182 n-d-853611-3 devstack@n-api.service[122210]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 18 11:29:56.663182 n-d-853611-3 devstack@n-api.service[122210]: action_args: {} Aug 18 11:29:56.663182 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:29:56.664035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:29:56.665234 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:29:56.666702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 18 11:29:56.666702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:56.668029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8ff166c-b1c0-44fe-92d9-b2c8019af984 tempest-TenantUsagesNegativeTestJSON-848628813 tempest-TenantUsagesNegativeTestJSON-848628813-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:56.669268 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8ff166c-b1c0-44fe-92d9-b2c8019af984 tempest-TenantUsagesNegativeTestJSON-848628813 tempest-TenantUsagesNegativeTestJSON-848628813-project] 10.222.0.73 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-17T11%3A29%3A55.669525&end=2022-08-19T11%3A29%3A55.669525&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.368580 Aug 18 11:29:56.669985 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 590/1191] 10.222.0.73 () {58 vars in 1335 bytes} [Thu Aug 18 11:29:56 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-17T11%3A29%3A55.669525&end=2022-08-19T11%3A29%3A55.669525&detailed=1 => generated 123 bytes in 370 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:29:56.690646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b5f51fa7-c30e-4c01-948f-318348c030a7 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:56.693884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b5f51fa7-c30e-4c01-948f-318348c030a7 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:56.705714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5f51fa7-c30e-4c01-948f-318348c030a7 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:56.706223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5f51fa7-c30e-4c01-948f-318348c030a7 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:56.706682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5f51fa7-c30e-4c01-948f-318348c030a7 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:56.707582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5f51fa7-c30e-4c01-948f-318348c030a7 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:56.708913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5f51fa7-c30e-4c01-948f-318348c030a7 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:56.715621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5f51fa7-c30e-4c01-948f-318348c030a7 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:56.749060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-12caff34-9456-4452-949b-19d20f7ffb02 tempest-FlavorsV2NegativeTest-94494002 tempest-FlavorsV2NegativeTest-94494002-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:56.755973 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b5f51fa7-c30e-4c01-948f-318348c030a7 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080352 Aug 18 11:29:56.758123 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 591/1192] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:29:56 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:29:56.763352 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-12caff34-9456-4452-949b-19d20f7ffb02 tempest-FlavorsV2NegativeTest-94494002 tempest-FlavorsV2NegativeTest-94494002-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.130610 Aug 18 11:29:56.775105 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 602/1193] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:29:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:56.848290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ef1c1a7d-ea0d-45c0-ac75-cf6e9d3482e0 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:56.850699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef1c1a7d-ea0d-45c0-ac75-cf6e9d3482e0 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:56.863149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef1c1a7d-ea0d-45c0-ac75-cf6e9d3482e0 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:56.864055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef1c1a7d-ea0d-45c0-ac75-cf6e9d3482e0 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:56.865673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef1c1a7d-ea0d-45c0-ac75-cf6e9d3482e0 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:56.866768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef1c1a7d-ea0d-45c0-ac75-cf6e9d3482e0 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:56.867766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef1c1a7d-ea0d-45c0-ac75-cf6e9d3482e0 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:56.868480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef1c1a7d-ea0d-45c0-ac75-cf6e9d3482e0 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:56.933811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef1c1a7d-ea0d-45c0-ac75-cf6e9d3482e0 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:29:57.074936 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ef1c1a7d-ea0d-45c0-ac75-cf6e9d3482e0 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 204 len: 0 microversion: 2.1 time: 0.230032 Aug 18 11:29:57.080895 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 592/1194] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:29:56 2022] DELETE /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:29:57.086975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-75b2b6fd-ae21-4140-8efb-21ea77d605e5 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:57.087651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-75b2b6fd-ae21-4140-8efb-21ea77d605e5 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:57.113748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75b2b6fd-ae21-4140-8efb-21ea77d605e5 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.115687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75b2b6fd-ae21-4140-8efb-21ea77d605e5 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.116153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75b2b6fd-ae21-4140-8efb-21ea77d605e5 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.116905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75b2b6fd-ae21-4140-8efb-21ea77d605e5 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.117365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75b2b6fd-ae21-4140-8efb-21ea77d605e5 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.117788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75b2b6fd-ae21-4140-8efb-21ea77d605e5 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.149380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a164b540-e839-410f-87c9-6904b900d22d req-c51ffd5b-ab18-4120-92b2-62389cabba83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f688dc84-1bfc-4f87-a2ed-0b196d40e86f", "name": "network-vif-plugged", "status": "completed", "tag": "db295dd6-2301-47bd-9a90-1c3544856223"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:57.170741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a164b540-e839-410f-87c9-6904b900d22d req-c51ffd5b-ab18-4120-92b2-62389cabba83 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.173128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a164b540-e839-410f-87c9-6904b900d22d req-c51ffd5b-ab18-4120-92b2-62389cabba83 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.176207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a164b540-e839-410f-87c9-6904b900d22d req-c51ffd5b-ab18-4120-92b2-62389cabba83 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.201051 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a164b540-e839-410f-87c9-6904b900d22d req-c51ffd5b-ab18-4120-92b2-62389cabba83 service nova] Creating event network-vif-plugged:db295dd6-2301-47bd-9a90-1c3544856223 for instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f on n-h2-853611-3 Aug 18 11:29:57.214205 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a164b540-e839-410f-87c9-6904b900d22d req-c51ffd5b-ab18-4120-92b2-62389cabba83 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071434 Aug 18 11:29:57.216322 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 593/1195] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:29:57.326924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-75b2b6fd-ae21-4140-8efb-21ea77d605e5 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:57.336900 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-75b2b6fd-ae21-4140-8efb-21ea77d605e5 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1681 microversion: 2.1 time: 0.254634 Aug 18 11:29:57.337876 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 603/1196] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:57 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1681 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:29:57.589537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0782d46b-82a5-4f71-9a3b-46bfd5cb7d91 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Action: 'update', calling method: .version_select at 0x7f519f9ddca0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:57.593800 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:29:57.593800 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:29:57.595082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0782d46b-82a5-4f71-9a3b-46bfd5cb7d91 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.595536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0782d46b-82a5-4f71-9a3b-46bfd5cb7d91 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.595987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0782d46b-82a5-4f71-9a3b-46bfd5cb7d91 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.622856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0782d46b-82a5-4f71-9a3b-46bfd5cb7d91 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.623463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0782d46b-82a5-4f71-9a3b-46bfd5cb7d91 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.624042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0782d46b-82a5-4f71-9a3b-46bfd5cb7d91 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.642872 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-0782d46b-82a5-4f71-9a3b-46bfd5cb7d91 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] HTTP exception thrown: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.643937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4a66174a-777f-49a6-bc3d-8932c632325d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:57.645732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4a66174a-777f-49a6-bc3d-8932c632325d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0782d46b-82a5-4f71-9a3b-46bfd5cb7d91 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Request method failure captured: Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: request: PUT /compute/v2.1/os-services/69ca0dce-ed91-4bd8-8a16-80d5202c5e34 HTTP/1.1 Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 56 Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iK13CCpT4ZmFvY42F0JOD3F4PKE8rzCiduEij4pgEYhniBzs-YojG_8AmLtopQKWVbQL0SwA0SdwxrtYNtEaoIFlxuNS3y10o9eKUps34-Wz_Z2JxCOhEEUo7sEt_FWFoEQ0MU88e6pnmn8ESdUbClzi0e6l3ZdMH-7paUy3Qt84lI Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.53 Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 347189ee53e547ee8e90e4348f70c17f Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1874085181 Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:29:57.647369 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:29:57.649038 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/347189ee53e547ee8e90e4348f70c17f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/347189ee53e547ee8e90e4348f70c17f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_347189ee53e547ee8e90e4348f70c17f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/347189ee53e547ee8e90e4348f70c17f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:57.649038 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1874085181 Aug 18 11:29:57.649038 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 347189ee53e547ee8e90e4348f70c17f Aug 18 11:29:57.649038 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1874085181 Aug 18 11:29:57.649038 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin Aug 18 11:29:57.649038 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:29:57.649038 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:29:57.649038 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 554d7a11a7d74c7498c45c5a82dd66c5 Aug 18 11:29:57.649038 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin Aug 18 11:29:57.649038 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:29:57.649038 n-d-853611-3 devstack@n-api.service[122210]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 18 11:29:57.649038 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:29:57.649038 n-d-853611-3 devstack@n-api.service[122210]: exception: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '69ca0dce-ed91-4bd8-8a16-80d5202c5e34', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6170, in service_get_by_id Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6172, in service_get_by_id Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.650047 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:57.651663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:57.657197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:57.657197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.657197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.657197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0782d46b-82a5-4f71-9a3b-46bfd5cb7d91 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Returning 404 to user: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:57.657197 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0782d46b-82a5-4f71-9a3b-46bfd5cb7d91 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-services/69ca0dce-ed91-4bd8-8a16-80d5202c5e34" status: 404 len: 110 microversion: 2.53 time: 0.300433 Aug 18 11:29:57.657641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a66174a-777f-49a6-bc3d-8932c632325d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.657641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a66174a-777f-49a6-bc3d-8932c632325d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.657641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a66174a-777f-49a6-bc3d-8932c632325d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.657926 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 594/1197] 10.222.0.73 () {62 vars in 1309 bytes} [Thu Aug 18 11:29:57 2022] PUT /compute/v2.1/os-services/69ca0dce-ed91-4bd8-8a16-80d5202c5e34 => generated 110 bytes in 304 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:29:57.658014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a66174a-777f-49a6-bc3d-8932c632325d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.658014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a66174a-777f-49a6-bc3d-8932c632325d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.658198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a66174a-777f-49a6-bc3d-8932c632325d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.665454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d849177-f96b-4356-ae27-cf37b177e007 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Action: 'update', calling method: .version_select at 0x7f519f9ddb80>, body: {"status": "disabled"} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:57.675977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d849177-f96b-4356-ae27-cf37b177e007 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.677292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d849177-f96b-4356-ae27-cf37b177e007 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.677767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d849177-f96b-4356-ae27-cf37b177e007 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.695826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d849177-f96b-4356-ae27-cf37b177e007 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.696414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d849177-f96b-4356-ae27-cf37b177e007 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.696865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d849177-f96b-4356-ae27-cf37b177e007 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.720218 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-2d849177-f96b-4356-ae27-cf37b177e007 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] HTTP exception thrown: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d849177-f96b-4356-ae27-cf37b177e007 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Request method failure captured: Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: request: PUT /compute/v2.1/os-services/69ca0dce-ed91-4bd8-8a16-80d5202c5e34 HTTP/1.1 Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 22 Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iK13CCpT4ZmFvY42F0JOD3F4PKE8rzCiduEij4pgEYhniBzs-YojG_8AmLtopQKWVbQL0SwA0SdwxrtYNtEaoIFlxuNS3y10o9eKUps34-Wz_Z2JxCOhEEUo7sEt_FWFoEQ0MU88e6pnmn8ESdUbClzi0e6l3ZdMH-7paUy3Qt84lI Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.53 Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 347189ee53e547ee8e90e4348f70c17f Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1874085181 Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:29:57.723143 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:29:57.725497 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/347189ee53e547ee8e90e4348f70c17f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/347189ee53e547ee8e90e4348f70c17f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_347189ee53e547ee8e90e4348f70c17f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/347189ee53e547ee8e90e4348f70c17f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:57.725497 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1874085181 Aug 18 11:29:57.725497 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 347189ee53e547ee8e90e4348f70c17f Aug 18 11:29:57.725497 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1874085181 Aug 18 11:29:57.725497 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin Aug 18 11:29:57.725497 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:29:57.725497 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:29:57.725497 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 554d7a11a7d74c7498c45c5a82dd66c5 Aug 18 11:29:57.725497 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin Aug 18 11:29:57.725497 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:29:57.725497 n-d-853611-3 devstack@n-api.service[122210]: {"status": "disabled"} Aug 18 11:29:57.725497 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:29:57.725497 n-d-853611-3 devstack@n-api.service[122210]: exception: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.725497 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '69ca0dce-ed91-4bd8-8a16-80d5202c5e34', 'body': {'status': 'disabled'}} Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6170, in service_get_by_id Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6172, in service_get_by_id Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:57.726541 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:57.728037 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:57.729602 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.729602 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.729602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d849177-f96b-4356-ae27-cf37b177e007 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Returning 404 to user: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:57.729602 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d849177-f96b-4356-ae27-cf37b177e007 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-services/69ca0dce-ed91-4bd8-8a16-80d5202c5e34" status: 404 len: 110 microversion: 2.53 time: 0.065980 Aug 18 11:29:57.731762 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 595/1198] 10.222.0.73 () {62 vars in 1309 bytes} [Thu Aug 18 11:29:57 2022] PUT /compute/v2.1/os-services/69ca0dce-ed91-4bd8-8a16-80d5202c5e34 => generated 110 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:29:57.741449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-152ca10a-60ff-4d2c-a162-885f94561dae tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Action: 'update', calling method: .version_select at 0x7f519faf05e0>, body: {"status": "enabled"} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:57.747869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-152ca10a-60ff-4d2c-a162-885f94561dae tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.749244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-152ca10a-60ff-4d2c-a162-885f94561dae tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.750200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-152ca10a-60ff-4d2c-a162-885f94561dae tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.763751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-152ca10a-60ff-4d2c-a162-885f94561dae tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.764555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-152ca10a-60ff-4d2c-a162-885f94561dae tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.765025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-152ca10a-60ff-4d2c-a162-885f94561dae tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.773583 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-152ca10a-60ff-4d2c-a162-885f94561dae tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] HTTP exception thrown: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-152ca10a-60ff-4d2c-a162-885f94561dae tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Request method failure captured: Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: request: PUT /compute/v2.1/os-services/69ca0dce-ed91-4bd8-8a16-80d5202c5e34 HTTP/1.1 Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 21 Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iK13CCpT4ZmFvY42F0JOD3F4PKE8rzCiduEij4pgEYhniBzs-YojG_8AmLtopQKWVbQL0SwA0SdwxrtYNtEaoIFlxuNS3y10o9eKUps34-Wz_Z2JxCOhEEUo7sEt_FWFoEQ0MU88e6pnmn8ESdUbClzi0e6l3ZdMH-7paUy3Qt84lI Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.53 Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 347189ee53e547ee8e90e4348f70c17f Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1874085181 Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:29:57.775875 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:29:57.777341 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/347189ee53e547ee8e90e4348f70c17f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/347189ee53e547ee8e90e4348f70c17f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_347189ee53e547ee8e90e4348f70c17f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/347189ee53e547ee8e90e4348f70c17f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:57.777341 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1874085181 Aug 18 11:29:57.777341 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 347189ee53e547ee8e90e4348f70c17f Aug 18 11:29:57.777341 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1874085181 Aug 18 11:29:57.777341 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin Aug 18 11:29:57.777341 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:29:57.777341 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:29:57.777341 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 554d7a11a7d74c7498c45c5a82dd66c5 Aug 18 11:29:57.777341 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin Aug 18 11:29:57.777341 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:29:57.777341 n-d-853611-3 devstack@n-api.service[122210]: {"status": "enabled"} Aug 18 11:29:57.777341 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:29:57.777341 n-d-853611-3 devstack@n-api.service[122210]: exception: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.777341 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '69ca0dce-ed91-4bd8-8a16-80d5202c5e34', 'body': {'status': 'enabled'}} Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6170, in service_get_by_id Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6172, in service_get_by_id Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:57.778235 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:57.779892 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:57.781115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. Aug 18 11:29:57.781115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:57.783102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-152ca10a-60ff-4d2c-a162-885f94561dae tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Returning 404 to user: Service 69ca0dce-ed91-4bd8-8a16-80d5202c5e34 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:57.784085 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-152ca10a-60ff-4d2c-a162-885f94561dae tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-services/69ca0dce-ed91-4bd8-8a16-80d5202c5e34" status: 404 len: 110 microversion: 2.53 time: 0.051135 Aug 18 11:29:57.790810 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 596/1199] 10.222.0.73 () {62 vars in 1309 bytes} [Thu Aug 18 11:29:57 2022] PUT /compute/v2.1/os-services/69ca0dce-ed91-4bd8-8a16-80d5202c5e34 => generated 110 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:29:57.799830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1d3a3a71-3a77-4d88-9bd7-84c39ab85618 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:57.807169 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:29:57.807169 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:29:57.808790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d3a3a71-3a77-4d88-9bd7-84c39ab85618 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.809319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d3a3a71-3a77-4d88-9bd7-84c39ab85618 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.809764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d3a3a71-3a77-4d88-9bd7-84c39ab85618 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.810527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d3a3a71-3a77-4d88-9bd7-84c39ab85618 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.811192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d3a3a71-3a77-4d88-9bd7-84c39ab85618 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.811814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d3a3a71-3a77-4d88-9bd7-84c39ab85618 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.846729 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1d3a3a71-3a77-4d88-9bd7-84c39ab85618 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.053885 Aug 18 11:29:57.847982 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 597/1200] 10.222.0.73 () {60 vars in 1178 bytes} [Thu Aug 18 11:29:57 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:57.865542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6fe8d72f-a30c-422a-a516-b96b12a34232 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:57.870418 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:29:57.870418 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:29:57.872017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fe8d72f-a30c-422a-a516-b96b12a34232 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.872687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fe8d72f-a30c-422a-a516-b96b12a34232 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.874369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fe8d72f-a30c-422a-a516-b96b12a34232 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.874369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fe8d72f-a30c-422a-a516-b96b12a34232 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.875587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fe8d72f-a30c-422a-a516-b96b12a34232 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.875587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fe8d72f-a30c-422a-a516-b96b12a34232 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.904242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4a66174a-777f-49a6-bc3d-8932c632325d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:57.915030 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6fe8d72f-a30c-422a-a516-b96b12a34232 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.057753 Aug 18 11:29:57.915892 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 598/1201] 10.222.0.73 () {60 vars in 1211 bytes} [Thu Aug 18 11:29:57 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:57.917865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:29:57.929022 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4a66174a-777f-49a6-bc3d-8932c632325d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1528 microversion: 2.1 time: 0.292292 Aug 18 11:29:57.930213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c1ef01cd-5330-404b-88a5-582764b91da0 tempest-FlavorsV2NegativeTest-94494002 tempest-FlavorsV2NegativeTest-94494002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-813625029", "imageRef": "5157b5b1-6c6d-494a-97b8-32129a8b5da5", "flavorRef": "452"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:57.935297 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 604/1202] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:57 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1528 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:57.944176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-76981208-2b05-439c-9a0d-11c3255b3350 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:57.947010 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:29:57.947010 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:29:57.948251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76981208-2b05-439c-9a0d-11c3255b3350 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.948741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76981208-2b05-439c-9a0d-11c3255b3350 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.949181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76981208-2b05-439c-9a0d-11c3255b3350 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:57.963115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76981208-2b05-439c-9a0d-11c3255b3350 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:57.968151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76981208-2b05-439c-9a0d-11c3255b3350 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:57.968635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76981208-2b05-439c-9a0d-11c3255b3350 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:58.000160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-c1ef01cd-5330-404b-88a5-582764b91da0 tempest-FlavorsV2NegativeTest-94494002 tempest-FlavorsV2NegativeTest-94494002-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:29:58.031900 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-76981208-2b05-439c-9a0d-11c3255b3350 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.094773 Aug 18 11:29:58.039980 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 605/1203] 10.222.0.73 () {60 vars in 1178 bytes} [Thu Aug 18 11:29:57 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:58.052271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5ee39dcf-44d8-43e7-b004-54e454da4c8c tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:58.056278 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:29:58.056278 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:29:58.058069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ee39dcf-44d8-43e7-b004-54e454da4c8c tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:58.058614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ee39dcf-44d8-43e7-b004-54e454da4c8c tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:58.059568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ee39dcf-44d8-43e7-b004-54e454da4c8c tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:58.060343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ee39dcf-44d8-43e7-b004-54e454da4c8c tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:58.060875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ee39dcf-44d8-43e7-b004-54e454da4c8c tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:58.061313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ee39dcf-44d8-43e7-b004-54e454da4c8c tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:58.100951 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5ee39dcf-44d8-43e7-b004-54e454da4c8c tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?host=n-d-853611-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.057636 Aug 18 11:29:58.110545 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 606/1204] 10.222.0.73 () {60 vars in 1235 bytes} [Thu Aug 18 11:29:58 2022] GET /compute/v2.1/os-services?host=n-d-853611-3&binary=xxx => generated 16 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:29:58.116403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a098064d-f050-4098-905b-5a82462f57f9 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:58.127590 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:29:58.127590 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:29:58.130331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a098064d-f050-4098-905b-5a82462f57f9 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:58.130877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a098064d-f050-4098-905b-5a82462f57f9 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:58.131325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a098064d-f050-4098-905b-5a82462f57f9 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:58.132078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a098064d-f050-4098-905b-5a82462f57f9 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:58.133403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a098064d-f050-4098-905b-5a82462f57f9 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:58.134304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a098064d-f050-4098-905b-5a82462f57f9 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:58.180139 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a098064d-f050-4098-905b-5a82462f57f9 tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.063602 Aug 18 11:29:58.190938 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 607/1205] 10.222.0.73 () {60 vars in 1178 bytes} [Thu Aug 18 11:29:58 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:29:58.197382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0e6a6dbd-4794-4437-844f-88a1b06321bd tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:58.202111 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:29:58.202111 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:29:58.205961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e6a6dbd-4794-4437-844f-88a1b06321bd tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:58.206938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e6a6dbd-4794-4437-844f-88a1b06321bd tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:58.207896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e6a6dbd-4794-4437-844f-88a1b06321bd tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:58.209201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e6a6dbd-4794-4437-844f-88a1b06321bd tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:58.210462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e6a6dbd-4794-4437-844f-88a1b06321bd tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:58.210927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e6a6dbd-4794-4437-844f-88a1b06321bd tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:58.245124 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0e6a6dbd-4794-4437-844f-88a1b06321bd tempest-ServicesAdminNegativeV253TestJSON-1874085181 tempest-ServicesAdminNegativeV253TestJSON-1874085181-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.052465 Aug 18 11:29:58.258005 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 608/1206] 10.222.0.73 () {60 vars in 1239 bytes} [Thu Aug 18 11:29:58 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:58.397750 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-c1ef01cd-5330-404b-88a5-582764b91da0 tempest-FlavorsV2NegativeTest-94494002 tempest-FlavorsV2NegativeTest-94494002-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c1ef01cd-5330-404b-88a5-582764b91da0 tempest-FlavorsV2NegativeTest-94494002 tempest-FlavorsV2NegativeTest-94494002-project] Request method failure captured: Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 142 Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iK0KsJMdRtySgTGZmZL6XyjgS11taUSOJNHZxWHl1g_Yd5AKdLHcKxuM4xYwEf4TlLcAQEnTG84XZVzPGdqHoBQ_O4uTnikxNEBzr-pwX0l4uSIp1yReg7CIAN8mAtIMQGJN56_gGij1BGqUYtrNzcMdL_M6q2yXT9iSHK41kchBOo Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: dff2363fb9a84772b938fc207c0024e1 Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-FlavorsV2NegativeTest-94494002 Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:29:58.399861 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:29:58.401241 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/dff2363fb9a84772b938fc207c0024e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/dff2363fb9a84772b938fc207c0024e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_dff2363fb9a84772b938fc207c0024e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/dff2363fb9a84772b938fc207c0024e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:58.401241 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-FlavorsV2NegativeTest-94494002 Aug 18 11:29:58.401241 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: dff2363fb9a84772b938fc207c0024e1 Aug 18 11:29:58.401241 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-94494002 Aug 18 11:29:58.401241 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-FlavorsV2NegativeTest-94494002-project Aug 18 11:29:58.401241 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:29:58.401241 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:29:58.401241 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 503b42007d3f4b26823c13a7c4a08dba Aug 18 11:29:58.401241 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-FlavorsV2NegativeTest-94494002-project Aug 18 11:29:58.401241 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:29:58.401241 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-813625029", "imageRef": "5157b5b1-6c6d-494a-97b8-32129a8b5da5", "flavorRef": "452"}} Aug 18 11:29:58.401241 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: exception: Flavor's memory is too small for requested image. Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-813625029', 'imageRef': '5157b5b1-6c6d-494a-97b8-32129a8b5da5', 'flavorRef': '452'}}} Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:58.402008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:58.403772 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:58.409430 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:58.409430 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:58.409430 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:29:58.409430 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:29:58.409430 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 18 11:29:58.409430 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:29:58.409430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c1ef01cd-5330-404b-88a5-582764b91da0 tempest-FlavorsV2NegativeTest-94494002 tempest-FlavorsV2NegativeTest-94494002-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:58.409430 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c1ef01cd-5330-404b-88a5-582764b91da0 tempest-FlavorsV2NegativeTest-94494002 tempest-FlavorsV2NegativeTest-94494002-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.483305 Aug 18 11:29:58.409430 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 599/1207] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:29:57 2022] POST /compute/v2.1/servers => generated 93 bytes in 485 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:29:58.415169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9d90454-29b2-40cd-828b-963ee46a0790 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:58.415169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c9d90454-29b2-40cd-828b-963ee46a0790 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:58.424756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9d90454-29b2-40cd-828b-963ee46a0790 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:58.425275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9d90454-29b2-40cd-828b-963ee46a0790 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:58.426184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9d90454-29b2-40cd-828b-963ee46a0790 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:58.430698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9d90454-29b2-40cd-828b-963ee46a0790 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:58.433531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9d90454-29b2-40cd-828b-963ee46a0790 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:58.435713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9d90454-29b2-40cd-828b-963ee46a0790 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:58.544509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c99a968e-d21b-40de-a549-ab388b7da910 tempest-ServicesAdminNegativeV253TestJSON-179328484 tempest-ServicesAdminNegativeV253TestJSON-179328484-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:58.547212 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:29:58.547212 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:29:58.549015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c99a968e-d21b-40de-a549-ab388b7da910 tempest-ServicesAdminNegativeV253TestJSON-179328484 tempest-ServicesAdminNegativeV253TestJSON-179328484-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '84de3ad95d9a495ea96c3b1265e16bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6aef66f7b34a9dbbf96a2c75f0eb01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c99a968e-d21b-40de-a549-ab388b7da910 tempest-ServicesAdminNegativeV253TestJSON-179328484 tempest-ServicesAdminNegativeV253TestJSON-179328484-project] Request method failure captured: Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iKz11-iZLjL-72vFlSVxeYqU6KJLfpNWR8NY5Ay-8GqxJnQk-eNTjlTbqbTY3j9ZCGg5wLshcxCyF_h0fGiFJDY7W10Vn43RgWjt6bD4GoSB_PuI1tG0J2t-g04cJQDg1wGmeSa71YD7ceCzqgM3e48nB2mKzLSpTiod6vRD_T2UMs Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: X-Openstack-Nova-Api-Version: 2.53 Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 3b6aef66f7b34a9dbbf96a2c75f0eb01 Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-179328484 Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:29:58.555293 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:29:58.556851 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3b6aef66f7b34a9dbbf96a2c75f0eb01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3b6aef66f7b34a9dbbf96a2c75f0eb01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3b6aef66f7b34a9dbbf96a2c75f0eb01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3b6aef66f7b34a9dbbf96a2c75f0eb01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:29:58.556851 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-179328484 Aug 18 11:29:58.556851 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 3b6aef66f7b34a9dbbf96a2c75f0eb01 Aug 18 11:29:58.556851 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-179328484 Aug 18 11:29:58.556851 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServicesAdminNegativeV253TestJSON-179328484-project Aug 18 11:29:58.556851 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:29:58.556851 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:29:58.556851 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 84de3ad95d9a495ea96c3b1265e16bf4 Aug 18 11:29:58.556851 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-179328484-project Aug 18 11:29:58.556851 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:29:58.556851 n-d-853611-3 devstack@n-api.service[122209]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 18 11:29:58.556851 n-d-853611-3 devstack@n-api.service[122209]: action_args: {} Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 18 11:29:58.557601 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 18 11:29:58.559733 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:29:58.562999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c99a968e-d21b-40de-a549-ab388b7da910 tempest-ServicesAdminNegativeV253TestJSON-179328484 tempest-ServicesAdminNegativeV253TestJSON-179328484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:29:58.562999 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c99a968e-d21b-40de-a549-ab388b7da910 tempest-ServicesAdminNegativeV253TestJSON-179328484 tempest-ServicesAdminNegativeV253TestJSON-179328484-project] 10.222.0.73 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.298248 Aug 18 11:29:58.562999 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 609/1208] 10.222.0.73 () {60 vars in 1178 bytes} [Thu Aug 18 11:29:58 2022] GET /compute/v2.1/os-services => generated 112 bytes in 300 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:29:58.669785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c9d90454-29b2-40cd-828b-963ee46a0790 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:58.682470 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c9d90454-29b2-40cd-828b-963ee46a0790 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1681 microversion: 2.1 time: 0.279368 Aug 18 11:29:58.683909 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 600/1209] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:58 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:58.766618 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-6453e921-8d9a-4751-805a-08605b12ae5c req-6e02e7d6-2876-4497-8f1e-a1085100a03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f688dc84-1bfc-4f87-a2ed-0b196d40e86f", "name": "network-vif-deleted", "tag": "db295dd6-2301-47bd-9a90-1c3544856223"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:29:58.795563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6453e921-8d9a-4751-805a-08605b12ae5c req-6e02e7d6-2876-4497-8f1e-a1085100a03d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:58.802736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6453e921-8d9a-4751-805a-08605b12ae5c req-6e02e7d6-2876-4497-8f1e-a1085100a03d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:58.808937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6453e921-8d9a-4751-805a-08605b12ae5c req-6e02e7d6-2876-4497-8f1e-a1085100a03d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:58.854230 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-6453e921-8d9a-4751-805a-08605b12ae5c req-6e02e7d6-2876-4497-8f1e-a1085100a03d service nova] Creating event network-vif-deleted:db295dd6-2301-47bd-9a90-1c3544856223 for instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f on n-h2-853611-3 Aug 18 11:29:58.863220 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-6453e921-8d9a-4751-805a-08605b12ae5c req-6e02e7d6-2876-4497-8f1e-a1085100a03d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107421 Aug 18 11:29:58.870990 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 610/1210] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:29:58.958077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8f4c3aa-dd54-4b15-b493-8dbc468d5acb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:58.959059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e8f4c3aa-dd54-4b15-b493-8dbc468d5acb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:58.986637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f4c3aa-dd54-4b15-b493-8dbc468d5acb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:58.988439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f4c3aa-dd54-4b15-b493-8dbc468d5acb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:58.989488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f4c3aa-dd54-4b15-b493-8dbc468d5acb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:58.990254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f4c3aa-dd54-4b15-b493-8dbc468d5acb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:58.992675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f4c3aa-dd54-4b15-b493-8dbc468d5acb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:58.994027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f4c3aa-dd54-4b15-b493-8dbc468d5acb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:59.070421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f4c3aa-dd54-4b15-b493-8dbc468d5acb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:59.071368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f4c3aa-dd54-4b15-b493-8dbc468d5acb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:59.072164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f4c3aa-dd54-4b15-b493-8dbc468d5acb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:59.072801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-e8f4c3aa-dd54-4b15-b493-8dbc468d5acb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lazy-loading 'fault' on Instance uuid f688dc84-1bfc-4f87-a2ed-0b196d40e86f {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:29:59.152872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e8f4c3aa-dd54-4b15-b493-8dbc468d5acb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:29:59.163324 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e8f4c3aa-dd54-4b15-b493-8dbc468d5acb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 200 len: 1315 microversion: 2.1 time: 0.211482 Aug 18 11:29:59.177901 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 601/1211] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:58 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:29:59.709557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a5bed5f5-abc7-470b-8224-243493830d43 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:29:59.711149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a5bed5f5-abc7-470b-8224-243493830d43 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:29:59.721369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5bed5f5-abc7-470b-8224-243493830d43 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:59.722172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5bed5f5-abc7-470b-8224-243493830d43 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:59.723525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5bed5f5-abc7-470b-8224-243493830d43 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:29:59.724461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5bed5f5-abc7-470b-8224-243493830d43 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:29:59.725712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5bed5f5-abc7-470b-8224-243493830d43 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:29:59.726376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5bed5f5-abc7-470b-8224-243493830d43 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:00.075853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a5bed5f5-abc7-470b-8224-243493830d43 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:00.094842 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a5bed5f5-abc7-470b-8224-243493830d43 tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1681 microversion: 2.1 time: 0.388095 Aug 18 11:30:00.098883 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 611/1212] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:29:59 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1681 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:00.189890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc3d32e3-eb9e-4940-b7b5-1e9ba31d50af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:00.191420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dc3d32e3-eb9e-4940-b7b5-1e9ba31d50af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:00.205534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc3d32e3-eb9e-4940-b7b5-1e9ba31d50af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:00.207171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc3d32e3-eb9e-4940-b7b5-1e9ba31d50af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:00.208573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc3d32e3-eb9e-4940-b7b5-1e9ba31d50af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:00.209499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc3d32e3-eb9e-4940-b7b5-1e9ba31d50af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:00.214155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc3d32e3-eb9e-4940-b7b5-1e9ba31d50af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:00.218553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc3d32e3-eb9e-4940-b7b5-1e9ba31d50af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:00.266485 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-dc3d32e3-eb9e-4940-b7b5-1e9ba31d50af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] HTTP exception thrown: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc3d32e3-eb9e-4940-b7b5-1e9ba31d50af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Request method failure captured: Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f HTTP/1.1 Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iKSlag_DyTRhHK9TqvjB3uaeJqTd30mOdcDQGSTKfo_1BiKJ_YVW1kKUDWBo3oX_2psn9QztObg-Czr0es9clWo5Gc0LlzQQSxBjjoX14p_m_VrrKtUvAek3sTjzCNUkm1K7bZ4E5tksWhtZBOj5XEF41miqv560I8D9uiLs9cmbSc Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:30:00.273536 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:30:00.275224 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:30:00.275224 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:30:00.275224 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:30:00.275224 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:30:00.275224 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:30:00.275224 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:30:00.275224 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:30:00.275224 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ed6ed454654f4ce0a01d407f18524a52 Aug 18 11:30:00.275224 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:30:00.275224 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:30:00.275224 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:30:00.275224 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'f688dc84-1bfc-4f87-a2ed-0b196d40e86f'} Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:30:00.275999 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:30:00.277275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:30:00.278581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc3d32e3-eb9e-4940-b7b5-1e9ba31d50af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Returning 404 to user: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:30:00.278581 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dc3d32e3-eb9e-4940-b7b5-1e9ba31d50af tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 404 len: 111 microversion: 2.1 time: 0.093357 Aug 18 11:30:00.278581 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 602/1213] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:00 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:30:00.292150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-654a6a32-5a1a-4db4-8949-15aaaa312228 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Action: 'create', calling method: .version_select at 0x7f519f811c10>, body: {"keypair": {"name": "tempest-keypair-1641911376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDStEM2mQwqpoQI7/UeEcsgMWcaDl5CBz6Ndl1/eFOHAseJHG11tDIjHFThNvNc5Gzz88dPMyHfeeXtaANmK0yMgRbLxZros1jVvYw2egMupYPG1u4zCD3y/g5J1ceMI6Q=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:00.328406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-654a6a32-5a1a-4db4-8949-15aaaa312228 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Getting quotas for project 8064d9cbfe6a4a96944cc1d7a1817ed8. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:00.354487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-654a6a32-5a1a-4db4-8949-15aaaa312228 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Getting quotas for user ed6ed454654f4ce0a01d407f18524a52 and project 8064d9cbfe6a4a96944cc1d7a1817ed8. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:00.398147 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-654a6a32-5a1a-4db4-8949-15aaaa312228 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110770 Aug 18 11:30:00.399888 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 612/1214] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:30:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:00.570656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de454391-4ed0-4f57-8fdd-c0907d88fafc tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:00.571393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-de454391-4ed0-4f57-8fdd-c0907d88fafc tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:00.585101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de454391-4ed0-4f57-8fdd-c0907d88fafc tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:00.586060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de454391-4ed0-4f57-8fdd-c0907d88fafc tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:00.588241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de454391-4ed0-4f57-8fdd-c0907d88fafc tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:00.593147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de454391-4ed0-4f57-8fdd-c0907d88fafc tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:00.594121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de454391-4ed0-4f57-8fdd-c0907d88fafc tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:00.595630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de454391-4ed0-4f57-8fdd-c0907d88fafc tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:01.127918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9e1ec322-e219-4947-92e1-4d6a3dd2a3ac tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:01.128552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9e1ec322-e219-4947-92e1-4d6a3dd2a3ac tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:01.149980 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e1ec322-e219-4947-92e1-4d6a3dd2a3ac tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:01.150766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e1ec322-e219-4947-92e1-4d6a3dd2a3ac tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:01.151377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e1ec322-e219-4947-92e1-4d6a3dd2a3ac tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:01.153087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e1ec322-e219-4947-92e1-4d6a3dd2a3ac tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:01.155861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e1ec322-e219-4947-92e1-4d6a3dd2a3ac tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:01.156496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e1ec322-e219-4947-92e1-4d6a3dd2a3ac tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:01.304742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-de454391-4ed0-4f57-8fdd-c0907d88fafc tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 18b9b772-9949-4239-a522-78ea800d8223 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:30:01.327117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9e1ec322-e219-4947-92e1-4d6a3dd2a3ac tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82883babd8814c4283e80c11881a67fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccfa07bf92894fb0918418f997c3c149', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:01.341463 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9e1ec322-e219-4947-92e1-4d6a3dd2a3ac tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 200 len: 1613 microversion: 2.1 time: 0.219993 Aug 18 11:30:01.342017 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de454391-4ed0-4f57-8fdd-c0907d88fafc tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 2343 microversion: 2.25 time: 0.781284 Aug 18 11:30:01.343163 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 613/1215] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:01 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 1613 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:30:01.360870 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 603/1216] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:30:00 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 2343 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:30:01.362835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-a0d922ae-92d9-482b-a9ce-c5e59d64c1d1 req-dd96ad23-a416-4967-8801-c6af6ebcb422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90c1672-67f6-4f31-84b5-695115309d3d", "name": "network-vif-deleted", "tag": "e16903bb-2ff8-4682-86db-5e9d462b751b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:01.381398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f7e0ef60-ce4b-43c6-873a-da21812a741e tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:01.388824 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a0d922ae-92d9-482b-a9ce-c5e59d64c1d1 req-dd96ad23-a416-4967-8801-c6af6ebcb422 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:01.389137 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:30:01.389137 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:30:01.389898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a0d922ae-92d9-482b-a9ce-c5e59d64c1d1 req-dd96ad23-a416-4967-8801-c6af6ebcb422 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:01.390601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a0d922ae-92d9-482b-a9ce-c5e59d64c1d1 req-dd96ad23-a416-4967-8801-c6af6ebcb422 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:01.400321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7e0ef60-ce4b-43c6-873a-da21812a741e tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:01.400321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7e0ef60-ce4b-43c6-873a-da21812a741e tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:01.400321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7e0ef60-ce4b-43c6-873a-da21812a741e tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:01.409949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7e0ef60-ce4b-43c6-873a-da21812a741e tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:01.411910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7e0ef60-ce4b-43c6-873a-da21812a741e tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:01.415048 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-a0d922ae-92d9-482b-a9ce-c5e59d64c1d1 req-dd96ad23-a416-4967-8801-c6af6ebcb422 service nova] Creating event network-vif-deleted:e16903bb-2ff8-4682-86db-5e9d462b751b for instance c90c1672-67f6-4f31-84b5-695115309d3d on n-h1-853611-3 Aug 18 11:30:01.415210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7e0ef60-ce4b-43c6-873a-da21812a741e tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:01.437318 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-a0d922ae-92d9-482b-a9ce-c5e59d64c1d1 req-dd96ad23-a416-4967-8801-c6af6ebcb422 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089393 Aug 18 11:30:01.446848 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 614/1217] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:01.492272 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f7e0ef60-ce4b-43c6-873a-da21812a741e tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.117064 Aug 18 11:30:01.509612 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 604/1218] 10.222.0.73 () {60 vars in 1217 bytes} [Thu Aug 18 11:30:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:30:02.371707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2f08f69-8e0c-48e7-851f-908c7990937e tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:02.372676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a2f08f69-8e0c-48e7-851f-908c7990937e tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:02.390888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2f08f69-8e0c-48e7-851f-908c7990937e tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:02.391393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2f08f69-8e0c-48e7-851f-908c7990937e tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:02.391845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2f08f69-8e0c-48e7-851f-908c7990937e tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:02.392572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2f08f69-8e0c-48e7-851f-908c7990937e tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:02.393033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2f08f69-8e0c-48e7-851f-908c7990937e tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:02.393463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2f08f69-8e0c-48e7-851f-908c7990937e tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:02.426112 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-a2f08f69-8e0c-48e7-851f-908c7990937e tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] HTTP exception thrown: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2f08f69-8e0c-48e7-851f-908c7990937e tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Request method failure captured: Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d HTTP/1.1 Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iIa0fw_l9SjNBE7YUuXjJnrcJS3nDgEDD1F1edPa6gyDQ2ozjoXqKSyLca8ZmPvLKpDuYjm7Cma0aTvGZeHeITyIpDvvfYW_gdE-hlbMBlhfxDDgc-0Le9qi2vpcDvKvvozsNBPWFwbi9ghqr0DC_dCqdnBtI6rk1GtBrMhP4hcDGI Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ccfa07bf92894fb0918418f997c3c149 Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1122046241 Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:30:02.430884 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:30:02.432323 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccfa07bf92894fb0918418f997c3c149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ccfa07bf92894fb0918418f997c3c149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ccfa07bf92894fb0918418f997c3c149"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccfa07bf92894fb0918418f997c3c149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:30:02.432323 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1122046241 Aug 18 11:30:02.432323 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ccfa07bf92894fb0918418f997c3c149 Aug 18 11:30:02.432323 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1122046241 Aug 18 11:30:02.432323 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachSCSIVolumeTestJSON-1122046241-project Aug 18 11:30:02.432323 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:30:02.432323 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:30:02.432323 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 82883babd8814c4283e80c11881a67fd Aug 18 11:30:02.432323 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1122046241-project Aug 18 11:30:02.432323 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:30:02.432323 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:02.432323 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'c90c1672-67f6-4f31-84b5-695115309d3d'} Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:30:02.433137 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:02.434522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:02.435713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2f08f69-8e0c-48e7-851f-908c7990937e tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Returning 404 to user: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:30:02.435911 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a2f08f69-8e0c-48e7-851f-908c7990937e tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 404 len: 111 microversion: 2.1 time: 0.072646 Aug 18 11:30:02.438357 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 615/1219] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:02 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:30:02.449633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f14fbc8-0ab8-45ad-a5c8-e81908c5510e tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '.version_select at 0x7f519fa8ea60>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:02.512306 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6f14fbc8-0ab8-45ad-a5c8-e81908c5510e tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145292547" status: 202 len: 0 microversion: 2.1 time: 0.068438 Aug 18 11:30:02.518554 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 605/1220] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 11:30:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145292547 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:30:04.353808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1396574283", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:04.370858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b41ef8c2-a28c-4987-b7ca-314bed210933 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Calling method '.version_select at 0x7f519f9830d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:04.482515 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b41ef8c2-a28c-4987-b7ca-314bed210933 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "GET /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86" status: 200 len: 637 microversion: 2.1 time: 0.113168 Aug 18 11:30:04.483557 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 606/1221] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:04 2022] GET /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86 => generated 637 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:30:04.492240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] validate_networks() for [('a030fd0a-f8f2-42d5-b02a-6604a919b9da', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:30:04.506141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b974a779-36e5-480a-8463-89a663648abd tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Action: 'update_all', calling method: .version_select at 0x7f519f983e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:04.591172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-b974a779-36e5-480a-8463-89a663648abd tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:04.604370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-b974a779-36e5-480a-8463-89a663648abd tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for user fee254fe5e414a1b9a1d8ecd1cbf28a2 and project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:05.096722 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b974a779-36e5-480a-8463-89a663648abd tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata" status: 200 len: 61 microversion: 2.1 time: 0.602999 Aug 18 11:30:05.106691 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 607/1222] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:30:04 2022] PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata => generated 61 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:30:05.113024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-687a51d4-4107-46fa-bead-e2dbd780a382 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c836bab-089b-4b70-bbc1-5a63e5ca6264", "device": "/dev/xvdb"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:05.117095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-687a51d4-4107-46fa-bead-e2dbd780a382 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:05.123838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-687a51d4-4107-46fa-bead-e2dbd780a382 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:05.124903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-687a51d4-4107-46fa-bead-e2dbd780a382 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:05.125518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-687a51d4-4107-46fa-bead-e2dbd780a382 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:05.126628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-687a51d4-4107-46fa-bead-e2dbd780a382 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:05.127391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-687a51d4-4107-46fa-bead-e2dbd780a382 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:05.127981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-687a51d4-4107-46fa-bead-e2dbd780a382 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:05.132636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:05.530522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:30:05.531095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:30:05.531802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:30:05.532226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:30:05.532687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:30:05.550179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:05.551173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:05.552053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:05.553044 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:05.553705 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:05.554374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:05.580735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Getting quotas for project 8064d9cbfe6a4a96944cc1d7a1817ed8. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:05.587960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Getting quotas for user ed6ed454654f4ce0a01d407f18524a52 and project 8064d9cbfe6a4a96944cc1d7a1817ed8. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:05.616450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:30:05.622356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:30:05.654606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:05.724975 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-faf67daa-cb83-43e4-80dd-bd576571407c tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.379060 Aug 18 11:30:05.731378 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 616/1223] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:30:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:30:05.747821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bb6451a5-380a-45b6-9ae2-8bdca3ba23d7 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Calling method '.version_select at 0x7f519f7def70>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:06.189732 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-687a51d4-4107-46fa-bead-e2dbd780a382 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "POST /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.076906 Aug 18 11:30:06.191427 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 608/1224] 10.222.0.73 () {62 vars in 1364 bytes} [Thu Aug 18 11:30:05 2022] POST /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments => generated 194 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:30:06.215097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-49073b74-4364-42a7-92ba-e035cdbd40c8 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:06.220680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-49073b74-4364-42a7-92ba-e035cdbd40c8 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:06.236224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:06.457954 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bb6451a5-380a-45b6-9ae2-8bdca3ba23d7 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "DELETE /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.724594 Aug 18 11:30:06.459052 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 617/1225] 10.222.0.73 () {58 vars in 1296 bytes} [Thu Aug 18 11:30:05 2022] DELETE /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata/os_version => generated 0 bytes in 727 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:30:06.463895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-49073b74-4364-42a7-92ba-e035cdbd40c8 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:06.473305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-54dc3e7a-aa2f-4140-aa43-a8b6ed9e4d17 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Calling method '.version_select at 0x7f519f7e6a60>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:06.480390 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-49073b74-4364-42a7-92ba-e035cdbd40c8 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1225 microversion: 2.1 time: 0.283401 Aug 18 11:30:06.507814 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 609/1226] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:06 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1225 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:06.584698 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-54dc3e7a-aa2f-4140-aa43-a8b6ed9e4d17 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "GET /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata" status: 200 len: 37 microversion: 2.1 time: 0.119343 Aug 18 11:30:06.590374 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 618/1227] 10.222.0.73 () {58 vars in 1260 bytes} [Thu Aug 18 11:30:06 2022] GET /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata => generated 37 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:30:06.596057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d86f1ba7-157b-4a75-ba09-46dfdaa3a312 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Action: 'update_all', calling method: .version_select at 0x7f519fa8edc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:06.689163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d86f1ba7-157b-4a75-ba09-46dfdaa3a312 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:06.713483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d86f1ba7-157b-4a75-ba09-46dfdaa3a312 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for user fee254fe5e414a1b9a1d8ecd1cbf28a2 and project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:07.240232 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d86f1ba7-157b-4a75-ba09-46dfdaa3a312 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata" status: 200 len: 61 microversion: 2.1 time: 0.648324 Aug 18 11:30:07.241383 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 610/1228] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:30:06 2022] PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata => generated 61 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:30:07.250800 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f0f15052-2dc2-47b2-b5aa-029bbf6fe031 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Calling method '.version_select at 0x7f519f7e6160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:07.520443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99e5315c-eb88-424b-8de7-1004b0b341ec tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:07.521332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-99e5315c-eb88-424b-8de7-1004b0b341ec tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:07.529409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99e5315c-eb88-424b-8de7-1004b0b341ec tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:07.530408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99e5315c-eb88-424b-8de7-1004b0b341ec tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:07.531077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99e5315c-eb88-424b-8de7-1004b0b341ec tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:07.532165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99e5315c-eb88-424b-8de7-1004b0b341ec tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:07.532889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99e5315c-eb88-424b-8de7-1004b0b341ec tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:07.533965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99e5315c-eb88-424b-8de7-1004b0b341ec tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:07.577707 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f0f15052-2dc2-47b2-b5aa-029bbf6fe031 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "GET /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.331034 Aug 18 11:30:07.578817 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 619/1229] 10.222.0.73 () {58 vars in 1290 bytes} [Thu Aug 18 11:30:07 2022] GET /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata/os_distro => generated 33 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:30:07.594026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f3566779-8908-46f3-bc3f-cd76e623d070 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Action: 'update_all', calling method: .version_select at 0x7f519fabfca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:07.795840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f3566779-8908-46f3-bc3f-cd76e623d070 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:07.803923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-99e5315c-eb88-424b-8de7-1004b0b341ec tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:07.818561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f3566779-8908-46f3-bc3f-cd76e623d070 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for user fee254fe5e414a1b9a1d8ecd1cbf28a2 and project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:07.819547 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-99e5315c-eb88-424b-8de7-1004b0b341ec tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1277 microversion: 2.1 time: 0.308574 Aug 18 11:30:07.821724 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 611/1230] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:07 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1277 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:08.134711 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f3566779-8908-46f3-bc3f-cd76e623d070 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata" status: 200 len: 61 microversion: 2.1 time: 0.546218 Aug 18 11:30:08.135952 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 620/1231] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:30:07 2022] PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata => generated 61 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 11:30:08.147362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-15a074bb-fb5d-40f6-86e2-0adac8ab89e5 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Calling method '.version_select at 0x7f519f9aad30>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:08.221730 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-15a074bb-fb5d-40f6-86e2-0adac8ab89e5 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "GET /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata" status: 200 len: 61 microversion: 2.1 time: 0.076803 Aug 18 11:30:08.223252 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 612/1232] 10.222.0.73 () {58 vars in 1260 bytes} [Thu Aug 18 11:30:08 2022] GET /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata => generated 61 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:30:08.235668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b30f2852-5202-42ff-aa80-5367a781bc33 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Action: 'update_all', calling method: .version_select at 0x7f519f7e6160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:08.348356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-b30f2852-5202-42ff-aa80-5367a781bc33 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:08.371325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-b30f2852-5202-42ff-aa80-5367a781bc33 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for user fee254fe5e414a1b9a1d8ecd1cbf28a2 and project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:08.729621 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b30f2852-5202-42ff-aa80-5367a781bc33 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata" status: 200 len: 61 microversion: 2.1 time: 0.498295 Aug 18 11:30:08.730250 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 621/1233] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:30:08 2022] PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata => generated 61 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:30:08.741088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-49260172-af10-489a-9a53-e09376ce5c22 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Action: 'update_all', calling method: .version_select at 0x7f519f9ec790>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:08.849636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-49260172-af10-489a-9a53-e09376ce5c22 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:08.851239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-af836a6c-c2f5-40c9-8383-bead7ea5f0b7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:08.852222 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-af836a6c-c2f5-40c9-8383-bead7ea5f0b7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:08.856454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-49260172-af10-489a-9a53-e09376ce5c22 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for user fee254fe5e414a1b9a1d8ecd1cbf28a2 and project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:08.862302 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af836a6c-c2f5-40c9-8383-bead7ea5f0b7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:08.868126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af836a6c-c2f5-40c9-8383-bead7ea5f0b7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:08.869112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af836a6c-c2f5-40c9-8383-bead7ea5f0b7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:08.869899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af836a6c-c2f5-40c9-8383-bead7ea5f0b7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:08.870384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af836a6c-c2f5-40c9-8383-bead7ea5f0b7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:08.870847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af836a6c-c2f5-40c9-8383-bead7ea5f0b7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:09.112899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-af836a6c-c2f5-40c9-8383-bead7ea5f0b7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:09.125268 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-af836a6c-c2f5-40c9-8383-bead7ea5f0b7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1283 microversion: 2.1 time: 0.278554 Aug 18 11:30:09.125874 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 622/1234] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:08 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1283 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:30:09.611492 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-49260172-af10-489a-9a53-e09376ce5c22 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata" status: 200 len: 64 microversion: 2.1 time: 0.875580 Aug 18 11:30:09.613343 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 613/1235] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:30:08 2022] PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata => generated 64 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:30:09.623191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7dc43af9-e9a4-44ff-9743-100f24c2d2ea tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Calling method '.version_select at 0x7f519f7e1dc0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:09.708089 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7dc43af9-e9a4-44ff-9743-100f24c2d2ea tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "GET /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata" status: 200 len: 64 microversion: 2.1 time: 0.089412 Aug 18 11:30:09.709291 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 623/1236] 10.222.0.73 () {58 vars in 1260 bytes} [Thu Aug 18 11:30:09 2022] GET /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata => generated 64 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:30:09.729212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-33026951-fc54-4a0a-84bc-1625ea521376 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Action: 'update_all', calling method: .version_select at 0x7f519fb2a430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:09.876766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-33026951-fc54-4a0a-84bc-1625ea521376 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:09.896611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-33026951-fc54-4a0a-84bc-1625ea521376 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for user fee254fe5e414a1b9a1d8ecd1cbf28a2 and project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:10.150182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-084733ea-7cf2-479f-b96f-68328cf2a0a8 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:10.151813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-084733ea-7cf2-479f-b96f-68328cf2a0a8 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:10.171735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-084733ea-7cf2-479f-b96f-68328cf2a0a8 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:10.183394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-084733ea-7cf2-479f-b96f-68328cf2a0a8 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:10.189183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-084733ea-7cf2-479f-b96f-68328cf2a0a8 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:10.193164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-084733ea-7cf2-479f-b96f-68328cf2a0a8 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:10.199773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-084733ea-7cf2-479f-b96f-68328cf2a0a8 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:10.201483 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-084733ea-7cf2-479f-b96f-68328cf2a0a8 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:10.630677 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-33026951-fc54-4a0a-84bc-1625ea521376 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata" status: 200 len: 61 microversion: 2.1 time: 0.908484 Aug 18 11:30:10.631092 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 614/1237] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:30:09 2022] PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata => generated 61 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:30:10.640819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7a9b6aa-1352-4ba3-9915-1137a8275c89 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Action: 'update', calling method: .version_select at 0x7f519f9ec1f0>, body: {"meta": {"os_version": "alt"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:10.778830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a7a9b6aa-1352-4ba3-9915-1137a8275c89 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:10.802623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a7a9b6aa-1352-4ba3-9915-1137a8275c89 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for user fee254fe5e414a1b9a1d8ecd1cbf28a2 and project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:11.358457 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a7a9b6aa-1352-4ba3-9915-1137a8275c89 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.721642 Aug 18 11:30:11.359282 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 615/1238] 10.222.0.73 () {60 vars in 1313 bytes} [Thu Aug 18 11:30:10 2022] PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata/os_version => generated 31 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:30:11.369593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-506c9ecd-6a1e-4b02-abcc-76b2fa09f7b4 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Calling method '.version_select at 0x7f519fa39820>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:11.393409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-084733ea-7cf2-479f-b96f-68328cf2a0a8 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:11.402885 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-084733ea-7cf2-479f-b96f-68328cf2a0a8 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1283 microversion: 2.1 time: 1.256788 Aug 18 11:30:11.407180 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 624/1239] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:10 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1283 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:11.435436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=14 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:11.445956 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-506c9ecd-6a1e-4b02-abcc-76b2fa09f7b4 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "GET /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata" status: 200 len: 58 microversion: 2.1 time: 0.080702 Aug 18 11:30:11.449667 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 616/1240] 10.222.0.73 () {58 vars in 1260 bytes} [Thu Aug 18 11:30:11 2022] GET /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata => generated 58 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:30:11.461855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-59419a0a-2f7e-400f-a803-362ba7ed3863 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Action: 'update_all', calling method: .version_select at 0x7f519f811b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:11.552229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-59419a0a-2f7e-400f-a803-362ba7ed3863 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:11.563673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-59419a0a-2f7e-400f-a803-362ba7ed3863 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for user fee254fe5e414a1b9a1d8ecd1cbf28a2 and project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:12.202469 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-59419a0a-2f7e-400f-a803-362ba7ed3863 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata" status: 200 len: 61 microversion: 2.1 time: 0.746372 Aug 18 11:30:12.210182 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 625/1241] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:30:11 2022] PUT /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata => generated 61 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:30:12.216057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0a6747c9-ffa6-4abe-8177-453b5947f607 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Action: 'create', calling method: .version_select at 0x7f519faf6a60>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:12.367795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0a6747c9-ffa6-4abe-8177-453b5947f607 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:12.389799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0a6747c9-ffa6-4abe-8177-453b5947f607 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Getting quotas for user fee254fe5e414a1b9a1d8ecd1cbf28a2 and project 99285e457bd3499da91646a532850bf5. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:12.428391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-54853a9d-1de2-43ff-9ef9-e13717d33e9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:12.429855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-54853a9d-1de2-43ff-9ef9-e13717d33e9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:12.445017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54853a9d-1de2-43ff-9ef9-e13717d33e9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:12.446470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54853a9d-1de2-43ff-9ef9-e13717d33e9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:12.447567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54853a9d-1de2-43ff-9ef9-e13717d33e9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:12.449154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54853a9d-1de2-43ff-9ef9-e13717d33e9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:12.454296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54853a9d-1de2-43ff-9ef9-e13717d33e9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:12.457687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54853a9d-1de2-43ff-9ef9-e13717d33e9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:12.819104 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0a6747c9-ffa6-4abe-8177-453b5947f607 tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "POST /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata" status: 200 len: 85 microversion: 2.1 time: 0.607759 Aug 18 11:30:12.822178 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 617/1242] 10.222.0.73 () {60 vars in 1281 bytes} [Thu Aug 18 11:30:12 2022] POST /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata => generated 85 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 11:30:12.832806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7771dea9-a9b0-4971-b607-a30465f5cbfc tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] Calling method '.version_select at 0x7f519f99d4c0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:12.883236 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7771dea9-a9b0-4971-b607-a30465f5cbfc tempest-ImagesMetadataTestJSON-563976165 tempest-ImagesMetadataTestJSON-563976165-project] 10.222.0.73 "GET /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata" status: 200 len: 85 microversion: 2.1 time: 0.055860 Aug 18 11:30:12.884222 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 618/1243] 10.222.0.73 () {58 vars in 1260 bytes} [Thu Aug 18 11:30:12 2022] GET /compute/v2.1/images/e95d19fb-2b82-49d0-b365-ef961efade86/metadata => generated 85 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:30:13.138594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-54853a9d-1de2-43ff-9ef9-e13717d33e9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:13.147904 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-54853a9d-1de2-43ff-9ef9-e13717d33e9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1325 microversion: 2.1 time: 0.723866 Aug 18 11:30:13.148500 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 626/1244] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:12 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1325 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:30:14.175423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0eaaef50-4524-4a4a-be12-09c95db942e7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:14.177095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0eaaef50-4524-4a4a-be12-09c95db942e7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:14.196398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0eaaef50-4524-4a4a-be12-09c95db942e7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:14.204863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0eaaef50-4524-4a4a-be12-09c95db942e7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:14.209039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0eaaef50-4524-4a4a-be12-09c95db942e7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:14.212785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0eaaef50-4524-4a4a-be12-09c95db942e7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:14.215045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0eaaef50-4524-4a4a-be12-09c95db942e7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:14.219185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0eaaef50-4524-4a4a-be12-09c95db942e7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:15.229484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8cdf5822-2d0c-4765-a72a-82e42eb087fe tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:15.230039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8cdf5822-2d0c-4765-a72a-82e42eb087fe tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:15.252636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8cdf5822-2d0c-4765-a72a-82e42eb087fe tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:15.253229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8cdf5822-2d0c-4765-a72a-82e42eb087fe tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:15.255192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8cdf5822-2d0c-4765-a72a-82e42eb087fe tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:15.255947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8cdf5822-2d0c-4765-a72a-82e42eb087fe tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:15.256414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8cdf5822-2d0c-4765-a72a-82e42eb087fe tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:15.256841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8cdf5822-2d0c-4765-a72a-82e42eb087fe tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:15.306995 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-8cdf5822-2d0c-4765-a72a-82e42eb087fe tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] HTTP exception thrown: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8cdf5822-2d0c-4765-a72a-82e42eb087fe tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Request method failure captured: Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d HTTP/1.1 Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iIa0fw_l9SjNBE7YUuXjJnrcJS3nDgEDD1F1edPa6gyDQ2ozjoXqKSyLca8ZmPvLKpDuYjm7Cma0aTvGZeHeITyIpDvvfYW_gdE-hlbMBlhfxDDgc-0Le9qi2vpcDvKvvozsNBPWFwbi9ghqr0DC_dCqdnBtI6rk1GtBrMhP4hcDGI Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ccfa07bf92894fb0918418f997c3c149 Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1122046241 Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:30:15.322524 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:30:15.324297 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccfa07bf92894fb0918418f997c3c149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ccfa07bf92894fb0918418f997c3c149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ccfa07bf92894fb0918418f997c3c149"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccfa07bf92894fb0918418f997c3c149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:30:15.324297 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1122046241 Aug 18 11:30:15.324297 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ccfa07bf92894fb0918418f997c3c149 Aug 18 11:30:15.324297 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1122046241 Aug 18 11:30:15.324297 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachSCSIVolumeTestJSON-1122046241-project Aug 18 11:30:15.324297 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:30:15.324297 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:30:15.324297 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 82883babd8814c4283e80c11881a67fd Aug 18 11:30:15.324297 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1122046241-project Aug 18 11:30:15.324297 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:30:15.324297 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:15.324297 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'c90c1672-67f6-4f31-84b5-695115309d3d'} Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:30:15.325071 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:15.326402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:15.330184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8cdf5822-2d0c-4765-a72a-82e42eb087fe tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Returning 404 to user: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:30:15.332197 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8cdf5822-2d0c-4765-a72a-82e42eb087fe tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 404 len: 111 microversion: 2.1 time: 0.106486 Aug 18 11:30:15.337023 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 627/1245] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:30:15 2022] DELETE /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:30:15.349611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d2d10e8d-9186-46e1-a73a-e0847aa97e3c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:15.353153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d2d10e8d-9186-46e1-a73a-e0847aa97e3c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] [instance: c90c1672-67f6-4f31-84b5-695115309d3d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:15.361804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0eaaef50-4524-4a4a-be12-09c95db942e7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:15.377012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2d10e8d-9186-46e1-a73a-e0847aa97e3c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:15.377855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2d10e8d-9186-46e1-a73a-e0847aa97e3c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:15.379594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2d10e8d-9186-46e1-a73a-e0847aa97e3c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:15.380558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2d10e8d-9186-46e1-a73a-e0847aa97e3c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:15.384286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2d10e8d-9186-46e1-a73a-e0847aa97e3c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:15.387322 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0eaaef50-4524-4a4a-be12-09c95db942e7 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1325 microversion: 2.1 time: 1.218235 Aug 18 11:30:15.387972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2d10e8d-9186-46e1-a73a-e0847aa97e3c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:15.389546 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 619/1246] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:14 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1325 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:15.438541 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-d2d10e8d-9186-46e1-a73a-e0847aa97e3c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] HTTP exception thrown: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d2d10e8d-9186-46e1-a73a-e0847aa97e3c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Request method failure captured: Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d HTTP/1.1 Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iIa0fw_l9SjNBE7YUuXjJnrcJS3nDgEDD1F1edPa6gyDQ2ozjoXqKSyLca8ZmPvLKpDuYjm7Cma0aTvGZeHeITyIpDvvfYW_gdE-hlbMBlhfxDDgc-0Le9qi2vpcDvKvvozsNBPWFwbi9ghqr0DC_dCqdnBtI6rk1GtBrMhP4hcDGI Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ccfa07bf92894fb0918418f997c3c149 Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1122046241 Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:30:15.446324 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:30:15.447762 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccfa07bf92894fb0918418f997c3c149"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ccfa07bf92894fb0918418f997c3c149"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ccfa07bf92894fb0918418f997c3c149"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ccfa07bf92894fb0918418f997c3c149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:30:15.447762 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1122046241 Aug 18 11:30:15.447762 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ccfa07bf92894fb0918418f997c3c149 Aug 18 11:30:15.447762 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1122046241 Aug 18 11:30:15.447762 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachSCSIVolumeTestJSON-1122046241-project Aug 18 11:30:15.447762 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:30:15.447762 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:30:15.447762 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 82883babd8814c4283e80c11881a67fd Aug 18 11:30:15.447762 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1122046241-project Aug 18 11:30:15.447762 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:30:15.447762 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:15.447762 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'c90c1672-67f6-4f31-84b5-695115309d3d'} Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:30:15.448595 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. Aug 18 11:30:15.449823 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:15.453577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d2d10e8d-9186-46e1-a73a-e0847aa97e3c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] Returning 404 to user: Instance c90c1672-67f6-4f31-84b5-695115309d3d could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:30:15.454766 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d2d10e8d-9186-46e1-a73a-e0847aa97e3c tempest-AttachSCSIVolumeTestJSON-1122046241 tempest-AttachSCSIVolumeTestJSON-1122046241-project] 10.222.0.73 "GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d" status: 404 len: 111 microversion: 2.1 time: 0.113710 Aug 18 11:30:15.457332 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 628/1247] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:15 2022] GET /compute/v2.1/servers/c90c1672-67f6-4f31-84b5-695115309d3d => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:30:15.894536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-0ad8437b-d013-4d90-88ce-46c6ebd145f1 req-bbc82de7-5876-405c-b559-9dbe9cd27075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0a3039-3467-44eb-8976-e8716cace7fa", "tag": "4a7b00ed-6768-45b2-a161-1008ac0d3221"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:15.969540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0ad8437b-d013-4d90-88ce-46c6ebd145f1 req-bbc82de7-5876-405c-b559-9dbe9cd27075 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:15.971360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0ad8437b-d013-4d90-88ce-46c6ebd145f1 req-bbc82de7-5876-405c-b559-9dbe9cd27075 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:15.975422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0ad8437b-d013-4d90-88ce-46c6ebd145f1 req-bbc82de7-5876-405c-b559-9dbe9cd27075 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:16.032075 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-0ad8437b-d013-4d90-88ce-46c6ebd145f1 req-bbc82de7-5876-405c-b559-9dbe9cd27075 service nova] Creating event network-changed:4a7b00ed-6768-45b2-a161-1008ac0d3221 for instance ea0a3039-3467-44eb-8976-e8716cace7fa on n-h1-853611-3 Aug 18 11:30:16.051422 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-0ad8437b-d013-4d90-88ce-46c6ebd145f1 req-bbc82de7-5876-405c-b559-9dbe9cd27075 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159683 Aug 18 11:30:16.057157 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 620/1248] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:16.413313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-35eda9cb-fe1c-4ec7-87e6-d3e9fd1759b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:16.414683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-35eda9cb-fe1c-4ec7-87e6-d3e9fd1759b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:16.435931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=16 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:16.441957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35eda9cb-fe1c-4ec7-87e6-d3e9fd1759b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:16.445098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35eda9cb-fe1c-4ec7-87e6-d3e9fd1759b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:16.448494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35eda9cb-fe1c-4ec7-87e6-d3e9fd1759b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:16.452035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35eda9cb-fe1c-4ec7-87e6-d3e9fd1759b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:16.456210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35eda9cb-fe1c-4ec7-87e6-d3e9fd1759b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:16.462721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35eda9cb-fe1c-4ec7-87e6-d3e9fd1759b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:17.371863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-35eda9cb-fe1c-4ec7-87e6-d3e9fd1759b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:17.386509 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-35eda9cb-fe1c-4ec7-87e6-d3e9fd1759b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1325 microversion: 2.1 time: 0.974082 Aug 18 11:30:17.398825 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 629/1249] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:16 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1325 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:18.419686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99ab0f9b-3cc3-4fc4-a9d8-19cc1c35e07e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:18.420643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-99ab0f9b-3cc3-4fc4-a9d8-19cc1c35e07e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:18.452635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99ab0f9b-3cc3-4fc4-a9d8-19cc1c35e07e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:18.453139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99ab0f9b-3cc3-4fc4-a9d8-19cc1c35e07e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:18.459804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99ab0f9b-3cc3-4fc4-a9d8-19cc1c35e07e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:18.460572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99ab0f9b-3cc3-4fc4-a9d8-19cc1c35e07e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:18.463505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99ab0f9b-3cc3-4fc4-a9d8-19cc1c35e07e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:18.465277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99ab0f9b-3cc3-4fc4-a9d8-19cc1c35e07e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:19.142771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-99ab0f9b-3cc3-4fc4-a9d8-19cc1c35e07e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:19.161223 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-99ab0f9b-3cc3-4fc4-a9d8-19cc1c35e07e tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1325 microversion: 2.1 time: 0.749935 Aug 18 11:30:19.164351 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 621/1250] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:18 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1325 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:20.227072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-67363e72-e2b9-46a1-91fd-f54055d85255 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:20.229053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-67363e72-e2b9-46a1-91fd-f54055d85255 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:20.282478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67363e72-e2b9-46a1-91fd-f54055d85255 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:20.283039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67363e72-e2b9-46a1-91fd-f54055d85255 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:20.283496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67363e72-e2b9-46a1-91fd-f54055d85255 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:20.284511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67363e72-e2b9-46a1-91fd-f54055d85255 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:20.284993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67363e72-e2b9-46a1-91fd-f54055d85255 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:20.285443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67363e72-e2b9-46a1-91fd-f54055d85255 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:21.052677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-67363e72-e2b9-46a1-91fd-f54055d85255 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:21.072979 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-67363e72-e2b9-46a1-91fd-f54055d85255 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1325 microversion: 2.1 time: 0.889282 Aug 18 11:30:21.075934 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 630/1251] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:20 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1325 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:22.107432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-78b2e175-0111-4355-8679-7d3ba80c61ae tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:22.107432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-78b2e175-0111-4355-8679-7d3ba80c61ae tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:22.120714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78b2e175-0111-4355-8679-7d3ba80c61ae tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:22.123831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78b2e175-0111-4355-8679-7d3ba80c61ae tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:22.126291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78b2e175-0111-4355-8679-7d3ba80c61ae tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:22.130511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78b2e175-0111-4355-8679-7d3ba80c61ae tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:22.131081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78b2e175-0111-4355-8679-7d3ba80c61ae tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:22.131819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78b2e175-0111-4355-8679-7d3ba80c61ae tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:22.401673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=26 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:23.349655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-78b2e175-0111-4355-8679-7d3ba80c61ae tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:23.364090 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-78b2e175-0111-4355-8679-7d3ba80c61ae tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1325 microversion: 2.1 time: 1.267480 Aug 18 11:30:23.366489 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 622/1252] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:22 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1325 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:24.036432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-875943754", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "757d6883-a6db-41ef-8704-3eeee6fff853"}], "security_groups": [{"name": "tempest-securitygroup--2011841414"}], "key_name": "tempest-keypair-676045141", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "25c59599-2356-4e03-b4d7-dfe66669e984", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:24.076610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=22 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:24.389486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c721fb84-5b02-456d-8f59-05cf5b6fc72a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:24.390126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c721fb84-5b02-456d-8f59-05cf5b6fc72a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:24.401691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c721fb84-5b02-456d-8f59-05cf5b6fc72a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:24.402183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c721fb84-5b02-456d-8f59-05cf5b6fc72a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:24.402668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c721fb84-5b02-456d-8f59-05cf5b6fc72a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:24.403406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c721fb84-5b02-456d-8f59-05cf5b6fc72a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:24.403869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c721fb84-5b02-456d-8f59-05cf5b6fc72a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:24.404296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c721fb84-5b02-456d-8f59-05cf5b6fc72a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:24.756156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] validate_networks() for [('757d6883-a6db-41ef-8704-3eeee6fff853', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:30:25.211494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c721fb84-5b02-456d-8f59-05cf5b6fc72a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:25.223611 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c721fb84-5b02-456d-8f59-05cf5b6fc72a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1325 microversion: 2.1 time: 0.837943 Aug 18 11:30:25.238718 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 623/1253] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:24 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1325 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:30:25.557844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1310673003", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "9087955c-aa00-44c0-84c8-58368fdadbd5"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:25.667201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] validate_networks() for [('9087955c-aa00-44c0-84c8-58368fdadbd5', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:30:25.952697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Getting quotas for project 9e395c10cbfd4c12ad0f5c0018620c9e. Resources: dict_keys(['metadata_items']) {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:25.981556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Getting quotas for user a6e9baff3c0f442586f217e007138a39 and project 9e395c10cbfd4c12ad0f5c0018620c9e. Resources: dict_keys(['metadata_items']) {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:26.059969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:30:26.062385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:30:26.064956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:30:26.066636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:30:26.068245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:30:26.132955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:26.135909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:26.136593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:26.137886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:26.139996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:26.145560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:26.208759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Getting quotas for project 9e395c10cbfd4c12ad0f5c0018620c9e. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:26.229581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Getting quotas for user a6e9baff3c0f442586f217e007138a39 and project 9e395c10cbfd4c12ad0f5c0018620c9e. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:26.396082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:30:26.401436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25c59599-2356-4e03-b4d7-dfe66669e984',volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:30:26.688086 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b9f9fc0d-53eb-4f7b-83ba-c0233ae866e2 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.648927 Aug 18 11:30:26.695381 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 631/1254] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:30:24 2022] POST /compute/v2.1/servers => generated 407 bytes in 2665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:30:26.701136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-25a6327c-ddc2-40cd-88ec-0f46722e0444 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:26.702293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-25a6327c-ddc2-40cd-88ec-0f46722e0444 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:26.731378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25a6327c-ddc2-40cd-88ec-0f46722e0444 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:26.732129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25a6327c-ddc2-40cd-88ec-0f46722e0444 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:26.732740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25a6327c-ddc2-40cd-88ec-0f46722e0444 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:26.733660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25a6327c-ddc2-40cd-88ec-0f46722e0444 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:26.734275 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25a6327c-ddc2-40cd-88ec-0f46722e0444 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:26.734887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25a6327c-ddc2-40cd-88ec-0f46722e0444 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:27.222698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-25a6327c-ddc2-40cd-88ec-0f46722e0444 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:27.240009 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-25a6327c-ddc2-40cd-88ec-0f46722e0444 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1325 microversion: 2.1 time: 0.538322 Aug 18 11:30:27.243040 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 632/1255] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:26 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1325 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:27.262863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8eb51a63-de88-469a-825c-0eb4a545f2f6 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:27.265035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8eb51a63-de88-469a-825c-0eb4a545f2f6 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:27.539455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8eb51a63-de88-469a-825c-0eb4a545f2f6 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:27.576761 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8eb51a63-de88-469a-825c-0eb4a545f2f6 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1120 microversion: 2.1 time: 0.319687 Aug 18 11:30:27.579363 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 633/1256] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:27 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1120 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:27.603076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-94caaae5-3672-4de1-8133-e7b14fe9a1a5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:27.604394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-94caaae5-3672-4de1-8133-e7b14fe9a1a5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:27.617879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94caaae5-3672-4de1-8133-e7b14fe9a1a5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:27.618993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94caaae5-3672-4de1-8133-e7b14fe9a1a5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:27.633932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94caaae5-3672-4de1-8133-e7b14fe9a1a5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:27.636614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94caaae5-3672-4de1-8133-e7b14fe9a1a5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:27.637937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94caaae5-3672-4de1-8133-e7b14fe9a1a5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:27.640989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94caaae5-3672-4de1-8133-e7b14fe9a1a5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:27.994077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:30:27.994632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:30:27.995097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:30:27.997369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:30:27.997869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:30:28.016966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:28.018513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:28.025192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:28.027612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:28.035696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:28.036531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:28.094822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Getting quotas for project 287b7017444e47b48aa08661b84a3798. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:28.107991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Getting quotas for user 678c78e8696f45c1a9d099199fcdcd36 and project 287b7017444e47b48aa08661b84a3798. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:28.148834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:30:28.152104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:30:28.269645 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-57a9e2a3-12c7-4aaa-82c1-953395ddf554 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.026479 Aug 18 11:30:28.281252 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 624/1257] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:30:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:30:28.292778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e2c1f16d-dc87-44d9-af2b-b22d73635c9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:28.295079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e2c1f16d-dc87-44d9-af2b-b22d73635c9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:28.309334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2c1f16d-dc87-44d9-af2b-b22d73635c9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:28.310868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2c1f16d-dc87-44d9-af2b-b22d73635c9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:28.312076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2c1f16d-dc87-44d9-af2b-b22d73635c9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:28.313600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2c1f16d-dc87-44d9-af2b-b22d73635c9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:28.314817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2c1f16d-dc87-44d9-af2b-b22d73635c9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:28.315914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2c1f16d-dc87-44d9-af2b-b22d73635c9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:28.852614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=75 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:28.864979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-94caaae5-3672-4de1-8133-e7b14fe9a1a5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 18b9b772-9949-4239-a522-78ea800d8223 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:30:28.901912 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-94caaae5-3672-4de1-8133-e7b14fe9a1a5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 2421 microversion: 2.25 time: 1.303429 Aug 18 11:30:28.902546 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 634/1258] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:30:27 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 2421 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:30:28.927660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-15b61478-d989-401d-8d3e-bbe5b78d6d01 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:28.928300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-15b61478-d989-401d-8d3e-bbe5b78d6d01 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:29.130135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e2c1f16d-dc87-44d9-af2b-b22d73635c9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:29.141440 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e2c1f16d-dc87-44d9-af2b-b22d73635c9b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1325 microversion: 2.1 time: 0.856736 Aug 18 11:30:29.143737 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 625/1259] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:28 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1325 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:29.150352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0d717a48-ddd2-46ef-99d2-543db87b8029 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:29.156135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0d717a48-ddd2-46ef-99d2-543db87b8029 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:29.167112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d717a48-ddd2-46ef-99d2-543db87b8029 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:29.167859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d717a48-ddd2-46ef-99d2-543db87b8029 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:29.170802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d717a48-ddd2-46ef-99d2-543db87b8029 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:29.171835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d717a48-ddd2-46ef-99d2-543db87b8029 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:29.172328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d717a48-ddd2-46ef-99d2-543db87b8029 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:29.172773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d717a48-ddd2-46ef-99d2-543db87b8029 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:29.335829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-15b61478-d989-401d-8d3e-bbe5b78d6d01 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:29.396034 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-15b61478-d989-401d-8d3e-bbe5b78d6d01 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 200 len: 1208 microversion: 2.1 time: 0.476175 Aug 18 11:30:29.418604 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 635/1260] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:28 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 1208 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:29.437498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-007317f0-7972-4da8-9c79-eb0bb03ebf94 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:29.438142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-007317f0-7972-4da8-9c79-eb0bb03ebf94 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:29.472661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-007317f0-7972-4da8-9c79-eb0bb03ebf94 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:29.473438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-007317f0-7972-4da8-9c79-eb0bb03ebf94 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:29.474710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-007317f0-7972-4da8-9c79-eb0bb03ebf94 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:29.477034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-007317f0-7972-4da8-9c79-eb0bb03ebf94 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:29.477712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-007317f0-7972-4da8-9c79-eb0bb03ebf94 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:29.480445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-007317f0-7972-4da8-9c79-eb0bb03ebf94 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:29.670353 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0d717a48-ddd2-46ef-99d2-543db87b8029 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1810 microversion: 2.1 time: 0.520283 Aug 18 11:30:29.671702 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 626/1261] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:29 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1810 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:29.693351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bff3340b-80a1-4b53-ba36-d2b8a5cf8023 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-853611-3", "block_migration": "auto"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:29.713728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bff3340b-80a1-4b53-ba36-d2b8a5cf8023 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:29.766771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bff3340b-80a1-4b53-ba36-d2b8a5cf8023 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:29.771818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bff3340b-80a1-4b53-ba36-d2b8a5cf8023 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:29.774895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bff3340b-80a1-4b53-ba36-d2b8a5cf8023 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:29.781435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bff3340b-80a1-4b53-ba36-d2b8a5cf8023 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:29.791325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bff3340b-80a1-4b53-ba36-d2b8a5cf8023 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:29.793062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bff3340b-80a1-4b53-ba36-d2b8a5cf8023 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:29.887783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-bff3340b-80a1-4b53-ba36-d2b8a5cf8023 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'flavor' on Instance uuid 18b9b772-9949-4239-a522-78ea800d8223 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:30:29.924057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bff3340b-80a1-4b53-ba36-d2b8a5cf8023 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Going to try to live migrate instance to n-h2-853611-3 {{(pid=122210) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 18 11:30:29.941665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-007317f0-7972-4da8-9c79-eb0bb03ebf94 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:29.953177 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-007317f0-7972-4da8-9c79-eb0bb03ebf94 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1226 microversion: 2.1 time: 0.533175 Aug 18 11:30:29.953776 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 636/1262] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:29 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1226 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:29.998990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-358a12f9-53be-42c6-b2ee-ae536ba6cb36 req-dbcaf60c-536d-448e-802b-4d8d60f8cfca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0a3039-3467-44eb-8976-e8716cace7fa", "name": "network-vif-plugged", "status": "completed", "tag": "4a7b00ed-6768-45b2-a161-1008ac0d3221"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:30.031669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-358a12f9-53be-42c6-b2ee-ae536ba6cb36 req-dbcaf60c-536d-448e-802b-4d8d60f8cfca service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:30.033937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-358a12f9-53be-42c6-b2ee-ae536ba6cb36 req-dbcaf60c-536d-448e-802b-4d8d60f8cfca service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:30.039845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-358a12f9-53be-42c6-b2ee-ae536ba6cb36 req-dbcaf60c-536d-448e-802b-4d8d60f8cfca service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:30.080309 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-358a12f9-53be-42c6-b2ee-ae536ba6cb36 req-dbcaf60c-536d-448e-802b-4d8d60f8cfca service nova] Creating event network-vif-plugged:4a7b00ed-6768-45b2-a161-1008ac0d3221 for instance ea0a3039-3467-44eb-8976-e8716cace7fa on n-h1-853611-3 Aug 18 11:30:30.115715 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-358a12f9-53be-42c6-b2ee-ae536ba6cb36 req-dbcaf60c-536d-448e-802b-4d8d60f8cfca service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160514 Aug 18 11:30:30.149519 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 637/1263] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:30.177103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-15e05d06-61b6-401e-96f5-791013d4dcea tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:30.189605 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:30:30.189605 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:30:30.195393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-15e05d06-61b6-401e-96f5-791013d4dcea tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:30.198116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-15e05d06-61b6-401e-96f5-791013d4dcea tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:30.198841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-15e05d06-61b6-401e-96f5-791013d4dcea tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:30.202187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-15e05d06-61b6-401e-96f5-791013d4dcea tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:30.207808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-15e05d06-61b6-401e-96f5-791013d4dcea tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:30.208719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-15e05d06-61b6-401e-96f5-791013d4dcea tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:30.306851 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-15e05d06-61b6-401e-96f5-791013d4dcea tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.154057 Aug 18 11:30:30.315515 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 638/1264] 10.222.0.73 () {58 vars in 1176 bytes} [Thu Aug 18 11:30:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:30.338385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e2a5707f-7081-4f4f-b753-16e28431ea80 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:30.347157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e2a5707f-7081-4f4f-b753-16e28431ea80 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:30.372934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2a5707f-7081-4f4f-b753-16e28431ea80 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:30.373427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2a5707f-7081-4f4f-b753-16e28431ea80 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:30.384203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2a5707f-7081-4f4f-b753-16e28431ea80 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:30.397156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2a5707f-7081-4f4f-b753-16e28431ea80 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:30.402188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2a5707f-7081-4f4f-b753-16e28431ea80 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:30.407518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2a5707f-7081-4f4f-b753-16e28431ea80 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:31.891181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e2a5707f-7081-4f4f-b753-16e28431ea80 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:31.903107 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e2a5707f-7081-4f4f-b753-16e28431ea80 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1325 microversion: 2.1 time: 1.586225 Aug 18 11:30:31.903710 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 639/1265] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:30 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1325 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:31.937260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-37bb8e57-cb33-4bd8-bd52-75b856da908f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:31.940892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-37bb8e57-cb33-4bd8-bd52-75b856da908f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:31.959199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37bb8e57-cb33-4bd8-bd52-75b856da908f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:31.977776 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37bb8e57-cb33-4bd8-bd52-75b856da908f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:31.978734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37bb8e57-cb33-4bd8-bd52-75b856da908f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:31.982357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37bb8e57-cb33-4bd8-bd52-75b856da908f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:31.989790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37bb8e57-cb33-4bd8-bd52-75b856da908f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:31.990792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37bb8e57-cb33-4bd8-bd52-75b856da908f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:32.634924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-37bb8e57-cb33-4bd8-bd52-75b856da908f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:32.654463 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-37bb8e57-cb33-4bd8-bd52-75b856da908f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 200 len: 1266 microversion: 2.1 time: 0.737041 Aug 18 11:30:32.657351 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 640/1266] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:31 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 1266 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:32.678812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a9cd6dca-f21f-4950-b5cf-f0c73e4bef74 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:32.685463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a9cd6dca-f21f-4950-b5cf-f0c73e4bef74 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:32.730296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9cd6dca-f21f-4950-b5cf-f0c73e4bef74 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:32.737889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9cd6dca-f21f-4950-b5cf-f0c73e4bef74 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:32.739344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9cd6dca-f21f-4950-b5cf-f0c73e4bef74 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:32.764085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9cd6dca-f21f-4950-b5cf-f0c73e4bef74 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:32.764929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9cd6dca-f21f-4950-b5cf-f0c73e4bef74 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:32.765618 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9cd6dca-f21f-4950-b5cf-f0c73e4bef74 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:33.465138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a9cd6dca-f21f-4950-b5cf-f0c73e4bef74 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:33.491819 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a9cd6dca-f21f-4950-b5cf-f0c73e4bef74 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1236 microversion: 2.1 time: 0.831833 Aug 18 11:30:33.492878 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 641/1267] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:32 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1236 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:33.510213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e9222a03-3f4c-48c9-9a4e-8e17fc6dff79 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:33.511327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e9222a03-3f4c-48c9-9a4e-8e17fc6dff79 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:33.521126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9222a03-3f4c-48c9-9a4e-8e17fc6dff79 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:33.523129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9222a03-3f4c-48c9-9a4e-8e17fc6dff79 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:33.526626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9222a03-3f4c-48c9-9a4e-8e17fc6dff79 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:33.527769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9222a03-3f4c-48c9-9a4e-8e17fc6dff79 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:33.528486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9222a03-3f4c-48c9-9a4e-8e17fc6dff79 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:33.529163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9222a03-3f4c-48c9-9a4e-8e17fc6dff79 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:34.728321 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bff3340b-80a1-4b53-ba36-d2b8a5cf8023 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/action" status: 202 len: 0 microversion: 2.25 time: 5.051704 Aug 18 11:30:34.732840 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 627/1268] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 18 11:30:29 2022] POST /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/action => generated 0 bytes in 5058 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:30:34.772184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a948faee-4ad8-495d-9164-465ce3f63aa1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:34.782380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a948faee-4ad8-495d-9164-465ce3f63aa1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:34.817265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a948faee-4ad8-495d-9164-465ce3f63aa1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:34.819561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a948faee-4ad8-495d-9164-465ce3f63aa1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:34.823164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a948faee-4ad8-495d-9164-465ce3f63aa1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:34.824188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a948faee-4ad8-495d-9164-465ce3f63aa1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:34.830219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a948faee-4ad8-495d-9164-465ce3f63aa1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:34.831179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a948faee-4ad8-495d-9164-465ce3f63aa1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:35.144320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a948faee-4ad8-495d-9164-465ce3f63aa1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:35.157068 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a948faee-4ad8-495d-9164-465ce3f63aa1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 200 len: 1266 microversion: 2.1 time: 0.422655 Aug 18 11:30:35.161458 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 628/1269] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:34 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 1266 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:35.171706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e9222a03-3f4c-48c9-9a4e-8e17fc6dff79 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:35.179003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8641abc5-1f10-48b9-86be-624c1c02a9ff tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:35.184913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8641abc5-1f10-48b9-86be-624c1c02a9ff tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:35.209672 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e9222a03-3f4c-48c9-9a4e-8e17fc6dff79 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1521 microversion: 2.1 time: 1.715187 Aug 18 11:30:35.213386 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 642/1270] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:33 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1521 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:35.217776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8641abc5-1f10-48b9-86be-624c1c02a9ff tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:35.223287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8641abc5-1f10-48b9-86be-624c1c02a9ff tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:35.225589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8641abc5-1f10-48b9-86be-624c1c02a9ff tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:35.226565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8641abc5-1f10-48b9-86be-624c1c02a9ff tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:35.230412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8641abc5-1f10-48b9-86be-624c1c02a9ff tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:35.231263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8641abc5-1f10-48b9-86be-624c1c02a9ff tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:35.234107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a9a60c5e-081d-436c-ba32-0ca5828a970a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:35.235041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a9a60c5e-081d-436c-ba32-0ca5828a970a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:35.264542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9a60c5e-081d-436c-ba32-0ca5828a970a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:35.268933 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9a60c5e-081d-436c-ba32-0ca5828a970a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:35.269664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9a60c5e-081d-436c-ba32-0ca5828a970a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:35.270640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9a60c5e-081d-436c-ba32-0ca5828a970a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:35.272220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9a60c5e-081d-436c-ba32-0ca5828a970a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:35.276032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9a60c5e-081d-436c-ba32-0ca5828a970a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:35.322320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:35.996959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a9a60c5e-081d-436c-ba32-0ca5828a970a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:36.009259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a9a60c5e-081d-436c-ba32-0ca5828a970a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:36.015353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a9a60c5e-081d-436c-ba32-0ca5828a970a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:36.019941 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a9a60c5e-081d-436c-ba32-0ca5828a970a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.803861 Aug 18 11:30:36.023177 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 643/1271] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:30:35 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:30:36.038187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-99807599-fa82-4654-bf0b-e9826dea982a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3c7a701-d080-43f6-8ed0-cd083a13b56a", "device": "/dev/xvdb"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:36.042808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-99807599-fa82-4654-bf0b-e9826dea982a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:36.056227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=92 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:36.059658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-99807599-fa82-4654-bf0b-e9826dea982a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:36.061917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-99807599-fa82-4654-bf0b-e9826dea982a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:36.065355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-99807599-fa82-4654-bf0b-e9826dea982a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:36.071370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-99807599-fa82-4654-bf0b-e9826dea982a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:36.072105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-99807599-fa82-4654-bf0b-e9826dea982a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:36.075286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-99807599-fa82-4654-bf0b-e9826dea982a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:36.141078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8641abc5-1f10-48b9-86be-624c1c02a9ff tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:36.160329 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8641abc5-1f10-48b9-86be-624c1c02a9ff tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1304 microversion: 2.1 time: 0.997210 Aug 18 11:30:36.177218 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 629/1272] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:35 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1304 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:36.195619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-abf6a853-a7e0-404a-bae8-80db5eee7fe3 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:36.210638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-abf6a853-a7e0-404a-bae8-80db5eee7fe3 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:36.231782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abf6a853-a7e0-404a-bae8-80db5eee7fe3 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:36.233023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abf6a853-a7e0-404a-bae8-80db5eee7fe3 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:36.233486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abf6a853-a7e0-404a-bae8-80db5eee7fe3 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:36.236860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abf6a853-a7e0-404a-bae8-80db5eee7fe3 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:36.237482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abf6a853-a7e0-404a-bae8-80db5eee7fe3 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:36.238890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abf6a853-a7e0-404a-bae8-80db5eee7fe3 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:36.821851 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-99807599-fa82-4654-bf0b-e9826dea982a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "POST /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796932 Aug 18 11:30:36.828837 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 644/1273] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:30:36 2022] POST /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments => generated 194 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:36.867266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f32a12d4-882a-4905-a7fd-5d0e028ff4c1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:36.869087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f32a12d4-882a-4905-a7fd-5d0e028ff4c1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:36.885242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f32a12d4-882a-4905-a7fd-5d0e028ff4c1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:36.889472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f32a12d4-882a-4905-a7fd-5d0e028ff4c1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:36.889939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f32a12d4-882a-4905-a7fd-5d0e028ff4c1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:36.891071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f32a12d4-882a-4905-a7fd-5d0e028ff4c1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:36.893962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f32a12d4-882a-4905-a7fd-5d0e028ff4c1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:36.894904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f32a12d4-882a-4905-a7fd-5d0e028ff4c1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:37.310127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-abf6a853-a7e0-404a-bae8-80db5eee7fe3 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:37.322628 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-abf6a853-a7e0-404a-bae8-80db5eee7fe3 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1521 microversion: 2.1 time: 1.139811 Aug 18 11:30:37.323248 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 630/1274] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:36 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1521 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:37.333042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3c7f26c1-98f9-4635-bc70-0bb7e762b4cf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:37.341416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3c7f26c1-98f9-4635-bc70-0bb7e762b4cf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:37.346202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:37.363099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c7f26c1-98f9-4635-bc70-0bb7e762b4cf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:37.364007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c7f26c1-98f9-4635-bc70-0bb7e762b4cf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:37.364707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c7f26c1-98f9-4635-bc70-0bb7e762b4cf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:37.365693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c7f26c1-98f9-4635-bc70-0bb7e762b4cf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:37.366394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c7f26c1-98f9-4635-bc70-0bb7e762b4cf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:37.367240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c7f26c1-98f9-4635-bc70-0bb7e762b4cf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:38.057520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:38.130085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:39.321737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f32a12d4-882a-4905-a7fd-5d0e028ff4c1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:39.337621 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f32a12d4-882a-4905-a7fd-5d0e028ff4c1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 200 len: 1308 microversion: 2.1 time: 2.505994 Aug 18 11:30:39.341033 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 645/1275] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:36 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 1308 bytes in 2511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:39.378220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2d6ed32f-2fbf-45fb-b6c2-2bad70111d21 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:39.381527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2d6ed32f-2fbf-45fb-b6c2-2bad70111d21 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:39.409683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=14 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:39.412860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d6ed32f-2fbf-45fb-b6c2-2bad70111d21 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:39.413681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d6ed32f-2fbf-45fb-b6c2-2bad70111d21 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:39.414573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d6ed32f-2fbf-45fb-b6c2-2bad70111d21 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:39.415619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d6ed32f-2fbf-45fb-b6c2-2bad70111d21 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:39.416415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d6ed32f-2fbf-45fb-b6c2-2bad70111d21 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:39.417125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d6ed32f-2fbf-45fb-b6c2-2bad70111d21 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:39.484532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3c7f26c1-98f9-4635-bc70-0bb7e762b4cf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:39.499277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3c7f26c1-98f9-4635-bc70-0bb7e762b4cf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:39.506754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3c7f26c1-98f9-4635-bc70-0bb7e762b4cf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:39.512353 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3c7f26c1-98f9-4635-bc70-0bb7e762b4cf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 2.186105 Aug 18 11:30:39.517842 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 631/1276] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:30:37 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 2192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:30:39.531547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55a58ae0-2fed-4e4f-b9b3-a1cf23ab88b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1467972473"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:39.537886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-55a58ae0-2fed-4e4f-b9b3-a1cf23ab88b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:39.581404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55a58ae0-2fed-4e4f-b9b3-a1cf23ab88b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:39.586021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55a58ae0-2fed-4e4f-b9b3-a1cf23ab88b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:39.591038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55a58ae0-2fed-4e4f-b9b3-a1cf23ab88b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:39.593881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55a58ae0-2fed-4e4f-b9b3-a1cf23ab88b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:39.594971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55a58ae0-2fed-4e4f-b9b3-a1cf23ab88b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:39.596901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55a58ae0-2fed-4e4f-b9b3-a1cf23ab88b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:40.134116 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-55a58ae0-2fed-4e4f-b9b3-a1cf23ab88b4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "POST /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa/action" status: 202 len: 0 microversion: 2.1 time: 0.614547 Aug 18 11:30:40.139552 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 632/1277] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:30:39 2022] POST /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa/action => generated 0 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 18 11:30:40.155344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2633d2c4-40ef-4cc7-8798-0fa60b69f9f6 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '.version_select at 0x7f519f9aa820>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:40.232296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:40.431158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2d6ed32f-2fbf-45fb-b6c2-2bad70111d21 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:40.452918 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2d6ed32f-2fbf-45fb-b6c2-2bad70111d21 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1304 microversion: 2.1 time: 1.092829 Aug 18 11:30:40.455491 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 646/1278] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:39 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1304 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:40.488005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-315bc67d-5add-44c1-a51a-0cccbc9f2f46 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:40.489786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-315bc67d-5add-44c1-a51a-0cccbc9f2f46 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:40.526916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-315bc67d-5add-44c1-a51a-0cccbc9f2f46 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:40.531652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-315bc67d-5add-44c1-a51a-0cccbc9f2f46 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:40.536469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-315bc67d-5add-44c1-a51a-0cccbc9f2f46 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:40.545450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-315bc67d-5add-44c1-a51a-0cccbc9f2f46 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:40.548272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-315bc67d-5add-44c1-a51a-0cccbc9f2f46 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:40.549365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-315bc67d-5add-44c1-a51a-0cccbc9f2f46 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:40.729163 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2633d2c4-40ef-4cc7-8798-0fa60b69f9f6 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "DELETE /compute/v2.1/images/d3e00b59-d624-42be-8998-fed8f28a94ba" status: 204 len: 0 microversion: 2.1 time: 0.582383 Aug 18 11:30:40.729745 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 633/1279] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:40 2022] DELETE /compute/v2.1/images/d3e00b59-d624-42be-8998-fed8f28a94ba => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:30:40.737226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8db62b30-da69-47f4-a7cb-76f6df06ac80 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:40.738365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8db62b30-da69-47f4-a7cb-76f6df06ac80 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:40.765488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db62b30-da69-47f4-a7cb-76f6df06ac80 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:40.782838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db62b30-da69-47f4-a7cb-76f6df06ac80 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:40.785591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db62b30-da69-47f4-a7cb-76f6df06ac80 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:40.786954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db62b30-da69-47f4-a7cb-76f6df06ac80 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:40.790539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db62b30-da69-47f4-a7cb-76f6df06ac80 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:40.791353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db62b30-da69-47f4-a7cb-76f6df06ac80 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:41.836950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-315bc67d-5add-44c1-a51a-0cccbc9f2f46 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:41.857124 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-315bc67d-5add-44c1-a51a-0cccbc9f2f46 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 200 len: 1308 microversion: 2.1 time: 1.393724 Aug 18 11:30:41.860141 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 647/1280] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:40 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 1308 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:42.071354 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-df473947-9292-442b-ab68-d15ee754cf7f req-5da91c5b-552d-400d-9180-5a0d6d690966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ebb25c-67fd-4720-aaa6-7f85e22a97b3", "tag": "0026f65d-53f0-4762-89f1-046f21b2ca8b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:42.091523 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-df473947-9292-442b-ab68-d15ee754cf7f req-5da91c5b-552d-400d-9180-5a0d6d690966 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:42.092551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-df473947-9292-442b-ab68-d15ee754cf7f req-5da91c5b-552d-400d-9180-5a0d6d690966 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:42.093159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-df473947-9292-442b-ab68-d15ee754cf7f req-5da91c5b-552d-400d-9180-5a0d6d690966 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:42.115677 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-df473947-9292-442b-ab68-d15ee754cf7f req-5da91c5b-552d-400d-9180-5a0d6d690966 service nova] Creating event network-changed:0026f65d-53f0-4762-89f1-046f21b2ca8b for instance a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 on n-h2-853611-3 Aug 18 11:30:42.127390 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-df473947-9292-442b-ab68-d15ee754cf7f req-5da91c5b-552d-400d-9180-5a0d6d690966 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265199 Aug 18 11:30:42.128446 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 648/1281] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:42.137906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-29961032-2db1-4247-ab59-f42d9eb257e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '.version_select at 0x7f519f712f70>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:42.171835 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-29961032-2db1-4247-ab59-f42d9eb257e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] HTTP exception thrown: Image not found. Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-29961032-2db1-4247-ab59-f42d9eb257e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Request method failure captured: Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/images/d3e00b59-d624-42be-8998-fed8f28a94ba HTTP/1.1 Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iKSlag_DyTRhHK9TqvjB3uaeJqTd30mOdcDQGSTKfo_1BiKJ_YVW1kKUDWBo3oX_2psn9QztObg-Czr0es9clWo5Gc0LlzQQSxBjjoX14p_m_VrrKtUvAek3sTjzCNUkm1K7bZ4E5tksWhtZBOj5XEF41miqv560I8D9uiLs9cmbSc Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:30:42.245763 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:30:42.247402 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:30:42.247402 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:30:42.247402 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:30:42.247402 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:30:42.247402 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:30:42.247402 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:30:42.247402 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:30:42.247402 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ed6ed454654f4ce0a01d407f18524a52 Aug 18 11:30:42.247402 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:30:42.247402 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:30:42.247402 n-d-853611-3 devstack@n-api.service[122209]: exception: Image not found. Aug 18 11:30:42.247402 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'd3e00b59-d624-42be-8998-fed8f28a94ba'} Aug 18 11:30:42.247402 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:30:42.248269 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d3e00b59-d624-42be-8998-fed8f28a94ba Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:30:42.249470 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d3e00b59-d624-42be-8998-fed8f28a94ba could not be found. Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:30:42.254125 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:30:42.257333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:42.264226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-29961032-2db1-4247-ab59-f42d9eb257e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Returning 404 to user: Image not found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:30:42.265410 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-29961032-2db1-4247-ab59-f42d9eb257e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/images/d3e00b59-d624-42be-8998-fed8f28a94ba" status: 404 len: 62 microversion: 2.1 time: 0.133987 Aug 18 11:30:42.272326 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 649/1282] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:30:42 2022] GET /compute/v2.1/images/d3e00b59-d624-42be-8998-fed8f28a94ba => generated 62 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:30:42.280879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cff784ff-4cc7-4d66-b85b-25fad55aafed tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:42.289537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cff784ff-4cc7-4d66-b85b-25fad55aafed tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:42.289833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8db62b30-da69-47f4-a7cb-76f6df06ac80 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:42.305939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8db62b30-da69-47f4-a7cb-76f6df06ac80 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:42.309955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cff784ff-4cc7-4d66-b85b-25fad55aafed tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:42.310851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cff784ff-4cc7-4d66-b85b-25fad55aafed tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:42.311526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cff784ff-4cc7-4d66-b85b-25fad55aafed tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:42.313995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cff784ff-4cc7-4d66-b85b-25fad55aafed tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:42.314777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cff784ff-4cc7-4d66-b85b-25fad55aafed tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:42.315567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cff784ff-4cc7-4d66-b85b-25fad55aafed tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:42.315763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8db62b30-da69-47f4-a7cb-76f6df06ac80 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:42.327087 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8db62b30-da69-47f4-a7cb-76f6df06ac80 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 1.590270 Aug 18 11:30:42.330305 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 634/1283] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:30:40 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:30:42.340022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4349a4dd-7a67-4750-95b9-41ba503eb4e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:42.348106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4349a4dd-7a67-4750-95b9-41ba503eb4e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:42.377804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4349a4dd-7a67-4750-95b9-41ba503eb4e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:42.380896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4349a4dd-7a67-4750-95b9-41ba503eb4e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:42.386283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4349a4dd-7a67-4750-95b9-41ba503eb4e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:42.387096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4349a4dd-7a67-4750-95b9-41ba503eb4e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:42.387632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4349a4dd-7a67-4750-95b9-41ba503eb4e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:42.391870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4349a4dd-7a67-4750-95b9-41ba503eb4e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:43.179459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cff784ff-4cc7-4d66-b85b-25fad55aafed tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:43.199390 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cff784ff-4cc7-4d66-b85b-25fad55aafed tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1304 microversion: 2.1 time: 0.923843 Aug 18 11:30:43.201472 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 650/1284] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:42 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1304 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:43.224877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c09ed901-9f12-4d91-8a08-97f912738382 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:43.226236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c09ed901-9f12-4d91-8a08-97f912738382 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:43.238302 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c09ed901-9f12-4d91-8a08-97f912738382 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:43.255306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c09ed901-9f12-4d91-8a08-97f912738382 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:43.256140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c09ed901-9f12-4d91-8a08-97f912738382 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:43.257106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c09ed901-9f12-4d91-8a08-97f912738382 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:43.257568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c09ed901-9f12-4d91-8a08-97f912738382 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:43.258006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c09ed901-9f12-4d91-8a08-97f912738382 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:43.748282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4349a4dd-7a67-4750-95b9-41ba503eb4e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:43.765098 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4349a4dd-7a67-4750-95b9-41ba503eb4e4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1539 microversion: 2.1 time: 1.433171 Aug 18 11:30:43.767779 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 635/1285] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:42 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1539 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:43.777711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-813151ec-ae0c-49cc-888b-c968312d7453 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:43.778804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-813151ec-ae0c-49cc-888b-c968312d7453 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:43.794351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-813151ec-ae0c-49cc-888b-c968312d7453 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:43.798919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-813151ec-ae0c-49cc-888b-c968312d7453 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:43.799486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-813151ec-ae0c-49cc-888b-c968312d7453 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:43.800276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-813151ec-ae0c-49cc-888b-c968312d7453 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:43.800753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-813151ec-ae0c-49cc-888b-c968312d7453 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:43.801187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-813151ec-ae0c-49cc-888b-c968312d7453 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:44.335521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-813151ec-ae0c-49cc-888b-c968312d7453 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:44.350348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-813151ec-ae0c-49cc-888b-c968312d7453 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:44.352856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-813151ec-ae0c-49cc-888b-c968312d7453 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:44.354173 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-813151ec-ae0c-49cc-888b-c968312d7453 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.585192 Aug 18 11:30:44.363035 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 636/1286] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:30:43 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:30:44.368235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5f27888c-a4af-456e-bc7e-027daaa9cdc9 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:44.369223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5f27888c-a4af-456e-bc7e-027daaa9cdc9 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:44.393462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f27888c-a4af-456e-bc7e-027daaa9cdc9 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:44.399480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f27888c-a4af-456e-bc7e-027daaa9cdc9 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:44.400006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f27888c-a4af-456e-bc7e-027daaa9cdc9 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:44.417370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f27888c-a4af-456e-bc7e-027daaa9cdc9 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:44.418734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f27888c-a4af-456e-bc7e-027daaa9cdc9 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:44.419425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f27888c-a4af-456e-bc7e-027daaa9cdc9 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:44.674938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c09ed901-9f12-4d91-8a08-97f912738382 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:44.702573 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c09ed901-9f12-4d91-8a08-97f912738382 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 200 len: 1308 microversion: 2.1 time: 1.495014 Aug 18 11:30:44.723565 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 651/1287] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:43 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 1308 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:44.726459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-f779b521-5176-4df4-9ff2-18a3a4c2e898 req-e92649d0-8aea-470f-89b0-a57dcff6f2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb46c1c-c94c-4ea9-942e-82187eb83479", "tag": "b659ed49-6503-43dd-9a80-64c66fbb2313"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:44.767209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f779b521-5176-4df4-9ff2-18a3a4c2e898 req-e92649d0-8aea-470f-89b0-a57dcff6f2c3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:44.768035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f779b521-5176-4df4-9ff2-18a3a4c2e898 req-e92649d0-8aea-470f-89b0-a57dcff6f2c3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:44.768646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f779b521-5176-4df4-9ff2-18a3a4c2e898 req-e92649d0-8aea-470f-89b0-a57dcff6f2c3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:44.789805 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-f779b521-5176-4df4-9ff2-18a3a4c2e898 req-e92649d0-8aea-470f-89b0-a57dcff6f2c3 service nova] Creating event network-changed:b659ed49-6503-43dd-9a80-64c66fbb2313 for instance dbb46c1c-c94c-4ea9-942e-82187eb83479 on n-h2-853611-3 Aug 18 11:30:44.796685 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-f779b521-5176-4df4-9ff2-18a3a4c2e898 req-e92649d0-8aea-470f-89b0-a57dcff6f2c3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079451 Aug 18 11:30:44.798354 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 652/1288] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:44.805398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5c818a73-d769-40cb-b740-99701e74d361 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:44.806958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5c818a73-d769-40cb-b740-99701e74d361 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:44.816131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c818a73-d769-40cb-b740-99701e74d361 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:44.819238 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c818a73-d769-40cb-b740-99701e74d361 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:44.819895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c818a73-d769-40cb-b740-99701e74d361 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:44.820874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c818a73-d769-40cb-b740-99701e74d361 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:44.821768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c818a73-d769-40cb-b740-99701e74d361 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:44.822513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c818a73-d769-40cb-b740-99701e74d361 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:45.066184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5c818a73-d769-40cb-b740-99701e74d361 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:45.081779 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5c818a73-d769-40cb-b740-99701e74d361 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1521 microversion: 2.1 time: 0.276659 Aug 18 11:30:45.083379 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 653/1289] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:44 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:45.105726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4428c997-3018-4890-bd42-97fd3e956c5b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:45.106236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4428c997-3018-4890-bd42-97fd3e956c5b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:45.124836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4428c997-3018-4890-bd42-97fd3e956c5b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:45.128427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4428c997-3018-4890-bd42-97fd3e956c5b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:45.129994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4428c997-3018-4890-bd42-97fd3e956c5b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:45.134073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4428c997-3018-4890-bd42-97fd3e956c5b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:45.134829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4428c997-3018-4890-bd42-97fd3e956c5b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:45.135469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4428c997-3018-4890-bd42-97fd3e956c5b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:45.173666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:45.236922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4428c997-3018-4890-bd42-97fd3e956c5b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:30:45.407672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5f27888c-a4af-456e-bc7e-027daaa9cdc9 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:45.438624 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5f27888c-a4af-456e-bc7e-027daaa9cdc9 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1304 microversion: 2.1 time: 1.073125 Aug 18 11:30:45.440191 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 637/1290] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:44 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1304 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:45.464091 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4428c997-3018-4890-bd42-97fd3e956c5b tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 204 len: 0 microversion: 2.1 time: 0.363106 Aug 18 11:30:45.469269 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 654/1291] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:30:45 2022] DELETE /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:30:45.483224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dfbb5231-20b9-4519-bb35-80f156530fde tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:45.487703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dfbb5231-20b9-4519-bb35-80f156530fde tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:45.506744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d9e60991-f4c7-4eae-86d8-951438cddb1d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:45.508557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d9e60991-f4c7-4eae-86d8-951438cddb1d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:45.518627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfbb5231-20b9-4519-bb35-80f156530fde tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:45.522811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfbb5231-20b9-4519-bb35-80f156530fde tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:45.524697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfbb5231-20b9-4519-bb35-80f156530fde tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:45.526310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfbb5231-20b9-4519-bb35-80f156530fde tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:45.529544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfbb5231-20b9-4519-bb35-80f156530fde tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:45.532444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfbb5231-20b9-4519-bb35-80f156530fde tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:45.533986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d9e60991-f4c7-4eae-86d8-951438cddb1d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:45.534993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d9e60991-f4c7-4eae-86d8-951438cddb1d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:45.543154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d9e60991-f4c7-4eae-86d8-951438cddb1d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:45.544514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d9e60991-f4c7-4eae-86d8-951438cddb1d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:45.545405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d9e60991-f4c7-4eae-86d8-951438cddb1d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:45.546275 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d9e60991-f4c7-4eae-86d8-951438cddb1d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:46.347738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dfbb5231-20b9-4519-bb35-80f156530fde tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:46.368599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dfbb5231-20b9-4519-bb35-80f156530fde tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:46.372705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dfbb5231-20b9-4519-bb35-80f156530fde tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:46.377248 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dfbb5231-20b9-4519-bb35-80f156530fde tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.933097 Aug 18 11:30:46.380337 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 638/1292] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:30:45 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:30:46.407854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34cc5153-cbb6-4afd-9b0c-21dc705c0ca8 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:46.410964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-34cc5153-cbb6-4afd-9b0c-21dc705c0ca8 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:46.444538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cc5153-cbb6-4afd-9b0c-21dc705c0ca8 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:46.448090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cc5153-cbb6-4afd-9b0c-21dc705c0ca8 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:46.451939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cc5153-cbb6-4afd-9b0c-21dc705c0ca8 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:46.454632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cc5153-cbb6-4afd-9b0c-21dc705c0ca8 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:46.471181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d9e60991-f4c7-4eae-86d8-951438cddb1d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:46.476773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cc5153-cbb6-4afd-9b0c-21dc705c0ca8 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:46.481722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cc5153-cbb6-4afd-9b0c-21dc705c0ca8 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:46.491197 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d9e60991-f4c7-4eae-86d8-951438cddb1d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1527 microversion: 2.1 time: 1.006579 Aug 18 11:30:46.492591 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 655/1293] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:45 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1527 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:30:46.497591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8880707f-0853-405e-ab1c-cb7b3cbdea3f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:46.502075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8880707f-0853-405e-ab1c-cb7b3cbdea3f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:46.544713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8880707f-0853-405e-ab1c-cb7b3cbdea3f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:46.545422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8880707f-0853-405e-ab1c-cb7b3cbdea3f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:46.546050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8880707f-0853-405e-ab1c-cb7b3cbdea3f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:46.549326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8880707f-0853-405e-ab1c-cb7b3cbdea3f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:46.550226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8880707f-0853-405e-ab1c-cb7b3cbdea3f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:46.550893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8880707f-0853-405e-ab1c-cb7b3cbdea3f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:46.868889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-34cc5153-cbb6-4afd-9b0c-21dc705c0ca8 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:46.878123 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34cc5153-cbb6-4afd-9b0c-21dc705c0ca8 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 200 len: 1308 microversion: 2.1 time: 0.494633 Aug 18 11:30:46.883121 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 639/1294] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:46 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 1308 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:47.064330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-834199f2-99e5-4a1f-a04d-29de8d1be6cc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'create', calling method: .version_select at 0x7f519f90ac10>, body: {"keypair": {"name": "tempest-keypair-1643977109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW/XOpjUK9RVlABbuZj/OZk9+2uZr3qt2J8MjiR8iRBUBSsssTPY08zDUjcIQm5YruOkOyTqQ/eTjxykjDvnH/uZUfo0tNSQcjix+DRUOjxUErerPh6mMt75Xky7Vul5w=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:47.122371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-834199f2-99e5-4a1f-a04d-29de8d1be6cc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Getting quotas for project c1a985dc6f824e5b847a2d966c0f79af. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:47.130458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-834199f2-99e5-4a1f-a04d-29de8d1be6cc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Getting quotas for user 0cd8451c50d941409a66864cbc1c7201 and project c1a985dc6f824e5b847a2d966c0f79af. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:47.182002 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-834199f2-99e5-4a1f-a04d-29de8d1be6cc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.297330 Aug 18 11:30:47.183057 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 640/1295] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:30:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:47.404849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6aa128a7-b810-4bd9-9bed-9e5f76d8d3a5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:47.405685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6aa128a7-b810-4bd9-9bed-9e5f76d8d3a5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:47.431312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6aa128a7-b810-4bd9-9bed-9e5f76d8d3a5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:47.432566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6aa128a7-b810-4bd9-9bed-9e5f76d8d3a5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:47.433199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6aa128a7-b810-4bd9-9bed-9e5f76d8d3a5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:47.434127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6aa128a7-b810-4bd9-9bed-9e5f76d8d3a5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:47.434791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6aa128a7-b810-4bd9-9bed-9e5f76d8d3a5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:47.435427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6aa128a7-b810-4bd9-9bed-9e5f76d8d3a5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:47.859124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8880707f-0853-405e-ab1c-cb7b3cbdea3f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:47.880733 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8880707f-0853-405e-ab1c-cb7b3cbdea3f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1304 microversion: 2.1 time: 1.386806 Aug 18 11:30:47.903199 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 656/1296] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:46 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1304 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:47.921008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a9d5773-f24d-4b6a-9a88-35036e95abaa tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:47.921645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0a9d5773-f24d-4b6a-9a88-35036e95abaa tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:47.947796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a9d5773-f24d-4b6a-9a88-35036e95abaa tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:47.952557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a9d5773-f24d-4b6a-9a88-35036e95abaa tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:47.955228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a9d5773-f24d-4b6a-9a88-35036e95abaa tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:47.961045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a9d5773-f24d-4b6a-9a88-35036e95abaa tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:47.961807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a9d5773-f24d-4b6a-9a88-35036e95abaa tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:47.963432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a9d5773-f24d-4b6a-9a88-35036e95abaa tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:48.111430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6aa128a7-b810-4bd9-9bed-9e5f76d8d3a5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:48.127849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6aa128a7-b810-4bd9-9bed-9e5f76d8d3a5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:48.129407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6aa128a7-b810-4bd9-9bed-9e5f76d8d3a5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:48.135793 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6aa128a7-b810-4bd9-9bed-9e5f76d8d3a5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.730709 Aug 18 11:30:48.157147 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 641/1297] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:30:47 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:30:48.373002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-627c733d-34dc-4ab1-9fbd-31b929f2bb5e tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Action: 'create', calling method: .version_select at 0x7f519f90aa60>, body: {"keypair": {"name": "tempest-keypair-1904316241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3Zw3xrvC36IQ6UdLb9TuAKmnE2eza0uY5mty+waq93HxmtcsZMHMoKA8z0X4G4I5doeak13aZvktrnWevcRKVSGBQALJP9knb+7uIoFmUz+7ZIXHY4XEJ1l/i44QXb3g=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:48.418377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-627c733d-34dc-4ab1-9fbd-31b929f2bb5e tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Getting quotas for project 6439cb52de454891b535bd23f11e88b1. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:48.443656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-627c733d-34dc-4ab1-9fbd-31b929f2bb5e tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Getting quotas for user d5312f9922c246a9a594be35a4a598ac and project 6439cb52de454891b535bd23f11e88b1. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:48.500695 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-627c733d-34dc-4ab1-9fbd-31b929f2bb5e tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.335339 Aug 18 11:30:48.501705 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 642/1298] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:30:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:48.548141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-32dd6c6e-36ec-4e11-b69a-a6ea0d331c7e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:48.552257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-32dd6c6e-36ec-4e11-b69a-a6ea0d331c7e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:48.581194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32dd6c6e-36ec-4e11-b69a-a6ea0d331c7e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:48.581770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32dd6c6e-36ec-4e11-b69a-a6ea0d331c7e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:48.584560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32dd6c6e-36ec-4e11-b69a-a6ea0d331c7e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:48.588228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32dd6c6e-36ec-4e11-b69a-a6ea0d331c7e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:48.593198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32dd6c6e-36ec-4e11-b69a-a6ea0d331c7e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:48.595567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32dd6c6e-36ec-4e11-b69a-a6ea0d331c7e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:48.700144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0a9d5773-f24d-4b6a-9a88-35036e95abaa tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:48.717417 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0a9d5773-f24d-4b6a-9a88-35036e95abaa tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1527 microversion: 2.1 time: 0.812966 Aug 18 11:30:48.728630 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 657/1299] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:47 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1527 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:48.910690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1566d6fe-328f-4478-a54b-97e990ac0adb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:48.912164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1566d6fe-328f-4478-a54b-97e990ac0adb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:48.928552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1566d6fe-328f-4478-a54b-97e990ac0adb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:48.929450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1566d6fe-328f-4478-a54b-97e990ac0adb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:48.930170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1566d6fe-328f-4478-a54b-97e990ac0adb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:48.931250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1566d6fe-328f-4478-a54b-97e990ac0adb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:48.931966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1566d6fe-328f-4478-a54b-97e990ac0adb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:48.932620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1566d6fe-328f-4478-a54b-97e990ac0adb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:49.346284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1566d6fe-328f-4478-a54b-97e990ac0adb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:49.365511 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1566d6fe-328f-4478-a54b-97e990ac0adb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1304 microversion: 2.1 time: 0.459188 Aug 18 11:30:49.382790 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 658/1300] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:48 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1304 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:49.402454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5177f357-cb16-4819-b66d-f2e18fc4dc77 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:49.410220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5177f357-cb16-4819-b66d-f2e18fc4dc77 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:49.429386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5177f357-cb16-4819-b66d-f2e18fc4dc77 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:49.433475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5177f357-cb16-4819-b66d-f2e18fc4dc77 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:49.434361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5177f357-cb16-4819-b66d-f2e18fc4dc77 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:49.439820 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5177f357-cb16-4819-b66d-f2e18fc4dc77 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:49.440577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5177f357-cb16-4819-b66d-f2e18fc4dc77 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:49.441314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5177f357-cb16-4819-b66d-f2e18fc4dc77 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:49.892916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5177f357-cb16-4819-b66d-f2e18fc4dc77 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:49.916726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5177f357-cb16-4819-b66d-f2e18fc4dc77 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:49.920319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5177f357-cb16-4819-b66d-f2e18fc4dc77 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:49.924153 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5177f357-cb16-4819-b66d-f2e18fc4dc77 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.538179 Aug 18 11:30:49.926221 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 659/1301] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:30:49 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:30:49.942372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-13739052-b37b-4271-bbea-7799cd3d0337 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:49.947512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-13739052-b37b-4271-bbea-7799cd3d0337 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:49.973617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13739052-b37b-4271-bbea-7799cd3d0337 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:49.974614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13739052-b37b-4271-bbea-7799cd3d0337 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:49.975275 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13739052-b37b-4271-bbea-7799cd3d0337 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:49.978189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13739052-b37b-4271-bbea-7799cd3d0337 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:49.979356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13739052-b37b-4271-bbea-7799cd3d0337 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:49.980169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-32dd6c6e-36ec-4e11-b69a-a6ea0d331c7e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:49.981962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13739052-b37b-4271-bbea-7799cd3d0337 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:49.989797 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-32dd6c6e-36ec-4e11-b69a-a6ea0d331c7e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 200 len: 1308 microversion: 2.1 time: 1.466553 Aug 18 11:30:49.995389 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 643/1302] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:48 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 1308 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:50.183633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c93441ba-cc65-4dbd-a0a9-378b7d368e4b req-4d8c4e03-18ca-404f-87b0-d1b40c957bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0a3039-3467-44eb-8976-e8716cace7fa", "name": "network-vif-deleted", "tag": "4a7b00ed-6768-45b2-a161-1008ac0d3221"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:50.206036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c93441ba-cc65-4dbd-a0a9-378b7d368e4b req-4d8c4e03-18ca-404f-87b0-d1b40c957bab service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:50.212692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c93441ba-cc65-4dbd-a0a9-378b7d368e4b req-4d8c4e03-18ca-404f-87b0-d1b40c957bab service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:50.215288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c93441ba-cc65-4dbd-a0a9-378b7d368e4b req-4d8c4e03-18ca-404f-87b0-d1b40c957bab service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:50.250899 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c93441ba-cc65-4dbd-a0a9-378b7d368e4b req-4d8c4e03-18ca-404f-87b0-d1b40c957bab service nova] Creating event network-vif-deleted:4a7b00ed-6768-45b2-a161-1008ac0d3221 for instance ea0a3039-3467-44eb-8976-e8716cace7fa on n-h1-853611-3 Aug 18 11:30:50.277679 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c93441ba-cc65-4dbd-a0a9-378b7d368e4b req-4d8c4e03-18ca-404f-87b0-d1b40c957bab service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280588 Aug 18 11:30:50.284109 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 644/1303] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:50.387236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-13739052-b37b-4271-bbea-7799cd3d0337 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:50.398761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-327c71de-dec5-4716-a616-2ffe3f980384 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:50.399750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-327c71de-dec5-4716-a616-2ffe3f980384 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:50.408419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-327c71de-dec5-4716-a616-2ffe3f980384 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:50.413933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-327c71de-dec5-4716-a616-2ffe3f980384 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:50.415105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-327c71de-dec5-4716-a616-2ffe3f980384 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:50.423817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-327c71de-dec5-4716-a616-2ffe3f980384 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:50.424666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-327c71de-dec5-4716-a616-2ffe3f980384 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:50.425532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-327c71de-dec5-4716-a616-2ffe3f980384 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:50.427222 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-13739052-b37b-4271-bbea-7799cd3d0337 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 200 len: 1310 microversion: 2.1 time: 0.498142 Aug 18 11:30:50.427873 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 660/1304] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:49 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 1310 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:50.949335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-83d1f50f-4136-4f83-b848-fdddf4775cf4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:50.954698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-83d1f50f-4136-4f83-b848-fdddf4775cf4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:50.966470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83d1f50f-4136-4f83-b848-fdddf4775cf4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:50.970155 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83d1f50f-4136-4f83-b848-fdddf4775cf4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:50.971725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83d1f50f-4136-4f83-b848-fdddf4775cf4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:50.981073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83d1f50f-4136-4f83-b848-fdddf4775cf4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:50.982199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83d1f50f-4136-4f83-b848-fdddf4775cf4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:50.983054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83d1f50f-4136-4f83-b848-fdddf4775cf4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:51.341708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-327c71de-dec5-4716-a616-2ffe3f980384 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:51.357667 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-327c71de-dec5-4716-a616-2ffe3f980384 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1292 microversion: 2.1 time: 0.963568 Aug 18 11:30:51.359598 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 645/1305] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:50 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1292 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:30:51.370321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cb0e5730-a64a-4188-aaef-2f5ddbe5ee18 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:51.373224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cb0e5730-a64a-4188-aaef-2f5ddbe5ee18 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:51.390052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb0e5730-a64a-4188-aaef-2f5ddbe5ee18 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:51.391109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb0e5730-a64a-4188-aaef-2f5ddbe5ee18 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:51.393024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb0e5730-a64a-4188-aaef-2f5ddbe5ee18 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:51.393815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb0e5730-a64a-4188-aaef-2f5ddbe5ee18 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:51.395691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb0e5730-a64a-4188-aaef-2f5ddbe5ee18 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:51.398903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb0e5730-a64a-4188-aaef-2f5ddbe5ee18 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:51.414140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-83d1f50f-4136-4f83-b848-fdddf4775cf4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:51.430555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-83d1f50f-4136-4f83-b848-fdddf4775cf4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:51.433003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-83d1f50f-4136-4f83-b848-fdddf4775cf4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:51.441455 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-83d1f50f-4136-4f83-b848-fdddf4775cf4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.493258 Aug 18 11:30:51.444986 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 661/1306] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:30:50 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:30:51.461007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9103b85f-c28f-4c0a-be37-52b1e38e31c5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:51.461965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9103b85f-c28f-4c0a-be37-52b1e38e31c5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:51.481224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9103b85f-c28f-4c0a-be37-52b1e38e31c5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:51.482070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9103b85f-c28f-4c0a-be37-52b1e38e31c5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:51.483865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9103b85f-c28f-4c0a-be37-52b1e38e31c5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:51.486472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9103b85f-c28f-4c0a-be37-52b1e38e31c5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:51.488829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9103b85f-c28f-4c0a-be37-52b1e38e31c5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:51.490208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9103b85f-c28f-4c0a-be37-52b1e38e31c5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:51.530597 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-9103b85f-c28f-4c0a-be37-52b1e38e31c5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] HTTP exception thrown: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9103b85f-c28f-4c0a-be37-52b1e38e31c5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Request method failure captured: Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa HTTP/1.1 Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iKSlag_DyTRhHK9TqvjB3uaeJqTd30mOdcDQGSTKfo_1BiKJ_YVW1kKUDWBo3oX_2psn9QztObg-Czr0es9clWo5Gc0LlzQQSxBjjoX14p_m_VrrKtUvAek3sTjzCNUkm1K7bZ4E5tksWhtZBOj5XEF41miqv560I8D9uiLs9cmbSc Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:30:51.536791 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:30:51.539011 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:30:51.539011 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:30:51.539011 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:30:51.539011 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:30:51.539011 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:30:51.539011 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:30:51.539011 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:30:51.539011 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ed6ed454654f4ce0a01d407f18524a52 Aug 18 11:30:51.539011 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:30:51.539011 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:30:51.539011 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:30:51.539011 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'ea0a3039-3467-44eb-8976-e8716cace7fa'} Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:30:51.539948 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:30:51.541423 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:30:51.543918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9103b85f-c28f-4c0a-be37-52b1e38e31c5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Returning 404 to user: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:30:51.544989 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9103b85f-c28f-4c0a-be37-52b1e38e31c5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 404 len: 111 microversion: 2.1 time: 0.098805 Aug 18 11:30:51.545737 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 662/1307] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:51 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:30:51.673240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-425275779", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:51.841734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] validate_networks() for [('a030fd0a-f8f2-42d5-b02a-6604a919b9da', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:30:52.164046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cb0e5730-a64a-4188-aaef-2f5ddbe5ee18 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:52.233695 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cb0e5730-a64a-4188-aaef-2f5ddbe5ee18 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 200 len: 1308 microversion: 2.1 time: 0.863669 Aug 18 11:30:52.235425 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 646/1308] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:51 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 1308 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:52.381392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55b15ec8-7b6f-4a98-ba00-3cae5bad2c1b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:52.383632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-55b15ec8-7b6f-4a98-ba00-3cae5bad2c1b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:52.397293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b15ec8-7b6f-4a98-ba00-3cae5bad2c1b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:52.400135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b15ec8-7b6f-4a98-ba00-3cae5bad2c1b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:52.402099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b15ec8-7b6f-4a98-ba00-3cae5bad2c1b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:52.404801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b15ec8-7b6f-4a98-ba00-3cae5bad2c1b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:52.405490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b15ec8-7b6f-4a98-ba00-3cae5bad2c1b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:52.407507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b15ec8-7b6f-4a98-ba00-3cae5bad2c1b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:53.137908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:30:53.138506 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:30:53.143395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:30:53.143830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:30:53.144266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:30:53.162179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:53.162805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:53.165991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:53.166903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:53.173522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:53.174097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:53.205536 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Getting quotas for project 8064d9cbfe6a4a96944cc1d7a1817ed8. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:53.217945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Getting quotas for user ed6ed454654f4ce0a01d407f18524a52 and project 8064d9cbfe6a4a96944cc1d7a1817ed8. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:53.253207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:30:53.255794 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:30:53.352324 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f330d012-568a-4c26-9939-75a5cbc6c125 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.685944 Aug 18 11:30:53.354910 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 663/1309] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:30:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:30:53.360015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-660a7639-282f-4f6b-ac7a-31ad87dd9043 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:53.365582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-660a7639-282f-4f6b-ac7a-31ad87dd9043 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:53.379417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-660a7639-282f-4f6b-ac7a-31ad87dd9043 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:53.380211 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-660a7639-282f-4f6b-ac7a-31ad87dd9043 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:53.380826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-660a7639-282f-4f6b-ac7a-31ad87dd9043 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:53.381732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-660a7639-282f-4f6b-ac7a-31ad87dd9043 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:53.382582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-660a7639-282f-4f6b-ac7a-31ad87dd9043 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:53.383214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-660a7639-282f-4f6b-ac7a-31ad87dd9043 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:53.428193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-55b15ec8-7b6f-4a98-ba00-3cae5bad2c1b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:53.451403 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-55b15ec8-7b6f-4a98-ba00-3cae5bad2c1b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1292 microversion: 2.1 time: 1.074164 Aug 18 11:30:53.454459 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 647/1310] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:52 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1292 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:53.831468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2fb8ab00-d7ff-44e0-81bc-bd0a6284f895 req-86640b87-1db7-4719-ba9e-a7c5769620c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb46c1c-c94c-4ea9-942e-82187eb83479", "name": "network-vif-plugged", "status": "completed", "tag": "b659ed49-6503-43dd-9a80-64c66fbb2313"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:53.837088 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-660a7639-282f-4f6b-ac7a-31ad87dd9043 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:53.854240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-660a7639-282f-4f6b-ac7a-31ad87dd9043 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:53.855341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2fb8ab00-d7ff-44e0-81bc-bd0a6284f895 req-86640b87-1db7-4719-ba9e-a7c5769620c0 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:53.857071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2fb8ab00-d7ff-44e0-81bc-bd0a6284f895 req-86640b87-1db7-4719-ba9e-a7c5769620c0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:53.859410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2fb8ab00-d7ff-44e0-81bc-bd0a6284f895 req-86640b87-1db7-4719-ba9e-a7c5769620c0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:53.859553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-660a7639-282f-4f6b-ac7a-31ad87dd9043 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:53.865279 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-660a7639-282f-4f6b-ac7a-31ad87dd9043 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.509082 Aug 18 11:30:53.870329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:53.879943 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 664/1311] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:30:53 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:30:53.887279 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2fb8ab00-d7ff-44e0-81bc-bd0a6284f895 req-86640b87-1db7-4719-ba9e-a7c5769620c0 service nova] Creating event network-vif-plugged:b659ed49-6503-43dd-9a80-64c66fbb2313 for instance dbb46c1c-c94c-4ea9-942e-82187eb83479 on n-h2-853611-3 Aug 18 11:30:53.894054 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2fb8ab00-d7ff-44e0-81bc-bd0a6284f895 req-86640b87-1db7-4719-ba9e-a7c5769620c0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.438049 Aug 18 11:30:53.896771 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 648/1312] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:53.903278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-978ab7ea-d5ba-4a3c-b94b-e8d2f01f64aa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:53.904427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-978ab7ea-d5ba-4a3c-b94b-e8d2f01f64aa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:53.915511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1611329207", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2420cd87-a1af-4a7a-8baa-ea2c21853a49"}], "security_groups": [{"name": "tempest-securitygroup--1414900753"}], "key_name": "tempest-keypair-1643977109", "user_data": "}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:53.943829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-978ab7ea-d5ba-4a3c-b94b-e8d2f01f64aa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:53.945494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-978ab7ea-d5ba-4a3c-b94b-e8d2f01f64aa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:53.947166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-978ab7ea-d5ba-4a3c-b94b-e8d2f01f64aa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:53.947977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-978ab7ea-d5ba-4a3c-b94b-e8d2f01f64aa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:53.950765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-978ab7ea-d5ba-4a3c-b94b-e8d2f01f64aa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:53.951706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-978ab7ea-d5ba-4a3c-b94b-e8d2f01f64aa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:54.205253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] validate_networks() for [('2420cd87-a1af-4a7a-8baa-ea2c21853a49', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:30:54.313760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-978ab7ea-d5ba-4a3c-b94b-e8d2f01f64aa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:54.333580 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-978ab7ea-d5ba-4a3c-b94b-e8d2f01f64aa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 200 len: 1308 microversion: 2.1 time: 0.433468 Aug 18 11:30:54.348576 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 649/1313] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:53 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 1308 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:54.348576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a8949e2-cb48-4b42-be9b-47c514a5ce9a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:54.348576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6a8949e2-cb48-4b42-be9b-47c514a5ce9a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:54.380009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a8949e2-cb48-4b42-be9b-47c514a5ce9a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:54.382128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a8949e2-cb48-4b42-be9b-47c514a5ce9a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:54.382952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a8949e2-cb48-4b42-be9b-47c514a5ce9a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:54.384077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a8949e2-cb48-4b42-be9b-47c514a5ce9a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:54.384792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a8949e2-cb48-4b42-be9b-47c514a5ce9a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:54.389527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a8949e2-cb48-4b42-be9b-47c514a5ce9a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:54.561437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6a8949e2-cb48-4b42-be9b-47c514a5ce9a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:54.575476 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6a8949e2-cb48-4b42-be9b-47c514a5ce9a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1228 microversion: 2.1 time: 0.235400 Aug 18 11:30:54.576877 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 650/1314] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:54 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1228 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:54.589311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-802741114", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "230a28da-425a-4af8-bf4b-1298e1d95739"}], "security_groups": [{"name": "tempest-securitygroup--1679488813"}], "key_name": "tempest-keypair-1904316241", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:54.818208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] validate_networks() for [('230a28da-425a-4af8-bf4b-1298e1d95739', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:30:55.033915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:30:55.034342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:30:55.034845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:30:55.035252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:30:55.035658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:30:55.065815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:55.066323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:55.068877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:55.069701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:55.070167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:55.070646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:55.134816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Getting quotas for project c1a985dc6f824e5b847a2d966c0f79af. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:55.150198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Getting quotas for user 0cd8451c50d941409a66864cbc1c7201 and project c1a985dc6f824e5b847a2d966c0f79af. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:55.182461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:30:55.188892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:30:55.309859 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8598a0ed-ebca-418b-8050-baf1bd6da6b6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.428654 Aug 18 11:30:55.310926 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 665/1315] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:30:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:30:55.327797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ba4ec9ee-97fe-4b77-8fcf-6b310f3370b5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:55.333231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ba4ec9ee-97fe-4b77-8fcf-6b310f3370b5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:55.342205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba4ec9ee-97fe-4b77-8fcf-6b310f3370b5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:55.349154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba4ec9ee-97fe-4b77-8fcf-6b310f3370b5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:55.349929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba4ec9ee-97fe-4b77-8fcf-6b310f3370b5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:55.352944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba4ec9ee-97fe-4b77-8fcf-6b310f3370b5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:55.353988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba4ec9ee-97fe-4b77-8fcf-6b310f3370b5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:55.354676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba4ec9ee-97fe-4b77-8fcf-6b310f3370b5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:55.986760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ba4ec9ee-97fe-4b77-8fcf-6b310f3370b5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:55.997727 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ba4ec9ee-97fe-4b77-8fcf-6b310f3370b5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1292 microversion: 2.1 time: 0.673993 Aug 18 11:30:55.998380 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 666/1316] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:55 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1292 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:56.007715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-31a80112-a4d7-4701-8399-57b291fd402e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:56.009645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-31a80112-a4d7-4701-8399-57b291fd402e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:56.022728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31a80112-a4d7-4701-8399-57b291fd402e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:56.023421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31a80112-a4d7-4701-8399-57b291fd402e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:56.024028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31a80112-a4d7-4701-8399-57b291fd402e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:56.024953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31a80112-a4d7-4701-8399-57b291fd402e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:56.025627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31a80112-a4d7-4701-8399-57b291fd402e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:56.026242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31a80112-a4d7-4701-8399-57b291fd402e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:56.203131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-31a80112-a4d7-4701-8399-57b291fd402e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:56.215708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-31a80112-a4d7-4701-8399-57b291fd402e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:56.220836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-31a80112-a4d7-4701-8399-57b291fd402e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:56.223486 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-31a80112-a4d7-4701-8399-57b291fd402e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.224005 Aug 18 11:30:56.224843 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 667/1317] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:30:55 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:30:56.230076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a64b2796-6be1-4f10-bfb8-7899f06e2e64 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:56.230970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a64b2796-6be1-4f10-bfb8-7899f06e2e64 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:56.243960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a64b2796-6be1-4f10-bfb8-7899f06e2e64 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:56.244912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a64b2796-6be1-4f10-bfb8-7899f06e2e64 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:56.245921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a64b2796-6be1-4f10-bfb8-7899f06e2e64 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:56.246829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a64b2796-6be1-4f10-bfb8-7899f06e2e64 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:56.247445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a64b2796-6be1-4f10-bfb8-7899f06e2e64 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:56.248030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a64b2796-6be1-4f10-bfb8-7899f06e2e64 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:56.313322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:30:56.314789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:30:56.315484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:30:56.316104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:30:56.316850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:30:56.329287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:56.330063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:56.330743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:56.331825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:56.336008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a64b2796-6be1-4f10-bfb8-7899f06e2e64 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:56.340980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:56.343766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:56.345787 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a64b2796-6be1-4f10-bfb8-7899f06e2e64 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1235 microversion: 2.1 time: 0.119430 Aug 18 11:30:56.346663 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 668/1318] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:56 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1235 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:56.360967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3de72bfc-ba8c-40e0-9044-c0b91e78f4e4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:56.361746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3de72bfc-ba8c-40e0-9044-c0b91e78f4e4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:56.375369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Getting quotas for project 6439cb52de454891b535bd23f11e88b1. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:30:56.382245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3de72bfc-ba8c-40e0-9044-c0b91e78f4e4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:56.382938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Getting quotas for user d5312f9922c246a9a594be35a4a598ac and project 6439cb52de454891b535bd23f11e88b1. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:30:56.383195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3de72bfc-ba8c-40e0-9044-c0b91e78f4e4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:56.383812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3de72bfc-ba8c-40e0-9044-c0b91e78f4e4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:56.384688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3de72bfc-ba8c-40e0-9044-c0b91e78f4e4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:56.385320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3de72bfc-ba8c-40e0-9044-c0b91e78f4e4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:56.385914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3de72bfc-ba8c-40e0-9044-c0b91e78f4e4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:56.408865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:30:56.414339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:30:56.471917 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e1076f8d-1f21-4df3-8ee3-9debd123ba37 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.892810 Aug 18 11:30:56.473403 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 651/1319] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:30:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:30:56.583182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3de72bfc-ba8c-40e0-9044-c0b91e78f4e4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:56.595818 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3de72bfc-ba8c-40e0-9044-c0b91e78f4e4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 200 len: 1308 microversion: 2.1 time: 0.245907 Aug 18 11:30:56.596820 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 669/1320] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:56 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 1308 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:56.602687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d800b13e-0dfb-414d-9ae2-b63696a527cf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:56.604442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d800b13e-0dfb-414d-9ae2-b63696a527cf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:56.622059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d800b13e-0dfb-414d-9ae2-b63696a527cf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:56.626343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d800b13e-0dfb-414d-9ae2-b63696a527cf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:56.626343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d800b13e-0dfb-414d-9ae2-b63696a527cf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:56.632640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d800b13e-0dfb-414d-9ae2-b63696a527cf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:56.633148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d800b13e-0dfb-414d-9ae2-b63696a527cf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:56.633600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d800b13e-0dfb-414d-9ae2-b63696a527cf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:56.650253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd503aea-551b-406a-927d-f9765f82f660 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:56.696533 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd503aea-551b-406a-927d-f9765f82f660 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.221712 Aug 18 11:30:56.697137 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 652/1321] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:30:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:56.732718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d800b13e-0dfb-414d-9ae2-b63696a527cf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:56.737591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f9dc321-cbbd-403d-815b-cb5f9572036f tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:56.739424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6f9dc321-cbbd-403d-815b-cb5f9572036f tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:56.744960 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d800b13e-0dfb-414d-9ae2-b63696a527cf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1282 microversion: 2.1 time: 0.146477 Aug 18 11:30:56.748475 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 670/1322] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:56 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1282 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:56.759217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-34ba886b-fa8d-4a04-a0ab-9075c11d71cd tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:56.788022 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-34ba886b-fa8d-4a04-a0ab-9075c11d71cd tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.037236 Aug 18 11:30:56.789413 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 671/1323] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 18 11:30:56 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:56.830421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-abe9952d-87eb-4dd7-b5a5-3ff3c638b5ba tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:56.863981 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-abe9952d-87eb-4dd7-b5a5-3ff3c638b5ba tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.052501 Aug 18 11:30:56.865962 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 672/1324] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:30:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:56.879088 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7b15e3db-6e3b-478b-8135-f31122e8a3cc tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:56.906524 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7b15e3db-6e3b-478b-8135-f31122e8a3cc tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027779 Aug 18 11:30:56.908683 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 673/1325] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:30:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:30:56.923952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-43594db3-42a5-47c1-82ee-d43d0f6a6c02 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:56.939414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6f9dc321-cbbd-403d-815b-cb5f9572036f tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:56.960122 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-43594db3-42a5-47c1-82ee-d43d0f6a6c02 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.039951 Aug 18 11:30:56.967066 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6f9dc321-cbbd-403d-815b-cb5f9572036f tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 200 len: 1241 microversion: 2.1 time: 0.251844 Aug 18 11:30:56.967809 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 653/1326] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:56 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 1241 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:56.972615 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 674/1327] 10.222.0.73 () {58 vars in 1165 bytes} [Thu Aug 18 11:30:56 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:56.985040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ea21fcef-bb2f-46fb-b920-61bc271ff470 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.003722 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ea21fcef-bb2f-46fb-b920-61bc271ff470 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027415 Aug 18 11:30:57.005589 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 654/1328] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:30:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:57.017071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c6c3d92e-0afb-4973-8abd-ca65701c72ae tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.040665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e6373f14-c87c-42b7-8f68-01a47ce1b70d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.042699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e6373f14-c87c-42b7-8f68-01a47ce1b70d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:57.044673 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c6c3d92e-0afb-4973-8abd-ca65701c72ae tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.032418 Aug 18 11:30:57.057844 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 675/1329] 10.222.0.73 () {58 vars in 1169 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:57.059779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6373f14-c87c-42b7-8f68-01a47ce1b70d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:57.060283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6373f14-c87c-42b7-8f68-01a47ce1b70d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:57.060768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6373f14-c87c-42b7-8f68-01a47ce1b70d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:57.063765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6373f14-c87c-42b7-8f68-01a47ce1b70d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:57.064321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6373f14-c87c-42b7-8f68-01a47ce1b70d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:57.064768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6373f14-c87c-42b7-8f68-01a47ce1b70d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:57.066264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4eb95b2b-b286-42fb-9fb1-1afb02c1a249 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.082002 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4eb95b2b-b286-42fb-9fb1-1afb02c1a249 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.021965 Aug 18 11:30:57.094641 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 676/1330] 10.222.0.73 () {58 vars in 1161 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:30:57.099728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-04f8598c-44b1-47f8-b614-e0d2f53daae9 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.104187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:57.108971 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-04f8598c-44b1-47f8-b614-e0d2f53daae9 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013185 Aug 18 11:30:57.115945 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 677/1331] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:30:57.133805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-070385aa-7094-40dd-a6d4-76a5464311ec tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.190141 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-070385aa-7094-40dd-a6d4-76a5464311ec tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.065970 Aug 18 11:30:57.207803 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 678/1332] 10.222.0.73 () {58 vars in 1167 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:57.217504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-41925911-9a56-4f6a-be37-0d157f2e540f tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.229124 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-41925911-9a56-4f6a-be37-0d157f2e540f tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017065 Aug 18 11:30:57.230341 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 679/1333] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:57.242739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bd9ca2c7-40f2-4665-b595-12f6374e9390 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.266056 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bd9ca2c7-40f2-4665-b595-12f6374e9390 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.026449 Aug 18 11:30:57.279581 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 680/1334] 10.222.0.73 () {58 vars in 1144 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:30:57.287901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-72b1d5dd-b6b6-4319-affa-e53165122956 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.288766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-72b1d5dd-b6b6-4319-affa-e53165122956 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:57.297365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72b1d5dd-b6b6-4319-affa-e53165122956 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:57.298178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72b1d5dd-b6b6-4319-affa-e53165122956 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:57.298974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72b1d5dd-b6b6-4319-affa-e53165122956 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:57.300016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72b1d5dd-b6b6-4319-affa-e53165122956 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:57.300643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72b1d5dd-b6b6-4319-affa-e53165122956 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:57.301371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72b1d5dd-b6b6-4319-affa-e53165122956 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:57.321555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:57.479710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-72b1d5dd-b6b6-4319-affa-e53165122956 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:57.490723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-72b1d5dd-b6b6-4319-affa-e53165122956 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:57.492539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-72b1d5dd-b6b6-4319-affa-e53165122956 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:57.494057 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-72b1d5dd-b6b6-4319-affa-e53165122956 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.212265 Aug 18 11:30:57.495022 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 681/1335] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:30:57.500437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-59c7042b-9b07-456e-9d35-5f82dedd5416 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.507423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e6373f14-c87c-42b7-8f68-01a47ce1b70d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:57.509542 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-59c7042b-9b07-456e-9d35-5f82dedd5416 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013327 Aug 18 11:30:57.510365 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 682/1336] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:57.520987 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e6373f14-c87c-42b7-8f68-01a47ce1b70d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1292 microversion: 2.1 time: 0.502478 Aug 18 11:30:57.522638 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 655/1337] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1292 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:57.523672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d5b74d28-0a29-4280-aee8-90893ae0d858 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.524302 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d5b74d28-0a29-4280-aee8-90893ae0d858 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:57.531624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5b74d28-0a29-4280-aee8-90893ae0d858 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:57.532122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5b74d28-0a29-4280-aee8-90893ae0d858 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:57.532567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5b74d28-0a29-4280-aee8-90893ae0d858 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:57.533344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5b74d28-0a29-4280-aee8-90893ae0d858 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:57.533810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5b74d28-0a29-4280-aee8-90893ae0d858 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:57.534241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5b74d28-0a29-4280-aee8-90893ae0d858 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:57.538840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6e740d4c-e73c-41b3-8c12-8a46f9972000 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.582597 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6e740d4c-e73c-41b3-8c12-8a46f9972000 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.058477 Aug 18 11:30:57.583315 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 656/1338] 10.222.0.73 () {58 vars in 1148 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:57.601686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f0cdd3ae-76c7-4590-b14c-cacfa0715ee3 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.627882 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f0cdd3ae-76c7-4590-b14c-cacfa0715ee3 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.024917 Aug 18 11:30:57.639497 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 657/1339] 10.222.0.73 () {58 vars in 1140 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:57.649245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cdea3b73-f538-416f-8fbe-9cfaea857be5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.650200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cdea3b73-f538-416f-8fbe-9cfaea857be5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:57.674900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdea3b73-f538-416f-8fbe-9cfaea857be5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:57.680563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdea3b73-f538-416f-8fbe-9cfaea857be5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:57.681338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdea3b73-f538-416f-8fbe-9cfaea857be5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:57.682324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdea3b73-f538-416f-8fbe-9cfaea857be5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:57.682985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdea3b73-f538-416f-8fbe-9cfaea857be5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:57.683614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdea3b73-f538-416f-8fbe-9cfaea857be5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:57.701700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d5b74d28-0a29-4280-aee8-90893ae0d858 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:57.720120 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d5b74d28-0a29-4280-aee8-90893ae0d858 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1297 microversion: 2.1 time: 0.201360 Aug 18 11:30:57.734056 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 683/1340] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1297 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:57.734056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b87fd324-d90e-4566-b7cf-0557739d6aa2 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.737346 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b87fd324-d90e-4566-b7cf-0557739d6aa2 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014804 Aug 18 11:30:57.738486 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 684/1341] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:57.751896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-45bec370-27af-4c9f-af46-4235213452b1 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.799494 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-45bec370-27af-4c9f-af46-4235213452b1 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.052785 Aug 18 11:30:57.812083 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 685/1342] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:57.818565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a3d2b47a-0a30-45e2-86d1-49cc864bdb58 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:57.819348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a3d2b47a-0a30-45e2-86d1-49cc864bdb58 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:57.827961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3d2b47a-0a30-45e2-86d1-49cc864bdb58 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:57.828612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3d2b47a-0a30-45e2-86d1-49cc864bdb58 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:57.829160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3d2b47a-0a30-45e2-86d1-49cc864bdb58 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:57.829997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3d2b47a-0a30-45e2-86d1-49cc864bdb58 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:57.830664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3d2b47a-0a30-45e2-86d1-49cc864bdb58 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:57.831197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3d2b47a-0a30-45e2-86d1-49cc864bdb58 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:58.002492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a3d2b47a-0a30-45e2-86d1-49cc864bdb58 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:58.016291 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a3d2b47a-0a30-45e2-86d1-49cc864bdb58 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1324 microversion: 2.1 time: 0.202171 Aug 18 11:30:58.029750 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 686/1343] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1324 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:58.047381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dc8f4f86-4cee-4211-9d70-a2221d369088 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:58.077857 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dc8f4f86-4cee-4211-9d70-a2221d369088 tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057519 Aug 18 11:30:58.078487 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 687/1344] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:30:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:58.094597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-18ee41fd-b33e-460f-bb1a-bc5280194bee tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:58.094597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-18ee41fd-b33e-460f-bb1a-bc5280194bee tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:58.106202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18ee41fd-b33e-460f-bb1a-bc5280194bee tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:58.107257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18ee41fd-b33e-460f-bb1a-bc5280194bee tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:58.107405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18ee41fd-b33e-460f-bb1a-bc5280194bee tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:58.108131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18ee41fd-b33e-460f-bb1a-bc5280194bee tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:58.109276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18ee41fd-b33e-460f-bb1a-bc5280194bee tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:58.110102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18ee41fd-b33e-460f-bb1a-bc5280194bee tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:58.206382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-18ee41fd-b33e-460f-bb1a-bc5280194bee tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:58.216571 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-18ee41fd-b33e-460f-bb1a-bc5280194bee tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 200 len: 1293 microversion: 2.1 time: 0.136747 Aug 18 11:30:58.217591 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 688/1345] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:58 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 1293 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:58.222888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-acf5c932-a96a-4bd3-a0fc-1956db5324c9 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:58.223927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-acf5c932-a96a-4bd3-a0fc-1956db5324c9 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:58.230813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-acf5c932-a96a-4bd3-a0fc-1956db5324c9 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:58.231679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-acf5c932-a96a-4bd3-a0fc-1956db5324c9 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:58.232391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-acf5c932-a96a-4bd3-a0fc-1956db5324c9 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:58.233214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-acf5c932-a96a-4bd3-a0fc-1956db5324c9 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:58.235949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-acf5c932-a96a-4bd3-a0fc-1956db5324c9 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:58.235949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-acf5c932-a96a-4bd3-a0fc-1956db5324c9 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:58.257177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cdea3b73-f538-416f-8fbe-9cfaea857be5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:58.265384 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cdea3b73-f538-416f-8fbe-9cfaea857be5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 200 len: 1489 microversion: 2.1 time: 0.623461 Aug 18 11:30:58.266555 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 658/1346] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:57 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 1489 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:58.286809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0fee220a-b382-4cce-bc83-7ad08be1a05d tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:58.295644 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0fee220a-b382-4cce-bc83-7ad08be1a05d tempest-FlavorsV2TestJSON-498949725 tempest-FlavorsV2TestJSON-498949725-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012671 Aug 18 11:30:58.297724 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 659/1347] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:30:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:30:58.304742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-00afdb33-fa43-4313-9066-099e1c9d5473 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:58.305662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-00afdb33-fa43-4313-9066-099e1c9d5473 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:58.313589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00afdb33-fa43-4313-9066-099e1c9d5473 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:58.314409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00afdb33-fa43-4313-9066-099e1c9d5473 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:58.315118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00afdb33-fa43-4313-9066-099e1c9d5473 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:58.316106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00afdb33-fa43-4313-9066-099e1c9d5473 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:58.316773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00afdb33-fa43-4313-9066-099e1c9d5473 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:58.317437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00afdb33-fa43-4313-9066-099e1c9d5473 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:58.459790 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-acf5c932-a96a-4bd3-a0fc-1956db5324c9 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1856 microversion: 2.1 time: 0.240687 Aug 18 11:30:58.461166 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 689/1348] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:58 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1856 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:58.477195 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-00afdb33-fa43-4313-9066-099e1c9d5473 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "POST /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479/action" status: 202 len: 0 microversion: 2.1 time: 0.177817 Aug 18 11:30:58.483077 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 660/1349] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:30:58 2022] POST /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:30:58.489288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-070c6ebb-1500-47d5-8eb1-69ddb4008554 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-853611-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:30:58.502142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-070c6ebb-1500-47d5-8eb1-69ddb4008554 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:58.503510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f9091b5-efdb-420b-996c-d0d8c9f53d91 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:58.506961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7f9091b5-efdb-420b-996c-d0d8c9f53d91 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:58.520570 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-070c6ebb-1500-47d5-8eb1-69ddb4008554 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:58.523140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-070c6ebb-1500-47d5-8eb1-69ddb4008554 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:58.523988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-070c6ebb-1500-47d5-8eb1-69ddb4008554 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:58.526640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-070c6ebb-1500-47d5-8eb1-69ddb4008554 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:58.529882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-070c6ebb-1500-47d5-8eb1-69ddb4008554 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:58.532245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-070c6ebb-1500-47d5-8eb1-69ddb4008554 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:58.545254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f9091b5-efdb-420b-996c-d0d8c9f53d91 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:58.545915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f9091b5-efdb-420b-996c-d0d8c9f53d91 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:58.546837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f9091b5-efdb-420b-996c-d0d8c9f53d91 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:58.558324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f9091b5-efdb-420b-996c-d0d8c9f53d91 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:58.561504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f9091b5-efdb-420b-996c-d0d8c9f53d91 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:58.562245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f9091b5-efdb-420b-996c-d0d8c9f53d91 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:58.613578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-070c6ebb-1500-47d5-8eb1-69ddb4008554 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lazy-loading 'flavor' on Instance uuid 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:30:58.659004 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-070c6ebb-1500-47d5-8eb1-69ddb4008554 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Going to try to live migrate instance to n-h1-853611-3 {{(pid=122209) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 18 11:30:59.229898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7f9091b5-efdb-420b-996c-d0d8c9f53d91 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:59.239538 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7f9091b5-efdb-420b-996c-d0d8c9f53d91 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 200 len: 1494 microversion: 2.1 time: 0.752050 Aug 18 11:30:59.247169 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 661/1350] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:58 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 1494 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:30:59.262945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e1de7207-b838-4953-887c-5c496faa9d8b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:59.264355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e1de7207-b838-4953-887c-5c496faa9d8b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:59.274238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1de7207-b838-4953-887c-5c496faa9d8b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:59.274942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1de7207-b838-4953-887c-5c496faa9d8b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:59.275565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1de7207-b838-4953-887c-5c496faa9d8b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:59.276569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1de7207-b838-4953-887c-5c496faa9d8b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:59.277203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1de7207-b838-4953-887c-5c496faa9d8b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:59.277795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1de7207-b838-4953-887c-5c496faa9d8b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:59.834931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e1de7207-b838-4953-887c-5c496faa9d8b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:59.860230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e1de7207-b838-4953-887c-5c496faa9d8b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:59.863147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e1de7207-b838-4953-887c-5c496faa9d8b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:30:59.865230 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e1de7207-b838-4953-887c-5c496faa9d8b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.616008 Aug 18 11:30:59.867551 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 662/1351] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:30:59 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:30:59.879611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-549bbb5a-d5b3-4b82-8352-08caf2e57d38 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:30:59.880698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-549bbb5a-d5b3-4b82-8352-08caf2e57d38 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:30:59.888383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:30:59.891729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-549bbb5a-d5b3-4b82-8352-08caf2e57d38 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:59.893266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-549bbb5a-d5b3-4b82-8352-08caf2e57d38 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:59.893917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-549bbb5a-d5b3-4b82-8352-08caf2e57d38 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:30:59.895325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-549bbb5a-d5b3-4b82-8352-08caf2e57d38 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:30:59.896662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-549bbb5a-d5b3-4b82-8352-08caf2e57d38 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:30:59.897300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-549bbb5a-d5b3-4b82-8352-08caf2e57d38 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:00.484258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-549bbb5a-d5b3-4b82-8352-08caf2e57d38 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:00.492792 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-549bbb5a-d5b3-4b82-8352-08caf2e57d38 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1292 microversion: 2.1 time: 0.622152 Aug 18 11:31:00.514248 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 663/1352] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:30:59 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1292 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:00.519473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0aae4c8b-1e39-42f0-bd5b-e87cfaf58f6e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:00.520310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0aae4c8b-1e39-42f0-bd5b-e87cfaf58f6e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:00.527665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0aae4c8b-1e39-42f0-bd5b-e87cfaf58f6e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:00.528425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0aae4c8b-1e39-42f0-bd5b-e87cfaf58f6e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:00.529018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0aae4c8b-1e39-42f0-bd5b-e87cfaf58f6e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:00.529890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0aae4c8b-1e39-42f0-bd5b-e87cfaf58f6e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:00.530681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0aae4c8b-1e39-42f0-bd5b-e87cfaf58f6e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:00.531261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0aae4c8b-1e39-42f0-bd5b-e87cfaf58f6e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:00.990451 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-070c6ebb-1500-47d5-8eb1-69ddb4008554 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/action" status: 202 len: 0 microversion: 2.1 time: 2.511268 Aug 18 11:31:00.991425 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 690/1353] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:30:58 2022] POST /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/action => generated 0 bytes in 2513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:31:00.997095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa15c184-d893-4e65-9fc8-974e5c9a5a9f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:00.997884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fa15c184-d893-4e65-9fc8-974e5c9a5a9f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:01.012438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa15c184-d893-4e65-9fc8-974e5c9a5a9f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:01.015203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa15c184-d893-4e65-9fc8-974e5c9a5a9f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:01.016173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa15c184-d893-4e65-9fc8-974e5c9a5a9f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:01.018127 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa15c184-d893-4e65-9fc8-974e5c9a5a9f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:01.019147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa15c184-d893-4e65-9fc8-974e5c9a5a9f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:01.019927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa15c184-d893-4e65-9fc8-974e5c9a5a9f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:01.041515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0aae4c8b-1e39-42f0-bd5b-e87cfaf58f6e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:01.066560 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0aae4c8b-1e39-42f0-bd5b-e87cfaf58f6e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1365 microversion: 2.1 time: 0.544351 Aug 18 11:31:01.067489 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 664/1354] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:00 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1365 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:01.083646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0d86707e-e688-422c-94d7-b733cd9f98ec tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:01.084302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0d86707e-e688-422c-94d7-b733cd9f98ec tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:01.104232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d86707e-e688-422c-94d7-b733cd9f98ec tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:01.110611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d86707e-e688-422c-94d7-b733cd9f98ec tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:01.111346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d86707e-e688-422c-94d7-b733cd9f98ec tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:01.112659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d86707e-e688-422c-94d7-b733cd9f98ec tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:01.115438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d86707e-e688-422c-94d7-b733cd9f98ec tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:01.116159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d86707e-e688-422c-94d7-b733cd9f98ec tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:01.466263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fa15c184-d893-4e65-9fc8-974e5c9a5a9f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:01.478035 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fa15c184-d893-4e65-9fc8-974e5c9a5a9f tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1324 microversion: 2.1 time: 0.485360 Aug 18 11:31:01.479627 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 691/1355] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:00 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1324 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:01.486343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4772487d-1a80-48a8-9896-06dd7e28d210 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:01.487332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4772487d-1a80-48a8-9896-06dd7e28d210 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:01.499006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4772487d-1a80-48a8-9896-06dd7e28d210 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:01.500330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4772487d-1a80-48a8-9896-06dd7e28d210 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:01.501546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4772487d-1a80-48a8-9896-06dd7e28d210 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:01.503301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4772487d-1a80-48a8-9896-06dd7e28d210 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:01.503301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4772487d-1a80-48a8-9896-06dd7e28d210 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:01.503673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4772487d-1a80-48a8-9896-06dd7e28d210 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:01.554563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0d86707e-e688-422c-94d7-b733cd9f98ec tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:01.564725 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0d86707e-e688-422c-94d7-b733cd9f98ec tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 200 len: 1367 microversion: 2.1 time: 0.496092 Aug 18 11:31:01.568257 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 665/1356] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:01 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 1367 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:01.577749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-97d038f6-ada7-48c8-b3d3-878b9f2f19f1 req-07dd0a9b-d54e-4faf-9403-5275afb219d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8", "tag": "3fa92fbf-bba6-4b83-9017-4544457a86cb"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:01.596414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-97d038f6-ada7-48c8-b3d3-878b9f2f19f1 req-07dd0a9b-d54e-4faf-9403-5275afb219d2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:01.597183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-97d038f6-ada7-48c8-b3d3-878b9f2f19f1 req-07dd0a9b-d54e-4faf-9403-5275afb219d2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:01.598065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-97d038f6-ada7-48c8-b3d3-878b9f2f19f1 req-07dd0a9b-d54e-4faf-9403-5275afb219d2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:01.621652 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-97d038f6-ada7-48c8-b3d3-878b9f2f19f1 req-07dd0a9b-d54e-4faf-9403-5275afb219d2 service nova] Creating event network-changed:3fa92fbf-bba6-4b83-9017-4544457a86cb for instance bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 on n-h1-853611-3 Aug 18 11:31:01.628229 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-97d038f6-ada7-48c8-b3d3-878b9f2f19f1 req-07dd0a9b-d54e-4faf-9403-5275afb219d2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058338 Aug 18 11:31:01.629945 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 666/1357] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:01.639133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f287f0ed-f80e-4fd5-89ff-d4fa6f2b9055 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:01.641236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f287f0ed-f80e-4fd5-89ff-d4fa6f2b9055 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:01.648256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f287f0ed-f80e-4fd5-89ff-d4fa6f2b9055 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:01.648757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f287f0ed-f80e-4fd5-89ff-d4fa6f2b9055 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:01.649453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f287f0ed-f80e-4fd5-89ff-d4fa6f2b9055 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:01.650379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f287f0ed-f80e-4fd5-89ff-d4fa6f2b9055 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:01.651125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f287f0ed-f80e-4fd5-89ff-d4fa6f2b9055 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:01.651834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f287f0ed-f80e-4fd5-89ff-d4fa6f2b9055 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:01.945871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4772487d-1a80-48a8-9896-06dd7e28d210 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:01.954804 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4772487d-1a80-48a8-9896-06dd7e28d210 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 200 len: 1474 microversion: 2.1 time: 0.473548 Aug 18 11:31:01.955394 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 692/1358] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:01 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 1474 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:01.960205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c472a4c4-e4b3-4bf6-9d90-5753c9dcf06b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:01.960814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c472a4c4-e4b3-4bf6-9d90-5753c9dcf06b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:01.967283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c472a4c4-e4b3-4bf6-9d90-5753c9dcf06b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:01.968098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c472a4c4-e4b3-4bf6-9d90-5753c9dcf06b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:01.968547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c472a4c4-e4b3-4bf6-9d90-5753c9dcf06b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:01.969255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c472a4c4-e4b3-4bf6-9d90-5753c9dcf06b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:01.969892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c472a4c4-e4b3-4bf6-9d90-5753c9dcf06b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:01.970330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c472a4c4-e4b3-4bf6-9d90-5753c9dcf06b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:01.993508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f287f0ed-f80e-4fd5-89ff-d4fa6f2b9055 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:02.007182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f287f0ed-f80e-4fd5-89ff-d4fa6f2b9055 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:02.009172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f287f0ed-f80e-4fd5-89ff-d4fa6f2b9055 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:02.011564 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f287f0ed-f80e-4fd5-89ff-d4fa6f2b9055 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.379174 Aug 18 11:31:02.013899 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 667/1359] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:01 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:02.023111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9d29310-1f12-4a2f-9f0d-3f90097116d5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:02.024869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c9d29310-1f12-4a2f-9f0d-3f90097116d5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:02.037819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9d29310-1f12-4a2f-9f0d-3f90097116d5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:02.038317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9d29310-1f12-4a2f-9f0d-3f90097116d5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:02.038780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9d29310-1f12-4a2f-9f0d-3f90097116d5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:02.040428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9d29310-1f12-4a2f-9f0d-3f90097116d5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:02.040428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9d29310-1f12-4a2f-9f0d-3f90097116d5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:02.040428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9d29310-1f12-4a2f-9f0d-3f90097116d5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:02.243751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c472a4c4-e4b3-4bf6-9d90-5753c9dcf06b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:02.252527 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c472a4c4-e4b3-4bf6-9d90-5753c9dcf06b tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.295877 Aug 18 11:31:02.253451 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 693/1360] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:01 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:02.262592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-c0d8a0c0-9ab2-4317-b00f-713887082dc7 req-ce212c9d-fbff-4b61-9705-be76154a2b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba680fc7-c565-43cb-9551-f9f71f1f66f4", "tag": "5e7be3c3-f066-4799-bcf8-bdf28f819406"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:02.276977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c0d8a0c0-9ab2-4317-b00f-713887082dc7 req-ce212c9d-fbff-4b61-9705-be76154a2b45 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:02.277854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c0d8a0c0-9ab2-4317-b00f-713887082dc7 req-ce212c9d-fbff-4b61-9705-be76154a2b45 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:02.278386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c0d8a0c0-9ab2-4317-b00f-713887082dc7 req-ce212c9d-fbff-4b61-9705-be76154a2b45 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:02.290534 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-c0d8a0c0-9ab2-4317-b00f-713887082dc7 req-ce212c9d-fbff-4b61-9705-be76154a2b45 service nova] Creating event network-changed:5e7be3c3-f066-4799-bcf8-bdf28f819406 for instance ba680fc7-c565-43cb-9551-f9f71f1f66f4 on n-h2-853611-3 Aug 18 11:31:02.298512 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-c0d8a0c0-9ab2-4317-b00f-713887082dc7 req-ce212c9d-fbff-4b61-9705-be76154a2b45 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043401 Aug 18 11:31:02.299408 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 694/1361] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:02.306110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-45502c7c-3688-4627-b93c-e9449f4ca2e4 req-88de6dfe-24f5-42b0-a00b-cc0d0ab13692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ebb25c-67fd-4720-aaa6-7f85e22a97b3", "name": "network-vif-plugged", "status": "completed", "tag": "0026f65d-53f0-4762-89f1-046f21b2ca8b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:02.316694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-45502c7c-3688-4627-b93c-e9449f4ca2e4 req-88de6dfe-24f5-42b0-a00b-cc0d0ab13692 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:02.317186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-45502c7c-3688-4627-b93c-e9449f4ca2e4 req-88de6dfe-24f5-42b0-a00b-cc0d0ab13692 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:02.317623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-45502c7c-3688-4627-b93c-e9449f4ca2e4 req-88de6dfe-24f5-42b0-a00b-cc0d0ab13692 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:02.329939 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-45502c7c-3688-4627-b93c-e9449f4ca2e4 req-88de6dfe-24f5-42b0-a00b-cc0d0ab13692 service nova] Creating event network-vif-plugged:0026f65d-53f0-4762-89f1-046f21b2ca8b for instance a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 on n-h2-853611-3 Aug 18 11:31:02.335251 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-45502c7c-3688-4627-b93c-e9449f4ca2e4 req-88de6dfe-24f5-42b0-a00b-cc0d0ab13692 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034116 Aug 18 11:31:02.335867 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 695/1362] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:02.341790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ee463a6e-9a50-421c-bb38-e1ada9b04efa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-494699841"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:02.344951 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ee463a6e-9a50-421c-bb38-e1ada9b04efa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:02.351266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee463a6e-9a50-421c-bb38-e1ada9b04efa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:02.351757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee463a6e-9a50-421c-bb38-e1ada9b04efa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:02.352195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee463a6e-9a50-421c-bb38-e1ada9b04efa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:02.352899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee463a6e-9a50-421c-bb38-e1ada9b04efa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:02.353356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee463a6e-9a50-421c-bb38-e1ada9b04efa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:02.353783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee463a6e-9a50-421c-bb38-e1ada9b04efa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:02.396279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c9d29310-1f12-4a2f-9f0d-3f90097116d5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:02.411082 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c9d29310-1f12-4a2f-9f0d-3f90097116d5 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1292 microversion: 2.1 time: 0.394558 Aug 18 11:31:02.412072 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 668/1363] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:02 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1292 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:02.430330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a80de894-cdb1-44e9-911c-b122ac3567a3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:02.442455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a80de894-cdb1-44e9-911c-b122ac3567a3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:02.455523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a80de894-cdb1-44e9-911c-b122ac3567a3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:02.455523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a80de894-cdb1-44e9-911c-b122ac3567a3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:02.456343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a80de894-cdb1-44e9-911c-b122ac3567a3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:02.457676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a80de894-cdb1-44e9-911c-b122ac3567a3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:02.458715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a80de894-cdb1-44e9-911c-b122ac3567a3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:02.459413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a80de894-cdb1-44e9-911c-b122ac3567a3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:02.659338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a80de894-cdb1-44e9-911c-b122ac3567a3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:02.667266 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a80de894-cdb1-44e9-911c-b122ac3567a3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1365 microversion: 2.1 time: 0.241577 Aug 18 11:31:02.667945 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 669/1364] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:02 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:02.674911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c685989c-43fc-49cd-8351-41639b66d56d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:02.677703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c685989c-43fc-49cd-8351-41639b66d56d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:02.690861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c685989c-43fc-49cd-8351-41639b66d56d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:02.691561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c685989c-43fc-49cd-8351-41639b66d56d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:02.692391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c685989c-43fc-49cd-8351-41639b66d56d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:02.693246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c685989c-43fc-49cd-8351-41639b66d56d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:02.694131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c685989c-43fc-49cd-8351-41639b66d56d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:02.694659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c685989c-43fc-49cd-8351-41639b66d56d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:02.696558 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ee463a6e-9a50-421c-bb38-e1ada9b04efa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "POST /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479/action" status: 202 len: 0 microversion: 2.1 time: 0.359016 Aug 18 11:31:02.697242 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 696/1365] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:31:02 2022] POST /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 18 11:31:02.703942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f9035b3b-2320-46b5-8ca4-da6557e61b53 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:02.704085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f9035b3b-2320-46b5-8ca4-da6557e61b53 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:02.715548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9035b3b-2320-46b5-8ca4-da6557e61b53 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:02.716049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9035b3b-2320-46b5-8ca4-da6557e61b53 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:02.716855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9035b3b-2320-46b5-8ca4-da6557e61b53 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:02.717321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9035b3b-2320-46b5-8ca4-da6557e61b53 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:02.718329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9035b3b-2320-46b5-8ca4-da6557e61b53 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:02.718810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9035b3b-2320-46b5-8ca4-da6557e61b53 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:02.929432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f9035b3b-2320-46b5-8ca4-da6557e61b53 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:02.939093 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f9035b3b-2320-46b5-8ca4-da6557e61b53 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 200 len: 1367 microversion: 2.1 time: 0.240469 Aug 18 11:31:02.940047 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 697/1366] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:02 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:02.944805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a6ad53b7-6b66-424b-a292-40908ef5fe8b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f8da160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:03.016634 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a6ad53b7-6b66-424b-a292-40908ef5fe8b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.075876 Aug 18 11:31:03.018244 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 698/1367] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:02 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:03.045138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1fd990bc-96da-4d1e-bc57-53d27e072fb5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:03.046700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1fd990bc-96da-4d1e-bc57-53d27e072fb5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:03.066138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fd990bc-96da-4d1e-bc57-53d27e072fb5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:03.067331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fd990bc-96da-4d1e-bc57-53d27e072fb5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:03.067793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fd990bc-96da-4d1e-bc57-53d27e072fb5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:03.068630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fd990bc-96da-4d1e-bc57-53d27e072fb5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:03.069335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fd990bc-96da-4d1e-bc57-53d27e072fb5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:03.069942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fd990bc-96da-4d1e-bc57-53d27e072fb5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:03.489695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c685989c-43fc-49cd-8351-41639b66d56d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:03.507055 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c685989c-43fc-49cd-8351-41639b66d56d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1324 microversion: 2.1 time: 0.837724 Aug 18 11:31:03.525832 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 670/1368] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:02 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1324 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:03.532472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-44381c19-8da1-4b32-aa2d-9ed02d16e25f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:03.533398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-44381c19-8da1-4b32-aa2d-9ed02d16e25f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:03.542372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44381c19-8da1-4b32-aa2d-9ed02d16e25f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:03.543333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44381c19-8da1-4b32-aa2d-9ed02d16e25f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:03.543940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44381c19-8da1-4b32-aa2d-9ed02d16e25f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:03.544982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44381c19-8da1-4b32-aa2d-9ed02d16e25f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:03.547611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44381c19-8da1-4b32-aa2d-9ed02d16e25f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:03.548237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44381c19-8da1-4b32-aa2d-9ed02d16e25f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:03.962187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-44381c19-8da1-4b32-aa2d-9ed02d16e25f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:03.966400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:03.982068 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-44381c19-8da1-4b32-aa2d-9ed02d16e25f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.454263 Aug 18 11:31:03.984244 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 671/1369] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:03 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:03.990777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-41163e84-56c3-4e92-bddd-095237c29262 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:03.992084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-41163e84-56c3-4e92-bddd-095237c29262 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:04.004726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41163e84-56c3-4e92-bddd-095237c29262 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:04.005463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41163e84-56c3-4e92-bddd-095237c29262 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:04.005936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41163e84-56c3-4e92-bddd-095237c29262 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:04.006948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41163e84-56c3-4e92-bddd-095237c29262 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:04.007446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41163e84-56c3-4e92-bddd-095237c29262 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:04.007918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41163e84-56c3-4e92-bddd-095237c29262 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:04.087137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1fd990bc-96da-4d1e-bc57-53d27e072fb5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:04.102053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1fd990bc-96da-4d1e-bc57-53d27e072fb5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:04.105173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1fd990bc-96da-4d1e-bc57-53d27e072fb5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:04.108408 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1fd990bc-96da-4d1e-bc57-53d27e072fb5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 1.066995 Aug 18 11:31:04.109344 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 699/1370] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:03 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:04.155949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-eae2af5c-b07b-4aff-8a50-378c7d83ba01 req-9b082925-0f6b-4d6c-966e-2607d7382523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a906b8-26ea-4413-bed0-9c6f7a6be35c", "tag": "6b2318ca-00cc-4182-8517-7647cceb2c66"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:04.177578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-eae2af5c-b07b-4aff-8a50-378c7d83ba01 req-9b082925-0f6b-4d6c-966e-2607d7382523 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:04.180348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-eae2af5c-b07b-4aff-8a50-378c7d83ba01 req-9b082925-0f6b-4d6c-966e-2607d7382523 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:04.181433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-eae2af5c-b07b-4aff-8a50-378c7d83ba01 req-9b082925-0f6b-4d6c-966e-2607d7382523 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:04.207331 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-eae2af5c-b07b-4aff-8a50-378c7d83ba01 req-9b082925-0f6b-4d6c-966e-2607d7382523 service nova] Creating event network-changed:6b2318ca-00cc-4182-8517-7647cceb2c66 for instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c on n-h1-853611-3 Aug 18 11:31:04.213639 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-eae2af5c-b07b-4aff-8a50-378c7d83ba01 req-9b082925-0f6b-4d6c-966e-2607d7382523 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099285 Aug 18 11:31:04.215274 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 700/1371] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:04.222917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-386b0154-967a-4965-a262-892b1ded4182 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:04.223996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-386b0154-967a-4965-a262-892b1ded4182 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:04.232060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-386b0154-967a-4965-a262-892b1ded4182 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:04.233448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-386b0154-967a-4965-a262-892b1ded4182 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:04.234142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-386b0154-967a-4965-a262-892b1ded4182 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:04.236123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-386b0154-967a-4965-a262-892b1ded4182 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:04.236807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-386b0154-967a-4965-a262-892b1ded4182 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:04.237844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-386b0154-967a-4965-a262-892b1ded4182 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:04.375931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-41163e84-56c3-4e92-bddd-095237c29262 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:04.383748 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-41163e84-56c3-4e92-bddd-095237c29262 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1292 microversion: 2.1 time: 0.398349 Aug 18 11:31:04.384325 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 672/1372] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:03 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1292 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:04.389220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1282bff7-2be6-411a-80f3-2ccaffdf2edc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:04.390193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1282bff7-2be6-411a-80f3-2ccaffdf2edc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:04.396456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1282bff7-2be6-411a-80f3-2ccaffdf2edc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:04.397167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1282bff7-2be6-411a-80f3-2ccaffdf2edc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:04.397770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1282bff7-2be6-411a-80f3-2ccaffdf2edc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:04.398508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1282bff7-2be6-411a-80f3-2ccaffdf2edc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:04.398965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1282bff7-2be6-411a-80f3-2ccaffdf2edc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:04.399389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1282bff7-2be6-411a-80f3-2ccaffdf2edc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:04.562788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1282bff7-2be6-411a-80f3-2ccaffdf2edc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:04.570570 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1282bff7-2be6-411a-80f3-2ccaffdf2edc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 200 len: 1367 microversion: 2.1 time: 0.185034 Aug 18 11:31:04.571145 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 673/1373] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:04 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:04.582444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-28a14974-0703-4e34-8b1f-a9094f2a31ae tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f90ab80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:04.630670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-386b0154-967a-4965-a262-892b1ded4182 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:04.630936 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-28a14974-0703-4e34-8b1f-a9094f2a31ae tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.058678 Aug 18 11:31:04.633076 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 674/1374] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:04 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:04.633382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:04.638072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-668a5489-8c4e-4469-84b3-ca9543a6a9e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:04.640225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-668a5489-8c4e-4469-84b3-ca9543a6a9e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:04.641939 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-386b0154-967a-4965-a262-892b1ded4182 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1365 microversion: 2.1 time: 0.425225 Aug 18 11:31:04.642734 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 701/1375] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:04 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1365 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:04.649604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-668a5489-8c4e-4469-84b3-ca9543a6a9e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:04.650887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-668a5489-8c4e-4469-84b3-ca9543a6a9e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:04.651408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-668a5489-8c4e-4469-84b3-ca9543a6a9e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:04.652299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-668a5489-8c4e-4469-84b3-ca9543a6a9e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:04.652902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-668a5489-8c4e-4469-84b3-ca9543a6a9e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:04.653462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-668a5489-8c4e-4469-84b3-ca9543a6a9e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:04.823098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-668a5489-8c4e-4469-84b3-ca9543a6a9e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:04.833610 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-668a5489-8c4e-4469-84b3-ca9543a6a9e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1324 microversion: 2.1 time: 0.201007 Aug 18 11:31:04.834844 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 675/1376] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:04 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1324 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:05.006366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-81ac917d-5aa8-47f3-893f-caf47bfeb27d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:05.007101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-81ac917d-5aa8-47f3-893f-caf47bfeb27d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:05.015498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-81ac917d-5aa8-47f3-893f-caf47bfeb27d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:05.016051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-81ac917d-5aa8-47f3-893f-caf47bfeb27d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:05.016493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-81ac917d-5aa8-47f3-893f-caf47bfeb27d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:05.017194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-81ac917d-5aa8-47f3-893f-caf47bfeb27d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:05.017818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-81ac917d-5aa8-47f3-893f-caf47bfeb27d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:05.018437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-81ac917d-5aa8-47f3-893f-caf47bfeb27d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:05.107215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:05.140089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11d6e3b8-b16b-4fba-9c3f-860d90ac4409 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:05.141259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-11d6e3b8-b16b-4fba-9c3f-860d90ac4409 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:05.155929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11d6e3b8-b16b-4fba-9c3f-860d90ac4409 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:05.156431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11d6e3b8-b16b-4fba-9c3f-860d90ac4409 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:05.156871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11d6e3b8-b16b-4fba-9c3f-860d90ac4409 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:05.157595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11d6e3b8-b16b-4fba-9c3f-860d90ac4409 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:05.163621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11d6e3b8-b16b-4fba-9c3f-860d90ac4409 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:05.166622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11d6e3b8-b16b-4fba-9c3f-860d90ac4409 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:05.176305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=12 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:05.370873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11d6e3b8-b16b-4fba-9c3f-860d90ac4409 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:05.381480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11d6e3b8-b16b-4fba-9c3f-860d90ac4409 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:05.384083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11d6e3b8-b16b-4fba-9c3f-860d90ac4409 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:05.385569 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-11d6e3b8-b16b-4fba-9c3f-860d90ac4409 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.251352 Aug 18 11:31:05.386925 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 676/1377] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:05 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:05.406599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-653d0fa7-0c5b-4aef-985f-37b99d892bfb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:05.407529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-653d0fa7-0c5b-4aef-985f-37b99d892bfb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:05.415355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-653d0fa7-0c5b-4aef-985f-37b99d892bfb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:05.416087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-653d0fa7-0c5b-4aef-985f-37b99d892bfb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:05.417351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-653d0fa7-0c5b-4aef-985f-37b99d892bfb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:05.418228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-653d0fa7-0c5b-4aef-985f-37b99d892bfb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:05.418889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-653d0fa7-0c5b-4aef-985f-37b99d892bfb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:05.419476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-653d0fa7-0c5b-4aef-985f-37b99d892bfb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:05.450467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-81ac917d-5aa8-47f3-893f-caf47bfeb27d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:05.476127 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-81ac917d-5aa8-47f3-893f-caf47bfeb27d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.474081 Aug 18 11:31:05.481437 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 702/1378] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:05 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:05.591342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-01af4faa-8c2e-45c2-8477-0a5b76fb7480 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:05.592032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-01af4faa-8c2e-45c2-8477-0a5b76fb7480 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:05.609774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01af4faa-8c2e-45c2-8477-0a5b76fb7480 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:05.610760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01af4faa-8c2e-45c2-8477-0a5b76fb7480 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:05.611243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01af4faa-8c2e-45c2-8477-0a5b76fb7480 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:05.612010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01af4faa-8c2e-45c2-8477-0a5b76fb7480 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:05.612473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01af4faa-8c2e-45c2-8477-0a5b76fb7480 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:05.612904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01af4faa-8c2e-45c2-8477-0a5b76fb7480 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:05.623910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-653d0fa7-0c5b-4aef-985f-37b99d892bfb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:05.636705 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-653d0fa7-0c5b-4aef-985f-37b99d892bfb tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1292 microversion: 2.1 time: 0.235291 Aug 18 11:31:05.647557 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 677/1379] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:05 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1292 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:05.664358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-318231f2-afc4-400e-8f31-a199afcf5bbb tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f9aaaf0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:05.759041 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-318231f2-afc4-400e-8f31-a199afcf5bbb tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.109354 Aug 18 11:31:05.760159 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 678/1380] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:05 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:05.766162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-80e860f7-e1fb-46cf-8a52-dc64aaa6edbb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:05.767151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-80e860f7-e1fb-46cf-8a52-dc64aaa6edbb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:05.774400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80e860f7-e1fb-46cf-8a52-dc64aaa6edbb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:05.775243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80e860f7-e1fb-46cf-8a52-dc64aaa6edbb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:05.775854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80e860f7-e1fb-46cf-8a52-dc64aaa6edbb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:05.776795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80e860f7-e1fb-46cf-8a52-dc64aaa6edbb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:05.777410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80e860f7-e1fb-46cf-8a52-dc64aaa6edbb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:05.777994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80e860f7-e1fb-46cf-8a52-dc64aaa6edbb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:06.013231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-01af4faa-8c2e-45c2-8477-0a5b76fb7480 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:06.022092 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-01af4faa-8c2e-45c2-8477-0a5b76fb7480 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 200 len: 1367 microversion: 2.1 time: 0.434919 Aug 18 11:31:06.024662 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 703/1381] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:05 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:06.027106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-80e860f7-e1fb-46cf-8a52-dc64aaa6edbb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:06.032517 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e005474a-07a8-46aa-9f94-f75811491ac5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:06.033553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e005474a-07a8-46aa-9f94-f75811491ac5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:06.038717 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-80e860f7-e1fb-46cf-8a52-dc64aaa6edbb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1365 microversion: 2.1 time: 0.277120 Aug 18 11:31:06.040727 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 679/1382] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:05 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:06.054008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e005474a-07a8-46aa-9f94-f75811491ac5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:06.054692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e005474a-07a8-46aa-9f94-f75811491ac5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:06.055233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e005474a-07a8-46aa-9f94-f75811491ac5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:06.056073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e005474a-07a8-46aa-9f94-f75811491ac5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:06.056633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e005474a-07a8-46aa-9f94-f75811491ac5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:06.057160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e005474a-07a8-46aa-9f94-f75811491ac5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:06.409803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-109fd813-d8d3-4d35-83b3-fdf6967dfb4a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:06.410541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-109fd813-d8d3-4d35-83b3-fdf6967dfb4a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:06.416334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:06.428150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-109fd813-d8d3-4d35-83b3-fdf6967dfb4a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:06.428665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-109fd813-d8d3-4d35-83b3-fdf6967dfb4a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:06.429233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-109fd813-d8d3-4d35-83b3-fdf6967dfb4a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:06.434027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-109fd813-d8d3-4d35-83b3-fdf6967dfb4a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:06.434901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-109fd813-d8d3-4d35-83b3-fdf6967dfb4a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:06.435661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-109fd813-d8d3-4d35-83b3-fdf6967dfb4a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:06.672250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-109fd813-d8d3-4d35-83b3-fdf6967dfb4a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:06.673807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e005474a-07a8-46aa-9f94-f75811491ac5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:06.681920 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e005474a-07a8-46aa-9f94-f75811491ac5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1324 microversion: 2.1 time: 0.653584 Aug 18 11:31:06.683432 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 704/1383] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:06 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1324 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:06.693253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d5a6f72b-3ac3-4bea-b128-852884123061 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:06.702252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-109fd813-d8d3-4d35-83b3-fdf6967dfb4a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:06.704478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-109fd813-d8d3-4d35-83b3-fdf6967dfb4a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:06.705926 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-109fd813-d8d3-4d35-83b3-fdf6967dfb4a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.300380 Aug 18 11:31:06.707076 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 680/1384] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:06 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:31:06.707344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d5a6f72b-3ac3-4bea-b128-852884123061 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:06.712712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1387c01c-8f67-4add-a648-6d3a1fd9ee3a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:06.713710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1387c01c-8f67-4add-a648-6d3a1fd9ee3a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:06.720399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5a6f72b-3ac3-4bea-b128-852884123061 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:06.721143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5a6f72b-3ac3-4bea-b128-852884123061 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:06.721811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5a6f72b-3ac3-4bea-b128-852884123061 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:06.722464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1387c01c-8f67-4add-a648-6d3a1fd9ee3a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:06.723038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5a6f72b-3ac3-4bea-b128-852884123061 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:06.723170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1387c01c-8f67-4add-a648-6d3a1fd9ee3a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:06.723692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1387c01c-8f67-4add-a648-6d3a1fd9ee3a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:06.724017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5a6f72b-3ac3-4bea-b128-852884123061 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:06.724648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5a6f72b-3ac3-4bea-b128-852884123061 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:06.724899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1387c01c-8f67-4add-a648-6d3a1fd9ee3a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:06.725460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1387c01c-8f67-4add-a648-6d3a1fd9ee3a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:06.726006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1387c01c-8f67-4add-a648-6d3a1fd9ee3a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:06.956080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=16 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:07.065057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1387c01c-8f67-4add-a648-6d3a1fd9ee3a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:07.075742 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1387c01c-8f67-4add-a648-6d3a1fd9ee3a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1482 microversion: 2.1 time: 0.367131 Aug 18 11:31:07.077330 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 681/1385] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:06 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1482 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:07.084151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-011e454e-6a72-425f-b5d0-9f001a6aeaa1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f8d6b80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:07.163900 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-011e454e-6a72-425f-b5d0-9f001a6aeaa1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.085276 Aug 18 11:31:07.164855 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 682/1386] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:07 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:07.169660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d8ec24a6-1909-4044-9c7c-2ef79307bf92 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:07.171420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d8ec24a6-1909-4044-9c7c-2ef79307bf92 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:07.179470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8ec24a6-1909-4044-9c7c-2ef79307bf92 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:07.180223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8ec24a6-1909-4044-9c7c-2ef79307bf92 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:07.180962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8ec24a6-1909-4044-9c7c-2ef79307bf92 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:07.181911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8ec24a6-1909-4044-9c7c-2ef79307bf92 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:07.182851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8ec24a6-1909-4044-9c7c-2ef79307bf92 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:07.183568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8ec24a6-1909-4044-9c7c-2ef79307bf92 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:07.345431 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d5a6f72b-3ac3-4bea-b128-852884123061 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:07.353835 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d5a6f72b-3ac3-4bea-b128-852884123061 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.664328 Aug 18 11:31:07.360379 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 705/1387] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:06 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:07.365144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9e35aa78-4d0e-4214-8083-a637509b80c5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:07.365767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9e35aa78-4d0e-4214-8083-a637509b80c5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:07.388496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e35aa78-4d0e-4214-8083-a637509b80c5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:07.389244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e35aa78-4d0e-4214-8083-a637509b80c5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:07.389727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e35aa78-4d0e-4214-8083-a637509b80c5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:07.390471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e35aa78-4d0e-4214-8083-a637509b80c5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:07.391070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e35aa78-4d0e-4214-8083-a637509b80c5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:07.395736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e35aa78-4d0e-4214-8083-a637509b80c5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:07.469210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d8ec24a6-1909-4044-9c7c-2ef79307bf92 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:07.479082 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d8ec24a6-1909-4044-9c7c-2ef79307bf92 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 200 len: 1367 microversion: 2.1 time: 0.312880 Aug 18 11:31:07.480219 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 683/1388] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:07 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:07.486575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f4b1f576-8802-4aae-a26f-70bde00621b8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:07.487088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f4b1f576-8802-4aae-a26f-70bde00621b8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:07.497841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4b1f576-8802-4aae-a26f-70bde00621b8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:07.499279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4b1f576-8802-4aae-a26f-70bde00621b8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:07.499911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4b1f576-8802-4aae-a26f-70bde00621b8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:07.501280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4b1f576-8802-4aae-a26f-70bde00621b8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:07.501931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4b1f576-8802-4aae-a26f-70bde00621b8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:07.502954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4b1f576-8802-4aae-a26f-70bde00621b8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:07.637173 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f4b1f576-8802-4aae-a26f-70bde00621b8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155580 Aug 18 11:31:07.647428 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 684/1389] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:31:07 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:07.705557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-710675f0-c6ec-4474-9579-2c49e48d4d76 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:07.715512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-710675f0-c6ec-4474-9579-2c49e48d4d76 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:07.727566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-710675f0-c6ec-4474-9579-2c49e48d4d76 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:07.728450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-710675f0-c6ec-4474-9579-2c49e48d4d76 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:07.729134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-710675f0-c6ec-4474-9579-2c49e48d4d76 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:07.731367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-710675f0-c6ec-4474-9579-2c49e48d4d76 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:07.732315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-710675f0-c6ec-4474-9579-2c49e48d4d76 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:07.736080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-710675f0-c6ec-4474-9579-2c49e48d4d76 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:08.458936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9e35aa78-4d0e-4214-8083-a637509b80c5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:08.481715 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9e35aa78-4d0e-4214-8083-a637509b80c5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1365 microversion: 2.1 time: 1.120128 Aug 18 11:31:08.497526 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 706/1390] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:07 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1365 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:08.504552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a9fec360-bb5d-4ee7-974a-7412bf3b54d8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:08.510128 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a9fec360-bb5d-4ee7-974a-7412bf3b54d8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:08.526836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9fec360-bb5d-4ee7-974a-7412bf3b54d8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:08.528022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9fec360-bb5d-4ee7-974a-7412bf3b54d8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:08.530684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9fec360-bb5d-4ee7-974a-7412bf3b54d8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:08.533910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9fec360-bb5d-4ee7-974a-7412bf3b54d8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:08.534657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9fec360-bb5d-4ee7-974a-7412bf3b54d8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:08.539006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9fec360-bb5d-4ee7-974a-7412bf3b54d8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:08.629085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-710675f0-c6ec-4474-9579-2c49e48d4d76 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:08.645430 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-710675f0-c6ec-4474-9579-2c49e48d4d76 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1324 microversion: 2.1 time: 0.939630 Aug 18 11:31:08.650360 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 685/1391] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:07 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1324 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:08.688491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c6d3ff44-c6b5-4119-804e-147c4226b623 req-fd5bd018-faf4-45e3-88aa-633d1575b355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8", "name": "network-vif-plugged", "status": "completed", "tag": "3fa92fbf-bba6-4b83-9017-4544457a86cb"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:08.758895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c6d3ff44-c6b5-4119-804e-147c4226b623 req-fd5bd018-faf4-45e3-88aa-633d1575b355 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:08.760480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c6d3ff44-c6b5-4119-804e-147c4226b623 req-fd5bd018-faf4-45e3-88aa-633d1575b355 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:08.761461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c6d3ff44-c6b5-4119-804e-147c4226b623 req-fd5bd018-faf4-45e3-88aa-633d1575b355 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:08.796923 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c6d3ff44-c6b5-4119-804e-147c4226b623 req-fd5bd018-faf4-45e3-88aa-633d1575b355 service nova] Creating event network-vif-plugged:3fa92fbf-bba6-4b83-9017-4544457a86cb for instance bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 on n-h1-853611-3 Aug 18 11:31:08.811785 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c6d3ff44-c6b5-4119-804e-147c4226b623 req-fd5bd018-faf4-45e3-88aa-633d1575b355 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158039 Aug 18 11:31:08.814204 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 686/1392] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:08.820872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eba321f9-13ab-4e8e-8c8c-b5d037b30b3d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f91c820>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:08.937483 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eba321f9-13ab-4e8e-8c8c-b5d037b30b3d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.120680 Aug 18 11:31:08.939335 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 687/1393] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:08 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:08.954536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b9cd2c0a-bc4c-4163-a475-c14bdd9f333a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:08.957723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b9cd2c0a-bc4c-4163-a475-c14bdd9f333a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:08.975014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9cd2c0a-bc4c-4163-a475-c14bdd9f333a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:08.984698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9cd2c0a-bc4c-4163-a475-c14bdd9f333a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:08.985862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9cd2c0a-bc4c-4163-a475-c14bdd9f333a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:08.986897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9cd2c0a-bc4c-4163-a475-c14bdd9f333a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:08.988054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9cd2c0a-bc4c-4163-a475-c14bdd9f333a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:08.989900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9cd2c0a-bc4c-4163-a475-c14bdd9f333a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:09.205010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a9fec360-bb5d-4ee7-974a-7412bf3b54d8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:09.215808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a9fec360-bb5d-4ee7-974a-7412bf3b54d8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:09.233429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a9fec360-bb5d-4ee7-974a-7412bf3b54d8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:09.250886 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a9fec360-bb5d-4ee7-974a-7412bf3b54d8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.747813 Aug 18 11:31:09.254556 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 707/1394] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:08 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:09.275751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e7cf40c5-39ec-4eb3-b599-e5668c56aa46 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:09.277074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e7cf40c5-39ec-4eb3-b599-e5668c56aa46 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:09.290188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7cf40c5-39ec-4eb3-b599-e5668c56aa46 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:09.291938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7cf40c5-39ec-4eb3-b599-e5668c56aa46 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:09.303884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7cf40c5-39ec-4eb3-b599-e5668c56aa46 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:09.304970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7cf40c5-39ec-4eb3-b599-e5668c56aa46 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:09.306829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7cf40c5-39ec-4eb3-b599-e5668c56aa46 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:09.307534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7cf40c5-39ec-4eb3-b599-e5668c56aa46 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:09.473339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b9cd2c0a-bc4c-4163-a475-c14bdd9f333a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:09.490784 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b9cd2c0a-bc4c-4163-a475-c14bdd9f333a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.548353 Aug 18 11:31:09.496939 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 688/1395] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:08 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:09.519428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cba00bd3-858c-4908-a20a-d5f856028303 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:09.520434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cba00bd3-858c-4908-a20a-d5f856028303 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:09.531502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cba00bd3-858c-4908-a20a-d5f856028303 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:09.532460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cba00bd3-858c-4908-a20a-d5f856028303 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:09.533666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cba00bd3-858c-4908-a20a-d5f856028303 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:09.539518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cba00bd3-858c-4908-a20a-d5f856028303 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:09.540518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cba00bd3-858c-4908-a20a-d5f856028303 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:09.542647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cba00bd3-858c-4908-a20a-d5f856028303 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:09.870056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cba00bd3-858c-4908-a20a-d5f856028303 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:09.881300 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cba00bd3-858c-4908-a20a-d5f856028303 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1365 microversion: 2.1 time: 0.369614 Aug 18 11:31:09.884500 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 689/1396] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:09 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1365 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:09.898654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a603eb5-4cd7-4fb7-98c3-154eb1ecdf33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:09.900615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6a603eb5-4cd7-4fb7-98c3-154eb1ecdf33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:09.917749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a603eb5-4cd7-4fb7-98c3-154eb1ecdf33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:09.920778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a603eb5-4cd7-4fb7-98c3-154eb1ecdf33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:09.921457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a603eb5-4cd7-4fb7-98c3-154eb1ecdf33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:09.922664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a603eb5-4cd7-4fb7-98c3-154eb1ecdf33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:09.927488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a603eb5-4cd7-4fb7-98c3-154eb1ecdf33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:09.928969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a603eb5-4cd7-4fb7-98c3-154eb1ecdf33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:10.417023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6a603eb5-4cd7-4fb7-98c3-154eb1ecdf33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:10.433686 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6a603eb5-4cd7-4fb7-98c3-154eb1ecdf33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1324 microversion: 2.1 time: 0.544806 Aug 18 11:31:10.435037 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 690/1397] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:09 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1324 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:10.450792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-817f68e5-c061-4305-abf8-3edb7dc04c37 req-d6fed53b-3e7f-4fba-b798-1d73f4d93350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18b9b772-9949-4239-a522-78ea800d8223", "name": "network-vif-unplugged", "status": "completed", "tag": "1e4bf72d-8bb8-436e-91c5-02acd25d351b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:10.481879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-817f68e5-c061-4305-abf8-3edb7dc04c37 req-d6fed53b-3e7f-4fba-b798-1d73f4d93350 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:10.484444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-817f68e5-c061-4305-abf8-3edb7dc04c37 req-d6fed53b-3e7f-4fba-b798-1d73f4d93350 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:10.485199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-817f68e5-c061-4305-abf8-3edb7dc04c37 req-d6fed53b-3e7f-4fba-b798-1d73f4d93350 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:10.500136 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-817f68e5-c061-4305-abf8-3edb7dc04c37 req-d6fed53b-3e7f-4fba-b798-1d73f4d93350 service nova] Creating event network-vif-unplugged:1e4bf72d-8bb8-436e-91c5-02acd25d351b for instance 18b9b772-9949-4239-a522-78ea800d8223 on n-h1-853611-3 Aug 18 11:31:10.506590 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-817f68e5-c061-4305-abf8-3edb7dc04c37 req-d6fed53b-3e7f-4fba-b798-1d73f4d93350 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067136 Aug 18 11:31:10.507810 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 691/1398] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:10.517244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6c4e2c86-46a1-4297-8ed4-6d1a98bc2bda tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f9621f0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:10.533019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e7cf40c5-39ec-4eb3-b599-e5668c56aa46 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:10.540838 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e7cf40c5-39ec-4eb3-b599-e5668c56aa46 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 200 len: 1367 microversion: 2.1 time: 1.284959 Aug 18 11:31:10.554580 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 708/1399] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:09 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 1367 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:10.560026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-43b2561e-2032-4a45-ba62-6a64f38831d5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:10.561097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-43b2561e-2032-4a45-ba62-6a64f38831d5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:10.567784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-43b2561e-2032-4a45-ba62-6a64f38831d5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:10.568591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-43b2561e-2032-4a45-ba62-6a64f38831d5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:10.569236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-43b2561e-2032-4a45-ba62-6a64f38831d5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:10.570375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-43b2561e-2032-4a45-ba62-6a64f38831d5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:10.571134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-43b2561e-2032-4a45-ba62-6a64f38831d5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:10.571734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-43b2561e-2032-4a45-ba62-6a64f38831d5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:10.620798 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6c4e2c86-46a1-4297-8ed4-6d1a98bc2bda tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.111179 Aug 18 11:31:10.622517 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 692/1400] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:10 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:10.628470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b90be44-7f96-4b84-84a1-639374fa530f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:10.629462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b90be44-7f96-4b84-84a1-639374fa530f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:10.637467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b90be44-7f96-4b84-84a1-639374fa530f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:10.638595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b90be44-7f96-4b84-84a1-639374fa530f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:10.639431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b90be44-7f96-4b84-84a1-639374fa530f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:10.642782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b90be44-7f96-4b84-84a1-639374fa530f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:10.643520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b90be44-7f96-4b84-84a1-639374fa530f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:10.644321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b90be44-7f96-4b84-84a1-639374fa530f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:10.872457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-43b2561e-2032-4a45-ba62-6a64f38831d5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:10.890016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-43b2561e-2032-4a45-ba62-6a64f38831d5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:10.891601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-43b2561e-2032-4a45-ba62-6a64f38831d5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:10.892821 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-43b2561e-2032-4a45-ba62-6a64f38831d5 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.336840 Aug 18 11:31:10.897495 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 709/1401] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:10 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:10.914329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-c6f89f20-fbf0-4086-9a04-91c13b4153e7 req-358730bf-7a81-46ec-a772-8bab9d662a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ebb25c-67fd-4720-aaa6-7f85e22a97b3", "tag": "0026f65d-53f0-4762-89f1-046f21b2ca8b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:10.928656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5b90be44-7f96-4b84-84a1-639374fa530f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:10.942785 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b90be44-7f96-4b84-84a1-639374fa530f tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1482 microversion: 2.1 time: 0.317911 Aug 18 11:31:10.945044 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c6f89f20-fbf0-4086-9a04-91c13b4153e7 req-358730bf-7a81-46ec-a772-8bab9d662a36 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:10.945377 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 693/1402] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:10 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1482 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:10.945989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c6f89f20-fbf0-4086-9a04-91c13b4153e7 req-358730bf-7a81-46ec-a772-8bab9d662a36 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:10.951302 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c6f89f20-fbf0-4086-9a04-91c13b4153e7 req-358730bf-7a81-46ec-a772-8bab9d662a36 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:10.955013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a58ebecd-fad9-4620-82f1-f1de6f7f6d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:10.960317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a58ebecd-fad9-4620-82f1-f1de6f7f6d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:10.977843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a58ebecd-fad9-4620-82f1-f1de6f7f6d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:10.978183 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-c6f89f20-fbf0-4086-9a04-91c13b4153e7 req-358730bf-7a81-46ec-a772-8bab9d662a36 service nova] Creating event network-changed:0026f65d-53f0-4762-89f1-046f21b2ca8b for instance a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 on n-h2-853611-3 Aug 18 11:31:10.978959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a58ebecd-fad9-4620-82f1-f1de6f7f6d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:10.980835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a58ebecd-fad9-4620-82f1-f1de6f7f6d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:10.981702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a58ebecd-fad9-4620-82f1-f1de6f7f6d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:10.983432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a58ebecd-fad9-4620-82f1-f1de6f7f6d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:10.986268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a58ebecd-fad9-4620-82f1-f1de6f7f6d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:10.991104 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-c6f89f20-fbf0-4086-9a04-91c13b4153e7 req-358730bf-7a81-46ec-a772-8bab9d662a36 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088803 Aug 18 11:31:10.995760 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 710/1403] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:11.024113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f71bb38a-3ea7-4b5b-b860-3b56c7754775 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:11.025237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f71bb38a-3ea7-4b5b-b860-3b56c7754775 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:11.039471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f71bb38a-3ea7-4b5b-b860-3b56c7754775 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:11.044426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f71bb38a-3ea7-4b5b-b860-3b56c7754775 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:11.045281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f71bb38a-3ea7-4b5b-b860-3b56c7754775 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:11.046594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f71bb38a-3ea7-4b5b-b860-3b56c7754775 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:11.047298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f71bb38a-3ea7-4b5b-b860-3b56c7754775 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:11.047985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f71bb38a-3ea7-4b5b-b860-3b56c7754775 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:11.286542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a58ebecd-fad9-4620-82f1-f1de6f7f6d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:11.309069 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a58ebecd-fad9-4620-82f1-f1de6f7f6d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.361754 Aug 18 11:31:11.314874 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 694/1404] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:10 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:11.319900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-6b3adb06-8faa-47ac-ae4f-e12b47c3a2c4 req-fafa65cb-020c-4db7-876e-28b154d8f498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba680fc7-c565-43cb-9551-f9f71f1f66f4", "name": "network-vif-plugged", "status": "completed", "tag": "5e7be3c3-f066-4799-bcf8-bdf28f819406"}, {"server_uuid": "a2a906b8-26ea-4413-bed0-9c6f7a6be35c", "name": "network-vif-plugged", "status": "completed", "tag": "6b2318ca-00cc-4182-8517-7647cceb2c66"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:11.338184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6b3adb06-8faa-47ac-ae4f-e12b47c3a2c4 req-fafa65cb-020c-4db7-876e-28b154d8f498 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:11.339227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6b3adb06-8faa-47ac-ae4f-e12b47c3a2c4 req-fafa65cb-020c-4db7-876e-28b154d8f498 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:11.340211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6b3adb06-8faa-47ac-ae4f-e12b47c3a2c4 req-fafa65cb-020c-4db7-876e-28b154d8f498 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:11.345512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:11.358809 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6b3adb06-8faa-47ac-ae4f-e12b47c3a2c4 req-fafa65cb-020c-4db7-876e-28b154d8f498 service nova] Creating event network-vif-plugged:5e7be3c3-f066-4799-bcf8-bdf28f819406 for instance ba680fc7-c565-43cb-9551-f9f71f1f66f4 on n-h2-853611-3 Aug 18 11:31:11.359758 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6b3adb06-8faa-47ac-ae4f-e12b47c3a2c4 req-fafa65cb-020c-4db7-876e-28b154d8f498 service nova] Creating event network-vif-plugged:6b2318ca-00cc-4182-8517-7647cceb2c66 for instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c on n-h1-853611-3 Aug 18 11:31:11.369946 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-6b3adb06-8faa-47ac-ae4f-e12b47c3a2c4 req-fafa65cb-020c-4db7-876e-28b154d8f498 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053635 Aug 18 11:31:11.371499 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 695/1405] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:11.460477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-380e3f20-4ef6-4460-8a0d-8a52fefe16e9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:11.461648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-380e3f20-4ef6-4460-8a0d-8a52fefe16e9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:11.475071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-380e3f20-4ef6-4460-8a0d-8a52fefe16e9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:11.477941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-380e3f20-4ef6-4460-8a0d-8a52fefe16e9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:11.478717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-380e3f20-4ef6-4460-8a0d-8a52fefe16e9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:11.480865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-380e3f20-4ef6-4460-8a0d-8a52fefe16e9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:11.481649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-380e3f20-4ef6-4460-8a0d-8a52fefe16e9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:11.482395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-380e3f20-4ef6-4460-8a0d-8a52fefe16e9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:11.866331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-380e3f20-4ef6-4460-8a0d-8a52fefe16e9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:11.880231 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-380e3f20-4ef6-4460-8a0d-8a52fefe16e9 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1324 microversion: 2.1 time: 0.425056 Aug 18 11:31:11.891032 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 696/1406] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:11 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1324 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:11.902513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bf468deb-1774-4f4f-94c1-006850d53d56 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:11.907297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bf468deb-1774-4f4f-94c1-006850d53d56 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:11.934140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf468deb-1774-4f4f-94c1-006850d53d56 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:11.938974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf468deb-1774-4f4f-94c1-006850d53d56 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:11.940026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf468deb-1774-4f4f-94c1-006850d53d56 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:11.945521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf468deb-1774-4f4f-94c1-006850d53d56 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:11.948345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf468deb-1774-4f4f-94c1-006850d53d56 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:11.949284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf468deb-1774-4f4f-94c1-006850d53d56 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:12.246342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f71bb38a-3ea7-4b5b-b860-3b56c7754775 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:12.263301 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f71bb38a-3ea7-4b5b-b860-3b56c7754775 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1365 microversion: 2.1 time: 1.265309 Aug 18 11:31:12.264769 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 711/1407] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:10 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1365 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:12.273141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3a580ad2-b3a9-41de-b8d7-2d9156173374 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f92c160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:12.313215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bf468deb-1774-4f4f-94c1-006850d53d56 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:12.330471 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bf468deb-1774-4f4f-94c1-006850d53d56 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 200 len: 1367 microversion: 2.1 time: 0.432584 Aug 18 11:31:12.344345 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 697/1408] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:11 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 1367 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:12.365827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0709faf4-7a52-44d9-81c6-45a355eb74bb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:12.366514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0709faf4-7a52-44d9-81c6-45a355eb74bb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:12.377713 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3a580ad2-b3a9-41de-b8d7-2d9156173374 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.111638 Aug 18 11:31:12.385291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0709faf4-7a52-44d9-81c6-45a355eb74bb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:12.385791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0709faf4-7a52-44d9-81c6-45a355eb74bb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:12.386420 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 712/1409] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:12 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:12.386881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0709faf4-7a52-44d9-81c6-45a355eb74bb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:12.387668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0709faf4-7a52-44d9-81c6-45a355eb74bb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:12.388216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0709faf4-7a52-44d9-81c6-45a355eb74bb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:12.388664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0709faf4-7a52-44d9-81c6-45a355eb74bb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:12.398138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f2aac038-6217-448d-b5d5-1481a2cf87df tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:12.405739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f2aac038-6217-448d-b5d5-1481a2cf87df tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:12.412979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2aac038-6217-448d-b5d5-1481a2cf87df tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:12.423708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2aac038-6217-448d-b5d5-1481a2cf87df tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:12.424393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2aac038-6217-448d-b5d5-1481a2cf87df tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:12.425482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2aac038-6217-448d-b5d5-1481a2cf87df tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:12.426132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2aac038-6217-448d-b5d5-1481a2cf87df tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:12.428846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2aac038-6217-448d-b5d5-1481a2cf87df tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:12.756296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0709faf4-7a52-44d9-81c6-45a355eb74bb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:12.770644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0709faf4-7a52-44d9-81c6-45a355eb74bb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:12.819362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0709faf4-7a52-44d9-81c6-45a355eb74bb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:12.821050 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0709faf4-7a52-44d9-81c6-45a355eb74bb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.468486 Aug 18 11:31:12.823959 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 698/1410] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:12 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:12.903243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-53168be5-714c-44e6-a722-086d866b24da tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:12.918726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-53168be5-714c-44e6-a722-086d866b24da tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:12.934542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53168be5-714c-44e6-a722-086d866b24da tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:12.935310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53168be5-714c-44e6-a722-086d866b24da tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:12.940160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53168be5-714c-44e6-a722-086d866b24da tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:12.941099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53168be5-714c-44e6-a722-086d866b24da tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:12.941697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53168be5-714c-44e6-a722-086d866b24da tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:12.942276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53168be5-714c-44e6-a722-086d866b24da tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:12.981482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f2aac038-6217-448d-b5d5-1481a2cf87df tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:12.991483 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f2aac038-6217-448d-b5d5-1481a2cf87df tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.601801 Aug 18 11:31:12.996931 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 713/1411] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:12 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:13.012590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-0a7c84ce-8801-4d58-95ad-9444af1fd6a7 req-2d29bb9d-1ad3-42a1-9f90-421341cdfac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18b9b772-9949-4239-a522-78ea800d8223", "tag": "1e4bf72d-8bb8-436e-91c5-02acd25d351b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:13.049075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0a7c84ce-8801-4d58-95ad-9444af1fd6a7 req-2d29bb9d-1ad3-42a1-9f90-421341cdfac5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:13.050390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0a7c84ce-8801-4d58-95ad-9444af1fd6a7 req-2d29bb9d-1ad3-42a1-9f90-421341cdfac5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:13.052345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0a7c84ce-8801-4d58-95ad-9444af1fd6a7 req-2d29bb9d-1ad3-42a1-9f90-421341cdfac5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:13.075140 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-0a7c84ce-8801-4d58-95ad-9444af1fd6a7 req-2d29bb9d-1ad3-42a1-9f90-421341cdfac5 service nova] Creating event network-changed:1e4bf72d-8bb8-436e-91c5-02acd25d351b for instance 18b9b772-9949-4239-a522-78ea800d8223 on n-h1-853611-3 Aug 18 11:31:13.087571 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-0a7c84ce-8801-4d58-95ad-9444af1fd6a7 req-2d29bb9d-1ad3-42a1-9f90-421341cdfac5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087348 Aug 18 11:31:13.091382 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 714/1412] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:13.287176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e17e6675-2862-4eb2-92ba-15cdc569ca8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:13.288706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e17e6675-2862-4eb2-92ba-15cdc569ca8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:13.299198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e17e6675-2862-4eb2-92ba-15cdc569ca8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:13.311352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e17e6675-2862-4eb2-92ba-15cdc569ca8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:13.312133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e17e6675-2862-4eb2-92ba-15cdc569ca8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:13.313091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e17e6675-2862-4eb2-92ba-15cdc569ca8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:13.317337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e17e6675-2862-4eb2-92ba-15cdc569ca8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:13.318088 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e17e6675-2862-4eb2-92ba-15cdc569ca8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:14.203683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-53168be5-714c-44e6-a722-086d866b24da tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:14.215840 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-53168be5-714c-44e6-a722-086d866b24da tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1521 microversion: 2.1 time: 1.317569 Aug 18 11:31:14.228365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 699/1413] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:12 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1521 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:14.241190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d0359778-b959-4eb6-801c-2c4dae6a92b0 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:14.242090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d0359778-b959-4eb6-801c-2c4dae6a92b0 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:14.250243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0359778-b959-4eb6-801c-2c4dae6a92b0 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:14.250924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0359778-b959-4eb6-801c-2c4dae6a92b0 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:14.251246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0359778-b959-4eb6-801c-2c4dae6a92b0 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:14.252338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0359778-b959-4eb6-801c-2c4dae6a92b0 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:14.252957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0359778-b959-4eb6-801c-2c4dae6a92b0 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:14.253705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0359778-b959-4eb6-801c-2c4dae6a92b0 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:14.493857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d0359778-b959-4eb6-801c-2c4dae6a92b0 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:14.503126 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d0359778-b959-4eb6-801c-2c4dae6a92b0 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 200 len: 1558 microversion: 2.1 time: 0.273270 Aug 18 11:31:14.519247 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 700/1414] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:14 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 1558 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:14.524487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-558645b3-4db4-4fa7-8fa9-1483276e5e0d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f9ec550>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:14.577630 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-558645b3-4db4-4fa7-8fa9-1483276e5e0d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.057153 Aug 18 11:31:14.578870 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 701/1415] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:14 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:14.585822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8adde289-0f67-41fa-8b85-a3b610b1513c req-ae62ccc2-fe10-4760-bc14-1dbbc09f1d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb46c1c-c94c-4ea9-942e-82187eb83479", "name": "network-vif-plugged", "status": "completed", "tag": "b659ed49-6503-43dd-9a80-64c66fbb2313"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:14.597852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8adde289-0f67-41fa-8b85-a3b610b1513c req-ae62ccc2-fe10-4760-bc14-1dbbc09f1d34 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:14.598665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8adde289-0f67-41fa-8b85-a3b610b1513c req-ae62ccc2-fe10-4760-bc14-1dbbc09f1d34 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:14.599276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8adde289-0f67-41fa-8b85-a3b610b1513c req-ae62ccc2-fe10-4760-bc14-1dbbc09f1d34 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:14.612232 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8adde289-0f67-41fa-8b85-a3b610b1513c req-ae62ccc2-fe10-4760-bc14-1dbbc09f1d34 service nova] Creating event network-vif-plugged:b659ed49-6503-43dd-9a80-64c66fbb2313 for instance dbb46c1c-c94c-4ea9-942e-82187eb83479 on n-h2-853611-3 Aug 18 11:31:14.618085 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8adde289-0f67-41fa-8b85-a3b610b1513c req-ae62ccc2-fe10-4760-bc14-1dbbc09f1d34 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037388 Aug 18 11:31:14.620719 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 702/1416] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:14.628115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a975dac-84bb-4976-85d4-557cf4594076 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:14.629006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a975dac-84bb-4976-85d4-557cf4594076 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:14.635998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a975dac-84bb-4976-85d4-557cf4594076 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:14.636768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a975dac-84bb-4976-85d4-557cf4594076 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:14.637391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a975dac-84bb-4976-85d4-557cf4594076 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:14.638328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a975dac-84bb-4976-85d4-557cf4594076 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:14.639079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a975dac-84bb-4976-85d4-557cf4594076 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:14.639679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a975dac-84bb-4976-85d4-557cf4594076 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:14.929188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a975dac-84bb-4976-85d4-557cf4594076 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:14.941357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a975dac-84bb-4976-85d4-557cf4594076 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:14.949051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a975dac-84bb-4976-85d4-557cf4594076 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:14.951758 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a975dac-84bb-4976-85d4-557cf4594076 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.329666 Aug 18 11:31:14.952610 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 703/1417] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:14 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:14.963827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-166c4a10-43fb-4008-99c4-2433a8841084 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:14.968448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-166c4a10-43fb-4008-99c4-2433a8841084 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:14.981357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-166c4a10-43fb-4008-99c4-2433a8841084 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:14.983167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-166c4a10-43fb-4008-99c4-2433a8841084 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:14.983704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-166c4a10-43fb-4008-99c4-2433a8841084 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:14.985974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-166c4a10-43fb-4008-99c4-2433a8841084 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:14.987062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-166c4a10-43fb-4008-99c4-2433a8841084 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:14.987062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-166c4a10-43fb-4008-99c4-2433a8841084 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:15.336556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-166c4a10-43fb-4008-99c4-2433a8841084 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:15.348360 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-166c4a10-43fb-4008-99c4-2433a8841084 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.393732 Aug 18 11:31:15.351606 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 704/1418] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:14 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:15.362151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d0559149-ca21-403b-9d0f-7b670a5eaccf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:15.366055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d0559149-ca21-403b-9d0f-7b670a5eaccf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:15.382192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0559149-ca21-403b-9d0f-7b670a5eaccf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:15.382986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0559149-ca21-403b-9d0f-7b670a5eaccf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:15.383648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0559149-ca21-403b-9d0f-7b670a5eaccf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:15.384563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0559149-ca21-403b-9d0f-7b670a5eaccf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:15.385194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0559149-ca21-403b-9d0f-7b670a5eaccf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:15.385786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0559149-ca21-403b-9d0f-7b670a5eaccf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:15.448375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d0559149-ca21-403b-9d0f-7b670a5eaccf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:31:15.571684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e17e6675-2862-4eb2-92ba-15cdc569ca8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:15.589000 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e17e6675-2862-4eb2-92ba-15cdc569ca8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1365 microversion: 2.1 time: 2.306140 Aug 18 11:31:15.604668 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 715/1419] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:13 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1365 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:15.617398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0fabce60-33be-4fab-bbf0-afecaf177c40 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:15.620198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0fabce60-33be-4fab-bbf0-afecaf177c40 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:15.631971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fabce60-33be-4fab-bbf0-afecaf177c40 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:15.633497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fabce60-33be-4fab-bbf0-afecaf177c40 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:15.634031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fabce60-33be-4fab-bbf0-afecaf177c40 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:15.635506 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fabce60-33be-4fab-bbf0-afecaf177c40 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:15.636954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fabce60-33be-4fab-bbf0-afecaf177c40 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:15.639671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fabce60-33be-4fab-bbf0-afecaf177c40 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:15.703462 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d0559149-ca21-403b-9d0f-7b670a5eaccf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 204 len: 0 microversion: 2.1 time: 0.349548 Aug 18 11:31:15.705762 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 705/1420] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:31:15 2022] DELETE /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:31:15.726486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76392ece-1a44-45b0-b926-f3c39e3933ee tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f9771f0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:15.823635 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76392ece-1a44-45b0-b926-f3c39e3933ee tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.111972 Aug 18 11:31:15.825466 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 706/1421] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:15 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:15.835072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5fbcfb60-67de-4e21-a0ec-30b6454547e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:15.835861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5fbcfb60-67de-4e21-a0ec-30b6454547e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:15.858735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fbcfb60-67de-4e21-a0ec-30b6454547e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:15.859241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fbcfb60-67de-4e21-a0ec-30b6454547e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:15.859686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fbcfb60-67de-4e21-a0ec-30b6454547e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:15.860417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fbcfb60-67de-4e21-a0ec-30b6454547e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:15.860881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fbcfb60-67de-4e21-a0ec-30b6454547e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:15.861312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fbcfb60-67de-4e21-a0ec-30b6454547e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:15.893918 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0fabce60-33be-4fab-bbf0-afecaf177c40 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.285974 Aug 18 11:31:15.894895 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 716/1422] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:31:15 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-interface => generated 285 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:15.978179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d303d725-d0cc-4d87-a2fa-eed37f64176a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:15.979882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d303d725-d0cc-4d87-a2fa-eed37f64176a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:15.994996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d303d725-d0cc-4d87-a2fa-eed37f64176a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:16.000853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d303d725-d0cc-4d87-a2fa-eed37f64176a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:16.001956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d303d725-d0cc-4d87-a2fa-eed37f64176a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:16.002967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d303d725-d0cc-4d87-a2fa-eed37f64176a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:16.004478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d303d725-d0cc-4d87-a2fa-eed37f64176a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:16.005749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d303d725-d0cc-4d87-a2fa-eed37f64176a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:16.234085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5fbcfb60-67de-4e21-a0ec-30b6454547e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:16.244268 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5fbcfb60-67de-4e21-a0ec-30b6454547e5 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1527 microversion: 2.1 time: 0.416414 Aug 18 11:31:16.261103 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 707/1423] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:15 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1527 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:16.345549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d303d725-d0cc-4d87-a2fa-eed37f64176a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:16.361405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d303d725-d0cc-4d87-a2fa-eed37f64176a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:16.362961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d303d725-d0cc-4d87-a2fa-eed37f64176a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:16.364162 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d303d725-d0cc-4d87-a2fa-eed37f64176a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.391503 Aug 18 11:31:16.364739 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 717/1424] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:15 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:16.381470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1092656a-8f04-45fb-a0ee-f301e638507e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:16.382489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1092656a-8f04-45fb-a0ee-f301e638507e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:16.390697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1092656a-8f04-45fb-a0ee-f301e638507e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:16.391197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1092656a-8f04-45fb-a0ee-f301e638507e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:16.391635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1092656a-8f04-45fb-a0ee-f301e638507e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:16.392348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1092656a-8f04-45fb-a0ee-f301e638507e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:16.392803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1092656a-8f04-45fb-a0ee-f301e638507e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:16.393230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1092656a-8f04-45fb-a0ee-f301e638507e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:16.618271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2043d18d-4679-4d68-8655-bf49b812fa2e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:16.619399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2043d18d-4679-4d68-8655-bf49b812fa2e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:16.631109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2043d18d-4679-4d68-8655-bf49b812fa2e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:16.632095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2043d18d-4679-4d68-8655-bf49b812fa2e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:16.632717 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2043d18d-4679-4d68-8655-bf49b812fa2e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:16.634730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2043d18d-4679-4d68-8655-bf49b812fa2e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:16.635875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2043d18d-4679-4d68-8655-bf49b812fa2e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:16.637254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2043d18d-4679-4d68-8655-bf49b812fa2e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:16.844968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1092656a-8f04-45fb-a0ee-f301e638507e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:16.857127 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1092656a-8f04-45fb-a0ee-f301e638507e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.483556 Aug 18 11:31:16.864843 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 708/1425] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:16 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:16.869744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-75b95fe6-b91e-42fd-8bb9-00b396fb0be7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f8f5700>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:17.000926 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-75b95fe6-b91e-42fd-8bb9-00b396fb0be7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.134361 Aug 18 11:31:17.002674 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 709/1426] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:16 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:17.029882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2043d18d-4679-4d68-8655-bf49b812fa2e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:17.076237 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2043d18d-4679-4d68-8655-bf49b812fa2e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1551 microversion: 2.1 time: 0.465221 Aug 18 11:31:17.091797 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 718/1427] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:16 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1551 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:17.105473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8dbfce5-eb47-47e3-ab73-84b36f63cdcd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:17.105971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e8dbfce5-eb47-47e3-ab73-84b36f63cdcd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:17.120283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8dbfce5-eb47-47e3-ab73-84b36f63cdcd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:17.120785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8dbfce5-eb47-47e3-ab73-84b36f63cdcd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:17.121219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8dbfce5-eb47-47e3-ab73-84b36f63cdcd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:17.121930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8dbfce5-eb47-47e3-ab73-84b36f63cdcd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:17.138236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8dbfce5-eb47-47e3-ab73-84b36f63cdcd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:17.139650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8dbfce5-eb47-47e3-ab73-84b36f63cdcd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:17.328235 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e8dbfce5-eb47-47e3-ab73-84b36f63cdcd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.228780 Aug 18 11:31:17.329447 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 710/1428] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:31:17 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/os-interface => generated 284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:17.346379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26a1fcf0-40f2-4a02-8ec7-047eb43e28bf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:17.347318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26a1fcf0-40f2-4a02-8ec7-047eb43e28bf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:17.365669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26a1fcf0-40f2-4a02-8ec7-047eb43e28bf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:17.368369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26a1fcf0-40f2-4a02-8ec7-047eb43e28bf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:17.369933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26a1fcf0-40f2-4a02-8ec7-047eb43e28bf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:17.372630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26a1fcf0-40f2-4a02-8ec7-047eb43e28bf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:17.374737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26a1fcf0-40f2-4a02-8ec7-047eb43e28bf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:17.375419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26a1fcf0-40f2-4a02-8ec7-047eb43e28bf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:17.524149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-121215140", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "3f6e42f5-884c-475b-8c6f-d14bf9ade0d8"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:17.618642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] validate_networks() for [('3f6e42f5-884c-475b-8c6f-d14bf9ade0d8', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:31:18.040969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-26a1fcf0-40f2-4a02-8ec7-047eb43e28bf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:18.061588 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-26a1fcf0-40f2-4a02-8ec7-047eb43e28bf tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1527 microversion: 2.1 time: 0.722886 Aug 18 11:31:18.062377 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 711/1429] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:17 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1527 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:18.067138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8244a81b-9612-40c0-bde9-b46c77ab178f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:18.067750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8244a81b-9612-40c0-bde9-b46c77ab178f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:18.089745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8244a81b-9612-40c0-bde9-b46c77ab178f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:18.090252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8244a81b-9612-40c0-bde9-b46c77ab178f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:18.090721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8244a81b-9612-40c0-bde9-b46c77ab178f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:18.091999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8244a81b-9612-40c0-bde9-b46c77ab178f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:18.092461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8244a81b-9612-40c0-bde9-b46c77ab178f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:18.092895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8244a81b-9612-40c0-bde9-b46c77ab178f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:18.202233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:31:18.203586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:31:18.205536 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:31:18.206167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:31:18.206941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:31:18.225944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:18.226794 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:18.230628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:18.232592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:18.235476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:18.236176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:18.283752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Getting quotas for project 981fdc1f21994baeaf839349c8831d89. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:31:18.307279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Getting quotas for user e9acdefe639f4a65b044946df5e14125 and project 981fdc1f21994baeaf839349c8831d89. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:31:18.332248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:31:18.334842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:31:18.456168 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4f1f2135-0f0c-4935-97ae-40f2faaca814 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.215806 Aug 18 11:31:18.459534 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 719/1430] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:31:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:31:18.477311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6382a6bf-02df-4bfb-a0b7-6ffd41146ac1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:18.480017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6382a6bf-02df-4bfb-a0b7-6ffd41146ac1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:18.492179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:18.502034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6382a6bf-02df-4bfb-a0b7-6ffd41146ac1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:18.502862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6382a6bf-02df-4bfb-a0b7-6ffd41146ac1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:18.508678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6382a6bf-02df-4bfb-a0b7-6ffd41146ac1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:18.509762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6382a6bf-02df-4bfb-a0b7-6ffd41146ac1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:18.510882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6382a6bf-02df-4bfb-a0b7-6ffd41146ac1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:18.512068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6382a6bf-02df-4bfb-a0b7-6ffd41146ac1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:18.900291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6382a6bf-02df-4bfb-a0b7-6ffd41146ac1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:18.919135 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6382a6bf-02df-4bfb-a0b7-6ffd41146ac1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.447515 Aug 18 11:31:18.921014 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 720/1431] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:18 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:18.937019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-73032c30-63e9-4376-befb-5a3e7d70cb3b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f92c0d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:19.025203 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-73032c30-63e9-4376-befb-5a3e7d70cb3b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.097888 Aug 18 11:31:19.026273 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 721/1432] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:18 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:19.051579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e604f9fc-7748-4cb0-b500-419e8abc3e4a tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:19.055014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e604f9fc-7748-4cb0-b500-419e8abc3e4a tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:19.187795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e604f9fc-7748-4cb0-b500-419e8abc3e4a tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9acdefe639f4a65b044946df5e14125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdc1f21994baeaf839349c8831d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:19.198300 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e604f9fc-7748-4cb0-b500-419e8abc3e4a tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 200 len: 1215 microversion: 2.1 time: 0.170707 Aug 18 11:31:19.208557 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 722/1433] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:19 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:19.218049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2b3c63df-f388-4f62-8ff9-591438207b7d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:19.221630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2b3c63df-f388-4f62-8ff9-591438207b7d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:19.241071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b3c63df-f388-4f62-8ff9-591438207b7d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:19.242000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b3c63df-f388-4f62-8ff9-591438207b7d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:19.242716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b3c63df-f388-4f62-8ff9-591438207b7d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:19.243709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b3c63df-f388-4f62-8ff9-591438207b7d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:19.248692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b3c63df-f388-4f62-8ff9-591438207b7d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:19.249515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b3c63df-f388-4f62-8ff9-591438207b7d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:19.569426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2b3c63df-f388-4f62-8ff9-591438207b7d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:19.578983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:19.588060 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2b3c63df-f388-4f62-8ff9-591438207b7d tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1527 microversion: 2.1 time: 0.387176 Aug 18 11:31:19.589402 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 723/1434] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:19 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1527 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:19.808376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-9d8cd576-826c-452d-b965-7c13e809c112 req-0535d031-8b96-4f84-945f-1d5ae067d82a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba680fc7-c565-43cb-9551-f9f71f1f66f4", "tag": "5e7be3c3-f066-4799-bcf8-bdf28f819406"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:19.840576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9d8cd576-826c-452d-b965-7c13e809c112 req-0535d031-8b96-4f84-945f-1d5ae067d82a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:19.841637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9d8cd576-826c-452d-b965-7c13e809c112 req-0535d031-8b96-4f84-945f-1d5ae067d82a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:19.842241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9d8cd576-826c-452d-b965-7c13e809c112 req-0535d031-8b96-4f84-945f-1d5ae067d82a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:19.879540 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-9d8cd576-826c-452d-b965-7c13e809c112 req-0535d031-8b96-4f84-945f-1d5ae067d82a service nova] Creating event network-changed:5e7be3c3-f066-4799-bcf8-bdf28f819406 for instance ba680fc7-c565-43cb-9551-f9f71f1f66f4 on n-h2-853611-3 Aug 18 11:31:19.895543 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-9d8cd576-826c-452d-b965-7c13e809c112 req-0535d031-8b96-4f84-945f-1d5ae067d82a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090892 Aug 18 11:31:19.912059 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 724/1435] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:19.959108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f1878b50-df92-4281-b300-aaa7498244eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:19.969192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f1878b50-df92-4281-b300-aaa7498244eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:19.985959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1878b50-df92-4281-b300-aaa7498244eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:19.986930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1878b50-df92-4281-b300-aaa7498244eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:19.988638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1878b50-df92-4281-b300-aaa7498244eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:19.989707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1878b50-df92-4281-b300-aaa7498244eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:19.990546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1878b50-df92-4281-b300-aaa7498244eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:19.991288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1878b50-df92-4281-b300-aaa7498244eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:20.179327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8244a81b-9612-40c0-bde9-b46c77ab178f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:20.194136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8244a81b-9612-40c0-bde9-b46c77ab178f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:20.198272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8244a81b-9612-40c0-bde9-b46c77ab178f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:20.220959 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8244a81b-9612-40c0-bde9-b46c77ab178f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 2.154495 Aug 18 11:31:20.222278 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 712/1436] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:18 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:20.238688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b0bf819-6928-496b-bad0-bb4cc4e0e929 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f88c4c0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:20.346805 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2b0bf819-6928-496b-bad0-bb4cc4e0e929 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.122757 Aug 18 11:31:20.347729 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 713/1437] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:20 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:20.358564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0cc7ce81-2243-43b6-9d0d-f36a1671fdc7 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:20.359487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0cc7ce81-2243-43b6-9d0d-f36a1671fdc7 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:20.413573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cc7ce81-2243-43b6-9d0d-f36a1671fdc7 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:20.415318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cc7ce81-2243-43b6-9d0d-f36a1671fdc7 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:20.424815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cc7ce81-2243-43b6-9d0d-f36a1671fdc7 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:20.426056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cc7ce81-2243-43b6-9d0d-f36a1671fdc7 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:20.426733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cc7ce81-2243-43b6-9d0d-f36a1671fdc7 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:20.427375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cc7ce81-2243-43b6-9d0d-f36a1671fdc7 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:20.753227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0cc7ce81-2243-43b6-9d0d-f36a1671fdc7 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9acdefe639f4a65b044946df5e14125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdc1f21994baeaf839349c8831d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:20.786101 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0cc7ce81-2243-43b6-9d0d-f36a1671fdc7 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 200 len: 1267 microversion: 2.1 time: 0.436394 Aug 18 11:31:20.799663 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 714/1438] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:20 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 1267 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:20.815665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a10ff93e-00d2-4d1c-81c5-8b3e8e0d1903 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:20.819906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a10ff93e-00d2-4d1c-81c5-8b3e8e0d1903 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:20.875223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a10ff93e-00d2-4d1c-81c5-8b3e8e0d1903 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:20.887127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a10ff93e-00d2-4d1c-81c5-8b3e8e0d1903 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:20.890235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a10ff93e-00d2-4d1c-81c5-8b3e8e0d1903 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:20.905930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a10ff93e-00d2-4d1c-81c5-8b3e8e0d1903 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:20.909209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a10ff93e-00d2-4d1c-81c5-8b3e8e0d1903 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:20.913853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a10ff93e-00d2-4d1c-81c5-8b3e8e0d1903 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:21.273498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a10ff93e-00d2-4d1c-81c5-8b3e8e0d1903 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed6ed454654f4ce0a01d407f18524a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8064d9cbfe6a4a96944cc1d7a1817ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:21.276012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:21.286961 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a10ff93e-00d2-4d1c-81c5-8b3e8e0d1903 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 200 len: 1309 microversion: 2.1 time: 0.478751 Aug 18 11:31:21.291586 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 715/1439] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:20 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 1309 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:21.321600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4675283a-2d19-45ed-9ef3-e1893e464d7f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:21.324124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4675283a-2d19-45ed-9ef3-e1893e464d7f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:21.342172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4675283a-2d19-45ed-9ef3-e1893e464d7f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:21.350664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4675283a-2d19-45ed-9ef3-e1893e464d7f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:21.353420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4675283a-2d19-45ed-9ef3-e1893e464d7f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:21.359604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4675283a-2d19-45ed-9ef3-e1893e464d7f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:21.360643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4675283a-2d19-45ed-9ef3-e1893e464d7f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:21.365199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f1878b50-df92-4281-b300-aaa7498244eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:21.366126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4675283a-2d19-45ed-9ef3-e1893e464d7f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:21.383647 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f1878b50-df92-4281-b300-aaa7498244eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 1.442006 Aug 18 11:31:21.387162 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 725/1440] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:19 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:21.403133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a389f0f0-b8d8-49f0-888f-bbf93ae46cc3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f8820d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:21.500150 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a389f0f0-b8d8-49f0-888f-bbf93ae46cc3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.111487 Aug 18 11:31:21.504174 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 726/1441] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:21 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:21.813434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-838903b9-bc8f-44a6-90c1-c8b009cc1261 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:21.814728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-838903b9-bc8f-44a6-90c1-c8b009cc1261 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:21.865657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-838903b9-bc8f-44a6-90c1-c8b009cc1261 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:21.866616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-838903b9-bc8f-44a6-90c1-c8b009cc1261 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:21.872920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-838903b9-bc8f-44a6-90c1-c8b009cc1261 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:21.874857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-838903b9-bc8f-44a6-90c1-c8b009cc1261 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:21.876718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-838903b9-bc8f-44a6-90c1-c8b009cc1261 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:21.878299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-838903b9-bc8f-44a6-90c1-c8b009cc1261 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:22.078762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4675283a-2d19-45ed-9ef3-e1893e464d7f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:22.102138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4675283a-2d19-45ed-9ef3-e1893e464d7f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:22.108755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4675283a-2d19-45ed-9ef3-e1893e464d7f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:22.117277 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4675283a-2d19-45ed-9ef3-e1893e464d7f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.817469 Aug 18 11:31:22.121105 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 716/1442] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:21 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:22.201367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5b0e1efe-eb84-4d3b-9a7b-20036b7e11ac req-e6ecff55-02eb-463f-a654-05e04d590422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8", "name": "network-vif-deleted", "tag": "3fa92fbf-bba6-4b83-9017-4544457a86cb"}, {"name": "network-changed", "server_uuid": "a2a906b8-26ea-4413-bed0-9c6f7a6be35c", "tag": "6b2318ca-00cc-4182-8517-7647cceb2c66"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:22.236121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5b0e1efe-eb84-4d3b-9a7b-20036b7e11ac req-e6ecff55-02eb-463f-a654-05e04d590422 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:22.238777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5b0e1efe-eb84-4d3b-9a7b-20036b7e11ac req-e6ecff55-02eb-463f-a654-05e04d590422 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:22.239494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5b0e1efe-eb84-4d3b-9a7b-20036b7e11ac req-e6ecff55-02eb-463f-a654-05e04d590422 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:22.243931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-838903b9-bc8f-44a6-90c1-c8b009cc1261 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9acdefe639f4a65b044946df5e14125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdc1f21994baeaf839349c8831d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:22.256885 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-838903b9-bc8f-44a6-90c1-c8b009cc1261 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 200 len: 1273 microversion: 2.1 time: 0.446375 Aug 18 11:31:22.260408 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 727/1443] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:21 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 1273 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:22.271793 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5b0e1efe-eb84-4d3b-9a7b-20036b7e11ac req-e6ecff55-02eb-463f-a654-05e04d590422 service nova] Creating event network-vif-deleted:3fa92fbf-bba6-4b83-9017-4544457a86cb for instance bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 on n-h1-853611-3 Aug 18 11:31:22.272675 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5b0e1efe-eb84-4d3b-9a7b-20036b7e11ac req-e6ecff55-02eb-463f-a654-05e04d590422 service nova] Creating event network-changed:6b2318ca-00cc-4182-8517-7647cceb2c66 for instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c on n-h1-853611-3 Aug 18 11:31:22.283192 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5b0e1efe-eb84-4d3b-9a7b-20036b7e11ac req-e6ecff55-02eb-463f-a654-05e04d590422 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.088378 Aug 18 11:31:22.290692 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 717/1444] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:22.312429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64adb3f4-91c9-4be6-b06f-f8432cb15efb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:22.315480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-64adb3f4-91c9-4be6-b06f-f8432cb15efb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:22.357753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64adb3f4-91c9-4be6-b06f-f8432cb15efb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:22.363539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64adb3f4-91c9-4be6-b06f-f8432cb15efb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:22.364362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64adb3f4-91c9-4be6-b06f-f8432cb15efb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:22.365686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64adb3f4-91c9-4be6-b06f-f8432cb15efb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:22.367356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64adb3f4-91c9-4be6-b06f-f8432cb15efb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:22.368024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64adb3f4-91c9-4be6-b06f-f8432cb15efb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:22.405665 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-64adb3f4-91c9-4be6-b06f-f8432cb15efb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] HTTP exception thrown: Instance bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 could not be found. Aug 18 11:31:22.409385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8e4d6943-6918-45f3-a751-48963beca4a6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:22.410099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8e4d6943-6918-45f3-a751-48963beca4a6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64adb3f4-91c9-4be6-b06f-f8432cb15efb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Request method failure captured: Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 HTTP/1.1 Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iKSlag_DyTRhHK9TqvjB3uaeJqTd30mOdcDQGSTKfo_1BiKJ_YVW1kKUDWBo3oX_2psn9QztObg-Czr0es9clWo5Gc0LlzQQSxBjjoX14p_m_VrrKtUvAek3sTjzCNUkm1K7bZ4E5tksWhtZBOj5XEF41miqv560I8D9uiLs9cmbSc Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:31:22.413273 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:31:22.416401 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:22.416401 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:22.416401 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:31:22.416401 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:22.416401 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:31:22.416401 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:31:22.416401 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:31:22.416401 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ed6ed454654f4ce0a01d407f18524a52 Aug 18 11:31:22.416401 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:31:22.416401 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:31:22.416401 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 could not be found. Aug 18 11:31:22.416401 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8'} Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 could not be found. Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:22.417281 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 could not be found. Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 could not be found. Aug 18 11:31:22.418822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.422937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64adb3f4-91c9-4be6-b06f-f8432cb15efb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Returning 404 to user: Instance bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:22.435924 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-64adb3f4-91c9-4be6-b06f-f8432cb15efb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8" status: 404 len: 111 microversion: 2.1 time: 0.128658 Aug 18 11:31:22.436844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e4d6943-6918-45f3-a751-48963beca4a6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:22.445292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e4d6943-6918-45f3-a751-48963beca4a6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:22.446370 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 728/1445] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:22 2022] GET /compute/v2.1/servers/bdee52ca-208a-4eb2-bf50-aecb6cc3d4c8 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:31:22.457016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e4d6943-6918-45f3-a751-48963beca4a6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:22.461191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e4d6943-6918-45f3-a751-48963beca4a6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:22.463820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e4d6943-6918-45f3-a751-48963beca4a6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:22.466177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e4d6943-6918-45f3-a751-48963beca4a6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:22.474721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7b8dc65e-d897-4f01-9b47-4a62bfb96e27 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '.version_select at 0x7f519f970ee0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:22.560793 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-7b8dc65e-d897-4f01-9b47-4a62bfb96e27 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] HTTP exception thrown: Image not found. Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7b8dc65e-d897-4f01-9b47-4a62bfb96e27 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Request method failure captured: Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/images/d3e00b59-d624-42be-8998-fed8f28a94ba HTTP/1.1 Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iKSlag_DyTRhHK9TqvjB3uaeJqTd30mOdcDQGSTKfo_1BiKJ_YVW1kKUDWBo3oX_2psn9QztObg-Czr0es9clWo5Gc0LlzQQSxBjjoX14p_m_VrrKtUvAek3sTjzCNUkm1K7bZ4E5tksWhtZBOj5XEF41miqv560I8D9uiLs9cmbSc Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:31:22.564175 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:31:22.565712 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:22.565712 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:22.565712 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:31:22.565712 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:22.565712 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:31:22.565712 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:31:22.565712 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:31:22.565712 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ed6ed454654f4ce0a01d407f18524a52 Aug 18 11:31:22.565712 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:31:22.565712 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:31:22.565712 n-d-853611-3 devstack@n-api.service[122209]: exception: Image not found. Aug 18 11:31:22.565712 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'd3e00b59-d624-42be-8998-fed8f28a94ba'} Aug 18 11:31:22.565712 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d3e00b59-d624-42be-8998-fed8f28a94ba to delete Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:22.566636 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d3e00b59-d624-42be-8998-fed8f28a94ba could not be found. Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:22.568326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:22.572864 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 18 11:31:22.572864 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:31:22.572864 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:31:22.572864 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.572864 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:22.572864 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.572864 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:22.572864 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:22.572864 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:22.572864 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:22.572864 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:22.572864 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:31:22.572864 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.578487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7b8dc65e-d897-4f01-9b47-4a62bfb96e27 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Returning 404 to user: Image not found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:22.580525 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7b8dc65e-d897-4f01-9b47-4a62bfb96e27 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "DELETE /compute/v2.1/images/d3e00b59-d624-42be-8998-fed8f28a94ba" status: 404 len: 62 microversion: 2.1 time: 0.124815 Aug 18 11:31:22.581523 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 729/1446] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:22 2022] DELETE /compute/v2.1/images/d3e00b59-d624-42be-8998-fed8f28a94ba => generated 62 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:31:22.605440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bf4f3517-d44d-4906-9392-70ff57e8a248 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f931af0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:22.709663 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bf4f3517-d44d-4906-9392-70ff57e8a248 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.120540 Aug 18 11:31:22.711224 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 730/1447] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:22 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:22.718659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f6c226df-0b3c-4a24-a38b-042dd9da8c33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:22.719501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f6c226df-0b3c-4a24-a38b-042dd9da8c33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:22.729989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6c226df-0b3c-4a24-a38b-042dd9da8c33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:22.731468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6c226df-0b3c-4a24-a38b-042dd9da8c33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:22.732785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6c226df-0b3c-4a24-a38b-042dd9da8c33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:22.734086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6c226df-0b3c-4a24-a38b-042dd9da8c33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:22.734844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6c226df-0b3c-4a24-a38b-042dd9da8c33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:22.735550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f6c226df-0b3c-4a24-a38b-042dd9da8c33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:22.768085 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-f6c226df-0b3c-4a24-a38b-042dd9da8c33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] HTTP exception thrown: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f6c226df-0b3c-4a24-a38b-042dd9da8c33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Request method failure captured: Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa HTTP/1.1 Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iKSlag_DyTRhHK9TqvjB3uaeJqTd30mOdcDQGSTKfo_1BiKJ_YVW1kKUDWBo3oX_2psn9QztObg-Czr0es9clWo5Gc0LlzQQSxBjjoX14p_m_VrrKtUvAek3sTjzCNUkm1K7bZ4E5tksWhtZBOj5XEF41miqv560I8D9uiLs9cmbSc Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:31:22.781837 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:31:22.783526 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:22.783526 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:22.783526 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:31:22.783526 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:22.783526 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:31:22.783526 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:31:22.783526 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:31:22.783526 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ed6ed454654f4ce0a01d407f18524a52 Aug 18 11:31:22.783526 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:31:22.783526 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:31:22.783526 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:31:22.783526 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'ea0a3039-3467-44eb-8976-e8716cace7fa'} Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:22.784354 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:31:22.785687 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.797146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f6c226df-0b3c-4a24-a38b-042dd9da8c33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Returning 404 to user: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:22.806118 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f6c226df-0b3c-4a24-a38b-042dd9da8c33 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 404 len: 111 microversion: 2.1 time: 0.093502 Aug 18 11:31:22.807039 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 731/1448] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:31:22 2022] DELETE /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:31:22.835645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-13e64163-0bf4-4d99-9e0b-adcbedb3d7f4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:22.840126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-13e64163-0bf4-4d99-9e0b-adcbedb3d7f4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: ea0a3039-3467-44eb-8976-e8716cace7fa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:22.858110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13e64163-0bf4-4d99-9e0b-adcbedb3d7f4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:22.871381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13e64163-0bf4-4d99-9e0b-adcbedb3d7f4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:22.872534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13e64163-0bf4-4d99-9e0b-adcbedb3d7f4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:22.886194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13e64163-0bf4-4d99-9e0b-adcbedb3d7f4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:22.887046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13e64163-0bf4-4d99-9e0b-adcbedb3d7f4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:22.887767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13e64163-0bf4-4d99-9e0b-adcbedb3d7f4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:22.926514 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-13e64163-0bf4-4d99-9e0b-adcbedb3d7f4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] HTTP exception thrown: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-13e64163-0bf4-4d99-9e0b-adcbedb3d7f4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Request method failure captured: Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa HTTP/1.1 Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iKSlag_DyTRhHK9TqvjB3uaeJqTd30mOdcDQGSTKfo_1BiKJ_YVW1kKUDWBo3oX_2psn9QztObg-Czr0es9clWo5Gc0LlzQQSxBjjoX14p_m_VrrKtUvAek3sTjzCNUkm1K7bZ4E5tksWhtZBOj5XEF41miqv560I8D9uiLs9cmbSc Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:31:22.929096 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:31:22.930597 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:22.930597 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:22.930597 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:31:22.930597 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:22.930597 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:31:22.930597 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:31:22.930597 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:31:22.930597 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ed6ed454654f4ce0a01d407f18524a52 Aug 18 11:31:22.930597 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:31:22.930597 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:31:22.930597 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:31:22.930597 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'ea0a3039-3467-44eb-8976-e8716cace7fa'} Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:22.931403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. Aug 18 11:31:22.932803 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:22.936762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-13e64163-0bf4-4d99-9e0b-adcbedb3d7f4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Returning 404 to user: Instance ea0a3039-3467-44eb-8976-e8716cace7fa could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:22.937996 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-13e64163-0bf4-4d99-9e0b-adcbedb3d7f4 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa" status: 404 len: 111 microversion: 2.1 time: 0.121522 Aug 18 11:31:22.942365 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 732/1449] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:22 2022] GET /compute/v2.1/servers/ea0a3039-3467-44eb-8976-e8716cace7fa => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:31:22.948813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1cfe2392-be63-41c1-a96d-b182d7bc73cb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '.version_select at 0x7f519f931040>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:22.988659 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1cfe2392-be63-41c1-a96d-b182d7bc73cb tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641911376" status: 202 len: 0 microversion: 2.1 time: 0.044802 Aug 18 11:31:22.989414 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 733/1450] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 11:31:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641911376 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:31:23.063921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8e4d6943-6918-45f3-a751-48963beca4a6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:23.096351 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8e4d6943-6918-45f3-a751-48963beca4a6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.694135 Aug 18 11:31:23.119299 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 718/1451] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:22 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:23.149575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1b44f15d-2822-4bf2-a67a-4a9e832af85d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:23.150555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1b44f15d-2822-4bf2-a67a-4a9e832af85d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:23.162175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b44f15d-2822-4bf2-a67a-4a9e832af85d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:23.166867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b44f15d-2822-4bf2-a67a-4a9e832af85d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:23.167760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b44f15d-2822-4bf2-a67a-4a9e832af85d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:23.171050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b44f15d-2822-4bf2-a67a-4a9e832af85d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:23.171824 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b44f15d-2822-4bf2-a67a-4a9e832af85d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:23.174982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b44f15d-2822-4bf2-a67a-4a9e832af85d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:23.286398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-424b34de-4b0f-4edf-a200-8c6c54ae826e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:23.287193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-424b34de-4b0f-4edf-a200-8c6c54ae826e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:23.289671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:23.308726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-424b34de-4b0f-4edf-a200-8c6c54ae826e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:23.310383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-424b34de-4b0f-4edf-a200-8c6c54ae826e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:23.311047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-424b34de-4b0f-4edf-a200-8c6c54ae826e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:23.316543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-424b34de-4b0f-4edf-a200-8c6c54ae826e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:23.317271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-424b34de-4b0f-4edf-a200-8c6c54ae826e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:23.319175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-424b34de-4b0f-4edf-a200-8c6c54ae826e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:23.424304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-424b34de-4b0f-4edf-a200-8c6c54ae826e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9acdefe639f4a65b044946df5e14125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdc1f21994baeaf839349c8831d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:23.439278 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-424b34de-4b0f-4edf-a200-8c6c54ae826e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 200 len: 1273 microversion: 2.1 time: 0.156604 Aug 18 11:31:23.459163 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 719/1452] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:23 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:23.726349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-afe344be-8e3e-46d4-ae85-77f9cbb8be00 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f977670>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:23.790549 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-afe344be-8e3e-46d4-ae85-77f9cbb8be00 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.068722 Aug 18 11:31:23.792326 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 720/1453] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:23 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:23.899234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1b44f15d-2822-4bf2-a67a-4a9e832af85d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:23.918231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1b44f15d-2822-4bf2-a67a-4a9e832af85d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:23.929240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1b44f15d-2822-4bf2-a67a-4a9e832af85d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:23.938921 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1b44f15d-2822-4bf2-a67a-4a9e832af85d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.793102 Aug 18 11:31:23.943457 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 734/1454] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:23 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:24.120029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3024e9cb-35b3-4b67-b7ee-04dfa9c31057 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:24.121016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3024e9cb-35b3-4b67-b7ee-04dfa9c31057 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:24.135628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3024e9cb-35b3-4b67-b7ee-04dfa9c31057 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:24.136578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3024e9cb-35b3-4b67-b7ee-04dfa9c31057 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:24.138340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3024e9cb-35b3-4b67-b7ee-04dfa9c31057 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:24.141430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3024e9cb-35b3-4b67-b7ee-04dfa9c31057 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:24.142297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3024e9cb-35b3-4b67-b7ee-04dfa9c31057 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:24.143300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3024e9cb-35b3-4b67-b7ee-04dfa9c31057 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:24.428006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-f45ca706-700e-403c-b301-0a3f2beaf7b3 req-a8f13193-4571-415c-95e8-1a9b105e8740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea", "name": "network-vif-unplugged", "status": "completed", "tag": "6f0d24ce-a546-4261-8582-706023203b8e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:24.474964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f45ca706-700e-403c-b301-0a3f2beaf7b3 req-a8f13193-4571-415c-95e8-1a9b105e8740 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:24.479549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f45ca706-700e-403c-b301-0a3f2beaf7b3 req-a8f13193-4571-415c-95e8-1a9b105e8740 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:24.480896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f45ca706-700e-403c-b301-0a3f2beaf7b3 req-a8f13193-4571-415c-95e8-1a9b105e8740 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:24.510324 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-f45ca706-700e-403c-b301-0a3f2beaf7b3 req-a8f13193-4571-415c-95e8-1a9b105e8740 service nova] Creating event network-vif-unplugged:6f0d24ce-a546-4261-8582-706023203b8e for instance 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea on n-h2-853611-3 Aug 18 11:31:24.518372 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-f45ca706-700e-403c-b301-0a3f2beaf7b3 req-a8f13193-4571-415c-95e8-1a9b105e8740 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099855 Aug 18 11:31:24.520029 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 735/1455] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:24.525944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ded62ecf-2bd1-46c2-97c0-99663e7430bc tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:24.527135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ded62ecf-2bd1-46c2-97c0-99663e7430bc tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:24.537000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ded62ecf-2bd1-46c2-97c0-99663e7430bc tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:24.537754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ded62ecf-2bd1-46c2-97c0-99663e7430bc tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:24.538510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ded62ecf-2bd1-46c2-97c0-99663e7430bc tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:24.539676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ded62ecf-2bd1-46c2-97c0-99663e7430bc tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:24.540410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ded62ecf-2bd1-46c2-97c0-99663e7430bc tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:24.541117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ded62ecf-2bd1-46c2-97c0-99663e7430bc tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:24.981427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ded62ecf-2bd1-46c2-97c0-99663e7430bc tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9acdefe639f4a65b044946df5e14125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdc1f21994baeaf839349c8831d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:24.991139 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ded62ecf-2bd1-46c2-97c0-99663e7430bc tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 200 len: 1315 microversion: 2.1 time: 0.469581 Aug 18 11:31:24.995612 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 736/1456] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:24 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:25.014279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2694db9-7b4d-4508-a46e-8643901860e3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f9b4d30>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:25.062496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3024e9cb-35b3-4b67-b7ee-04dfa9c31057 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:25.074754 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3024e9cb-35b3-4b67-b7ee-04dfa9c31057 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.958749 Aug 18 11:31:25.093724 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 721/1457] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:24 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:25.098785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-862dfe03-3bd7-432c-a43a-636927c8f606 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:25.099407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-862dfe03-3bd7-432c-a43a-636927c8f606 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:25.100903 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a2694db9-7b4d-4508-a46e-8643901860e3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.103099 Aug 18 11:31:25.102859 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 737/1458] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:24 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:25.115926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-862dfe03-3bd7-432c-a43a-636927c8f606 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:25.116434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-862dfe03-3bd7-432c-a43a-636927c8f606 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:25.116856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-862dfe03-3bd7-432c-a43a-636927c8f606 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:25.117573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-862dfe03-3bd7-432c-a43a-636927c8f606 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:25.118026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-862dfe03-3bd7-432c-a43a-636927c8f606 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:25.118484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-862dfe03-3bd7-432c-a43a-636927c8f606 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:25.305410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-0b3e797f-1ec8-4d00-b5a1-e1166ab4ef41 req-0eca016d-1ae9-4b05-93dd-937429a5b590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7290b8-c88b-4742-9fa8-ee6fce5420b0", "tag": "14fd99b0-1758-4dcc-912e-7aeacba2da78"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:25.327877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0b3e797f-1ec8-4d00-b5a1-e1166ab4ef41 req-0eca016d-1ae9-4b05-93dd-937429a5b590 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:25.329418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0b3e797f-1ec8-4d00-b5a1-e1166ab4ef41 req-0eca016d-1ae9-4b05-93dd-937429a5b590 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:25.338931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0b3e797f-1ec8-4d00-b5a1-e1166ab4ef41 req-0eca016d-1ae9-4b05-93dd-937429a5b590 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:25.356626 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-0b3e797f-1ec8-4d00-b5a1-e1166ab4ef41 req-0eca016d-1ae9-4b05-93dd-937429a5b590 service nova] Creating event network-changed:14fd99b0-1758-4dcc-912e-7aeacba2da78 for instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 on n-h1-853611-3 Aug 18 11:31:25.362376 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-0b3e797f-1ec8-4d00-b5a1-e1166ab4ef41 req-0eca016d-1ae9-4b05-93dd-937429a5b590 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062359 Aug 18 11:31:25.363522 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 738/1459] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:31:26.019736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-11900048-2bc1-4232-92c6-c0189c7287c8 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:26.020427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-11900048-2bc1-4232-92c6-c0189c7287c8 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:26.030312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11900048-2bc1-4232-92c6-c0189c7287c8 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:26.030836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11900048-2bc1-4232-92c6-c0189c7287c8 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:26.031493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11900048-2bc1-4232-92c6-c0189c7287c8 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:26.032392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11900048-2bc1-4232-92c6-c0189c7287c8 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:26.032849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11900048-2bc1-4232-92c6-c0189c7287c8 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:26.033466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11900048-2bc1-4232-92c6-c0189c7287c8 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:26.119040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-862dfe03-3bd7-432c-a43a-636927c8f606 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:26.138630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-862dfe03-3bd7-432c-a43a-636927c8f606 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:26.146710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-862dfe03-3bd7-432c-a43a-636927c8f606 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:26.155954 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-862dfe03-3bd7-432c-a43a-636927c8f606 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 1.060303 Aug 18 11:31:26.156631 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 722/1460] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:25 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:26.173933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e6013661-33eb-4d54-919a-3ca3c08332e8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:26.176088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e6013661-33eb-4d54-919a-3ca3c08332e8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:26.187549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6013661-33eb-4d54-919a-3ca3c08332e8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:26.188610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6013661-33eb-4d54-919a-3ca3c08332e8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:26.189280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6013661-33eb-4d54-919a-3ca3c08332e8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:26.191650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6013661-33eb-4d54-919a-3ca3c08332e8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:26.192732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6013661-33eb-4d54-919a-3ca3c08332e8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:26.193448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6013661-33eb-4d54-919a-3ca3c08332e8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:26.307970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-11900048-2bc1-4232-92c6-c0189c7287c8 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9acdefe639f4a65b044946df5e14125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdc1f21994baeaf839349c8831d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:26.316329 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-11900048-2bc1-4232-92c6-c0189c7287c8 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 200 len: 1315 microversion: 2.1 time: 0.301984 Aug 18 11:31:26.317256 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 739/1461] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:26 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:26.322009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-12e7cba5-6d5e-4889-af94-b9fa9c656962 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f9af550>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:26.382411 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-12e7cba5-6d5e-4889-af94-b9fa9c656962 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.063868 Aug 18 11:31:26.383650 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 740/1462] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:26 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:26.881733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-647e1236-94a0-4746-a181-fae0f5f6cd8b req-b9d36437-e2cc-46cb-99e0-61cc2740744b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea", "tag": "6f0d24ce-a546-4261-8582-706023203b8e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:26.909587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-647e1236-94a0-4746-a181-fae0f5f6cd8b req-b9d36437-e2cc-46cb-99e0-61cc2740744b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:26.910467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-647e1236-94a0-4746-a181-fae0f5f6cd8b req-b9d36437-e2cc-46cb-99e0-61cc2740744b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:26.914717 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-647e1236-94a0-4746-a181-fae0f5f6cd8b req-b9d36437-e2cc-46cb-99e0-61cc2740744b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:26.932672 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-647e1236-94a0-4746-a181-fae0f5f6cd8b req-b9d36437-e2cc-46cb-99e0-61cc2740744b service nova] Creating event network-changed:6f0d24ce-a546-4261-8582-706023203b8e for instance 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea on n-h2-853611-3 Aug 18 11:31:26.964538 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-647e1236-94a0-4746-a181-fae0f5f6cd8b req-b9d36437-e2cc-46cb-99e0-61cc2740744b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088848 Aug 18 11:31:26.965654 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 741/1463] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:27.091772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e6013661-33eb-4d54-919a-3ca3c08332e8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:27.103010 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e6013661-33eb-4d54-919a-3ca3c08332e8 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.944815 Aug 18 11:31:27.109982 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 723/1464] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:26 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:27.183652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c381cf1d-bf11-417f-b7dd-4add10c7a8f8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:27.186167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c381cf1d-bf11-417f-b7dd-4add10c7a8f8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:27.205508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f08a928d-b280-4008-a046-139fdf9ef177 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '.version_select at 0x7f519f9775e0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:27.243089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c381cf1d-bf11-417f-b7dd-4add10c7a8f8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:27.243616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c381cf1d-bf11-417f-b7dd-4add10c7a8f8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:27.248626 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-f08a928d-b280-4008-a046-139fdf9ef177 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] HTTP exception thrown: Image not found. Aug 18 11:31:27.248879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c381cf1d-bf11-417f-b7dd-4add10c7a8f8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f08a928d-b280-4008-a046-139fdf9ef177 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Request method failure captured: Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/images/f2173add-7c27-43b8-ae77-1a0fa710023f HTTP/1.1 Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iKSlag_DyTRhHK9TqvjB3uaeJqTd30mOdcDQGSTKfo_1BiKJ_YVW1kKUDWBo3oX_2psn9QztObg-Czr0es9clWo5Gc0LlzQQSxBjjoX14p_m_VrrKtUvAek3sTjzCNUkm1K7bZ4E5tksWhtZBOj5XEF41miqv560I8D9uiLs9cmbSc Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:31:27.252788 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:31:27.254539 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:27.254539 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:27.254539 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:31:27.254539 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:27.254539 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:31:27.254539 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:31:27.254539 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:31:27.254539 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ed6ed454654f4ce0a01d407f18524a52 Aug 18 11:31:27.254539 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:31:27.254539 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:31:27.254539 n-d-853611-3 devstack@n-api.service[122210]: exception: Image not found. Aug 18 11:31:27.254539 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'f2173add-7c27-43b8-ae77-1a0fa710023f'} Aug 18 11:31:27.254539 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f2173add-7c27-43b8-ae77-1a0fa710023f to delete Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:27.255727 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f2173add-7c27-43b8-ae77-1a0fa710023f could not be found. Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:27.257216 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:27.258876 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 18 11:31:27.258876 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:31:27.258876 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:31:27.258876 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.258876 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:27.258876 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.258876 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:27.258876 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:27.258876 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:27.258876 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:27.258876 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:27.258876 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:31:27.258876 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.259886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c381cf1d-bf11-417f-b7dd-4add10c7a8f8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:27.259886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c381cf1d-bf11-417f-b7dd-4add10c7a8f8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:27.259886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c381cf1d-bf11-417f-b7dd-4add10c7a8f8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:27.260986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f08a928d-b280-4008-a046-139fdf9ef177 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Returning 404 to user: Image not found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:27.262657 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f08a928d-b280-4008-a046-139fdf9ef177 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "DELETE /compute/v2.1/images/f2173add-7c27-43b8-ae77-1a0fa710023f" status: 404 len: 62 microversion: 2.1 time: 0.061376 Aug 18 11:31:27.266891 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 724/1465] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:27 2022] DELETE /compute/v2.1/images/f2173add-7c27-43b8-ae77-1a0fa710023f => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:31:27.272058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de8d466f-dcd4-4e3a-9ae8-e6164c25b74a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:27.272548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-de8d466f-dcd4-4e3a-9ae8-e6164c25b74a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:27.296746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de8d466f-dcd4-4e3a-9ae8-e6164c25b74a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:27.297657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de8d466f-dcd4-4e3a-9ae8-e6164c25b74a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:27.298353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de8d466f-dcd4-4e3a-9ae8-e6164c25b74a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:27.299344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de8d466f-dcd4-4e3a-9ae8-e6164c25b74a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:27.300028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de8d466f-dcd4-4e3a-9ae8-e6164c25b74a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:27.300698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de8d466f-dcd4-4e3a-9ae8-e6164c25b74a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:27.323715 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-de8d466f-dcd4-4e3a-9ae8-e6164c25b74a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] HTTP exception thrown: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de8d466f-dcd4-4e3a-9ae8-e6164c25b74a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Request method failure captured: Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f HTTP/1.1 Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iKSlag_DyTRhHK9TqvjB3uaeJqTd30mOdcDQGSTKfo_1BiKJ_YVW1kKUDWBo3oX_2psn9QztObg-Czr0es9clWo5Gc0LlzQQSxBjjoX14p_m_VrrKtUvAek3sTjzCNUkm1K7bZ4E5tksWhtZBOj5XEF41miqv560I8D9uiLs9cmbSc Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:31:27.335230 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:31:27.336870 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:27.336870 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:27.336870 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:31:27.336870 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:27.336870 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:31:27.336870 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:31:27.336870 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:31:27.336870 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ed6ed454654f4ce0a01d407f18524a52 Aug 18 11:31:27.336870 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:31:27.336870 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:31:27.336870 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:31:27.336870 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'f688dc84-1bfc-4f87-a2ed-0b196d40e86f'} Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:27.337712 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:31:27.339381 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.342054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de8d466f-dcd4-4e3a-9ae8-e6164c25b74a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Returning 404 to user: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:27.343195 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de8d466f-dcd4-4e3a-9ae8-e6164c25b74a tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 404 len: 111 microversion: 2.1 time: 0.075034 Aug 18 11:31:27.344269 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 725/1466] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:31:27 2022] DELETE /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:31:27.349914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-377fc323-e40d-4102-82df-c9b3060f260f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:27.355299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-377fc323-e40d-4102-82df-c9b3060f260f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:27.364767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-377fc323-e40d-4102-82df-c9b3060f260f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:27.375223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-377fc323-e40d-4102-82df-c9b3060f260f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:27.376038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-377fc323-e40d-4102-82df-c9b3060f260f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:27.378938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-377fc323-e40d-4102-82df-c9b3060f260f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:27.378938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-377fc323-e40d-4102-82df-c9b3060f260f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:27.378938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-377fc323-e40d-4102-82df-c9b3060f260f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:27.561842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c381cf1d-bf11-417f-b7dd-4add10c7a8f8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:27.572644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c381cf1d-bf11-417f-b7dd-4add10c7a8f8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:27.578152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c381cf1d-bf11-417f-b7dd-4add10c7a8f8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:27.579800 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c381cf1d-bf11-417f-b7dd-4add10c7a8f8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.403306 Aug 18 11:31:27.580619 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 742/1467] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:27 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:27.585625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d93e8522-799c-49c8-b100-828207481753 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:27.586384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d93e8522-799c-49c8-b100-828207481753 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] [instance: f688dc84-1bfc-4f87-a2ed-0b196d40e86f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:27.593957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d93e8522-799c-49c8-b100-828207481753 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:27.594643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d93e8522-799c-49c8-b100-828207481753 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:27.595196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d93e8522-799c-49c8-b100-828207481753 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:27.596091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d93e8522-799c-49c8-b100-828207481753 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:27.596631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d93e8522-799c-49c8-b100-828207481753 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:27.597156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d93e8522-799c-49c8-b100-828207481753 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:27.614490 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-d93e8522-799c-49c8-b100-828207481753 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] HTTP exception thrown: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d93e8522-799c-49c8-b100-828207481753 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Request method failure captured: Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f HTTP/1.1 Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iKSlag_DyTRhHK9TqvjB3uaeJqTd30mOdcDQGSTKfo_1BiKJ_YVW1kKUDWBo3oX_2psn9QztObg-Czr0es9clWo5Gc0LlzQQSxBjjoX14p_m_VrrKtUvAek3sTjzCNUkm1K7bZ4E5tksWhtZBOj5XEF41miqv560I8D9uiLs9cmbSc Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:31:27.616501 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:31:27.618021 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8064d9cbfe6a4a96944cc1d7a1817ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:27.618021 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:27.618021 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 8064d9cbfe6a4a96944cc1d7a1817ed8 Aug 18 11:31:27.618021 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-198791852 Aug 18 11:31:27.618021 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:31:27.618021 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:31:27.618021 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:31:27.618021 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ed6ed454654f4ce0a01d407f18524a52 Aug 18 11:31:27.618021 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-198791852-project Aug 18 11:31:27.618021 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:31:27.618021 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:31:27.618021 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'f688dc84-1bfc-4f87-a2ed-0b196d40e86f'} Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:27.618887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. Aug 18 11:31:27.620256 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:27.621737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d93e8522-799c-49c8-b100-828207481753 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] Returning 404 to user: Instance f688dc84-1bfc-4f87-a2ed-0b196d40e86f could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:27.621737 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d93e8522-799c-49c8-b100-828207481753 tempest-ImagesOneServerNegativeTestJSON-198791852 tempest-ImagesOneServerNegativeTestJSON-198791852-project] 10.222.0.73 "GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f" status: 404 len: 111 microversion: 2.1 time: 0.035983 Aug 18 11:31:27.623434 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 743/1468] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:27 2022] GET /compute/v2.1/servers/f688dc84-1bfc-4f87-a2ed-0b196d40e86f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:31:27.628694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e3891ebc-eda2-46e7-bbba-6107cffa49d3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f9299d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:27.689740 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e3891ebc-eda2-46e7-bbba-6107cffa49d3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.064444 Aug 18 11:31:27.698909 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 744/1469] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:27 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:27.889759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-377fc323-e40d-4102-82df-c9b3060f260f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9acdefe639f4a65b044946df5e14125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdc1f21994baeaf839349c8831d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:27.906463 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-377fc323-e40d-4102-82df-c9b3060f260f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 200 len: 1315 microversion: 2.1 time: 0.560636 Aug 18 11:31:27.907755 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 726/1470] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:27 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:28.132338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8fcfa6a9-9609-49b4-92ef-fe63dc4d31d6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:28.132835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8fcfa6a9-9609-49b4-92ef-fe63dc4d31d6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:28.145466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8fcfa6a9-9609-49b4-92ef-fe63dc4d31d6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:28.145466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8fcfa6a9-9609-49b4-92ef-fe63dc4d31d6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:28.145913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8fcfa6a9-9609-49b4-92ef-fe63dc4d31d6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:28.146637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8fcfa6a9-9609-49b4-92ef-fe63dc4d31d6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:28.147795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8fcfa6a9-9609-49b4-92ef-fe63dc4d31d6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:28.149084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8fcfa6a9-9609-49b4-92ef-fe63dc4d31d6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:28.253162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:28.604406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b43b4e7-c3ca-4428-ad11-c8f04d206eec tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:28.606853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9b43b4e7-c3ca-4428-ad11-c8f04d206eec tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:28.615839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b43b4e7-c3ca-4428-ad11-c8f04d206eec tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:28.616893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b43b4e7-c3ca-4428-ad11-c8f04d206eec tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:28.617905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b43b4e7-c3ca-4428-ad11-c8f04d206eec tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:28.618960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b43b4e7-c3ca-4428-ad11-c8f04d206eec tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:28.619666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b43b4e7-c3ca-4428-ad11-c8f04d206eec tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:28.620335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b43b4e7-c3ca-4428-ad11-c8f04d206eec tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:28.663867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8fcfa6a9-9609-49b4-92ef-fe63dc4d31d6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:28.679719 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8fcfa6a9-9609-49b4-92ef-fe63dc4d31d6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.551537 Aug 18 11:31:28.694344 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 745/1471] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:28 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:28.705318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8aedb415-6e84-4fa2-8e9c-7b565ab6fb33 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f8f2f70>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:28.765217 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8aedb415-6e84-4fa2-8e9c-7b565ab6fb33 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1413 microversion: 2.1 time: 0.063712 Aug 18 11:31:28.765795 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 746/1472] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:28 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1413 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:28.928746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c2c5d97f-dcc0-46c0-aa16-f16cf2d0bc64 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:28.930109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c2c5d97f-dcc0-46c0-aa16-f16cf2d0bc64 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:28.942537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9b43b4e7-c3ca-4428-ad11-c8f04d206eec tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:28.958874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2c5d97f-dcc0-46c0-aa16-f16cf2d0bc64 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:28.959751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2c5d97f-dcc0-46c0-aa16-f16cf2d0bc64 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:28.960505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2c5d97f-dcc0-46c0-aa16-f16cf2d0bc64 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:28.961407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2c5d97f-dcc0-46c0-aa16-f16cf2d0bc64 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:28.961731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2c5d97f-dcc0-46c0-aa16-f16cf2d0bc64 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:28.962162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2c5d97f-dcc0-46c0-aa16-f16cf2d0bc64 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:28.963060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9b43b4e7-c3ca-4428-ad11-c8f04d206eec tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:28.964654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9b43b4e7-c3ca-4428-ad11-c8f04d206eec tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:28.965942 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b43b4e7-c3ca-4428-ad11-c8f04d206eec tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.365941 Aug 18 11:31:28.970678 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 727/1473] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:28 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:29.194423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=8 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:29.470734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c2c5d97f-dcc0-46c0-aa16-f16cf2d0bc64 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9acdefe639f4a65b044946df5e14125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdc1f21994baeaf839349c8831d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:29.479440 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c2c5d97f-dcc0-46c0-aa16-f16cf2d0bc64 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 200 len: 1315 microversion: 2.1 time: 0.554948 Aug 18 11:31:29.485897 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 747/1474] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:28 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:29.701559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-25346703-287f-4ae7-8746-73b13d9f55d3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:29.702134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-25346703-287f-4ae7-8746-73b13d9f55d3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:29.708557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25346703-287f-4ae7-8746-73b13d9f55d3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:29.709270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25346703-287f-4ae7-8746-73b13d9f55d3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:29.709709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25346703-287f-4ae7-8746-73b13d9f55d3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:29.710409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25346703-287f-4ae7-8746-73b13d9f55d3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:29.711008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25346703-287f-4ae7-8746-73b13d9f55d3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:29.711307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25346703-287f-4ae7-8746-73b13d9f55d3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:29.782637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7bafa928-e582-4e59-aa37-4edb3b5ddd5e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f9b4c10>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:29.843499 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7bafa928-e582-4e59-aa37-4edb3b5ddd5e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1422 microversion: 2.1 time: 0.067053 Aug 18 11:31:29.852965 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 748/1475] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:29 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1422 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:29.860418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e9a4bc70-2f20-413a-90f5-d7de4402215d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f929c10>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:29.903562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-25346703-287f-4ae7-8746-73b13d9f55d3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:29.921765 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-25346703-287f-4ae7-8746-73b13d9f55d3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.224306 Aug 18 11:31:29.922786 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 728/1476] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:29 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:29.929475 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e9a4bc70-2f20-413a-90f5-d7de4402215d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 200 len: 1422 microversion: 2.1 time: 0.074936 Aug 18 11:31:29.930943 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 749/1477] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:29 2022] GET /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 1422 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:29.944300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6898688-b173-47d4-858c-f4a0e5f2f808 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f85fee0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:29.992881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d2371bd8-6c0d-4474-a471-6c517cc0a644 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:29.993758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d2371bd8-6c0d-4474-a471-6c517cc0a644 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:30.004819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2371bd8-6c0d-4474-a471-6c517cc0a644 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:30.005331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2371bd8-6c0d-4474-a471-6c517cc0a644 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:30.005880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2371bd8-6c0d-4474-a471-6c517cc0a644 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:30.006649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2371bd8-6c0d-4474-a471-6c517cc0a644 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:30.007122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2371bd8-6c0d-4474-a471-6c517cc0a644 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:30.007547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2371bd8-6c0d-4474-a471-6c517cc0a644 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:30.301506 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d2371bd8-6c0d-4474-a471-6c517cc0a644 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:30.313547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d2371bd8-6c0d-4474-a471-6c517cc0a644 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:30.315230 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d2371bd8-6c0d-4474-a471-6c517cc0a644 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:30.316657 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d2371bd8-6c0d-4474-a471-6c517cc0a644 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1812 microversion: 2.25 time: 0.328926 Aug 18 11:31:30.317324 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 750/1478] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:29 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1812 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:31:30.501422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7907aac2-4269-418f-8afc-286153f50be6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:30.502133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7907aac2-4269-418f-8afc-286153f50be6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:30.518200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7907aac2-4269-418f-8afc-286153f50be6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:30.519108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7907aac2-4269-418f-8afc-286153f50be6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:30.519548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7907aac2-4269-418f-8afc-286153f50be6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:30.520399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7907aac2-4269-418f-8afc-286153f50be6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:30.521306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7907aac2-4269-418f-8afc-286153f50be6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:30.521306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7907aac2-4269-418f-8afc-286153f50be6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:30.640630 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c6898688-b173-47d4-858c-f4a0e5f2f808 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 204 len: 0 microversion: 2.1 time: 0.699090 Aug 18 11:31:30.643026 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 729/1479] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:29 2022] DELETE /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:31:30.655066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df94d7b2-a556-43bf-a5a4-a188ab77a919 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:30.655819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df94d7b2-a556-43bf-a5a4-a188ab77a919 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:30.675957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df94d7b2-a556-43bf-a5a4-a188ab77a919 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:30.677229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df94d7b2-a556-43bf-a5a4-a188ab77a919 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:30.677895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df94d7b2-a556-43bf-a5a4-a188ab77a919 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:30.680770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df94d7b2-a556-43bf-a5a4-a188ab77a919 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:30.681484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df94d7b2-a556-43bf-a5a4-a188ab77a919 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:30.682113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df94d7b2-a556-43bf-a5a4-a188ab77a919 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:30.729499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df94d7b2-a556-43bf-a5a4-a188ab77a919 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:31:30.847856 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df94d7b2-a556-43bf-a5a4-a188ab77a919 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 204 len: 0 microversion: 2.1 time: 0.199042 Aug 18 11:31:30.851507 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 730/1480] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:31:30 2022] DELETE /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:31:30.885785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7907aac2-4269-418f-8afc-286153f50be6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9acdefe639f4a65b044946df5e14125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdc1f21994baeaf839349c8831d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:30.895774 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7907aac2-4269-418f-8afc-286153f50be6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 200 len: 1315 microversion: 2.1 time: 0.398474 Aug 18 11:31:30.904265 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 751/1481] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:30 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:30.951385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-21155733-7a65-4da6-a2db-b4488eceb13d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:30.953359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-21155733-7a65-4da6-a2db-b4488eceb13d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:30.962233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21155733-7a65-4da6-a2db-b4488eceb13d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:30.963356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21155733-7a65-4da6-a2db-b4488eceb13d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:30.964025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21155733-7a65-4da6-a2db-b4488eceb13d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:30.965748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21155733-7a65-4da6-a2db-b4488eceb13d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:30.966519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21155733-7a65-4da6-a2db-b4488eceb13d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:30.966992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21155733-7a65-4da6-a2db-b4488eceb13d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:31.036874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1689987206", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "9087955c-aa00-44c0-84c8-58368fdadbd5"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:31.101742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] validate_networks() for [('9087955c-aa00-44c0-84c8-58368fdadbd5', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:31:31.153618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-21155733-7a65-4da6-a2db-b4488eceb13d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:31.164557 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-21155733-7a65-4da6-a2db-b4488eceb13d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.222900 Aug 18 11:31:31.174776 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 731/1482] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:30 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:31.345137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ba2ba3fe-ab43-4896-861e-e61f68e02b18 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:31.345757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ba2ba3fe-ab43-4896-861e-e61f68e02b18 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:31.352009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba2ba3fe-ab43-4896-861e-e61f68e02b18 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:31.352502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba2ba3fe-ab43-4896-861e-e61f68e02b18 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:31.352942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba2ba3fe-ab43-4896-861e-e61f68e02b18 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:31.353659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba2ba3fe-ab43-4896-861e-e61f68e02b18 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:31.354116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba2ba3fe-ab43-4896-861e-e61f68e02b18 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:31.354789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba2ba3fe-ab43-4896-861e-e61f68e02b18 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:31.495510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ba2ba3fe-ab43-4896-861e-e61f68e02b18 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:31.504768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ba2ba3fe-ab43-4896-861e-e61f68e02b18 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:31.506344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ba2ba3fe-ab43-4896-861e-e61f68e02b18 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:31.507657 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ba2ba3fe-ab43-4896-861e-e61f68e02b18 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1802 microversion: 2.25 time: 0.166654 Aug 18 11:31:31.508311 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 732/1483] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:31 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:31:31.531598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6d7d0e25-0fe0-41d8-8406-51ddf185b663 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '.version_select at 0x7f519f862b80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:31.535421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d7d0e25-0fe0-41d8-8406-51ddf185b663 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:31.536074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d7d0e25-0fe0-41d8-8406-51ddf185b663 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:31.536516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d7d0e25-0fe0-41d8-8406-51ddf185b663 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:31.548368 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6d7d0e25-0fe0-41d8-8406-51ddf185b663 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/os-migrations" status: 200 len: 3024 microversion: 2.25 time: 0.021419 Aug 18 11:31:31.548989 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 733/1484] 10.222.0.73 () {60 vars in 1184 bytes} [Thu Aug 18 11:31:31 2022] GET /compute/v2.1/os-migrations => generated 3024 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:31:31.564356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c554b381-ed5f-446d-b17b-de4313f98b38 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:31.564974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c554b381-ed5f-446d-b17b-de4313f98b38 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:31.571464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c554b381-ed5f-446d-b17b-de4313f98b38 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:31.572000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c554b381-ed5f-446d-b17b-de4313f98b38 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:31.572434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c554b381-ed5f-446d-b17b-de4313f98b38 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:31.573140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c554b381-ed5f-446d-b17b-de4313f98b38 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:31.573594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c554b381-ed5f-446d-b17b-de4313f98b38 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:31.574117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c554b381-ed5f-446d-b17b-de4313f98b38 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:31.737478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-c554b381-ed5f-446d-b17b-de4313f98b38 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 18b9b772-9949-4239-a522-78ea800d8223 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:31:31.760338 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c554b381-ed5f-446d-b17b-de4313f98b38 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 2421 microversion: 2.25 time: 0.199657 Aug 18 11:31:31.761306 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 734/1485] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:31 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 2421 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:31.783339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d8584e7-d7cc-432a-ba2c-64bebc879513 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:31.784030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7d8584e7-d7cc-432a-ba2c-64bebc879513 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:31.791191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d8584e7-d7cc-432a-ba2c-64bebc879513 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:31.791683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d8584e7-d7cc-432a-ba2c-64bebc879513 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:31.792112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d8584e7-d7cc-432a-ba2c-64bebc879513 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:31.793625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d8584e7-d7cc-432a-ba2c-64bebc879513 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:31.794095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d8584e7-d7cc-432a-ba2c-64bebc879513 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:31.794545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d8584e7-d7cc-432a-ba2c-64bebc879513 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:31.814400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:32.146094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-7d8584e7-d7cc-432a-ba2c-64bebc879513 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 18b9b772-9949-4239-a522-78ea800d8223 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:31:32.170982 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7d8584e7-d7cc-432a-ba2c-64bebc879513 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 2421 microversion: 2.25 time: 0.391613 Aug 18 11:31:32.195169 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 735/1486] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:31:31 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 2421 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:31:32.203956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3958402a-731e-4401-bd7a-511508e09b76 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:32.205511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3958402a-731e-4401-bd7a-511508e09b76 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:32.216714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3958402a-731e-4401-bd7a-511508e09b76 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:32.217508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3958402a-731e-4401-bd7a-511508e09b76 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:32.218162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3958402a-731e-4401-bd7a-511508e09b76 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:32.219208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3958402a-731e-4401-bd7a-511508e09b76 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:32.222652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3958402a-731e-4401-bd7a-511508e09b76 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:32.223424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3958402a-731e-4401-bd7a-511508e09b76 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:32.290782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:31:32.291365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:31:32.291684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:31:32.292100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:31:32.292667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:31:32.315343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:32.320191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:32.321001 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:32.322321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:32.323022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:32.325102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:32.352803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Getting quotas for project 287b7017444e47b48aa08661b84a3798. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:31:32.365278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Getting quotas for user 678c78e8696f45c1a9d099199fcdcd36 and project 287b7017444e47b48aa08661b84a3798. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:31:32.380991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:31:32.385646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:31:32.453344 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-748d291a-b321-4878-b6e4-4d233ab4c586 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.420345 Aug 18 11:31:32.460481 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 752/1487] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:31:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:31:32.460481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-d060da81-600f-4436-8930-7db98805f223 req-24b39457-0e3c-4563-a4cd-d35a81b46a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7290b8-c88b-4742-9fa8-ee6fce5420b0", "name": "network-vif-plugged", "status": "completed", "tag": "14fd99b0-1758-4dcc-912e-7aeacba2da78"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:32.471651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d060da81-600f-4436-8930-7db98805f223 req-24b39457-0e3c-4563-a4cd-d35a81b46a3e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:32.472139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d060da81-600f-4436-8930-7db98805f223 req-24b39457-0e3c-4563-a4cd-d35a81b46a3e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:32.472567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d060da81-600f-4436-8930-7db98805f223 req-24b39457-0e3c-4563-a4cd-d35a81b46a3e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:32.486557 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-d060da81-600f-4436-8930-7db98805f223 req-24b39457-0e3c-4563-a4cd-d35a81b46a3e service nova] Creating event network-vif-plugged:14fd99b0-1758-4dcc-912e-7aeacba2da78 for instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 on n-h1-853611-3 Aug 18 11:31:32.493469 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-d060da81-600f-4436-8930-7db98805f223 req-24b39457-0e3c-4563-a4cd-d35a81b46a3e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037690 Aug 18 11:31:32.494695 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 753/1488] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:32.504275 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d2a9b46f-d686-498b-b36d-018a5aadbf0e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:32.505246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d2a9b46f-d686-498b-b36d-018a5aadbf0e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:32.533696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2a9b46f-d686-498b-b36d-018a5aadbf0e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:32.534822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2a9b46f-d686-498b-b36d-018a5aadbf0e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:32.535557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2a9b46f-d686-498b-b36d-018a5aadbf0e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:32.538186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2a9b46f-d686-498b-b36d-018a5aadbf0e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:32.539834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2a9b46f-d686-498b-b36d-018a5aadbf0e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:32.540907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2a9b46f-d686-498b-b36d-018a5aadbf0e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:32.560415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3958402a-731e-4401-bd7a-511508e09b76 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9acdefe639f4a65b044946df5e14125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdc1f21994baeaf839349c8831d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:32.573819 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3958402a-731e-4401-bd7a-511508e09b76 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 200 len: 1315 microversion: 2.1 time: 0.374116 Aug 18 11:31:32.581241 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 736/1489] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:32 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:32.596213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bc38888d-0195-4c81-85ac-fc6ad5a73576 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:32.596717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bc38888d-0195-4c81-85ac-fc6ad5a73576 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:32.612690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc38888d-0195-4c81-85ac-fc6ad5a73576 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:32.617474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc38888d-0195-4c81-85ac-fc6ad5a73576 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:32.618518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc38888d-0195-4c81-85ac-fc6ad5a73576 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:32.619445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc38888d-0195-4c81-85ac-fc6ad5a73576 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:32.623526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc38888d-0195-4c81-85ac-fc6ad5a73576 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:32.624405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc38888d-0195-4c81-85ac-fc6ad5a73576 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:32.848818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-bc38888d-0195-4c81-85ac-fc6ad5a73576 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lazy-loading 'services' on Instance uuid 18b9b772-9949-4239-a522-78ea800d8223 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:31:32.885781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d2a9b46f-d686-498b-b36d-018a5aadbf0e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:32.898655 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d2a9b46f-d686-498b-b36d-018a5aadbf0e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.402493 Aug 18 11:31:32.899673 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 754/1490] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:32 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:32.905374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aa1988f2-04a4-40d1-92de-1031093e196b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:32.906288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-aa1988f2-04a4-40d1-92de-1031093e196b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:32.965819 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bc38888d-0195-4c81-85ac-fc6ad5a73576 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "DELETE /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments/7c836bab-089b-4b70-bbc1-5a63e5ca6264" status: 202 len: 0 microversion: 2.25 time: 0.383127 Aug 18 11:31:32.970156 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 737/1491] 10.222.0.73 () {60 vars in 1457 bytes} [Thu Aug 18 11:31:32 2022] DELETE /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments/7c836bab-089b-4b70-bbc1-5a63e5ca6264 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:31:32.977663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f76d6de4-8d80-4535-a03c-1812f567116b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:32.981483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f76d6de4-8d80-4535-a03c-1812f567116b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:32.989587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f76d6de4-8d80-4535-a03c-1812f567116b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:32.990186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f76d6de4-8d80-4535-a03c-1812f567116b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:32.990866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f76d6de4-8d80-4535-a03c-1812f567116b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:32.991917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f76d6de4-8d80-4535-a03c-1812f567116b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:32.993543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f76d6de4-8d80-4535-a03c-1812f567116b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:32.993942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f76d6de4-8d80-4535-a03c-1812f567116b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:32.999535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aa1988f2-04a4-40d1-92de-1031093e196b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:33.015509 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aa1988f2-04a4-40d1-92de-1031093e196b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1208 microversion: 2.1 time: 0.112936 Aug 18 11:31:33.017309 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 755/1492] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:32 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1208 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:33.040420 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f76d6de4-8d80-4535-a03c-1812f567116b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.067150 Aug 18 11:31:33.041361 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 738/1493] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:31:32 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:31:33.596228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e5a1936d-aa11-41a7-895d-5ed987e6f2bf tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:33.596783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e5a1936d-aa11-41a7-895d-5ed987e6f2bf tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:33.603035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5a1936d-aa11-41a7-895d-5ed987e6f2bf tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:33.603981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5a1936d-aa11-41a7-895d-5ed987e6f2bf tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:33.604601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5a1936d-aa11-41a7-895d-5ed987e6f2bf tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:33.605444 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5a1936d-aa11-41a7-895d-5ed987e6f2bf tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:33.605956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5a1936d-aa11-41a7-895d-5ed987e6f2bf tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:33.606662 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5a1936d-aa11-41a7-895d-5ed987e6f2bf tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:33.923075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ff6328b7-8fa0-4eb6-b93f-f462cc4a2ece tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:33.924832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ff6328b7-8fa0-4eb6-b93f-f462cc4a2ece tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:33.925082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e5a1936d-aa11-41a7-895d-5ed987e6f2bf tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9acdefe639f4a65b044946df5e14125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdc1f21994baeaf839349c8831d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:33.934101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff6328b7-8fa0-4eb6-b93f-f462cc4a2ece tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:33.934810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff6328b7-8fa0-4eb6-b93f-f462cc4a2ece tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:33.934975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff6328b7-8fa0-4eb6-b93f-f462cc4a2ece tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:33.935920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff6328b7-8fa0-4eb6-b93f-f462cc4a2ece tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:33.936227 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e5a1936d-aa11-41a7-895d-5ed987e6f2bf tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 200 len: 1315 microversion: 2.1 time: 0.343471 Aug 18 11:31:33.936568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff6328b7-8fa0-4eb6-b93f-f462cc4a2ece tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:33.937134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff6328b7-8fa0-4eb6-b93f-f462cc4a2ece tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:33.937710 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 756/1494] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:33 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:34.039182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-14d07476-0154-4381-ae84-6a82f70fafa7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:34.040035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-14d07476-0154-4381-ae84-6a82f70fafa7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:34.051128 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-14d07476-0154-4381-ae84-6a82f70fafa7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:34.051666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-14d07476-0154-4381-ae84-6a82f70fafa7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:34.062862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-14d07476-0154-4381-ae84-6a82f70fafa7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:34.063946 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-14d07476-0154-4381-ae84-6a82f70fafa7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:34.064449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-14d07476-0154-4381-ae84-6a82f70fafa7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:34.064898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-14d07476-0154-4381-ae84-6a82f70fafa7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:34.229805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ff6328b7-8fa0-4eb6-b93f-f462cc4a2ece tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:34.243085 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ff6328b7-8fa0-4eb6-b93f-f462cc4a2ece tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.325339 Aug 18 11:31:34.243959 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 739/1495] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:33 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:34.268253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-783d2aa5-0c74-471c-8fdf-118983684542 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:34.272920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-783d2aa5-0c74-471c-8fdf-118983684542 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:34.279848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-14d07476-0154-4381-ae84-6a82f70fafa7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:34.287991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-783d2aa5-0c74-471c-8fdf-118983684542 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:34.288493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-783d2aa5-0c74-471c-8fdf-118983684542 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:34.289040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-783d2aa5-0c74-471c-8fdf-118983684542 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:34.289863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-783d2aa5-0c74-471c-8fdf-118983684542 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:34.290411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-783d2aa5-0c74-471c-8fdf-118983684542 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:34.290866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-783d2aa5-0c74-471c-8fdf-118983684542 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:34.296103 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-14d07476-0154-4381-ae84-6a82f70fafa7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1212 microversion: 2.1 time: 0.262472 Aug 18 11:31:34.297029 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 757/1496] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:34 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1212 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:34.380960 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-783d2aa5-0c74-471c-8fdf-118983684542 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.114136 Aug 18 11:31:34.383077 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 740/1497] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:31:34 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:31:34.429121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-304dc38f-c0bf-401e-addf-7e03a7d1c49d req-9ff94f64-2faa-4943-ae7f-d5d3007358a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb46c1c-c94c-4ea9-942e-82187eb83479", "name": "network-vif-deleted", "tag": "b659ed49-6503-43dd-9a80-64c66fbb2313"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:34.458765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-304dc38f-c0bf-401e-addf-7e03a7d1c49d req-9ff94f64-2faa-4943-ae7f-d5d3007358a4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:34.459331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-304dc38f-c0bf-401e-addf-7e03a7d1c49d req-9ff94f64-2faa-4943-ae7f-d5d3007358a4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:34.459947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-304dc38f-c0bf-401e-addf-7e03a7d1c49d req-9ff94f64-2faa-4943-ae7f-d5d3007358a4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:34.491794 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:34.497259 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-304dc38f-c0bf-401e-addf-7e03a7d1c49d req-9ff94f64-2faa-4943-ae7f-d5d3007358a4 service nova] Creating event network-vif-deleted:b659ed49-6503-43dd-9a80-64c66fbb2313 for instance dbb46c1c-c94c-4ea9-942e-82187eb83479 on n-h2-853611-3 Aug 18 11:31:34.514135 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-304dc38f-c0bf-401e-addf-7e03a7d1c49d req-9ff94f64-2faa-4943-ae7f-d5d3007358a4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086192 Aug 18 11:31:34.516257 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 758/1498] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:34.548462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-dced5f7b-7a58-4588-b5ad-509e18dd867f req-49c7de24-813b-47c8-b7d9-ac88e6f5d1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb46c1c-c94c-4ea9-942e-82187eb83479", "name": "network-vif-unplugged", "status": "completed", "tag": "b659ed49-6503-43dd-9a80-64c66fbb2313"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:34.570473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-dced5f7b-7a58-4588-b5ad-509e18dd867f req-49c7de24-813b-47c8-b7d9-ac88e6f5d1c3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:34.571226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-dced5f7b-7a58-4588-b5ad-509e18dd867f req-49c7de24-813b-47c8-b7d9-ac88e6f5d1c3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:34.571864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-dced5f7b-7a58-4588-b5ad-509e18dd867f req-49c7de24-813b-47c8-b7d9-ac88e6f5d1c3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:34.593898 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-dced5f7b-7a58-4588-b5ad-509e18dd867f req-49c7de24-813b-47c8-b7d9-ac88e6f5d1c3 service nova] Creating event network-vif-unplugged:b659ed49-6503-43dd-9a80-64c66fbb2313 for instance dbb46c1c-c94c-4ea9-942e-82187eb83479 on n-h2-853611-3 Aug 18 11:31:34.611241 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-dced5f7b-7a58-4588-b5ad-509e18dd867f req-49c7de24-813b-47c8-b7d9-ac88e6f5d1c3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074923 Aug 18 11:31:34.612527 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 741/1499] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:31:34.962960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-56fb1a31-0bbb-4e10-afe7-55e1278c8078 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:34.965275 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-56fb1a31-0bbb-4e10-afe7-55e1278c8078 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:34.982449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-56fb1a31-0bbb-4e10-afe7-55e1278c8078 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:34.983346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-56fb1a31-0bbb-4e10-afe7-55e1278c8078 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:34.985732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-56fb1a31-0bbb-4e10-afe7-55e1278c8078 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:34.988155 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-56fb1a31-0bbb-4e10-afe7-55e1278c8078 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:34.989594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-56fb1a31-0bbb-4e10-afe7-55e1278c8078 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:34.990685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-56fb1a31-0bbb-4e10-afe7-55e1278c8078 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:35.268701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-93f72643-5114-4b45-8b90-ef41caa5a2b2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:35.269621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-93f72643-5114-4b45-8b90-ef41caa5a2b2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:35.311960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f72643-5114-4b45-8b90-ef41caa5a2b2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:35.312785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f72643-5114-4b45-8b90-ef41caa5a2b2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:35.313417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f72643-5114-4b45-8b90-ef41caa5a2b2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:35.314382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f72643-5114-4b45-8b90-ef41caa5a2b2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:35.315076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f72643-5114-4b45-8b90-ef41caa5a2b2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:35.315699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f72643-5114-4b45-8b90-ef41caa5a2b2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:35.449948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-56fb1a31-0bbb-4e10-afe7-55e1278c8078 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9acdefe639f4a65b044946df5e14125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdc1f21994baeaf839349c8831d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:35.459878 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-56fb1a31-0bbb-4e10-afe7-55e1278c8078 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 200 len: 1502 microversion: 2.1 time: 0.502209 Aug 18 11:31:35.462642 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 759/1500] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:34 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 1502 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:35.467967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f3acfb1d-2d8f-4b7e-b9c8-24a48e1a50f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:35.468864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f3acfb1d-2d8f-4b7e-b9c8-24a48e1a50f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:35.479715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3acfb1d-2d8f-4b7e-b9c8-24a48e1a50f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:35.481361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3acfb1d-2d8f-4b7e-b9c8-24a48e1a50f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:35.482050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3acfb1d-2d8f-4b7e-b9c8-24a48e1a50f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:35.482893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3acfb1d-2d8f-4b7e-b9c8-24a48e1a50f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:35.483439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3acfb1d-2d8f-4b7e-b9c8-24a48e1a50f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:35.483943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3acfb1d-2d8f-4b7e-b9c8-24a48e1a50f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:35.573098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f3acfb1d-2d8f-4b7e-b9c8-24a48e1a50f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:35.585327 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f3acfb1d-2d8f-4b7e-b9c8-24a48e1a50f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1266 microversion: 2.1 time: 0.120823 Aug 18 11:31:35.600858 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 760/1501] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:35 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:35.608584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d0110e3d-dddf-4202-8a2b-310c4264b0dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:35.614959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d0110e3d-dddf-4202-8a2b-310c4264b0dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:35.627901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0110e3d-dddf-4202-8a2b-310c4264b0dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:35.629841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0110e3d-dddf-4202-8a2b-310c4264b0dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:35.631140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0110e3d-dddf-4202-8a2b-310c4264b0dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:35.633003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0110e3d-dddf-4202-8a2b-310c4264b0dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:35.635223 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0110e3d-dddf-4202-8a2b-310c4264b0dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:35.635829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0110e3d-dddf-4202-8a2b-310c4264b0dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:35.657429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-93f72643-5114-4b45-8b90-ef41caa5a2b2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:35.669854 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-93f72643-5114-4b45-8b90-ef41caa5a2b2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.406764 Aug 18 11:31:35.672688 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 742/1502] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:35 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:35.684706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c51424be-00a6-4d1c-a287-bb2c8aa0f4d5 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:35.689271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c51424be-00a6-4d1c-a287-bb2c8aa0f4d5 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:35.690539 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d0110e3d-dddf-4202-8a2b-310c4264b0dd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.087957 Aug 18 11:31:35.691766 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 761/1503] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:31:35 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:31:35.704420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c51424be-00a6-4d1c-a287-bb2c8aa0f4d5 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:35.705129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c51424be-00a6-4d1c-a287-bb2c8aa0f4d5 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:35.705745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c51424be-00a6-4d1c-a287-bb2c8aa0f4d5 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:35.706651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c51424be-00a6-4d1c-a287-bb2c8aa0f4d5 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:35.707278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c51424be-00a6-4d1c-a287-bb2c8aa0f4d5 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:35.707872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c51424be-00a6-4d1c-a287-bb2c8aa0f4d5 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:35.748443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c51424be-00a6-4d1c-a287-bb2c8aa0f4d5 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:31:35.886243 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c51424be-00a6-4d1c-a287-bb2c8aa0f4d5 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 204 len: 0 microversion: 2.1 time: 0.210842 Aug 18 11:31:35.888656 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 743/1504] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:31:35 2022] DELETE /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:31:35.900535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c503140e-61d5-444d-97fa-78db21462368 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:35.901925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c503140e-61d5-444d-97fa-78db21462368 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:35.911925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c503140e-61d5-444d-97fa-78db21462368 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:35.912425 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c503140e-61d5-444d-97fa-78db21462368 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:35.913291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c503140e-61d5-444d-97fa-78db21462368 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:35.914016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c503140e-61d5-444d-97fa-78db21462368 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:35.914562 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c503140e-61d5-444d-97fa-78db21462368 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:35.915189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c503140e-61d5-444d-97fa-78db21462368 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:36.202602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c503140e-61d5-444d-97fa-78db21462368 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9acdefe639f4a65b044946df5e14125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdc1f21994baeaf839349c8831d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:36.213978 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c503140e-61d5-444d-97fa-78db21462368 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 200 len: 1508 microversion: 2.1 time: 0.320770 Aug 18 11:31:36.217664 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 762/1505] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:35 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:36.612451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-53e2ac2d-e1b3-4df4-9f12-dd77102dcc44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:36.613190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-53e2ac2d-e1b3-4df4-9f12-dd77102dcc44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:36.620453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53e2ac2d-e1b3-4df4-9f12-dd77102dcc44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:36.620937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53e2ac2d-e1b3-4df4-9f12-dd77102dcc44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:36.621372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53e2ac2d-e1b3-4df4-9f12-dd77102dcc44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:36.622095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53e2ac2d-e1b3-4df4-9f12-dd77102dcc44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:36.622575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53e2ac2d-e1b3-4df4-9f12-dd77102dcc44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:36.622995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53e2ac2d-e1b3-4df4-9f12-dd77102dcc44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:36.695119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d6c8983e-35ad-45b9-847c-d8c73d0cf5fe tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:36.697903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d6c8983e-35ad-45b9-847c-d8c73d0cf5fe tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:36.723787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d6c8983e-35ad-45b9-847c-d8c73d0cf5fe tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:36.725531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d6c8983e-35ad-45b9-847c-d8c73d0cf5fe tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:36.738981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d6c8983e-35ad-45b9-847c-d8c73d0cf5fe tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:36.740296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d6c8983e-35ad-45b9-847c-d8c73d0cf5fe tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:36.741847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d6c8983e-35ad-45b9-847c-d8c73d0cf5fe tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:36.743877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d6c8983e-35ad-45b9-847c-d8c73d0cf5fe tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:36.912955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-53e2ac2d-e1b3-4df4-9f12-dd77102dcc44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:36.926208 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-53e2ac2d-e1b3-4df4-9f12-dd77102dcc44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1308 microversion: 2.1 time: 0.318402 Aug 18 11:31:36.927434 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 744/1506] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:36 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1308 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:36.935761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2c734a6f-e2b2-406f-b842-a6d7776c71fd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:36.938831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2c734a6f-e2b2-406f-b842-a6d7776c71fd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:36.950766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c734a6f-e2b2-406f-b842-a6d7776c71fd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:36.951535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c734a6f-e2b2-406f-b842-a6d7776c71fd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:36.952481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c734a6f-e2b2-406f-b842-a6d7776c71fd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:36.953524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c734a6f-e2b2-406f-b842-a6d7776c71fd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:36.954208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c734a6f-e2b2-406f-b842-a6d7776c71fd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:36.954959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c734a6f-e2b2-406f-b842-a6d7776c71fd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:37.008226 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2c734a6f-e2b2-406f-b842-a6d7776c71fd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.079027 Aug 18 11:31:37.010034 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 745/1507] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:31:36 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:31:37.051999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d6c8983e-35ad-45b9-847c-d8c73d0cf5fe tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:37.064442 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d6c8983e-35ad-45b9-847c-d8c73d0cf5fe tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.374572 Aug 18 11:31:37.066472 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 763/1508] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:36 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:37.239612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4eeb4371-8a3b-4ced-aa09-745c2ab57314 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:37.240565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4eeb4371-8a3b-4ced-aa09-745c2ab57314 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:37.247735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4eeb4371-8a3b-4ced-aa09-745c2ab57314 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:37.248541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4eeb4371-8a3b-4ced-aa09-745c2ab57314 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:37.249214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4eeb4371-8a3b-4ced-aa09-745c2ab57314 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:37.250140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4eeb4371-8a3b-4ced-aa09-745c2ab57314 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:37.250833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4eeb4371-8a3b-4ced-aa09-745c2ab57314 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:37.251465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4eeb4371-8a3b-4ced-aa09-745c2ab57314 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:37.482798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b163cf41-dce3-472a-848e-b366eff1ec92 tempest-ListImageFiltersNegativeTestJSON-942755583 tempest-ListImageFiltersNegativeTestJSON-942755583-project] Calling method '.version_select at 0x7f519f8da430>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:37.521315 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-b163cf41-dce3-472a-848e-b366eff1ec92 tempest-ListImageFiltersNegativeTestJSON-942755583 tempest-ListImageFiltersNegativeTestJSON-942755583-project] HTTP exception thrown: Image not found. Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b163cf41-dce3-472a-848e-b366eff1ec92 tempest-ListImageFiltersNegativeTestJSON-942755583 tempest-ListImageFiltersNegativeTestJSON-942755583-project] Request method failure captured: Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/images/9c722228-cf2e-434b-9d98-67d4f3f75e1d HTTP/1.1 Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMZkKpb9Ft5c2nnxxi-buP533JjTZ83NSpEAZEgRzqZcwZ4oLhA-CNK-Bx3exoY408BYQd1cPsdRIDX_U4QBAGOUXZ4oes5xWNG75SUFT4t4f7kLmSnVOK6WwMSX5Rc2kGezVWx6VnIuZ7Ythk6-k9j6do7Z3xlP9QyZjitwDTPKwc Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 5d97ff1ececb42e8b8c33dd8d2c6e530 Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-942755583 Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:31:37.525538 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:31:37.528438 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5d97ff1ececb42e8b8c33dd8d2c6e530"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5d97ff1ececb42e8b8c33dd8d2c6e530"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5d97ff1ececb42e8b8c33dd8d2c6e530"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5d97ff1ececb42e8b8c33dd8d2c6e530"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:37.528438 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-942755583 Aug 18 11:31:37.528438 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 5d97ff1ececb42e8b8c33dd8d2c6e530 Aug 18 11:31:37.528438 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-942755583 Aug 18 11:31:37.528438 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ListImageFiltersNegativeTestJSON-942755583-project Aug 18 11:31:37.528438 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:31:37.528438 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:31:37.528438 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b882d85db6b94d6e82bfe31eab346482 Aug 18 11:31:37.528438 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-942755583-project Aug 18 11:31:37.528438 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:31:37.528438 n-d-853611-3 devstack@n-api.service[122209]: exception: Image not found. Aug 18 11:31:37.528438 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '9c722228-cf2e-434b-9d98-67d4f3f75e1d'} Aug 18 11:31:37.528438 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:31:37.529469 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9c722228-cf2e-434b-9d98-67d4f3f75e1d Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:31:37.530806 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9c722228-cf2e-434b-9d98-67d4f3f75e1d could not be found. Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:31:37.532149 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:31:37.534628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:37.538022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b163cf41-dce3-472a-848e-b366eff1ec92 tempest-ListImageFiltersNegativeTestJSON-942755583 tempest-ListImageFiltersNegativeTestJSON-942755583-project] Returning 404 to user: Image not found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:37.538022 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b163cf41-dce3-472a-848e-b366eff1ec92 tempest-ListImageFiltersNegativeTestJSON-942755583 tempest-ListImageFiltersNegativeTestJSON-942755583-project] 10.222.0.73 "GET /compute/v2.1/images/9c722228-cf2e-434b-9d98-67d4f3f75e1d" status: 404 len: 62 microversion: 2.1 time: 0.247007 Aug 18 11:31:37.539444 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 764/1509] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:31:37 2022] GET /compute/v2.1/images/9c722228-cf2e-434b-9d98-67d4f3f75e1d => generated 62 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 18 11:31:37.953113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4eeb4371-8a3b-4ced-aa09-745c2ab57314 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9acdefe639f4a65b044946df5e14125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981fdc1f21994baeaf839349c8831d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:37.963269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a9b909d0-7746-4d10-a88e-47c86ca27caf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:37.969548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a9b909d0-7746-4d10-a88e-47c86ca27caf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:37.992330 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4eeb4371-8a3b-4ced-aa09-745c2ab57314 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 200 len: 1508 microversion: 2.1 time: 0.755465 Aug 18 11:31:37.993737 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 746/1510] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:37 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 1508 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:38.004413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9b909d0-7746-4d10-a88e-47c86ca27caf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:38.004959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9b909d0-7746-4d10-a88e-47c86ca27caf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:38.005636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9b909d0-7746-4d10-a88e-47c86ca27caf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:38.006743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9b909d0-7746-4d10-a88e-47c86ca27caf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:38.007209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9b909d0-7746-4d10-a88e-47c86ca27caf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:38.007635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9b909d0-7746-4d10-a88e-47c86ca27caf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:38.027368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a5902c7f-f21b-4547-ad54-c1a7725c4381 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:38.033171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a5902c7f-f21b-4547-ad54-c1a7725c4381 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:38.043318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5902c7f-f21b-4547-ad54-c1a7725c4381 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:38.045102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5902c7f-f21b-4547-ad54-c1a7725c4381 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:38.045728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5902c7f-f21b-4547-ad54-c1a7725c4381 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:38.046608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5902c7f-f21b-4547-ad54-c1a7725c4381 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:38.047299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5902c7f-f21b-4547-ad54-c1a7725c4381 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:38.047985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5902c7f-f21b-4547-ad54-c1a7725c4381 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:38.130143 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a5902c7f-f21b-4547-ad54-c1a7725c4381 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111107 Aug 18 11:31:38.130967 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 747/1511] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:31:38 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:31:38.155340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-551ff836-ddb2-4f5f-af34-4a1759b8cb18 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:38.156411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-551ff836-ddb2-4f5f-af34-4a1759b8cb18 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:38.168765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-551ff836-ddb2-4f5f-af34-4a1759b8cb18 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:38.169550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-551ff836-ddb2-4f5f-af34-4a1759b8cb18 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:38.172670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-551ff836-ddb2-4f5f-af34-4a1759b8cb18 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:38.175390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-551ff836-ddb2-4f5f-af34-4a1759b8cb18 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:38.177749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-551ff836-ddb2-4f5f-af34-4a1759b8cb18 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:38.186356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-551ff836-ddb2-4f5f-af34-4a1759b8cb18 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:38.369659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a9b909d0-7746-4d10-a88e-47c86ca27caf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:38.379653 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a9b909d0-7746-4d10-a88e-47c86ca27caf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1308 microversion: 2.1 time: 0.432290 Aug 18 11:31:38.380431 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 765/1512] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:37 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1308 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:38.386583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-ab1dc45b-f517-43ab-9fc6-11b9f6c38ca9 req-02913480-4b85-4c5e-a57c-a308b8696761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7290b8-c88b-4742-9fa8-ee6fce5420b0", "name": "network-vif-deleted", "tag": "14fd99b0-1758-4dcc-912e-7aeacba2da78"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:38.398495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ab1dc45b-f517-43ab-9fc6-11b9f6c38ca9 req-02913480-4b85-4c5e-a57c-a308b8696761 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:38.398990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ab1dc45b-f517-43ab-9fc6-11b9f6c38ca9 req-02913480-4b85-4c5e-a57c-a308b8696761 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:38.399685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ab1dc45b-f517-43ab-9fc6-11b9f6c38ca9 req-02913480-4b85-4c5e-a57c-a308b8696761 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:38.413780 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ab1dc45b-f517-43ab-9fc6-11b9f6c38ca9 req-02913480-4b85-4c5e-a57c-a308b8696761 service nova] Creating event network-vif-deleted:14fd99b0-1758-4dcc-912e-7aeacba2da78 for instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 on n-h1-853611-3 Aug 18 11:31:38.419609 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-ab1dc45b-f517-43ab-9fc6-11b9f6c38ca9 req-02913480-4b85-4c5e-a57c-a308b8696761 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037785 Aug 18 11:31:38.420229 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 766/1513] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:38.686581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-551ff836-ddb2-4f5f-af34-4a1759b8cb18 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:38.704895 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-551ff836-ddb2-4f5f-af34-4a1759b8cb18 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1715 microversion: 2.1 time: 0.571875 Aug 18 11:31:38.708111 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 748/1514] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:38 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1715 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:39.017344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e17525f3-26f6-4edf-afe0-b6d11d41bb1e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:39.018062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e17525f3-26f6-4edf-afe0-b6d11d41bb1e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:39.037159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e17525f3-26f6-4edf-afe0-b6d11d41bb1e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.037617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e17525f3-26f6-4edf-afe0-b6d11d41bb1e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.039089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e17525f3-26f6-4edf-afe0-b6d11d41bb1e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.040073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e17525f3-26f6-4edf-afe0-b6d11d41bb1e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.040749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e17525f3-26f6-4edf-afe0-b6d11d41bb1e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.041261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e17525f3-26f6-4edf-afe0-b6d11d41bb1e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.062646 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-e17525f3-26f6-4edf-afe0-b6d11d41bb1e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] HTTP exception thrown: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e17525f3-26f6-4edf-afe0-b6d11d41bb1e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Request method failure captured: Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 HTTP/1.1 Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iME-TVL2RwVO4CT-ofmWhM9PepGKF04Jjam-STxNLFTkYV0yW4TuV-VcjYy2tK6bi7bTbTNzc_dd1NM35jadGWh4YNkOSlozaelqsfsAh_A12bKQ5WazqVJX2tHww6OD5TQ5vZNrhshxWm-p6rxJXaMh4NMo6P91qfU_im6j_ZcaK0 Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 981fdc1f21994baeaf839349c8831d89 Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:31:39.065625 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:31:39.067983 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_981fdc1f21994baeaf839349c8831d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:39.067983 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.067983 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 981fdc1f21994baeaf839349c8831d89 Aug 18 11:31:39.067983 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.067983 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesNegativeTestJSON-2048318030-project Aug 18 11:31:39.067983 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:31:39.067983 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:31:39.067983 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e9acdefe639f4a65b044946df5e14125 Aug 18 11:31:39.067983 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesNegativeTestJSON-2048318030-project Aug 18 11:31:39.067983 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:31:39.067983 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.067983 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3a7290b8-c88b-4742-9fa8-ee6fce5420b0'} Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:39.069285 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.071692 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.081420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e17525f3-26f6-4edf-afe0-b6d11d41bb1e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Returning 404 to user: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:39.081420 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e17525f3-26f6-4edf-afe0-b6d11d41bb1e tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 404 len: 111 microversion: 2.1 time: 0.057260 Aug 18 11:31:39.081420 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 767/1515] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:39 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:31:39.083860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-68de72d9-2f1e-4a0a-b207-6d7edcb83d65 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-370098136", "metadata": {"image_type": "test"}}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:39.086672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-68de72d9-2f1e-4a0a-b207-6d7edcb83d65 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:39.107378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68de72d9-2f1e-4a0a-b207-6d7edcb83d65 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.108535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68de72d9-2f1e-4a0a-b207-6d7edcb83d65 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.109232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68de72d9-2f1e-4a0a-b207-6d7edcb83d65 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.111156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68de72d9-2f1e-4a0a-b207-6d7edcb83d65 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.113249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68de72d9-2f1e-4a0a-b207-6d7edcb83d65 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.115631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68de72d9-2f1e-4a0a-b207-6d7edcb83d65 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.149694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4b7d31e4-9de5-4f32-bd73-161a85ea4a9d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:39.157513 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-68de72d9-2f1e-4a0a-b207-6d7edcb83d65 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] HTTP exception thrown: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-68de72d9-2f1e-4a0a-b207-6d7edcb83d65 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Request method failure captured: Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0/action HTTP/1.1 Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 111 Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iME-TVL2RwVO4CT-ofmWhM9PepGKF04Jjam-STxNLFTkYV0yW4TuV-VcjYy2tK6bi7bTbTNzc_dd1NM35jadGWh4YNkOSlozaelqsfsAh_A12bKQ5WazqVJX2tHww6OD5TQ5vZNrhshxWm-p6rxJXaMh4NMo6P91qfU_im6j_ZcaK0 Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 981fdc1f21994baeaf839349c8831d89 Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:31:39.165035 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:31:39.167877 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_981fdc1f21994baeaf839349c8831d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:39.167877 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.167877 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 981fdc1f21994baeaf839349c8831d89 Aug 18 11:31:39.167877 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.167877 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesNegativeTestJSON-2048318030-project Aug 18 11:31:39.167877 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:31:39.167877 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:31:39.167877 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e9acdefe639f4a65b044946df5e14125 Aug 18 11:31:39.167877 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesNegativeTestJSON-2048318030-project Aug 18 11:31:39.167877 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:31:39.167877 n-d-853611-3 devstack@n-api.service[122210]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-370098136", "metadata": {"image_type": "test"}}} Aug 18 11:31:39.167877 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '3a7290b8-c88b-4742-9fa8-ee6fce5420b0', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-370098136', 'metadata': {'image_type': 'test'}}}} Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:39.169025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.171699 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:39.180242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:39.180242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:39.180242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:39.180242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.180242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.181591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4b7d31e4-9de5-4f32-bd73-161a85ea4a9d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:39.182395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-68de72d9-2f1e-4a0a-b207-6d7edcb83d65 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Returning 404 to user: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:39.182395 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-68de72d9-2f1e-4a0a-b207-6d7edcb83d65 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "POST /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0/action" status: 404 len: 111 microversion: 2.1 time: 0.091681 Aug 18 11:31:39.182395 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 749/1516] 10.222.0.73 () {60 vars in 1279 bytes} [Thu Aug 18 11:31:39 2022] POST /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0/action => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:31:39.183408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ee486224-8602-4343-993d-6e1bbe6ce29f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1497548929", "metadata": {"image_type": "test"}}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:39.185945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b7d31e4-9de5-4f32-bd73-161a85ea4a9d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.186267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ee486224-8602-4343-993d-6e1bbe6ce29f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Failed to fetch instance by id tempest-invalid-755894950 {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 18 11:31:39.186505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b7d31e4-9de5-4f32-bd73-161a85ea4a9d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.186813 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-ee486224-8602-4343-993d-6e1bbe6ce29f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] HTTP exception thrown: Instance tempest-invalid-755894950 could not be found. Aug 18 11:31:39.187003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b7d31e4-9de5-4f32-bd73-161a85ea4a9d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.187610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b7d31e4-9de5-4f32-bd73-161a85ea4a9d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.188074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b7d31e4-9de5-4f32-bd73-161a85ea4a9d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ee486224-8602-4343-993d-6e1bbe6ce29f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Request method failure captured: Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/tempest-invalid-755894950/action HTTP/1.1 Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 112 Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iME-TVL2RwVO4CT-ofmWhM9PepGKF04Jjam-STxNLFTkYV0yW4TuV-VcjYy2tK6bi7bTbTNzc_dd1NM35jadGWh4YNkOSlozaelqsfsAh_A12bKQ5WazqVJX2tHww6OD5TQ5vZNrhshxWm-p6rxJXaMh4NMo6P91qfU_im6j_ZcaK0 Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 981fdc1f21994baeaf839349c8831d89 Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:31:39.188335 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:31:39.195505 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_981fdc1f21994baeaf839349c8831d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:39.195505 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.195505 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 981fdc1f21994baeaf839349c8831d89 Aug 18 11:31:39.195505 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.195505 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesNegativeTestJSON-2048318030-project Aug 18 11:31:39.195505 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:31:39.195505 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:31:39.195505 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e9acdefe639f4a65b044946df5e14125 Aug 18 11:31:39.195505 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesNegativeTestJSON-2048318030-project Aug 18 11:31:39.195505 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:31:39.195505 n-d-853611-3 devstack@n-api.service[122210]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1497548929", "metadata": {"image_type": "test"}}} Aug 18 11:31:39.195505 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance tempest-invalid-755894950 could not be found. Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'tempest-invalid-755894950', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1497548929', 'metadata': {'image_type': 'test'}}}} Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-755894950 could not be found. Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:39.197104 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-755894950 could not be found. Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-755894950 could not be found. Aug 18 11:31:39.200447 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.204181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b7d31e4-9de5-4f32-bd73-161a85ea4a9d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.204403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ee486224-8602-4343-993d-6e1bbe6ce29f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Returning 404 to user: Instance tempest-invalid-755894950 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:39.204403 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ee486224-8602-4343-993d-6e1bbe6ce29f tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "POST /compute/v2.1/servers/tempest-invalid-755894950/action" status: 404 len: 100 microversion: 2.1 time: 0.011550 Aug 18 11:31:39.204403 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 750/1517] 10.222.0.73 () {60 vars in 1246 bytes} [Thu Aug 18 11:31:39 2022] POST /compute/v2.1/servers/tempest-invalid-755894950/action => generated 100 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:31:39.204403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-51a5f268-4465-4a8a-a275-4badb03d5282 req-3fa77f19-5eb2-4660-a222-0bcb9032c77b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95fda40e-acac-4a4a-8823-1a6aa7d9c359", "tag": "843cde9b-134a-4680-a1a3-1ee63acb156b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:39.214794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-51a5f268-4465-4a8a-a275-4badb03d5282 req-3fa77f19-5eb2-4660-a222-0bcb9032c77b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.216310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-51a5f268-4465-4a8a-a275-4badb03d5282 req-3fa77f19-5eb2-4660-a222-0bcb9032c77b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.216942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-51a5f268-4465-4a8a-a275-4badb03d5282 req-3fa77f19-5eb2-4660-a222-0bcb9032c77b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.233284 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-51a5f268-4465-4a8a-a275-4badb03d5282 req-3fa77f19-5eb2-4660-a222-0bcb9032c77b service nova] Creating event network-changed:843cde9b-134a-4680-a1a3-1ee63acb156b for instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 on n-h1-853611-3 Aug 18 11:31:39.242618 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-51a5f268-4465-4a8a-a275-4badb03d5282 req-3fa77f19-5eb2-4660-a222-0bcb9032c77b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049518 Aug 18 11:31:39.243628 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 751/1518] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:39.251040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dfc18e15-771a-481f-82fa-259b2818ef28 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1620948462"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:39.253827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dfc18e15-771a-481f-82fa-259b2818ef28 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 18 11:31:39.254695 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-dfc18e15-771a-481f-82fa-259b2818ef28 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dfc18e15-771a-481f-82fa-259b2818ef28 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Request method failure captured: Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 57 Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iME-TVL2RwVO4CT-ofmWhM9PepGKF04Jjam-STxNLFTkYV0yW4TuV-VcjYy2tK6bi7bTbTNzc_dd1NM35jadGWh4YNkOSlozaelqsfsAh_A12bKQ5WazqVJX2tHww6OD5TQ5vZNrhshxWm-p6rxJXaMh4NMo6P91qfU_im6j_ZcaK0 Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 981fdc1f21994baeaf839349c8831d89 Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:31:39.257121 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:31:39.258766 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_981fdc1f21994baeaf839349c8831d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:39.258766 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.258766 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 981fdc1f21994baeaf839349c8831d89 Aug 18 11:31:39.258766 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.258766 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesNegativeTestJSON-2048318030-project Aug 18 11:31:39.258766 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:31:39.258766 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:31:39.258766 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e9acdefe639f4a65b044946df5e14125 Aug 18 11:31:39.258766 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesNegativeTestJSON-2048318030-project Aug 18 11:31:39.258766 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:31:39.258766 n-d-853611-3 devstack@n-api.service[122210]: {"createImage": {"name": "tempest-test-snap-1620948462"}} Aug 18 11:31:39.258766 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:31:39.258766 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1620948462'}}} Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:31:39.259631 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 18 11:31:39.262637 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.265545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dfc18e15-771a-481f-82fa-259b2818ef28 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:39.265545 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dfc18e15-771a-481f-82fa-259b2818ef28 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.013649 Aug 18 11:31:39.265545 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 752/1519] 10.222.0.73 () {60 vars in 1275 bytes} [Thu Aug 18 11:31:39 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:31:39.271941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5e7cbee5-542c-4e81-93b7-f59ab50e1ad6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-94730611"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:39.276689 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4b7d31e4-9de5-4f32-bd73-161a85ea4a9d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.134143 Aug 18 11:31:39.277633 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 768/1520] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:31:39 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 11:31:39.281740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5e7cbee5-542c-4e81-93b7-f59ab50e1ad6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 18 11:31:39.291660 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-5e7cbee5-542c-4e81-93b7-f59ab50e1ad6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5e7cbee5-542c-4e81-93b7-f59ab50e1ad6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Request method failure captured: Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 55 Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iME-TVL2RwVO4CT-ofmWhM9PepGKF04Jjam-STxNLFTkYV0yW4TuV-VcjYy2tK6bi7bTbTNzc_dd1NM35jadGWh4YNkOSlozaelqsfsAh_A12bKQ5WazqVJX2tHww6OD5TQ5vZNrhshxWm-p6rxJXaMh4NMo6P91qfU_im6j_ZcaK0 Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 981fdc1f21994baeaf839349c8831d89 Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:31:39.297443 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:31:39.299264 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_981fdc1f21994baeaf839349c8831d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:39.299264 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.299264 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 981fdc1f21994baeaf839349c8831d89 Aug 18 11:31:39.299264 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.299264 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesNegativeTestJSON-2048318030-project Aug 18 11:31:39.299264 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:31:39.299264 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:31:39.299264 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e9acdefe639f4a65b044946df5e14125 Aug 18 11:31:39.299264 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesNegativeTestJSON-2048318030-project Aug 18 11:31:39.299264 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:31:39.299264 n-d-853611-3 devstack@n-api.service[122210]: {"createImage": {"name": "tempest-test-snap-94730611"}} Aug 18 11:31:39.299264 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:31:39.299264 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-94730611'}}} Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:31:39.300368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 18 11:31:39.301932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.305701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5e7cbee5-542c-4e81-93b7-f59ab50e1ad6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:39.307013 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5e7cbee5-542c-4e81-93b7-f59ab50e1ad6 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.039833 Aug 18 11:31:39.309014 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 753/1521] 10.222.0.73 () {60 vars in 1281 bytes} [Thu Aug 18 11:31:39 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:31:39.317879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-54f77853-5241-4bcd-bf17-1e169d500157 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:39.318386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-54f77853-5241-4bcd-bf17-1e169d500157 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:39.326828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54f77853-5241-4bcd-bf17-1e169d500157 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.327587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54f77853-5241-4bcd-bf17-1e169d500157 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.328259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54f77853-5241-4bcd-bf17-1e169d500157 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.329815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54f77853-5241-4bcd-bf17-1e169d500157 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.330507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54f77853-5241-4bcd-bf17-1e169d500157 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.331848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54f77853-5241-4bcd-bf17-1e169d500157 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.351579 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-54f77853-5241-4bcd-bf17-1e169d500157 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] HTTP exception thrown: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-54f77853-5241-4bcd-bf17-1e169d500157 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Request method failure captured: Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 HTTP/1.1 Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iME-TVL2RwVO4CT-ofmWhM9PepGKF04Jjam-STxNLFTkYV0yW4TuV-VcjYy2tK6bi7bTbTNzc_dd1NM35jadGWh4YNkOSlozaelqsfsAh_A12bKQ5WazqVJX2tHww6OD5TQ5vZNrhshxWm-p6rxJXaMh4NMo6P91qfU_im6j_ZcaK0 Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 981fdc1f21994baeaf839349c8831d89 Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:31:39.353658 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:31:39.355925 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_981fdc1f21994baeaf839349c8831d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:39.355925 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.355925 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 981fdc1f21994baeaf839349c8831d89 Aug 18 11:31:39.355925 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.355925 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesNegativeTestJSON-2048318030-project Aug 18 11:31:39.355925 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:31:39.355925 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:31:39.355925 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e9acdefe639f4a65b044946df5e14125 Aug 18 11:31:39.355925 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesNegativeTestJSON-2048318030-project Aug 18 11:31:39.355925 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:31:39.355925 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.355925 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3a7290b8-c88b-4742-9fa8-ee6fce5420b0'} Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:39.357880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.364787 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.369024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-54f77853-5241-4bcd-bf17-1e169d500157 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Returning 404 to user: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:39.369024 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-54f77853-5241-4bcd-bf17-1e169d500157 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 404 len: 111 microversion: 2.1 time: 0.042938 Aug 18 11:31:39.369024 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 769/1522] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:31:39 2022] DELETE /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:31:39.369345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8677ef94-43b0-4a15-8817-5301df0b14c1 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:39.372529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8677ef94-43b0-4a15-8817-5301df0b14c1 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] [instance: 3a7290b8-c88b-4742-9fa8-ee6fce5420b0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:39.380548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8677ef94-43b0-4a15-8817-5301df0b14c1 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.381085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8677ef94-43b0-4a15-8817-5301df0b14c1 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.381545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8677ef94-43b0-4a15-8817-5301df0b14c1 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.382270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8677ef94-43b0-4a15-8817-5301df0b14c1 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.382759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8677ef94-43b0-4a15-8817-5301df0b14c1 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.383435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8677ef94-43b0-4a15-8817-5301df0b14c1 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.401693 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-8677ef94-43b0-4a15-8817-5301df0b14c1 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] HTTP exception thrown: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8677ef94-43b0-4a15-8817-5301df0b14c1 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Request method failure captured: Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 HTTP/1.1 Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iME-TVL2RwVO4CT-ofmWhM9PepGKF04Jjam-STxNLFTkYV0yW4TuV-VcjYy2tK6bi7bTbTNzc_dd1NM35jadGWh4YNkOSlozaelqsfsAh_A12bKQ5WazqVJX2tHww6OD5TQ5vZNrhshxWm-p6rxJXaMh4NMo6P91qfU_im6j_ZcaK0 Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 981fdc1f21994baeaf839349c8831d89 Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:31:39.403679 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:31:39.405417 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_981fdc1f21994baeaf839349c8831d89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/981fdc1f21994baeaf839349c8831d89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:31:39.405417 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.405417 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 981fdc1f21994baeaf839349c8831d89 Aug 18 11:31:39.405417 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2048318030 Aug 18 11:31:39.405417 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesNegativeTestJSON-2048318030-project Aug 18 11:31:39.405417 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:31:39.405417 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:31:39.405417 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e9acdefe639f4a65b044946df5e14125 Aug 18 11:31:39.405417 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesNegativeTestJSON-2048318030-project Aug 18 11:31:39.405417 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:31:39.405417 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.405417 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '3a7290b8-c88b-4742-9fa8-ee6fce5420b0'} Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:31:39.406667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. Aug 18 11:31:39.408257 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:31:39.409922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d81af3ff-bd9f-425c-ae7c-4ba81ffc3e52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:39.410028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8677ef94-43b0-4a15-8817-5301df0b14c1 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] Returning 404 to user: Instance 3a7290b8-c88b-4742-9fa8-ee6fce5420b0 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:31:39.410126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d81af3ff-bd9f-425c-ae7c-4ba81ffc3e52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:39.410222 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8677ef94-43b0-4a15-8817-5301df0b14c1 tempest-ImagesNegativeTestJSON-2048318030 tempest-ImagesNegativeTestJSON-2048318030-project] 10.222.0.73 "GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0" status: 404 len: 111 microversion: 2.1 time: 0.042760 Aug 18 11:31:39.410222 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 754/1523] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:39 2022] GET /compute/v2.1/servers/3a7290b8-c88b-4742-9fa8-ee6fce5420b0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:31:39.420501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d81af3ff-bd9f-425c-ae7c-4ba81ffc3e52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.421013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d81af3ff-bd9f-425c-ae7c-4ba81ffc3e52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.421469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d81af3ff-bd9f-425c-ae7c-4ba81ffc3e52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.422192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d81af3ff-bd9f-425c-ae7c-4ba81ffc3e52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.422694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d81af3ff-bd9f-425c-ae7c-4ba81ffc3e52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.423132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d81af3ff-bd9f-425c-ae7c-4ba81ffc3e52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.735713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fd627ba7-cb27-4e15-ad63-ce9a87b58b90 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:39.736699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fd627ba7-cb27-4e15-ad63-ce9a87b58b90 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:39.755921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd627ba7-cb27-4e15-ad63-ce9a87b58b90 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.757252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd627ba7-cb27-4e15-ad63-ce9a87b58b90 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.758884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd627ba7-cb27-4e15-ad63-ce9a87b58b90 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.759804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d81af3ff-bd9f-425c-ae7c-4ba81ffc3e52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:39.762158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd627ba7-cb27-4e15-ad63-ce9a87b58b90 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:39.763278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd627ba7-cb27-4e15-ad63-ce9a87b58b90 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:39.765399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd627ba7-cb27-4e15-ad63-ce9a87b58b90 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:39.771366 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d81af3ff-bd9f-425c-ae7c-4ba81ffc3e52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1308 microversion: 2.1 time: 0.372055 Aug 18 11:31:39.787859 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 770/1524] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:39 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1308 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:39.803906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:40.105256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fd627ba7-cb27-4e15-ad63-ce9a87b58b90 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:40.121004 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fd627ba7-cb27-4e15-ad63-ce9a87b58b90 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1705 microversion: 2.1 time: 0.392688 Aug 18 11:31:40.123178 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 755/1525] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:39 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1705 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:40.148958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1cd000a6-5481-4c80-a861-63661ec9914f tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '.version_select at 0x7f519f94f820>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:40.156092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1cd000a6-5481-4c80-a861-63661ec9914f tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:40.157325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1cd000a6-5481-4c80-a861-63661ec9914f tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:40.158058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1cd000a6-5481-4c80-a861-63661ec9914f tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:40.172578 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1cd000a6-5481-4c80-a861-63661ec9914f tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.027651 Aug 18 11:31:40.173861 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 771/1526] 10.222.0.73 () {58 vars in 1143 bytes} [Thu Aug 18 11:31:40 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:40.189585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a3a45806-d1b0-4aa2-81d0-81888b7d5b22 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:40.191064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a3a45806-d1b0-4aa2-81d0-81888b7d5b22 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:40.200329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3a45806-d1b0-4aa2-81d0-81888b7d5b22 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:40.201135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3a45806-d1b0-4aa2-81d0-81888b7d5b22 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:40.202514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3a45806-d1b0-4aa2-81d0-81888b7d5b22 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:40.203544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3a45806-d1b0-4aa2-81d0-81888b7d5b22 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:40.204634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3a45806-d1b0-4aa2-81d0-81888b7d5b22 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:40.205349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3a45806-d1b0-4aa2-81d0-81888b7d5b22 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:40.290532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4e9aa16d-d866-4aeb-9058-1b71c739764c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:40.299181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4e9aa16d-d866-4aeb-9058-1b71c739764c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:40.302659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:40.315815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e9aa16d-d866-4aeb-9058-1b71c739764c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:40.316334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e9aa16d-d866-4aeb-9058-1b71c739764c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:40.316790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e9aa16d-d866-4aeb-9058-1b71c739764c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:40.317558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e9aa16d-d866-4aeb-9058-1b71c739764c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:40.317993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e9aa16d-d866-4aeb-9058-1b71c739764c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:40.318450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e9aa16d-d866-4aeb-9058-1b71c739764c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:40.355102 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4e9aa16d-d866-4aeb-9058-1b71c739764c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.068196 Aug 18 11:31:40.360497 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 772/1527] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:31:40 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:31:40.387928 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a3a45806-d1b0-4aa2-81d0-81888b7d5b22 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1856 microversion: 2.1 time: 0.202540 Aug 18 11:31:40.388835 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 756/1528] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:40 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1856 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:40.409023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b18dad43-b836-4bf7-8cef-8a29bd2aa8c0 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:40.409650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b18dad43-b836-4bf7-8cef-8a29bd2aa8c0 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:40.420960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b18dad43-b836-4bf7-8cef-8a29bd2aa8c0 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:40.421757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b18dad43-b836-4bf7-8cef-8a29bd2aa8c0 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:40.422217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b18dad43-b836-4bf7-8cef-8a29bd2aa8c0 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:40.425544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b18dad43-b836-4bf7-8cef-8a29bd2aa8c0 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:40.426044 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b18dad43-b836-4bf7-8cef-8a29bd2aa8c0 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:40.426526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b18dad43-b836-4bf7-8cef-8a29bd2aa8c0 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:40.727993 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b18dad43-b836-4bf7-8cef-8a29bd2aa8c0 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1856 microversion: 2.1 time: 0.322401 Aug 18 11:31:40.729033 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 773/1529] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:40 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1856 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:40.796740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5ecab01a-06a9-42c1-b387-8b32a0ca0433 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:40.797434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5ecab01a-06a9-42c1-b387-8b32a0ca0433 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:40.810186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ecab01a-06a9-42c1-b387-8b32a0ca0433 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:40.811066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ecab01a-06a9-42c1-b387-8b32a0ca0433 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:40.811749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ecab01a-06a9-42c1-b387-8b32a0ca0433 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:40.812736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ecab01a-06a9-42c1-b387-8b32a0ca0433 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:40.813704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ecab01a-06a9-42c1-b387-8b32a0ca0433 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:40.814345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ecab01a-06a9-42c1-b387-8b32a0ca0433 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:40.821458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d67e66c6-589f-4ce9-aedf-19ca5f5b27a2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:40.822294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d67e66c6-589f-4ce9-aedf-19ca5f5b27a2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:40.829810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d67e66c6-589f-4ce9-aedf-19ca5f5b27a2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:40.830336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d67e66c6-589f-4ce9-aedf-19ca5f5b27a2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:40.830853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d67e66c6-589f-4ce9-aedf-19ca5f5b27a2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:40.831622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d67e66c6-589f-4ce9-aedf-19ca5f5b27a2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:40.832324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d67e66c6-589f-4ce9-aedf-19ca5f5b27a2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:40.832952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d67e66c6-589f-4ce9-aedf-19ca5f5b27a2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:41.043553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-d67e66c6-589f-4ce9-aedf-19ca5f5b27a2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lazy-loading 'services' on Instance uuid 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:31:41.155811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5ecab01a-06a9-42c1-b387-8b32a0ca0433 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:41.173627 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5ecab01a-06a9-42c1-b387-8b32a0ca0433 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1308 microversion: 2.1 time: 0.382912 Aug 18 11:31:41.174857 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 757/1530] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:40 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1308 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:41.271583 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d67e66c6-589f-4ce9-aedf-19ca5f5b27a2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments/a3c7a701-d080-43f6-8ed0-cd083a13b56a" status: 202 len: 0 microversion: 2.1 time: 0.454113 Aug 18 11:31:41.272551 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 774/1531] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 11:31:40 2022] DELETE /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments/a3c7a701-d080-43f6-8ed0-cd083a13b56a => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:31:41.287299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de0be3ff-e3fe-40ff-b80a-2837c9b6330d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:41.289868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-de0be3ff-e3fe-40ff-b80a-2837c9b6330d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:41.306245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de0be3ff-e3fe-40ff-b80a-2837c9b6330d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:41.308657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de0be3ff-e3fe-40ff-b80a-2837c9b6330d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:41.309652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de0be3ff-e3fe-40ff-b80a-2837c9b6330d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:41.311356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de0be3ff-e3fe-40ff-b80a-2837c9b6330d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:41.313544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de0be3ff-e3fe-40ff-b80a-2837c9b6330d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:41.316003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de0be3ff-e3fe-40ff-b80a-2837c9b6330d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:41.368677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-47931f6b-ebb4-43aa-bdc4-34c7bd6394cd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:41.371568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-47931f6b-ebb4-43aa-bdc4-34c7bd6394cd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:41.383816 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de0be3ff-e3fe-40ff-b80a-2837c9b6330d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104616 Aug 18 11:31:41.387016 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 758/1532] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:31:41 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:41.391413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47931f6b-ebb4-43aa-bdc4-34c7bd6394cd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:41.392220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47931f6b-ebb4-43aa-bdc4-34c7bd6394cd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:41.393615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47931f6b-ebb4-43aa-bdc4-34c7bd6394cd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:41.394667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47931f6b-ebb4-43aa-bdc4-34c7bd6394cd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:41.395313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47931f6b-ebb4-43aa-bdc4-34c7bd6394cd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:41.396733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47931f6b-ebb4-43aa-bdc4-34c7bd6394cd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:41.440538 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-47931f6b-ebb4-43aa-bdc4-34c7bd6394cd tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.076273 Aug 18 11:31:41.441126 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 775/1533] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:31:41 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:42.198403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8c1c346b-b2c8-43fc-9f71-541f8c9d935c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:42.199452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8c1c346b-b2c8-43fc-9f71-541f8c9d935c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:42.213295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c1c346b-b2c8-43fc-9f71-541f8c9d935c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:42.215758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c1c346b-b2c8-43fc-9f71-541f8c9d935c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:42.215758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c1c346b-b2c8-43fc-9f71-541f8c9d935c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:42.216379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c1c346b-b2c8-43fc-9f71-541f8c9d935c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:42.216838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c1c346b-b2c8-43fc-9f71-541f8c9d935c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:42.217265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c1c346b-b2c8-43fc-9f71-541f8c9d935c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:42.398300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0ee0f050-09c2-479e-b49d-7f0322a73de2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:42.402647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0ee0f050-09c2-479e-b49d-7f0322a73de2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:42.421813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:42.444021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ee0f050-09c2-479e-b49d-7f0322a73de2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:42.445401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ee0f050-09c2-479e-b49d-7f0322a73de2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:42.446047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ee0f050-09c2-479e-b49d-7f0322a73de2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:42.447004 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ee0f050-09c2-479e-b49d-7f0322a73de2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:42.451242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ee0f050-09c2-479e-b49d-7f0322a73de2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:42.451932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ee0f050-09c2-479e-b49d-7f0322a73de2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:42.562848 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0ee0f050-09c2-479e-b49d-7f0322a73de2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168965 Aug 18 11:31:42.573656 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 776/1534] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:31:42 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:42.762210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8c1c346b-b2c8-43fc-9f71-541f8c9d935c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:42.774421 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8c1c346b-b2c8-43fc-9f71-541f8c9d935c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1308 microversion: 2.1 time: 0.579071 Aug 18 11:31:42.777639 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 759/1535] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:42 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1308 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:43.575766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=8 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:43.589274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9b9e129b-0559-4adb-a4eb-03a9ce477a2d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:43.600942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9b9e129b-0559-4adb-a4eb-03a9ce477a2d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:43.632270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b9e129b-0559-4adb-a4eb-03a9ce477a2d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:43.633424 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b9e129b-0559-4adb-a4eb-03a9ce477a2d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:43.634882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b9e129b-0559-4adb-a4eb-03a9ce477a2d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:43.638341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b9e129b-0559-4adb-a4eb-03a9ce477a2d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:43.639929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b9e129b-0559-4adb-a4eb-03a9ce477a2d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:43.642577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b9e129b-0559-4adb-a4eb-03a9ce477a2d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:43.709302 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9b9e129b-0559-4adb-a4eb-03a9ce477a2d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134068 Aug 18 11:31:43.711319 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 777/1536] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:31:43 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:43.801093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4d65dcc5-c3ba-4609-b9d1-2b20f906d389 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:43.801712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4d65dcc5-c3ba-4609-b9d1-2b20f906d389 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:43.817616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d65dcc5-c3ba-4609-b9d1-2b20f906d389 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:43.818115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d65dcc5-c3ba-4609-b9d1-2b20f906d389 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:43.818719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d65dcc5-c3ba-4609-b9d1-2b20f906d389 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:43.819765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d65dcc5-c3ba-4609-b9d1-2b20f906d389 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:43.820463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d65dcc5-c3ba-4609-b9d1-2b20f906d389 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:43.821106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d65dcc5-c3ba-4609-b9d1-2b20f906d389 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:44.321492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4d65dcc5-c3ba-4609-b9d1-2b20f906d389 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:44.345984 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4d65dcc5-c3ba-4609-b9d1-2b20f906d389 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1308 microversion: 2.1 time: 0.541496 Aug 18 11:31:44.365148 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 760/1537] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:43 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1308 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:44.725069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ae2f7dfd-13e0-491c-8db2-1869dfb54d67 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:44.727503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ae2f7dfd-13e0-491c-8db2-1869dfb54d67 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:44.745033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ae2f7dfd-13e0-491c-8db2-1869dfb54d67 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:44.746703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ae2f7dfd-13e0-491c-8db2-1869dfb54d67 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:44.749270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ae2f7dfd-13e0-491c-8db2-1869dfb54d67 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:44.750935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ae2f7dfd-13e0-491c-8db2-1869dfb54d67 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:44.759064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ae2f7dfd-13e0-491c-8db2-1869dfb54d67 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:44.759681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ae2f7dfd-13e0-491c-8db2-1869dfb54d67 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:44.806264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:44.845048 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ae2f7dfd-13e0-491c-8db2-1869dfb54d67 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123974 Aug 18 11:31:44.846773 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 778/1538] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:31:44 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:45.382365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fca35aa9-f1c5-41d8-8272-245e1c3321f9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:45.384451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fca35aa9-f1c5-41d8-8272-245e1c3321f9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:45.414387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fca35aa9-f1c5-41d8-8272-245e1c3321f9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:45.414387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fca35aa9-f1c5-41d8-8272-245e1c3321f9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:45.414387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fca35aa9-f1c5-41d8-8272-245e1c3321f9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:45.414387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fca35aa9-f1c5-41d8-8272-245e1c3321f9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:45.414909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fca35aa9-f1c5-41d8-8272-245e1c3321f9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:45.418489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fca35aa9-f1c5-41d8-8272-245e1c3321f9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:45.581687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-d3d9941e-3888-46cc-b31c-f1e376702000 req-84c408c5-713b-45ec-b7b0-ca356877ba7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95fda40e-acac-4a4a-8823-1a6aa7d9c359", "name": "network-vif-plugged", "status": "completed", "tag": "843cde9b-134a-4680-a1a3-1ee63acb156b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:45.618606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d3d9941e-3888-46cc-b31c-f1e376702000 req-84c408c5-713b-45ec-b7b0-ca356877ba7f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:45.620832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d3d9941e-3888-46cc-b31c-f1e376702000 req-84c408c5-713b-45ec-b7b0-ca356877ba7f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:45.639652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d3d9941e-3888-46cc-b31c-f1e376702000 req-84c408c5-713b-45ec-b7b0-ca356877ba7f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:45.695790 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-d3d9941e-3888-46cc-b31c-f1e376702000 req-84c408c5-713b-45ec-b7b0-ca356877ba7f service nova] Creating event network-vif-plugged:843cde9b-134a-4680-a1a3-1ee63acb156b for instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 on n-h1-853611-3 Aug 18 11:31:45.724450 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-d3d9941e-3888-46cc-b31c-f1e376702000 req-84c408c5-713b-45ec-b7b0-ca356877ba7f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147937 Aug 18 11:31:45.727586 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 779/1539] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:31:45.861977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ee48b362-a52e-4e51-82da-ff8683b21a93 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:45.871870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ee48b362-a52e-4e51-82da-ff8683b21a93 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:45.931726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee48b362-a52e-4e51-82da-ff8683b21a93 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:45.949663 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee48b362-a52e-4e51-82da-ff8683b21a93 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:45.953777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee48b362-a52e-4e51-82da-ff8683b21a93 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:45.957591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee48b362-a52e-4e51-82da-ff8683b21a93 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:45.958872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee48b362-a52e-4e51-82da-ff8683b21a93 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:45.962562 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee48b362-a52e-4e51-82da-ff8683b21a93 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:46.060328 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ee48b362-a52e-4e51-82da-ff8683b21a93 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206180 Aug 18 11:31:46.061683 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 780/1540] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:31:45 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:31:46.569369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fca35aa9-f1c5-41d8-8272-245e1c3321f9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:46.585665 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fca35aa9-f1c5-41d8-8272-245e1c3321f9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1308 microversion: 2.1 time: 1.217551 Aug 18 11:31:46.587584 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 761/1541] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:45 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1308 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:47.080213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-755ba456-b63b-4bf7-b531-e755076bb372 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:47.083303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-755ba456-b63b-4bf7-b531-e755076bb372 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:47.119112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-755ba456-b63b-4bf7-b531-e755076bb372 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:47.122133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-755ba456-b63b-4bf7-b531-e755076bb372 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:47.123725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-755ba456-b63b-4bf7-b531-e755076bb372 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:47.124995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-755ba456-b63b-4bf7-b531-e755076bb372 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:47.135050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-755ba456-b63b-4bf7-b531-e755076bb372 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:47.136130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-755ba456-b63b-4bf7-b531-e755076bb372 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:47.285035 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-755ba456-b63b-4bf7-b531-e755076bb372 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213296 Aug 18 11:31:47.299312 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 781/1542] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:31:47 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:47.608808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3c909635-7ef2-458f-9725-5601ee4bee42 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:47.610163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3c909635-7ef2-458f-9725-5601ee4bee42 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:47.620437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c909635-7ef2-458f-9725-5601ee4bee42 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:47.625630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c909635-7ef2-458f-9725-5601ee4bee42 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:47.626354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c909635-7ef2-458f-9725-5601ee4bee42 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:47.629548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c909635-7ef2-458f-9725-5601ee4bee42 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:47.630312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c909635-7ef2-458f-9725-5601ee4bee42 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:47.653664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c909635-7ef2-458f-9725-5601ee4bee42 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:48.219120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3c909635-7ef2-458f-9725-5601ee4bee42 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:48.229284 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3c909635-7ef2-458f-9725-5601ee4bee42 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1308 microversion: 2.1 time: 0.623944 Aug 18 11:31:48.234471 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 762/1543] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:47 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1308 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:48.304747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-386f3e98-dfd1-4d25-950c-e7e6551e7c32 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:48.308532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-386f3e98-dfd1-4d25-950c-e7e6551e7c32 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:48.326966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-386f3e98-dfd1-4d25-950c-e7e6551e7c32 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:48.327683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-386f3e98-dfd1-4d25-950c-e7e6551e7c32 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:48.328012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-386f3e98-dfd1-4d25-950c-e7e6551e7c32 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:48.328737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-386f3e98-dfd1-4d25-950c-e7e6551e7c32 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:48.329192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-386f3e98-dfd1-4d25-950c-e7e6551e7c32 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:48.329615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-386f3e98-dfd1-4d25-950c-e7e6551e7c32 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:48.370573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2003951508", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:48.415920 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-386f3e98-dfd1-4d25-950c-e7e6551e7c32 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115024 Aug 18 11:31:48.422997 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 763/1544] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:31:48 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:48.478057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:31:48.841891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:31:48.842468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:31:48.843052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:31:48.843579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:31:48.844092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:31:48.862837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:48.863468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:48.864007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:48.864844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:48.865400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:48.865940 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:48.901061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Getting quotas for project 933f2e895a88476593bf14a643c2b7f6. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:31:48.914520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Getting quotas for user 368fa7a976b745ae8ab1251352a56975 and project 933f2e895a88476593bf14a643c2b7f6. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:31:48.937650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:31:48.943179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:31:49.039629 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8c579492-40ec-4805-ab4b-44cc8eacd563 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.027349 Aug 18 11:31:49.041461 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 782/1545] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:31:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:31:49.051897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0351a902-393e-4c9c-92cd-4a8ce316f552 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:49.053027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0351a902-393e-4c9c-92cd-4a8ce316f552 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:49.180807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0351a902-393e-4c9c-92cd-4a8ce316f552 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:49.196578 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0351a902-393e-4c9c-92cd-4a8ce316f552 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1217 microversion: 2.1 time: 0.148465 Aug 18 11:31:49.199294 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 764/1546] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:49 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:49.264943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2e0e481-6391-43c1-9a7f-4a67961122f2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:49.266676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a2e0e481-6391-43c1-9a7f-4a67961122f2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:49.288950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2e0e481-6391-43c1-9a7f-4a67961122f2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:49.295845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2e0e481-6391-43c1-9a7f-4a67961122f2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:49.296847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2e0e481-6391-43c1-9a7f-4a67961122f2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:49.300282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2e0e481-6391-43c1-9a7f-4a67961122f2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:49.300822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2e0e481-6391-43c1-9a7f-4a67961122f2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:49.312849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2e0e481-6391-43c1-9a7f-4a67961122f2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:49.438210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0a38708b-ab52-48ed-bf7c-14538775e3ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:49.446722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0a38708b-ab52-48ed-bf7c-14538775e3ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:49.487083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a38708b-ab52-48ed-bf7c-14538775e3ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:49.487593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a38708b-ab52-48ed-bf7c-14538775e3ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:49.488044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a38708b-ab52-48ed-bf7c-14538775e3ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:49.493144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a38708b-ab52-48ed-bf7c-14538775e3ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:49.493640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a38708b-ab52-48ed-bf7c-14538775e3ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:49.500218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a38708b-ab52-48ed-bf7c-14538775e3ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:49.550287 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0a38708b-ab52-48ed-bf7c-14538775e3ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120334 Aug 18 11:31:49.551437 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 765/1547] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:31:49 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:49.734552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a2e0e481-6391-43c1-9a7f-4a67961122f2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:49.784702 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a2e0e481-6391-43c1-9a7f-4a67961122f2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1488 microversion: 2.1 time: 0.527263 Aug 18 11:31:49.787697 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 783/1548] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:49 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1488 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:49.816943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df72617e-7001-426a-b6e0-f88c4f427c44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:49.827741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df72617e-7001-426a-b6e0-f88c4f427c44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:49.828309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df72617e-7001-426a-b6e0-f88c4f427c44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:49.828756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df72617e-7001-426a-b6e0-f88c4f427c44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:49.976526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df72617e-7001-426a-b6e0-f88c4f427c44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Going to try to stop instance {{(pid=122210) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 11:31:50.055564 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df72617e-7001-426a-b6e0-f88c4f427c44 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "POST /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359/action" status: 202 len: 0 microversion: 2.1 time: 0.249418 Aug 18 11:31:50.058169 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 766/1549] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:31:49 2022] POST /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:31:50.068935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e22412f4-ea6a-4bd2-82f4-a20019a44d8b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:50.069912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e22412f4-ea6a-4bd2-82f4-a20019a44d8b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:50.078918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e22412f4-ea6a-4bd2-82f4-a20019a44d8b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:50.079720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e22412f4-ea6a-4bd2-82f4-a20019a44d8b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:50.080358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e22412f4-ea6a-4bd2-82f4-a20019a44d8b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:50.081463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e22412f4-ea6a-4bd2-82f4-a20019a44d8b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:50.081994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e22412f4-ea6a-4bd2-82f4-a20019a44d8b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:50.082608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e22412f4-ea6a-4bd2-82f4-a20019a44d8b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:50.222267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-307feea0-265f-4cb3-ab4d-e0975a31a978 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:50.223448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-307feea0-265f-4cb3-ab4d-e0975a31a978 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:50.235260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-307feea0-265f-4cb3-ab4d-e0975a31a978 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:50.236013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-307feea0-265f-4cb3-ab4d-e0975a31a978 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:50.237321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-307feea0-265f-4cb3-ab4d-e0975a31a978 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:50.238543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-307feea0-265f-4cb3-ab4d-e0975a31a978 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:50.239904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-307feea0-265f-4cb3-ab4d-e0975a31a978 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:50.242517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-307feea0-265f-4cb3-ab4d-e0975a31a978 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:50.347257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-307feea0-265f-4cb3-ab4d-e0975a31a978 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:50.360369 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-307feea0-265f-4cb3-ab4d-e0975a31a978 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1221 microversion: 2.1 time: 0.141657 Aug 18 11:31:50.361597 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 767/1550] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:50 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:50.422405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e22412f4-ea6a-4bd2-82f4-a20019a44d8b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:50.433353 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e22412f4-ea6a-4bd2-82f4-a20019a44d8b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.370182 Aug 18 11:31:50.434876 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 784/1551] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:50 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:50.564430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-31879e31-bbb2-4106-b0b6-dbca2a86de33 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:50.567050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-31879e31-bbb2-4106-b0b6-dbca2a86de33 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:50.577388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31879e31-bbb2-4106-b0b6-dbca2a86de33 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:50.578185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31879e31-bbb2-4106-b0b6-dbca2a86de33 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:50.578852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31879e31-bbb2-4106-b0b6-dbca2a86de33 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:50.579761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31879e31-bbb2-4106-b0b6-dbca2a86de33 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:50.580407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31879e31-bbb2-4106-b0b6-dbca2a86de33 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:50.581027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31879e31-bbb2-4106-b0b6-dbca2a86de33 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:50.624820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-31879e31-bbb2-4106-b0b6-dbca2a86de33 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064911 Aug 18 11:31:50.642490 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 768/1552] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:31:50 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:31:51.386401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-72ddc29f-b21d-4ad6-81c3-f63e95e0b5c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:51.387065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-72ddc29f-b21d-4ad6-81c3-f63e95e0b5c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:51.398250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72ddc29f-b21d-4ad6-81c3-f63e95e0b5c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:51.398935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72ddc29f-b21d-4ad6-81c3-f63e95e0b5c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:51.399382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72ddc29f-b21d-4ad6-81c3-f63e95e0b5c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:51.400640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72ddc29f-b21d-4ad6-81c3-f63e95e0b5c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:51.401671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72ddc29f-b21d-4ad6-81c3-f63e95e0b5c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:51.402299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72ddc29f-b21d-4ad6-81c3-f63e95e0b5c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:51.467377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5d8e37eb-43a0-486e-ab1f-2ca6f0d37943 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:51.468183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5d8e37eb-43a0-486e-ab1f-2ca6f0d37943 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:51.494555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:51.496470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d8e37eb-43a0-486e-ab1f-2ca6f0d37943 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:51.496977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d8e37eb-43a0-486e-ab1f-2ca6f0d37943 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:51.497419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d8e37eb-43a0-486e-ab1f-2ca6f0d37943 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:51.498135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d8e37eb-43a0-486e-ab1f-2ca6f0d37943 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:51.515828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d8e37eb-43a0-486e-ab1f-2ca6f0d37943 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:51.526648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d8e37eb-43a0-486e-ab1f-2ca6f0d37943 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:51.617988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-72ddc29f-b21d-4ad6-81c3-f63e95e0b5c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:51.629060 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-72ddc29f-b21d-4ad6-81c3-f63e95e0b5c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1275 microversion: 2.1 time: 0.247841 Aug 18 11:31:51.645783 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 785/1553] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:51 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1275 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:51.909989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-917440104", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "22608490-9e6a-4848-bc6d-66289c233bc1"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:51.995849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5d8e37eb-43a0-486e-ab1f-2ca6f0d37943 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:52.004673 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5d8e37eb-43a0-486e-ab1f-2ca6f0d37943 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.550315 Aug 18 11:31:52.009642 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 769/1554] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:51 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:52.039279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] validate_networks() for [('22608490-9e6a-4848-bc6d-66289c233bc1', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:31:52.661756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bf15d2a5-0660-40df-bdd2-9cf024aef167 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:52.663414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bf15d2a5-0660-40df-bdd2-9cf024aef167 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:52.675208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf15d2a5-0660-40df-bdd2-9cf024aef167 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:52.675995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf15d2a5-0660-40df-bdd2-9cf024aef167 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:52.676600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf15d2a5-0660-40df-bdd2-9cf024aef167 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:52.677502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf15d2a5-0660-40df-bdd2-9cf024aef167 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:52.678350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf15d2a5-0660-40df-bdd2-9cf024aef167 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:52.679077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf15d2a5-0660-40df-bdd2-9cf024aef167 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:52.761865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bf15d2a5-0660-40df-bdd2-9cf024aef167 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:52.773003 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bf15d2a5-0660-40df-bdd2-9cf024aef167 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1275 microversion: 2.1 time: 0.115293 Aug 18 11:31:52.774631 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 770/1555] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:52 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1275 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:52.973348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:31:52.974337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:31:52.975036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:31:52.976316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:31:52.976934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:31:52.992252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:52.993021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:52.993632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:52.995397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:52.996097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:52.996712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:53.024878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Getting quotas for project a98846d5998440dd87f3d85de0bf9d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:31:53.034025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-be1cfb02-9eaa-4d7f-9de2-089e56ada3a6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:53.035109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-be1cfb02-9eaa-4d7f-9de2-089e56ada3a6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:53.037347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Getting quotas for user 7bf7b0cd3d8740aca2d71944bc371d75 and project a98846d5998440dd87f3d85de0bf9d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:31:53.044520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be1cfb02-9eaa-4d7f-9de2-089e56ada3a6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:53.046994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be1cfb02-9eaa-4d7f-9de2-089e56ada3a6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:53.047522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be1cfb02-9eaa-4d7f-9de2-089e56ada3a6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:53.049401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be1cfb02-9eaa-4d7f-9de2-089e56ada3a6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:53.051461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be1cfb02-9eaa-4d7f-9de2-089e56ada3a6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:53.052125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be1cfb02-9eaa-4d7f-9de2-089e56ada3a6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:53.055032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:31:53.058408 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:31:53.151194 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-595137d0-fec6-4519-b47d-1df176105dcb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.320304 Aug 18 11:31:53.152537 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 786/1556] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:31:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:31:53.163855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-760920dd-e60d-4ab8-a77c-f9fb40765e04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:53.165606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-760920dd-e60d-4ab8-a77c-f9fb40765e04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:53.317988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-760920dd-e60d-4ab8-a77c-f9fb40765e04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:53.328924 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-760920dd-e60d-4ab8-a77c-f9fb40765e04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 200 len: 1214 microversion: 2.1 time: 0.167328 Aug 18 11:31:53.330593 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 787/1557] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:53 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:53.700226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-be1cfb02-9eaa-4d7f-9de2-089e56ada3a6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:53.707631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:53.712421 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-be1cfb02-9eaa-4d7f-9de2-089e56ada3a6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.681762 Aug 18 11:31:53.724892 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 771/1558] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:53 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:53.800125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-67ea9c5e-5c75-44fc-a57c-48e5458f2739 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:53.801671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-67ea9c5e-5c75-44fc-a57c-48e5458f2739 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:53.814931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67ea9c5e-5c75-44fc-a57c-48e5458f2739 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:53.815896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67ea9c5e-5c75-44fc-a57c-48e5458f2739 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:53.816565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67ea9c5e-5c75-44fc-a57c-48e5458f2739 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:53.819635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67ea9c5e-5c75-44fc-a57c-48e5458f2739 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:53.820849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67ea9c5e-5c75-44fc-a57c-48e5458f2739 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:53.821466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67ea9c5e-5c75-44fc-a57c-48e5458f2739 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:54.173692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-67ea9c5e-5c75-44fc-a57c-48e5458f2739 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:54.191605 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-67ea9c5e-5c75-44fc-a57c-48e5458f2739 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1317 microversion: 2.1 time: 0.398631 Aug 18 11:31:54.196599 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 788/1559] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:53 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:54.350680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a100dbc3-1527-49c4-9b7a-3e743ca5bd95 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:54.351300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a100dbc3-1527-49c4-9b7a-3e743ca5bd95 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:54.361130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a100dbc3-1527-49c4-9b7a-3e743ca5bd95 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:54.366741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a100dbc3-1527-49c4-9b7a-3e743ca5bd95 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:54.367271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a100dbc3-1527-49c4-9b7a-3e743ca5bd95 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:54.368038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a100dbc3-1527-49c4-9b7a-3e743ca5bd95 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:54.370187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a100dbc3-1527-49c4-9b7a-3e743ca5bd95 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:54.370679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a100dbc3-1527-49c4-9b7a-3e743ca5bd95 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:54.481736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a100dbc3-1527-49c4-9b7a-3e743ca5bd95 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:54.495175 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a100dbc3-1527-49c4-9b7a-3e743ca5bd95 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 200 len: 1266 microversion: 2.1 time: 0.145464 Aug 18 11:31:54.496754 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 772/1560] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:54 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:54.717807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-36250603-1471-4589-b7c2-7be47c41e7f0 req-0fa55f98-9a96-4583-86a0-71aca2246ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c6c996b-c6b0-4f55-97ed-b4b472dc3640", "tag": "ffdd209f-cefa-48ce-8e0f-9845986fb9ef"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:54.745899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8293fb21-4778-48f9-a360-71d57cac949d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:54.746592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8293fb21-4778-48f9-a360-71d57cac949d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:54.761582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-36250603-1471-4589-b7c2-7be47c41e7f0 req-0fa55f98-9a96-4583-86a0-71aca2246ea8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:54.762252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-36250603-1471-4589-b7c2-7be47c41e7f0 req-0fa55f98-9a96-4583-86a0-71aca2246ea8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:54.762615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-36250603-1471-4589-b7c2-7be47c41e7f0 req-0fa55f98-9a96-4583-86a0-71aca2246ea8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:54.772356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8293fb21-4778-48f9-a360-71d57cac949d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:54.773053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8293fb21-4778-48f9-a360-71d57cac949d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:54.773709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8293fb21-4778-48f9-a360-71d57cac949d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:54.774751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8293fb21-4778-48f9-a360-71d57cac949d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:54.776151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8293fb21-4778-48f9-a360-71d57cac949d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:54.776801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8293fb21-4778-48f9-a360-71d57cac949d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:54.794153 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-36250603-1471-4589-b7c2-7be47c41e7f0 req-0fa55f98-9a96-4583-86a0-71aca2246ea8 service nova] Creating event network-changed:ffdd209f-cefa-48ce-8e0f-9845986fb9ef for instance 6c6c996b-c6b0-4f55-97ed-b4b472dc3640 on n-h2-853611-3 Aug 18 11:31:54.812890 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-36250603-1471-4589-b7c2-7be47c41e7f0 req-0fa55f98-9a96-4583-86a0-71aca2246ea8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103346 Aug 18 11:31:54.816667 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 789/1561] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:31:55.041245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8293fb21-4778-48f9-a360-71d57cac949d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:55.056015 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8293fb21-4778-48f9-a360-71d57cac949d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.312674 Aug 18 11:31:55.073598 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 773/1562] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:54 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:55.217243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e7a649b6-ee24-4a26-976b-775a143707b0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:55.218188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e7a649b6-ee24-4a26-976b-775a143707b0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:55.236586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7a649b6-ee24-4a26-976b-775a143707b0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:55.237171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7a649b6-ee24-4a26-976b-775a143707b0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:55.237668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7a649b6-ee24-4a26-976b-775a143707b0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:55.238392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7a649b6-ee24-4a26-976b-775a143707b0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:55.238873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7a649b6-ee24-4a26-976b-775a143707b0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:55.239300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7a649b6-ee24-4a26-976b-775a143707b0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:55.297776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e21c4dc-751e-45eb-854a-f86bc1a20c7d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:55.308676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e21c4dc-751e-45eb-854a-f86bc1a20c7d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:55.309393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e21c4dc-751e-45eb-854a-f86bc1a20c7d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Searching by: {'deleted': False, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:31:55.335402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e21c4dc-751e-45eb-854a-f86bc1a20c7d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:55.335896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e21c4dc-751e-45eb-854a-f86bc1a20c7d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:55.336819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e21c4dc-751e-45eb-854a-f86bc1a20c7d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:55.337864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e21c4dc-751e-45eb-854a-f86bc1a20c7d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:55.356801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e21c4dc-751e-45eb-854a-f86bc1a20c7d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:55.360283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e21c4dc-751e-45eb-854a-f86bc1a20c7d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:55.527626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-0e21c4dc-751e-45eb-854a-f86bc1a20c7d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:31:55.664832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e7a649b6-ee24-4a26-976b-775a143707b0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:55.680745 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e7a649b6-ee24-4a26-976b-775a143707b0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1317 microversion: 2.1 time: 0.467703 Aug 18 11:31:55.683201 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 790/1563] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:55 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:55.688606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-346d3b9d-34e0-4f22-ba1a-b931fa22f7d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:55.689433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-346d3b9d-34e0-4f22-ba1a-b931fa22f7d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:55.711546 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e21c4dc-751e-45eb-854a-f86bc1a20c7d tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.412115 Aug 18 11:31:55.719631 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 774/1564] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 18 11:31:55 2022] GET /compute/v2.1/servers => generated 343 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:55.720413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-346d3b9d-34e0-4f22-ba1a-b931fa22f7d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:55.720413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-346d3b9d-34e0-4f22-ba1a-b931fa22f7d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:55.720413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-346d3b9d-34e0-4f22-ba1a-b931fa22f7d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:55.720413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-346d3b9d-34e0-4f22-ba1a-b931fa22f7d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:55.721418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-346d3b9d-34e0-4f22-ba1a-b931fa22f7d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:55.721418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-346d3b9d-34e0-4f22-ba1a-b931fa22f7d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:55.736410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:55.753303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:55.754113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Searching by: {'deleted': False, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:31:55.764122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:55.765257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:55.765909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:55.767086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:55.767717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:55.768624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:55.875878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-346d3b9d-34e0-4f22-ba1a-b931fa22f7d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:55.888555 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-346d3b9d-34e0-4f22-ba1a-b931fa22f7d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 200 len: 1272 microversion: 2.1 time: 0.201871 Aug 18 11:31:55.891066 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 791/1565] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:55 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:55.921283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:31:56.014246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:56.027232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:56.027718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:56.028347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:56.079507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0b2a5d91-505c-4b3a-b912-5a2db3fb5f14 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:56.080631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0b2a5d91-505c-4b3a-b912-5a2db3fb5f14 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:56.091017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b2a5d91-505c-4b3a-b912-5a2db3fb5f14 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:56.091711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b2a5d91-505c-4b3a-b912-5a2db3fb5f14 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:56.092486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b2a5d91-505c-4b3a-b912-5a2db3fb5f14 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:56.093496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b2a5d91-505c-4b3a-b912-5a2db3fb5f14 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:56.094289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b2a5d91-505c-4b3a-b912-5a2db3fb5f14 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:56.095078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b2a5d91-505c-4b3a-b912-5a2db3fb5f14 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:56.262830 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b8ad00b-9437-41c8-b7b1-2d4c46dc56a3 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.540039 Aug 18 11:31:56.266494 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 775/1566] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:31:55 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:56.290110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3b1ba24-45bc-4664-8f5e-51019ddc0744 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:56.301552 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3b1ba24-45bc-4664-8f5e-51019ddc0744 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015388 Aug 18 11:31:56.302209 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 776/1567] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:31:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:31:56.408048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0b2a5d91-505c-4b3a-b912-5a2db3fb5f14 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:56.422889 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0b2a5d91-505c-4b3a-b912-5a2db3fb5f14 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.344992 Aug 18 11:31:56.424873 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 792/1568] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:56 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:56.707664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cb710a80-8719-42ce-b61a-2056ecbafeb7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:56.717520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cb710a80-8719-42ce-b61a-2056ecbafeb7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:56.724388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb710a80-8719-42ce-b61a-2056ecbafeb7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:56.724886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb710a80-8719-42ce-b61a-2056ecbafeb7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:56.725380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb710a80-8719-42ce-b61a-2056ecbafeb7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:56.726053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb710a80-8719-42ce-b61a-2056ecbafeb7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:56.726568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb710a80-8719-42ce-b61a-2056ecbafeb7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:56.727218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb710a80-8719-42ce-b61a-2056ecbafeb7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:56.810771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-abff8b36-cd65-4833-9564-cab36c4b892a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:56.811279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-abff8b36-cd65-4833-9564-cab36c4b892a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:56.820218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-abff8b36-cd65-4833-9564-cab36c4b892a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:56.821292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-abff8b36-cd65-4833-9564-cab36c4b892a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:56.822455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-abff8b36-cd65-4833-9564-cab36c4b892a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:56.823419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-abff8b36-cd65-4833-9564-cab36c4b892a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:56.824046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-abff8b36-cd65-4833-9564-cab36c4b892a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:56.824742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-abff8b36-cd65-4833-9564-cab36c4b892a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:56.896911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-abff8b36-cd65-4833-9564-cab36c4b892a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:31:56.931436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cb710a80-8719-42ce-b61a-2056ecbafeb7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:56.947644 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cb710a80-8719-42ce-b61a-2056ecbafeb7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1317 microversion: 2.1 time: 0.243237 Aug 18 11:31:56.950157 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 777/1569] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:56 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:56.955901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b105c26-a970-4314-9e6a-542ba7a0b45b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:56.956524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b105c26-a970-4314-9e6a-542ba7a0b45b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:56.962873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b105c26-a970-4314-9e6a-542ba7a0b45b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:56.963593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b105c26-a970-4314-9e6a-542ba7a0b45b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:56.964393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b105c26-a970-4314-9e6a-542ba7a0b45b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:56.965544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b105c26-a970-4314-9e6a-542ba7a0b45b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:56.966388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b105c26-a970-4314-9e6a-542ba7a0b45b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:56.966990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b105c26-a970-4314-9e6a-542ba7a0b45b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:57.040831 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-abff8b36-cd65-4833-9564-cab36c4b892a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 204 len: 0 microversion: 2.1 time: 0.233847 Aug 18 11:31:57.044970 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 793/1570] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:31:56 2022] DELETE /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:31:57.061755 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ba2e32be-94e1-4207-ba70-56cd960effed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:57.076120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ba2e32be-94e1-4207-ba70-56cd960effed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:57.076120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba2e32be-94e1-4207-ba70-56cd960effed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:57.076120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba2e32be-94e1-4207-ba70-56cd960effed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:57.076120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba2e32be-94e1-4207-ba70-56cd960effed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:57.076554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba2e32be-94e1-4207-ba70-56cd960effed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:57.076554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba2e32be-94e1-4207-ba70-56cd960effed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:57.076554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba2e32be-94e1-4207-ba70-56cd960effed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:57.253098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b105c26-a970-4314-9e6a-542ba7a0b45b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:57.267139 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b105c26-a970-4314-9e6a-542ba7a0b45b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 200 len: 1314 microversion: 2.1 time: 0.313738 Aug 18 11:31:57.268416 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 778/1571] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:56 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:57.299136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fa4e2a22-7ae8-4391-825f-b74bba6ab57a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:57.301485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fa4e2a22-7ae8-4391-825f-b74bba6ab57a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:57.311069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4e2a22-7ae8-4391-825f-b74bba6ab57a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:57.312002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4e2a22-7ae8-4391-825f-b74bba6ab57a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:57.312669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4e2a22-7ae8-4391-825f-b74bba6ab57a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:57.313605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4e2a22-7ae8-4391-825f-b74bba6ab57a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:57.315173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4e2a22-7ae8-4391-825f-b74bba6ab57a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:57.316025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4e2a22-7ae8-4391-825f-b74bba6ab57a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:57.398417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ba2e32be-94e1-4207-ba70-56cd960effed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:57.406775 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ba2e32be-94e1-4207-ba70-56cd960effed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.360256 Aug 18 11:31:57.421989 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 794/1572] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:57 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:57.443521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0ee487c3-e035-470c-82e0-92cf3626e12e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:57.443521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0ee487c3-e035-470c-82e0-92cf3626e12e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:57.448108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ee487c3-e035-470c-82e0-92cf3626e12e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:57.448108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ee487c3-e035-470c-82e0-92cf3626e12e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:57.448108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ee487c3-e035-470c-82e0-92cf3626e12e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:57.448792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ee487c3-e035-470c-82e0-92cf3626e12e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:57.454801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ee487c3-e035-470c-82e0-92cf3626e12e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:57.455290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0ee487c3-e035-470c-82e0-92cf3626e12e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:57.531375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fa4e2a22-7ae8-4391-825f-b74bba6ab57a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:57.542697 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fa4e2a22-7ae8-4391-825f-b74bba6ab57a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1607 microversion: 2.1 time: 0.257437 Aug 18 11:31:57.543464 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 779/1573] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:57 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1607 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:57.548721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-14619ee6-6aaf-4969-9f52-f6a255ed0e0d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:57.549513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-14619ee6-6aaf-4969-9f52-f6a255ed0e0d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:57.556780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14619ee6-6aaf-4969-9f52-f6a255ed0e0d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:57.558590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14619ee6-6aaf-4969-9f52-f6a255ed0e0d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:57.559437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14619ee6-6aaf-4969-9f52-f6a255ed0e0d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:57.560711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14619ee6-6aaf-4969-9f52-f6a255ed0e0d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:57.561347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14619ee6-6aaf-4969-9f52-f6a255ed0e0d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:57.562204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14619ee6-6aaf-4969-9f52-f6a255ed0e0d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:57.736919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0ee487c3-e035-470c-82e0-92cf3626e12e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:57.751974 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0ee487c3-e035-470c-82e0-92cf3626e12e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.324352 Aug 18 11:31:57.752776 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 795/1574] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:57 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:57.772214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fe00ef42-8dd6-44ed-9b74-a3a278f57769 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:57.772839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fe00ef42-8dd6-44ed-9b74-a3a278f57769 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:57.785778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe00ef42-8dd6-44ed-9b74-a3a278f57769 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:57.786271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe00ef42-8dd6-44ed-9b74-a3a278f57769 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:57.786734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe00ef42-8dd6-44ed-9b74-a3a278f57769 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:57.787444 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe00ef42-8dd6-44ed-9b74-a3a278f57769 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:57.787917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe00ef42-8dd6-44ed-9b74-a3a278f57769 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:57.788339 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe00ef42-8dd6-44ed-9b74-a3a278f57769 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:57.799337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-14619ee6-6aaf-4969-9f52-f6a255ed0e0d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:57.812671 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-14619ee6-6aaf-4969-9f52-f6a255ed0e0d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.267661 Aug 18 11:31:57.813805 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 780/1575] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:57 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:57.975846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-507a0dc3-0aa0-41cd-82f6-538c5e1a4d76 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:57.980455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-507a0dc3-0aa0-41cd-82f6-538c5e1a4d76 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:57.996612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-507a0dc3-0aa0-41cd-82f6-538c5e1a4d76 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:57.997568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-507a0dc3-0aa0-41cd-82f6-538c5e1a4d76 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:57.998564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-507a0dc3-0aa0-41cd-82f6-538c5e1a4d76 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:58.000448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-507a0dc3-0aa0-41cd-82f6-538c5e1a4d76 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:58.001109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-507a0dc3-0aa0-41cd-82f6-538c5e1a4d76 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:58.001717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-507a0dc3-0aa0-41cd-82f6-538c5e1a4d76 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:58.064215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fe00ef42-8dd6-44ed-9b74-a3a278f57769 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:58.092727 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fe00ef42-8dd6-44ed-9b74-a3a278f57769 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.310511 Aug 18 11:31:58.093644 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 796/1576] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:57 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:58.120406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c2d99bc2-9433-492a-b197-363a40c6e70f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1548425090"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:58.129891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c2d99bc2-9433-492a-b197-363a40c6e70f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:58.144273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2d99bc2-9433-492a-b197-363a40c6e70f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:58.144943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2d99bc2-9433-492a-b197-363a40c6e70f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:58.145499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2d99bc2-9433-492a-b197-363a40c6e70f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:58.149366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2d99bc2-9433-492a-b197-363a40c6e70f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:58.150631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2d99bc2-9433-492a-b197-363a40c6e70f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:58.153569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2d99bc2-9433-492a-b197-363a40c6e70f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:58.157482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:58.280367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-507a0dc3-0aa0-41cd-82f6-538c5e1a4d76 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:58.290974 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-507a0dc3-0aa0-41cd-82f6-538c5e1a4d76 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1317 microversion: 2.1 time: 0.324281 Aug 18 11:31:58.292226 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 781/1577] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:57 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:31:58.297797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eb4a7e2e-fff3-4a06-bff3-59c6cabda747 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:58.298793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eb4a7e2e-fff3-4a06-bff3-59c6cabda747 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:58.305526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb4a7e2e-fff3-4a06-bff3-59c6cabda747 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:58.307150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb4a7e2e-fff3-4a06-bff3-59c6cabda747 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:58.319303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb4a7e2e-fff3-4a06-bff3-59c6cabda747 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:58.322271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb4a7e2e-fff3-4a06-bff3-59c6cabda747 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:58.322834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb4a7e2e-fff3-4a06-bff3-59c6cabda747 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:58.323374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb4a7e2e-fff3-4a06-bff3-59c6cabda747 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:58.562878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-eb4a7e2e-fff3-4a06-bff3-59c6cabda747 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:58.584412 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eb4a7e2e-fff3-4a06-bff3-59c6cabda747 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 200 len: 1314 microversion: 2.1 time: 0.290667 Aug 18 11:31:58.586675 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 782/1578] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:58 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:58.596948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-387671af-366b-49aa-8c6a-85af812bc9a3 req-27106af9-434a-4b08-b713-ee49de4eba22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "625fceb4-de53-4e6b-849d-98873e81773d", "tag": "8cb10222-e133-4451-8b15-b3404fd4f1a8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:58.610156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-387671af-366b-49aa-8c6a-85af812bc9a3 req-27106af9-434a-4b08-b713-ee49de4eba22 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:58.610744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-387671af-366b-49aa-8c6a-85af812bc9a3 req-27106af9-434a-4b08-b713-ee49de4eba22 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:58.611184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-387671af-366b-49aa-8c6a-85af812bc9a3 req-27106af9-434a-4b08-b713-ee49de4eba22 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:58.627016 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-387671af-366b-49aa-8c6a-85af812bc9a3 req-27106af9-434a-4b08-b713-ee49de4eba22 service nova] Creating event network-changed:8cb10222-e133-4451-8b15-b3404fd4f1a8 for instance 625fceb4-de53-4e6b-849d-98873e81773d on n-h2-853611-3 Aug 18 11:31:58.642459 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-387671af-366b-49aa-8c6a-85af812bc9a3 req-27106af9-434a-4b08-b713-ee49de4eba22 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043916 Aug 18 11:31:58.642459 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 783/1579] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:31:58.642459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94d23588-0b77-4298-9e9f-db5a32a420e4 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:58.642459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-94d23588-0b77-4298-9e9f-db5a32a420e4 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:58.649503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94d23588-0b77-4298-9e9f-db5a32a420e4 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:58.650749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94d23588-0b77-4298-9e9f-db5a32a420e4 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:58.651378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94d23588-0b77-4298-9e9f-db5a32a420e4 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:58.652115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94d23588-0b77-4298-9e9f-db5a32a420e4 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:58.652590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94d23588-0b77-4298-9e9f-db5a32a420e4 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:58.653677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94d23588-0b77-4298-9e9f-db5a32a420e4 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:58.860220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-94d23588-0b77-4298-9e9f-db5a32a420e4 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:58.875040 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-94d23588-0b77-4298-9e9f-db5a32a420e4 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1607 microversion: 2.1 time: 0.240386 Aug 18 11:31:58.876214 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 784/1580] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:58 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1607 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:58.887127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8f826079-73cf-4ea9-bee0-1d47b0a7e1d6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:58.888479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8f826079-73cf-4ea9-bee0-1d47b0a7e1d6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:58.896011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f826079-73cf-4ea9-bee0-1d47b0a7e1d6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:58.896867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f826079-73cf-4ea9-bee0-1d47b0a7e1d6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:58.897550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f826079-73cf-4ea9-bee0-1d47b0a7e1d6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:58.898908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f826079-73cf-4ea9-bee0-1d47b0a7e1d6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:58.900463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f826079-73cf-4ea9-bee0-1d47b0a7e1d6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:58.902284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f826079-73cf-4ea9-bee0-1d47b0a7e1d6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:59.101948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8f826079-73cf-4ea9-bee0-1d47b0a7e1d6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:59.119627 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8f826079-73cf-4ea9-bee0-1d47b0a7e1d6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.240708 Aug 18 11:31:59.120451 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 785/1581] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:58 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:59.254627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b94c939e-fe64-4453-a717-57fa4800c172 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5132610-9225-4967-ae11-347cf76be3df"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:31:59.257964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b94c939e-fe64-4453-a717-57fa4800c172 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:59.265439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b94c939e-fe64-4453-a717-57fa4800c172 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:59.266118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b94c939e-fe64-4453-a717-57fa4800c172 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:59.266758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b94c939e-fe64-4453-a717-57fa4800c172 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:59.267664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b94c939e-fe64-4453-a717-57fa4800c172 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:59.268296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b94c939e-fe64-4453-a717-57fa4800c172 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:59.268889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b94c939e-fe64-4453-a717-57fa4800c172 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:59.619245 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b94c939e-fe64-4453-a717-57fa4800c172 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "POST /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367489 Aug 18 11:31:59.625198 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 786/1582] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:31:59 2022] POST /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:31:59.627640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-23db2e73-d702-4138-9808-aec44215fcda tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:59.627640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-23db2e73-d702-4138-9808-aec44215fcda tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:59.635325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23db2e73-d702-4138-9808-aec44215fcda tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:59.635717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23db2e73-d702-4138-9808-aec44215fcda tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:59.636411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23db2e73-d702-4138-9808-aec44215fcda tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:59.637161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23db2e73-d702-4138-9808-aec44215fcda tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:59.637767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23db2e73-d702-4138-9808-aec44215fcda tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:59.638219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23db2e73-d702-4138-9808-aec44215fcda tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:59.881268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-23db2e73-d702-4138-9808-aec44215fcda tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:31:59.885067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:31:59.896566 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-23db2e73-d702-4138-9808-aec44215fcda tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1317 microversion: 2.1 time: 0.274673 Aug 18 11:31:59.897825 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 787/1583] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:59 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:31:59.906728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6d4dc5ee-5145-409b-a3ea-805dd61f4a30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:31:59.912081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6d4dc5ee-5145-409b-a3ea-805dd61f4a30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:31:59.924714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d4dc5ee-5145-409b-a3ea-805dd61f4a30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:59.925508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d4dc5ee-5145-409b-a3ea-805dd61f4a30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:59.925963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d4dc5ee-5145-409b-a3ea-805dd61f4a30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:31:59.927089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d4dc5ee-5145-409b-a3ea-805dd61f4a30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:31:59.928316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d4dc5ee-5145-409b-a3ea-805dd61f4a30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:31:59.929334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d4dc5ee-5145-409b-a3ea-805dd61f4a30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:00.099171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6d4dc5ee-5145-409b-a3ea-805dd61f4a30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:00.113660 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6d4dc5ee-5145-409b-a3ea-805dd61f4a30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 200 len: 1314 microversion: 2.1 time: 0.214200 Aug 18 11:32:00.116313 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 788/1584] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:31:59 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:00.124263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6d0bc8fa-5496-4fff-b29f-2871c76c497a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:00.124926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6d0bc8fa-5496-4fff-b29f-2871c76c497a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:00.132413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d0bc8fa-5496-4fff-b29f-2871c76c497a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:00.133297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d0bc8fa-5496-4fff-b29f-2871c76c497a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:00.134205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d0bc8fa-5496-4fff-b29f-2871c76c497a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:00.135430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d0bc8fa-5496-4fff-b29f-2871c76c497a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:00.136399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d0bc8fa-5496-4fff-b29f-2871c76c497a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:00.137412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d0bc8fa-5496-4fff-b29f-2871c76c497a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:00.348648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6d0bc8fa-5496-4fff-b29f-2871c76c497a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:00.371559 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6d0bc8fa-5496-4fff-b29f-2871c76c497a tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1607 microversion: 2.1 time: 0.250515 Aug 18 11:32:00.372534 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 789/1585] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:00 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1607 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:00.387263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1366100e-f00b-4e70-96f4-f42a19617cdc tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:00.388871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1366100e-f00b-4e70-96f4-f42a19617cdc tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:00.405763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1366100e-f00b-4e70-96f4-f42a19617cdc tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:00.406362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1366100e-f00b-4e70-96f4-f42a19617cdc tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:00.406981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1366100e-f00b-4e70-96f4-f42a19617cdc tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:00.407791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1366100e-f00b-4e70-96f4-f42a19617cdc tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:00.408359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1366100e-f00b-4e70-96f4-f42a19617cdc tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:00.408879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1366100e-f00b-4e70-96f4-f42a19617cdc tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:00.608068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1366100e-f00b-4e70-96f4-f42a19617cdc tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:00.619019 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1366100e-f00b-4e70-96f4-f42a19617cdc tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.244029 Aug 18 11:32:00.620198 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 790/1586] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:00 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:00.898340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-06b5e3ab-0a3e-4765-b3e2-97e8e2762eaa req-f6b68339-0d41-435a-b81c-29df9a20289e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6c996b-c6b0-4f55-97ed-b4b472dc3640", "name": "network-vif-plugged", "status": "completed", "tag": "ffdd209f-cefa-48ce-8e0f-9845986fb9ef"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:00.929333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-06b5e3ab-0a3e-4765-b3e2-97e8e2762eaa req-f6b68339-0d41-435a-b81c-29df9a20289e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:00.930318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-06b5e3ab-0a3e-4765-b3e2-97e8e2762eaa req-f6b68339-0d41-435a-b81c-29df9a20289e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:00.931705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-06b5e3ab-0a3e-4765-b3e2-97e8e2762eaa req-f6b68339-0d41-435a-b81c-29df9a20289e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:00.965885 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-06b5e3ab-0a3e-4765-b3e2-97e8e2762eaa req-f6b68339-0d41-435a-b81c-29df9a20289e service nova] Creating event network-vif-plugged:ffdd209f-cefa-48ce-8e0f-9845986fb9ef for instance 6c6c996b-c6b0-4f55-97ed-b4b472dc3640 on n-h2-853611-3 Aug 18 11:32:00.976949 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-06b5e3ab-0a3e-4765-b3e2-97e8e2762eaa req-f6b68339-0d41-435a-b81c-29df9a20289e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081728 Aug 18 11:32:00.979487 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 791/1587] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:32:00.990605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d4b35935-6060-4070-bf88-9d5606e56628 req-df15edcb-5239-42c0-b27a-6c882a0ac148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ebb25c-67fd-4720-aaa6-7f85e22a97b3", "name": "network-vif-deleted", "tag": "0026f65d-53f0-4762-89f1-046f21b2ca8b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:01.016750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d4b35935-6060-4070-bf88-9d5606e56628 req-df15edcb-5239-42c0-b27a-6c882a0ac148 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:01.023537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d4b35935-6060-4070-bf88-9d5606e56628 req-df15edcb-5239-42c0-b27a-6c882a0ac148 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:01.024273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d4b35935-6060-4070-bf88-9d5606e56628 req-df15edcb-5239-42c0-b27a-6c882a0ac148 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:01.056282 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d4b35935-6060-4070-bf88-9d5606e56628 req-df15edcb-5239-42c0-b27a-6c882a0ac148 service nova] Creating event network-vif-deleted:0026f65d-53f0-4762-89f1-046f21b2ca8b for instance a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 on n-h2-853611-3 Aug 18 11:32:01.074233 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d4b35935-6060-4070-bf88-9d5606e56628 req-df15edcb-5239-42c0-b27a-6c882a0ac148 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090792 Aug 18 11:32:01.075232 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 792/1588] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:01.092477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-218c3e6a-e7ea-4a3a-9e35-92acb0ccc1d7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:01.093215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-218c3e6a-e7ea-4a3a-9e35-92acb0ccc1d7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:01.114167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-218c3e6a-e7ea-4a3a-9e35-92acb0ccc1d7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:01.115566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-218c3e6a-e7ea-4a3a-9e35-92acb0ccc1d7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:01.116214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-218c3e6a-e7ea-4a3a-9e35-92acb0ccc1d7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:01.117219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-218c3e6a-e7ea-4a3a-9e35-92acb0ccc1d7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:01.117867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-218c3e6a-e7ea-4a3a-9e35-92acb0ccc1d7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:01.120244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-218c3e6a-e7ea-4a3a-9e35-92acb0ccc1d7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:01.426695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-218c3e6a-e7ea-4a3a-9e35-92acb0ccc1d7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:01.442142 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-218c3e6a-e7ea-4a3a-9e35-92acb0ccc1d7 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1317 microversion: 2.1 time: 0.358343 Aug 18 11:32:01.444448 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 793/1589] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:01 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:01.453655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd590990-d370-4198-8a0e-b4d2d2e09fff tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:01.454391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dd590990-d370-4198-8a0e-b4d2d2e09fff tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:01.482051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd590990-d370-4198-8a0e-b4d2d2e09fff tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:01.483579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd590990-d370-4198-8a0e-b4d2d2e09fff tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:01.485552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd590990-d370-4198-8a0e-b4d2d2e09fff tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:01.486387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd590990-d370-4198-8a0e-b4d2d2e09fff tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:01.488890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd590990-d370-4198-8a0e-b4d2d2e09fff tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:01.491355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd590990-d370-4198-8a0e-b4d2d2e09fff tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:01.790400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd590990-d370-4198-8a0e-b4d2d2e09fff tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:01.798796 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd590990-d370-4198-8a0e-b4d2d2e09fff tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 200 len: 1314 microversion: 2.1 time: 0.353071 Aug 18 11:32:01.799387 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 794/1590] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:01 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:01.812648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e3d32ec3-48d2-42cf-a20a-15a7790fdb01 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:01.818871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e3d32ec3-48d2-42cf-a20a-15a7790fdb01 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:01.828411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d32ec3-48d2-42cf-a20a-15a7790fdb01 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:01.828904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d32ec3-48d2-42cf-a20a-15a7790fdb01 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:01.829337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d32ec3-48d2-42cf-a20a-15a7790fdb01 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:01.830045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d32ec3-48d2-42cf-a20a-15a7790fdb01 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:01.830554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d32ec3-48d2-42cf-a20a-15a7790fdb01 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:01.832148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d32ec3-48d2-42cf-a20a-15a7790fdb01 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:01.953106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e3d32ec3-48d2-42cf-a20a-15a7790fdb01 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:01.966065 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e3d32ec3-48d2-42cf-a20a-15a7790fdb01 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1251 microversion: 2.1 time: 0.165519 Aug 18 11:32:01.967042 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 795/1591] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:01 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1251 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:01.988279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bf5c8896-1939-479a-8252-542db24fac52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:01.989331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bf5c8896-1939-479a-8252-542db24fac52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:01.996480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf5c8896-1939-479a-8252-542db24fac52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:01.997240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf5c8896-1939-479a-8252-542db24fac52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:01.997845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf5c8896-1939-479a-8252-542db24fac52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:01.998752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf5c8896-1939-479a-8252-542db24fac52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:01.999403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf5c8896-1939-479a-8252-542db24fac52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:01.999992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf5c8896-1939-479a-8252-542db24fac52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:02.184667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bf5c8896-1939-479a-8252-542db24fac52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:02.193689 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bf5c8896-1939-479a-8252-542db24fac52 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.225302 Aug 18 11:32:02.194396 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 796/1592] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:01 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:02.483799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5c7631bc-d657-4e91-859d-7ccdb8abb7c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:02.485880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5c7631bc-d657-4e91-859d-7ccdb8abb7c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:02.499253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c7631bc-d657-4e91-859d-7ccdb8abb7c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:02.500403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c7631bc-d657-4e91-859d-7ccdb8abb7c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:02.502730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c7631bc-d657-4e91-859d-7ccdb8abb7c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:02.503805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c7631bc-d657-4e91-859d-7ccdb8abb7c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:02.504670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c7631bc-d657-4e91-859d-7ccdb8abb7c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:02.505269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c7631bc-d657-4e91-859d-7ccdb8abb7c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:02.793339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5c7631bc-d657-4e91-859d-7ccdb8abb7c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:02.809282 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5c7631bc-d657-4e91-859d-7ccdb8abb7c5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1317 microversion: 2.1 time: 0.343182 Aug 18 11:32:02.824724 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 797/1593] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:02 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:32:02.830232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e12e269-f78c-4207-a34e-4066d50debcc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:02.832323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7e12e269-f78c-4207-a34e-4066d50debcc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:02.844995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e12e269-f78c-4207-a34e-4066d50debcc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:02.847293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e12e269-f78c-4207-a34e-4066d50debcc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:02.847967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e12e269-f78c-4207-a34e-4066d50debcc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:02.848966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e12e269-f78c-4207-a34e-4066d50debcc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:02.849622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e12e269-f78c-4207-a34e-4066d50debcc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:02.852415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e12e269-f78c-4207-a34e-4066d50debcc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:03.012386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:03.035890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7e12e269-f78c-4207-a34e-4066d50debcc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:03.044907 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e12e269-f78c-4207-a34e-4066d50debcc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 200 len: 1314 microversion: 2.1 time: 0.218430 Aug 18 11:32:03.060569 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 798/1594] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:02 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:03.065673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e2e5149a-d29f-4720-9cbc-48fe77708e27 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:03.066286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e2e5149a-d29f-4720-9cbc-48fe77708e27 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:03.074328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2e5149a-d29f-4720-9cbc-48fe77708e27 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:03.075124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2e5149a-d29f-4720-9cbc-48fe77708e27 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:03.075557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2e5149a-d29f-4720-9cbc-48fe77708e27 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:03.076486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2e5149a-d29f-4720-9cbc-48fe77708e27 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:03.076936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2e5149a-d29f-4720-9cbc-48fe77708e27 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:03.077528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2e5149a-d29f-4720-9cbc-48fe77708e27 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:03.176661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e2e5149a-d29f-4720-9cbc-48fe77708e27 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:03.185941 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e2e5149a-d29f-4720-9cbc-48fe77708e27 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1251 microversion: 2.1 time: 0.123909 Aug 18 11:32:03.186589 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 799/1595] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:03 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1251 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:03.216524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fe5a7460-2223-4d7b-854d-e5f418cb1ff3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:03.217147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fe5a7460-2223-4d7b-854d-e5f418cb1ff3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:03.228252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe5a7460-2223-4d7b-854d-e5f418cb1ff3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:03.228892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe5a7460-2223-4d7b-854d-e5f418cb1ff3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:03.230060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe5a7460-2223-4d7b-854d-e5f418cb1ff3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:03.231122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe5a7460-2223-4d7b-854d-e5f418cb1ff3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:03.231718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe5a7460-2223-4d7b-854d-e5f418cb1ff3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:03.232163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe5a7460-2223-4d7b-854d-e5f418cb1ff3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:03.326221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=14 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:03.419521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fe5a7460-2223-4d7b-854d-e5f418cb1ff3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:03.429991 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fe5a7460-2223-4d7b-854d-e5f418cb1ff3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.217299 Aug 18 11:32:03.431790 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 800/1596] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:03 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:03.833336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59440669-bdc4-413d-93f5-ca53ba54ff59 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:03.833958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59440669-bdc4-413d-93f5-ca53ba54ff59 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:03.846240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59440669-bdc4-413d-93f5-ca53ba54ff59 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:03.846786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59440669-bdc4-413d-93f5-ca53ba54ff59 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:03.847240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59440669-bdc4-413d-93f5-ca53ba54ff59 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:03.847973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59440669-bdc4-413d-93f5-ca53ba54ff59 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:03.848441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59440669-bdc4-413d-93f5-ca53ba54ff59 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:03.849124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59440669-bdc4-413d-93f5-ca53ba54ff59 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:04.004671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-59440669-bdc4-413d-93f5-ca53ba54ff59 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:04.017442 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59440669-bdc4-413d-93f5-ca53ba54ff59 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1466 microversion: 2.1 time: 0.188348 Aug 18 11:32:04.018263 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 801/1597] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:03 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1466 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:32:04.041720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c655f4bb-3931-4149-a3bf-d5bd35ca2fe5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1469008153", "metadata": {"image_type": "test"}}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:04.044371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c655f4bb-3931-4149-a3bf-d5bd35ca2fe5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:04.051655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c655f4bb-3931-4149-a3bf-d5bd35ca2fe5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:04.052251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c655f4bb-3931-4149-a3bf-d5bd35ca2fe5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:04.052863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c655f4bb-3931-4149-a3bf-d5bd35ca2fe5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:04.053634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c655f4bb-3931-4149-a3bf-d5bd35ca2fe5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:04.054104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c655f4bb-3931-4149-a3bf-d5bd35ca2fe5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:04.054576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c655f4bb-3931-4149-a3bf-d5bd35ca2fe5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:04.099385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c655f4bb-3931-4149-a3bf-d5bd35ca2fe5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Getting quotas for project 933f2e895a88476593bf14a643c2b7f6. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:32:04.106262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c655f4bb-3931-4149-a3bf-d5bd35ca2fe5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Getting quotas for user 368fa7a976b745ae8ab1251352a56975 and project 933f2e895a88476593bf14a643c2b7f6. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:32:05.161850 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c2d99bc2-9433-492a-b197-363a40c6e70f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 7.047215 Aug 18 11:32:05.166918 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 797/1598] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:31:58 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 7053 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Aug 18 11:32:05.173938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f0aa7950-43d4-49c5-8c1d-1fd792914baf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:05.175158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f0aa7950-43d4-49c5-8c1d-1fd792914baf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:05.188918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0aa7950-43d4-49c5-8c1d-1fd792914baf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:05.189454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0aa7950-43d4-49c5-8c1d-1fd792914baf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:05.189980 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0aa7950-43d4-49c5-8c1d-1fd792914baf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:05.191170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0aa7950-43d4-49c5-8c1d-1fd792914baf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:05.191638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0aa7950-43d4-49c5-8c1d-1fd792914baf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:05.192198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0aa7950-43d4-49c5-8c1d-1fd792914baf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:05.312666 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c655f4bb-3931-4149-a3bf-d5bd35ca2fe5 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "POST /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640/action" status: 202 len: 0 microversion: 2.1 time: 1.274992 Aug 18 11:32:05.319818 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 802/1599] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:32:04 2022] POST /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640/action => generated 0 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 18 11:32:05.328708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-435e572a-159c-4715-a845-85c05756c470 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:05.329992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-435e572a-159c-4715-a845-85c05756c470 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:05.350107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-435e572a-159c-4715-a845-85c05756c470 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:05.350638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-435e572a-159c-4715-a845-85c05756c470 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:05.351081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-435e572a-159c-4715-a845-85c05756c470 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:05.351801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-435e572a-159c-4715-a845-85c05756c470 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:05.352792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-435e572a-159c-4715-a845-85c05756c470 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:05.353247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-435e572a-159c-4715-a845-85c05756c470 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:05.433082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f0aa7950-43d4-49c5-8c1d-1fd792914baf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:05.442604 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f0aa7950-43d4-49c5-8c1d-1fd792914baf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 200 len: 1314 microversion: 2.1 time: 0.274065 Aug 18 11:32:05.458747 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 798/1600] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:05 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:05.460043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-435e572a-159c-4715-a845-85c05756c470 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:05.463469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:05.465344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-09335030-e2da-41a1-84f2-ac47853f6d97 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:05.466646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-09335030-e2da-41a1-84f2-ac47853f6d97 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:05.474457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09335030-e2da-41a1-84f2-ac47853f6d97 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:05.475085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09335030-e2da-41a1-84f2-ac47853f6d97 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:05.475666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09335030-e2da-41a1-84f2-ac47853f6d97 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:05.476672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09335030-e2da-41a1-84f2-ac47853f6d97 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:05.477756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09335030-e2da-41a1-84f2-ac47853f6d97 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:05.478000 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-435e572a-159c-4715-a845-85c05756c470 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1251 microversion: 2.1 time: 0.156169 Aug 18 11:32:05.478386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09335030-e2da-41a1-84f2-ac47853f6d97 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:05.478824 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 803/1601] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:05 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1251 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:05.491482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1f3d9e1e-101c-4419-a339-fa7e169969f8 req-4856c9c7-5553-40a3-9c86-9e353296094c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625fceb4-de53-4e6b-849d-98873e81773d", "name": "network-vif-plugged", "status": "completed", "tag": "8cb10222-e133-4451-8b15-b3404fd4f1a8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:05.517278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1f3d9e1e-101c-4419-a339-fa7e169969f8 req-4856c9c7-5553-40a3-9c86-9e353296094c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:05.517761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1f3d9e1e-101c-4419-a339-fa7e169969f8 req-4856c9c7-5553-40a3-9c86-9e353296094c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:05.518201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1f3d9e1e-101c-4419-a339-fa7e169969f8 req-4856c9c7-5553-40a3-9c86-9e353296094c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:05.556899 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1f3d9e1e-101c-4419-a339-fa7e169969f8 req-4856c9c7-5553-40a3-9c86-9e353296094c service nova] Creating event network-vif-plugged:8cb10222-e133-4451-8b15-b3404fd4f1a8 for instance 625fceb4-de53-4e6b-849d-98873e81773d on n-h2-853611-3 Aug 18 11:32:05.568219 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1f3d9e1e-101c-4419-a339-fa7e169969f8 req-4856c9c7-5553-40a3-9c86-9e353296094c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086244 Aug 18 11:32:05.570810 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 804/1602] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:05.583874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-52ec33dc-fa5c-4ab6-8195-b188817dbd91 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519f963670>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:05.662684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-09335030-e2da-41a1-84f2-ac47853f6d97 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:05.672237 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-09335030-e2da-41a1-84f2-ac47853f6d97 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.212107 Aug 18 11:32:05.673867 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 799/1603] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:05 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:05.712693 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-52ec33dc-fa5c-4ab6-8195-b188817dbd91 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1" status: 200 len: 1422 microversion: 2.1 time: 0.139375 Aug 18 11:32:05.713480 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 805/1604] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:05 2022] GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1 => generated 1422 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:06.469879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-29b85185-c337-48a3-a7fb-4611a82b40bc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:06.473801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-29b85185-c337-48a3-a7fb-4611a82b40bc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:06.481416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29b85185-c337-48a3-a7fb-4611a82b40bc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:06.482421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29b85185-c337-48a3-a7fb-4611a82b40bc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:06.483191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29b85185-c337-48a3-a7fb-4611a82b40bc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:06.484109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29b85185-c337-48a3-a7fb-4611a82b40bc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:06.485187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29b85185-c337-48a3-a7fb-4611a82b40bc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:06.486057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29b85185-c337-48a3-a7fb-4611a82b40bc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:06.496107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:06.498282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:06.502854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d7504808-2c89-418f-80f0-0ad8d671ef48 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:06.503856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d7504808-2c89-418f-80f0-0ad8d671ef48 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:06.512965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7504808-2c89-418f-80f0-0ad8d671ef48 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:06.513804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7504808-2c89-418f-80f0-0ad8d671ef48 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:06.514483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7504808-2c89-418f-80f0-0ad8d671ef48 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:06.515647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7504808-2c89-418f-80f0-0ad8d671ef48 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:06.516342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7504808-2c89-418f-80f0-0ad8d671ef48 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:06.516969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7504808-2c89-418f-80f0-0ad8d671ef48 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:06.643784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d7504808-2c89-418f-80f0-0ad8d671ef48 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:06.658005 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d7504808-2c89-418f-80f0-0ad8d671ef48 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1251 microversion: 2.1 time: 0.162601 Aug 18 11:32:06.664044 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 806/1605] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:06 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1251 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:06.699934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b05c3733-54c1-4af4-b47d-9f3419b6c47a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:06.701528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b05c3733-54c1-4af4-b47d-9f3419b6c47a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:06.719802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b05c3733-54c1-4af4-b47d-9f3419b6c47a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:06.722000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b05c3733-54c1-4af4-b47d-9f3419b6c47a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:06.723395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b05c3733-54c1-4af4-b47d-9f3419b6c47a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:06.725431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b05c3733-54c1-4af4-b47d-9f3419b6c47a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:06.728597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b05c3733-54c1-4af4-b47d-9f3419b6c47a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:06.733371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b05c3733-54c1-4af4-b47d-9f3419b6c47a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:06.783262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-29b85185-c337-48a3-a7fb-4611a82b40bc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:06.795427 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-29b85185-c337-48a3-a7fb-4611a82b40bc tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 200 len: 1314 microversion: 2.1 time: 0.329598 Aug 18 11:32:06.798853 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 800/1606] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:06 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:06.811971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-53f9e4bf-90b0-4bda-937f-9a012bd9b19f tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519f9318b0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:06.922403 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-53f9e4bf-90b0-4bda-937f-9a012bd9b19f tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1" status: 200 len: 1422 microversion: 2.1 time: 0.122337 Aug 18 11:32:06.938623 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 801/1607] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:06 2022] GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1 => generated 1422 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:07.045746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b05c3733-54c1-4af4-b47d-9f3419b6c47a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:07.068752 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b05c3733-54c1-4af4-b47d-9f3419b6c47a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.375037 Aug 18 11:32:07.070013 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 807/1608] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:06 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:07.686996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-28068d62-1119-406a-acf6-34b6c61f793c tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:07.687614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-28068d62-1119-406a-acf6-34b6c61f793c tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:07.695076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28068d62-1119-406a-acf6-34b6c61f793c tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:07.695574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28068d62-1119-406a-acf6-34b6c61f793c tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:07.696293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28068d62-1119-406a-acf6-34b6c61f793c tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:07.697137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28068d62-1119-406a-acf6-34b6c61f793c tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:07.697604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28068d62-1119-406a-acf6-34b6c61f793c tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:07.698041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28068d62-1119-406a-acf6-34b6c61f793c tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:07.787502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-28068d62-1119-406a-acf6-34b6c61f793c tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:07.796584 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-28068d62-1119-406a-acf6-34b6c61f793c tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1251 microversion: 2.1 time: 0.114716 Aug 18 11:32:07.797481 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 802/1609] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:07 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1251 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:32:07.817159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d94ba3d8-29b8-4b68-8e5f-0bf185800128 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:07.817768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d94ba3d8-29b8-4b68-8e5f-0bf185800128 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:07.827384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d94ba3d8-29b8-4b68-8e5f-0bf185800128 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:07.828208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d94ba3d8-29b8-4b68-8e5f-0bf185800128 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:07.828881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d94ba3d8-29b8-4b68-8e5f-0bf185800128 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:07.829803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d94ba3d8-29b8-4b68-8e5f-0bf185800128 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:07.830489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d94ba3d8-29b8-4b68-8e5f-0bf185800128 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:07.831127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d94ba3d8-29b8-4b68-8e5f-0bf185800128 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:07.942106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1ce3a9f5-e9b3-4c18-b959-aa89448c9b12 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519f931af0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:08.026893 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1ce3a9f5-e9b3-4c18-b959-aa89448c9b12 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1" status: 200 len: 1422 microversion: 2.1 time: 0.092577 Aug 18 11:32:08.028340 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 803/1610] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:07 2022] GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1 => generated 1422 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:08.066696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d94ba3d8-29b8-4b68-8e5f-0bf185800128 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:08.077859 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d94ba3d8-29b8-4b68-8e5f-0bf185800128 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 200 len: 1501 microversion: 2.1 time: 0.264109 Aug 18 11:32:08.079319 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 808/1611] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:07 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 1501 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:08.094627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-36859871-67db-4683-9067-5b860ba13295 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:08.095935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-36859871-67db-4683-9067-5b860ba13295 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:08.102539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d285a076-9d34-4413-88d6-daf5436700a6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:08.103807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d285a076-9d34-4413-88d6-daf5436700a6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:08.105676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36859871-67db-4683-9067-5b860ba13295 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:08.106485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36859871-67db-4683-9067-5b860ba13295 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:08.107382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36859871-67db-4683-9067-5b860ba13295 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:08.108708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36859871-67db-4683-9067-5b860ba13295 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:08.109528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36859871-67db-4683-9067-5b860ba13295 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:08.110078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36859871-67db-4683-9067-5b860ba13295 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:08.111582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d285a076-9d34-4413-88d6-daf5436700a6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:08.112224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d285a076-9d34-4413-88d6-daf5436700a6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:08.112677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d285a076-9d34-4413-88d6-daf5436700a6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:08.113405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d285a076-9d34-4413-88d6-daf5436700a6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:08.113872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d285a076-9d34-4413-88d6-daf5436700a6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:08.114309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d285a076-9d34-4413-88d6-daf5436700a6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:08.147317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d285a076-9d34-4413-88d6-daf5436700a6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:32:08.316434 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d285a076-9d34-4413-88d6-daf5436700a6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "DELETE /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 204 len: 0 microversion: 2.1 time: 0.217064 Aug 18 11:32:08.318878 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 809/1612] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:32:08 2022] DELETE /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:32:08.329492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ff7b26ab-4898-492f-a75e-435f66781fdd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:08.330167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ff7b26ab-4898-492f-a75e-435f66781fdd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:08.339305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff7b26ab-4898-492f-a75e-435f66781fdd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:08.340034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff7b26ab-4898-492f-a75e-435f66781fdd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:08.340479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff7b26ab-4898-492f-a75e-435f66781fdd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:08.341253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff7b26ab-4898-492f-a75e-435f66781fdd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:08.341695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff7b26ab-4898-492f-a75e-435f66781fdd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:08.342152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff7b26ab-4898-492f-a75e-435f66781fdd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:08.392715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-36859871-67db-4683-9067-5b860ba13295 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:08.401874 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-36859871-67db-4683-9067-5b860ba13295 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.313502 Aug 18 11:32:08.415536 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 804/1613] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:08 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:08.605616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ff7b26ab-4898-492f-a75e-435f66781fdd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:08.616353 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ff7b26ab-4898-492f-a75e-435f66781fdd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 200 len: 1507 microversion: 2.1 time: 0.292923 Aug 18 11:32:08.632589 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 810/1614] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:08 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 1507 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:08.818764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ff091768-c6d4-47f6-9b94-169a35a0f76e tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:08.822533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ff091768-c6d4-47f6-9b94-169a35a0f76e tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:08.837530 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ff091768-c6d4-47f6-9b94-169a35a0f76e tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:08.841978 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ff091768-c6d4-47f6-9b94-169a35a0f76e tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:08.843432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ff091768-c6d4-47f6-9b94-169a35a0f76e tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:08.844402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ff091768-c6d4-47f6-9b94-169a35a0f76e tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:08.848426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ff091768-c6d4-47f6-9b94-169a35a0f76e tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:08.849214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ff091768-c6d4-47f6-9b94-169a35a0f76e tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:09.003188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ff091768-c6d4-47f6-9b94-169a35a0f76e tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:09.020167 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ff091768-c6d4-47f6-9b94-169a35a0f76e tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1251 microversion: 2.1 time: 0.206558 Aug 18 11:32:09.021137 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 805/1615] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:08 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1251 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:09.047594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5d8e0f0c-89cb-46dc-9f2b-c3a1dfffb7ef tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519f822550>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:09.393363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-01db216b-29e0-4254-be60-e80cd34d3b81 req-48444d4b-c672-4140-9a33-dbcb8106cc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6c996b-c6b0-4f55-97ed-b4b472dc3640", "name": "network-vif-plugged", "status": "completed", "tag": "ffdd209f-cefa-48ce-8e0f-9845986fb9ef"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:09.402451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:09.419326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-01db216b-29e0-4254-be60-e80cd34d3b81 req-48444d4b-c672-4140-9a33-dbcb8106cc95 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:09.420058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-01db216b-29e0-4254-be60-e80cd34d3b81 req-48444d4b-c672-4140-9a33-dbcb8106cc95 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:09.420957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-01db216b-29e0-4254-be60-e80cd34d3b81 req-48444d4b-c672-4140-9a33-dbcb8106cc95 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:09.462636 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-01db216b-29e0-4254-be60-e80cd34d3b81 req-48444d4b-c672-4140-9a33-dbcb8106cc95 service nova] Creating event network-vif-plugged:ffdd209f-cefa-48ce-8e0f-9845986fb9ef for instance 6c6c996b-c6b0-4f55-97ed-b4b472dc3640 on n-h2-853611-3 Aug 18 11:32:09.480097 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-01db216b-29e0-4254-be60-e80cd34d3b81 req-48444d4b-c672-4140-9a33-dbcb8106cc95 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091749 Aug 18 11:32:09.484773 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 806/1616] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:09.501153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2af47721-20d6-4afe-b349-63955df4f7f6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:09.505446 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2af47721-20d6-4afe-b349-63955df4f7f6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:09.530258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2af47721-20d6-4afe-b349-63955df4f7f6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:09.538844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2af47721-20d6-4afe-b349-63955df4f7f6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:09.545242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2af47721-20d6-4afe-b349-63955df4f7f6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:09.546693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2af47721-20d6-4afe-b349-63955df4f7f6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:09.550371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2af47721-20d6-4afe-b349-63955df4f7f6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:09.551130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2af47721-20d6-4afe-b349-63955df4f7f6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:09.989576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2af47721-20d6-4afe-b349-63955df4f7f6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:10.015242 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2af47721-20d6-4afe-b349-63955df4f7f6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.520705 Aug 18 11:32:10.020377 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 807/1617] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:09 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:10.048737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7da69cc2-9ee4-4ff8-bc0f-fdc59fc4125b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:10.057998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7da69cc2-9ee4-4ff8-bc0f-fdc59fc4125b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:10.103862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7da69cc2-9ee4-4ff8-bc0f-fdc59fc4125b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:10.104494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7da69cc2-9ee4-4ff8-bc0f-fdc59fc4125b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:10.104964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7da69cc2-9ee4-4ff8-bc0f-fdc59fc4125b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:10.105728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7da69cc2-9ee4-4ff8-bc0f-fdc59fc4125b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:10.106194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7da69cc2-9ee4-4ff8-bc0f-fdc59fc4125b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:10.107569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7da69cc2-9ee4-4ff8-bc0f-fdc59fc4125b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:10.569245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7da69cc2-9ee4-4ff8-bc0f-fdc59fc4125b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:10.586648 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7da69cc2-9ee4-4ff8-bc0f-fdc59fc4125b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 200 len: 1507 microversion: 2.1 time: 0.563449 Aug 18 11:32:10.590605 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 808/1618] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:10 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 1507 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:10.601334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d673046c-a812-4b60-b6f2-a8dc0cd4b564 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:10.606128 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d673046c-a812-4b60-b6f2-a8dc0cd4b564 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:10.630294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d673046c-a812-4b60-b6f2-a8dc0cd4b564 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:10.631884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d673046c-a812-4b60-b6f2-a8dc0cd4b564 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:10.632333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d673046c-a812-4b60-b6f2-a8dc0cd4b564 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:10.634617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d673046c-a812-4b60-b6f2-a8dc0cd4b564 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:10.635110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d673046c-a812-4b60-b6f2-a8dc0cd4b564 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:10.636865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d673046c-a812-4b60-b6f2-a8dc0cd4b564 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:10.753642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d673046c-a812-4b60-b6f2-a8dc0cd4b564 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:10.755075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d673046c-a812-4b60-b6f2-a8dc0cd4b564 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:10.759610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d673046c-a812-4b60-b6f2-a8dc0cd4b564 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:10.775207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-d673046c-a812-4b60-b6f2-a8dc0cd4b564 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lazy-loading 'fault' on Instance uuid a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:32:11.066837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d673046c-a812-4b60-b6f2-a8dc0cd4b564 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e9baff3c0f442586f217e007138a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e395c10cbfd4c12ad0f5c0018620c9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:11.078012 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d673046c-a812-4b60-b6f2-a8dc0cd4b564 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 200 len: 1210 microversion: 2.1 time: 0.486101 Aug 18 11:32:11.082771 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 809/1619] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:10 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 1210 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:11.099695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e7ebd5c2-a367-48d2-8a31-95ea8a7b1ed2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:11.103559 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e7ebd5c2-a367-48d2-8a31-95ea8a7b1ed2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:11.118693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7ebd5c2-a367-48d2-8a31-95ea8a7b1ed2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:11.119604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7ebd5c2-a367-48d2-8a31-95ea8a7b1ed2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:11.121181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7ebd5c2-a367-48d2-8a31-95ea8a7b1ed2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:11.125581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7ebd5c2-a367-48d2-8a31-95ea8a7b1ed2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:11.126349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7ebd5c2-a367-48d2-8a31-95ea8a7b1ed2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:11.128688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7ebd5c2-a367-48d2-8a31-95ea8a7b1ed2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:11.628240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e7ebd5c2-a367-48d2-8a31-95ea8a7b1ed2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:11.658473 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e7ebd5c2-a367-48d2-8a31-95ea8a7b1ed2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.571786 Aug 18 11:32:11.662251 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 810/1620] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:11 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:11.677313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-9e1fbc34-8035-44c9-aac0-d977fcbc57b2 req-e43f8489-6f8c-4f70-8353-a5db360b9d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a906b8-26ea-4413-bed0-9c6f7a6be35c", "name": "network-vif-plugged", "status": "completed", "tag": "6b2318ca-00cc-4182-8517-7647cceb2c66"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:11.718924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9e1fbc34-8035-44c9-aac0-d977fcbc57b2 req-e43f8489-6f8c-4f70-8353-a5db360b9d2d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:11.722605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9e1fbc34-8035-44c9-aac0-d977fcbc57b2 req-e43f8489-6f8c-4f70-8353-a5db360b9d2d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:11.723312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9e1fbc34-8035-44c9-aac0-d977fcbc57b2 req-e43f8489-6f8c-4f70-8353-a5db360b9d2d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:11.750297 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-9e1fbc34-8035-44c9-aac0-d977fcbc57b2 req-e43f8489-6f8c-4f70-8353-a5db360b9d2d service nova] Creating event network-vif-plugged:6b2318ca-00cc-4182-8517-7647cceb2c66 for instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c on n-h1-853611-3 Aug 18 11:32:11.768881 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-9e1fbc34-8035-44c9-aac0-d977fcbc57b2 req-e43f8489-6f8c-4f70-8353-a5db360b9d2d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105117 Aug 18 11:32:11.771916 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 811/1621] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:11.795942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-cd092141-268a-48a0-b7f0-5a4a88a12eb9 req-38d5aed9-8168-4f10-870e-f3790bdf558f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625fceb4-de53-4e6b-849d-98873e81773d", "name": "network-vif-deleted", "tag": "8cb10222-e133-4451-8b15-b3404fd4f1a8"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:11.817477 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-cd092141-268a-48a0-b7f0-5a4a88a12eb9 req-38d5aed9-8168-4f10-870e-f3790bdf558f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:11.818349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-cd092141-268a-48a0-b7f0-5a4a88a12eb9 req-38d5aed9-8168-4f10-870e-f3790bdf558f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:11.819148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-cd092141-268a-48a0-b7f0-5a4a88a12eb9 req-38d5aed9-8168-4f10-870e-f3790bdf558f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:11.837319 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-cd092141-268a-48a0-b7f0-5a4a88a12eb9 req-38d5aed9-8168-4f10-870e-f3790bdf558f service nova] Creating event network-vif-deleted:8cb10222-e133-4451-8b15-b3404fd4f1a8 for instance 625fceb4-de53-4e6b-849d-98873e81773d on n-h2-853611-3 Aug 18 11:32:11.842921 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-cd092141-268a-48a0-b7f0-5a4a88a12eb9 req-38d5aed9-8168-4f10-870e-f3790bdf558f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055059 Aug 18 11:32:11.844689 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 812/1622] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:11.852925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-89e47877-92a7-48d6-8f2a-b842424351d7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:11.854482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-89e47877-92a7-48d6-8f2a-b842424351d7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:11.875125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89e47877-92a7-48d6-8f2a-b842424351d7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:11.876022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89e47877-92a7-48d6-8f2a-b842424351d7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:11.877151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89e47877-92a7-48d6-8f2a-b842424351d7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:11.878721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89e47877-92a7-48d6-8f2a-b842424351d7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:11.879526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89e47877-92a7-48d6-8f2a-b842424351d7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:11.880414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89e47877-92a7-48d6-8f2a-b842424351d7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:11.948306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89e47877-92a7-48d6-8f2a-b842424351d7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:11.949033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89e47877-92a7-48d6-8f2a-b842424351d7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:11.949631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89e47877-92a7-48d6-8f2a-b842424351d7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:11.950243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-89e47877-92a7-48d6-8f2a-b842424351d7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lazy-loading 'fault' on Instance uuid 625fceb4-de53-4e6b-849d-98873e81773d {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:32:12.057266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-89e47877-92a7-48d6-8f2a-b842424351d7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:12.068384 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-89e47877-92a7-48d6-8f2a-b842424351d7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 200 len: 1304 microversion: 2.1 time: 0.221535 Aug 18 11:32:12.082455 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 813/1623] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:11 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 1304 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:12.108232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d1f98aa9-ccfd-4187-8f89-0bd128b8c7c8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:12.108852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d1f98aa9-ccfd-4187-8f89-0bd128b8c7c8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] [instance: a2ebb25c-67fd-4720-aaa6-7f85e22a97b3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:12.123553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1f98aa9-ccfd-4187-8f89-0bd128b8c7c8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:12.128574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1f98aa9-ccfd-4187-8f89-0bd128b8c7c8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:12.128574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1f98aa9-ccfd-4187-8f89-0bd128b8c7c8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:12.129437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1f98aa9-ccfd-4187-8f89-0bd128b8c7c8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:12.130831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1f98aa9-ccfd-4187-8f89-0bd128b8c7c8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:12.131279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1f98aa9-ccfd-4187-8f89-0bd128b8c7c8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:12.201091 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-d1f98aa9-ccfd-4187-8f89-0bd128b8c7c8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] HTTP exception thrown: Instance a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 could not be found. Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d1f98aa9-ccfd-4187-8f89-0bd128b8c7c8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Request method failure captured: Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 HTTP/1.1 Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iKjgpAzvwltWOW-7Rb-0j2ZJCkOvhZGracaQ-eSYGEDbADGYiwhzmG53xFqPT5G4GESBJ2OlDPN9nyyABm5veTOQU3kXbwH8GhDDR_Tt1uf87WetA3SZrfEpneTfYOD79NoDrYsadjsBVvHMWiACdLye4orUmPE1rM_JDQgWVePZT4 Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 9e395c10cbfd4c12ad0f5c0018620c9e Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersTestBootFromVolume-1032523511 Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:32:12.215257 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:32:12.217177 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9e395c10cbfd4c12ad0f5c0018620c9e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9e395c10cbfd4c12ad0f5c0018620c9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9e395c10cbfd4c12ad0f5c0018620c9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9e395c10cbfd4c12ad0f5c0018620c9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:32:12.217177 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersTestBootFromVolume-1032523511 Aug 18 11:32:12.217177 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 9e395c10cbfd4c12ad0f5c0018620c9e Aug 18 11:32:12.217177 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1032523511 Aug 18 11:32:12.217177 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersTestBootFromVolume-1032523511-project Aug 18 11:32:12.217177 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:32:12.217177 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:32:12.217177 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: a6e9baff3c0f442586f217e007138a39 Aug 18 11:32:12.217177 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersTestBootFromVolume-1032523511-project Aug 18 11:32:12.217177 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:32:12.217177 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 could not be found. Aug 18 11:32:12.217177 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'a2ebb25c-67fd-4720-aaa6-7f85e22a97b3'} Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 could not be found. Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:32:12.218151 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 could not be found. Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 could not be found. Aug 18 11:32:12.219939 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:12.221520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d1f98aa9-ccfd-4187-8f89-0bd128b8c7c8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Returning 404 to user: Instance a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:32:12.221520 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d1f98aa9-ccfd-4187-8f89-0bd128b8c7c8 tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3" status: 404 len: 111 microversion: 2.1 time: 0.116314 Aug 18 11:32:12.230630 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 814/1624] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:12 2022] GET /compute/v2.1/servers/a2ebb25c-67fd-4720-aaa6-7f85e22a97b3 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:32:12.236764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1f3d8ad4-0c27-4de6-8106-f8aae678e47b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] Calling method '.version_select at 0x7f519fae6160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:12.287948 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1f3d8ad4-0c27-4de6-8106-f8aae678e47b tempest-ServersTestBootFromVolume-1032523511 tempest-ServersTestBootFromVolume-1032523511-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-676045141" status: 202 len: 0 microversion: 2.1 time: 0.055219 Aug 18 11:32:12.289513 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 815/1625] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 18 11:32:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-676045141 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:32:12.692505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-12bef75c-7896-4a5f-a478-3ac12bfdb35c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:12.693774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-12bef75c-7896-4a5f-a478-3ac12bfdb35c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:12.721110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12bef75c-7896-4a5f-a478-3ac12bfdb35c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:12.724319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12bef75c-7896-4a5f-a478-3ac12bfdb35c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:12.728134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12bef75c-7896-4a5f-a478-3ac12bfdb35c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:12.729240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12bef75c-7896-4a5f-a478-3ac12bfdb35c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:12.730071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12bef75c-7896-4a5f-a478-3ac12bfdb35c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:12.734457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-12bef75c-7896-4a5f-a478-3ac12bfdb35c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:13.193989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-12bef75c-7896-4a5f-a478-3ac12bfdb35c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:13.213415 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-12bef75c-7896-4a5f-a478-3ac12bfdb35c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.521167 Aug 18 11:32:13.215069 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 816/1626] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:12 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:13.223569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2773bf3e-7b67-4c85-bbd4-130e8284a0b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:13.224427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2773bf3e-7b67-4c85-bbd4-130e8284a0b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:13.246785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2773bf3e-7b67-4c85-bbd4-130e8284a0b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:13.247590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2773bf3e-7b67-4c85-bbd4-130e8284a0b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:13.248272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2773bf3e-7b67-4c85-bbd4-130e8284a0b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:13.249853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2773bf3e-7b67-4c85-bbd4-130e8284a0b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:13.250849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2773bf3e-7b67-4c85-bbd4-130e8284a0b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:13.251757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2773bf3e-7b67-4c85-bbd4-130e8284a0b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:13.300589 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-2773bf3e-7b67-4c85-bbd4-130e8284a0b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2773bf3e-7b67-4c85-bbd4-130e8284a0b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d HTTP/1.1 Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:32:13.308976 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:32:13.311137 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:32:13.311137 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:32:13.311137 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:32:13.311137 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:32:13.311137 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:32:13.311137 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:32:13.311137 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:32:13.311137 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:32:13.311137 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:32:13.311137 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:32:13.311137 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:32:13.311137 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '625fceb4-de53-4e6b-849d-98873e81773d'} Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:32:13.312177 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:32:13.313822 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:13.317487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2773bf3e-7b67-4c85-bbd4-130e8284a0b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:32:13.318984 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2773bf3e-7b67-4c85-bbd4-130e8284a0b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 404 len: 111 microversion: 2.1 time: 0.102896 Aug 18 11:32:13.331902 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 817/1627] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:13 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:32:13.392287 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1268608390", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "22608490-9e6a-4848-bc6d-66289c233bc1"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:14.108966 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5d8e0f0c-89cb-46dc-9f2b-c3a1dfffb7ef tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1" status: 200 len: 1422 microversion: 2.1 time: 5.066006 Aug 18 11:32:14.111030 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 811/1628] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:09 2022] GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1 => generated 1422 bytes in 5069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:32:14.145612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] validate_networks() for [('22608490-9e6a-4848-bc6d-66289c233bc1', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:32:14.240916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7a977eab-c3f8-4667-aeaf-183cf4f5cbb4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:14.241906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7a977eab-c3f8-4667-aeaf-183cf4f5cbb4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:14.255525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a977eab-c3f8-4667-aeaf-183cf4f5cbb4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:14.256323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a977eab-c3f8-4667-aeaf-183cf4f5cbb4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:14.258299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a977eab-c3f8-4667-aeaf-183cf4f5cbb4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:14.259348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a977eab-c3f8-4667-aeaf-183cf4f5cbb4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:14.264788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a977eab-c3f8-4667-aeaf-183cf4f5cbb4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:14.265469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a977eab-c3f8-4667-aeaf-183cf4f5cbb4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:14.664424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7a977eab-c3f8-4667-aeaf-183cf4f5cbb4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:14.690961 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7a977eab-c3f8-4667-aeaf-183cf4f5cbb4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.455648 Aug 18 11:32:14.724737 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 812/1629] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:14 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:15.128810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-80982fb6-4f9d-43c8-bc72-c219df001e8f tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519fa8ee50>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:15.281570 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:32:15.282123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:32:15.282496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:32:15.282903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:32:15.283533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:32:15.302169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:15.303100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:15.304917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:15.307086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:15.309654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:15.310560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:15.331721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:15.370617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Getting quotas for project a98846d5998440dd87f3d85de0bf9d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:32:15.384188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Getting quotas for user 7bf7b0cd3d8740aca2d71944bc371d75 and project a98846d5998440dd87f3d85de0bf9d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:32:15.422633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:32:15.425472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:32:15.541017 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-32e99c0b-b26a-4e3e-a0ec-6df7446bfd76 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.151122 Aug 18 11:32:15.542319 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 818/1630] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:32:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:32:15.553897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0999cb8b-505c-40ef-9087-45c26df93ed4 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:15.557354 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0999cb8b-505c-40ef-9087-45c26df93ed4 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:15.679938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0999cb8b-505c-40ef-9087-45c26df93ed4 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:15.694527 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0999cb8b-505c-40ef-9087-45c26df93ed4 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 200 len: 1215 microversion: 2.1 time: 0.144460 Aug 18 11:32:15.698473 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 819/1631] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:15 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:32:15.721229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3175e9d3-e884-4a82-ab3e-503a67d300bb tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:15.722195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3175e9d3-e884-4a82-ab3e-503a67d300bb tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:15.747554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3175e9d3-e884-4a82-ab3e-503a67d300bb tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:15.752159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3175e9d3-e884-4a82-ab3e-503a67d300bb tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:15.752972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3175e9d3-e884-4a82-ab3e-503a67d300bb tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:15.758378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3175e9d3-e884-4a82-ab3e-503a67d300bb tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:15.758378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3175e9d3-e884-4a82-ab3e-503a67d300bb tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:15.758841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3175e9d3-e884-4a82-ab3e-503a67d300bb tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:16.183352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3175e9d3-e884-4a82-ab3e-503a67d300bb tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:16.200048 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3175e9d3-e884-4a82-ab3e-503a67d300bb tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.487010 Aug 18 11:32:16.200968 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 820/1632] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:15 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:16.209798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1964580237", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d0a3b2b0-b08b-4498-bc9d-af64e9bcff20"}], "block_device_mapping_v2": [{"uuid": "6aef4931-7f7a-4ed4-b24f-fb192bdb91f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:16.459579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] validate_networks() for [('d0a3b2b0-b08b-4498-bc9d-af64e9bcff20', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:32:17.610587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:32:17.611333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:32:17.611607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:32:17.612042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:32:17.612439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:32:17.623807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:17.624528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:17.625143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:17.626120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:17.626873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:17.627494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:17.664172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Getting quotas for project 51319140bae948cf873746a482aaf588. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:32:17.675569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Getting quotas for user 36162046d3d84db98ce76b19770f6322 and project 51319140bae948cf873746a482aaf588. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:32:17.800728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:32:17.807840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6aef4931-7f7a-4ed4-b24f-fb192bdb91f2',volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:32:18.239676 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f60aeb0f-6eb1-44b3-91b2-10fa5442caae tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.037315 Aug 18 11:32:18.253575 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 821/1633] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:32:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2052 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 11:32:18.268296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9e94b7f2-015e-4a55-8396-3de12523ddb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:18.274853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9e94b7f2-015e-4a55-8396-3de12523ddb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:18.302845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e94b7f2-015e-4a55-8396-3de12523ddb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:18.310023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e94b7f2-015e-4a55-8396-3de12523ddb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:18.310793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e94b7f2-015e-4a55-8396-3de12523ddb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:18.315544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e94b7f2-015e-4a55-8396-3de12523ddb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:18.318010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e94b7f2-015e-4a55-8396-3de12523ddb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:18.318681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e94b7f2-015e-4a55-8396-3de12523ddb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:18.518911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9e94b7f2-015e-4a55-8396-3de12523ddb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:18.537701 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9e94b7f2-015e-4a55-8396-3de12523ddb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 200 len: 1285 microversion: 2.1 time: 0.273918 Aug 18 11:32:18.539542 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 822/1634] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:18 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 1285 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:18.544457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-08a3557e-a1ee-4ae8-b09b-104427e88bbf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:18.546854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-08a3557e-a1ee-4ae8-b09b-104427e88bbf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:18.574105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a3557e-a1ee-4ae8-b09b-104427e88bbf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:18.574624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a3557e-a1ee-4ae8-b09b-104427e88bbf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:18.575551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a3557e-a1ee-4ae8-b09b-104427e88bbf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:18.576303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a3557e-a1ee-4ae8-b09b-104427e88bbf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:18.576739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a3557e-a1ee-4ae8-b09b-104427e88bbf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:18.577369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a3557e-a1ee-4ae8-b09b-104427e88bbf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:19.305898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-08a3557e-a1ee-4ae8-b09b-104427e88bbf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:19.315451 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-08a3557e-a1ee-4ae8-b09b-104427e88bbf tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 0.774591 Aug 18 11:32:19.319186 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 823/1635] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:18 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:19.338211 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2ee33445-ad0a-48e4-8bcc-0570f67ec6a1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:19.355634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2ee33445-ad0a-48e4-8bcc-0570f67ec6a1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:19.591241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2ee33445-ad0a-48e4-8bcc-0570f67ec6a1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:19.605304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2ee33445-ad0a-48e4-8bcc-0570f67ec6a1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:19.622953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2ee33445-ad0a-48e4-8bcc-0570f67ec6a1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:19.628710 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2ee33445-ad0a-48e4-8bcc-0570f67ec6a1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1104 microversion: 2.25 time: 0.301495 Aug 18 11:32:19.638466 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 824/1636] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:32:19 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1104 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:32:19.650670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-690ddc22-eaaf-4c04-bead-e12a358d0ff6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:19.651440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-690ddc22-eaaf-4c04-bead-e12a358d0ff6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:19.691230 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-690ddc22-eaaf-4c04-bead-e12a358d0ff6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:19.695403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-690ddc22-eaaf-4c04-bead-e12a358d0ff6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:19.695953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-690ddc22-eaaf-4c04-bead-e12a358d0ff6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:19.703385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-690ddc22-eaaf-4c04-bead-e12a358d0ff6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:19.709195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-690ddc22-eaaf-4c04-bead-e12a358d0ff6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:19.709811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-690ddc22-eaaf-4c04-bead-e12a358d0ff6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:19.883681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-690ddc22-eaaf-4c04-bead-e12a358d0ff6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:19.892994 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-690ddc22-eaaf-4c04-bead-e12a358d0ff6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 200 len: 1273 microversion: 2.1 time: 0.257867 Aug 18 11:32:19.903169 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 825/1637] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:19 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:20.216462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a4240ee3-264e-4651-9358-276fe36fa62b tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "79915332-3c10-4ce8-8213-2503b135e5d0"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:20.219564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a4240ee3-264e-4651-9358-276fe36fa62b tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:20.228463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4240ee3-264e-4651-9358-276fe36fa62b tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:20.229266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4240ee3-264e-4651-9358-276fe36fa62b tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:20.229923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4240ee3-264e-4651-9358-276fe36fa62b tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:20.230869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4240ee3-264e-4651-9358-276fe36fa62b tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:20.231493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4240ee3-264e-4651-9358-276fe36fa62b tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:20.232091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4240ee3-264e-4651-9358-276fe36fa62b tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:20.433445 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-a4240ee3-264e-4651-9358-276fe36fa62b tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] HTTP exception thrown: Volume 79915332-3c10-4ce8-8213-2503b135e5d0 could not be found. Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a4240ee3-264e-4651-9358-276fe36fa62b tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Request method failure captured: Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: request: PUT /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments/e5132610-9225-4967-ae11-347cf76be3df HTTP/1.1 Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 74 Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iLnsbuUgzjUzwv2PPU7ZJsCNWM2ODYg4iTR4NP-oZWlL2GNfL5NvxPk7Cz8GK6TRynKX7QGHFBXUl0abyfNPt_M2XNEdYAcjWOqTfR29xLu9g1v0K9vwhgQv2v1Y_xQJYPt05abiyOzcHYuegnHzMDLuuDGXv5O3B7cy8CnBtZMv88 Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ad2953d699e9488fba834b56a4a8308f Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-VolumesAdminNegativeTest-1784515100 Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:32:20.468439 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:32:20.470317 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ad2953d699e9488fba834b56a4a8308f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ad2953d699e9488fba834b56a4a8308f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ad2953d699e9488fba834b56a4a8308f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ad2953d699e9488fba834b56a4a8308f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:32:20.470317 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-VolumesAdminNegativeTest-1784515100 Aug 18 11:32:20.470317 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ad2953d699e9488fba834b56a4a8308f Aug 18 11:32:20.470317 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1784515100 Aug 18 11:32:20.470317 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-VolumesAdminNegativeTest-1784515100-project-admin Aug 18 11:32:20.470317 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:32:20.470317 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:32:20.470317 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1abec3a9a8bc48fbb0e128074284f405 Aug 18 11:32:20.470317 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-VolumesAdminNegativeTest-1784515100-project-admin Aug 18 11:32:20.470317 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:32:20.470317 n-d-853611-3 devstack@n-api.service[122209]: {"volumeAttachment": {"volumeId": "79915332-3c10-4ce8-8213-2503b135e5d0"}} Aug 18 11:32:20.470317 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:32:20.470317 n-d-853611-3 devstack@n-api.service[122209]: exception: Volume 79915332-3c10-4ce8-8213-2503b135e5d0 could not be found. Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'server_id': 'ba680fc7-c565-43cb-9551-f9f71f1f66f4', 'id': 'e5132610-9225-4967-ae11-347cf76be3df', 'body': {'volumeAttachment': {'volumeId': '79915332-3c10-4ce8-8213-2503b135e5d0'}}} Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:32:20.471441 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79915332-3c10-4ce8-8213-2503b135e5d0 could not be found. (HTTP 404) (Request-ID: req-7f443365-fe39-417a-b073-2fccedabf487) Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:32:20.472874 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79915332-3c10-4ce8-8213-2503b135e5d0 could not be found. Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:32:20.474392 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 79915332-3c10-4ce8-8213-2503b135e5d0 could not be found. Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79915332-3c10-4ce8-8213-2503b135e5d0 could not be found. Aug 18 11:32:20.476282 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:20.479172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a4240ee3-264e-4651-9358-276fe36fa62b tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Returning 400 to user: Volume 79915332-3c10-4ce8-8213-2503b135e5d0 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:32:20.480351 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a4240ee3-264e-4651-9358-276fe36fa62b tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] 10.222.0.73 "PUT /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments/e5132610-9225-4967-ae11-347cf76be3df" status: 400 len: 107 microversion: 2.1 time: 0.574711 Aug 18 11:32:20.481512 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 826/1638] 10.222.0.73 () {60 vars in 1433 bytes} [Thu Aug 18 11:32:19 2022] PUT /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments/e5132610-9225-4967-ae11-347cf76be3df => generated 107 bytes in 576 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:32:20.486902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-66c030e9-9ffa-40da-bcff-9315b17db57c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:20.487702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-66c030e9-9ffa-40da-bcff-9315b17db57c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:20.511337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66c030e9-9ffa-40da-bcff-9315b17db57c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:20.517624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66c030e9-9ffa-40da-bcff-9315b17db57c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:20.519983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66c030e9-9ffa-40da-bcff-9315b17db57c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:20.526901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66c030e9-9ffa-40da-bcff-9315b17db57c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:20.527741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66c030e9-9ffa-40da-bcff-9315b17db57c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:20.529715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66c030e9-9ffa-40da-bcff-9315b17db57c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:22.199835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-66c030e9-9ffa-40da-bcff-9315b17db57c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:22.214139 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-66c030e9-9ffa-40da-bcff-9315b17db57c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1498 microversion: 2.1 time: 1.731164 Aug 18 11:32:22.216204 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 827/1639] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:20 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1498 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:22.226258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c4ed0044-f565-4a9d-b72d-c881339320ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:22.228438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c4ed0044-f565-4a9d-b72d-c881339320ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:22.246073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4ed0044-f565-4a9d-b72d-c881339320ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:22.248019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4ed0044-f565-4a9d-b72d-c881339320ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:22.250174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4ed0044-f565-4a9d-b72d-c881339320ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:22.251206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4ed0044-f565-4a9d-b72d-c881339320ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:22.253186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4ed0044-f565-4a9d-b72d-c881339320ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:22.258320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4ed0044-f565-4a9d-b72d-c881339320ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:22.627314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c4ed0044-f565-4a9d-b72d-c881339320ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:22.643393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c4ed0044-f565-4a9d-b72d-c881339320ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:22.652390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c4ed0044-f565-4a9d-b72d-c881339320ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:22.658230 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c4ed0044-f565-4a9d-b72d-c881339320ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1251 microversion: 2.25 time: 0.438436 Aug 18 11:32:22.666745 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 828/1640] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:32:22 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1251 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:32:22.693628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a37db425-cf4f-44e3-bbe6-50bcbf7539dc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:22.700519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a37db425-cf4f-44e3-bbe6-50bcbf7539dc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:22.728091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a37db425-cf4f-44e3-bbe6-50bcbf7539dc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:22.730676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a37db425-cf4f-44e3-bbe6-50bcbf7539dc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:22.732418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a37db425-cf4f-44e3-bbe6-50bcbf7539dc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:22.736485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a37db425-cf4f-44e3-bbe6-50bcbf7539dc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:22.738838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a37db425-cf4f-44e3-bbe6-50bcbf7539dc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:22.751899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a37db425-cf4f-44e3-bbe6-50bcbf7539dc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:23.111637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-a37db425-cf4f-44e3-bbe6-50bcbf7539dc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lazy-loading 'services' on Instance uuid ba680fc7-c565-43cb-9551-f9f71f1f66f4 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:32:23.510920 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a37db425-cf4f-44e3-bbe6-50bcbf7539dc tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments/e5132610-9225-4967-ae11-347cf76be3df" status: 202 len: 0 microversion: 2.1 time: 0.838236 Aug 18 11:32:23.511648 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 829/1641] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 11:32:22 2022] DELETE /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments/e5132610-9225-4967-ae11-347cf76be3df => generated 0 bytes in 843 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:32:23.550303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-077f5aa1-fe77-4a4c-8156-78209a9f5e6a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:23.558889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-077f5aa1-fe77-4a4c-8156-78209a9f5e6a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:23.597637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-077f5aa1-fe77-4a4c-8156-78209a9f5e6a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:23.598514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-077f5aa1-fe77-4a4c-8156-78209a9f5e6a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:23.599198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-077f5aa1-fe77-4a4c-8156-78209a9f5e6a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:23.602494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-077f5aa1-fe77-4a4c-8156-78209a9f5e6a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:23.603265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-077f5aa1-fe77-4a4c-8156-78209a9f5e6a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:23.603901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-077f5aa1-fe77-4a4c-8156-78209a9f5e6a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:24.255476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:24.320432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-077f5aa1-fe77-4a4c-8156-78209a9f5e6a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:24.332794 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-077f5aa1-fe77-4a4c-8156-78209a9f5e6a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 200 len: 1315 microversion: 2.1 time: 0.798754 Aug 18 11:32:24.333715 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 830/1642] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:23 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 1315 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:24.345285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-25218c15-9954-4a63-a8f8-78d90076e498 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:24.357627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-25218c15-9954-4a63-a8f8-78d90076e498 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:24.377764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25218c15-9954-4a63-a8f8-78d90076e498 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:24.382669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25218c15-9954-4a63-a8f8-78d90076e498 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:24.389022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25218c15-9954-4a63-a8f8-78d90076e498 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:24.389801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25218c15-9954-4a63-a8f8-78d90076e498 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:24.390281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25218c15-9954-4a63-a8f8-78d90076e498 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:24.390744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25218c15-9954-4a63-a8f8-78d90076e498 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:24.685965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:25.180067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-25218c15-9954-4a63-a8f8-78d90076e498 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:25.189334 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-25218c15-9954-4a63-a8f8-78d90076e498 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 200 len: 1475 microversion: 2.1 time: 0.849782 Aug 18 11:32:25.199233 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 831/1643] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:24 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 1475 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:25.211559 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e3d6b727-1a67-4b68-9999-a54b3e72eb78 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:25.232683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e3d6b727-1a67-4b68-9999-a54b3e72eb78 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:25.250084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3d6b727-1a67-4b68-9999-a54b3e72eb78 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:25.250633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3d6b727-1a67-4b68-9999-a54b3e72eb78 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:25.251079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3d6b727-1a67-4b68-9999-a54b3e72eb78 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:25.251797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3d6b727-1a67-4b68-9999-a54b3e72eb78 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:25.254686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3d6b727-1a67-4b68-9999-a54b3e72eb78 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:25.256091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3d6b727-1a67-4b68-9999-a54b3e72eb78 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:25.339312 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e3d6b727-1a67-4b68-9999-a54b3e72eb78 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136050 Aug 18 11:32:25.342515 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 832/1644] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:32:25 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:25.350248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fc077072-1732-482d-8985-370ef8ee26b3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:25.355459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fc077072-1732-482d-8985-370ef8ee26b3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:25.372522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc077072-1732-482d-8985-370ef8ee26b3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:25.374024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc077072-1732-482d-8985-370ef8ee26b3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:25.375952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc077072-1732-482d-8985-370ef8ee26b3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:25.377304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc077072-1732-482d-8985-370ef8ee26b3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:25.377879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc077072-1732-482d-8985-370ef8ee26b3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:25.378319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc077072-1732-482d-8985-370ef8ee26b3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:26.659310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fc077072-1732-482d-8985-370ef8ee26b3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:26.674475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fc077072-1732-482d-8985-370ef8ee26b3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:26.680846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fc077072-1732-482d-8985-370ef8ee26b3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:26.684523 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fc077072-1732-482d-8985-370ef8ee26b3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1293 microversion: 2.25 time: 1.340575 Aug 18 11:32:26.699782 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 833/1645] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:32:25 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1293 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:32:26.712359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-67266ff9-445b-4f23-b56b-820a62fc05f4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1713986186"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:26.715138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-67266ff9-445b-4f23-b56b-820a62fc05f4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:26.723255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67266ff9-445b-4f23-b56b-820a62fc05f4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:26.724036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67266ff9-445b-4f23-b56b-820a62fc05f4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:26.724664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67266ff9-445b-4f23-b56b-820a62fc05f4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:26.726103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67266ff9-445b-4f23-b56b-820a62fc05f4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:26.726798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67266ff9-445b-4f23-b56b-820a62fc05f4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:26.727403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67266ff9-445b-4f23-b56b-820a62fc05f4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:27.637676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:29.596015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=16 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:33.917836 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-80982fb6-4f9d-43c8-bc72-c219df001e8f tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1" status: 200 len: 1422 microversion: 2.1 time: 18.793279 Aug 18 11:32:33.931795 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 813/1646] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:15 2022] GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1 => generated 1422 bytes in 18808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:33.938371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2bea67ff-1f22-48f4-879d-fc53f3c5ff6d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:33.939072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2bea67ff-1f22-48f4-879d-fc53f3c5ff6d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:33.967199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bea67ff-1f22-48f4-879d-fc53f3c5ff6d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:33.967693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bea67ff-1f22-48f4-879d-fc53f3c5ff6d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:33.968131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bea67ff-1f22-48f4-879d-fc53f3c5ff6d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:33.969043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bea67ff-1f22-48f4-879d-fc53f3c5ff6d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:33.969509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bea67ff-1f22-48f4-879d-fc53f3c5ff6d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:33.969938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bea67ff-1f22-48f4-879d-fc53f3c5ff6d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:34.309955 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-67266ff9-445b-4f23-b56b-820a62fc05f4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "POST /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359/action" status: 202 len: 0 microversion: 2.1 time: 7.607943 Aug 18 11:32:34.315822 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 834/1647] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:32:26 2022] POST /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359/action => generated 0 bytes in 7611 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 18 11:32:34.324979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-ecbaa32d-4fa2-4bc9-83a6-72e393acbd61 req-0e5ed4a2-7a3c-437d-a358-1919b29e5db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecc4c6b-9de9-497a-8421-657f7f6a4cb0", "tag": "6a82185e-6584-4c38-b3fb-0db9eebc3d1b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:34.341512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ecbaa32d-4fa2-4bc9-83a6-72e393acbd61 req-0e5ed4a2-7a3c-437d-a358-1919b29e5db3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:34.342389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ecbaa32d-4fa2-4bc9-83a6-72e393acbd61 req-0e5ed4a2-7a3c-437d-a358-1919b29e5db3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:34.343077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ecbaa32d-4fa2-4bc9-83a6-72e393acbd61 req-0e5ed4a2-7a3c-437d-a358-1919b29e5db3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:34.357122 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ecbaa32d-4fa2-4bc9-83a6-72e393acbd61 req-0e5ed4a2-7a3c-437d-a358-1919b29e5db3 service nova] Creating event network-changed:6a82185e-6584-4c38-b3fb-0db9eebc3d1b for instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 on n-h2-853611-3 Aug 18 11:32:34.363745 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-ecbaa32d-4fa2-4bc9-83a6-72e393acbd61 req-0e5ed4a2-7a3c-437d-a358-1919b29e5db3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045835 Aug 18 11:32:34.370088 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 835/1648] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:34.376305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bddf9f16-fe69-4270-af7c-72184ffc5199 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:34.379120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bddf9f16-fe69-4270-af7c-72184ffc5199 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:34.388202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bddf9f16-fe69-4270-af7c-72184ffc5199 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:34.389200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bddf9f16-fe69-4270-af7c-72184ffc5199 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:34.390169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bddf9f16-fe69-4270-af7c-72184ffc5199 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:34.391213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bddf9f16-fe69-4270-af7c-72184ffc5199 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:34.391911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bddf9f16-fe69-4270-af7c-72184ffc5199 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:34.392716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bddf9f16-fe69-4270-af7c-72184ffc5199 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:34.464892 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bddf9f16-fe69-4270-af7c-72184ffc5199 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092851 Aug 18 11:32:34.466286 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 836/1649] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:32:34 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:34.471524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-da5dee99-bfa3-425d-bc60-652f930b4bb9 req-b30d75d9-7519-4278-80fb-2e6ae33a4c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d34316-2cf9-44a6-a370-673959e72cb3", "tag": "0e79fe89-a5db-4cc8-a9e2-eeb3956f1a86"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:34.481079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:34.489060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-da5dee99-bfa3-425d-bc60-652f930b4bb9 req-b30d75d9-7519-4278-80fb-2e6ae33a4c2b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:34.489916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-da5dee99-bfa3-425d-bc60-652f930b4bb9 req-b30d75d9-7519-4278-80fb-2e6ae33a4c2b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:34.491432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-da5dee99-bfa3-425d-bc60-652f930b4bb9 req-b30d75d9-7519-4278-80fb-2e6ae33a4c2b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:34.498454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:34.515467 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-da5dee99-bfa3-425d-bc60-652f930b4bb9 req-b30d75d9-7519-4278-80fb-2e6ae33a4c2b service nova] Creating event network-changed:0e79fe89-a5db-4cc8-a9e2-eeb3956f1a86 for instance 19d34316-2cf9-44a6-a370-673959e72cb3 on n-h1-853611-3 Aug 18 11:32:34.528748 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-da5dee99-bfa3-425d-bc60-652f930b4bb9 req-b30d75d9-7519-4278-80fb-2e6ae33a4c2b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060735 Aug 18 11:32:34.530622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2bea67ff-1f22-48f4-879d-fc53f3c5ff6d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:34.531212 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 837/1650] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:34.538171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a59d4e05-3997-47b6-952b-2a92e5ebe5b9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:34.539224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a59d4e05-3997-47b6-952b-2a92e5ebe5b9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:34.541156 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2bea67ff-1f22-48f4-879d-fc53f3c5ff6d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 200 len: 1315 microversion: 2.1 time: 0.608171 Aug 18 11:32:34.541749 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 814/1651] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:33 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:34.547742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a59d4e05-3997-47b6-952b-2a92e5ebe5b9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:34.548584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a59d4e05-3997-47b6-952b-2a92e5ebe5b9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:34.549195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a59d4e05-3997-47b6-952b-2a92e5ebe5b9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:34.550220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a59d4e05-3997-47b6-952b-2a92e5ebe5b9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:34.551430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a59d4e05-3997-47b6-952b-2a92e5ebe5b9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:34.552304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a59d4e05-3997-47b6-952b-2a92e5ebe5b9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:34.572016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-da8e36ae-ea11-46b7-b2c5-0255a6b078a2 req-a69b0340-cb88-4f13-b4af-f45bb929c34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecc4c6b-9de9-497a-8421-657f7f6a4cb0", "name": "network-vif-plugged", "status": "completed", "tag": "6a82185e-6584-4c38-b3fb-0db9eebc3d1b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:34.613454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-da8e36ae-ea11-46b7-b2c5-0255a6b078a2 req-a69b0340-cb88-4f13-b4af-f45bb929c34e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:34.614601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-da8e36ae-ea11-46b7-b2c5-0255a6b078a2 req-a69b0340-cb88-4f13-b4af-f45bb929c34e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:34.615528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-da8e36ae-ea11-46b7-b2c5-0255a6b078a2 req-a69b0340-cb88-4f13-b4af-f45bb929c34e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:34.687922 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-da8e36ae-ea11-46b7-b2c5-0255a6b078a2 req-a69b0340-cb88-4f13-b4af-f45bb929c34e service nova] Creating event network-vif-plugged:6a82185e-6584-4c38-b3fb-0db9eebc3d1b for instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 on n-h2-853611-3 Aug 18 11:32:34.700662 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-da8e36ae-ea11-46b7-b2c5-0255a6b078a2 req-a69b0340-cb88-4f13-b4af-f45bb929c34e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153922 Aug 18 11:32:34.706047 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 815/1652] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:34.721202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8d200740-33af-49a3-b1d4-b6457ee383e3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:34.730474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8d200740-33af-49a3-b1d4-b6457ee383e3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:34.746104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d200740-33af-49a3-b1d4-b6457ee383e3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:34.747170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d200740-33af-49a3-b1d4-b6457ee383e3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:34.747869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d200740-33af-49a3-b1d4-b6457ee383e3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:34.748881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d200740-33af-49a3-b1d4-b6457ee383e3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:34.751081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d200740-33af-49a3-b1d4-b6457ee383e3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:34.754812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d200740-33af-49a3-b1d4-b6457ee383e3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:35.271077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a59d4e05-3997-47b6-952b-2a92e5ebe5b9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:35.306641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a59d4e05-3997-47b6-952b-2a92e5ebe5b9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:35.313756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a59d4e05-3997-47b6-952b-2a92e5ebe5b9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:35.316669 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a59d4e05-3997-47b6-952b-2a92e5ebe5b9 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1293 microversion: 2.25 time: 0.784082 Aug 18 11:32:35.321517 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 838/1653] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:32:34 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1293 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:32:35.338976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-103421d1-6c67-4b62-b065-3839376729da tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fac18b0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:35.449785 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-103421d1-6c67-4b62-b065-3839376729da tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168" status: 200 len: 1414 microversion: 2.1 time: 0.123602 Aug 18 11:32:35.460610 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 839/1654] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:35 2022] GET /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168 => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:35.474171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b215ace-e793-4948-98b3-07932ab5ce23 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519ff96040>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:35.583064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8d200740-33af-49a3-b1d4-b6457ee383e3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:35.596285 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5b215ace-e793-4948-98b3-07932ab5ce23 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1" status: 200 len: 1422 microversion: 2.1 time: 0.138755 Aug 18 11:32:35.598240 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 840/1655] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:35 2022] GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1 => generated 1422 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:35.601223 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8d200740-33af-49a3-b1d4-b6457ee383e3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.886667 Aug 18 11:32:35.614606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a67794af-67bb-4145-ade7-0f82dc8ec79d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:35.620458 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 816/1656] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:34 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:35.623152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a67794af-67bb-4145-ade7-0f82dc8ec79d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:35.633487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd2753a9-e6ac-4a6b-b553-8649744676e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:35.634118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dd2753a9-e6ac-4a6b-b553-8649744676e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:35.640119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a67794af-67bb-4145-ade7-0f82dc8ec79d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:35.640714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a67794af-67bb-4145-ade7-0f82dc8ec79d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:35.641257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a67794af-67bb-4145-ade7-0f82dc8ec79d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:35.642113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a67794af-67bb-4145-ade7-0f82dc8ec79d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:35.642837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a67794af-67bb-4145-ade7-0f82dc8ec79d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:35.643415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a67794af-67bb-4145-ade7-0f82dc8ec79d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:35.651809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd2753a9-e6ac-4a6b-b553-8649744676e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:35.652319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd2753a9-e6ac-4a6b-b553-8649744676e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:35.652762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd2753a9-e6ac-4a6b-b553-8649744676e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:35.653518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd2753a9-e6ac-4a6b-b553-8649744676e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:35.653988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd2753a9-e6ac-4a6b-b553-8649744676e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:35.654418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd2753a9-e6ac-4a6b-b553-8649744676e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:35.706743 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a67794af-67bb-4145-ade7-0f82dc8ec79d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104086 Aug 18 11:32:35.712377 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 841/1657] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:32:35 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:35.717638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5658dcfc-541c-4c68-9456-fdbfe1d0406c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-317979571"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:35.720399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5658dcfc-541c-4c68-9456-fdbfe1d0406c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:35.727890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5658dcfc-541c-4c68-9456-fdbfe1d0406c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:35.728550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5658dcfc-541c-4c68-9456-fdbfe1d0406c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:35.729099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5658dcfc-541c-4c68-9456-fdbfe1d0406c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:35.730076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5658dcfc-541c-4c68-9456-fdbfe1d0406c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:35.730954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5658dcfc-541c-4c68-9456-fdbfe1d0406c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:35.734580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5658dcfc-541c-4c68-9456-fdbfe1d0406c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:36.188581 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5658dcfc-541c-4c68-9456-fdbfe1d0406c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.468620 Aug 18 11:32:36.191557 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 842/1658] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:32:35 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 18 11:32:36.349672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2faecc8e-2358-40c5-93f1-861022a28d04 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:36.351255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2faecc8e-2358-40c5-93f1-861022a28d04 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:36.366857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2faecc8e-2358-40c5-93f1-861022a28d04 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:36.367745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2faecc8e-2358-40c5-93f1-861022a28d04 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:36.370095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2faecc8e-2358-40c5-93f1-861022a28d04 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:36.372774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2faecc8e-2358-40c5-93f1-861022a28d04 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:36.374166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2faecc8e-2358-40c5-93f1-861022a28d04 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:36.374852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2faecc8e-2358-40c5-93f1-861022a28d04 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:36.569906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd2753a9-e6ac-4a6b-b553-8649744676e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:36.585436 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd2753a9-e6ac-4a6b-b553-8649744676e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 200 len: 1315 microversion: 2.1 time: 0.963171 Aug 18 11:32:36.589224 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 817/1659] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:35 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 1315 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:36.608908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-54720b47-de2e-495d-ac81-45b719fd579d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519faf6c10>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:36.707679 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-54720b47-de2e-495d-ac81-45b719fd579d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168" status: 200 len: 1414 microversion: 2.1 time: 0.114322 Aug 18 11:32:36.708476 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 818/1660] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:36 2022] GET /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168 => generated 1414 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:36.727090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fc89509a-c449-49bc-a4b7-9161b7246eff tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519fa899d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:36.794412 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2faecc8e-2358-40c5-93f1-861022a28d04 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:36.811563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2faecc8e-2358-40c5-93f1-861022a28d04 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:36.815012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2faecc8e-2358-40c5-93f1-861022a28d04 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:36.819460 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2faecc8e-2358-40c5-93f1-861022a28d04 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1293 microversion: 2.25 time: 0.471560 Aug 18 11:32:36.836706 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 843/1661] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:32:36 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1293 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:32:36.852713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7b21cd15-5d86-4ef6-8800-ce42c8138f3d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:36.860990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7b21cd15-5d86-4ef6-8800-ce42c8138f3d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:36.878461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b21cd15-5d86-4ef6-8800-ce42c8138f3d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:36.878669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b21cd15-5d86-4ef6-8800-ce42c8138f3d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:36.879463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b21cd15-5d86-4ef6-8800-ce42c8138f3d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:36.879762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b21cd15-5d86-4ef6-8800-ce42c8138f3d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:36.880228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b21cd15-5d86-4ef6-8800-ce42c8138f3d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:36.881252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b21cd15-5d86-4ef6-8800-ce42c8138f3d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:36.885153 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fc89509a-c449-49bc-a4b7-9161b7246eff tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1" status: 200 len: 1422 microversion: 2.1 time: 0.174849 Aug 18 11:32:36.929961 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 819/1662] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:36 2022] GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1 => generated 1422 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:36.961236 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7b21cd15-5d86-4ef6-8800-ce42c8138f3d tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122718 Aug 18 11:32:36.967821 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 844/1663] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:32:36 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:37.612998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ee4bc978-03bb-4710-b959-52fe15f58958 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:37.614414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ee4bc978-03bb-4710-b959-52fe15f58958 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:37.645420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee4bc978-03bb-4710-b959-52fe15f58958 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:37.654354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee4bc978-03bb-4710-b959-52fe15f58958 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:37.656270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee4bc978-03bb-4710-b959-52fe15f58958 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:37.658668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee4bc978-03bb-4710-b959-52fe15f58958 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:37.658947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee4bc978-03bb-4710-b959-52fe15f58958 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:37.659905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee4bc978-03bb-4710-b959-52fe15f58958 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:37.725603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b27a5c6c-ddfc-44b5-92e7-7452f66713b4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f9b9550>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:37.824071 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b27a5c6c-ddfc-44b5-92e7-7452f66713b4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168" status: 200 len: 1414 microversion: 2.1 time: 0.103607 Aug 18 11:32:37.835797 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 845/1664] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:37 2022] GET /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:37.853735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dd7ca7d2-d790-4c86-a5a3-574515a28754 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:37.858154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dd7ca7d2-d790-4c86-a5a3-574515a28754 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:37.871298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dd7ca7d2-d790-4c86-a5a3-574515a28754 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:37.872666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dd7ca7d2-d790-4c86-a5a3-574515a28754 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:37.873327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dd7ca7d2-d790-4c86-a5a3-574515a28754 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:37.875094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dd7ca7d2-d790-4c86-a5a3-574515a28754 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:37.877007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dd7ca7d2-d790-4c86-a5a3-574515a28754 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:37.877765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dd7ca7d2-d790-4c86-a5a3-574515a28754 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:38.153453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dd7ca7d2-d790-4c86-a5a3-574515a28754 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:38.164085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dd7ca7d2-d790-4c86-a5a3-574515a28754 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:38.165714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dd7ca7d2-d790-4c86-a5a3-574515a28754 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:38.167119 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dd7ca7d2-d790-4c86-a5a3-574515a28754 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1293 microversion: 2.25 time: 0.319557 Aug 18 11:32:38.168065 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 846/1665] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:32:37 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1293 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:32:38.173311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1a39c8b4-c1f8-419f-8d95-0f574bd62643 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519f9b9c10>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:38.296743 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1a39c8b4-c1f8-419f-8d95-0f574bd62643 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1" status: 200 len: 1431 microversion: 2.1 time: 0.127526 Aug 18 11:32:38.297589 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 847/1666] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:38 2022] GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1 => generated 1431 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:38.309131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-529bea0a-f031-42a9-a870-402ea1183b8a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:38.316261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-529bea0a-f031-42a9-a870-402ea1183b8a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:38.336106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-529bea0a-f031-42a9-a870-402ea1183b8a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:38.340502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-529bea0a-f031-42a9-a870-402ea1183b8a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:38.341111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-529bea0a-f031-42a9-a870-402ea1183b8a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:38.341989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-529bea0a-f031-42a9-a870-402ea1183b8a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:38.343256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-529bea0a-f031-42a9-a870-402ea1183b8a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:38.343698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-529bea0a-f031-42a9-a870-402ea1183b8a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:38.419548 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-529bea0a-f031-42a9-a870-402ea1183b8a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120243 Aug 18 11:32:38.420405 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 848/1667] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:32:38 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:38.432443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ee4bc978-03bb-4710-b959-52fe15f58958 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:38.434991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e43cf613-0bc7-443a-a6df-12c3b98b2932 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519ff96160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:38.443441 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ee4bc978-03bb-4710-b959-52fe15f58958 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 200 len: 1502 microversion: 2.1 time: 0.837884 Aug 18 11:32:38.448885 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 820/1668] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:37 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 1502 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:32:38.528603 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e43cf613-0bc7-443a-a6df-12c3b98b2932 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1" status: 200 len: 1431 microversion: 2.1 time: 0.107093 Aug 18 11:32:38.529518 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 849/1669] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:38 2022] GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1 => generated 1431 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:38.546756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cfbc9a35-9701-416f-b179-31f9253b9506 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:38.548030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cfbc9a35-9701-416f-b179-31f9253b9506 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:38.564995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfbc9a35-9701-416f-b179-31f9253b9506 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:38.566165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfbc9a35-9701-416f-b179-31f9253b9506 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:38.566903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfbc9a35-9701-416f-b179-31f9253b9506 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:38.579338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfbc9a35-9701-416f-b179-31f9253b9506 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:38.580355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfbc9a35-9701-416f-b179-31f9253b9506 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:38.582273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfbc9a35-9701-416f-b179-31f9253b9506 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:38.845525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1346de76-0698-4226-9732-4f7082002fd4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f712b80>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:38.969813 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1346de76-0698-4226-9732-4f7082002fd4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168" status: 200 len: 1414 microversion: 2.1 time: 0.129881 Aug 18 11:32:38.975213 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 850/1670] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:38 2022] GET /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168 => generated 1414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:32:39.207378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b7ea751-32e2-4bd3-a53b-db88144e7caf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:39.207831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5b7ea751-32e2-4bd3-a53b-db88144e7caf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:39.218084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b7ea751-32e2-4bd3-a53b-db88144e7caf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:39.225938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b7ea751-32e2-4bd3-a53b-db88144e7caf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:39.226828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b7ea751-32e2-4bd3-a53b-db88144e7caf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:39.232639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b7ea751-32e2-4bd3-a53b-db88144e7caf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:39.233209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b7ea751-32e2-4bd3-a53b-db88144e7caf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:39.234778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b7ea751-32e2-4bd3-a53b-db88144e7caf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:39.278140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cfbc9a35-9701-416f-b179-31f9253b9506 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:39.289911 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cfbc9a35-9701-416f-b179-31f9253b9506 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1466 microversion: 2.1 time: 0.748124 Aug 18 11:32:39.295944 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 821/1671] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:38 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1466 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:39.323146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bf9be515-6020-4fe8-8b80-4ef445808124 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519f822550>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:39.408187 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bf9be515-6020-4fe8-8b80-4ef445808124 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/1073d795-16bf-4b88-a573-c9b71aeef18a" status: 200 len: 784 microversion: 2.1 time: 0.097245 Aug 18 11:32:39.409125 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 822/1672] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:39 2022] GET /compute/v2.1/images/1073d795-16bf-4b88-a573-c9b71aeef18a => generated 784 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:32:39.430076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-85c59f9c-af53-4d54-8d9d-d4c45a944a42 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:39.459420 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-85c59f9c-af53-4d54-8d9d-d4c45a944a42 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040507 Aug 18 11:32:39.460002 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 823/1673] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:32:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:32:39.464732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a484241d-a0ea-408a-90be-23ed7bdff0cf tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:39.484144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a484241d-a0ea-408a-90be-23ed7bdff0cf tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:39.497514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a484241d-a0ea-408a-90be-23ed7bdff0cf tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:39.506605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a484241d-a0ea-408a-90be-23ed7bdff0cf tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:39.508631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a484241d-a0ea-408a-90be-23ed7bdff0cf tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:39.512798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a484241d-a0ea-408a-90be-23ed7bdff0cf tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:39.514703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a484241d-a0ea-408a-90be-23ed7bdff0cf tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:39.516529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a484241d-a0ea-408a-90be-23ed7bdff0cf tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:39.625737 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a484241d-a0ea-408a-90be-23ed7bdff0cf tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.164643 Aug 18 11:32:39.633781 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 824/1674] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:32:39 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4/os-volume_attachments => generated 25 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:32:39.649053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2334577f-4146-47b2-8150-55e571b82355 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519f91c280>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:39.761933 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5b7ea751-32e2-4bd3-a53b-db88144e7caf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:39.774224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5b7ea751-32e2-4bd3-a53b-db88144e7caf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:39.798263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5b7ea751-32e2-4bd3-a53b-db88144e7caf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:39.799518 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5b7ea751-32e2-4bd3-a53b-db88144e7caf tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1293 microversion: 2.25 time: 0.596642 Aug 18 11:32:39.804129 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 851/1675] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:32:39 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1293 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:32:39.991473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e1c6a0f4-7e4e-4664-a128-e063949f2f1e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fdeb550>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:41.351690 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2334577f-4146-47b2-8150-55e571b82355 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "DELETE /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1" status: 204 len: 0 microversion: 2.1 time: 1.716813 Aug 18 11:32:41.352280 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 825/1676] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:39 2022] DELETE /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1 => generated 0 bytes in 1718 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:32:41.357944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5c4f78be-f25a-4466-bf8a-08070a5c8fa4 req-653d30d8-cfa3-400a-a7ba-4ce8edfaf937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95fda40e-acac-4a4a-8823-1a6aa7d9c359", "name": "network-vif-plugged", "status": "completed", "tag": "843cde9b-134a-4680-a1a3-1ee63acb156b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:41.393935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c4f78be-f25a-4466-bf8a-08070a5c8fa4 req-653d30d8-cfa3-400a-a7ba-4ce8edfaf937 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:41.394457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c4f78be-f25a-4466-bf8a-08070a5c8fa4 req-653d30d8-cfa3-400a-a7ba-4ce8edfaf937 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:41.394913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c4f78be-f25a-4466-bf8a-08070a5c8fa4 req-653d30d8-cfa3-400a-a7ba-4ce8edfaf937 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:41.448151 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5c4f78be-f25a-4466-bf8a-08070a5c8fa4 req-653d30d8-cfa3-400a-a7ba-4ce8edfaf937 service nova] Creating event network-vif-plugged:843cde9b-134a-4680-a1a3-1ee63acb156b for instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 on n-h1-853611-3 Aug 18 11:32:41.484898 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5c4f78be-f25a-4466-bf8a-08070a5c8fa4 req-653d30d8-cfa3-400a-a7ba-4ce8edfaf937 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130645 Aug 18 11:32:41.490818 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 826/1677] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:41.504163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1261384152", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "230a28da-425a-4af8-bf4b-1298e1d95739"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:41.523080 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e1c6a0f4-7e4e-4664-a128-e063949f2f1e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168" status: 200 len: 1414 microversion: 2.1 time: 1.536802 Aug 18 11:32:41.525587 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 852/1678] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:39 2022] GET /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168 => generated 1414 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:41.573576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-244dca35-5de6-4415-bf66-8ada6e23f798 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:41.578007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-244dca35-5de6-4415-bf66-8ada6e23f798 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:41.629810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-244dca35-5de6-4415-bf66-8ada6e23f798 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:41.646672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-244dca35-5de6-4415-bf66-8ada6e23f798 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:41.654693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-244dca35-5de6-4415-bf66-8ada6e23f798 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:41.667518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-244dca35-5de6-4415-bf66-8ada6e23f798 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:41.667518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-244dca35-5de6-4415-bf66-8ada6e23f798 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:41.667518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-244dca35-5de6-4415-bf66-8ada6e23f798 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:41.976173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] validate_networks() for [('230a28da-425a-4af8-bf4b-1298e1d95739', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:32:42.961720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-244dca35-5de6-4415-bf66-8ada6e23f798 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:42.991977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-244dca35-5de6-4415-bf66-8ada6e23f798 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:43.001866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-244dca35-5de6-4415-bf66-8ada6e23f798 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:43.007007 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-244dca35-5de6-4415-bf66-8ada6e23f798 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1293 microversion: 2.25 time: 1.479686 Aug 18 11:32:43.009211 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 853/1679] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:32:41 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1293 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:32:43.022350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-498bb800-6817-43a1-9810-ab9b92b4ceae tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519fdebd30>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:43.123112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:32:43.124243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:32:43.124893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:32:43.125605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:32:43.126251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:32:43.139244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:43.139959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:43.140569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:43.141461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:43.142140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:43.143043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:43.226881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Getting quotas for project 6439cb52de454891b535bd23f11e88b1. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:32:43.246408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Getting quotas for user d5312f9922c246a9a594be35a4a598ac and project 6439cb52de454891b535bd23f11e88b1. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:32:43.309822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:32:43.316826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: e639b060-d272-4d48-8939-20d840f9c5e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:32:43.448570 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3b290334-bb56-4dc4-beb8-d6b9c6ed5550 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.956280 Aug 18 11:32:43.450367 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 827/1680] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:32:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:32:43.860038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-576973704", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "3ec14bb0-8b77-4071-ad78-05609bd9c5fa"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:51.630180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=19 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:52.979442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:53.184885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:53.188931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=42 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:53.287576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:53.912061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:32:56.521919 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-498bb800-6817-43a1-9810-ab9b92b4ceae tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] HTTP exception thrown: Image not found. Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-498bb800-6817-43a1-9810-ab9b92b4ceae tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Request method failure captured: Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1 HTTP/1.1 Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMjfRC-O8PK_EouMjP6hN6W7GFuUm8qVLrXLLfvWoh_BmvsHGZINu0MaP0VYWFOrQ1qZ8zjEruT5C1t-cytRaGCTf4oXnxD3U8S1xKx9ZukmNRQ1f32uuukBtZg-gvqrP4W1VZQFIV3BPIsbR_EnyJflENSRi5ho1dBYDS_A4rlfuA Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 933f2e895a88476593bf14a643c2b7f6 Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesOneServerTestJSON-516433174 Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:32:56.525804 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:32:56.527455 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/933f2e895a88476593bf14a643c2b7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/933f2e895a88476593bf14a643c2b7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_933f2e895a88476593bf14a643c2b7f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/933f2e895a88476593bf14a643c2b7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:32:56.527455 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesOneServerTestJSON-516433174 Aug 18 11:32:56.527455 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 933f2e895a88476593bf14a643c2b7f6 Aug 18 11:32:56.527455 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-516433174 Aug 18 11:32:56.527455 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesOneServerTestJSON-516433174-project Aug 18 11:32:56.527455 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:32:56.527455 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:32:56.527455 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 368fa7a976b745ae8ab1251352a56975 Aug 18 11:32:56.527455 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesOneServerTestJSON-516433174-project Aug 18 11:32:56.527455 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:32:56.527455 n-d-853611-3 devstack@n-api.service[122209]: exception: Image not found. Aug 18 11:32:56.527455 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '22cf7cd8-d170-4cd6-ac59-942c5f3412d1'} Aug 18 11:32:56.527455 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:32:56.528450 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 22cf7cd8-d170-4cd6-ac59-942c5f3412d1 Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:32:56.529721 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22cf7cd8-d170-4cd6-ac59-942c5f3412d1 could not be found. Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:32:56.536058 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-498bb800-6817-43a1-9810-ab9b92b4ceae tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Returning 404 to user: Image not found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:32:56.537535 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-498bb800-6817-43a1-9810-ab9b92b4ceae tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1" status: 404 len: 62 microversion: 2.1 time: 13.514054 Aug 18 11:32:56.540073 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 854/1681] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:43 2022] GET /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1 => generated 62 bytes in 13526 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:32:56.545982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2709e4b6-3159-4fc9-9f71-25f499f5790a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fd980d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:56.593482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] validate_networks() for [('3ec14bb0-8b77-4071-ad78-05609bd9c5fa', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:32:56.641623 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2709e4b6-3159-4fc9-9f71-25f499f5790a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168" status: 200 len: 1423 microversion: 2.1 time: 0.099873 Aug 18 11:32:56.642525 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 855/1682] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:56 2022] GET /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168 => generated 1423 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:56.657232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b698973f-b243-4f0b-b918-391d58dbe46b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:56.658027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b698973f-b243-4f0b-b918-391d58dbe46b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: e639b060-d272-4d48-8939-20d840f9c5e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:56.665086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b698973f-b243-4f0b-b918-391d58dbe46b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:56.665596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b698973f-b243-4f0b-b918-391d58dbe46b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:56.666052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b698973f-b243-4f0b-b918-391d58dbe46b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:56.666845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b698973f-b243-4f0b-b918-391d58dbe46b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:56.667324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b698973f-b243-4f0b-b918-391d58dbe46b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:56.667760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b698973f-b243-4f0b-b918-391d58dbe46b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:56.888072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b698973f-b243-4f0b-b918-391d58dbe46b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:56.914912 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b698973f-b243-4f0b-b918-391d58dbe46b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4" status: 200 len: 1318 microversion: 2.1 time: 0.270998 Aug 18 11:32:56.916897 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 856/1683] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:56 2022] GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:56.922193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-d18c7e0d-9294-46fc-89e5-3952cabc932e req-bfc04eea-4cd8-415b-b45e-49e7a3b7ef4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6c996b-c6b0-4f55-97ed-b4b472dc3640", "name": "network-vif-unplugged", "status": "completed", "tag": "ffdd209f-cefa-48ce-8e0f-9845986fb9ef"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:56.952773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d18c7e0d-9294-46fc-89e5-3952cabc932e req-bfc04eea-4cd8-415b-b45e-49e7a3b7ef4d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:56.953297 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d18c7e0d-9294-46fc-89e5-3952cabc932e req-bfc04eea-4cd8-415b-b45e-49e7a3b7ef4d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:56.954182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d18c7e0d-9294-46fc-89e5-3952cabc932e req-bfc04eea-4cd8-415b-b45e-49e7a3b7ef4d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:56.984950 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-d18c7e0d-9294-46fc-89e5-3952cabc932e req-bfc04eea-4cd8-415b-b45e-49e7a3b7ef4d service nova] Creating event network-vif-unplugged:ffdd209f-cefa-48ce-8e0f-9845986fb9ef for instance 6c6c996b-c6b0-4f55-97ed-b4b472dc3640 on n-h2-853611-3 Aug 18 11:32:57.001654 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-d18c7e0d-9294-46fc-89e5-3952cabc932e req-bfc04eea-4cd8-415b-b45e-49e7a3b7ef4d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083256 Aug 18 11:32:57.008182 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 857/1684] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:57.014642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-67697ff1-0396-4d30-95f6-f5365424aaaf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a41055c8-3c57-4f83-ac83-94c4e90e0655"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:57.017451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-67697ff1-0396-4d30-95f6-f5365424aaaf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:57.026450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67697ff1-0396-4d30-95f6-f5365424aaaf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:57.027322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67697ff1-0396-4d30-95f6-f5365424aaaf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:57.028275 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67697ff1-0396-4d30-95f6-f5365424aaaf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:57.029084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67697ff1-0396-4d30-95f6-f5365424aaaf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:57.030133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67697ff1-0396-4d30-95f6-f5365424aaaf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:57.030652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-67697ff1-0396-4d30-95f6-f5365424aaaf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:57.110999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:32:57.111682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:32:57.112368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:32:57.113787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:32:57.114867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:32:57.130514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:57.131471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:57.131920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:57.132719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:57.133598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:57.134214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:57.163077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Getting quotas for project 845b1ec9db86457a9b110eef1b36d898. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:32:57.169805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Getting quotas for user 0ab807fb8bcd4081ac5140bb24b4358c and project 845b1ec9db86457a9b110eef1b36d898. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:32:57.185565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Going to run 3 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:32:57.193108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: dc571952-f3e6-43fc-984c-85c632fa12ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:32:57.238713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=dc571952-f3e6-43fc-984c-85c632fa12ca,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:32:57.290060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:32:57.347827 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-67697ff1-0396-4d30-95f6-f5365424aaaf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "POST /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337377 Aug 18 11:32:57.349303 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 858/1685] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:32:57 2022] POST /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:57.369869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ed07e628-9a07-463d-9c2f-ef01fcbaaa14 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:57.372307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ed07e628-9a07-463d-9c2f-ef01fcbaaa14 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:57.388975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed07e628-9a07-463d-9c2f-ef01fcbaaa14 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:57.390107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed07e628-9a07-463d-9c2f-ef01fcbaaa14 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:57.395140 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c0a4ab4f-fe59-411c-94cf-cc9feb685e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.941826 Aug 18 11:32:57.397701 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 828/1686] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:32:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 13946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:32:57.404979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-790443183", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "e8f8f2ff-7601-4fd1-9ee3-58fd8a4e9af3"}], "block_device_mapping_v2": [{"uuid": "93d5e57a-2dbc-418a-a86f-15e2af522d5a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:57.407263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed07e628-9a07-463d-9c2f-ef01fcbaaa14 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:57.408514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed07e628-9a07-463d-9c2f-ef01fcbaaa14 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:57.409237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed07e628-9a07-463d-9c2f-ef01fcbaaa14 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:57.410900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed07e628-9a07-463d-9c2f-ef01fcbaaa14 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:57.615283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] validate_networks() for [('e8f8f2ff-7601-4fd1-9ee3-58fd8a4e9af3', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:32:57.703943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ed07e628-9a07-463d-9c2f-ef01fcbaaa14 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:57.717330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ed07e628-9a07-463d-9c2f-ef01fcbaaa14 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:57.721482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ed07e628-9a07-463d-9c2f-ef01fcbaaa14 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:57.723285 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ed07e628-9a07-463d-9c2f-ef01fcbaaa14 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1281 microversion: 2.25 time: 0.372114 Aug 18 11:32:57.738454 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 859/1687] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:32:57 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1281 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:32:57.744750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-44402875-c18a-46f8-9aad-6b8c41407f62 req-a2ae9a87-de4b-4341-9c26-f4b5b9fdc119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e639b060-d272-4d48-8939-20d840f9c5e4", "tag": "63d5df2a-a11d-4c19-94fd-a21c1c8c3008"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:57.759627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-44402875-c18a-46f8-9aad-6b8c41407f62 req-a2ae9a87-de4b-4341-9c26-f4b5b9fdc119 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:57.760616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-44402875-c18a-46f8-9aad-6b8c41407f62 req-a2ae9a87-de4b-4341-9c26-f4b5b9fdc119 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:57.760616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-44402875-c18a-46f8-9aad-6b8c41407f62 req-a2ae9a87-de4b-4341-9c26-f4b5b9fdc119 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:57.783420 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-44402875-c18a-46f8-9aad-6b8c41407f62 req-a2ae9a87-de4b-4341-9c26-f4b5b9fdc119 service nova] Creating event network-changed:63d5df2a-a11d-4c19-94fd-a21c1c8c3008 for instance e639b060-d272-4d48-8939-20d840f9c5e4 on n-h2-853611-3 Aug 18 11:32:57.795523 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-44402875-c18a-46f8-9aad-6b8c41407f62 req-a2ae9a87-de4b-4341-9c26-f4b5b9fdc119 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069683 Aug 18 11:32:57.796436 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 860/1688] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:57.830613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5c6ba71b-b2bd-425f-9efa-7950593b8bb8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2021156099"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:57.835329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5c6ba71b-b2bd-425f-9efa-7950593b8bb8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:57.851582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c6ba71b-b2bd-425f-9efa-7950593b8bb8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:57.852458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c6ba71b-b2bd-425f-9efa-7950593b8bb8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:57.852574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c6ba71b-b2bd-425f-9efa-7950593b8bb8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:57.853230 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c6ba71b-b2bd-425f-9efa-7950593b8bb8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:57.853695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c6ba71b-b2bd-425f-9efa-7950593b8bb8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:57.854127 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c6ba71b-b2bd-425f-9efa-7950593b8bb8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:58.291041 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5c6ba71b-b2bd-425f-9efa-7950593b8bb8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "POST /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640/action" status: 202 len: 0 microversion: 2.1 time: 0.481351 Aug 18 11:32:58.297299 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 861/1689] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:32:57 2022] POST /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 18 11:32:58.309373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7921f515-0712-43c6-95ce-e8e45442f7c7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f9295e0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:58.352697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:32:58.353215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:32:58.353759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:32:58.354238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:32:58.354752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:32:58.364671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:58.365258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:58.365933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:58.366943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:58.367581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:58.368177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:58.391391 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7921f515-0712-43c6-95ce-e8e45442f7c7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168" status: 200 len: 1423 microversion: 2.1 time: 0.089069 Aug 18 11:32:58.392710 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 862/1690] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:58 2022] GET /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168 => generated 1423 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:58.398423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b793396-8f0b-4d20-8524-8dce33f639c0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:58.403578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5b793396-8f0b-4d20-8524-8dce33f639c0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:58.404867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5b793396-8f0b-4d20-8524-8dce33f639c0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Searching by: {'deleted': False, 'project_id': '845b1ec9db86457a9b110eef1b36d898'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:32:58.427622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Getting quotas for project 22660df6ec1a4f718a08cbeda2be364c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:32:58.428701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b793396-8f0b-4d20-8524-8dce33f639c0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:58.429651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b793396-8f0b-4d20-8524-8dce33f639c0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:58.431064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b793396-8f0b-4d20-8524-8dce33f639c0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:58.432766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b793396-8f0b-4d20-8524-8dce33f639c0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:58.434245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b793396-8f0b-4d20-8524-8dce33f639c0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:58.434747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Getting quotas for user 0cf7fe4236764bea83c6560516441759 and project 22660df6ec1a4f718a08cbeda2be364c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:32:58.435341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b793396-8f0b-4d20-8524-8dce33f639c0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:58.462041 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5b793396-8f0b-4d20-8524-8dce33f639c0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.067858 Aug 18 11:32:58.463080 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 863/1691] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 18 11:32:58 2022] GET /compute/v2.1/servers => generated 1015 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:58.472851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-58ea568b-93cc-4295-b789-822fb50c3c6b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:58.473999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-58ea568b-93cc-4295-b789-822fb50c3c6b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: e639b060-d272-4d48-8939-20d840f9c5e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:58.480735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58ea568b-93cc-4295-b789-822fb50c3c6b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:58.481403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58ea568b-93cc-4295-b789-822fb50c3c6b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:58.482269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58ea568b-93cc-4295-b789-822fb50c3c6b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:58.482871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58ea568b-93cc-4295-b789-822fb50c3c6b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:58.483427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58ea568b-93cc-4295-b789-822fb50c3c6b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:58.484157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58ea568b-93cc-4295-b789-822fb50c3c6b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:58.533020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:32:58.536392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93d5e57a-2dbc-418a-a86f-15e2af522d5a',volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:32:58.858945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-58ea568b-93cc-4295-b789-822fb50c3c6b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:58.867526 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-58ea568b-93cc-4295-b789-822fb50c3c6b tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4" status: 200 len: 1318 microversion: 2.1 time: 0.403118 Aug 18 11:32:58.871970 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 864/1692] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:58 2022] GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4 => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:58.884835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5ee5d151-3793-43c3-ac17-1611544019a4 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519f9b9550>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:58.950294 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5ee5d151-3793-43c3-ac17-1611544019a4 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c" status: 200 len: 1427 microversion: 2.1 time: 0.076917 Aug 18 11:32:58.950961 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 865/1693] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:32:58 2022] GET /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:58.953980 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6c9d3a73-201d-4827-8c0e-f006a891a1fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.555013 Aug 18 11:32:58.954770 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 829/1694] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:32:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:32:58.960769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6dac4eac-a3d6-4919-87b2-df1665d0d16e tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:58.961689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6dac4eac-a3d6-4919-87b2-df1665d0d16e tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:58.965439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6f655d37-3be6-48f4-beb8-fe133912983b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f6258b0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:59.041029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6dac4eac-a3d6-4919-87b2-df1665d0d16e tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:59.049049 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6dac4eac-a3d6-4919-87b2-df1665d0d16e tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1222 microversion: 2.1 time: 0.093000 Aug 18 11:32:59.049628 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 830/1695] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:58 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:59.060404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d64c51ef-dc79-40cd-9edd-b14895015598 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:59.061019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d64c51ef-dc79-40cd-9edd-b14895015598 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:59.072753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d64c51ef-dc79-40cd-9edd-b14895015598 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:59.073253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d64c51ef-dc79-40cd-9edd-b14895015598 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:59.073696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d64c51ef-dc79-40cd-9edd-b14895015598 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:59.074413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d64c51ef-dc79-40cd-9edd-b14895015598 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:59.074897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d64c51ef-dc79-40cd-9edd-b14895015598 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:59.075327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d64c51ef-dc79-40cd-9edd-b14895015598 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:59.367558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d64c51ef-dc79-40cd-9edd-b14895015598 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:59.381884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d64c51ef-dc79-40cd-9edd-b14895015598 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:59.384971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d64c51ef-dc79-40cd-9edd-b14895015598 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:59.386774 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d64c51ef-dc79-40cd-9edd-b14895015598 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1281 microversion: 2.25 time: 0.329962 Aug 18 11:32:59.387996 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 831/1696] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:32:59 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1281 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:32:59.396839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b07d859-db48-472d-b4e5-006c37633f2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:59.398269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b07d859-db48-472d-b4e5-006c37633f2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:59.408641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b07d859-db48-472d-b4e5-006c37633f2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:59.410495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b07d859-db48-472d-b4e5-006c37633f2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:59.411498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b07d859-db48-472d-b4e5-006c37633f2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:59.412407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b07d859-db48-472d-b4e5-006c37633f2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:59.414237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b07d859-db48-472d-b4e5-006c37633f2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:59.415044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b07d859-db48-472d-b4e5-006c37633f2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:59.746791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b07d859-db48-472d-b4e5-006c37633f2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:59.759394 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b07d859-db48-472d-b4e5-006c37633f2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.369720 Aug 18 11:32:59.760728 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 832/1697] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:59 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:59.767882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0c9c568-265f-4754-8718-cf685c283572 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:59.769087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a0c9c568-265f-4754-8718-cf685c283572 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:59.777916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0c9c568-265f-4754-8718-cf685c283572 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:59.779093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0c9c568-265f-4754-8718-cf685c283572 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:59.779792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0c9c568-265f-4754-8718-cf685c283572 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:59.781102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0c9c568-265f-4754-8718-cf685c283572 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:59.782013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0c9c568-265f-4754-8718-cf685c283572 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:59.782746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0c9c568-265f-4754-8718-cf685c283572 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:59.856056 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6f655d37-3be6-48f4-beb8-fe133912983b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168" status: 204 len: 0 microversion: 2.1 time: 0.903013 Aug 18 11:32:59.856235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a0c9c568-265f-4754-8718-cf685c283572 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:32:59.856962 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 866/1698] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:58 2022] DELETE /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168 => generated 0 bytes in 904 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:32:59.862195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-c4535b3b-da44-4b84-8cdc-5ca8b68a8a5a req-de01e63b-2033-4e44-b824-ee0310f80dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a906b8-26ea-4413-bed0-9c6f7a6be35c", "name": "network-vif-plugged", "status": "completed", "tag": "6b2318ca-00cc-4182-8517-7647cceb2c66"}, {"server_uuid": "19d34316-2cf9-44a6-a370-673959e72cb3", "name": "network-vif-plugged", "status": "completed", "tag": "0e79fe89-a5db-4cc8-a9e2-eeb3956f1a86"}, {"server_uuid": "e639b060-d272-4d48-8939-20d840f9c5e4", "name": "network-vif-plugged", "status": "completed", "tag": "63d5df2a-a11d-4c19-94fd-a21c1c8c3008"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:59.868865 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a0c9c568-265f-4754-8718-cf685c283572 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1102 microversion: 2.1 time: 0.106666 Aug 18 11:32:59.869571 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 833/1699] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:32:59 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1102 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:32:59.875614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d32518b5-e1f0-4431-a2f7-c182cc52b64d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-2063381615"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:32:59.879501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d32518b5-e1f0-4431-a2f7-c182cc52b64d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:59.889762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d32518b5-e1f0-4431-a2f7-c182cc52b64d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:59.890385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d32518b5-e1f0-4431-a2f7-c182cc52b64d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:59.890947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d32518b5-e1f0-4431-a2f7-c182cc52b64d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:59.891833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d32518b5-e1f0-4431-a2f7-c182cc52b64d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:59.892580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d32518b5-e1f0-4431-a2f7-c182cc52b64d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:59.893275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d32518b5-e1f0-4431-a2f7-c182cc52b64d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:59.904361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c4535b3b-da44-4b84-8cdc-5ca8b68a8a5a req-de01e63b-2033-4e44-b824-ee0310f80dba service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:59.904759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c4535b3b-da44-4b84-8cdc-5ca8b68a8a5a req-de01e63b-2033-4e44-b824-ee0310f80dba service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:59.908825 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c4535b3b-da44-4b84-8cdc-5ca8b68a8a5a req-de01e63b-2033-4e44-b824-ee0310f80dba service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:59.934934 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-c4535b3b-da44-4b84-8cdc-5ca8b68a8a5a req-de01e63b-2033-4e44-b824-ee0310f80dba service nova] Creating event network-vif-plugged:6b2318ca-00cc-4182-8517-7647cceb2c66 for instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c on n-h1-853611-3 Aug 18 11:32:59.941665 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-c4535b3b-da44-4b84-8cdc-5ca8b68a8a5a req-de01e63b-2033-4e44-b824-ee0310f80dba service nova] Creating event network-vif-plugged:0e79fe89-a5db-4cc8-a9e2-eeb3956f1a86 for instance 19d34316-2cf9-44a6-a370-673959e72cb3 on n-h1-853611-3 Aug 18 11:32:59.942238 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-c4535b3b-da44-4b84-8cdc-5ca8b68a8a5a req-de01e63b-2033-4e44-b824-ee0310f80dba service nova] Creating event network-vif-plugged:63d5df2a-a11d-4c19-94fd-a21c1c8c3008 for instance e639b060-d272-4d48-8939-20d840f9c5e4 on n-h2-853611-3 Aug 18 11:32:59.963689 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-c4535b3b-da44-4b84-8cdc-5ca8b68a8a5a req-de01e63b-2033-4e44-b824-ee0310f80dba service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.105261 Aug 18 11:32:59.965138 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 867/1700] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:32:59.973742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4f9e3ce2-aabe-4ca4-a509-52da76df6ae0 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:32:59.974627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4f9e3ce2-aabe-4ca4-a509-52da76df6ae0 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:32:59.983840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f9e3ce2-aabe-4ca4-a509-52da76df6ae0 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:59.984529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f9e3ce2-aabe-4ca4-a509-52da76df6ae0 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:59.985150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f9e3ce2-aabe-4ca4-a509-52da76df6ae0 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:32:59.986060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f9e3ce2-aabe-4ca4-a509-52da76df6ae0 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:32:59.986711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f9e3ce2-aabe-4ca4-a509-52da76df6ae0 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:32:59.987293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f9e3ce2-aabe-4ca4-a509-52da76df6ae0 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:00.023357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4f9e3ce2-aabe-4ca4-a509-52da76df6ae0 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:33:00.179478 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4f9e3ce2-aabe-4ca4-a509-52da76df6ae0 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 204 len: 0 microversion: 2.1 time: 0.212268 Aug 18 11:33:00.180548 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 868/1701] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:32:59 2022] DELETE /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:33:00.189155 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4ad8fb7f-ce05-4c57-8374-d595e26a5860 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:00.190084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4ad8fb7f-ce05-4c57-8374-d595e26a5860 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: e639b060-d272-4d48-8939-20d840f9c5e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:00.200620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ad8fb7f-ce05-4c57-8374-d595e26a5860 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:00.201553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ad8fb7f-ce05-4c57-8374-d595e26a5860 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:00.202162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ad8fb7f-ce05-4c57-8374-d595e26a5860 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:00.203206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ad8fb7f-ce05-4c57-8374-d595e26a5860 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:00.204592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ad8fb7f-ce05-4c57-8374-d595e26a5860 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:00.205111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ad8fb7f-ce05-4c57-8374-d595e26a5860 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:00.302023 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d32518b5-e1f0-4431-a2f7-c182cc52b64d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.429432 Aug 18 11:33:00.303947 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 834/1702] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:32:59 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 18 11:33:00.310122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f057c20a-b20e-43f2-89cc-908172fa61dd tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519fb88dc0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:00.367401 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f057c20a-b20e-43f2-89cc-908172fa61dd tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c" status: 200 len: 1427 microversion: 2.1 time: 0.061966 Aug 18 11:33:00.367995 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 835/1703] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:00 2022] GET /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:00.387459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7eb542cf-bb8c-42e9-aa1b-891a970bedf7 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:00.388633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7eb542cf-bb8c-42e9-aa1b-891a970bedf7 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:00.415421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eb542cf-bb8c-42e9-aa1b-891a970bedf7 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:00.416869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eb542cf-bb8c-42e9-aa1b-891a970bedf7 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:00.417430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eb542cf-bb8c-42e9-aa1b-891a970bedf7 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:00.418469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eb542cf-bb8c-42e9-aa1b-891a970bedf7 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:00.419035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eb542cf-bb8c-42e9-aa1b-891a970bedf7 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:00.419861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eb542cf-bb8c-42e9-aa1b-891a970bedf7 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:00.479708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4ad8fb7f-ce05-4c57-8374-d595e26a5860 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:00.490745 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4ad8fb7f-ce05-4c57-8374-d595e26a5860 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4" status: 200 len: 1318 microversion: 2.1 time: 0.308671 Aug 18 11:33:00.492446 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 869/1704] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:00 2022] GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:00.499149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-113eaff6-378d-41b8-ad37-7b77ddbe7f97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:00.500046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-113eaff6-378d-41b8-ad37-7b77ddbe7f97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:00.509114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-113eaff6-378d-41b8-ad37-7b77ddbe7f97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:00.510011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-113eaff6-378d-41b8-ad37-7b77ddbe7f97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:00.510893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-113eaff6-378d-41b8-ad37-7b77ddbe7f97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:00.512220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-113eaff6-378d-41b8-ad37-7b77ddbe7f97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:00.512921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-113eaff6-378d-41b8-ad37-7b77ddbe7f97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:00.513578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-113eaff6-378d-41b8-ad37-7b77ddbe7f97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:00.539101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7eb542cf-bb8c-42e9-aa1b-891a970bedf7 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:00.548854 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7eb542cf-bb8c-42e9-aa1b-891a970bedf7 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1274 microversion: 2.1 time: 0.173149 Aug 18 11:33:00.550723 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 836/1705] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:00 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1274 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:00.563723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-574605824", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "9087955c-aa00-44c0-84c8-58368fdadbd5"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:00.654449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] validate_networks() for [('9087955c-aa00-44c0-84c8-58368fdadbd5', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:33:01.296186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:33:01.296186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:33:01.296408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:33:01.296811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:33:01.297541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:33:01.313332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:01.313997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:01.314292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:01.315082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:01.315666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:01.316894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:01.332515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-113eaff6-378d-41b8-ad37-7b77ddbe7f97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:01.343900 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-113eaff6-378d-41b8-ad37-7b77ddbe7f97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1679 microversion: 2.1 time: 0.850096 Aug 18 11:33:01.344781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Getting quotas for project 287b7017444e47b48aa08661b84a3798. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:33:01.348036 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 870/1706] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:00 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1679 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:01.351230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Getting quotas for user 678c78e8696f45c1a9d099199fcdcd36 and project 287b7017444e47b48aa08661b84a3798. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:33:01.355109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f16981f4-2a3b-422e-8a7d-b77f3656c594 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:01.360565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f16981f4-2a3b-422e-8a7d-b77f3656c594 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:01.375481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f16981f4-2a3b-422e-8a7d-b77f3656c594 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:01.377995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f16981f4-2a3b-422e-8a7d-b77f3656c594 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:01.379259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f16981f4-2a3b-422e-8a7d-b77f3656c594 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:01.380010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f16981f4-2a3b-422e-8a7d-b77f3656c594 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:01.380467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f16981f4-2a3b-422e-8a7d-b77f3656c594 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:01.380892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f16981f4-2a3b-422e-8a7d-b77f3656c594 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:01.385821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:33:01.388315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:33:01.500851 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-74b8f1d3-3a54-4b19-9706-644c878752f7 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944525 Aug 18 11:33:01.502325 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 837/1707] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:33:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:33:01.514200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76a593fa-938b-4ff5-b3bb-7a02ab669ecc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:01.515349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-76a593fa-938b-4ff5-b3bb-7a02ab669ecc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:01.531721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76a593fa-938b-4ff5-b3bb-7a02ab669ecc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:01.532909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76a593fa-938b-4ff5-b3bb-7a02ab669ecc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:01.534066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76a593fa-938b-4ff5-b3bb-7a02ab669ecc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:01.537922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76a593fa-938b-4ff5-b3bb-7a02ab669ecc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:01.540314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76a593fa-938b-4ff5-b3bb-7a02ab669ecc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:01.540968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76a593fa-938b-4ff5-b3bb-7a02ab669ecc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:01.666894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-76a593fa-938b-4ff5-b3bb-7a02ab669ecc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:01.693461 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76a593fa-938b-4ff5-b3bb-7a02ab669ecc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1158 microversion: 2.1 time: 0.175129 Aug 18 11:33:01.712980 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 838/1708] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:01 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1158 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:01.727070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1bb720c7-5640-4a3d-b126-c5f23c10a0da tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519fb880d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:01.819201 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1bb720c7-5640-4a3d-b126-c5f23c10a0da tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c" status: 200 len: 1427 microversion: 2.1 time: 0.104431 Aug 18 11:33:01.828562 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 839/1709] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:01 2022] GET /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:01.835081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-00e1340d-117a-4425-8132-39aa960b0632 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:01.835841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-00e1340d-117a-4425-8132-39aa960b0632 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: e639b060-d272-4d48-8939-20d840f9c5e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:01.861257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00e1340d-117a-4425-8132-39aa960b0632 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:01.861851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00e1340d-117a-4425-8132-39aa960b0632 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:01.862340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00e1340d-117a-4425-8132-39aa960b0632 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:01.863114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00e1340d-117a-4425-8132-39aa960b0632 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:01.863572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00e1340d-117a-4425-8132-39aa960b0632 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:01.864024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00e1340d-117a-4425-8132-39aa960b0632 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:02.465295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-00e1340d-117a-4425-8132-39aa960b0632 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:02.477960 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-00e1340d-117a-4425-8132-39aa960b0632 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4" status: 200 len: 1318 microversion: 2.1 time: 0.647991 Aug 18 11:33:02.482808 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 840/1710] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:01 2022] GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4 => generated 1318 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:02.494308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2a59cc56-6dc8-457c-85e9-97281f46d538 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:02.497938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2a59cc56-6dc8-457c-85e9-97281f46d538 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:02.518345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a59cc56-6dc8-457c-85e9-97281f46d538 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:02.519025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a59cc56-6dc8-457c-85e9-97281f46d538 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:02.519477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a59cc56-6dc8-457c-85e9-97281f46d538 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:02.520210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a59cc56-6dc8-457c-85e9-97281f46d538 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:02.520716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a59cc56-6dc8-457c-85e9-97281f46d538 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:02.521151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a59cc56-6dc8-457c-85e9-97281f46d538 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:02.639001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2a59cc56-6dc8-457c-85e9-97281f46d538 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:02.650105 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2a59cc56-6dc8-457c-85e9-97281f46d538 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6" status: 200 len: 1211 microversion: 2.1 time: 0.165746 Aug 18 11:33:02.651807 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 841/1711] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:02 2022] GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6 => generated 1211 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:02.661827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-75d56da1-a108-4384-bf75-8e5a9f0fa84d tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:02.663407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-75d56da1-a108-4384-bf75-8e5a9f0fa84d tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:02.699122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75d56da1-a108-4384-bf75-8e5a9f0fa84d tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:02.699920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75d56da1-a108-4384-bf75-8e5a9f0fa84d tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:02.704792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75d56da1-a108-4384-bf75-8e5a9f0fa84d tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:02.705845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75d56da1-a108-4384-bf75-8e5a9f0fa84d tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:02.706563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75d56da1-a108-4384-bf75-8e5a9f0fa84d tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:02.707335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75d56da1-a108-4384-bf75-8e5a9f0fa84d tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:02.859609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-75d56da1-a108-4384-bf75-8e5a9f0fa84d tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:02.871566 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-75d56da1-a108-4384-bf75-8e5a9f0fa84d tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1280 microversion: 2.1 time: 0.218160 Aug 18 11:33:02.875629 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 842/1712] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:02 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1280 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:02.895240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-63c9e9e8-5cc6-4c64-a315-78219ca4f865 req-ecba1beb-7119-4272-a8df-c99ecc4ba494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a906b8-26ea-4413-bed0-9c6f7a6be35c", "name": "network-vif-unplugged", "status": "completed", "tag": "6b2318ca-00cc-4182-8517-7647cceb2c66"}, {"server_uuid": "95fda40e-acac-4a4a-8823-1a6aa7d9c359", "name": "network-vif-unplugged", "status": "completed", "tag": "843cde9b-134a-4680-a1a3-1ee63acb156b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:02.917945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-63c9e9e8-5cc6-4c64-a315-78219ca4f865 req-ecba1beb-7119-4272-a8df-c99ecc4ba494 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:02.923298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-63c9e9e8-5cc6-4c64-a315-78219ca4f865 req-ecba1beb-7119-4272-a8df-c99ecc4ba494 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:02.924038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-63c9e9e8-5cc6-4c64-a315-78219ca4f865 req-ecba1beb-7119-4272-a8df-c99ecc4ba494 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:02.945938 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-63c9e9e8-5cc6-4c64-a315-78219ca4f865 req-ecba1beb-7119-4272-a8df-c99ecc4ba494 service nova] Creating event network-vif-unplugged:6b2318ca-00cc-4182-8517-7647cceb2c66 for instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c on n-h1-853611-3 Aug 18 11:33:02.947096 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-63c9e9e8-5cc6-4c64-a315-78219ca4f865 req-ecba1beb-7119-4272-a8df-c99ecc4ba494 service nova] Creating event network-vif-unplugged:843cde9b-134a-4680-a1a3-1ee63acb156b for instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 on n-h1-853611-3 Aug 18 11:33:02.955245 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-63c9e9e8-5cc6-4c64-a315-78219ca4f865 req-ecba1beb-7119-4272-a8df-c99ecc4ba494 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.077956 Aug 18 11:33:02.956248 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 843/1713] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:02.966854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-52978174-71cb-4068-a13a-1641f8920978 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:02.967810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-52978174-71cb-4068-a13a-1641f8920978 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:02.976510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52978174-71cb-4068-a13a-1641f8920978 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:02.977615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52978174-71cb-4068-a13a-1641f8920978 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:02.978299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52978174-71cb-4068-a13a-1641f8920978 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:02.980167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52978174-71cb-4068-a13a-1641f8920978 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:02.981057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52978174-71cb-4068-a13a-1641f8920978 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:02.981743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52978174-71cb-4068-a13a-1641f8920978 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:03.025966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f16981f4-2a3b-422e-8a7d-b77f3656c594 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:03.042246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f16981f4-2a3b-422e-8a7d-b77f3656c594 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:03.049438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f16981f4-2a3b-422e-8a7d-b77f3656c594 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:03.051350 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f16981f4-2a3b-422e-8a7d-b77f3656c594 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1281 microversion: 2.25 time: 1.701937 Aug 18 11:33:03.069748 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 871/1714] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:01 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1281 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:03.077791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4e3a23d2-1a2a-4669-92ce-8c3d64f52761 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:03.078958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4e3a23d2-1a2a-4669-92ce-8c3d64f52761 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:03.091086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e3a23d2-1a2a-4669-92ce-8c3d64f52761 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:03.092232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e3a23d2-1a2a-4669-92ce-8c3d64f52761 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:03.093187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e3a23d2-1a2a-4669-92ce-8c3d64f52761 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:03.094595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e3a23d2-1a2a-4669-92ce-8c3d64f52761 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:03.095598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e3a23d2-1a2a-4669-92ce-8c3d64f52761 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:03.096551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e3a23d2-1a2a-4669-92ce-8c3d64f52761 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:03.322855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4e3a23d2-1a2a-4669-92ce-8c3d64f52761 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:03.335289 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4e3a23d2-1a2a-4669-92ce-8c3d64f52761 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1168 microversion: 2.1 time: 0.264024 Aug 18 11:33:03.346877 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 872/1715] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:03 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1168 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:03.353239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6e009039-c4a0-4d63-8452-deb8c044bf7e tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519fae65e0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:03.406754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-52978174-71cb-4068-a13a-1641f8920978 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:03.418182 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-52978174-71cb-4068-a13a-1641f8920978 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1679 microversion: 2.1 time: 0.460269 Aug 18 11:33:03.432486 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 844/1716] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:02 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1679 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:03.437763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d71a7329-05f7-4e40-abf1-a6af11e85965 req-dc275170-39c7-4776-a470-5384586b10bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95fda40e-acac-4a4a-8823-1a6aa7d9c359", "name": "network-vif-deleted", "tag": "843cde9b-134a-4680-a1a3-1ee63acb156b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:03.481203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d71a7329-05f7-4e40-abf1-a6af11e85965 req-dc275170-39c7-4776-a470-5384586b10bb service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:03.482451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d71a7329-05f7-4e40-abf1-a6af11e85965 req-dc275170-39c7-4776-a470-5384586b10bb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:03.483119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d71a7329-05f7-4e40-abf1-a6af11e85965 req-dc275170-39c7-4776-a470-5384586b10bb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:03.499124 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d71a7329-05f7-4e40-abf1-a6af11e85965 req-dc275170-39c7-4776-a470-5384586b10bb service nova] Creating event network-vif-deleted:843cde9b-134a-4680-a1a3-1ee63acb156b for instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 on n-h1-853611-3 Aug 18 11:33:03.526053 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d71a7329-05f7-4e40-abf1-a6af11e85965 req-dc275170-39c7-4776-a470-5384586b10bb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091865 Aug 18 11:33:03.527360 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 845/1717] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:03.544842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b60a6c49-1e7b-416c-819c-255c5c562045 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:03.548634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b60a6c49-1e7b-416c-819c-255c5c562045 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: e639b060-d272-4d48-8939-20d840f9c5e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:03.561366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b60a6c49-1e7b-416c-819c-255c5c562045 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:03.562255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b60a6c49-1e7b-416c-819c-255c5c562045 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:03.563059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b60a6c49-1e7b-416c-819c-255c5c562045 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:03.564037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b60a6c49-1e7b-416c-819c-255c5c562045 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:03.564906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b60a6c49-1e7b-416c-819c-255c5c562045 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:03.567566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b60a6c49-1e7b-416c-819c-255c5c562045 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:03.604027 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6e009039-c4a0-4d63-8452-deb8c044bf7e tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c" status: 200 len: 1427 microversion: 2.1 time: 0.260986 Aug 18 11:33:03.604742 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 873/1718] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:03 2022] GET /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c => generated 1427 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:03.676887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-02ff9310-f7a6-4603-8cc7-e955f3a0f9cd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:03.677512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-02ff9310-f7a6-4603-8cc7-e955f3a0f9cd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:03.713722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02ff9310-f7a6-4603-8cc7-e955f3a0f9cd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:03.732469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02ff9310-f7a6-4603-8cc7-e955f3a0f9cd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:03.732469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02ff9310-f7a6-4603-8cc7-e955f3a0f9cd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:03.732820 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02ff9310-f7a6-4603-8cc7-e955f3a0f9cd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:03.733506 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02ff9310-f7a6-4603-8cc7-e955f3a0f9cd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:03.734123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02ff9310-f7a6-4603-8cc7-e955f3a0f9cd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:04.016849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b60a6c49-1e7b-416c-819c-255c5c562045 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:04.033263 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b60a6c49-1e7b-416c-819c-255c5c562045 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4" status: 200 len: 1508 microversion: 2.1 time: 0.504312 Aug 18 11:33:04.037340 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 846/1719] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:03 2022] GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4 => generated 1508 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:04.058589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-222b270e-87b7-409a-9fa1-100ebaf12214 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:04.060724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-222b270e-87b7-409a-9fa1-100ebaf12214 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:04.089475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-222b270e-87b7-409a-9fa1-100ebaf12214 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:04.091051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-222b270e-87b7-409a-9fa1-100ebaf12214 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:04.091787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-222b270e-87b7-409a-9fa1-100ebaf12214 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:04.093676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-222b270e-87b7-409a-9fa1-100ebaf12214 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:04.094379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-222b270e-87b7-409a-9fa1-100ebaf12214 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:04.094978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-222b270e-87b7-409a-9fa1-100ebaf12214 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:04.169465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-02ff9310-f7a6-4603-8cc7-e955f3a0f9cd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:04.185100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:04.189415 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-02ff9310-f7a6-4603-8cc7-e955f3a0f9cd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6" status: 200 len: 1203 microversion: 2.1 time: 0.517859 Aug 18 11:33:04.198917 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 874/1720] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:03 2022] GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6 => generated 1203 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:33:04.209357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a909f179-44a6-4210-b04c-7f50fa0aa2cb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:04.218590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a909f179-44a6-4210-b04c-7f50fa0aa2cb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:04.241667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a909f179-44a6-4210-b04c-7f50fa0aa2cb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:04.242649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a909f179-44a6-4210-b04c-7f50fa0aa2cb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:04.243597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a909f179-44a6-4210-b04c-7f50fa0aa2cb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:04.244678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a909f179-44a6-4210-b04c-7f50fa0aa2cb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:04.245480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a909f179-44a6-4210-b04c-7f50fa0aa2cb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:04.246171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a909f179-44a6-4210-b04c-7f50fa0aa2cb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:04.331660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-222b270e-87b7-409a-9fa1-100ebaf12214 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:04.356785 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-222b270e-87b7-409a-9fa1-100ebaf12214 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1280 microversion: 2.1 time: 0.316767 Aug 18 11:33:04.357653 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 847/1721] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:04 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1280 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:04.397338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3ff87798-8978-4ced-80fb-8716ba845aec tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:04.398184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3ff87798-8978-4ced-80fb-8716ba845aec tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:04.419455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ff87798-8978-4ced-80fb-8716ba845aec tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:04.420225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ff87798-8978-4ced-80fb-8716ba845aec tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:04.420832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ff87798-8978-4ced-80fb-8716ba845aec tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:04.421777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ff87798-8978-4ced-80fb-8716ba845aec tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:04.422256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ff87798-8978-4ced-80fb-8716ba845aec tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:04.422755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ff87798-8978-4ced-80fb-8716ba845aec tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:04.594026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3ff87798-8978-4ced-80fb-8716ba845aec tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:04.604778 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3ff87798-8978-4ced-80fb-8716ba845aec tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1168 microversion: 2.1 time: 0.227267 Aug 18 11:33:04.623460 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 848/1722] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:04 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1168 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:04.637490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-19c6cfac-afec-4821-82d1-ae82e5217750 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:04.638220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-19c6cfac-afec-4821-82d1-ae82e5217750 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:04.656459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19c6cfac-afec-4821-82d1-ae82e5217750 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:04.662619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19c6cfac-afec-4821-82d1-ae82e5217750 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:04.662619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19c6cfac-afec-4821-82d1-ae82e5217750 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:04.662619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19c6cfac-afec-4821-82d1-ae82e5217750 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:04.663767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19c6cfac-afec-4821-82d1-ae82e5217750 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:04.664133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19c6cfac-afec-4821-82d1-ae82e5217750 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:04.708472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:04.998738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-19c6cfac-afec-4821-82d1-ae82e5217750 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:05.011811 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-19c6cfac-afec-4821-82d1-ae82e5217750 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1687 microversion: 2.1 time: 0.387002 Aug 18 11:33:05.029733 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 849/1723] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:04 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1687 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:05.029733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d9fe0cc0-0522-4306-b0e0-46e427c590df tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519f822f70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:05.113617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a909f179-44a6-4210-b04c-7f50fa0aa2cb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:05.120230 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d9fe0cc0-0522-4306-b0e0-46e427c590df tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c" status: 200 len: 1427 microversion: 2.1 time: 0.105943 Aug 18 11:33:05.125538 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a909f179-44a6-4210-b04c-7f50fa0aa2cb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:05.126606 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 850/1724] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:05 2022] GET /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c => generated 1427 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:05.127089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a909f179-44a6-4210-b04c-7f50fa0aa2cb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:05.129003 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a909f179-44a6-4210-b04c-7f50fa0aa2cb tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1477 microversion: 2.25 time: 0.924952 Aug 18 11:33:05.154229 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 875/1725] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:04 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1477 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:05.154556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-474c2376-04bd-4f14-ab0c-20032cb807d4 req-a0494d03-3f03-4c3c-af28-c18d95b8367c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6c996b-c6b0-4f55-97ed-b4b472dc3640", "name": "network-vif-plugged", "status": "completed", "tag": "ffdd209f-cefa-48ce-8e0f-9845986fb9ef"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:05.200130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-474c2376-04bd-4f14-ab0c-20032cb807d4 req-a0494d03-3f03-4c3c-af28-c18d95b8367c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:05.200641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-474c2376-04bd-4f14-ab0c-20032cb807d4 req-a0494d03-3f03-4c3c-af28-c18d95b8367c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:05.203565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-474c2376-04bd-4f14-ab0c-20032cb807d4 req-a0494d03-3f03-4c3c-af28-c18d95b8367c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:05.244238 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-474c2376-04bd-4f14-ab0c-20032cb807d4 req-a0494d03-3f03-4c3c-af28-c18d95b8367c service nova] Creating event network-vif-plugged:ffdd209f-cefa-48ce-8e0f-9845986fb9ef for instance 6c6c996b-c6b0-4f55-97ed-b4b472dc3640 on n-h2-853611-3 Aug 18 11:33:05.260864 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-474c2376-04bd-4f14-ab0c-20032cb807d4 req-a0494d03-3f03-4c3c-af28-c18d95b8367c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127341 Aug 18 11:33:05.267494 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 851/1726] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:05.284932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c7b680cf-1018-4a12-b7f6-2585b8c672e2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:05.286714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c7b680cf-1018-4a12-b7f6-2585b8c672e2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:05.306400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7b680cf-1018-4a12-b7f6-2585b8c672e2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:05.306716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7b680cf-1018-4a12-b7f6-2585b8c672e2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:05.308419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7b680cf-1018-4a12-b7f6-2585b8c672e2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:05.312430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7b680cf-1018-4a12-b7f6-2585b8c672e2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:05.313822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7b680cf-1018-4a12-b7f6-2585b8c672e2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:05.317287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7b680cf-1018-4a12-b7f6-2585b8c672e2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:05.609374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f2d64f7e-612d-4133-a7c7-adae4c1081c9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:05.613351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f2d64f7e-612d-4133-a7c7-adae4c1081c9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:05.639557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2d64f7e-612d-4133-a7c7-adae4c1081c9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:05.640033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2d64f7e-612d-4133-a7c7-adae4c1081c9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:05.648423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2d64f7e-612d-4133-a7c7-adae4c1081c9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:05.649250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2d64f7e-612d-4133-a7c7-adae4c1081c9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:05.651091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2d64f7e-612d-4133-a7c7-adae4c1081c9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:05.653541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2d64f7e-612d-4133-a7c7-adae4c1081c9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:05.657256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c7b680cf-1018-4a12-b7f6-2585b8c672e2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:05.673581 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c7b680cf-1018-4a12-b7f6-2585b8c672e2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6" status: 200 len: 1265 microversion: 2.1 time: 0.399064 Aug 18 11:33:05.681465 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 852/1727] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:05 2022] GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6 => generated 1265 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:05.699426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8377644-1bbc-46f2-9c91-a430692e3d8b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:05.702359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f8377644-1bbc-46f2-9c91-a430692e3d8b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:05.725647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8377644-1bbc-46f2-9c91-a430692e3d8b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:05.739018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8377644-1bbc-46f2-9c91-a430692e3d8b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:05.741996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8377644-1bbc-46f2-9c91-a430692e3d8b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:05.745448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8377644-1bbc-46f2-9c91-a430692e3d8b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:05.747754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8377644-1bbc-46f2-9c91-a430692e3d8b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:05.749316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8377644-1bbc-46f2-9c91-a430692e3d8b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:06.402822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-f2d64f7e-612d-4133-a7c7-adae4c1081c9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 19d34316-2cf9-44a6-a370-673959e72cb3 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:33:06.436964 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f2d64f7e-612d-4133-a7c7-adae4c1081c9 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1970 microversion: 2.25 time: 1.264445 Aug 18 11:33:06.438064 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 876/1728] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:05 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1970 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:33:06.450638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-60f80e5f-6df7-48b5-a72b-f55a06afb6ed tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:06.451949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-60f80e5f-6df7-48b5-a72b-f55a06afb6ed tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:06.466150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60f80e5f-6df7-48b5-a72b-f55a06afb6ed tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:06.468326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60f80e5f-6df7-48b5-a72b-f55a06afb6ed tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:06.470779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60f80e5f-6df7-48b5-a72b-f55a06afb6ed tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:06.474160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60f80e5f-6df7-48b5-a72b-f55a06afb6ed tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:06.474703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60f80e5f-6df7-48b5-a72b-f55a06afb6ed tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:06.476317 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60f80e5f-6df7-48b5-a72b-f55a06afb6ed tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:06.630124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f8377644-1bbc-46f2-9c91-a430692e3d8b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:06.662675 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8377644-1bbc-46f2-9c91-a430692e3d8b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1322 microversion: 2.1 time: 0.979741 Aug 18 11:33:06.664361 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 853/1729] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:05 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1322 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:06.673997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-85b85ca0-a53a-4dc2-8010-65a79f0fe497 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:06.694337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-85b85ca0-a53a-4dc2-8010-65a79f0fe497 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:06.719787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-60f80e5f-6df7-48b5-a72b-f55a06afb6ed tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:06.732020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85b85ca0-a53a-4dc2-8010-65a79f0fe497 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:06.732535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85b85ca0-a53a-4dc2-8010-65a79f0fe497 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:06.732984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85b85ca0-a53a-4dc2-8010-65a79f0fe497 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:06.733715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85b85ca0-a53a-4dc2-8010-65a79f0fe497 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:06.734172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85b85ca0-a53a-4dc2-8010-65a79f0fe497 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:06.734632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85b85ca0-a53a-4dc2-8010-65a79f0fe497 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:06.740311 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-60f80e5f-6df7-48b5-a72b-f55a06afb6ed tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1168 microversion: 2.1 time: 0.296253 Aug 18 11:33:06.758473 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 877/1730] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:06 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1168 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:06.766417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-395a82f5-ef1c-43b8-b125-2a5d6b390627 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519f7128b0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:07.388278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-85b85ca0-a53a-4dc2-8010-65a79f0fe497 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:07.401393 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-85b85ca0-a53a-4dc2-8010-65a79f0fe497 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1682 microversion: 2.1 time: 0.735773 Aug 18 11:33:07.403638 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 854/1731] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:06 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1682 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:07.412251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eaabb179-b167-41ba-9f9b-7cf97084a038 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:07.412880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eaabb179-b167-41ba-9f9b-7cf97084a038 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:07.434628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:07.446195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eaabb179-b167-41ba-9f9b-7cf97084a038 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:07.446867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eaabb179-b167-41ba-9f9b-7cf97084a038 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:07.447136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eaabb179-b167-41ba-9f9b-7cf97084a038 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:07.456955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eaabb179-b167-41ba-9f9b-7cf97084a038 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:07.473216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eaabb179-b167-41ba-9f9b-7cf97084a038 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:07.474296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eaabb179-b167-41ba-9f9b-7cf97084a038 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:08.448632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:08.672906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-eaabb179-b167-41ba-9f9b-7cf97084a038 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 19d34316-2cf9-44a6-a370-673959e72cb3 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:33:08.765921 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eaabb179-b167-41ba-9f9b-7cf97084a038 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1970 microversion: 2.25 time: 1.356931 Aug 18 11:33:08.791114 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 855/1732] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:07 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1970 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:08.809651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0fea8222-5fd8-4604-8820-4d1e41d7479f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:08.810400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0fea8222-5fd8-4604-8820-4d1e41d7479f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:08.870246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fea8222-5fd8-4604-8820-4d1e41d7479f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:08.870918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fea8222-5fd8-4604-8820-4d1e41d7479f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:08.871393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fea8222-5fd8-4604-8820-4d1e41d7479f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:08.886417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fea8222-5fd8-4604-8820-4d1e41d7479f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:08.891286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fea8222-5fd8-4604-8820-4d1e41d7479f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:08.894999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fea8222-5fd8-4604-8820-4d1e41d7479f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:09.444538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0fea8222-5fd8-4604-8820-4d1e41d7479f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:09.458384 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0fea8222-5fd8-4604-8820-4d1e41d7479f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6" status: 200 len: 1307 microversion: 2.1 time: 0.666016 Aug 18 11:33:09.470619 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 856/1733] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:08 2022] GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6 => generated 1307 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:09.529115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2b177ddb-13bf-45dc-b759-e68bccb59662 req-2f92a2cc-bf53-4c41-bac8-23de6c897df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a906b8-26ea-4413-bed0-9c6f7a6be35c", "name": "network-vif-plugged", "status": "completed", "tag": "6b2318ca-00cc-4182-8517-7647cceb2c66"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:09.587852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2b177ddb-13bf-45dc-b759-e68bccb59662 req-2f92a2cc-bf53-4c41-bac8-23de6c897df2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:09.592781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2b177ddb-13bf-45dc-b759-e68bccb59662 req-2f92a2cc-bf53-4c41-bac8-23de6c897df2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:09.598292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2b177ddb-13bf-45dc-b759-e68bccb59662 req-2f92a2cc-bf53-4c41-bac8-23de6c897df2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:09.642066 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2b177ddb-13bf-45dc-b759-e68bccb59662 req-2f92a2cc-bf53-4c41-bac8-23de6c897df2 service nova] Creating event network-vif-plugged:6b2318ca-00cc-4182-8517-7647cceb2c66 for instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c on n-h1-853611-3 Aug 18 11:33:09.650803 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2b177ddb-13bf-45dc-b759-e68bccb59662 req-2f92a2cc-bf53-4c41-bac8-23de6c897df2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175687 Aug 18 11:33:09.653858 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 857/1734] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:09.677868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b6262fb-5aa8-4f2a-a12c-e2d924288636 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:09.688056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8b6262fb-5aa8-4f2a-a12c-e2d924288636 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:09.721236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b6262fb-5aa8-4f2a-a12c-e2d924288636 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:09.722347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b6262fb-5aa8-4f2a-a12c-e2d924288636 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:09.723049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b6262fb-5aa8-4f2a-a12c-e2d924288636 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:09.723785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b6262fb-5aa8-4f2a-a12c-e2d924288636 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:09.724250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b6262fb-5aa8-4f2a-a12c-e2d924288636 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:09.724753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b6262fb-5aa8-4f2a-a12c-e2d924288636 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:10.398822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8b6262fb-5aa8-4f2a-a12c-e2d924288636 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:10.409757 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8b6262fb-5aa8-4f2a-a12c-e2d924288636 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1322 microversion: 2.1 time: 0.754163 Aug 18 11:33:10.436961 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 858/1735] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:09 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1322 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:10.448877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-457a317f-d691-4bba-8c64-b9c327993d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:10.462150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-457a317f-d691-4bba-8c64-b9c327993d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:10.489324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-457a317f-d691-4bba-8c64-b9c327993d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:10.499940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-457a317f-d691-4bba-8c64-b9c327993d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:10.502086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-457a317f-d691-4bba-8c64-b9c327993d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:10.505434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-457a317f-d691-4bba-8c64-b9c327993d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:10.515174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-457a317f-d691-4bba-8c64-b9c327993d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:10.516724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-457a317f-d691-4bba-8c64-b9c327993d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:11.038969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-457a317f-d691-4bba-8c64-b9c327993d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:11.059894 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-457a317f-d691-4bba-8c64-b9c327993d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1210 microversion: 2.1 time: 0.620502 Aug 18 11:33:11.079405 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 859/1736] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:10 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1210 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:11.120098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-985467b1-5236-4025-9941-2c7cd67c2e2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:11.122609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-985467b1-5236-4025-9941-2c7cd67c2e2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:11.146667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-985467b1-5236-4025-9941-2c7cd67c2e2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:11.156622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-985467b1-5236-4025-9941-2c7cd67c2e2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:11.160578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-985467b1-5236-4025-9941-2c7cd67c2e2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:11.163338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-985467b1-5236-4025-9941-2c7cd67c2e2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:11.166369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-985467b1-5236-4025-9941-2c7cd67c2e2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:11.177519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-985467b1-5236-4025-9941-2c7cd67c2e2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:11.357879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:11.373409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=20 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:11.567503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-985467b1-5236-4025-9941-2c7cd67c2e2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:11.576506 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-985467b1-5236-4025-9941-2c7cd67c2e2c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1682 microversion: 2.1 time: 0.495567 Aug 18 11:33:11.579415 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 860/1737] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:11 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1682 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:11.589684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6e5abbc9-b28f-4410-94af-f5d126f219a2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:11.597249 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:33:11.597249 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:33:11.600478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e5abbc9-b28f-4410-94af-f5d126f219a2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:11.603617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e5abbc9-b28f-4410-94af-f5d126f219a2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:11.604674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e5abbc9-b28f-4410-94af-f5d126f219a2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:11.607596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e5abbc9-b28f-4410-94af-f5d126f219a2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:11.610070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e5abbc9-b28f-4410-94af-f5d126f219a2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:11.612797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e5abbc9-b28f-4410-94af-f5d126f219a2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:11.694669 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6e5abbc9-b28f-4410-94af-f5d126f219a2 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.108326 Aug 18 11:33:11.698910 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 861/1738] 10.222.0.73 () {60 vars in 1217 bytes} [Thu Aug 18 11:33:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:33:11.711401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-03fc33b9-b1ea-44e8-b8e1-456ebe1054d0 req-5a34d50f-2706-406f-9fdd-5e3f4e749307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a25b73-ea72-405a-b127-add6779c63d6", "tag": "e08c585a-7b0e-4a25-afaf-7bbad84d469a"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:11.745835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-03fc33b9-b1ea-44e8-b8e1-456ebe1054d0 req-5a34d50f-2706-406f-9fdd-5e3f4e749307 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:11.746897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-03fc33b9-b1ea-44e8-b8e1-456ebe1054d0 req-5a34d50f-2706-406f-9fdd-5e3f4e749307 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:11.749269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-03fc33b9-b1ea-44e8-b8e1-456ebe1054d0 req-5a34d50f-2706-406f-9fdd-5e3f4e749307 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:11.774887 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-03fc33b9-b1ea-44e8-b8e1-456ebe1054d0 req-5a34d50f-2706-406f-9fdd-5e3f4e749307 service nova] Creating event network-changed:e08c585a-7b0e-4a25-afaf-7bbad84d469a for instance e2a25b73-ea72-405a-b127-add6779c63d6 on n-h1-853611-3 Aug 18 11:33:11.783562 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-03fc33b9-b1ea-44e8-b8e1-456ebe1054d0 req-5a34d50f-2706-406f-9fdd-5e3f4e749307 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082916 Aug 18 11:33:11.796419 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 862/1739] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:11.820611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02900415-3da6-4f6d-9b2e-c25a5e08b706 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:11.823461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-02900415-3da6-4f6d-9b2e-c25a5e08b706 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:11.856726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02900415-3da6-4f6d-9b2e-c25a5e08b706 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:11.867290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02900415-3da6-4f6d-9b2e-c25a5e08b706 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:11.867751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02900415-3da6-4f6d-9b2e-c25a5e08b706 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:11.868514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02900415-3da6-4f6d-9b2e-c25a5e08b706 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:11.868978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02900415-3da6-4f6d-9b2e-c25a5e08b706 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:11.869413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02900415-3da6-4f6d-9b2e-c25a5e08b706 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:12.304057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-02900415-3da6-4f6d-9b2e-c25a5e08b706 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:12.315598 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-02900415-3da6-4f6d-9b2e-c25a5e08b706 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6" status: 200 len: 1307 microversion: 2.1 time: 0.510071 Aug 18 11:33:12.325461 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 863/1740] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:11 2022] GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6 => generated 1307 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:12.341958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f1b0ac00-c3f7-4b69-a4f4-f79d4bcedd4c req-d56716cc-51dd-4e1d-ab7f-3277ff2a9ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc571952-f3e6-43fc-984c-85c632fa12ca", "tag": "d13c51ee-6c0f-4546-bde0-dc5d63e83f9d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:12.431353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f1b0ac00-c3f7-4b69-a4f4-f79d4bcedd4c req-d56716cc-51dd-4e1d-ab7f-3277ff2a9ab6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:12.432016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f1b0ac00-c3f7-4b69-a4f4-f79d4bcedd4c req-d56716cc-51dd-4e1d-ab7f-3277ff2a9ab6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:12.432563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f1b0ac00-c3f7-4b69-a4f4-f79d4bcedd4c req-d56716cc-51dd-4e1d-ab7f-3277ff2a9ab6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:12.471292 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f1b0ac00-c3f7-4b69-a4f4-f79d4bcedd4c req-d56716cc-51dd-4e1d-ab7f-3277ff2a9ab6 service nova] Creating event network-changed:d13c51ee-6c0f-4546-bde0-dc5d63e83f9d for instance dc571952-f3e6-43fc-984c-85c632fa12ca on n-h2-853611-3 Aug 18 11:33:12.482512 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f1b0ac00-c3f7-4b69-a4f4-f79d4bcedd4c req-d56716cc-51dd-4e1d-ab7f-3277ff2a9ab6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150692 Aug 18 11:33:12.483425 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 864/1741] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:12.501213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-64c1bedb-5e41-4ce4-9162-0747b5e619dc tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:12.502461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-64c1bedb-5e41-4ce4-9162-0747b5e619dc tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:12.519235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64c1bedb-5e41-4ce4-9162-0747b5e619dc tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:12.520043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64c1bedb-5e41-4ce4-9162-0747b5e619dc tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:12.520664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64c1bedb-5e41-4ce4-9162-0747b5e619dc tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:12.521604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64c1bedb-5e41-4ce4-9162-0747b5e619dc tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:12.522246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64c1bedb-5e41-4ce4-9162-0747b5e619dc tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:12.522872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64c1bedb-5e41-4ce4-9162-0747b5e619dc tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:13.678333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-64c1bedb-5e41-4ce4-9162-0747b5e619dc tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:13.717736 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-64c1bedb-5e41-4ce4-9162-0747b5e619dc tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1322 microversion: 2.1 time: 1.219368 Aug 18 11:33:13.717736 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 865/1742] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:12 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1322 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:13.717736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-260159ff-ccc7-4f5c-8c9c-026f25f9c9e5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-853611-3", "block_migration": "auto"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:13.738573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-260159ff-ccc7-4f5c-8c9c-026f25f9c9e5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:13.756039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-260159ff-ccc7-4f5c-8c9c-026f25f9c9e5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:13.770583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-260159ff-ccc7-4f5c-8c9c-026f25f9c9e5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:13.771294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-260159ff-ccc7-4f5c-8c9c-026f25f9c9e5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:13.772149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-260159ff-ccc7-4f5c-8c9c-026f25f9c9e5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:13.772628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-260159ff-ccc7-4f5c-8c9c-026f25f9c9e5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:13.779792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-260159ff-ccc7-4f5c-8c9c-026f25f9c9e5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:13.844852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-260159ff-ccc7-4f5c-8c9c-026f25f9c9e5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'flavor' on Instance uuid 19d34316-2cf9-44a6-a370-673959e72cb3 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:33:13.874149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-260159ff-ccc7-4f5c-8c9c-026f25f9c9e5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Going to try to live migrate instance to n-h2-853611-3 {{(pid=122210) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 18 11:33:16.457758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:16.553848 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:33:16.554928 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 11:33:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3/action (ip 10.222.0.73) !!! Aug 18 11:33:16.730463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=20 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:18.251199 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-260159ff-ccc7-4f5c-8c9c-026f25f9c9e5 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3/action" status: 202 len: 0 microversion: 2.25 time: 4.537488 Aug 18 11:33:18.253456 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 866/1743] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 18 11:33:13 2022] POST /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3/action => generated 0 bytes in 4543 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:33:18.258897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4d892de9-825f-48d1-bfc3-5c65f4cef16f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:18.259819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4d892de9-825f-48d1-bfc3-5c65f4cef16f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:18.340280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d892de9-825f-48d1-bfc3-5c65f4cef16f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:18.353473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d892de9-825f-48d1-bfc3-5c65f4cef16f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:18.358010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d892de9-825f-48d1-bfc3-5c65f4cef16f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:18.363772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d892de9-825f-48d1-bfc3-5c65f4cef16f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:18.370966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d892de9-825f-48d1-bfc3-5c65f4cef16f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:18.372519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d892de9-825f-48d1-bfc3-5c65f4cef16f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:18.692640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4d892de9-825f-48d1-bfc3-5c65f4cef16f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:18.713707 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4d892de9-825f-48d1-bfc3-5c65f4cef16f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1210 microversion: 2.1 time: 0.454974 Aug 18 11:33:18.722887 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 867/1744] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:18 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1210 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:18.729659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c188889d-9740-4d3d-ad2f-063c66a80963 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:18.730283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c188889d-9740-4d3d-ad2f-063c66a80963 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:18.738976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c188889d-9740-4d3d-ad2f-063c66a80963 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:18.738976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c188889d-9740-4d3d-ad2f-063c66a80963 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:18.738976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c188889d-9740-4d3d-ad2f-063c66a80963 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:18.738976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c188889d-9740-4d3d-ad2f-063c66a80963 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:18.739572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c188889d-9740-4d3d-ad2f-063c66a80963 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:18.739700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c188889d-9740-4d3d-ad2f-063c66a80963 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:18.764097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:18.943292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c188889d-9740-4d3d-ad2f-063c66a80963 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:18.957176 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c188889d-9740-4d3d-ad2f-063c66a80963 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1682 microversion: 2.1 time: 0.232757 Aug 18 11:33:18.979104 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 868/1745] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:18 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:18.996915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f59efd83-5749-4d37-b4d0-e8310c748aee tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e63058c0-ef7e-40a2-a38e-843edaea8f4d"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:18.999563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f59efd83-5749-4d37-b4d0-e8310c748aee tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] [instance: e639b060-d272-4d48-8939-20d840f9c5e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:19.036066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f59efd83-5749-4d37-b4d0-e8310c748aee tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:19.036636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f59efd83-5749-4d37-b4d0-e8310c748aee tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:19.037095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f59efd83-5749-4d37-b4d0-e8310c748aee tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:19.037865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f59efd83-5749-4d37-b4d0-e8310c748aee tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:19.038333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f59efd83-5749-4d37-b4d0-e8310c748aee tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:19.038794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f59efd83-5749-4d37-b4d0-e8310c748aee tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:19.243786 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-f59efd83-5749-4d37-b4d0-e8310c748aee tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] HTTP exception thrown: Volume 9fc66e57-0df0-4fdc-b4c3-240380969935 could not be found. Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f59efd83-5749-4d37-b4d0-e8310c748aee tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Request method failure captured: Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: request: PUT /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4/os-volume_attachments/9fc66e57-0df0-4fdc-b4c3-240380969935 HTTP/1.1 Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 74 Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iLnsbuUgzjUzwv2PPU7ZJsCNWM2ODYg4iTR4NP-oZWlL2GNfL5NvxPk7Cz8GK6TRynKX7QGHFBXUl0abyfNPt_M2XNEdYAcjWOqTfR29xLu9g1v0K9vwhgQv2v1Y_xQJYPt05abiyOzcHYuegnHzMDLuuDGXv5O3B7cy8CnBtZMv88 Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ad2953d699e9488fba834b56a4a8308f Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-VolumesAdminNegativeTest-1784515100 Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 11:33:19.248149 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 11:33:19.249844 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ad2953d699e9488fba834b56a4a8308f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ad2953d699e9488fba834b56a4a8308f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ad2953d699e9488fba834b56a4a8308f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ad2953d699e9488fba834b56a4a8308f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:19.249844 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-VolumesAdminNegativeTest-1784515100 Aug 18 11:33:19.249844 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ad2953d699e9488fba834b56a4a8308f Aug 18 11:33:19.249844 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1784515100 Aug 18 11:33:19.249844 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-VolumesAdminNegativeTest-1784515100-project-admin Aug 18 11:33:19.249844 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:33:19.249844 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:33:19.249844 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 1abec3a9a8bc48fbb0e128074284f405 Aug 18 11:33:19.249844 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-VolumesAdminNegativeTest-1784515100-project-admin Aug 18 11:33:19.249844 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:33:19.249844 n-d-853611-3 devstack@n-api.service[122210]: {"volumeAttachment": {"volumeId": "e63058c0-ef7e-40a2-a38e-843edaea8f4d"}} Aug 18 11:33:19.249844 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:33:19.249844 n-d-853611-3 devstack@n-api.service[122210]: exception: Volume 9fc66e57-0df0-4fdc-b4c3-240380969935 could not be found. Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': 'e639b060-d272-4d48-8939-20d840f9c5e4', 'id': '9fc66e57-0df0-4fdc-b4c3-240380969935', 'body': {'volumeAttachment': {'volumeId': 'e63058c0-ef7e-40a2-a38e-843edaea8f4d'}}} Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:33:19.250866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9fc66e57-0df0-4fdc-b4c3-240380969935 could not be found. (HTTP 404) (Request-ID: req-24490cbb-275e-4972-97a0-a30bf2eb332b) Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:33:19.253100 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9fc66e57-0df0-4fdc-b4c3-240380969935 could not be found. Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:19.257249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9fc66e57-0df0-4fdc-b4c3-240380969935 could not be found. Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9fc66e57-0df0-4fdc-b4c3-240380969935 could not be found. Aug 18 11:33:19.260204 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:19.264826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f59efd83-5749-4d37-b4d0-e8310c748aee tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] Returning 404 to user: Volume 9fc66e57-0df0-4fdc-b4c3-240380969935 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:19.264826 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f59efd83-5749-4d37-b4d0-e8310c748aee tempest-VolumesAdminNegativeTest-1784515100 tempest-VolumesAdminNegativeTest-1784515100-project-admin] 10.222.0.73 "PUT /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4/os-volume_attachments/9fc66e57-0df0-4fdc-b4c3-240380969935" status: 404 len: 109 microversion: 2.1 time: 0.268915 Aug 18 11:33:19.264826 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 869/1746] 10.222.0.73 () {60 vars in 1433 bytes} [Thu Aug 18 11:33:18 2022] PUT /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4/os-volume_attachments/9fc66e57-0df0-4fdc-b4c3-240380969935 => generated 109 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:33:19.265633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-51e7ba9b-222c-4c0d-8fed-6aea7d46ed0f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:19.266119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-51e7ba9b-222c-4c0d-8fed-6aea7d46ed0f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:19.280872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51e7ba9b-222c-4c0d-8fed-6aea7d46ed0f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:19.281368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51e7ba9b-222c-4c0d-8fed-6aea7d46ed0f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:19.281804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51e7ba9b-222c-4c0d-8fed-6aea7d46ed0f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:19.282542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51e7ba9b-222c-4c0d-8fed-6aea7d46ed0f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:19.284237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51e7ba9b-222c-4c0d-8fed-6aea7d46ed0f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:19.284515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51e7ba9b-222c-4c0d-8fed-6aea7d46ed0f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:19.553447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-51e7ba9b-222c-4c0d-8fed-6aea7d46ed0f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:19.577080 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-51e7ba9b-222c-4c0d-8fed-6aea7d46ed0f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6" status: 200 len: 1307 microversion: 2.1 time: 0.324257 Aug 18 11:33:19.597226 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 870/1747] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:19 2022] GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6 => generated 1307 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:19.602246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b81584f5-1218-43aa-bd7b-c142ed4fa765 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:19.602246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b81584f5-1218-43aa-bd7b-c142ed4fa765 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:19.627421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b81584f5-1218-43aa-bd7b-c142ed4fa765 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:19.627994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b81584f5-1218-43aa-bd7b-c142ed4fa765 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:19.628361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b81584f5-1218-43aa-bd7b-c142ed4fa765 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:19.637605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b81584f5-1218-43aa-bd7b-c142ed4fa765 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:19.647388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b81584f5-1218-43aa-bd7b-c142ed4fa765 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:19.648182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b81584f5-1218-43aa-bd7b-c142ed4fa765 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:19.750457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b81584f5-1218-43aa-bd7b-c142ed4fa765 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:33:20.057812 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b81584f5-1218-43aa-bd7b-c142ed4fa765 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 204 len: 0 microversion: 2.1 time: 0.460038 Aug 18 11:33:20.062574 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 871/1748] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:33:19 2022] DELETE /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:33:20.070078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fd20cbf1-acc1-4bbd-90d6-f70eecd4e6d1 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:20.080990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fd20cbf1-acc1-4bbd-90d6-f70eecd4e6d1 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:20.092019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd20cbf1-acc1-4bbd-90d6-f70eecd4e6d1 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:20.092903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd20cbf1-acc1-4bbd-90d6-f70eecd4e6d1 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:20.094036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd20cbf1-acc1-4bbd-90d6-f70eecd4e6d1 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:20.104767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd20cbf1-acc1-4bbd-90d6-f70eecd4e6d1 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:20.105777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd20cbf1-acc1-4bbd-90d6-f70eecd4e6d1 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:20.106530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd20cbf1-acc1-4bbd-90d6-f70eecd4e6d1 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:20.520364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fd20cbf1-acc1-4bbd-90d6-f70eecd4e6d1 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:20.529777 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fd20cbf1-acc1-4bbd-90d6-f70eecd4e6d1 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1322 microversion: 2.1 time: 0.464528 Aug 18 11:33:20.571268 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 872/1749] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:20 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:20.584152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8d724b6d-a6e3-4c69-93af-2de08ad02b28 req-5128faeb-57aa-42b3-9427-3bb2bd89c500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d278c6fc-34a1-4830-9e81-d644ff49e10d", "tag": "55065be2-4f0e-4654-a40b-a54830d4acf4"}, {"name": "network-changed", "server_uuid": "2979b2d3-3055-479e-ad21-b8aac94ee848", "tag": "7b97022c-78ee-42c8-b0d9-ab1df08cddb4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:20.629994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8d724b6d-a6e3-4c69-93af-2de08ad02b28 req-5128faeb-57aa-42b3-9427-3bb2bd89c500 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:20.634193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8d724b6d-a6e3-4c69-93af-2de08ad02b28 req-5128faeb-57aa-42b3-9427-3bb2bd89c500 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:20.634879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8d724b6d-a6e3-4c69-93af-2de08ad02b28 req-5128faeb-57aa-42b3-9427-3bb2bd89c500 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:20.696203 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8d724b6d-a6e3-4c69-93af-2de08ad02b28 req-5128faeb-57aa-42b3-9427-3bb2bd89c500 service nova] Creating event network-changed:55065be2-4f0e-4654-a40b-a54830d4acf4 for instance d278c6fc-34a1-4830-9e81-d644ff49e10d on n-h2-853611-3 Aug 18 11:33:20.699176 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8d724b6d-a6e3-4c69-93af-2de08ad02b28 req-5128faeb-57aa-42b3-9427-3bb2bd89c500 service nova] Creating event network-changed:7b97022c-78ee-42c8-b0d9-ab1df08cddb4 for instance 2979b2d3-3055-479e-ad21-b8aac94ee848 on n-h2-853611-3 Aug 18 11:33:20.725648 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8d724b6d-a6e3-4c69-93af-2de08ad02b28 req-5128faeb-57aa-42b3-9427-3bb2bd89c500 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.152589 Aug 18 11:33:20.750847 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 873/1750] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:20.763072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-08d147f8-f84c-499e-9a0b-8d52a2bed220 req-35b3108e-608e-4486-9827-8bc94a5bbba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a25b73-ea72-405a-b127-add6779c63d6", "name": "network-vif-plugged", "status": "completed", "tag": "e08c585a-7b0e-4a25-afaf-7bbad84d469a"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:20.788917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-08d147f8-f84c-499e-9a0b-8d52a2bed220 req-35b3108e-608e-4486-9827-8bc94a5bbba0 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:20.789752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-08d147f8-f84c-499e-9a0b-8d52a2bed220 req-35b3108e-608e-4486-9827-8bc94a5bbba0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:20.790367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-08d147f8-f84c-499e-9a0b-8d52a2bed220 req-35b3108e-608e-4486-9827-8bc94a5bbba0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:20.823304 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-08d147f8-f84c-499e-9a0b-8d52a2bed220 req-35b3108e-608e-4486-9827-8bc94a5bbba0 service nova] Creating event network-vif-plugged:e08c585a-7b0e-4a25-afaf-7bbad84d469a for instance e2a25b73-ea72-405a-b127-add6779c63d6 on n-h1-853611-3 Aug 18 11:33:20.840554 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-08d147f8-f84c-499e-9a0b-8d52a2bed220 req-35b3108e-608e-4486-9827-8bc94a5bbba0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086393 Aug 18 11:33:20.843438 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 874/1751] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:20.869127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-051fa35f-0fc2-414e-92a9-3179bfe235ad tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:20.878262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-051fa35f-0fc2-414e-92a9-3179bfe235ad tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:20.898106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-051fa35f-0fc2-414e-92a9-3179bfe235ad tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:20.898662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-051fa35f-0fc2-414e-92a9-3179bfe235ad tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:20.899114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-051fa35f-0fc2-414e-92a9-3179bfe235ad tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:20.900297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-051fa35f-0fc2-414e-92a9-3179bfe235ad tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:20.900449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-051fa35f-0fc2-414e-92a9-3179bfe235ad tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:20.900800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-051fa35f-0fc2-414e-92a9-3179bfe235ad tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:21.186439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-051fa35f-0fc2-414e-92a9-3179bfe235ad tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:21.207221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-051fa35f-0fc2-414e-92a9-3179bfe235ad tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:21.208677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-051fa35f-0fc2-414e-92a9-3179bfe235ad tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:21.209942 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-051fa35f-0fc2-414e-92a9-3179bfe235ad tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.365078 Aug 18 11:33:21.210818 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 875/1752] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:20 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:21.219391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94f6e81c-1d9d-4966-9438-15ebed10d4fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:21.221446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-94f6e81c-1d9d-4966-9438-15ebed10d4fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:21.240475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94f6e81c-1d9d-4966-9438-15ebed10d4fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:21.240997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94f6e81c-1d9d-4966-9438-15ebed10d4fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:21.241441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94f6e81c-1d9d-4966-9438-15ebed10d4fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:21.242167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94f6e81c-1d9d-4966-9438-15ebed10d4fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:21.242654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94f6e81c-1d9d-4966-9438-15ebed10d4fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:21.243084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94f6e81c-1d9d-4966-9438-15ebed10d4fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:21.585008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-94f6e81c-1d9d-4966-9438-15ebed10d4fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:21.600574 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-94f6e81c-1d9d-4966-9438-15ebed10d4fc tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1198 microversion: 2.1 time: 0.388635 Aug 18 11:33:21.605221 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 876/1753] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:21 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1198 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:21.624763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-53fc7aa2-2053-4fdc-90a9-de72e3a5a0bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:21.625502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-53fc7aa2-2053-4fdc-90a9-de72e3a5a0bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:21.667498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:21.682451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53fc7aa2-2053-4fdc-90a9-de72e3a5a0bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:21.695939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53fc7aa2-2053-4fdc-90a9-de72e3a5a0bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:21.695939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53fc7aa2-2053-4fdc-90a9-de72e3a5a0bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:21.695939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53fc7aa2-2053-4fdc-90a9-de72e3a5a0bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:21.695939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53fc7aa2-2053-4fdc-90a9-de72e3a5a0bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:21.696575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53fc7aa2-2053-4fdc-90a9-de72e3a5a0bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:22.184227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-53fc7aa2-2053-4fdc-90a9-de72e3a5a0bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:22.194800 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-53fc7aa2-2053-4fdc-90a9-de72e3a5a0bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1682 microversion: 2.1 time: 0.586979 Aug 18 11:33:22.212398 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 877/1754] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:21 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1682 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:22.226729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cfbd13aa-58e9-4d93-89ef-405f8829737a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:22.229987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cfbd13aa-58e9-4d93-89ef-405f8829737a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:22.257111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfbd13aa-58e9-4d93-89ef-405f8829737a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:22.260123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfbd13aa-58e9-4d93-89ef-405f8829737a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:22.262175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfbd13aa-58e9-4d93-89ef-405f8829737a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:22.264441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfbd13aa-58e9-4d93-89ef-405f8829737a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:22.268194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfbd13aa-58e9-4d93-89ef-405f8829737a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:22.268719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfbd13aa-58e9-4d93-89ef-405f8829737a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:22.691537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cfbd13aa-58e9-4d93-89ef-405f8829737a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:22.703768 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cfbd13aa-58e9-4d93-89ef-405f8829737a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 200 len: 1554 microversion: 2.1 time: 0.490027 Aug 18 11:33:22.710407 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 878/1755] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:22 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 1554 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:22.731021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b855ca72-9e8c-4165-9e7a-d8f8c8d59d1a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:22.733774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b855ca72-9e8c-4165-9e7a-d8f8c8d59d1a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:22.750088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b855ca72-9e8c-4165-9e7a-d8f8c8d59d1a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:22.750984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b855ca72-9e8c-4165-9e7a-d8f8c8d59d1a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:22.755628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b855ca72-9e8c-4165-9e7a-d8f8c8d59d1a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:22.756764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b855ca72-9e8c-4165-9e7a-d8f8c8d59d1a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:22.758258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b855ca72-9e8c-4165-9e7a-d8f8c8d59d1a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:22.758917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b855ca72-9e8c-4165-9e7a-d8f8c8d59d1a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:23.041046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b855ca72-9e8c-4165-9e7a-d8f8c8d59d1a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:23.053838 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b855ca72-9e8c-4165-9e7a-d8f8c8d59d1a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6" status: 200 len: 1488 microversion: 2.1 time: 0.341852 Aug 18 11:33:23.054800 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 879/1756] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:22 2022] GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6 => generated 1488 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:23.069522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-027a0554-a264-4222-8f74-29916f477aa9 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:23.070785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-027a0554-a264-4222-8f74-29916f477aa9 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:23.089517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-027a0554-a264-4222-8f74-29916f477aa9 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:23.097960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-027a0554-a264-4222-8f74-29916f477aa9 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:23.099805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-027a0554-a264-4222-8f74-29916f477aa9 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:23.101622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-027a0554-a264-4222-8f74-29916f477aa9 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:23.105359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-027a0554-a264-4222-8f74-29916f477aa9 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:23.106302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-027a0554-a264-4222-8f74-29916f477aa9 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:23.483286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-027a0554-a264-4222-8f74-29916f477aa9 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:23.502922 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-027a0554-a264-4222-8f74-29916f477aa9 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1322 microversion: 2.1 time: 0.441440 Aug 18 11:33:23.519003 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 880/1757] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:23 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:23.520868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-808c6fcc-b092-4fdf-ac7b-f15116870c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:23.525445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-808c6fcc-b092-4fdf-ac7b-f15116870c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:23.545491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808c6fcc-b092-4fdf-ac7b-f15116870c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:23.550524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808c6fcc-b092-4fdf-ac7b-f15116870c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:23.552528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808c6fcc-b092-4fdf-ac7b-f15116870c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:23.553921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808c6fcc-b092-4fdf-ac7b-f15116870c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:23.556501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808c6fcc-b092-4fdf-ac7b-f15116870c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:23.557113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808c6fcc-b092-4fdf-ac7b-f15116870c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:23.993782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-808c6fcc-b092-4fdf-ac7b-f15116870c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:24.034401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-808c6fcc-b092-4fdf-ac7b-f15116870c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:24.060264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-808c6fcc-b092-4fdf-ac7b-f15116870c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:24.063109 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-808c6fcc-b092-4fdf-ac7b-f15116870c1e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.552588 Aug 18 11:33:24.071942 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 881/1758] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:23 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:24.122237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-850477bd-572c-4a1c-8cdd-cf7290f4650e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:24.131291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-850477bd-572c-4a1c-8cdd-cf7290f4650e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:24.168735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-850477bd-572c-4a1c-8cdd-cf7290f4650e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:24.179459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-850477bd-572c-4a1c-8cdd-cf7290f4650e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:24.180208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-850477bd-572c-4a1c-8cdd-cf7290f4650e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:24.183823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-850477bd-572c-4a1c-8cdd-cf7290f4650e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:24.194305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-850477bd-572c-4a1c-8cdd-cf7290f4650e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:24.199011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-850477bd-572c-4a1c-8cdd-cf7290f4650e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:24.270016 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-395a82f5-ef1c-43b8-b125-2a5d6b390627 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c" status: 200 len: 1436 microversion: 2.1 time: 17.521915 Aug 18 11:33:24.280098 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 878/1759] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:06 2022] GET /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c => generated 1436 bytes in 17523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:24.288548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-8020dbab-5860-4a03-8793-fe0d118f067b req-a49bdacf-de83-45b8-8b9c-b400c264d490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84", "tag": "3edd002c-1a59-4f75-96f6-1d8c15c5a54f"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:24.327357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8020dbab-5860-4a03-8793-fe0d118f067b req-a49bdacf-de83-45b8-8b9c-b400c264d490 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:24.331849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8020dbab-5860-4a03-8793-fe0d118f067b req-a49bdacf-de83-45b8-8b9c-b400c264d490 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:24.334281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8020dbab-5860-4a03-8793-fe0d118f067b req-a49bdacf-de83-45b8-8b9c-b400c264d490 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:24.390201 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-8020dbab-5860-4a03-8793-fe0d118f067b req-a49bdacf-de83-45b8-8b9c-b400c264d490 service nova] Creating event network-changed:3edd002c-1a59-4f75-96f6-1d8c15c5a54f for instance 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 on n-h1-853611-3 Aug 18 11:33:24.418911 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-8020dbab-5860-4a03-8793-fe0d118f067b req-a49bdacf-de83-45b8-8b9c-b400c264d490 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132529 Aug 18 11:33:24.421500 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 879/1760] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:24.461672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-c5fc69a1-27be-439d-92d4-2e86eeef772f req-dfb660ba-7dea-477c-83ba-68aee7161621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84", "name": "network-vif-plugged", "status": "completed", "tag": "3edd002c-1a59-4f75-96f6-1d8c15c5a54f"}, {"server_uuid": "dc571952-f3e6-43fc-984c-85c632fa12ca", "name": "network-vif-plugged", "status": "completed", "tag": "d13c51ee-6c0f-4546-bde0-dc5d63e83f9d"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:24.509831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c5fc69a1-27be-439d-92d4-2e86eeef772f req-dfb660ba-7dea-477c-83ba-68aee7161621 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:24.512757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c5fc69a1-27be-439d-92d4-2e86eeef772f req-dfb660ba-7dea-477c-83ba-68aee7161621 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:24.513854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c5fc69a1-27be-439d-92d4-2e86eeef772f req-dfb660ba-7dea-477c-83ba-68aee7161621 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:24.550070 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-c5fc69a1-27be-439d-92d4-2e86eeef772f req-dfb660ba-7dea-477c-83ba-68aee7161621 service nova] Creating event network-vif-plugged:3edd002c-1a59-4f75-96f6-1d8c15c5a54f for instance 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 on n-h1-853611-3 Aug 18 11:33:24.551649 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-c5fc69a1-27be-439d-92d4-2e86eeef772f req-dfb660ba-7dea-477c-83ba-68aee7161621 service nova] Creating event network-vif-plugged:d13c51ee-6c0f-4546-bde0-dc5d63e83f9d for instance dc571952-f3e6-43fc-984c-85c632fa12ca on n-h2-853611-3 Aug 18 11:33:24.591319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-850477bd-572c-4a1c-8cdd-cf7290f4650e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:24.592416 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-c5fc69a1-27be-439d-92d4-2e86eeef772f req-dfb660ba-7dea-477c-83ba-68aee7161621 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.145903 Aug 18 11:33:24.599484 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 880/1761] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:24.606152 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-850477bd-572c-4a1c-8cdd-cf7290f4650e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1198 microversion: 2.1 time: 0.512944 Aug 18 11:33:24.608443 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 882/1762] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:24 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1198 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:24.620684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ea8b469-25ed-4b7a-800d-961e112b4068 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:24.623195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa92dfea-5355-453b-bdef-a2910215b0bd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:24.623790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6ea8b469-25ed-4b7a-800d-961e112b4068 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:24.627467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fa92dfea-5355-453b-bdef-a2910215b0bd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:24.643056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ea8b469-25ed-4b7a-800d-961e112b4068 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:24.645489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ea8b469-25ed-4b7a-800d-961e112b4068 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:24.645708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ea8b469-25ed-4b7a-800d-961e112b4068 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:24.647535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ea8b469-25ed-4b7a-800d-961e112b4068 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:24.648072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ea8b469-25ed-4b7a-800d-961e112b4068 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:24.650774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ea8b469-25ed-4b7a-800d-961e112b4068 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:24.665954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa92dfea-5355-453b-bdef-a2910215b0bd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:24.678085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa92dfea-5355-453b-bdef-a2910215b0bd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:24.683522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa92dfea-5355-453b-bdef-a2910215b0bd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:24.690313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa92dfea-5355-453b-bdef-a2910215b0bd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:24.693981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa92dfea-5355-453b-bdef-a2910215b0bd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:24.698205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa92dfea-5355-453b-bdef-a2910215b0bd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:24.838886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-fa92dfea-5355-453b-bdef-a2910215b0bd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lazy-loading 'flavor' on Instance uuid e2a25b73-ea72-405a-b127-add6779c63d6 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:33:25.237118 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fa92dfea-5355-453b-bdef-a2910215b0bd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "POST /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6/action" status: 202 len: 0 microversion: 2.1 time: 0.614772 Aug 18 11:33:25.251811 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 881/1763] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:33:24 2022] POST /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:33:25.262575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c20db1b5-a1f9-4772-b626-cd4fdd638a54 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:25.267397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c20db1b5-a1f9-4772-b626-cd4fdd638a54 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:25.296649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c20db1b5-a1f9-4772-b626-cd4fdd638a54 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:25.297361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c20db1b5-a1f9-4772-b626-cd4fdd638a54 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:25.298722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c20db1b5-a1f9-4772-b626-cd4fdd638a54 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:25.300075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c20db1b5-a1f9-4772-b626-cd4fdd638a54 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:25.300374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c20db1b5-a1f9-4772-b626-cd4fdd638a54 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:25.307033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6ea8b469-25ed-4b7a-800d-961e112b4068 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:25.315598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c20db1b5-a1f9-4772-b626-cd4fdd638a54 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:25.332944 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6ea8b469-25ed-4b7a-800d-961e112b4068 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1682 microversion: 2.1 time: 0.721144 Aug 18 11:33:25.333996 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 883/1764] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:24 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1682 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:25.340371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f0d2b9a5-37c5-4594-80b9-e4bc46339639 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:25.341195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f0d2b9a5-37c5-4594-80b9-e4bc46339639 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: e639b060-d272-4d48-8939-20d840f9c5e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:25.350347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0d2b9a5-37c5-4594-80b9-e4bc46339639 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:25.351225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0d2b9a5-37c5-4594-80b9-e4bc46339639 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:25.351921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0d2b9a5-37c5-4594-80b9-e4bc46339639 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:25.353036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0d2b9a5-37c5-4594-80b9-e4bc46339639 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:25.353846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0d2b9a5-37c5-4594-80b9-e4bc46339639 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:25.354649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0d2b9a5-37c5-4594-80b9-e4bc46339639 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:25.460302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f0d2b9a5-37c5-4594-80b9-e4bc46339639 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: e639b060-d272-4d48-8939-20d840f9c5e4] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:33:25.464702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:25.690911 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f0d2b9a5-37c5-4594-80b9-e4bc46339639 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4" status: 204 len: 0 microversion: 2.1 time: 0.355139 Aug 18 11:33:25.691859 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 884/1765] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:33:25 2022] DELETE /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:33:25.697500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7ba56f8e-4484-42b9-a411-40c8c80aa4db tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519fab2160>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:25.804273 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7ba56f8e-4484-42b9-a411-40c8c80aa4db tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c" status: 200 len: 1436 microversion: 2.1 time: 0.111198 Aug 18 11:33:25.805444 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 885/1766] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:25 2022] GET /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c => generated 1436 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:25.812176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7499b2cd-cf7a-4195-81ec-27c6c6b8c230 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:25.813411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7499b2cd-cf7a-4195-81ec-27c6c6b8c230 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:25.824045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7499b2cd-cf7a-4195-81ec-27c6c6b8c230 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:25.824627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7499b2cd-cf7a-4195-81ec-27c6c6b8c230 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:25.825061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7499b2cd-cf7a-4195-81ec-27c6c6b8c230 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:25.826021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7499b2cd-cf7a-4195-81ec-27c6c6b8c230 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:25.826528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7499b2cd-cf7a-4195-81ec-27c6c6b8c230 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:25.827091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7499b2cd-cf7a-4195-81ec-27c6c6b8c230 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:25.939299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c20db1b5-a1f9-4772-b626-cd4fdd638a54 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:25.958219 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c20db1b5-a1f9-4772-b626-cd4fdd638a54 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 200 len: 1512 microversion: 2.1 time: 0.704504 Aug 18 11:33:25.970704 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 882/1767] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:25 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 1512 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:25.984407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-daeabb0d-7290-4831-a7ad-b8a784e400ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:25.990556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-daeabb0d-7290-4831-a7ad-b8a784e400ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:26.015747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-daeabb0d-7290-4831-a7ad-b8a784e400ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:26.025150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-daeabb0d-7290-4831-a7ad-b8a784e400ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:26.026600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-daeabb0d-7290-4831-a7ad-b8a784e400ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:26.030460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-daeabb0d-7290-4831-a7ad-b8a784e400ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:26.034555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-daeabb0d-7290-4831-a7ad-b8a784e400ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:26.038619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-daeabb0d-7290-4831-a7ad-b8a784e400ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:26.154520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7499b2cd-cf7a-4195-81ec-27c6c6b8c230 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:26.166625 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7499b2cd-cf7a-4195-81ec-27c6c6b8c230 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1322 microversion: 2.1 time: 0.359812 Aug 18 11:33:26.167985 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 886/1768] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:25 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:26.175797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-214b74b8-0c80-45c2-9464-343866ff84ec tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:26.176944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-214b74b8-0c80-45c2-9464-343866ff84ec tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:26.189459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-214b74b8-0c80-45c2-9464-343866ff84ec tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:26.190256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-214b74b8-0c80-45c2-9464-343866ff84ec tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:26.192801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-214b74b8-0c80-45c2-9464-343866ff84ec tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:26.193871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-214b74b8-0c80-45c2-9464-343866ff84ec tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:26.194893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-214b74b8-0c80-45c2-9464-343866ff84ec tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:26.195502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-214b74b8-0c80-45c2-9464-343866ff84ec tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:26.501876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-daeabb0d-7290-4831-a7ad-b8a784e400ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:26.520330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-daeabb0d-7290-4831-a7ad-b8a784e400ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:26.530973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-daeabb0d-7290-4831-a7ad-b8a784e400ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:26.541381 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-daeabb0d-7290-4831-a7ad-b8a784e400ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.561302 Aug 18 11:33:26.542281 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 883/1769] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:25 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:26.550828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5c9ee17d-151e-4455-b330-10f857d55516 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:26.562904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5c9ee17d-151e-4455-b330-10f857d55516 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:26.577170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-214b74b8-0c80-45c2-9464-343866ff84ec tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:26.590975 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-214b74b8-0c80-45c2-9464-343866ff84ec tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6" status: 200 len: 1496 microversion: 2.1 time: 0.420117 Aug 18 11:33:26.594199 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 887/1770] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:26 2022] GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6 => generated 1496 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:26.606728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c9ee17d-151e-4455-b330-10f857d55516 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:26.606728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c9ee17d-151e-4455-b330-10f857d55516 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:26.606728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c9ee17d-151e-4455-b330-10f857d55516 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:26.606728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c9ee17d-151e-4455-b330-10f857d55516 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:26.607150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c9ee17d-151e-4455-b330-10f857d55516 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:26.607150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c9ee17d-151e-4455-b330-10f857d55516 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:26.611555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f137dc4-ad68-4166-946b-094ef2e516d2 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:26.612336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7f137dc4-ad68-4166-946b-094ef2e516d2 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: e639b060-d272-4d48-8939-20d840f9c5e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:26.622417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f137dc4-ad68-4166-946b-094ef2e516d2 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:26.623003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f137dc4-ad68-4166-946b-094ef2e516d2 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:26.623456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f137dc4-ad68-4166-946b-094ef2e516d2 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:26.624416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f137dc4-ad68-4166-946b-094ef2e516d2 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:26.624936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f137dc4-ad68-4166-946b-094ef2e516d2 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:26.625374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f137dc4-ad68-4166-946b-094ef2e516d2 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:26.899433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7f137dc4-ad68-4166-946b-094ef2e516d2 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:26.912313 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7f137dc4-ad68-4166-946b-094ef2e516d2 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4" status: 200 len: 1514 microversion: 2.1 time: 0.312368 Aug 18 11:33:26.912933 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 888/1771] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:26 2022] GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4 => generated 1514 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:26.932280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e4038ba-884b-489e-a23b-9589ae2c596f tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:26.932907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e4038ba-884b-489e-a23b-9589ae2c596f tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:26.940147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4038ba-884b-489e-a23b-9589ae2c596f tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:26.940636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4038ba-884b-489e-a23b-9589ae2c596f tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:26.941076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4038ba-884b-489e-a23b-9589ae2c596f tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:26.941784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4038ba-884b-489e-a23b-9589ae2c596f tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:26.942235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4038ba-884b-489e-a23b-9589ae2c596f tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:26.942850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4038ba-884b-489e-a23b-9589ae2c596f tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:27.129076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e4038ba-884b-489e-a23b-9589ae2c596f tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:27.139323 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e4038ba-884b-489e-a23b-9589ae2c596f tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1466 microversion: 2.1 time: 0.210855 Aug 18 11:33:27.154456 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 889/1772] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:26 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1466 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:27.154456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1691164-de79-479f-9187-71e4f915e9c2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:27.154456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1691164-de79-479f-9187-71e4f915e9c2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:27.154456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1691164-de79-479f-9187-71e4f915e9c2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:27.156315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1691164-de79-479f-9187-71e4f915e9c2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:27.156765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1691164-de79-479f-9187-71e4f915e9c2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:27.158837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1691164-de79-479f-9187-71e4f915e9c2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:27.159490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1691164-de79-479f-9187-71e4f915e9c2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:27.160141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1691164-de79-479f-9187-71e4f915e9c2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:27.403067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a1691164-de79-479f-9187-71e4f915e9c2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:27.415973 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1691164-de79-479f-9187-71e4f915e9c2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1682 microversion: 2.1 time: 0.274600 Aug 18 11:33:27.420773 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 890/1773] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:27 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1682 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:27.427463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-e27290b1-57ba-4be4-a63a-02447882aedd req-97fa4b89-fb4c-418c-aa78-ade3dc2abc92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecc4c6b-9de9-497a-8421-657f7f6a4cb0", "name": "network-vif-deleted", "tag": "6a82185e-6584-4c38-b3fb-0db9eebc3d1b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:27.472836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e27290b1-57ba-4be4-a63a-02447882aedd req-97fa4b89-fb4c-418c-aa78-ade3dc2abc92 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:27.473327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e27290b1-57ba-4be4-a63a-02447882aedd req-97fa4b89-fb4c-418c-aa78-ade3dc2abc92 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:27.473766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e27290b1-57ba-4be4-a63a-02447882aedd req-97fa4b89-fb4c-418c-aa78-ade3dc2abc92 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:27.510327 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e27290b1-57ba-4be4-a63a-02447882aedd req-97fa4b89-fb4c-418c-aa78-ade3dc2abc92 service nova] Creating event network-vif-deleted:6a82185e-6584-4c38-b3fb-0db9eebc3d1b for instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 on n-h2-853611-3 Aug 18 11:33:27.525054 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-e27290b1-57ba-4be4-a63a-02447882aedd req-97fa4b89-fb4c-418c-aa78-ade3dc2abc92 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101790 Aug 18 11:33:27.545837 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 891/1774] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:27.545837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f7cae280-b41b-4dec-8c21-56df6f781eb1 req-bf6dbfd1-537d-4169-ac83-92fd08982a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6c996b-c6b0-4f55-97ed-b4b472dc3640", "name": "network-vif-unplugged", "status": "completed", "tag": "ffdd209f-cefa-48ce-8e0f-9845986fb9ef"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:27.558966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f7cae280-b41b-4dec-8c21-56df6f781eb1 req-bf6dbfd1-537d-4169-ac83-92fd08982a29 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:27.558966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f7cae280-b41b-4dec-8c21-56df6f781eb1 req-bf6dbfd1-537d-4169-ac83-92fd08982a29 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:27.558966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f7cae280-b41b-4dec-8c21-56df6f781eb1 req-bf6dbfd1-537d-4169-ac83-92fd08982a29 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:27.584344 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f7cae280-b41b-4dec-8c21-56df6f781eb1 req-bf6dbfd1-537d-4169-ac83-92fd08982a29 service nova] Creating event network-vif-unplugged:ffdd209f-cefa-48ce-8e0f-9845986fb9ef for instance 6c6c996b-c6b0-4f55-97ed-b4b472dc3640 on n-h2-853611-3 Aug 18 11:33:27.592529 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f7cae280-b41b-4dec-8c21-56df6f781eb1 req-bf6dbfd1-537d-4169-ac83-92fd08982a29 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053785 Aug 18 11:33:27.593091 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 892/1775] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:27.606046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7ef52c2-058d-4bf0-946c-cd39cd6d6277 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:27.606385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e7ef52c2-058d-4bf0-946c-cd39cd6d6277 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:27.616374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ef52c2-058d-4bf0-946c-cd39cd6d6277 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:27.617032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ef52c2-058d-4bf0-946c-cd39cd6d6277 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:27.618871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ef52c2-058d-4bf0-946c-cd39cd6d6277 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:27.621310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ef52c2-058d-4bf0-946c-cd39cd6d6277 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:27.622235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ef52c2-058d-4bf0-946c-cd39cd6d6277 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:27.623315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ef52c2-058d-4bf0-946c-cd39cd6d6277 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:27.738364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e7ef52c2-058d-4bf0-946c-cd39cd6d6277 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:27.748425 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e7ef52c2-058d-4bf0-946c-cd39cd6d6277 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 200 len: 1346 microversion: 2.1 time: 0.150150 Aug 18 11:33:27.763015 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 893/1776] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:27 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 1346 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:27.769954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-204ae3d8-59c9-450c-9af8-e8c1ee0fdd98 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519f822e50>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:27.870908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5c9ee17d-151e-4455-b330-10f857d55516 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:27.884667 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5c9ee17d-151e-4455-b330-10f857d55516 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1198 microversion: 2.1 time: 1.337334 Aug 18 11:33:27.885752 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 884/1777] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:26 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1198 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:27.891309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0fe033f6-9d6f-42f0-ac13-32f9e4efba06 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:27.892423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0fe033f6-9d6f-42f0-ac13-32f9e4efba06 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:27.899622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fe033f6-9d6f-42f0-ac13-32f9e4efba06 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:27.900619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fe033f6-9d6f-42f0-ac13-32f9e4efba06 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:27.901153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fe033f6-9d6f-42f0-ac13-32f9e4efba06 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:27.902197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fe033f6-9d6f-42f0-ac13-32f9e4efba06 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:27.902803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fe033f6-9d6f-42f0-ac13-32f9e4efba06 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:27.903346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fe033f6-9d6f-42f0-ac13-32f9e4efba06 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:28.249676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0fe033f6-9d6f-42f0-ac13-32f9e4efba06 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:28.261528 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0fe033f6-9d6f-42f0-ac13-32f9e4efba06 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1322 microversion: 2.1 time: 0.374521 Aug 18 11:33:28.269223 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 885/1778] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:27 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:28.285678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-398352ba-3084-46a4-9a50-7a692740dce6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:28.286806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-398352ba-3084-46a4-9a50-7a692740dce6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:28.307009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-398352ba-3084-46a4-9a50-7a692740dce6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:28.308884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-398352ba-3084-46a4-9a50-7a692740dce6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:28.312573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-398352ba-3084-46a4-9a50-7a692740dce6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:28.313454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-398352ba-3084-46a4-9a50-7a692740dce6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:28.314991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-398352ba-3084-46a4-9a50-7a692740dce6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:28.315448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-398352ba-3084-46a4-9a50-7a692740dce6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:28.450973 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-204ae3d8-59c9-450c-9af8-e8c1ee0fdd98 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "DELETE /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c" status: 204 len: 0 microversion: 2.1 time: 0.686835 Aug 18 11:33:28.451555 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 894/1779] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:27 2022] DELETE /compute/v2.1/images/9741aba7-4d1d-4438-9c32-59940f36de3c => generated 0 bytes in 688 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:33:28.466513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-acfd5943-bebb-4a23-8975-1e1e24b77899 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:28.467673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-acfd5943-bebb-4a23-8975-1e1e24b77899 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:28.492230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-acfd5943-bebb-4a23-8975-1e1e24b77899 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:28.492989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-acfd5943-bebb-4a23-8975-1e1e24b77899 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:28.493904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-acfd5943-bebb-4a23-8975-1e1e24b77899 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:28.494858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-acfd5943-bebb-4a23-8975-1e1e24b77899 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:28.495446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-acfd5943-bebb-4a23-8975-1e1e24b77899 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:28.496068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-acfd5943-bebb-4a23-8975-1e1e24b77899 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:28.757244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-398352ba-3084-46a4-9a50-7a692740dce6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:28.783588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-398352ba-3084-46a4-9a50-7a692740dce6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:28.809381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-398352ba-3084-46a4-9a50-7a692740dce6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:28.810421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-acfd5943-bebb-4a23-8975-1e1e24b77899 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:28.811062 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-398352ba-3084-46a4-9a50-7a692740dce6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.540208 Aug 18 11:33:28.811653 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 886/1780] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:28 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:28.824437 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-acfd5943-bebb-4a23-8975-1e1e24b77899 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6" status: 200 len: 1479 microversion: 2.1 time: 0.369865 Aug 18 11:33:28.838457 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 895/1781] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:28 2022] GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6 => generated 1479 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:28.838457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3ab6456b-8403-4550-9c5f-8c337345f151 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:28.838805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3ab6456b-8403-4550-9c5f-8c337345f151 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:28.844471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-78dd1720-da34-462e-ae8d-6946b7a31a2c tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:28.847515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-78dd1720-da34-462e-ae8d-6946b7a31a2c tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: e639b060-d272-4d48-8939-20d840f9c5e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:28.856352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ab6456b-8403-4550-9c5f-8c337345f151 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:28.857159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ab6456b-8403-4550-9c5f-8c337345f151 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:28.857767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ab6456b-8403-4550-9c5f-8c337345f151 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:28.860820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ab6456b-8403-4550-9c5f-8c337345f151 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:28.861812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ab6456b-8403-4550-9c5f-8c337345f151 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:28.864023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ab6456b-8403-4550-9c5f-8c337345f151 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:28.868472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78dd1720-da34-462e-ae8d-6946b7a31a2c tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:28.869069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78dd1720-da34-462e-ae8d-6946b7a31a2c tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:28.872171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78dd1720-da34-462e-ae8d-6946b7a31a2c tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:28.874832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78dd1720-da34-462e-ae8d-6946b7a31a2c tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:28.875452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78dd1720-da34-462e-ae8d-6946b7a31a2c tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:28.876148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78dd1720-da34-462e-ae8d-6946b7a31a2c tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:29.187777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-78dd1720-da34-462e-ae8d-6946b7a31a2c tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:29.190538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3ab6456b-8403-4550-9c5f-8c337345f151 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:29.199214 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-78dd1720-da34-462e-ae8d-6946b7a31a2c tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4" status: 200 len: 1514 microversion: 2.1 time: 0.383516 Aug 18 11:33:29.210911 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 887/1782] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:28 2022] GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4 => generated 1514 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:29.210911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-667b7bef-f128-4495-93b2-7122e9301879 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '.version_select at 0x7f519ffdfb80>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:29.211149 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3ab6456b-8403-4550-9c5f-8c337345f151 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.378258 Aug 18 11:33:29.211149 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 896/1783] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:28 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:29.216126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-383f39b6-e531-418f-a370-0156fc017607 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:29.216126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-383f39b6-e531-418f-a370-0156fc017607 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:29.223966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-383f39b6-e531-418f-a370-0156fc017607 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:29.224470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-383f39b6-e531-418f-a370-0156fc017607 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:29.224916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-383f39b6-e531-418f-a370-0156fc017607 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:29.225635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-383f39b6-e531-418f-a370-0156fc017607 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:29.226098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-383f39b6-e531-418f-a370-0156fc017607 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:29.226607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-383f39b6-e531-418f-a370-0156fc017607 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:29.252731 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-667b7bef-f128-4495-93b2-7122e9301879 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] HTTP exception thrown: Image not found. Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-667b7bef-f128-4495-93b2-7122e9301879 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Request method failure captured: Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1 HTTP/1.1 Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMjfRC-O8PK_EouMjP6hN6W7GFuUm8qVLrXLLfvWoh_BmvsHGZINu0MaP0VYWFOrQ1qZ8zjEruT5C1t-cytRaGCTf4oXnxD3U8S1xKx9ZukmNRQ1f32uuukBtZg-gvqrP4W1VZQFIV3BPIsbR_EnyJflENSRi5ho1dBYDS_A4rlfuA Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 933f2e895a88476593bf14a643c2b7f6 Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesOneServerTestJSON-516433174 Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:33:29.255069 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:33:29.257033 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/933f2e895a88476593bf14a643c2b7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/933f2e895a88476593bf14a643c2b7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_933f2e895a88476593bf14a643c2b7f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/933f2e895a88476593bf14a643c2b7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:29.257033 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesOneServerTestJSON-516433174 Aug 18 11:33:29.257033 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 933f2e895a88476593bf14a643c2b7f6 Aug 18 11:33:29.257033 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-516433174 Aug 18 11:33:29.257033 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesOneServerTestJSON-516433174-project Aug 18 11:33:29.257033 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:33:29.257033 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:33:29.257033 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 368fa7a976b745ae8ab1251352a56975 Aug 18 11:33:29.257033 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesOneServerTestJSON-516433174-project Aug 18 11:33:29.257033 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:33:29.257033 n-d-853611-3 devstack@n-api.service[122209]: exception: Image not found. Aug 18 11:33:29.257033 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '22cf7cd8-d170-4cd6-ac59-942c5f3412d1'} Aug 18 11:33:29.257033 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 22cf7cd8-d170-4cd6-ac59-942c5f3412d1 to delete Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:29.258183 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22cf7cd8-d170-4cd6-ac59-942c5f3412d1 could not be found. Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:29.260131 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-667b7bef-f128-4495-93b2-7122e9301879 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Returning 404 to user: Image not found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:29.261894 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-667b7bef-f128-4495-93b2-7122e9301879 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "DELETE /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1" status: 404 len: 62 microversion: 2.1 time: 0.054456 Aug 18 11:33:29.263383 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 888/1784] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:29 2022] DELETE /compute/v2.1/images/22cf7cd8-d170-4cd6-ac59-942c5f3412d1 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:33:29.263383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2ce1cd05-556f-4fcb-91a5-27259b5949c5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-825977509"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:29.265753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2ce1cd05-556f-4fcb-91a5-27259b5949c5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:29.273904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ce1cd05-556f-4fcb-91a5-27259b5949c5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:29.274675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ce1cd05-556f-4fcb-91a5-27259b5949c5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:29.275175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ce1cd05-556f-4fcb-91a5-27259b5949c5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:29.275899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ce1cd05-556f-4fcb-91a5-27259b5949c5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:29.276556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ce1cd05-556f-4fcb-91a5-27259b5949c5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:29.277168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ce1cd05-556f-4fcb-91a5-27259b5949c5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:29.340628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-383f39b6-e531-418f-a370-0156fc017607 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:29.353610 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-383f39b6-e531-418f-a370-0156fc017607 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 200 len: 1346 microversion: 2.1 time: 0.142845 Aug 18 11:33:29.354542 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 897/1785] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:29 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 1346 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:29.371368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ed7c0a1-4fe3-4660-b620-1028ee7e2d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:29.372493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6ed7c0a1-4fe3-4660-b620-1028ee7e2d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:29.396797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ed7c0a1-4fe3-4660-b620-1028ee7e2d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:29.397663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ed7c0a1-4fe3-4660-b620-1028ee7e2d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:29.398918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ed7c0a1-4fe3-4660-b620-1028ee7e2d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:29.399862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ed7c0a1-4fe3-4660-b620-1028ee7e2d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:29.400545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ed7c0a1-4fe3-4660-b620-1028ee7e2d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:29.401183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ed7c0a1-4fe3-4660-b620-1028ee7e2d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:29.565838 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2ce1cd05-556f-4fcb-91a5-27259b5949c5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "POST /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6/action" status: 202 len: 0 microversion: 2.1 time: 0.307593 Aug 18 11:33:29.567272 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 889/1786] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:33:29 2022] POST /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 18 11:33:29.577139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7a8a3481-f4f6-4720-9d75-2f95616b2edb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:29.578227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7a8a3481-f4f6-4720-9d75-2f95616b2edb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:29.588899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a8a3481-f4f6-4720-9d75-2f95616b2edb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:29.589675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a8a3481-f4f6-4720-9d75-2f95616b2edb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:29.590596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a8a3481-f4f6-4720-9d75-2f95616b2edb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:29.592157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a8a3481-f4f6-4720-9d75-2f95616b2edb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:29.592880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a8a3481-f4f6-4720-9d75-2f95616b2edb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:29.593498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a8a3481-f4f6-4720-9d75-2f95616b2edb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:29.630659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7a8a3481-f4f6-4720-9d75-2f95616b2edb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:33:29.703850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6ed7c0a1-4fe3-4660-b620-1028ee7e2d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:29.717992 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6ed7c0a1-4fe3-4660-b620-1028ee7e2d48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1198 microversion: 2.1 time: 0.361924 Aug 18 11:33:29.719053 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 898/1787] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:29 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1198 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:29.726055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-add33daa-22de-484e-8454-fe529d4d4e07 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:29.727386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-add33daa-22de-484e-8454-fe529d4d4e07 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:29.739649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:29.744293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-add33daa-22de-484e-8454-fe529d4d4e07 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:29.745581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-add33daa-22de-484e-8454-fe529d4d4e07 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:29.746449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-add33daa-22de-484e-8454-fe529d4d4e07 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:29.747653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-add33daa-22de-484e-8454-fe529d4d4e07 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:29.748400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-add33daa-22de-484e-8454-fe529d4d4e07 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:29.748789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-add33daa-22de-484e-8454-fe529d4d4e07 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:29.784216 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7a8a3481-f4f6-4720-9d75-2f95616b2edb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 204 len: 0 microversion: 2.1 time: 0.214703 Aug 18 11:33:29.784606 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 890/1788] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:33:29 2022] DELETE /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:33:29.791638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1572bc09-acbc-46b3-b2af-5e341f858b46 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:29.792555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1572bc09-acbc-46b3-b2af-5e341f858b46 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:29.802869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1572bc09-acbc-46b3-b2af-5e341f858b46 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:29.802869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1572bc09-acbc-46b3-b2af-5e341f858b46 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:29.803979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1572bc09-acbc-46b3-b2af-5e341f858b46 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:29.804891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1572bc09-acbc-46b3-b2af-5e341f858b46 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:29.805480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1572bc09-acbc-46b3-b2af-5e341f858b46 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:29.805987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1572bc09-acbc-46b3-b2af-5e341f858b46 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:30.022556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-add33daa-22de-484e-8454-fe529d4d4e07 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:30.034603 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-add33daa-22de-484e-8454-fe529d4d4e07 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1322 microversion: 2.1 time: 0.312049 Aug 18 11:33:30.035831 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 899/1789] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:29 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:30.038223 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1572bc09-acbc-46b3-b2af-5e341f858b46 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:30.041952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cf894d28-5603-4b48-9f3a-08c1bcbaa1c6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fc05b80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:30.047521 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1572bc09-acbc-46b3-b2af-5e341f858b46 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.260786 Aug 18 11:33:30.050256 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 891/1790] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:29 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:30.057709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-4c0d4c22-f2fd-4408-ab2d-5e23a2171d78 req-d8ecb671-932e-4f8c-b64b-388ee456c360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d278c6fc-34a1-4830-9e81-d644ff49e10d", "name": "network-vif-plugged", "status": "completed", "tag": "55065be2-4f0e-4654-a40b-a54830d4acf4"}, {"server_uuid": "2979b2d3-3055-479e-ad21-b8aac94ee848", "name": "network-vif-plugged", "status": "completed", "tag": "7b97022c-78ee-42c8-b0d9-ab1df08cddb4"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:30.071385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4c0d4c22-f2fd-4408-ab2d-5e23a2171d78 req-d8ecb671-932e-4f8c-b64b-388ee456c360 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:30.072642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4c0d4c22-f2fd-4408-ab2d-5e23a2171d78 req-d8ecb671-932e-4f8c-b64b-388ee456c360 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:30.072864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4c0d4c22-f2fd-4408-ab2d-5e23a2171d78 req-d8ecb671-932e-4f8c-b64b-388ee456c360 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:30.101997 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-4c0d4c22-f2fd-4408-ab2d-5e23a2171d78 req-d8ecb671-932e-4f8c-b64b-388ee456c360 service nova] Creating event network-vif-plugged:55065be2-4f0e-4654-a40b-a54830d4acf4 for instance d278c6fc-34a1-4830-9e81-d644ff49e10d on n-h2-853611-3 Aug 18 11:33:30.103800 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-4c0d4c22-f2fd-4408-ab2d-5e23a2171d78 req-d8ecb671-932e-4f8c-b64b-388ee456c360 service nova] Creating event network-vif-plugged:7b97022c-78ee-42c8-b0d9-ab1df08cddb4 for instance 2979b2d3-3055-479e-ad21-b8aac94ee848 on n-h2-853611-3 Aug 18 11:33:30.121964 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cf894d28-5603-4b48-9f3a-08c1bcbaa1c6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.084647 Aug 18 11:33:30.122827 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 900/1791] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:30 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:30.124412 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-4c0d4c22-f2fd-4408-ab2d-5e23a2171d78 req-d8ecb671-932e-4f8c-b64b-388ee456c360 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072591 Aug 18 11:33:30.130851 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 892/1792] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:30.137750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-67d887a8-e13b-46f6-9ffa-ad8b052d5290 req-1217ff30-d4fb-49b2-853c-db795932e8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e639b060-d272-4d48-8939-20d840f9c5e4", "name": "network-vif-deleted", "tag": "63d5df2a-a11d-4c19-94fd-a21c1c8c3008"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:30.144555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7bda1bc2-1cc1-45d9-95ca-fd207eda9de0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:30.145771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7bda1bc2-1cc1-45d9-95ca-fd207eda9de0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:30.155736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bda1bc2-1cc1-45d9-95ca-fd207eda9de0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:30.156500 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bda1bc2-1cc1-45d9-95ca-fd207eda9de0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:30.158128 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bda1bc2-1cc1-45d9-95ca-fd207eda9de0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:30.159156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bda1bc2-1cc1-45d9-95ca-fd207eda9de0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:30.160018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bda1bc2-1cc1-45d9-95ca-fd207eda9de0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:30.160659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bda1bc2-1cc1-45d9-95ca-fd207eda9de0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:30.170085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-67d887a8-e13b-46f6-9ffa-ad8b052d5290 req-1217ff30-d4fb-49b2-853c-db795932e8e1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:30.170706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-67d887a8-e13b-46f6-9ffa-ad8b052d5290 req-1217ff30-d4fb-49b2-853c-db795932e8e1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:30.171396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-67d887a8-e13b-46f6-9ffa-ad8b052d5290 req-1217ff30-d4fb-49b2-853c-db795932e8e1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:30.199512 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-67d887a8-e13b-46f6-9ffa-ad8b052d5290 req-1217ff30-d4fb-49b2-853c-db795932e8e1 service nova] Creating event network-vif-deleted:63d5df2a-a11d-4c19-94fd-a21c1c8c3008 for instance e639b060-d272-4d48-8939-20d840f9c5e4 on n-h2-853611-3 Aug 18 11:33:30.216548 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-67d887a8-e13b-46f6-9ffa-ad8b052d5290 req-1217ff30-d4fb-49b2-853c-db795932e8e1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087133 Aug 18 11:33:30.222855 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 901/1793] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:30.234242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0a78f33b-b688-4310-a5a8-453b4298aed4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:30.236092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0a78f33b-b688-4310-a5a8-453b4298aed4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:30.254996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a78f33b-b688-4310-a5a8-453b4298aed4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:30.255536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a78f33b-b688-4310-a5a8-453b4298aed4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:30.255970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a78f33b-b688-4310-a5a8-453b4298aed4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:30.256704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a78f33b-b688-4310-a5a8-453b4298aed4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:30.261523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a78f33b-b688-4310-a5a8-453b4298aed4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:30.262260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a78f33b-b688-4310-a5a8-453b4298aed4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:30.433408 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7bda1bc2-1cc1-45d9-95ca-fd207eda9de0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:30.437767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:30.448662 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7bda1bc2-1cc1-45d9-95ca-fd207eda9de0 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1472 microversion: 2.1 time: 0.315602 Aug 18 11:33:30.456576 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 893/1794] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:30 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:30.461513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-af823756-3868-442e-98ed-81ae71f35d63 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:30.462314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-af823756-3868-442e-98ed-81ae71f35d63 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: e639b060-d272-4d48-8939-20d840f9c5e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:30.469577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af823756-3868-442e-98ed-81ae71f35d63 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:30.470074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af823756-3868-442e-98ed-81ae71f35d63 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:30.470546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af823756-3868-442e-98ed-81ae71f35d63 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:30.471524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af823756-3868-442e-98ed-81ae71f35d63 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:30.471989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af823756-3868-442e-98ed-81ae71f35d63 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:30.472537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af823756-3868-442e-98ed-81ae71f35d63 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:30.507282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0a78f33b-b688-4310-a5a8-453b4298aed4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:30.519107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0a78f33b-b688-4310-a5a8-453b4298aed4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:30.520781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0a78f33b-b688-4310-a5a8-453b4298aed4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:30.522800 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0a78f33b-b688-4310-a5a8-453b4298aed4 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.297998 Aug 18 11:33:30.535749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af823756-3868-442e-98ed-81ae71f35d63 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:30.536246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af823756-3868-442e-98ed-81ae71f35d63 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:30.536689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af823756-3868-442e-98ed-81ae71f35d63 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:30.537307 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 902/1795] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:30 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:30.542639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-af823756-3868-442e-98ed-81ae71f35d63 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lazy-loading 'fault' on Instance uuid e639b060-d272-4d48-8939-20d840f9c5e4 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:33:30.546196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8c98620-1451-4196-8ce9-e5c8e45ccdcd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:30.548321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f8c98620-1451-4196-8ce9-e5c8e45ccdcd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:30.561647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8c98620-1451-4196-8ce9-e5c8e45ccdcd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:30.562478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8c98620-1451-4196-8ce9-e5c8e45ccdcd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:30.563355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8c98620-1451-4196-8ce9-e5c8e45ccdcd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:30.564526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8c98620-1451-4196-8ce9-e5c8e45ccdcd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:30.565305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8c98620-1451-4196-8ce9-e5c8e45ccdcd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:30.568032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8c98620-1451-4196-8ce9-e5c8e45ccdcd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:30.612554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-af823756-3868-442e-98ed-81ae71f35d63 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:30.622909 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-af823756-3868-442e-98ed-81ae71f35d63 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4" status: 200 len: 1308 microversion: 2.1 time: 0.165289 Aug 18 11:33:30.635371 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 894/1796] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:30 2022] GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4 => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:30.656450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f8c98620-1451-4196-8ce9-e5c8e45ccdcd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:30.666366 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8c98620-1451-4196-8ce9-e5c8e45ccdcd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 200 len: 1346 microversion: 2.1 time: 0.127851 Aug 18 11:33:30.668669 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 903/1797] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:30 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 1346 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:30.744043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2e692f5c-4943-4de1-b538-82e67fa7a5f0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:30.744964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2e692f5c-4943-4de1-b538-82e67fa7a5f0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:30.753853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e692f5c-4943-4de1-b538-82e67fa7a5f0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:30.754466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e692f5c-4943-4de1-b538-82e67fa7a5f0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:30.754985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e692f5c-4943-4de1-b538-82e67fa7a5f0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:30.755837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e692f5c-4943-4de1-b538-82e67fa7a5f0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:30.756396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e692f5c-4943-4de1-b538-82e67fa7a5f0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:30.756901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e692f5c-4943-4de1-b538-82e67fa7a5f0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:30.960752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2e692f5c-4943-4de1-b538-82e67fa7a5f0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:30.971114 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2e692f5c-4943-4de1-b538-82e67fa7a5f0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1198 microversion: 2.1 time: 0.233638 Aug 18 11:33:30.983580 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 895/1798] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:30 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1198 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:31.056472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ef7248cc-1bec-4244-a9aa-3920eae3fff4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:31.057087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef7248cc-1bec-4244-a9aa-3920eae3fff4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:31.063949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7248cc-1bec-4244-a9aa-3920eae3fff4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:31.064722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7248cc-1bec-4244-a9aa-3920eae3fff4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:31.065326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7248cc-1bec-4244-a9aa-3920eae3fff4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:31.066584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7248cc-1bec-4244-a9aa-3920eae3fff4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:31.067204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7248cc-1bec-4244-a9aa-3920eae3fff4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:31.068096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7248cc-1bec-4244-a9aa-3920eae3fff4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:31.137851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-51bb938b-cad7-4024-9910-059d121f8bce tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519ffdf940>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:31.222819 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-51bb938b-cad7-4024-9910-059d121f8bce tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.089487 Aug 18 11:33:31.228005 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 896/1799] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:31 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:33:31.297521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ef7248cc-1bec-4244-a9aa-3920eae3fff4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:31.302271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:31.308722 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ef7248cc-1bec-4244-a9aa-3920eae3fff4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1322 microversion: 2.1 time: 0.256435 Aug 18 11:33:31.323369 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 904/1800] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:31 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:31.420739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-44cf9abd-32ed-4a94-b94b-1441fefa1012 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:31.421445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-44cf9abd-32ed-4a94-b94b-1441fefa1012 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:31.430810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44cf9abd-32ed-4a94-b94b-1441fefa1012 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:31.431400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44cf9abd-32ed-4a94-b94b-1441fefa1012 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:31.431913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44cf9abd-32ed-4a94-b94b-1441fefa1012 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:31.432687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44cf9abd-32ed-4a94-b94b-1441fefa1012 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:31.433218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44cf9abd-32ed-4a94-b94b-1441fefa1012 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:31.433705 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44cf9abd-32ed-4a94-b94b-1441fefa1012 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:31.477289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d861e8c-8128-4d67-a34a-53a78a6af713 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:31.478486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9d861e8c-8128-4d67-a34a-53a78a6af713 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:31.509505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d861e8c-8128-4d67-a34a-53a78a6af713 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:31.510303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d861e8c-8128-4d67-a34a-53a78a6af713 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:31.511121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d861e8c-8128-4d67-a34a-53a78a6af713 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:31.511949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d861e8c-8128-4d67-a34a-53a78a6af713 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:31.512514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d861e8c-8128-4d67-a34a-53a78a6af713 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:31.513183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d861e8c-8128-4d67-a34a-53a78a6af713 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:31.687419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9d861e8c-8128-4d67-a34a-53a78a6af713 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:31.689085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-44cf9abd-32ed-4a94-b94b-1441fefa1012 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:31.696831 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9d861e8c-8128-4d67-a34a-53a78a6af713 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1472 microversion: 2.1 time: 0.223747 Aug 18 11:33:31.697655 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-44cf9abd-32ed-4a94-b94b-1441fefa1012 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.281936 Aug 18 11:33:31.699235 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 905/1801] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:31 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:33:31.709342 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 897/1802] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:31 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:31.719941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a3a875c9-21c5-4f09-8a68-2273a045a45a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:31.719941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a3a875c9-21c5-4f09-8a68-2273a045a45a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: e639b060-d272-4d48-8939-20d840f9c5e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:31.725315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-45e09bfe-8ee7-4a41-b5a1-e458e2726341 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:31.726185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-45e09bfe-8ee7-4a41-b5a1-e458e2726341 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:31.729423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3a875c9-21c5-4f09-8a68-2273a045a45a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:31.729874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3a875c9-21c5-4f09-8a68-2273a045a45a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:31.730386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3a875c9-21c5-4f09-8a68-2273a045a45a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:31.731210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3a875c9-21c5-4f09-8a68-2273a045a45a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:31.732439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3a875c9-21c5-4f09-8a68-2273a045a45a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:31.734152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45e09bfe-8ee7-4a41-b5a1-e458e2726341 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:31.734789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3a875c9-21c5-4f09-8a68-2273a045a45a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:31.735145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45e09bfe-8ee7-4a41-b5a1-e458e2726341 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:31.735785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45e09bfe-8ee7-4a41-b5a1-e458e2726341 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:31.736678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45e09bfe-8ee7-4a41-b5a1-e458e2726341 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:31.737305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45e09bfe-8ee7-4a41-b5a1-e458e2726341 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:31.737925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45e09bfe-8ee7-4a41-b5a1-e458e2726341 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:31.754078 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-a3a875c9-21c5-4f09-8a68-2273a045a45a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] HTTP exception thrown: Instance e639b060-d272-4d48-8939-20d840f9c5e4 could not be found. Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a3a875c9-21c5-4f09-8a68-2273a045a45a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Request method failure captured: Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4 HTTP/1.1 Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iLNyBWHRpE5A1xSuMCY-zKLcxMxeDuFIfS3bIWhBGVVZOfjC_vWC6pw3oiTARce4Kc8W_31C9CH_CpIUA5vF5-8RiEkD0K7q3Lb6Y1hcR5CEOIpadBfnPFV3fI49iJVU2VLoFDk-G0gRDfxHvYp6wTbvNAOOJLnPyCwxpak5-oPUdo Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6439cb52de454891b535bd23f11e88b1 Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-VolumesAdminNegativeTest-1930471309 Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:33:31.755852 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:33:31.757634 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6439cb52de454891b535bd23f11e88b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6439cb52de454891b535bd23f11e88b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6439cb52de454891b535bd23f11e88b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6439cb52de454891b535bd23f11e88b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:31.757634 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-VolumesAdminNegativeTest-1930471309 Aug 18 11:33:31.757634 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6439cb52de454891b535bd23f11e88b1 Aug 18 11:33:31.757634 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1930471309 Aug 18 11:33:31.757634 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-VolumesAdminNegativeTest-1930471309-project Aug 18 11:33:31.757634 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:33:31.757634 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:33:31.757634 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: d5312f9922c246a9a594be35a4a598ac Aug 18 11:33:31.757634 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-VolumesAdminNegativeTest-1930471309-project Aug 18 11:33:31.757634 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:33:31.757634 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance e639b060-d272-4d48-8939-20d840f9c5e4 could not be found. Aug 18 11:33:31.757634 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'e639b060-d272-4d48-8939-20d840f9c5e4'} Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e639b060-d272-4d48-8939-20d840f9c5e4 could not be found. Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:31.758711 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e639b060-d272-4d48-8939-20d840f9c5e4 could not be found. Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e639b060-d272-4d48-8939-20d840f9c5e4 could not be found. Aug 18 11:33:31.760505 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:31.762060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a3a875c9-21c5-4f09-8a68-2273a045a45a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Returning 404 to user: Instance e639b060-d272-4d48-8939-20d840f9c5e4 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:31.762060 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a3a875c9-21c5-4f09-8a68-2273a045a45a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4" status: 404 len: 111 microversion: 2.1 time: 0.059238 Aug 18 11:33:31.762873 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 898/1803] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:31 2022] GET /compute/v2.1/servers/e639b060-d272-4d48-8939-20d840f9c5e4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:33:31.768410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-affff7a6-e1af-4d55-86d4-b34859714b64 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:31.769229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-affff7a6-e1af-4d55-86d4-b34859714b64 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:31.775830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-affff7a6-e1af-4d55-86d4-b34859714b64 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:31.776454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-affff7a6-e1af-4d55-86d4-b34859714b64 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:31.776992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-affff7a6-e1af-4d55-86d4-b34859714b64 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:31.777806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-affff7a6-e1af-4d55-86d4-b34859714b64 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:31.778362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-affff7a6-e1af-4d55-86d4-b34859714b64 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:31.778908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-affff7a6-e1af-4d55-86d4-b34859714b64 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:31.906488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-affff7a6-e1af-4d55-86d4-b34859714b64 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:31.921051 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-affff7a6-e1af-4d55-86d4-b34859714b64 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 200 len: 1346 microversion: 2.1 time: 0.156574 Aug 18 11:33:31.922941 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 899/1804] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:31 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 1346 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:31.936816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6540ca0d-f3ea-4298-8060-77a67c98b406 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:31.937392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6540ca0d-f3ea-4298-8060-77a67c98b406 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:31.957268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6540ca0d-f3ea-4298-8060-77a67c98b406 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:31.957785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6540ca0d-f3ea-4298-8060-77a67c98b406 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:31.958233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6540ca0d-f3ea-4298-8060-77a67c98b406 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:31.960423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6540ca0d-f3ea-4298-8060-77a67c98b406 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:31.962827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6540ca0d-f3ea-4298-8060-77a67c98b406 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:31.963313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6540ca0d-f3ea-4298-8060-77a67c98b406 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:31.993051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-45e09bfe-8ee7-4a41-b5a1-e458e2726341 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:32.031863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-45e09bfe-8ee7-4a41-b5a1-e458e2726341 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:32.036447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-45e09bfe-8ee7-4a41-b5a1-e458e2726341 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:32.040640 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-45e09bfe-8ee7-4a41-b5a1-e458e2726341 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.328397 Aug 18 11:33:32.042356 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 906/1805] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:31 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:32.058545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24d87d70-42a6-438b-927b-eeeb96e5b0dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:32.064128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-24d87d70-42a6-438b-927b-eeeb96e5b0dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:32.072694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24d87d70-42a6-438b-927b-eeeb96e5b0dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:32.073252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24d87d70-42a6-438b-927b-eeeb96e5b0dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:32.073882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24d87d70-42a6-438b-927b-eeeb96e5b0dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:32.074640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24d87d70-42a6-438b-927b-eeeb96e5b0dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:32.075355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24d87d70-42a6-438b-927b-eeeb96e5b0dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:32.075954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24d87d70-42a6-438b-927b-eeeb96e5b0dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:32.321203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-24d87d70-42a6-438b-927b-eeeb96e5b0dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:32.338950 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-24d87d70-42a6-438b-927b-eeeb96e5b0dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1198 microversion: 2.1 time: 0.287493 Aug 18 11:33:32.340318 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 907/1806] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:32 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1198 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:32.349705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-130349b6-b972-4667-b02e-3dc4c0bc8c7b req-1aa7aec4-da6a-4c40-b3db-0b385c180c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a906b8-26ea-4413-bed0-9c6f7a6be35c", "name": "network-vif-unplugged", "status": "completed", "tag": "6b2318ca-00cc-4182-8517-7647cceb2c66"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:32.368649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-130349b6-b972-4667-b02e-3dc4c0bc8c7b req-1aa7aec4-da6a-4c40-b3db-0b385c180c11 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:32.369377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-130349b6-b972-4667-b02e-3dc4c0bc8c7b req-1aa7aec4-da6a-4c40-b3db-0b385c180c11 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:32.370164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-130349b6-b972-4667-b02e-3dc4c0bc8c7b req-1aa7aec4-da6a-4c40-b3db-0b385c180c11 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:32.384279 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-130349b6-b972-4667-b02e-3dc4c0bc8c7b req-1aa7aec4-da6a-4c40-b3db-0b385c180c11 service nova] Creating event network-vif-unplugged:6b2318ca-00cc-4182-8517-7647cceb2c66 for instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c on n-h1-853611-3 Aug 18 11:33:32.389641 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-130349b6-b972-4667-b02e-3dc4c0bc8c7b req-1aa7aec4-da6a-4c40-b3db-0b385c180c11 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045896 Aug 18 11:33:32.391458 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 908/1807] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:32.397632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5c40cd6c-ab10-4124-9f1c-27c73ce9ed79 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fa39820>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:32.427164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6540ca0d-f3ea-4298-8060-77a67c98b406 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:32.441859 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6540ca0d-f3ea-4298-8060-77a67c98b406 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.517239 Aug 18 11:33:32.460231 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 900/1808] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:31 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:32.477939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2b0c2449-2009-4fdd-aa0c-6a71b60f5b4a tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:32.480729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2b0c2449-2009-4fdd-aa0c-6a71b60f5b4a tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:32.497930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b0c2449-2009-4fdd-aa0c-6a71b60f5b4a tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:32.498479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b0c2449-2009-4fdd-aa0c-6a71b60f5b4a tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:32.498935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b0c2449-2009-4fdd-aa0c-6a71b60f5b4a tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:32.499666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b0c2449-2009-4fdd-aa0c-6a71b60f5b4a tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:32.500131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b0c2449-2009-4fdd-aa0c-6a71b60f5b4a tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:32.500608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b0c2449-2009-4fdd-aa0c-6a71b60f5b4a tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:32.501595 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5c40cd6c-ab10-4124-9f1c-27c73ce9ed79 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.104145 Aug 18 11:33:32.501734 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 909/1809] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:32 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:32.515134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1dbb7aa0-929e-4661-b320-3823ec3cbe4b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:32.517806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1dbb7aa0-929e-4661-b320-3823ec3cbe4b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:32.525690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dbb7aa0-929e-4661-b320-3823ec3cbe4b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:32.526449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dbb7aa0-929e-4661-b320-3823ec3cbe4b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:32.526907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dbb7aa0-929e-4661-b320-3823ec3cbe4b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:32.527799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dbb7aa0-929e-4661-b320-3823ec3cbe4b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:32.528545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dbb7aa0-929e-4661-b320-3823ec3cbe4b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:32.529041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dbb7aa0-929e-4661-b320-3823ec3cbe4b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:32.760703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1dbb7aa0-929e-4661-b320-3823ec3cbe4b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:32.772700 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1dbb7aa0-929e-4661-b320-3823ec3cbe4b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.264585 Aug 18 11:33:32.784455 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 910/1810] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:32 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:32.784455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5ee73f9b-cee7-47fe-9d89-45528f40e4bb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:32.784455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5ee73f9b-cee7-47fe-9d89-45528f40e4bb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:32.789419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ee73f9b-cee7-47fe-9d89-45528f40e4bb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:32.790469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ee73f9b-cee7-47fe-9d89-45528f40e4bb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:32.791132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ee73f9b-cee7-47fe-9d89-45528f40e4bb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:32.792530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ee73f9b-cee7-47fe-9d89-45528f40e4bb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:32.793133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ee73f9b-cee7-47fe-9d89-45528f40e4bb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:32.793840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ee73f9b-cee7-47fe-9d89-45528f40e4bb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:32.925897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2b0c2449-2009-4fdd-aa0c-6a71b60f5b4a tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:32.934021 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2b0c2449-2009-4fdd-aa0c-6a71b60f5b4a tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1322 microversion: 2.1 time: 0.474070 Aug 18 11:33:32.956378 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 901/1811] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:32 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:32.956378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-57a5eccb-4ca8-4452-b50f-bdf42a07e937 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:32.963144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-57a5eccb-4ca8-4452-b50f-bdf42a07e937 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:32.982630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57a5eccb-4ca8-4452-b50f-bdf42a07e937 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:32.983608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57a5eccb-4ca8-4452-b50f-bdf42a07e937 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:32.986454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57a5eccb-4ca8-4452-b50f-bdf42a07e937 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:32.989140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57a5eccb-4ca8-4452-b50f-bdf42a07e937 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:32.992082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57a5eccb-4ca8-4452-b50f-bdf42a07e937 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:32.992633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57a5eccb-4ca8-4452-b50f-bdf42a07e937 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:33.148017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5ee73f9b-cee7-47fe-9d89-45528f40e4bb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:33.180000 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5ee73f9b-cee7-47fe-9d89-45528f40e4bb tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1472 microversion: 2.1 time: 0.401756 Aug 18 11:33:33.183557 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 911/1812] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:32 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1472 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:33.205412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-20daaeca-25a1-4cbc-9335-1d055d026d49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:33.207052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-20daaeca-25a1-4cbc-9335-1d055d026d49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:33.227441 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-57a5eccb-4ca8-4452-b50f-bdf42a07e937 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.282858 Aug 18 11:33:33.230422 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 902/1813] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:33:32 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:33:33.233182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20daaeca-25a1-4cbc-9335-1d055d026d49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:33.235791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20daaeca-25a1-4cbc-9335-1d055d026d49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:33.236515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20daaeca-25a1-4cbc-9335-1d055d026d49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:33.240919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20daaeca-25a1-4cbc-9335-1d055d026d49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:33.243332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20daaeca-25a1-4cbc-9335-1d055d026d49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:33.244046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20daaeca-25a1-4cbc-9335-1d055d026d49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:33.253019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c0b9e3a2-4b81-4dab-a657-f4a405abb40a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:33.254471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c0b9e3a2-4b81-4dab-a657-f4a405abb40a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:33.269509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c0b9e3a2-4b81-4dab-a657-f4a405abb40a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:33.273829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c0b9e3a2-4b81-4dab-a657-f4a405abb40a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:33.276206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c0b9e3a2-4b81-4dab-a657-f4a405abb40a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:33.277264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c0b9e3a2-4b81-4dab-a657-f4a405abb40a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:33.279689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c0b9e3a2-4b81-4dab-a657-f4a405abb40a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:33.280568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c0b9e3a2-4b81-4dab-a657-f4a405abb40a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:33.337621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20daaeca-25a1-4cbc-9335-1d055d026d49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:33.339194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20daaeca-25a1-4cbc-9335-1d055d026d49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:33.341392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20daaeca-25a1-4cbc-9335-1d055d026d49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:33.342166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-20daaeca-25a1-4cbc-9335-1d055d026d49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lazy-loading 'fault' on Instance uuid 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:33:33.398763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-20daaeca-25a1-4cbc-9335-1d055d026d49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:33.411803 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-20daaeca-25a1-4cbc-9335-1d055d026d49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 200 len: 1351 microversion: 2.1 time: 0.226627 Aug 18 11:33:33.428449 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 912/1814] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:33 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 1351 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:33.434533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-37349884-859f-40a9-9d86-ceceb0e503f3 req-03abfe4b-77da-430a-afdf-4d7a92afecde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c6c996b-c6b0-4f55-97ed-b4b472dc3640", "name": "network-vif-deleted", "tag": "ffdd209f-cefa-48ce-8e0f-9845986fb9ef"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:33.448169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-37349884-859f-40a9-9d86-ceceb0e503f3 req-03abfe4b-77da-430a-afdf-4d7a92afecde service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:33.449155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-37349884-859f-40a9-9d86-ceceb0e503f3 req-03abfe4b-77da-430a-afdf-4d7a92afecde service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:33.449846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-37349884-859f-40a9-9d86-ceceb0e503f3 req-03abfe4b-77da-430a-afdf-4d7a92afecde service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:33.467945 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-37349884-859f-40a9-9d86-ceceb0e503f3 req-03abfe4b-77da-430a-afdf-4d7a92afecde service nova] Creating event network-vif-deleted:ffdd209f-cefa-48ce-8e0f-9845986fb9ef for instance 6c6c996b-c6b0-4f55-97ed-b4b472dc3640 on n-h2-853611-3 Aug 18 11:33:33.481558 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-37349884-859f-40a9-9d86-ceceb0e503f3 req-03abfe4b-77da-430a-afdf-4d7a92afecde service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051322 Aug 18 11:33:33.483442 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 913/1815] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:33.491876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac763068-10e8-4fc7-8065-f5666c7de060 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:33.493136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ac763068-10e8-4fc7-8065-f5666c7de060 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:33.501710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac763068-10e8-4fc7-8065-f5666c7de060 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:33.502640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac763068-10e8-4fc7-8065-f5666c7de060 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:33.503544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac763068-10e8-4fc7-8065-f5666c7de060 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:33.504935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac763068-10e8-4fc7-8065-f5666c7de060 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:33.505866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac763068-10e8-4fc7-8065-f5666c7de060 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:33.506573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac763068-10e8-4fc7-8065-f5666c7de060 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:33.744665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c0b9e3a2-4b81-4dab-a657-f4a405abb40a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:33.773343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c0b9e3a2-4b81-4dab-a657-f4a405abb40a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:33.774940 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c0b9e3a2-4b81-4dab-a657-f4a405abb40a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:33.783565 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c0b9e3a2-4b81-4dab-a657-f4a405abb40a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.549412 Aug 18 11:33:33.784167 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 903/1816] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:33 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:33.800727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3f13d5af-eeaf-4e27-9f06-26c5511512f6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:33.801405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3f13d5af-eeaf-4e27-9f06-26c5511512f6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:33.847488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f13d5af-eeaf-4e27-9f06-26c5511512f6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:33.847997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f13d5af-eeaf-4e27-9f06-26c5511512f6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:33.848441 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f13d5af-eeaf-4e27-9f06-26c5511512f6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:33.851527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f13d5af-eeaf-4e27-9f06-26c5511512f6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:33.852022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f13d5af-eeaf-4e27-9f06-26c5511512f6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:33.852462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f13d5af-eeaf-4e27-9f06-26c5511512f6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:33.897515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ac763068-10e8-4fc7-8065-f5666c7de060 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:33.908723 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ac763068-10e8-4fc7-8065-f5666c7de060 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1671 microversion: 2.1 time: 0.422568 Aug 18 11:33:33.910066 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 914/1817] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:33 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1671 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:33.923572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02d0fb17-ca19-4693-a4eb-a28d819b1606 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fc2df70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:34.017797 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-02d0fb17-ca19-4693-a4eb-a28d819b1606 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.102962 Aug 18 11:33:34.019033 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 915/1818] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:33 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:34.027479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-07f9092b-e59e-4b2b-a1bd-72f2ffbf4b77 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:34.028254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-07f9092b-e59e-4b2b-a1bd-72f2ffbf4b77 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:34.045288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07f9092b-e59e-4b2b-a1bd-72f2ffbf4b77 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:34.046059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07f9092b-e59e-4b2b-a1bd-72f2ffbf4b77 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:34.046778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07f9092b-e59e-4b2b-a1bd-72f2ffbf4b77 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:34.048709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07f9092b-e59e-4b2b-a1bd-72f2ffbf4b77 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:34.049830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07f9092b-e59e-4b2b-a1bd-72f2ffbf4b77 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:34.050762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07f9092b-e59e-4b2b-a1bd-72f2ffbf4b77 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:34.272588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-07f9092b-e59e-4b2b-a1bd-72f2ffbf4b77 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:34.281408 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-07f9092b-e59e-4b2b-a1bd-72f2ffbf4b77 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 200 len: 1515 microversion: 2.1 time: 0.259087 Aug 18 11:33:34.283241 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 916/1819] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:34 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 1515 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:34.301488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-12d11a41-f396-427d-9f4e-8a84b0d87aa8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:34.302554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-12d11a41-f396-427d-9f4e-8a84b0d87aa8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:34.323348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d11a41-f396-427d-9f4e-8a84b0d87aa8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:34.327189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d11a41-f396-427d-9f4e-8a84b0d87aa8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:34.336937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d11a41-f396-427d-9f4e-8a84b0d87aa8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:34.337918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d11a41-f396-427d-9f4e-8a84b0d87aa8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:34.342574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3f13d5af-eeaf-4e27-9f06-26c5511512f6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:34.346993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d11a41-f396-427d-9f4e-8a84b0d87aa8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:34.347551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d11a41-f396-427d-9f4e-8a84b0d87aa8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:34.364177 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3f13d5af-eeaf-4e27-9f06-26c5511512f6 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1381 microversion: 2.1 time: 0.575460 Aug 18 11:33:34.367094 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 904/1820] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:33 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1381 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:34.379458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-131af7f2-afb4-480c-ae0a-3de4d69e203b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:34.382060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-131af7f2-afb4-480c-ae0a-3de4d69e203b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:34.399085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131af7f2-afb4-480c-ae0a-3de4d69e203b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:34.401165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131af7f2-afb4-480c-ae0a-3de4d69e203b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:34.403456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131af7f2-afb4-480c-ae0a-3de4d69e203b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:34.405971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131af7f2-afb4-480c-ae0a-3de4d69e203b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:34.407520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131af7f2-afb4-480c-ae0a-3de4d69e203b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:34.408241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131af7f2-afb4-480c-ae0a-3de4d69e203b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:34.469868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d11a41-f396-427d-9f4e-8a84b0d87aa8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:34.474889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d11a41-f396-427d-9f4e-8a84b0d87aa8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:34.475467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d11a41-f396-427d-9f4e-8a84b0d87aa8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:34.476032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-12d11a41-f396-427d-9f4e-8a84b0d87aa8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lazy-loading 'fault' on Instance uuid 6c6c996b-c6b0-4f55-97ed-b4b472dc3640 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:33:34.551845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-12d11a41-f396-427d-9f4e-8a84b0d87aa8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368fa7a976b745ae8ab1251352a56975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933f2e895a88476593bf14a643c2b7f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:34.563620 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-12d11a41-f396-427d-9f4e-8a84b0d87aa8 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 200 len: 1307 microversion: 2.1 time: 0.278118 Aug 18 11:33:34.570597 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 917/1821] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:34 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 1307 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:34.760574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-004efa14-cd20-4a6d-9848-d31c4145c03a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:34.761426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-004efa14-cd20-4a6d-9848-d31c4145c03a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:34.772136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-004efa14-cd20-4a6d-9848-d31c4145c03a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:34.772892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-004efa14-cd20-4a6d-9848-d31c4145c03a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:34.775630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-004efa14-cd20-4a6d-9848-d31c4145c03a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:34.776372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-004efa14-cd20-4a6d-9848-d31c4145c03a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:34.776830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-004efa14-cd20-4a6d-9848-d31c4145c03a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:34.778599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-004efa14-cd20-4a6d-9848-d31c4145c03a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:34.822004 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-131af7f2-afb4-480c-ae0a-3de4d69e203b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:34.832277 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-131af7f2-afb4-480c-ae0a-3de4d69e203b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84" status: 200 len: 1515 microversion: 2.1 time: 0.463908 Aug 18 11:33:34.850762 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 905/1822] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:34 2022] GET /compute/v2.1/servers/8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 => generated 1515 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:34.850762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-bd74289b-88c0-4d4e-9e67-ae338b17a751 req-2bf61490-3bc8-420b-bc47-c3d5c9fd08eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a25b73-ea72-405a-b127-add6779c63d6", "name": "network-vif-plugged", "status": "completed", "tag": "e08c585a-7b0e-4a25-afaf-7bbad84d469a"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:34.869492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bd74289b-88c0-4d4e-9e67-ae338b17a751 req-2bf61490-3bc8-420b-bc47-c3d5c9fd08eb service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:34.871889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bd74289b-88c0-4d4e-9e67-ae338b17a751 req-2bf61490-3bc8-420b-bc47-c3d5c9fd08eb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:34.872457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bd74289b-88c0-4d4e-9e67-ae338b17a751 req-2bf61490-3bc8-420b-bc47-c3d5c9fd08eb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:34.903045 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-bd74289b-88c0-4d4e-9e67-ae338b17a751 req-2bf61490-3bc8-420b-bc47-c3d5c9fd08eb service nova] Creating event network-vif-plugged:e08c585a-7b0e-4a25-afaf-7bbad84d469a for instance e2a25b73-ea72-405a-b127-add6779c63d6 on n-h1-853611-3 Aug 18 11:33:34.915532 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-bd74289b-88c0-4d4e-9e67-ae338b17a751 req-2bf61490-3bc8-420b-bc47-c3d5c9fd08eb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079201 Aug 18 11:33:34.922902 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 906/1823] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:34.931414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3f92894-0225-4fab-b70f-eb232b9a246c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:34.932632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d3f92894-0225-4fab-b70f-eb232b9a246c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:34.942982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3f92894-0225-4fab-b70f-eb232b9a246c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:34.943876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3f92894-0225-4fab-b70f-eb232b9a246c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:34.944826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3f92894-0225-4fab-b70f-eb232b9a246c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:34.947325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3f92894-0225-4fab-b70f-eb232b9a246c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:34.948935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3f92894-0225-4fab-b70f-eb232b9a246c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:34.949801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3f92894-0225-4fab-b70f-eb232b9a246c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:34.968604 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-d3f92894-0225-4fab-b70f-eb232b9a246c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3f92894-0225-4fab-b70f-eb232b9a246c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 HTTP/1.1 Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:33:34.972462 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:33:34.974122 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:34.974122 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:33:34.974122 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:33:34.974122 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:33:34.974122 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:33:34.974122 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:33:34.974122 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:33:34.974122 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:33:34.974122 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:33:34.974122 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:33:34.974122 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:33:34.974122 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '5ecc4c6b-9de9-497a-8421-657f7f6a4cb0'} Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:34.975048 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:33:34.978074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:34.981645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3f92894-0225-4fab-b70f-eb232b9a246c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:34.983019 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d3f92894-0225-4fab-b70f-eb232b9a246c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 404 len: 111 microversion: 2.1 time: 0.058062 Aug 18 11:33:34.984008 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 907/1824] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:34 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:33:34.985165 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-004efa14-cd20-4a6d-9848-d31c4145c03a tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1532 microversion: 2.1 time: 0.412449 Aug 18 11:33:34.986084 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 918/1825] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:34 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1532 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:34.991205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a77b34df-050c-48c3-9f1e-d523d1397a6e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:34.992667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a77b34df-050c-48c3-9f1e-d523d1397a6e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:34.999435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a77b34df-050c-48c3-9f1e-d523d1397a6e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.001096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a77b34df-050c-48c3-9f1e-d523d1397a6e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.002320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a77b34df-050c-48c3-9f1e-d523d1397a6e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.003358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a77b34df-050c-48c3-9f1e-d523d1397a6e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.004375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a77b34df-050c-48c3-9f1e-d523d1397a6e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.005045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a77b34df-050c-48c3-9f1e-d523d1397a6e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.005870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0cfdbc72-c0c2-4b88-975b-097c2191ef49 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:35.006504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0cfdbc72-c0c2-4b88-975b-097c2191ef49 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: dc571952-f3e6-43fc-984c-85c632fa12ca] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:35.013915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cfdbc72-c0c2-4b88-975b-097c2191ef49 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.028452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cfdbc72-c0c2-4b88-975b-097c2191ef49 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.029231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cfdbc72-c0c2-4b88-975b-097c2191ef49 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.030368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cfdbc72-c0c2-4b88-975b-097c2191ef49 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.031043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cfdbc72-c0c2-4b88-975b-097c2191ef49 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.031779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cfdbc72-c0c2-4b88-975b-097c2191ef49 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.289143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0cfdbc72-c0c2-4b88-975b-097c2191ef49 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:35.291893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a77b34df-050c-48c3-9f1e-d523d1397a6e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:35.303260 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0cfdbc72-c0c2-4b88-975b-097c2191ef49 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca" status: 200 len: 1514 microversion: 2.1 time: 0.316305 Aug 18 11:33:35.306956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a77b34df-050c-48c3-9f1e-d523d1397a6e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:35.309291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a77b34df-050c-48c3-9f1e-d523d1397a6e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:35.310867 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a77b34df-050c-48c3-9f1e-d523d1397a6e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.323853 Aug 18 11:33:35.313831 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 908/1826] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:34 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:35.340383 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 919/1827] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:34 2022] GET /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca => generated 1514 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:35.346137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cb9b2909-d2ec-4344-aba8-b232ca086bd3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:35.348303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cb9b2909-d2ec-4344-aba8-b232ca086bd3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:35.352825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-302326da-3f9f-433b-973c-b603db730f10 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:35.354646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-302326da-3f9f-433b-973c-b603db730f10 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:35.366449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb9b2909-d2ec-4344-aba8-b232ca086bd3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.367060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb9b2909-d2ec-4344-aba8-b232ca086bd3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.367591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb9b2909-d2ec-4344-aba8-b232ca086bd3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.371422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb9b2909-d2ec-4344-aba8-b232ca086bd3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.371948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb9b2909-d2ec-4344-aba8-b232ca086bd3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.372392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb9b2909-d2ec-4344-aba8-b232ca086bd3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.373498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-302326da-3f9f-433b-973c-b603db730f10 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.374241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-302326da-3f9f-433b-973c-b603db730f10 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.375673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-302326da-3f9f-433b-973c-b603db730f10 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.377060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-302326da-3f9f-433b-973c-b603db730f10 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.378097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-302326da-3f9f-433b-973c-b603db730f10 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.379016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-302326da-3f9f-433b-973c-b603db730f10 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.658308 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-302326da-3f9f-433b-973c-b603db730f10 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1532 microversion: 2.1 time: 0.311155 Aug 18 11:33:35.659898 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 920/1828] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:35 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1532 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:35.690167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bc4a12fb-be93-4a9d-a414-c8ea87f0d325 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fd89a60>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:35.740108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cb9b2909-d2ec-4344-aba8-b232ca086bd3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:35.751273 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cb9b2909-d2ec-4344-aba8-b232ca086bd3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1676 microversion: 2.1 time: 0.435706 Aug 18 11:33:35.752655 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 909/1829] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:35 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1676 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:35.757901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-521d9e5b-6d39-430e-9678-4f4974196dd8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:35.761220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-521d9e5b-6d39-430e-9678-4f4974196dd8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:35.770780 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-521d9e5b-6d39-430e-9678-4f4974196dd8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.772345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-521d9e5b-6d39-430e-9678-4f4974196dd8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.772989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-521d9e5b-6d39-430e-9678-4f4974196dd8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.777526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-521d9e5b-6d39-430e-9678-4f4974196dd8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.777714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-521d9e5b-6d39-430e-9678-4f4974196dd8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.778156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-521d9e5b-6d39-430e-9678-4f4974196dd8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.793350 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bc4a12fb-be93-4a9d-a414-c8ea87f0d325 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.127814 Aug 18 11:33:35.794703 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-521d9e5b-6d39-430e-9678-4f4974196dd8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:33:35.795256 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 921/1830] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:35 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-521d9e5b-6d39-430e-9678-4f4974196dd8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0/os-volume_attachments HTTP/1.1 Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:33:35.796440 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:33:35.798336 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:35.798336 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:33:35.798336 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:33:35.798336 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:33:35.798336 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:33:35.798336 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:33:35.798336 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:33:35.798336 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:33:35.798336 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:33:35.798336 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:33:35.798336 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:33:35.798336 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'server_id': '5ecc4c6b-9de9-497a-8421-657f7f6a4cb0'} Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:35.799304 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:33:35.800732 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:35.802770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-521d9e5b-6d39-430e-9678-4f4974196dd8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:35.802770 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-521d9e5b-6d39-430e-9678-4f4974196dd8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044155 Aug 18 11:33:35.802770 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 910/1831] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:33:35 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:33:35.807261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-65286b08-f409-4e10-9589-f8913ead8597 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:35.807880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-65286b08-f409-4e10-9589-f8913ead8597 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] [instance: 6c6c996b-c6b0-4f55-97ed-b4b472dc3640] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:35.815737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65286b08-f409-4e10-9589-f8913ead8597 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.816411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65286b08-f409-4e10-9589-f8913ead8597 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.817126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65286b08-f409-4e10-9589-f8913ead8597 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.818022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65286b08-f409-4e10-9589-f8913ead8597 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.818702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65286b08-f409-4e10-9589-f8913ead8597 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.819295 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65286b08-f409-4e10-9589-f8913ead8597 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.831534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fde09397-6aa7-4607-919a-2612de3a18f3 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:35.832105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fde09397-6aa7-4607-919a-2612de3a18f3 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: dc571952-f3e6-43fc-984c-85c632fa12ca] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:35.839300 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-65286b08-f409-4e10-9589-f8913ead8597 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] HTTP exception thrown: Instance 6c6c996b-c6b0-4f55-97ed-b4b472dc3640 could not be found. Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-65286b08-f409-4e10-9589-f8913ead8597 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Request method failure captured: Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 HTTP/1.1 Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMjfRC-O8PK_EouMjP6hN6W7GFuUm8qVLrXLLfvWoh_BmvsHGZINu0MaP0VYWFOrQ1qZ8zjEruT5C1t-cytRaGCTf4oXnxD3U8S1xKx9ZukmNRQ1f32uuukBtZg-gvqrP4W1VZQFIV3BPIsbR_EnyJflENSRi5ho1dBYDS_A4rlfuA Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 933f2e895a88476593bf14a643c2b7f6 Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesOneServerTestJSON-516433174 Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:33:35.841485 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:33:35.843360 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/933f2e895a88476593bf14a643c2b7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/933f2e895a88476593bf14a643c2b7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_933f2e895a88476593bf14a643c2b7f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/933f2e895a88476593bf14a643c2b7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:35.843360 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesOneServerTestJSON-516433174 Aug 18 11:33:35.843360 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 933f2e895a88476593bf14a643c2b7f6 Aug 18 11:33:35.843360 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-516433174 Aug 18 11:33:35.843360 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesOneServerTestJSON-516433174-project Aug 18 11:33:35.843360 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:33:35.843360 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:33:35.843360 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 368fa7a976b745ae8ab1251352a56975 Aug 18 11:33:35.843360 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesOneServerTestJSON-516433174-project Aug 18 11:33:35.843360 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:33:35.843360 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 6c6c996b-c6b0-4f55-97ed-b4b472dc3640 could not be found. Aug 18 11:33:35.843360 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '6c6c996b-c6b0-4f55-97ed-b4b472dc3640'} Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c6c996b-c6b0-4f55-97ed-b4b472dc3640 could not be found. Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:35.844395 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c6c996b-c6b0-4f55-97ed-b4b472dc3640 could not be found. Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c6c996b-c6b0-4f55-97ed-b4b472dc3640 could not be found. Aug 18 11:33:35.846022 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:35.849061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-65286b08-f409-4e10-9589-f8913ead8597 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] Returning 404 to user: Instance 6c6c996b-c6b0-4f55-97ed-b4b472dc3640 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:35.850104 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-65286b08-f409-4e10-9589-f8913ead8597 tempest-ImagesOneServerTestJSON-516433174 tempest-ImagesOneServerTestJSON-516433174-project] 10.222.0.73 "GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640" status: 404 len: 111 microversion: 2.1 time: 0.046861 Aug 18 11:33:35.851645 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 911/1832] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:35 2022] GET /compute/v2.1/servers/6c6c996b-c6b0-4f55-97ed-b4b472dc3640 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:33:35.851957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fde09397-6aa7-4607-919a-2612de3a18f3 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.853187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fde09397-6aa7-4607-919a-2612de3a18f3 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.853630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fde09397-6aa7-4607-919a-2612de3a18f3 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.858513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8a6f1fda-fcc3-4824-b258-f64ffb6c199b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:35.861684 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:33:35.861684 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:33:35.863421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8a6f1fda-fcc3-4824-b258-f64ffb6c199b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.863978 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8a6f1fda-fcc3-4824-b258-f64ffb6c199b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.864451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8a6f1fda-fcc3-4824-b258-f64ffb6c199b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.865369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8a6f1fda-fcc3-4824-b258-f64ffb6c199b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.865616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8a6f1fda-fcc3-4824-b258-f64ffb6c199b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.866041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8a6f1fda-fcc3-4824-b258-f64ffb6c199b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.871258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fde09397-6aa7-4607-919a-2612de3a18f3 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.873792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fde09397-6aa7-4607-919a-2612de3a18f3 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.875944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fde09397-6aa7-4607-919a-2612de3a18f3 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.917471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fde09397-6aa7-4607-919a-2612de3a18f3 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: dc571952-f3e6-43fc-984c-85c632fa12ca] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:33:35.925981 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8a6f1fda-fcc3-4824-b258-f64ffb6c199b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.072338 Aug 18 11:33:35.935411 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 912/1833] 10.222.0.73 () {58 vars in 1176 bytes} [Thu Aug 18 11:33:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:35.940883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7583eb63-4fc7-4cfd-a55a-7f30fe10a157 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-853611-3", "block_migration": false, "disk_over_commit": false}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:35.956178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7583eb63-4fc7-4cfd-a55a-7f30fe10a157 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:35.978109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7583eb63-4fc7-4cfd-a55a-7f30fe10a157 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.986659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7583eb63-4fc7-4cfd-a55a-7f30fe10a157 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.991102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7583eb63-4fc7-4cfd-a55a-7f30fe10a157 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:35.994675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7583eb63-4fc7-4cfd-a55a-7f30fe10a157 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:35.995802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7583eb63-4fc7-4cfd-a55a-7f30fe10a157 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:35.997346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7583eb63-4fc7-4cfd-a55a-7f30fe10a157 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:36.044192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-7583eb63-4fc7-4cfd-a55a-7f30fe10a157 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lazy-loading 'flavor' on Instance uuid 2979b2d3-3055-479e-ad21-b8aac94ee848 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:33:36.064696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7583eb63-4fc7-4cfd-a55a-7f30fe10a157 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Going to try to live migrate instance to n-h1-853611-3 {{(pid=122209) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 18 11:33:36.073248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:36.099283 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fde09397-6aa7-4607-919a-2612de3a18f3 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca" status: 204 len: 0 microversion: 2.1 time: 0.282226 Aug 18 11:33:36.106995 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 922/1834] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:33:35 2022] DELETE /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:33:36.116725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-096ad9b8-40d7-40da-adfe-b1078f353c6f tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:36.121689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-096ad9b8-40d7-40da-adfe-b1078f353c6f tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: dc571952-f3e6-43fc-984c-85c632fa12ca] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:36.133139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-096ad9b8-40d7-40da-adfe-b1078f353c6f tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:36.134052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-096ad9b8-40d7-40da-adfe-b1078f353c6f tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:36.135374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-096ad9b8-40d7-40da-adfe-b1078f353c6f tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:36.136636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-096ad9b8-40d7-40da-adfe-b1078f353c6f tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:36.137942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-096ad9b8-40d7-40da-adfe-b1078f353c6f tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:36.138714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-096ad9b8-40d7-40da-adfe-b1078f353c6f tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:36.174351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:36.410871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-096ad9b8-40d7-40da-adfe-b1078f353c6f tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:36.421526 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-096ad9b8-40d7-40da-adfe-b1078f353c6f tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca" status: 200 len: 1520 microversion: 2.1 time: 0.309106 Aug 18 11:33:36.423357 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 923/1835] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:36 2022] GET /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:36.440805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-27494994", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "22608490-9e6a-4848-bc6d-66289c233bc1"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:36.513104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] validate_networks() for [('22608490-9e6a-4848-bc6d-66289c233bc1', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:33:37.358031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:33:37.358971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:33:37.362129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:33:37.364154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:33:37.365034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:33:37.398177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:37.398809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:37.399261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:37.400049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:37.400518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:37.400941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:37.449267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Getting quotas for project a98846d5998440dd87f3d85de0bf9d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:33:37.460475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Getting quotas for user 7bf7b0cd3d8740aca2d71944bc371d75 and project a98846d5998440dd87f3d85de0bf9d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:33:37.575969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:33:37.595559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: a78df714-e554-4024-a8ad-625d14ed6b0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:33:37.713088 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8588e10a-a3c9-4ad9-af1d-40a47ca8da98 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.288101 Aug 18 11:33:37.720913 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 924/1836] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:33:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:33:37.728311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e14f3b3-4bc5-4a41-a646-ae4a22f9b538 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:37.730113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1e14f3b3-4bc5-4a41-a646-ae4a22f9b538 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:37.754683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e14f3b3-4bc5-4a41-a646-ae4a22f9b538 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:37.755655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e14f3b3-4bc5-4a41-a646-ae4a22f9b538 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:37.756393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e14f3b3-4bc5-4a41-a646-ae4a22f9b538 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:37.757648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e14f3b3-4bc5-4a41-a646-ae4a22f9b538 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:37.760282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e14f3b3-4bc5-4a41-a646-ae4a22f9b538 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:37.760850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e14f3b3-4bc5-4a41-a646-ae4a22f9b538 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:38.122813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1e14f3b3-4bc5-4a41-a646-ae4a22f9b538 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:38.132288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1e14f3b3-4bc5-4a41-a646-ae4a22f9b538 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:38.145288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1e14f3b3-4bc5-4a41-a646-ae4a22f9b538 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:38.146649 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1e14f3b3-4bc5-4a41-a646-ae4a22f9b538 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.428413 Aug 18 11:33:38.150515 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 925/1837] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:37 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:38.169177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-33ab8a0f-2dd4-414b-ab59-884a30c52092 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:38.170159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-33ab8a0f-2dd4-414b-ab59-884a30c52092 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:38.186716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33ab8a0f-2dd4-414b-ab59-884a30c52092 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:38.188312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33ab8a0f-2dd4-414b-ab59-884a30c52092 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:38.189017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33ab8a0f-2dd4-414b-ab59-884a30c52092 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:38.189955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33ab8a0f-2dd4-414b-ab59-884a30c52092 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:38.190679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33ab8a0f-2dd4-414b-ab59-884a30c52092 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:38.191337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33ab8a0f-2dd4-414b-ab59-884a30c52092 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:38.547111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-33ab8a0f-2dd4-414b-ab59-884a30c52092 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:38.560108 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-33ab8a0f-2dd4-414b-ab59-884a30c52092 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.408304 Aug 18 11:33:38.561851 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 926/1838] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:38 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:38.569407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8c87131b-fc85-4762-b9c1-57e10fd1fa04 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fbc7160>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:38.700918 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8c87131b-fc85-4762-b9c1-57e10fd1fa04 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.137319 Aug 18 11:33:38.701993 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 927/1839] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:38 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:38.732092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-72d4edba-1f41-49bc-94a4-527a46adeaab tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:38.746403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-72d4edba-1f41-49bc-94a4-527a46adeaab tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: dc571952-f3e6-43fc-984c-85c632fa12ca] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:38.784287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72d4edba-1f41-49bc-94a4-527a46adeaab tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:38.785665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72d4edba-1f41-49bc-94a4-527a46adeaab tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:38.788370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72d4edba-1f41-49bc-94a4-527a46adeaab tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:38.792621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72d4edba-1f41-49bc-94a4-527a46adeaab tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:38.795043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72d4edba-1f41-49bc-94a4-527a46adeaab tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:38.803001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72d4edba-1f41-49bc-94a4-527a46adeaab tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:39.068805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-72d4edba-1f41-49bc-94a4-527a46adeaab tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:39.089745 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-72d4edba-1f41-49bc-94a4-527a46adeaab tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca" status: 200 len: 1478 microversion: 2.1 time: 0.385885 Aug 18 11:33:39.111002 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 928/1840] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:38 2022] GET /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca => generated 1478 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:39.126602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b819abed-59e5-4ee8-bade-15f19ec1e586 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:39.127230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b819abed-59e5-4ee8-bade-15f19ec1e586 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: a78df714-e554-4024-a8ad-625d14ed6b0c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:39.177890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b819abed-59e5-4ee8-bade-15f19ec1e586 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:39.178993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b819abed-59e5-4ee8-bade-15f19ec1e586 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:39.182047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b819abed-59e5-4ee8-bade-15f19ec1e586 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:39.188410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b819abed-59e5-4ee8-bade-15f19ec1e586 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:39.189199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b819abed-59e5-4ee8-bade-15f19ec1e586 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:39.191424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b819abed-59e5-4ee8-bade-15f19ec1e586 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:39.400802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b819abed-59e5-4ee8-bade-15f19ec1e586 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:39.418134 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b819abed-59e5-4ee8-bade-15f19ec1e586 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c" status: 200 len: 1217 microversion: 2.1 time: 0.300786 Aug 18 11:33:39.422512 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 929/1841] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:39 2022] GET /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c => generated 1217 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:39.434616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-01070964-b9a7-4e8c-8e59-ed81f7ad63df tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:39.441615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-01070964-b9a7-4e8c-8e59-ed81f7ad63df tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:39.458332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01070964-b9a7-4e8c-8e59-ed81f7ad63df tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:39.460338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01070964-b9a7-4e8c-8e59-ed81f7ad63df tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:39.461954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01070964-b9a7-4e8c-8e59-ed81f7ad63df tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:39.464824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01070964-b9a7-4e8c-8e59-ed81f7ad63df tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:39.467595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01070964-b9a7-4e8c-8e59-ed81f7ad63df tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:39.470362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01070964-b9a7-4e8c-8e59-ed81f7ad63df tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:39.560029 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-01070964-b9a7-4e8c-8e59-ed81f7ad63df tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 200 len: 322 microversion: 2.1 time: 0.133226 Aug 18 11:33:39.568311 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 930/1842] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:33:39 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:39.592626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-fd6fc958-600a-4859-ba44-01578af8370b req-f72f6c04-ceaf-4925-a996-2a7f452bebb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc571952-f3e6-43fc-984c-85c632fa12ca", "name": "network-vif-deleted", "tag": "d13c51ee-6c0f-4546-bde0-dc5d63e83f9d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:39.620318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fd6fc958-600a-4859-ba44-01578af8370b req-f72f6c04-ceaf-4925-a996-2a7f452bebb1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:39.621657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fd6fc958-600a-4859-ba44-01578af8370b req-f72f6c04-ceaf-4925-a996-2a7f452bebb1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:39.622276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fd6fc958-600a-4859-ba44-01578af8370b req-f72f6c04-ceaf-4925-a996-2a7f452bebb1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:39.652504 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-fd6fc958-600a-4859-ba44-01578af8370b req-f72f6c04-ceaf-4925-a996-2a7f452bebb1 service nova] Creating event network-vif-deleted:d13c51ee-6c0f-4546-bde0-dc5d63e83f9d for instance dc571952-f3e6-43fc-984c-85c632fa12ca on n-h2-853611-3 Aug 18 11:33:39.662129 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-fd6fc958-600a-4859-ba44-01578af8370b req-f72f6c04-ceaf-4925-a996-2a7f452bebb1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091942 Aug 18 11:33:39.663919 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 931/1843] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:39.673055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f746ff89-c093-4a16-b5ae-b4faebc15d26 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:39.675875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f746ff89-c093-4a16-b5ae-b4faebc15d26 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:39.684379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f746ff89-c093-4a16-b5ae-b4faebc15d26 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:39.685419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f746ff89-c093-4a16-b5ae-b4faebc15d26 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:39.686106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f746ff89-c093-4a16-b5ae-b4faebc15d26 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:39.687624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f746ff89-c093-4a16-b5ae-b4faebc15d26 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:39.688510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f746ff89-c093-4a16-b5ae-b4faebc15d26 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:39.689367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f746ff89-c093-4a16-b5ae-b4faebc15d26 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:39.906168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f746ff89-c093-4a16-b5ae-b4faebc15d26 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:39.919374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f746ff89-c093-4a16-b5ae-b4faebc15d26 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:39.923337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f746ff89-c093-4a16-b5ae-b4faebc15d26 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:39.924856 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f746ff89-c093-4a16-b5ae-b4faebc15d26 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.259450 Aug 18 11:33:39.926023 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 932/1844] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:39 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:39.931308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-396381dd-68bb-43f9-a52e-69d3ad30bdbd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:39.932096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-396381dd-68bb-43f9-a52e-69d3ad30bdbd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: a78df714-e554-4024-a8ad-625d14ed6b0c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:39.939949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-396381dd-68bb-43f9-a52e-69d3ad30bdbd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:39.940834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-396381dd-68bb-43f9-a52e-69d3ad30bdbd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:39.941510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-396381dd-68bb-43f9-a52e-69d3ad30bdbd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:39.942840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-396381dd-68bb-43f9-a52e-69d3ad30bdbd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:39.943531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-396381dd-68bb-43f9-a52e-69d3ad30bdbd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:39.944029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-396381dd-68bb-43f9-a52e-69d3ad30bdbd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:39.996930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-396381dd-68bb-43f9-a52e-69d3ad30bdbd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: a78df714-e554-4024-a8ad-625d14ed6b0c] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:33:40.014027 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7583eb63-4fc7-4cfd-a55a-7f30fe10a157 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848/action" status: 202 len: 0 microversion: 2.1 time: 4.077003 Aug 18 11:33:40.019567 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 913/1845] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:33:35 2022] POST /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848/action => generated 0 bytes in 4083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:33:40.025238 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-69de9601-d2d0-45d1-9af8-2d6682a13707 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:40.026253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-69de9601-d2d0-45d1-9af8-2d6682a13707 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:40.053100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69de9601-d2d0-45d1-9af8-2d6682a13707 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:40.059923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69de9601-d2d0-45d1-9af8-2d6682a13707 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:40.064640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69de9601-d2d0-45d1-9af8-2d6682a13707 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:40.072148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69de9601-d2d0-45d1-9af8-2d6682a13707 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:40.072999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69de9601-d2d0-45d1-9af8-2d6682a13707 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:40.073766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69de9601-d2d0-45d1-9af8-2d6682a13707 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:40.166330 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-396381dd-68bb-43f9-a52e-69d3ad30bdbd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c" status: 204 len: 0 microversion: 2.1 time: 0.238208 Aug 18 11:33:40.167941 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 933/1846] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:33:39 2022] DELETE /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:33:40.176386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2aab0a1-c803-49af-8d84-eef9ea955981 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fca60d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:40.246953 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b2aab0a1-c803-49af-8d84-eef9ea955981 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.076639 Aug 18 11:33:40.256260 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 934/1847] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:40 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:40.262454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-db236cf8-e474-46e2-82de-05ada0ba77d0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:40.263623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-db236cf8-e474-46e2-82de-05ada0ba77d0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:40.274774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db236cf8-e474-46e2-82de-05ada0ba77d0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:40.275475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db236cf8-e474-46e2-82de-05ada0ba77d0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:40.276259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db236cf8-e474-46e2-82de-05ada0ba77d0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:40.278078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db236cf8-e474-46e2-82de-05ada0ba77d0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:40.278937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db236cf8-e474-46e2-82de-05ada0ba77d0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:40.279856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db236cf8-e474-46e2-82de-05ada0ba77d0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:40.624085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-db236cf8-e474-46e2-82de-05ada0ba77d0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:40.641070 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-db236cf8-e474-46e2-82de-05ada0ba77d0 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.382351 Aug 18 11:33:40.642843 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 935/1848] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:40 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:40.648922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08764b7a-d8e6-4188-8232-7ca2f34a4871 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:40.649892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-08764b7a-d8e6-4188-8232-7ca2f34a4871 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: dc571952-f3e6-43fc-984c-85c632fa12ca] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:40.660130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08764b7a-d8e6-4188-8232-7ca2f34a4871 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:40.660975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08764b7a-d8e6-4188-8232-7ca2f34a4871 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:40.661952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08764b7a-d8e6-4188-8232-7ca2f34a4871 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:40.662998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08764b7a-d8e6-4188-8232-7ca2f34a4871 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:40.663640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08764b7a-d8e6-4188-8232-7ca2f34a4871 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:40.664339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08764b7a-d8e6-4188-8232-7ca2f34a4871 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:40.696275 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-08764b7a-d8e6-4188-8232-7ca2f34a4871 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] HTTP exception thrown: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08764b7a-d8e6-4188-8232-7ca2f34a4871 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Request method failure captured: Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca HTTP/1.1 Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iNZdcAg8SY4hlhh9Drx4_tcjizL0r44nIOuI_79_Wuzsra1AbZA26rHsn4Xo8ZrEABkwxjZWXv_aKhLGCuGtym3qJHuddyYJxsYOEXwSiPvRPgFc8Uc4GtUB0IP_UCkV4ozw1UsdEnOSzPevQNGTXtADLHG3FxTvgra5idI3UXLuk0 Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:33:40.698904 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:33:40.700920 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:40.700920 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:40.700920 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:40.700920 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:40.700920 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:40.700920 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:33:40.700920 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:33:40.700920 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 0ab807fb8bcd4081ac5140bb24b4358c Aug 18 11:33:40.700920 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:40.700920 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:33:40.700920 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:40.700920 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'dc571952-f3e6-43fc-984c-85c632fa12ca'} Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:40.702025 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:40.704692 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:40.708639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08764b7a-d8e6-4188-8232-7ca2f34a4871 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Returning 404 to user: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:40.711417 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-08764b7a-d8e6-4188-8232-7ca2f34a4871 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca" status: 404 len: 111 microversion: 2.1 time: 0.067223 Aug 18 11:33:40.711995 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 936/1849] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:40 2022] GET /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:33:40.723721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c3e7602a-f6e3-483a-b4fc-ecf3f74e0724 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:40.724646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c3e7602a-f6e3-483a-b4fc-ecf3f74e0724 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: a78df714-e554-4024-a8ad-625d14ed6b0c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:40.737081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3e7602a-f6e3-483a-b4fc-ecf3f74e0724 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:40.737586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3e7602a-f6e3-483a-b4fc-ecf3f74e0724 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:40.738039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3e7602a-f6e3-483a-b4fc-ecf3f74e0724 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:40.738900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3e7602a-f6e3-483a-b4fc-ecf3f74e0724 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:40.739520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3e7602a-f6e3-483a-b4fc-ecf3f74e0724 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:40.739968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3e7602a-f6e3-483a-b4fc-ecf3f74e0724 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:40.813272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c3e7602a-f6e3-483a-b4fc-ecf3f74e0724 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:40.821256 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c3e7602a-f6e3-483a-b4fc-ecf3f74e0724 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c" status: 200 len: 1215 microversion: 2.1 time: 0.101411 Aug 18 11:33:40.823949 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 937/1850] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:40 2022] GET /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:40.854018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bcc7cb1f-a9d6-4e62-b604-aa7ee9e05f19 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:40.862707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bcc7cb1f-a9d6-4e62-b604-aa7ee9e05f19 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:40.866512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bcc7cb1f-a9d6-4e62-b604-aa7ee9e05f19 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '845b1ec9db86457a9b110eef1b36d898'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:33:40.882211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcc7cb1f-a9d6-4e62-b604-aa7ee9e05f19 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:40.884108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcc7cb1f-a9d6-4e62-b604-aa7ee9e05f19 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:40.887096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcc7cb1f-a9d6-4e62-b604-aa7ee9e05f19 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:40.891103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcc7cb1f-a9d6-4e62-b604-aa7ee9e05f19 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:40.891103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcc7cb1f-a9d6-4e62-b604-aa7ee9e05f19 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:40.892188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcc7cb1f-a9d6-4e62-b604-aa7ee9e05f19 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:41.001377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-69de9601-d2d0-45d1-9af8-2d6682a13707 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:41.012252 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-69de9601-d2d0-45d1-9af8-2d6682a13707 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.991287 Aug 18 11:33:41.020497 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 914/1851] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:40 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:41.027238 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7e5d1345-469b-4aa7-95dc-e9d185fa3610 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:41.035811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7e5d1345-469b-4aa7-95dc-e9d185fa3610 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:41.051823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7e5d1345-469b-4aa7-95dc-e9d185fa3610 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:41.054606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7e5d1345-469b-4aa7-95dc-e9d185fa3610 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:41.055479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7e5d1345-469b-4aa7-95dc-e9d185fa3610 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:41.056576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7e5d1345-469b-4aa7-95dc-e9d185fa3610 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:41.057145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7e5d1345-469b-4aa7-95dc-e9d185fa3610 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:41.061975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7e5d1345-469b-4aa7-95dc-e9d185fa3610 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:41.089592 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bcc7cb1f-a9d6-4e62-b604-aa7ee9e05f19 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.250725 Aug 18 11:33:41.090456 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 938/1852] 10.222.0.73 () {58 vars in 1230 bytes} [Thu Aug 18 11:33:40 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:33:41.109577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bdb5c76e-ce0b-4adc-980b-ed876f990701 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:41.113060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bdb5c76e-ce0b-4adc-980b-ed876f990701 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:41.131433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdb5c76e-ce0b-4adc-980b-ed876f990701 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:41.132149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdb5c76e-ce0b-4adc-980b-ed876f990701 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:41.132612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdb5c76e-ce0b-4adc-980b-ed876f990701 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:41.135277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdb5c76e-ce0b-4adc-980b-ed876f990701 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:41.135767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdb5c76e-ce0b-4adc-980b-ed876f990701 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:41.137916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdb5c76e-ce0b-4adc-980b-ed876f990701 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:41.357431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bdb5c76e-ce0b-4adc-980b-ed876f990701 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:41.370908 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bdb5c76e-ce0b-4adc-980b-ed876f990701 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.279202 Aug 18 11:33:41.376366 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 939/1853] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:41 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:41.404169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e331903-70b5-4751-9ea0-15e08d15dff7 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e331903-70b5-4751-9ea0-15e08d15dff7 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Request method failure captured: Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iNZdcAg8SY4hlhh9Drx4_tcjizL0r44nIOuI_79_Wuzsra1AbZA26rHsn4Xo8ZrEABkwxjZWXv_aKhLGCuGtym3qJHuddyYJxsYOEXwSiPvRPgFc8Uc4GtUB0IP_UCkV4ozw1UsdEnOSzPevQNGTXtADLHG3FxTvgra5idI3UXLuk0 Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:33:41.414839 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:33:41.416751 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:41.416751 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:41.416751 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:41.416751 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:41.416751 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:41.416751 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:33:41.416751 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:33:41.416751 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 0ab807fb8bcd4081ac5140bb24b4358c Aug 18 11:33:41.416751 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:41.416751 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:33:41.416751 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 18 11:33:41.416751 n-d-853611-3 devstack@n-api.service[122210]: action_args: {} Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:41.417851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:41.419915 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:41.421750 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:33:41.421750 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:33:41.421750 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 18 11:33:41.421750 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:41.421750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e331903-70b5-4751-9ea0-15e08d15dff7 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:41.421750 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e331903-70b5-4751-9ea0-15e08d15dff7 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.027339 Aug 18 11:33:41.426752 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 940/1854] 10.222.0.73 () {58 vars in 1182 bytes} [Thu Aug 18 11:33:41 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:33:41.440614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b7f2d67-335b-4d0f-a031-71ba58a93c31 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fb82790>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:41.631210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7e5d1345-469b-4aa7-95dc-e9d185fa3610 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:41.643768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7e5d1345-469b-4aa7-95dc-e9d185fa3610 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:41.648861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7e5d1345-469b-4aa7-95dc-e9d185fa3610 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:41.651670 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7e5d1345-469b-4aa7-95dc-e9d185fa3610 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.628285 Aug 18 11:33:41.667503 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 915/1855] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:41 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:41.672413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8c1221f9-706b-4050-86e9-5b22d40b01cd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:41.687948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8c1221f9-706b-4050-86e9-5b22d40b01cd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:41.694699 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c1221f9-706b-4050-86e9-5b22d40b01cd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:41.695473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c1221f9-706b-4050-86e9-5b22d40b01cd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:41.696088 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c1221f9-706b-4050-86e9-5b22d40b01cd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:41.696974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c1221f9-706b-4050-86e9-5b22d40b01cd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:41.703328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c1221f9-706b-4050-86e9-5b22d40b01cd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:41.704037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c1221f9-706b-4050-86e9-5b22d40b01cd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:41.868398 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8b7f2d67-335b-4d0f-a031-71ba58a93c31 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.431691 Aug 18 11:33:41.869370 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 941/1856] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:41 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:41.875057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e57e4174-d58d-42ee-89a6-7cbe14ad68b0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:41.887067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e57e4174-d58d-42ee-89a6-7cbe14ad68b0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:41.888151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e57e4174-d58d-42ee-89a6-7cbe14ad68b0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Searching by: {'deleted': False, 'project_id': '845b1ec9db86457a9b110eef1b36d898'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:33:41.891949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:41.897931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e57e4174-d58d-42ee-89a6-7cbe14ad68b0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:41.898851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e57e4174-d58d-42ee-89a6-7cbe14ad68b0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:41.899533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e57e4174-d58d-42ee-89a6-7cbe14ad68b0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:41.900524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e57e4174-d58d-42ee-89a6-7cbe14ad68b0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:41.901217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e57e4174-d58d-42ee-89a6-7cbe14ad68b0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:41.901891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e57e4174-d58d-42ee-89a6-7cbe14ad68b0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:41.945047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-e57e4174-d58d-42ee-89a6-7cbe14ad68b0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:33:42.000488 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e57e4174-d58d-42ee-89a6-7cbe14ad68b0 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.129177 Aug 18 11:33:42.003602 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 942/1857] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 18 11:33:41 2022] GET /compute/v2.1/servers => generated 681 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:42.009852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-38f6fe82-b7f4-4164-8ff8-6689e5e8c98c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:42.010994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-38f6fe82-b7f4-4164-8ff8-6689e5e8c98c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:42.018986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38f6fe82-b7f4-4164-8ff8-6689e5e8c98c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:42.019853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38f6fe82-b7f4-4164-8ff8-6689e5e8c98c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:42.020522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38f6fe82-b7f4-4164-8ff8-6689e5e8c98c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:42.021510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38f6fe82-b7f4-4164-8ff8-6689e5e8c98c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:42.023039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38f6fe82-b7f4-4164-8ff8-6689e5e8c98c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:42.024833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38f6fe82-b7f4-4164-8ff8-6689e5e8c98c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:42.291737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-38f6fe82-b7f4-4164-8ff8-6689e5e8c98c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:42.325244 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-38f6fe82-b7f4-4164-8ff8-6689e5e8c98c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.319256 Aug 18 11:33:42.342912 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 943/1858] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:42 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:42.364636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ecaec22-b896-4005-9a52-0aafe1dd89c9 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fd83b80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:42.446021 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9ecaec22-b896-4005-9a52-0aafe1dd89c9 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/5dca259d-4f2e-4621-9577-41a0dc709c06" status: 200 len: 661 microversion: 2.1 time: 0.100977 Aug 18 11:33:42.459397 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 944/1859] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:42 2022] GET /compute/v2.1/images/5dca259d-4f2e-4621-9577-41a0dc709c06 => generated 661 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:42.472299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6eb30628-6285-450b-8204-4d0913331b02 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:42.472930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6eb30628-6285-450b-8204-4d0913331b02 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: a78df714-e554-4024-a8ad-625d14ed6b0c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:42.493345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eb30628-6285-450b-8204-4d0913331b02 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:42.493857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eb30628-6285-450b-8204-4d0913331b02 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:42.494300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eb30628-6285-450b-8204-4d0913331b02 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:42.495062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eb30628-6285-450b-8204-4d0913331b02 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:42.495521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eb30628-6285-450b-8204-4d0913331b02 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:42.495946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eb30628-6285-450b-8204-4d0913331b02 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:42.660233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8c1221f9-706b-4050-86e9-5b22d40b01cd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:42.669037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6eb30628-6285-450b-8204-4d0913331b02 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:42.681377 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6eb30628-6285-450b-8204-4d0913331b02 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c" status: 200 len: 1215 microversion: 2.1 time: 0.220749 Aug 18 11:33:42.694669 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 945/1860] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:42 2022] GET /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c => generated 1215 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:42.694922 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8c1221f9-706b-4050-86e9-5b22d40b01cd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 1.032083 Aug 18 11:33:42.694922 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 916/1861] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:41 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:42.705076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76c928b9-c4f6-4bcc-b321-a823e433cc00 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:42.705609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a00af9e5-1d22-4cee-a77d-a78d7910c27f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f5a8f70>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:42.717706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-76c928b9-c4f6-4bcc-b321-a823e433cc00 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:42.718226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.compute.servers [None req-76c928b9-c4f6-4bcc-b321-a823e433cc00 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Removing options 'limit' from query {{(pid=122210) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 18 11:33:42.718929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-76c928b9-c4f6-4bcc-b321-a823e433cc00 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Searching by: {'deleted': False, 'project_id': '845b1ec9db86457a9b110eef1b36d898'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:33:42.724853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c928b9-c4f6-4bcc-b321-a823e433cc00 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:42.726989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c928b9-c4f6-4bcc-b321-a823e433cc00 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:42.727440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c928b9-c4f6-4bcc-b321-a823e433cc00 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:42.728202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c928b9-c4f6-4bcc-b321-a823e433cc00 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:42.728660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c928b9-c4f6-4bcc-b321-a823e433cc00 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:42.730802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c928b9-c4f6-4bcc-b321-a823e433cc00 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:42.763315 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a00af9e5-1d22-4cee-a77d-a78d7910c27f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/5dca259d-4f2e-4621-9577-41a0dc709c06" status: 200 len: 661 microversion: 2.1 time: 0.067389 Aug 18 11:33:42.766265 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 917/1862] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:42 2022] GET /compute/v2.1/images/5dca259d-4f2e-4621-9577-41a0dc709c06 => generated 661 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:42.777489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:42.778881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-25374b50-f58d-4b27-a0fb-5ef0ebd83651 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:42.780775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-25374b50-f58d-4b27-a0fb-5ef0ebd83651 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:42.798593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25374b50-f58d-4b27-a0fb-5ef0ebd83651 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:42.800050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25374b50-f58d-4b27-a0fb-5ef0ebd83651 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:42.802065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25374b50-f58d-4b27-a0fb-5ef0ebd83651 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:42.803137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25374b50-f58d-4b27-a0fb-5ef0ebd83651 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:42.807545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25374b50-f58d-4b27-a0fb-5ef0ebd83651 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:42.808555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25374b50-f58d-4b27-a0fb-5ef0ebd83651 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:42.815645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-76c928b9-c4f6-4bcc-b321-a823e433cc00 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:33:42.907464 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76c928b9-c4f6-4bcc-b321-a823e433cc00 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.215353 Aug 18 11:33:42.908165 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 946/1863] 10.222.0.73 () {58 vars in 1144 bytes} [Thu Aug 18 11:33:42 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:42.932302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-73b16893-76b5-458c-ac4d-ecede80e32a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:42.934580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-73b16893-76b5-458c-ac4d-ecede80e32a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:42.954064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73b16893-76b5-458c-ac4d-ecede80e32a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:42.954928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73b16893-76b5-458c-ac4d-ecede80e32a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:42.956475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73b16893-76b5-458c-ac4d-ecede80e32a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:42.958068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73b16893-76b5-458c-ac4d-ecede80e32a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:42.958894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73b16893-76b5-458c-ac4d-ecede80e32a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:42.959806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73b16893-76b5-458c-ac4d-ecede80e32a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:43.171392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-73b16893-76b5-458c-ac4d-ecede80e32a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:43.183212 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-73b16893-76b5-458c-ac4d-ecede80e32a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.274170 Aug 18 11:33:43.185969 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 947/1864] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:42 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:43.197805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de40e3a8-cbaf-47b1-b052-f86bf2e1a68d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fd83ee0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:43.291747 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de40e3a8-cbaf-47b1-b052-f86bf2e1a68d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.104487 Aug 18 11:33:43.292634 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 948/1865] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:43 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:43.298222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f6521be-415f-402c-bf54-34ae89641095 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f6521be-415f-402c-bf54-34ae89641095 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Request method failure captured: Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iNZdcAg8SY4hlhh9Drx4_tcjizL0r44nIOuI_79_Wuzsra1AbZA26rHsn4Xo8ZrEABkwxjZWXv_aKhLGCuGtym3qJHuddyYJxsYOEXwSiPvRPgFc8Uc4GtUB0IP_UCkV4ozw1UsdEnOSzPevQNGTXtADLHG3FxTvgra5idI3UXLuk0 Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:33:43.318165 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:33:43.320107 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:43.320107 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:43.320107 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:43.320107 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:43.320107 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:43.320107 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:33:43.320107 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:33:43.320107 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 0ab807fb8bcd4081ac5140bb24b4358c Aug 18 11:33:43.320107 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:43.320107 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:33:43.320107 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 18 11:33:43.320107 n-d-853611-3 devstack@n-api.service[122210]: action_args: {} Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi '-1' Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:43.321127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:43.323162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:43.330101 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:43.330101 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:43.330101 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:33:43.330101 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:33:43.330101 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 18 11:33:43.330101 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:43.330101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f6521be-415f-402c-bf54-34ae89641095 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:43.330101 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6f6521be-415f-402c-bf54-34ae89641095 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.025544 Aug 18 11:33:43.330101 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 949/1866] 10.222.0.73 () {58 vars in 1142 bytes} [Thu Aug 18 11:33:43 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:33:43.338676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24edf5f0-fc72-496c-9f34-4dd01c08f734 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24edf5f0-fc72-496c-9f34-4dd01c08f734 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Request method failure captured: Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iNZdcAg8SY4hlhh9Drx4_tcjizL0r44nIOuI_79_Wuzsra1AbZA26rHsn4Xo8ZrEABkwxjZWXv_aKhLGCuGtym3qJHuddyYJxsYOEXwSiPvRPgFc8Uc4GtUB0IP_UCkV4ozw1UsdEnOSzPevQNGTXtADLHG3FxTvgra5idI3UXLuk0 Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:33:43.353777 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:33:43.355726 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:43.355726 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:43.355726 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:43.355726 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:43.355726 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:43.355726 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:33:43.355726 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:33:43.355726 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 0ab807fb8bcd4081ac5140bb24b4358c Aug 18 11:33:43.355726 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:43.355726 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:33:43.355726 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 18 11:33:43.355726 n-d-853611-3 devstack@n-api.service[122210]: action_args: {} Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'testing' Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:43.356718 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:43.359495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:43.361291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:43.361291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:43.361291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:33:43.361291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:33:43.361291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 18 11:33:43.361291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:43.361291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24edf5f0-fc72-496c-9f34-4dd01c08f734 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:43.361291 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-24edf5f0-fc72-496c-9f34-4dd01c08f734 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.024806 Aug 18 11:33:43.366495 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 950/1867] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:33:43 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:33:43.369742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99a2bce2-5985-4616-b232-3de74fdf4511 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:43.370365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-99a2bce2-5985-4616-b232-3de74fdf4511 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:43.380173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99a2bce2-5985-4616-b232-3de74fdf4511 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:43.380666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99a2bce2-5985-4616-b232-3de74fdf4511 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:43.381101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99a2bce2-5985-4616-b232-3de74fdf4511 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:43.381807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99a2bce2-5985-4616-b232-3de74fdf4511 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:43.382261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99a2bce2-5985-4616-b232-3de74fdf4511 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:43.382748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99a2bce2-5985-4616-b232-3de74fdf4511 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:43.568171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-25374b50-f58d-4b27-a0fb-5ef0ebd83651 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:43.577280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-25374b50-f58d-4b27-a0fb-5ef0ebd83651 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:43.596540 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-25374b50-f58d-4b27-a0fb-5ef0ebd83651 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:43.598043 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-25374b50-f58d-4b27-a0fb-5ef0ebd83651 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.829923 Aug 18 11:33:43.598816 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 918/1868] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:42 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:43.602021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-99a2bce2-5985-4616-b232-3de74fdf4511 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:43.619677 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-99a2bce2-5985-4616-b232-3de74fdf4511 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.251597 Aug 18 11:33:43.622023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f7d22dcc-9c1c-4de7-8695-03006a1d6486 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:43.639175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f7d22dcc-9c1c-4de7-8695-03006a1d6486 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:43.639487 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 951/1869] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:43 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:43.641392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f7d22dcc-9c1c-4de7-8695-03006a1d6486 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '845b1ec9db86457a9b110eef1b36d898'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:33:43.659306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-730837860", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "2420cd87-a1af-4a7a-8baa-ea2c21853a49"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:43.660267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.compute.servers [None req-f7d22dcc-9c1c-4de7-8695-03006a1d6486 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Flavor 'non_existing_flavor' could not be found {{(pid=122209) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 18 11:33:43.662036 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f7d22dcc-9c1c-4de7-8695-03006a1d6486 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.062059 Aug 18 11:33:43.664159 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 919/1870] 10.222.0.73 () {58 vars in 1178 bytes} [Thu Aug 18 11:33:43 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:33:43.696204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3090c553-277a-4340-8ae0-9ed2e621600b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:43.715597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3090c553-277a-4340-8ae0-9ed2e621600b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:43.722770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3090c553-277a-4340-8ae0-9ed2e621600b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '845b1ec9db86457a9b110eef1b36d898'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:33:43.750278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3090c553-277a-4340-8ae0-9ed2e621600b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:43.756953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3090c553-277a-4340-8ae0-9ed2e621600b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:43.757686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3090c553-277a-4340-8ae0-9ed2e621600b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:43.762674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3090c553-277a-4340-8ae0-9ed2e621600b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:43.763540 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3090c553-277a-4340-8ae0-9ed2e621600b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:43.766204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3090c553-277a-4340-8ae0-9ed2e621600b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:43.844615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] validate_networks() for [('2420cd87-a1af-4a7a-8baa-ea2c21853a49', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:33:43.924192 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3090c553-277a-4340-8ae0-9ed2e621600b tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.243259 Aug 18 11:33:43.933989 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 920/1871] 10.222.0.73 () {58 vars in 1174 bytes} [Thu Aug 18 11:33:43 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:33:43.945622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-733574f7-a939-4bbc-8ad9-cd5d9fe14d57 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:43.953179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-733574f7-a939-4bbc-8ad9-cd5d9fe14d57 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: a78df714-e554-4024-a8ad-625d14ed6b0c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:43.960949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-733574f7-a939-4bbc-8ad9-cd5d9fe14d57 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:43.962897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-733574f7-a939-4bbc-8ad9-cd5d9fe14d57 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:43.963534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-733574f7-a939-4bbc-8ad9-cd5d9fe14d57 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:43.964449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-733574f7-a939-4bbc-8ad9-cd5d9fe14d57 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:43.965077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-733574f7-a939-4bbc-8ad9-cd5d9fe14d57 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:43.965694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-733574f7-a939-4bbc-8ad9-cd5d9fe14d57 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:44.253100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-733574f7-a939-4bbc-8ad9-cd5d9fe14d57 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:44.289542 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-733574f7-a939-4bbc-8ad9-cd5d9fe14d57 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c" status: 200 len: 1217 microversion: 2.1 time: 0.346940 Aug 18 11:33:44.294484 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 921/1872] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:43 2022] GET /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c => generated 1217 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:44.311597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d5265154-e533-44c0-bde5-f8201f4e4e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:44.329365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d5265154-e533-44c0-bde5-f8201f4e4e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:44.331370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d5265154-e533-44c0-bde5-f8201f4e4e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '845b1ec9db86457a9b110eef1b36d898'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:33:44.348969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5265154-e533-44c0-bde5-f8201f4e4e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:44.356951 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5265154-e533-44c0-bde5-f8201f4e4e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:44.360328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5265154-e533-44c0-bde5-f8201f4e4e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:44.361353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5265154-e533-44c0-bde5-f8201f4e4e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:44.361850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5265154-e533-44c0-bde5-f8201f4e4e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:44.367773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5265154-e533-44c0-bde5-f8201f4e4e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:44.580977 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d5265154-e533-44c0-bde5-f8201f4e4e10 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.284084 Aug 18 11:33:44.592199 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 922/1873] 10.222.0.73 () {58 vars in 1184 bytes} [Thu Aug 18 11:33:44 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:33:44.606984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0b3658fb-96e9-495a-b718-ec10334f33d5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f5c6af0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:44.726845 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0b3658fb-96e9-495a-b718-ec10334f33d5 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.140882 Aug 18 11:33:44.735720 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 923/1874] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:44 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:44.747845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:44.763070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:44.763851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Searching by: {'deleted': False, 'project_id': '845b1ec9db86457a9b110eef1b36d898'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:33:44.800841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:44.801340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:44.807281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:44.814572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:44.815086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:44.815539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:44.879451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:33:44.880687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:33:44.881117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:33:44.881829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:33:44.882651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:33:44.911099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:44.913030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:44.913717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:44.916848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:44.917571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:44.918229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:44.965188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Getting quotas for project c1a985dc6f824e5b847a2d966c0f79af. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:33:44.988313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Getting quotas for user 0cd8451c50d941409a66864cbc1c7201 and project c1a985dc6f824e5b847a2d966c0f79af. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:33:45.008164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:33:45.010507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:33:45.055778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:33:45.091814 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-165f62f3-412d-4869-beaf-1a331259f30b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.442725 Aug 18 11:33:45.098920 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 952/1875] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:33:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:33:45.103437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e4c6b979-10da-4e55-9d42-852a08fc9658 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:45.104498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e4c6b979-10da-4e55-9d42-852a08fc9658 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:45.113388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4c6b979-10da-4e55-9d42-852a08fc9658 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:45.113884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4c6b979-10da-4e55-9d42-852a08fc9658 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:45.114462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4c6b979-10da-4e55-9d42-852a08fc9658 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:45.115733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4c6b979-10da-4e55-9d42-852a08fc9658 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:45.115733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4c6b979-10da-4e55-9d42-852a08fc9658 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:45.116089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4c6b979-10da-4e55-9d42-852a08fc9658 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:45.251407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:45.267074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:45.267887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:45.272147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:45.369117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e4c6b979-10da-4e55-9d42-852a08fc9658 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:45.382074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e4c6b979-10da-4e55-9d42-852a08fc9658 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:45.384752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e4c6b979-10da-4e55-9d42-852a08fc9658 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:45.386640 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e4c6b979-10da-4e55-9d42-852a08fc9658 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.292757 Aug 18 11:33:45.403858 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 953/1876] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:45 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:45.410317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0272d34b-2108-4c79-bdf8-7a51a95c6c33 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fd83310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:45.469310 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0272d34b-2108-4c79-bdf8-7a51a95c6c33 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8bcab6a1-d117-4d3b-9a03-46129dd37a87" status: 200 len: 662 microversion: 2.1 time: 0.063926 Aug 18 11:33:45.470185 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 954/1877] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:45 2022] GET /compute/v2.1/images/8bcab6a1-d117-4d3b-9a03-46129dd37a87 => generated 662 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:45.476723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ede96ba-452d-4b7a-a943-0b46f3b0b637 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:45.477589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9ede96ba-452d-4b7a-a943-0b46f3b0b637 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:45.484933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ede96ba-452d-4b7a-a943-0b46f3b0b637 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:45.487126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ede96ba-452d-4b7a-a943-0b46f3b0b637 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:45.487763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ede96ba-452d-4b7a-a943-0b46f3b0b637 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:45.488852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ede96ba-452d-4b7a-a943-0b46f3b0b637 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:45.489587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ede96ba-452d-4b7a-a943-0b46f3b0b637 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:45.490195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ede96ba-452d-4b7a-a943-0b46f3b0b637 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:45.625391 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-20a426bc-66a1-4506-beb9-2843a4af25bd tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.888088 Aug 18 11:33:45.626360 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 924/1878] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:33:44 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:45.648235 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-482b6566-9bc4-40ae-96d8-9ebabfc500ae tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:45.649115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-482b6566-9bc4-40ae-96d8-9ebabfc500ae tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:45.660126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:45.663072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-482b6566-9bc4-40ae-96d8-9ebabfc500ae tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:45.664921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-482b6566-9bc4-40ae-96d8-9ebabfc500ae tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:45.670596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-482b6566-9bc4-40ae-96d8-9ebabfc500ae tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:45.672443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-482b6566-9bc4-40ae-96d8-9ebabfc500ae tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:45.673210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-482b6566-9bc4-40ae-96d8-9ebabfc500ae tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:45.673883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-482b6566-9bc4-40ae-96d8-9ebabfc500ae tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:45.752581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-482b6566-9bc4-40ae-96d8-9ebabfc500ae tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:33:45.809783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9ede96ba-452d-4b7a-a943-0b46f3b0b637 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:45.820203 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9ede96ba-452d-4b7a-a943-0b46f3b0b637 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.348684 Aug 18 11:33:45.821124 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 955/1879] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:45 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:45.826753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e414ed15-45dc-4841-a942-d5c5c94d305a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:45.827988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e414ed15-45dc-4841-a942-d5c5c94d305a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:45.901458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e414ed15-45dc-4841-a942-d5c5c94d305a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:45.911903 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e414ed15-45dc-4841-a942-d5c5c94d305a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1214 microversion: 2.1 time: 0.089545 Aug 18 11:33:45.912855 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 956/1880] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:45 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:45.931905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e2ce18a-caf6-427c-a568-d3c61431a935 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:45.935016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e2ce18a-caf6-427c-a568-d3c61431a935 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: a78df714-e554-4024-a8ad-625d14ed6b0c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:45.953624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2ce18a-caf6-427c-a568-d3c61431a935 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:45.955610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2ce18a-caf6-427c-a568-d3c61431a935 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:45.956691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2ce18a-caf6-427c-a568-d3c61431a935 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:45.957771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2ce18a-caf6-427c-a568-d3c61431a935 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:45.960567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2ce18a-caf6-427c-a568-d3c61431a935 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:45.962881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2ce18a-caf6-427c-a568-d3c61431a935 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:46.000982 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-0e2ce18a-caf6-427c-a568-d3c61431a935 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e2ce18a-caf6-427c-a568-d3c61431a935 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c HTTP/1.1 Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:33:46.003021 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:33:46.004943 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:46.004943 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:33:46.004943 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:33:46.004943 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:33:46.004943 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:33:46.004943 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:33:46.004943 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:33:46.004943 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:33:46.004943 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:33:46.004943 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:33:46.004943 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:33:46.004943 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'a78df714-e554-4024-a8ad-625d14ed6b0c'} Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:46.006010 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:33:46.007678 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:46.009627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e2ce18a-caf6-427c-a568-d3c61431a935 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:46.011005 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e2ce18a-caf6-427c-a568-d3c61431a935 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c" status: 404 len: 111 microversion: 2.1 time: 0.097240 Aug 18 11:33:46.024427 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 957/1881] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:45 2022] GET /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:33:46.032052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-51867694-9f0c-4bfd-ae51-0095f8fb3288 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fd83ca0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:46.051794 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-482b6566-9bc4-40ae-96d8-9ebabfc500ae tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 204 len: 0 microversion: 2.1 time: 0.410945 Aug 18 11:33:46.054319 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 925/1882] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:33:45 2022] DELETE /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:33:46.074660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eb75b094-641c-4393-b32b-26f182b880b9 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:46.104165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eb75b094-641c-4393-b32b-26f182b880b9 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:46.106419 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eb75b094-641c-4393-b32b-26f182b880b9 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.049381 Aug 18 11:33:46.130543 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 926/1883] 10.222.0.73 () {58 vars in 1178 bytes} [Thu Aug 18 11:33:46 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:33:46.133608 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-51867694-9f0c-4bfd-ae51-0095f8fb3288 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8bcab6a1-d117-4d3b-9a03-46129dd37a87" status: 200 len: 662 microversion: 2.1 time: 0.106400 Aug 18 11:33:46.135607 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 958/1884] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:46 2022] GET /compute/v2.1/images/8bcab6a1-d117-4d3b-9a03-46129dd37a87 => generated 662 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:46.150465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f862902-ce16-463f-9720-f394d1ea8057 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:46.152620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f862902-ce16-463f-9720-f394d1ea8057 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:46.153744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fda1016a-438f-4e57-b5c0-120b7c2bb2b1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f5463a0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:46.173652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f862902-ce16-463f-9720-f394d1ea8057 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:46.180622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f862902-ce16-463f-9720-f394d1ea8057 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:46.181206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f862902-ce16-463f-9720-f394d1ea8057 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:46.187699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f862902-ce16-463f-9720-f394d1ea8057 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:46.192865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f862902-ce16-463f-9720-f394d1ea8057 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:46.193333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f862902-ce16-463f-9720-f394d1ea8057 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:46.292248 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fda1016a-438f-4e57-b5c0-120b7c2bb2b1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.158375 Aug 18 11:33:46.293468 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 927/1885] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:46 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:46.299670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7ed96d28-ed07-4def-ba2a-9e48ff8b2f4c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:46.305967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7ed96d28-ed07-4def-ba2a-9e48ff8b2f4c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:46.306137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7ed96d28-ed07-4def-ba2a-9e48ff8b2f4c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Searching by: {'deleted': False, 'project_id': '845b1ec9db86457a9b110eef1b36d898'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:33:46.312821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ed96d28-ed07-4def-ba2a-9e48ff8b2f4c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:46.313602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ed96d28-ed07-4def-ba2a-9e48ff8b2f4c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:46.314325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ed96d28-ed07-4def-ba2a-9e48ff8b2f4c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:46.315335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ed96d28-ed07-4def-ba2a-9e48ff8b2f4c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:46.316083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ed96d28-ed07-4def-ba2a-9e48ff8b2f4c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:46.316731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ed96d28-ed07-4def-ba2a-9e48ff8b2f4c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:46.355209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-7ed96d28-ed07-4def-ba2a-9e48ff8b2f4c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:33:46.439743 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7ed96d28-ed07-4def-ba2a-9e48ff8b2f4c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.144984 Aug 18 11:33:46.440444 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 928/1886] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 18 11:33:46 2022] GET /compute/v2.1/servers => generated 681 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:46.453395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-652833307", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "22608490-9e6a-4848-bc6d-66289c233bc1"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:46.477730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2f862902-ce16-463f-9720-f394d1ea8057 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:46.495187 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f862902-ce16-463f-9720-f394d1ea8057 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 200 len: 1682 microversion: 2.1 time: 0.358416 Aug 18 11:33:46.497239 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 959/1887] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:46 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 1682 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:46.510688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a789b7bb-f1aa-48d4-acf6-940bad866c1c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:46.521354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a789b7bb-f1aa-48d4-acf6-940bad866c1c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:46.523418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] validate_networks() for [('22608490-9e6a-4848-bc6d-66289c233bc1', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:33:46.547195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a789b7bb-f1aa-48d4-acf6-940bad866c1c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:46.554954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a789b7bb-f1aa-48d4-acf6-940bad866c1c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:46.555799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a789b7bb-f1aa-48d4-acf6-940bad866c1c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:46.556776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a789b7bb-f1aa-48d4-acf6-940bad866c1c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:46.557454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a789b7bb-f1aa-48d4-acf6-940bad866c1c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:46.558139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a789b7bb-f1aa-48d4-acf6-940bad866c1c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:46.883484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a789b7bb-f1aa-48d4-acf6-940bad866c1c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:46.902543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a789b7bb-f1aa-48d4-acf6-940bad866c1c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:46.904088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a789b7bb-f1aa-48d4-acf6-940bad866c1c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:46.920248 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a789b7bb-f1aa-48d4-acf6-940bad866c1c tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.415967 Aug 18 11:33:46.922211 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 960/1888] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:46 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:46.936273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d311343b-894f-4b34-833c-c2d63a678d81 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:46.937464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d311343b-894f-4b34-833c-c2d63a678d81 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: dc571952-f3e6-43fc-984c-85c632fa12ca] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:46.962084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d311343b-894f-4b34-833c-c2d63a678d81 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:46.962664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d311343b-894f-4b34-833c-c2d63a678d81 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:46.963142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d311343b-894f-4b34-833c-c2d63a678d81 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:46.967371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d311343b-894f-4b34-833c-c2d63a678d81 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:46.968616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d311343b-894f-4b34-833c-c2d63a678d81 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:46.969036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d311343b-894f-4b34-833c-c2d63a678d81 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:47.028859 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-d311343b-894f-4b34-833c-c2d63a678d81 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] HTTP exception thrown: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d311343b-894f-4b34-833c-c2d63a678d81 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Request method failure captured: Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca HTTP/1.1 Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iNZdcAg8SY4hlhh9Drx4_tcjizL0r44nIOuI_79_Wuzsra1AbZA26rHsn4Xo8ZrEABkwxjZWXv_aKhLGCuGtym3qJHuddyYJxsYOEXwSiPvRPgFc8Uc4GtUB0IP_UCkV4ozw1UsdEnOSzPevQNGTXtADLHG3FxTvgra5idI3UXLuk0 Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:33:47.032113 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:33:47.035741 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:47.035741 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:47.035741 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:47.035741 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:47.035741 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:47.035741 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:33:47.035741 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:33:47.035741 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 0ab807fb8bcd4081ac5140bb24b4358c Aug 18 11:33:47.035741 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:47.035741 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:33:47.035741 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:47.035741 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'dc571952-f3e6-43fc-984c-85c632fa12ca'} Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:47.037687 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:47.039516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:47.041193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d311343b-894f-4b34-833c-c2d63a678d81 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Returning 404 to user: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:47.041193 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d311343b-894f-4b34-833c-c2d63a678d81 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca" status: 404 len: 111 microversion: 2.1 time: 0.110883 Aug 18 11:33:47.041193 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 961/1889] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:33:46 2022] DELETE /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:33:47.044729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b2c3e11-61b7-409f-9d81-f4942b0e2621 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:47.047016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1b2c3e11-61b7-409f-9d81-f4942b0e2621 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:47.060205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b2c3e11-61b7-409f-9d81-f4942b0e2621 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:47.062256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b2c3e11-61b7-409f-9d81-f4942b0e2621 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:47.062858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b2c3e11-61b7-409f-9d81-f4942b0e2621 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:47.063652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b2c3e11-61b7-409f-9d81-f4942b0e2621 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:47.064197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b2c3e11-61b7-409f-9d81-f4942b0e2621 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:47.064636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b2c3e11-61b7-409f-9d81-f4942b0e2621 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:47.137462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:33:47.138055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:33:47.138341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:33:47.147069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:33:47.148675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:33:47.169434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:47.169947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:47.170396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:47.171829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:47.172299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:47.172721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:47.239834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Getting quotas for project a98846d5998440dd87f3d85de0bf9d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:33:47.246130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Getting quotas for user 7bf7b0cd3d8740aca2d71944bc371d75 and project a98846d5998440dd87f3d85de0bf9d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:33:47.276947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:33:47.280026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:33:47.290501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1b2c3e11-61b7-409f-9d81-f4942b0e2621 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:47.301125 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1b2c3e11-61b7-409f-9d81-f4942b0e2621 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.264371 Aug 18 11:33:47.302979 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 962/1890] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:47 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:47.308644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-70419717-89d8-4a29-b0cd-351df05374d0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:47.309658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-70419717-89d8-4a29-b0cd-351df05374d0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:47.318418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70419717-89d8-4a29-b0cd-351df05374d0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:47.319256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70419717-89d8-4a29-b0cd-351df05374d0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:47.320039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70419717-89d8-4a29-b0cd-351df05374d0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:47.321028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70419717-89d8-4a29-b0cd-351df05374d0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:47.321699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70419717-89d8-4a29-b0cd-351df05374d0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:47.323218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70419717-89d8-4a29-b0cd-351df05374d0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:47.412523 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5cfd17a6-8904-4897-9828-f65d6add66b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.970713 Aug 18 11:33:47.414146 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 929/1891] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:33:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:33:47.433034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5948216b-1c0c-45b1-b45a-b0abe7f5004c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:47.440083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5948216b-1c0c-45b1-b45a-b0abe7f5004c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:47.441088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-70419717-89d8-4a29-b0cd-351df05374d0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:47.449260 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-70419717-89d8-4a29-b0cd-351df05374d0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1218 microversion: 2.1 time: 0.144902 Aug 18 11:33:47.449859 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 963/1892] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:47 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:47.466388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5948216b-1c0c-45b1-b45a-b0abe7f5004c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:47.467363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5948216b-1c0c-45b1-b45a-b0abe7f5004c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:47.467363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5948216b-1c0c-45b1-b45a-b0abe7f5004c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:47.468050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5948216b-1c0c-45b1-b45a-b0abe7f5004c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:47.468521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5948216b-1c0c-45b1-b45a-b0abe7f5004c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:47.469297 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5948216b-1c0c-45b1-b45a-b0abe7f5004c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:47.484484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec55e43c-de84-4908-93c7-9a115ed7935a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fd83ca0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:47.547989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5948216b-1c0c-45b1-b45a-b0abe7f5004c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:33:47.829587 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5948216b-1c0c-45b1-b45a-b0abe7f5004c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84" status: 204 len: 0 microversion: 2.1 time: 0.411320 Aug 18 11:33:47.837036 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 930/1893] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:33:47 2022] DELETE /compute/v2.1/servers/8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:33:47.848248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5113a478-1faf-4ca0-9dc3-390e83f51786 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:47.848745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5113a478-1faf-4ca0-9dc3-390e83f51786 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:48.000396 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ec55e43c-de84-4908-93c7-9a115ed7935a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.540822 Aug 18 11:33:48.001486 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 964/1894] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:47 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:48.011960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5e35fb05-4066-47f0-bac6-7b568a44dcb3 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:48.028146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5e35fb05-4066-47f0-bac6-7b568a44dcb3 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:48.052068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e35fb05-4066-47f0-bac6-7b568a44dcb3 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:48.052569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e35fb05-4066-47f0-bac6-7b568a44dcb3 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:48.054570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e35fb05-4066-47f0-bac6-7b568a44dcb3 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:48.057354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e35fb05-4066-47f0-bac6-7b568a44dcb3 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:48.058711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e35fb05-4066-47f0-bac6-7b568a44dcb3 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:48.059164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e35fb05-4066-47f0-bac6-7b568a44dcb3 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:48.118772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5113a478-1faf-4ca0-9dc3-390e83f51786 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:48.133431 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5113a478-1faf-4ca0-9dc3-390e83f51786 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1214 microversion: 2.1 time: 0.297952 Aug 18 11:33:48.134226 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 931/1895] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:47 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1214 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:48.175287 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b5e1c6d0-934f-4426-8c17-f077bbb28427 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:48.176008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b5e1c6d0-934f-4426-8c17-f077bbb28427 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:48.187495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5e1c6d0-934f-4426-8c17-f077bbb28427 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:48.187997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5e1c6d0-934f-4426-8c17-f077bbb28427 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:48.188603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5e1c6d0-934f-4426-8c17-f077bbb28427 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:48.189336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5e1c6d0-934f-4426-8c17-f077bbb28427 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:48.189874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5e1c6d0-934f-4426-8c17-f077bbb28427 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:48.190310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5e1c6d0-934f-4426-8c17-f077bbb28427 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:48.219470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:48.224681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b5e1c6d0-934f-4426-8c17-f077bbb28427 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:33:48.444985 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b5e1c6d0-934f-4426-8c17-f077bbb28427 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 204 len: 0 microversion: 2.1 time: 0.309408 Aug 18 11:33:48.445829 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 932/1896] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:33:48 2022] DELETE /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:33:48.463635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-20a6f0e4-1047-4713-a0d0-048a1d7848ed tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f5beb80>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:48.469134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5e35fb05-4066-47f0-bac6-7b568a44dcb3 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:48.482641 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5e35fb05-4066-47f0-bac6-7b568a44dcb3 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 200 len: 1682 microversion: 2.1 time: 0.476968 Aug 18 11:33:48.498405 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 965/1897] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:48 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 1682 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:48.506622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5d623ef5-a8cd-4ae5-9a4f-642fac465a3f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:48.507723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5d623ef5-a8cd-4ae5-9a4f-642fac465a3f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:48.515216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d623ef5-a8cd-4ae5-9a4f-642fac465a3f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:48.516966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d623ef5-a8cd-4ae5-9a4f-642fac465a3f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:48.517690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d623ef5-a8cd-4ae5-9a4f-642fac465a3f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:48.518862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d623ef5-a8cd-4ae5-9a4f-642fac465a3f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:48.519575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d623ef5-a8cd-4ae5-9a4f-642fac465a3f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:48.520264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d623ef5-a8cd-4ae5-9a4f-642fac465a3f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:48.587310 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-20a6f0e4-1047-4713-a0d0-048a1d7848ed tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/2bc83ce8-72b7-4815-8543-de0836f3ce02" status: 200 len: 662 microversion: 2.1 time: 0.139925 Aug 18 11:33:48.594643 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 933/1898] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:48 2022] GET /compute/v2.1/images/2bc83ce8-72b7-4815-8543-de0836f3ce02 => generated 662 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:48.610743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a6f4bd02-ae80-4ccc-847d-be932122ee4c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:48.611505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a6f4bd02-ae80-4ccc-847d-be932122ee4c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:48.643233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6f4bd02-ae80-4ccc-847d-be932122ee4c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:48.643659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6f4bd02-ae80-4ccc-847d-be932122ee4c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:48.644104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6f4bd02-ae80-4ccc-847d-be932122ee4c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:48.644834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6f4bd02-ae80-4ccc-847d-be932122ee4c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:48.647442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6f4bd02-ae80-4ccc-847d-be932122ee4c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:48.647886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6f4bd02-ae80-4ccc-847d-be932122ee4c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:48.743654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5d623ef5-a8cd-4ae5-9a4f-642fac465a3f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:48.754102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5d623ef5-a8cd-4ae5-9a4f-642fac465a3f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:48.756244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5d623ef5-a8cd-4ae5-9a4f-642fac465a3f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:48.758448 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5d623ef5-a8cd-4ae5-9a4f-642fac465a3f tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.255999 Aug 18 11:33:48.759339 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 966/1899] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:48 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:48.773169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-855db2aa-660b-4df9-add0-6abd64c87087 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:48.774204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-855db2aa-660b-4df9-add0-6abd64c87087 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: dc571952-f3e6-43fc-984c-85c632fa12ca] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:48.788438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-855db2aa-660b-4df9-add0-6abd64c87087 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:48.789262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-855db2aa-660b-4df9-add0-6abd64c87087 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:48.790062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-855db2aa-660b-4df9-add0-6abd64c87087 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:48.791084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-855db2aa-660b-4df9-add0-6abd64c87087 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:48.791749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-855db2aa-660b-4df9-add0-6abd64c87087 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:48.792505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-855db2aa-660b-4df9-add0-6abd64c87087 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:48.817449 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-855db2aa-660b-4df9-add0-6abd64c87087 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] HTTP exception thrown: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-855db2aa-660b-4df9-add0-6abd64c87087 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Request method failure captured: Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca HTTP/1.1 Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iNZdcAg8SY4hlhh9Drx4_tcjizL0r44nIOuI_79_Wuzsra1AbZA26rHsn4Xo8ZrEABkwxjZWXv_aKhLGCuGtym3qJHuddyYJxsYOEXwSiPvRPgFc8Uc4GtUB0IP_UCkV4ozw1UsdEnOSzPevQNGTXtADLHG3FxTvgra5idI3UXLuk0 Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:33:48.819445 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:33:48.821088 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:48.821088 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:48.821088 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:48.821088 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:48.821088 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:48.821088 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:33:48.821088 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:33:48.821088 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 0ab807fb8bcd4081ac5140bb24b4358c Aug 18 11:33:48.821088 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:48.821088 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:33:48.821088 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:48.821088 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'dc571952-f3e6-43fc-984c-85c632fa12ca'} Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:48.821982 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. Aug 18 11:33:48.824392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:48.830989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-855db2aa-660b-4df9-add0-6abd64c87087 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Returning 404 to user: Instance dc571952-f3e6-43fc-984c-85c632fa12ca could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:48.832087 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-855db2aa-660b-4df9-add0-6abd64c87087 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca" status: 404 len: 111 microversion: 2.1 time: 0.071559 Aug 18 11:33:48.835104 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 967/1900] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:48 2022] GET /compute/v2.1/servers/dc571952-f3e6-43fc-984c-85c632fa12ca => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:33:48.850690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e6eefe2b-1940-4ceb-a491-e0732e527e28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:48.851333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e6eefe2b-1940-4ceb-a491-e0732e527e28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:48.858671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6eefe2b-1940-4ceb-a491-e0732e527e28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:48.859206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6eefe2b-1940-4ceb-a491-e0732e527e28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:48.859658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6eefe2b-1940-4ceb-a491-e0732e527e28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:48.860372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6eefe2b-1940-4ceb-a491-e0732e527e28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:48.860832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6eefe2b-1940-4ceb-a491-e0732e527e28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:48.861258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6eefe2b-1940-4ceb-a491-e0732e527e28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:48.962177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e6eefe2b-1940-4ceb-a491-e0732e527e28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:48.972644 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e6eefe2b-1940-4ceb-a491-e0732e527e28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1274 microversion: 2.1 time: 0.136341 Aug 18 11:33:48.973541 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 968/1901] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:48 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1274 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:48.991726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b85bbc33-128b-4017-be8b-71b89a331977 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f894b80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:49.048645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a6f4bd02-ae80-4ccc-847d-be932122ee4c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:49.051929 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b85bbc33-128b-4017-be8b-71b89a331977 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/2bc83ce8-72b7-4815-8543-de0836f3ce02" status: 200 len: 662 microversion: 2.1 time: 0.064026 Aug 18 11:33:49.066297 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 969/1902] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:48 2022] GET /compute/v2.1/images/2bc83ce8-72b7-4815-8543-de0836f3ce02 => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:49.070692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9ef8031-185f-4c17-b678-ab360c9a2be8 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:49.071350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c9ef8031-185f-4c17-b678-ab360c9a2be8 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:49.074190 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a6f4bd02-ae80-4ccc-847d-be932122ee4c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.478406 Aug 18 11:33:49.075333 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 934/1903] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:48 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:49.081334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-44fdd816-3c5f-41a4-852a-257100cbc03e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f51ac188dc0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:49.095832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9ef8031-185f-4c17-b678-ab360c9a2be8 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:49.096548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9ef8031-185f-4c17-b678-ab360c9a2be8 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:49.097166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9ef8031-185f-4c17-b678-ab360c9a2be8 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:49.100510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9ef8031-185f-4c17-b678-ab360c9a2be8 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:49.101477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9ef8031-185f-4c17-b678-ab360c9a2be8 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:49.102120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9ef8031-185f-4c17-b678-ab360c9a2be8 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:49.143359 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-44fdd816-3c5f-41a4-852a-257100cbc03e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.066693 Aug 18 11:33:49.145918 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 935/1904] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:49 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:49.163621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cbbd5c95-f870-42bb-b429-dfb9a4a72243 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:49.165198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cbbd5c95-f870-42bb-b429-dfb9a4a72243 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:49.193324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cbbd5c95-f870-42bb-b429-dfb9a4a72243 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:49.194069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cbbd5c95-f870-42bb-b429-dfb9a4a72243 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:49.194285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cbbd5c95-f870-42bb-b429-dfb9a4a72243 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:49.195164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cbbd5c95-f870-42bb-b429-dfb9a4a72243 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:49.195621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cbbd5c95-f870-42bb-b429-dfb9a4a72243 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:49.196045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cbbd5c95-f870-42bb-b429-dfb9a4a72243 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:49.297252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c9ef8031-185f-4c17-b678-ab360c9a2be8 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:49.308464 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c9ef8031-185f-4c17-b678-ab360c9a2be8 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84" status: 200 len: 1521 microversion: 2.1 time: 0.253847 Aug 18 11:33:49.309430 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 970/1905] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:49 2022] GET /compute/v2.1/servers/8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:49.315370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-876753728", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:49.390785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cbbd5c95-f870-42bb-b429-dfb9a4a72243 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:49.397135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:33:49.409264 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cbbd5c95-f870-42bb-b429-dfb9a4a72243 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1218 microversion: 2.1 time: 0.252105 Aug 18 11:33:49.423056 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 936/1906] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:49 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1218 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:33:49.505994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1b0aa183-30ce-40d3-aeb8-e934acda5d12 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:49.506689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1b0aa183-30ce-40d3-aeb8-e934acda5d12 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:49.519183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b0aa183-30ce-40d3-aeb8-e934acda5d12 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:49.519602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b0aa183-30ce-40d3-aeb8-e934acda5d12 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:49.520047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b0aa183-30ce-40d3-aeb8-e934acda5d12 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:49.520769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b0aa183-30ce-40d3-aeb8-e934acda5d12 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:49.526901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b0aa183-30ce-40d3-aeb8-e934acda5d12 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:49.527401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b0aa183-30ce-40d3-aeb8-e934acda5d12 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:49.783773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:33:49.784538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:33:49.785238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:33:49.785485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1b0aa183-30ce-40d3-aeb8-e934acda5d12 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:49.786184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:33:49.786843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:33:49.798365 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1b0aa183-30ce-40d3-aeb8-e934acda5d12 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 200 len: 1614 microversion: 2.1 time: 0.293341 Aug 18 11:33:49.800488 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 937/1907] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:49 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 1614 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:49.801425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:49.802124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:49.803540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:49.804472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:49.805194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:49.805784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:49.814398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1ec8c751-befe-44d2-bfef-f2322e5587f7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:49.814836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1ec8c751-befe-44d2-bfef-f2322e5587f7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:49.844577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ec8c751-befe-44d2-bfef-f2322e5587f7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:49.846663 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ec8c751-befe-44d2-bfef-f2322e5587f7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:49.847148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ec8c751-befe-44d2-bfef-f2322e5587f7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:49.853574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ec8c751-befe-44d2-bfef-f2322e5587f7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:49.854850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Getting quotas for project 7fe39b6aea8849d788b0d0a425c0e591. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:33:49.855333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ec8c751-befe-44d2-bfef-f2322e5587f7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:49.859119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ec8c751-befe-44d2-bfef-f2322e5587f7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:49.868814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Getting quotas for user 321f5430950547d3b63d50d87a6a95c6 and project 7fe39b6aea8849d788b0d0a425c0e591. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:33:49.903554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:33:49.906462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 51e3865d-a413-4c57-b0dc-1b29e76be1de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:33:50.026908 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-154b5493-1959-4d69-a12e-ebb996bf773c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715991 Aug 18 11:33:50.027800 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 971/1908] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:33:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:33:50.038316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bc333aa1-1d25-493a-8dac-50351fea701d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:50.038995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bc333aa1-1d25-493a-8dac-50351fea701d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:50.066376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc333aa1-1d25-493a-8dac-50351fea701d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:50.067293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc333aa1-1d25-493a-8dac-50351fea701d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:50.067485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc333aa1-1d25-493a-8dac-50351fea701d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:50.070830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc333aa1-1d25-493a-8dac-50351fea701d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:50.072432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc333aa1-1d25-493a-8dac-50351fea701d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:50.072885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc333aa1-1d25-493a-8dac-50351fea701d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:50.202464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bc333aa1-1d25-493a-8dac-50351fea701d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:50.211839 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bc333aa1-1d25-493a-8dac-50351fea701d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1284 microversion: 2.1 time: 0.182374 Aug 18 11:33:50.212901 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 972/1909] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:50 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:50.220027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-561b7edf-9e37-4677-b110-4471248a0854 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:50.221023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-561b7edf-9e37-4677-b110-4471248a0854 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:50.232948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-561b7edf-9e37-4677-b110-4471248a0854 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:50.234363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-561b7edf-9e37-4677-b110-4471248a0854 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:50.234997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-561b7edf-9e37-4677-b110-4471248a0854 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:50.236023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-561b7edf-9e37-4677-b110-4471248a0854 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:50.236646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-561b7edf-9e37-4677-b110-4471248a0854 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:50.237826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-561b7edf-9e37-4677-b110-4471248a0854 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:50.465213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-561b7edf-9e37-4677-b110-4471248a0854 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:50.474689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:50.492976 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-561b7edf-9e37-4677-b110-4471248a0854 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.278753 Aug 18 11:33:50.509068 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 973/1910] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:50 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:50.520031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-612751309", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:50.621491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:33:50.975749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:33:50.976172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:33:50.976646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:33:50.977053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:33:50.977462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:33:50.990290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:50.990290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:50.990290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:50.990727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:50.991117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:50.991544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:51.011031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Getting quotas for project 7fe39b6aea8849d788b0d0a425c0e591. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:33:51.016488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Getting quotas for user 321f5430950547d3b63d50d87a6a95c6 and project 7fe39b6aea8849d788b0d0a425c0e591. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:33:51.033224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:33:51.035393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:33:51.135856 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d7e7ca21-df5e-476f-bcd4-de6bf2cdbb24 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625529 Aug 18 11:33:51.136557 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 974/1911] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:33:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:33:51.153496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3bdaa008-0f4a-4ef5-a9f5-bd91420c897e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fdca5e0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:51.260336 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3bdaa008-0f4a-4ef5-a9f5-bd91420c897e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.122749 Aug 18 11:33:51.261974 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 975/1912] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:51 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:51.267196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb8f5ad6-286f-4637-8557-7c04aa96240c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:51.274605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bb8f5ad6-286f-4637-8557-7c04aa96240c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:51.289380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb8f5ad6-286f-4637-8557-7c04aa96240c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:51.289866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb8f5ad6-286f-4637-8557-7c04aa96240c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:51.290311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb8f5ad6-286f-4637-8557-7c04aa96240c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:51.292573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb8f5ad6-286f-4637-8557-7c04aa96240c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:51.293048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb8f5ad6-286f-4637-8557-7c04aa96240c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:51.293480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb8f5ad6-286f-4637-8557-7c04aa96240c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:51.606506 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1ec8c751-befe-44d2-bfef-f2322e5587f7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:51.617232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1ec8c751-befe-44d2-bfef-f2322e5587f7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:51.625643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1ec8c751-befe-44d2-bfef-f2322e5587f7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:51.627427 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1ec8c751-befe-44d2-bfef-f2322e5587f7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 1.825753 Aug 18 11:33:51.639580 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 938/1913] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:49 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:51.646763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e3b2be54-c832-47c0-9423-e69234ebcb96 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:51.647739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e3b2be54-c832-47c0-9423-e69234ebcb96 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:51.656858 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3b2be54-c832-47c0-9423-e69234ebcb96 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:51.663151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3b2be54-c832-47c0-9423-e69234ebcb96 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:51.663878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3b2be54-c832-47c0-9423-e69234ebcb96 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:51.664808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3b2be54-c832-47c0-9423-e69234ebcb96 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:51.665446 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3b2be54-c832-47c0-9423-e69234ebcb96 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:51.666074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3b2be54-c832-47c0-9423-e69234ebcb96 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:51.702352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bb8f5ad6-286f-4637-8557-7c04aa96240c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:51.725062 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bb8f5ad6-286f-4637-8557-7c04aa96240c tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84" status: 200 len: 1521 microversion: 2.1 time: 0.461566 Aug 18 11:33:51.726092 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 976/1914] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:51 2022] GET /compute/v2.1/servers/8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:51.730895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-61b7c920-51ef-47c3-ba7e-1d32bab42b9a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:51.731733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-61b7c920-51ef-47c3-ba7e-1d32bab42b9a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:51.740665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61b7c920-51ef-47c3-ba7e-1d32bab42b9a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:51.741405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61b7c920-51ef-47c3-ba7e-1d32bab42b9a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:51.747214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61b7c920-51ef-47c3-ba7e-1d32bab42b9a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:51.748226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61b7c920-51ef-47c3-ba7e-1d32bab42b9a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:51.748968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61b7c920-51ef-47c3-ba7e-1d32bab42b9a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:51.749567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61b7c920-51ef-47c3-ba7e-1d32bab42b9a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:51.871132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-61b7c920-51ef-47c3-ba7e-1d32bab42b9a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5312f9922c246a9a594be35a4a598ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6439cb52de454891b535bd23f11e88b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:51.885312 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-61b7c920-51ef-47c3-ba7e-1d32bab42b9a tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 200 len: 1614 microversion: 2.1 time: 0.157086 Aug 18 11:33:51.887460 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 977/1915] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:51 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 1614 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:51.895642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bbf9a604-df78-4f39-a0d2-5b684ea96d3d tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:51.897228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bbf9a604-df78-4f39-a0d2-5b684ea96d3d tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:51.919164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:51.995915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bbf9a604-df78-4f39-a0d2-5b684ea96d3d tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:52.038003 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bbf9a604-df78-4f39-a0d2-5b684ea96d3d tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1217 microversion: 2.1 time: 0.146253 Aug 18 11:33:52.040050 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 978/1916] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:51 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:52.046005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1f883c1e-9dc4-4afa-9c3e-a96102b6b6e5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:52.047490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1f883c1e-9dc4-4afa-9c3e-a96102b6b6e5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:52.055062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f883c1e-9dc4-4afa-9c3e-a96102b6b6e5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:52.055703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f883c1e-9dc4-4afa-9c3e-a96102b6b6e5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:52.056903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f883c1e-9dc4-4afa-9c3e-a96102b6b6e5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:52.057849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f883c1e-9dc4-4afa-9c3e-a96102b6b6e5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:52.058527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f883c1e-9dc4-4afa-9c3e-a96102b6b6e5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:52.059738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f883c1e-9dc4-4afa-9c3e-a96102b6b6e5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:52.214854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e3b2be54-c832-47c0-9423-e69234ebcb96 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:52.237159 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e3b2be54-c832-47c0-9423-e69234ebcb96 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1210 microversion: 2.1 time: 0.595906 Aug 18 11:33:52.250075 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 939/1917] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:51 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1210 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:52.266887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2796c58c-2e1c-46ec-b47e-6a5d4eec1a37 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:52.267942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2796c58c-2e1c-46ec-b47e-6a5d4eec1a37 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:52.285927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2796c58c-2e1c-46ec-b47e-6a5d4eec1a37 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:52.288401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2796c58c-2e1c-46ec-b47e-6a5d4eec1a37 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:52.290535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2796c58c-2e1c-46ec-b47e-6a5d4eec1a37 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:52.293377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2796c58c-2e1c-46ec-b47e-6a5d4eec1a37 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:52.294030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2796c58c-2e1c-46ec-b47e-6a5d4eec1a37 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:52.297100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2796c58c-2e1c-46ec-b47e-6a5d4eec1a37 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:52.319070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1f883c1e-9dc4-4afa-9c3e-a96102b6b6e5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:52.351829 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1f883c1e-9dc4-4afa-9c3e-a96102b6b6e5 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1272 microversion: 2.1 time: 0.305281 Aug 18 11:33:52.352679 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 979/1918] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:52 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1272 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:52.375510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-84ba16fe-795a-497d-8a0e-cb5f7d00746a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fc2d790>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:52.459415 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-84ba16fe-795a-497d-8a0e-cb5f7d00746a tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.088850 Aug 18 11:33:52.468893 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 980/1919] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:52 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:52.672834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1734e085-b3ff-43b3-91bb-196d355eec97 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:52.673453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1734e085-b3ff-43b3-91bb-196d355eec97 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:52.703045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1734e085-b3ff-43b3-91bb-196d355eec97 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:52.703634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1734e085-b3ff-43b3-91bb-196d355eec97 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:52.704157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1734e085-b3ff-43b3-91bb-196d355eec97 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:52.714231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1734e085-b3ff-43b3-91bb-196d355eec97 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:52.716245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1734e085-b3ff-43b3-91bb-196d355eec97 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:52.717809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1734e085-b3ff-43b3-91bb-196d355eec97 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:53.169223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1734e085-b3ff-43b3-91bb-196d355eec97 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:53.183072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1734e085-b3ff-43b3-91bb-196d355eec97 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:53.188082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1734e085-b3ff-43b3-91bb-196d355eec97 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:53.189087 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1734e085-b3ff-43b3-91bb-196d355eec97 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.521841 Aug 18 11:33:53.189684 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 981/1920] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:52 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:33:53.199023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e54fe78-f9c7-4f3f-8a55-632e2e323301 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:53.199640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1e54fe78-f9c7-4f3f-8a55-632e2e323301 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:53.217894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e54fe78-f9c7-4f3f-8a55-632e2e323301 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:53.220610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e54fe78-f9c7-4f3f-8a55-632e2e323301 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:53.221162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e54fe78-f9c7-4f3f-8a55-632e2e323301 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:53.222053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e54fe78-f9c7-4f3f-8a55-632e2e323301 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:53.225748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e54fe78-f9c7-4f3f-8a55-632e2e323301 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:53.226562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e54fe78-f9c7-4f3f-8a55-632e2e323301 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:53.809279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2796c58c-2e1c-46ec-b47e-6a5d4eec1a37 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:53.827359 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2796c58c-2e1c-46ec-b47e-6a5d4eec1a37 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 1.571440 Aug 18 11:33:53.828014 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 940/1921] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:52 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:53.841864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-182cba81-3ed3-4886-81ac-41050c915577 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:53.847492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-182cba81-3ed3-4886-81ac-41050c915577 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] [instance: ba680fc7-c565-43cb-9551-f9f71f1f66f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:53.864946 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-182cba81-3ed3-4886-81ac-41050c915577 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:53.867510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-182cba81-3ed3-4886-81ac-41050c915577 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:53.869715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-182cba81-3ed3-4886-81ac-41050c915577 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:53.875010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-182cba81-3ed3-4886-81ac-41050c915577 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:53.875909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-182cba81-3ed3-4886-81ac-41050c915577 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:53.877967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-182cba81-3ed3-4886-81ac-41050c915577 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:53.916799 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-182cba81-3ed3-4886-81ac-41050c915577 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] HTTP exception thrown: Instance ba680fc7-c565-43cb-9551-f9f71f1f66f4 could not be found. Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-182cba81-3ed3-4886-81ac-41050c915577 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Request method failure captured: Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 HTTP/1.1 Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iLNyBWHRpE5A1xSuMCY-zKLcxMxeDuFIfS3bIWhBGVVZOfjC_vWC6pw3oiTARce4Kc8W_31C9CH_CpIUA5vF5-8RiEkD0K7q3Lb6Y1hcR5CEOIpadBfnPFV3fI49iJVU2VLoFDk-G0gRDfxHvYp6wTbvNAOOJLnPyCwxpak5-oPUdo Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6439cb52de454891b535bd23f11e88b1 Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-VolumesAdminNegativeTest-1930471309 Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:33:53.923320 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:33:53.925441 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6439cb52de454891b535bd23f11e88b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6439cb52de454891b535bd23f11e88b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6439cb52de454891b535bd23f11e88b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6439cb52de454891b535bd23f11e88b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:53.925441 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-VolumesAdminNegativeTest-1930471309 Aug 18 11:33:53.925441 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6439cb52de454891b535bd23f11e88b1 Aug 18 11:33:53.925441 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1930471309 Aug 18 11:33:53.925441 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-VolumesAdminNegativeTest-1930471309-project Aug 18 11:33:53.925441 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:33:53.925441 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:33:53.925441 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: d5312f9922c246a9a594be35a4a598ac Aug 18 11:33:53.925441 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-VolumesAdminNegativeTest-1930471309-project Aug 18 11:33:53.925441 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:33:53.925441 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance ba680fc7-c565-43cb-9551-f9f71f1f66f4 could not be found. Aug 18 11:33:53.925441 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'ba680fc7-c565-43cb-9551-f9f71f1f66f4'} Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba680fc7-c565-43cb-9551-f9f71f1f66f4 could not be found. Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:53.926385 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba680fc7-c565-43cb-9551-f9f71f1f66f4 could not be found. Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba680fc7-c565-43cb-9551-f9f71f1f66f4 could not be found. Aug 18 11:33:53.929904 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:53.935448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-182cba81-3ed3-4886-81ac-41050c915577 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Returning 404 to user: Instance ba680fc7-c565-43cb-9551-f9f71f1f66f4 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:53.938007 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-182cba81-3ed3-4886-81ac-41050c915577 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4" status: 404 len: 111 microversion: 2.1 time: 0.106417 Aug 18 11:33:53.941746 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 941/1922] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:53 2022] GET /compute/v2.1/servers/ba680fc7-c565-43cb-9551-f9f71f1f66f4 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:33:53.958132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0e122c8e-6047-4ded-8eb5-bf2960de72d9 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:53.959133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0e122c8e-6047-4ded-8eb5-bf2960de72d9 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:53.976677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e122c8e-6047-4ded-8eb5-bf2960de72d9 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:53.982395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e122c8e-6047-4ded-8eb5-bf2960de72d9 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:53.983842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e122c8e-6047-4ded-8eb5-bf2960de72d9 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:53.985181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e122c8e-6047-4ded-8eb5-bf2960de72d9 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:53.986054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e122c8e-6047-4ded-8eb5-bf2960de72d9 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:53.987095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e122c8e-6047-4ded-8eb5-bf2960de72d9 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:54.214327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0e122c8e-6047-4ded-8eb5-bf2960de72d9 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:54.231168 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0e122c8e-6047-4ded-8eb5-bf2960de72d9 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1275 microversion: 2.1 time: 0.285033 Aug 18 11:33:54.234687 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 942/1923] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:53 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1275 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:54.247508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-0fe4ede3-f220-49a9-966e-08ac695fe962 req-ef915ea8-aa17-454f-a23a-789d44f16ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba680fc7-c565-43cb-9551-f9f71f1f66f4", "name": "network-vif-deleted", "tag": "5e7be3c3-f066-4799-bcf8-bdf28f819406"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:54.272840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0fe4ede3-f220-49a9-966e-08ac695fe962 req-ef915ea8-aa17-454f-a23a-789d44f16ac1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:54.273613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0fe4ede3-f220-49a9-966e-08ac695fe962 req-ef915ea8-aa17-454f-a23a-789d44f16ac1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:54.289157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0fe4ede3-f220-49a9-966e-08ac695fe962 req-ef915ea8-aa17-454f-a23a-789d44f16ac1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:54.293854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1e54fe78-f9c7-4f3f-8a55-632e2e323301 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab807fb8bcd4081ac5140bb24b4358c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845b1ec9db86457a9b110eef1b36d898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:54.321879 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-0fe4ede3-f220-49a9-966e-08ac695fe962 req-ef915ea8-aa17-454f-a23a-789d44f16ac1 service nova] Creating event network-vif-deleted:5e7be3c3-f066-4799-bcf8-bdf28f819406 for instance ba680fc7-c565-43cb-9551-f9f71f1f66f4 on n-h2-853611-3 Aug 18 11:33:54.331662 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1e54fe78-f9c7-4f3f-8a55-632e2e323301 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84" status: 200 len: 1521 microversion: 2.1 time: 1.121556 Aug 18 11:33:54.333465 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 982/1924] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:53 2022] GET /compute/v2.1/servers/8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 => generated 1521 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:54.353132 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-0fe4ede3-f220-49a9-966e-08ac695fe962 req-ef915ea8-aa17-454f-a23a-789d44f16ac1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116118 Aug 18 11:33:54.359669 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 943/1925] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:54.365134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8fc26e24-bcb7-491f-a844-1638e25e3a4b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:54.369676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8fc26e24-bcb7-491f-a844-1638e25e3a4b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:54.371552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2b8c98ee-b951-43bc-8ee0-f4af3b4d1a1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:54.375487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2b8c98ee-b951-43bc-8ee0-f4af3b4d1a1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:54.401282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fc26e24-bcb7-491f-a844-1638e25e3a4b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:54.403819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fc26e24-bcb7-491f-a844-1638e25e3a4b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:54.409885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fc26e24-bcb7-491f-a844-1638e25e3a4b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:54.411803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fc26e24-bcb7-491f-a844-1638e25e3a4b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:54.413441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fc26e24-bcb7-491f-a844-1638e25e3a4b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:54.417394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fc26e24-bcb7-491f-a844-1638e25e3a4b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:54.418400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b8c98ee-b951-43bc-8ee0-f4af3b4d1a1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:54.419071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b8c98ee-b951-43bc-8ee0-f4af3b4d1a1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:54.419532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b8c98ee-b951-43bc-8ee0-f4af3b4d1a1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:54.420880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b8c98ee-b951-43bc-8ee0-f4af3b4d1a1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:54.422002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b8c98ee-b951-43bc-8ee0-f4af3b4d1a1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:54.422002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b8c98ee-b951-43bc-8ee0-f4af3b4d1a1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:54.751079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8fc26e24-bcb7-491f-a844-1638e25e3a4b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:54.778787 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8fc26e24-bcb7-491f-a844-1638e25e3a4b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1272 microversion: 2.1 time: 0.437956 Aug 18 11:33:54.782146 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 983/1926] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:54 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1272 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:54.796796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76fd0d40-5790-4ab3-8461-e76516668d24 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f78a430>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:54.962084 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76fd0d40-5790-4ab3-8461-e76516668d24 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.177713 Aug 18 11:33:54.963735 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 984/1927] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:54 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:54.972759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-45ac572f-e69f-4a33-8770-80f3914088e1 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] Calling method '.version_select at 0x7f519f835ee0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:55.044973 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-45ac572f-e69f-4a33-8770-80f3914088e1 tempest-VolumesAdminNegativeTest-1930471309 tempest-VolumesAdminNegativeTest-1930471309-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1904316241" status: 202 len: 0 microversion: 2.1 time: 0.079831 Aug 18 11:33:55.047317 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 985/1928] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 11:33:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1904316241 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:33:55.051357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2b8c98ee-b951-43bc-8ee0-f4af3b4d1a1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:55.070421 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2b8c98ee-b951-43bc-8ee0-f4af3b4d1a1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1272 microversion: 2.1 time: 0.709076 Aug 18 11:33:55.080919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-faea821d-5991-45bf-bae9-ecc40c98303b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:55.082056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-faea821d-5991-45bf-bae9-ecc40c98303b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:55.093013 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 944/1929] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:54 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1272 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:55.106040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c86884df-3676-4bf8-bcea-033bf85ec9d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:55.111049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-faea821d-5991-45bf-bae9-ecc40c98303b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:55.116349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c86884df-3676-4bf8-bcea-033bf85ec9d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:55.117254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-faea821d-5991-45bf-bae9-ecc40c98303b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:55.119236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-faea821d-5991-45bf-bae9-ecc40c98303b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:55.121613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-faea821d-5991-45bf-bae9-ecc40c98303b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:55.122413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-faea821d-5991-45bf-bae9-ecc40c98303b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:55.129137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-faea821d-5991-45bf-bae9-ecc40c98303b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:55.142970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c86884df-3676-4bf8-bcea-033bf85ec9d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:55.142970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c86884df-3676-4bf8-bcea-033bf85ec9d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:55.143437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c86884df-3676-4bf8-bcea-033bf85ec9d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:55.143917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c86884df-3676-4bf8-bcea-033bf85ec9d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:55.144377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c86884df-3676-4bf8-bcea-033bf85ec9d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:55.144808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c86884df-3676-4bf8-bcea-033bf85ec9d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:55.822490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c86884df-3676-4bf8-bcea-033bf85ec9d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:55.837436 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c86884df-3676-4bf8-bcea-033bf85ec9d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.743203 Aug 18 11:33:55.839165 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 945/1930] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:55 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:55.850855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fdfde472-0acf-44c1-b12c-07ebb1869070 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:55.855133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fdfde472-0acf-44c1-b12c-07ebb1869070 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:55.871435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdfde472-0acf-44c1-b12c-07ebb1869070 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:55.874928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdfde472-0acf-44c1-b12c-07ebb1869070 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:55.875361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdfde472-0acf-44c1-b12c-07ebb1869070 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:55.880925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdfde472-0acf-44c1-b12c-07ebb1869070 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:55.881466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdfde472-0acf-44c1-b12c-07ebb1869070 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:55.881903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdfde472-0acf-44c1-b12c-07ebb1869070 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:56.068322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fdfde472-0acf-44c1-b12c-07ebb1869070 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:56.086413 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fdfde472-0acf-44c1-b12c-07ebb1869070 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1275 microversion: 2.1 time: 0.245931 Aug 18 11:33:56.087776 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 946/1931] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:55 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1275 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:56.096817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d036dcd0-9f40-4b56-9e2f-471756018ca4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:56.107402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d036dcd0-9f40-4b56-9e2f-471756018ca4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:56.115225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d036dcd0-9f40-4b56-9e2f-471756018ca4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:56.119991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d036dcd0-9f40-4b56-9e2f-471756018ca4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:56.121173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d036dcd0-9f40-4b56-9e2f-471756018ca4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:56.123415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d036dcd0-9f40-4b56-9e2f-471756018ca4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:56.126880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d036dcd0-9f40-4b56-9e2f-471756018ca4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:56.132507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d036dcd0-9f40-4b56-9e2f-471756018ca4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:56.162827 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-d036dcd0-9f40-4b56-9e2f-471756018ca4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] HTTP exception thrown: Instance 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 could not be found. Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d036dcd0-9f40-4b56-9e2f-471756018ca4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Request method failure captured: Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 HTTP/1.1 Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iNZdcAg8SY4hlhh9Drx4_tcjizL0r44nIOuI_79_Wuzsra1AbZA26rHsn4Xo8ZrEABkwxjZWXv_aKhLGCuGtym3qJHuddyYJxsYOEXwSiPvRPgFc8Uc4GtUB0IP_UCkV4ozw1UsdEnOSzPevQNGTXtADLHG3FxTvgra5idI3UXLuk0 Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:33:56.165338 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:33:56.167262 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:56.167262 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:56.167262 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:56.167262 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:56.167262 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:56.167262 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:33:56.167262 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:33:56.167262 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 0ab807fb8bcd4081ac5140bb24b4358c Aug 18 11:33:56.167262 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:56.167262 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:33:56.167262 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 could not be found. Aug 18 11:33:56.167262 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84'} Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 could not be found. Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:56.168351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 could not be found. Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 could not be found. Aug 18 11:33:56.170068 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:33:56.175455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d036dcd0-9f40-4b56-9e2f-471756018ca4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Returning 404 to user: Instance 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:56.180076 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d036dcd0-9f40-4b56-9e2f-471756018ca4 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84" status: 404 len: 111 microversion: 2.1 time: 0.087836 Aug 18 11:33:56.181203 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 947/1932] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:56 2022] GET /compute/v2.1/servers/8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:33:56.188845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-88c18c03-b0b0-4808-b80e-e477b6835c04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:56.189783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-88c18c03-b0b0-4808-b80e-e477b6835c04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:56.196208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88c18c03-b0b0-4808-b80e-e477b6835c04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:56.197003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88c18c03-b0b0-4808-b80e-e477b6835c04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:56.197668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88c18c03-b0b0-4808-b80e-e477b6835c04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:56.198678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88c18c03-b0b0-4808-b80e-e477b6835c04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:56.199523 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88c18c03-b0b0-4808-b80e-e477b6835c04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:56.200180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88c18c03-b0b0-4808-b80e-e477b6835c04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:56.409533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-88c18c03-b0b0-4808-b80e-e477b6835c04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:56.427687 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-88c18c03-b0b0-4808-b80e-e477b6835c04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1272 microversion: 2.1 time: 0.243792 Aug 18 11:33:56.439603 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 948/1933] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:56 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:56.449010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a3acb79f-3387-4799-ab17-b992d4cfaa23 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f62d8b0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:56.546613 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a3acb79f-3387-4799-ab17-b992d4cfaa23 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1439 microversion: 2.1 time: 0.105462 Aug 18 11:33:56.557879 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 949/1934] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:56 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1439 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:56.573481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f1b12da3-6b0f-4dc0-83a6-d112ec7409b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:56.579448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f1b12da3-6b0f-4dc0-83a6-d112ec7409b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:56.597651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-faea821d-5991-45bf-bae9-ecc40c98303b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:56.612442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1b12da3-6b0f-4dc0-83a6-d112ec7409b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:56.614878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1b12da3-6b0f-4dc0-83a6-d112ec7409b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:56.614878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1b12da3-6b0f-4dc0-83a6-d112ec7409b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:56.614878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1b12da3-6b0f-4dc0-83a6-d112ec7409b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:56.616278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1b12da3-6b0f-4dc0-83a6-d112ec7409b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:56.616278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1b12da3-6b0f-4dc0-83a6-d112ec7409b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:56.662611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-faea821d-5991-45bf-bae9-ecc40c98303b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:56.667330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-faea821d-5991-45bf-bae9-ecc40c98303b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:56.671236 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-faea821d-5991-45bf-bae9-ecc40c98303b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 1.604193 Aug 18 11:33:56.673356 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 986/1935] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:55 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:56.684345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e300321-8e47-48e0-8ae5-c654257ae743 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:56.685359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e300321-8e47-48e0-8ae5-c654257ae743 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] [instance: d278c6fc-34a1-4830-9e81-d644ff49e10d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:56.711047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e300321-8e47-48e0-8ae5-c654257ae743 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:56.712724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e300321-8e47-48e0-8ae5-c654257ae743 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:56.713835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e300321-8e47-48e0-8ae5-c654257ae743 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:56.716013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e300321-8e47-48e0-8ae5-c654257ae743 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:56.721411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e300321-8e47-48e0-8ae5-c654257ae743 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:56.724636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e300321-8e47-48e0-8ae5-c654257ae743 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:56.756464 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-0e300321-8e47-48e0-8ae5-c654257ae743 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] HTTP exception thrown: Instance d278c6fc-34a1-4830-9e81-d644ff49e10d could not be found. Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e300321-8e47-48e0-8ae5-c654257ae743 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Request method failure captured: Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d HTTP/1.1 Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iNZdcAg8SY4hlhh9Drx4_tcjizL0r44nIOuI_79_Wuzsra1AbZA26rHsn4Xo8ZrEABkwxjZWXv_aKhLGCuGtym3qJHuddyYJxsYOEXwSiPvRPgFc8Uc4GtUB0IP_UCkV4ozw1UsdEnOSzPevQNGTXtADLHG3FxTvgra5idI3UXLuk0 Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:33:56.758718 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:33:56.760510 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/845b1ec9db86457a9b110eef1b36d898"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:33:56.760510 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:56.760510 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 845b1ec9db86457a9b110eef1b36d898 Aug 18 11:33:56.760510 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-141436045 Aug 18 11:33:56.760510 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:56.760510 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:33:56.760510 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:33:56.760510 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 0ab807fb8bcd4081ac5140bb24b4358c Aug 18 11:33:56.760510 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ListServersNegativeTestJSON-141436045-project Aug 18 11:33:56.760510 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:33:56.760510 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance d278c6fc-34a1-4830-9e81-d644ff49e10d could not be found. Aug 18 11:33:56.760510 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'd278c6fc-34a1-4830-9e81-d644ff49e10d'} Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d278c6fc-34a1-4830-9e81-d644ff49e10d could not be found. Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:33:56.761473 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d278c6fc-34a1-4830-9e81-d644ff49e10d could not be found. Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d278c6fc-34a1-4830-9e81-d644ff49e10d could not be found. Aug 18 11:33:56.765095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:33:56.769861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e300321-8e47-48e0-8ae5-c654257ae743 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] Returning 404 to user: Instance d278c6fc-34a1-4830-9e81-d644ff49e10d could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:33:56.771310 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e300321-8e47-48e0-8ae5-c654257ae743 tempest-ListServersNegativeTestJSON-141436045 tempest-ListServersNegativeTestJSON-141436045-project] 10.222.0.73 "GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d" status: 404 len: 111 microversion: 2.1 time: 0.095526 Aug 18 11:33:56.772518 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 987/1936] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:56 2022] GET /compute/v2.1/servers/d278c6fc-34a1-4830-9e81-d644ff49e10d => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:33:56.781747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-00c15789-a70c-4c7f-a8e9-d461e1f1fc99 req-1252d108-79d7-4d59-a8e5-6d3efe094b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84", "name": "network-vif-deleted", "tag": "3edd002c-1a59-4f75-96f6-1d8c15c5a54f"}, {"server_uuid": "19d34316-2cf9-44a6-a370-673959e72cb3", "name": "network-vif-unplugged", "status": "completed", "tag": "0e79fe89-a5db-4cc8-a9e2-eeb3956f1a86"}, {"server_uuid": "d278c6fc-34a1-4830-9e81-d644ff49e10d", "name": "network-vif-deleted", "tag": "55065be2-4f0e-4654-a40b-a54830d4acf4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:56.805020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-00c15789-a70c-4c7f-a8e9-d461e1f1fc99 req-1252d108-79d7-4d59-a8e5-6d3efe094b5f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:56.808650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-00c15789-a70c-4c7f-a8e9-d461e1f1fc99 req-1252d108-79d7-4d59-a8e5-6d3efe094b5f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:56.810073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-00c15789-a70c-4c7f-a8e9-d461e1f1fc99 req-1252d108-79d7-4d59-a8e5-6d3efe094b5f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:56.875501 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-00c15789-a70c-4c7f-a8e9-d461e1f1fc99 req-1252d108-79d7-4d59-a8e5-6d3efe094b5f service nova] Creating event network-vif-deleted:3edd002c-1a59-4f75-96f6-1d8c15c5a54f for instance 8df4c9fe-8cb3-4a4e-80a4-f784eeb3ae84 on n-h1-853611-3 Aug 18 11:33:56.876460 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-00c15789-a70c-4c7f-a8e9-d461e1f1fc99 req-1252d108-79d7-4d59-a8e5-6d3efe094b5f service nova] Creating event network-vif-unplugged:0e79fe89-a5db-4cc8-a9e2-eeb3956f1a86 for instance 19d34316-2cf9-44a6-a370-673959e72cb3 on n-h1-853611-3 Aug 18 11:33:56.877270 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-00c15789-a70c-4c7f-a8e9-d461e1f1fc99 req-1252d108-79d7-4d59-a8e5-6d3efe094b5f service nova] Creating event network-vif-deleted:55065be2-4f0e-4654-a40b-a54830d4acf4 for instance d278c6fc-34a1-4830-9e81-d644ff49e10d on n-h2-853611-3 Aug 18 11:33:56.891434 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-00c15789-a70c-4c7f-a8e9-d461e1f1fc99 req-1252d108-79d7-4d59-a8e5-6d3efe094b5f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.117051 Aug 18 11:33:56.892935 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 988/1937] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:56.903677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d2f3c977-a387-45aa-b05e-b2e82affa41e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:56.909707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d2f3c977-a387-45aa-b05e-b2e82affa41e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:56.921365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2f3c977-a387-45aa-b05e-b2e82affa41e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:56.922810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2f3c977-a387-45aa-b05e-b2e82affa41e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:56.923774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2f3c977-a387-45aa-b05e-b2e82affa41e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:56.924954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2f3c977-a387-45aa-b05e-b2e82affa41e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:56.927693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2f3c977-a387-45aa-b05e-b2e82affa41e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:56.929046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2f3c977-a387-45aa-b05e-b2e82affa41e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:57.193497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=12 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:57.536194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f1b12da3-6b0f-4dc0-83a6-d112ec7409b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:57.571742 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f1b12da3-6b0f-4dc0-83a6-d112ec7409b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1314 microversion: 2.1 time: 1.011588 Aug 18 11:33:57.582155 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 950/1938] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:56 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:57.614888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cf749d20-944d-4ce2-bd35-316619773891 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:57.618081 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cf749d20-944d-4ce2-bd35-316619773891 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:57.634571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cf749d20-944d-4ce2-bd35-316619773891 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:57.635100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cf749d20-944d-4ce2-bd35-316619773891 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:57.638693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cf749d20-944d-4ce2-bd35-316619773891 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:57.641101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cf749d20-944d-4ce2-bd35-316619773891 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:57.642754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cf749d20-944d-4ce2-bd35-316619773891 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:57.643811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cf749d20-944d-4ce2-bd35-316619773891 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:57.858857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cf749d20-944d-4ce2-bd35-316619773891 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:57.869778 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cf749d20-944d-4ce2-bd35-316619773891 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1275 microversion: 2.1 time: 0.284528 Aug 18 11:33:57.877379 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 951/1939] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:57 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1275 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:57.888229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aeb36457-8698-4095-ac9c-ad0b3d25e992 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:57.892258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-aeb36457-8698-4095-ac9c-ad0b3d25e992 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:57.905590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb36457-8698-4095-ac9c-ad0b3d25e992 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:57.906194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb36457-8698-4095-ac9c-ad0b3d25e992 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:57.906685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb36457-8698-4095-ac9c-ad0b3d25e992 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:57.907885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb36457-8698-4095-ac9c-ad0b3d25e992 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:57.908565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb36457-8698-4095-ac9c-ad0b3d25e992 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:57.909222 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb36457-8698-4095-ac9c-ad0b3d25e992 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:57.918289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2f3c977-a387-45aa-b05e-b2e82affa41e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:57.934321 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d2f3c977-a387-45aa-b05e-b2e82affa41e tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 1.038247 Aug 18 11:33:57.935826 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 989/1940] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:56 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:57.953906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-48ad0746-50c5-42ab-bef9-27716cceaccc tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f835820>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:57.991154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:58.042054 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-48ad0746-50c5-42ab-bef9-27716cceaccc tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1448 microversion: 2.1 time: 0.104126 Aug 18 11:33:58.042982 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 990/1941] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:57 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1448 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:58.058887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1422ebc-e1d4-4517-bfdc-28781a766d05 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:58.059772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1422ebc-e1d4-4517-bfdc-28781a766d05 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:58.068653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1422ebc-e1d4-4517-bfdc-28781a766d05 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:58.069466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1422ebc-e1d4-4517-bfdc-28781a766d05 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:58.070087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1422ebc-e1d4-4517-bfdc-28781a766d05 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:58.071024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1422ebc-e1d4-4517-bfdc-28781a766d05 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:58.072173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1422ebc-e1d4-4517-bfdc-28781a766d05 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:58.073013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1422ebc-e1d4-4517-bfdc-28781a766d05 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:58.129066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=10 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:33:58.575845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a1422ebc-e1d4-4517-bfdc-28781a766d05 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:58.588602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a1422ebc-e1d4-4517-bfdc-28781a766d05 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:58.590340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a1422ebc-e1d4-4517-bfdc-28781a766d05 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:58.591657 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1422ebc-e1d4-4517-bfdc-28781a766d05 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.537444 Aug 18 11:33:58.592233 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 991/1942] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:58 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:33:58.597091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-97154ccd-ec8e-4fe1-9e4a-242290d0b0be tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f828af0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:58.637170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aeb36457-8698-4095-ac9c-ad0b3d25e992 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:58.645622 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aeb36457-8698-4095-ac9c-ad0b3d25e992 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1314 microversion: 2.1 time: 0.766997 Aug 18 11:33:58.646590 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 952/1943] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:57 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:58.652339 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3830c236-5328-4f2d-b357-24c97543121d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:58.653296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3830c236-5328-4f2d-b357-24c97543121d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:58.660422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3830c236-5328-4f2d-b357-24c97543121d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:58.661278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3830c236-5328-4f2d-b357-24c97543121d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:58.661917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3830c236-5328-4f2d-b357-24c97543121d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:58.662994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3830c236-5328-4f2d-b357-24c97543121d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:58.663503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3830c236-5328-4f2d-b357-24c97543121d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:58.664251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3830c236-5328-4f2d-b357-24c97543121d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:58.673202 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-97154ccd-ec8e-4fe1-9e4a-242290d0b0be tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 200 len: 1448 microversion: 2.1 time: 0.079554 Aug 18 11:33:58.674119 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 992/1944] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:33:58 2022] GET /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 1448 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:58.694996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34134727-b211-4436-b2a0-0fb6819189c6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fcb99d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:59.105109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3830c236-5328-4f2d-b357-24c97543121d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:59.114759 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3830c236-5328-4f2d-b357-24c97543121d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1314 microversion: 2.1 time: 0.466751 Aug 18 11:33:59.120171 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 953/1945] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:58 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:59.130953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a7b802bd-275c-44e8-8fc8-2f00b07c5b6f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:59.132040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a7b802bd-275c-44e8-8fc8-2f00b07c5b6f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:59.155016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7b802bd-275c-44e8-8fc8-2f00b07c5b6f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:59.157601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7b802bd-275c-44e8-8fc8-2f00b07c5b6f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:59.158381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7b802bd-275c-44e8-8fc8-2f00b07c5b6f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:59.159417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7b802bd-275c-44e8-8fc8-2f00b07c5b6f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:59.160261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7b802bd-275c-44e8-8fc8-2f00b07c5b6f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:59.165968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7b802bd-275c-44e8-8fc8-2f00b07c5b6f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:59.307927 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34134727-b211-4436-b2a0-0fb6819189c6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 204 len: 0 microversion: 2.1 time: 0.616609 Aug 18 11:33:59.309662 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 993/1946] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:58 2022] DELETE /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:33:59.315731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b795cbf2-f124-4615-9ae2-a15beb429d5a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:59.345751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b795cbf2-f124-4615-9ae2-a15beb429d5a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:59.362206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b795cbf2-f124-4615-9ae2-a15beb429d5a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:59.362823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b795cbf2-f124-4615-9ae2-a15beb429d5a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:59.364775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b795cbf2-f124-4615-9ae2-a15beb429d5a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:59.366272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b795cbf2-f124-4615-9ae2-a15beb429d5a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:59.368601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b795cbf2-f124-4615-9ae2-a15beb429d5a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:59.369164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b795cbf2-f124-4615-9ae2-a15beb429d5a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:59.620688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a7b802bd-275c-44e8-8fc8-2f00b07c5b6f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:59.632456 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a7b802bd-275c-44e8-8fc8-2f00b07c5b6f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1317 microversion: 2.1 time: 0.513651 Aug 18 11:33:59.645885 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 954/1947] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:59 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1317 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:59.645885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-cd051519-27a8-4500-b263-fd64a53003ac req-75f4d0f6-7062-4a74-9b54-21c554b4d8ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d34316-2cf9-44a6-a370-673959e72cb3", "tag": "0e79fe89-a5db-4cc8-a9e2-eeb3956f1a86"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:33:59.659913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-cd051519-27a8-4500-b263-fd64a53003ac req-75f4d0f6-7062-4a74-9b54-21c554b4d8ae service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:59.660530 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-cd051519-27a8-4500-b263-fd64a53003ac req-75f4d0f6-7062-4a74-9b54-21c554b4d8ae service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:59.661252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-cd051519-27a8-4500-b263-fd64a53003ac req-75f4d0f6-7062-4a74-9b54-21c554b4d8ae service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:59.675830 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-cd051519-27a8-4500-b263-fd64a53003ac req-75f4d0f6-7062-4a74-9b54-21c554b4d8ae service nova] Creating event network-changed:0e79fe89-a5db-4cc8-a9e2-eeb3956f1a86 for instance 19d34316-2cf9-44a6-a370-673959e72cb3 on n-h1-853611-3 Aug 18 11:33:59.686593 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-cd051519-27a8-4500-b263-fd64a53003ac req-75f4d0f6-7062-4a74-9b54-21c554b4d8ae service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049891 Aug 18 11:33:59.688328 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 955/1948] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:33:59.696608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-977af29a-2ffc-4d87-8c4e-0c873cf03b93 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:59.697353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-977af29a-2ffc-4d87-8c4e-0c873cf03b93 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:59.705671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-977af29a-2ffc-4d87-8c4e-0c873cf03b93 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:59.706252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-977af29a-2ffc-4d87-8c4e-0c873cf03b93 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:59.711735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-977af29a-2ffc-4d87-8c4e-0c873cf03b93 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:59.711735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-977af29a-2ffc-4d87-8c4e-0c873cf03b93 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:59.711735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-977af29a-2ffc-4d87-8c4e-0c873cf03b93 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:59.711735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-977af29a-2ffc-4d87-8c4e-0c873cf03b93 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:59.748968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-977af29a-2ffc-4d87-8c4e-0c873cf03b93 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:33:59.871699 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-977af29a-2ffc-4d87-8c4e-0c873cf03b93 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6" status: 204 len: 0 microversion: 2.1 time: 0.178118 Aug 18 11:33:59.873048 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 956/1949] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:33:59 2022] DELETE /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:33:59.881368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1d0951e0-d7dc-4994-834c-da860117b2da tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:59.886681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b795cbf2-f124-4615-9ae2-a15beb429d5a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:33:59.888395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1d0951e0-d7dc-4994-834c-da860117b2da tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:59.904496 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b795cbf2-f124-4615-9ae2-a15beb429d5a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.592251 Aug 18 11:33:59.906089 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 994/1950] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:59 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:33:59.910992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d0951e0-d7dc-4994-834c-da860117b2da tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:59.911848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d0951e0-d7dc-4994-834c-da860117b2da tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:59.912572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d0951e0-d7dc-4994-834c-da860117b2da tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:59.913849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ede433b9-8a0c-40ad-b9a0-957411fbd962 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:33:59.914751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ede433b9-8a0c-40ad-b9a0-957411fbd962 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:33:59.917593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d0951e0-d7dc-4994-834c-da860117b2da tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:59.918323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d0951e0-d7dc-4994-834c-da860117b2da tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:59.921358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d0951e0-d7dc-4994-834c-da860117b2da tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:59.927176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ede433b9-8a0c-40ad-b9a0-957411fbd962 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:59.927930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ede433b9-8a0c-40ad-b9a0-957411fbd962 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:59.928792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ede433b9-8a0c-40ad-b9a0-957411fbd962 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:33:59.933048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ede433b9-8a0c-40ad-b9a0-957411fbd962 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:33:59.937902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ede433b9-8a0c-40ad-b9a0-957411fbd962 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:33:59.940125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ede433b9-8a0c-40ad-b9a0-957411fbd962 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:00.290974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1d0951e0-d7dc-4994-834c-da860117b2da tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:00.300468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1d0951e0-d7dc-4994-834c-da860117b2da tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:00.301929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1d0951e0-d7dc-4994-834c-da860117b2da tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:00.303195 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1d0951e0-d7dc-4994-834c-da860117b2da tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.428514 Aug 18 11:34:00.304060 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 957/1951] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:33:59 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:00.309150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-859597008", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "9087955c-aa00-44c0-84c8-58368fdadbd5"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:00.385043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] validate_networks() for [('9087955c-aa00-44c0-84c8-58368fdadbd5', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:34:00.546061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ede433b9-8a0c-40ad-b9a0-957411fbd962 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:00.556306 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ede433b9-8a0c-40ad-b9a0-957411fbd962 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1314 microversion: 2.1 time: 0.648845 Aug 18 11:34:00.567900 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 995/1952] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:33:59 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:00.579823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-100bb475-0979-4e87-bda0-c267b12b5876 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:00.580755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-100bb475-0979-4e87-bda0-c267b12b5876 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:00.587013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-100bb475-0979-4e87-bda0-c267b12b5876 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:00.587960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-100bb475-0979-4e87-bda0-c267b12b5876 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:00.588616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-100bb475-0979-4e87-bda0-c267b12b5876 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:00.589548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-100bb475-0979-4e87-bda0-c267b12b5876 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:00.590235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-100bb475-0979-4e87-bda0-c267b12b5876 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:00.590809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-100bb475-0979-4e87-bda0-c267b12b5876 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:01.002212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=14 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:01.053485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-100bb475-0979-4e87-bda0-c267b12b5876 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:01.062393 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-100bb475-0979-4e87-bda0-c267b12b5876 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1314 microversion: 2.1 time: 0.489185 Aug 18 11:34:01.075877 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 996/1953] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:00 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:01.083984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f94965f8-08b0-4d54-adcf-f3446c911b64 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:01.085387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f94965f8-08b0-4d54-adcf-f3446c911b64 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:01.092862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f94965f8-08b0-4d54-adcf-f3446c911b64 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:01.093800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f94965f8-08b0-4d54-adcf-f3446c911b64 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:01.094558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f94965f8-08b0-4d54-adcf-f3446c911b64 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:01.095486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f94965f8-08b0-4d54-adcf-f3446c911b64 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:01.096198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f94965f8-08b0-4d54-adcf-f3446c911b64 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:01.096850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f94965f8-08b0-4d54-adcf-f3446c911b64 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:01.156298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:34:01.156298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:34:01.156298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:34:01.156298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:34:01.156298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:34:01.174393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:01.175205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:01.175839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:01.177773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:01.178235 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:01.178771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:01.193864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:01.203236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Getting quotas for project 287b7017444e47b48aa08661b84a3798. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:34:01.210185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Getting quotas for user 678c78e8696f45c1a9d099199fcdcd36 and project 287b7017444e47b48aa08661b84a3798. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:34:01.239746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:34:01.242581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:34:01.318642 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6040158c-b6de-405f-9898-e157cc23c5c4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013040 Aug 18 11:34:01.327260 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 958/1954] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:34:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:34:01.333084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-c947f618-2d60-4e10-8987-feb48a6eaa51 req-8b526579-6503-4032-80e7-51f3fdb7bfb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e3865d-a413-4c57-b0dc-1b29e76be1de", "tag": "1fd7f00c-a7c9-42e6-b6f0-3b9378c92c89"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:01.347631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c947f618-2d60-4e10-8987-feb48a6eaa51 req-8b526579-6503-4032-80e7-51f3fdb7bfb1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:01.356765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c947f618-2d60-4e10-8987-feb48a6eaa51 req-8b526579-6503-4032-80e7-51f3fdb7bfb1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:01.358248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c947f618-2d60-4e10-8987-feb48a6eaa51 req-8b526579-6503-4032-80e7-51f3fdb7bfb1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:01.375758 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-c947f618-2d60-4e10-8987-feb48a6eaa51 req-8b526579-6503-4032-80e7-51f3fdb7bfb1 service nova] Creating event network-changed:1fd7f00c-a7c9-42e6-b6f0-3b9378c92c89 for instance 51e3865d-a413-4c57-b0dc-1b29e76be1de on n-h1-853611-3 Aug 18 11:34:01.395710 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-c947f618-2d60-4e10-8987-feb48a6eaa51 req-8b526579-6503-4032-80e7-51f3fdb7bfb1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066506 Aug 18 11:34:01.396984 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 959/1955] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:01.403536 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5f349f38-85eb-49d5-b3ed-876bf8443a14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:01.404795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5f349f38-85eb-49d5-b3ed-876bf8443a14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:01.413795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f349f38-85eb-49d5-b3ed-876bf8443a14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:01.414748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f349f38-85eb-49d5-b3ed-876bf8443a14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:01.415433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f349f38-85eb-49d5-b3ed-876bf8443a14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:01.416524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f349f38-85eb-49d5-b3ed-876bf8443a14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:01.417231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f349f38-85eb-49d5-b3ed-876bf8443a14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:01.418284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f349f38-85eb-49d5-b3ed-876bf8443a14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:01.668043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f94965f8-08b0-4d54-adcf-f3446c911b64 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:01.699163 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f94965f8-08b0-4d54-adcf-f3446c911b64 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1317 microversion: 2.1 time: 0.621011 Aug 18 11:34:01.713666 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 997/1956] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:01 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:01.732562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-315e5d46-4126-4062-83db-1ad0988455a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:01.734198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-315e5d46-4126-4062-83db-1ad0988455a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:02.024606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=28 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:02.330314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5f349f38-85eb-49d5-b3ed-876bf8443a14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:02.341590 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5f349f38-85eb-49d5-b3ed-876bf8443a14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.942796 Aug 18 11:34:02.346227 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 960/1957] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:01 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:02.359396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bf826b57-41ac-4e12-b279-4e8be3965213 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:02.360383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bf826b57-41ac-4e12-b279-4e8be3965213 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:02.369940 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf826b57-41ac-4e12-b279-4e8be3965213 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:02.375104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf826b57-41ac-4e12-b279-4e8be3965213 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:02.375558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf826b57-41ac-4e12-b279-4e8be3965213 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:02.376536 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf826b57-41ac-4e12-b279-4e8be3965213 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:02.387248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf826b57-41ac-4e12-b279-4e8be3965213 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:02.387981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf826b57-41ac-4e12-b279-4e8be3965213 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:02.518089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-315e5d46-4126-4062-83db-1ad0988455a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:02.532828 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-315e5d46-4126-4062-83db-1ad0988455a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1207 microversion: 2.1 time: 0.814178 Aug 18 11:34:02.535430 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 998/1958] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:01 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1207 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:02.547038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-37b3f336-a2d7-42c0-aefc-889f08626844 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:02.551582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-37b3f336-a2d7-42c0-aefc-889f08626844 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:02.581331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37b3f336-a2d7-42c0-aefc-889f08626844 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:02.581848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37b3f336-a2d7-42c0-aefc-889f08626844 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:02.583695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37b3f336-a2d7-42c0-aefc-889f08626844 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:02.585831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37b3f336-a2d7-42c0-aefc-889f08626844 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:02.586320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37b3f336-a2d7-42c0-aefc-889f08626844 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:02.586817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37b3f336-a2d7-42c0-aefc-889f08626844 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:02.993597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bf826b57-41ac-4e12-b279-4e8be3965213 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:03.013059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bf826b57-41ac-4e12-b279-4e8be3965213 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:03.016084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bf826b57-41ac-4e12-b279-4e8be3965213 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:03.017523 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bf826b57-41ac-4e12-b279-4e8be3965213 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.670103 Aug 18 11:34:03.018401 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 961/1959] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:02 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:03.023300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-15075bc1-0417-4b76-9c49-918c41f8884b req-078e8e6c-3473-413d-8917-d12030e9788b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c4596fe-66e9-4fe7-bb85-433fc508040d", "tag": "950eb03a-fc74-48ad-b320-fd8a36ea6c4e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:03.052214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-15075bc1-0417-4b76-9c49-918c41f8884b req-078e8e6c-3473-413d-8917-d12030e9788b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:03.053177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-15075bc1-0417-4b76-9c49-918c41f8884b req-078e8e6c-3473-413d-8917-d12030e9788b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:03.054222 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-15075bc1-0417-4b76-9c49-918c41f8884b req-078e8e6c-3473-413d-8917-d12030e9788b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:03.086605 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-15075bc1-0417-4b76-9c49-918c41f8884b req-078e8e6c-3473-413d-8917-d12030e9788b service nova] Creating event network-changed:950eb03a-fc74-48ad-b320-fd8a36ea6c4e for instance 3c4596fe-66e9-4fe7-bb85-433fc508040d on n-h2-853611-3 Aug 18 11:34:03.104532 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-15075bc1-0417-4b76-9c49-918c41f8884b req-078e8e6c-3473-413d-8917-d12030e9788b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084519 Aug 18 11:34:03.105869 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 962/1960] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:03.126705 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-53b714c8-0997-416e-b717-41abbf2327be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:03.127890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-53b714c8-0997-416e-b717-41abbf2327be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:03.148504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53b714c8-0997-416e-b717-41abbf2327be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:03.149282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53b714c8-0997-416e-b717-41abbf2327be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:03.150059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53b714c8-0997-416e-b717-41abbf2327be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:03.151901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53b714c8-0997-416e-b717-41abbf2327be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:03.152660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53b714c8-0997-416e-b717-41abbf2327be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:03.155294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53b714c8-0997-416e-b717-41abbf2327be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:03.609666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-53b714c8-0997-416e-b717-41abbf2327be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:03.625105 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-53b714c8-0997-416e-b717-41abbf2327be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1314 microversion: 2.1 time: 0.517070 Aug 18 11:34:03.636250 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 963/1961] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:03 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:03.636250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-0f4ab1e1-b50e-4820-8ed8-f535b2dcf80b req-d505b7dc-41fe-48dc-b787-50328101730f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a25b73-ea72-405a-b127-add6779c63d6", "name": "network-vif-unplugged", "status": "completed", "tag": "e08c585a-7b0e-4a25-afaf-7bbad84d469a"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:03.657347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0f4ab1e1-b50e-4820-8ed8-f535b2dcf80b req-d505b7dc-41fe-48dc-b787-50328101730f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:03.657836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0f4ab1e1-b50e-4820-8ed8-f535b2dcf80b req-d505b7dc-41fe-48dc-b787-50328101730f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:03.658303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0f4ab1e1-b50e-4820-8ed8-f535b2dcf80b req-d505b7dc-41fe-48dc-b787-50328101730f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:03.682155 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-0f4ab1e1-b50e-4820-8ed8-f535b2dcf80b req-d505b7dc-41fe-48dc-b787-50328101730f service nova] Creating event network-vif-unplugged:e08c585a-7b0e-4a25-afaf-7bbad84d469a for instance e2a25b73-ea72-405a-b127-add6779c63d6 on n-h1-853611-3 Aug 18 11:34:03.694340 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-0f4ab1e1-b50e-4820-8ed8-f535b2dcf80b req-d505b7dc-41fe-48dc-b787-50328101730f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067327 Aug 18 11:34:03.706898 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 964/1962] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:03.713054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3bead734-335a-49d1-9bed-1a4cacb3b4d4 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:03.713770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3bead734-335a-49d1-9bed-1a4cacb3b4d4 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:03.734875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bead734-335a-49d1-9bed-1a4cacb3b4d4 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:03.735671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bead734-335a-49d1-9bed-1a4cacb3b4d4 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:03.736179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bead734-335a-49d1-9bed-1a4cacb3b4d4 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:03.736944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bead734-335a-49d1-9bed-1a4cacb3b4d4 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:03.737420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bead734-335a-49d1-9bed-1a4cacb3b4d4 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:03.737858 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bead734-335a-49d1-9bed-1a4cacb3b4d4 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:03.946638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-37b3f336-a2d7-42c0-aefc-889f08626844 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:03.957321 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-37b3f336-a2d7-42c0-aefc-889f08626844 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1314 microversion: 2.1 time: 1.420040 Aug 18 11:34:03.960869 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 999/1963] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:02 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1314 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:03.975496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc7ecc0a-cb5c-464e-a83c-7e71c8216ce5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:03.976558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dc7ecc0a-cb5c-464e-a83c-7e71c8216ce5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:03.994709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc7ecc0a-cb5c-464e-a83c-7e71c8216ce5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:03.995611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc7ecc0a-cb5c-464e-a83c-7e71c8216ce5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:03.996306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc7ecc0a-cb5c-464e-a83c-7e71c8216ce5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:03.999038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc7ecc0a-cb5c-464e-a83c-7e71c8216ce5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:04.000741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc7ecc0a-cb5c-464e-a83c-7e71c8216ce5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:04.002275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc7ecc0a-cb5c-464e-a83c-7e71c8216ce5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:04.502276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3bead734-335a-49d1-9bed-1a4cacb3b4d4 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:04.519164 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3bead734-335a-49d1-9bed-1a4cacb3b4d4 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1317 microversion: 2.1 time: 0.808773 Aug 18 11:34:04.521722 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 965/1964] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:03 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1317 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:04.539740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-4af9527b-630c-4759-8f26-1b5c6f07c317 req-0d7b6854-366e-4dbd-a882-32da423bceaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "071f6b87-653b-4d66-b1b8-c9cc2a4a82a4", "tag": "4d84674c-506d-4fd5-9c2d-cd307b473df3"}, {"name": "network-changed", "server_uuid": "61b34fc6-468f-4179-b73f-6776c809d055", "tag": "7aa41449-e2a8-4d62-a5db-c9bcce1f4420"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:04.561028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4af9527b-630c-4759-8f26-1b5c6f07c317 req-0d7b6854-366e-4dbd-a882-32da423bceaa service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:04.561860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4af9527b-630c-4759-8f26-1b5c6f07c317 req-0d7b6854-366e-4dbd-a882-32da423bceaa service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:04.562748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4af9527b-630c-4759-8f26-1b5c6f07c317 req-0d7b6854-366e-4dbd-a882-32da423bceaa service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:04.579693 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-4af9527b-630c-4759-8f26-1b5c6f07c317 req-0d7b6854-366e-4dbd-a882-32da423bceaa service nova] Creating event network-changed:4d84674c-506d-4fd5-9c2d-cd307b473df3 for instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 on n-h2-853611-3 Aug 18 11:34:04.580658 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-4af9527b-630c-4759-8f26-1b5c6f07c317 req-0d7b6854-366e-4dbd-a882-32da423bceaa service nova] Creating event network-changed:7aa41449-e2a8-4d62-a5db-c9bcce1f4420 for instance 61b34fc6-468f-4179-b73f-6776c809d055 on n-h1-853611-3 Aug 18 11:34:04.593428 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-4af9527b-630c-4759-8f26-1b5c6f07c317 req-0d7b6854-366e-4dbd-a882-32da423bceaa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.067150 Aug 18 11:34:04.594399 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 966/1965] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:04.600847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-653db09b-f35d-4eaf-9689-f07ccbc7f94d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:04.601624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-653db09b-f35d-4eaf-9689-f07ccbc7f94d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:04.609874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-653db09b-f35d-4eaf-9689-f07ccbc7f94d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:04.610555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-653db09b-f35d-4eaf-9689-f07ccbc7f94d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:04.611050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-653db09b-f35d-4eaf-9689-f07ccbc7f94d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:04.612087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-653db09b-f35d-4eaf-9689-f07ccbc7f94d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:04.612679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-653db09b-f35d-4eaf-9689-f07ccbc7f94d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:04.613372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-653db09b-f35d-4eaf-9689-f07ccbc7f94d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:04.759427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dc7ecc0a-cb5c-464e-a83c-7e71c8216ce5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:04.788306 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dc7ecc0a-cb5c-464e-a83c-7e71c8216ce5 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.825862 Aug 18 11:34:04.803614 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1000/1966] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:03 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:04.812158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a40710f5-c818-44ce-b055-bf53ea1cd198 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:04.813065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a40710f5-c818-44ce-b055-bf53ea1cd198 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:04.821132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a40710f5-c818-44ce-b055-bf53ea1cd198 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:04.822071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a40710f5-c818-44ce-b055-bf53ea1cd198 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:04.823368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a40710f5-c818-44ce-b055-bf53ea1cd198 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:04.824361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a40710f5-c818-44ce-b055-bf53ea1cd198 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:04.826006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a40710f5-c818-44ce-b055-bf53ea1cd198 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:04.827303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a40710f5-c818-44ce-b055-bf53ea1cd198 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:04.863792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:05.327862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-653db09b-f35d-4eaf-9689-f07ccbc7f94d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:05.353691 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-653db09b-f35d-4eaf-9689-f07ccbc7f94d tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1265 microversion: 2.1 time: 0.757648 Aug 18 11:34:05.355049 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 967/1967] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:04 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1265 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:05.380569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f83d4905-456b-489a-ae75-7ecd61a5d158 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:05.385445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f83d4905-456b-489a-ae75-7ecd61a5d158 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:05.396830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f83d4905-456b-489a-ae75-7ecd61a5d158 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:05.397697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f83d4905-456b-489a-ae75-7ecd61a5d158 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:05.398704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f83d4905-456b-489a-ae75-7ecd61a5d158 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:05.399804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f83d4905-456b-489a-ae75-7ecd61a5d158 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:05.403216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f83d4905-456b-489a-ae75-7ecd61a5d158 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:05.404856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f83d4905-456b-489a-ae75-7ecd61a5d158 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:05.983401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a40710f5-c818-44ce-b055-bf53ea1cd198 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:05.999194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a40710f5-c818-44ce-b055-bf53ea1cd198 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:06.003204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a40710f5-c818-44ce-b055-bf53ea1cd198 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:06.004878 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a40710f5-c818-44ce-b055-bf53ea1cd198 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 1.199661 Aug 18 11:34:06.008414 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1001/1968] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:04 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:06.014324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a4ebdf74-b1e0-4091-9707-0b2897c73700 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:06.015452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a4ebdf74-b1e0-4091-9707-0b2897c73700 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:06.022679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4ebdf74-b1e0-4091-9707-0b2897c73700 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:06.023541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4ebdf74-b1e0-4091-9707-0b2897c73700 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:06.023989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4ebdf74-b1e0-4091-9707-0b2897c73700 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:06.024709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4ebdf74-b1e0-4091-9707-0b2897c73700 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:06.025995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4ebdf74-b1e0-4091-9707-0b2897c73700 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:06.026462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4ebdf74-b1e0-4091-9707-0b2897c73700 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:06.151317 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f83d4905-456b-489a-ae75-7ecd61a5d158 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:06.166674 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f83d4905-456b-489a-ae75-7ecd61a5d158 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1314 microversion: 2.1 time: 0.809820 Aug 18 11:34:06.171999 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 968/1969] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:05 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1314 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:06.194036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-c0d7d69b-720f-430b-bd86-07b2aa857fa5 req-8fc93898-668f-4d7d-85c0-aa73aea64a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2979b2d3-3055-479e-ad21-b8aac94ee848", "name": "network-vif-unplugged", "status": "completed", "tag": "7b97022c-78ee-42c8-b0d9-ab1df08cddb4"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:06.213895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c0d7d69b-720f-430b-bd86-07b2aa857fa5 req-8fc93898-668f-4d7d-85c0-aa73aea64a8e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:06.215138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c0d7d69b-720f-430b-bd86-07b2aa857fa5 req-8fc93898-668f-4d7d-85c0-aa73aea64a8e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:06.218062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c0d7d69b-720f-430b-bd86-07b2aa857fa5 req-8fc93898-668f-4d7d-85c0-aa73aea64a8e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:06.237401 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-c0d7d69b-720f-430b-bd86-07b2aa857fa5 req-8fc93898-668f-4d7d-85c0-aa73aea64a8e service nova] Creating event network-vif-unplugged:7b97022c-78ee-42c8-b0d9-ab1df08cddb4 for instance 2979b2d3-3055-479e-ad21-b8aac94ee848 on n-h2-853611-3 Aug 18 11:34:06.253783 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-c0d7d69b-720f-430b-bd86-07b2aa857fa5 req-8fc93898-668f-4d7d-85c0-aa73aea64a8e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076317 Aug 18 11:34:06.255027 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 969/1970] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:06.261437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fdc3e275-e039-4c60-9819-30707690392b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:06.263345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fdc3e275-e039-4c60-9819-30707690392b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:06.275790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdc3e275-e039-4c60-9819-30707690392b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:06.277183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdc3e275-e039-4c60-9819-30707690392b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:06.277926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdc3e275-e039-4c60-9819-30707690392b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:06.280673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdc3e275-e039-4c60-9819-30707690392b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:06.281442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdc3e275-e039-4c60-9819-30707690392b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:06.283746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdc3e275-e039-4c60-9819-30707690392b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:06.543317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a4ebdf74-b1e0-4091-9707-0b2897c73700 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:06.561543 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a4ebdf74-b1e0-4091-9707-0b2897c73700 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1314 microversion: 2.1 time: 0.550522 Aug 18 11:34:06.563788 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1002/1971] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:06 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:06.571490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7ae135eb-40b8-4481-b4a6-806248a4353d req-659975ea-c5d2-43ac-9fb6-cb3d6b0d625c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4596fe-66e9-4fe7-bb85-433fc508040d", "name": "network-vif-plugged", "status": "completed", "tag": "950eb03a-fc74-48ad-b320-fd8a36ea6c4e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:06.588158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7ae135eb-40b8-4481-b4a6-806248a4353d req-659975ea-c5d2-43ac-9fb6-cb3d6b0d625c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:06.589038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7ae135eb-40b8-4481-b4a6-806248a4353d req-659975ea-c5d2-43ac-9fb6-cb3d6b0d625c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:06.600921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7ae135eb-40b8-4481-b4a6-806248a4353d req-659975ea-c5d2-43ac-9fb6-cb3d6b0d625c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:06.656063 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7ae135eb-40b8-4481-b4a6-806248a4353d req-659975ea-c5d2-43ac-9fb6-cb3d6b0d625c service nova] Creating event network-vif-plugged:950eb03a-fc74-48ad-b320-fd8a36ea6c4e for instance 3c4596fe-66e9-4fe7-bb85-433fc508040d on n-h2-853611-3 Aug 18 11:34:06.656063 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7ae135eb-40b8-4481-b4a6-806248a4353d req-659975ea-c5d2-43ac-9fb6-cb3d6b0d625c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063107 Aug 18 11:34:06.656063 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1003/1972] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:06.698897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a4345b7c-ac27-4b96-9d58-626c339250d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:06.699589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a4345b7c-ac27-4b96-9d58-626c339250d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:06.712333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4345b7c-ac27-4b96-9d58-626c339250d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:06.712842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4345b7c-ac27-4b96-9d58-626c339250d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:06.718033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4345b7c-ac27-4b96-9d58-626c339250d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:06.718773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4345b7c-ac27-4b96-9d58-626c339250d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:06.719268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4345b7c-ac27-4b96-9d58-626c339250d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:06.719712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4345b7c-ac27-4b96-9d58-626c339250d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:07.001520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a4345b7c-ac27-4b96-9d58-626c339250d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:07.043217 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a4345b7c-ac27-4b96-9d58-626c339250d9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.368296 Aug 18 11:34:07.043940 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1004/1973] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:06 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:07.057425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3ed79c0a-de83-4522-b067-545e5dbd0860 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:07.058412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3ed79c0a-de83-4522-b067-545e5dbd0860 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:07.077220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ed79c0a-de83-4522-b067-545e5dbd0860 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:07.078198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ed79c0a-de83-4522-b067-545e5dbd0860 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:07.080082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ed79c0a-de83-4522-b067-545e5dbd0860 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:07.081203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ed79c0a-de83-4522-b067-545e5dbd0860 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:07.081818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ed79c0a-de83-4522-b067-545e5dbd0860 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:07.082612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ed79c0a-de83-4522-b067-545e5dbd0860 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:07.202793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3ed79c0a-de83-4522-b067-545e5dbd0860 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:07.214286 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3ed79c0a-de83-4522-b067-545e5dbd0860 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1265 microversion: 2.1 time: 0.168057 Aug 18 11:34:07.215641 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1005/1974] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:07 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:07.229891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-efbe381e-be51-4309-9076-8a1308bd59a2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:07.234035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-efbe381e-be51-4309-9076-8a1308bd59a2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:07.241944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efbe381e-be51-4309-9076-8a1308bd59a2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:07.242658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efbe381e-be51-4309-9076-8a1308bd59a2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:07.243373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efbe381e-be51-4309-9076-8a1308bd59a2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:07.244839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efbe381e-be51-4309-9076-8a1308bd59a2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:07.245496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efbe381e-be51-4309-9076-8a1308bd59a2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:07.246163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efbe381e-be51-4309-9076-8a1308bd59a2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:07.265034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fdc3e275-e039-4c60-9819-30707690392b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:07.275267 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fdc3e275-e039-4c60-9819-30707690392b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1317 microversion: 2.1 time: 1.017989 Aug 18 11:34:07.288125 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 970/1975] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:06 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1317 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:07.299598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3d2be1e4-34f6-42bf-acaa-f5b4584bce88 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:07.300550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3d2be1e4-34f6-42bf-acaa-f5b4584bce88 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:07.308087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d2be1e4-34f6-42bf-acaa-f5b4584bce88 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:07.309379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d2be1e4-34f6-42bf-acaa-f5b4584bce88 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:07.310412 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d2be1e4-34f6-42bf-acaa-f5b4584bce88 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:07.311774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d2be1e4-34f6-42bf-acaa-f5b4584bce88 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:07.312323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d2be1e4-34f6-42bf-acaa-f5b4584bce88 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:07.313007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d2be1e4-34f6-42bf-acaa-f5b4584bce88 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:07.610061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-efbe381e-be51-4309-9076-8a1308bd59a2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:07.626480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-efbe381e-be51-4309-9076-8a1308bd59a2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:07.628233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-efbe381e-be51-4309-9076-8a1308bd59a2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:07.632051 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-efbe381e-be51-4309-9076-8a1308bd59a2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.408515 Aug 18 11:34:07.634235 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1006/1976] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:07 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:07.646290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9240f9a9-ee74-4fb6-8386-e19a2ab82388 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:07.655237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9240f9a9-ee74-4fb6-8386-e19a2ab82388 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:07.668093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9240f9a9-ee74-4fb6-8386-e19a2ab82388 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:07.668788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9240f9a9-ee74-4fb6-8386-e19a2ab82388 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:07.670343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9240f9a9-ee74-4fb6-8386-e19a2ab82388 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:07.671142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9240f9a9-ee74-4fb6-8386-e19a2ab82388 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:07.671613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9240f9a9-ee74-4fb6-8386-e19a2ab82388 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:07.672052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9240f9a9-ee74-4fb6-8386-e19a2ab82388 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:07.904793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3d2be1e4-34f6-42bf-acaa-f5b4584bce88 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:07.915504 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3d2be1e4-34f6-42bf-acaa-f5b4584bce88 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1314 microversion: 2.1 time: 0.625909 Aug 18 11:34:07.931623 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 971/1977] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:07 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:07.973233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9240f9a9-ee74-4fb6-8386-e19a2ab82388 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:07.989793 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9240f9a9-ee74-4fb6-8386-e19a2ab82388 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1314 microversion: 2.1 time: 0.352141 Aug 18 11:34:07.991488 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1007/1978] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:07 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:08.069947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3f36f1e1-e3b0-438a-bfb0-87b63266ffa7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:08.070757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3f36f1e1-e3b0-438a-bfb0-87b63266ffa7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:08.084894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f36f1e1-e3b0-438a-bfb0-87b63266ffa7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:08.086816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f36f1e1-e3b0-438a-bfb0-87b63266ffa7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:08.088294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f36f1e1-e3b0-438a-bfb0-87b63266ffa7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:08.089288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f36f1e1-e3b0-438a-bfb0-87b63266ffa7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:08.091677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f36f1e1-e3b0-438a-bfb0-87b63266ffa7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:08.092134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f36f1e1-e3b0-438a-bfb0-87b63266ffa7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:08.104227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:08.273976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ad87a94b-3daf-4d0e-bf65-e06bd456253e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:08.276814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ad87a94b-3daf-4d0e-bf65-e06bd456253e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:08.296749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad87a94b-3daf-4d0e-bf65-e06bd456253e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:08.297593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad87a94b-3daf-4d0e-bf65-e06bd456253e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:08.299341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad87a94b-3daf-4d0e-bf65-e06bd456253e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:08.300436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad87a94b-3daf-4d0e-bf65-e06bd456253e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:08.301166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad87a94b-3daf-4d0e-bf65-e06bd456253e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:08.301820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad87a94b-3daf-4d0e-bf65-e06bd456253e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:08.618280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ad87a94b-3daf-4d0e-bf65-e06bd456253e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:08.631449 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ad87a94b-3daf-4d0e-bf65-e06bd456253e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1307 microversion: 2.1 time: 0.393328 Aug 18 11:34:08.650091 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1008/1979] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:08 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1307 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:08.659608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c40a3fe8-3bf9-4ae5-94bc-dcb8a2c712bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:08.660452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c40a3fe8-3bf9-4ae5-94bc-dcb8a2c712bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:08.667421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c40a3fe8-3bf9-4ae5-94bc-dcb8a2c712bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:08.668202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c40a3fe8-3bf9-4ae5-94bc-dcb8a2c712bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:08.669432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c40a3fe8-3bf9-4ae5-94bc-dcb8a2c712bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:08.671257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c40a3fe8-3bf9-4ae5-94bc-dcb8a2c712bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:08.671737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c40a3fe8-3bf9-4ae5-94bc-dcb8a2c712bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:08.672193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c40a3fe8-3bf9-4ae5-94bc-dcb8a2c712bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:08.957979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c40a3fe8-3bf9-4ae5-94bc-dcb8a2c712bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:08.971499 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c40a3fe8-3bf9-4ae5-94bc-dcb8a2c712bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1317 microversion: 2.1 time: 0.316221 Aug 18 11:34:08.973967 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1009/1980] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:08 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:08.980705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1eda5ace-e61e-495b-9678-6b8d688d67f6 req-15c6aa07-52e0-4b55-85e6-313f3888aa91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a25b73-ea72-405a-b127-add6779c63d6", "name": "network-vif-deleted", "tag": "e08c585a-7b0e-4a25-afaf-7bbad84d469a"}, {"name": "network-changed", "server_uuid": "2979b2d3-3055-479e-ad21-b8aac94ee848", "tag": "7b97022c-78ee-42c8-b0d9-ab1df08cddb4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:08.996170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1eda5ace-e61e-495b-9678-6b8d688d67f6 req-15c6aa07-52e0-4b55-85e6-313f3888aa91 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:08.998779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1eda5ace-e61e-495b-9678-6b8d688d67f6 req-15c6aa07-52e0-4b55-85e6-313f3888aa91 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:08.999468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1eda5ace-e61e-495b-9678-6b8d688d67f6 req-15c6aa07-52e0-4b55-85e6-313f3888aa91 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:09.017696 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1eda5ace-e61e-495b-9678-6b8d688d67f6 req-15c6aa07-52e0-4b55-85e6-313f3888aa91 service nova] Creating event network-vif-deleted:e08c585a-7b0e-4a25-afaf-7bbad84d469a for instance e2a25b73-ea72-405a-b127-add6779c63d6 on n-h1-853611-3 Aug 18 11:34:09.018932 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1eda5ace-e61e-495b-9678-6b8d688d67f6 req-15c6aa07-52e0-4b55-85e6-313f3888aa91 service nova] Creating event network-changed:7b97022c-78ee-42c8-b0d9-ab1df08cddb4 for instance 2979b2d3-3055-479e-ad21-b8aac94ee848 on n-h2-853611-3 Aug 18 11:34:09.032436 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1eda5ace-e61e-495b-9678-6b8d688d67f6 req-15c6aa07-52e0-4b55-85e6-313f3888aa91 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.056389 Aug 18 11:34:09.034004 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1010/1981] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:09.040652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7e7a3de-cefb-46b3-812d-3579e04281ba tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:09.041977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a7e7a3de-cefb-46b3-812d-3579e04281ba tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:09.052019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7e7a3de-cefb-46b3-812d-3579e04281ba tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:09.053345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7e7a3de-cefb-46b3-812d-3579e04281ba tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:09.054160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7e7a3de-cefb-46b3-812d-3579e04281ba tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:09.055229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7e7a3de-cefb-46b3-812d-3579e04281ba tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:09.055944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7e7a3de-cefb-46b3-812d-3579e04281ba tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:09.056615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7e7a3de-cefb-46b3-812d-3579e04281ba tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:09.220392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3f36f1e1-e3b0-438a-bfb0-87b63266ffa7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:09.239378 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3f36f1e1-e3b0-438a-bfb0-87b63266ffa7 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 1.173664 Aug 18 11:34:09.240835 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 972/1982] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:08 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:09.266645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-28c8d65b-0052-4606-812d-e41ee56c8146 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:09.268794 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-28c8d65b-0052-4606-812d-e41ee56c8146 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:09.298270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28c8d65b-0052-4606-812d-e41ee56c8146 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:09.299575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28c8d65b-0052-4606-812d-e41ee56c8146 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:09.300783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28c8d65b-0052-4606-812d-e41ee56c8146 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:09.306945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28c8d65b-0052-4606-812d-e41ee56c8146 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:09.312558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28c8d65b-0052-4606-812d-e41ee56c8146 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:09.313548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28c8d65b-0052-4606-812d-e41ee56c8146 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:09.350587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a7e7a3de-cefb-46b3-812d-3579e04281ba tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:09.374734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a7e7a3de-cefb-46b3-812d-3579e04281ba tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:09.376759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a7e7a3de-cefb-46b3-812d-3579e04281ba tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:09.378633 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a7e7a3de-cefb-46b3-812d-3579e04281ba tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.342936 Aug 18 11:34:09.414098 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1011/1983] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:09 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:09.429980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f32c667d-b685-4630-b900-c1dff5df62a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:09.431472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f32c667d-b685-4630-b900-c1dff5df62a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:09.439156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f32c667d-b685-4630-b900-c1dff5df62a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:09.439708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f32c667d-b685-4630-b900-c1dff5df62a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:09.440174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f32c667d-b685-4630-b900-c1dff5df62a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:09.440974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f32c667d-b685-4630-b900-c1dff5df62a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:09.441476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f32c667d-b685-4630-b900-c1dff5df62a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:09.441977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f32c667d-b685-4630-b900-c1dff5df62a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:09.606301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f32c667d-b685-4630-b900-c1dff5df62a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:09.619189 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f32c667d-b685-4630-b900-c1dff5df62a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1314 microversion: 2.1 time: 0.194380 Aug 18 11:34:09.619956 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1012/1984] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:09 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:09.625450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5c3ab7c0-08c6-4404-8c74-a25add89f749 req-1ffba80a-1928-421b-9ecc-1a390abb620c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071f6b87-653b-4d66-b1b8-c9cc2a4a82a4", "name": "network-vif-plugged", "status": "completed", "tag": "4d84674c-506d-4fd5-9c2d-cd307b473df3"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:09.637298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c3ab7c0-08c6-4404-8c74-a25add89f749 req-1ffba80a-1928-421b-9ecc-1a390abb620c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:09.638379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c3ab7c0-08c6-4404-8c74-a25add89f749 req-1ffba80a-1928-421b-9ecc-1a390abb620c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:09.639215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c3ab7c0-08c6-4404-8c74-a25add89f749 req-1ffba80a-1928-421b-9ecc-1a390abb620c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:09.654913 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5c3ab7c0-08c6-4404-8c74-a25add89f749 req-1ffba80a-1928-421b-9ecc-1a390abb620c service nova] Creating event network-vif-plugged:4d84674c-506d-4fd5-9c2d-cd307b473df3 for instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 on n-h2-853611-3 Aug 18 11:34:09.661030 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5c3ab7c0-08c6-4404-8c74-a25add89f749 req-1ffba80a-1928-421b-9ecc-1a390abb620c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039630 Aug 18 11:34:09.661814 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1013/1985] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:09.667645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-672d4e1f-edcf-4142-884b-cb6fd3d8f84b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:09.668699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-672d4e1f-edcf-4142-884b-cb6fd3d8f84b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:09.678257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-672d4e1f-edcf-4142-884b-cb6fd3d8f84b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:09.679025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-672d4e1f-edcf-4142-884b-cb6fd3d8f84b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:09.679803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-672d4e1f-edcf-4142-884b-cb6fd3d8f84b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:09.680710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-672d4e1f-edcf-4142-884b-cb6fd3d8f84b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:09.681287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-672d4e1f-edcf-4142-884b-cb6fd3d8f84b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:09.681764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-672d4e1f-edcf-4142-884b-cb6fd3d8f84b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:09.927992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-672d4e1f-edcf-4142-884b-cb6fd3d8f84b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:09.942120 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-672d4e1f-edcf-4142-884b-cb6fd3d8f84b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1307 microversion: 2.1 time: 0.278871 Aug 18 11:34:09.943660 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1014/1986] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:09 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1307 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:09.999756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-47a80edb-a674-452f-a728-d7c6f3d69e78 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:10.000360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-47a80edb-a674-452f-a728-d7c6f3d69e78 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:10.007338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47a80edb-a674-452f-a728-d7c6f3d69e78 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:10.008218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47a80edb-a674-452f-a728-d7c6f3d69e78 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:10.008844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47a80edb-a674-452f-a728-d7c6f3d69e78 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:10.009928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47a80edb-a674-452f-a728-d7c6f3d69e78 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:10.010684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47a80edb-a674-452f-a728-d7c6f3d69e78 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:10.011324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47a80edb-a674-452f-a728-d7c6f3d69e78 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:10.089976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-28c8d65b-0052-4606-812d-e41ee56c8146 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:10.117557 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-28c8d65b-0052-4606-812d-e41ee56c8146 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1500 microversion: 2.1 time: 0.869872 Aug 18 11:34:10.118415 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 973/1987] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:09 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1500 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:10.141239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e7edb7c3-de3a-4009-9cc9-26064928ccfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:10.150039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7edb7c3-de3a-4009-9cc9-26064928ccfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:10.150739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7edb7c3-de3a-4009-9cc9-26064928ccfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:10.151311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7edb7c3-de3a-4009-9cc9-26064928ccfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:10.236444 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e7edb7c3-de3a-4009-9cc9-26064928ccfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Going to try to stop instance {{(pid=122209) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 11:34:10.303017 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e7edb7c3-de3a-4009-9cc9-26064928ccfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d/action" status: 202 len: 0 microversion: 2.1 time: 0.166564 Aug 18 11:34:10.306748 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 974/1988] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:34:10 2022] POST /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:34:10.311710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5459a2fd-3871-4d25-8c54-c3621422d53d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:10.312451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5459a2fd-3871-4d25-8c54-c3621422d53d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:10.320369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5459a2fd-3871-4d25-8c54-c3621422d53d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:10.320963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5459a2fd-3871-4d25-8c54-c3621422d53d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:10.321576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5459a2fd-3871-4d25-8c54-c3621422d53d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:10.322400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5459a2fd-3871-4d25-8c54-c3621422d53d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:10.323198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5459a2fd-3871-4d25-8c54-c3621422d53d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:10.323638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5459a2fd-3871-4d25-8c54-c3621422d53d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:10.324336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-47a80edb-a674-452f-a728-d7c6f3d69e78 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:10.334563 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-47a80edb-a674-452f-a728-d7c6f3d69e78 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1317 microversion: 2.1 time: 0.339648 Aug 18 11:34:10.337826 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1015/1989] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:09 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:10.354209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b17a0cb-70d8-49b5-9c6c-a96a90e23a17 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:10.355427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1b17a0cb-70d8-49b5-9c6c-a96a90e23a17 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:10.375684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b17a0cb-70d8-49b5-9c6c-a96a90e23a17 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:10.377529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b17a0cb-70d8-49b5-9c6c-a96a90e23a17 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:10.379438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b17a0cb-70d8-49b5-9c6c-a96a90e23a17 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:10.381999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b17a0cb-70d8-49b5-9c6c-a96a90e23a17 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:10.383200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b17a0cb-70d8-49b5-9c6c-a96a90e23a17 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:10.385004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b17a0cb-70d8-49b5-9c6c-a96a90e23a17 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:10.634806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5459a2fd-3871-4d25-8c54-c3621422d53d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:10.648448 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5459a2fd-3871-4d25-8c54-c3621422d53d tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.341757 Aug 18 11:34:10.659734 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 975/1990] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:10 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:10.672559 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-58a1db81-6ab1-4190-82dc-9a10d6ee58b7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:10.674153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-58a1db81-6ab1-4190-82dc-9a10d6ee58b7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:10.698228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58a1db81-6ab1-4190-82dc-9a10d6ee58b7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:10.734941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58a1db81-6ab1-4190-82dc-9a10d6ee58b7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:10.743581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1b17a0cb-70d8-49b5-9c6c-a96a90e23a17 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:10.752261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58a1db81-6ab1-4190-82dc-9a10d6ee58b7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.053s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:10.763318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58a1db81-6ab1-4190-82dc-9a10d6ee58b7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:10.764309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58a1db81-6ab1-4190-82dc-9a10d6ee58b7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:10.764972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58a1db81-6ab1-4190-82dc-9a10d6ee58b7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:10.772690 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1b17a0cb-70d8-49b5-9c6c-a96a90e23a17 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1510 microversion: 2.1 time: 0.432050 Aug 18 11:34:10.774550 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1016/1991] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:10 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:10.796478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e3d5c05-cda4-4aeb-8bec-1eeb6555b47d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:10.797470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9e3d5c05-cda4-4aeb-8bec-1eeb6555b47d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:10.809064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e3d5c05-cda4-4aeb-8bec-1eeb6555b47d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:10.811182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e3d5c05-cda4-4aeb-8bec-1eeb6555b47d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:10.816488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e3d5c05-cda4-4aeb-8bec-1eeb6555b47d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:10.819079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e3d5c05-cda4-4aeb-8bec-1eeb6555b47d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:10.819914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e3d5c05-cda4-4aeb-8bec-1eeb6555b47d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:10.821612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e3d5c05-cda4-4aeb-8bec-1eeb6555b47d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:11.125731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-58a1db81-6ab1-4190-82dc-9a10d6ee58b7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:11.135052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-58a1db81-6ab1-4190-82dc-9a10d6ee58b7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:11.136789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-58a1db81-6ab1-4190-82dc-9a10d6ee58b7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:11.138155 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-58a1db81-6ab1-4190-82dc-9a10d6ee58b7 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.474818 Aug 18 11:34:11.139036 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 976/1992] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:10 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:11.144859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa7cab11-6bb6-4d2d-807a-e8a2bdeca0e6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:11.145549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fa7cab11-6bb6-4d2d-807a-e8a2bdeca0e6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:11.163272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa7cab11-6bb6-4d2d-807a-e8a2bdeca0e6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:11.164209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa7cab11-6bb6-4d2d-807a-e8a2bdeca0e6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:11.164696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa7cab11-6bb6-4d2d-807a-e8a2bdeca0e6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:11.165457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa7cab11-6bb6-4d2d-807a-e8a2bdeca0e6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:11.165950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa7cab11-6bb6-4d2d-807a-e8a2bdeca0e6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:11.166402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa7cab11-6bb6-4d2d-807a-e8a2bdeca0e6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:11.191636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:11.199615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9e3d5c05-cda4-4aeb-8bec-1eeb6555b47d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:11.220635 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9e3d5c05-cda4-4aeb-8bec-1eeb6555b47d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1314 microversion: 2.1 time: 0.444670 Aug 18 11:34:11.234795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:11.241687 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1017/1993] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:10 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:11.319010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-93f5dff6-2f9d-4a06-b288-f969233a2bc1 req-109c7137-ec0d-4ad8-b5bc-67c8cb355a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24678345-9136-412f-b4d0-3bdb8a59141d", "tag": "972f02f1-f655-4ac5-b32a-de1a99f97085"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:11.352553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-93f5dff6-2f9d-4a06-b288-f969233a2bc1 req-109c7137-ec0d-4ad8-b5bc-67c8cb355a0d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:11.353087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-93f5dff6-2f9d-4a06-b288-f969233a2bc1 req-109c7137-ec0d-4ad8-b5bc-67c8cb355a0d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:11.355174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-93f5dff6-2f9d-4a06-b288-f969233a2bc1 req-109c7137-ec0d-4ad8-b5bc-67c8cb355a0d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:11.401256 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-93f5dff6-2f9d-4a06-b288-f969233a2bc1 req-109c7137-ec0d-4ad8-b5bc-67c8cb355a0d service nova] Creating event network-changed:972f02f1-f655-4ac5-b32a-de1a99f97085 for instance 24678345-9136-412f-b4d0-3bdb8a59141d on n-h1-853611-3 Aug 18 11:34:11.423177 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-93f5dff6-2f9d-4a06-b288-f969233a2bc1 req-109c7137-ec0d-4ad8-b5bc-67c8cb355a0d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108400 Aug 18 11:34:11.425165 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1018/1994] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:11.431114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7b2bb396-564b-4437-a5a0-a721ed7c5455 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:11.432186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7b2bb396-564b-4437-a5a0-a721ed7c5455 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:11.441939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b2bb396-564b-4437-a5a0-a721ed7c5455 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:11.442698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b2bb396-564b-4437-a5a0-a721ed7c5455 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:11.443290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b2bb396-564b-4437-a5a0-a721ed7c5455 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:11.444243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b2bb396-564b-4437-a5a0-a721ed7c5455 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:11.444836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b2bb396-564b-4437-a5a0-a721ed7c5455 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:11.445561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b2bb396-564b-4437-a5a0-a721ed7c5455 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:11.718802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fa7cab11-6bb6-4d2d-807a-e8a2bdeca0e6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:11.728469 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fa7cab11-6bb6-4d2d-807a-e8a2bdeca0e6 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1307 microversion: 2.1 time: 0.587950 Aug 18 11:34:11.729890 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 977/1995] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:11 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1307 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:11.749763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-40399cd4-b32e-42d1-afb5-848ebb962a3c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:11.750773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-40399cd4-b32e-42d1-afb5-848ebb962a3c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:11.758786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40399cd4-b32e-42d1-afb5-848ebb962a3c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:11.760194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40399cd4-b32e-42d1-afb5-848ebb962a3c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:11.760645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40399cd4-b32e-42d1-afb5-848ebb962a3c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:11.761382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40399cd4-b32e-42d1-afb5-848ebb962a3c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:11.761845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40399cd4-b32e-42d1-afb5-848ebb962a3c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:11.763071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40399cd4-b32e-42d1-afb5-848ebb962a3c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:12.088723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7b2bb396-564b-4437-a5a0-a721ed7c5455 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:12.097616 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7b2bb396-564b-4437-a5a0-a721ed7c5455 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1317 microversion: 2.1 time: 0.671037 Aug 18 11:34:12.112294 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1019/1996] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:11 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1317 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:12.118128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-74c39433-9508-4dac-9eb8-d6cbaf454114 req-c2e0495a-2edf-4484-a8a2-9aba234d52f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b34fc6-468f-4179-b73f-6776c809d055", "name": "network-vif-plugged", "status": "completed", "tag": "7aa41449-e2a8-4d62-a5db-c9bcce1f4420"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:12.129985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-74c39433-9508-4dac-9eb8-d6cbaf454114 req-c2e0495a-2edf-4484-a8a2-9aba234d52f4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:12.130737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-74c39433-9508-4dac-9eb8-d6cbaf454114 req-c2e0495a-2edf-4484-a8a2-9aba234d52f4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:12.131394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-74c39433-9508-4dac-9eb8-d6cbaf454114 req-c2e0495a-2edf-4484-a8a2-9aba234d52f4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:12.144027 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-74c39433-9508-4dac-9eb8-d6cbaf454114 req-c2e0495a-2edf-4484-a8a2-9aba234d52f4 service nova] Creating event network-vif-plugged:7aa41449-e2a8-4d62-a5db-c9bcce1f4420 for instance 61b34fc6-468f-4179-b73f-6776c809d055 on n-h1-853611-3 Aug 18 11:34:12.150467 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-74c39433-9508-4dac-9eb8-d6cbaf454114 req-c2e0495a-2edf-4484-a8a2-9aba234d52f4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036502 Aug 18 11:34:12.157028 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1020/1997] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:12.162919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d1be7e8b-2ad9-45a2-8bc8-1c797bb9ece7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:12.163923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d1be7e8b-2ad9-45a2-8bc8-1c797bb9ece7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:12.171339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1be7e8b-2ad9-45a2-8bc8-1c797bb9ece7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:12.172141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1be7e8b-2ad9-45a2-8bc8-1c797bb9ece7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:12.172772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1be7e8b-2ad9-45a2-8bc8-1c797bb9ece7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:12.174285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1be7e8b-2ad9-45a2-8bc8-1c797bb9ece7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:12.174979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1be7e8b-2ad9-45a2-8bc8-1c797bb9ece7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:12.175646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1be7e8b-2ad9-45a2-8bc8-1c797bb9ece7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:12.197066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:12.250681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-40399cd4-b32e-42d1-afb5-848ebb962a3c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:12.265049 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-40399cd4-b32e-42d1-afb5-848ebb962a3c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.520304 Aug 18 11:34:12.265649 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 978/1998] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:11 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:12.282713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-be2c54b5-fa1b-433a-9e9d-e62792fb1aa8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:12.283467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-be2c54b5-fa1b-433a-9e9d-e62792fb1aa8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:12.293392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be2c54b5-fa1b-433a-9e9d-e62792fb1aa8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:12.294369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be2c54b5-fa1b-433a-9e9d-e62792fb1aa8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:12.294885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be2c54b5-fa1b-433a-9e9d-e62792fb1aa8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:12.301768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be2c54b5-fa1b-433a-9e9d-e62792fb1aa8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:12.302332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be2c54b5-fa1b-433a-9e9d-e62792fb1aa8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:12.302816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be2c54b5-fa1b-433a-9e9d-e62792fb1aa8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:12.525846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:12.581750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d1be7e8b-2ad9-45a2-8bc8-1c797bb9ece7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:12.590049 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d1be7e8b-2ad9-45a2-8bc8-1c797bb9ece7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1510 microversion: 2.1 time: 0.431289 Aug 18 11:34:12.591807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-be2c54b5-fa1b-433a-9e9d-e62792fb1aa8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:12.593005 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1021/1999] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:12 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1510 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:12.603239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-be2c54b5-fa1b-433a-9e9d-e62792fb1aa8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:12.603454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a864cd58-bfca-4f5e-9253-572e4fdffa37 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:12.604178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a864cd58-bfca-4f5e-9253-572e4fdffa37 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:12.604722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-be2c54b5-fa1b-433a-9e9d-e62792fb1aa8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:12.606676 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-be2c54b5-fa1b-433a-9e9d-e62792fb1aa8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1487 microversion: 2.25 time: 0.330462 Aug 18 11:34:12.607590 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 979/2000] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:12 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1487 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:12.622778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a864cd58-bfca-4f5e-9253-572e4fdffa37 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:12.626687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a864cd58-bfca-4f5e-9253-572e4fdffa37 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:12.627578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a864cd58-bfca-4f5e-9253-572e4fdffa37 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:12.628803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a864cd58-bfca-4f5e-9253-572e4fdffa37 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:12.629420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a864cd58-bfca-4f5e-9253-572e4fdffa37 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:12.629991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a864cd58-bfca-4f5e-9253-572e4fdffa37 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:12.761468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-428c9371-8ff0-4a40-8aaf-747c90b586b2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:12.766382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-428c9371-8ff0-4a40-8aaf-747c90b586b2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:12.801745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-428c9371-8ff0-4a40-8aaf-747c90b586b2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:12.802343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-428c9371-8ff0-4a40-8aaf-747c90b586b2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:12.803061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-428c9371-8ff0-4a40-8aaf-747c90b586b2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:12.804487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-428c9371-8ff0-4a40-8aaf-747c90b586b2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:12.805332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-428c9371-8ff0-4a40-8aaf-747c90b586b2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:12.805971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-428c9371-8ff0-4a40-8aaf-747c90b586b2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:12.935213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a864cd58-bfca-4f5e-9253-572e4fdffa37 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:12.946188 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a864cd58-bfca-4f5e-9253-572e4fdffa37 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1501 microversion: 2.1 time: 0.346537 Aug 18 11:34:12.946827 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1022/2001] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:12 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1501 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:12.976011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3c6b1d7-9ce1-4356-b5fb-6d2b25f44a49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:12.976693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3c6b1d7-9ce1-4356-b5fb-6d2b25f44a49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:12.991060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3c6b1d7-9ce1-4356-b5fb-6d2b25f44a49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:12.991571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3c6b1d7-9ce1-4356-b5fb-6d2b25f44a49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:12.992015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3c6b1d7-9ce1-4356-b5fb-6d2b25f44a49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:12.993026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3c6b1d7-9ce1-4356-b5fb-6d2b25f44a49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:12.993646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3c6b1d7-9ce1-4356-b5fb-6d2b25f44a49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:12.994217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3c6b1d7-9ce1-4356-b5fb-6d2b25f44a49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:13.131432 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3c6b1d7-9ce1-4356-b5fb-6d2b25f44a49 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "POST /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4/action" status: 202 len: 0 microversion: 2.1 time: 0.158222 Aug 18 11:34:13.135729 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1023/2002] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:34:12 2022] POST /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:34:13.144871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8ecb425-29d5-4999-81ea-103fc76bdffc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:13.145884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f8ecb425-29d5-4999-81ea-103fc76bdffc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:13.156593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ecb425-29d5-4999-81ea-103fc76bdffc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:13.159713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ecb425-29d5-4999-81ea-103fc76bdffc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:13.160864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ecb425-29d5-4999-81ea-103fc76bdffc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:13.162244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ecb425-29d5-4999-81ea-103fc76bdffc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:13.164519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ecb425-29d5-4999-81ea-103fc76bdffc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:13.165309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ecb425-29d5-4999-81ea-103fc76bdffc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:13.265944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-428c9371-8ff0-4a40-8aaf-747c90b586b2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:13.278546 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-428c9371-8ff0-4a40-8aaf-747c90b586b2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1307 microversion: 2.1 time: 0.528505 Aug 18 11:34:13.281123 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 980/2003] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:12 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1307 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:13.318396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ba50248a-d0b9-4437-9ef4-9e9a21e8f356 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:13.320290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ba50248a-d0b9-4437-9ef4-9e9a21e8f356 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:13.337490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba50248a-d0b9-4437-9ef4-9e9a21e8f356 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:13.339159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba50248a-d0b9-4437-9ef4-9e9a21e8f356 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:13.340576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba50248a-d0b9-4437-9ef4-9e9a21e8f356 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:13.341335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba50248a-d0b9-4437-9ef4-9e9a21e8f356 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:13.341804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba50248a-d0b9-4437-9ef4-9e9a21e8f356 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:13.345681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba50248a-d0b9-4437-9ef4-9e9a21e8f356 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:13.563092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ba50248a-d0b9-4437-9ef4-9e9a21e8f356 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:13.585332 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ba50248a-d0b9-4437-9ef4-9e9a21e8f356 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1506 microversion: 2.1 time: 0.301477 Aug 18 11:34:13.589019 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 981/2004] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:13 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:13.598343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5d53b42e-74b4-4ba6-a87d-94d2d4835564 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:13.599136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5d53b42e-74b4-4ba6-a87d-94d2d4835564 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:13.605610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f8ecb425-29d5-4999-81ea-103fc76bdffc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:13.615135 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8ecb425-29d5-4999-81ea-103fc76bdffc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1317 microversion: 2.1 time: 0.477138 Aug 18 11:34:13.617755 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1024/2005] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:13 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:13.624122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d53b42e-74b4-4ba6-a87d-94d2d4835564 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:13.624623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d53b42e-74b4-4ba6-a87d-94d2d4835564 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:13.625050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d53b42e-74b4-4ba6-a87d-94d2d4835564 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:13.625823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d53b42e-74b4-4ba6-a87d-94d2d4835564 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:13.626289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d53b42e-74b4-4ba6-a87d-94d2d4835564 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:13.626825 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d53b42e-74b4-4ba6-a87d-94d2d4835564 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:13.635346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de8f19d3-016e-41d9-a954-829217a55fec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:13.636194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-de8f19d3-016e-41d9-a954-829217a55fec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:13.671396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de8f19d3-016e-41d9-a954-829217a55fec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:13.671906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de8f19d3-016e-41d9-a954-829217a55fec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:13.672357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de8f19d3-016e-41d9-a954-829217a55fec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:13.673087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de8f19d3-016e-41d9-a954-829217a55fec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:13.673548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de8f19d3-016e-41d9-a954-829217a55fec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:13.673983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de8f19d3-016e-41d9-a954-829217a55fec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:13.864451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5d53b42e-74b4-4ba6-a87d-94d2d4835564 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:13.877051 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5d53b42e-74b4-4ba6-a87d-94d2d4835564 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.286827 Aug 18 11:34:13.882492 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 982/2006] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:13 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:13.882872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-87112b80-0e23-4fde-a490-3b3379a89433 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:13.883795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-87112b80-0e23-4fde-a490-3b3379a89433 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:13.898799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87112b80-0e23-4fde-a490-3b3379a89433 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:13.899523 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87112b80-0e23-4fde-a490-3b3379a89433 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:13.900051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87112b80-0e23-4fde-a490-3b3379a89433 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:13.900988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87112b80-0e23-4fde-a490-3b3379a89433 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:13.901658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87112b80-0e23-4fde-a490-3b3379a89433 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:13.902403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87112b80-0e23-4fde-a490-3b3379a89433 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.038470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-de8f19d3-016e-41d9-a954-829217a55fec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:14.055174 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de8f19d3-016e-41d9-a954-829217a55fec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1510 microversion: 2.1 time: 0.436059 Aug 18 11:34:14.055784 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1025/2007] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:13 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1510 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:14.121364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-87112b80-0e23-4fde-a490-3b3379a89433 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:14.131163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-87112b80-0e23-4fde-a490-3b3379a89433 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:14.135049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-87112b80-0e23-4fde-a490-3b3379a89433 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:14.136694 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-87112b80-0e23-4fde-a490-3b3379a89433 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1477 microversion: 2.25 time: 0.257513 Aug 18 11:34:14.151635 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 983/2008] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:13 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1477 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:14.161467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24cf64d5-9fe7-4388-90de-29fa4e1a9d5e tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '.version_select at 0x7f519f78a940>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:14.165472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24cf64d5-9fe7-4388-90de-29fa4e1a9d5e tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:14.165960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24cf64d5-9fe7-4388-90de-29fa4e1a9d5e tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:14.166397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24cf64d5-9fe7-4388-90de-29fa4e1a9d5e tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.169471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-5b1f22a8-838e-49b7-a51b-916075faefd9 req-9f938097-042a-40dd-bc29-a3fe539ff14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e3865d-a413-4c57-b0dc-1b29e76be1de", "name": "network-vif-plugged", "status": "completed", "tag": "1fd7f00c-a7c9-42e6-b6f0-3b9378c92c89"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:14.181564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5b1f22a8-838e-49b7-a51b-916075faefd9 req-9f938097-042a-40dd-bc29-a3fe539ff14f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:14.185678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5b1f22a8-838e-49b7-a51b-916075faefd9 req-9f938097-042a-40dd-bc29-a3fe539ff14f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:14.186022 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-24cf64d5-9fe7-4388-90de-29fa4e1a9d5e tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/os-migrations" status: 200 len: 3864 microversion: 2.25 time: 0.028257 Aug 18 11:34:14.187711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5b1f22a8-838e-49b7-a51b-916075faefd9 req-9f938097-042a-40dd-bc29-a3fe539ff14f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.187854 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1026/2009] 10.222.0.73 () {60 vars in 1184 bytes} [Thu Aug 18 11:34:14 2022] GET /compute/v2.1/os-migrations => generated 3864 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:14.205917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3369ff4e-2b98-4221-b66a-0b47b6f93121 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:14.207070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3369ff4e-2b98-4221-b66a-0b47b6f93121 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:14.212346 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5b1f22a8-838e-49b7-a51b-916075faefd9 req-9f938097-042a-40dd-bc29-a3fe539ff14f service nova] Creating event network-vif-plugged:1fd7f00c-a7c9-42e6-b6f0-3b9378c92c89 for instance 51e3865d-a413-4c57-b0dc-1b29e76be1de on n-h1-853611-3 Aug 18 11:34:14.216868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3369ff4e-2b98-4221-b66a-0b47b6f93121 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:14.217654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3369ff4e-2b98-4221-b66a-0b47b6f93121 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:14.218318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3369ff4e-2b98-4221-b66a-0b47b6f93121 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.220364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3369ff4e-2b98-4221-b66a-0b47b6f93121 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:14.221039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3369ff4e-2b98-4221-b66a-0b47b6f93121 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:14.221702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3369ff4e-2b98-4221-b66a-0b47b6f93121 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.227060 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-5b1f22a8-838e-49b7-a51b-916075faefd9 req-9f938097-042a-40dd-bc29-a3fe539ff14f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062328 Aug 18 11:34:14.227681 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 984/2010] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:14.304131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-adf1268a-19ff-4e97-8c12-30279e45d9f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:14.304878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-adf1268a-19ff-4e97-8c12-30279e45d9f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:14.313993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-adf1268a-19ff-4e97-8c12-30279e45d9f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:14.315034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-adf1268a-19ff-4e97-8c12-30279e45d9f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:14.315445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-adf1268a-19ff-4e97-8c12-30279e45d9f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.316190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-adf1268a-19ff-4e97-8c12-30279e45d9f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:14.316994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-adf1268a-19ff-4e97-8c12-30279e45d9f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:14.317565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-adf1268a-19ff-4e97-8c12-30279e45d9f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.577959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-3369ff4e-2b98-4221-b66a-0b47b6f93121 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] Lazy-loading 'services' on Instance uuid 19d34316-2cf9-44a6-a370-673959e72cb3 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:34:14.594381 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3369ff4e-2b98-4221-b66a-0b47b6f93121 tempest-LiveAutoBlockMigrationV225Test-1202319487 tempest-LiveAutoBlockMigrationV225Test-1202319487-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1970 microversion: 2.25 time: 0.392694 Aug 18 11:34:14.595528 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1027/2011] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:14 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1970 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:34:14.629899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de715caf-2ae5-412b-9eeb-1e0d3c499750 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:14.630552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-de715caf-2ae5-412b-9eeb-1e0d3c499750 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:14.638864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de715caf-2ae5-412b-9eeb-1e0d3c499750 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:14.639489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de715caf-2ae5-412b-9eeb-1e0d3c499750 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:14.639788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de715caf-2ae5-412b-9eeb-1e0d3c499750 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.640617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de715caf-2ae5-412b-9eeb-1e0d3c499750 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:14.641069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de715caf-2ae5-412b-9eeb-1e0d3c499750 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:14.641547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de715caf-2ae5-412b-9eeb-1e0d3c499750 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.709803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-adf1268a-19ff-4e97-8c12-30279e45d9f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:14.722345 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-adf1268a-19ff-4e97-8c12-30279e45d9f1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1307 microversion: 2.1 time: 0.423656 Aug 18 11:34:14.723887 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 985/2012] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:14 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1307 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:34:14.737122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-42a04d4e-73cc-4b9e-bcd1-2f5c4f5562ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:14.738987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-42a04d4e-73cc-4b9e-bcd1-2f5c4f5562ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:14.750372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42a04d4e-73cc-4b9e-bcd1-2f5c4f5562ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:14.750902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42a04d4e-73cc-4b9e-bcd1-2f5c4f5562ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:14.751339 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42a04d4e-73cc-4b9e-bcd1-2f5c4f5562ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.752270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42a04d4e-73cc-4b9e-bcd1-2f5c4f5562ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:14.752882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42a04d4e-73cc-4b9e-bcd1-2f5c4f5562ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:14.753460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42a04d4e-73cc-4b9e-bcd1-2f5c4f5562ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.813097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-de715caf-2ae5-412b-9eeb-1e0d3c499750 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:14.814270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-42a04d4e-73cc-4b9e-bcd1-2f5c4f5562ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:34:14.821915 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de715caf-2ae5-412b-9eeb-1e0d3c499750 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1486 microversion: 2.1 time: 0.211821 Aug 18 11:34:14.839105 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1028/2013] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:14 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1486 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:14.846531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5e20a630-db9b-4c9a-bd71-284d766f79cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:14.847379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5e20a630-db9b-4c9a-bd71-284d766f79cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:14.854232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e20a630-db9b-4c9a-bd71-284d766f79cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:14.855024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e20a630-db9b-4c9a-bd71-284d766f79cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:14.855764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e20a630-db9b-4c9a-bd71-284d766f79cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.856490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e20a630-db9b-4c9a-bd71-284d766f79cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:14.857100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e20a630-db9b-4c9a-bd71-284d766f79cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:14.857719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e20a630-db9b-4c9a-bd71-284d766f79cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.883289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:14.922835 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-42a04d4e-73cc-4b9e-bcd1-2f5c4f5562ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "DELETE /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 204 len: 0 microversion: 2.25 time: 0.196965 Aug 18 11:34:14.924190 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 986/2014] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:34:14 2022] DELETE /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:34:14.931333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-26f42a32-7c12-4d5e-a396-8404c55e448e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:14.932345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-26f42a32-7c12-4d5e-a396-8404c55e448e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:14.942484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26f42a32-7c12-4d5e-a396-8404c55e448e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:14.943558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26f42a32-7c12-4d5e-a396-8404c55e448e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:14.944301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26f42a32-7c12-4d5e-a396-8404c55e448e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.945264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26f42a32-7c12-4d5e-a396-8404c55e448e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:14.945939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26f42a32-7c12-4d5e-a396-8404c55e448e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:14.946615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26f42a32-7c12-4d5e-a396-8404c55e448e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:14.987721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-26f42a32-7c12-4d5e-a396-8404c55e448e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:34:15.114011 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-26f42a32-7c12-4d5e-a396-8404c55e448e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "DELETE /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 204 len: 0 microversion: 2.1 time: 0.188056 Aug 18 11:34:15.115857 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 987/2015] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:34:14 2022] DELETE /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:34:15.124369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f962dd8d-c044-4136-96f0-a1f156bde862 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:15.125514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f962dd8d-c044-4136-96f0-a1f156bde862 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:15.133157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f962dd8d-c044-4136-96f0-a1f156bde862 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:15.134019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f962dd8d-c044-4136-96f0-a1f156bde862 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:15.134721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f962dd8d-c044-4136-96f0-a1f156bde862 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:15.135640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f962dd8d-c044-4136-96f0-a1f156bde862 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:15.136413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f962dd8d-c044-4136-96f0-a1f156bde862 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:15.137998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f962dd8d-c044-4136-96f0-a1f156bde862 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:15.337998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5e20a630-db9b-4c9a-bd71-284d766f79cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:15.353822 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5e20a630-db9b-4c9a-bd71-284d766f79cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1317 microversion: 2.1 time: 0.513233 Aug 18 11:34:15.370213 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1029/2016] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:14 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:15.375733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-66f916c2-0693-49f1-83ce-d3412472aa96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:15.376533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-66f916c2-0693-49f1-83ce-d3412472aa96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:15.397379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66f916c2-0693-49f1-83ce-d3412472aa96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:15.397940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66f916c2-0693-49f1-83ce-d3412472aa96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:15.398417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66f916c2-0693-49f1-83ce-d3412472aa96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:15.399162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66f916c2-0693-49f1-83ce-d3412472aa96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:15.399618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66f916c2-0693-49f1-83ce-d3412472aa96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:15.400048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66f916c2-0693-49f1-83ce-d3412472aa96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:15.759080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-66f916c2-0693-49f1-83ce-d3412472aa96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:15.772742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-66f916c2-0693-49f1-83ce-d3412472aa96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:15.778276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-66f916c2-0693-49f1-83ce-d3412472aa96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:15.781795 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-66f916c2-0693-49f1-83ce-d3412472aa96 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1483 microversion: 2.25 time: 0.410158 Aug 18 11:34:15.784233 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1030/2017] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:15 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1483 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:15.791007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-46b2934c-d642-40b3-81fa-56622bcb7ac0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:15.791761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-46b2934c-d642-40b3-81fa-56622bcb7ac0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:15.814654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46b2934c-d642-40b3-81fa-56622bcb7ac0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:15.815430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46b2934c-d642-40b3-81fa-56622bcb7ac0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:15.815833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46b2934c-d642-40b3-81fa-56622bcb7ac0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:15.830828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46b2934c-d642-40b3-81fa-56622bcb7ac0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:15.831892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46b2934c-d642-40b3-81fa-56622bcb7ac0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:15.832363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46b2934c-d642-40b3-81fa-56622bcb7ac0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:15.896149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f962dd8d-c044-4136-96f0-a1f156bde862 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:15.910857 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f962dd8d-c044-4136-96f0-a1f156bde862 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.792763 Aug 18 11:34:15.911977 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 988/2018] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:15 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:15.918387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-80e11be7-71ae-4684-a6fd-eaa34100efe9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:15.919831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-80e11be7-71ae-4684-a6fd-eaa34100efe9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:15.927530 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80e11be7-71ae-4684-a6fd-eaa34100efe9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:15.928377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80e11be7-71ae-4684-a6fd-eaa34100efe9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:15.929026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80e11be7-71ae-4684-a6fd-eaa34100efe9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:15.930141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80e11be7-71ae-4684-a6fd-eaa34100efe9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:15.930829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80e11be7-71ae-4684-a6fd-eaa34100efe9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:15.931337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80e11be7-71ae-4684-a6fd-eaa34100efe9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:16.165726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-46b2934c-d642-40b3-81fa-56622bcb7ac0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:16.182984 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-46b2934c-d642-40b3-81fa-56622bcb7ac0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1510 microversion: 2.1 time: 0.395911 Aug 18 11:34:16.186291 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1031/2019] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:15 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1510 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:16.194033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-77e556b5-b901-467e-9219-89532b1c977f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:16.195825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-77e556b5-b901-467e-9219-89532b1c977f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:16.204304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:16.207271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77e556b5-b901-467e-9219-89532b1c977f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:16.208030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77e556b5-b901-467e-9219-89532b1c977f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:16.208680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77e556b5-b901-467e-9219-89532b1c977f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:16.209645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77e556b5-b901-467e-9219-89532b1c977f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:16.211235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77e556b5-b901-467e-9219-89532b1c977f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:16.212028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77e556b5-b901-467e-9219-89532b1c977f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:16.341463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-80e11be7-71ae-4684-a6fd-eaa34100efe9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:16.351086 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-80e11be7-71ae-4684-a6fd-eaa34100efe9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1492 microversion: 2.1 time: 0.437483 Aug 18 11:34:16.357352 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 989/2020] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:15 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1492 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:16.378337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-db402170-f076-46a9-a41d-4d62e825a90f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:16.379186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-db402170-f076-46a9-a41d-4d62e825a90f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:16.385490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db402170-f076-46a9-a41d-4d62e825a90f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:16.385940 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db402170-f076-46a9-a41d-4d62e825a90f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:16.386375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db402170-f076-46a9-a41d-4d62e825a90f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:16.387696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db402170-f076-46a9-a41d-4d62e825a90f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:16.388154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db402170-f076-46a9-a41d-4d62e825a90f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:16.388620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db402170-f076-46a9-a41d-4d62e825a90f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:16.539319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-77e556b5-b901-467e-9219-89532b1c977f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:16.551919 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-77e556b5-b901-467e-9219-89532b1c977f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1307 microversion: 2.1 time: 0.363147 Aug 18 11:34:16.552973 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1032/2021] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:16 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1307 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:16.818012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3286800b-bcaa-4c23-97c3-41a68e87c1bc tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:16.820439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3286800b-bcaa-4c23-97c3-41a68e87c1bc tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:16.821896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-db402170-f076-46a9-a41d-4d62e825a90f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:16.829827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3286800b-bcaa-4c23-97c3-41a68e87c1bc tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:16.830809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3286800b-bcaa-4c23-97c3-41a68e87c1bc tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:16.831579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3286800b-bcaa-4c23-97c3-41a68e87c1bc tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:16.832572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3286800b-bcaa-4c23-97c3-41a68e87c1bc tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:16.833213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3286800b-bcaa-4c23-97c3-41a68e87c1bc tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:16.833340 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-db402170-f076-46a9-a41d-4d62e825a90f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1467 microversion: 2.1 time: 0.459072 Aug 18 11:34:16.833927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3286800b-bcaa-4c23-97c3-41a68e87c1bc tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:16.834644 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 990/2022] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:16 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1467 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:16.854462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-72f5e55a-d743-43c9-83a8-e75b4657ebcf tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:16.855456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-72f5e55a-d743-43c9-83a8-e75b4657ebcf tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 51e3865d-a413-4c57-b0dc-1b29e76be1de] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:16.862927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72f5e55a-d743-43c9-83a8-e75b4657ebcf tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:16.863694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72f5e55a-d743-43c9-83a8-e75b4657ebcf tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:16.864276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72f5e55a-d743-43c9-83a8-e75b4657ebcf tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:16.865247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72f5e55a-d743-43c9-83a8-e75b4657ebcf tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:16.865938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72f5e55a-d743-43c9-83a8-e75b4657ebcf tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:16.866924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72f5e55a-d743-43c9-83a8-e75b4657ebcf tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:16.979014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3286800b-bcaa-4c23-97c3-41a68e87c1bc tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:16.988645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3286800b-bcaa-4c23-97c3-41a68e87c1bc tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:16.990143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3286800b-bcaa-4c23-97c3-41a68e87c1bc tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:16.991417 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3286800b-bcaa-4c23-97c3-41a68e87c1bc tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1483 microversion: 2.25 time: 0.177920 Aug 18 11:34:16.991977 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1033/2023] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:16 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1483 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:34:17.001640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b02bdbd4-63a3-4ebe-9061-312b37dcd4cd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:17.002251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b02bdbd4-63a3-4ebe-9061-312b37dcd4cd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:17.008647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b02bdbd4-63a3-4ebe-9061-312b37dcd4cd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:17.009142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b02bdbd4-63a3-4ebe-9061-312b37dcd4cd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:17.009579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b02bdbd4-63a3-4ebe-9061-312b37dcd4cd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:17.010318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b02bdbd4-63a3-4ebe-9061-312b37dcd4cd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:17.010800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b02bdbd4-63a3-4ebe-9061-312b37dcd4cd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:17.011224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b02bdbd4-63a3-4ebe-9061-312b37dcd4cd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:17.254339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b02bdbd4-63a3-4ebe-9061-312b37dcd4cd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:17.277391 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b02bdbd4-63a3-4ebe-9061-312b37dcd4cd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.284324 Aug 18 11:34:17.278559 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1034/2024] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:16 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:17.285774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f914730d-c68d-4535-af7d-5f6b52358ac6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:17.286805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f914730d-c68d-4535-af7d-5f6b52358ac6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:17.298065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f914730d-c68d-4535-af7d-5f6b52358ac6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:17.299110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f914730d-c68d-4535-af7d-5f6b52358ac6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:17.299774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f914730d-c68d-4535-af7d-5f6b52358ac6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:17.301426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f914730d-c68d-4535-af7d-5f6b52358ac6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:17.302121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f914730d-c68d-4535-af7d-5f6b52358ac6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:17.302862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f914730d-c68d-4535-af7d-5f6b52358ac6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:17.486263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f914730d-c68d-4535-af7d-5f6b52358ac6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:17.491196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-72f5e55a-d743-43c9-83a8-e75b4657ebcf tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:17.494806 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f914730d-c68d-4535-af7d-5f6b52358ac6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1510 microversion: 2.1 time: 0.213454 Aug 18 11:34:17.495593 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1035/2025] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:17 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:17.501879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7dce23cf-37f8-4a1c-84db-3117a2f76669 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:17.502521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dce23cf-37f8-4a1c-84db-3117a2f76669 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:17.509432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dce23cf-37f8-4a1c-84db-3117a2f76669 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:17.510137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dce23cf-37f8-4a1c-84db-3117a2f76669 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:17.510625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dce23cf-37f8-4a1c-84db-3117a2f76669 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:17.511333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dce23cf-37f8-4a1c-84db-3117a2f76669 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:17.512380 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-72f5e55a-d743-43c9-83a8-e75b4657ebcf tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de" status: 200 len: 1317 microversion: 2.1 time: 0.661704 Aug 18 11:34:17.512488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dce23cf-37f8-4a1c-84db-3117a2f76669 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:17.512859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dce23cf-37f8-4a1c-84db-3117a2f76669 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:17.514003 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 991/2026] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:16 2022] GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:34:17.578245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-65cee6e0-1ea4-4149-8991-c4b9b8985732 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:17.579147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-65cee6e0-1ea4-4149-8991-c4b9b8985732 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:17.598674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65cee6e0-1ea4-4149-8991-c4b9b8985732 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:17.599248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65cee6e0-1ea4-4149-8991-c4b9b8985732 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:17.600173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65cee6e0-1ea4-4149-8991-c4b9b8985732 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:17.600988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65cee6e0-1ea4-4149-8991-c4b9b8985732 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:17.601496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65cee6e0-1ea4-4149-8991-c4b9b8985732 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:17.601989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65cee6e0-1ea4-4149-8991-c4b9b8985732 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:17.780549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7dce23cf-37f8-4a1c-84db-3117a2f76669 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:17.791647 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7dce23cf-37f8-4a1c-84db-3117a2f76669 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1492 microversion: 2.1 time: 0.293817 Aug 18 11:34:17.792561 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1036/2027] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:17 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1492 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:18.015972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-226e2739-0889-44bd-a21d-67368a3bbb38 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:18.016782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-226e2739-0889-44bd-a21d-67368a3bbb38 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:18.024135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-226e2739-0889-44bd-a21d-67368a3bbb38 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:18.024632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-226e2739-0889-44bd-a21d-67368a3bbb38 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:18.025070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-226e2739-0889-44bd-a21d-67368a3bbb38 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:18.026038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-226e2739-0889-44bd-a21d-67368a3bbb38 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:18.026533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-226e2739-0889-44bd-a21d-67368a3bbb38 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:18.026962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-226e2739-0889-44bd-a21d-67368a3bbb38 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:18.050627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:18.265820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-226e2739-0889-44bd-a21d-67368a3bbb38 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:18.277286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-226e2739-0889-44bd-a21d-67368a3bbb38 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:18.281001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-226e2739-0889-44bd-a21d-67368a3bbb38 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:18.282240 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-226e2739-0889-44bd-a21d-67368a3bbb38 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1483 microversion: 2.25 time: 0.270494 Aug 18 11:34:18.283111 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1037/2028] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:18 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1483 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:34:18.306481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0a4c1c7-f28c-48e8-ae1c-2f0a9da46194 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:18.307417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a0a4c1c7-f28c-48e8-ae1c-2f0a9da46194 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:18.316104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0a4c1c7-f28c-48e8-ae1c-2f0a9da46194 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:18.316751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0a4c1c7-f28c-48e8-ae1c-2f0a9da46194 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:18.317264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0a4c1c7-f28c-48e8-ae1c-2f0a9da46194 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:18.318130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0a4c1c7-f28c-48e8-ae1c-2f0a9da46194 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:18.318698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0a4c1c7-f28c-48e8-ae1c-2f0a9da46194 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:18.319247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0a4c1c7-f28c-48e8-ae1c-2f0a9da46194 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:18.539115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-65cee6e0-1ea4-4149-8991-c4b9b8985732 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:18.549815 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-65cee6e0-1ea4-4149-8991-c4b9b8985732 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1307 microversion: 2.1 time: 0.977210 Aug 18 11:34:18.550910 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 992/2029] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:17 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1307 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:18.555732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7a2018e8-322f-4710-aaa4-3c992afefd9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:18.556338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7a2018e8-322f-4710-aaa4-3c992afefd9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:18.578074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a2018e8-322f-4710-aaa4-3c992afefd9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:18.579209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a2018e8-322f-4710-aaa4-3c992afefd9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:18.579327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a2018e8-322f-4710-aaa4-3c992afefd9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:18.579986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a2018e8-322f-4710-aaa4-3c992afefd9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:18.580440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a2018e8-322f-4710-aaa4-3c992afefd9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:18.580862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a2018e8-322f-4710-aaa4-3c992afefd9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:18.622816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a0a4c1c7-f28c-48e8-ae1c-2f0a9da46194 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:18.635600 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a0a4c1c7-f28c-48e8-ae1c-2f0a9da46194 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1391 microversion: 2.1 time: 0.333346 Aug 18 11:34:18.636883 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1038/2030] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:18 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1391 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:18.647976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c0867d0-9c3c-459d-9ae4-173ed797fd5a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:18.649456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c0867d0-9c3c-459d-9ae4-173ed797fd5a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 51e3865d-a413-4c57-b0dc-1b29e76be1de] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:18.661490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c0867d0-9c3c-459d-9ae4-173ed797fd5a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:18.662221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c0867d0-9c3c-459d-9ae4-173ed797fd5a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:18.662859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c0867d0-9c3c-459d-9ae4-173ed797fd5a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:18.665193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c0867d0-9c3c-459d-9ae4-173ed797fd5a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:18.666162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c0867d0-9c3c-459d-9ae4-173ed797fd5a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:18.666870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c0867d0-9c3c-459d-9ae4-173ed797fd5a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:18.949025 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7a2018e8-322f-4710-aaa4-3c992afefd9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:18.963009 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7a2018e8-322f-4710-aaa4-3c992afefd9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1510 microversion: 2.1 time: 0.410752 Aug 18 11:34:18.965729 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 993/2031] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:18 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1510 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:18.973321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-7da3b0ef-c3a5-4e64-b38c-93765bfbfbb1 req-b8c51353-10b0-4b92-a05b-536b8a19ce57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24678345-9136-412f-b4d0-3bdb8a59141d", "name": "network-vif-plugged", "status": "completed", "tag": "972f02f1-f655-4ac5-b32a-de1a99f97085"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:18.997141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7da3b0ef-c3a5-4e64-b38c-93765bfbfbb1 req-b8c51353-10b0-4b92-a05b-536b8a19ce57 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:18.999435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7da3b0ef-c3a5-4e64-b38c-93765bfbfbb1 req-b8c51353-10b0-4b92-a05b-536b8a19ce57 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:19.013305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7da3b0ef-c3a5-4e64-b38c-93765bfbfbb1 req-b8c51353-10b0-4b92-a05b-536b8a19ce57 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:19.033114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9c0867d0-9c3c-459d-9ae4-173ed797fd5a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:19.045270 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-7da3b0ef-c3a5-4e64-b38c-93765bfbfbb1 req-b8c51353-10b0-4b92-a05b-536b8a19ce57 service nova] Creating event network-vif-plugged:972f02f1-f655-4ac5-b32a-de1a99f97085 for instance 24678345-9136-412f-b4d0-3bdb8a59141d on n-h1-853611-3 Aug 18 11:34:19.048464 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c0867d0-9c3c-459d-9ae4-173ed797fd5a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de" status: 200 len: 1466 microversion: 2.1 time: 0.409653 Aug 18 11:34:19.051993 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-7da3b0ef-c3a5-4e64-b38c-93765bfbfbb1 req-b8c51353-10b0-4b92-a05b-536b8a19ce57 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084263 Aug 18 11:34:19.053457 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 994/2032] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:19.060439 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1039/2033] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:18 2022] GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de => generated 1466 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:19.063692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4ff8ade2-acd4-402b-85e8-627d3c89e0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:19.064456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4ff8ade2-acd4-402b-85e8-627d3c89e0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:19.089025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-17d2de38-7638-450c-bf1d-74f814c46118 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1334096408"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:19.095969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ff8ade2-acd4-402b-85e8-627d3c89e0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:19.097926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ff8ade2-acd4-402b-85e8-627d3c89e0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:19.100069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ff8ade2-acd4-402b-85e8-627d3c89e0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:19.102505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ff8ade2-acd4-402b-85e8-627d3c89e0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:19.104554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-17d2de38-7638-450c-bf1d-74f814c46118 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 51e3865d-a413-4c57-b0dc-1b29e76be1de] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:19.108996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ff8ade2-acd4-402b-85e8-627d3c89e0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:19.109599 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ff8ade2-acd4-402b-85e8-627d3c89e0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:19.123657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17d2de38-7638-450c-bf1d-74f814c46118 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:19.124165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17d2de38-7638-450c-bf1d-74f814c46118 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:19.124613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17d2de38-7638-450c-bf1d-74f814c46118 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:19.125341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17d2de38-7638-450c-bf1d-74f814c46118 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:19.125872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17d2de38-7638-450c-bf1d-74f814c46118 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:19.126483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17d2de38-7638-450c-bf1d-74f814c46118 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:19.329470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4ff8ade2-acd4-402b-85e8-627d3c89e0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:19.345282 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4ff8ade2-acd4-402b-85e8-627d3c89e0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 200 len: 1450 microversion: 2.1 time: 0.289621 Aug 18 11:34:19.345940 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 995/2034] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:19 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 1450 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:19.367490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-9a29ad35-545d-4860-8a75-a151ae76e64f req-13154f67-0484-4c7c-9fb2-c109e4ce9bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071f6b87-653b-4d66-b1b8-c9cc2a4a82a4", "name": "network-vif-deleted", "tag": "4d84674c-506d-4fd5-9c2d-cd307b473df3"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:19.387280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9a29ad35-545d-4860-8a75-a151ae76e64f req-13154f67-0484-4c7c-9fb2-c109e4ce9bc3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:19.390093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9a29ad35-545d-4860-8a75-a151ae76e64f req-13154f67-0484-4c7c-9fb2-c109e4ce9bc3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:19.392332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9a29ad35-545d-4860-8a75-a151ae76e64f req-13154f67-0484-4c7c-9fb2-c109e4ce9bc3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:19.407867 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-9a29ad35-545d-4860-8a75-a151ae76e64f req-13154f67-0484-4c7c-9fb2-c109e4ce9bc3 service nova] Creating event network-vif-deleted:4d84674c-506d-4fd5-9c2d-cd307b473df3 for instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 on n-h2-853611-3 Aug 18 11:34:19.426635 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-9a29ad35-545d-4860-8a75-a151ae76e64f req-13154f67-0484-4c7c-9fb2-c109e4ce9bc3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077756 Aug 18 11:34:19.427993 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 996/2035] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:19.446788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-66a556f8-baba-4d94-841d-d407e25d6f30 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:19.447770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-66a556f8-baba-4d94-841d-d407e25d6f30 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:19.460502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:19.466629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66a556f8-baba-4d94-841d-d407e25d6f30 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:19.467352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66a556f8-baba-4d94-841d-d407e25d6f30 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:19.468695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66a556f8-baba-4d94-841d-d407e25d6f30 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:19.470055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66a556f8-baba-4d94-841d-d407e25d6f30 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:19.470795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66a556f8-baba-4d94-841d-d407e25d6f30 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:19.471565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66a556f8-baba-4d94-841d-d407e25d6f30 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:19.565476 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-17d2de38-7638-450c-bf1d-74f814c46118 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "POST /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de/action" status: 202 len: 0 microversion: 2.1 time: 0.479711 Aug 18 11:34:19.566278 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1040/2036] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:34:19 2022] POST /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 18 11:34:19.582018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-39fe72d1-42e6-4087-8142-5fa89dbe2db9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:19.582735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-39fe72d1-42e6-4087-8142-5fa89dbe2db9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:19.599680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39fe72d1-42e6-4087-8142-5fa89dbe2db9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:19.600467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39fe72d1-42e6-4087-8142-5fa89dbe2db9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:19.601406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39fe72d1-42e6-4087-8142-5fa89dbe2db9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:19.602683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39fe72d1-42e6-4087-8142-5fa89dbe2db9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:19.603376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39fe72d1-42e6-4087-8142-5fa89dbe2db9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:19.604020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39fe72d1-42e6-4087-8142-5fa89dbe2db9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:19.727000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-66a556f8-baba-4d94-841d-d407e25d6f30 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:19.737189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-66a556f8-baba-4d94-841d-d407e25d6f30 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:19.744548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-66a556f8-baba-4d94-841d-d407e25d6f30 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:19.750022 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-66a556f8-baba-4d94-841d-d407e25d6f30 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1441 microversion: 2.25 time: 0.308370 Aug 18 11:34:19.752319 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 997/2037] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:19 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1441 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:19.757838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0bb3ebd6-8560-43c7-b103-4f66e5a82817 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f3b9700>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:19.851283 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0bb3ebd6-8560-43c7-b103-4f66e5a82817 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.097048 Aug 18 11:34:19.857990 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 998/2038] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:19 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:19.866210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e95bc7b2-e13c-421c-92a0-cae7c13b77dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:19.867545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e95bc7b2-e13c-421c-92a0-cae7c13b77dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:19.884916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e95bc7b2-e13c-421c-92a0-cae7c13b77dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:19.892350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e95bc7b2-e13c-421c-92a0-cae7c13b77dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:19.893160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e95bc7b2-e13c-421c-92a0-cae7c13b77dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:19.894064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e95bc7b2-e13c-421c-92a0-cae7c13b77dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:19.894704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e95bc7b2-e13c-421c-92a0-cae7c13b77dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:19.895462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e95bc7b2-e13c-421c-92a0-cae7c13b77dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:20.173197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e95bc7b2-e13c-421c-92a0-cae7c13b77dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:20.192816 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e95bc7b2-e13c-421c-92a0-cae7c13b77dd tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1381 microversion: 2.1 time: 0.333323 Aug 18 11:34:20.210760 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 999/2039] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:19 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1381 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:20.224840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5cfb288c-13af-49dd-959a-9e304a0e84a0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:20.225488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5cfb288c-13af-49dd-959a-9e304a0e84a0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:20.265373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfb288c-13af-49dd-959a-9e304a0e84a0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:20.269048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfb288c-13af-49dd-959a-9e304a0e84a0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:20.272232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfb288c-13af-49dd-959a-9e304a0e84a0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:20.273544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfb288c-13af-49dd-959a-9e304a0e84a0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:20.280021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfb288c-13af-49dd-959a-9e304a0e84a0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:20.286135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cfb288c-13af-49dd-959a-9e304a0e84a0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:20.520647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-39fe72d1-42e6-4087-8142-5fa89dbe2db9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:20.535060 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-39fe72d1-42e6-4087-8142-5fa89dbe2db9 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1307 microversion: 2.1 time: 0.964503 Aug 18 11:34:20.536540 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1041/2040] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:19 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1307 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:20.541778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-420f76a6-d393-4671-9d77-689f330a4671 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '.version_select at 0x7f519f583af0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:20.547777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-420f76a6-d393-4671-9d77-689f330a4671 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:20.548646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-420f76a6-d393-4671-9d77-689f330a4671 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:20.549439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-420f76a6-d393-4671-9d77-689f330a4671 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:20.564950 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-420f76a6-d393-4671-9d77-689f330a4671 tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/os-migrations" status: 200 len: 3088 microversion: 2.1 time: 0.027089 Aug 18 11:34:20.566781 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1042/2041] 10.222.0.73 () {58 vars in 1143 bytes} [Thu Aug 18 11:34:20 2022] GET /compute/v2.1/os-migrations => generated 3088 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:20.572488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ff9c4f5a-3dfb-4181-a0fc-e6aa19fbbce9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:20.573413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ff9c4f5a-3dfb-4181-a0fc-e6aa19fbbce9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:20.592861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff9c4f5a-3dfb-4181-a0fc-e6aa19fbbce9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:20.593741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff9c4f5a-3dfb-4181-a0fc-e6aa19fbbce9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:20.594443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff9c4f5a-3dfb-4181-a0fc-e6aa19fbbce9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:20.595403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff9c4f5a-3dfb-4181-a0fc-e6aa19fbbce9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:20.596097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff9c4f5a-3dfb-4181-a0fc-e6aa19fbbce9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:20.596888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff9c4f5a-3dfb-4181-a0fc-e6aa19fbbce9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:20.623650 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-ff9c4f5a-3dfb-4181-a0fc-e6aa19fbbce9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ff9c4f5a-3dfb-4181-a0fc-e6aa19fbbce9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 HTTP/1.1 Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:34:20.628471 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:34:20.629544 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:20.629544 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:34:20.629544 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:34:20.629544 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:34:20.629544 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:34:20.629544 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:34:20.629544 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:34:20.629544 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:34:20.629544 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:34:20.629544 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:34:20.629544 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:34:20.629544 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '071f6b87-653b-4d66-b1b8-c9cc2a4a82a4'} Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:20.630118 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:34:20.632203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:20.634493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ff9c4f5a-3dfb-4181-a0fc-e6aa19fbbce9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:20.635534 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ff9c4f5a-3dfb-4181-a0fc-e6aa19fbbce9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 404 len: 111 microversion: 2.1 time: 0.067307 Aug 18 11:34:20.648460 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1043/2042] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:20 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:34:20.649212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4376e212-b3c1-42ec-9f2c-8e565d97628b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:20.650829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4376e212-b3c1-42ec-9f2c-8e565d97628b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:20.666460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4376e212-b3c1-42ec-9f2c-8e565d97628b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:20.667057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4376e212-b3c1-42ec-9f2c-8e565d97628b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:20.667387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4376e212-b3c1-42ec-9f2c-8e565d97628b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:20.671591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4376e212-b3c1-42ec-9f2c-8e565d97628b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:20.672130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4376e212-b3c1-42ec-9f2c-8e565d97628b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:20.676294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5cfb288c-13af-49dd-959a-9e304a0e84a0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:20.679312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4376e212-b3c1-42ec-9f2c-8e565d97628b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:20.686204 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5cfb288c-13af-49dd-959a-9e304a0e84a0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1510 microversion: 2.1 time: 0.491643 Aug 18 11:34:20.691107 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1000/2043] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:20 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1510 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:20.782586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-818e0c59-67d2-4608-b5f9-4de44fca75b6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:20.784135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-818e0c59-67d2-4608-b5f9-4de44fca75b6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:20.793627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-818e0c59-67d2-4608-b5f9-4de44fca75b6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:20.794708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-818e0c59-67d2-4608-b5f9-4de44fca75b6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:20.795323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-818e0c59-67d2-4608-b5f9-4de44fca75b6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:20.796226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-818e0c59-67d2-4608-b5f9-4de44fca75b6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:20.796862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-818e0c59-67d2-4608-b5f9-4de44fca75b6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:20.797451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-818e0c59-67d2-4608-b5f9-4de44fca75b6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:20.936535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-818e0c59-67d2-4608-b5f9-4de44fca75b6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:20.968354 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-818e0c59-67d2-4608-b5f9-4de44fca75b6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:20.974148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-818e0c59-67d2-4608-b5f9-4de44fca75b6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:20.975394 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-818e0c59-67d2-4608-b5f9-4de44fca75b6 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1266 microversion: 2.25 time: 0.199127 Aug 18 11:34:20.976998 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1001/2044] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:20 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:20.993138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-855876765", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "22608490-9e6a-4848-bc6d-66289c233bc1"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:21.014523 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4376e212-b3c1-42ec-9f2c-8e565d97628b tempest-LiveMigrationTest-1891038995 tempest-LiveMigrationTest-1891038995-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1532 microversion: 2.1 time: 0.376345 Aug 18 11:34:21.017921 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1044/2045] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:20 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1532 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:21.030279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-204c3496-aab3-4985-8943-913fce37dd16 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f51b0e283a0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:21.119742 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-204c3496-aab3-4985-8943-913fce37dd16 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.098907 Aug 18 11:34:21.130764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] validate_networks() for [('22608490-9e6a-4848-bc6d-66289c233bc1', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:34:21.136340 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1045/2046] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:21 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:21.144849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24e9cbc1-187a-4f26-9edc-603b2561a48c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:21.145913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-24e9cbc1-187a-4f26-9edc-603b2561a48c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:21.163177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e9cbc1-187a-4f26-9edc-603b2561a48c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:21.164161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e9cbc1-187a-4f26-9edc-603b2561a48c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:21.164932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e9cbc1-187a-4f26-9edc-603b2561a48c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:21.165859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e9cbc1-187a-4f26-9edc-603b2561a48c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:21.166704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e9cbc1-187a-4f26-9edc-603b2561a48c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:21.167306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e9cbc1-187a-4f26-9edc-603b2561a48c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:21.207771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-24e9cbc1-187a-4f26-9edc-603b2561a48c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:34:21.352317 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-24e9cbc1-187a-4f26-9edc-603b2561a48c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 204 len: 0 microversion: 2.1 time: 0.213321 Aug 18 11:34:21.355944 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1046/2047] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:34:21 2022] DELETE /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:34:21.369452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-19a6a068-4e04-42b2-a052-7ddef205cacb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:21.370136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-19a6a068-4e04-42b2-a052-7ddef205cacb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:21.389707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19a6a068-4e04-42b2-a052-7ddef205cacb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:21.390203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19a6a068-4e04-42b2-a052-7ddef205cacb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:21.390671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19a6a068-4e04-42b2-a052-7ddef205cacb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:21.391439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19a6a068-4e04-42b2-a052-7ddef205cacb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:21.391898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19a6a068-4e04-42b2-a052-7ddef205cacb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:21.392329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19a6a068-4e04-42b2-a052-7ddef205cacb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:21.637568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-19a6a068-4e04-42b2-a052-7ddef205cacb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:21.650907 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-19a6a068-4e04-42b2-a052-7ddef205cacb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1387 microversion: 2.1 time: 0.288119 Aug 18 11:34:21.667493 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1047/2048] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:21 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1387 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:21.675115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9bee9bd7-2191-4319-bbd7-fea7329a5e8a req-3e52a896-08e3-4dc3-b512-da8f4ccd6cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d34316-2cf9-44a6-a370-673959e72cb3", "name": "network-vif-deleted", "tag": "0e79fe89-a5db-4cc8-a9e2-eeb3956f1a86"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:21.721852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9bee9bd7-2191-4319-bbd7-fea7329a5e8a req-3e52a896-08e3-4dc3-b512-da8f4ccd6cbd service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:21.722342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9bee9bd7-2191-4319-bbd7-fea7329a5e8a req-3e52a896-08e3-4dc3-b512-da8f4ccd6cbd service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:21.731758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9bee9bd7-2191-4319-bbd7-fea7329a5e8a req-3e52a896-08e3-4dc3-b512-da8f4ccd6cbd service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:21.773099 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9bee9bd7-2191-4319-bbd7-fea7329a5e8a req-3e52a896-08e3-4dc3-b512-da8f4ccd6cbd service nova] Creating event network-vif-deleted:0e79fe89-a5db-4cc8-a9e2-eeb3956f1a86 for instance 19d34316-2cf9-44a6-a370-673959e72cb3 on n-h2-853611-3 Aug 18 11:34:21.785172 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9bee9bd7-2191-4319-bbd7-fea7329a5e8a req-3e52a896-08e3-4dc3-b512-da8f4ccd6cbd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115511 Aug 18 11:34:21.788250 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1048/2049] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:21.806969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5dbef33b-545f-4541-948e-08ff76b0a6e1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:21.807722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5dbef33b-545f-4541-948e-08ff76b0a6e1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:21.821448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dbef33b-545f-4541-948e-08ff76b0a6e1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:21.822866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dbef33b-545f-4541-948e-08ff76b0a6e1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:21.825721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dbef33b-545f-4541-948e-08ff76b0a6e1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:21.827693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dbef33b-545f-4541-948e-08ff76b0a6e1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:21.830005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dbef33b-545f-4541-948e-08ff76b0a6e1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:21.834249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dbef33b-545f-4541-948e-08ff76b0a6e1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:21.961264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:34:21.961857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:34:21.962565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:34:21.963086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:34:21.963934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:34:21.979341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:21.980534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:21.981993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:21.983132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:21.983827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:21.985128 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:22.009551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Getting quotas for project a98846d5998440dd87f3d85de0bf9d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:34:22.019790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Getting quotas for user 7bf7b0cd3d8740aca2d71944bc371d75 and project a98846d5998440dd87f3d85de0bf9d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:34:22.060085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:34:22.064668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:34:22.137097 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-08a4ebf6-cb4e-4a16-afc8-0f06660ccf93 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160014 Aug 18 11:34:22.140038 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1002/2050] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:34:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:34:22.151197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-875cdf08-6745-42f0-ab26-db105d93d6a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:22.152410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-875cdf08-6745-42f0-ab26-db105d93d6a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:22.160067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-875cdf08-6745-42f0-ab26-db105d93d6a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:22.160568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-875cdf08-6745-42f0-ab26-db105d93d6a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:22.161010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-875cdf08-6745-42f0-ab26-db105d93d6a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:22.161784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-875cdf08-6745-42f0-ab26-db105d93d6a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:22.162260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-875cdf08-6745-42f0-ab26-db105d93d6a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:22.162996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-875cdf08-6745-42f0-ab26-db105d93d6a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:22.392434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-875cdf08-6745-42f0-ab26-db105d93d6a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:22.404142 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-875cdf08-6745-42f0-ab26-db105d93d6a8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1510 microversion: 2.1 time: 0.261222 Aug 18 11:34:22.413272 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1003/2051] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:22 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:22.423048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-09b4155d-8fd9-4a3f-83a1-02a645f09f9a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:22.424965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-09b4155d-8fd9-4a3f-83a1-02a645f09f9a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:22.442085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09b4155d-8fd9-4a3f-83a1-02a645f09f9a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:22.442628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09b4155d-8fd9-4a3f-83a1-02a645f09f9a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:22.443131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09b4155d-8fd9-4a3f-83a1-02a645f09f9a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:22.443949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09b4155d-8fd9-4a3f-83a1-02a645f09f9a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:22.444413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09b4155d-8fd9-4a3f-83a1-02a645f09f9a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:22.445190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09b4155d-8fd9-4a3f-83a1-02a645f09f9a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:22.536970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5dbef33b-545f-4541-948e-08ff76b0a6e1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:22.549021 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5dbef33b-545f-4541-948e-08ff76b0a6e1 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1487 microversion: 2.1 time: 0.758132 Aug 18 11:34:22.555138 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1049/2052] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:21 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1487 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:22.570987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3d4fb3cb-02a1-4663-a087-847560a23148 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:22.571965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3d4fb3cb-02a1-4663-a087-847560a23148 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:22.626414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-09b4155d-8fd9-4a3f-83a1-02a645f09f9a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:22.631410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:22.642969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-09b4155d-8fd9-4a3f-83a1-02a645f09f9a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:22.656876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-09b4155d-8fd9-4a3f-83a1-02a645f09f9a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:22.670384 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-09b4155d-8fd9-4a3f-83a1-02a645f09f9a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1266 microversion: 2.25 time: 0.243580 Aug 18 11:34:22.671419 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1004/2053] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:22 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:22.696897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-86349e90-701b-4152-a558-c04ce91dc5ea tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f2cbc10>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:22.718764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3d4fb3cb-02a1-4663-a087-847560a23148 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:22.728111 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3d4fb3cb-02a1-4663-a087-847560a23148 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1214 microversion: 2.1 time: 0.171504 Aug 18 11:34:22.737769 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1050/2054] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:22 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:22.751126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a7f5d2f-9ca8-4496-964b-8f78cabf2f69 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-408905407"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:22.753906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4a7f5d2f-9ca8-4496-964b-8f78cabf2f69 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:22.767718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7f5d2f-9ca8-4496-964b-8f78cabf2f69 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:22.768324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7f5d2f-9ca8-4496-964b-8f78cabf2f69 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:22.768867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7f5d2f-9ca8-4496-964b-8f78cabf2f69 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:22.769684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7f5d2f-9ca8-4496-964b-8f78cabf2f69 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:22.770352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7f5d2f-9ca8-4496-964b-8f78cabf2f69 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:22.774361 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-86349e90-701b-4152-a558-c04ce91dc5ea tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.101294 Aug 18 11:34:22.775267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7f5d2f-9ca8-4496-964b-8f78cabf2f69 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:22.775506 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1005/2055] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:22 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:22.782212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dd962403-1c83-4a21-9761-5c3000012257 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:22.782913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dd962403-1c83-4a21-9761-5c3000012257 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:22.791620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dd962403-1c83-4a21-9761-5c3000012257 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:22.792114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dd962403-1c83-4a21-9761-5c3000012257 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:22.793090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dd962403-1c83-4a21-9761-5c3000012257 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:22.793367 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dd962403-1c83-4a21-9761-5c3000012257 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:22.793821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dd962403-1c83-4a21-9761-5c3000012257 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:22.794363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dd962403-1c83-4a21-9761-5c3000012257 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:22.995358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dd962403-1c83-4a21-9761-5c3000012257 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:23.009177 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dd962403-1c83-4a21-9761-5c3000012257 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1387 microversion: 2.1 time: 0.232443 Aug 18 11:34:23.015626 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1006/2056] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:22 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1387 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:23.199903 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4a7f5d2f-9ca8-4496-964b-8f78cabf2f69 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "POST /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d/action" status: 202 len: 0 microversion: 2.1 time: 0.460278 Aug 18 11:34:23.206850 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1051/2057] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:34:22 2022] POST /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 18 11:34:23.216000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b03c380b-2a13-4935-b9b0-acf6e95a15a4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f3b9ca0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:23.279695 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b03c380b-2a13-4935-b9b0-acf6e95a15a4 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/40ad19e5-966a-4389-a51d-03d9c3822f77" status: 200 len: 1413 microversion: 2.1 time: 0.069113 Aug 18 11:34:23.282868 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1007/2058] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:23 2022] GET /compute/v2.1/images/40ad19e5-966a-4389-a51d-03d9c3822f77 => generated 1413 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:23.299535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-31d81462-0dd1-4df1-bbe9-99b41380523f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f5af160>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:23.384643 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-31d81462-0dd1-4df1-bbe9-99b41380523f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/40ad19e5-966a-4389-a51d-03d9c3822f77" status: 200 len: 1413 microversion: 2.1 time: 0.092504 Aug 18 11:34:23.397955 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1052/2059] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:23 2022] GET /compute/v2.1/images/40ad19e5-966a-4389-a51d-03d9c3822f77 => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:23.400289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fd6f3b2b-b147-4f42-a210-cf0afac3457b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f3ee670>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:23.428098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03a9d4f0-d2ed-4ebf-b23e-3588163c9ebb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:23.432592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-03a9d4f0-d2ed-4ebf-b23e-3588163c9ebb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:23.462870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03a9d4f0-d2ed-4ebf-b23e-3588163c9ebb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:23.463587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03a9d4f0-d2ed-4ebf-b23e-3588163c9ebb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:23.464053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03a9d4f0-d2ed-4ebf-b23e-3588163c9ebb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:23.466093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03a9d4f0-d2ed-4ebf-b23e-3588163c9ebb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:23.466347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03a9d4f0-d2ed-4ebf-b23e-3588163c9ebb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:23.467495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03a9d4f0-d2ed-4ebf-b23e-3588163c9ebb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:23.685452 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fd6f3b2b-b147-4f42-a210-cf0afac3457b tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/images/40ad19e5-966a-4389-a51d-03d9c3822f77" status: 204 len: 0 microversion: 2.1 time: 0.289887 Aug 18 11:34:23.686550 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1008/2060] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:23 2022] DELETE /compute/v2.1/images/40ad19e5-966a-4389-a51d-03d9c3822f77 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:34:23.701905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0be5668a-708b-48ef-a45c-d93294acd7fa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f36d820>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:23.772256 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-0be5668a-708b-48ef-a45c-d93294acd7fa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] HTTP exception thrown: Image not found. Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0be5668a-708b-48ef-a45c-d93294acd7fa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Request method failure captured: Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/images/40ad19e5-966a-4389-a51d-03d9c3822f77 HTTP/1.1 Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iLQMBYbEYGBiukl8Grc4cgaoip9vYqgvFfgfnpbnlZkSYN7JiarysZng6UxxKLxiZ4y65MAFaOeVWWhpAUJdn51lu23bqEafBew5yuwtK0ajOw4Ed5vO75L1W2pM3AbKugULtMYQtHpN1cPlPnjVANDl7kKfG9M-fTj_PMYAHww2dA Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:34:23.775911 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:34:23.777542 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/287b7017444e47b48aa08661b84a3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_287b7017444e47b48aa08661b84a3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:23.777542 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:23.777542 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:23.777542 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:23.777542 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:23.777542 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:34:23.777542 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:34:23.777542 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 678c78e8696f45c1a9d099199fcdcd36 Aug 18 11:34:23.777542 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:23.777542 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:34:23.777542 n-d-853611-3 devstack@n-api.service[122209]: exception: Image not found. Aug 18 11:34:23.777542 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '40ad19e5-966a-4389-a51d-03d9c3822f77'} Aug 18 11:34:23.777542 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:23.777542 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 40ad19e5-966a-4389-a51d-03d9c3822f77 Aug 18 11:34:23.778220 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:34:23.780287 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 40ad19e5-966a-4389-a51d-03d9c3822f77 could not be found. Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:34:23.781880 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0be5668a-708b-48ef-a45c-d93294acd7fa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Returning 404 to user: Image not found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:23.783070 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0be5668a-708b-48ef-a45c-d93294acd7fa tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/images/40ad19e5-966a-4389-a51d-03d9c3822f77" status: 404 len: 62 microversion: 2.1 time: 0.086319 Aug 18 11:34:23.784090 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1009/2061] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:23 2022] GET /compute/v2.1/images/40ad19e5-966a-4389-a51d-03d9c3822f77 => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:34:23.790238 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d63068f6-5a27-435b-8bfb-5fef02eafe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:23.791095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d63068f6-5a27-435b-8bfb-5fef02eafe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:23.812323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d63068f6-5a27-435b-8bfb-5fef02eafe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:23.818977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d63068f6-5a27-435b-8bfb-5fef02eafe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:23.819981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d63068f6-5a27-435b-8bfb-5fef02eafe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:23.821205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d63068f6-5a27-435b-8bfb-5fef02eafe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:23.821686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d63068f6-5a27-435b-8bfb-5fef02eafe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:23.822118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d63068f6-5a27-435b-8bfb-5fef02eafe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:23.945664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d63068f6-5a27-435b-8bfb-5fef02eafe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:23.984147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d63068f6-5a27-435b-8bfb-5fef02eafe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:23.997378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d63068f6-5a27-435b-8bfb-5fef02eafe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:24.003540 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d63068f6-5a27-435b-8bfb-5fef02eafe4e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1266 microversion: 2.25 time: 0.220272 Aug 18 11:34:24.007189 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1010/2062] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:23 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:24.032988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8f6107c4-a220-4938-9aeb-45186179fba2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:24.034260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8f6107c4-a220-4938-9aeb-45186179fba2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:24.044544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f6107c4-a220-4938-9aeb-45186179fba2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:24.045597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f6107c4-a220-4938-9aeb-45186179fba2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:24.046765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f6107c4-a220-4938-9aeb-45186179fba2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:24.047993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f6107c4-a220-4938-9aeb-45186179fba2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:24.048708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f6107c4-a220-4938-9aeb-45186179fba2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:24.049390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f6107c4-a220-4938-9aeb-45186179fba2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:24.219891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-03a9d4f0-d2ed-4ebf-b23e-3588163c9ebb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:24.228757 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-03a9d4f0-d2ed-4ebf-b23e-3588163c9ebb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1510 microversion: 2.1 time: 0.806312 Aug 18 11:34:24.236873 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1053/2063] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:23 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1510 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:24.253559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb3f04a3-9b09-481f-bc36-6ecfd45554e3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:24.255775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bb3f04a3-9b09-481f-bc36-6ecfd45554e3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:24.297966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb3f04a3-9b09-481f-bc36-6ecfd45554e3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:24.301514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb3f04a3-9b09-481f-bc36-6ecfd45554e3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:24.310084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb3f04a3-9b09-481f-bc36-6ecfd45554e3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:24.311176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb3f04a3-9b09-481f-bc36-6ecfd45554e3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:24.315154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb3f04a3-9b09-481f-bc36-6ecfd45554e3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:24.317069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb3f04a3-9b09-481f-bc36-6ecfd45554e3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:24.356837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8f6107c4-a220-4938-9aeb-45186179fba2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:24.375771 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8f6107c4-a220-4938-9aeb-45186179fba2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1274 microversion: 2.1 time: 0.360530 Aug 18 11:34:24.377998 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1011/2064] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:24 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1274 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:24.393047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-97ffc3d0-fb73-4066-9a8e-9765250dd681 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f2d4ca0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:24.547020 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-97ffc3d0-fb73-4066-9a8e-9765250dd681 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.161585 Aug 18 11:34:24.557543 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1012/2065] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:24 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:24.595405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7a749191-605b-4b22-81f9-0310e4592952 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:24.596087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7a749191-605b-4b22-81f9-0310e4592952 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:24.611677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a749191-605b-4b22-81f9-0310e4592952 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:24.612119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a749191-605b-4b22-81f9-0310e4592952 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:24.612673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a749191-605b-4b22-81f9-0310e4592952 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:24.613412 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a749191-605b-4b22-81f9-0310e4592952 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:24.613874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a749191-605b-4b22-81f9-0310e4592952 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:24.614581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a749191-605b-4b22-81f9-0310e4592952 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:25.066510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bb3f04a3-9b09-481f-bc36-6ecfd45554e3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:25.072390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:25.102766 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bb3f04a3-9b09-481f-bc36-6ecfd45554e3 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1499 microversion: 2.1 time: 0.864411 Aug 18 11:34:25.115938 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1054/2066] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:24 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1499 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:25.124085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8b009da8-e938-4797-a337-88f9613eff64 req-d2cc98fa-8aa8-4ced-8a19-ad0c1fd72d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2979b2d3-3055-479e-ad21-b8aac94ee848", "name": "network-vif-deleted", "tag": "7b97022c-78ee-42c8-b0d9-ab1df08cddb4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:25.252320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8b009da8-e938-4797-a337-88f9613eff64 req-d2cc98fa-8aa8-4ced-8a19-ad0c1fd72d95 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:25.254849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8b009da8-e938-4797-a337-88f9613eff64 req-d2cc98fa-8aa8-4ced-8a19-ad0c1fd72d95 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:25.255983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8b009da8-e938-4797-a337-88f9613eff64 req-d2cc98fa-8aa8-4ced-8a19-ad0c1fd72d95 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:25.307696 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8b009da8-e938-4797-a337-88f9613eff64 req-d2cc98fa-8aa8-4ced-8a19-ad0c1fd72d95 service nova] Creating event network-vif-deleted:7b97022c-78ee-42c8-b0d9-ab1df08cddb4 for instance 2979b2d3-3055-479e-ad21-b8aac94ee848 on n-h1-853611-3 Aug 18 11:34:25.328313 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8b009da8-e938-4797-a337-88f9613eff64 req-d2cc98fa-8aa8-4ced-8a19-ad0c1fd72d95 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208940 Aug 18 11:34:25.335927 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1055/2067] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:25.361468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-229fe14a-c939-4538-b235-96ecd504c4a8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:25.362653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-229fe14a-c939-4538-b235-96ecd504c4a8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:25.386946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-229fe14a-c939-4538-b235-96ecd504c4a8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:25.387474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-229fe14a-c939-4538-b235-96ecd504c4a8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:25.388259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-229fe14a-c939-4538-b235-96ecd504c4a8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:25.389531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-229fe14a-c939-4538-b235-96ecd504c4a8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:25.390547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-229fe14a-c939-4538-b235-96ecd504c4a8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:25.391113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-229fe14a-c939-4538-b235-96ecd504c4a8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:25.626569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7a749191-605b-4b22-81f9-0310e4592952 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:25.629908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-229fe14a-c939-4538-b235-96ecd504c4a8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:25.645346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-229fe14a-c939-4538-b235-96ecd504c4a8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:25.647338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-229fe14a-c939-4538-b235-96ecd504c4a8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:25.649152 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-229fe14a-c939-4538-b235-96ecd504c4a8 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1266 microversion: 2.25 time: 0.311745 Aug 18 11:34:25.654115 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7a749191-605b-4b22-81f9-0310e4592952 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1183 microversion: 2.1 time: 1.089355 Aug 18 11:34:25.654765 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1013/2068] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:24 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1183 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:25.655355 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1056/2069] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:25 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:25.669134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e96f7c28-c558-4176-a358-a6ecae4e7820 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:25.669964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e96f7c28-c558-4176-a358-a6ecae4e7820 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:25.680989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e96f7c28-c558-4176-a358-a6ecae4e7820 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:25.681691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e96f7c28-c558-4176-a358-a6ecae4e7820 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:25.682290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e96f7c28-c558-4176-a358-a6ecae4e7820 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:25.686505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e96f7c28-c558-4176-a358-a6ecae4e7820 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:25.687148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e96f7c28-c558-4176-a358-a6ecae4e7820 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:25.687767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e96f7c28-c558-4176-a358-a6ecae4e7820 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:25.722415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b45b7a95-8d68-4530-9b00-2f6f15786084 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:25.727585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b45b7a95-8d68-4530-9b00-2f6f15786084 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:25.757063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b45b7a95-8d68-4530-9b00-2f6f15786084 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:25.763125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b45b7a95-8d68-4530-9b00-2f6f15786084 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:25.766845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b45b7a95-8d68-4530-9b00-2f6f15786084 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:25.771122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b45b7a95-8d68-4530-9b00-2f6f15786084 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:25.773433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b45b7a95-8d68-4530-9b00-2f6f15786084 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:25.774625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b45b7a95-8d68-4530-9b00-2f6f15786084 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:25.852708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e96f7c28-c558-4176-a358-a6ecae4e7820 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:25.895412 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e96f7c28-c558-4176-a358-a6ecae4e7820 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1272 microversion: 2.1 time: 0.238244 Aug 18 11:34:25.925675 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1057/2070] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:25 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:25.938272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-01064b4f-dbe0-472c-9246-01314c8f1a49 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f51b0e23f70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:26.010006 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-01064b4f-dbe0-472c-9246-01314c8f1a49 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.081388 Aug 18 11:34:26.011673 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1058/2071] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:25 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:26.525165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-72467bd6-9c5f-4c94-b3de-5a911615b416 tempest-ListImagesTestJSON-359992024 tempest-ListImagesTestJSON-359992024-project] Calling method '.version_select at 0x7f519f598700>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:26.676376 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-72467bd6-9c5f-4c94-b3de-5a911615b416 tempest-ListImagesTestJSON-359992024 tempest-ListImagesTestJSON-359992024-project] 10.222.0.73 "GET /compute/v2.1/images/1073d795-16bf-4b88-a573-c9b71aeef18a" status: 200 len: 784 microversion: 2.1 time: 0.662787 Aug 18 11:34:26.710700 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1059/2072] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:26 2022] GET /compute/v2.1/images/1073d795-16bf-4b88-a573-c9b71aeef18a => generated 784 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:26.746165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-108d00b6-848e-41b7-af29-882a2712c816 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:26.747902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b45b7a95-8d68-4530-9b00-2f6f15786084 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:26.755812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-108d00b6-848e-41b7-af29-882a2712c816 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:26.763621 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b45b7a95-8d68-4530-9b00-2f6f15786084 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1510 microversion: 2.1 time: 1.085616 Aug 18 11:34:26.767063 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1014/2073] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:25 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1510 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:26.777490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-108d00b6-848e-41b7-af29-882a2712c816 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:26.779876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-108d00b6-848e-41b7-af29-882a2712c816 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:26.781945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-108d00b6-848e-41b7-af29-882a2712c816 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:26.783084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-108d00b6-848e-41b7-af29-882a2712c816 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:26.786754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-108d00b6-848e-41b7-af29-882a2712c816 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:26.787364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-108d00b6-848e-41b7-af29-882a2712c816 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:26.797768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-77f234b5-4ad5-4b36-862b-bd409e43b918 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:26.811240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-77f234b5-4ad5-4b36-862b-bd409e43b918 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:26.838644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-77f234b5-4ad5-4b36-862b-bd409e43b918 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:26.839579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-77f234b5-4ad5-4b36-862b-bd409e43b918 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:26.843035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-77f234b5-4ad5-4b36-862b-bd409e43b918 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:26.848195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-77f234b5-4ad5-4b36-862b-bd409e43b918 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:26.849654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-77f234b5-4ad5-4b36-862b-bd409e43b918 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:26.850986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-77f234b5-4ad5-4b36-862b-bd409e43b918 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:27.051099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-77f234b5-4ad5-4b36-862b-bd409e43b918 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:27.065961 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-77f234b5-4ad5-4b36-862b-bd409e43b918 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1183 microversion: 2.1 time: 0.297641 Aug 18 11:34:27.067333 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1015/2074] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:26 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1183 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:27.072644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ecfdf8b3-fedb-49c2-9ce3-d90a1a29997a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:27.079130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ecfdf8b3-fedb-49c2-9ce3-d90a1a29997a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:27.091924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ecfdf8b3-fedb-49c2-9ce3-d90a1a29997a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:27.092686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ecfdf8b3-fedb-49c2-9ce3-d90a1a29997a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:27.097398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ecfdf8b3-fedb-49c2-9ce3-d90a1a29997a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:27.099072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ecfdf8b3-fedb-49c2-9ce3-d90a1a29997a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:27.099793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ecfdf8b3-fedb-49c2-9ce3-d90a1a29997a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:27.100458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ecfdf8b3-fedb-49c2-9ce3-d90a1a29997a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:27.318591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-108d00b6-848e-41b7-af29-882a2712c816 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:27.333445 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-108d00b6-848e-41b7-af29-882a2712c816 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1505 microversion: 2.1 time: 0.618858 Aug 18 11:34:27.341161 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1060/2075] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:26 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1505 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:27.352050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eb632e41-9d78-4cf0-b739-f62e9bc5925c tempest-ListImagesTestJSON-359992024 tempest-ListImagesTestJSON-359992024-project] Calling method '.version_select at 0x7f519f5afca0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:27.430032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ecfdf8b3-fedb-49c2-9ce3-d90a1a29997a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:27.446186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ecfdf8b3-fedb-49c2-9ce3-d90a1a29997a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:27.456749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ecfdf8b3-fedb-49c2-9ce3-d90a1a29997a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:27.466403 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ecfdf8b3-fedb-49c2-9ce3-d90a1a29997a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1266 microversion: 2.25 time: 0.397472 Aug 18 11:34:27.475908 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1016/2076] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:27 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1266 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:27.501255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c03d2d17-8edf-4158-b76a-523d99573fef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:27.502048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c03d2d17-8edf-4158-b76a-523d99573fef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:27.524188 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eb632e41-9d78-4cf0-b739-f62e9bc5925c tempest-ListImagesTestJSON-359992024 tempest-ListImagesTestJSON-359992024-project] 10.222.0.73 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.179430 Aug 18 11:34:27.524801 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1061/2077] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 11:34:27 2022] GET /compute/v2.1/images => generated 445 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:27.532569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c03d2d17-8edf-4158-b76a-523d99573fef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:27.532569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c03d2d17-8edf-4158-b76a-523d99573fef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:27.532569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c03d2d17-8edf-4158-b76a-523d99573fef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:27.532569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c03d2d17-8edf-4158-b76a-523d99573fef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:27.532905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c03d2d17-8edf-4158-b76a-523d99573fef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:27.536767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2aa501c7-5023-4bb7-9c3c-fd025fb1157b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f583700>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:27.545281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c03d2d17-8edf-4158-b76a-523d99573fef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:27.628531 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2aa501c7-5023-4bb7-9c3c-fd025fb1157b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.102598 Aug 18 11:34:27.641903 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1062/2078] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:27 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:27.659648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-af5ec795-d010-4ab2-a37f-2383352f5150 tempest-ListImagesTestJSON-359992024 tempest-ListImagesTestJSON-359992024-project] Calling method '.version_select at 0x7f519f5afb80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:27.799217 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-af5ec795-d010-4ab2-a37f-2383352f5150 tempest-ListImagesTestJSON-359992024 tempest-ListImagesTestJSON-359992024-project] 10.222.0.73 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.155354 Aug 18 11:34:27.800403 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1063/2079] 10.222.0.73 () {58 vars in 1143 bytes} [Thu Aug 18 11:34:27 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:27.813695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-eb572643-52d8-4641-ad1b-8bece7b92dcb req-befd1b4a-964a-4eca-a47d-327bf8293825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e3865d-a413-4c57-b0dc-1b29e76be1de", "name": "network-vif-plugged", "status": "completed", "tag": "1fd7f00c-a7c9-42e6-b6f0-3b9378c92c89"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:27.842961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eb572643-52d8-4641-ad1b-8bece7b92dcb req-befd1b4a-964a-4eca-a47d-327bf8293825 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:27.844471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eb572643-52d8-4641-ad1b-8bece7b92dcb req-befd1b4a-964a-4eca-a47d-327bf8293825 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:27.846465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eb572643-52d8-4641-ad1b-8bece7b92dcb req-befd1b4a-964a-4eca-a47d-327bf8293825 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:27.874695 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-eb572643-52d8-4641-ad1b-8bece7b92dcb req-befd1b4a-964a-4eca-a47d-327bf8293825 service nova] Creating event network-vif-plugged:1fd7f00c-a7c9-42e6-b6f0-3b9378c92c89 for instance 51e3865d-a413-4c57-b0dc-1b29e76be1de on n-h1-853611-3 Aug 18 11:34:27.890795 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-eb572643-52d8-4641-ad1b-8bece7b92dcb req-befd1b4a-964a-4eca-a47d-327bf8293825 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087573 Aug 18 11:34:27.892042 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1064/2080] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:27.898533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8ab3089f-5118-4941-bd2e-d6bb07b72478 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:27.914306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8ab3089f-5118-4941-bd2e-d6bb07b72478 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:27.923602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ab3089f-5118-4941-bd2e-d6bb07b72478 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:27.925978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ab3089f-5118-4941-bd2e-d6bb07b72478 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:27.941716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ab3089f-5118-4941-bd2e-d6bb07b72478 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:27.947365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ab3089f-5118-4941-bd2e-d6bb07b72478 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:27.953616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ab3089f-5118-4941-bd2e-d6bb07b72478 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:27.954481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ab3089f-5118-4941-bd2e-d6bb07b72478 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:28.245638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c03d2d17-8edf-4158-b76a-523d99573fef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:28.268192 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c03d2d17-8edf-4158-b76a-523d99573fef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1314 microversion: 2.1 time: 0.790761 Aug 18 11:34:28.271722 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1017/2081] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:27 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1314 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:28.293754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f63912f2-e1e6-44c8-a2d2-74e9ec8aacee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:28.297080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f63912f2-e1e6-44c8-a2d2-74e9ec8aacee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:28.324615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f63912f2-e1e6-44c8-a2d2-74e9ec8aacee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:28.326248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f63912f2-e1e6-44c8-a2d2-74e9ec8aacee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:28.326811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f63912f2-e1e6-44c8-a2d2-74e9ec8aacee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:28.327633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f63912f2-e1e6-44c8-a2d2-74e9ec8aacee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:28.328365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f63912f2-e1e6-44c8-a2d2-74e9ec8aacee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:28.330199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f63912f2-e1e6-44c8-a2d2-74e9ec8aacee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:28.397881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8ab3089f-5118-4941-bd2e-d6bb07b72478 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:28.413359 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8ab3089f-5118-4941-bd2e-d6bb07b72478 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1510 microversion: 2.1 time: 0.519462 Aug 18 11:34:28.418342 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1065/2082] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:27 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1510 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:28.438285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8aea45f-61b5-45e5-9a23-62f18e4e367f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:28.440252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f8aea45f-61b5-45e5-9a23-62f18e4e367f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:28.456350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8aea45f-61b5-45e5-9a23-62f18e4e367f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:28.459044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8aea45f-61b5-45e5-9a23-62f18e4e367f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:28.460230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8aea45f-61b5-45e5-9a23-62f18e4e367f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:28.462708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8aea45f-61b5-45e5-9a23-62f18e4e367f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:28.465831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8aea45f-61b5-45e5-9a23-62f18e4e367f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:28.466526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8aea45f-61b5-45e5-9a23-62f18e4e367f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:28.673172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f63912f2-e1e6-44c8-a2d2-74e9ec8aacee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:28.689505 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f63912f2-e1e6-44c8-a2d2-74e9ec8aacee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1183 microversion: 2.1 time: 0.411322 Aug 18 11:34:28.693360 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1018/2083] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:28 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1183 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:28.720276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c19f0f87-b090-4ae2-bb5a-910dbe2f898a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:28.720822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c19f0f87-b090-4ae2-bb5a-910dbe2f898a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:28.734705 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c19f0f87-b090-4ae2-bb5a-910dbe2f898a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:28.746754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c19f0f87-b090-4ae2-bb5a-910dbe2f898a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:28.750052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c19f0f87-b090-4ae2-bb5a-910dbe2f898a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:28.751041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c19f0f87-b090-4ae2-bb5a-910dbe2f898a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:28.751667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c19f0f87-b090-4ae2-bb5a-910dbe2f898a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:28.754062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c19f0f87-b090-4ae2-bb5a-910dbe2f898a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:28.934364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f8aea45f-61b5-45e5-9a23-62f18e4e367f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:28.947392 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8aea45f-61b5-45e5-9a23-62f18e4e367f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1487 microversion: 2.1 time: 0.526274 Aug 18 11:34:28.948817 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1066/2084] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:28 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1487 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:28.954826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b398fe3-dca8-4c05-8344-5bcf6c3045ee tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f828670>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:28.959052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c19f0f87-b090-4ae2-bb5a-910dbe2f898a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:28.986287 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c19f0f87-b090-4ae2-bb5a-910dbe2f898a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:28.994706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c19f0f87-b090-4ae2-bb5a-910dbe2f898a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:28.998488 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c19f0f87-b090-4ae2-bb5a-910dbe2f898a tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 200 len: 1266 microversion: 2.25 time: 0.288110 Aug 18 11:34:29.006583 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1019/2085] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:28 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 1266 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:29.044449 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3b398fe3-dca8-4c05-8344-5bcf6c3045ee tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.094017 Aug 18 11:34:29.045522 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1067/2086] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:28 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:29.059879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1112dfde-01ab-4652-9ab3-dab2efdfe756 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:29.069065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1112dfde-01ab-4652-9ab3-dab2efdfe756 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:29.090894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1112dfde-01ab-4652-9ab3-dab2efdfe756 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:29.093698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1112dfde-01ab-4652-9ab3-dab2efdfe756 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:29.098409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1112dfde-01ab-4652-9ab3-dab2efdfe756 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:29.103773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1112dfde-01ab-4652-9ab3-dab2efdfe756 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:29.104560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1112dfde-01ab-4652-9ab3-dab2efdfe756 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:29.109340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1112dfde-01ab-4652-9ab3-dab2efdfe756 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:29.187781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1112dfde-01ab-4652-9ab3-dab2efdfe756 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:34:29.424606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1971499692", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:29.465510 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1112dfde-01ab-4652-9ab3-dab2efdfe756 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 204 len: 0 microversion: 2.1 time: 0.416082 Aug 18 11:34:29.466579 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1068/2087] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:34:29 2022] DELETE /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:34:29.472533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5da6ca19-162f-4be5-ad0d-daaf4cc96b30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:29.473446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5da6ca19-162f-4be5-ad0d-daaf4cc96b30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:29.482586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5da6ca19-162f-4be5-ad0d-daaf4cc96b30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:29.483363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5da6ca19-162f-4be5-ad0d-daaf4cc96b30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:29.483950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5da6ca19-162f-4be5-ad0d-daaf4cc96b30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:29.484823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5da6ca19-162f-4be5-ad0d-daaf4cc96b30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:29.485439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5da6ca19-162f-4be5-ad0d-daaf4cc96b30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:29.486011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5da6ca19-162f-4be5-ad0d-daaf4cc96b30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:29.565607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] validate_networks() for [('dabb5a44-fe8f-477b-b07e-e2f6100f41ae', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:34:30.000857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5da6ca19-162f-4be5-ad0d-daaf4cc96b30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:30.010026 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5da6ca19-162f-4be5-ad0d-daaf4cc96b30 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1314 microversion: 2.1 time: 0.541819 Aug 18 11:34:30.010689 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1069/2088] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:29 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:30.042852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ae6e8401-61f1-4d1c-8677-598b5d368f5c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:30.043715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ae6e8401-61f1-4d1c-8677-598b5d368f5c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:30.070753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae6e8401-61f1-4d1c-8677-598b5d368f5c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:30.071179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae6e8401-61f1-4d1c-8677-598b5d368f5c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:30.071624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae6e8401-61f1-4d1c-8677-598b5d368f5c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:30.090323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae6e8401-61f1-4d1c-8677-598b5d368f5c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:30.091001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae6e8401-61f1-4d1c-8677-598b5d368f5c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:30.091824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae6e8401-61f1-4d1c-8677-598b5d368f5c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:30.739200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ae6e8401-61f1-4d1c-8677-598b5d368f5c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:30.748985 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ae6e8401-61f1-4d1c-8677-598b5d368f5c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1510 microversion: 2.1 time: 0.717438 Aug 18 11:34:30.756356 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1070/2089] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:30 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1510 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:30.770460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2c6da90a-37a6-4076-b253-eeec8ce7cb54 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519fec7e50>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:30.863650 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-2c6da90a-37a6-4076-b253-eeec8ce7cb54 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] HTTP exception thrown: Image not found. Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2c6da90a-37a6-4076-b253-eeec8ce7cb54 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Request method failure captured: Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/images/40ad19e5-966a-4389-a51d-03d9c3822f77 HTTP/1.1 Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iLQMBYbEYGBiukl8Grc4cgaoip9vYqgvFfgfnpbnlZkSYN7JiarysZng6UxxKLxiZ4y65MAFaOeVWWhpAUJdn51lu23bqEafBew5yuwtK0ajOw4Ed5vO75L1W2pM3AbKugULtMYQtHpN1cPlPnjVANDl7kKfG9M-fTj_PMYAHww2dA Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:34:30.865974 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:34:30.867376 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/287b7017444e47b48aa08661b84a3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_287b7017444e47b48aa08661b84a3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:30.867376 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:30.867376 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:30.867376 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:30.867376 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:30.867376 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:34:30.867376 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:34:30.867376 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 678c78e8696f45c1a9d099199fcdcd36 Aug 18 11:34:30.867376 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:30.867376 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:34:30.867376 n-d-853611-3 devstack@n-api.service[122210]: exception: Image not found. Aug 18 11:34:30.867376 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '40ad19e5-966a-4389-a51d-03d9c3822f77'} Aug 18 11:34:30.867376 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:30.867376 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 40ad19e5-966a-4389-a51d-03d9c3822f77 to delete Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:30.868220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 40ad19e5-966a-4389-a51d-03d9c3822f77 could not be found. Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:30.869258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 18 11:34:30.871093 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:34:30.871093 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:34:30.871093 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:30.871093 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:30.871093 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:30.871093 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:30.871093 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:30.871093 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:30.871093 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:30.871093 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:30.871093 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:34:30.871093 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:30.871093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2c6da90a-37a6-4076-b253-eeec8ce7cb54 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Returning 404 to user: Image not found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:30.871093 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2c6da90a-37a6-4076-b253-eeec8ce7cb54 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/images/40ad19e5-966a-4389-a51d-03d9c3822f77" status: 404 len: 62 microversion: 2.1 time: 0.110198 Aug 18 11:34:30.872025 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1071/2090] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:30 2022] DELETE /compute/v2.1/images/40ad19e5-966a-4389-a51d-03d9c3822f77 => generated 62 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:34:30.898883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d97b2704-2846-4bab-b7e0-06f729d73bfa req-cc1c1f29-52b0-4c55-a65d-6a8b3e2c363e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ad9e5e-ca95-4e76-9823-3d357ca17f37", "tag": "bb50eb05-55f9-44f6-93f6-81a14dd7c19b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:30.935095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d97b2704-2846-4bab-b7e0-06f729d73bfa req-cc1c1f29-52b0-4c55-a65d-6a8b3e2c363e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:30.935665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d97b2704-2846-4bab-b7e0-06f729d73bfa req-cc1c1f29-52b0-4c55-a65d-6a8b3e2c363e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:30.936297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d97b2704-2846-4bab-b7e0-06f729d73bfa req-cc1c1f29-52b0-4c55-a65d-6a8b3e2c363e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:30.985781 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d97b2704-2846-4bab-b7e0-06f729d73bfa req-cc1c1f29-52b0-4c55-a65d-6a8b3e2c363e service nova] Creating event network-changed:bb50eb05-55f9-44f6-93f6-81a14dd7c19b for instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 on n-h2-853611-3 Aug 18 11:34:31.002281 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d97b2704-2846-4bab-b7e0-06f729d73bfa req-cc1c1f29-52b0-4c55-a65d-6a8b3e2c363e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128863 Aug 18 11:34:31.003471 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1072/2091] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:31.015345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c58c3fe6-90c3-4697-b6e2-b1e8c0787822 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:31.015526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c58c3fe6-90c3-4697-b6e2-b1e8c0787822 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:31.030284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c58c3fe6-90c3-4697-b6e2-b1e8c0787822 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:31.034306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c58c3fe6-90c3-4697-b6e2-b1e8c0787822 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:31.035089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c58c3fe6-90c3-4697-b6e2-b1e8c0787822 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:31.036376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c58c3fe6-90c3-4697-b6e2-b1e8c0787822 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:31.038499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c58c3fe6-90c3-4697-b6e2-b1e8c0787822 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:31.039406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c58c3fe6-90c3-4697-b6e2-b1e8c0787822 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:31.147752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:34:31.149503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:34:31.150142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:34:31.150887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:34:31.152865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:34:31.178976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:31.185033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:31.187320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:31.190047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:31.195041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:31.195896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:31.240768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c58c3fe6-90c3-4697-b6e2-b1e8c0787822 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:31.255527 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c58c3fe6-90c3-4697-b6e2-b1e8c0787822 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1183 microversion: 2.1 time: 0.250817 Aug 18 11:34:31.259196 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1073/2092] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:31 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:31.273082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4b71e0ad-7eab-4f75-b9fd-dadc3f38a4ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:31.273896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4b71e0ad-7eab-4f75-b9fd-dadc3f38a4ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 19d34316-2cf9-44a6-a370-673959e72cb3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:31.275376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Getting quotas for project 4a508683f2ec488eb659d92a87e88582. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:34:31.298906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b71e0ad-7eab-4f75-b9fd-dadc3f38a4ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:31.301093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Getting quotas for user c2b7d55b36a7418d978d4a8abc7399fc and project 4a508683f2ec488eb659d92a87e88582. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:34:31.302840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b71e0ad-7eab-4f75-b9fd-dadc3f38a4ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:31.306085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b71e0ad-7eab-4f75-b9fd-dadc3f38a4ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:31.308287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b71e0ad-7eab-4f75-b9fd-dadc3f38a4ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:31.311483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b71e0ad-7eab-4f75-b9fd-dadc3f38a4ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:31.313573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b71e0ad-7eab-4f75-b9fd-dadc3f38a4ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:31.361046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:34:31.372022 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-4b71e0ad-7eab-4f75-b9fd-dadc3f38a4ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] HTTP exception thrown: Instance 19d34316-2cf9-44a6-a370-673959e72cb3 could not be found. Aug 18 11:34:31.378034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4b71e0ad-7eab-4f75-b9fd-dadc3f38a4ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Request method failure captured: Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 HTTP/1.1 Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iHfonnPQX3UJ8JVfLWKn0-FBTKN1-o3Xum7prCJ2FMsZdZvRcJbTv-8FrUmDTr-Wlg49nWJuhk-bpn_UY-LeVzzNa3m_Kxo5hgM8hOtgGSiqCxiFtvOEgk-Fwkg_0hf4Qntsc1Yrpr_ZAdG8yDS1A0RPRSVo189_-HZVJtp6ztfGbE Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.25 Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 51319140bae948cf873746a482aaf588 Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1161683466 Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:34:31.379419 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:34:31.380756 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51319140bae948cf873746a482aaf588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/51319140bae948cf873746a482aaf588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_51319140bae948cf873746a482aaf588"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51319140bae948cf873746a482aaf588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:31.380756 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1161683466 Aug 18 11:34:31.380756 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 51319140bae948cf873746a482aaf588 Aug 18 11:34:31.380756 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1161683466 Aug 18 11:34:31.380756 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-LiveAutoBlockMigrationV225Test-1161683466-project Aug 18 11:34:31.380756 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:34:31.380756 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:34:31.380756 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 36162046d3d84db98ce76b19770f6322 Aug 18 11:34:31.380756 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1161683466-project Aug 18 11:34:31.380756 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:34:31.380756 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 19d34316-2cf9-44a6-a370-673959e72cb3 could not be found. Aug 18 11:34:31.380756 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '19d34316-2cf9-44a6-a370-673959e72cb3'} Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d34316-2cf9-44a6-a370-673959e72cb3 could not be found. Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:31.381468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d34316-2cf9-44a6-a370-673959e72cb3 could not be found. Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d34316-2cf9-44a6-a370-673959e72cb3 could not be found. Aug 18 11:34:31.382547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:31.384076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4b71e0ad-7eab-4f75-b9fd-dadc3f38a4ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Returning 404 to user: Instance 19d34316-2cf9-44a6-a370-673959e72cb3 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:31.389362 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4b71e0ad-7eab-4f75-b9fd-dadc3f38a4ff tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3" status: 404 len: 111 microversion: 2.25 time: 0.126323 Aug 18 11:34:31.391840 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1074/2093] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:31 2022] GET /compute/v2.1/servers/19d34316-2cf9-44a6-a370-673959e72cb3 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:34:31.402178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c04a1e5d-e5a8-47a0-9a14-09a46e60d2b5 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f51b0d865e0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:31.488732 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c04a1e5d-e5a8-47a0-9a14-09a46e60d2b5 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.094823 Aug 18 11:34:31.506528 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1075/2094] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:31 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:31.516192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ffb6cf2e-fc4c-4833-a853-2612c21a89a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:31.521424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ffb6cf2e-fc4c-4833-a853-2612c21a89a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:31.544637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ffb6cf2e-fc4c-4833-a853-2612c21a89a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:31.547699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ffb6cf2e-fc4c-4833-a853-2612c21a89a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:31.548303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ffb6cf2e-fc4c-4833-a853-2612c21a89a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:31.549316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ffb6cf2e-fc4c-4833-a853-2612c21a89a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:31.558524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ffb6cf2e-fc4c-4833-a853-2612c21a89a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:31.559519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ffb6cf2e-fc4c-4833-a853-2612c21a89a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:31.628930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ffb6cf2e-fc4c-4833-a853-2612c21a89a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:34:31.672845 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5e3ab032-de0d-4404-9913-3ad13869e392 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.658955 Aug 18 11:34:31.678062 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1020/2095] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:34:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:34:31.707244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ad3dbef1-654e-41c3-9b81-c742d400b559 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:31.708761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ad3dbef1-654e-41c3-9b81-c742d400b559 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:31.728608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad3dbef1-654e-41c3-9b81-c742d400b559 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:31.732343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad3dbef1-654e-41c3-9b81-c742d400b559 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:31.735269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad3dbef1-654e-41c3-9b81-c742d400b559 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:31.739854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad3dbef1-654e-41c3-9b81-c742d400b559 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:31.741805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad3dbef1-654e-41c3-9b81-c742d400b559 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:31.743863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad3dbef1-654e-41c3-9b81-c742d400b559 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:31.747325 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.compute.api [None req-ffb6cf2e-fc4c-4833-a853-2612c21a89a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Instance is already in deleting state, ignoring this request Aug 18 11:34:31.748221 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ffb6cf2e-fc4c-4833-a853-2612c21a89a2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 204 len: 0 microversion: 2.1 time: 0.240393 Aug 18 11:34:31.758657 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1076/2096] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:34:31 2022] DELETE /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:34:31.790747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99cca2e8-c714-415d-896e-ffe938727871 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:31.799293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-99cca2e8-c714-415d-896e-ffe938727871 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:32.035426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-99cca2e8-c714-415d-896e-ffe938727871 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:32.051878 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-99cca2e8-c714-415d-896e-ffe938727871 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1223 microversion: 2.1 time: 0.286464 Aug 18 11:34:32.055103 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1077/2097] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:31 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1223 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:32.072796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df15c429-d095-4a85-b757-ffde626e9988 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:32.074014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df15c429-d095-4a85-b757-ffde626e9988 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:32.097885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df15c429-d095-4a85-b757-ffde626e9988 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:32.100089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df15c429-d095-4a85-b757-ffde626e9988 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:32.102796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df15c429-d095-4a85-b757-ffde626e9988 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:32.104798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df15c429-d095-4a85-b757-ffde626e9988 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:32.105469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df15c429-d095-4a85-b757-ffde626e9988 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:32.107815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df15c429-d095-4a85-b757-ffde626e9988 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:32.234923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ad3dbef1-654e-41c3-9b81-c742d400b559 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:32.254096 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ad3dbef1-654e-41c3-9b81-c742d400b559 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1314 microversion: 2.1 time: 0.564424 Aug 18 11:34:32.255832 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1021/2098] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:31 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:32.262639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7fa56018-d5f0-498f-a3b4-c512f6013465 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:32.272492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7fa56018-d5f0-498f-a3b4-c512f6013465 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:32.298627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fa56018-d5f0-498f-a3b4-c512f6013465 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:32.314787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fa56018-d5f0-498f-a3b4-c512f6013465 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:32.316643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fa56018-d5f0-498f-a3b4-c512f6013465 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:32.319010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fa56018-d5f0-498f-a3b4-c512f6013465 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:32.322139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fa56018-d5f0-498f-a3b4-c512f6013465 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:32.324906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fa56018-d5f0-498f-a3b4-c512f6013465 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:33.044801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df15c429-d095-4a85-b757-ffde626e9988 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678c78e8696f45c1a9d099199fcdcd36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b7017444e47b48aa08661b84a3798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:33.058400 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df15c429-d095-4a85-b757-ffde626e9988 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 200 len: 1493 microversion: 2.1 time: 1.002057 Aug 18 11:34:33.059289 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1078/2099] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:32 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 1493 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:33.072044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c96c8c23-bc9d-4b7e-ab72-2f1ab9eb3854 req-221627da-da51-494c-9ac1-d7e9b9680668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24678345-9136-412f-b4d0-3bdb8a59141d", "name": "network-vif-plugged", "status": "completed", "tag": "972f02f1-f655-4ac5-b32a-de1a99f97085"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:33.106351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c96c8c23-bc9d-4b7e-ab72-2f1ab9eb3854 req-221627da-da51-494c-9ac1-d7e9b9680668 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:33.108758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c96c8c23-bc9d-4b7e-ab72-2f1ab9eb3854 req-221627da-da51-494c-9ac1-d7e9b9680668 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:33.118417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c96c8c23-bc9d-4b7e-ab72-2f1ab9eb3854 req-221627da-da51-494c-9ac1-d7e9b9680668 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:33.145940 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c96c8c23-bc9d-4b7e-ab72-2f1ab9eb3854 req-221627da-da51-494c-9ac1-d7e9b9680668 service nova] Creating event network-vif-plugged:972f02f1-f655-4ac5-b32a-de1a99f97085 for instance 24678345-9136-412f-b4d0-3bdb8a59141d on n-h1-853611-3 Aug 18 11:34:33.159458 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c96c8c23-bc9d-4b7e-ab72-2f1ab9eb3854 req-221627da-da51-494c-9ac1-d7e9b9680668 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091003 Aug 18 11:34:33.160451 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1079/2100] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:33.168163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-52551b2d-01ef-4d1f-a5d4-d063a26cc79a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:33.169349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-52551b2d-01ef-4d1f-a5d4-d063a26cc79a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:33.181227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52551b2d-01ef-4d1f-a5d4-d063a26cc79a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:33.184339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52551b2d-01ef-4d1f-a5d4-d063a26cc79a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:33.185062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52551b2d-01ef-4d1f-a5d4-d063a26cc79a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:33.190666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52551b2d-01ef-4d1f-a5d4-d063a26cc79a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:33.203273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52551b2d-01ef-4d1f-a5d4-d063a26cc79a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:33.204298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52551b2d-01ef-4d1f-a5d4-d063a26cc79a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:33.424266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7fa56018-d5f0-498f-a3b4-c512f6013465 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:33.454795 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7fa56018-d5f0-498f-a3b4-c512f6013465 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1510 microversion: 2.1 time: 1.193784 Aug 18 11:34:33.458776 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1022/2101] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:32 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1510 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:33.470477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-52551b2d-01ef-4d1f-a5d4-d063a26cc79a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:33.489990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:33.498411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1846b740-adce-4ffc-a620-fc3aff0b949b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f3b05e0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:33.517329 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-52551b2d-01ef-4d1f-a5d4-d063a26cc79a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1183 microversion: 2.1 time: 0.352102 Aug 18 11:34:33.521344 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1080/2102] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:33 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1183 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:33.540794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a8384639-d6b9-4bb3-9d2e-164b0ec45b24 req-6d5dd4d2-aa95-4cea-bb41-e9427e52b507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24678345-9136-412f-b4d0-3bdb8a59141d", "name": "network-vif-deleted", "tag": "972f02f1-f655-4ac5-b32a-de1a99f97085"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:33.564713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a8384639-d6b9-4bb3-9d2e-164b0ec45b24 req-6d5dd4d2-aa95-4cea-bb41-e9427e52b507 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:33.565964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a8384639-d6b9-4bb3-9d2e-164b0ec45b24 req-6d5dd4d2-aa95-4cea-bb41-e9427e52b507 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:33.566978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a8384639-d6b9-4bb3-9d2e-164b0ec45b24 req-6d5dd4d2-aa95-4cea-bb41-e9427e52b507 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:33.603417 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a8384639-d6b9-4bb3-9d2e-164b0ec45b24 req-6d5dd4d2-aa95-4cea-bb41-e9427e52b507 service nova] Creating event network-vif-deleted:972f02f1-f655-4ac5-b32a-de1a99f97085 for instance 24678345-9136-412f-b4d0-3bdb8a59141d on n-h1-853611-3 Aug 18 11:34:33.616668 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a8384639-d6b9-4bb3-9d2e-164b0ec45b24 req-6d5dd4d2-aa95-4cea-bb41-e9427e52b507 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089691 Aug 18 11:34:33.624492 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1081/2103] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:33.644873 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1846b740-adce-4ffc-a620-fc3aff0b949b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.180787 Aug 18 11:34:33.659258 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1023/2104] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:33 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:33.659631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-36341253-f4f9-4d64-9338-2f9654747259 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:33.660711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-36341253-f4f9-4d64-9338-2f9654747259 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:33.668869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-25af484e-2044-40b3-87a2-fa2170e6e421 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:33.672303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-25af484e-2044-40b3-87a2-fa2170e6e421 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:33.690963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36341253-f4f9-4d64-9338-2f9654747259 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:33.693558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36341253-f4f9-4d64-9338-2f9654747259 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:33.694494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36341253-f4f9-4d64-9338-2f9654747259 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:33.695778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36341253-f4f9-4d64-9338-2f9654747259 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:33.699598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36341253-f4f9-4d64-9338-2f9654747259 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:33.701289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36341253-f4f9-4d64-9338-2f9654747259 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:33.712451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25af484e-2044-40b3-87a2-fa2170e6e421 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:33.716474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25af484e-2044-40b3-87a2-fa2170e6e421 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:33.718908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25af484e-2044-40b3-87a2-fa2170e6e421 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:33.723974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25af484e-2044-40b3-87a2-fa2170e6e421 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:33.726383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25af484e-2044-40b3-87a2-fa2170e6e421 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:33.728894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25af484e-2044-40b3-87a2-fa2170e6e421 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:33.982836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-36341253-f4f9-4d64-9338-2f9654747259 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:33.993134 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-36341253-f4f9-4d64-9338-2f9654747259 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1275 microversion: 2.1 time: 0.355970 Aug 18 11:34:33.994310 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1082/2105] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:33 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1275 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:34.098252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e3a11a65-4e69-4107-a2d3-0a0bc993f665 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:34.099599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e3a11a65-4e69-4107-a2d3-0a0bc993f665 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 24678345-9136-412f-b4d0-3bdb8a59141d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:34.116896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3a11a65-4e69-4107-a2d3-0a0bc993f665 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:34.123200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3a11a65-4e69-4107-a2d3-0a0bc993f665 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:34.124440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3a11a65-4e69-4107-a2d3-0a0bc993f665 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:34.128247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3a11a65-4e69-4107-a2d3-0a0bc993f665 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:34.132974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3a11a65-4e69-4107-a2d3-0a0bc993f665 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:34.137376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3a11a65-4e69-4107-a2d3-0a0bc993f665 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:34.193303 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-e3a11a65-4e69-4107-a2d3-0a0bc993f665 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] HTTP exception thrown: Instance 24678345-9136-412f-b4d0-3bdb8a59141d could not be found. Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e3a11a65-4e69-4107-a2d3-0a0bc993f665 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Request method failure captured: Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d HTTP/1.1 Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iLQMBYbEYGBiukl8Grc4cgaoip9vYqgvFfgfnpbnlZkSYN7JiarysZng6UxxKLxiZ4y65MAFaOeVWWhpAUJdn51lu23bqEafBew5yuwtK0ajOw4Ed5vO75L1W2pM3AbKugULtMYQtHpN1cPlPnjVANDl7kKfG9M-fTj_PMYAHww2dA Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:34:34.201984 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:34:34.203500 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/287b7017444e47b48aa08661b84a3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_287b7017444e47b48aa08661b84a3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:34.203500 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.203500 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:34.203500 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.203500 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:34.203500 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:34:34.203500 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:34:34.203500 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 678c78e8696f45c1a9d099199fcdcd36 Aug 18 11:34:34.203500 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:34.203500 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:34:34.203500 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 24678345-9136-412f-b4d0-3bdb8a59141d could not be found. Aug 18 11:34:34.203500 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '24678345-9136-412f-b4d0-3bdb8a59141d'} Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24678345-9136-412f-b4d0-3bdb8a59141d could not be found. Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:34.204197 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24678345-9136-412f-b4d0-3bdb8a59141d could not be found. Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24678345-9136-412f-b4d0-3bdb8a59141d could not be found. Aug 18 11:34:34.205689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.211255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e3a11a65-4e69-4107-a2d3-0a0bc993f665 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Returning 404 to user: Instance 24678345-9136-412f-b4d0-3bdb8a59141d could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:34.215641 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e3a11a65-4e69-4107-a2d3-0a0bc993f665 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d" status: 404 len: 111 microversion: 2.1 time: 0.122269 Aug 18 11:34:34.217652 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1083/2106] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:34 2022] GET /compute/v2.1/servers/24678345-9136-412f-b4d0-3bdb8a59141d => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:34:34.225663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cbbec994-bf86-4a7a-8319-dce0e997137f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f828a60>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:34.321278 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-cbbec994-bf86-4a7a-8319-dce0e997137f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] HTTP exception thrown: Image not found. Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cbbec994-bf86-4a7a-8319-dce0e997137f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Request method failure captured: Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 HTTP/1.1 Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iLQMBYbEYGBiukl8Grc4cgaoip9vYqgvFfgfnpbnlZkSYN7JiarysZng6UxxKLxiZ4y65MAFaOeVWWhpAUJdn51lu23bqEafBew5yuwtK0ajOw4Ed5vO75L1W2pM3AbKugULtMYQtHpN1cPlPnjVANDl7kKfG9M-fTj_PMYAHww2dA Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:34:34.324430 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:34:34.325789 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/287b7017444e47b48aa08661b84a3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_287b7017444e47b48aa08661b84a3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:34.325789 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.325789 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:34.325789 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.325789 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:34.325789 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:34:34.325789 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:34:34.325789 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 678c78e8696f45c1a9d099199fcdcd36 Aug 18 11:34:34.325789 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:34.325789 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:34:34.325789 n-d-853611-3 devstack@n-api.service[122210]: exception: Image not found. Aug 18 11:34:34.325789 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '3d379fe8-b90e-446e-a350-9bb6fc0d7714'} Aug 18 11:34:34.325789 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:34.325789 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3d379fe8-b90e-446e-a350-9bb6fc0d7714 to delete Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.326567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3d379fe8-b90e-446e-a350-9bb6fc0d7714 could not be found. Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:34.327769 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 18 11:34:34.328724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:34:34.328724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:34:34.328724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.328724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:34.328724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.328724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.328724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:34.328724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:34.328724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:34.328724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:34.328724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:34:34.328724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.328724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cbbec994-bf86-4a7a-8319-dce0e997137f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Returning 404 to user: Image not found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:34.328724 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cbbec994-bf86-4a7a-8319-dce0e997137f tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714" status: 404 len: 62 microversion: 2.1 time: 0.104061 Aug 18 11:34:34.330864 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1084/2107] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:34 2022] DELETE /compute/v2.1/images/3d379fe8-b90e-446e-a350-9bb6fc0d7714 => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:34:34.348543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-25af484e-2044-40b3-87a2-fa2170e6e421 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:34.359782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f608f344-4f83-4a55-bff6-709a017cf091 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:34.362308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f608f344-4f83-4a55-bff6-709a017cf091 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:34.366175 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-25af484e-2044-40b3-87a2-fa2170e6e421 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1314 microversion: 2.1 time: 0.707041 Aug 18 11:34:34.367033 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1024/2108] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:33 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:34.406752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f608f344-4f83-4a55-bff6-709a017cf091 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:34.415190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f608f344-4f83-4a55-bff6-709a017cf091 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:34.415697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f608f344-4f83-4a55-bff6-709a017cf091 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:34.417740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f608f344-4f83-4a55-bff6-709a017cf091 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:34.418620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f608f344-4f83-4a55-bff6-709a017cf091 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:34.419316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f608f344-4f83-4a55-bff6-709a017cf091 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:34.466062 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-f608f344-4f83-4a55-bff6-709a017cf091 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] HTTP exception thrown: Instance e2a25b73-ea72-405a-b127-add6779c63d6 could not be found. Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f608f344-4f83-4a55-bff6-709a017cf091 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Request method failure captured: Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6 HTTP/1.1 Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iLQMBYbEYGBiukl8Grc4cgaoip9vYqgvFfgfnpbnlZkSYN7JiarysZng6UxxKLxiZ4y65MAFaOeVWWhpAUJdn51lu23bqEafBew5yuwtK0ajOw4Ed5vO75L1W2pM3AbKugULtMYQtHpN1cPlPnjVANDl7kKfG9M-fTj_PMYAHww2dA Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:34:34.468122 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:34:34.469226 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/287b7017444e47b48aa08661b84a3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_287b7017444e47b48aa08661b84a3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:34.469226 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.469226 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:34.469226 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.469226 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:34.469226 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:34:34.469226 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:34:34.469226 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 678c78e8696f45c1a9d099199fcdcd36 Aug 18 11:34:34.469226 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:34.469226 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:34:34.469226 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance e2a25b73-ea72-405a-b127-add6779c63d6 could not be found. Aug 18 11:34:34.469226 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'e2a25b73-ea72-405a-b127-add6779c63d6'} Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a25b73-ea72-405a-b127-add6779c63d6 could not be found. Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:34.469808 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a25b73-ea72-405a-b127-add6779c63d6 could not be found. Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a25b73-ea72-405a-b127-add6779c63d6 could not be found. Aug 18 11:34:34.470861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.472402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f608f344-4f83-4a55-bff6-709a017cf091 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Returning 404 to user: Instance e2a25b73-ea72-405a-b127-add6779c63d6 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:34.473262 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f608f344-4f83-4a55-bff6-709a017cf091 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6" status: 404 len: 111 microversion: 2.1 time: 0.141210 Aug 18 11:34:34.481263 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1085/2109] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:34:34 2022] DELETE /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:34:34.484873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-07ccecea-5921-4e0a-8d7c-c194c5bf3d33 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:34.486277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-07ccecea-5921-4e0a-8d7c-c194c5bf3d33 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: e2a25b73-ea72-405a-b127-add6779c63d6] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:34.494850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ccecea-5921-4e0a-8d7c-c194c5bf3d33 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:34.495745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ccecea-5921-4e0a-8d7c-c194c5bf3d33 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:34.496373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ccecea-5921-4e0a-8d7c-c194c5bf3d33 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:34.497306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ccecea-5921-4e0a-8d7c-c194c5bf3d33 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:34.498085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ccecea-5921-4e0a-8d7c-c194c5bf3d33 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:34.498768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ccecea-5921-4e0a-8d7c-c194c5bf3d33 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:34.500457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0ca8e6f0-520c-48df-a70b-4fb9381a0d90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:34.501111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0ca8e6f0-520c-48df-a70b-4fb9381a0d90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:34.509651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:34.511341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ca8e6f0-520c-48df-a70b-4fb9381a0d90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:34.511835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ca8e6f0-520c-48df-a70b-4fb9381a0d90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:34.513442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ca8e6f0-520c-48df-a70b-4fb9381a0d90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:34.516312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ca8e6f0-520c-48df-a70b-4fb9381a0d90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:34.517881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ca8e6f0-520c-48df-a70b-4fb9381a0d90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:34.518872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ca8e6f0-520c-48df-a70b-4fb9381a0d90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:34.530638 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-07ccecea-5921-4e0a-8d7c-c194c5bf3d33 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] HTTP exception thrown: Instance e2a25b73-ea72-405a-b127-add6779c63d6 could not be found. Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-07ccecea-5921-4e0a-8d7c-c194c5bf3d33 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Request method failure captured: Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6 HTTP/1.1 Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iLQMBYbEYGBiukl8Grc4cgaoip9vYqgvFfgfnpbnlZkSYN7JiarysZng6UxxKLxiZ4y65MAFaOeVWWhpAUJdn51lu23bqEafBew5yuwtK0ajOw4Ed5vO75L1W2pM3AbKugULtMYQtHpN1cPlPnjVANDl7kKfG9M-fTj_PMYAHww2dA Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:34:34.532633 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:34:34.533716 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/287b7017444e47b48aa08661b84a3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_287b7017444e47b48aa08661b84a3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:34.533716 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.533716 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:34.533716 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.533716 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:34.533716 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:34:34.533716 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:34:34.533716 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 678c78e8696f45c1a9d099199fcdcd36 Aug 18 11:34:34.533716 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:34.533716 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:34:34.533716 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance e2a25b73-ea72-405a-b127-add6779c63d6 could not be found. Aug 18 11:34:34.533716 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'e2a25b73-ea72-405a-b127-add6779c63d6'} Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a25b73-ea72-405a-b127-add6779c63d6 could not be found. Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:34.534375 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a25b73-ea72-405a-b127-add6779c63d6 could not be found. Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a25b73-ea72-405a-b127-add6779c63d6 could not be found. Aug 18 11:34:34.535809 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.536754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-07ccecea-5921-4e0a-8d7c-c194c5bf3d33 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Returning 404 to user: Instance e2a25b73-ea72-405a-b127-add6779c63d6 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:34.536754 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-07ccecea-5921-4e0a-8d7c-c194c5bf3d33 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6" status: 404 len: 111 microversion: 2.1 time: 0.055951 Aug 18 11:34:34.538721 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1025/2110] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:34 2022] GET /compute/v2.1/servers/e2a25b73-ea72-405a-b127-add6779c63d6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:34:34.544508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-422ef9f8-b9cd-4f1f-87b9-b55901f29284 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f519f3b0280>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:34.575190 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-422ef9f8-b9cd-4f1f-87b9-b55901f29284 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] HTTP exception thrown: Image not found. Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-422ef9f8-b9cd-4f1f-87b9-b55901f29284 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Request method failure captured: Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168 HTTP/1.1 Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iLQMBYbEYGBiukl8Grc4cgaoip9vYqgvFfgfnpbnlZkSYN7JiarysZng6UxxKLxiZ4y65MAFaOeVWWhpAUJdn51lu23bqEafBew5yuwtK0ajOw4Ed5vO75L1W2pM3AbKugULtMYQtHpN1cPlPnjVANDl7kKfG9M-fTj_PMYAHww2dA Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:34:34.578410 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:34:34.579723 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/287b7017444e47b48aa08661b84a3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_287b7017444e47b48aa08661b84a3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:34.579723 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.579723 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:34.579723 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:34.579723 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:34.579723 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:34:34.579723 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:34:34.579723 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 678c78e8696f45c1a9d099199fcdcd36 Aug 18 11:34:34.579723 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:34.579723 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:34:34.579723 n-d-853611-3 devstack@n-api.service[122209]: exception: Image not found. Aug 18 11:34:34.579723 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '1b2f74bd-e602-4a9f-85cf-20ab148e2168'} Aug 18 11:34:34.579723 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:34.579723 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1b2f74bd-e602-4a9f-85cf-20ab148e2168 to delete Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.580447 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1b2f74bd-e602-4a9f-85cf-20ab148e2168 could not be found. Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:34.581332 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 18 11:34:34.582265 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:34:34.582265 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:34:34.582265 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.582265 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:34.582265 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.582265 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:34.582265 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:34.582265 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:34.582265 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:34.582265 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:34.582265 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:34:34.582265 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:34.584853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-422ef9f8-b9cd-4f1f-87b9-b55901f29284 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Returning 404 to user: Image not found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:34.585880 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-422ef9f8-b9cd-4f1f-87b9-b55901f29284 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168" status: 404 len: 62 microversion: 2.1 time: 0.046054 Aug 18 11:34:34.590714 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1026/2111] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:34 2022] DELETE /compute/v2.1/images/1b2f74bd-e602-4a9f-85cf-20ab148e2168 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:34:34.597221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a187dba3-7715-46eb-98b1-b6a32b078908 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:34.599035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a187dba3-7715-46eb-98b1-b6a32b078908 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:34.626686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a187dba3-7715-46eb-98b1-b6a32b078908 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:34.627666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a187dba3-7715-46eb-98b1-b6a32b078908 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:34.628437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a187dba3-7715-46eb-98b1-b6a32b078908 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:34.629703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a187dba3-7715-46eb-98b1-b6a32b078908 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:34.630547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a187dba3-7715-46eb-98b1-b6a32b078908 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:34.631325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a187dba3-7715-46eb-98b1-b6a32b078908 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:34.953382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a187dba3-7715-46eb-98b1-b6a32b078908 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:34.967958 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a187dba3-7715-46eb-98b1-b6a32b078908 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1183 microversion: 2.1 time: 0.372473 Aug 18 11:34:34.989301 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1027/2112] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:34 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1183 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:34.995624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bc3a9f63-804e-4b11-96a3-1d193ef1661c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:34.996465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bc3a9f63-804e-4b11-96a3-1d193ef1661c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:35.003883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc3a9f63-804e-4b11-96a3-1d193ef1661c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:35.004617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc3a9f63-804e-4b11-96a3-1d193ef1661c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:35.005206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc3a9f63-804e-4b11-96a3-1d193ef1661c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:35.006076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc3a9f63-804e-4b11-96a3-1d193ef1661c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:35.009639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc3a9f63-804e-4b11-96a3-1d193ef1661c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:35.011018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc3a9f63-804e-4b11-96a3-1d193ef1661c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:35.053333 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-bc3a9f63-804e-4b11-96a3-1d193ef1661c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] HTTP exception thrown: Instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 could not be found. Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bc3a9f63-804e-4b11-96a3-1d193ef1661c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Request method failure captured: Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 HTTP/1.1 Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iLQMBYbEYGBiukl8Grc4cgaoip9vYqgvFfgfnpbnlZkSYN7JiarysZng6UxxKLxiZ4y65MAFaOeVWWhpAUJdn51lu23bqEafBew5yuwtK0ajOw4Ed5vO75L1W2pM3AbKugULtMYQtHpN1cPlPnjVANDl7kKfG9M-fTj_PMYAHww2dA Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:34:35.054983 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:34:35.056064 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/287b7017444e47b48aa08661b84a3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_287b7017444e47b48aa08661b84a3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:35.056064 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:35.056064 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:35.056064 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:35.056064 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:35.056064 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:34:35.056064 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:34:35.056064 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 678c78e8696f45c1a9d099199fcdcd36 Aug 18 11:34:35.056064 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:35.056064 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:34:35.056064 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 could not be found. Aug 18 11:34:35.056064 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '95fda40e-acac-4a4a-8823-1a6aa7d9c359'} Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 could not be found. Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:35.056675 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 could not be found. Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 could not be found. Aug 18 11:34:35.058163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.061786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bc3a9f63-804e-4b11-96a3-1d193ef1661c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Returning 404 to user: Instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:35.061786 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bc3a9f63-804e-4b11-96a3-1d193ef1661c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 404 len: 111 microversion: 2.1 time: 0.065805 Aug 18 11:34:35.061786 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1028/2113] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:34:34 2022] DELETE /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:34:35.074688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2f0b2f9f-0953-4aa8-afb6-9fec0ed3b3d2 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f62da60>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:35.184683 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2f0b2f9f-0953-4aa8-afb6-9fec0ed3b3d2 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.119487 Aug 18 11:34:35.187232 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1029/2114] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:35 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:35.210005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5f6c5c59-7aa5-4452-9353-e6bbd8b738a8 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:35.225620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5f6c5c59-7aa5-4452-9353-e6bbd8b738a8 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:35.246028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6c5c59-7aa5-4452-9353-e6bbd8b738a8 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:35.247027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6c5c59-7aa5-4452-9353-e6bbd8b738a8 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:35.251770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6c5c59-7aa5-4452-9353-e6bbd8b738a8 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:35.253173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6c5c59-7aa5-4452-9353-e6bbd8b738a8 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:35.254896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6c5c59-7aa5-4452-9353-e6bbd8b738a8 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:35.262664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f6c5c59-7aa5-4452-9353-e6bbd8b738a8 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:35.623152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5f6c5c59-7aa5-4452-9353-e6bbd8b738a8 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:35.634411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0ca8e6f0-520c-48df-a70b-4fb9381a0d90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:35.641612 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5f6c5c59-7aa5-4452-9353-e6bbd8b738a8 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1281 microversion: 2.1 time: 0.452537 Aug 18 11:34:35.642410 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1030/2115] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:35 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1281 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:35.665774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7df67f27-6b5a-4acb-a4af-f0d0ef835d9c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:35.670393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7df67f27-6b5a-4acb-a4af-f0d0ef835d9c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: 95fda40e-acac-4a4a-8823-1a6aa7d9c359] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:35.674601 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0ca8e6f0-520c-48df-a70b-4fb9381a0d90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1510 microversion: 2.1 time: 1.175084 Aug 18 11:34:35.691724 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1086/2116] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:34 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1510 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:35.694182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7df67f27-6b5a-4acb-a4af-f0d0ef835d9c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:35.696851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7df67f27-6b5a-4acb-a4af-f0d0ef835d9c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:35.698997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7df67f27-6b5a-4acb-a4af-f0d0ef835d9c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:35.706227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7df67f27-6b5a-4acb-a4af-f0d0ef835d9c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:35.709224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7df67f27-6b5a-4acb-a4af-f0d0ef835d9c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:35.710584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2edc3e0f-bf27-4e1a-9f75-617c4c38bed2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:35.711031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7df67f27-6b5a-4acb-a4af-f0d0ef835d9c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:35.711643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2edc3e0f-bf27-4e1a-9f75-617c4c38bed2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:35.726867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edc3e0f-bf27-4e1a-9f75-617c4c38bed2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:35.728944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edc3e0f-bf27-4e1a-9f75-617c4c38bed2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:35.732977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edc3e0f-bf27-4e1a-9f75-617c4c38bed2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:35.734010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edc3e0f-bf27-4e1a-9f75-617c4c38bed2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:35.735105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edc3e0f-bf27-4e1a-9f75-617c4c38bed2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:35.743239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edc3e0f-bf27-4e1a-9f75-617c4c38bed2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:35.778785 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-7df67f27-6b5a-4acb-a4af-f0d0ef835d9c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] HTTP exception thrown: Instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 could not be found. Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7df67f27-6b5a-4acb-a4af-f0d0ef835d9c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Request method failure captured: Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 HTTP/1.1 Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iLQMBYbEYGBiukl8Grc4cgaoip9vYqgvFfgfnpbnlZkSYN7JiarysZng6UxxKLxiZ4y65MAFaOeVWWhpAUJdn51lu23bqEafBew5yuwtK0ajOw4Ed5vO75L1W2pM3AbKugULtMYQtHpN1cPlPnjVANDl7kKfG9M-fTj_PMYAHww2dA Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:34:35.783430 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:34:35.784782 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/287b7017444e47b48aa08661b84a3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_287b7017444e47b48aa08661b84a3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:35.784782 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:35.784782 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:35.784782 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:35.784782 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:35.784782 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:34:35.784782 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:34:35.784782 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 678c78e8696f45c1a9d099199fcdcd36 Aug 18 11:34:35.784782 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:35.784782 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:34:35.784782 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 could not be found. Aug 18 11:34:35.784782 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '95fda40e-acac-4a4a-8823-1a6aa7d9c359'} Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 could not be found. Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:35.785508 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 could not be found. Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 could not be found. Aug 18 11:34:35.786776 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.790242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7df67f27-6b5a-4acb-a4af-f0d0ef835d9c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Returning 404 to user: Instance 95fda40e-acac-4a4a-8823-1a6aa7d9c359 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:35.791387 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7df67f27-6b5a-4acb-a4af-f0d0ef835d9c tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359" status: 404 len: 111 microversion: 2.1 time: 0.142650 Aug 18 11:34:35.798180 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1031/2117] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:35 2022] GET /compute/v2.1/servers/95fda40e-acac-4a4a-8823-1a6aa7d9c359 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:34:35.810907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-48da96ac-4d1f-455f-a87e-4516ad586fe2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '.version_select at 0x7f51ac141c10>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:35.856448 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-48da96ac-4d1f-455f-a87e-4516ad586fe2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] HTTP exception thrown: Image not found. Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-48da96ac-4d1f-455f-a87e-4516ad586fe2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Request method failure captured: Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 HTTP/1.1 Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iLQMBYbEYGBiukl8Grc4cgaoip9vYqgvFfgfnpbnlZkSYN7JiarysZng6UxxKLxiZ4y65MAFaOeVWWhpAUJdn51lu23bqEafBew5yuwtK0ajOw4Ed5vO75L1W2pM3AbKugULtMYQtHpN1cPlPnjVANDl7kKfG9M-fTj_PMYAHww2dA Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:34:35.858149 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:34:35.859312 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/287b7017444e47b48aa08661b84a3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_287b7017444e47b48aa08661b84a3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:35.859312 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:35.859312 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:35.859312 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:35.859312 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:35.859312 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:34:35.859312 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:34:35.859312 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 678c78e8696f45c1a9d099199fcdcd36 Aug 18 11:34:35.859312 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:35.859312 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:34:35.859312 n-d-853611-3 devstack@n-api.service[122209]: exception: Image not found. Aug 18 11:34:35.859312 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '69065af0-1506-4af2-a8e5-fdf1ecfaa872'} Aug 18 11:34:35.859312 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:35.859312 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 69065af0-1506-4af2-a8e5-fdf1ecfaa872 to delete Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.860093 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 69065af0-1506-4af2-a8e5-fdf1ecfaa872 could not be found. Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:35.861019 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 18 11:34:35.862020 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:34:35.862020 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:34:35.862020 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.862020 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:35.862020 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.862020 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:35.862020 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:35.862020 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:35.862020 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:35.862020 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:35.862020 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:34:35.862020 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.862020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-48da96ac-4d1f-455f-a87e-4516ad586fe2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Returning 404 to user: Image not found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:35.864169 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-48da96ac-4d1f-455f-a87e-4516ad586fe2 tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872" status: 404 len: 62 microversion: 2.1 time: 0.064495 Aug 18 11:34:35.869013 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1032/2118] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:35 2022] DELETE /compute/v2.1/images/69065af0-1506-4af2-a8e5-fdf1ecfaa872 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:34:35.879090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-021680f6-625c-4fc1-9425-b9702991d20e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:35.896061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-021680f6-625c-4fc1-9425-b9702991d20e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:35.908564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-021680f6-625c-4fc1-9425-b9702991d20e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:35.914654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-021680f6-625c-4fc1-9425-b9702991d20e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:35.915274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-021680f6-625c-4fc1-9425-b9702991d20e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:35.916050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-021680f6-625c-4fc1-9425-b9702991d20e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:35.917663 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-021680f6-625c-4fc1-9425-b9702991d20e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:35.918083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-021680f6-625c-4fc1-9425-b9702991d20e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:35.932771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:35.961238 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-021680f6-625c-4fc1-9425-b9702991d20e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] HTTP exception thrown: Instance dbb46c1c-c94c-4ea9-942e-82187eb83479 could not be found. Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-021680f6-625c-4fc1-9425-b9702991d20e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Request method failure captured: Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 HTTP/1.1 Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iLQMBYbEYGBiukl8Grc4cgaoip9vYqgvFfgfnpbnlZkSYN7JiarysZng6UxxKLxiZ4y65MAFaOeVWWhpAUJdn51lu23bqEafBew5yuwtK0ajOw4Ed5vO75L1W2pM3AbKugULtMYQtHpN1cPlPnjVANDl7kKfG9M-fTj_PMYAHww2dA Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:34:35.964841 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:34:35.966192 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/287b7017444e47b48aa08661b84a3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_287b7017444e47b48aa08661b84a3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:35.966192 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:35.966192 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:35.966192 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:35.966192 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:35.966192 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:34:35.966192 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:34:35.966192 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 678c78e8696f45c1a9d099199fcdcd36 Aug 18 11:34:35.966192 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:35.966192 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:34:35.966192 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance dbb46c1c-c94c-4ea9-942e-82187eb83479 could not be found. Aug 18 11:34:35.966192 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'dbb46c1c-c94c-4ea9-942e-82187eb83479'} Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb46c1c-c94c-4ea9-942e-82187eb83479 could not be found. Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:35.966966 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb46c1c-c94c-4ea9-942e-82187eb83479 could not be found. Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb46c1c-c94c-4ea9-942e-82187eb83479 could not be found. Aug 18 11:34:35.968212 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:35.973310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-021680f6-625c-4fc1-9425-b9702991d20e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Returning 404 to user: Instance dbb46c1c-c94c-4ea9-942e-82187eb83479 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:35.980106 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-021680f6-625c-4fc1-9425-b9702991d20e tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 404 len: 111 microversion: 2.1 time: 0.104305 Aug 18 11:34:35.980986 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1033/2119] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:34:35 2022] DELETE /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:34:35.996573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-218161a3-8882-471f-8500-97638b7932dd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:35.997590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-218161a3-8882-471f-8500-97638b7932dd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] [instance: dbb46c1c-c94c-4ea9-942e-82187eb83479] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:36.010167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218161a3-8882-471f-8500-97638b7932dd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:36.014506 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218161a3-8882-471f-8500-97638b7932dd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:36.023018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218161a3-8882-471f-8500-97638b7932dd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:36.026218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218161a3-8882-471f-8500-97638b7932dd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:36.026978 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218161a3-8882-471f-8500-97638b7932dd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:36.027575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218161a3-8882-471f-8500-97638b7932dd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:36.050327 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-218161a3-8882-471f-8500-97638b7932dd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] HTTP exception thrown: Instance dbb46c1c-c94c-4ea9-942e-82187eb83479 could not be found. Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-218161a3-8882-471f-8500-97638b7932dd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Request method failure captured: Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 HTTP/1.1 Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iLQMBYbEYGBiukl8Grc4cgaoip9vYqgvFfgfnpbnlZkSYN7JiarysZng6UxxKLxiZ4y65MAFaOeVWWhpAUJdn51lu23bqEafBew5yuwtK0ajOw4Ed5vO75L1W2pM3AbKugULtMYQtHpN1cPlPnjVANDl7kKfG9M-fTj_PMYAHww2dA Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:34:36.061752 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:34:36.063236 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/287b7017444e47b48aa08661b84a3798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_287b7017444e47b48aa08661b84a3798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/287b7017444e47b48aa08661b84a3798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:36.063236 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:36.063236 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 287b7017444e47b48aa08661b84a3798 Aug 18 11:34:36.063236 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesTestJSON-1207307748 Aug 18 11:34:36.063236 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:36.063236 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:34:36.063236 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:34:36.063236 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 678c78e8696f45c1a9d099199fcdcd36 Aug 18 11:34:36.063236 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesTestJSON-1207307748-project Aug 18 11:34:36.063236 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:34:36.063236 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance dbb46c1c-c94c-4ea9-942e-82187eb83479 could not be found. Aug 18 11:34:36.063236 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'dbb46c1c-c94c-4ea9-942e-82187eb83479'} Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb46c1c-c94c-4ea9-942e-82187eb83479 could not be found. Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:36.064090 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb46c1c-c94c-4ea9-942e-82187eb83479 could not be found. Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb46c1c-c94c-4ea9-942e-82187eb83479 could not be found. Aug 18 11:34:36.065195 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:36.066273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-218161a3-8882-471f-8500-97638b7932dd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] Returning 404 to user: Instance dbb46c1c-c94c-4ea9-942e-82187eb83479 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:36.066273 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-218161a3-8882-471f-8500-97638b7932dd tempest-ImagesTestJSON-1207307748 tempest-ImagesTestJSON-1207307748-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479" status: 404 len: 111 microversion: 2.1 time: 0.077050 Aug 18 11:34:36.066273 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1034/2120] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:35 2022] GET /compute/v2.1/servers/dbb46c1c-c94c-4ea9-942e-82187eb83479 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:34:36.079575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-553876b7-f7aa-4ff8-8c98-35c76203c7e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:36.083365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-553876b7-f7aa-4ff8-8c98-35c76203c7e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:36.110694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-553876b7-f7aa-4ff8-8c98-35c76203c7e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:36.113839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-553876b7-f7aa-4ff8-8c98-35c76203c7e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:36.114568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-553876b7-f7aa-4ff8-8c98-35c76203c7e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:36.116250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-553876b7-f7aa-4ff8-8c98-35c76203c7e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:36.118359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-553876b7-f7aa-4ff8-8c98-35c76203c7e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:36.120599 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-553876b7-f7aa-4ff8-8c98-35c76203c7e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:36.223803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2edc3e0f-bf27-4e1a-9f75-617c4c38bed2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:36.233351 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2edc3e0f-bf27-4e1a-9f75-617c4c38bed2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1314 microversion: 2.1 time: 0.540054 Aug 18 11:34:36.254232 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1087/2121] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:35 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:36.273217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76b4a8f3-59b8-4ec5-8895-966934c49823 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f9ddee0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:36.366639 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76b4a8f3-59b8-4ec5-8895-966934c49823 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.110071 Aug 18 11:34:36.371800 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1088/2122] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:36 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:36.484929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-553876b7-f7aa-4ff8-8c98-35c76203c7e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:36.502095 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-553876b7-f7aa-4ff8-8c98-35c76203c7e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1183 microversion: 2.1 time: 0.433435 Aug 18 11:34:36.515219 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1035/2123] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:36 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1183 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:36.674486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d334297-c298-49f8-856e-08385135be70 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:36.677049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2d334297-c298-49f8-856e-08385135be70 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:36.711641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0f75b441-7b53-4625-9839-e0559e314cdf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:36.715866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0f75b441-7b53-4625-9839-e0559e314cdf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:36.735800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d334297-c298-49f8-856e-08385135be70 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:36.740520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d334297-c298-49f8-856e-08385135be70 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:36.741846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d334297-c298-49f8-856e-08385135be70 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:36.755341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d334297-c298-49f8-856e-08385135be70 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:36.756187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d334297-c298-49f8-856e-08385135be70 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:36.761902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d334297-c298-49f8-856e-08385135be70 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:36.763716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f75b441-7b53-4625-9839-e0559e314cdf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:36.768820 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f75b441-7b53-4625-9839-e0559e314cdf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:36.769893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f75b441-7b53-4625-9839-e0559e314cdf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:36.772216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f75b441-7b53-4625-9839-e0559e314cdf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:36.774304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f75b441-7b53-4625-9839-e0559e314cdf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:36.776122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f75b441-7b53-4625-9839-e0559e314cdf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:37.082303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2d334297-c298-49f8-856e-08385135be70 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:37.096673 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d334297-c298-49f8-856e-08385135be70 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1281 microversion: 2.1 time: 0.428262 Aug 18 11:34:37.099504 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1089/2124] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:36 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1281 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:37.257321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9a9c173d-2927-4696-898a-02336fee5cf6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:37.258391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9a9c173d-2927-4696-898a-02336fee5cf6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:37.274955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a9c173d-2927-4696-898a-02336fee5cf6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:37.285788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a9c173d-2927-4696-898a-02336fee5cf6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:37.286298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a9c173d-2927-4696-898a-02336fee5cf6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:37.291710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a9c173d-2927-4696-898a-02336fee5cf6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:37.296408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a9c173d-2927-4696-898a-02336fee5cf6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:37.301716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a9c173d-2927-4696-898a-02336fee5cf6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:37.336038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0f75b441-7b53-4625-9839-e0559e314cdf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:37.346477 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0f75b441-7b53-4625-9839-e0559e314cdf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1487 microversion: 2.1 time: 0.645658 Aug 18 11:34:37.353242 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1036/2125] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:36 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1487 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:37.374726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e46591e1-9784-4032-a820-c0b788e4be16 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:37.377637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e46591e1-9784-4032-a820-c0b788e4be16 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:37.395182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e46591e1-9784-4032-a820-c0b788e4be16 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:37.396011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e46591e1-9784-4032-a820-c0b788e4be16 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:37.396721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e46591e1-9784-4032-a820-c0b788e4be16 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:37.397692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e46591e1-9784-4032-a820-c0b788e4be16 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:37.403337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e46591e1-9784-4032-a820-c0b788e4be16 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:37.404165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e46591e1-9784-4032-a820-c0b788e4be16 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:37.488568 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e46591e1-9784-4032-a820-c0b788e4be16 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 200 len: 176 microversion: 2.1 time: 0.117557 Aug 18 11:34:37.489661 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1037/2126] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:34:37 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 176 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:34:37.498706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f104a3e8-bcd9-4dda-bfaa-ee8ca9af9988 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f5c6e50>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:37.592241 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f104a3e8-bcd9-4dda-bfaa-ee8ca9af9988 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.100932 Aug 18 11:34:37.597726 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1038/2127] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:37 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:37.609513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-38209e84-a680-4953-b869-12b4df4acbfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:37.611621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-38209e84-a680-4953-b869-12b4df4acbfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:37.628911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38209e84-a680-4953-b869-12b4df4acbfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:37.629735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38209e84-a680-4953-b869-12b4df4acbfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:37.630451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38209e84-a680-4953-b869-12b4df4acbfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:37.634029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38209e84-a680-4953-b869-12b4df4acbfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:37.635727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38209e84-a680-4953-b869-12b4df4acbfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:37.640241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38209e84-a680-4953-b869-12b4df4acbfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:38.065370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9a9c173d-2927-4696-898a-02336fee5cf6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:38.079064 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9a9c173d-2927-4696-898a-02336fee5cf6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1314 microversion: 2.1 time: 0.825932 Aug 18 11:34:38.097963 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1090/2128] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:37 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1314 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:38.100590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e405ebee-21fa-4fd0-bfe0-f8e25ddb4a8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:38.101252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e405ebee-21fa-4fd0-bfe0-f8e25ddb4a8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:38.121276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e405ebee-21fa-4fd0-bfe0-f8e25ddb4a8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:38.123528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e405ebee-21fa-4fd0-bfe0-f8e25ddb4a8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:38.125692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e405ebee-21fa-4fd0-bfe0-f8e25ddb4a8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:38.127094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e405ebee-21fa-4fd0-bfe0-f8e25ddb4a8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:38.128925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e405ebee-21fa-4fd0-bfe0-f8e25ddb4a8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:38.130850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e405ebee-21fa-4fd0-bfe0-f8e25ddb4a8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:38.190615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-38209e84-a680-4953-b869-12b4df4acbfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:38.208867 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-38209e84-a680-4953-b869-12b4df4acbfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.609752 Aug 18 11:34:38.213440 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1039/2129] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:37 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:38.240900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-964cb6c7-8dcf-4e42-80ce-8e309248b0eb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:38.248508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-964cb6c7-8dcf-4e42-80ce-8e309248b0eb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:38.265376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-964cb6c7-8dcf-4e42-80ce-8e309248b0eb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:38.266159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-964cb6c7-8dcf-4e42-80ce-8e309248b0eb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:38.266963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-964cb6c7-8dcf-4e42-80ce-8e309248b0eb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:38.267931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-964cb6c7-8dcf-4e42-80ce-8e309248b0eb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:38.268605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-964cb6c7-8dcf-4e42-80ce-8e309248b0eb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:38.269256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-964cb6c7-8dcf-4e42-80ce-8e309248b0eb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:38.370049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e405ebee-21fa-4fd0-bfe0-f8e25ddb4a8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:38.385462 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e405ebee-21fa-4fd0-bfe0-f8e25ddb4a8c tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1183 microversion: 2.1 time: 0.299418 Aug 18 11:34:38.386820 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1091/2130] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:38 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:38.401138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6408067e-875b-4863-9f78-0d2d5c7e083f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:38.404728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6408067e-875b-4863-9f78-0d2d5c7e083f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:38.423896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6408067e-875b-4863-9f78-0d2d5c7e083f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:38.424760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6408067e-875b-4863-9f78-0d2d5c7e083f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:38.427486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6408067e-875b-4863-9f78-0d2d5c7e083f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:38.430805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6408067e-875b-4863-9f78-0d2d5c7e083f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:38.433993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6408067e-875b-4863-9f78-0d2d5c7e083f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:38.435734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6408067e-875b-4863-9f78-0d2d5c7e083f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:38.791030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6408067e-875b-4863-9f78-0d2d5c7e083f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:38.805706 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6408067e-875b-4863-9f78-0d2d5c7e083f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.416801 Aug 18 11:34:38.806442 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1092/2131] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:38 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:38.830968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-73916f59-d598-4f00-add3-4ad999462e98 req-1e6ca4fc-f601-49eb-8715-222f14c5c9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ad9e5e-ca95-4e76-9823-3d357ca17f37", "name": "network-vif-plugged", "status": "completed", "tag": "bb50eb05-55f9-44f6-93f6-81a14dd7c19b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:38.871128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-73916f59-d598-4f00-add3-4ad999462e98 req-1e6ca4fc-f601-49eb-8715-222f14c5c9c7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:38.882325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-964cb6c7-8dcf-4e42-80ce-8e309248b0eb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:38.887352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-73916f59-d598-4f00-add3-4ad999462e98 req-1e6ca4fc-f601-49eb-8715-222f14c5c9c7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:38.887818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-73916f59-d598-4f00-add3-4ad999462e98 req-1e6ca4fc-f601-49eb-8715-222f14c5c9c7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:38.918068 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-964cb6c7-8dcf-4e42-80ce-8e309248b0eb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1323 microversion: 2.1 time: 0.669639 Aug 18 11:34:38.921935 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1040/2132] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:38 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1323 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:38.939091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-95647dca-8457-4ed7-a460-498296372d12 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f62db80>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:38.979690 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-73916f59-d598-4f00-add3-4ad999462e98 req-1e6ca4fc-f601-49eb-8715-222f14c5c9c7 service nova] Creating event network-vif-plugged:bb50eb05-55f9-44f6-93f6-81a14dd7c19b for instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 on n-h2-853611-3 Aug 18 11:34:38.990622 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-73916f59-d598-4f00-add3-4ad999462e98 req-1e6ca4fc-f601-49eb-8715-222f14c5c9c7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180216 Aug 18 11:34:38.993277 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1093/2133] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:39.029638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-120e4f42-e92e-4ad5-9628-4f0d4d180caa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:39.032172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-120e4f42-e92e-4ad5-9628-4f0d4d180caa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:39.040628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-120e4f42-e92e-4ad5-9628-4f0d4d180caa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:39.042096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-120e4f42-e92e-4ad5-9628-4f0d4d180caa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:39.043542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-120e4f42-e92e-4ad5-9628-4f0d4d180caa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:39.044673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-120e4f42-e92e-4ad5-9628-4f0d4d180caa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:39.045329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-120e4f42-e92e-4ad5-9628-4f0d4d180caa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:39.045927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-120e4f42-e92e-4ad5-9628-4f0d4d180caa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:39.070960 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-95647dca-8457-4ed7-a460-498296372d12 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.147528 Aug 18 11:34:39.080009 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1041/2134] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:38 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:39.106750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-85d739c5-71ea-4815-9e6c-ace04d97748e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:39.107380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-85d739c5-71ea-4815-9e6c-ace04d97748e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:39.125585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85d739c5-71ea-4815-9e6c-ace04d97748e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:39.126089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85d739c5-71ea-4815-9e6c-ace04d97748e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:39.126566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85d739c5-71ea-4815-9e6c-ace04d97748e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:39.127299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85d739c5-71ea-4815-9e6c-ace04d97748e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:39.127761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85d739c5-71ea-4815-9e6c-ace04d97748e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:39.128196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85d739c5-71ea-4815-9e6c-ace04d97748e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:39.448882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-85d739c5-71ea-4815-9e6c-ace04d97748e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:39.459282 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-85d739c5-71ea-4815-9e6c-ace04d97748e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1314 microversion: 2.1 time: 0.357421 Aug 18 11:34:39.463650 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1042/2135] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:39 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:39.479077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4dae7bca-5b02-4027-8d7f-d8644998bff1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:39.480155 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4dae7bca-5b02-4027-8d7f-d8644998bff1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:39.500328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dae7bca-5b02-4027-8d7f-d8644998bff1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:39.502802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dae7bca-5b02-4027-8d7f-d8644998bff1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:39.505866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dae7bca-5b02-4027-8d7f-d8644998bff1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:39.507300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dae7bca-5b02-4027-8d7f-d8644998bff1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:39.512159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dae7bca-5b02-4027-8d7f-d8644998bff1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:39.514103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dae7bca-5b02-4027-8d7f-d8644998bff1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:39.558729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dae7bca-5b02-4027-8d7f-d8644998bff1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:39.559588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dae7bca-5b02-4027-8d7f-d8644998bff1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:39.560448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dae7bca-5b02-4027-8d7f-d8644998bff1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:39.561591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-4dae7bca-5b02-4027-8d7f-d8644998bff1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lazy-loading 'fault' on Instance uuid 2979b2d3-3055-479e-ad21-b8aac94ee848 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:34:39.750233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4dae7bca-5b02-4027-8d7f-d8644998bff1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:39.763374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-120e4f42-e92e-4ad5-9628-4f0d4d180caa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:39.778772 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4dae7bca-5b02-4027-8d7f-d8644998bff1 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 200 len: 1188 microversion: 2.1 time: 0.313069 Aug 18 11:34:39.799782 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1043/2136] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:39 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 1188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:39.799999 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-120e4f42-e92e-4ad5-9628-4f0d4d180caa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.785019 Aug 18 11:34:39.800779 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1094/2137] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:38 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:39.820268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c963d96c-4739-424f-ac38-2d80699108a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:39.826799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c963d96c-4739-424f-ac38-2d80699108a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:39.834847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:39.842251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c963d96c-4739-424f-ac38-2d80699108a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:39.845479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c963d96c-4739-424f-ac38-2d80699108a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:39.846303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c963d96c-4739-424f-ac38-2d80699108a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:39.847391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c963d96c-4739-424f-ac38-2d80699108a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:39.848137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c963d96c-4739-424f-ac38-2d80699108a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:39.848801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c963d96c-4739-424f-ac38-2d80699108a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:39.956679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-725b42b0-53ad-45be-aa9b-5caf5da23e95 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:39.958098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-725b42b0-53ad-45be-aa9b-5caf5da23e95 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:39.969433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-725b42b0-53ad-45be-aa9b-5caf5da23e95 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:39.974012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-725b42b0-53ad-45be-aa9b-5caf5da23e95 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:39.974650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-725b42b0-53ad-45be-aa9b-5caf5da23e95 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:39.979157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-725b42b0-53ad-45be-aa9b-5caf5da23e95 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:39.983322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-725b42b0-53ad-45be-aa9b-5caf5da23e95 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:39.987537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-725b42b0-53ad-45be-aa9b-5caf5da23e95 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:40.495599 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c963d96c-4739-424f-ac38-2d80699108a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:40.504024 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c963d96c-4739-424f-ac38-2d80699108a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.691080 Aug 18 11:34:40.520077 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1044/2138] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:39 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:40.531429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c918d056-29a9-4aab-944c-b3a5e7b465b7 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f39fb80>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:40.593421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-725b42b0-53ad-45be-aa9b-5caf5da23e95 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:40.605230 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-725b42b0-53ad-45be-aa9b-5caf5da23e95 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1323 microversion: 2.1 time: 0.667331 Aug 18 11:34:40.605983 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1095/2139] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:39 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1323 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:34:40.641098 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c918d056-29a9-4aab-944c-b3a5e7b465b7 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.116964 Aug 18 11:34:40.642091 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1045/2140] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:40 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:40.645533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3cb74171-9f77-4875-9c79-138def8ed889 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:40.646154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3cb74171-9f77-4875-9c79-138def8ed889 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:40.684249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cb74171-9f77-4875-9c79-138def8ed889 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:40.684730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cb74171-9f77-4875-9c79-138def8ed889 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:40.685142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cb74171-9f77-4875-9c79-138def8ed889 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:40.685866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cb74171-9f77-4875-9c79-138def8ed889 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:40.686351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cb74171-9f77-4875-9c79-138def8ed889 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:40.703044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cb74171-9f77-4875-9c79-138def8ed889 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:40.808764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-efa27967-2ad1-4e98-81d3-396d1680fb48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:40.809569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-efa27967-2ad1-4e98-81d3-396d1680fb48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 2979b2d3-3055-479e-ad21-b8aac94ee848] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:40.846712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-efa27967-2ad1-4e98-81d3-396d1680fb48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:40.847511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-efa27967-2ad1-4e98-81d3-396d1680fb48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:40.852517 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-efa27967-2ad1-4e98-81d3-396d1680fb48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:40.856264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-efa27967-2ad1-4e98-81d3-396d1680fb48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:40.858527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-efa27967-2ad1-4e98-81d3-396d1680fb48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:40.860120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-efa27967-2ad1-4e98-81d3-396d1680fb48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:40.900912 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-efa27967-2ad1-4e98-81d3-396d1680fb48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] HTTP exception thrown: Instance 2979b2d3-3055-479e-ad21-b8aac94ee848 could not be found. Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-efa27967-2ad1-4e98-81d3-396d1680fb48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Request method failure captured: Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 HTTP/1.1 Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iIZ73k_YPF_W2EIMMri9FswITgky3Trv8mszMC_q7DqKHRQdz1obOf92XsfI5eHcOKQ4Taq-4WecACwzcaZUhv56AdpPX-KscZp_JKFwtxRcvZ5iK0fyDGxpMgEaIqG5cDWy9Nd7bp6IxhUSg7zZ_33iKe3ZgVsB8DA6NyW9vAbKfs Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 22660df6ec1a4f718a08cbeda2be364c Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-LiveMigrationTest-290401536 Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:34:40.903075 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:34:40.904289 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:40.904289 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-LiveMigrationTest-290401536 Aug 18 11:34:40.904289 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 22660df6ec1a4f718a08cbeda2be364c Aug 18 11:34:40.904289 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-LiveMigrationTest-290401536 Aug 18 11:34:40.904289 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-LiveMigrationTest-290401536-project Aug 18 11:34:40.904289 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:34:40.904289 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:34:40.904289 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 0cf7fe4236764bea83c6560516441759 Aug 18 11:34:40.904289 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-LiveMigrationTest-290401536-project Aug 18 11:34:40.904289 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:34:40.904289 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 2979b2d3-3055-479e-ad21-b8aac94ee848 could not be found. Aug 18 11:34:40.904289 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '2979b2d3-3055-479e-ad21-b8aac94ee848'} Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2979b2d3-3055-479e-ad21-b8aac94ee848 could not be found. Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:40.905028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2979b2d3-3055-479e-ad21-b8aac94ee848 could not be found. Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2979b2d3-3055-479e-ad21-b8aac94ee848 could not be found. Aug 18 11:34:40.906083 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:34:40.914010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-efa27967-2ad1-4e98-81d3-396d1680fb48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Returning 404 to user: Instance 2979b2d3-3055-479e-ad21-b8aac94ee848 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:40.915447 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-efa27967-2ad1-4e98-81d3-396d1680fb48 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848" status: 404 len: 111 microversion: 2.1 time: 0.111844 Aug 18 11:34:40.927942 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1046/2141] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:40 2022] GET /compute/v2.1/servers/2979b2d3-3055-479e-ad21-b8aac94ee848 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:34:40.941919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1133664893", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "2420cd87-a1af-4a7a-8baa-ea2c21853a49"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:41.076481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3cb74171-9f77-4875-9c79-138def8ed889 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:41.092879 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3cb74171-9f77-4875-9c79-138def8ed889 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1314 microversion: 2.1 time: 0.460346 Aug 18 11:34:41.108081 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1096/2142] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:40 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:41.138591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] validate_networks() for [('2420cd87-a1af-4a7a-8baa-ea2c21853a49', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:34:41.231831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:41.336733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=12 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:41.626240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b23557e0-09fd-4d3b-97e5-9c8a29184b19 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:41.627291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b23557e0-09fd-4d3b-97e5-9c8a29184b19 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:41.639873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b23557e0-09fd-4d3b-97e5-9c8a29184b19 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:41.640527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b23557e0-09fd-4d3b-97e5-9c8a29184b19 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:41.644033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b23557e0-09fd-4d3b-97e5-9c8a29184b19 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:41.645096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b23557e0-09fd-4d3b-97e5-9c8a29184b19 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:41.645828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b23557e0-09fd-4d3b-97e5-9c8a29184b19 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:41.648360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b23557e0-09fd-4d3b-97e5-9c8a29184b19 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:42.040357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:42.329465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b23557e0-09fd-4d3b-97e5-9c8a29184b19 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:42.359453 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b23557e0-09fd-4d3b-97e5-9c8a29184b19 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1323 microversion: 2.1 time: 0.737703 Aug 18 11:34:42.364483 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1097/2143] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:41 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1323 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:42.378510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5c11c75f-c990-4da5-a07e-095dd3f4a93b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f51b0d8fe50>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:42.509589 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5c11c75f-c990-4da5-a07e-095dd3f4a93b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.143679 Aug 18 11:34:42.510762 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1098/2144] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:42 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:42.528187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de61d80f-91f6-4d65-bc5a-8757c85e7d41 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:42.531933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-de61d80f-91f6-4d65-bc5a-8757c85e7d41 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:42.554523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de61d80f-91f6-4d65-bc5a-8757c85e7d41 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:42.556210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de61d80f-91f6-4d65-bc5a-8757c85e7d41 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:42.572647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de61d80f-91f6-4d65-bc5a-8757c85e7d41 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:42.573975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de61d80f-91f6-4d65-bc5a-8757c85e7d41 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:42.574708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de61d80f-91f6-4d65-bc5a-8757c85e7d41 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:42.575395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de61d80f-91f6-4d65-bc5a-8757c85e7d41 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:43.100515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-de61d80f-91f6-4d65-bc5a-8757c85e7d41 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:43.110901 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de61d80f-91f6-4d65-bc5a-8757c85e7d41 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1501 microversion: 2.1 time: 0.590955 Aug 18 11:34:43.117077 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1099/2145] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:42 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1501 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:43.142457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7dae4470-b4af-4672-9e9b-8f9cbadc1111 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:43.144568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dae4470-b4af-4672-9e9b-8f9cbadc1111 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:43.166688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dae4470-b4af-4672-9e9b-8f9cbadc1111 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:43.167236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dae4470-b4af-4672-9e9b-8f9cbadc1111 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:43.167709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dae4470-b4af-4672-9e9b-8f9cbadc1111 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:43.168480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dae4470-b4af-4672-9e9b-8f9cbadc1111 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:43.176083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dae4470-b4af-4672-9e9b-8f9cbadc1111 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:43.176553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dae4470-b4af-4672-9e9b-8f9cbadc1111 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:43.287652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-7dae4470-b4af-4672-9e9b-8f9cbadc1111 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lazy-loading 'flavor' on Instance uuid 23ad9e5e-ca95-4e76-9823-3d357ca17f37 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:34:43.946651 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7dae4470-b4af-4672-9e9b-8f9cbadc1111 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "POST /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37/action" status: 202 len: 0 microversion: 2.1 time: 0.807953 Aug 18 11:34:43.947902 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1100/2146] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:34:43 2022] POST /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37/action => generated 0 bytes in 810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:34:43.958846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c8bef780-1eac-4c4a-bcd4-daeb1f5fb028 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:43.961419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c8bef780-1eac-4c4a-bcd4-daeb1f5fb028 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:43.980671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8bef780-1eac-4c4a-bcd4-daeb1f5fb028 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:43.982981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8bef780-1eac-4c4a-bcd4-daeb1f5fb028 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:43.985322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8bef780-1eac-4c4a-bcd4-daeb1f5fb028 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:43.986665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8bef780-1eac-4c4a-bcd4-daeb1f5fb028 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:43.987330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8bef780-1eac-4c4a-bcd4-daeb1f5fb028 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:43.987769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8bef780-1eac-4c4a-bcd4-daeb1f5fb028 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:44.005674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:44.593723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c8bef780-1eac-4c4a-bcd4-daeb1f5fb028 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:44.602633 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c8bef780-1eac-4c4a-bcd4-daeb1f5fb028 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1323 microversion: 2.1 time: 0.653312 Aug 18 11:34:44.615008 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1101/2147] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:43 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1323 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:44.630833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3e73f642-ac02-435b-991d-9ff048aeb8c0 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f51b0ddf1f0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:44.775871 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3e73f642-ac02-435b-991d-9ff048aeb8c0 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.158207 Aug 18 11:34:44.779782 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1102/2148] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:44 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:44.805650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d7a2a5da-8822-4e4e-a4ba-ccc9e0635f90 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:44.810311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d7a2a5da-8822-4e4e-a4ba-ccc9e0635f90 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:44.837436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7a2a5da-8822-4e4e-a4ba-ccc9e0635f90 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:44.838096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7a2a5da-8822-4e4e-a4ba-ccc9e0635f90 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:44.839706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7a2a5da-8822-4e4e-a4ba-ccc9e0635f90 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:44.844153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7a2a5da-8822-4e4e-a4ba-ccc9e0635f90 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:44.845233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7a2a5da-8822-4e4e-a4ba-ccc9e0635f90 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:44.846284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7a2a5da-8822-4e4e-a4ba-ccc9e0635f90 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:44.852084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:34:44.853395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:34:44.854069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:34:44.854672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:34:44.855319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:34:44.888587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:44.889090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:44.889537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:44.899162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:44.901161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:44.901634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:44.988104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Getting quotas for project c1a985dc6f824e5b847a2d966c0f79af. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:34:45.016485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Getting quotas for user 0cd8451c50d941409a66864cbc1c7201 and project c1a985dc6f824e5b847a2d966c0f79af. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:34:45.066849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:34:45.079017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:34:45.245330 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e6a42c9b-e980-4cf0-bb51-92891d8bbea7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.313821 Aug 18 11:34:45.246286 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1047/2149] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:34:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 4318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:34:45.263435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-d58c1596-c377-4175-b996-c86c250b88d1 req-6aad8159-1d1a-459c-a88c-a3cd4913903d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1582eb-3994-4092-a342-4c88340004c3", "tag": "a50a09ef-ed01-44ae-96dc-b34d0e3ea646"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:45.279390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d58c1596-c377-4175-b996-c86c250b88d1 req-6aad8159-1d1a-459c-a88c-a3cd4913903d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:45.280137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d58c1596-c377-4175-b996-c86c250b88d1 req-6aad8159-1d1a-459c-a88c-a3cd4913903d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:45.280729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d58c1596-c377-4175-b996-c86c250b88d1 req-6aad8159-1d1a-459c-a88c-a3cd4913903d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:45.312472 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-d58c1596-c377-4175-b996-c86c250b88d1 req-6aad8159-1d1a-459c-a88c-a3cd4913903d service nova] Creating event network-changed:a50a09ef-ed01-44ae-96dc-b34d0e3ea646 for instance 2e1582eb-3994-4092-a342-4c88340004c3 on n-h2-853611-3 Aug 18 11:34:45.345920 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-d58c1596-c377-4175-b996-c86c250b88d1 req-6aad8159-1d1a-459c-a88c-a3cd4913903d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095783 Aug 18 11:34:45.349777 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1048/2150] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:45.363892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4ff949de-ff9b-4eab-ab28-c1c349cbdebb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:45.368395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4ff949de-ff9b-4eab-ab28-c1c349cbdebb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:45.508200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4ff949de-ff9b-4eab-ab28-c1c349cbdebb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:45.516448 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4ff949de-ff9b-4eab-ab28-c1c349cbdebb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1215 microversion: 2.1 time: 0.163899 Aug 18 11:34:45.531340 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1049/2151] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:45 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:45.628745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f3a6a26c-b7f9-4334-b183-35f9f3896af4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:45.629740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f3a6a26c-b7f9-4334-b183-35f9f3896af4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:45.661201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d7a2a5da-8822-4e4e-a4ba-ccc9e0635f90 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:45.687863 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d7a2a5da-8822-4e4e-a4ba-ccc9e0635f90 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 0.893812 Aug 18 11:34:45.695209 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1103/2152] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:44 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:45.696285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3a6a26c-b7f9-4334-b183-35f9f3896af4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:45.703456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3a6a26c-b7f9-4334-b183-35f9f3896af4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:45.704540 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3a6a26c-b7f9-4334-b183-35f9f3896af4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:45.706248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3a6a26c-b7f9-4334-b183-35f9f3896af4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:45.714393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3a6a26c-b7f9-4334-b183-35f9f3896af4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:45.724772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3a6a26c-b7f9-4334-b183-35f9f3896af4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:45.793932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-82794ac1-7cba-4f5f-88b6-8cf951276c93 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f51b0ddf160>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:45.916651 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-82794ac1-7cba-4f5f-88b6-8cf951276c93 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.127057 Aug 18 11:34:45.917567 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1104/2153] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:45 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:46.545391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dae7aa61-f97f-4807-9558-1706da2a0be2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:46.546682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dae7aa61-f97f-4807-9558-1706da2a0be2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:46.902529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dae7aa61-f97f-4807-9558-1706da2a0be2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:46.944641 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dae7aa61-f97f-4807-9558-1706da2a0be2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1215 microversion: 2.1 time: 0.394955 Aug 18 11:34:46.946580 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1105/2154] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:46 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1215 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:46.986011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f1a715c5-04b5-4478-b98e-879495ef5fdb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:46.989356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f1a715c5-04b5-4478-b98e-879495ef5fdb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:47.034191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1a715c5-04b5-4478-b98e-879495ef5fdb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:47.040718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1a715c5-04b5-4478-b98e-879495ef5fdb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:47.044008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1a715c5-04b5-4478-b98e-879495ef5fdb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:47.044811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1a715c5-04b5-4478-b98e-879495ef5fdb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:47.072496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1a715c5-04b5-4478-b98e-879495ef5fdb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:47.073239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1a715c5-04b5-4478-b98e-879495ef5fdb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:47.509573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f3a6a26c-b7f9-4334-b183-35f9f3896af4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:47.526844 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f3a6a26c-b7f9-4334-b183-35f9f3896af4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1323 microversion: 2.1 time: 1.897390 Aug 18 11:34:47.539593 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1050/2155] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:45 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1323 bytes in 1906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:34:47.552883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8d3cf109-20c1-413e-a31c-8d58a5ecd749 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f5c6820>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:47.601615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f1a715c5-04b5-4478-b98e-879495ef5fdb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:47.619369 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f1a715c5-04b5-4478-b98e-879495ef5fdb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 0.668193 Aug 18 11:34:47.623439 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1106/2156] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:46 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:47.768690 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8d3cf109-20c1-413e-a31c-8d58a5ecd749 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.227118 Aug 18 11:34:47.775426 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1051/2157] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:47 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:47.969914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8f417ba4-edea-47e4-a50e-efe4e22296bf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:47.970586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8f417ba4-edea-47e4-a50e-efe4e22296bf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:47.989781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f417ba4-edea-47e4-a50e-efe4e22296bf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:47.990285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f417ba4-edea-47e4-a50e-efe4e22296bf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:47.999018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f417ba4-edea-47e4-a50e-efe4e22296bf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:47.999858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f417ba4-edea-47e4-a50e-efe4e22296bf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:48.000355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f417ba4-edea-47e4-a50e-efe4e22296bf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:48.000831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f417ba4-edea-47e4-a50e-efe4e22296bf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:48.037811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-358175b5-5894-49fd-b5ce-9e0d7e4947f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:48.038318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-358175b5-5894-49fd-b5ce-9e0d7e4947f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:48.076356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-358175b5-5894-49fd-b5ce-9e0d7e4947f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:48.077422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-358175b5-5894-49fd-b5ce-9e0d7e4947f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:48.086529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-358175b5-5894-49fd-b5ce-9e0d7e4947f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:48.086529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-358175b5-5894-49fd-b5ce-9e0d7e4947f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:48.086529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-358175b5-5894-49fd-b5ce-9e0d7e4947f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:48.093481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-358175b5-5894-49fd-b5ce-9e0d7e4947f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:48.268918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-358175b5-5894-49fd-b5ce-9e0d7e4947f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:34:48.358658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8f417ba4-edea-47e4-a50e-efe4e22296bf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:48.373756 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8f417ba4-edea-47e4-a50e-efe4e22296bf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1275 microversion: 2.1 time: 0.407770 Aug 18 11:34:48.379388 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1107/2158] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:47 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1275 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:48.552860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e8ae4de-8f83-455b-9de4-8964eae929fe tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:48.554928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9e8ae4de-8f83-455b-9de4-8964eae929fe tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:48.588341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e8ae4de-8f83-455b-9de4-8964eae929fe tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:48.589380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e8ae4de-8f83-455b-9de4-8964eae929fe tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:48.590028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e8ae4de-8f83-455b-9de4-8964eae929fe tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:48.590924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e8ae4de-8f83-455b-9de4-8964eae929fe tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:48.593432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e8ae4de-8f83-455b-9de4-8964eae929fe tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:48.601687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e8ae4de-8f83-455b-9de4-8964eae929fe tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:48.676195 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-358175b5-5894-49fd-b5ce-9e0d7e4947f1 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "DELETE /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 204 len: 0 microversion: 2.25 time: 0.642664 Aug 18 11:34:48.676991 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1052/2159] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:34:48 2022] DELETE /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:34:48.690331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8b8c195a-c7cd-48f6-a349-920a595e8d74 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:48.709948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8b8c195a-c7cd-48f6-a349-920a595e8d74 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:48.737112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b8c195a-c7cd-48f6-a349-920a595e8d74 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:48.747169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b8c195a-c7cd-48f6-a349-920a595e8d74 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:48.750059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b8c195a-c7cd-48f6-a349-920a595e8d74 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:48.751913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b8c195a-c7cd-48f6-a349-920a595e8d74 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:48.752537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b8c195a-c7cd-48f6-a349-920a595e8d74 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:48.757697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b8c195a-c7cd-48f6-a349-920a595e8d74 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:49.214834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8b8c195a-c7cd-48f6-a349-920a595e8d74 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:49.246827 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8b8c195a-c7cd-48f6-a349-920a595e8d74 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 0.560729 Aug 18 11:34:49.255913 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1053/2160] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:48 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:49.282758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aec67c7c-0974-4187-a1ca-dbfe400223de tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:49.289989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-aec67c7c-0974-4187-a1ca-dbfe400223de tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:49.310721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aec67c7c-0974-4187-a1ca-dbfe400223de tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:49.325318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aec67c7c-0974-4187-a1ca-dbfe400223de tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:49.326249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aec67c7c-0974-4187-a1ca-dbfe400223de tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:49.343481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aec67c7c-0974-4187-a1ca-dbfe400223de tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:49.344176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aec67c7c-0974-4187-a1ca-dbfe400223de tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:49.345310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aec67c7c-0974-4187-a1ca-dbfe400223de tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:50.330543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9e8ae4de-8f83-455b-9de4-8964eae929fe tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:50.339647 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9e8ae4de-8f83-455b-9de4-8964eae929fe tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1323 microversion: 2.1 time: 1.790993 Aug 18 11:34:50.344072 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1108/2161] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:48 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1323 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:34:50.349203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76027e82-b8fc-439e-a154-ed720f02fc78 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f51b0d6a4c0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:50.539733 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76027e82-b8fc-439e-a154-ed720f02fc78 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.194264 Aug 18 11:34:50.541041 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1109/2162] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:50 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:51.024084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5e79253f-af4d-4490-abbf-74cbffb541fb tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Action: 'create', calling method: .version_select at 0x7f519f583f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-478383411", "description": "tempest-description-2070445717"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:51.867740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aec67c7c-0974-4187-a1ca-dbfe400223de tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:51.888614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aec67c7c-0974-4187-a1ca-dbfe400223de tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:51.899570 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aec67c7c-0974-4187-a1ca-dbfe400223de tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:51.905852 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aec67c7c-0974-4187-a1ca-dbfe400223de tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1730 microversion: 2.25 time: 2.647804 Aug 18 11:34:51.919627 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1054/2163] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:49 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1730 bytes in 2655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:51.928511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0897c08a-c20c-456e-a683-cbdf3285e77e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:51.934418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0897c08a-c20c-456e-a683-cbdf3285e77e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:51.940937 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5e79253f-af4d-4490-abbf-74cbffb541fb tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.398607 Aug 18 11:34:51.941555 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1110/2164] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:34:50 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:51.950002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eb1a96c8-fd41-4384-b0e1-18f7ab4bb215 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:51.950946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eb1a96c8-fd41-4384-b0e1-18f7ab4bb215 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:51.965542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897c08a-c20c-456e-a683-cbdf3285e77e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:51.966258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897c08a-c20c-456e-a683-cbdf3285e77e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:51.970740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897c08a-c20c-456e-a683-cbdf3285e77e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:51.971587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897c08a-c20c-456e-a683-cbdf3285e77e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:51.977151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb1a96c8-fd41-4384-b0e1-18f7ab4bb215 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:51.978421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb1a96c8-fd41-4384-b0e1-18f7ab4bb215 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:51.981018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897c08a-c20c-456e-a683-cbdf3285e77e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:51.981582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897c08a-c20c-456e-a683-cbdf3285e77e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:51.981850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb1a96c8-fd41-4384-b0e1-18f7ab4bb215 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:51.984360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb1a96c8-fd41-4384-b0e1-18f7ab4bb215 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:51.985010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb1a96c8-fd41-4384-b0e1-18f7ab4bb215 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:51.986880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb1a96c8-fd41-4384-b0e1-18f7ab4bb215 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:52.448589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0897c08a-c20c-456e-a683-cbdf3285e77e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:52.468279 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0897c08a-c20c-456e-a683-cbdf3285e77e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1273 microversion: 2.1 time: 0.554331 Aug 18 11:34:52.471370 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1055/2165] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:51 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1273 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:52.540763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c28af574-02cc-4c31-b6ed-af854ecb0862 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:52.543682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c28af574-02cc-4c31-b6ed-af854ecb0862 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:52.593826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c28af574-02cc-4c31-b6ed-af854ecb0862 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:52.600782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c28af574-02cc-4c31-b6ed-af854ecb0862 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:52.603713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c28af574-02cc-4c31-b6ed-af854ecb0862 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:52.611562 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c28af574-02cc-4c31-b6ed-af854ecb0862 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:52.615598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c28af574-02cc-4c31-b6ed-af854ecb0862 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:52.623691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c28af574-02cc-4c31-b6ed-af854ecb0862 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:52.810300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:53.210291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-eb1a96c8-fd41-4384-b0e1-18f7ab4bb215 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:53.220342 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eb1a96c8-fd41-4384-b0e1-18f7ab4bb215 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 1.277367 Aug 18 11:34:53.227240 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1111/2166] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:51 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:53.232320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fc546f14-448c-440d-b54d-4591cd316153 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f51b0d6a820>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:53.310656 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fc546f14-448c-440d-b54d-4591cd316153 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.082108 Aug 18 11:34:53.311757 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1112/2167] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:53 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:53.329963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a314e1a7-3aa7-44ee-8714-053bfc6d22b4 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Action: 'create', calling method: .version_select at 0x7f519fec7f70>, body: {"security_group_rule": {"parent_group_id": "0f930b4d-9809-4712-9cea-0d425ad4b626", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:53.939532 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a314e1a7-3aa7-44ee-8714-053bfc6d22b4 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.626543 Aug 18 11:34:53.940359 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1113/2168] 10.222.0.73 () {60 vars in 1195 bytes} [Thu Aug 18 11:34:53 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:53.945431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:53.946987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:53.992488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:53.993590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:53.994068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:54.013777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:54.014332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:54.014811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:54.172767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:54.175602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:54.176242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:54.176848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lazy-loading 'fault' on Instance uuid 18b9b772-9949-4239-a522-78ea800d8223 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:34:54.521960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:54.530921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:54.532474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:54.545024 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-65119499-6a49-4aa6-8085-b56a0b6d2061 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 200 len: 1374 microversion: 2.25 time: 0.603426 Aug 18 11:34:54.545635 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1114/2169] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:53 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 1374 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:34:54.583683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-60ce2ce1-5526-44f9-a952-c453a9d1ded4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:54.584760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-60ce2ce1-5526-44f9-a952-c453a9d1ded4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:54.626818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60ce2ce1-5526-44f9-a952-c453a9d1ded4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:54.627321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60ce2ce1-5526-44f9-a952-c453a9d1ded4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:54.627847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60ce2ce1-5526-44f9-a952-c453a9d1ded4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:54.628611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60ce2ce1-5526-44f9-a952-c453a9d1ded4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:54.629146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60ce2ce1-5526-44f9-a952-c453a9d1ded4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:54.629576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60ce2ce1-5526-44f9-a952-c453a9d1ded4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:54.890538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-60ce2ce1-5526-44f9-a952-c453a9d1ded4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:54.900593 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-60ce2ce1-5526-44f9-a952-c453a9d1ded4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1273 microversion: 2.1 time: 0.353851 Aug 18 11:34:54.907184 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1115/2170] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:54 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1273 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:54.923899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-61cd249d-b789-478b-a188-4fd059f2b968 req-d494528d-594c-419d-a553-4923d731dd5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18b9b772-9949-4239-a522-78ea800d8223", "name": "network-vif-deleted", "tag": "1e4bf72d-8bb8-436e-91c5-02acd25d351b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:54.944220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-61cd249d-b789-478b-a188-4fd059f2b968 req-d494528d-594c-419d-a553-4923d731dd5d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:54.945070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-61cd249d-b789-478b-a188-4fd059f2b968 req-d494528d-594c-419d-a553-4923d731dd5d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:54.948364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-61cd249d-b789-478b-a188-4fd059f2b968 req-d494528d-594c-419d-a553-4923d731dd5d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:54.949457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:54.979155 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-61cd249d-b789-478b-a188-4fd059f2b968 req-d494528d-594c-419d-a553-4923d731dd5d service nova] Creating event network-vif-deleted:1e4bf72d-8bb8-436e-91c5-02acd25d351b for instance 18b9b772-9949-4239-a522-78ea800d8223 on n-h2-853611-3 Aug 18 11:34:54.990065 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-61cd249d-b789-478b-a188-4fd059f2b968 req-d494528d-594c-419d-a553-4923d731dd5d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081278 Aug 18 11:34:54.994279 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1116/2171] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:55.002759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d65da33c-45d9-4c27-aa0d-458c084ac219 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Action: 'create', calling method: .version_select at 0x7f51b0dada60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2063265551", "description": "tempest-description-1634637809"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:55.413935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c28af574-02cc-4c31-b6ed-af854ecb0862 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:55.433998 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c28af574-02cc-4c31-b6ed-af854ecb0862 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1323 microversion: 2.1 time: 2.947947 Aug 18 11:34:55.434673 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1056/2172] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:52 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1323 bytes in 2963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:55.471600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d7e5946d-407a-44df-b22e-8768aff18cec tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:55.472237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d7e5946d-407a-44df-b22e-8768aff18cec tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:55.511043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7e5946d-407a-44df-b22e-8768aff18cec tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:55.517866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7e5946d-407a-44df-b22e-8768aff18cec tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:55.525607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7e5946d-407a-44df-b22e-8768aff18cec tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:55.529329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7e5946d-407a-44df-b22e-8768aff18cec tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:55.537939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7e5946d-407a-44df-b22e-8768aff18cec tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:55.540100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7e5946d-407a-44df-b22e-8768aff18cec tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:55.541955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=8 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:56.178442 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d65da33c-45d9-4c27-aa0d-458c084ac219 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.179910 Aug 18 11:34:56.179436 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1117/2173] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:34:54 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:56.184938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-82301b1e-d9b7-440e-aca7-6e1f16e6bff4 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f51b0dfc1f0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:56.233967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d7e5946d-407a-44df-b22e-8768aff18cec tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:56.244747 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d7e5946d-407a-44df-b22e-8768aff18cec tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 0.799394 Aug 18 11:34:56.247522 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1057/2174] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:55 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:56.261595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-8a27c94f-fab7-46ca-a339-342092aecf18 req-be5a7b89-783b-4b71-999d-e5003a320717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1582eb-3994-4092-a342-4c88340004c3", "name": "network-vif-plugged", "status": "completed", "tag": "a50a09ef-ed01-44ae-96dc-b34d0e3ea646"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:56.297058 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-82301b1e-d9b7-440e-aca7-6e1f16e6bff4 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.114362 Aug 18 11:34:56.297673 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1118/2175] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:56 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:56.322229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8a27c94f-fab7-46ca-a339-342092aecf18 req-be5a7b89-783b-4b71-999d-e5003a320717 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:56.322751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8a27c94f-fab7-46ca-a339-342092aecf18 req-be5a7b89-783b-4b71-999d-e5003a320717 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:56.323179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8a27c94f-fab7-46ca-a339-342092aecf18 req-be5a7b89-783b-4b71-999d-e5003a320717 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:56.324897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e774765f-4308-434f-be91-b1961c068e22 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:56.327539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e774765f-4308-434f-be91-b1961c068e22 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 18b9b772-9949-4239-a522-78ea800d8223] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:56.361441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e774765f-4308-434f-be91-b1961c068e22 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:56.361960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e774765f-4308-434f-be91-b1961c068e22 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:56.362460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e774765f-4308-434f-be91-b1961c068e22 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:56.363186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e774765f-4308-434f-be91-b1961c068e22 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:56.363622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e774765f-4308-434f-be91-b1961c068e22 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:56.364050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e774765f-4308-434f-be91-b1961c068e22 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:56.394509 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-8a27c94f-fab7-46ca-a339-342092aecf18 req-be5a7b89-783b-4b71-999d-e5003a320717 service nova] Creating event network-vif-plugged:a50a09ef-ed01-44ae-96dc-b34d0e3ea646 for instance 2e1582eb-3994-4092-a342-4c88340004c3 on n-h2-853611-3 Aug 18 11:34:56.412872 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-8a27c94f-fab7-46ca-a339-342092aecf18 req-be5a7b89-783b-4b71-999d-e5003a320717 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160947 Aug 18 11:34:56.413516 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1058/2176] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:56.432328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-97978d55-c551-4261-8cb2-68750749a4d6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:56.433048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-97978d55-c551-4261-8cb2-68750749a4d6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:56.437057 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-e774765f-4308-434f-be91-b1961c068e22 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] HTTP exception thrown: Instance 18b9b772-9949-4239-a522-78ea800d8223 could not be found. Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e774765f-4308-434f-be91-b1961c068e22 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Request method failure captured: Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 HTTP/1.1 Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iHfonnPQX3UJ8JVfLWKn0-FBTKN1-o3Xum7prCJ2FMsZdZvRcJbTv-8FrUmDTr-Wlg49nWJuhk-bpn_UY-LeVzzNa3m_Kxo5hgM8hOtgGSiqCxiFtvOEgk-Fwkg_0hf4Qntsc1Yrpr_ZAdG8yDS1A0RPRSVo189_-HZVJtp6ztfGbE Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.25 Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 51319140bae948cf873746a482aaf588 Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1161683466 Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:34:56.438786 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:34:56.440324 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51319140bae948cf873746a482aaf588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/51319140bae948cf873746a482aaf588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_51319140bae948cf873746a482aaf588"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51319140bae948cf873746a482aaf588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:34:56.440324 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1161683466 Aug 18 11:34:56.440324 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 51319140bae948cf873746a482aaf588 Aug 18 11:34:56.440324 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1161683466 Aug 18 11:34:56.440324 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-LiveAutoBlockMigrationV225Test-1161683466-project Aug 18 11:34:56.440324 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:34:56.440324 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:34:56.440324 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 36162046d3d84db98ce76b19770f6322 Aug 18 11:34:56.440324 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1161683466-project Aug 18 11:34:56.440324 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:34:56.440324 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 18b9b772-9949-4239-a522-78ea800d8223 could not be found. Aug 18 11:34:56.440324 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '18b9b772-9949-4239-a522-78ea800d8223'} Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18b9b772-9949-4239-a522-78ea800d8223 could not be found. Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:34:56.441177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18b9b772-9949-4239-a522-78ea800d8223 could not be found. Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18b9b772-9949-4239-a522-78ea800d8223 could not be found. Aug 18 11:34:56.442608 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:34:56.447416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e774765f-4308-434f-be91-b1961c068e22 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Returning 404 to user: Instance 18b9b772-9949-4239-a522-78ea800d8223 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:34:56.448306 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e774765f-4308-434f-be91-b1961c068e22 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223" status: 404 len: 111 microversion: 2.25 time: 0.149705 Aug 18 11:34:56.459808 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1119/2177] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:34:56 2022] GET /compute/v2.1/servers/18b9b772-9949-4239-a522-78ea800d8223 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:34:56.469882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97978d55-c551-4261-8cb2-68750749a4d6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:56.470604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97978d55-c551-4261-8cb2-68750749a4d6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:56.471066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97978d55-c551-4261-8cb2-68750749a4d6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:56.471818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97978d55-c551-4261-8cb2-68750749a4d6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:56.472282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97978d55-c551-4261-8cb2-68750749a4d6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:56.472716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97978d55-c551-4261-8cb2-68750749a4d6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:56.476468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cdff06d5-72d0-4420-bcff-5e38339c2549 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:56.480132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cdff06d5-72d0-4420-bcff-5e38339c2549 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:56.499083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdff06d5-72d0-4420-bcff-5e38339c2549 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:56.499584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdff06d5-72d0-4420-bcff-5e38339c2549 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:56.506121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdff06d5-72d0-4420-bcff-5e38339c2549 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:56.507209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdff06d5-72d0-4420-bcff-5e38339c2549 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:56.507662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdff06d5-72d0-4420-bcff-5e38339c2549 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:56.510697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdff06d5-72d0-4420-bcff-5e38339c2549 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:56.614301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cdff06d5-72d0-4420-bcff-5e38339c2549 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:34:56.822821 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cdff06d5-72d0-4420-bcff-5e38339c2549 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 204 len: 0 microversion: 2.1 time: 0.359876 Aug 18 11:34:56.823696 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1120/2178] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:34:56 2022] DELETE /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:34:56.837453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a067e669-7211-452c-aa47-90003a3c7e68 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Action: 'create', calling method: .version_select at 0x7f51b0e085e0>, body: {"security_group_rule": {"parent_group_id": "be38661f-a466-431a-84bf-b8178115fd05", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:56.910036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:34:57.091565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-97978d55-c551-4261-8cb2-68750749a4d6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:57.102414 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-97978d55-c551-4261-8cb2-68750749a4d6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1315 microversion: 2.1 time: 0.681596 Aug 18 11:34:57.106687 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1059/2179] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:56 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:57.133053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d18eba99-1b09-47a2-8aa8-43ab6e7d6b84 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '.version_select at 0x7f519f546310>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:57.205108 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d18eba99-1b09-47a2-8aa8-43ab6e7d6b84 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-58552124" status: 204 len: 0 microversion: 2.25 time: 0.083288 Aug 18 11:34:57.205908 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1060/2180] 10.222.0.73 () {60 vars in 1256 bytes} [Thu Aug 18 11:34:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-58552124 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:34:57.211966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4bfefbc3-07c4-4667-b903-c07ce8626388 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:57.216286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4bfefbc3-07c4-4667-b903-c07ce8626388 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:57.232211 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bfefbc3-07c4-4667-b903-c07ce8626388 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:57.232905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bfefbc3-07c4-4667-b903-c07ce8626388 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:57.233633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bfefbc3-07c4-4667-b903-c07ce8626388 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:57.234531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bfefbc3-07c4-4667-b903-c07ce8626388 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:57.235805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bfefbc3-07c4-4667-b903-c07ce8626388 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:57.243996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bfefbc3-07c4-4667-b903-c07ce8626388 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:57.355909 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a067e669-7211-452c-aa47-90003a3c7e68 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.528244 Aug 18 11:34:57.357698 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1121/2181] 10.222.0.73 () {60 vars in 1195 bytes} [Thu Aug 18 11:34:56 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:57.363797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c32af19f-ea2c-42c3-a5a7-32bab68931e9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:57.370150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c32af19f-ea2c-42c3-a5a7-32bab68931e9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:57.390008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c32af19f-ea2c-42c3-a5a7-32bab68931e9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:57.390674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c32af19f-ea2c-42c3-a5a7-32bab68931e9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:57.391264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c32af19f-ea2c-42c3-a5a7-32bab68931e9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:57.392192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c32af19f-ea2c-42c3-a5a7-32bab68931e9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:57.392870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c32af19f-ea2c-42c3-a5a7-32bab68931e9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:57.393411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c32af19f-ea2c-42c3-a5a7-32bab68931e9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:57.819383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4bfefbc3-07c4-4667-b903-c07ce8626388 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:57.832434 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4bfefbc3-07c4-4667-b903-c07ce8626388 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1323 microversion: 2.1 time: 0.625390 Aug 18 11:34:57.832961 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1061/2182] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:57 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1323 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:57.854340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2219b19b-85a3-497a-b47f-7714b88febf2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:57.855041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2219b19b-85a3-497a-b47f-7714b88febf2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:57.894304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2219b19b-85a3-497a-b47f-7714b88febf2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:57.900139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2219b19b-85a3-497a-b47f-7714b88febf2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:57.903911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2219b19b-85a3-497a-b47f-7714b88febf2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:57.905970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2219b19b-85a3-497a-b47f-7714b88febf2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:57.910124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2219b19b-85a3-497a-b47f-7714b88febf2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:57.919445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2219b19b-85a3-497a-b47f-7714b88febf2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:58.111072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c32af19f-ea2c-42c3-a5a7-32bab68931e9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:58.121143 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c32af19f-ea2c-42c3-a5a7-32bab68931e9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1665 microversion: 2.1 time: 0.762049 Aug 18 11:34:58.125586 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1122/2183] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:57 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1665 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:58.139827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9498ea72-8585-4db6-99b9-1cedc200eb83 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f51b0d69790>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:58.247822 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9498ea72-8585-4db6-99b9-1cedc200eb83 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1451 microversion: 2.1 time: 0.119806 Aug 18 11:34:58.250365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1123/2184] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:34:58 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1451 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:58.276861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-147a7994-fa94-409d-a51d-332882ce0c23 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Action: 'create', calling method: .version_select at 0x7f51b0d9a1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1974182805", "description": "tempest-description-51447007"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:58.927763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2219b19b-85a3-497a-b47f-7714b88febf2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:58.969871 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2219b19b-85a3-497a-b47f-7714b88febf2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 1.135744 Aug 18 11:34:58.971607 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1062/2185] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:57 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:58.985207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-99544ab3-dc12-41aa-84ca-171c77ea3a93 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:58.986889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-99544ab3-dc12-41aa-84ca-171c77ea3a93 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:59.006111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-99544ab3-dc12-41aa-84ca-171c77ea3a93 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:59.006683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-99544ab3-dc12-41aa-84ca-171c77ea3a93 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:59.007135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-99544ab3-dc12-41aa-84ca-171c77ea3a93 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:59.007887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-99544ab3-dc12-41aa-84ca-171c77ea3a93 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:59.009005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-99544ab3-dc12-41aa-84ca-171c77ea3a93 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:59.009124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-99544ab3-dc12-41aa-84ca-171c77ea3a93 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:59.119709 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-147a7994-fa94-409d-a51d-332882ce0c23 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.865596 Aug 18 11:34:59.127456 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1124/2186] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:34:58 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:34:59.135018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d7fb23af-8df2-4fa8-91be-5db1470e3432 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:59.138539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d7fb23af-8df2-4fa8-91be-5db1470e3432 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:59.170529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7fb23af-8df2-4fa8-91be-5db1470e3432 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:59.171198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7fb23af-8df2-4fa8-91be-5db1470e3432 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:59.171917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7fb23af-8df2-4fa8-91be-5db1470e3432 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:59.172847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7fb23af-8df2-4fa8-91be-5db1470e3432 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:59.174039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7fb23af-8df2-4fa8-91be-5db1470e3432 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:59.177654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7fb23af-8df2-4fa8-91be-5db1470e3432 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:59.448394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-99544ab3-dc12-41aa-84ca-171c77ea3a93 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:59.481441 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-99544ab3-dc12-41aa-84ca-171c77ea3a93 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1315 microversion: 2.1 time: 0.506650 Aug 18 11:34:59.482027 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1063/2187] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:58 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:59.491845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d7e588b7-49b4-4426-88a4-1eccebc67bcd tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Action: 'create', calling method: .version_select at 0x7f519f712ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1360356903", "description": "tempest-description-1766588369"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:34:59.578118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d7fb23af-8df2-4fa8-91be-5db1470e3432 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:59.590934 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d7fb23af-8df2-4fa8-91be-5db1470e3432 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1517 microversion: 2.1 time: 0.467818 Aug 18 11:34:59.592416 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1125/2188] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:59 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1517 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:34:59.632425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b6818af-fb33-4b2a-ba5d-4b3f844ebf9a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:34:59.633153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b6818af-fb33-4b2a-ba5d-4b3f844ebf9a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:34:59.647637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b6818af-fb33-4b2a-ba5d-4b3f844ebf9a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:59.648070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b6818af-fb33-4b2a-ba5d-4b3f844ebf9a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:59.653594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b6818af-fb33-4b2a-ba5d-4b3f844ebf9a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:59.654864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b6818af-fb33-4b2a-ba5d-4b3f844ebf9a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:34:59.655668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b6818af-fb33-4b2a-ba5d-4b3f844ebf9a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:34:59.656966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b6818af-fb33-4b2a-ba5d-4b3f844ebf9a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:34:59.988808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b6818af-fb33-4b2a-ba5d-4b3f844ebf9a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:34:59.991022 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d7e588b7-49b4-4426-88a4-1eccebc67bcd tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.507905 Aug 18 11:34:59.999358 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b6818af-fb33-4b2a-ba5d-4b3f844ebf9a tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 200 len: 1665 microversion: 2.1 time: 0.379425 Aug 18 11:35:00.000025 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1064/2189] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:34:59 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:00.005025 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a3eebdea-df62-40d4-8fc9-80432aa67ab3 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f38a940>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:00.015714 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1126/2190] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:34:59 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 1665 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:00.021288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-172416c8-65fe-40ba-991d-008629891cae req-35b4144b-6753-494b-8853-2d21a0b9f886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda29354-2be3-4b36-aa1e-4a96b0954806", "tag": "40179a13-a7d9-43a4-b12f-bec53ae16fd6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:00.032850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-172416c8-65fe-40ba-991d-008629891cae req-35b4144b-6753-494b-8853-2d21a0b9f886 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:00.033338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-172416c8-65fe-40ba-991d-008629891cae req-35b4144b-6753-494b-8853-2d21a0b9f886 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:00.033823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-172416c8-65fe-40ba-991d-008629891cae req-35b4144b-6753-494b-8853-2d21a0b9f886 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:00.048736 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-172416c8-65fe-40ba-991d-008629891cae req-35b4144b-6753-494b-8853-2d21a0b9f886 service nova] Creating event network-changed:40179a13-a7d9-43a4-b12f-bec53ae16fd6 for instance fda29354-2be3-4b36-aa1e-4a96b0954806 on n-h2-853611-3 Aug 18 11:35:00.053673 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-172416c8-65fe-40ba-991d-008629891cae req-35b4144b-6753-494b-8853-2d21a0b9f886 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036791 Aug 18 11:35:00.054859 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1127/2191] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:00.061933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-88b1f988-2f46-4460-b4f2-456431c16f68 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:00.065301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88b1f988-2f46-4460-b4f2-456431c16f68 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:00.066477 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a3eebdea-df62-40d4-8fc9-80432aa67ab3 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1460 microversion: 2.1 time: 0.065104 Aug 18 11:35:00.067247 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1065/2192] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:00 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1460 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:00.073675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88b1f988-2f46-4460-b4f2-456431c16f68 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:00.073907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8bee01ed-174a-40da-92b5-a84a52045342 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:00.074180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88b1f988-2f46-4460-b4f2-456431c16f68 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:00.074779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88b1f988-2f46-4460-b4f2-456431c16f68 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:00.075000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8bee01ed-174a-40da-92b5-a84a52045342 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:00.075501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88b1f988-2f46-4460-b4f2-456431c16f68 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:00.077120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88b1f988-2f46-4460-b4f2-456431c16f68 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:00.077535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88b1f988-2f46-4460-b4f2-456431c16f68 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:00.083353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bee01ed-174a-40da-92b5-a84a52045342 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:00.083857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bee01ed-174a-40da-92b5-a84a52045342 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:00.084310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bee01ed-174a-40da-92b5-a84a52045342 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:00.085443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bee01ed-174a-40da-92b5-a84a52045342 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:00.085979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bee01ed-174a-40da-92b5-a84a52045342 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:00.087130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bee01ed-174a-40da-92b5-a84a52045342 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:00.111402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-88b1f988-2f46-4460-b4f2-456431c16f68 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lazy-loading 'flavor' on Instance uuid 2e1582eb-3994-4092-a342-4c88340004c3 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:35:00.137808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8bee01ed-174a-40da-92b5-a84a52045342 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:35:00.189074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:00.238852 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-88b1f988-2f46-4460-b4f2-456431c16f68 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "POST /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3/action" status: 200 len: 32 microversion: 2.1 time: 0.181061 Aug 18 11:35:00.240395 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1128/2193] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:00 2022] POST /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:35:00.252190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e296aa27-fad6-40b7-b073-d3d3b747706f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:00.254567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e296aa27-fad6-40b7-b073-d3d3b747706f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:00.271727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e296aa27-fad6-40b7-b073-d3d3b747706f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:00.272415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e296aa27-fad6-40b7-b073-d3d3b747706f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:00.272942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e296aa27-fad6-40b7-b073-d3d3b747706f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:00.274325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e296aa27-fad6-40b7-b073-d3d3b747706f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:00.274955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e296aa27-fad6-40b7-b073-d3d3b747706f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:00.275865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e296aa27-fad6-40b7-b073-d3d3b747706f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:00.319222 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8bee01ed-174a-40da-92b5-a84a52045342 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 204 len: 0 microversion: 2.25 time: 0.250511 Aug 18 11:35:00.321075 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1066/2194] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:35:00 2022] DELETE /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:35:00.331199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-27f27c5a-f820-480a-9b52-07690bd8fb7c tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Action: 'create', calling method: .version_select at 0x7f519f5c39d0>, body: {"security_group_rule": {"parent_group_id": "8600c3fb-b3f0-4d90-ab82-8a10f580240c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d8c099a0-eb17-4c1b-b682-a334b7ee221d"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:00.855659 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-27f27c5a-f820-480a-9b52-07690bd8fb7c tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.532809 Aug 18 11:35:00.863829 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1067/2195] 10.222.0.73 () {60 vars in 1195 bytes} [Thu Aug 18 11:35:00 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:00.869767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a6d818b4-93a6-45fb-beb5-f03b4dfb3e82 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f39f160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:00.901243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e296aa27-fad6-40b7-b073-d3d3b747706f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:00.910917 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e296aa27-fad6-40b7-b073-d3d3b747706f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 0.668896 Aug 18 11:35:00.918478 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1129/2196] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:00 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:00.918478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8670666d-6932-44e5-b2d4-9ad4d519cb1b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:00.918478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8670666d-6932-44e5-b2d4-9ad4d519cb1b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:00.923676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8670666d-6932-44e5-b2d4-9ad4d519cb1b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:00.924274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8670666d-6932-44e5-b2d4-9ad4d519cb1b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:00.924812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8670666d-6932-44e5-b2d4-9ad4d519cb1b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:00.925705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8670666d-6932-44e5-b2d4-9ad4d519cb1b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:00.926274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8670666d-6932-44e5-b2d4-9ad4d519cb1b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:00.927015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8670666d-6932-44e5-b2d4-9ad4d519cb1b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:00.951191 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a6d818b4-93a6-45fb-beb5-f03b4dfb3e82 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 200 len: 1460 microversion: 2.1 time: 0.092529 Aug 18 11:35:00.954481 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1068/2197] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:00 2022] GET /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 1460 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:00.964447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-871db49c-0113-4f58-a181-dbbb816d80ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:00.965371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-871db49c-0113-4f58-a181-dbbb816d80ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:00.974772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-871db49c-0113-4f58-a181-dbbb816d80ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:00.975436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-871db49c-0113-4f58-a181-dbbb816d80ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:00.976070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-871db49c-0113-4f58-a181-dbbb816d80ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:00.978933 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-871db49c-0113-4f58-a181-dbbb816d80ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:00.981948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-871db49c-0113-4f58-a181-dbbb816d80ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:00.982604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-871db49c-0113-4f58-a181-dbbb816d80ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:01.116653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8670666d-6932-44e5-b2d4-9ad4d519cb1b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:01.127965 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8670666d-6932-44e5-b2d4-9ad4d519cb1b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.214855 Aug 18 11:35:01.129247 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1130/2198] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:00 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:01.134861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-cb78cb4c-963b-4ef6-a7e3-e532e200452f req-6c7fc69d-9bf3-4a47-9b5a-25b893f61561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea", "name": "network-vif-deleted", "tag": "6f0d24ce-a546-4261-8582-706023203b8e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:01.145472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cb78cb4c-963b-4ef6-a7e3-e532e200452f req-6c7fc69d-9bf3-4a47-9b5a-25b893f61561 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:01.146200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cb78cb4c-963b-4ef6-a7e3-e532e200452f req-6c7fc69d-9bf3-4a47-9b5a-25b893f61561 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:01.146843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cb78cb4c-963b-4ef6-a7e3-e532e200452f req-6c7fc69d-9bf3-4a47-9b5a-25b893f61561 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:01.163032 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-cb78cb4c-963b-4ef6-a7e3-e532e200452f req-6c7fc69d-9bf3-4a47-9b5a-25b893f61561 service nova] Creating event network-vif-deleted:6f0d24ce-a546-4261-8582-706023203b8e for instance 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea on n-h1-853611-3 Aug 18 11:35:01.172448 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-cb78cb4c-963b-4ef6-a7e3-e532e200452f req-6c7fc69d-9bf3-4a47-9b5a-25b893f61561 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041626 Aug 18 11:35:01.176733 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1131/2199] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:01.177064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-871db49c-0113-4f58-a181-dbbb816d80ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:01.183405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b1a5b73-5a53-4737-b6c8-ad3b0104f432 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:01.184122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b1a5b73-5a53-4737-b6c8-ad3b0104f432 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:01.191740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b1a5b73-5a53-4737-b6c8-ad3b0104f432 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:01.192515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b1a5b73-5a53-4737-b6c8-ad3b0104f432 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:01.192735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b1a5b73-5a53-4737-b6c8-ad3b0104f432 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:01.193624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b1a5b73-5a53-4737-b6c8-ad3b0104f432 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:01.194099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b1a5b73-5a53-4737-b6c8-ad3b0104f432 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:01.194398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-871db49c-0113-4f58-a181-dbbb816d80ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:01.194646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b1a5b73-5a53-4737-b6c8-ad3b0104f432 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:01.198037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-871db49c-0113-4f58-a181-dbbb816d80ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:01.199510 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-871db49c-0113-4f58-a181-dbbb816d80ef tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1550 microversion: 2.25 time: 0.243732 Aug 18 11:35:01.200545 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1069/2200] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:35:00 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1550 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:35:01.215025 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3b90782e-be9e-4128-9df7-aa78beafbea3 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Action: 'create', calling method: .version_select at 0x7f519f712550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1399224912", "description": "tempest-description-1893419256"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:01.390118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5b1a5b73-5a53-4737-b6c8-ad3b0104f432 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:01.404687 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b1a5b73-5a53-4737-b6c8-ad3b0104f432 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1315 microversion: 2.1 time: 0.225602 Aug 18 11:35:01.418496 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1132/2201] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:01 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:01.418496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-07543f59-ea0f-4328-af9e-7c328605a6fc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:01.418496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-07543f59-ea0f-4328-af9e-7c328605a6fc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 51e3865d-a413-4c57-b0dc-1b29e76be1de] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:01.429702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07543f59-ea0f-4328-af9e-7c328605a6fc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:01.430600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07543f59-ea0f-4328-af9e-7c328605a6fc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:01.431123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07543f59-ea0f-4328-af9e-7c328605a6fc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:01.431890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07543f59-ea0f-4328-af9e-7c328605a6fc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:01.432363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07543f59-ea0f-4328-af9e-7c328605a6fc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:01.432833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07543f59-ea0f-4328-af9e-7c328605a6fc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:01.479223 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3b90782e-be9e-4128-9df7-aa78beafbea3 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.277075 Aug 18 11:35:01.480111 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1070/2202] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:35:01 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:01.486059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5cd6a495-072d-4b61-a9da-d5d2af60a0e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:01.486927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5cd6a495-072d-4b61-a9da-d5d2af60a0e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:01.497807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cd6a495-072d-4b61-a9da-d5d2af60a0e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:01.498768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cd6a495-072d-4b61-a9da-d5d2af60a0e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:01.499422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cd6a495-072d-4b61-a9da-d5d2af60a0e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:01.500478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cd6a495-072d-4b61-a9da-d5d2af60a0e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:01.501372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cd6a495-072d-4b61-a9da-d5d2af60a0e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:01.502273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5cd6a495-072d-4b61-a9da-d5d2af60a0e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:01.531691 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-5cd6a495-072d-4b61-a9da-d5d2af60a0e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] HTTP exception thrown: Instance 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea could not be found. Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5cd6a495-072d-4b61-a9da-d5d2af60a0e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Request method failure captured: Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea HTTP/1.1 Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iIZ73k_YPF_W2EIMMri9FswITgky3Trv8mszMC_q7DqKHRQdz1obOf92XsfI5eHcOKQ4Taq-4WecACwzcaZUhv56AdpPX-KscZp_JKFwtxRcvZ5iK0fyDGxpMgEaIqG5cDWy9Nd7bp6IxhUSg7zZ_33iKe3ZgVsB8DA6NyW9vAbKfs Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 22660df6ec1a4f718a08cbeda2be364c Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-LiveMigrationTest-290401536 Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:35:01.534571 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:35:01.536013 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:01.536013 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-LiveMigrationTest-290401536 Aug 18 11:35:01.536013 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 22660df6ec1a4f718a08cbeda2be364c Aug 18 11:35:01.536013 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-LiveMigrationTest-290401536 Aug 18 11:35:01.536013 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-LiveMigrationTest-290401536-project Aug 18 11:35:01.536013 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:35:01.536013 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:35:01.536013 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 0cf7fe4236764bea83c6560516441759 Aug 18 11:35:01.536013 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-LiveMigrationTest-290401536-project Aug 18 11:35:01.536013 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:35:01.536013 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea could not be found. Aug 18 11:35:01.536013 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea'} Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea could not be found. Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:01.536685 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea could not be found. Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea could not be found. Aug 18 11:35:01.537724 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:01.540064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5cd6a495-072d-4b61-a9da-d5d2af60a0e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Returning 404 to user: Instance 6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:01.541103 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5cd6a495-072d-4b61-a9da-d5d2af60a0e3 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea" status: 404 len: 111 microversion: 2.1 time: 0.059598 Aug 18 11:35:01.545263 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1071/2203] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:01 2022] GET /compute/v2.1/servers/6438fe0d-c03b-4cfd-9c4a-4ca6e021aaea => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:35:01.551470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dbf95996-42ae-4a2a-967b-98c0a8ab12df tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Action: 'create', calling method: .version_select at 0x7f519f5ace50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1386988982", "description": "tempest-description-2099725031"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:01.639997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-07543f59-ea0f-4328-af9e-7c328605a6fc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:01.653255 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-07543f59-ea0f-4328-af9e-7c328605a6fc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de" status: 200 len: 1466 microversion: 2.1 time: 0.245792 Aug 18 11:35:01.653685 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1133/2204] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:01 2022] GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de => generated 1466 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:01.660719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-574b798c-d7cf-423d-bcac-146444a1f9e2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '.version_select at 0x7f51b0dc3670>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:01.690901 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-574b798c-d7cf-423d-bcac-146444a1f9e2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083530406" status: 202 len: 0 microversion: 2.1 time: 0.035345 Aug 18 11:35:01.691400 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1134/2205] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 11:35:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083530406 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:01.870942 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b24107ec-fee0-4e0f-8e68-be5f1accb179 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] 10.222.0.73 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.178224 Aug 18 11:35:01.872979 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1135/2206] 10.222.0.73 () {58 vars in 1128 bytes} [Thu Aug 18 11:35:01 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 11:35:01.879739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-60582a3a-6068-4cd2-afe8-158a10fd70cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-232820698"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:01.882418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-60582a3a-6068-4cd2-afe8-158a10fd70cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:01.891575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60582a3a-6068-4cd2-afe8-158a10fd70cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:01.892600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60582a3a-6068-4cd2-afe8-158a10fd70cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:01.893389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60582a3a-6068-4cd2-afe8-158a10fd70cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:01.894666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60582a3a-6068-4cd2-afe8-158a10fd70cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:01.898153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60582a3a-6068-4cd2-afe8-158a10fd70cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:01.899485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60582a3a-6068-4cd2-afe8-158a10fd70cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:02.206562 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-60582a3a-6068-4cd2-afe8-158a10fd70cc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "POST /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055/action" status: 202 len: 0 microversion: 2.1 time: 0.331760 Aug 18 11:35:02.214165 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1136/2207] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:01 2022] POST /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 18 11:35:02.214165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0a4d3124-6db6-40e4-bde3-98aeb53ef732 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Calling method '.version_select at 0x7f51b0dc39d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:02.236173 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-0a4d3124-6db6-40e4-bde3-98aeb53ef732 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] HTTP exception thrown: Image not found. Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0a4d3124-6db6-40e4-bde3-98aeb53ef732 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Request method failure captured: Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iPlnU1Q7tasTGBz6brCCEZCxHH4GP60qlcX7Tyj8vsc_CcdyBOTLVRnwthUWIfLi7D-6anMlKkFgLzUukJJatowBRGl44u22rjuXKIMB-NlB2mTzjn4uy4aaUrK7WNDCng_h6NsQ3Em2zEB9DLiGVSt3ea5FQOnVZW1Oi15gpZ5A4c Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 086d2d6b9be5473aad25b91fcef28b59 Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:35:02.238938 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:35:02.240533 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:02.240533 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:02.240533 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 086d2d6b9be5473aad25b91fcef28b59 Aug 18 11:35:02.240533 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:02.240533 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesDeleteNegativeTestJSON-117541993-project Aug 18 11:35:02.240533 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:35:02.240533 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:35:02.240533 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: f449137e45d643e7abd83d4cd426bf73 Aug 18 11:35:02.240533 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-117541993-project Aug 18 11:35:02.240533 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:35:02.240533 n-d-853611-3 devstack@n-api.service[122210]: exception: Image not found. Aug 18 11:35:02.240533 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '-1'} Aug 18 11:35:02.240533 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:02.240533 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:02.241566 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:02.243299 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 18 11:35:02.244694 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:35:02.244694 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:35:02.244694 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:02.244694 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:02.244694 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:02.244694 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:02.244694 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:02.244694 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:02.244694 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:02.244694 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:02.244694 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:35:02.244694 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:02.244694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0a4d3124-6db6-40e4-bde3-98aeb53ef732 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Returning 404 to user: Image not found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:02.245615 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0a4d3124-6db6-40e4-bde3-98aeb53ef732 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] 10.222.0.73 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.034032 Aug 18 11:35:02.246837 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1137/2208] 10.222.0.73 () {58 vars in 1134 bytes} [Thu Aug 18 11:35:02 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:35:02.252207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d801daa0-6c1c-4370-bc96-1d528a1d3c82 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:02.253044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d801daa0-6c1c-4370-bc96-1d528a1d3c82 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:02.261851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d801daa0-6c1c-4370-bc96-1d528a1d3c82 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:02.262473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d801daa0-6c1c-4370-bc96-1d528a1d3c82 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:02.263002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d801daa0-6c1c-4370-bc96-1d528a1d3c82 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:02.263825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d801daa0-6c1c-4370-bc96-1d528a1d3c82 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:02.264347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d801daa0-6c1c-4370-bc96-1d528a1d3c82 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:02.264860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d801daa0-6c1c-4370-bc96-1d528a1d3c82 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:02.436107 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dbf95996-42ae-4a2a-967b-98c0a8ab12df tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.889346 Aug 18 11:35:02.444895 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1072/2209] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:35:01 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:02.451567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-89ec6e25-7092-4319-9e5f-152d4d079d16 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:02.452550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-89ec6e25-7092-4319-9e5f-152d4d079d16 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:02.462624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89ec6e25-7092-4319-9e5f-152d4d079d16 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:02.463144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89ec6e25-7092-4319-9e5f-152d4d079d16 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:02.463665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89ec6e25-7092-4319-9e5f-152d4d079d16 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:02.464611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89ec6e25-7092-4319-9e5f-152d4d079d16 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:02.465377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89ec6e25-7092-4319-9e5f-152d4d079d16 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:02.466733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89ec6e25-7092-4319-9e5f-152d4d079d16 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:02.727322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d801daa0-6c1c-4370-bc96-1d528a1d3c82 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:02.735027 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d801daa0-6c1c-4370-bc96-1d528a1d3c82 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 0.487041 Aug 18 11:35:02.735651 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1138/2210] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:02 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:02.740599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-95cae345-8e18-4327-9260-3a917406f54b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f51b0dc3310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:02.797129 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-95cae345-8e18-4327-9260-3a917406f54b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 200 len: 1450 microversion: 2.1 time: 0.059867 Aug 18 11:35:02.797697 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1139/2211] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:02 2022] GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 1450 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:02.802417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f12bef11-b44a-4710-980b-017e17970e3b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:02.803273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f12bef11-b44a-4710-980b-017e17970e3b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:02.811190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f12bef11-b44a-4710-980b-017e17970e3b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:02.811766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f12bef11-b44a-4710-980b-017e17970e3b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:02.812276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f12bef11-b44a-4710-980b-017e17970e3b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:02.813049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f12bef11-b44a-4710-980b-017e17970e3b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:02.813569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f12bef11-b44a-4710-980b-017e17970e3b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:02.814239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f12bef11-b44a-4710-980b-017e17970e3b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:02.833684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-89ec6e25-7092-4319-9e5f-152d4d079d16 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:02.845192 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-89ec6e25-7092-4319-9e5f-152d4d079d16 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.397918 Aug 18 11:35:02.847252 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1073/2212] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:02 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:02.857963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-22ee1e01-0473-41c6-a525-ef42435e6e78 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Calling method '.version_select at 0x7f519f5c3310>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:02.885022 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-22ee1e01-0473-41c6-a525-ef42435e6e78 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] HTTP exception thrown: Image not found. Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-22ee1e01-0473-41c6-a525-ef42435e6e78 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Request method failure captured: Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/images/b7f47227-e3ca-4cc6-915c-146e05fa561j HTTP/1.1 Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iPlnU1Q7tasTGBz6brCCEZCxHH4GP60qlcX7Tyj8vsc_CcdyBOTLVRnwthUWIfLi7D-6anMlKkFgLzUukJJatowBRGl44u22rjuXKIMB-NlB2mTzjn4uy4aaUrK7WNDCng_h6NsQ3Em2zEB9DLiGVSt3ea5FQOnVZW1Oi15gpZ5A4c Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 086d2d6b9be5473aad25b91fcef28b59 Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:35:02.886944 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:35:02.888088 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:02.888088 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:02.888088 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 086d2d6b9be5473aad25b91fcef28b59 Aug 18 11:35:02.888088 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:02.888088 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesDeleteNegativeTestJSON-117541993-project Aug 18 11:35:02.888088 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:35:02.888088 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:35:02.888088 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: f449137e45d643e7abd83d4cd426bf73 Aug 18 11:35:02.888088 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-117541993-project Aug 18 11:35:02.888088 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:35:02.888088 n-d-853611-3 devstack@n-api.service[122209]: exception: Image not found. Aug 18 11:35:02.888088 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'b7f47227-e3ca-4cc6-915c-146e05fa561j'} Aug 18 11:35:02.888088 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b7f47227-e3ca-4cc6-915c-146e05fa561j to delete Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:02.888792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b7f47227-e3ca-4cc6-915c-146e05fa561j could not be found. Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:02.889782 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-22ee1e01-0473-41c6-a525-ef42435e6e78 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Returning 404 to user: Image not found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:02.891192 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-22ee1e01-0473-41c6-a525-ef42435e6e78 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] 10.222.0.73 "DELETE /compute/v2.1/images/b7f47227-e3ca-4cc6-915c-146e05fa561j" status: 404 len: 62 microversion: 2.1 time: 0.034250 Aug 18 11:35:02.891949 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1074/2213] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:02 2022] DELETE /compute/v2.1/images/b7f47227-e3ca-4cc6-915c-146e05fa561j => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:35:02.896374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-05e7cb00-2105-4671-bb23-265a7851cdfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:02.897067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-05e7cb00-2105-4671-bb23-265a7851cdfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:02.906025 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05e7cb00-2105-4671-bb23-265a7851cdfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:02.906863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05e7cb00-2105-4671-bb23-265a7851cdfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:02.907374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05e7cb00-2105-4671-bb23-265a7851cdfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:02.908178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05e7cb00-2105-4671-bb23-265a7851cdfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:02.908789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05e7cb00-2105-4671-bb23-265a7851cdfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:02.909287 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05e7cb00-2105-4671-bb23-265a7851cdfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:03.125604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-05e7cb00-2105-4671-bb23-265a7851cdfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:03.133709 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-05e7cb00-2105-4671-bb23-265a7851cdfd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1315 microversion: 2.1 time: 0.243053 Aug 18 11:35:03.134287 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1075/2214] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:02 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:03.139154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cbcee029-ab77-41ba-a779-21db21801a92 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Action: 'create', calling method: .version_select at 0x7f519f5acca0>, body: {"security_group_rule": {"parent_group_id": "0a2d7c11-e5b8-4cce-b17b-d7a55c6f09f6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d190c473-0e99-4dc1-ad29-5d3d65ac8e48"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:03.177320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f12bef11-b44a-4710-980b-017e17970e3b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:03.187093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f12bef11-b44a-4710-980b-017e17970e3b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:03.189039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f12bef11-b44a-4710-980b-017e17970e3b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:03.189825 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f12bef11-b44a-4710-980b-017e17970e3b tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 200 len: 1550 microversion: 2.25 time: 0.390996 Aug 18 11:35:03.206295 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1140/2215] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:35:02 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 1550 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:35:03.211637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac6fc2b0-3d9e-4344-a50d-5ac936250dce tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Calling method '.version_select at 0x7f519fda2c10>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:03.231933 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-ac6fc2b0-3d9e-4344-a50d-5ac936250dce tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] HTTP exception thrown: Image not found. Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac6fc2b0-3d9e-4344-a50d-5ac936250dce tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Request method failure captured: Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/images/cc250ca0-ec44-4a41-a8a8-559dbf2479c81 HTTP/1.1 Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iPlnU1Q7tasTGBz6brCCEZCxHH4GP60qlcX7Tyj8vsc_CcdyBOTLVRnwthUWIfLi7D-6anMlKkFgLzUukJJatowBRGl44u22rjuXKIMB-NlB2mTzjn4uy4aaUrK7WNDCng_h6NsQ3Em2zEB9DLiGVSt3ea5FQOnVZW1Oi15gpZ5A4c Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 086d2d6b9be5473aad25b91fcef28b59 Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:35:03.233939 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:35:03.235198 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:03.235198 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:03.235198 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 086d2d6b9be5473aad25b91fcef28b59 Aug 18 11:35:03.235198 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:03.235198 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesDeleteNegativeTestJSON-117541993-project Aug 18 11:35:03.235198 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:35:03.235198 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:35:03.235198 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: f449137e45d643e7abd83d4cd426bf73 Aug 18 11:35:03.235198 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-117541993-project Aug 18 11:35:03.235198 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:35:03.235198 n-d-853611-3 devstack@n-api.service[122210]: exception: Image not found. Aug 18 11:35:03.235198 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'cc250ca0-ec44-4a41-a8a8-559dbf2479c81'} Aug 18 11:35:03.235198 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cc250ca0-ec44-4a41-a8a8-559dbf2479c81 to delete Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:03.235902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cc250ca0-ec44-4a41-a8a8-559dbf2479c81 could not be found. Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:03.236888 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac6fc2b0-3d9e-4344-a50d-5ac936250dce tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Returning 404 to user: Image not found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:03.239392 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ac6fc2b0-3d9e-4344-a50d-5ac936250dce tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] 10.222.0.73 "DELETE /compute/v2.1/images/cc250ca0-ec44-4a41-a8a8-559dbf2479c81" status: 404 len: 62 microversion: 2.1 time: 0.028115 Aug 18 11:35:03.241732 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1141/2216] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:35:03 2022] DELETE /compute/v2.1/images/cc250ca0-ec44-4a41-a8a8-559dbf2479c81 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:35:03.247826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-932c611c-68ee-433a-81f6-90ded4a4d46d tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Calling method '.version_select at 0x7f51b0da2310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:03.272714 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-932c611c-68ee-433a-81f6-90ded4a4d46d tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] HTTP exception thrown: Image not found. Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-932c611c-68ee-433a-81f6-90ded4a4d46d tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Request method failure captured: Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/images/tempest-invalid-1099153734 HTTP/1.1 Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iPlnU1Q7tasTGBz6brCCEZCxHH4GP60qlcX7Tyj8vsc_CcdyBOTLVRnwthUWIfLi7D-6anMlKkFgLzUukJJatowBRGl44u22rjuXKIMB-NlB2mTzjn4uy4aaUrK7WNDCng_h6NsQ3Em2zEB9DLiGVSt3ea5FQOnVZW1Oi15gpZ5A4c Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 086d2d6b9be5473aad25b91fcef28b59 Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:35:03.279267 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:35:03.280658 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:03.280658 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:03.280658 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 086d2d6b9be5473aad25b91fcef28b59 Aug 18 11:35:03.280658 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:03.280658 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesDeleteNegativeTestJSON-117541993-project Aug 18 11:35:03.280658 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:35:03.280658 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:35:03.280658 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: f449137e45d643e7abd83d4cd426bf73 Aug 18 11:35:03.280658 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-117541993-project Aug 18 11:35:03.280658 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:35:03.280658 n-d-853611-3 devstack@n-api.service[122210]: exception: Image not found. Aug 18 11:35:03.280658 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'tempest-invalid-1099153734'} Aug 18 11:35:03.280658 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1099153734 to delete Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:03.281348 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1099153734 could not be found. Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:03.282302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-932c611c-68ee-433a-81f6-90ded4a4d46d tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Returning 404 to user: Image not found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:03.283372 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-932c611c-68ee-433a-81f6-90ded4a4d46d tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] 10.222.0.73 "DELETE /compute/v2.1/images/tempest-invalid-1099153734" status: 404 len: 62 microversion: 2.1 time: 0.038146 Aug 18 11:35:03.284750 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1142/2217] 10.222.0.73 () {58 vars in 1206 bytes} [Thu Aug 18 11:35:03 2022] DELETE /compute/v2.1/images/tempest-invalid-1099153734 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:35:03.295307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a4a04da-85c0-4673-96a7-3def6867f490 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Calling method '.version_select at 0x7f51b0dc33a0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:03.333254 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-1a4a04da-85c0-4673-96a7-3def6867f490 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] HTTP exception thrown: Image not found. Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a4a04da-85c0-4673-96a7-3def6867f490 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Request method failure captured: Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/images/c8e6bb8d-9fe2-442b-8e0c-7fbecd661a13 HTTP/1.1 Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iPlnU1Q7tasTGBz6brCCEZCxHH4GP60qlcX7Tyj8vsc_CcdyBOTLVRnwthUWIfLi7D-6anMlKkFgLzUukJJatowBRGl44u22rjuXKIMB-NlB2mTzjn4uy4aaUrK7WNDCng_h6NsQ3Em2zEB9DLiGVSt3ea5FQOnVZW1Oi15gpZ5A4c Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 086d2d6b9be5473aad25b91fcef28b59 Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:35:03.337205 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:35:03.338643 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/086d2d6b9be5473aad25b91fcef28b59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:03.338643 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:03.338643 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 086d2d6b9be5473aad25b91fcef28b59 Aug 18 11:35:03.338643 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-117541993 Aug 18 11:35:03.338643 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesDeleteNegativeTestJSON-117541993-project Aug 18 11:35:03.338643 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:35:03.338643 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:35:03.338643 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: f449137e45d643e7abd83d4cd426bf73 Aug 18 11:35:03.338643 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-117541993-project Aug 18 11:35:03.338643 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:35:03.338643 n-d-853611-3 devstack@n-api.service[122210]: exception: Image not found. Aug 18 11:35:03.338643 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'c8e6bb8d-9fe2-442b-8e0c-7fbecd661a13'} Aug 18 11:35:03.338643 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c8e6bb8d-9fe2-442b-8e0c-7fbecd661a13 to delete Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:03.339485 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c8e6bb8d-9fe2-442b-8e0c-7fbecd661a13 could not be found. Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:03.340547 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a4a04da-85c0-4673-96a7-3def6867f490 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] Returning 404 to user: Image not found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:03.341568 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a4a04da-85c0-4673-96a7-3def6867f490 tempest-ImagesDeleteNegativeTestJSON-117541993 tempest-ImagesDeleteNegativeTestJSON-117541993-project] 10.222.0.73 "DELETE /compute/v2.1/images/c8e6bb8d-9fe2-442b-8e0c-7fbecd661a13" status: 404 len: 62 microversion: 2.1 time: 0.050168 Aug 18 11:35:03.342350 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1143/2218] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:03 2022] DELETE /compute/v2.1/images/c8e6bb8d-9fe2-442b-8e0c-7fbecd661a13 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:35:03.387198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-58086372-b522-45b6-8644-20bf401678a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:03.388113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-58086372-b522-45b6-8644-20bf401678a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:03.405297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58086372-b522-45b6-8644-20bf401678a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:03.419564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58086372-b522-45b6-8644-20bf401678a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:03.422753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58086372-b522-45b6-8644-20bf401678a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:03.426344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58086372-b522-45b6-8644-20bf401678a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:03.426851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58086372-b522-45b6-8644-20bf401678a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:03.427347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58086372-b522-45b6-8644-20bf401678a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:03.491018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-58086372-b522-45b6-8644-20bf401678a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:35:03.508874 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cbcee029-ab77-41ba-a779-21db21801a92 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.372993 Aug 18 11:35:03.509599 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1076/2219] 10.222.0.73 () {60 vars in 1195 bytes} [Thu Aug 18 11:35:03 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:03.514883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-0dc1184d-ad87-4638-a6ff-d1ddb6fb1f87 req-760b1f7c-956e-47e3-84d4-417ad07bb8ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e802eca-675c-4376-8bdb-666b223637db", "name": "network-vif-deleted", "tag": "ac380441-814b-46b7-aff6-6a2c1648907c"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:03.539697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0dc1184d-ad87-4638-a6ff-d1ddb6fb1f87 req-760b1f7c-956e-47e3-84d4-417ad07bb8ba service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:03.540514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0dc1184d-ad87-4638-a6ff-d1ddb6fb1f87 req-760b1f7c-956e-47e3-84d4-417ad07bb8ba service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:03.542286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0dc1184d-ad87-4638-a6ff-d1ddb6fb1f87 req-760b1f7c-956e-47e3-84d4-417ad07bb8ba service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:03.562626 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-0dc1184d-ad87-4638-a6ff-d1ddb6fb1f87 req-760b1f7c-956e-47e3-84d4-417ad07bb8ba service nova] Creating event network-vif-deleted:ac380441-814b-46b7-aff6-6a2c1648907c for instance 2e802eca-675c-4376-8bdb-666b223637db on n-h2-853611-3 Aug 18 11:35:03.568657 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-0dc1184d-ad87-4638-a6ff-d1ddb6fb1f87 req-760b1f7c-956e-47e3-84d4-417ad07bb8ba service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057846 Aug 18 11:35:03.571293 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1077/2220] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:03.579712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e9c18760-d663-4429-9919-cf890b410087 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Calling method '.version_select at 0x7f519f5ac280>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:03.690554 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-58086372-b522-45b6-8644-20bf401678a9 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "DELETE /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 204 len: 0 microversion: 2.1 time: 0.308341 Aug 18 11:35:03.692477 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1144/2221] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:35:03 2022] DELETE /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:35:03.709736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08f6e155-b510-46ca-9714-db7aef2d656f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:03.710789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-08f6e155-b510-46ca-9714-db7aef2d656f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:03.720269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08f6e155-b510-46ca-9714-db7aef2d656f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:03.720768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08f6e155-b510-46ca-9714-db7aef2d656f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:03.721218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08f6e155-b510-46ca-9714-db7aef2d656f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:03.721909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08f6e155-b510-46ca-9714-db7aef2d656f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:03.722360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08f6e155-b510-46ca-9714-db7aef2d656f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:03.722834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08f6e155-b510-46ca-9714-db7aef2d656f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:03.874216 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e9c18760-d663-4429-9919-cf890b410087 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/d190c473-0e99-4dc1-ad29-5d3d65ac8e48" status: 202 len: 0 microversion: 2.1 time: 0.300019 Aug 18 11:35:03.875347 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1078/2222] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:35:03 2022] DELETE /compute/v2.1/os-security-groups/d190c473-0e99-4dc1-ad29-5d3d65ac8e48 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:03.883913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-36e373b9-4732-45f3-8dd1-cfb32db9af01 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:03.884819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-36e373b9-4732-45f3-8dd1-cfb32db9af01 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:03.899328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-08f6e155-b510-46ca-9714-db7aef2d656f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:03.901405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36e373b9-4732-45f3-8dd1-cfb32db9af01 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:03.902105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36e373b9-4732-45f3-8dd1-cfb32db9af01 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:03.902726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36e373b9-4732-45f3-8dd1-cfb32db9af01 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:03.903649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36e373b9-4732-45f3-8dd1-cfb32db9af01 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:03.905276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36e373b9-4732-45f3-8dd1-cfb32db9af01 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:03.905925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36e373b9-4732-45f3-8dd1-cfb32db9af01 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:03.907880 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-08f6e155-b510-46ca-9714-db7aef2d656f tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1485 microversion: 2.1 time: 0.210143 Aug 18 11:35:03.908521 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1145/2223] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:03 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1485 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:35:03.924097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2073ed3b-82b1-4c97-a90e-75b5696f17fe tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f51b0da2ee0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:03.984199 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2073ed3b-82b1-4c97-a90e-75b5696f17fe tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 200 len: 1450 microversion: 2.1 time: 0.074242 Aug 18 11:35:03.984772 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1146/2224] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:03 2022] GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 1450 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:03.990339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-97fc17fb-e71b-41ae-9fc6-1f0cd2bb70e4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:03.991213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-97fc17fb-e71b-41ae-9fc6-1f0cd2bb70e4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:03.997312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:03.999113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97fc17fb-e71b-41ae-9fc6-1f0cd2bb70e4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:03.999619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97fc17fb-e71b-41ae-9fc6-1f0cd2bb70e4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:04.000064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97fc17fb-e71b-41ae-9fc6-1f0cd2bb70e4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:04.000778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97fc17fb-e71b-41ae-9fc6-1f0cd2bb70e4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:04.001595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97fc17fb-e71b-41ae-9fc6-1f0cd2bb70e4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:04.002034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97fc17fb-e71b-41ae-9fc6-1f0cd2bb70e4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:04.096573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-36e373b9-4732-45f3-8dd1-cfb32db9af01 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:04.105372 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-36e373b9-4732-45f3-8dd1-cfb32db9af01 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 0.228597 Aug 18 11:35:04.106560 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1079/2225] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:03 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:04.111471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0575ad54-0c71-4b5e-b986-c02c6fc6a44e tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Calling method '.version_select at 0x7f519f2d43a0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:04.189599 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0575ad54-0c71-4b5e-b986-c02c6fc6a44e tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "GET /compute/v2.1/os-security-groups/0a2d7c11-e5b8-4cce-b17b-d7a55c6f09f6" status: 200 len: 248 microversion: 2.1 time: 0.081739 Aug 18 11:35:04.194759 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1080/2226] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:35:04 2022] GET /compute/v2.1/os-security-groups/0a2d7c11-e5b8-4cce-b17b-d7a55c6f09f6 => generated 248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:04.201360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-305a5d21-74ec-45fa-8d26-59a7de488f76 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:04.201983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-305a5d21-74ec-45fa-8d26-59a7de488f76 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:04.208123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-305a5d21-74ec-45fa-8d26-59a7de488f76 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:04.208833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-305a5d21-74ec-45fa-8d26-59a7de488f76 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:04.209279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-305a5d21-74ec-45fa-8d26-59a7de488f76 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:04.209994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-305a5d21-74ec-45fa-8d26-59a7de488f76 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:04.210471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-305a5d21-74ec-45fa-8d26-59a7de488f76 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:04.211480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-305a5d21-74ec-45fa-8d26-59a7de488f76 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:04.348318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-97fc17fb-e71b-41ae-9fc6-1f0cd2bb70e4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:04.359558 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-97fc17fb-e71b-41ae-9fc6-1f0cd2bb70e4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.373532 Aug 18 11:35:04.361515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-305a5d21-74ec-45fa-8d26-59a7de488f76 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:04.364180 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1147/2227] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:03 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:04.370624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-deab9981-6418-4f61-9116-4196fc612aba tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Action: 'create', calling method: .version_select at 0x7f519f835700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2109833063", "description": "tempest-description-1178461291"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:04.370828 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-305a5d21-74ec-45fa-8d26-59a7de488f76 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1315 microversion: 2.1 time: 0.174213 Aug 18 11:35:04.371515 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1081/2228] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:04 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:04.389130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c861edfe-e562-4a2d-80f7-1c39a106b07e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:04.389850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c861edfe-e562-4a2d-80f7-1c39a106b07e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 2e802eca-675c-4376-8bdb-666b223637db] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:04.396490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c861edfe-e562-4a2d-80f7-1c39a106b07e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:04.396991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c861edfe-e562-4a2d-80f7-1c39a106b07e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:04.397432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c861edfe-e562-4a2d-80f7-1c39a106b07e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:04.398915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c861edfe-e562-4a2d-80f7-1c39a106b07e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:04.399272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c861edfe-e562-4a2d-80f7-1c39a106b07e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:04.399703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c861edfe-e562-4a2d-80f7-1c39a106b07e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:04.413417 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-c861edfe-e562-4a2d-80f7-1c39a106b07e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] HTTP exception thrown: Instance 2e802eca-675c-4376-8bdb-666b223637db could not be found. Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c861edfe-e562-4a2d-80f7-1c39a106b07e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Request method failure captured: Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db HTTP/1.1 Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iHfonnPQX3UJ8JVfLWKn0-FBTKN1-o3Xum7prCJ2FMsZdZvRcJbTv-8FrUmDTr-Wlg49nWJuhk-bpn_UY-LeVzzNa3m_Kxo5hgM8hOtgGSiqCxiFtvOEgk-Fwkg_0hf4Qntsc1Yrpr_ZAdG8yDS1A0RPRSVo189_-HZVJtp6ztfGbE Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: X-Openstack-Nova-Api-Version: 2.25 Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 51319140bae948cf873746a482aaf588 Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1161683466 Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:35:04.415298 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:35:04.416691 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51319140bae948cf873746a482aaf588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/51319140bae948cf873746a482aaf588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_51319140bae948cf873746a482aaf588"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51319140bae948cf873746a482aaf588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:04.416691 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1161683466 Aug 18 11:35:04.416691 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 51319140bae948cf873746a482aaf588 Aug 18 11:35:04.416691 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1161683466 Aug 18 11:35:04.416691 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-LiveAutoBlockMigrationV225Test-1161683466-project Aug 18 11:35:04.416691 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:35:04.416691 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:35:04.416691 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 36162046d3d84db98ce76b19770f6322 Aug 18 11:35:04.416691 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1161683466-project Aug 18 11:35:04.416691 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:35:04.416691 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 2e802eca-675c-4376-8bdb-666b223637db could not be found. Aug 18 11:35:04.416691 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '2e802eca-675c-4376-8bdb-666b223637db'} Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e802eca-675c-4376-8bdb-666b223637db could not be found. Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:04.417399 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e802eca-675c-4376-8bdb-666b223637db could not be found. Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e802eca-675c-4376-8bdb-666b223637db could not be found. Aug 18 11:35:04.419548 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:04.421134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c861edfe-e562-4a2d-80f7-1c39a106b07e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Returning 404 to user: Instance 2e802eca-675c-4376-8bdb-666b223637db could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:04.421134 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c861edfe-e562-4a2d-80f7-1c39a106b07e tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db" status: 404 len: 111 microversion: 2.25 time: 0.044269 Aug 18 11:35:04.421134 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1082/2229] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:35:04 2022] GET /compute/v2.1/servers/2e802eca-675c-4376-8bdb-666b223637db => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:35:04.425178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3b30906e-cfb5-46c1-9d58-f2d72b9b918d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:04.425677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3b30906e-cfb5-46c1-9d58-f2d72b9b918d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:04.432748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b30906e-cfb5-46c1-9d58-f2d72b9b918d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:04.433486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b30906e-cfb5-46c1-9d58-f2d72b9b918d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:04.434098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b30906e-cfb5-46c1-9d58-f2d72b9b918d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:04.434937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b30906e-cfb5-46c1-9d58-f2d72b9b918d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:04.435690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b30906e-cfb5-46c1-9d58-f2d72b9b918d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:04.436465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b30906e-cfb5-46c1-9d58-f2d72b9b918d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:04.465898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3b30906e-cfb5-46c1-9d58-f2d72b9b918d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:35:04.522242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:04.563374 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3b30906e-cfb5-46c1-9d58-f2d72b9b918d tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 204 len: 0 microversion: 2.25 time: 0.140496 Aug 18 11:35:04.564616 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1083/2230] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:35:04 2022] DELETE /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:35:04.578306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-be2af9d4-f00d-48ce-bbe8-08eac3b82ca2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:04.579322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-be2af9d4-f00d-48ce-bbe8-08eac3b82ca2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:04.586209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be2af9d4-f00d-48ce-bbe8-08eac3b82ca2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:04.587764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be2af9d4-f00d-48ce-bbe8-08eac3b82ca2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:04.588404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be2af9d4-f00d-48ce-bbe8-08eac3b82ca2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:04.589152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be2af9d4-f00d-48ce-bbe8-08eac3b82ca2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:04.589625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be2af9d4-f00d-48ce-bbe8-08eac3b82ca2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:04.590058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be2af9d4-f00d-48ce-bbe8-08eac3b82ca2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:04.749721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-be2af9d4-f00d-48ce-bbe8-08eac3b82ca2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:04.757635 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-deab9981-6418-4f61-9116-4196fc612aba tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.388973 Aug 18 11:35:04.757635 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1148/2231] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:35:04 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:04.763452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-be2af9d4-f00d-48ce-bbe8-08eac3b82ca2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:04.765100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-be2af9d4-f00d-48ce-bbe8-08eac3b82ca2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:04.766485 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-be2af9d4-f00d-48ce-bbe8-08eac3b82ca2 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1565 microversion: 2.25 time: 0.196977 Aug 18 11:35:04.767668 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1084/2232] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:35:04 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1565 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:35:04.770319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c26ccddf-4c61-45b4-a1e8-8e200372f166 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Action: 'create', calling method: .version_select at 0x7f519f78ab80>, body: {"security_group_rule": {"parent_group_id": "c2fc7d14-0d4a-4bef-bcda-5190decf826b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:04.935057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-18dd3c4f-1aeb-49f3-ba11-a76e97915125 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:04.936793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-18dd3c4f-1aeb-49f3-ba11-a76e97915125 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:04.943865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18dd3c4f-1aeb-49f3-ba11-a76e97915125 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:04.944574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18dd3c4f-1aeb-49f3-ba11-a76e97915125 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:04.945354 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18dd3c4f-1aeb-49f3-ba11-a76e97915125 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:04.946484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18dd3c4f-1aeb-49f3-ba11-a76e97915125 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:04.947719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18dd3c4f-1aeb-49f3-ba11-a76e97915125 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:04.948512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18dd3c4f-1aeb-49f3-ba11-a76e97915125 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:05.031310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-18dd3c4f-1aeb-49f3-ba11-a76e97915125 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:05.041662 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-18dd3c4f-1aeb-49f3-ba11-a76e97915125 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 200 len: 1443 microversion: 2.1 time: 0.112273 Aug 18 11:35:05.046172 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1085/2233] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:04 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 1443 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:05.051023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-53526cd6-a95a-40e1-a4c1-626c03166454 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f5c3790>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:05.107190 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-53526cd6-a95a-40e1-a4c1-626c03166454 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 200 len: 1450 microversion: 2.1 time: 0.059375 Aug 18 11:35:05.107689 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1086/2234] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:05 2022] GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 1450 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:05.112254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-7b0ab2fa-f8be-43a7-af51-d37233a7eef2 req-653d7977-ff90-476a-bd72-8f925e6c7008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e3865d-a413-4c57-b0dc-1b29e76be1de", "name": "network-vif-unplugged", "status": "completed", "tag": "1fd7f00c-a7c9-42e6-b6f0-3b9378c92c89"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:05.121867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7b0ab2fa-f8be-43a7-af51-d37233a7eef2 req-653d7977-ff90-476a-bd72-8f925e6c7008 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:05.122354 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7b0ab2fa-f8be-43a7-af51-d37233a7eef2 req-653d7977-ff90-476a-bd72-8f925e6c7008 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:05.123096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7b0ab2fa-f8be-43a7-af51-d37233a7eef2 req-653d7977-ff90-476a-bd72-8f925e6c7008 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:05.135822 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-7b0ab2fa-f8be-43a7-af51-d37233a7eef2 req-653d7977-ff90-476a-bd72-8f925e6c7008 service nova] Creating event network-vif-unplugged:1fd7f00c-a7c9-42e6-b6f0-3b9378c92c89 for instance 51e3865d-a413-4c57-b0dc-1b29e76be1de on n-h1-853611-3 Aug 18 11:35:05.141146 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-7b0ab2fa-f8be-43a7-af51-d37233a7eef2 req-653d7977-ff90-476a-bd72-8f925e6c7008 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032368 Aug 18 11:35:05.142525 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1087/2235] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:05.148356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4513c689-3bbe-4d3a-b875-5c61e37b0289 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:05.152275 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4513c689-3bbe-4d3a-b875-5c61e37b0289 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:05.165054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4513c689-3bbe-4d3a-b875-5c61e37b0289 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:05.165975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4513c689-3bbe-4d3a-b875-5c61e37b0289 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:05.168142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4513c689-3bbe-4d3a-b875-5c61e37b0289 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:05.169046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4513c689-3bbe-4d3a-b875-5c61e37b0289 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:05.169680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4513c689-3bbe-4d3a-b875-5c61e37b0289 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:05.170374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4513c689-3bbe-4d3a-b875-5c61e37b0289 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:05.338395 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c26ccddf-4c61-45b4-a1e8-8e200372f166 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.572548 Aug 18 11:35:05.345312 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1149/2236] 10.222.0.73 () {60 vars in 1195 bytes} [Thu Aug 18 11:35:04 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:05.350111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-44eb0fff-c6ec-4fc4-95b0-e284ce1cb35d tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Action: 'create', calling method: .version_select at 0x7f51b0dc3e50>, body: {"security_group_rule": {"parent_group_id": "c2fc7d14-0d4a-4bef-bcda-5190decf826b", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:05.599899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4513c689-3bbe-4d3a-b875-5c61e37b0289 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:05.616329 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4513c689-3bbe-4d3a-b875-5c61e37b0289 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 0.472402 Aug 18 11:35:05.618844 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1088/2237] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:05 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:05.625481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a79f72ad-c5e8-4e4f-9580-7b073de5db57 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:05.639398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a79f72ad-c5e8-4e4f-9580-7b073de5db57 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:05.642881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:05.657363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a79f72ad-c5e8-4e4f-9580-7b073de5db57 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:05.658420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a79f72ad-c5e8-4e4f-9580-7b073de5db57 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:05.659139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a79f72ad-c5e8-4e4f-9580-7b073de5db57 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:05.660532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a79f72ad-c5e8-4e4f-9580-7b073de5db57 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:05.661423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a79f72ad-c5e8-4e4f-9580-7b073de5db57 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:05.662305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a79f72ad-c5e8-4e4f-9580-7b073de5db57 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:05.700198 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-44eb0fff-c6ec-4fc4-95b0-e284ce1cb35d tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.353747 Aug 18 11:35:05.701040 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1150/2238] 10.222.0.73 () {60 vars in 1195 bytes} [Thu Aug 18 11:35:05 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:05.706089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7848d663-243a-4c65-80ce-bf0b93d122a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:05.706924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7848d663-243a-4c65-80ce-bf0b93d122a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:05.723955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7848d663-243a-4c65-80ce-bf0b93d122a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:05.724454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7848d663-243a-4c65-80ce-bf0b93d122a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:05.724893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7848d663-243a-4c65-80ce-bf0b93d122a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:05.725611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7848d663-243a-4c65-80ce-bf0b93d122a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:05.726180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7848d663-243a-4c65-80ce-bf0b93d122a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:05.726803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7848d663-243a-4c65-80ce-bf0b93d122a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:06.008125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a79f72ad-c5e8-4e4f-9580-7b073de5db57 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:06.016844 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a79f72ad-c5e8-4e4f-9580-7b073de5db57 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.395126 Aug 18 11:35:06.020511 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1089/2239] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:05 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:06.032725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-aa492183-dad8-4c25-9476-b9f3fef9f749 req-b12136c7-2c81-45ca-9a03-3273225d7caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "995b6878-0830-4d2c-87ca-d3eed8a35f22", "name": "network-vif-deleted", "tag": "a724a63e-95c2-4d42-8094-45a0c52650a9"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:06.052393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-aa492183-dad8-4c25-9476-b9f3fef9f749 req-b12136c7-2c81-45ca-9a03-3273225d7caa service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:06.053956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-aa492183-dad8-4c25-9476-b9f3fef9f749 req-b12136c7-2c81-45ca-9a03-3273225d7caa service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:06.054608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-aa492183-dad8-4c25-9476-b9f3fef9f749 req-b12136c7-2c81-45ca-9a03-3273225d7caa service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:06.090137 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-aa492183-dad8-4c25-9476-b9f3fef9f749 req-b12136c7-2c81-45ca-9a03-3273225d7caa service nova] Creating event network-vif-deleted:a724a63e-95c2-4d42-8094-45a0c52650a9 for instance 995b6878-0830-4d2c-87ca-d3eed8a35f22 on n-h1-853611-3 Aug 18 11:35:06.096788 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-aa492183-dad8-4c25-9476-b9f3fef9f749 req-b12136c7-2c81-45ca-9a03-3273225d7caa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074780 Aug 18 11:35:06.100744 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1090/2240] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:06.110339 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b1faacce-c281-413e-8520-cb40700bb1e9 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Calling method '.version_select at 0x7f519f62df70>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:06.139617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7848d663-243a-4c65-80ce-bf0b93d122a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:06.149423 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7848d663-243a-4c65-80ce-bf0b93d122a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1315 microversion: 2.1 time: 0.447118 Aug 18 11:35:06.150074 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1151/2241] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:05 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:06.231481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9bc28a72-3258-409c-8ffa-63fcad151c54 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Action: 'create', calling method: .version_select at 0x7f51b0da2550>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXJt6T9ipGyQhOLBphFCFQUuxHyhMtKd52k++ZwcyOKzEwRzx+bNpUp/yZ+flu6A94fSP5rwQ2L4GJCazFHPVio4LeAUqyt2myAcDT58aP8MDRirKyjed7GEkj6jx8xJQ=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9bc28a72-3258-409c-8ffa-63fcad151c54 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Request method failure captured: Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 257 Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iPplMyLE7cAVoFSDgOhcCRcQS6lEfHl7Er2RXBSi3fHY3bH75eUb8DNPATp3L1cJQlFC5DjcIfamUFtqrC-Pr-5rcnEHjlRehmbgdgKOu4w1mxYs5p4-zSQ4vlr8YWKYxg6T8ZRgPQP4npS-OskEn-xzdUZHg-atvbPwVvrk0L-8m8 Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:35:06.235956 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:35:06.237100 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d8416dce549a4a928df611c20012a76f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d8416dce549a4a928df611c20012a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:06.237100 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:06.237100 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:06.237100 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:06.237100 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:06.237100 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:35:06.237100 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:35:06.237100 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 40ac0071ac5b4d52ad024f75de8ee29a Aug 18 11:35:06.237100 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:06.237100 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:35:06.237100 n-d-853611-3 devstack@n-api.service[122210]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXJt6T9ipGyQhOLBphFCFQUuxHyhMtKd52k++ZwcyOKzEwRzx+bNpUp/yZ+flu6A94fSP5rwQ2L4GJCazFHPVio4LeAUqyt2myAcDT58aP8MDRirKyjed7GEkj6jx8xJQ=="}} Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXJt6T9ipGyQhOLBphFCFQUuxHyhMtKd52k++ZwcyOKzEwRzx+bNpUp/yZ+flu6A94fSP5rwQ2L4GJCazFHPVio4LeAUqyt2myAcDT58aP8MDRirKyjed7GEkj6jx8xJQ=='}}} Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:06.237724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:35:06.240418 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:35:06.242173 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:35:06.243457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 18 11:35:06.243457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.246189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9bc28a72-3258-409c-8ffa-63fcad151c54 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:06.247331 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9bc28a72-3258-409c-8ffa-63fcad151c54 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.096251 Aug 18 11:35:06.249954 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1152/2242] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:35:06 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:35:06.262272 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b1faacce-c281-413e-8520-cb40700bb1e9 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "GET /compute/v2.1/os-security-groups/c2fc7d14-0d4a-4bef-bcda-5190decf826b" status: 200 len: 665 microversion: 2.1 time: 0.155962 Aug 18 11:35:06.263103 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1091/2243] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:35:06 2022] GET /compute/v2.1/os-security-groups/c2fc7d14-0d4a-4bef-bcda-5190decf826b => generated 665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:06.264522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a8271e31-31ec-46e3-905e-4a94293df804 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:06.265289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a8271e31-31ec-46e3-905e-4a94293df804 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:06.269170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7b55fdb0-4122-4d28-bbb0-b58cf94dcd14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:06.270020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7b55fdb0-4122-4d28-bbb0-b58cf94dcd14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: 995b6878-0830-4d2c-87ca-d3eed8a35f22] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:06.277609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b55fdb0-4122-4d28-bbb0-b58cf94dcd14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:06.278105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b55fdb0-4122-4d28-bbb0-b58cf94dcd14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:06.278588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b55fdb0-4122-4d28-bbb0-b58cf94dcd14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:06.279303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b55fdb0-4122-4d28-bbb0-b58cf94dcd14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:06.280032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b55fdb0-4122-4d28-bbb0-b58cf94dcd14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:06.280487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b55fdb0-4122-4d28-bbb0-b58cf94dcd14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:06.282422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8271e31-31ec-46e3-905e-4a94293df804 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:06.283238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8271e31-31ec-46e3-905e-4a94293df804 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:06.283916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8271e31-31ec-46e3-905e-4a94293df804 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:06.284861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8271e31-31ec-46e3-905e-4a94293df804 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:06.285540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8271e31-31ec-46e3-905e-4a94293df804 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:06.286076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8271e31-31ec-46e3-905e-4a94293df804 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:06.300150 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-7b55fdb0-4122-4d28-bbb0-b58cf94dcd14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] HTTP exception thrown: Instance 995b6878-0830-4d2c-87ca-d3eed8a35f22 could not be found. Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7b55fdb0-4122-4d28-bbb0-b58cf94dcd14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Request method failure captured: Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 HTTP/1.1 Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iIZ73k_YPF_W2EIMMri9FswITgky3Trv8mszMC_q7DqKHRQdz1obOf92XsfI5eHcOKQ4Taq-4WecACwzcaZUhv56AdpPX-KscZp_JKFwtxRcvZ5iK0fyDGxpMgEaIqG5cDWy9Nd7bp6IxhUSg7zZ_33iKe3ZgVsB8DA6NyW9vAbKfs Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 22660df6ec1a4f718a08cbeda2be364c Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-LiveMigrationTest-290401536 Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:35:06.302419 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:35:06.305638 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:06.305638 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-LiveMigrationTest-290401536 Aug 18 11:35:06.305638 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 22660df6ec1a4f718a08cbeda2be364c Aug 18 11:35:06.305638 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-LiveMigrationTest-290401536 Aug 18 11:35:06.305638 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-LiveMigrationTest-290401536-project Aug 18 11:35:06.305638 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:35:06.305638 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:35:06.305638 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 0cf7fe4236764bea83c6560516441759 Aug 18 11:35:06.305638 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-LiveMigrationTest-290401536-project Aug 18 11:35:06.305638 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:35:06.305638 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 995b6878-0830-4d2c-87ca-d3eed8a35f22 could not be found. Aug 18 11:35:06.305638 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '995b6878-0830-4d2c-87ca-d3eed8a35f22'} Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 995b6878-0830-4d2c-87ca-d3eed8a35f22 could not be found. Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:06.306630 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 995b6878-0830-4d2c-87ca-d3eed8a35f22 could not be found. Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 995b6878-0830-4d2c-87ca-d3eed8a35f22 could not be found. Aug 18 11:35:06.308006 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.310208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7b55fdb0-4122-4d28-bbb0-b58cf94dcd14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Returning 404 to user: Instance 995b6878-0830-4d2c-87ca-d3eed8a35f22 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:06.311542 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7b55fdb0-4122-4d28-bbb0-b58cf94dcd14 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22" status: 404 len: 111 microversion: 2.1 time: 0.047264 Aug 18 11:35:06.312188 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1092/2244] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:06 2022] GET /compute/v2.1/servers/995b6878-0830-4d2c-87ca-d3eed8a35f22 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:35:06.323926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3eabdba9-025d-41fb-80fd-90ade25250a0 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f5c3790>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:06.371306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a8271e31-31ec-46e3-905e-4a94293df804 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:06.383385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a8271e31-31ec-46e3-905e-4a94293df804 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:06.385148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a8271e31-31ec-46e3-905e-4a94293df804 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36162046d3d84db98ce76b19770f6322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51319140bae948cf873746a482aaf588', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:06.386337 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a8271e31-31ec-46e3-905e-4a94293df804 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 200 len: 1523 microversion: 2.25 time: 0.128928 Aug 18 11:35:06.395153 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3eabdba9-025d-41fb-80fd-90ade25250a0 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 200 len: 1450 microversion: 2.1 time: 0.079451 Aug 18 11:35:06.395734 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1093/2245] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:06 2022] GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 1450 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:06.403493 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1153/2246] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:35:06 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:35:06.405691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8a57bdb7-5a8d-411c-8651-2242453716d5 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Action: 'create', calling method: .version_select at 0x7f519f712e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1333041747", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:06.408482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3292a100-800d-4633-9b57-591c0c734065 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Calling method '.version_select at 0x7f519f78ab80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:06.425610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-8a57bdb7-5a8d-411c-8651-2242453716d5 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Getting quotas for project d8416dce549a4a928df611c20012a76f. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:35:06.432410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-8a57bdb7-5a8d-411c-8651-2242453716d5 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Getting quotas for user 40ac0071ac5b4d52ad024f75de8ee29a and project d8416dce549a4a928df611c20012a76f. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:35:06.455008 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-8a57bdb7-5a8d-411c-8651-2242453716d5 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8a57bdb7-5a8d-411c-8651-2242453716d5 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Request method failure captured: Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 2167 Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iPplMyLE7cAVoFSDgOhcCRcQS6lEfHl7Er2RXBSi3fHY3bH75eUb8DNPATp3L1cJQlFC5DjcIfamUFtqrC-Pr-5rcnEHjlRehmbgdgKOu4w1mxYs5p4-zSQ4vlr8YWKYxg6T8ZRgPQP4npS-OskEn-xzdUZHg-atvbPwVvrk0L-8m8 Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d8416dce549a4a928df611c20012a76f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d8416dce549a4a928df611c20012a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 40ac0071ac5b4d52ad024f75de8ee29a Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1333041747", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:35:06.472767 n-d-853611-3 devstack@n-api.service[122209]: exception: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1333041747', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:06.474749 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8a57bdb7-5a8d-411c-8651-2242453716d5 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:06.477522 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8a57bdb7-5a8d-411c-8651-2242453716d5 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.077884 Aug 18 11:35:06.483903 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1094/2247] 10.222.0.73 () {60 vars in 1160 bytes} [Thu Aug 18 11:35:06 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:35:06.491459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-0e9bfeb1-fd60-416e-a714-0dfc45ee6b0e req-2a6c2cfd-e9df-4787-9f02-2014c101a85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ebd4b99-aee2-480b-b361-3bdc41f5a871", "name": "network-vif-deleted", "tag": "c4f46619-40b4-4c76-b5f3-e22d33b57732"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:06.503046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0e9bfeb1-fd60-416e-a714-0dfc45ee6b0e req-2a6c2cfd-e9df-4787-9f02-2014c101a85f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:06.503566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0e9bfeb1-fd60-416e-a714-0dfc45ee6b0e req-2a6c2cfd-e9df-4787-9f02-2014c101a85f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:06.504367 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0e9bfeb1-fd60-416e-a714-0dfc45ee6b0e req-2a6c2cfd-e9df-4787-9f02-2014c101a85f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:06.517462 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-0e9bfeb1-fd60-416e-a714-0dfc45ee6b0e req-2a6c2cfd-e9df-4787-9f02-2014c101a85f service nova] Creating event network-vif-deleted:c4f46619-40b4-4c76-b5f3-e22d33b57732 for instance 6ebd4b99-aee2-480b-b361-3bdc41f5a871 on n-h1-853611-3 Aug 18 11:35:06.522714 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-0e9bfeb1-fd60-416e-a714-0dfc45ee6b0e req-2a6c2cfd-e9df-4787-9f02-2014c101a85f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036676 Aug 18 11:35:06.524480 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1095/2248] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:06.529948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7a852632-7218-4787-b31c-741b65280ae2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:06.530573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7a852632-7218-4787-b31c-741b65280ae2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:06.537572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a852632-7218-4787-b31c-741b65280ae2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:06.538067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a852632-7218-4787-b31c-741b65280ae2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:06.539053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a852632-7218-4787-b31c-741b65280ae2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:06.539825 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a852632-7218-4787-b31c-741b65280ae2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:06.540527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a852632-7218-4787-b31c-741b65280ae2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:06.541112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a852632-7218-4787-b31c-741b65280ae2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:06.571619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7a852632-7218-4787-b31c-741b65280ae2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:35:06.621950 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3292a100-800d-4633-9b57-591c0c734065 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-group-rules/e3962aa0-64c0-4aa6-b31e-07fc5996c0b2" status: 202 len: 0 microversion: 2.1 time: 0.217013 Aug 18 11:35:06.622777 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1154/2249] 10.222.0.73 () {58 vars in 1287 bytes} [Thu Aug 18 11:35:06 2022] DELETE /compute/v2.1/os-security-group-rules/e3962aa0-64c0-4aa6-b31e-07fc5996c0b2 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:06.637130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a8cb029-e929-4d40-b8e4-f11d75939d18 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Action: 'create', calling method: .version_select at 0x7f519fedc700>, body: {"keypair": {"name": "tempest-keypair-1525963859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuq3AK/DjpMpc3MhPCn6QX0SWcXd8dABBp4s3Umc9TBNKTsG8EAGXPeWr1W/k/rbLJjcoMBBquu7caJRQH4dER3gvR7h748CZm92vp+yr/teduLpxPuVZ1rRPbDcigP4A=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:06.656868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-6a8cb029-e929-4d40-b8e4-f11d75939d18 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Getting quotas for project d8416dce549a4a928df611c20012a76f. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:35:06.662957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-6a8cb029-e929-4d40-b8e4-f11d75939d18 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Getting quotas for user 40ac0071ac5b4d52ad024f75de8ee29a and project d8416dce549a4a928df611c20012a76f. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:35:06.696390 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6a8cb029-e929-4d40-b8e4-f11d75939d18 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072076 Aug 18 11:35:06.697797 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1155/2250] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:35:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:06.704867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-089398f7-4d8f-4a0c-9773-da587184ab44 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Calling method '.version_select at 0x7f519fda29d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:06.714782 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7a852632-7218-4787-b31c-741b65280ae2 tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 204 len: 0 microversion: 2.1 time: 0.185526 Aug 18 11:35:06.716605 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1096/2251] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:35:06 2022] DELETE /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:35:06.728442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3bd347d3-34cf-491a-8504-56c2d47d0bfd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:06.729431 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3bd347d3-34cf-491a-8504-56c2d47d0bfd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:06.747908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bd347d3-34cf-491a-8504-56c2d47d0bfd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:06.749681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bd347d3-34cf-491a-8504-56c2d47d0bfd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:06.750519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bd347d3-34cf-491a-8504-56c2d47d0bfd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:06.751301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bd347d3-34cf-491a-8504-56c2d47d0bfd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:06.751770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bd347d3-34cf-491a-8504-56c2d47d0bfd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:06.752206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bd347d3-34cf-491a-8504-56c2d47d0bfd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:06.935200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3bd347d3-34cf-491a-8504-56c2d47d0bfd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:06.946450 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3bd347d3-34cf-491a-8504-56c2d47d0bfd tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 0.226581 Aug 18 11:35:06.948660 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1097/2252] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:06 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:06.954122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa462bd6-ea16-4a50-849c-fab2ee752d41 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Action: 'create', calling method: .version_select at 0x7f519f5beb80>, body: {"keypair": {"name": "tempest-keypair-1525963859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwP7TBsyvs2jH8ujpUMDpdB2XixeSvlldoaq8qlJ/XMB8FdhquoRQHCDxWOSjyocje4gwcnt4+vrx3WLoT4+/yjpxqyWi8iadXgMZzkKP/aLpobM072yrOSZJqWc1OQtQ=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:06.972942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-fa462bd6-ea16-4a50-849c-fab2ee752d41 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Getting quotas for project d8416dce549a4a928df611c20012a76f. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:35:06.979244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-fa462bd6-ea16-4a50-849c-fab2ee752d41 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Getting quotas for user 40ac0071ac5b4d52ad024f75de8ee29a and project d8416dce549a4a928df611c20012a76f. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:35:07.016972 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-fa462bd6-ea16-4a50-849c-fab2ee752d41 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] HTTP exception thrown: Key pair 'tempest-keypair-1525963859' already exists. Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa462bd6-ea16-4a50-849c-fab2ee752d41 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Request method failure captured: Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 273 Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iPplMyLE7cAVoFSDgOhcCRcQS6lEfHl7Er2RXBSi3fHY3bH75eUb8DNPATp3L1cJQlFC5DjcIfamUFtqrC-Pr-5rcnEHjlRehmbgdgKOu4w1mxYs5p4-zSQ4vlr8YWKYxg6T8ZRgPQP4npS-OskEn-xzdUZHg-atvbPwVvrk0L-8m8 Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d8416dce549a4a928df611c20012a76f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d8416dce549a4a928df611c20012a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 40ac0071ac5b4d52ad024f75de8ee29a Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: {"keypair": {"name": "tempest-keypair-1525963859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwP7TBsyvs2jH8ujpUMDpdB2XixeSvlldoaq8qlJ/XMB8FdhquoRQHCDxWOSjyocje4gwcnt4+vrx3WLoT4+/yjpxqyWi8iadXgMZzkKP/aLpobM072yrOSZJqWc1OQtQ=="}} Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: exception: Key pair 'tempest-keypair-1525963859' already exists. Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1525963859', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwP7TBsyvs2jH8ujpUMDpdB2XixeSvlldoaq8qlJ/XMB8FdhquoRQHCDxWOSjyocje4gwcnt4+vrx3WLoT4+/yjpxqyWi8iadXgMZzkKP/aLpobM072yrOSZJqWc1OQtQ=='}}} Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result.read() Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '40ac0071ac5b4d52ad024f75de8ee29a-tempest-keypair-1525963859' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 18 11:35:07.033372 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi session.flush() Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result.read() Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 18 11:35:07.041116 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '40ac0071ac5b4d52ad024f75de8ee29a-tempest-keypair-1525963859' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 18, 11, 35, 7, 4221), 'updated_at': None, 'name': 'tempest-keypair-1525963859', 'user_id': '40ac0071ac5b4d52ad024f75de8ee29a', 'fingerprint': '53:69:00:10:fd:bb:4f:4a:a7:4e:23:8a:02:99:1d:a3', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwP7TBsyvs2jH8ujpUMDpdB2XixeSvlldoaq8qlJ/XMB8FdhquoRQHCDxWOSjyocje4gwcnt4+vrx3WLoT4+/yjpxqyWi8iadXgMZzkKP/aLpobM072yrOSZJqWc1OQtQ==', 'type': 'ssh'}] Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6743, in import_key_pair Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi keypair.create() Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._create() Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1525963859' already exists. Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 18 11:35:07.044783 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1525963859' already exists. Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1525963859' already exists. Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa462bd6-ea16-4a50-849c-fab2ee752d41 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Returning 409 to user: Key pair 'tempest-keypair-1525963859' already exists. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fa462bd6-ea16-4a50-849c-fab2ee752d41 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.085368 Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1098/2253] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:35:06 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-70defb71-b8a9-4743-b705-b7d0473a09ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:07.051390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-70defb71-b8a9-4743-b705-b7d0473a09ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:07.052523 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-70defb71-b8a9-4743-b705-b7d0473a09ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:07.052523 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-70defb71-b8a9-4743-b705-b7d0473a09ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:07.052908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-70defb71-b8a9-4743-b705-b7d0473a09ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:07.055601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-70defb71-b8a9-4743-b705-b7d0473a09ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:07.056254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-70defb71-b8a9-4743-b705-b7d0473a09ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:07.056702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-70defb71-b8a9-4743-b705-b7d0473a09ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:07.139210 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-089398f7-4d8f-4a0c-9773-da587184ab44 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/c2fc7d14-0d4a-4bef-bcda-5190decf826b" status: 202 len: 0 microversion: 2.1 time: 0.440104 Aug 18 11:35:07.139944 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1156/2254] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:35:06 2022] DELETE /compute/v2.1/os-security-groups/c2fc7d14-0d4a-4bef-bcda-5190decf826b => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:07.150520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9519807f-14b3-4e05-844b-099f9d66c0a5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:07.151498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9519807f-14b3-4e05-844b-099f9d66c0a5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:07.165443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9519807f-14b3-4e05-844b-099f9d66c0a5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:07.171754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9519807f-14b3-4e05-844b-099f9d66c0a5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:07.172410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9519807f-14b3-4e05-844b-099f9d66c0a5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:07.173319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9519807f-14b3-4e05-844b-099f9d66c0a5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:07.173976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9519807f-14b3-4e05-844b-099f9d66c0a5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:07.174619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9519807f-14b3-4e05-844b-099f9d66c0a5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:07.181672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:07.357937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-70defb71-b8a9-4743-b705-b7d0473a09ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:07.369402 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-70defb71-b8a9-4743-b705-b7d0473a09ee tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1500 microversion: 2.1 time: 0.332158 Aug 18 11:35:07.371452 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1099/2255] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:07 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1500 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:07.377273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-02d6504c-1431-4b87-975f-57559626be4b tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Calling method '.version_select at 0x7f519f2d49d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:07.383492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9519807f-14b3-4e05-844b-099f9d66c0a5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:07.392770 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9519807f-14b3-4e05-844b-099f9d66c0a5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.248696 Aug 18 11:35:07.394125 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1157/2256] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:07 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:07.406212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ca6269cf-3b62-4113-8788-e5525335d44d tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Calling method '.version_select at 0x7f519f598dc0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:07.433185 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-02d6504c-1431-4b87-975f-57559626be4b tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525963859" status: 202 len: 0 microversion: 2.1 time: 0.060506 Aug 18 11:35:07.434555 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1100/2257] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 11:35:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525963859 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:07.444054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-ca6269cf-3b62-4113-8788-e5525335d44d tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d190c473-0e99-4dc1-ad29-5d3d65ac8e48 does not exist", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:35:07.445522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1d212764-68de-4888-8d3d-1b3834f1921c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:07.446255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1d212764-68de-4888-8d3d-1b3834f1921c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:07.446556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.security_group_api [None req-ca6269cf-3b62-4113-8788-e5525335d44d tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Neutron security group d190c473-0e99-4dc1-ad29-5d3d65ac8e48 not found {{(pid=122210) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:35:07.447281 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-ca6269cf-3b62-4113-8788-e5525335d44d tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] HTTP exception thrown: Security group d190c473-0e99-4dc1-ad29-5d3d65ac8e48 does not exist Aug 18 11:35:07.447281 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-a7cfe737-a7ea-4129-a7cc-65525494a9a2'] Aug 18 11:35:07.454134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d212764-68de-4888-8d3d-1b3834f1921c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:07.455163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d212764-68de-4888-8d3d-1b3834f1921c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:07.456083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d212764-68de-4888-8d3d-1b3834f1921c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:07.456888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d212764-68de-4888-8d3d-1b3834f1921c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ca6269cf-3b62-4113-8788-e5525335d44d tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Request method failure captured: Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/os-security-groups/d190c473-0e99-4dc1-ad29-5d3d65ac8e48 HTTP/1.1 Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iPZD2T9qq9rYaZLqnS9NQltIUYpLhboiHAx_wdn_jhNRrGTNy7vNdhfYgaOUaFOW81J0KOez3bL8GtSn5grLIn5zV-pZWV-Dr9TUTU7pcckIwRw29CE3rquPEH9mKDaQLD49_-LaQWP5-EcCKgZ-OWDJaFfvkHi2B5j1URo53MBhvc Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 5cf97dd2d2504756ab20b08a39d5ca85 Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-498045311 Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5cf97dd2d2504756ab20b08a39d5ca85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5cf97dd2d2504756ab20b08a39d5ca85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5cf97dd2d2504756ab20b08a39d5ca85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5cf97dd2d2504756ab20b08a39d5ca85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupRulesTestJSON-498045311 Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 5cf97dd2d2504756ab20b08a39d5ca85 Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-498045311 Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupRulesTestJSON-498045311-project Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 5aebb1a21b4d4a32ad2fc6c763a763e2 Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupRulesTestJSON-498045311-project Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: exception: Security group d190c473-0e99-4dc1-ad29-5d3d65ac8e48 does not exist Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-a7cfe737-a7ea-4129-a7cc-65525494a9a2'] Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'd190c473-0e99-4dc1-ad29-5d3d65ac8e48'} Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:35:07.457560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d190c473-0e99-4dc1-ad29-5d3d65ac8e48 does not exist Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7cfe737-a7ea-4129-a7cc-65525494a9a2'] Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d190c473-0e99-4dc1-ad29-5d3d65ac8e48 does not exist Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7cfe737-a7ea-4129-a7cc-65525494a9a2'] Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d190c473-0e99-4dc1-ad29-5d3d65ac8e48 does not exist Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7cfe737-a7ea-4129-a7cc-65525494a9a2'] Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d190c473-0e99-4dc1-ad29-5d3d65ac8e48 does not exist Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a7cfe737-a7ea-4129-a7cc-65525494a9a2'] Aug 18 11:35:07.461878 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.468729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ca6269cf-3b62-4113-8788-e5525335d44d tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Returning 404 to user: Security group d190c473-0e99-4dc1-ad29-5d3d65ac8e48 does not exist Aug 18 11:35:07.468729 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-a7cfe737-a7ea-4129-a7cc-65525494a9a2'] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:07.468925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d212764-68de-4888-8d3d-1b3834f1921c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:07.468925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d212764-68de-4888-8d3d-1b3834f1921c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:07.469071 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ca6269cf-3b62-4113-8788-e5525335d44d tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/d190c473-0e99-4dc1-ad29-5d3d65ac8e48" status: 404 len: 194 microversion: 2.1 time: 0.070280 Aug 18 11:35:07.469071 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1158/2258] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:35:07 2022] DELETE /compute/v2.1/os-security-groups/d190c473-0e99-4dc1-ad29-5d3d65ac8e48 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:35:07.474903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ef8dc58f-9d7f-4a83-9a79-3fab7c910219 req-c8742fce-0c6f-4935-b64d-a66adccb2448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda29354-2be3-4b36-aa1e-4a96b0954806", "name": "network-vif-plugged", "status": "completed", "tag": "40179a13-a7d9-43a4-b12f-bec53ae16fd6"}, {"server_uuid": "61b34fc6-468f-4179-b73f-6776c809d055", "name": "network-vif-plugged", "status": "completed", "tag": "7aa41449-e2a8-4d62-a5db-c9bcce1f4420"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:07.488031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ef8dc58f-9d7f-4a83-9a79-3fab7c910219 req-c8742fce-0c6f-4935-b64d-a66adccb2448 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:07.488684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ef8dc58f-9d7f-4a83-9a79-3fab7c910219 req-c8742fce-0c6f-4935-b64d-a66adccb2448 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:07.489247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ef8dc58f-9d7f-4a83-9a79-3fab7c910219 req-c8742fce-0c6f-4935-b64d-a66adccb2448 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:07.506274 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ef8dc58f-9d7f-4a83-9a79-3fab7c910219 req-c8742fce-0c6f-4935-b64d-a66adccb2448 service nova] Creating event network-vif-plugged:40179a13-a7d9-43a4-b12f-bec53ae16fd6 for instance fda29354-2be3-4b36-aa1e-4a96b0954806 on n-h2-853611-3 Aug 18 11:35:07.506983 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ef8dc58f-9d7f-4a83-9a79-3fab7c910219 req-c8742fce-0c6f-4935-b64d-a66adccb2448 service nova] Creating event network-vif-plugged:7aa41449-e2a8-4d62-a5db-c9bcce1f4420 for instance 61b34fc6-468f-4179-b73f-6776c809d055 on n-h1-853611-3 Aug 18 11:35:07.518975 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ef8dc58f-9d7f-4a83-9a79-3fab7c910219 req-c8742fce-0c6f-4935-b64d-a66adccb2448 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051316 Aug 18 11:35:07.519737 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1159/2259] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:07.526771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-891281e2-0747-4ad4-b128-06fabd8c2cf3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:07.527646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-891281e2-0747-4ad4-b128-06fabd8c2cf3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] [instance: 6ebd4b99-aee2-480b-b361-3bdc41f5a871] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:07.538273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-891281e2-0747-4ad4-b128-06fabd8c2cf3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:07.539482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-891281e2-0747-4ad4-b128-06fabd8c2cf3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:07.539945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-891281e2-0747-4ad4-b128-06fabd8c2cf3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:07.540935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-891281e2-0747-4ad4-b128-06fabd8c2cf3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:07.541699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-891281e2-0747-4ad4-b128-06fabd8c2cf3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:07.542140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-891281e2-0747-4ad4-b128-06fabd8c2cf3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:07.565546 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-891281e2-0747-4ad4-b128-06fabd8c2cf3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] HTTP exception thrown: Instance 6ebd4b99-aee2-480b-b361-3bdc41f5a871 could not be found. Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-891281e2-0747-4ad4-b128-06fabd8c2cf3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Request method failure captured: Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 HTTP/1.1 Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iHfonnPQX3UJ8JVfLWKn0-FBTKN1-o3Xum7prCJ2FMsZdZvRcJbTv-8FrUmDTr-Wlg49nWJuhk-bpn_UY-LeVzzNa3m_Kxo5hgM8hOtgGSiqCxiFtvOEgk-Fwkg_0hf4Qntsc1Yrpr_ZAdG8yDS1A0RPRSVo189_-HZVJtp6ztfGbE Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.25 Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 51319140bae948cf873746a482aaf588 Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1161683466 Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51319140bae948cf873746a482aaf588"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/51319140bae948cf873746a482aaf588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_51319140bae948cf873746a482aaf588"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/51319140bae948cf873746a482aaf588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1161683466 Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 51319140bae948cf873746a482aaf588 Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1161683466 Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-LiveAutoBlockMigrationV225Test-1161683466-project Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 36162046d3d84db98ce76b19770f6322 Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1161683466-project Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 6ebd4b99-aee2-480b-b361-3bdc41f5a871 could not be found. Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '6ebd4b99-aee2-480b-b361-3bdc41f5a871'} Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ebd4b99-aee2-480b-b361-3bdc41f5a871 could not be found. Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ebd4b99-aee2-480b-b361-3bdc41f5a871 could not be found. Aug 18 11:35:07.567870 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.573249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:07.573249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.573249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.573249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:07.573249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:07.573249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:07.573249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:07.573249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ebd4b99-aee2-480b-b361-3bdc41f5a871 could not be found. Aug 18 11:35:07.573249 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.573249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-891281e2-0747-4ad4-b128-06fabd8c2cf3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] Returning 404 to user: Instance 6ebd4b99-aee2-480b-b361-3bdc41f5a871 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:07.573249 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-891281e2-0747-4ad4-b128-06fabd8c2cf3 tempest-LiveAutoBlockMigrationV225Test-1161683466 tempest-LiveAutoBlockMigrationV225Test-1161683466-project] 10.222.0.73 "GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871" status: 404 len: 111 microversion: 2.25 time: 0.048758 Aug 18 11:35:07.573249 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1160/2260] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:35:07 2022] GET /compute/v2.1/servers/6ebd4b99-aee2-480b-b361-3bdc41f5a871 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:35:07.582860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-622d5afd-0a05-4076-81f2-4c994533d070 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fdeca60>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:07.664457 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-622d5afd-0a05-4076-81f2-4c994533d070 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 200 len: 1450 microversion: 2.1 time: 0.086683 Aug 18 11:35:07.664840 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1161/2261] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:07 2022] GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 1450 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:07.673704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2aba4420-fc52-4e36-a2b9-1bec634dbfcb tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Action: 'create', calling method: .version_select at 0x7f519f5984c0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtYh+BwowZfYpFCn5vsT+75An5s6YXAtzR0bbBoiS9XrXA28bnCjRApD4ub1om5rzTMDKjhK5oNmaP9/LcpTKB1jwaHvUKEycquSpojR98azPp6das86RWspSLJfiooXA=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2aba4420-fc52-4e36-a2b9-1bec634dbfcb tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Request method failure captured: Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 247 Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iPplMyLE7cAVoFSDgOhcCRcQS6lEfHl7Er2RXBSi3fHY3bH75eUb8DNPATp3L1cJQlFC5DjcIfamUFtqrC-Pr-5rcnEHjlRehmbgdgKOu4w1mxYs5p4-zSQ4vlr8YWKYxg6T8ZRgPQP4npS-OskEn-xzdUZHg-atvbPwVvrk0L-8m8 Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d8416dce549a4a928df611c20012a76f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d8416dce549a4a928df611c20012a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 40ac0071ac5b4d52ad024f75de8ee29a Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtYh+BwowZfYpFCn5vsT+75An5s6YXAtzR0bbBoiS9XrXA28bnCjRApD4ub1om5rzTMDKjhK5oNmaP9/LcpTKB1jwaHvUKEycquSpojR98azPp6das86RWspSLJfiooXA=="}} Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtYh+BwowZfYpFCn5vsT+75An5s6YXAtzR0bbBoiS9XrXA28bnCjRApD4ub1om5rzTMDKjhK5oNmaP9/LcpTKB1jwaHvUKEycquSpojR98azPp6das86RWspSLJfiooXA=='}}} Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi '' Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:35:07.678042 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 18 11:35:07.682406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:07.685220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2aba4420-fc52-4e36-a2b9-1bec634dbfcb tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:07.686102 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2aba4420-fc52-4e36-a2b9-1bec634dbfcb tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.020164 Aug 18 11:35:07.686714 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1162/2262] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:35:07 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:35:07.696241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-840111e8-61c6-407f-ad3b-2bbf313d5fae tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Calling method '.version_select at 0x7f519f5980d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:07.919842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1d212764-68de-4888-8d3d-1b3834f1921c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:07.930079 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1d212764-68de-4888-8d3d-1b3834f1921c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1315 microversion: 2.1 time: 0.493604 Aug 18 11:35:07.931536 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1101/2263] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:07 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:07.944270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-62bdae0c-443b-4729-b1be-7360cec4d4b9 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Action: 'create', calling method: .version_select at 0x7f519f39fa60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1037822604", "public_key": " "}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:07.990068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-62bdae0c-443b-4729-b1be-7360cec4d4b9 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Getting quotas for project d8416dce549a4a928df611c20012a76f. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:35:07.998120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-62bdae0c-443b-4729-b1be-7360cec4d4b9 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Getting quotas for user 40ac0071ac5b4d52ad024f75de8ee29a and project d8416dce549a4a928df611c20012a76f. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:35:08.021362 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-62bdae0c-443b-4729-b1be-7360cec4d4b9 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-62bdae0c-443b-4729-b1be-7360cec4d4b9 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Request method failure captured: Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 95 Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iPplMyLE7cAVoFSDgOhcCRcQS6lEfHl7Er2RXBSi3fHY3bH75eUb8DNPATp3L1cJQlFC5DjcIfamUFtqrC-Pr-5rcnEHjlRehmbgdgKOu4w1mxYs5p4-zSQ4vlr8YWKYxg6T8ZRgPQP4npS-OskEn-xzdUZHg-atvbPwVvrk0L-8m8 Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d8416dce549a4a928df611c20012a76f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d8416dce549a4a928df611c20012a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 40ac0071ac5b4d52ad024f75de8ee29a Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1037822604", "public_key": " "}} Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: exception: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1037822604', 'public_key': ' '}}} Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:08.023679 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:08.027240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.030932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-62bdae0c-443b-4729-b1be-7360cec4d4b9 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:08.031970 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-62bdae0c-443b-4729-b1be-7360cec4d4b9 tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.098568 Aug 18 11:35:08.042734 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1102/2264] 10.222.0.73 () {60 vars in 1158 bytes} [Thu Aug 18 11:35:07 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:35:08.053244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-be3eec74-b3b0-490e-b82b-e76877985731 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:08.054214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-be3eec74-b3b0-490e-b82b-e76877985731 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:08.061425 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be3eec74-b3b0-490e-b82b-e76877985731 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:08.062145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be3eec74-b3b0-490e-b82b-e76877985731 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:08.062882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be3eec74-b3b0-490e-b82b-e76877985731 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:08.063831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be3eec74-b3b0-490e-b82b-e76877985731 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:08.064532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be3eec74-b3b0-490e-b82b-e76877985731 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:08.065571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be3eec74-b3b0-490e-b82b-e76877985731 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:08.112505 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-840111e8-61c6-407f-ad3b-2bbf313d5fae tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/0a2d7c11-e5b8-4cce-b17b-d7a55c6f09f6" status: 202 len: 0 microversion: 2.1 time: 0.424371 Aug 18 11:35:08.113488 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1163/2265] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:35:07 2022] DELETE /compute/v2.1/os-security-groups/0a2d7c11-e5b8-4cce-b17b-d7a55c6f09f6 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:08.119109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a71be584-08c3-4022-83b0-de03f55755ff tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Action: 'create', calling method: .version_select at 0x7f51ac255ee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw/QLxoF27dng2mr0mrGnweO58wMTtUs6Vp5QrGV2PnBNsY5Pr3wUKtRuIeDNHIKyBUy+te8nKTSWcOMfvUIpD/hLyVqpsTpi4EeV8ux5a2HGjIaMQztcNkSeWgHDdNPg=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a71be584-08c3-4022-83b0-de03f55755ff tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Request method failure captured: Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 507 Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iPplMyLE7cAVoFSDgOhcCRcQS6lEfHl7Er2RXBSi3fHY3bH75eUb8DNPATp3L1cJQlFC5DjcIfamUFtqrC-Pr-5rcnEHjlRehmbgdgKOu4w1mxYs5p4-zSQ4vlr8YWKYxg6T8ZRgPQP4npS-OskEn-xzdUZHg-atvbPwVvrk0L-8m8 Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d8416dce549a4a928df611c20012a76f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d8416dce549a4a928df611c20012a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 40ac0071ac5b4d52ad024f75de8ee29a Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw/QLxoF27dng2mr0mrGnweO58wMTtUs6Vp5QrGV2PnBNsY5Pr3wUKtRuIeDNHIKyBUy+te8nKTSWcOMfvUIpD/hLyVqpsTpi4EeV8ux5a2HGjIaMQztcNkSeWgHDdNPg=="}} Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw/QLxoF27dng2mr0mrGnweO58wMTtUs6Vp5QrGV2PnBNsY5Pr3wUKtRuIeDNHIKyBUy+te8nKTSWcOMfvUIpD/hLyVqpsTpi4EeV8ux5a2HGjIaMQztcNkSeWgHDdNPg=='}}} Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 18 11:35:08.123120 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 18 11:35:08.125851 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.129281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a71be584-08c3-4022-83b0-de03f55755ff tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:08.130386 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a71be584-08c3-4022-83b0-de03f55755ff tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.015815 Aug 18 11:35:08.131231 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1164/2266] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:35:08 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:35:08.138349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-37cffa24-f813-44e9-83b6-f4654eb6e6cc tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Calling method '.version_select at 0x7f519fd83040>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:08.290880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-be3eec74-b3b0-490e-b82b-e76877985731 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:08.302011 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-be3eec74-b3b0-490e-b82b-e76877985731 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 0.255479 Aug 18 11:35:08.306016 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1103/2267] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:08 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:08.321457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e9864a93-0dd1-49fe-96dc-8656c30e645a tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Action: 'create', calling method: .version_select at 0x7f519f325790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-978999494", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:08.347717 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-e9864a93-0dd1-49fe-96dc-8656c30e645a tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Getting quotas for project d8416dce549a4a928df611c20012a76f. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:35:08.357189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-e9864a93-0dd1-49fe-96dc-8656c30e645a tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Getting quotas for user 40ac0071ac5b4d52ad024f75de8ee29a and project d8416dce549a4a928df611c20012a76f. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:35:08.399349 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-e9864a93-0dd1-49fe-96dc-8656c30e645a tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e9864a93-0dd1-49fe-96dc-8656c30e645a tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Request method failure captured: Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 117 Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iPplMyLE7cAVoFSDgOhcCRcQS6lEfHl7Er2RXBSi3fHY3bH75eUb8DNPATp3L1cJQlFC5DjcIfamUFtqrC-Pr-5rcnEHjlRehmbgdgKOu4w1mxYs5p4-zSQ4vlr8YWKYxg6T8ZRgPQP4npS-OskEn-xzdUZHg-atvbPwVvrk0L-8m8 Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d8416dce549a4a928df611c20012a76f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d8416dce549a4a928df611c20012a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 40ac0071ac5b4d52ad024f75de8ee29a Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-978999494", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: exception: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-978999494', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Aug 18 11:35:08.401178 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e9864a93-0dd1-49fe-96dc-8656c30e645a tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e9864a93-0dd1-49fe-96dc-8656c30e645a tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.090578 Aug 18 11:35:08.405134 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1104/2268] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:35:08 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:35:08.411213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3e74db9c-582b-44b8-b94b-d3428b5386ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:08.411818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3e74db9c-582b-44b8-b94b-d3428b5386ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:08.440329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e74db9c-582b-44b8-b94b-d3428b5386ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:08.440830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e74db9c-582b-44b8-b94b-d3428b5386ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:08.441271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e74db9c-582b-44b8-b94b-d3428b5386ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:08.441994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e74db9c-582b-44b8-b94b-d3428b5386ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:08.442481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e74db9c-582b-44b8-b94b-d3428b5386ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:08.442915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e74db9c-582b-44b8-b94b-d3428b5386ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:08.508409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e74db9c-582b-44b8-b94b-d3428b5386ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:08.516792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e74db9c-582b-44b8-b94b-d3428b5386ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:08.517337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e74db9c-582b-44b8-b94b-d3428b5386ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:08.517816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-3e74db9c-582b-44b8-b94b-d3428b5386ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lazy-loading 'fault' on Instance uuid ffe68694-3a7c-41cb-b2f2-1f25d8648218 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:35:08.572585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3e74db9c-582b-44b8-b94b-d3428b5386ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf7fe4236764bea83c6560516441759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22660df6ec1a4f718a08cbeda2be364c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:08.583619 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3e74db9c-582b-44b8-b94b-d3428b5386ff tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 200 len: 1301 microversion: 2.1 time: 0.179233 Aug 18 11:35:08.584692 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1105/2269] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:08 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 1301 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:08.591371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0bb7ef6b-33d7-4fc6-ab58-d6e93469019d tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Calling method '.version_select at 0x7f519f5be4c0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:08.608466 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-0bb7ef6b-33d7-4fc6-ab58-d6e93469019d tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1945887914 not found for user 40ac0071ac5b4d52ad024f75de8ee29a Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0bb7ef6b-33d7-4fc6-ab58-d6e93469019d tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Request method failure captured: Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1945887914 HTTP/1.1 Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iPplMyLE7cAVoFSDgOhcCRcQS6lEfHl7Er2RXBSi3fHY3bH75eUb8DNPATp3L1cJQlFC5DjcIfamUFtqrC-Pr-5rcnEHjlRehmbgdgKOu4w1mxYs5p4-zSQ4vlr8YWKYxg6T8ZRgPQP4npS-OskEn-xzdUZHg-atvbPwVvrk0L-8m8 Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d8416dce549a4a928df611c20012a76f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d8416dce549a4a928df611c20012a76f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d8416dce549a4a928df611c20012a76f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: d8416dce549a4a928df611c20012a76f Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-830466430 Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 40ac0071ac5b4d52ad024f75de8ee29a Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-KeyPairsNegativeTestJSON-830466430-project Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: exception: Keypair tempest-keypair-non-existent-1945887914 not found for user 40ac0071ac5b4d52ad024f75de8ee29a Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'tempest-keypair-non-existent-1945887914'} Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise self.value Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6827, in delete_key_pair Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6848, in get_key_pair Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1945887914 not found for user 40ac0071ac5b4d52ad024f75de8ee29a Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.610694 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1945887914 not found for user 40ac0071ac5b4d52ad024f75de8ee29a Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1945887914 not found for user 40ac0071ac5b4d52ad024f75de8ee29a Aug 18 11:35:08.613849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:08.616988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0bb7ef6b-33d7-4fc6-ab58-d6e93469019d tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1945887914 not found for user 40ac0071ac5b4d52ad024f75de8ee29a {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:08.619714 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0bb7ef6b-33d7-4fc6-ab58-d6e93469019d tempest-KeyPairsNegativeTestJSON-830466430 tempest-KeyPairsNegativeTestJSON-830466430-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1945887914" status: 404 len: 145 microversion: 2.1 time: 0.033119 Aug 18 11:35:08.620813 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1106/2270] 10.222.0.73 () {58 vars in 1260 bytes} [Thu Aug 18 11:35:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1945887914 => generated 145 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:35:08.627919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-92098cde-178b-4295-98ed-238a34b0178b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:08.631033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-92098cde-178b-4295-98ed-238a34b0178b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:08.639226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92098cde-178b-4295-98ed-238a34b0178b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:08.640002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92098cde-178b-4295-98ed-238a34b0178b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:08.640632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92098cde-178b-4295-98ed-238a34b0178b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:08.641530 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92098cde-178b-4295-98ed-238a34b0178b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:08.642203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92098cde-178b-4295-98ed-238a34b0178b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:08.642946 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92098cde-178b-4295-98ed-238a34b0178b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:08.939876 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-37cffa24-f813-44e9-83b6-f4654eb6e6cc tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/d8c099a0-eb17-4c1b-b682-a334b7ee221d" status: 202 len: 0 microversion: 2.1 time: 0.807387 Aug 18 11:35:08.941373 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1165/2271] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:35:08 2022] DELETE /compute/v2.1/os-security-groups/d8c099a0-eb17-4c1b-b682-a334b7ee221d => generated 0 bytes in 809 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:08.947774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-eda6700e-80c4-44d6-aa6a-65dfa904b439 req-874aeea1-b143-4e48-a75c-c327283f4e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe68694-3a7c-41cb-b2f2-1f25d8648218", "name": "network-vif-deleted", "tag": "ed0c5302-2b34-44c1-a1e3-e5121abc35f0"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:08.973294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-92098cde-178b-4295-98ed-238a34b0178b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:08.981417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eda6700e-80c4-44d6-aa6a-65dfa904b439 req-874aeea1-b143-4e48-a75c-c327283f4e41 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:08.984695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eda6700e-80c4-44d6-aa6a-65dfa904b439 req-874aeea1-b143-4e48-a75c-c327283f4e41 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:08.985149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eda6700e-80c4-44d6-aa6a-65dfa904b439 req-874aeea1-b143-4e48-a75c-c327283f4e41 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:08.989814 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-92098cde-178b-4295-98ed-238a34b0178b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.362031 Aug 18 11:35:08.991852 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1107/2272] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:08 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:09.006546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-53a4cf46-bd95-4f2b-9da0-d3881c7cca44 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f5bec10>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:09.014222 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-eda6700e-80c4-44d6-aa6a-65dfa904b439 req-874aeea1-b143-4e48-a75c-c327283f4e41 service nova] Creating event network-vif-deleted:ed0c5302-2b34-44c1-a1e3-e5121abc35f0 for instance ffe68694-3a7c-41cb-b2f2-1f25d8648218 on n-h1-853611-3 Aug 18 11:35:09.028033 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-eda6700e-80c4-44d6-aa6a-65dfa904b439 req-874aeea1-b143-4e48-a75c-c327283f4e41 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084867 Aug 18 11:35:09.028655 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1166/2273] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:09.043497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dfc016a6-282e-4725-8e08-7673d3b69a61 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Calling method '.version_select at 0x7f519fda23a0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:09.100589 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-53a4cf46-bd95-4f2b-9da0-d3881c7cca44 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 200 len: 1450 microversion: 2.1 time: 0.107196 Aug 18 11:35:09.101667 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1108/2274] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:08 2022] GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 1450 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:09.115683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5a2cd528-b3ea-4bad-ab26-752c9a831920 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:09.117106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5a2cd528-b3ea-4bad-ab26-752c9a831920 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:09.127884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a2cd528-b3ea-4bad-ab26-752c9a831920 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:09.128386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a2cd528-b3ea-4bad-ab26-752c9a831920 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:09.129027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a2cd528-b3ea-4bad-ab26-752c9a831920 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:09.129762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a2cd528-b3ea-4bad-ab26-752c9a831920 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:09.130232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a2cd528-b3ea-4bad-ab26-752c9a831920 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:09.130699 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a2cd528-b3ea-4bad-ab26-752c9a831920 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:09.373907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5a2cd528-b3ea-4bad-ab26-752c9a831920 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:09.387393 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5a2cd528-b3ea-4bad-ab26-752c9a831920 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1315 microversion: 2.1 time: 0.284623 Aug 18 11:35:09.388231 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1109/2275] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:09 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:09.396009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-101e1bb1-c69f-43c2-8ba7-e467a3e8d52e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:09.396963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-101e1bb1-c69f-43c2-8ba7-e467a3e8d52e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:09.408562 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-101e1bb1-c69f-43c2-8ba7-e467a3e8d52e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:09.409419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-101e1bb1-c69f-43c2-8ba7-e467a3e8d52e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:09.410167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-101e1bb1-c69f-43c2-8ba7-e467a3e8d52e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:09.411153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-101e1bb1-c69f-43c2-8ba7-e467a3e8d52e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:09.411826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-101e1bb1-c69f-43c2-8ba7-e467a3e8d52e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:09.412463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-101e1bb1-c69f-43c2-8ba7-e467a3e8d52e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:09.515922 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dfc016a6-282e-4725-8e08-7673d3b69a61 tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/8600c3fb-b3f0-4d90-ab82-8a10f580240c" status: 202 len: 0 microversion: 2.1 time: 0.485203 Aug 18 11:35:09.517088 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1167/2276] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:35:09 2022] DELETE /compute/v2.1/os-security-groups/8600c3fb-b3f0-4d90-ab82-8a10f580240c => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:09.527852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a09bb0b7-3a78-4014-b80a-64fed678c8bc tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Calling method '.version_select at 0x7f519fd83040>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:09.779924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-101e1bb1-c69f-43c2-8ba7-e467a3e8d52e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:09.790913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:09.793895 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-101e1bb1-c69f-43c2-8ba7-e467a3e8d52e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 0.404349 Aug 18 11:35:09.795384 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1110/2277] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:09 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:09.804739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-89eef3ee-8a7f-4b9c-93de-29741feb10eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:09.805648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-89eef3ee-8a7f-4b9c-93de-29741feb10eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] [instance: ffe68694-3a7c-41cb-b2f2-1f25d8648218] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:09.813927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89eef3ee-8a7f-4b9c-93de-29741feb10eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:09.815155 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89eef3ee-8a7f-4b9c-93de-29741feb10eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:09.815607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89eef3ee-8a7f-4b9c-93de-29741feb10eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:09.818013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89eef3ee-8a7f-4b9c-93de-29741feb10eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:09.818770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89eef3ee-8a7f-4b9c-93de-29741feb10eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:09.819983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89eef3ee-8a7f-4b9c-93de-29741feb10eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:09.852053 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-89eef3ee-8a7f-4b9c-93de-29741feb10eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] HTTP exception thrown: Instance ffe68694-3a7c-41cb-b2f2-1f25d8648218 could not be found. Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-89eef3ee-8a7f-4b9c-93de-29741feb10eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Request method failure captured: Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 HTTP/1.1 Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iIZ73k_YPF_W2EIMMri9FswITgky3Trv8mszMC_q7DqKHRQdz1obOf92XsfI5eHcOKQ4Taq-4WecACwzcaZUhv56AdpPX-KscZp_JKFwtxRcvZ5iK0fyDGxpMgEaIqG5cDWy9Nd7bp6IxhUSg7zZ_33iKe3ZgVsB8DA6NyW9vAbKfs Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 22660df6ec1a4f718a08cbeda2be364c Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-LiveMigrationTest-290401536 Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/22660df6ec1a4f718a08cbeda2be364c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-LiveMigrationTest-290401536 Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 22660df6ec1a4f718a08cbeda2be364c Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-LiveMigrationTest-290401536 Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-LiveMigrationTest-290401536-project Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 0cf7fe4236764bea83c6560516441759 Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-LiveMigrationTest-290401536-project Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance ffe68694-3a7c-41cb-b2f2-1f25d8648218 could not be found. Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'ffe68694-3a7c-41cb-b2f2-1f25d8648218'} Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe68694-3a7c-41cb-b2f2-1f25d8648218 could not be found. Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe68694-3a7c-41cb-b2f2-1f25d8648218 could not be found. Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:09.855816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:09.859652 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:09.859652 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:09.859652 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:09.859652 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:09.859652 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:09.859652 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe68694-3a7c-41cb-b2f2-1f25d8648218 could not be found. Aug 18 11:35:09.859652 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:09.863263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-89eef3ee-8a7f-4b9c-93de-29741feb10eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] Returning 404 to user: Instance ffe68694-3a7c-41cb-b2f2-1f25d8648218 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:09.864281 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-89eef3ee-8a7f-4b9c-93de-29741feb10eb tempest-LiveMigrationTest-290401536 tempest-LiveMigrationTest-290401536-project] 10.222.0.73 "GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218" status: 404 len: 111 microversion: 2.1 time: 0.067483 Aug 18 11:35:09.868566 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1111/2278] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:09 2022] GET /compute/v2.1/servers/ffe68694-3a7c-41cb-b2f2-1f25d8648218 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:35:10.017398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dc63ab9b-8cd4-4674-9c6a-c4c5134edebf tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:10.018089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dc63ab9b-8cd4-4674-9c6a-c4c5134edebf tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:10.031223 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc63ab9b-8cd4-4674-9c6a-c4c5134edebf tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:10.032706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc63ab9b-8cd4-4674-9c6a-c4c5134edebf tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:10.033372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc63ab9b-8cd4-4674-9c6a-c4c5134edebf tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:10.035436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc63ab9b-8cd4-4674-9c6a-c4c5134edebf tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:10.036447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc63ab9b-8cd4-4674-9c6a-c4c5134edebf tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:10.037134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc63ab9b-8cd4-4674-9c6a-c4c5134edebf tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:10.093203 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a09bb0b7-3a78-4014-b80a-64fed678c8bc tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/be38661f-a466-431a-84bf-b8178115fd05" status: 202 len: 0 microversion: 2.1 time: 0.571480 Aug 18 11:35:10.098550 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1168/2279] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:35:09 2022] DELETE /compute/v2.1/os-security-groups/be38661f-a466-431a-84bf-b8178115fd05 => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:10.114972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3f03a94a-4c2e-44a0-a6ff-1ddf9d7b89ec tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] Calling method '.version_select at 0x7f519fdecf70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:10.439192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dc63ab9b-8cd4-4674-9c6a-c4c5134edebf tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:10.454125 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dc63ab9b-8cd4-4674-9c6a-c4c5134edebf tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.439902 Aug 18 11:35:10.458663 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1112/2280] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:10 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:35:10.464466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cd2154df-d3a1-4549-9969-60aa9c20cc70 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fcc0af0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:10.537909 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cd2154df-d3a1-4549-9969-60aa9c20cc70 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 200 len: 1450 microversion: 2.1 time: 0.077647 Aug 18 11:35:10.545277 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1113/2281] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:10 2022] GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 1450 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:10.558576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e36cbc24-a4ca-4e99-a042-5d71dd53f2d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:10.562661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e36cbc24-a4ca-4e99-a042-5d71dd53f2d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:10.586597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e36cbc24-a4ca-4e99-a042-5d71dd53f2d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:10.589046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e36cbc24-a4ca-4e99-a042-5d71dd53f2d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:10.589787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e36cbc24-a4ca-4e99-a042-5d71dd53f2d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:10.590804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e36cbc24-a4ca-4e99-a042-5d71dd53f2d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:10.591568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e36cbc24-a4ca-4e99-a042-5d71dd53f2d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:10.592215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e36cbc24-a4ca-4e99-a042-5d71dd53f2d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:10.749696 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3f03a94a-4c2e-44a0-a6ff-1ddf9d7b89ec tempest-SecurityGroupRulesTestJSON-498045311 tempest-SecurityGroupRulesTestJSON-498045311-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/0f930b4d-9809-4712-9cea-0d425ad4b626" status: 202 len: 0 microversion: 2.1 time: 0.649543 Aug 18 11:35:10.751031 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1169/2282] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:35:10 2022] DELETE /compute/v2.1/os-security-groups/0f930b4d-9809-4712-9cea-0d425ad4b626 => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:10.826573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e025f944-e3d9-493e-9f85-316140bda0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:10.828136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e025f944-e3d9-493e-9f85-316140bda0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:10.853660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e025f944-e3d9-493e-9f85-316140bda0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:10.854718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e025f944-e3d9-493e-9f85-316140bda0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:10.855357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e025f944-e3d9-493e-9f85-316140bda0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:10.856285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e025f944-e3d9-493e-9f85-316140bda0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:10.856922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e025f944-e3d9-493e-9f85-316140bda0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:10.857579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e025f944-e3d9-493e-9f85-316140bda0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:10.992658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e36cbc24-a4ca-4e99-a042-5d71dd53f2d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:11.003138 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e36cbc24-a4ca-4e99-a042-5d71dd53f2d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1501 microversion: 2.1 time: 0.455155 Aug 18 11:35:11.003731 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1114/2283] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:10 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1501 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:11.025841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a40c3c09-eaf6-4303-af7f-9af8849bbfb9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:11.028449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a40c3c09-eaf6-4303-af7f-9af8849bbfb9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:11.035777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a40c3c09-eaf6-4303-af7f-9af8849bbfb9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:11.036700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a40c3c09-eaf6-4303-af7f-9af8849bbfb9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:11.037361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a40c3c09-eaf6-4303-af7f-9af8849bbfb9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:11.039182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a40c3c09-eaf6-4303-af7f-9af8849bbfb9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:11.039882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a40c3c09-eaf6-4303-af7f-9af8849bbfb9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:11.040524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a40c3c09-eaf6-4303-af7f-9af8849bbfb9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:11.088489 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a40c3c09-eaf6-4303-af7f-9af8849bbfb9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action" status: 200 len: 14 microversion: 2.1 time: 0.066865 Aug 18 11:35:11.092577 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1115/2284] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:11 2022] POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 11:35:11.471924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e025f944-e3d9-493e-9f85-316140bda0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:11.484417 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e025f944-e3d9-493e-9f85-316140bda0d6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 0.667128 Aug 18 11:35:11.488613 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1170/2285] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:10 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:35:11.501076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5d04711e-e63c-49fe-8ebc-a6c974c31dae tempest-AZV2TestJSON-1521388605 tempest-AZV2TestJSON-1521388605-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:11.502576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dabfb476-660e-4c93-bfc8-c1770e2f1bd2 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:11.503267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dabfb476-660e-4c93-bfc8-c1770e2f1bd2 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:11.503388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d04711e-e63c-49fe-8ebc-a6c974c31dae tempest-AZV2TestJSON-1521388605 tempest-AZV2TestJSON-1521388605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:11.503798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d04711e-e63c-49fe-8ebc-a6c974c31dae tempest-AZV2TestJSON-1521388605 tempest-AZV2TestJSON-1521388605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:11.504239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d04711e-e63c-49fe-8ebc-a6c974c31dae tempest-AZV2TestJSON-1521388605 tempest-AZV2TestJSON-1521388605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:11.504973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d04711e-e63c-49fe-8ebc-a6c974c31dae tempest-AZV2TestJSON-1521388605 tempest-AZV2TestJSON-1521388605-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:11.505427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d04711e-e63c-49fe-8ebc-a6c974c31dae tempest-AZV2TestJSON-1521388605 tempest-AZV2TestJSON-1521388605-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:11.505854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d04711e-e63c-49fe-8ebc-a6c974c31dae tempest-AZV2TestJSON-1521388605 tempest-AZV2TestJSON-1521388605-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:11.510626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dabfb476-660e-4c93-bfc8-c1770e2f1bd2 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:11.511676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dabfb476-660e-4c93-bfc8-c1770e2f1bd2 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:11.512462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dabfb476-660e-4c93-bfc8-c1770e2f1bd2 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:11.513420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dabfb476-660e-4c93-bfc8-c1770e2f1bd2 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:11.514249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dabfb476-660e-4c93-bfc8-c1770e2f1bd2 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:11.514909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dabfb476-660e-4c93-bfc8-c1770e2f1bd2 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:11.573972 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5d04711e-e63c-49fe-8ebc-a6c974c31dae tempest-AZV2TestJSON-1521388605 tempest-AZV2TestJSON-1521388605-project] 10.222.0.73 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.226770 Aug 18 11:35:11.584123 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1116/2286] 10.222.0.73 () {58 vars in 1164 bytes} [Thu Aug 18 11:35:11 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 11:35:11.590479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2b751d0e-032c-4844-aefb-af8fd385b5ce tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519ff961f0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:11.678533 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2b751d0e-032c-4844-aefb-af8fd385b5ce tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 200 len: 1450 microversion: 2.1 time: 0.092221 Aug 18 11:35:11.683831 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1117/2287] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:11 2022] GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 1450 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:11.818065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dabfb476-660e-4c93-bfc8-c1770e2f1bd2 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:11.860415 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dabfb476-660e-4c93-bfc8-c1770e2f1bd2 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.370287 Aug 18 11:35:11.861848 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1171/2288] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:11 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:12.102546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a49de3a0-4d57-4829-9204-f75bc26726ca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:12.105286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a49de3a0-4d57-4829-9204-f75bc26726ca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:12.135908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a49de3a0-4d57-4829-9204-f75bc26726ca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:12.136325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a49de3a0-4d57-4829-9204-f75bc26726ca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:12.138237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a49de3a0-4d57-4829-9204-f75bc26726ca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:12.138237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a49de3a0-4d57-4829-9204-f75bc26726ca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:12.138237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a49de3a0-4d57-4829-9204-f75bc26726ca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:12.138862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a49de3a0-4d57-4829-9204-f75bc26726ca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:12.274318 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a49de3a0-4d57-4829-9204-f75bc26726ca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action" status: 200 len: 14 microversion: 2.1 time: 0.178491 Aug 18 11:35:12.279191 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1118/2289] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:12 2022] POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 11:35:12.510345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d4e3800-3630-4662-942c-56f6fdcd2654 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:12.510968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9d4e3800-3630-4662-942c-56f6fdcd2654 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:12.525759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d4e3800-3630-4662-942c-56f6fdcd2654 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:12.526548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d4e3800-3630-4662-942c-56f6fdcd2654 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:12.527136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d4e3800-3630-4662-942c-56f6fdcd2654 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:12.528058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d4e3800-3630-4662-942c-56f6fdcd2654 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:12.528671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d4e3800-3630-4662-942c-56f6fdcd2654 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:12.532394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d4e3800-3630-4662-942c-56f6fdcd2654 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:12.707801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e0eeb79f-260c-4cf0-a013-b07c6ba16daa tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519ffbbee0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:12.840948 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e0eeb79f-260c-4cf0-a013-b07c6ba16daa tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 200 len: 1450 microversion: 2.1 time: 0.146800 Aug 18 11:35:12.842230 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1119/2290] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:12 2022] GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:35:12.882501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-375f35fb-0676-4727-8c68-4aad513493fa tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:12.884352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-375f35fb-0676-4727-8c68-4aad513493fa tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:12.899097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-375f35fb-0676-4727-8c68-4aad513493fa tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:12.901859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-375f35fb-0676-4727-8c68-4aad513493fa tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:12.902460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-375f35fb-0676-4727-8c68-4aad513493fa tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:12.903348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-375f35fb-0676-4727-8c68-4aad513493fa tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:12.907447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-375f35fb-0676-4727-8c68-4aad513493fa tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:12.908094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-375f35fb-0676-4727-8c68-4aad513493fa tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:12.991739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9d4e3800-3630-4662-942c-56f6fdcd2654 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:13.006350 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9d4e3800-3630-4662-942c-56f6fdcd2654 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 0.499199 Aug 18 11:35:13.009378 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1172/2291] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:12 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:13.291880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-61791224-6cd4-45f6-9453-59c4aea39178 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:13.298651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-61791224-6cd4-45f6-9453-59c4aea39178 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:13.308401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61791224-6cd4-45f6-9453-59c4aea39178 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:13.309526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61791224-6cd4-45f6-9453-59c4aea39178 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:13.310120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61791224-6cd4-45f6-9453-59c4aea39178 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:13.311209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61791224-6cd4-45f6-9453-59c4aea39178 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:13.311820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61791224-6cd4-45f6-9453-59c4aea39178 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:13.312567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61791224-6cd4-45f6-9453-59c4aea39178 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:13.379019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-375f35fb-0676-4727-8c68-4aad513493fa tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:13.384739 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-61791224-6cd4-45f6-9453-59c4aea39178 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action" status: 200 len: 14 microversion: 2.1 time: 0.098781 Aug 18 11:35:13.391434 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1173/2292] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:13 2022] POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:35:13.394727 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-375f35fb-0676-4727-8c68-4aad513493fa tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.517025 Aug 18 11:35:13.396236 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1120/2293] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:12 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:13.857208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11bcbd99-b686-41a4-8bd3-cc86ff4f8f48 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fc30a60>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:13.930752 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-11bcbd99-b686-41a4-8bd3-cc86ff4f8f48 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 200 len: 1450 microversion: 2.1 time: 0.077903 Aug 18 11:35:13.938742 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1174/2294] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:13 2022] GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 1450 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:14.033325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-92387c81-602a-4c97-a1a8-56b1d31629f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:14.034153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-92387c81-602a-4c97-a1a8-56b1d31629f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:14.044413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92387c81-602a-4c97-a1a8-56b1d31629f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:14.045329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92387c81-602a-4c97-a1a8-56b1d31629f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:14.045960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92387c81-602a-4c97-a1a8-56b1d31629f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:14.046914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92387c81-602a-4c97-a1a8-56b1d31629f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:14.049176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92387c81-602a-4c97-a1a8-56b1d31629f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:14.049817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92387c81-602a-4c97-a1a8-56b1d31629f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:14.396613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bbb74d65-627d-4f0a-a17b-2b0a947579b7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:14.400562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bbb74d65-627d-4f0a-a17b-2b0a947579b7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:14.421349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbb74d65-627d-4f0a-a17b-2b0a947579b7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:14.421854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbb74d65-627d-4f0a-a17b-2b0a947579b7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:14.422295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbb74d65-627d-4f0a-a17b-2b0a947579b7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:14.423050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbb74d65-627d-4f0a-a17b-2b0a947579b7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:14.423509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbb74d65-627d-4f0a-a17b-2b0a947579b7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:14.423934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbb74d65-627d-4f0a-a17b-2b0a947579b7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:14.506531 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bbb74d65-627d-4f0a-a17b-2b0a947579b7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action" status: 200 len: 14 microversion: 2.1 time: 0.113619 Aug 18 11:35:14.510140 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1175/2295] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:14 2022] POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:35:14.515272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-009273f5-13b8-4101-a5dc-92e94d87fb63 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:14.515991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-009273f5-13b8-4101-a5dc-92e94d87fb63 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:14.532866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009273f5-13b8-4101-a5dc-92e94d87fb63 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:14.533282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009273f5-13b8-4101-a5dc-92e94d87fb63 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:14.534622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009273f5-13b8-4101-a5dc-92e94d87fb63 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:14.537416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009273f5-13b8-4101-a5dc-92e94d87fb63 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:14.538598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009273f5-13b8-4101-a5dc-92e94d87fb63 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:14.539067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009273f5-13b8-4101-a5dc-92e94d87fb63 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:14.782641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-92387c81-602a-4c97-a1a8-56b1d31629f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:14.793184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-009273f5-13b8-4101-a5dc-92e94d87fb63 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:14.806361 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-009273f5-13b8-4101-a5dc-92e94d87fb63 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.297334 Aug 18 11:35:14.807604 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1176/2296] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:14 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:14.809052 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-92387c81-602a-4c97-a1a8-56b1d31629f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1507 microversion: 2.1 time: 0.779666 Aug 18 11:35:14.810058 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1121/2297] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:14 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1507 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:14.948211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b62ee9d-9066-4451-b856-76473a31d349 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fdec430>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:15.040993 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b62ee9d-9066-4451-b856-76473a31d349 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 200 len: 1450 microversion: 2.1 time: 0.099050 Aug 18 11:35:15.058248 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1177/2298] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:14 2022] GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 1450 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:15.519484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-044bf928-7e5d-43fc-ac2e-93567f4bf1dc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:15.522990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-044bf928-7e5d-43fc-ac2e-93567f4bf1dc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:15.542276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:15.547603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-044bf928-7e5d-43fc-ac2e-93567f4bf1dc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:15.548397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-044bf928-7e5d-43fc-ac2e-93567f4bf1dc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:15.550381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-044bf928-7e5d-43fc-ac2e-93567f4bf1dc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:15.551391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-044bf928-7e5d-43fc-ac2e-93567f4bf1dc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:15.554379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-044bf928-7e5d-43fc-ac2e-93567f4bf1dc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:15.555491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-044bf928-7e5d-43fc-ac2e-93567f4bf1dc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:15.662238 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-044bf928-7e5d-43fc-ac2e-93567f4bf1dc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action" status: 200 len: 14 microversion: 2.1 time: 0.144956 Aug 18 11:35:15.665279 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1122/2299] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:15 2022] POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:35:15.839525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-91f9345c-ce1a-4a09-96a1-d4e69dd73708 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:15.840553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-91f9345c-ce1a-4a09-96a1-d4e69dd73708 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:15.846992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b478967d-ce56-4c6a-b73b-791d6ec0d85b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:15.848907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b478967d-ce56-4c6a-b73b-791d6ec0d85b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:15.860424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91f9345c-ce1a-4a09-96a1-d4e69dd73708 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:15.863753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91f9345c-ce1a-4a09-96a1-d4e69dd73708 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:15.864627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b478967d-ce56-4c6a-b73b-791d6ec0d85b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:15.865731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b478967d-ce56-4c6a-b73b-791d6ec0d85b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:15.866391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b478967d-ce56-4c6a-b73b-791d6ec0d85b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:15.868307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91f9345c-ce1a-4a09-96a1-d4e69dd73708 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:15.869314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b478967d-ce56-4c6a-b73b-791d6ec0d85b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:15.869954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b478967d-ce56-4c6a-b73b-791d6ec0d85b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:15.870577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b478967d-ce56-4c6a-b73b-791d6ec0d85b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:15.875556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91f9345c-ce1a-4a09-96a1-d4e69dd73708 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:15.876445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91f9345c-ce1a-4a09-96a1-d4e69dd73708 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:15.880065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91f9345c-ce1a-4a09-96a1-d4e69dd73708 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:16.478614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-91f9345c-ce1a-4a09-96a1-d4e69dd73708 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:16.492438 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-91f9345c-ce1a-4a09-96a1-d4e69dd73708 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1528 microversion: 2.1 time: 0.657606 Aug 18 11:35:16.497711 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1178/2300] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:15 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1528 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:16.514712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-042429a7-fc5c-4929-bf9f-ecffdea04d83 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f894e50>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:16.603339 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-042429a7-fc5c-4929-bf9f-ecffdea04d83 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 200 len: 1450 microversion: 2.1 time: 0.103751 Aug 18 11:35:16.612092 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1179/2301] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:16 2022] GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 1450 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:16.676217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-696465d1-ae84-4512-a7e5-d13ba3ab0fd6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:16.679794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-696465d1-ae84-4512-a7e5-d13ba3ab0fd6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:16.698961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:16.701802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-696465d1-ae84-4512-a7e5-d13ba3ab0fd6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:16.707016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-696465d1-ae84-4512-a7e5-d13ba3ab0fd6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:16.707819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-696465d1-ae84-4512-a7e5-d13ba3ab0fd6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:16.708742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-696465d1-ae84-4512-a7e5-d13ba3ab0fd6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:16.710893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-696465d1-ae84-4512-a7e5-d13ba3ab0fd6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:16.713611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-696465d1-ae84-4512-a7e5-d13ba3ab0fd6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:16.837935 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-696465d1-ae84-4512-a7e5-d13ba3ab0fd6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action" status: 200 len: 14 microversion: 2.1 time: 0.166289 Aug 18 11:35:16.845433 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1180/2302] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:16 2022] POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:35:17.288482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b478967d-ce56-4c6a-b73b-791d6ec0d85b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:17.306790 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b478967d-ce56-4c6a-b73b-791d6ec0d85b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 1.461132 Aug 18 11:35:17.309119 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1123/2303] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:15 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:17.516074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d1c562c8-b87e-471e-8afc-bf9143c507d3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:17.516813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d1c562c8-b87e-471e-8afc-bf9143c507d3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:17.535549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1c562c8-b87e-471e-8afc-bf9143c507d3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:17.536108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1c562c8-b87e-471e-8afc-bf9143c507d3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:17.538808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1c562c8-b87e-471e-8afc-bf9143c507d3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:17.540241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1c562c8-b87e-471e-8afc-bf9143c507d3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:17.542169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1c562c8-b87e-471e-8afc-bf9143c507d3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:17.543392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1c562c8-b87e-471e-8afc-bf9143c507d3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:17.618712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6b949ee0-0f5e-45a7-bb86-9864fdebf7a7 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fd95f70>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:18.028754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d1c562c8-b87e-471e-8afc-bf9143c507d3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:18.038404 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d1c562c8-b87e-471e-8afc-bf9143c507d3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1523 microversion: 2.1 time: 0.526852 Aug 18 11:35:18.048359 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1181/2304] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:17 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1523 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:18.065648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a4bf319-29d2-4a52-9674-e7cbcf250331 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:18.073843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4a4bf319-29d2-4a52-9674-e7cbcf250331 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:18.106515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a4bf319-29d2-4a52-9674-e7cbcf250331 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:18.111128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a4bf319-29d2-4a52-9674-e7cbcf250331 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:18.111821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a4bf319-29d2-4a52-9674-e7cbcf250331 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:18.112749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a4bf319-29d2-4a52-9674-e7cbcf250331 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:18.116987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a4bf319-29d2-4a52-9674-e7cbcf250331 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:18.118097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a4bf319-29d2-4a52-9674-e7cbcf250331 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:18.211312 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4a4bf319-29d2-4a52-9674-e7cbcf250331 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action" status: 200 len: 14 microversion: 2.1 time: 0.160861 Aug 18 11:35:18.212688 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1182/2305] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:18 2022] POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:35:18.336493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c47fb8e0-b3de-4161-9d87-8cbf494e17c5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:18.337583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c47fb8e0-b3de-4161-9d87-8cbf494e17c5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:18.360010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c47fb8e0-b3de-4161-9d87-8cbf494e17c5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:18.360619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c47fb8e0-b3de-4161-9d87-8cbf494e17c5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:18.361396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c47fb8e0-b3de-4161-9d87-8cbf494e17c5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:18.362339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c47fb8e0-b3de-4161-9d87-8cbf494e17c5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:18.366408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c47fb8e0-b3de-4161-9d87-8cbf494e17c5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:18.367750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c47fb8e0-b3de-4161-9d87-8cbf494e17c5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:18.370129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=16 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:19.026707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c47fb8e0-b3de-4161-9d87-8cbf494e17c5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:19.036398 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c47fb8e0-b3de-4161-9d87-8cbf494e17c5 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.709239 Aug 18 11:35:19.043292 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1183/2306] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:18 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:19.068552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd0f9fa4-8dab-4b0a-8e39-2ea1edb4080c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:19.069798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dd0f9fa4-8dab-4b0a-8e39-2ea1edb4080c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:19.081410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd0f9fa4-8dab-4b0a-8e39-2ea1edb4080c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:19.082291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd0f9fa4-8dab-4b0a-8e39-2ea1edb4080c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:19.082986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd0f9fa4-8dab-4b0a-8e39-2ea1edb4080c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:19.083968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd0f9fa4-8dab-4b0a-8e39-2ea1edb4080c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:19.087527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd0f9fa4-8dab-4b0a-8e39-2ea1edb4080c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:19.091625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd0f9fa4-8dab-4b0a-8e39-2ea1edb4080c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:20.317016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd0f9fa4-8dab-4b0a-8e39-2ea1edb4080c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:20.333434 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd0f9fa4-8dab-4b0a-8e39-2ea1edb4080c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1523 microversion: 2.1 time: 1.266031 Aug 18 11:35:20.334899 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1184/2307] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:19 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1523 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:20.363673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b9c0826a-4cae-4cdb-bead-697a3bd45ec1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:20.368575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b9c0826a-4cae-4cdb-bead-697a3bd45ec1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:20.399597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9c0826a-4cae-4cdb-bead-697a3bd45ec1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:20.403115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9c0826a-4cae-4cdb-bead-697a3bd45ec1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:20.405938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9c0826a-4cae-4cdb-bead-697a3bd45ec1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:20.407491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9c0826a-4cae-4cdb-bead-697a3bd45ec1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:20.415290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9c0826a-4cae-4cdb-bead-697a3bd45ec1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:20.416136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9c0826a-4cae-4cdb-bead-697a3bd45ec1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:20.536818 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b9c0826a-4cae-4cdb-bead-697a3bd45ec1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action" status: 200 len: 14 microversion: 2.1 time: 0.197019 Aug 18 11:35:20.538122 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1185/2308] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:20 2022] POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:35:20.547757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-165f79af-e358-4c0d-a6b5-626e149b4e97 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:20.563182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-165f79af-e358-4c0d-a6b5-626e149b4e97 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:20.589651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165f79af-e358-4c0d-a6b5-626e149b4e97 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:20.596039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165f79af-e358-4c0d-a6b5-626e149b4e97 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:20.596874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165f79af-e358-4c0d-a6b5-626e149b4e97 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:20.597940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165f79af-e358-4c0d-a6b5-626e149b4e97 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:20.598756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165f79af-e358-4c0d-a6b5-626e149b4e97 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:20.599421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-165f79af-e358-4c0d-a6b5-626e149b4e97 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:21.265300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-165f79af-e358-4c0d-a6b5-626e149b4e97 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:21.274160 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-165f79af-e358-4c0d-a6b5-626e149b4e97 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.730633 Aug 18 11:35:21.282560 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1186/2309] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:20 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:21.295533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-39a02336-c441-4c1f-a214-167f63c56a3d req-2f3852f9-1f1d-4c94-ae36-8f7620a11c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ad9e5e-ca95-4e76-9823-3d357ca17f37", "name": "network-vif-plugged", "status": "completed", "tag": "bb50eb05-55f9-44f6-93f6-81a14dd7c19b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:21.348026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-39a02336-c441-4c1f-a214-167f63c56a3d req-2f3852f9-1f1d-4c94-ae36-8f7620a11c7b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:21.349367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-39a02336-c441-4c1f-a214-167f63c56a3d req-2f3852f9-1f1d-4c94-ae36-8f7620a11c7b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:21.350155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-39a02336-c441-4c1f-a214-167f63c56a3d req-2f3852f9-1f1d-4c94-ae36-8f7620a11c7b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:21.385933 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-39a02336-c441-4c1f-a214-167f63c56a3d req-2f3852f9-1f1d-4c94-ae36-8f7620a11c7b service nova] Creating event network-vif-plugged:bb50eb05-55f9-44f6-93f6-81a14dd7c19b for instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 on n-h2-853611-3 Aug 18 11:35:21.394242 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-39a02336-c441-4c1f-a214-167f63c56a3d req-2f3852f9-1f1d-4c94-ae36-8f7620a11c7b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110068 Aug 18 11:35:21.395217 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1187/2310] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:21.403034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f92c3a39-10d4-4c40-89d7-546fa3cf7b62 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:21.403750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f92c3a39-10d4-4c40-89d7-546fa3cf7b62 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:21.431163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f92c3a39-10d4-4c40-89d7-546fa3cf7b62 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:21.431869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f92c3a39-10d4-4c40-89d7-546fa3cf7b62 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:21.432160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f92c3a39-10d4-4c40-89d7-546fa3cf7b62 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:21.436636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f92c3a39-10d4-4c40-89d7-546fa3cf7b62 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:21.438998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f92c3a39-10d4-4c40-89d7-546fa3cf7b62 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:21.439473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f92c3a39-10d4-4c40-89d7-546fa3cf7b62 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:21.526661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:23.120473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f92c3a39-10d4-4c40-89d7-546fa3cf7b62 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:23.135440 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f92c3a39-10d4-4c40-89d7-546fa3cf7b62 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1523 microversion: 2.1 time: 1.738584 Aug 18 11:35:23.147973 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1188/2311] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:21 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1523 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:23.158672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-48a6ad15-f34c-4937-91c5-e82a3113135c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:23.165312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-48a6ad15-f34c-4937-91c5-e82a3113135c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:23.185801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48a6ad15-f34c-4937-91c5-e82a3113135c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:23.187117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48a6ad15-f34c-4937-91c5-e82a3113135c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:23.191499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48a6ad15-f34c-4937-91c5-e82a3113135c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:23.194809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48a6ad15-f34c-4937-91c5-e82a3113135c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:23.208108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48a6ad15-f34c-4937-91c5-e82a3113135c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:23.210901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48a6ad15-f34c-4937-91c5-e82a3113135c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:23.304876 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-48a6ad15-f34c-4937-91c5-e82a3113135c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action" status: 200 len: 14 microversion: 2.1 time: 0.155254 Aug 18 11:35:23.305805 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1189/2312] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:23 2022] POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:35:23.315471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03711772-125f-4c61-888b-470432ef3be6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:23.316433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-03711772-125f-4c61-888b-470432ef3be6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:23.354884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03711772-125f-4c61-888b-470432ef3be6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:23.358170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03711772-125f-4c61-888b-470432ef3be6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:23.359028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03711772-125f-4c61-888b-470432ef3be6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:23.362882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03711772-125f-4c61-888b-470432ef3be6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:23.363644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03711772-125f-4c61-888b-470432ef3be6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:23.364289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03711772-125f-4c61-888b-470432ef3be6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:23.447481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:24.650576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-03711772-125f-4c61-888b-470432ef3be6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:24.681625 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-03711772-125f-4c61-888b-470432ef3be6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 1.374197 Aug 18 11:35:24.703183 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1190/2313] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:23 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:24.719290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-04d0cc94-aeb8-4a22-b68c-067c136df01f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:24.720477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-04d0cc94-aeb8-4a22-b68c-067c136df01f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:24.744209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04d0cc94-aeb8-4a22-b68c-067c136df01f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:24.748317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04d0cc94-aeb8-4a22-b68c-067c136df01f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:24.751714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04d0cc94-aeb8-4a22-b68c-067c136df01f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:24.752962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04d0cc94-aeb8-4a22-b68c-067c136df01f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:24.759652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04d0cc94-aeb8-4a22-b68c-067c136df01f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:24.760488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04d0cc94-aeb8-4a22-b68c-067c136df01f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:25.862596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:26.395797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-04d0cc94-aeb8-4a22-b68c-067c136df01f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:26.423324 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-04d0cc94-aeb8-4a22-b68c-067c136df01f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1523 microversion: 2.1 time: 1.718552 Aug 18 11:35:26.437246 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1191/2314] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:24 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1523 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:26.457293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-33c5082f-1eba-4de1-8fa5-150388455ebf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:26.463940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-33c5082f-1eba-4de1-8fa5-150388455ebf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:26.493438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33c5082f-1eba-4de1-8fa5-150388455ebf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:26.512156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33c5082f-1eba-4de1-8fa5-150388455ebf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:26.512755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33c5082f-1eba-4de1-8fa5-150388455ebf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:26.514211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33c5082f-1eba-4de1-8fa5-150388455ebf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:26.514485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33c5082f-1eba-4de1-8fa5-150388455ebf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:26.515618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33c5082f-1eba-4de1-8fa5-150388455ebf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:26.652320 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-33c5082f-1eba-4de1-8fa5-150388455ebf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action" status: 200 len: 16398 microversion: 2.1 time: 0.208815 Aug 18 11:35:26.659684 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1192/2315] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:26 2022] POST /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806/action => generated 16398 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:35:26.690579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ca383953-fd92-4b06-b5db-0b4941f28a5b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:26.691933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ca383953-fd92-4b06-b5db-0b4941f28a5b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:26.731400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca383953-fd92-4b06-b5db-0b4941f28a5b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:26.732277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca383953-fd92-4b06-b5db-0b4941f28a5b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:26.732908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca383953-fd92-4b06-b5db-0b4941f28a5b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:26.738311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca383953-fd92-4b06-b5db-0b4941f28a5b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:26.739294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca383953-fd92-4b06-b5db-0b4941f28a5b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:26.740838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca383953-fd92-4b06-b5db-0b4941f28a5b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:27.296957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=46 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:27.586311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ca383953-fd92-4b06-b5db-0b4941f28a5b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:27.606993 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ca383953-fd92-4b06-b5db-0b4941f28a5b tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.941411 Aug 18 11:35:27.608466 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1193/2316] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:26 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:27.616614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-878f074d-97a5-40ec-bf81-68691afbedfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:27.618786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-878f074d-97a5-40ec-bf81-68691afbedfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:27.641835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-878f074d-97a5-40ec-bf81-68691afbedfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:27.642333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-878f074d-97a5-40ec-bf81-68691afbedfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:27.652734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-878f074d-97a5-40ec-bf81-68691afbedfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:27.655593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-878f074d-97a5-40ec-bf81-68691afbedfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:27.658013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-878f074d-97a5-40ec-bf81-68691afbedfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:27.658665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-878f074d-97a5-40ec-bf81-68691afbedfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:29.446413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-878f074d-97a5-40ec-bf81-68691afbedfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:29.455752 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-878f074d-97a5-40ec-bf81-68691afbedfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 1.845823 Aug 18 11:35:29.462160 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1194/2317] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:27 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:29.479752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de432d75-592a-4562-a3d6-aa92fca4065b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:29.480393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-de432d75-592a-4562-a3d6-aa92fca4065b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:29.509739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de432d75-592a-4562-a3d6-aa92fca4065b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:29.515340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de432d75-592a-4562-a3d6-aa92fca4065b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:29.520205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de432d75-592a-4562-a3d6-aa92fca4065b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:29.523088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de432d75-592a-4562-a3d6-aa92fca4065b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:29.523830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de432d75-592a-4562-a3d6-aa92fca4065b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:29.525345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de432d75-592a-4562-a3d6-aa92fca4065b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:29.655202 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6b949ee0-0f5e-45a7-bb86-9864fdebf7a7 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 200 len: 1459 microversion: 2.1 time: 12.041079 Aug 18 11:35:29.668532 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1124/2318] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:17 2022] GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 1459 bytes in 12055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:35:29.684568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c822a7f5-2169-456d-a1c7-a714fffb30fb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:29.685686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c822a7f5-2169-456d-a1c7-a714fffb30fb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:29.701418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c822a7f5-2169-456d-a1c7-a714fffb30fb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:29.703481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c822a7f5-2169-456d-a1c7-a714fffb30fb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:29.705195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c822a7f5-2169-456d-a1c7-a714fffb30fb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:29.707429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c822a7f5-2169-456d-a1c7-a714fffb30fb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:29.709080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c822a7f5-2169-456d-a1c7-a714fffb30fb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:29.709899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c822a7f5-2169-456d-a1c7-a714fffb30fb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:30.487321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c822a7f5-2169-456d-a1c7-a714fffb30fb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:30.508557 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c822a7f5-2169-456d-a1c7-a714fffb30fb tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.830773 Aug 18 11:35:30.509742 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1125/2319] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:29 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:30.533121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1149891c-8af2-4bdd-a39f-2eb42b548ca9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:30.539160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1149891c-8af2-4bdd-a39f-2eb42b548ca9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:30.569598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1149891c-8af2-4bdd-a39f-2eb42b548ca9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:30.570109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1149891c-8af2-4bdd-a39f-2eb42b548ca9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:30.580823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1149891c-8af2-4bdd-a39f-2eb42b548ca9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:30.589618 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1149891c-8af2-4bdd-a39f-2eb42b548ca9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:30.590164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1149891c-8af2-4bdd-a39f-2eb42b548ca9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:30.590668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1149891c-8af2-4bdd-a39f-2eb42b548ca9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:30.643923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-de432d75-592a-4562-a3d6-aa92fca4065b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:30.653394 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de432d75-592a-4562-a3d6-aa92fca4065b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1523 microversion: 2.1 time: 1.189800 Aug 18 11:35:30.659526 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1195/2320] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:29 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1523 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:30.687919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eef1b1a9-2da5-4cbd-ad3e-21219d313f3e tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fbc71f0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:30.866482 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eef1b1a9-2da5-4cbd-ad3e-21219d313f3e tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 200 len: 1459 microversion: 2.1 time: 0.205387 Aug 18 11:35:30.867859 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1196/2321] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:30 2022] GET /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 1459 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:30.889782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b83bb08d-36da-4cfb-aee5-ddaaf989c57a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:30.890592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b83bb08d-36da-4cfb-aee5-ddaaf989c57a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:30.923741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b83bb08d-36da-4cfb-aee5-ddaaf989c57a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:30.924253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b83bb08d-36da-4cfb-aee5-ddaaf989c57a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:30.926385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b83bb08d-36da-4cfb-aee5-ddaaf989c57a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:30.929243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b83bb08d-36da-4cfb-aee5-ddaaf989c57a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:30.929742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b83bb08d-36da-4cfb-aee5-ddaaf989c57a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:30.930193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b83bb08d-36da-4cfb-aee5-ddaaf989c57a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:31.607718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b83bb08d-36da-4cfb-aee5-ddaaf989c57a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:31.617381 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b83bb08d-36da-4cfb-aee5-ddaaf989c57a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1467 microversion: 2.1 time: 0.738995 Aug 18 11:35:31.626266 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1197/2322] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:30 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1467 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:31.640957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2187b6a0-30cb-4ae2-a35e-a6c8b3fcf0b0 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:31.646512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2187b6a0-30cb-4ae2-a35e-a6c8b3fcf0b0 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:31.660151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1149891c-8af2-4bdd-a39f-2eb42b548ca9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:31.665846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2187b6a0-30cb-4ae2-a35e-a6c8b3fcf0b0 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:31.666629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2187b6a0-30cb-4ae2-a35e-a6c8b3fcf0b0 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:31.667266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2187b6a0-30cb-4ae2-a35e-a6c8b3fcf0b0 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:31.669657 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1149891c-8af2-4bdd-a39f-2eb42b548ca9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 1.155925 Aug 18 11:35:31.671077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2187b6a0-30cb-4ae2-a35e-a6c8b3fcf0b0 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:31.671859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2187b6a0-30cb-4ae2-a35e-a6c8b3fcf0b0 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:31.672706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2187b6a0-30cb-4ae2-a35e-a6c8b3fcf0b0 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:31.685440 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1126/2323] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:30 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:31.714249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-21e69710-e2a2-43bd-8c31-982cc350fb4b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-42227110"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:31.726177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-21e69710-e2a2-43bd-8c31-982cc350fb4b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 51e3865d-a413-4c57-b0dc-1b29e76be1de] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:31.756388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21e69710-e2a2-43bd-8c31-982cc350fb4b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:31.761977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21e69710-e2a2-43bd-8c31-982cc350fb4b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:31.764589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21e69710-e2a2-43bd-8c31-982cc350fb4b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:31.765510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21e69710-e2a2-43bd-8c31-982cc350fb4b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:31.767667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21e69710-e2a2-43bd-8c31-982cc350fb4b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:31.768258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21e69710-e2a2-43bd-8c31-982cc350fb4b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:32.299469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2187b6a0-30cb-4ae2-a35e-a6c8b3fcf0b0 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:32.308650 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2187b6a0-30cb-4ae2-a35e-a6c8b3fcf0b0 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.679093 Aug 18 11:35:32.314790 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1198/2324] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:31 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:32.334080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c81ae87b-e9a9-4c49-bba2-53b424f63f2e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:32.335123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c81ae87b-e9a9-4c49-bba2-53b424f63f2e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:32.351220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c81ae87b-e9a9-4c49-bba2-53b424f63f2e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:32.355575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c81ae87b-e9a9-4c49-bba2-53b424f63f2e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:32.356207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c81ae87b-e9a9-4c49-bba2-53b424f63f2e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:32.358542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c81ae87b-e9a9-4c49-bba2-53b424f63f2e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:32.359027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c81ae87b-e9a9-4c49-bba2-53b424f63f2e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:32.359452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c81ae87b-e9a9-4c49-bba2-53b424f63f2e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:32.396315 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-21e69710-e2a2-43bd-8c31-982cc350fb4b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "POST /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de/action" status: 202 len: 0 microversion: 2.1 time: 0.699259 Aug 18 11:35:32.399994 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1127/2325] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:31 2022] POST /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de/action => generated 0 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 18 11:35:32.427246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-91376885-8971-4406-81b3-ae3fe7557e77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:32.429770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-91376885-8971-4406-81b3-ae3fe7557e77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:32.464325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91376885-8971-4406-81b3-ae3fe7557e77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:32.465731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91376885-8971-4406-81b3-ae3fe7557e77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:32.466487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91376885-8971-4406-81b3-ae3fe7557e77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:32.467419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91376885-8971-4406-81b3-ae3fe7557e77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:32.468969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91376885-8971-4406-81b3-ae3fe7557e77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:32.472272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91376885-8971-4406-81b3-ae3fe7557e77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:33.092676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-91376885-8971-4406-81b3-ae3fe7557e77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:33.105769 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-91376885-8971-4406-81b3-ae3fe7557e77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.699851 Aug 18 11:35:33.108447 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1128/2326] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:32 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:33.132152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa129528-352f-44b4-9f9a-605bcf8b3c65 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f51ac554dc0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:33.206779 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fa129528-352f-44b4-9f9a-605bcf8b3c65 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a" status: 200 len: 1449 microversion: 2.1 time: 0.086878 Aug 18 11:35:33.208785 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1129/2327] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:33 2022] GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a => generated 1449 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:33.219365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-261ded3f-c175-4357-9024-b2aefbb44a07 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:33.222217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-261ded3f-c175-4357-9024-b2aefbb44a07 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:33.247381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-261ded3f-c175-4357-9024-b2aefbb44a07 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:33.248363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-261ded3f-c175-4357-9024-b2aefbb44a07 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:33.248982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-261ded3f-c175-4357-9024-b2aefbb44a07 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:33.249944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-261ded3f-c175-4357-9024-b2aefbb44a07 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:33.252038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-261ded3f-c175-4357-9024-b2aefbb44a07 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:33.253883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-261ded3f-c175-4357-9024-b2aefbb44a07 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:33.590540 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-261ded3f-c175-4357-9024-b2aefbb44a07 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:33.599518 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-261ded3f-c175-4357-9024-b2aefbb44a07 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.389193 Aug 18 11:35:33.603162 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1130/2328] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:33 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:33.612441 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b7e6c0b4-7fba-49d0-96a3-562c3431c6d4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:33.615497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b7e6c0b4-7fba-49d0-96a3-562c3431c6d4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:33.635655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b7e6c0b4-7fba-49d0-96a3-562c3431c6d4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:33.638634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b7e6c0b4-7fba-49d0-96a3-562c3431c6d4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:33.639291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b7e6c0b4-7fba-49d0-96a3-562c3431c6d4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:33.640228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b7e6c0b4-7fba-49d0-96a3-562c3431c6d4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:33.640885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b7e6c0b4-7fba-49d0-96a3-562c3431c6d4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:33.646611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b7e6c0b4-7fba-49d0-96a3-562c3431c6d4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:33.737791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c81ae87b-e9a9-4c49-bba2-53b424f63f2e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:33.759929 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c81ae87b-e9a9-4c49-bba2-53b424f63f2e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1523 microversion: 2.1 time: 1.443760 Aug 18 11:35:33.762342 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1199/2329] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:32 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1523 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:33.789359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-720317f4-a373-4c19-9f44-8ac2f42f5e49 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:33.791925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-720317f4-a373-4c19-9f44-8ac2f42f5e49 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:33.808349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-720317f4-a373-4c19-9f44-8ac2f42f5e49 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:33.809144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-720317f4-a373-4c19-9f44-8ac2f42f5e49 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:33.809769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-720317f4-a373-4c19-9f44-8ac2f42f5e49 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:33.810731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-720317f4-a373-4c19-9f44-8ac2f42f5e49 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:33.811352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-720317f4-a373-4c19-9f44-8ac2f42f5e49 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:33.811941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-720317f4-a373-4c19-9f44-8ac2f42f5e49 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:33.938020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-720317f4-a373-4c19-9f44-8ac2f42f5e49 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Locking {{(pid=122210) lock /opt/stack/nova/nova/compute/api.py:4794}} Aug 18 11:35:34.151114 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-720317f4-a373-4c19-9f44-8ac2f42f5e49 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.381925 Aug 18 11:35:34.155681 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1200/2330] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:33 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:34.168862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b117e6d-ca88-4838-968e-3d686beb88eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:34.170997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b117e6d-ca88-4838-968e-3d686beb88eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:34.174595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:34.181614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b7e6c0b4-7fba-49d0-96a3-562c3431c6d4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:34.187131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b117e6d-ca88-4838-968e-3d686beb88eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:34.187562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b117e6d-ca88-4838-968e-3d686beb88eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:34.187983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b117e6d-ca88-4838-968e-3d686beb88eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:34.188719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b117e6d-ca88-4838-968e-3d686beb88eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:34.194300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b117e6d-ca88-4838-968e-3d686beb88eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:34.194725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b117e6d-ca88-4838-968e-3d686beb88eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:34.200081 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b7e6c0b4-7fba-49d0-96a3-562c3431c6d4 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.593842 Aug 18 11:35:34.202586 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1131/2331] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:33 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:34.217230 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-d9e3954d-fc64-474b-8cf5-683586c27ec5 req-ede7891e-a50a-4db5-938b-ca3e9f0d52f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b34fc6-468f-4179-b73f-6776c809d055", "name": "network-vif-unplugged", "status": "completed", "tag": "7aa41449-e2a8-4d62-a5db-c9bcce1f4420"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:34.264245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d9e3954d-fc64-474b-8cf5-683586c27ec5 req-ede7891e-a50a-4db5-938b-ca3e9f0d52f8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:34.266402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d9e3954d-fc64-474b-8cf5-683586c27ec5 req-ede7891e-a50a-4db5-938b-ca3e9f0d52f8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:34.268744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d9e3954d-fc64-474b-8cf5-683586c27ec5 req-ede7891e-a50a-4db5-938b-ca3e9f0d52f8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:34.326952 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-d9e3954d-fc64-474b-8cf5-683586c27ec5 req-ede7891e-a50a-4db5-938b-ca3e9f0d52f8 service nova] Creating event network-vif-unplugged:7aa41449-e2a8-4d62-a5db-c9bcce1f4420 for instance 61b34fc6-468f-4179-b73f-6776c809d055 on n-h1-853611-3 Aug 18 11:35:34.367500 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-d9e3954d-fc64-474b-8cf5-683586c27ec5 req-ede7891e-a50a-4db5-938b-ca3e9f0d52f8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156932 Aug 18 11:35:34.372044 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1132/2332] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:34.385125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d57a8635-856c-449e-aff3-35f84135d758 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fa62e50>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:34.541762 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d57a8635-856c-449e-aff3-35f84135d758 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a" status: 200 len: 1449 microversion: 2.1 time: 0.167146 Aug 18 11:35:34.543794 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1133/2333] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:34 2022] GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a => generated 1449 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:34.785060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f20bddc5-f238-42c8-95ae-fb1d2c969d8d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:34.791749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f20bddc5-f238-42c8-95ae-fb1d2c969d8d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:34.839526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f20bddc5-f238-42c8-95ae-fb1d2c969d8d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:34.840585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f20bddc5-f238-42c8-95ae-fb1d2c969d8d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:34.841265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f20bddc5-f238-42c8-95ae-fb1d2c969d8d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:34.842250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f20bddc5-f238-42c8-95ae-fb1d2c969d8d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:34.843034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f20bddc5-f238-42c8-95ae-fb1d2c969d8d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:34.843759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f20bddc5-f238-42c8-95ae-fb1d2c969d8d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:35.640474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f20bddc5-f238-42c8-95ae-fb1d2c969d8d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:35.650531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b117e6d-ca88-4838-968e-3d686beb88eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:35.665256 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b117e6d-ca88-4838-968e-3d686beb88eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 1.506936 Aug 18 11:35:35.666830 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f20bddc5-f238-42c8-95ae-fb1d2c969d8d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1523 microversion: 2.1 time: 0.884531 Aug 18 11:35:35.668030 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1201/2334] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:34 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:35.686926 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1134/2335] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:34 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1523 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:35.700109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fdf5ecc2-be06-44aa-8f16-958ee918a4d6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:35.701195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fdf5ecc2-be06-44aa-8f16-958ee918a4d6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:35.704183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cb21aea4-b948-407d-9447-be427db202fc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fa9c160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:35.716032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fdf5ecc2-be06-44aa-8f16-958ee918a4d6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:35.718248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fdf5ecc2-be06-44aa-8f16-958ee918a4d6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:35.718968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fdf5ecc2-be06-44aa-8f16-958ee918a4d6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:35.720971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fdf5ecc2-be06-44aa-8f16-958ee918a4d6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:35.721595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fdf5ecc2-be06-44aa-8f16-958ee918a4d6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:35.722217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fdf5ecc2-be06-44aa-8f16-958ee918a4d6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:35.807030 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cb21aea4-b948-407d-9447-be427db202fc tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a" status: 200 len: 1449 microversion: 2.1 time: 0.117592 Aug 18 11:35:35.822123 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1135/2336] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:35 2022] GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a => generated 1449 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:35.839468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b6a699c2-a7e6-4a87-ad15-aa8c90dc0d56 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:35.859224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6a699c2-a7e6-4a87-ad15-aa8c90dc0d56 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:35.860208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6a699c2-a7e6-4a87-ad15-aa8c90dc0d56 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:35.860942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6a699c2-a7e6-4a87-ad15-aa8c90dc0d56 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:35.934386 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-b6a699c2-a7e6-4a87-ad15-aa8c90dc0d56 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] HTTP exception thrown: Instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c is locked Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b6a699c2-a7e6-4a87-ad15-aa8c90dc0d56 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Request method failure captured: Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action HTTP/1.1 Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 15 Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iLmk9InP0duM3a0KDx_rtZKV8FK6L1K2bxM2FY_EgJYqIM7l6-dvd1lSerO55Wyi5U4yj1fTG6Vc3OaZITag4LeT6S8IZr53KJqlR_jcP3WXpPplfH-I6YY1lxUr6Gwpsy1_3hY6Dk0Yq1AVixRwd4iEqTkfityyzTwlhBMvpVDaIo Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: c1a985dc6f824e5b847a2d966c0f79af Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerActionsTestJSON-998907994 Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerActionsTestJSON-998907994 Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: c1a985dc6f824e5b847a2d966c0f79af Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerActionsTestJSON-998907994 Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerActionsTestJSON-998907994-project Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 0cd8451c50d941409a66864cbc1c7201 Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerActionsTestJSON-998907994-project Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: {"os-stop": {}} Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c is locked Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'a2a906b8-26ea-4413-bed0-9c6f7a6be35c', 'body': {'os-stop': {}}} Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c is locked Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c is locked Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c is locked Aug 18 11:35:35.940062 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:35:35.945109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b6a699c2-a7e6-4a87-ad15-aa8c90dc0d56 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Returning 409 to user: Instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c is locked {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:35:35.945109 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b6a699c2-a7e6-4a87-ad15-aa8c90dc0d56 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 409 len: 107 microversion: 2.1 time: 0.120698 Aug 18 11:35:35.950080 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1136/2337] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:35 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 107 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:35:35.957954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-93ac17d4-b96b-4f1a-9455-c52589faf7be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:35.961197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-93ac17d4-b96b-4f1a-9455-c52589faf7be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:35.978867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93ac17d4-b96b-4f1a-9455-c52589faf7be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:35.979383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93ac17d4-b96b-4f1a-9455-c52589faf7be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:35.979838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93ac17d4-b96b-4f1a-9455-c52589faf7be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:35.982862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93ac17d4-b96b-4f1a-9455-c52589faf7be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:35.983569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93ac17d4-b96b-4f1a-9455-c52589faf7be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:35.984829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93ac17d4-b96b-4f1a-9455-c52589faf7be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:36.100655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-93ac17d4-b96b-4f1a-9455-c52589faf7be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Unlocking {{(pid=122209) unlock /opt/stack/nova/nova/compute/api.py:4823}} Aug 18 11:35:36.250265 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-93ac17d4-b96b-4f1a-9455-c52589faf7be tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.299850 Aug 18 11:35:36.256052 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1137/2338] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:35 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:36.263040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-82749ef3-5ad1-4261-8c25-b7a993dd5c9d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:36.270520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82749ef3-5ad1-4261-8c25-b7a993dd5c9d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:36.271763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82749ef3-5ad1-4261-8c25-b7a993dd5c9d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:36.272459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82749ef3-5ad1-4261-8c25-b7a993dd5c9d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:36.323955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-82749ef3-5ad1-4261-8c25-b7a993dd5c9d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Going to try to stop instance {{(pid=122209) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 11:35:36.437662 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-82749ef3-5ad1-4261-8c25-b7a993dd5c9d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.175802 Aug 18 11:35:36.444402 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1138/2339] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:36 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:36.461761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-281579d1-daee-4e5c-b2b0-4bf202163c52 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:36.466813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-281579d1-daee-4e5c-b2b0-4bf202163c52 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:36.484945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-281579d1-daee-4e5c-b2b0-4bf202163c52 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:36.485844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-281579d1-daee-4e5c-b2b0-4bf202163c52 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:36.486737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-281579d1-daee-4e5c-b2b0-4bf202163c52 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:36.489994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-281579d1-daee-4e5c-b2b0-4bf202163c52 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:36.491508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-281579d1-daee-4e5c-b2b0-4bf202163c52 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:36.493118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-281579d1-daee-4e5c-b2b0-4bf202163c52 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:36.503504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fdf5ecc2-be06-44aa-8f16-958ee918a4d6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:36.578057 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fdf5ecc2-be06-44aa-8f16-958ee918a4d6 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1523 microversion: 2.1 time: 0.908306 Aug 18 11:35:36.578351 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1202/2340] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:35 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1523 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:36.697348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b831530d-d3c8-4e1a-9829-8f2dc38071db tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:36.698095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b831530d-d3c8-4e1a-9829-8f2dc38071db tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:36.759476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b831530d-d3c8-4e1a-9829-8f2dc38071db tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:36.761586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b831530d-d3c8-4e1a-9829-8f2dc38071db tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:36.762247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b831530d-d3c8-4e1a-9829-8f2dc38071db tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:36.764416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b831530d-d3c8-4e1a-9829-8f2dc38071db tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:36.766166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b831530d-d3c8-4e1a-9829-8f2dc38071db tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:36.766799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b831530d-d3c8-4e1a-9829-8f2dc38071db tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:37.302140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-281579d1-daee-4e5c-b2b0-4bf202163c52 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:37.314045 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-281579d1-daee-4e5c-b2b0-4bf202163c52 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1679 microversion: 2.1 time: 0.866936 Aug 18 11:35:37.320001 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1139/2341] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:36 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1679 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:37.330175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1fe83a99-a7a2-4326-8a5c-9708bb635178 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f625e50>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:38.089899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b831530d-d3c8-4e1a-9829-8f2dc38071db tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:38.103464 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b831530d-d3c8-4e1a-9829-8f2dc38071db tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1523 microversion: 2.1 time: 1.411585 Aug 18 11:35:38.122474 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1203/2342] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:36 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1523 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:38.148307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f287155f-ffe4-4343-9d73-91407e4c44dd tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:38.152082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f287155f-ffe4-4343-9d73-91407e4c44dd tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:38.167945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f287155f-ffe4-4343-9d73-91407e4c44dd tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:38.169666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f287155f-ffe4-4343-9d73-91407e4c44dd tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:38.171459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f287155f-ffe4-4343-9d73-91407e4c44dd tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:38.172266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f287155f-ffe4-4343-9d73-91407e4c44dd tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:38.172743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f287155f-ffe4-4343-9d73-91407e4c44dd tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:38.173179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f287155f-ffe4-4343-9d73-91407e4c44dd tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:40.057083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f287155f-ffe4-4343-9d73-91407e4c44dd tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:40.071599 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f287155f-ffe4-4343-9d73-91407e4c44dd tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1503 microversion: 2.1 time: 1.947728 Aug 18 11:35:40.080830 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1204/2343] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:38 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1503 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:40.110686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8e388b7b-8027-47e9-96f1-7186bb14c385 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:40.116605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8e388b7b-8027-47e9-96f1-7186bb14c385 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:40.146671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e388b7b-8027-47e9-96f1-7186bb14c385 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:40.147956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e388b7b-8027-47e9-96f1-7186bb14c385 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:40.150064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e388b7b-8027-47e9-96f1-7186bb14c385 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:40.151955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e388b7b-8027-47e9-96f1-7186bb14c385 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:40.154351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e388b7b-8027-47e9-96f1-7186bb14c385 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:40.155104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e388b7b-8027-47e9-96f1-7186bb14c385 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:40.731913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8e388b7b-8027-47e9-96f1-7186bb14c385 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:40.790614 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8e388b7b-8027-47e9-96f1-7186bb14c385 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1679 microversion: 2.1 time: 0.700376 Aug 18 11:35:40.817576 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1205/2344] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:40 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1679 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:40.859629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cbb910a1-db4b-4d5e-a6fa-4889ea2cc6d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:40.867246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cbb910a1-db4b-4d5e-a6fa-4889ea2cc6d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:40.924479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbb910a1-db4b-4d5e-a6fa-4889ea2cc6d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:40.929201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbb910a1-db4b-4d5e-a6fa-4889ea2cc6d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:40.932554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbb910a1-db4b-4d5e-a6fa-4889ea2cc6d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:40.933883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbb910a1-db4b-4d5e-a6fa-4889ea2cc6d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:40.942244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbb910a1-db4b-4d5e-a6fa-4889ea2cc6d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:40.945519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbb910a1-db4b-4d5e-a6fa-4889ea2cc6d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:41.128595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:41.607063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cbb910a1-db4b-4d5e-a6fa-4889ea2cc6d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:41.619686 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cbb910a1-db4b-4d5e-a6fa-4889ea2cc6d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1523 microversion: 2.1 time: 0.799812 Aug 18 11:35:41.633099 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1206/2345] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:40 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1523 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:41.639486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5d00d3e9-4347-4487-ab64-35dc4b254fec tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Action: 'create', calling method: .version_select at 0x7f51ac3beca0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-697212393", "description": "tempest-description-1842023902"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:42.331645 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5d00d3e9-4347-4487-ab64-35dc4b254fec tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.697111 Aug 18 11:35:42.335529 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1207/2346] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:35:41 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:42.344460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1757248589", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "e6580407-1f5f-48c9-8a1b-ec236739cf11"}, {"uuid": "e0b0d061-f220-4d70-a9ba-f3564eb80e87"}, {"uuid": "e6580407-1f5f-48c9-8a1b-ec236739cf11"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:45.218562 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1fe83a99-a7a2-4326-8a5c-9708bb635178 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a" status: 200 len: 1449 microversion: 2.1 time: 7.897030 Aug 18 11:35:45.230471 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1140/2347] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:37 2022] GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a => generated 1449 bytes in 7909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:45.230599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] validate_networks() for [('e6580407-1f5f-48c9-8a1b-ec236739cf11', None, None, None, None, None), ('e0b0d061-f220-4d70-a9ba-f3564eb80e87', None, None, None, None, None), ('e6580407-1f5f-48c9-8a1b-ec236739cf11', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:35:45.253329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b21ccdf3-2f40-44db-a181-0d4ccf5b9e97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:45.253329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b21ccdf3-2f40-44db-a181-0d4ccf5b9e97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:45.273197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b21ccdf3-2f40-44db-a181-0d4ccf5b9e97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:45.273703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b21ccdf3-2f40-44db-a181-0d4ccf5b9e97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:45.274148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b21ccdf3-2f40-44db-a181-0d4ccf5b9e97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:45.278734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b21ccdf3-2f40-44db-a181-0d4ccf5b9e97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:45.279321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b21ccdf3-2f40-44db-a181-0d4ccf5b9e97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:45.279775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b21ccdf3-2f40-44db-a181-0d4ccf5b9e97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:45.653759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b21ccdf3-2f40-44db-a181-0d4ccf5b9e97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:45.656290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:45.679014 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b21ccdf3-2f40-44db-a181-0d4ccf5b9e97 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1679 microversion: 2.1 time: 0.446331 Aug 18 11:35:45.682013 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1141/2348] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:45 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1679 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:45.709139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2e7c771-794d-4397-a61e-ff9977ee4a6a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-697212393"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:45.710686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a2e7c771-794d-4397-a61e-ff9977ee4a6a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:45.743944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2e7c771-794d-4397-a61e-ff9977ee4a6a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:45.744519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2e7c771-794d-4397-a61e-ff9977ee4a6a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:45.745914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2e7c771-794d-4397-a61e-ff9977ee4a6a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:45.749133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2e7c771-794d-4397-a61e-ff9977ee4a6a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:45.749509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2e7c771-794d-4397-a61e-ff9977ee4a6a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:45.750106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2e7c771-794d-4397-a61e-ff9977ee4a6a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:46.067350 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.network.security_group_api [None req-a2e7c771-794d-4397-a61e-ff9977ee4a6a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Adding security group 5a5bb2a9-9c20-4f75-a15f-dbdffdc3ae03 to port a50a09ef-ed01-44ae-96dc-b34d0e3ea646 Aug 18 11:35:47.001454 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a2e7c771-794d-4397-a61e-ff9977ee4a6a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "POST /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3/action" status: 202 len: 0 microversion: 2.1 time: 1.310947 Aug 18 11:35:47.003578 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1142/2349] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:45 2022] POST /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3/action => generated 0 bytes in 1318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:47.010015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7f7a805a-fbc6-407d-8d85-91024ec25e00 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:47.011557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7f7a805a-fbc6-407d-8d85-91024ec25e00 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:47.031503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f7a805a-fbc6-407d-8d85-91024ec25e00 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:47.032084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f7a805a-fbc6-407d-8d85-91024ec25e00 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:47.032898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f7a805a-fbc6-407d-8d85-91024ec25e00 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:47.033631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f7a805a-fbc6-407d-8d85-91024ec25e00 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:47.034095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f7a805a-fbc6-407d-8d85-91024ec25e00 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:47.034553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f7a805a-fbc6-407d-8d85-91024ec25e00 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:47.311650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7f7a805a-fbc6-407d-8d85-91024ec25e00 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:47.327605 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7f7a805a-fbc6-407d-8d85-91024ec25e00 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1505 microversion: 2.1 time: 0.322089 Aug 18 11:35:47.328601 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1143/2350] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:47 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:47.645825 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-af8c209e-33ea-42ad-9f57-9443df97d9ea tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Action: 'create', calling method: .version_select at 0x7f51ac23b9d0>, body: {"keypair": {"name": "tempest-keypair-859566373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgWC+yjw8S5/cJGzHeYu4RJTAw0j0yX1cwR3t48oKa9GhOP0lI3/Ny/Uy/ru6bHCxvNn+vlFvyhpgukx5nS256PAd1ShnsC7ee3UtTGXBc7OeaywBr5AtaJZNt07eRXWQ=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:47.716430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-af8c209e-33ea-42ad-9f57-9443df97d9ea tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Getting quotas for project 344f7f9d319f4a3fb6d2089c02e8c5a9. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:35:47.723239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-af8c209e-33ea-42ad-9f57-9443df97d9ea tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Getting quotas for user f7f8d720a3b14f698850489ae40b9d44 and project 344f7f9d319f4a3fb6d2089c02e8c5a9. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:35:47.761315 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-af8c209e-33ea-42ad-9f57-9443df97d9ea tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.430833 Aug 18 11:35:47.762832 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1144/2351] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:35:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:47.776441 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c99c8b83-12a0-4e19-a824-bea95ba538e8 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f94fa60>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:47.886406 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c99c8b83-12a0-4e19-a824-bea95ba538e8 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a" status: 200 len: 1449 microversion: 2.1 time: 0.121332 Aug 18 11:35:47.888681 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1145/2352] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:47 2022] GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a => generated 1449 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:48.065741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:35:48.066726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:35:48.067362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:35:48.067936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:35:48.068432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:35:48.088304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:48.091992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:48.094373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:48.099340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:48.100175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:48.100854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:48.151543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Getting quotas for project f31cf551fa744480b3aeb24d97f9c7ae. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:35:48.161946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Getting quotas for user a31512cf212247b59aa951006f887d02 and project f31cf551fa744480b3aeb24d97f9c7ae. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:35:48.200097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:35:48.205586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:35:48.339826 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a4cf8bf-4d8b-4496-80f4-df71ab38af5d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.002902 Aug 18 11:35:48.341920 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1208/2353] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:35:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 6006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:35:48.524252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ab8102fd-93c9-4ed6-afd5-f0e10cb8f2d9 tempest-QuotaClassesAdmin257Test-1779343144 tempest-QuotaClassesAdmin257Test-1779343144-project-admin] Calling method '.version_select at 0x7f519ffc5c10>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:48.525771 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:35:48.525771 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:35:48.584490 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ab8102fd-93c9-4ed6-afd5-f0e10cb8f2d9 tempest-QuotaClassesAdmin257Test-1779343144 tempest-QuotaClassesAdmin257Test-1779343144-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.689078 Aug 18 11:35:48.589613 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1146/2354] 10.222.0.73 () {60 vars in 1226 bytes} [Thu Aug 18 11:35:47 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:35:48.603574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-49fa57ed-d0a8-4815-a717-2e7d920dd0ed req-96945248-c2c0-46e4-9225-f12196ff5043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e3865d-a413-4c57-b0dc-1b29e76be1de", "name": "network-vif-plugged", "status": "completed", "tag": "1fd7f00c-a7c9-42e6-b6f0-3b9378c92c89"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:48.645015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-49fa57ed-d0a8-4815-a717-2e7d920dd0ed req-96945248-c2c0-46e4-9225-f12196ff5043 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:48.645587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-49fa57ed-d0a8-4815-a717-2e7d920dd0ed req-96945248-c2c0-46e4-9225-f12196ff5043 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:48.648019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-49fa57ed-d0a8-4815-a717-2e7d920dd0ed req-96945248-c2c0-46e4-9225-f12196ff5043 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:48.722694 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-49fa57ed-d0a8-4815-a717-2e7d920dd0ed req-96945248-c2c0-46e4-9225-f12196ff5043 service nova] Creating event network-vif-plugged:1fd7f00c-a7c9-42e6-b6f0-3b9378c92c89 for instance 51e3865d-a413-4c57-b0dc-1b29e76be1de on n-h1-853611-3 Aug 18 11:35:48.732505 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-49fa57ed-d0a8-4815-a717-2e7d920dd0ed req-96945248-c2c0-46e4-9225-f12196ff5043 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141129 Aug 18 11:35:48.738914 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1147/2355] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:48.787142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d94e81f2-6278-40b5-ab19-f90ea4efe891 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-697212393"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:48.791724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d94e81f2-6278-40b5-ab19-f90ea4efe891 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:48.829625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d94e81f2-6278-40b5-ab19-f90ea4efe891 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:48.831046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d94e81f2-6278-40b5-ab19-f90ea4efe891 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:48.832989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d94e81f2-6278-40b5-ab19-f90ea4efe891 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:48.836222 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d94e81f2-6278-40b5-ab19-f90ea4efe891 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:48.844174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d94e81f2-6278-40b5-ab19-f90ea4efe891 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:48.845519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d94e81f2-6278-40b5-ab19-f90ea4efe891 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:48.940777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4cc88884-ca85-4be1-ad86-8f87200d97ac tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:48.941502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4cc88884-ca85-4be1-ad86-8f87200d97ac tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:48.955616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc88884-ca85-4be1-ad86-8f87200d97ac tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:48.956208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc88884-ca85-4be1-ad86-8f87200d97ac tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:48.957911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc88884-ca85-4be1-ad86-8f87200d97ac tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:48.960763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc88884-ca85-4be1-ad86-8f87200d97ac tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:48.961436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc88884-ca85-4be1-ad86-8f87200d97ac tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:48.963513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc88884-ca85-4be1-ad86-8f87200d97ac tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:49.218140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4cc88884-ca85-4be1-ad86-8f87200d97ac tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:49.233576 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4cc88884-ca85-4be1-ad86-8f87200d97ac tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1656 microversion: 2.1 time: 0.886929 Aug 18 11:35:49.237356 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1209/2356] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:48 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1656 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:49.365636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-52358f7a-de7a-4cd2-9d48-b57388e2ab8c req-39e2fd3b-0ebe-4962-b824-e169faf81fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1582eb-3994-4092-a342-4c88340004c3", "tag": "a50a09ef-ed01-44ae-96dc-b34d0e3ea646"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:49.386676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-52358f7a-de7a-4cd2-9d48-b57388e2ab8c req-39e2fd3b-0ebe-4962-b824-e169faf81fd6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:49.387378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-52358f7a-de7a-4cd2-9d48-b57388e2ab8c req-39e2fd3b-0ebe-4962-b824-e169faf81fd6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:49.387813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-52358f7a-de7a-4cd2-9d48-b57388e2ab8c req-39e2fd3b-0ebe-4962-b824-e169faf81fd6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:49.414330 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-52358f7a-de7a-4cd2-9d48-b57388e2ab8c req-39e2fd3b-0ebe-4962-b824-e169faf81fd6 service nova] Creating event network-changed:a50a09ef-ed01-44ae-96dc-b34d0e3ea646 for instance 2e1582eb-3994-4092-a342-4c88340004c3 on n-h2-853611-3 Aug 18 11:35:49.420072 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.network.security_group_api [None req-d94e81f2-6278-40b5-ab19-f90ea4efe891 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Removing security group 5a5bb2a9-9c20-4f75-a15f-dbdffdc3ae03 from port a50a09ef-ed01-44ae-96dc-b34d0e3ea646 Aug 18 11:35:49.428159 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-52358f7a-de7a-4cd2-9d48-b57388e2ab8c req-39e2fd3b-0ebe-4962-b824-e169faf81fd6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188437 Aug 18 11:35:49.428781 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1210/2357] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:49.439324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a91d6480-3648-4f9a-84e5-2e0275125758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:49.446537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a91d6480-3648-4f9a-84e5-2e0275125758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:49.464010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a91d6480-3648-4f9a-84e5-2e0275125758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:49.464619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a91d6480-3648-4f9a-84e5-2e0275125758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:49.465248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a91d6480-3648-4f9a-84e5-2e0275125758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:49.466030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a91d6480-3648-4f9a-84e5-2e0275125758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:49.466669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a91d6480-3648-4f9a-84e5-2e0275125758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:49.467118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a91d6480-3648-4f9a-84e5-2e0275125758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:49.898517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a91d6480-3648-4f9a-84e5-2e0275125758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:49.924015 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a91d6480-3648-4f9a-84e5-2e0275125758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1505 microversion: 2.1 time: 0.493779 Aug 18 11:35:49.946303 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1211/2358] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:49 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:49.951643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-423e6cd0-ed25-43ea-a5d0-1881ae48292d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:49.952264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-423e6cd0-ed25-43ea-a5d0-1881ae48292d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:49.990402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-423e6cd0-ed25-43ea-a5d0-1881ae48292d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:49.991910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-423e6cd0-ed25-43ea-a5d0-1881ae48292d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:49.992925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-423e6cd0-ed25-43ea-a5d0-1881ae48292d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:49.993987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-423e6cd0-ed25-43ea-a5d0-1881ae48292d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:49.994987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-423e6cd0-ed25-43ea-a5d0-1881ae48292d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:49.995806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-423e6cd0-ed25-43ea-a5d0-1881ae48292d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:50.127839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-423e6cd0-ed25-43ea-a5d0-1881ae48292d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:50.143351 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-423e6cd0-ed25-43ea-a5d0-1881ae48292d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1209 microversion: 2.1 time: 0.195269 Aug 18 11:35:50.143574 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1212/2359] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:49 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1209 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:50.275769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2025168846", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:50.441449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:35:50.655757 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d94e81f2-6278-40b5-ab19-f90ea4efe891 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "POST /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3/action" status: 202 len: 0 microversion: 2.1 time: 1.912164 Aug 18 11:35:50.656578 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1148/2360] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:48 2022] POST /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3/action => generated 0 bytes in 1916 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:50.676241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b25ff324-f4bd-4c47-a904-981f49814fbe tempest-QuotaClassesAdmin257Test-1779343144 tempest-QuotaClassesAdmin257Test-1779343144-project-admin] Action: 'update', calling method: .version_select at 0x7f519fa62550>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:50.693772 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:35:50.693772 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:35:50.937103 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b25ff324-f4bd-4c47-a904-981f49814fbe tempest-QuotaClassesAdmin257Test-1779343144 tempest-QuotaClassesAdmin257Test-1779343144-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.278733 Aug 18 11:35:50.938793 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1149/2361] 10.222.0.73 () {62 vars in 1247 bytes} [Thu Aug 18 11:35:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:35:50.962117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-406d259f-b200-4717-ad91-11e1899ed5cd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fd95ca0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:51.095208 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-406d259f-b200-4717-ad91-11e1899ed5cd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a" status: 200 len: 1449 microversion: 2.1 time: 0.153307 Aug 18 11:35:51.095808 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1150/2362] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:50 2022] GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:51.124474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9a277c17-a896-4972-a755-d770e6f6f636 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:51.155345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a277c17-a896-4972-a755-d770e6f6f636 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:51.155870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a277c17-a896-4972-a755-d770e6f6f636 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:51.156300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a277c17-a896-4972-a755-d770e6f6f636 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:51.238815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9a277c17-a896-4972-a755-d770e6f6f636 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Going to try to start instance {{(pid=122209) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 18 11:35:51.375316 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9a277c17-a896-4972-a755-d770e6f6f636 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.278044 Aug 18 11:35:51.375832 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1151/2363] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:35:51 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:35:51.381314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8d66475a-ef13-4bf5-8344-0f59691244a9 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Action: 'create', calling method: .version_select at 0x7f519fa5bdc0>, body: {"pool": null} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:51.689969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:35:51.690992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:35:51.692016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:35:51.692511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:35:51.695723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:35:51.734969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:51.737152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:51.743012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:51.751110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:51.752398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:51.756966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:51.806407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Getting quotas for project 6387896b424840deb9ef97aae02edd99. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:35:51.824177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Getting quotas for user 9269fc4d233c42a590bfcbfaa7f2e895 and project 6387896b424840deb9ef97aae02edd99. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:35:51.854263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:35:51.864723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:35:51.985380 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a42e0f53-aaff-4ac1-8e96-205586fdc861 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.828367 Aug 18 11:35:51.994227 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1213/2364] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:35:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:35:51.998382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d0611c6-9c5e-4ea2-bade-27005d086534 tempest-QuotaClassesAdmin257Test-1779343144 tempest-QuotaClassesAdmin257Test-1779343144-project-admin] Calling method '.version_select at 0x7f51b0da29d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:51.999560 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:35:51.999560 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:35:52.026760 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d0611c6-9c5e-4ea2-bade-27005d086534 tempest-QuotaClassesAdmin257Test-1779343144 tempest-QuotaClassesAdmin257Test-1779343144-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.036472 Aug 18 11:35:52.027368 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1214/2365] 10.222.0.73 () {60 vars in 1226 bytes} [Thu Aug 18 11:35:51 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:35:52.048633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7997f17b-c26d-4af0-83c6-2dcfbc8e858d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:52.055480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7997f17b-c26d-4af0-83c6-2dcfbc8e858d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:52.074121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7997f17b-c26d-4af0-83c6-2dcfbc8e858d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:52.074897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7997f17b-c26d-4af0-83c6-2dcfbc8e858d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:52.075488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7997f17b-c26d-4af0-83c6-2dcfbc8e858d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:52.076279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7997f17b-c26d-4af0-83c6-2dcfbc8e858d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:52.076757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7997f17b-c26d-4af0-83c6-2dcfbc8e858d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:52.077194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7997f17b-c26d-4af0-83c6-2dcfbc8e858d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:52.822147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7997f17b-c26d-4af0-83c6-2dcfbc8e858d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:52.874081 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7997f17b-c26d-4af0-83c6-2dcfbc8e858d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 200 len: 1448 microversion: 2.1 time: 0.845602 Aug 18 11:35:52.885593 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1215/2366] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:52 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 1448 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:52.926552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-986f8712-c560-4697-a66c-f4593bc49e51 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:52.927546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-986f8712-c560-4697-a66c-f4593bc49e51 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:52.954002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-986f8712-c560-4697-a66c-f4593bc49e51 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:52.963040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-986f8712-c560-4697-a66c-f4593bc49e51 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:52.963911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-986f8712-c560-4697-a66c-f4593bc49e51 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:52.965433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-986f8712-c560-4697-a66c-f4593bc49e51 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:52.970601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-986f8712-c560-4697-a66c-f4593bc49e51 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:52.976580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-986f8712-c560-4697-a66c-f4593bc49e51 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:53.248821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-986f8712-c560-4697-a66c-f4593bc49e51 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:53.283928 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-986f8712-c560-4697-a66c-f4593bc49e51 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1271 microversion: 2.1 time: 0.369330 Aug 18 11:35:53.294739 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1216/2367] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:52 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1271 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:53.314642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1ae28e22-4df5-40b5-a62b-d80208bcff2f req-c193e8d9-8217-432b-966b-cd2b36606d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ad9e5e-ca95-4e76-9823-3d357ca17f37", "name": "network-vif-unplugged", "status": "completed", "tag": "bb50eb05-55f9-44f6-93f6-81a14dd7c19b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:53.356713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1ae28e22-4df5-40b5-a62b-d80208bcff2f req-c193e8d9-8217-432b-966b-cd2b36606d93 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:53.357212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1ae28e22-4df5-40b5-a62b-d80208bcff2f req-c193e8d9-8217-432b-966b-cd2b36606d93 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:53.357658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1ae28e22-4df5-40b5-a62b-d80208bcff2f req-c193e8d9-8217-432b-966b-cd2b36606d93 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:53.405760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.compute.server_external_events [req-1ae28e22-4df5-40b5-a62b-d80208bcff2f req-c193e8d9-8217-432b-966b-cd2b36606d93 service nova] Unable to find a host for instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37. Dropping event network-vif-unplugged {{(pid=122210) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 11:35:53.408767 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1ae28e22-4df5-40b5-a62b-d80208bcff2f req-c193e8d9-8217-432b-966b-cd2b36606d93 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.112248 Aug 18 11:35:53.411147 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1217/2368] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 116 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 18 11:35:53.431515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0d7868cf-3581-4aea-a4ee-326fb6972d1f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:53.432656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0d7868cf-3581-4aea-a4ee-326fb6972d1f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:53.459206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d7868cf-3581-4aea-a4ee-326fb6972d1f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:53.461322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d7868cf-3581-4aea-a4ee-326fb6972d1f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:53.466008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d7868cf-3581-4aea-a4ee-326fb6972d1f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:53.467044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d7868cf-3581-4aea-a4ee-326fb6972d1f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:53.467968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d7868cf-3581-4aea-a4ee-326fb6972d1f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:53.469768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d7868cf-3581-4aea-a4ee-326fb6972d1f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:53.861005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0d7868cf-3581-4aea-a4ee-326fb6972d1f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:53.874066 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0d7868cf-3581-4aea-a4ee-326fb6972d1f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1665 microversion: 2.1 time: 0.459294 Aug 18 11:35:53.875277 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1218/2369] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:53 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1665 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:53.910208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7fd8ec36-f173-46fe-9667-e0561187e337 req-899d8f9e-e065-40af-9c90-6378e5915897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1582eb-3994-4092-a342-4c88340004c3", "tag": "a50a09ef-ed01-44ae-96dc-b34d0e3ea646"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:53.941036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7fd8ec36-f173-46fe-9667-e0561187e337 req-899d8f9e-e065-40af-9c90-6378e5915897 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:53.943681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7fd8ec36-f173-46fe-9667-e0561187e337 req-899d8f9e-e065-40af-9c90-6378e5915897 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:53.944314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7fd8ec36-f173-46fe-9667-e0561187e337 req-899d8f9e-e065-40af-9c90-6378e5915897 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:53.980333 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7fd8ec36-f173-46fe-9667-e0561187e337 req-899d8f9e-e065-40af-9c90-6378e5915897 service nova] Creating event network-changed:a50a09ef-ed01-44ae-96dc-b34d0e3ea646 for instance 2e1582eb-3994-4092-a342-4c88340004c3 on n-h2-853611-3 Aug 18 11:35:54.009061 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7fd8ec36-f173-46fe-9667-e0561187e337 req-899d8f9e-e065-40af-9c90-6378e5915897 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115751 Aug 18 11:35:54.009743 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1219/2370] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:54.024070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f185dc5e-db35-4817-a6d1-ec29c8857f89 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:54.024780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f185dc5e-db35-4817-a6d1-ec29c8857f89 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:54.047383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f185dc5e-db35-4817-a6d1-ec29c8857f89 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:54.047883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f185dc5e-db35-4817-a6d1-ec29c8857f89 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:54.048349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f185dc5e-db35-4817-a6d1-ec29c8857f89 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:54.049052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f185dc5e-db35-4817-a6d1-ec29c8857f89 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:54.049515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f185dc5e-db35-4817-a6d1-ec29c8857f89 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:54.050741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f185dc5e-db35-4817-a6d1-ec29c8857f89 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:54.366675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f185dc5e-db35-4817-a6d1-ec29c8857f89 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:54.384196 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f185dc5e-db35-4817-a6d1-ec29c8857f89 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1265 microversion: 2.1 time: 0.372062 Aug 18 11:35:54.407071 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1220/2371] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:54 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1265 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:54.437643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-70d45b32-ff0d-4ff8-a439-a1672eab2289 tempest-QuotaClassesAdmin257Test-1779343144 tempest-QuotaClassesAdmin257Test-1779343144-project-admin] Action: 'update', calling method: .version_select at 0x7f51ac255820>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:54.445764 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:35:54.445764 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:35:54.625938 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-70d45b32-ff0d-4ff8-a439-a1672eab2289 tempest-QuotaClassesAdmin257Test-1779343144 tempest-QuotaClassesAdmin257Test-1779343144-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.213703 Aug 18 11:35:54.631171 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1221/2372] 10.222.0.73 () {62 vars in 1247 bytes} [Thu Aug 18 11:35:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:35:54.662298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5d710882-5171-4f51-bf0c-380fdcd6f835 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fa89f70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:54.809222 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5d710882-5171-4f51-bf0c-380fdcd6f835 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a" status: 200 len: 1449 microversion: 2.1 time: 0.175354 Aug 18 11:35:54.809222 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1222/2373] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:35:54 2022] GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a => generated 1449 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:54.832517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:54.833022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:54.866177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:54.866825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:54.867143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:54.880082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:54.880591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:54.881048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:54.951659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:35:54.965773 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.compute.api [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Working on deleting snapshot 8e7d1a04-6db4-4ce9-bb3a-b108270a0912 from shelved instance... Aug 18 11:35:56.470669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Doing local delete in cell 68989ef7-340f-4449-87c1-932f111c2bdb(cell1) {{(pid=122210) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 18 11:35:56.474898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:56.476656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:56.477365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:56.479002 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.compute.api [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 18 11:35:56.486089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] deallocate_for_instance() {{(pid=122210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 18 11:35:58.089099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Updating instance_info_cache with network_info: [] {{(pid=122210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 18 11:35:58.868662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:58.896893 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1ed197e7-9b62-446f-871c-56c8be016159 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "DELETE /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 204 len: 0 microversion: 2.1 time: 4.086412 Aug 18 11:35:58.897501 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1223/2374] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:35:54 2022] DELETE /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 0 bytes in 4088 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:35:58.919272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1793778867", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "eeb4634a-89fc-4d7b-a321-17fd0c589357"}], "security_groups": [{"name": "tempest-securitygroup--1747158390"}], "key_name": "tempest-keypair-859566373", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:35:58.974167 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8d66475a-ef13-4bf5-8344-0f59691244a9 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.596980 Aug 18 11:35:58.976403 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1152/2375] 10.222.0.73 () {60 vars in 1170 bytes} [Thu Aug 18 11:35:51 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:35:58.981790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-beb8fe34-9d22-47f1-9ac4-b941a0bac612 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:58.982754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-beb8fe34-9d22-47f1-9ac4-b941a0bac612 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:59.029647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=7 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:59.033227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-beb8fe34-9d22-47f1-9ac4-b941a0bac612 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:59.053073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-beb8fe34-9d22-47f1-9ac4-b941a0bac612 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:59.057399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-beb8fe34-9d22-47f1-9ac4-b941a0bac612 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:59.058362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-beb8fe34-9d22-47f1-9ac4-b941a0bac612 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:59.059509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-beb8fe34-9d22-47f1-9ac4-b941a0bac612 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:59.060095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-beb8fe34-9d22-47f1-9ac4-b941a0bac612 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:59.123190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] validate_networks() for [('eeb4634a-89fc-4d7b-a321-17fd0c589357', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:35:59.792289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-beb8fe34-9d22-47f1-9ac4-b941a0bac612 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:35:59.838170 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-beb8fe34-9d22-47f1-9ac4-b941a0bac612 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1334 microversion: 2.1 time: 0.855936 Aug 18 11:35:59.848160 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1153/2376] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:58 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1334 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:35:59.849380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Getting quotas for project 344f7f9d319f4a3fb6d2089c02e8c5a9. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:35:59.867290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d889cf22-a753-4ab8-a336-c8107b5d256c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:35:59.870590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d889cf22-a753-4ab8-a336-c8107b5d256c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:35:59.873161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Getting quotas for user f7f8d720a3b14f698850489ae40b9d44 and project 344f7f9d319f4a3fb6d2089c02e8c5a9. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:35:59.882076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:UPDATE=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:35:59.885908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d889cf22-a753-4ab8-a336-c8107b5d256c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:59.887745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d889cf22-a753-4ab8-a336-c8107b5d256c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:59.889743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d889cf22-a753-4ab8-a336-c8107b5d256c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:59.893818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d889cf22-a753-4ab8-a336-c8107b5d256c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:59.894589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d889cf22-a753-4ab8-a336-c8107b5d256c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:59.895777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d889cf22-a753-4ab8-a336-c8107b5d256c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:59.933660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:35:59.934412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:35:59.935087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:35:59.936775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:35:59.937395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:35:59.965034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:59.965541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:59.965992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:35:59.966783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:35:59.975082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:35:59.976095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:00.012259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Getting quotas for project 344f7f9d319f4a3fb6d2089c02e8c5a9. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:36:00.029720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Getting quotas for user f7f8d720a3b14f698850489ae40b9d44 and project 344f7f9d319f4a3fb6d2089c02e8c5a9. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:36:00.081969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:36:00.091410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:36:00.212414 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f6ea2915-5f28-4d0c-8270-82034c882a16 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.304363 Aug 18 11:36:00.213875 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1224/2377] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:35:58 2022] POST /compute/v2.1/servers => generated 407 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:36:00.220904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0948566f-4454-4d42-b332-00684d58faad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:00.224096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0948566f-4454-4d42-b332-00684d58faad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:00.232384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0948566f-4454-4d42-b332-00684d58faad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:00.232832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0948566f-4454-4d42-b332-00684d58faad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:00.233251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0948566f-4454-4d42-b332-00684d58faad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:00.233972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0948566f-4454-4d42-b332-00684d58faad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:00.234456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0948566f-4454-4d42-b332-00684d58faad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:00.234912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0948566f-4454-4d42-b332-00684d58faad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:00.383907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d889cf22-a753-4ab8-a336-c8107b5d256c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:00.396133 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d889cf22-a753-4ab8-a336-c8107b5d256c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.545312 Aug 18 11:36:00.397800 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1154/2378] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:35:59 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:00.411263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-186c388c-80e4-4cf2-8669-5d21001a5903 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f92c310>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:00.507738 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-186c388c-80e4-4cf2-8669-5d21001a5903 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a" status: 200 len: 1449 microversion: 2.1 time: 0.108435 Aug 18 11:36:00.516609 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1155/2379] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:36:00 2022] GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a => generated 1449 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:00.535038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0948566f-4454-4d42-b332-00684d58faad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:00.546574 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0948566f-4454-4d42-b332-00684d58faad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1313 microversion: 2.1 time: 0.331378 Aug 18 11:36:00.550804 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1225/2380] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:00 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:00.568518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7ebec281-ff7e-42f2-83e6-7d64cba24634 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:00.569356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7ebec281-ff7e-42f2-83e6-7d64cba24634 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:00.584210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ebec281-ff7e-42f2-83e6-7d64cba24634 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:00.584718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ebec281-ff7e-42f2-83e6-7d64cba24634 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:00.585159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ebec281-ff7e-42f2-83e6-7d64cba24634 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:00.585881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ebec281-ff7e-42f2-83e6-7d64cba24634 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:00.586332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ebec281-ff7e-42f2-83e6-7d64cba24634 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:00.592288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ebec281-ff7e-42f2-83e6-7d64cba24634 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:00.637904 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-7ebec281-ff7e-42f2-83e6-7d64cba24634 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7ebec281-ff7e-42f2-83e6-7d64cba24634 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 HTTP/1.1 Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '23ad9e5e-ca95-4e76-9823-3d357ca17f37'} Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:00.640078 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:00.643816 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:00.643816 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:00.643816 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:00.643816 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:36:00.643816 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:36:00.643816 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:36:00.643816 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:00.647290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7ebec281-ff7e-42f2-83e6-7d64cba24634 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:36:00.648464 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7ebec281-ff7e-42f2-83e6-7d64cba24634 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 404 len: 111 microversion: 2.1 time: 0.096046 Aug 18 11:36:00.656572 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1226/2381] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:00 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:36:00.669066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-07992f72-d9af-4901-8ca7-770287653542 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.55"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:00.683764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-07992f72-d9af-4901-8ca7-770287653542 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:00.761249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07992f72-d9af-4901-8ca7-770287653542 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:00.762530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07992f72-d9af-4901-8ca7-770287653542 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:00.763181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07992f72-d9af-4901-8ca7-770287653542 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:00.765966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07992f72-d9af-4901-8ca7-770287653542 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:00.766747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07992f72-d9af-4901-8ca7-770287653542 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:00.767364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07992f72-d9af-4901-8ca7-770287653542 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:00.896167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07992f72-d9af-4901-8ca7-770287653542 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "refresh_cache-2e1582eb-3994-4092-a342-4c88340004c3" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:36:00.896598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07992f72-d9af-4901-8ca7-770287653542 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquired lock "refresh_cache-2e1582eb-3994-4092-a342-4c88340004c3" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:36:00.929734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=14,nova_cell0:UPDATE=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:01.013934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-7486b479-1337-4a75-9e92-d1291a97e688 req-48a970d4-2221-4914-82a5-7e29eabeef41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ad9e5e-ca95-4e76-9823-3d357ca17f37", "name": "network-vif-deleted", "tag": "bb50eb05-55f9-44f6-93f6-81a14dd7c19b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:01.048307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7486b479-1337-4a75-9e92-d1291a97e688 req-48a970d4-2221-4914-82a5-7e29eabeef41 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:01.048811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7486b479-1337-4a75-9e92-d1291a97e688 req-48a970d4-2221-4914-82a5-7e29eabeef41 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:01.049875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7486b479-1337-4a75-9e92-d1291a97e688 req-48a970d4-2221-4914-82a5-7e29eabeef41 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:01.088832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.compute.server_external_events [req-7486b479-1337-4a75-9e92-d1291a97e688 req-48a970d4-2221-4914-82a5-7e29eabeef41 service nova] Unable to find a host for instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37. Dropping event network-vif-deleted {{(pid=122209) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 11:36:01.089790 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-7486b479-1337-4a75-9e92-d1291a97e688 req-48a970d4-2221-4914-82a5-7e29eabeef41 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.572134 Aug 18 11:36:01.091618 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1156/2382] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 574 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 18 11:36:01.106289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5e3e74e9-278e-49bb-843c-39b3bfc8f626 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:01.107221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5e3e74e9-278e-49bb-843c-39b3bfc8f626 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:01.301006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5e3e74e9-278e-49bb-843c-39b3bfc8f626 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:01.318484 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5e3e74e9-278e-49bb-843c-39b3bfc8f626 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 200 len: 1269 microversion: 2.1 time: 0.224515 Aug 18 11:36:01.323718 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1157/2383] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:01 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 1269 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:01.329597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-db5d0987-4796-451b-aef2-fdd24f1b2b67 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:01.331338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-db5d0987-4796-451b-aef2-fdd24f1b2b67 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:01.366906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db5d0987-4796-451b-aef2-fdd24f1b2b67 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:01.369145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db5d0987-4796-451b-aef2-fdd24f1b2b67 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:01.371231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db5d0987-4796-451b-aef2-fdd24f1b2b67 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:01.373520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db5d0987-4796-451b-aef2-fdd24f1b2b67 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:01.378674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db5d0987-4796-451b-aef2-fdd24f1b2b67 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:01.382997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db5d0987-4796-451b-aef2-fdd24f1b2b67 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:01.954657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-db5d0987-4796-451b-aef2-fdd24f1b2b67 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:01.964424 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-db5d0987-4796-451b-aef2-fdd24f1b2b67 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.639228 Aug 18 11:36:01.965009 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1158/2384] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:01 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:01.970754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-587ad5a0-93e9-42d9-b58a-fa6255fbc8ae req-930e97cf-a94f-4be2-9f06-8ef83107ef8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a776f65-9e1f-42e1-93d9-68500a17e6c2", "tag": "d808536d-6bce-46ed-a111-e4d891c6dd78"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:01.993066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-587ad5a0-93e9-42d9-b58a-fa6255fbc8ae req-930e97cf-a94f-4be2-9f06-8ef83107ef8b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:01.996754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-587ad5a0-93e9-42d9-b58a-fa6255fbc8ae req-930e97cf-a94f-4be2-9f06-8ef83107ef8b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:01.998307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-587ad5a0-93e9-42d9-b58a-fa6255fbc8ae req-930e97cf-a94f-4be2-9f06-8ef83107ef8b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:02.013111 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-587ad5a0-93e9-42d9-b58a-fa6255fbc8ae req-930e97cf-a94f-4be2-9f06-8ef83107ef8b service nova] Creating event network-changed:d808536d-6bce-46ed-a111-e4d891c6dd78 for instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 on n-h2-853611-3 Aug 18 11:36:02.020322 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-587ad5a0-93e9-42d9-b58a-fa6255fbc8ae req-930e97cf-a94f-4be2-9f06-8ef83107ef8b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053132 Aug 18 11:36:02.021469 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1159/2385] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:02.047739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-518b1016-f34c-4952-83cc-f44f846ff05c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:02.048493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-518b1016-f34c-4952-83cc-f44f846ff05c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:02.065695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-518b1016-f34c-4952-83cc-f44f846ff05c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:02.066375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-518b1016-f34c-4952-83cc-f44f846ff05c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:02.066843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-518b1016-f34c-4952-83cc-f44f846ff05c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:02.067565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-518b1016-f34c-4952-83cc-f44f846ff05c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:02.068022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-518b1016-f34c-4952-83cc-f44f846ff05c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:02.068508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-518b1016-f34c-4952-83cc-f44f846ff05c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:02.449033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-518b1016-f34c-4952-83cc-f44f846ff05c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:02.457377 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-518b1016-f34c-4952-83cc-f44f846ff05c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1355 microversion: 2.1 time: 0.434598 Aug 18 11:36:02.458175 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1160/2386] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:02 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1355 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:02.477117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-183773756", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "22608490-9e6a-4848-bc6d-66289c233bc1"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:02.541890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] validate_networks() for [('22608490-9e6a-4848-bc6d-66289c233bc1', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:36:02.598597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-07992f72-d9af-4901-8ca7-770287653542 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Building network info cache for instance {{(pid=122210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 18 11:36:03.161145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-07992f72-d9af-4901-8ca7-770287653542 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Updating instance_info_cache with network_info: [{"id": "a50a09ef-ed01-44ae-96dc-b34d0e3ea646", "address": "fa:16:3e:b5:63:37", "network": {"id": "dabb5a44-fe8f-477b-b07e-e2f6100f41ae", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-112832457-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4a508683f2ec488eb659d92a87e88582", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa50a09ef-ed", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 18 11:36:03.178354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07992f72-d9af-4901-8ca7-770287653542 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Releasing lock "refresh_cache-2e1582eb-3994-4092-a342-4c88340004c3" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:36:03.179653 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-07992f72-d9af-4901-8ca7-770287653542 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "POST /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3/action" status: 202 len: 0 microversion: 2.1 time: 2.525237 Aug 18 11:36:03.181318 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1227/2387] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:36:00 2022] POST /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3/action => generated 0 bytes in 2527 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 18 11:36:03.186834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2207a4bf-bfd1-4ed6-b022-9a1146fb8a2a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fb885e0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:03.219239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:36:03.221606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:36:03.223391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:36:03.223747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:36:03.224208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:36:03.237773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:03.238602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:03.239159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:03.239476 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2207a4bf-bfd1-4ed6-b022-9a1146fb8a2a tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a" status: 200 len: 1458 microversion: 2.1 time: 0.056308 Aug 18 11:36:03.240230 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1228/2388] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:36:03 2022] GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a => generated 1458 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:03.242456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:03.243477 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:03.244655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:03.245816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2a7c3ba5-44cc-446e-b513-245a5544e231 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:03.246673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2a7c3ba5-44cc-446e-b513-245a5544e231 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:03.257266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a7c3ba5-44cc-446e-b513-245a5544e231 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:03.257995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a7c3ba5-44cc-446e-b513-245a5544e231 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:03.258652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a7c3ba5-44cc-446e-b513-245a5544e231 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:03.259529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a7c3ba5-44cc-446e-b513-245a5544e231 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:03.260269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a7c3ba5-44cc-446e-b513-245a5544e231 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:03.260858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a7c3ba5-44cc-446e-b513-245a5544e231 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:03.281821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Getting quotas for project a98846d5998440dd87f3d85de0bf9d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:36:03.288847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Getting quotas for user 7bf7b0cd3d8740aca2d71944bc371d75 and project a98846d5998440dd87f3d85de0bf9d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:36:03.306469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:36:03.309018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:36:03.386977 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-66abbe61-4c7f-4f8c-a94b-1e8a9d931ad2 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911667 Aug 18 11:36:03.388871 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1161/2389] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:36:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:36:03.615564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2a7c3ba5-44cc-446e-b513-245a5544e231 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:03.624507 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2a7c3ba5-44cc-446e-b513-245a5544e231 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1313 microversion: 2.1 time: 0.382926 Aug 18 11:36:03.625032 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1229/2390] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:03 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:03.636489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e17e2165-65ad-4fba-9779-745edac81c77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:03.637911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e17e2165-65ad-4fba-9779-745edac81c77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:03.643487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1304251473", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:03.664046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e17e2165-65ad-4fba-9779-745edac81c77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:03.664550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e17e2165-65ad-4fba-9779-745edac81c77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:03.664990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e17e2165-65ad-4fba-9779-745edac81c77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:03.665716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e17e2165-65ad-4fba-9779-745edac81c77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:03.669583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e17e2165-65ad-4fba-9779-745edac81c77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:03.670057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e17e2165-65ad-4fba-9779-745edac81c77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:03.749481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:36:03.771219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e17e2165-65ad-4fba-9779-745edac81c77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Unlocking {{(pid=122210) unlock /opt/stack/nova/nova/compute/api.py:4823}} Aug 18 11:36:03.865408 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e17e2165-65ad-4fba-9779-745edac81c77 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.238828 Aug 18 11:36:03.875726 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1230/2391] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:36:03 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:36:03.882018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a106ecc-13b4-4745-ab74-bdb72a97d7b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:03.883296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a106ecc-13b4-4745-ab74-bdb72a97d7b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:03.890956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a106ecc-13b4-4745-ab74-bdb72a97d7b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:03.891890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a106ecc-13b4-4745-ab74-bdb72a97d7b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:03.893828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a106ecc-13b4-4745-ab74-bdb72a97d7b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:03.894885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a106ecc-13b4-4745-ab74-bdb72a97d7b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:03.895701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a106ecc-13b4-4745-ab74-bdb72a97d7b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:03.896365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a106ecc-13b4-4745-ab74-bdb72a97d7b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:03.995543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a106ecc-13b4-4745-ab74-bdb72a97d7b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:04.007774 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a106ecc-13b4-4745-ab74-bdb72a97d7b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 200 len: 1327 microversion: 2.1 time: 0.128846 Aug 18 11:36:04.009179 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1231/2392] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:03 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 1327 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:04.014840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-3d9709a8-0903-4b0c-a2c2-ea18db2b37fe req-6668a101-629b-4f41-8053-f58733e98df9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1582eb-3994-4092-a342-4c88340004c3", "tag": "a50a09ef-ed01-44ae-96dc-b34d0e3ea646"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:04.046624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3d9709a8-0903-4b0c-a2c2-ea18db2b37fe req-6668a101-629b-4f41-8053-f58733e98df9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:04.047118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3d9709a8-0903-4b0c-a2c2-ea18db2b37fe req-6668a101-629b-4f41-8053-f58733e98df9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:04.047696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3d9709a8-0903-4b0c-a2c2-ea18db2b37fe req-6668a101-629b-4f41-8053-f58733e98df9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:04.074542 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-3d9709a8-0903-4b0c-a2c2-ea18db2b37fe req-6668a101-629b-4f41-8053-f58733e98df9 service nova] Creating event network-changed:a50a09ef-ed01-44ae-96dc-b34d0e3ea646 for instance 2e1582eb-3994-4092-a342-4c88340004c3 on n-h2-853611-3 Aug 18 11:36:04.081851 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-3d9709a8-0903-4b0c-a2c2-ea18db2b37fe req-6668a101-629b-4f41-8053-f58733e98df9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070390 Aug 18 11:36:04.082903 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1232/2393] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:04.089472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eefdec46-743d-4594-8c34-c8a1b7a9133a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.55"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:04.323771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eefdec46-743d-4594-8c34-c8a1b7a9133a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:04.330175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eefdec46-743d-4594-8c34-c8a1b7a9133a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:04.331585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eefdec46-743d-4594-8c34-c8a1b7a9133a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:04.336570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eefdec46-743d-4594-8c34-c8a1b7a9133a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:04.337477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eefdec46-743d-4594-8c34-c8a1b7a9133a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:04.338078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eefdec46-743d-4594-8c34-c8a1b7a9133a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:04.338657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eefdec46-743d-4594-8c34-c8a1b7a9133a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:04.448657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:36:04.449090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:36:04.449540 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:36:04.450528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:36:04.450949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:36:04.461916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:04.462934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:04.463582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:04.464471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:04.465080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:04.465795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:04.488599 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Getting quotas for project 894e2bd813f444e9bb6075a02985e347. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:36:04.494225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Getting quotas for user 44b470d4e29048bbbeb3c107f2ee42dc and project 894e2bd813f444e9bb6075a02985e347. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:36:04.507671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:36:04.510378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:36:04.567498 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-64e68f06-1351-48ac-ae83-85c51212013e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.175333 Aug 18 11:36:04.569297 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1162/2394] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:36:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:36:04.576164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-22b46787-1eb8-405b-8015-63d6d31e1523 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f892e50>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:04.642046 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-22b46787-1eb8-405b-8015-63d6d31e1523 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a" status: 200 len: 1458 microversion: 2.1 time: 0.071004 Aug 18 11:36:04.644139 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1163/2395] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:36:04 2022] GET /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a => generated 1458 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:04.657433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5ca8ee94-1374-4444-9ab1-e9634acda7a8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:04.661072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5ca8ee94-1374-4444-9ab1-e9634acda7a8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:04.690337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ca8ee94-1374-4444-9ab1-e9634acda7a8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:04.693570 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ca8ee94-1374-4444-9ab1-e9634acda7a8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:04.694154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ca8ee94-1374-4444-9ab1-e9634acda7a8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:04.699490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ca8ee94-1374-4444-9ab1-e9634acda7a8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:04.699490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ca8ee94-1374-4444-9ab1-e9634acda7a8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:04.699490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ca8ee94-1374-4444-9ab1-e9634acda7a8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:04.945210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5ca8ee94-1374-4444-9ab1-e9634acda7a8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:04.963013 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5ca8ee94-1374-4444-9ab1-e9634acda7a8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1266 microversion: 2.1 time: 0.315742 Aug 18 11:36:04.964853 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1164/2396] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:04 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:04.977021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4eeacbc0-e3fd-4aba-80d6-e3457add4f0b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:04.978618 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4eeacbc0-e3fd-4aba-80d6-e3457add4f0b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:05.005732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4eeacbc0-e3fd-4aba-80d6-e3457add4f0b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:05.006378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4eeacbc0-e3fd-4aba-80d6-e3457add4f0b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:05.007531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4eeacbc0-e3fd-4aba-80d6-e3457add4f0b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:05.012112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4eeacbc0-e3fd-4aba-80d6-e3457add4f0b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:05.014629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4eeacbc0-e3fd-4aba-80d6-e3457add4f0b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:05.015862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4eeacbc0-e3fd-4aba-80d6-e3457add4f0b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:05.158719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eefdec46-743d-4594-8c34-c8a1b7a9133a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "refresh_cache-2e1582eb-3994-4092-a342-4c88340004c3" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 11:36:05.160493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eefdec46-743d-4594-8c34-c8a1b7a9133a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquired lock "refresh_cache-2e1582eb-3994-4092-a342-4c88340004c3" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 11:36:05.842876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4eeacbc0-e3fd-4aba-80d6-e3457add4f0b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:05.863286 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4eeacbc0-e3fd-4aba-80d6-e3457add4f0b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1355 microversion: 2.1 time: 0.894411 Aug 18 11:36:05.866982 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1165/2397] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:04 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1355 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:05.875788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c2e481ef-1e7a-4751-bccf-de0eefb528ba tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:05.877407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c2e481ef-1e7a-4751-bccf-de0eefb528ba tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:05.890572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2e481ef-1e7a-4751-bccf-de0eefb528ba tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:05.891326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2e481ef-1e7a-4751-bccf-de0eefb528ba tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:05.891986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2e481ef-1e7a-4751-bccf-de0eefb528ba tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:05.895642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2e481ef-1e7a-4751-bccf-de0eefb528ba tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:05.896413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2e481ef-1e7a-4751-bccf-de0eefb528ba tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:05.897066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2e481ef-1e7a-4751-bccf-de0eefb528ba tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:06.187218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c2e481ef-1e7a-4751-bccf-de0eefb528ba tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:06.199167 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c2e481ef-1e7a-4751-bccf-de0eefb528ba tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.330806 Aug 18 11:36:06.200624 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1166/2398] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:05 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:06.206743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-5f4211e8-14bc-4aaf-a188-7d1aff3747a8 req-25957f4d-39f1-432b-a108-5362d3c135bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed2bb36-0499-4abd-b690-93bbafd53c4e", "tag": "87982b37-1820-40af-8443-4ac2fe0add38"}, {"name": "network-changed", "server_uuid": "3ed2bb36-0499-4abd-b690-93bbafd53c4e", "tag": "40544f64-d224-4fb3-a2f8-d97b2a87d52c"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:06.216919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5f4211e8-14bc-4aaf-a188-7d1aff3747a8 req-25957f4d-39f1-432b-a108-5362d3c135bc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:06.217609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5f4211e8-14bc-4aaf-a188-7d1aff3747a8 req-25957f4d-39f1-432b-a108-5362d3c135bc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:06.218582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5f4211e8-14bc-4aaf-a188-7d1aff3747a8 req-25957f4d-39f1-432b-a108-5362d3c135bc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:06.232568 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5f4211e8-14bc-4aaf-a188-7d1aff3747a8 req-25957f4d-39f1-432b-a108-5362d3c135bc service nova] Creating event network-changed:87982b37-1820-40af-8443-4ac2fe0add38 for instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e on n-h1-853611-3 Aug 18 11:36:06.234684 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5f4211e8-14bc-4aaf-a188-7d1aff3747a8 req-25957f4d-39f1-432b-a108-5362d3c135bc service nova] Creating event network-changed:40544f64-d224-4fb3-a2f8-d97b2a87d52c for instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e on n-h1-853611-3 Aug 18 11:36:06.239567 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-5f4211e8-14bc-4aaf-a188-7d1aff3747a8 req-25957f4d-39f1-432b-a108-5362d3c135bc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037330 Aug 18 11:36:06.240872 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1167/2399] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:06.259747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fab8a1e0-69f7-4a3a-b520-4741dcfadfca tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:06.262610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fab8a1e0-69f7-4a3a-b520-4741dcfadfca tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:06.278829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fab8a1e0-69f7-4a3a-b520-4741dcfadfca tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:06.280023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fab8a1e0-69f7-4a3a-b520-4741dcfadfca tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:06.280803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fab8a1e0-69f7-4a3a-b520-4741dcfadfca tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:06.284432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fab8a1e0-69f7-4a3a-b520-4741dcfadfca tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:06.290714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fab8a1e0-69f7-4a3a-b520-4741dcfadfca tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:06.294599 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fab8a1e0-69f7-4a3a-b520-4741dcfadfca tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:06.648961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fab8a1e0-69f7-4a3a-b520-4741dcfadfca tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:06.656982 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fab8a1e0-69f7-4a3a-b520-4741dcfadfca tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1313 microversion: 2.1 time: 0.414168 Aug 18 11:36:06.657696 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1168/2400] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:06 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:06.690619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-245fb5b0-4458-424e-8106-0790dbcba0bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:06.691666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-245fb5b0-4458-424e-8106-0790dbcba0bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 51e3865d-a413-4c57-b0dc-1b29e76be1de] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:06.699315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-245fb5b0-4458-424e-8106-0790dbcba0bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:06.699315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-245fb5b0-4458-424e-8106-0790dbcba0bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:06.699537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-245fb5b0-4458-424e-8106-0790dbcba0bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:06.700577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-245fb5b0-4458-424e-8106-0790dbcba0bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:06.701797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-245fb5b0-4458-424e-8106-0790dbcba0bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:06.702626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-245fb5b0-4458-424e-8106-0790dbcba0bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:06.871881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-eefdec46-743d-4594-8c34-c8a1b7a9133a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Building network info cache for instance {{(pid=122210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 18 11:36:07.052452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-245fb5b0-4458-424e-8106-0790dbcba0bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:07.067303 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-245fb5b0-4458-424e-8106-0790dbcba0bd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de" status: 200 len: 1466 microversion: 2.1 time: 0.389310 Aug 18 11:36:07.081289 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1169/2401] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:06 2022] GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de => generated 1466 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:07.081289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-993890270", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:07.179423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:36:07.700622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:36:07.701265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:36:07.702164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:36:07.702819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:36:07.703565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:36:07.727054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:07.727550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:07.727990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:07.728721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:07.729174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:07.739149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:07.791038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Getting quotas for project 894e2bd813f444e9bb6075a02985e347. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:36:07.802911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Getting quotas for user 44b470d4e29048bbbeb3c107f2ee42dc and project 894e2bd813f444e9bb6075a02985e347. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:36:07.840026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:36:07.842496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:36:07.939112 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-90ef00ef-3a48-45c2-b290-88c82613d8dc tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868496 Aug 18 11:36:07.942040 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1170/2402] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:36:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:36:07.952537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-072d9c99-7f4b-4159-8327-7d0f7c995eb0 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:07.956112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-072d9c99-7f4b-4159-8327-7d0f7c995eb0 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:07.967597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-072d9c99-7f4b-4159-8327-7d0f7c995eb0 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:07.968473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-072d9c99-7f4b-4159-8327-7d0f7c995eb0 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:07.969493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-072d9c99-7f4b-4159-8327-7d0f7c995eb0 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:07.971990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-072d9c99-7f4b-4159-8327-7d0f7c995eb0 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:07.972718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-072d9c99-7f4b-4159-8327-7d0f7c995eb0 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:07.973604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-072d9c99-7f4b-4159-8327-7d0f7c995eb0 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:08.435554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-072d9c99-7f4b-4159-8327-7d0f7c995eb0 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:08.448067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:08.472149 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-072d9c99-7f4b-4159-8327-7d0f7c995eb0 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 200 len: 1395 microversion: 2.1 time: 0.512137 Aug 18 11:36:08.475042 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1171/2403] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:07 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 1395 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:08.612231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-34691dd6-f918-4315-9bd9-81defef9bf9a req-a00b387b-732c-4731-8b31-32a8bf0b941a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e3865d-a413-4c57-b0dc-1b29e76be1de", "name": "network-vif-unplugged", "status": "completed", "tag": "1fd7f00c-a7c9-42e6-b6f0-3b9378c92c89"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:08.633462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-34691dd6-f918-4315-9bd9-81defef9bf9a req-a00b387b-732c-4731-8b31-32a8bf0b941a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:08.634060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-34691dd6-f918-4315-9bd9-81defef9bf9a req-a00b387b-732c-4731-8b31-32a8bf0b941a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:08.634531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-34691dd6-f918-4315-9bd9-81defef9bf9a req-a00b387b-732c-4731-8b31-32a8bf0b941a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:08.643611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-eefdec46-743d-4594-8c34-c8a1b7a9133a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Updating instance_info_cache with network_info: [{"id": "a50a09ef-ed01-44ae-96dc-b34d0e3ea646", "address": "fa:16:3e:b5:63:37", "network": {"id": "dabb5a44-fe8f-477b-b07e-e2f6100f41ae", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-112832457-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4a508683f2ec488eb659d92a87e88582", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa50a09ef-ed", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 18 11:36:08.665925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eefdec46-743d-4594-8c34-c8a1b7a9133a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Releasing lock "refresh_cache-2e1582eb-3994-4092-a342-4c88340004c3" {{(pid=122210) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 11:36:08.667058 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eefdec46-743d-4594-8c34-c8a1b7a9133a tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "POST /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3/action" status: 202 len: 0 microversion: 2.1 time: 4.583201 Aug 18 11:36:08.667888 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1233/2404] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:36:04 2022] POST /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3/action => generated 0 bytes in 4585 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 18 11:36:08.675980 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-34691dd6-f918-4315-9bd9-81defef9bf9a req-a00b387b-732c-4731-8b31-32a8bf0b941a service nova] Creating event network-vif-unplugged:1fd7f00c-a7c9-42e6-b6f0-3b9378c92c89 for instance 51e3865d-a413-4c57-b0dc-1b29e76be1de on n-h1-853611-3 Aug 18 11:36:08.677891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-21be9350-58ea-45fb-98a0-58d8d5ad4f04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:08.679886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-21be9350-58ea-45fb-98a0-58d8d5ad4f04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:08.696099 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-34691dd6-f918-4315-9bd9-81defef9bf9a req-a00b387b-732c-4731-8b31-32a8bf0b941a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.201338 Aug 18 11:36:08.698142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21be9350-58ea-45fb-98a0-58d8d5ad4f04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:08.700145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21be9350-58ea-45fb-98a0-58d8d5ad4f04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:08.700849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21be9350-58ea-45fb-98a0-58d8d5ad4f04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:08.702460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21be9350-58ea-45fb-98a0-58d8d5ad4f04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:08.704426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21be9350-58ea-45fb-98a0-58d8d5ad4f04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:08.705465 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1172/2405] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:08.711414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21be9350-58ea-45fb-98a0-58d8d5ad4f04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:08.719727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-774abc5a-6567-499b-8347-bd9d4403eda9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:08.720522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-774abc5a-6567-499b-8347-bd9d4403eda9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:08.738945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-774abc5a-6567-499b-8347-bd9d4403eda9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:08.740174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-774abc5a-6567-499b-8347-bd9d4403eda9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:08.742521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-774abc5a-6567-499b-8347-bd9d4403eda9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:08.744153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-774abc5a-6567-499b-8347-bd9d4403eda9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:08.745789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-774abc5a-6567-499b-8347-bd9d4403eda9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:08.746411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-774abc5a-6567-499b-8347-bd9d4403eda9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:09.045638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-774abc5a-6567-499b-8347-bd9d4403eda9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:09.063317 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-774abc5a-6567-499b-8347-bd9d4403eda9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.355746 Aug 18 11:36:09.078274 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1173/2406] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:08 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:09.078274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-9f78c7ba-47d7-4cc7-bd12-46577306050b req-47099aae-c763-4840-a938-c74acbb73ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1582eb-3994-4092-a342-4c88340004c3", "tag": "a50a09ef-ed01-44ae-96dc-b34d0e3ea646"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:09.084677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-21be9350-58ea-45fb-98a0-58d8d5ad4f04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:09.089193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9f78c7ba-47d7-4cc7-bd12-46577306050b req-47099aae-c763-4840-a938-c74acbb73ec1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:09.091873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9f78c7ba-47d7-4cc7-bd12-46577306050b req-47099aae-c763-4840-a938-c74acbb73ec1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:09.093833 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-21be9350-58ea-45fb-98a0-58d8d5ad4f04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1314 microversion: 2.1 time: 0.424625 Aug 18 11:36:09.094463 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1234/2407] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:08 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:09.094695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9f78c7ba-47d7-4cc7-bd12-46577306050b req-47099aae-c763-4840-a938-c74acbb73ec1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:09.112288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dfd697c9-0c84-4161-a011-a97f115518ef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:09.113346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dfd697c9-0c84-4161-a011-a97f115518ef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:09.121531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfd697c9-0c84-4161-a011-a97f115518ef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:09.122379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfd697c9-0c84-4161-a011-a97f115518ef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:09.123010 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-9f78c7ba-47d7-4cc7-bd12-46577306050b req-47099aae-c763-4840-a938-c74acbb73ec1 service nova] Creating event network-changed:a50a09ef-ed01-44ae-96dc-b34d0e3ea646 for instance 2e1582eb-3994-4092-a342-4c88340004c3 on n-h2-853611-3 Aug 18 11:36:09.123311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfd697c9-0c84-4161-a011-a97f115518ef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:09.124331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfd697c9-0c84-4161-a011-a97f115518ef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:09.124987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfd697c9-0c84-4161-a011-a97f115518ef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:09.125651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfd697c9-0c84-4161-a011-a97f115518ef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:09.142778 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-9f78c7ba-47d7-4cc7-bd12-46577306050b req-47099aae-c763-4840-a938-c74acbb73ec1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074772 Aug 18 11:36:09.148474 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1174/2408] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:09.153619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8792bcf4-a622-465e-8d3e-e5bb5615f5a4 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f92c160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:09.293870 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8792bcf4-a622-465e-8d3e-e5bb5615f5a4 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images?changes-since=2022-08-18T11%3A33%3A46Z" status: 200 len: 1901 microversion: 2.1 time: 0.144216 Aug 18 11:36:09.303782 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1175/2409] 10.222.0.73 () {58 vars in 1199 bytes} [Thu Aug 18 11:36:09 2022] GET /compute/v2.1/images?changes-since=2022-08-18T11%3A33%3A46Z => generated 1901 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:09.303782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dc64b539-b224-45ba-967b-92ab72d50f61 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:09.303782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dc64b539-b224-45ba-967b-92ab72d50f61 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:09.312270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc64b539-b224-45ba-967b-92ab72d50f61 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:09.313518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc64b539-b224-45ba-967b-92ab72d50f61 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:09.314756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc64b539-b224-45ba-967b-92ab72d50f61 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:09.315747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc64b539-b224-45ba-967b-92ab72d50f61 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:09.316327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc64b539-b224-45ba-967b-92ab72d50f61 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:09.316757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc64b539-b224-45ba-967b-92ab72d50f61 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:09.411175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dfd697c9-0c84-4161-a011-a97f115518ef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:09.418694 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dfd697c9-0c84-4161-a011-a97f115518ef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1355 microversion: 2.1 time: 0.323057 Aug 18 11:36:09.419640 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1235/2410] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:09 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1355 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:09.425965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5c2617f0-9276-4ca0-88fa-1c4dd398ec45 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:09.426678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5c2617f0-9276-4ca0-88fa-1c4dd398ec45 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:09.433917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c2617f0-9276-4ca0-88fa-1c4dd398ec45 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:09.434636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c2617f0-9276-4ca0-88fa-1c4dd398ec45 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:09.435067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c2617f0-9276-4ca0-88fa-1c4dd398ec45 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:09.435949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c2617f0-9276-4ca0-88fa-1c4dd398ec45 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:09.436628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c2617f0-9276-4ca0-88fa-1c4dd398ec45 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:09.437129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c2617f0-9276-4ca0-88fa-1c4dd398ec45 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:09.526359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5c2617f0-9276-4ca0-88fa-1c4dd398ec45 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:09.526562 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dc64b539-b224-45ba-967b-92ab72d50f61 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:09.534763 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dc64b539-b224-45ba-967b-92ab72d50f61 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1313 microversion: 2.1 time: 0.239201 Aug 18 11:36:09.535945 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1176/2411] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:09 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:09.541705 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-895e8538-213f-48c0-95f6-fb5ec528a3d1 req-36dcc682-0e8d-46dc-9104-a2f261e1bfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed2bb36-0499-4abd-b690-93bbafd53c4e", "tag": "dd5f20e2-c3e1-4d6e-92b7-f4f34dea36b8"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:09.551980 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5c2617f0-9276-4ca0-88fa-1c4dd398ec45 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1217 microversion: 2.1 time: 0.131041 Aug 18 11:36:09.566166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-895e8538-213f-48c0-95f6-fb5ec528a3d1 req-36dcc682-0e8d-46dc-9104-a2f261e1bfe9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:09.566166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-895e8538-213f-48c0-95f6-fb5ec528a3d1 req-36dcc682-0e8d-46dc-9104-a2f261e1bfe9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:09.566166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-895e8538-213f-48c0-95f6-fb5ec528a3d1 req-36dcc682-0e8d-46dc-9104-a2f261e1bfe9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:09.567626 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1236/2412] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:09 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1217 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:09.573065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aff4ba54-2db0-4869-ba3c-2ed0cc68704e tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '.version_select at 0x7f51b0daddc0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:09.582801 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-895e8538-213f-48c0-95f6-fb5ec528a3d1 req-36dcc682-0e8d-46dc-9104-a2f261e1bfe9 service nova] Creating event network-changed:dd5f20e2-c3e1-4d6e-92b7-f4f34dea36b8 for instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e on n-h1-853611-3 Aug 18 11:36:09.588434 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-895e8538-213f-48c0-95f6-fb5ec528a3d1 req-36dcc682-0e8d-46dc-9104-a2f261e1bfe9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051019 Aug 18 11:36:09.589284 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1177/2413] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:09.595037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0f564c6e-ac08-47ed-a11c-ec6b5f914864 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:09.596059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0f564c6e-ac08-47ed-a11c-ec6b5f914864 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:09.602473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f564c6e-ac08-47ed-a11c-ec6b5f914864 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:09.603202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f564c6e-ac08-47ed-a11c-ec6b5f914864 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:09.603640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f564c6e-ac08-47ed-a11c-ec6b5f914864 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:09.604348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f564c6e-ac08-47ed-a11c-ec6b5f914864 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:09.604801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f564c6e-ac08-47ed-a11c-ec6b5f914864 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:09.605228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f564c6e-ac08-47ed-a11c-ec6b5f914864 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:09.779972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0f564c6e-ac08-47ed-a11c-ec6b5f914864 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:09.796595 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0f564c6e-ac08-47ed-a11c-ec6b5f914864 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.206096 Aug 18 11:36:09.797435 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1178/2414] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:09 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:09.805493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2294072e-ba78-458b-a3b1-a49ab1b8d11b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fac1dc0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:09.911542 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2294072e-ba78-458b-a3b1-a49ab1b8d11b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-416063027" status: 200 len: 484 microversion: 2.1 time: 0.111051 Aug 18 11:36:09.912793 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1179/2415] 10.222.0.73 () {58 vars in 1229 bytes} [Thu Aug 18 11:36:09 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-416063027 => generated 484 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:09.927335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-98ce493a-66f7-430a-96c6-f7be038f5041 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:09.928729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-98ce493a-66f7-430a-96c6-f7be038f5041 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:09.935377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98ce493a-66f7-430a-96c6-f7be038f5041 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:09.936208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98ce493a-66f7-430a-96c6-f7be038f5041 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:09.936885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98ce493a-66f7-430a-96c6-f7be038f5041 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:09.937835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98ce493a-66f7-430a-96c6-f7be038f5041 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:09.938583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98ce493a-66f7-430a-96c6-f7be038f5041 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:09.940552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98ce493a-66f7-430a-96c6-f7be038f5041 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:10.000091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:10.070181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=26 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:10.226173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-98ce493a-66f7-430a-96c6-f7be038f5041 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:10.234335 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-98ce493a-66f7-430a-96c6-f7be038f5041 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 200 len: 1395 microversion: 2.1 time: 0.320297 Aug 18 11:36:10.247999 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1180/2416] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:09 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 1395 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:10.253918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2b40e982-cbee-4b91-b73c-14e418673e3e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:10.254490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2b40e982-cbee-4b91-b73c-14e418673e3e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:10.261351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b40e982-cbee-4b91-b73c-14e418673e3e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:10.261852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b40e982-cbee-4b91-b73c-14e418673e3e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:10.262302 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b40e982-cbee-4b91-b73c-14e418673e3e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:10.263046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b40e982-cbee-4b91-b73c-14e418673e3e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:10.263508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b40e982-cbee-4b91-b73c-14e418673e3e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:10.263994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b40e982-cbee-4b91-b73c-14e418673e3e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:10.353259 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2b40e982-cbee-4b91-b73c-14e418673e3e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.103291 Aug 18 11:36:10.354304 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1181/2417] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:36:10 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:36:10.362369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5ed49bb7-a4e2-4ccd-8b5e-2bf2d05eec83 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fa94430>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:10.492751 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5ed49bb7-a4e2-4ccd-8b5e-2bf2d05eec83 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images?server=51e3865d-a413-4c57-b0dc-1b29e76be1de" status: 200 len: 956 microversion: 2.1 time: 0.136420 Aug 18 11:36:10.501181 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1182/2418] 10.222.0.73 () {58 vars in 1209 bytes} [Thu Aug 18 11:36:10 2022] GET /compute/v2.1/images?server=51e3865d-a413-4c57-b0dc-1b29e76be1de => generated 956 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:10.501181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c6f74b64-fa46-49a6-b375-4394a48fdbce tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:10.501181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c6f74b64-fa46-49a6-b375-4394a48fdbce tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:10.509193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6f74b64-fa46-49a6-b375-4394a48fdbce tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:10.509886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6f74b64-fa46-49a6-b375-4394a48fdbce tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:10.510472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6f74b64-fa46-49a6-b375-4394a48fdbce tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:10.511454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6f74b64-fa46-49a6-b375-4394a48fdbce tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:10.511885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6f74b64-fa46-49a6-b375-4394a48fdbce tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:10.512424 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6f74b64-fa46-49a6-b375-4394a48fdbce tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:11.110310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c6f74b64-fa46-49a6-b375-4394a48fdbce tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:11.121448 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c6f74b64-fa46-49a6-b375-4394a48fdbce tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1314 microversion: 2.1 time: 0.626930 Aug 18 11:36:11.122521 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1183/2419] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:10 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:11.128126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4ca2785f-3469-42af-9cf6-5de08949eed8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:11.129008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4ca2785f-3469-42af-9cf6-5de08949eed8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:11.136906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ca2785f-3469-42af-9cf6-5de08949eed8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:11.137727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ca2785f-3469-42af-9cf6-5de08949eed8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:11.138279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ca2785f-3469-42af-9cf6-5de08949eed8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:11.139107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ca2785f-3469-42af-9cf6-5de08949eed8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:11.139770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ca2785f-3469-42af-9cf6-5de08949eed8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:11.140617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ca2785f-3469-42af-9cf6-5de08949eed8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:11.320514 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aff4ba54-2db0-4869-ba3c-2ed0cc68704e tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/708e85a1-7302-4c6b-8ed5-4a93bec815f9" status: 202 len: 0 microversion: 2.1 time: 1.751237 Aug 18 11:36:11.322871 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1237/2420] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:36:09 2022] DELETE /compute/v2.1/os-floating-ips/708e85a1-7302-4c6b-8ed5-4a93bec815f9 => generated 0 bytes in 1755 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:36:11.340878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9acf578c-fe7d-4fb5-a54a-3213a2b003b9 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:11.341642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9acf578c-fe7d-4fb5-a54a-3213a2b003b9 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:11.349670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9acf578c-fe7d-4fb5-a54a-3213a2b003b9 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:11.350264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9acf578c-fe7d-4fb5-a54a-3213a2b003b9 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:11.350799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9acf578c-fe7d-4fb5-a54a-3213a2b003b9 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:11.351762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9acf578c-fe7d-4fb5-a54a-3213a2b003b9 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:11.352507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9acf578c-fe7d-4fb5-a54a-3213a2b003b9 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:11.353098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9acf578c-fe7d-4fb5-a54a-3213a2b003b9 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:11.447512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4ca2785f-3469-42af-9cf6-5de08949eed8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:11.462884 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4ca2785f-3469-42af-9cf6-5de08949eed8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1654 microversion: 2.1 time: 0.338754 Aug 18 11:36:11.467762 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1184/2421] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:11 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1654 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:11.475396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ebd10bbf-9735-4dfb-9d28-24d36a9f7677 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f92c430>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:11.548026 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ebd10bbf-9735-4dfb-9d28-24d36a9f7677 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.73%2Fcompute%2Fv2.1%2Fservers%2F61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 484 microversion: 2.1 time: 0.077833 Aug 18 11:36:11.554218 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1185/2422] 10.222.0.73 () {58 vars in 1317 bytes} [Thu Aug 18 11:36:11 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.73%2Fcompute%2Fv2.1%2Fservers%2F61b34fc6-468f-4179-b73f-6776c809d055 => generated 484 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:11.561823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8ade5881-0f87-46f7-9731-668947f60cae tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:11.563047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8ade5881-0f87-46f7-9731-668947f60cae tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:11.570850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ade5881-0f87-46f7-9731-668947f60cae tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:11.571350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ade5881-0f87-46f7-9731-668947f60cae tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:11.571828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ade5881-0f87-46f7-9731-668947f60cae tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:11.572982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ade5881-0f87-46f7-9731-668947f60cae tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:11.573566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ade5881-0f87-46f7-9731-668947f60cae tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:11.574036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ade5881-0f87-46f7-9731-668947f60cae tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:11.624891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9acf578c-fe7d-4fb5-a54a-3213a2b003b9 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:11.634445 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9acf578c-fe7d-4fb5-a54a-3213a2b003b9 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1355 microversion: 2.1 time: 0.301424 Aug 18 11:36:11.635506 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1238/2423] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:11 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1355 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:11.644559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c1ca47b8-3942-4c40-ba01-5eecaf0275c7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:11.645635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c1ca47b8-3942-4c40-ba01-5eecaf0275c7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:11.653973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1ca47b8-3942-4c40-ba01-5eecaf0275c7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:11.654551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1ca47b8-3942-4c40-ba01-5eecaf0275c7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:11.655296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1ca47b8-3942-4c40-ba01-5eecaf0275c7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:11.656088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1ca47b8-3942-4c40-ba01-5eecaf0275c7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:11.656554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1ca47b8-3942-4c40-ba01-5eecaf0275c7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:11.658395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1ca47b8-3942-4c40-ba01-5eecaf0275c7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:11.737430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c1ca47b8-3942-4c40-ba01-5eecaf0275c7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:11.745589 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c1ca47b8-3942-4c40-ba01-5eecaf0275c7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1271 microversion: 2.1 time: 0.107509 Aug 18 11:36:11.746519 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1239/2424] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:11 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:11.761902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-30da9a1c-31c3-4e5a-9ef1-7dff337ad8b5 req-ddefdb85-4a72-45ab-9c79-70218ab8be0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a776f65-9e1f-42e1-93d9-68500a17e6c2", "name": "network-vif-plugged", "status": "completed", "tag": "d808536d-6bce-46ed-a111-e4d891c6dd78"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:11.774331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-30da9a1c-31c3-4e5a-9ef1-7dff337ad8b5 req-ddefdb85-4a72-45ab-9c79-70218ab8be0c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:11.774934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-30da9a1c-31c3-4e5a-9ef1-7dff337ad8b5 req-ddefdb85-4a72-45ab-9c79-70218ab8be0c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:11.775494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-30da9a1c-31c3-4e5a-9ef1-7dff337ad8b5 req-ddefdb85-4a72-45ab-9c79-70218ab8be0c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:11.780368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:DELETE=1,nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=6,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:11.791247 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-30da9a1c-31c3-4e5a-9ef1-7dff337ad8b5 req-ddefdb85-4a72-45ab-9c79-70218ab8be0c service nova] Creating event network-vif-plugged:d808536d-6bce-46ed-a111-e4d891c6dd78 for instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 on n-h2-853611-3 Aug 18 11:36:11.796942 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-30da9a1c-31c3-4e5a-9ef1-7dff337ad8b5 req-ddefdb85-4a72-45ab-9c79-70218ab8be0c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040633 Aug 18 11:36:11.797716 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1240/2425] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:11.804927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-e8ba7ebc-b64e-4d38-9b36-a9fbc6a29ce0 req-f51c98e2-a208-4c08-9607-1b8e7f28a886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43cef527-b63e-455e-bb59-0af5ce753dd2", "tag": "234ff5c5-55d2-4c13-bb2c-a900c736a26b"}, {"name": "network-changed", "server_uuid": "2ee89e61-02ed-4624-bbbe-898aac54e492", "tag": "37af06aa-0d3d-4f65-9b48-b4c97e8f72f3"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:11.818371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e8ba7ebc-b64e-4d38-9b36-a9fbc6a29ce0 req-f51c98e2-a208-4c08-9607-1b8e7f28a886 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:11.819051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e8ba7ebc-b64e-4d38-9b36-a9fbc6a29ce0 req-f51c98e2-a208-4c08-9607-1b8e7f28a886 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:11.819593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e8ba7ebc-b64e-4d38-9b36-a9fbc6a29ce0 req-f51c98e2-a208-4c08-9607-1b8e7f28a886 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:11.838052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8ade5881-0f87-46f7-9731-668947f60cae tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:11.838824 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e8ba7ebc-b64e-4d38-9b36-a9fbc6a29ce0 req-f51c98e2-a208-4c08-9607-1b8e7f28a886 service nova] Creating event network-changed:234ff5c5-55d2-4c13-bb2c-a900c736a26b for instance 43cef527-b63e-455e-bb59-0af5ce753dd2 on n-h2-853611-3 Aug 18 11:36:11.839429 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e8ba7ebc-b64e-4d38-9b36-a9fbc6a29ce0 req-f51c98e2-a208-4c08-9607-1b8e7f28a886 service nova] Creating event network-changed:37af06aa-0d3d-4f65-9b48-b4c97e8f72f3 for instance 2ee89e61-02ed-4624-bbbe-898aac54e492 on n-h1-853611-3 Aug 18 11:36:11.850416 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-e8ba7ebc-b64e-4d38-9b36-a9fbc6a29ce0 req-f51c98e2-a208-4c08-9607-1b8e7f28a886 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050451 Aug 18 11:36:11.850723 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8ade5881-0f87-46f7-9731-668947f60cae tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1313 microversion: 2.1 time: 0.295160 Aug 18 11:36:11.851347 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1241/2426] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:11.851761 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1186/2427] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:11 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:11.858788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ccf007c2-eb2f-4ff8-9894-204a980d95dd tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:11.859710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ccf007c2-eb2f-4ff8-9894-204a980d95dd tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:11.866524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3d793458-ca5e-487b-9bd3-579959ce05c8 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '.version_select at 0x7f519f92c550>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:11.867161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccf007c2-eb2f-4ff8-9894-204a980d95dd tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:11.867654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccf007c2-eb2f-4ff8-9894-204a980d95dd tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:11.868267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccf007c2-eb2f-4ff8-9894-204a980d95dd tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:11.868985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccf007c2-eb2f-4ff8-9894-204a980d95dd tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:11.869598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccf007c2-eb2f-4ff8-9894-204a980d95dd tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:11.870187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccf007c2-eb2f-4ff8-9894-204a980d95dd tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:12.016068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ccf007c2-eb2f-4ff8-9894-204a980d95dd tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:12.025298 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ccf007c2-eb2f-4ff8-9894-204a980d95dd tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 200 len: 1395 microversion: 2.1 time: 0.172284 Aug 18 11:36:12.039488 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1242/2428] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:11 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 1395 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:12.045811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-afa48967-b5c5-409b-bab7-5674ecfa2715 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:12.046773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-afa48967-b5c5-409b-bab7-5674ecfa2715 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:12.054606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa48967-b5c5-409b-bab7-5674ecfa2715 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:12.054898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa48967-b5c5-409b-bab7-5674ecfa2715 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:12.055384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa48967-b5c5-409b-bab7-5674ecfa2715 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:12.056081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa48967-b5c5-409b-bab7-5674ecfa2715 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:12.056541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa48967-b5c5-409b-bab7-5674ecfa2715 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:12.057078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa48967-b5c5-409b-bab7-5674ecfa2715 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:12.149682 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-afa48967-b5c5-409b-bab7-5674ecfa2715 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.108355 Aug 18 11:36:12.155554 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1243/2429] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:36:12 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:36:12.162592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7cd2934c-6cdb-4ad5-abe4-273ef19e7cb3 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f9dd9d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:12.263477 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3d793458-ca5e-487b-9bd3-579959ce05c8 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/5a5bb2a9-9c20-4f75-a15f-dbdffdc3ae03" status: 202 len: 0 microversion: 2.1 time: 0.410414 Aug 18 11:36:12.267800 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1187/2430] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:36:11 2022] DELETE /compute/v2.1/os-security-groups/5a5bb2a9-9c20-4f75-a15f-dbdffdc3ae03 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:36:12.268612 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7cd2934c-6cdb-4ad5-abe4-273ef19e7cb3 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.73%2Fcompute%2Fservers%2F61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 484 microversion: 2.1 time: 0.112901 Aug 18 11:36:12.270831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-ce521eaf-2752-4ad9-92ac-1fe810cff49b req-84fd5eac-e1c3-48e8-95a5-66a63e5be5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aee369f-2ece-4b53-a7db-efe946936831", "tag": "fdd9010d-de96-4f58-8fc4-5c78c661a107"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:12.279439 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1244/2431] 10.222.0.73 () {58 vars in 1303 bytes} [Thu Aug 18 11:36:12 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.73%2Fcompute%2Fservers%2F61b34fc6-468f-4179-b73f-6776c809d055 => generated 484 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:12.284375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:12.300608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ce521eaf-2752-4ad9-92ac-1fe810cff49b req-84fd5eac-e1c3-48e8-95a5-66a63e5be5d9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:12.301170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ce521eaf-2752-4ad9-92ac-1fe810cff49b req-84fd5eac-e1c3-48e8-95a5-66a63e5be5d9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:12.301627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ce521eaf-2752-4ad9-92ac-1fe810cff49b req-84fd5eac-e1c3-48e8-95a5-66a63e5be5d9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:12.311941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-803c5ae1-968b-417e-8267-67ebbab30d59 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:12.315736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-803c5ae1-968b-417e-8267-67ebbab30d59 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:12.323003 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ce521eaf-2752-4ad9-92ac-1fe810cff49b req-84fd5eac-e1c3-48e8-95a5-66a63e5be5d9 service nova] Creating event network-changed:fdd9010d-de96-4f58-8fc4-5c78c661a107 for instance 5aee369f-2ece-4b53-a7db-efe946936831 on n-h2-853611-3 Aug 18 11:36:12.332454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-803c5ae1-968b-417e-8267-67ebbab30d59 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:12.333603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-803c5ae1-968b-417e-8267-67ebbab30d59 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:12.335153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-803c5ae1-968b-417e-8267-67ebbab30d59 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:12.349033 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-ce521eaf-2752-4ad9-92ac-1fe810cff49b req-84fd5eac-e1c3-48e8-95a5-66a63e5be5d9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082508 Aug 18 11:36:12.350332 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1188/2432] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:12.351290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-803c5ae1-968b-417e-8267-67ebbab30d59 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:12.351855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-803c5ae1-968b-417e-8267-67ebbab30d59 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:12.353543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-803c5ae1-968b-417e-8267-67ebbab30d59 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:12.357023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4bb8da54-9605-4eab-9559-8197f016d233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:12.358006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4bb8da54-9605-4eab-9559-8197f016d233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:12.370869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bb8da54-9605-4eab-9559-8197f016d233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:12.379998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bb8da54-9605-4eab-9559-8197f016d233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:12.380742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bb8da54-9605-4eab-9559-8197f016d233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:12.381691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bb8da54-9605-4eab-9559-8197f016d233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:12.382325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bb8da54-9605-4eab-9559-8197f016d233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:12.382957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bb8da54-9605-4eab-9559-8197f016d233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:12.840986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-803c5ae1-968b-417e-8267-67ebbab30d59 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:12.851122 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-803c5ae1-968b-417e-8267-67ebbab30d59 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1314 microversion: 2.1 time: 0.570463 Aug 18 11:36:12.851709 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1245/2433] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:12 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:12.856899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d68246e7-0cdd-4ff0-9388-298575d26c99 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:12.857700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d68246e7-0cdd-4ff0-9388-298575d26c99 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:12.875952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d68246e7-0cdd-4ff0-9388-298575d26c99 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:12.877411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d68246e7-0cdd-4ff0-9388-298575d26c99 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:12.878136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d68246e7-0cdd-4ff0-9388-298575d26c99 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:12.878997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d68246e7-0cdd-4ff0-9388-298575d26c99 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:12.880430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d68246e7-0cdd-4ff0-9388-298575d26c99 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:12.881001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d68246e7-0cdd-4ff0-9388-298575d26c99 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:12.915359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d68246e7-0cdd-4ff0-9388-298575d26c99 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:36:12.924133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4bb8da54-9605-4eab-9559-8197f016d233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:12.937933 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4bb8da54-9605-4eab-9559-8197f016d233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1661 microversion: 2.1 time: 0.584406 Aug 18 11:36:12.939069 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1189/2434] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:12 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1661 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:12.945786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4d3aa859-7efb-4c8a-af67-c3cd219ef70b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fabfd30>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:13.035288 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d68246e7-0cdd-4ff0-9388-298575d26c99 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 204 len: 0 microversion: 2.1 time: 0.182014 Aug 18 11:36:13.039006 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1246/2435] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:36:12 2022] DELETE /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:36:13.046140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-271eb1d4-3936-4792-8812-32b56ac0c96c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:13.046474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-271eb1d4-3936-4792-8812-32b56ac0c96c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:13.055373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-271eb1d4-3936-4792-8812-32b56ac0c96c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:13.055861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-271eb1d4-3936-4792-8812-32b56ac0c96c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:13.056516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-271eb1d4-3936-4792-8812-32b56ac0c96c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:13.057507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-271eb1d4-3936-4792-8812-32b56ac0c96c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:13.058008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-271eb1d4-3936-4792-8812-32b56ac0c96c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:13.058469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-271eb1d4-3936-4792-8812-32b56ac0c96c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:13.109087 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4d3aa859-7efb-4c8a-af67-c3cd219ef70b tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.168055 Aug 18 11:36:13.109682 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1190/2436] 10.222.0.73 () {58 vars in 1149 bytes} [Thu Aug 18 11:36:12 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:13.115834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ab35b5d5-d000-4117-b3a9-5f3d4e539b2b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:13.116792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ab35b5d5-d000-4117-b3a9-5f3d4e539b2b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:13.147723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab35b5d5-d000-4117-b3a9-5f3d4e539b2b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:13.148338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab35b5d5-d000-4117-b3a9-5f3d4e539b2b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:13.148855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab35b5d5-d000-4117-b3a9-5f3d4e539b2b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:13.149675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab35b5d5-d000-4117-b3a9-5f3d4e539b2b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:13.155026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab35b5d5-d000-4117-b3a9-5f3d4e539b2b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:13.155870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab35b5d5-d000-4117-b3a9-5f3d4e539b2b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:13.514480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ab35b5d5-d000-4117-b3a9-5f3d4e539b2b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:13.526795 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ab35b5d5-d000-4117-b3a9-5f3d4e539b2b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1313 microversion: 2.1 time: 0.415533 Aug 18 11:36:13.542068 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1191/2437] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:13 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:13.551950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e3f69d66-618a-4cb5-9c91-5b19aa3b4ce2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:13.553072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e3f69d66-618a-4cb5-9c91-5b19aa3b4ce2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:13.562022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3f69d66-618a-4cb5-9c91-5b19aa3b4ce2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:13.565958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3f69d66-618a-4cb5-9c91-5b19aa3b4ce2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:13.567015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3f69d66-618a-4cb5-9c91-5b19aa3b4ce2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:13.568079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3f69d66-618a-4cb5-9c91-5b19aa3b4ce2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:13.568831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3f69d66-618a-4cb5-9c91-5b19aa3b4ce2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:13.569488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3f69d66-618a-4cb5-9c91-5b19aa3b4ce2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:13.791289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-271eb1d4-3936-4792-8812-32b56ac0c96c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:13.802815 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-271eb1d4-3936-4792-8812-32b56ac0c96c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1355 microversion: 2.1 time: 0.764826 Aug 18 11:36:13.804234 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1247/2438] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:13 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1355 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:13.815784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cba1f8e4-1b1a-4cde-9794-c545ea7cb24c tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:13.817408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cba1f8e4-1b1a-4cde-9794-c545ea7cb24c tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:13.825499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cba1f8e4-1b1a-4cde-9794-c545ea7cb24c tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:13.828702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cba1f8e4-1b1a-4cde-9794-c545ea7cb24c tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:13.836268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cba1f8e4-1b1a-4cde-9794-c545ea7cb24c tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:13.837228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cba1f8e4-1b1a-4cde-9794-c545ea7cb24c tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:13.837509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cba1f8e4-1b1a-4cde-9794-c545ea7cb24c tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:13.837972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cba1f8e4-1b1a-4cde-9794-c545ea7cb24c tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:13.887796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e3f69d66-618a-4cb5-9c91-5b19aa3b4ce2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:13.906308 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e3f69d66-618a-4cb5-9c91-5b19aa3b4ce2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1313 microversion: 2.1 time: 0.362543 Aug 18 11:36:13.906943 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1192/2439] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:13 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:13.912953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ce42cc9d-6cb7-4be5-8e93-f7cfd27f65e4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:13.913576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ce42cc9d-6cb7-4be5-8e93-f7cfd27f65e4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:13.932855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce42cc9d-6cb7-4be5-8e93-f7cfd27f65e4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:13.933313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce42cc9d-6cb7-4be5-8e93-f7cfd27f65e4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:13.933765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce42cc9d-6cb7-4be5-8e93-f7cfd27f65e4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:13.944162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce42cc9d-6cb7-4be5-8e93-f7cfd27f65e4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:13.944724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce42cc9d-6cb7-4be5-8e93-f7cfd27f65e4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:13.945188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce42cc9d-6cb7-4be5-8e93-f7cfd27f65e4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:14.132567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cba1f8e4-1b1a-4cde-9794-c545ea7cb24c tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:14.146207 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cba1f8e4-1b1a-4cde-9794-c545ea7cb24c tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1509 microversion: 2.1 time: 0.336802 Aug 18 11:36:14.147329 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1248/2440] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:13 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1509 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:14.159144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-85e7b6fd-faf1-4e62-bc0b-32bf88f7617c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f598e50>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:14.262024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ce42cc9d-6cb7-4be5-8e93-f7cfd27f65e4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:14.274489 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ce42cc9d-6cb7-4be5-8e93-f7cfd27f65e4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 200 len: 1395 microversion: 2.1 time: 0.365351 Aug 18 11:36:14.280836 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1193/2441] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:13 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 1395 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:14.286708 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-85e7b6fd-faf1-4e62-bc0b-32bf88f7617c tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.137733 Aug 18 11:36:14.288978 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-691b5461-394a-46c7-9a00-626ed0f7e3e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:14.290080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-691b5461-394a-46c7-9a00-626ed0f7e3e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:14.297344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-691b5461-394a-46c7-9a00-626ed0f7e3e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:14.300289 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1249/2442] 10.222.0.73 () {58 vars in 1149 bytes} [Thu Aug 18 11:36:14 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:14.307396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6964e333-673e-4144-a425-655025d7f8f7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:14.308453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-691b5461-394a-46c7-9a00-626ed0f7e3e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:14.310855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-691b5461-394a-46c7-9a00-626ed0f7e3e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:14.311812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-691b5461-394a-46c7-9a00-626ed0f7e3e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:14.312438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-691b5461-394a-46c7-9a00-626ed0f7e3e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:14.313036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-691b5461-394a-46c7-9a00-626ed0f7e3e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:14.316599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6964e333-673e-4144-a425-655025d7f8f7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:14.356398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6964e333-673e-4144-a425-655025d7f8f7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:14.357851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6964e333-673e-4144-a425-655025d7f8f7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:14.363057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6964e333-673e-4144-a425-655025d7f8f7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:14.364577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6964e333-673e-4144-a425-655025d7f8f7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:14.365217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6964e333-673e-4144-a425-655025d7f8f7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:14.366660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6964e333-673e-4144-a425-655025d7f8f7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:14.551673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6964e333-673e-4144-a425-655025d7f8f7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:14.559627 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6964e333-673e-4144-a425-655025d7f8f7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.256710 Aug 18 11:36:14.560636 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1250/2443] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:14 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:14.565906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5d43557a-e8b0-458f-af65-abcd6d47814f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fc1e430>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:14.617475 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5d43557a-e8b0-458f-af65-abcd6d47814f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images?limit=1" status: 200 len: 620 microversion: 2.1 time: 0.055701 Aug 18 11:36:14.618057 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1251/2444] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:36:14 2022] GET /compute/v2.1/images?limit=1 => generated 620 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:14.620403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-691b5461-394a-46c7-9a00-626ed0f7e3e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:14.626622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-de12a6c3-6e20-4f6f-8b1a-0c145b1c37df req-890d4359-73dc-43e8-8fb7-aee37c1b9ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43cef527-b63e-455e-bb59-0af5ce753dd2", "name": "network-vif-plugged", "status": "completed", "tag": "234ff5c5-55d2-4c13-bb2c-a900c736a26b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:14.632874 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-691b5461-394a-46c7-9a00-626ed0f7e3e6 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1314 microversion: 2.1 time: 0.350537 Aug 18 11:36:14.633470 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1194/2445] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:14 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:14.639307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-bd00aea8-d01d-428c-8436-e2887fec1a33 req-e9eb843c-e927-49b3-a3d0-204fe6c072e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f11f7372-0d2e-4159-8c18-a86d32428841", "tag": "cb2d2511-5c49-464c-be36-c45456072cfb"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:14.651213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-de12a6c3-6e20-4f6f-8b1a-0c145b1c37df req-890d4359-73dc-43e8-8fb7-aee37c1b9ac4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:14.651696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-de12a6c3-6e20-4f6f-8b1a-0c145b1c37df req-890d4359-73dc-43e8-8fb7-aee37c1b9ac4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:14.652130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-de12a6c3-6e20-4f6f-8b1a-0c145b1c37df req-890d4359-73dc-43e8-8fb7-aee37c1b9ac4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:14.653507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bd00aea8-d01d-428c-8436-e2887fec1a33 req-e9eb843c-e927-49b3-a3d0-204fe6c072e1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:14.654111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bd00aea8-d01d-428c-8436-e2887fec1a33 req-e9eb843c-e927-49b3-a3d0-204fe6c072e1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:14.654677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bd00aea8-d01d-428c-8436-e2887fec1a33 req-e9eb843c-e927-49b3-a3d0-204fe6c072e1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:14.664401 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-de12a6c3-6e20-4f6f-8b1a-0c145b1c37df req-890d4359-73dc-43e8-8fb7-aee37c1b9ac4 service nova] Creating event network-vif-plugged:234ff5c5-55d2-4c13-bb2c-a900c736a26b for instance 43cef527-b63e-455e-bb59-0af5ce753dd2 on n-h2-853611-3 Aug 18 11:36:14.668909 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-bd00aea8-d01d-428c-8436-e2887fec1a33 req-e9eb843c-e927-49b3-a3d0-204fe6c072e1 service nova] Creating event network-changed:cb2d2511-5c49-464c-be36-c45456072cfb for instance f11f7372-0d2e-4159-8c18-a86d32428841 on n-h1-853611-3 Aug 18 11:36:14.669553 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-de12a6c3-6e20-4f6f-8b1a-0c145b1c37df req-890d4359-73dc-43e8-8fb7-aee37c1b9ac4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047349 Aug 18 11:36:14.670597 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1252/2446] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:14.676913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ead27188-69be-4e57-a874-5a68aebf9147 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:14.677103 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-bd00aea8-d01d-428c-8436-e2887fec1a33 req-e9eb843c-e927-49b3-a3d0-204fe6c072e1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041306 Aug 18 11:36:14.677621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ead27188-69be-4e57-a874-5a68aebf9147 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:14.678023 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1195/2447] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:14.687016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-76ab82ab-a19c-453c-ac85-febf260575dd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:14.687016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-76ab82ab-a19c-453c-ac85-febf260575dd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:14.690927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ead27188-69be-4e57-a874-5a68aebf9147 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:14.691572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ead27188-69be-4e57-a874-5a68aebf9147 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:14.692120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ead27188-69be-4e57-a874-5a68aebf9147 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:14.692985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ead27188-69be-4e57-a874-5a68aebf9147 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:14.693560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ead27188-69be-4e57-a874-5a68aebf9147 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:14.693982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76ab82ab-a19c-453c-ac85-febf260575dd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:14.694336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ead27188-69be-4e57-a874-5a68aebf9147 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:14.694606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76ab82ab-a19c-453c-ac85-febf260575dd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:14.695052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76ab82ab-a19c-453c-ac85-febf260575dd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:14.695764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76ab82ab-a19c-453c-ac85-febf260575dd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:14.696225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76ab82ab-a19c-453c-ac85-febf260575dd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:14.696650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76ab82ab-a19c-453c-ac85-febf260575dd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:14.865895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ead27188-69be-4e57-a874-5a68aebf9147 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:14.872653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-76ab82ab-a19c-453c-ac85-febf260575dd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:14.875419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:14.881305 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ead27188-69be-4e57-a874-5a68aebf9147 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1313 microversion: 2.1 time: 0.209305 Aug 18 11:36:14.883818 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-76ab82ab-a19c-453c-ac85-febf260575dd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.204658 Aug 18 11:36:14.884665 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1196/2448] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:14 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:14.889970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d9bd186b-ba16-48b9-83c9-4a5e2eb3bcb7 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f94f0d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:14.894898 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1253/2449] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:14 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:14.901528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c69e42ba-cf04-4feb-a6e9-12c2e945a478 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:14.902271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c69e42ba-cf04-4feb-a6e9-12c2e945a478 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:14.910180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c69e42ba-cf04-4feb-a6e9-12c2e945a478 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:14.910798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c69e42ba-cf04-4feb-a6e9-12c2e945a478 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:14.911625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c69e42ba-cf04-4feb-a6e9-12c2e945a478 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:14.912350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c69e42ba-cf04-4feb-a6e9-12c2e945a478 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:14.912805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c69e42ba-cf04-4feb-a6e9-12c2e945a478 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:14.913231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c69e42ba-cf04-4feb-a6e9-12c2e945a478 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.006466 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d9bd186b-ba16-48b9-83c9-4a5e2eb3bcb7 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/detail?changes-since=2022-08-18T11%3A33%3A40Z" status: 200 len: 6320 microversion: 2.1 time: 0.120195 Aug 18 11:36:15.007082 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1197/2450] 10.222.0.73 () {58 vars in 1220 bytes} [Thu Aug 18 11:36:14 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-18T11%3A33%3A40Z => generated 6320 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:15.011922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5f53a4c0-b802-4d31-98ec-b2fc130321cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:15.012830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5f53a4c0-b802-4d31-98ec-b2fc130321cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:15.021818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f53a4c0-b802-4d31-98ec-b2fc130321cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:15.022327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f53a4c0-b802-4d31-98ec-b2fc130321cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:15.022810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f53a4c0-b802-4d31-98ec-b2fc130321cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.023529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f53a4c0-b802-4d31-98ec-b2fc130321cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:15.023992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f53a4c0-b802-4d31-98ec-b2fc130321cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:15.024429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f53a4c0-b802-4d31-98ec-b2fc130321cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.066032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c69e42ba-cf04-4feb-a6e9-12c2e945a478 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:15.074630 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c69e42ba-cf04-4feb-a6e9-12c2e945a478 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1355 microversion: 2.1 time: 0.178499 Aug 18 11:36:15.075258 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1254/2451] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:14 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1355 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:15.084934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ce30d812-03a1-4d7a-8bd4-c858bfc65281 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:15.085721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ce30d812-03a1-4d7a-8bd4-c858bfc65281 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:15.092449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce30d812-03a1-4d7a-8bd4-c858bfc65281 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:15.092961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce30d812-03a1-4d7a-8bd4-c858bfc65281 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:15.093420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce30d812-03a1-4d7a-8bd4-c858bfc65281 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.094167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce30d812-03a1-4d7a-8bd4-c858bfc65281 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:15.094707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce30d812-03a1-4d7a-8bd4-c858bfc65281 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:15.095853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce30d812-03a1-4d7a-8bd4-c858bfc65281 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.167075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5f53a4c0-b802-4d31-98ec-b2fc130321cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:15.175153 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5f53a4c0-b802-4d31-98ec-b2fc130321cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.166864 Aug 18 11:36:15.175730 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1198/2452] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:15 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:15.193501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d04de809-ad1e-423d-a8c2-13d56e163127 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f9afd30>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:15.242832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ce30d812-03a1-4d7a-8bd4-c858bfc65281 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:15.252015 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ce30d812-03a1-4d7a-8bd4-c858bfc65281 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1313 microversion: 2.1 time: 0.170919 Aug 18 11:36:15.254870 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1255/2453] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:15 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:15.276411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fab1c0d0-0b41-48fe-896f-4c5ba3eadd47 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:15.277152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fab1c0d0-0b41-48fe-896f-4c5ba3eadd47 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:15.281342 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d04de809-ad1e-423d-a8c2-13d56e163127 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-416063027" status: 200 len: 664 microversion: 2.1 time: 0.091844 Aug 18 11:36:15.285955 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1199/2454] 10.222.0.73 () {58 vars in 1250 bytes} [Thu Aug 18 11:36:15 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-416063027 => generated 664 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:15.291891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fab1c0d0-0b41-48fe-896f-4c5ba3eadd47 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:15.292640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fab1c0d0-0b41-48fe-896f-4c5ba3eadd47 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:15.293081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fab1c0d0-0b41-48fe-896f-4c5ba3eadd47 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.293808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fab1c0d0-0b41-48fe-896f-4c5ba3eadd47 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:15.294259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fab1c0d0-0b41-48fe-896f-4c5ba3eadd47 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:15.294709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fab1c0d0-0b41-48fe-896f-4c5ba3eadd47 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.296849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9f49aa00-f338-4cab-9695-ebae986c6d50 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:15.298400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9f49aa00-f338-4cab-9695-ebae986c6d50 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:15.309790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f49aa00-f338-4cab-9695-ebae986c6d50 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:15.311941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f49aa00-f338-4cab-9695-ebae986c6d50 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:15.313151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f49aa00-f338-4cab-9695-ebae986c6d50 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.314811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f49aa00-f338-4cab-9695-ebae986c6d50 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:15.315441 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f49aa00-f338-4cab-9695-ebae986c6d50 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:15.316054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f49aa00-f338-4cab-9695-ebae986c6d50 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.464796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fab1c0d0-0b41-48fe-896f-4c5ba3eadd47 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:15.475964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9f49aa00-f338-4cab-9695-ebae986c6d50 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:15.476154 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fab1c0d0-0b41-48fe-896f-4c5ba3eadd47 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1509 microversion: 2.1 time: 0.219628 Aug 18 11:36:15.485732 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9f49aa00-f338-4cab-9695-ebae986c6d50 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.197617 Aug 18 11:36:15.491537 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1256/2455] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:15 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:15.496913 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1200/2456] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:15 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:15.500230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-102636df-9659-40a0-bd11-e7d5ae5092d8 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fa39a60>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:15.509017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-17b591d3-9448-40fd-a6cb-920ed0c6fb64 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:15.509770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-17b591d3-9448-40fd-a6cb-920ed0c6fb64 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:15.517406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-17b591d3-9448-40fd-a6cb-920ed0c6fb64 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:15.517406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-17b591d3-9448-40fd-a6cb-920ed0c6fb64 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:15.518308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-17b591d3-9448-40fd-a6cb-920ed0c6fb64 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.518811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-17b591d3-9448-40fd-a6cb-920ed0c6fb64 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:15.519270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-17b591d3-9448-40fd-a6cb-920ed0c6fb64 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:15.519712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-17b591d3-9448-40fd-a6cb-920ed0c6fb64 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.585506 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-102636df-9659-40a0-bd11-e7d5ae5092d8 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.73%2Fcompute%2Fv2.1%2Fservers%2F61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1462 microversion: 2.1 time: 0.092565 Aug 18 11:36:15.596337 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1257/2457] 10.222.0.73 () {58 vars in 1338 bytes} [Thu Aug 18 11:36:15 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.73%2Fcompute%2Fv2.1%2Fservers%2F61b34fc6-468f-4179-b73f-6776c809d055 => generated 1462 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:15.596337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d11402b0-f5f8-4db8-970e-b0f646c30a23 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:15.596337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d11402b0-f5f8-4db8-970e-b0f646c30a23 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:15.601459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11402b0-f5f8-4db8-970e-b0f646c30a23 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:15.601974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11402b0-f5f8-4db8-970e-b0f646c30a23 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:15.602447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11402b0-f5f8-4db8-970e-b0f646c30a23 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.603183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11402b0-f5f8-4db8-970e-b0f646c30a23 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:15.603645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11402b0-f5f8-4db8-970e-b0f646c30a23 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:15.604078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11402b0-f5f8-4db8-970e-b0f646c30a23 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.708215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-17b591d3-9448-40fd-a6cb-920ed0c6fb64 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:15.731179 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-17b591d3-9448-40fd-a6cb-920ed0c6fb64 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 200 len: 1395 microversion: 2.1 time: 0.232761 Aug 18 11:36:15.732187 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1201/2458] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:15 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 1395 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:15.757619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9d58d57e-cb01-4b7a-837a-b2f70bec4d62 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f2d49d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:15.827539 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9d58d57e-cb01-4b7a-837a-b2f70bec4d62 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.73%2Fcompute%2Fservers%2F61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1462 microversion: 2.1 time: 0.079562 Aug 18 11:36:15.829627 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1202/2459] 10.222.0.73 () {58 vars in 1324 bytes} [Thu Aug 18 11:36:15 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.73%2Fcompute%2Fservers%2F61b34fc6-468f-4179-b73f-6776c809d055 => generated 1462 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:15.839663 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-10f68749-104b-4369-acba-3806a28bb369 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:15.840589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-10f68749-104b-4369-acba-3806a28bb369 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:15.850573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10f68749-104b-4369-acba-3806a28bb369 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:15.851928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10f68749-104b-4369-acba-3806a28bb369 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:15.852751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10f68749-104b-4369-acba-3806a28bb369 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.853813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10f68749-104b-4369-acba-3806a28bb369 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:15.854471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10f68749-104b-4369-acba-3806a28bb369 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:15.855091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10f68749-104b-4369-acba-3806a28bb369 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:15.919720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d11402b0-f5f8-4db8-970e-b0f646c30a23 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:15.928185 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d11402b0-f5f8-4db8-970e-b0f646c30a23 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.340586 Aug 18 11:36:15.928772 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1258/2460] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:15 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:15.933740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fcdc0e36-3221-4293-9e16-4459bb6f7897 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fa399d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:16.113389 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fcdc0e36-3221-4293-9e16-4459bb6f7897 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7095 microversion: 2.1 time: 0.182576 Aug 18 11:36:16.126457 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1259/2461] 10.222.0.73 () {58 vars in 1170 bytes} [Thu Aug 18 11:36:15 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7095 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:16.126457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-20352cb2-7448-453b-bf38-f4608bc0d08a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:16.126457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-20352cb2-7448-453b-bf38-f4608bc0d08a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:16.133822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20352cb2-7448-453b-bf38-f4608bc0d08a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:16.133822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20352cb2-7448-453b-bf38-f4608bc0d08a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:16.134138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20352cb2-7448-453b-bf38-f4608bc0d08a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:16.134954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20352cb2-7448-453b-bf38-f4608bc0d08a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:16.136175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20352cb2-7448-453b-bf38-f4608bc0d08a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:16.136758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20352cb2-7448-453b-bf38-f4608bc0d08a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:16.352230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-20352cb2-7448-453b-bf38-f4608bc0d08a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:16.361637 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-20352cb2-7448-453b-bf38-f4608bc0d08a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1313 microversion: 2.1 time: 0.246043 Aug 18 11:36:16.362871 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1260/2462] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:16 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:16.368114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6c088ea8-9bba-48a4-8f4d-f5ce859eae9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:16.368770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6c088ea8-9bba-48a4-8f4d-f5ce859eae9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:16.375150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c088ea8-9bba-48a4-8f4d-f5ce859eae9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:16.376538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c088ea8-9bba-48a4-8f4d-f5ce859eae9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:16.377151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c088ea8-9bba-48a4-8f4d-f5ce859eae9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:16.378072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c088ea8-9bba-48a4-8f4d-f5ce859eae9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:16.378566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c088ea8-9bba-48a4-8f4d-f5ce859eae9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:16.379150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c088ea8-9bba-48a4-8f4d-f5ce859eae9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:16.384445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:16.548566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6c088ea8-9bba-48a4-8f4d-f5ce859eae9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:16.557116 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6c088ea8-9bba-48a4-8f4d-f5ce859eae9f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.192811 Aug 18 11:36:16.558029 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1261/2463] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:16 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:16.563863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f02195d-05ec-46ec-8ada-d970da9f2363 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:16.564868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f02195d-05ec-46ec-8ada-d970da9f2363 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:16.571465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f02195d-05ec-46ec-8ada-d970da9f2363 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:16.572547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f02195d-05ec-46ec-8ada-d970da9f2363 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:16.573481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f02195d-05ec-46ec-8ada-d970da9f2363 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:16.574465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f02195d-05ec-46ec-8ada-d970da9f2363 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:16.575357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f02195d-05ec-46ec-8ada-d970da9f2363 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:16.575855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f02195d-05ec-46ec-8ada-d970da9f2363 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:16.762622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2f02195d-05ec-46ec-8ada-d970da9f2363 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:16.771623 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f02195d-05ec-46ec-8ada-d970da9f2363 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1355 microversion: 2.1 time: 0.212292 Aug 18 11:36:16.773021 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1262/2464] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:16 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1355 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:16.777970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-052d56c9-9213-419c-a3d4-add7fd7d3981 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f954040>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:16.789355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-10f68749-104b-4369-acba-3806a28bb369 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:16.798086 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-10f68749-104b-4369-acba-3806a28bb369 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1314 microversion: 2.1 time: 0.965973 Aug 18 11:36:16.799107 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1203/2465] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:15 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1314 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:16.804091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-659aa83b-96df-442f-bc3e-cafa2121cb86 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:16.804918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-659aa83b-96df-442f-bc3e-cafa2121cb86 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:16.827801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-659aa83b-96df-442f-bc3e-cafa2121cb86 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:16.828493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-659aa83b-96df-442f-bc3e-cafa2121cb86 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:16.829277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-659aa83b-96df-442f-bc3e-cafa2121cb86 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:16.831111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-659aa83b-96df-442f-bc3e-cafa2121cb86 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:16.831111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-659aa83b-96df-442f-bc3e-cafa2121cb86 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:16.831111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-659aa83b-96df-442f-bc3e-cafa2121cb86 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:16.857615 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-052d56c9-9213-419c-a3d4-add7fd7d3981 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4362 microversion: 2.1 time: 0.083427 Aug 18 11:36:16.858460 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1263/2466] 10.222.0.73 () {58 vars in 1170 bytes} [Thu Aug 18 11:36:16 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4362 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:16.864807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d95d8000-1342-4569-936e-a8bb62a89169 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:16.865432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d95d8000-1342-4569-936e-a8bb62a89169 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:16.872966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d95d8000-1342-4569-936e-a8bb62a89169 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:16.873460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d95d8000-1342-4569-936e-a8bb62a89169 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:16.873899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d95d8000-1342-4569-936e-a8bb62a89169 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:16.874694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d95d8000-1342-4569-936e-a8bb62a89169 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:16.875127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d95d8000-1342-4569-936e-a8bb62a89169 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:16.875560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d95d8000-1342-4569-936e-a8bb62a89169 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:17.030546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d95d8000-1342-4569-936e-a8bb62a89169 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:17.040210 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d95d8000-1342-4569-936e-a8bb62a89169 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1509 microversion: 2.1 time: 0.180389 Aug 18 11:36:17.043030 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1264/2467] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:16 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:17.045657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-09b9bc12-2175-4cad-aa97-b7d103ad4ebf req-7610f84f-ede8-450f-987b-9b66db5c2f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed2bb36-0499-4abd-b690-93bbafd53c4e", "name": "network-vif-plugged", "status": "completed", "tag": "40544f64-d224-4fb3-a2f8-d97b2a87d52c"}, {"server_uuid": "5aee369f-2ece-4b53-a7db-efe946936831", "name": "network-vif-plugged", "status": "completed", "tag": "fdd9010d-de96-4f58-8fc4-5c78c661a107"}, {"server_uuid": "3ed2bb36-0499-4abd-b690-93bbafd53c4e", "name": "network-vif-plugged", "status": "completed", "tag": "87982b37-1820-40af-8443-4ac2fe0add38"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:17.057812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-09b9bc12-2175-4cad-aa97-b7d103ad4ebf req-7610f84f-ede8-450f-987b-9b66db5c2f3b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:17.057812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-09b9bc12-2175-4cad-aa97-b7d103ad4ebf req-7610f84f-ede8-450f-987b-9b66db5c2f3b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:17.058242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-09b9bc12-2175-4cad-aa97-b7d103ad4ebf req-7610f84f-ede8-450f-987b-9b66db5c2f3b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:17.073019 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-09b9bc12-2175-4cad-aa97-b7d103ad4ebf req-7610f84f-ede8-450f-987b-9b66db5c2f3b service nova] Creating event network-vif-plugged:40544f64-d224-4fb3-a2f8-d97b2a87d52c for instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e on n-h1-853611-3 Aug 18 11:36:17.073656 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-09b9bc12-2175-4cad-aa97-b7d103ad4ebf req-7610f84f-ede8-450f-987b-9b66db5c2f3b service nova] Creating event network-vif-plugged:fdd9010d-de96-4f58-8fc4-5c78c661a107 for instance 5aee369f-2ece-4b53-a7db-efe946936831 on n-h2-853611-3 Aug 18 11:36:17.074225 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-09b9bc12-2175-4cad-aa97-b7d103ad4ebf req-7610f84f-ede8-450f-987b-9b66db5c2f3b service nova] Creating event network-vif-plugged:87982b37-1820-40af-8443-4ac2fe0add38 for instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e on n-h1-853611-3 Aug 18 11:36:17.083574 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-09b9bc12-2175-4cad-aa97-b7d103ad4ebf req-7610f84f-ede8-450f-987b-9b66db5c2f3b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041616 Aug 18 11:36:17.084593 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1265/2468] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:17.089566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-83759fe6-8ed1-4b4c-bd9e-038be105fea4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:17.090255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-83759fe6-8ed1-4b4c-bd9e-038be105fea4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:17.098000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83759fe6-8ed1-4b4c-bd9e-038be105fea4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:17.099081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83759fe6-8ed1-4b4c-bd9e-038be105fea4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:17.099081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83759fe6-8ed1-4b4c-bd9e-038be105fea4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:17.099577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83759fe6-8ed1-4b4c-bd9e-038be105fea4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:17.100030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83759fe6-8ed1-4b4c-bd9e-038be105fea4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:17.100458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83759fe6-8ed1-4b4c-bd9e-038be105fea4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:17.253962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-83759fe6-8ed1-4b4c-bd9e-038be105fea4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:17.261748 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-83759fe6-8ed1-4b4c-bd9e-038be105fea4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 200 len: 1395 microversion: 2.1 time: 0.176177 Aug 18 11:36:17.262349 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1266/2469] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:17 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 1395 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:17.268677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-33d40f00-e3f9-4691-9602-3b7dca3c67e9 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fc1e4c0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:17.280541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-659aa83b-96df-442f-bc3e-cafa2121cb86 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:17.289619 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-659aa83b-96df-442f-bc3e-cafa2121cb86 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1463 microversion: 2.1 time: 0.489148 Aug 18 11:36:17.290909 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1204/2470] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:16 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1463 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:17.327607 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-33d40f00-e3f9-4691-9602-3b7dca3c67e9 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/1073d795-16bf-4b88-a573-c9b71aeef18a" status: 200 len: 784 microversion: 2.1 time: 0.064161 Aug 18 11:36:17.328550 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1267/2471] 10.222.0.73 () {58 vars in 1233 bytes} [Thu Aug 18 11:36:17 2022] GET /compute/v2.1/images/1073d795-16bf-4b88-a573-c9b71aeef18a => generated 784 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:17.344173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5a311eb8-ce86-4a1b-b409-4de80d582937 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fab2f70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:17.411067 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5a311eb8-ce86-4a1b-b409-4de80d582937 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1605 microversion: 2.1 time: 0.071096 Aug 18 11:36:17.411802 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1268/2472] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:36:17 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1605 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:17.417292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c03e3874-1dc3-4d28-bbc3-792177d33497 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:17.418351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c03e3874-1dc3-4d28-bbc3-792177d33497 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:17.425391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c03e3874-1dc3-4d28-bbc3-792177d33497 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:17.426003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c03e3874-1dc3-4d28-bbc3-792177d33497 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:17.426841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c03e3874-1dc3-4d28-bbc3-792177d33497 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:17.427480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c03e3874-1dc3-4d28-bbc3-792177d33497 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:17.428165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c03e3874-1dc3-4d28-bbc3-792177d33497 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:17.428777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c03e3874-1dc3-4d28-bbc3-792177d33497 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:17.480062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a46c21e6-027a-4799-a04e-d8624f40c847 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:17.481214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a46c21e6-027a-4799-a04e-d8624f40c847 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:17.488836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a46c21e6-027a-4799-a04e-d8624f40c847 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:17.489473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a46c21e6-027a-4799-a04e-d8624f40c847 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:17.490157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a46c21e6-027a-4799-a04e-d8624f40c847 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:17.491212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a46c21e6-027a-4799-a04e-d8624f40c847 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:17.493095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a46c21e6-027a-4799-a04e-d8624f40c847 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:17.496932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a46c21e6-027a-4799-a04e-d8624f40c847 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:17.610286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c03e3874-1dc3-4d28-bbc3-792177d33497 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:17.619423 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c03e3874-1dc3-4d28-bbc3-792177d33497 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1313 microversion: 2.1 time: 0.206367 Aug 18 11:36:17.632628 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1269/2473] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:17 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:17.638800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab42386d-929d-44ca-a318-3c8d02509e05 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519fa39430>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:17.763953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:17.824744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=20 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:18.095475 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a46c21e6-027a-4799-a04e-d8624f40c847 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1614 microversion: 2.1 time: 0.784630 Aug 18 11:36:18.096463 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1205/2474] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:17 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1614 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:18.116851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3b914dd5-e322-49c7-b70f-3e5b27afa269 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:18.117766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3b914dd5-e322-49c7-b70f-3e5b27afa269 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:18.127041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b914dd5-e322-49c7-b70f-3e5b27afa269 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:18.127637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b914dd5-e322-49c7-b70f-3e5b27afa269 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:18.128198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b914dd5-e322-49c7-b70f-3e5b27afa269 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:18.129958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b914dd5-e322-49c7-b70f-3e5b27afa269 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:18.129958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b914dd5-e322-49c7-b70f-3e5b27afa269 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:18.130168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b914dd5-e322-49c7-b70f-3e5b27afa269 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:18.361274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3b914dd5-e322-49c7-b70f-3e5b27afa269 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:18.371580 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3b914dd5-e322-49c7-b70f-3e5b27afa269 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1355 microversion: 2.1 time: 0.266743 Aug 18 11:36:18.372174 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1206/2475] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:18 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1355 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:18.383494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-08c65ee0-6f8a-4424-bc65-0e09168f2694 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:18.384165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-08c65ee0-6f8a-4424-bc65-0e09168f2694 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:18.390537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08c65ee0-6f8a-4424-bc65-0e09168f2694 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:18.391673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08c65ee0-6f8a-4424-bc65-0e09168f2694 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:18.392184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08c65ee0-6f8a-4424-bc65-0e09168f2694 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:18.392979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08c65ee0-6f8a-4424-bc65-0e09168f2694 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:18.393431 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08c65ee0-6f8a-4424-bc65-0e09168f2694 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:18.393863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08c65ee0-6f8a-4424-bc65-0e09168f2694 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:18.408125 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab42386d-929d-44ca-a318-3c8d02509e05 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "DELETE /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a" status: 204 len: 0 microversion: 2.1 time: 0.773242 Aug 18 11:36:18.408864 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1270/2476] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:17 2022] DELETE /compute/v2.1/images/2eb37113-f64f-41dd-b8d4-d6622f5dfb3a => generated 0 bytes in 775 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:36:18.416177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-65ddc435-3ba7-41d2-b271-2198d7a9b655 req-907b1c9f-fdf4-4033-aa12-250d5e3cb8ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1582eb-3994-4092-a342-4c88340004c3", "name": "network-vif-deleted", "tag": "a50a09ef-ed01-44ae-96dc-b34d0e3ea646"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:18.426973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-65ddc435-3ba7-41d2-b271-2198d7a9b655 req-907b1c9f-fdf4-4033-aa12-250d5e3cb8ad service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:18.427477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-65ddc435-3ba7-41d2-b271-2198d7a9b655 req-907b1c9f-fdf4-4033-aa12-250d5e3cb8ad service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:18.427906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-65ddc435-3ba7-41d2-b271-2198d7a9b655 req-907b1c9f-fdf4-4033-aa12-250d5e3cb8ad service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:18.445542 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-65ddc435-3ba7-41d2-b271-2198d7a9b655 req-907b1c9f-fdf4-4033-aa12-250d5e3cb8ad service nova] Creating event network-vif-deleted:a50a09ef-ed01-44ae-96dc-b34d0e3ea646 for instance 2e1582eb-3994-4092-a342-4c88340004c3 on n-h2-853611-3 Aug 18 11:36:18.451185 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-65ddc435-3ba7-41d2-b271-2198d7a9b655 req-907b1c9f-fdf4-4033-aa12-250d5e3cb8ad service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040688 Aug 18 11:36:18.451801 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1271/2477] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:18.457684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-98f03f24-b10b-46d9-a113-77aaae7144be tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:18.458382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-98f03f24-b10b-46d9-a113-77aaae7144be tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:18.465404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98f03f24-b10b-46d9-a113-77aaae7144be tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:18.465905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98f03f24-b10b-46d9-a113-77aaae7144be tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:18.466349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98f03f24-b10b-46d9-a113-77aaae7144be tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:18.467143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98f03f24-b10b-46d9-a113-77aaae7144be tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:18.467609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98f03f24-b10b-46d9-a113-77aaae7144be tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:18.468042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98f03f24-b10b-46d9-a113-77aaae7144be tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:18.502233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98f03f24-b10b-46d9-a113-77aaae7144be tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:18.502749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98f03f24-b10b-46d9-a113-77aaae7144be tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:18.503190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98f03f24-b10b-46d9-a113-77aaae7144be tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:18.503654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-98f03f24-b10b-46d9-a113-77aaae7144be tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lazy-loading 'fault' on Instance uuid 2e1582eb-3994-4092-a342-4c88340004c3 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:36:18.544767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-08c65ee0-6f8a-4424-bc65-0e09168f2694 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:18.551385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-98f03f24-b10b-46d9-a113-77aaae7144be tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7d55b36a7418d978d4a8abc7399fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a508683f2ec488eb659d92a87e88582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:18.553004 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-08c65ee0-6f8a-4424-bc65-0e09168f2694 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1314 microversion: 2.1 time: 0.173698 Aug 18 11:36:18.553597 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1207/2478] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:18 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:18.558024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a28dc85-9f21-409d-8373-4c768ddc4d23 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:18.558666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0a28dc85-9f21-409d-8373-4c768ddc4d23 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:18.559018 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-98f03f24-b10b-46d9-a113-77aaae7144be tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 200 len: 1313 microversion: 2.1 time: 0.105969 Aug 18 11:36:18.561640 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1272/2479] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:18 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 1313 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:18.566104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a28dc85-9f21-409d-8373-4c768ddc4d23 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:18.566956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a28dc85-9f21-409d-8373-4c768ddc4d23 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:18.567545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a28dc85-9f21-409d-8373-4c768ddc4d23 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:18.568793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a28dc85-9f21-409d-8373-4c768ddc4d23 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:18.569406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a28dc85-9f21-409d-8373-4c768ddc4d23 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:18.569924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a28dc85-9f21-409d-8373-4c768ddc4d23 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:18.572164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dfbdca6f-7452-4e00-bf17-fa39d1678e82 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:18.572793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dfbdca6f-7452-4e00-bf17-fa39d1678e82 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:18.574797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:18.581658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfbdca6f-7452-4e00-bf17-fa39d1678e82 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:18.582243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfbdca6f-7452-4e00-bf17-fa39d1678e82 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:18.582826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfbdca6f-7452-4e00-bf17-fa39d1678e82 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:18.583576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfbdca6f-7452-4e00-bf17-fa39d1678e82 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:18.584037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfbdca6f-7452-4e00-bf17-fa39d1678e82 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:18.584468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfbdca6f-7452-4e00-bf17-fa39d1678e82 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:18.608700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0a28dc85-9f21-409d-8373-4c768ddc4d23 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0b1fc7f260154f4e90bdd7aad924eef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6cdef501fd64db9ad001e62a302ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:18.609712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0a28dc85-9f21-409d-8373-4c768ddc4d23 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] flavor_id is None. Assuming migration. {{(pid=122209) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 18 11:36:18.611145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0a28dc85-9f21-409d-8373-4c768ddc4d23 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122209) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 11:36:18.745060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dfbdca6f-7452-4e00-bf17-fa39d1678e82 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:18.754665 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dfbdca6f-7452-4e00-bf17-fa39d1678e82 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 200 len: 1575 microversion: 2.1 time: 0.191519 Aug 18 11:36:18.755373 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1273/2480] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:18 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:18.760456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-033dda1f-d0c1-4997-b493-5087fe40b3d2 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f51b0da2b80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:19.015615 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0a28dc85-9f21-409d-8373-4c768ddc4d23 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2/action" status: 202 len: 0 microversion: 2.1 time: 0.460407 Aug 18 11:36:19.026890 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1208/2481] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:36:18 2022] POST /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:36:19.045864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1499b13e-7573-4e9b-8670-698899c65958 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:19.046645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1499b13e-7573-4e9b-8670-698899c65958 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:19.057005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1499b13e-7573-4e9b-8670-698899c65958 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:19.058025 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1499b13e-7573-4e9b-8670-698899c65958 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:19.058507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1499b13e-7573-4e9b-8670-698899c65958 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:19.059406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1499b13e-7573-4e9b-8670-698899c65958 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:19.060031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1499b13e-7573-4e9b-8670-698899c65958 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:19.061063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1499b13e-7573-4e9b-8670-698899c65958 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:19.246144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1499b13e-7573-4e9b-8670-698899c65958 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:19.256578 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1499b13e-7573-4e9b-8670-698899c65958 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1313 microversion: 2.1 time: 0.220601 Aug 18 11:36:19.257355 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1209/2482] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:19 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:19.270916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-afe27145-f1e0-430f-9658-679178efff55 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:19.271728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-afe27145-f1e0-430f-9658-679178efff55 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:19.279178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-afe27145-f1e0-430f-9658-679178efff55 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:19.279838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-afe27145-f1e0-430f-9658-679178efff55 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:19.280309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-afe27145-f1e0-430f-9658-679178efff55 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:19.281014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-afe27145-f1e0-430f-9658-679178efff55 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:19.281495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-afe27145-f1e0-430f-9658-679178efff55 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:19.286960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-afe27145-f1e0-430f-9658-679178efff55 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:19.328104 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-033dda1f-d0c1-4997-b493-5087fe40b3d2 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "DELETE /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505" status: 204 len: 0 microversion: 2.1 time: 0.571506 Aug 18 11:36:19.329462 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1274/2483] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:18 2022] DELETE /compute/v2.1/images/8275feeb-19e9-4064-a0a9-4f1e9c0c4505 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:36:19.334509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-42e9f41d-51ad-4e9b-956d-ea02b55d9f7b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:19.335149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-42e9f41d-51ad-4e9b-956d-ea02b55d9f7b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:19.341728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42e9f41d-51ad-4e9b-956d-ea02b55d9f7b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:19.342262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42e9f41d-51ad-4e9b-956d-ea02b55d9f7b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:19.342730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42e9f41d-51ad-4e9b-956d-ea02b55d9f7b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:19.343432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42e9f41d-51ad-4e9b-956d-ea02b55d9f7b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:19.344047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42e9f41d-51ad-4e9b-956d-ea02b55d9f7b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:19.344671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42e9f41d-51ad-4e9b-956d-ea02b55d9f7b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:19.380852 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-afe27145-f1e0-430f-9658-679178efff55 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122217 Aug 18 11:36:19.381501 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1210/2484] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:36:19 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:19.396247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-5858e96b-b838-481a-aae4-694f8b311195 req-4a343ea7-1ba4-4adf-9e0e-eb6caf2cec37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed2bb36-0499-4abd-b690-93bbafd53c4e", "name": "network-vif-plugged", "status": "completed", "tag": "dd5f20e2-c3e1-4d6e-92b7-f4f34dea36b8"}, {"server_uuid": "2ee89e61-02ed-4624-bbbe-898aac54e492", "name": "network-vif-plugged", "status": "completed", "tag": "37af06aa-0d3d-4f65-9b48-b4c97e8f72f3"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:19.417019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5858e96b-b838-481a-aae4-694f8b311195 req-4a343ea7-1ba4-4adf-9e0e-eb6caf2cec37 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:19.417775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5858e96b-b838-481a-aae4-694f8b311195 req-4a343ea7-1ba4-4adf-9e0e-eb6caf2cec37 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:19.418368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5858e96b-b838-481a-aae4-694f8b311195 req-4a343ea7-1ba4-4adf-9e0e-eb6caf2cec37 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:19.439178 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5858e96b-b838-481a-aae4-694f8b311195 req-4a343ea7-1ba4-4adf-9e0e-eb6caf2cec37 service nova] Creating event network-vif-plugged:dd5f20e2-c3e1-4d6e-92b7-f4f34dea36b8 for instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e on n-h1-853611-3 Aug 18 11:36:19.440135 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5858e96b-b838-481a-aae4-694f8b311195 req-4a343ea7-1ba4-4adf-9e0e-eb6caf2cec37 service nova] Creating event network-vif-plugged:37af06aa-0d3d-4f65-9b48-b4c97e8f72f3 for instance 2ee89e61-02ed-4624-bbbe-898aac54e492 on n-h1-853611-3 Aug 18 11:36:19.449547 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-5858e96b-b838-481a-aae4-694f8b311195 req-4a343ea7-1ba4-4adf-9e0e-eb6caf2cec37 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066714 Aug 18 11:36:19.450759 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1211/2485] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:19.463920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1313da14-42e9-49b5-ae3c-1c6f5aee3b1f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f9af5e0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:19.520363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-42e9f41d-51ad-4e9b-956d-ea02b55d9f7b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:19.529241 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-42e9f41d-51ad-4e9b-956d-ea02b55d9f7b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1472 microversion: 2.1 time: 0.198409 Aug 18 11:36:19.530456 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1275/2486] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:19 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1472 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:19.536564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-161504c0-5431-442c-99ce-fa01941e52fa tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:19.537400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-161504c0-5431-442c-99ce-fa01941e52fa tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:19.554990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-161504c0-5431-442c-99ce-fa01941e52fa tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:19.555727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-161504c0-5431-442c-99ce-fa01941e52fa tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:19.556340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-161504c0-5431-442c-99ce-fa01941e52fa tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:19.557231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-161504c0-5431-442c-99ce-fa01941e52fa tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:19.557844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-161504c0-5431-442c-99ce-fa01941e52fa tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:19.559744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-161504c0-5431-442c-99ce-fa01941e52fa tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:19.867910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-161504c0-5431-442c-99ce-fa01941e52fa tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:19.878875 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-161504c0-5431-442c-99ce-fa01941e52fa tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1355 microversion: 2.1 time: 0.346832 Aug 18 11:36:19.879514 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1276/2487] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:19 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1355 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:19.889384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-767e9749-003b-40d8-9bd9-edfb0468d9f5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:19.890023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-767e9749-003b-40d8-9bd9-edfb0468d9f5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:19.897492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767e9749-003b-40d8-9bd9-edfb0468d9f5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:19.898021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767e9749-003b-40d8-9bd9-edfb0468d9f5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:19.898492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767e9749-003b-40d8-9bd9-edfb0468d9f5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:19.899278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767e9749-003b-40d8-9bd9-edfb0468d9f5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:19.899750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767e9749-003b-40d8-9bd9-edfb0468d9f5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:19.900181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767e9749-003b-40d8-9bd9-edfb0468d9f5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:20.072755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-767e9749-003b-40d8-9bd9-edfb0468d9f5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:20.083406 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-767e9749-003b-40d8-9bd9-edfb0468d9f5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1314 microversion: 2.1 time: 0.200525 Aug 18 11:36:20.098402 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1277/2488] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:19 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:20.104758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3673c030-bbce-410a-aa89-97e26989e439 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:20.105718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3673c030-bbce-410a-aa89-97e26989e439 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] [instance: 2e1582eb-3994-4092-a342-4c88340004c3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:20.115337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3673c030-bbce-410a-aa89-97e26989e439 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:20.116478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3673c030-bbce-410a-aa89-97e26989e439 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:20.116966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3673c030-bbce-410a-aa89-97e26989e439 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:20.118107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3673c030-bbce-410a-aa89-97e26989e439 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:20.118917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3673c030-bbce-410a-aa89-97e26989e439 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:20.119519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3673c030-bbce-410a-aa89-97e26989e439 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:20.139269 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-3673c030-bbce-410a-aa89-97e26989e439 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] HTTP exception thrown: Instance 2e1582eb-3994-4092-a342-4c88340004c3 could not be found. Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3673c030-bbce-410a-aa89-97e26989e439 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Request method failure captured: Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 HTTP/1.1 Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iPEsfEPIkT9vmXlmBI33L2gT0stIzYK4OAtJSah72CPd4Tnxq431H0sZMNUusEcMm3lewjBQj24Nec4GIwOT6Tk-xBgCJuqUNB2dB_MIdey99hIpB_JZj5_sfT7HpL0ThMNuuKVqXb0X9O8QrxBxQ-IfS2t-ynb63vS6uOBeYOa-zQ Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 4a508683f2ec488eb659d92a87e88582 Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1204128420 Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a508683f2ec488eb659d92a87e88582"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/4a508683f2ec488eb659d92a87e88582"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_4a508683f2ec488eb659d92a87e88582"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/4a508683f2ec488eb659d92a87e88582"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1204128420 Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 4a508683f2ec488eb659d92a87e88582 Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1204128420 Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerRescueTestJSONUnderV235-1204128420-project Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c2b7d55b36a7418d978d4a8abc7399fc Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1204128420-project Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 2e1582eb-3994-4092-a342-4c88340004c3 could not be found. Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '2e1582eb-3994-4092-a342-4c88340004c3'} Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1582eb-3994-4092-a342-4c88340004c3 could not be found. Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1582eb-3994-4092-a342-4c88340004c3 could not be found. Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:20.141242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:20.144942 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:20.144942 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:20.144942 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:20.144942 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:20.144942 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:36:20.144942 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:36:20.144942 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1582eb-3994-4092-a342-4c88340004c3 could not be found. Aug 18 11:36:20.144942 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:20.147374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3673c030-bbce-410a-aa89-97e26989e439 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] Returning 404 to user: Instance 2e1582eb-3994-4092-a342-4c88340004c3 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:36:20.148504 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3673c030-bbce-410a-aa89-97e26989e439 tempest-ServerRescueTestJSONUnderV235-1204128420 tempest-ServerRescueTestJSONUnderV235-1204128420-project] 10.222.0.73 "GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3" status: 404 len: 111 microversion: 2.1 time: 0.048778 Aug 18 11:36:20.149514 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1278/2489] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:20 2022] GET /compute/v2.1/servers/2e1582eb-3994-4092-a342-4c88340004c3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:36:20.208132 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1313da14-42e9-49b5-ae3c-1c6f5aee3b1f tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "DELETE /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e" status: 204 len: 0 microversion: 2.1 time: 0.755089 Aug 18 11:36:20.209158 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1212/2490] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:19 2022] DELETE /compute/v2.1/images/4db8bc29-68e1-492a-b218-30a3d75c461e => generated 0 bytes in 757 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:36:20.217372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-36462743-0cdb-4357-bd7c-586b051b8602 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:20.217892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-36462743-0cdb-4357-bd7c-586b051b8602 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:20.225410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36462743-0cdb-4357-bd7c-586b051b8602 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:20.225913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36462743-0cdb-4357-bd7c-586b051b8602 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:20.226749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36462743-0cdb-4357-bd7c-586b051b8602 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:20.227706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36462743-0cdb-4357-bd7c-586b051b8602 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:20.228529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36462743-0cdb-4357-bd7c-586b051b8602 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:20.229316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36462743-0cdb-4357-bd7c-586b051b8602 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:20.262100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-36462743-0cdb-4357-bd7c-586b051b8602 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:36:20.278980 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eb756877-1afb-4d23-9558-febfd4bdf4e0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:20.279811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-eb756877-1afb-4d23-9558-febfd4bdf4e0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:20.296067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb756877-1afb-4d23-9558-febfd4bdf4e0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:20.296772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb756877-1afb-4d23-9558-febfd4bdf4e0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:20.297271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb756877-1afb-4d23-9558-febfd4bdf4e0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:20.298922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb756877-1afb-4d23-9558-febfd4bdf4e0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:20.299432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb756877-1afb-4d23-9558-febfd4bdf4e0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:20.301896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb756877-1afb-4d23-9558-febfd4bdf4e0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:20.384177 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-36462743-0cdb-4357-bd7c-586b051b8602 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "DELETE /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 204 len: 0 microversion: 2.1 time: 0.170275 Aug 18 11:36:20.388063 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1279/2491] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:36:20 2022] DELETE /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:36:20.397551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a244405-3f7b-4c50-b355-4952d99ceacd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:20.398589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a244405-3f7b-4c50-b355-4952d99ceacd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:20.406365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a244405-3f7b-4c50-b355-4952d99ceacd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:20.407702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a244405-3f7b-4c50-b355-4952d99ceacd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:20.408388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a244405-3f7b-4c50-b355-4952d99ceacd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:20.409283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a244405-3f7b-4c50-b355-4952d99ceacd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:20.410011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a244405-3f7b-4c50-b355-4952d99ceacd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:20.410702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a244405-3f7b-4c50-b355-4952d99ceacd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:20.613627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eb756877-1afb-4d23-9558-febfd4bdf4e0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:20.636196 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eb756877-1afb-4d23-9558-febfd4bdf4e0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1313 microversion: 2.1 time: 0.361178 Aug 18 11:36:20.636906 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1213/2492] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:20 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:20.654814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eddf42f5-4542-4eb6-b409-192b889f82a1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:20.655541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-eddf42f5-4542-4eb6-b409-192b889f82a1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:20.666360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eddf42f5-4542-4eb6-b409-192b889f82a1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:20.669977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eddf42f5-4542-4eb6-b409-192b889f82a1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:20.670777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eddf42f5-4542-4eb6-b409-192b889f82a1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:20.673602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a244405-3f7b-4c50-b355-4952d99ceacd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:20.674967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eddf42f5-4542-4eb6-b409-192b889f82a1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:20.678085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eddf42f5-4542-4eb6-b409-192b889f82a1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:20.678837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eddf42f5-4542-4eb6-b409-192b889f82a1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:20.681222 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a244405-3f7b-4c50-b355-4952d99ceacd tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1473 microversion: 2.1 time: 0.289753 Aug 18 11:36:20.682024 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1280/2493] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:20 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1473 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:20.900796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d8df990c-5fe0-4460-9b94-401369d6799d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:20.901542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d8df990c-5fe0-4460-9b94-401369d6799d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:20.908216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eddf42f5-4542-4eb6-b409-192b889f82a1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:20.908964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8df990c-5fe0-4460-9b94-401369d6799d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:20.909653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8df990c-5fe0-4460-9b94-401369d6799d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:20.910290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8df990c-5fe0-4460-9b94-401369d6799d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:20.911052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8df990c-5fe0-4460-9b94-401369d6799d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:20.911677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8df990c-5fe0-4460-9b94-401369d6799d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:20.912267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8df990c-5fe0-4460-9b94-401369d6799d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:20.917511 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eddf42f5-4542-4eb6-b409-192b889f82a1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1472 microversion: 2.1 time: 0.276753 Aug 18 11:36:20.932859 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1214/2494] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:20 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1472 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:21.012565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-94592bde-42b5-4353-b3a6-2b1d8d19f987 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:21.013184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-94592bde-42b5-4353-b3a6-2b1d8d19f987 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:21.020438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94592bde-42b5-4353-b3a6-2b1d8d19f987 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:21.021215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94592bde-42b5-4353-b3a6-2b1d8d19f987 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:21.021820 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94592bde-42b5-4353-b3a6-2b1d8d19f987 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:21.022857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94592bde-42b5-4353-b3a6-2b1d8d19f987 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:21.023480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94592bde-42b5-4353-b3a6-2b1d8d19f987 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:21.025130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94592bde-42b5-4353-b3a6-2b1d8d19f987 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:21.171293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d8df990c-5fe0-4460-9b94-401369d6799d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:21.185354 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d8df990c-5fe0-4460-9b94-401369d6799d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1355 microversion: 2.1 time: 0.288537 Aug 18 11:36:21.187183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-94592bde-42b5-4353-b3a6-2b1d8d19f987 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:21.195786 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-94592bde-42b5-4353-b3a6-2b1d8d19f987 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 200 len: 1575 microversion: 2.1 time: 0.187127 Aug 18 11:36:21.199629 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1281/2495] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:20 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1355 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:21.205554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-40333476-aef4-49b8-b49f-f41cff93e99d req-d54ec8b8-c326-41e8-bef1-0493a5e5efbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43cef527-b63e-455e-bb59-0af5ce753dd2", "tag": "234ff5c5-55d2-4c13-bb2c-a900c736a26b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:21.211253 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1215/2496] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:21 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:21.218027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2b0d071e-cd91-41b5-9909-c0147ab7f197 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:21.218600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2b0d071e-cd91-41b5-9909-c0147ab7f197 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:21.220652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-40333476-aef4-49b8-b49f-f41cff93e99d req-d54ec8b8-c326-41e8-bef1-0493a5e5efbf service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:21.221328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-40333476-aef4-49b8-b49f-f41cff93e99d req-d54ec8b8-c326-41e8-bef1-0493a5e5efbf service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:21.222275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-40333476-aef4-49b8-b49f-f41cff93e99d req-d54ec8b8-c326-41e8-bef1-0493a5e5efbf service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:21.225760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b0d071e-cd91-41b5-9909-c0147ab7f197 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:21.226255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b0d071e-cd91-41b5-9909-c0147ab7f197 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:21.226723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b0d071e-cd91-41b5-9909-c0147ab7f197 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:21.227622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b0d071e-cd91-41b5-9909-c0147ab7f197 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:21.228081 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b0d071e-cd91-41b5-9909-c0147ab7f197 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:21.228510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b0d071e-cd91-41b5-9909-c0147ab7f197 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:21.238131 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-40333476-aef4-49b8-b49f-f41cff93e99d req-d54ec8b8-c326-41e8-bef1-0493a5e5efbf service nova] Creating event network-changed:234ff5c5-55d2-4c13-bb2c-a900c736a26b for instance 43cef527-b63e-455e-bb59-0af5ce753dd2 on n-h2-853611-3 Aug 18 11:36:21.245221 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-40333476-aef4-49b8-b49f-f41cff93e99d req-d54ec8b8-c326-41e8-bef1-0493a5e5efbf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043690 Aug 18 11:36:21.246508 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1282/2497] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:21.473548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-fab14bd3-7774-4a8e-b1d6-c916e24a86c2 req-2ce8b25a-1cfb-456e-a12c-b11275812bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11f7372-0d2e-4159-8c18-a86d32428841", "name": "network-vif-plugged", "status": "completed", "tag": "cb2d2511-5c49-464c-be36-c45456072cfb"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:21.484643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fab14bd3-7774-4a8e-b1d6-c916e24a86c2 req-2ce8b25a-1cfb-456e-a12c-b11275812bdc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:21.485509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fab14bd3-7774-4a8e-b1d6-c916e24a86c2 req-2ce8b25a-1cfb-456e-a12c-b11275812bdc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:21.486169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fab14bd3-7774-4a8e-b1d6-c916e24a86c2 req-2ce8b25a-1cfb-456e-a12c-b11275812bdc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:21.500864 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-fab14bd3-7774-4a8e-b1d6-c916e24a86c2 req-2ce8b25a-1cfb-456e-a12c-b11275812bdc service nova] Creating event network-vif-plugged:cb2d2511-5c49-464c-be36-c45456072cfb for instance f11f7372-0d2e-4159-8c18-a86d32428841 on n-h1-853611-3 Aug 18 11:36:21.506201 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-fab14bd3-7774-4a8e-b1d6-c916e24a86c2 req-2ce8b25a-1cfb-456e-a12c-b11275812bdc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037961 Aug 18 11:36:21.511072 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1283/2498] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:36:21.529390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2b0d071e-cd91-41b5-9909-c0147ab7f197 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:21.537182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:21.540637 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2b0d071e-cd91-41b5-9909-c0147ab7f197 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1314 microversion: 2.1 time: 0.328186 Aug 18 11:36:21.555083 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1216/2499] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:21 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:21.659368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-884c23ce-f37f-465b-b46d-11937db27063 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:21.660536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-884c23ce-f37f-465b-b46d-11937db27063 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:21.671705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-884c23ce-f37f-465b-b46d-11937db27063 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:21.673019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-884c23ce-f37f-465b-b46d-11937db27063 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:21.673713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-884c23ce-f37f-465b-b46d-11937db27063 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:21.676266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-884c23ce-f37f-465b-b46d-11937db27063 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:21.678276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-884c23ce-f37f-465b-b46d-11937db27063 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:21.690995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-884c23ce-f37f-465b-b46d-11937db27063 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:21.696418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:21.721723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f8d165b5-ccd1-49be-b56b-84eba3132063 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:21.723214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f8d165b5-ccd1-49be-b56b-84eba3132063 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:21.737040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8d165b5-ccd1-49be-b56b-84eba3132063 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:21.738834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8d165b5-ccd1-49be-b56b-84eba3132063 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:21.740278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8d165b5-ccd1-49be-b56b-84eba3132063 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:21.741150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8d165b5-ccd1-49be-b56b-84eba3132063 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:21.743615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8d165b5-ccd1-49be-b56b-84eba3132063 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:21.744164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8d165b5-ccd1-49be-b56b-84eba3132063 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:21.981130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-884c23ce-f37f-465b-b46d-11937db27063 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:21.993897 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-884c23ce-f37f-465b-b46d-11937db27063 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1313 microversion: 2.1 time: 0.340152 Aug 18 11:36:21.999430 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1284/2500] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:21 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:22.013032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06a16f6e-3311-4566-a10a-7b64c600d0a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:22.013653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-06a16f6e-3311-4566-a10a-7b64c600d0a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:22.022934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06a16f6e-3311-4566-a10a-7b64c600d0a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:22.024003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06a16f6e-3311-4566-a10a-7b64c600d0a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:22.024612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06a16f6e-3311-4566-a10a-7b64c600d0a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:22.025538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06a16f6e-3311-4566-a10a-7b64c600d0a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:22.026187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06a16f6e-3311-4566-a10a-7b64c600d0a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:22.026820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06a16f6e-3311-4566-a10a-7b64c600d0a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:22.300142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-06a16f6e-3311-4566-a10a-7b64c600d0a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:22.312198 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-06a16f6e-3311-4566-a10a-7b64c600d0a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1472 microversion: 2.1 time: 0.310098 Aug 18 11:36:22.315809 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1285/2501] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:21 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1472 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:22.322878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2481be8c-6496-485b-a1a0-834a58cb6795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:22.323707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2481be8c-6496-485b-a1a0-834a58cb6795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:22.335659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f8d165b5-ccd1-49be-b56b-84eba3132063 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:22.343471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2481be8c-6496-485b-a1a0-834a58cb6795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:22.344081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2481be8c-6496-485b-a1a0-834a58cb6795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:22.344531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2481be8c-6496-485b-a1a0-834a58cb6795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:22.345277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2481be8c-6496-485b-a1a0-834a58cb6795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:22.345749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2481be8c-6496-485b-a1a0-834a58cb6795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:22.346157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2481be8c-6496-485b-a1a0-834a58cb6795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:22.348584 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f8d165b5-ccd1-49be-b56b-84eba3132063 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1473 microversion: 2.1 time: 0.633468 Aug 18 11:36:22.349826 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1217/2502] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:21 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1473 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:22.563658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7d76eed9-cb24-4eef-899a-119ae93b996c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:22.564623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7d76eed9-cb24-4eef-899a-119ae93b996c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:22.576416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d76eed9-cb24-4eef-899a-119ae93b996c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:22.576921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d76eed9-cb24-4eef-899a-119ae93b996c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:22.577558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d76eed9-cb24-4eef-899a-119ae93b996c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:22.578374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d76eed9-cb24-4eef-899a-119ae93b996c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:22.579786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d76eed9-cb24-4eef-899a-119ae93b996c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:22.580425 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d76eed9-cb24-4eef-899a-119ae93b996c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:22.740720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7d76eed9-cb24-4eef-899a-119ae93b996c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:22.761507 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7d76eed9-cb24-4eef-899a-119ae93b996c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1314 microversion: 2.1 time: 0.201070 Aug 18 11:36:22.776849 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1218/2503] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:22 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:22.928584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2481be8c-6496-485b-a1a0-834a58cb6795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:22.939841 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2481be8c-6496-485b-a1a0-834a58cb6795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1355 microversion: 2.1 time: 0.622549 Aug 18 11:36:22.940826 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1286/2504] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:22 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1355 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:23.018156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c61f7530-b220-4e6c-a7ea-bf49e14a108a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:23.019075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c61f7530-b220-4e6c-a7ea-bf49e14a108a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:23.027181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c61f7530-b220-4e6c-a7ea-bf49e14a108a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:23.028054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c61f7530-b220-4e6c-a7ea-bf49e14a108a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:23.028743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c61f7530-b220-4e6c-a7ea-bf49e14a108a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:23.029707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c61f7530-b220-4e6c-a7ea-bf49e14a108a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:23.030402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c61f7530-b220-4e6c-a7ea-bf49e14a108a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:23.031104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c61f7530-b220-4e6c-a7ea-bf49e14a108a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:23.204610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c61f7530-b220-4e6c-a7ea-bf49e14a108a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:23.212986 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c61f7530-b220-4e6c-a7ea-bf49e14a108a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1313 microversion: 2.1 time: 0.200003 Aug 18 11:36:23.213573 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1219/2505] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:23 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:23.336876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cef302c6-e770-4601-9ef1-2a338734d878 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:23.337728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cef302c6-e770-4601-9ef1-2a338734d878 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:23.352539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cef302c6-e770-4601-9ef1-2a338734d878 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:23.353048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cef302c6-e770-4601-9ef1-2a338734d878 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:23.353528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cef302c6-e770-4601-9ef1-2a338734d878 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:23.354257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cef302c6-e770-4601-9ef1-2a338734d878 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:23.354780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cef302c6-e770-4601-9ef1-2a338734d878 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:23.355219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cef302c6-e770-4601-9ef1-2a338734d878 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:23.373346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b4acb1fb-d8cf-4082-9cab-8bf35e502498 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:23.383036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b4acb1fb-d8cf-4082-9cab-8bf35e502498 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:23.396398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b4acb1fb-d8cf-4082-9cab-8bf35e502498 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:23.396921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b4acb1fb-d8cf-4082-9cab-8bf35e502498 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:23.397370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b4acb1fb-d8cf-4082-9cab-8bf35e502498 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:23.398099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b4acb1fb-d8cf-4082-9cab-8bf35e502498 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:23.398600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b4acb1fb-d8cf-4082-9cab-8bf35e502498 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:23.399567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b4acb1fb-d8cf-4082-9cab-8bf35e502498 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:23.706729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b4acb1fb-d8cf-4082-9cab-8bf35e502498 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:23.716456 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b4acb1fb-d8cf-4082-9cab-8bf35e502498 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1473 microversion: 2.1 time: 0.347182 Aug 18 11:36:23.721312 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1220/2506] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:23 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1473 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:23.749726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cef302c6-e770-4601-9ef1-2a338734d878 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:23.761175 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cef302c6-e770-4601-9ef1-2a338734d878 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1472 microversion: 2.1 time: 0.428434 Aug 18 11:36:23.761795 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1287/2507] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:23 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1472 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:23.786698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-425c928a-2006-4d63-a682-c2b289be011f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:23.787322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-425c928a-2006-4d63-a682-c2b289be011f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:23.808501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-425c928a-2006-4d63-a682-c2b289be011f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:23.815425 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-425c928a-2006-4d63-a682-c2b289be011f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:23.816566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-425c928a-2006-4d63-a682-c2b289be011f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:23.820116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-425c928a-2006-4d63-a682-c2b289be011f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:23.821683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-425c928a-2006-4d63-a682-c2b289be011f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:23.822590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-425c928a-2006-4d63-a682-c2b289be011f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:23.961669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2373171f-6834-4332-9462-0bdc7580db12 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:23.962679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2373171f-6834-4332-9462-0bdc7580db12 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:23.969875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2373171f-6834-4332-9462-0bdc7580db12 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:23.975777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2373171f-6834-4332-9462-0bdc7580db12 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:23.976630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2373171f-6834-4332-9462-0bdc7580db12 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:23.977834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2373171f-6834-4332-9462-0bdc7580db12 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:23.978539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2373171f-6834-4332-9462-0bdc7580db12 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:23.979185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2373171f-6834-4332-9462-0bdc7580db12 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.139865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-425c928a-2006-4d63-a682-c2b289be011f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:24.157873 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-425c928a-2006-4d63-a682-c2b289be011f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1502 microversion: 2.1 time: 0.374962 Aug 18 11:36:24.158838 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1221/2508] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:23 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1502 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:24.188881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f3676a75-9094-4581-8964-03723d9c1e2b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:24.196701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3676a75-9094-4581-8964-03723d9c1e2b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.197198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3676a75-9094-4581-8964-03723d9c1e2b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.197638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f3676a75-9094-4581-8964-03723d9c1e2b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.222241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f3676a75-9094-4581-8964-03723d9c1e2b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Going to try to stop instance {{(pid=122209) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 11:36:24.273263 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f3676a75-9094-4581-8964-03723d9c1e2b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "POST /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492/action" status: 202 len: 0 microversion: 2.1 time: 0.091521 Aug 18 11:36:24.274308 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1222/2509] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:36:24 2022] POST /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:36:24.282608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4bbb4502-d1d1-46c5-8faa-5252ce5156c1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:24.284123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4bbb4502-d1d1-46c5-8faa-5252ce5156c1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:24.293880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bbb4502-d1d1-46c5-8faa-5252ce5156c1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.294932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bbb4502-d1d1-46c5-8faa-5252ce5156c1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.296051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bbb4502-d1d1-46c5-8faa-5252ce5156c1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.297270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bbb4502-d1d1-46c5-8faa-5252ce5156c1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.298590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bbb4502-d1d1-46c5-8faa-5252ce5156c1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.299379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bbb4502-d1d1-46c5-8faa-5252ce5156c1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.322744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2373171f-6834-4332-9462-0bdc7580db12 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:24.349328 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2373171f-6834-4332-9462-0bdc7580db12 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1805 microversion: 2.1 time: 0.391387 Aug 18 11:36:24.350275 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1288/2510] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:23 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1805 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:24.366711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-81d6341b-fd09-4d7d-a870-704791f45e0c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:24.367324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-81d6341b-fd09-4d7d-a870-704791f45e0c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:24.374241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81d6341b-fd09-4d7d-a870-704791f45e0c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.375048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81d6341b-fd09-4d7d-a870-704791f45e0c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.375706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81d6341b-fd09-4d7d-a870-704791f45e0c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.376766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81d6341b-fd09-4d7d-a870-704791f45e0c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.377658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81d6341b-fd09-4d7d-a870-704791f45e0c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.378387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81d6341b-fd09-4d7d-a870-704791f45e0c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.600507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4bbb4502-d1d1-46c5-8faa-5252ce5156c1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:24.608526 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4bbb4502-d1d1-46c5-8faa-5252ce5156c1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1313 microversion: 2.1 time: 0.332282 Aug 18 11:36:24.609318 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1223/2511] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:24 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:24.614494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dfb85c47-bb08-498a-9833-794860ac4dc4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:24.614990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dfb85c47-bb08-498a-9833-794860ac4dc4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:24.624029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dfb85c47-bb08-498a-9833-794860ac4dc4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.624526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dfb85c47-bb08-498a-9833-794860ac4dc4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.625471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dfb85c47-bb08-498a-9833-794860ac4dc4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.632566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dfb85c47-bb08-498a-9833-794860ac4dc4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.633060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dfb85c47-bb08-498a-9833-794860ac4dc4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.633728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dfb85c47-bb08-498a-9833-794860ac4dc4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.669638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-81d6341b-fd09-4d7d-a870-704791f45e0c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:24.677000 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dfb85c47-bb08-498a-9833-794860ac4dc4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e/ips" status: 200 len: 218 microversion: 2.1 time: 0.065493 Aug 18 11:36:24.685190 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-81d6341b-fd09-4d7d-a870-704791f45e0c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.333426 Aug 18 11:36:24.688869 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1289/2512] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:24 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:24.693215 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1224/2513] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:36:24 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e/ips => generated 218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:24.696664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4ae36a83-acf0-4535-a738-7013df91dae2 req-468a186a-8ef8-4383-bc30-fff73bf5e1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b34fc6-468f-4179-b73f-6776c809d055", "name": "network-vif-deleted", "tag": "7aa41449-e2a8-4d62-a5db-c9bcce1f4420"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:24.704962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2a235935-d649-4633-88ed-6e5ec67e34ec tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:24.705479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2a235935-d649-4633-88ed-6e5ec67e34ec tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:24.711958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a235935-d649-4633-88ed-6e5ec67e34ec tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.712744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a235935-d649-4633-88ed-6e5ec67e34ec tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.713583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a235935-d649-4633-88ed-6e5ec67e34ec tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.714493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a235935-d649-4633-88ed-6e5ec67e34ec tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.715811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a235935-d649-4633-88ed-6e5ec67e34ec tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.716398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a235935-d649-4633-88ed-6e5ec67e34ec tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.755507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4ae36a83-acf0-4535-a738-7013df91dae2 req-468a186a-8ef8-4383-bc30-fff73bf5e1e0 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.756347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4ae36a83-acf0-4535-a738-7013df91dae2 req-468a186a-8ef8-4383-bc30-fff73bf5e1e0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.756951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4ae36a83-acf0-4535-a738-7013df91dae2 req-468a186a-8ef8-4383-bc30-fff73bf5e1e0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.772258 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4ae36a83-acf0-4535-a738-7013df91dae2 req-468a186a-8ef8-4383-bc30-fff73bf5e1e0 service nova] Creating event network-vif-deleted:7aa41449-e2a8-4d62-a5db-c9bcce1f4420 for instance 61b34fc6-468f-4179-b73f-6776c809d055 on n-h1-853611-3 Aug 18 11:36:24.780483 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4ae36a83-acf0-4535-a738-7013df91dae2 req-468a186a-8ef8-4383-bc30-fff73bf5e1e0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086269 Aug 18 11:36:24.781150 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1290/2514] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:24.785114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2a235935-d649-4633-88ed-6e5ec67e34ec tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:36:24.790030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-674bf35a-902f-4cfa-a323-a87451774e8e tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:24.792533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-674bf35a-902f-4cfa-a323-a87451774e8e tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:24.803078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-674bf35a-902f-4cfa-a323-a87451774e8e tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.803604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-674bf35a-902f-4cfa-a323-a87451774e8e tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.804060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-674bf35a-902f-4cfa-a323-a87451774e8e tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.804930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-674bf35a-902f-4cfa-a323-a87451774e8e tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.805655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-674bf35a-902f-4cfa-a323-a87451774e8e tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.806334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-674bf35a-902f-4cfa-a323-a87451774e8e tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.936905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-674bf35a-902f-4cfa-a323-a87451774e8e tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:24.945193 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2a235935-d649-4633-88ed-6e5ec67e34ec tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 204 len: 0 microversion: 2.1 time: 0.249683 Aug 18 11:36:24.945947 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1225/2515] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:36:24 2022] DELETE /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:36:24.950741 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-674bf35a-902f-4cfa-a323-a87451774e8e tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1302 microversion: 2.1 time: 0.166297 Aug 18 11:36:24.951767 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1291/2516] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:24 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1302 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:24.958593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ebe508e7-3de4-4c5f-b278-ed6557ff27e4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:24.959772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ebe508e7-3de4-4c5f-b278-ed6557ff27e4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:24.960327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0e3b86e0-f4db-4b5c-b416-fe174307fcf8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:24.962015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0e3b86e0-f4db-4b5c-b416-fe174307fcf8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:24.970577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebe508e7-3de4-4c5f-b278-ed6557ff27e4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.971813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebe508e7-3de4-4c5f-b278-ed6557ff27e4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.972862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebe508e7-3de4-4c5f-b278-ed6557ff27e4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.973745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebe508e7-3de4-4c5f-b278-ed6557ff27e4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.974699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebe508e7-3de4-4c5f-b278-ed6557ff27e4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.975486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebe508e7-3de4-4c5f-b278-ed6557ff27e4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.985577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e3b86e0-f4db-4b5c-b416-fe174307fcf8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.986336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e3b86e0-f4db-4b5c-b416-fe174307fcf8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.986820 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e3b86e0-f4db-4b5c-b416-fe174307fcf8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:24.987606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e3b86e0-f4db-4b5c-b416-fe174307fcf8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:24.988069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e3b86e0-f4db-4b5c-b416-fe174307fcf8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:24.988499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e3b86e0-f4db-4b5c-b416-fe174307fcf8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:25.166776 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0e3b86e0-f4db-4b5c-b416-fe174307fcf8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:25.178953 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0e3b86e0-f4db-4b5c-b416-fe174307fcf8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1472 microversion: 2.1 time: 0.231031 Aug 18 11:36:25.181992 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1226/2517] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:24 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1472 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:25.197990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ebe508e7-3de4-4c5f-b278-ed6557ff27e4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:25.207049 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ebe508e7-3de4-4c5f-b278-ed6557ff27e4 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1811 microversion: 2.1 time: 0.253612 Aug 18 11:36:25.207670 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1292/2518] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:24 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1811 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:25.632689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ce398519-a043-405a-ab43-62d01319e102 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:25.633391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ce398519-a043-405a-ab43-62d01319e102 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:25.640156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce398519-a043-405a-ab43-62d01319e102 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:25.641650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce398519-a043-405a-ab43-62d01319e102 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:25.642099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce398519-a043-405a-ab43-62d01319e102 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:25.642857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce398519-a043-405a-ab43-62d01319e102 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:25.643326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce398519-a043-405a-ab43-62d01319e102 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:25.643760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ce398519-a043-405a-ab43-62d01319e102 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:25.713486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c792b4f0-11c2-40ca-b5b9-c2e35457f5d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:25.714848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c792b4f0-11c2-40ca-b5b9-c2e35457f5d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:25.722062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c792b4f0-11c2-40ca-b5b9-c2e35457f5d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:25.722659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c792b4f0-11c2-40ca-b5b9-c2e35457f5d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:25.723098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c792b4f0-11c2-40ca-b5b9-c2e35457f5d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:25.724042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c792b4f0-11c2-40ca-b5b9-c2e35457f5d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:25.724502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c792b4f0-11c2-40ca-b5b9-c2e35457f5d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:25.725086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c792b4f0-11c2-40ca-b5b9-c2e35457f5d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:25.789839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ce398519-a043-405a-ab43-62d01319e102 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:25.800201 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ce398519-a043-405a-ab43-62d01319e102 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1313 microversion: 2.1 time: 0.172174 Aug 18 11:36:25.800853 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1227/2519] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:25 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:25.900771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c792b4f0-11c2-40ca-b5b9-c2e35457f5d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:25.913569 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c792b4f0-11c2-40ca-b5b9-c2e35457f5d8 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.204266 Aug 18 11:36:25.927411 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1293/2520] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:25 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:25.980585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-00a72350-6fb2-4ef4-8949-0cdc9307a718 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:25.981572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-00a72350-6fb2-4ef4-8949-0cdc9307a718 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:25.992624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00a72350-6fb2-4ef4-8949-0cdc9307a718 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:25.993475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00a72350-6fb2-4ef4-8949-0cdc9307a718 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:25.994068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00a72350-6fb2-4ef4-8949-0cdc9307a718 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:25.994959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00a72350-6fb2-4ef4-8949-0cdc9307a718 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:25.995575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00a72350-6fb2-4ef4-8949-0cdc9307a718 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:25.996008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00a72350-6fb2-4ef4-8949-0cdc9307a718 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:26.030648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00a72350-6fb2-4ef4-8949-0cdc9307a718 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:26.031660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00a72350-6fb2-4ef4-8949-0cdc9307a718 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:26.032100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00a72350-6fb2-4ef4-8949-0cdc9307a718 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:26.032657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-00a72350-6fb2-4ef4-8949-0cdc9307a718 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lazy-loading 'fault' on Instance uuid 61b34fc6-468f-4179-b73f-6776c809d055 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:36:26.087677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-00a72350-6fb2-4ef4-8949-0cdc9307a718 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:26.098795 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-00a72350-6fb2-4ef4-8949-0cdc9307a718 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 200 len: 1307 microversion: 2.1 time: 0.127923 Aug 18 11:36:26.099661 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1228/2521] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:25 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 1307 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:26.203001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4b9a1b7e-e0c9-4ea0-832c-c8d588665eea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:26.204501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4b9a1b7e-e0c9-4ea0-832c-c8d588665eea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:26.210911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b9a1b7e-e0c9-4ea0-832c-c8d588665eea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:26.211391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b9a1b7e-e0c9-4ea0-832c-c8d588665eea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:26.211829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b9a1b7e-e0c9-4ea0-832c-c8d588665eea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:26.212651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b9a1b7e-e0c9-4ea0-832c-c8d588665eea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:26.213108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b9a1b7e-e0c9-4ea0-832c-c8d588665eea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:26.213530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b9a1b7e-e0c9-4ea0-832c-c8d588665eea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:26.229700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-84f2a28d-4922-4337-bf92-6958f359289b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:26.230335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-84f2a28d-4922-4337-bf92-6958f359289b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:26.237010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84f2a28d-4922-4337-bf92-6958f359289b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:26.237501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84f2a28d-4922-4337-bf92-6958f359289b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:26.237947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84f2a28d-4922-4337-bf92-6958f359289b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:26.238685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84f2a28d-4922-4337-bf92-6958f359289b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:26.239147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84f2a28d-4922-4337-bf92-6958f359289b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:26.239585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84f2a28d-4922-4337-bf92-6958f359289b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:26.392020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-84f2a28d-4922-4337-bf92-6958f359289b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:26.400357 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-84f2a28d-4922-4337-bf92-6958f359289b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1811 microversion: 2.1 time: 0.175126 Aug 18 11:36:26.404537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4b9a1b7e-e0c9-4ea0-832c-c8d588665eea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:26.410916 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1229/2522] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:26 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1811 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:26.413660 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4b9a1b7e-e0c9-4ea0-832c-c8d588665eea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1477 microversion: 2.1 time: 0.214554 Aug 18 11:36:26.418476 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1294/2523] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:26 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:26.822367 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e05c26a6-b014-44b0-9d44-b4d0b0d31c75 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:26.823162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e05c26a6-b014-44b0-9d44-b4d0b0d31c75 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:26.830776 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e05c26a6-b014-44b0-9d44-b4d0b0d31c75 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:26.831259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e05c26a6-b014-44b0-9d44-b4d0b0d31c75 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:26.831696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e05c26a6-b014-44b0-9d44-b4d0b0d31c75 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:26.832400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e05c26a6-b014-44b0-9d44-b4d0b0d31c75 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:26.833148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e05c26a6-b014-44b0-9d44-b4d0b0d31c75 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:26.833726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e05c26a6-b014-44b0-9d44-b4d0b0d31c75 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:26.935209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-32f9d2a6-ea13-4c32-936a-b189f2d7fd27 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:26.935938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-32f9d2a6-ea13-4c32-936a-b189f2d7fd27 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:26.943147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9d2a6-ea13-4c32-936a-b189f2d7fd27 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:26.943725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9d2a6-ea13-4c32-936a-b189f2d7fd27 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:26.944259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9d2a6-ea13-4c32-936a-b189f2d7fd27 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:26.945046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9d2a6-ea13-4c32-936a-b189f2d7fd27 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:26.945569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9d2a6-ea13-4c32-936a-b189f2d7fd27 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:26.946066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9d2a6-ea13-4c32-936a-b189f2d7fd27 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:27.111938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-32f9d2a6-ea13-4c32-936a-b189f2d7fd27 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:27.121503 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-32f9d2a6-ea13-4c32-936a-b189f2d7fd27 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.189700 Aug 18 11:36:27.131714 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1295/2524] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:26 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:27.132054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e05c26a6-b014-44b0-9d44-b4d0b0d31c75 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:27.132164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb10e768-c4a4-4f54-9d6e-8e5ab7a49148 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:27.132164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bb10e768-c4a4-4f54-9d6e-8e5ab7a49148 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 61b34fc6-468f-4179-b73f-6776c809d055] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:27.134869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:27.138221 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e05c26a6-b014-44b0-9d44-b4d0b0d31c75 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1462 microversion: 2.1 time: 0.319994 Aug 18 11:36:27.138836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb10e768-c4a4-4f54-9d6e-8e5ab7a49148 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:27.139414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb10e768-c4a4-4f54-9d6e-8e5ab7a49148 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:27.140956 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1230/2525] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:26 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1462 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:27.142510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb10e768-c4a4-4f54-9d6e-8e5ab7a49148 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:27.143595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb10e768-c4a4-4f54-9d6e-8e5ab7a49148 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:27.144145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb10e768-c4a4-4f54-9d6e-8e5ab7a49148 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:27.144795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb10e768-c4a4-4f54-9d6e-8e5ab7a49148 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:27.165837 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-bb10e768-c4a4-4f54-9d6e-8e5ab7a49148 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] HTTP exception thrown: Instance 61b34fc6-468f-4179-b73f-6776c809d055 could not be found. Aug 18 11:36:27.168795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-51354ef8-4dd1-4c22-b259-184749c65085 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb10e768-c4a4-4f54-9d6e-8e5ab7a49148 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Request method failure captured: Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 HTTP/1.1 Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iOSBjNimecq0A_zyKJoYEzxPieZ9ek0QVTpH1yQOelYW-LnuPXuIU8J75XW5YeuB3rnCiQFyhkqBmun5mFv87BWdlSX9BSGflIZiOWkrBoxpy9Ek-2BCJ8ipZaoWfDug4UhH0WeEuXslT1m-YZtspQP071ejKBhjcntE217XtkHaYg Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 7fe39b6aea8849d788b0d0a425c0e591 Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ListImageFiltersTestJSON-98893192 Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7fe39b6aea8849d788b0d0a425c0e591"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7fe39b6aea8849d788b0d0a425c0e591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7fe39b6aea8849d788b0d0a425c0e591"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7fe39b6aea8849d788b0d0a425c0e591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ListImageFiltersTestJSON-98893192 Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 7fe39b6aea8849d788b0d0a425c0e591 Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-98893192 Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ListImageFiltersTestJSON-98893192-project Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 321f5430950547d3b63d50d87a6a95c6 Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ListImageFiltersTestJSON-98893192-project Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 61b34fc6-468f-4179-b73f-6776c809d055 could not be found. Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '61b34fc6-468f-4179-b73f-6776c809d055'} Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61b34fc6-468f-4179-b73f-6776c809d055 could not be found. Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61b34fc6-468f-4179-b73f-6776c809d055 could not be found. Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:27.169650 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:27.173896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:27.173896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:27.173896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:27.173896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:36:27.173896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:36:27.173896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61b34fc6-468f-4179-b73f-6776c809d055 could not be found. Aug 18 11:36:27.173896 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:27.173896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb10e768-c4a4-4f54-9d6e-8e5ab7a49148 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Returning 404 to user: Instance 61b34fc6-468f-4179-b73f-6776c809d055 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:36:27.173896 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bb10e768-c4a4-4f54-9d6e-8e5ab7a49148 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055" status: 404 len: 111 microversion: 2.1 time: 0.047697 Aug 18 11:36:27.173896 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1296/2526] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:27 2022] GET /compute/v2.1/servers/61b34fc6-468f-4179-b73f-6776c809d055 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:36:27.177519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-51354ef8-4dd1-4c22-b259-184749c65085 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:27.181538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4ae6b0ca-aed3-4980-b54c-f12f7f4e6663 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:27.182050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4ae6b0ca-aed3-4980-b54c-f12f7f4e6663 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 51e3865d-a413-4c57-b0dc-1b29e76be1de] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:27.191540 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51354ef8-4dd1-4c22-b259-184749c65085 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:27.191822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ae6b0ca-aed3-4980-b54c-f12f7f4e6663 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:27.192334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ae6b0ca-aed3-4980-b54c-f12f7f4e6663 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:27.192784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ae6b0ca-aed3-4980-b54c-f12f7f4e6663 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:27.192908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51354ef8-4dd1-4c22-b259-184749c65085 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:27.193579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51354ef8-4dd1-4c22-b259-184749c65085 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:27.193725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ae6b0ca-aed3-4980-b54c-f12f7f4e6663 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:27.194198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ae6b0ca-aed3-4980-b54c-f12f7f4e6663 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:27.194660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ae6b0ca-aed3-4980-b54c-f12f7f4e6663 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:27.195145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51354ef8-4dd1-4c22-b259-184749c65085 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:27.195844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51354ef8-4dd1-4c22-b259-184749c65085 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:27.196916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51354ef8-4dd1-4c22-b259-184749c65085 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:27.230475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4ae6b0ca-aed3-4980-b54c-f12f7f4e6663 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 51e3865d-a413-4c57-b0dc-1b29e76be1de] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:36:27.352950 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4ae6b0ca-aed3-4980-b54c-f12f7f4e6663 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "DELETE /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de" status: 204 len: 0 microversion: 2.1 time: 0.176226 Aug 18 11:36:27.353769 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1297/2527] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:36:27 2022] DELETE /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:36:27.362940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fe2bd533-1ec2-4e5c-b2dc-114dcca02643 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:27.364075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fe2bd533-1ec2-4e5c-b2dc-114dcca02643 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 51e3865d-a413-4c57-b0dc-1b29e76be1de] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:27.370417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe2bd533-1ec2-4e5c-b2dc-114dcca02643 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:27.371164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe2bd533-1ec2-4e5c-b2dc-114dcca02643 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:27.371866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe2bd533-1ec2-4e5c-b2dc-114dcca02643 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:27.372662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe2bd533-1ec2-4e5c-b2dc-114dcca02643 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:27.373347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe2bd533-1ec2-4e5c-b2dc-114dcca02643 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:27.374380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe2bd533-1ec2-4e5c-b2dc-114dcca02643 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:27.453938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-51354ef8-4dd1-4c22-b259-184749c65085 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:27.463024 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-51354ef8-4dd1-4c22-b259-184749c65085 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1464 microversion: 2.1 time: 0.298446 Aug 18 11:36:27.464158 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1231/2528] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:27 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1464 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:27.478513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-76360a86-129c-4fa2-b667-78a44bb8804a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:27.479592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-76360a86-129c-4fa2-b667-78a44bb8804a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:27.500334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76360a86-129c-4fa2-b667-78a44bb8804a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:27.507248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76360a86-129c-4fa2-b667-78a44bb8804a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:27.507990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76360a86-129c-4fa2-b667-78a44bb8804a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:27.508846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76360a86-129c-4fa2-b667-78a44bb8804a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:27.509323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76360a86-129c-4fa2-b667-78a44bb8804a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:27.509975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76360a86-129c-4fa2-b667-78a44bb8804a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:27.694695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fe2bd533-1ec2-4e5c-b2dc-114dcca02643 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:27.722810 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fe2bd533-1ec2-4e5c-b2dc-114dcca02643 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de" status: 200 len: 1472 microversion: 2.1 time: 0.364449 Aug 18 11:36:27.724096 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1298/2529] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:27 2022] GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de => generated 1472 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:27.729763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d200623-a5cd-4bcd-b1d8-b5ac1e190f63 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:27.730762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2d200623-a5cd-4bcd-b1d8-b5ac1e190f63 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:27.742358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d200623-a5cd-4bcd-b1d8-b5ac1e190f63 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:27.743124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d200623-a5cd-4bcd-b1d8-b5ac1e190f63 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:27.744401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d200623-a5cd-4bcd-b1d8-b5ac1e190f63 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:27.745378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d200623-a5cd-4bcd-b1d8-b5ac1e190f63 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:27.746119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d200623-a5cd-4bcd-b1d8-b5ac1e190f63 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:27.747214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d200623-a5cd-4bcd-b1d8-b5ac1e190f63 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:27.911876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-76360a86-129c-4fa2-b667-78a44bb8804a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:27.928262 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-76360a86-129c-4fa2-b667-78a44bb8804a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1811 microversion: 2.1 time: 0.462780 Aug 18 11:36:27.929090 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1232/2530] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:27 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1811 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:27.933715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-273047214", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "5aee369f-2ece-4b53-a7db-efe946936831"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:28.007070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:36:28.124935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2d200623-a5cd-4bcd-b1d8-b5ac1e190f63 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:28.135684 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d200623-a5cd-4bcd-b1d8-b5ac1e190f63 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1477 microversion: 2.1 time: 0.410101 Aug 18 11:36:28.139258 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1299/2531] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:27 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1477 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:28.145906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-bf183ebd-1620-43cd-9094-ff5e4987e291 req-759ec175-d5cf-47be-9137-a1b9f9877e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed2bb36-0499-4abd-b690-93bbafd53c4e", "name": "network-vif-deleted", "tag": "40544f64-d224-4fb3-a2f8-d97b2a87d52c"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:28.158401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bf183ebd-1620-43cd-9094-ff5e4987e291 req-759ec175-d5cf-47be-9137-a1b9f9877e47 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:28.158934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bf183ebd-1620-43cd-9094-ff5e4987e291 req-759ec175-d5cf-47be-9137-a1b9f9877e47 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:28.159378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bf183ebd-1620-43cd-9094-ff5e4987e291 req-759ec175-d5cf-47be-9137-a1b9f9877e47 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:28.180783 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-bf183ebd-1620-43cd-9094-ff5e4987e291 req-759ec175-d5cf-47be-9137-a1b9f9877e47 service nova] Creating event network-vif-deleted:40544f64-d224-4fb3-a2f8-d97b2a87d52c for instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e on n-h1-853611-3 Aug 18 11:36:28.191486 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-bf183ebd-1620-43cd-9094-ff5e4987e291 req-759ec175-d5cf-47be-9137-a1b9f9877e47 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048767 Aug 18 11:36:28.193359 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1300/2532] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:28.213937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d1e266c3-604b-4cca-a0eb-e1c2f80f5cfe tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:28.214997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d1e266c3-604b-4cca-a0eb-e1c2f80f5cfe tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:28.232486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1e266c3-604b-4cca-a0eb-e1c2f80f5cfe tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:28.234844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1e266c3-604b-4cca-a0eb-e1c2f80f5cfe tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:28.235485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1e266c3-604b-4cca-a0eb-e1c2f80f5cfe tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:28.237276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1e266c3-604b-4cca-a0eb-e1c2f80f5cfe tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:28.241585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1e266c3-604b-4cca-a0eb-e1c2f80f5cfe tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:28.242343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1e266c3-604b-4cca-a0eb-e1c2f80f5cfe tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:28.255929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:28.354771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:36:28.355406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:36:28.356115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:36:28.356766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:36:28.357395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:36:28.374100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:28.376702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:28.377451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:28.378507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:28.379704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:28.381572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:28.412548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Getting quotas for project 894e2bd813f444e9bb6075a02985e347. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:36:28.422759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Getting quotas for user 44b470d4e29048bbbeb3c107f2ee42dc and project 894e2bd813f444e9bb6075a02985e347. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:36:28.443146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:28.445409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:36:28.448845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:36:28.506031 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d382b370-f757-4d87-b89d-01c219c724c0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575494 Aug 18 11:36:28.513334 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1233/2533] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:36:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:36:28.522191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d1e266c3-604b-4cca-a0eb-e1c2f80f5cfe tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:28.544987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2c183b1-7a0c-4629-8f39-af579b112b8e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:28.545131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a2c183b1-7a0c-4629-8f39-af579b112b8e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:28.547969 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d1e266c3-604b-4cca-a0eb-e1c2f80f5cfe tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.350683 Aug 18 11:36:28.556448 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1301/2534] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:28 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:28.626404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a2c183b1-7a0c-4629-8f39-af579b112b8e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:28.635516 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a2c183b1-7a0c-4629-8f39-af579b112b8e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1213 microversion: 2.1 time: 0.120791 Aug 18 11:36:28.649256 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1234/2535] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:28 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1213 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:28.747739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bfe9083a-76c4-4a08-bba2-e7e954f4ce06 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:28.748437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bfe9083a-76c4-4a08-bba2-e7e954f4ce06 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 51e3865d-a413-4c57-b0dc-1b29e76be1de] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:28.756451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfe9083a-76c4-4a08-bba2-e7e954f4ce06 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:28.757083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfe9083a-76c4-4a08-bba2-e7e954f4ce06 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:28.757532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfe9083a-76c4-4a08-bba2-e7e954f4ce06 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:28.758235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfe9083a-76c4-4a08-bba2-e7e954f4ce06 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:28.759281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfe9083a-76c4-4a08-bba2-e7e954f4ce06 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:28.759886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfe9083a-76c4-4a08-bba2-e7e954f4ce06 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:28.957561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0e64b533-4b4d-43d7-9c56-b5a34c109b81 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:28.958584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0e64b533-4b4d-43d7-9c56-b5a34c109b81 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:28.967576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e64b533-4b4d-43d7-9c56-b5a34c109b81 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:28.968216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e64b533-4b4d-43d7-9c56-b5a34c109b81 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:28.969291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e64b533-4b4d-43d7-9c56-b5a34c109b81 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:28.970229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e64b533-4b4d-43d7-9c56-b5a34c109b81 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:28.970886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e64b533-4b4d-43d7-9c56-b5a34c109b81 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:28.971322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e64b533-4b4d-43d7-9c56-b5a34c109b81 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:28.991266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bfe9083a-76c4-4a08-bba2-e7e954f4ce06 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:29.000205 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bfe9083a-76c4-4a08-bba2-e7e954f4ce06 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de" status: 200 len: 1472 microversion: 2.1 time: 0.255813 Aug 18 11:36:29.001364 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1302/2536] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:28 2022] GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de => generated 1472 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:29.159051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0e64b533-4b4d-43d7-9c56-b5a34c109b81 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:29.167115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1c85af49-f33e-47a2-84ea-78c6313cd7a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:29.167710 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0e64b533-4b4d-43d7-9c56-b5a34c109b81 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1790 microversion: 2.1 time: 0.215246 Aug 18 11:36:29.167823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1c85af49-f33e-47a2-84ea-78c6313cd7a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:29.173957 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1235/2537] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:28 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1790 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:29.174349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c85af49-f33e-47a2-84ea-78c6313cd7a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:29.174904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c85af49-f33e-47a2-84ea-78c6313cd7a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:29.175378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c85af49-f33e-47a2-84ea-78c6313cd7a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:29.176077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c85af49-f33e-47a2-84ea-78c6313cd7a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:29.177185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c85af49-f33e-47a2-84ea-78c6313cd7a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:29.177611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c85af49-f33e-47a2-84ea-78c6313cd7a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:29.573383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-de32e57d-0fcd-4b30-990a-9df49c0b98aa tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:29.573998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-de32e57d-0fcd-4b30-990a-9df49c0b98aa tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:29.581090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de32e57d-0fcd-4b30-990a-9df49c0b98aa tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:29.581329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de32e57d-0fcd-4b30-990a-9df49c0b98aa tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:29.582124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de32e57d-0fcd-4b30-990a-9df49c0b98aa tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:29.582694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de32e57d-0fcd-4b30-990a-9df49c0b98aa tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:29.583151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de32e57d-0fcd-4b30-990a-9df49c0b98aa tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:29.583766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de32e57d-0fcd-4b30-990a-9df49c0b98aa tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:29.960927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1c85af49-f33e-47a2-84ea-78c6313cd7a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:29.980307 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1c85af49-f33e-47a2-84ea-78c6313cd7a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1477 microversion: 2.1 time: 0.816159 Aug 18 11:36:29.997534 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1303/2538] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:29 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1477 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:30.029798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-048f69de-cfa9-44ae-988b-0ef7af109dde tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:30.034863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-048f69de-cfa9-44ae-988b-0ef7af109dde tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:30.050839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-048f69de-cfa9-44ae-988b-0ef7af109dde tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:30.055791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-048f69de-cfa9-44ae-988b-0ef7af109dde tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:30.056520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-048f69de-cfa9-44ae-988b-0ef7af109dde tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:30.059672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-048f69de-cfa9-44ae-988b-0ef7af109dde tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:30.060850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-048f69de-cfa9-44ae-988b-0ef7af109dde tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:30.063630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-048f69de-cfa9-44ae-988b-0ef7af109dde tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:30.197833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-048f69de-cfa9-44ae-988b-0ef7af109dde tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:30.212798 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-048f69de-cfa9-44ae-988b-0ef7af109dde tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1271 microversion: 2.1 time: 0.200547 Aug 18 11:36:30.215240 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1304/2539] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:30 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:30.228703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c558352b-43ae-40c2-826b-3b58d3ce7c23 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:30.229707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c558352b-43ae-40c2-826b-3b58d3ce7c23 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 51e3865d-a413-4c57-b0dc-1b29e76be1de] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:30.251943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c558352b-43ae-40c2-826b-3b58d3ce7c23 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:30.256245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c558352b-43ae-40c2-826b-3b58d3ce7c23 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:30.256946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c558352b-43ae-40c2-826b-3b58d3ce7c23 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:30.259493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c558352b-43ae-40c2-826b-3b58d3ce7c23 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:30.260730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c558352b-43ae-40c2-826b-3b58d3ce7c23 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:30.261186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c558352b-43ae-40c2-826b-3b58d3ce7c23 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:30.340125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-de32e57d-0fcd-4b30-990a-9df49c0b98aa tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:30.352099 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-de32e57d-0fcd-4b30-990a-9df49c0b98aa tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.782722 Aug 18 11:36:30.355145 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1236/2540] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:29 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:30.365485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4fef700d-f649-46ee-a87a-e13a62458cfb tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:30.371251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4fef700d-f649-46ee-a87a-e13a62458cfb tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:30.382545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4fef700d-f649-46ee-a87a-e13a62458cfb tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:30.383300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4fef700d-f649-46ee-a87a-e13a62458cfb tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:30.383906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4fef700d-f649-46ee-a87a-e13a62458cfb tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:30.386200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4fef700d-f649-46ee-a87a-e13a62458cfb tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:30.386988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4fef700d-f649-46ee-a87a-e13a62458cfb tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:30.393135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4fef700d-f649-46ee-a87a-e13a62458cfb tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:30.788878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4fef700d-f649-46ee-a87a-e13a62458cfb tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:30.806461 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4fef700d-f649-46ee-a87a-e13a62458cfb tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 200 len: 1611 microversion: 2.1 time: 0.449933 Aug 18 11:36:30.810126 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1237/2541] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:30 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 1611 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:30.824390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c558352b-43ae-40c2-826b-3b58d3ce7c23 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:30.828809 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-4b33857c-95a1-4063-9ead-5f2d3ac792c8 req-bfd78232-2282-42a2-9480-829fd2343296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed2bb36-0499-4abd-b690-93bbafd53c4e", "name": "network-vif-deleted", "tag": "87982b37-1820-40af-8443-4ac2fe0add38"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:30.833308 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c558352b-43ae-40c2-826b-3b58d3ce7c23 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de" status: 200 len: 1472 microversion: 2.1 time: 0.613161 Aug 18 11:36:30.838753 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1305/2542] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:30 2022] GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de => generated 1472 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:30.873387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4b33857c-95a1-4063-9ead-5f2d3ac792c8 req-bfd78232-2282-42a2-9480-829fd2343296 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:30.873792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4b33857c-95a1-4063-9ead-5f2d3ac792c8 req-bfd78232-2282-42a2-9480-829fd2343296 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:30.875377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4b33857c-95a1-4063-9ead-5f2d3ac792c8 req-bfd78232-2282-42a2-9480-829fd2343296 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:30.907419 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-4b33857c-95a1-4063-9ead-5f2d3ac792c8 req-bfd78232-2282-42a2-9480-829fd2343296 service nova] Creating event network-vif-deleted:87982b37-1820-40af-8443-4ac2fe0add38 for instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e on n-h1-853611-3 Aug 18 11:36:30.929998 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-4b33857c-95a1-4063-9ead-5f2d3ac792c8 req-bfd78232-2282-42a2-9480-829fd2343296 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107612 Aug 18 11:36:30.930737 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1238/2543] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:31.019017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cbf7738e-60ec-482e-bb7a-c0ccc974ab27 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:31.019644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cbf7738e-60ec-482e-bb7a-c0ccc974ab27 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:31.030026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf7738e-60ec-482e-bb7a-c0ccc974ab27 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:31.030464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf7738e-60ec-482e-bb7a-c0ccc974ab27 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:31.035082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf7738e-60ec-482e-bb7a-c0ccc974ab27 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:31.035883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf7738e-60ec-482e-bb7a-c0ccc974ab27 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:31.036362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf7738e-60ec-482e-bb7a-c0ccc974ab27 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:31.036798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf7738e-60ec-482e-bb7a-c0ccc974ab27 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:31.239700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9d3c1a17-38f8-484e-ae52-ba510cd1c1a1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:31.241323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9d3c1a17-38f8-484e-ae52-ba510cd1c1a1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:31.268704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d3c1a17-38f8-484e-ae52-ba510cd1c1a1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:31.269586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d3c1a17-38f8-484e-ae52-ba510cd1c1a1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:31.270247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d3c1a17-38f8-484e-ae52-ba510cd1c1a1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:31.274083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d3c1a17-38f8-484e-ae52-ba510cd1c1a1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:31.275473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d3c1a17-38f8-484e-ae52-ba510cd1c1a1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:31.275947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d3c1a17-38f8-484e-ae52-ba510cd1c1a1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:31.573362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cbf7738e-60ec-482e-bb7a-c0ccc974ab27 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:31.587945 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cbf7738e-60ec-482e-bb7a-c0ccc974ab27 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1477 microversion: 2.1 time: 0.573749 Aug 18 11:36:31.590828 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1306/2544] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:31 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1477 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:31.601917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1ed64da8-da07-450b-95e6-bcc349ff64a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:31.608166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1ed64da8-da07-450b-95e6-bcc349ff64a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:31.616812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed64da8-da07-450b-95e6-bcc349ff64a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:31.617673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed64da8-da07-450b-95e6-bcc349ff64a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:31.618979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed64da8-da07-450b-95e6-bcc349ff64a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:31.620586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed64da8-da07-450b-95e6-bcc349ff64a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:31.621205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed64da8-da07-450b-95e6-bcc349ff64a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:31.621808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed64da8-da07-450b-95e6-bcc349ff64a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:32.053216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1ed64da8-da07-450b-95e6-bcc349ff64a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:32.061186 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1ed64da8-da07-450b-95e6-bcc349ff64a5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.468469 Aug 18 11:36:32.061822 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1307/2545] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:31 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:32.066338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9bd3222d-f10c-458b-bd9a-1b27257c34f3 req-b8be3647-03a1-487a-8be2-fceb2d7bb1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e3865d-a413-4c57-b0dc-1b29e76be1de", "name": "network-vif-deleted", "tag": "1fd7f00c-a7c9-42e6-b6f0-3b9378c92c89"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:32.100967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9bd3222d-f10c-458b-bd9a-1b27257c34f3 req-b8be3647-03a1-487a-8be2-fceb2d7bb1d8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:32.101453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9bd3222d-f10c-458b-bd9a-1b27257c34f3 req-b8be3647-03a1-487a-8be2-fceb2d7bb1d8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:32.101898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9bd3222d-f10c-458b-bd9a-1b27257c34f3 req-b8be3647-03a1-487a-8be2-fceb2d7bb1d8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:32.123187 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9bd3222d-f10c-458b-bd9a-1b27257c34f3 req-b8be3647-03a1-487a-8be2-fceb2d7bb1d8 service nova] Creating event network-vif-deleted:1fd7f00c-a7c9-42e6-b6f0-3b9378c92c89 for instance 51e3865d-a413-4c57-b0dc-1b29e76be1de on n-h1-853611-3 Aug 18 11:36:32.133375 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9bd3222d-f10c-458b-bd9a-1b27257c34f3 req-b8be3647-03a1-487a-8be2-fceb2d7bb1d8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070328 Aug 18 11:36:32.134002 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1308/2546] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:32.153363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-268c239c-8ed6-40c6-86db-62f0aa97a34b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:32.154074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-268c239c-8ed6-40c6-86db-62f0aa97a34b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:32.164956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-268c239c-8ed6-40c6-86db-62f0aa97a34b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:32.165466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-268c239c-8ed6-40c6-86db-62f0aa97a34b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:32.165909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-268c239c-8ed6-40c6-86db-62f0aa97a34b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:32.166650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-268c239c-8ed6-40c6-86db-62f0aa97a34b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:32.167103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-268c239c-8ed6-40c6-86db-62f0aa97a34b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:32.167530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-268c239c-8ed6-40c6-86db-62f0aa97a34b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:32.190036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9d3c1a17-38f8-484e-ae52-ba510cd1c1a1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:32.197612 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-268c239c-8ed6-40c6-86db-62f0aa97a34b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] HTTP exception thrown: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-268c239c-8ed6-40c6-86db-62f0aa97a34b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Request method failure captured: Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e HTTP/1.1 Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iQDeZ3vTQ5lUqeMii3qX57oborv4EjBm23fJ3fdlpgg_xyg4ZfS1P3NNt9NRwiHSsYfPMkw_xl4by97cwPjPN8FjwAlYw7mtE8gvGpkhRgBFmITXnZrPwO4TSenN3nBmXrYrA1xDb2_59enfLW6RS80rIj1updNoUXDpDYSIA4_jv0 Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f31cf551fa744480b3aeb24d97f9c7ae Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestMultiNic-220166442 Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestMultiNic-220166442 Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f31cf551fa744480b3aeb24d97f9c7ae Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestMultiNic-220166442 Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestMultiNic-220166442-project Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: a31512cf212247b59aa951006f887d02 Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestMultiNic-220166442-project Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '3ed2bb36-0499-4abd-b690-93bbafd53c4e'} Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:32.206190 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:32.210302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:32.210302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:32.210302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:32.210302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:36:32.210302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:36:32.210302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:36:32.210302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:32.210302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-268c239c-8ed6-40c6-86db-62f0aa97a34b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Returning 404 to user: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:36:32.210302 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-268c239c-8ed6-40c6-86db-62f0aa97a34b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 404 len: 111 microversion: 2.1 time: 0.072655 Aug 18 11:36:32.211278 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1309/2547] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:32 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:36:32.217698 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9d3c1a17-38f8-484e-ae52-ba510cd1c1a1 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1313 microversion: 2.1 time: 0.983781 Aug 18 11:36:32.218630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fafeef44-1535-43ff-8679-b6808a242a31 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:32.219327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fafeef44-1535-43ff-8679-b6808a242a31 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 51e3865d-a413-4c57-b0dc-1b29e76be1de] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:32.227317 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1239/2548] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:31 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1313 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:32.248553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fafeef44-1535-43ff-8679-b6808a242a31 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:32.249065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fafeef44-1535-43ff-8679-b6808a242a31 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:32.250097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fafeef44-1535-43ff-8679-b6808a242a31 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:32.251153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fafeef44-1535-43ff-8679-b6808a242a31 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:32.251628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fafeef44-1535-43ff-8679-b6808a242a31 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:32.252088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fafeef44-1535-43ff-8679-b6808a242a31 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:32.329414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fafeef44-1535-43ff-8679-b6808a242a31 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:32.329838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fafeef44-1535-43ff-8679-b6808a242a31 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:32.330324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fafeef44-1535-43ff-8679-b6808a242a31 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:32.330812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-fafeef44-1535-43ff-8679-b6808a242a31 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lazy-loading 'fault' on Instance uuid 51e3865d-a413-4c57-b0dc-1b29e76be1de {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:36:32.468518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fafeef44-1535-43ff-8679-b6808a242a31 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321f5430950547d3b63d50d87a6a95c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe39b6aea8849d788b0d0a425c0e591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:32.482757 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fafeef44-1535-43ff-8679-b6808a242a31 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de" status: 200 len: 1307 microversion: 2.1 time: 0.270214 Aug 18 11:36:32.484166 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1310/2549] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:32 2022] GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de => generated 1307 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:32.617463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d640f143-8342-41a3-88fc-8bd817225d90 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:32.620420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d640f143-8342-41a3-88fc-8bd817225d90 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:32.629513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d640f143-8342-41a3-88fc-8bd817225d90 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:32.630515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d640f143-8342-41a3-88fc-8bd817225d90 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:32.631457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d640f143-8342-41a3-88fc-8bd817225d90 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:32.632417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d640f143-8342-41a3-88fc-8bd817225d90 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:32.633032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d640f143-8342-41a3-88fc-8bd817225d90 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:32.634088 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d640f143-8342-41a3-88fc-8bd817225d90 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:32.962866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d640f143-8342-41a3-88fc-8bd817225d90 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:32.973959 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d640f143-8342-41a3-88fc-8bd817225d90 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1477 microversion: 2.1 time: 0.365628 Aug 18 11:36:32.975782 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1240/2550] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:32 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1477 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:33.009983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ee75d558-aa9e-4ed7-9d00-c39f1d2e0705 req-48a9e09b-7862-45df-98b2-49007a19009f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed2bb36-0499-4abd-b690-93bbafd53c4e", "name": "network-vif-deleted", "tag": "dd5f20e2-c3e1-4d6e-92b7-f4f34dea36b8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:33.027877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ee75d558-aa9e-4ed7-9d00-c39f1d2e0705 req-48a9e09b-7862-45df-98b2-49007a19009f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:33.028665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ee75d558-aa9e-4ed7-9d00-c39f1d2e0705 req-48a9e09b-7862-45df-98b2-49007a19009f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:33.029247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ee75d558-aa9e-4ed7-9d00-c39f1d2e0705 req-48a9e09b-7862-45df-98b2-49007a19009f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:33.058210 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ee75d558-aa9e-4ed7-9d00-c39f1d2e0705 req-48a9e09b-7862-45df-98b2-49007a19009f service nova] Creating event network-vif-deleted:dd5f20e2-c3e1-4d6e-92b7-f4f34dea36b8 for instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e on n-h1-853611-3 Aug 18 11:36:33.065000 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ee75d558-aa9e-4ed7-9d00-c39f1d2e0705 req-48a9e09b-7862-45df-98b2-49007a19009f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058353 Aug 18 11:36:33.066125 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1311/2551] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:33.090529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-69e105e0-f1f4-4787-8af6-3f631559de8a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:33.091046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-69e105e0-f1f4-4787-8af6-3f631559de8a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:33.101773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e105e0-f1f4-4787-8af6-3f631559de8a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:33.103044 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e105e0-f1f4-4787-8af6-3f631559de8a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:33.103786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e105e0-f1f4-4787-8af6-3f631559de8a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:33.104671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e105e0-f1f4-4787-8af6-3f631559de8a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:33.105534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e105e0-f1f4-4787-8af6-3f631559de8a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:33.106165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e105e0-f1f4-4787-8af6-3f631559de8a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:33.248494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f3bb2dc2-7e52-48d6-bfd3-748bab481174 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:33.249233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f3bb2dc2-7e52-48d6-bfd3-748bab481174 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:33.268892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3bb2dc2-7e52-48d6-bfd3-748bab481174 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:33.269687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3bb2dc2-7e52-48d6-bfd3-748bab481174 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:33.272361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3bb2dc2-7e52-48d6-bfd3-748bab481174 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:33.273591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3bb2dc2-7e52-48d6-bfd3-748bab481174 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:33.274977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3bb2dc2-7e52-48d6-bfd3-748bab481174 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:33.277360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3bb2dc2-7e52-48d6-bfd3-748bab481174 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:33.368696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-69e105e0-f1f4-4787-8af6-3f631559de8a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:33.379745 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-69e105e0-f1f4-4787-8af6-3f631559de8a tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.294301 Aug 18 11:36:33.382508 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1241/2552] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:33 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:33.510340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9ac35c56-12e8-487a-9f53-8689e4722045 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:33.511384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9ac35c56-12e8-487a-9f53-8689e4722045 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] [instance: 51e3865d-a413-4c57-b0dc-1b29e76be1de] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:33.519804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9ac35c56-12e8-487a-9f53-8689e4722045 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:33.526616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9ac35c56-12e8-487a-9f53-8689e4722045 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:33.527396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9ac35c56-12e8-487a-9f53-8689e4722045 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:33.528905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9ac35c56-12e8-487a-9f53-8689e4722045 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:33.529532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9ac35c56-12e8-487a-9f53-8689e4722045 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:33.530114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9ac35c56-12e8-487a-9f53-8689e4722045 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:33.557754 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-9ac35c56-12e8-487a-9f53-8689e4722045 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] HTTP exception thrown: Instance 51e3865d-a413-4c57-b0dc-1b29e76be1de could not be found. Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9ac35c56-12e8-487a-9f53-8689e4722045 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Request method failure captured: Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de HTTP/1.1 Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iOSBjNimecq0A_zyKJoYEzxPieZ9ek0QVTpH1yQOelYW-LnuPXuIU8J75XW5YeuB3rnCiQFyhkqBmun5mFv87BWdlSX9BSGflIZiOWkrBoxpy9Ek-2BCJ8ipZaoWfDug4UhH0WeEuXslT1m-YZtspQP071ejKBhjcntE217XtkHaYg Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 7fe39b6aea8849d788b0d0a425c0e591 Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ListImageFiltersTestJSON-98893192 Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7fe39b6aea8849d788b0d0a425c0e591"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7fe39b6aea8849d788b0d0a425c0e591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7fe39b6aea8849d788b0d0a425c0e591"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7fe39b6aea8849d788b0d0a425c0e591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ListImageFiltersTestJSON-98893192 Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 7fe39b6aea8849d788b0d0a425c0e591 Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-98893192 Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ListImageFiltersTestJSON-98893192-project Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 321f5430950547d3b63d50d87a6a95c6 Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ListImageFiltersTestJSON-98893192-project Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 51e3865d-a413-4c57-b0dc-1b29e76be1de could not be found. Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '51e3865d-a413-4c57-b0dc-1b29e76be1de'} Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51e3865d-a413-4c57-b0dc-1b29e76be1de could not be found. Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e3865d-a413-4c57-b0dc-1b29e76be1de could not be found. Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:33.559745 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:36:33.564426 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:33.564426 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:33.564426 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:33.564426 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:36:33.564426 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:36:33.564426 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e3865d-a413-4c57-b0dc-1b29e76be1de could not be found. Aug 18 11:36:33.564426 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:36:33.566378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9ac35c56-12e8-487a-9f53-8689e4722045 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Returning 404 to user: Instance 51e3865d-a413-4c57-b0dc-1b29e76be1de could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:36:33.571465 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9ac35c56-12e8-487a-9f53-8689e4722045 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de" status: 404 len: 111 microversion: 2.1 time: 0.068722 Aug 18 11:36:33.572248 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1242/2553] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:33 2022] GET /compute/v2.1/servers/51e3865d-a413-4c57-b0dc-1b29e76be1de => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:36:33.581639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ab41e9ba-de06-4b3a-83e9-35cd6eb62773 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f7005e0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:33.643692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f3bb2dc2-7e52-48d6-bfd3-748bab481174 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:33.670456 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f3bb2dc2-7e52-48d6-bfd3-748bab481174 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1313 microversion: 2.1 time: 0.426594 Aug 18 11:36:33.674684 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1312/2554] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:33 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:33.997929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-828cd5cf-fe76-4b26-bc72-d1cd4cc4ed87 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:34.000292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-828cd5cf-fe76-4b26-bc72-d1cd4cc4ed87 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:34.010900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-828cd5cf-fe76-4b26-bc72-d1cd4cc4ed87 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:34.011598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-828cd5cf-fe76-4b26-bc72-d1cd4cc4ed87 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:34.012296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-828cd5cf-fe76-4b26-bc72-d1cd4cc4ed87 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:34.013163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-828cd5cf-fe76-4b26-bc72-d1cd4cc4ed87 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:34.014648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-828cd5cf-fe76-4b26-bc72-d1cd4cc4ed87 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:34.015459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-828cd5cf-fe76-4b26-bc72-d1cd4cc4ed87 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:34.147179 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ab41e9ba-de06-4b3a-83e9-35cd6eb62773 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "DELETE /compute/v2.1/images/2bc83ce8-72b7-4815-8543-de0836f3ce02" status: 204 len: 0 microversion: 2.1 time: 0.569610 Aug 18 11:36:34.147758 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1243/2555] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:33 2022] DELETE /compute/v2.1/images/2bc83ce8-72b7-4815-8543-de0836f3ce02 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:36:34.156143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0006cba7-8703-489e-ba71-b8102cb1a743 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f87f790>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:34.356804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-828cd5cf-fe76-4b26-bc72-d1cd4cc4ed87 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:34.374685 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-828cd5cf-fe76-4b26-bc72-d1cd4cc4ed87 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1477 microversion: 2.1 time: 0.381030 Aug 18 11:36:34.376134 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1313/2556] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:33 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1477 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:34.409019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-43bd8b22-a46d-4267-a950-4886dff7301c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:34.409966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-43bd8b22-a46d-4267-a950-4886dff7301c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:34.418024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43bd8b22-a46d-4267-a950-4886dff7301c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:34.418880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43bd8b22-a46d-4267-a950-4886dff7301c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:34.419567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43bd8b22-a46d-4267-a950-4886dff7301c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:34.420533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43bd8b22-a46d-4267-a950-4886dff7301c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:34.422117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43bd8b22-a46d-4267-a950-4886dff7301c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:34.422823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43bd8b22-a46d-4267-a950-4886dff7301c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:34.490088 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0006cba7-8703-489e-ba71-b8102cb1a743 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "DELETE /compute/v2.1/images/8bcab6a1-d117-4d3b-9a03-46129dd37a87" status: 204 len: 0 microversion: 2.1 time: 0.338176 Aug 18 11:36:34.493862 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1244/2557] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:34 2022] DELETE /compute/v2.1/images/8bcab6a1-d117-4d3b-9a03-46129dd37a87 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:36:34.500781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-543776a3-4830-4276-a4ac-c4532d78de54 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] Calling method '.version_select at 0x7f519f7e1040>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:34.782621 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-543776a3-4830-4276-a4ac-c4532d78de54 tempest-ListImageFiltersTestJSON-98893192 tempest-ListImageFiltersTestJSON-98893192-project] 10.222.0.73 "DELETE /compute/v2.1/images/5dca259d-4f2e-4621-9577-41a0dc709c06" status: 204 len: 0 microversion: 2.1 time: 0.287571 Aug 18 11:36:34.783209 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1245/2558] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:34 2022] DELETE /compute/v2.1/images/5dca259d-4f2e-4621-9577-41a0dc709c06 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:36:34.787844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-15ef5858-f2c0-4b83-a3fd-b83f733ca15b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:34.788420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-15ef5858-f2c0-4b83-a3fd-b83f733ca15b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:34.797927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-15ef5858-f2c0-4b83-a3fd-b83f733ca15b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:34.798916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-15ef5858-f2c0-4b83-a3fd-b83f733ca15b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:34.799807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-15ef5858-f2c0-4b83-a3fd-b83f733ca15b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:34.801089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-15ef5858-f2c0-4b83-a3fd-b83f733ca15b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:34.801992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-15ef5858-f2c0-4b83-a3fd-b83f733ca15b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:34.802721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-15ef5858-f2c0-4b83-a3fd-b83f733ca15b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:34.988955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-15ef5858-f2c0-4b83-a3fd-b83f733ca15b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:34.998081 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-15ef5858-f2c0-4b83-a3fd-b83f733ca15b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1313 microversion: 2.1 time: 0.213764 Aug 18 11:36:35.006647 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1246/2559] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:34 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:35.088437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-685d2a10-6cfb-4cf2-ac0b-d3533ba8ae07 req-1ee030c6-63ec-46de-8fc2-46921cb24c1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ade0e1d-521a-435b-bf64-c9b5da703862", "tag": "d9b4162d-a9be-46e0-80ab-1abf1b8713e9"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:35.099922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-685d2a10-6cfb-4cf2-ac0b-d3533ba8ae07 req-1ee030c6-63ec-46de-8fc2-46921cb24c1c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:35.100664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-685d2a10-6cfb-4cf2-ac0b-d3533ba8ae07 req-1ee030c6-63ec-46de-8fc2-46921cb24c1c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:35.101258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-685d2a10-6cfb-4cf2-ac0b-d3533ba8ae07 req-1ee030c6-63ec-46de-8fc2-46921cb24c1c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:35.121687 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-685d2a10-6cfb-4cf2-ac0b-d3533ba8ae07 req-1ee030c6-63ec-46de-8fc2-46921cb24c1c service nova] Creating event network-changed:d9b4162d-a9be-46e0-80ab-1abf1b8713e9 for instance 3ade0e1d-521a-435b-bf64-c9b5da703862 on n-h2-853611-3 Aug 18 11:36:35.127585 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-685d2a10-6cfb-4cf2-ac0b-d3533ba8ae07 req-1ee030c6-63ec-46de-8fc2-46921cb24c1c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046588 Aug 18 11:36:35.132559 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1247/2560] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:36:35.144797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-43bd8b22-a46d-4267-a950-4886dff7301c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:35.153846 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-43bd8b22-a46d-4267-a950-4886dff7301c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.753159 Aug 18 11:36:35.155155 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1314/2561] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:34 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:35.408796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-41708d61-150d-474c-bcfb-2e8657c896a3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:35.414965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-41708d61-150d-474c-bcfb-2e8657c896a3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:35.427988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-41708d61-150d-474c-bcfb-2e8657c896a3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:35.432075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-41708d61-150d-474c-bcfb-2e8657c896a3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:35.432734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-41708d61-150d-474c-bcfb-2e8657c896a3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:35.435117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-41708d61-150d-474c-bcfb-2e8657c896a3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:35.438021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-41708d61-150d-474c-bcfb-2e8657c896a3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:35.439051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-41708d61-150d-474c-bcfb-2e8657c896a3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:35.696874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-393053640", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:35.802877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] validate_networks() for [('26f1b349-d280-46a0-801f-2b32d525fe0e', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:36:36.429055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-41708d61-150d-474c-bcfb-2e8657c896a3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:36.441142 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-41708d61-150d-474c-bcfb-2e8657c896a3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1477 microversion: 2.1 time: 1.038250 Aug 18 11:36:36.443059 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1248/2562] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:35 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1477 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:36.455949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a59dabe-1e73-4dd8-8a09-1b9baf7613ed tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:36.459758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0a59dabe-1e73-4dd8-8a09-1b9baf7613ed tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:36.481612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a59dabe-1e73-4dd8-8a09-1b9baf7613ed tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:36.483438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a59dabe-1e73-4dd8-8a09-1b9baf7613ed tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:36.486165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a59dabe-1e73-4dd8-8a09-1b9baf7613ed tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:36.488005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a59dabe-1e73-4dd8-8a09-1b9baf7613ed tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:36.488666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a59dabe-1e73-4dd8-8a09-1b9baf7613ed tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:36.489439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a59dabe-1e73-4dd8-8a09-1b9baf7613ed tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:36.732197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:36:36.732680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:36:36.733057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:36:36.734267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:36:36.734710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:36:36.746145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:36.746831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:36.747593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:36.748531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:36.749325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:36.750334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:36.775268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:36.786663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Getting quotas for project 00d9eeb4297f442694052b28a297d9a3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:36:36.799992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Getting quotas for user 4eea5599d0754399a32a3ae3431ff18f and project 00d9eeb4297f442694052b28a297d9a3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:36:36.828784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:36:36.831151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:36:36.841564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0a59dabe-1e73-4dd8-8a09-1b9baf7613ed tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:36.879631 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0a59dabe-1e73-4dd8-8a09-1b9baf7613ed tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1313 microversion: 2.1 time: 0.433820 Aug 18 11:36:36.886098 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1249/2563] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:36 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:36.888101 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3f6565d8-8022-433b-88c3-234357941889 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.406080 Aug 18 11:36:36.894927 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1315/2564] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:36:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:36:36.896297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94b260b0-bb6d-42c1-b048-8eac00225527 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:36.899636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-94b260b0-bb6d-42c1-b048-8eac00225527 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:36.900932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-85aeaee2-b6ab-4103-87ee-a72439a24d67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:36.905246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-85aeaee2-b6ab-4103-87ee-a72439a24d67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:36.907425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94b260b0-bb6d-42c1-b048-8eac00225527 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:36.908308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94b260b0-bb6d-42c1-b048-8eac00225527 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:36.908961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94b260b0-bb6d-42c1-b048-8eac00225527 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:36.910025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94b260b0-bb6d-42c1-b048-8eac00225527 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:36.910695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94b260b0-bb6d-42c1-b048-8eac00225527 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:36.911321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94b260b0-bb6d-42c1-b048-8eac00225527 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:36.925306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85aeaee2-b6ab-4103-87ee-a72439a24d67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:36.926118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85aeaee2-b6ab-4103-87ee-a72439a24d67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:36.926919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85aeaee2-b6ab-4103-87ee-a72439a24d67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:36.928238 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85aeaee2-b6ab-4103-87ee-a72439a24d67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:36.928845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85aeaee2-b6ab-4103-87ee-a72439a24d67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:36.930548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85aeaee2-b6ab-4103-87ee-a72439a24d67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:37.028824 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-94b260b0-bb6d-42c1-b048-8eac00225527 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.137398 Aug 18 11:36:37.035537 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1316/2565] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:36:36 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:36:37.052280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b02aa2e-cbd8-4d6e-8e21-1d0da68edeac tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:37.053050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b02aa2e-cbd8-4d6e-8e21-1d0da68edeac tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:37.258086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b02aa2e-cbd8-4d6e-8e21-1d0da68edeac tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:37.278296 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b02aa2e-cbd8-4d6e-8e21-1d0da68edeac tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1221 microversion: 2.1 time: 0.234743 Aug 18 11:36:37.293540 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1317/2566] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:37 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1221 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:37.301643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34cfdc85-dd29-445e-8f76-631d43271d09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:37.303150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-34cfdc85-dd29-445e-8f76-631d43271d09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:37.314980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cfdc85-dd29-445e-8f76-631d43271d09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:37.315970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cfdc85-dd29-445e-8f76-631d43271d09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:37.316585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cfdc85-dd29-445e-8f76-631d43271d09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:37.325504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-85aeaee2-b6ab-4103-87ee-a72439a24d67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:37.334285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cfdc85-dd29-445e-8f76-631d43271d09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:37.336620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cfdc85-dd29-445e-8f76-631d43271d09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:37.337947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cfdc85-dd29-445e-8f76-631d43271d09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:37.340530 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-85aeaee2-b6ab-4103-87ee-a72439a24d67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.453169 Aug 18 11:36:37.354464 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1250/2567] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:36 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:37.464894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0926e905-6dee-4848-b16d-8499266d9d8b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:37.465665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0926e905-6dee-4848-b16d-8499266d9d8b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:37.473579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0926e905-6dee-4848-b16d-8499266d9d8b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:37.479657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0926e905-6dee-4848-b16d-8499266d9d8b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:37.480259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0926e905-6dee-4848-b16d-8499266d9d8b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:37.481036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0926e905-6dee-4848-b16d-8499266d9d8b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:37.481517 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0926e905-6dee-4848-b16d-8499266d9d8b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:37.481956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0926e905-6dee-4848-b16d-8499266d9d8b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:37.700435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0926e905-6dee-4848-b16d-8499266d9d8b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:37.721816 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0926e905-6dee-4848-b16d-8499266d9d8b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1477 microversion: 2.1 time: 0.260946 Aug 18 11:36:37.731019 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1251/2568] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:37 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1477 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:37.743416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1815669028", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:37.745554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-34cfdc85-dd29-445e-8f76-631d43271d09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:37.754207 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34cfdc85-dd29-445e-8f76-631d43271d09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1671 microversion: 2.1 time: 0.459245 Aug 18 11:36:37.758555 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1318/2569] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:37 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1671 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:37.843582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] validate_networks() for [('26f1b349-d280-46a0-801f-2b32d525fe0e', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:36:38.121212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d36c4b15-5f76-4c42-9ba4-dd230ed94f15 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] Calling method '.version_select at 0x7f519fed9dc0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:38.141299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36c4b15-5f76-4c42-9ba4-dd230ed94f15 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:38.142689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36c4b15-5f76-4c42-9ba4-dd230ed94f15 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:38.143986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36c4b15-5f76-4c42-9ba4-dd230ed94f15 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:38.144845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36c4b15-5f76-4c42-9ba4-dd230ed94f15 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:38.145388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36c4b15-5f76-4c42-9ba4-dd230ed94f15 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:38.145899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36c4b15-5f76-4c42-9ba4-dd230ed94f15 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:38.210806 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d36c4b15-5f76-4c42-9ba4-dd230ed94f15 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] 10.222.0.73 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.450517 Aug 18 11:36:38.211442 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1319/2570] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 11:36:37 2022] GET /compute/v2.1/limits => generated 511 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:38.216639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aa17e05a-3cff-4a41-b7ef-23a2074bd9ef tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:38.217261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aa17e05a-3cff-4a41-b7ef-23a2074bd9ef tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:38.239322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa17e05a-3cff-4a41-b7ef-23a2074bd9ef tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:38.239889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa17e05a-3cff-4a41-b7ef-23a2074bd9ef tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:38.240549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa17e05a-3cff-4a41-b7ef-23a2074bd9ef tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:38.242359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa17e05a-3cff-4a41-b7ef-23a2074bd9ef tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:38.244012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa17e05a-3cff-4a41-b7ef-23a2074bd9ef tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:38.245638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa17e05a-3cff-4a41-b7ef-23a2074bd9ef tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:38.401880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:38.634965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=8 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:38.641481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aa17e05a-3cff-4a41-b7ef-23a2074bd9ef tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:38.646154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:38.659808 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aa17e05a-3cff-4a41-b7ef-23a2074bd9ef tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1313 microversion: 2.1 time: 0.446975 Aug 18 11:36:38.660453 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1320/2571] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:38 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:38.665782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f7b64ba-42df-46b9-8d76-e083a560fee6 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1277928816", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:38.740806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:36:38.741798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:36:38.742601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:36:38.743434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:36:38.744055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:36:38.770569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:38.782823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:38.783682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:38.785168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:38.786458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-7f7b64ba-42df-46b9-8d76-e083a560fee6 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:36:38.787345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:38.788016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:38.840038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Getting quotas for project 00d9eeb4297f442694052b28a297d9a3. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:36:38.851552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Getting quotas for user 4eea5599d0754399a32a3ae3431ff18f and project 00d9eeb4297f442694052b28a297d9a3. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:36:38.893389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:36:38.896276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:36:38.981335 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a371c0b9-433a-4061-9213-0bfd1b83f2c9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.241953 Aug 18 11:36:38.982382 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1252/2572] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:36:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:36:38.992664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5259b07c-c15f-4573-8702-95635d759c5d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:38.993679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5259b07c-c15f-4573-8702-95635d759c5d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:39.009717 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5259b07c-c15f-4573-8702-95635d759c5d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:39.010636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5259b07c-c15f-4573-8702-95635d759c5d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:39.011306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5259b07c-c15f-4573-8702-95635d759c5d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:39.012430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5259b07c-c15f-4573-8702-95635d759c5d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:39.013144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5259b07c-c15f-4573-8702-95635d759c5d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:39.013794 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5259b07c-c15f-4573-8702-95635d759c5d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:39.331313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5259b07c-c15f-4573-8702-95635d759c5d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:39.339913 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5259b07c-c15f-4573-8702-95635d759c5d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.356046 Aug 18 11:36:39.340504 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1253/2573] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:38 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:39.345355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ba5dd81f-a044-455f-86e7-7a0a9913c58c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:39.345971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ba5dd81f-a044-455f-86e7-7a0a9913c58c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:39.360804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba5dd81f-a044-455f-86e7-7a0a9913c58c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:39.361551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba5dd81f-a044-455f-86e7-7a0a9913c58c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:39.362169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba5dd81f-a044-455f-86e7-7a0a9913c58c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:39.363165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba5dd81f-a044-455f-86e7-7a0a9913c58c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:39.363896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba5dd81f-a044-455f-86e7-7a0a9913c58c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:39.364472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba5dd81f-a044-455f-86e7-7a0a9913c58c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:39.597139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ba5dd81f-a044-455f-86e7-7a0a9913c58c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:39.600174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:39.612351 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ba5dd81f-a044-455f-86e7-7a0a9913c58c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1477 microversion: 2.1 time: 0.270544 Aug 18 11:36:39.614293 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1254/2574] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:39 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1477 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:39.621826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7ad2d60a-dda9-4302-9b4f-3cd040c37051 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:39.622921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7ad2d60a-dda9-4302-9b4f-3cd040c37051 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:39.633807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ad2d60a-dda9-4302-9b4f-3cd040c37051 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:39.635405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ad2d60a-dda9-4302-9b4f-3cd040c37051 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:39.637501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ad2d60a-dda9-4302-9b4f-3cd040c37051 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:39.641868 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ad2d60a-dda9-4302-9b4f-3cd040c37051 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:39.642765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ad2d60a-dda9-4302-9b4f-3cd040c37051 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:39.644408 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ad2d60a-dda9-4302-9b4f-3cd040c37051 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:39.696455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7f7b64ba-42df-46b9-8d76-e083a560fee6 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] Getting quotas for project 49b4b0c13f9c44c69a6b0e587bcd5dc9. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:36:39.716719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7f7b64ba-42df-46b9-8d76-e083a560fee6 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] Getting quotas for user c2fd264a40994abaa01b304ad1d36046 and project 49b4b0c13f9c44c69a6b0e587bcd5dc9. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:36:39.752243 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-7f7b64ba-42df-46b9-8d76-e083a560fee6 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f7b64ba-42df-46b9-8d76-e083a560fee6 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] Request method failure captured: Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 1752 Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iRFApdS1MTF7fLjcOGvHdH-bovDy3v5NxxmO0BQ533GRJvTxbN5PwbGD-Q1gQyS-GtvmH52eA89CJD4j3IOz09frem1FyhXKT9BeMGV9FAXNtoPjoJB-L1K_QOmH1lmfV5kNGCBzCktxb-JMq_h31i11E46JiuxmQkRPXmPiejuK34 Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 49b4b0c13f9c44c69a6b0e587bcd5dc9 Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1313193194 Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/49b4b0c13f9c44c69a6b0e587bcd5dc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/49b4b0c13f9c44c69a6b0e587bcd5dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_49b4b0c13f9c44c69a6b0e587bcd5dc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/49b4b0c13f9c44c69a6b0e587bcd5dc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1313193194 Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 49b4b0c13f9c44c69a6b0e587bcd5dc9 Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1313193194 Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c2fd264a40994abaa01b304ad1d36046 Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1277928816", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:36:39.758952 n-d-853611-3 devstack@n-api.service[122210]: exception: Maximum number of metadata items exceeds 128 Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1277928816', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:36:39.761240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:39.763967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f7b64ba-42df-46b9-8d76-e083a560fee6 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:36:39.766882 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7f7b64ba-42df-46b9-8d76-e083a560fee6 tempest-AbsoluteLimitsNegativeTestJSON-1313193194 tempest-AbsoluteLimitsNegativeTestJSON-1313193194-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.098813 Aug 18 11:36:39.774081 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1321/2575] 10.222.0.73 () {60 vars in 1148 bytes} [Thu Aug 18 11:36:38 2022] POST /compute/v2.1/servers => generated 87 bytes in 1111 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:36:39.791772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f0e0feb-4b02-488e-bbb5-bac2ce0f841d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:39.794077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f0e0feb-4b02-488e-bbb5-bac2ce0f841d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:39.906633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7ad2d60a-dda9-4302-9b4f-3cd040c37051 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:39.937081 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7ad2d60a-dda9-4302-9b4f-3cd040c37051 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.318284 Aug 18 11:36:39.941609 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1255/2576] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:39 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:39.955342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ad90fc0e-cb98-48fe-a3ec-18ad63b7e41d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:39.956231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ad90fc0e-cb98-48fe-a3ec-18ad63b7e41d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:39.968142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad90fc0e-cb98-48fe-a3ec-18ad63b7e41d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:39.970065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad90fc0e-cb98-48fe-a3ec-18ad63b7e41d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:39.971969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad90fc0e-cb98-48fe-a3ec-18ad63b7e41d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:39.975815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad90fc0e-cb98-48fe-a3ec-18ad63b7e41d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:39.976458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2f0e0feb-4b02-488e-bbb5-bac2ce0f841d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:39.977017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad90fc0e-cb98-48fe-a3ec-18ad63b7e41d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:39.978868 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad90fc0e-cb98-48fe-a3ec-18ad63b7e41d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:40.000138 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f0e0feb-4b02-488e-bbb5-bac2ce0f841d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1222 microversion: 2.1 time: 0.217883 Aug 18 11:36:40.013605 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1322/2577] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:39 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1222 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:40.254108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ad90fc0e-cb98-48fe-a3ec-18ad63b7e41d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:40.265785 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ad90fc0e-cb98-48fe-a3ec-18ad63b7e41d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1313 microversion: 2.1 time: 0.320118 Aug 18 11:36:40.270132 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1256/2578] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:39 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:40.363396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-50ddb07b-d195-4d10-ae35-2959e404ebf9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:40.364447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-50ddb07b-d195-4d10-ae35-2959e404ebf9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:40.378656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50ddb07b-d195-4d10-ae35-2959e404ebf9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:40.379343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50ddb07b-d195-4d10-ae35-2959e404ebf9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:40.380040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50ddb07b-d195-4d10-ae35-2959e404ebf9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:40.380848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50ddb07b-d195-4d10-ae35-2959e404ebf9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:40.381639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50ddb07b-d195-4d10-ae35-2959e404ebf9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:40.382553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50ddb07b-d195-4d10-ae35-2959e404ebf9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:40.636092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5d9cb030-071d-4a09-bae3-6ba300fc4224 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:40.636708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5d9cb030-071d-4a09-bae3-6ba300fc4224 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:40.650549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d9cb030-071d-4a09-bae3-6ba300fc4224 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:40.657729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d9cb030-071d-4a09-bae3-6ba300fc4224 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:40.658469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d9cb030-071d-4a09-bae3-6ba300fc4224 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:40.672087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d9cb030-071d-4a09-bae3-6ba300fc4224 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:40.675086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d9cb030-071d-4a09-bae3-6ba300fc4224 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:40.675594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5d9cb030-071d-4a09-bae3-6ba300fc4224 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:40.790618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-50ddb07b-d195-4d10-ae35-2959e404ebf9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:40.799637 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-50ddb07b-d195-4d10-ae35-2959e404ebf9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.442148 Aug 18 11:36:40.822699 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1323/2579] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:40 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:41.020713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fbfe5992-4a14-45eb-9643-3f84bd252bf5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:41.022773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fbfe5992-4a14-45eb-9643-3f84bd252bf5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:41.030335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbfe5992-4a14-45eb-9643-3f84bd252bf5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:41.038405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbfe5992-4a14-45eb-9643-3f84bd252bf5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:41.039269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbfe5992-4a14-45eb-9643-3f84bd252bf5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:41.054548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbfe5992-4a14-45eb-9643-3f84bd252bf5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:41.055619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbfe5992-4a14-45eb-9643-3f84bd252bf5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:41.056359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbfe5992-4a14-45eb-9643-3f84bd252bf5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:41.180979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5d9cb030-071d-4a09-bae3-6ba300fc4224 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:41.191262 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5d9cb030-071d-4a09-bae3-6ba300fc4224 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1477 microversion: 2.1 time: 0.558977 Aug 18 11:36:41.191851 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1257/2580] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:40 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1477 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:41.208742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1616762771", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "2f7a768a-0d38-4a0f-b260-e5c4f9eb641a"}, {"uuid": "605da5dd-c9fa-4801-8355-f59aa8300c60"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:41.210597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fbfe5992-4a14-45eb-9643-3f84bd252bf5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:41.222248 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fbfe5992-4a14-45eb-9643-3f84bd252bf5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1292 microversion: 2.1 time: 0.205383 Aug 18 11:36:41.225200 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1324/2581] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:41 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1292 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:41.292643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d1db9f5f-7a0d-4a80-bfdc-1a254b0e7e11 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:41.294538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d1db9f5f-7a0d-4a80-bfdc-1a254b0e7e11 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:41.333314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] validate_networks() for [('2f7a768a-0d38-4a0f-b260-e5c4f9eb641a', None, None, None, None, None), ('605da5dd-c9fa-4801-8355-f59aa8300c60', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:36:41.336592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1db9f5f-7a0d-4a80-bfdc-1a254b0e7e11 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:41.337562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1db9f5f-7a0d-4a80-bfdc-1a254b0e7e11 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:41.338198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1db9f5f-7a0d-4a80-bfdc-1a254b0e7e11 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:41.339797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1db9f5f-7a0d-4a80-bfdc-1a254b0e7e11 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:41.341494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1db9f5f-7a0d-4a80-bfdc-1a254b0e7e11 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:41.342619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1db9f5f-7a0d-4a80-bfdc-1a254b0e7e11 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:41.577623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d1db9f5f-7a0d-4a80-bfdc-1a254b0e7e11 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:41.595189 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d1db9f5f-7a0d-4a80-bfdc-1a254b0e7e11 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1313 microversion: 2.1 time: 0.305849 Aug 18 11:36:41.596868 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1325/2582] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:41 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:41.831004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03859ce9-8194-4056-909f-4b65612727f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:41.833003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-03859ce9-8194-4056-909f-4b65612727f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:41.848507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03859ce9-8194-4056-909f-4b65612727f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:41.849022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03859ce9-8194-4056-909f-4b65612727f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:41.849471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03859ce9-8194-4056-909f-4b65612727f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:41.850230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03859ce9-8194-4056-909f-4b65612727f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:41.850756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03859ce9-8194-4056-909f-4b65612727f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:41.851196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03859ce9-8194-4056-909f-4b65612727f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:42.577622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-03859ce9-8194-4056-909f-4b65612727f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:42.589142 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-03859ce9-8194-4056-909f-4b65612727f1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.763786 Aug 18 11:36:42.590251 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1326/2583] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:41 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:42.597258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1f8a5e5f-e316-44e4-8710-c875db6068a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:42.598619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1f8a5e5f-e316-44e4-8710-c875db6068a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:42.613390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f8a5e5f-e316-44e4-8710-c875db6068a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:42.619050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f8a5e5f-e316-44e4-8710-c875db6068a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:42.619548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f8a5e5f-e316-44e4-8710-c875db6068a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:42.620324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f8a5e5f-e316-44e4-8710-c875db6068a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:42.620805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f8a5e5f-e316-44e4-8710-c875db6068a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:42.621244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f8a5e5f-e316-44e4-8710-c875db6068a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:42.943651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:36:42.944250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:36:42.946072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:36:42.946777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:36:42.948534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:36:42.982104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:42.983973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:42.984725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:42.985971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:42.986958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:42.987625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:43.022887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Getting quotas for project f31cf551fa744480b3aeb24d97f9c7ae. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:36:43.039284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Getting quotas for user a31512cf212247b59aa951006f887d02 and project f31cf551fa744480b3aeb24d97f9c7ae. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:36:43.065209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:36:43.067842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:36:43.094531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1f8a5e5f-e316-44e4-8710-c875db6068a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:43.109590 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1f8a5e5f-e316-44e4-8710-c875db6068a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1477 microversion: 2.1 time: 0.517590 Aug 18 11:36:43.110196 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1327/2584] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:42 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1477 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:43.132060 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-228a7b96-76df-4c0a-8132-c07da2e288bf tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.938302 Aug 18 11:36:43.141630 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1258/2585] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:36:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:36:43.141630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b950496e-f276-4acb-881d-652042f6dd57 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:43.142067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b950496e-f276-4acb-881d-652042f6dd57 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:43.143151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b6425e2f-bb17-48e4-9672-52746be63a65 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:43.143571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b6425e2f-bb17-48e4-9672-52746be63a65 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:43.150687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b950496e-f276-4acb-881d-652042f6dd57 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:43.151923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b950496e-f276-4acb-881d-652042f6dd57 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:43.152662 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b950496e-f276-4acb-881d-652042f6dd57 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:43.153617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b950496e-f276-4acb-881d-652042f6dd57 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:43.154291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b950496e-f276-4acb-881d-652042f6dd57 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:43.155894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b950496e-f276-4acb-881d-652042f6dd57 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:43.160017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6425e2f-bb17-48e4-9672-52746be63a65 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:43.160392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6425e2f-bb17-48e4-9672-52746be63a65 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:43.160835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6425e2f-bb17-48e4-9672-52746be63a65 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:43.185597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6425e2f-bb17-48e4-9672-52746be63a65 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:43.187120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6425e2f-bb17-48e4-9672-52746be63a65 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:43.187808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6425e2f-bb17-48e4-9672-52746be63a65 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:43.613393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b950496e-f276-4acb-881d-652042f6dd57 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:43.620445 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b950496e-f276-4acb-881d-652042f6dd57 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1313 microversion: 2.1 time: 0.485309 Aug 18 11:36:43.621041 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1259/2586] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:43 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:43.647177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-71376f29-1b97-4cbb-94da-cee8362ac390 req-5431ad58-dd00-45ba-8d26-0c731bbe0b9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f665d8-ddd8-4030-be59-efb1140ef80e", "tag": "c56130e0-5b17-4391-828c-7beff1aa7e98"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:43.703746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-71376f29-1b97-4cbb-94da-cee8362ac390 req-5431ad58-dd00-45ba-8d26-0c731bbe0b9e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:43.704257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-71376f29-1b97-4cbb-94da-cee8362ac390 req-5431ad58-dd00-45ba-8d26-0c731bbe0b9e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:43.704700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-71376f29-1b97-4cbb-94da-cee8362ac390 req-5431ad58-dd00-45ba-8d26-0c731bbe0b9e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:43.771379 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-71376f29-1b97-4cbb-94da-cee8362ac390 req-5431ad58-dd00-45ba-8d26-0c731bbe0b9e service nova] Creating event network-changed:c56130e0-5b17-4391-828c-7beff1aa7e98 for instance d6f665d8-ddd8-4030-be59-efb1140ef80e on n-h1-853611-3 Aug 18 11:36:43.779836 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-71376f29-1b97-4cbb-94da-cee8362ac390 req-5431ad58-dd00-45ba-8d26-0c731bbe0b9e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149967 Aug 18 11:36:43.785271 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1260/2587] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:43.791113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fb333919-ff81-43a1-ba33-f9b67d815a34 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:43.797771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fb333919-ff81-43a1-ba33-f9b67d815a34 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:43.898921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fb333919-ff81-43a1-ba33-f9b67d815a34 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:43.910771 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fb333919-ff81-43a1-ba33-f9b67d815a34 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1213 microversion: 2.1 time: 0.123766 Aug 18 11:36:43.911843 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1261/2588] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:43 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:43.928319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-0d1e3d6f-f93e-4e6d-8ed3-b13368727996 req-d7cfdf71-0822-468f-852a-9351b9cf5363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ade0e1d-521a-435b-bf64-c9b5da703862", "name": "network-vif-plugged", "status": "completed", "tag": "d9b4162d-a9be-46e0-80ab-1abf1b8713e9"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:43.956737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0d1e3d6f-f93e-4e6d-8ed3-b13368727996 req-d7cfdf71-0822-468f-852a-9351b9cf5363 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:43.958218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0d1e3d6f-f93e-4e6d-8ed3-b13368727996 req-d7cfdf71-0822-468f-852a-9351b9cf5363 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:43.960375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0d1e3d6f-f93e-4e6d-8ed3-b13368727996 req-d7cfdf71-0822-468f-852a-9351b9cf5363 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:43.975728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b6425e2f-bb17-48e4-9672-52746be63a65 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:43.984008 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-0d1e3d6f-f93e-4e6d-8ed3-b13368727996 req-d7cfdf71-0822-468f-852a-9351b9cf5363 service nova] Creating event network-vif-plugged:d9b4162d-a9be-46e0-80ab-1abf1b8713e9 for instance 3ade0e1d-521a-435b-bf64-c9b5da703862 on n-h2-853611-3 Aug 18 11:36:43.989512 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b6425e2f-bb17-48e4-9672-52746be63a65 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1322 microversion: 2.1 time: 0.870079 Aug 18 11:36:43.990121 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1328/2589] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:43 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1322 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:43.993727 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-0d1e3d6f-f93e-4e6d-8ed3-b13368727996 req-d7cfdf71-0822-468f-852a-9351b9cf5363 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077427 Aug 18 11:36:43.994976 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1262/2590] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:44.009676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9da84594-1845-4e42-8416-4a7151909245 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:44.010641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9da84594-1845-4e42-8416-4a7151909245 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:44.039681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9da84594-1845-4e42-8416-4a7151909245 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:44.041476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9da84594-1845-4e42-8416-4a7151909245 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:44.041961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9da84594-1845-4e42-8416-4a7151909245 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:44.043073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9da84594-1845-4e42-8416-4a7151909245 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:44.044166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9da84594-1845-4e42-8416-4a7151909245 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:44.045975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9da84594-1845-4e42-8416-4a7151909245 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:44.139804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-84954927-3b47-4f9b-be0e-16b05a3117d0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:44.140992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-84954927-3b47-4f9b-be0e-16b05a3117d0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:44.153282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84954927-3b47-4f9b-be0e-16b05a3117d0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:44.154288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84954927-3b47-4f9b-be0e-16b05a3117d0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:44.174035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84954927-3b47-4f9b-be0e-16b05a3117d0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:44.175458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84954927-3b47-4f9b-be0e-16b05a3117d0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:44.176122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84954927-3b47-4f9b-be0e-16b05a3117d0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:44.176974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84954927-3b47-4f9b-be0e-16b05a3117d0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:44.533803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9da84594-1845-4e42-8416-4a7151909245 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:44.546646 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9da84594-1845-4e42-8416-4a7151909245 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.545129 Aug 18 11:36:44.550677 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1329/2591] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:43 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:44.646116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4194f25f-8625-4f5b-9d4b-c84b862db5dd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:44.647171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4194f25f-8625-4f5b-9d4b-c84b862db5dd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:44.656394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4194f25f-8625-4f5b-9d4b-c84b862db5dd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:44.657541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4194f25f-8625-4f5b-9d4b-c84b862db5dd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:44.658195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4194f25f-8625-4f5b-9d4b-c84b862db5dd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:44.659276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4194f25f-8625-4f5b-9d4b-c84b862db5dd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:44.659949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4194f25f-8625-4f5b-9d4b-c84b862db5dd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:44.660733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4194f25f-8625-4f5b-9d4b-c84b862db5dd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:44.745553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-84954927-3b47-4f9b-be0e-16b05a3117d0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:44.782573 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-84954927-3b47-4f9b-be0e-16b05a3117d0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1477 microversion: 2.1 time: 0.648665 Aug 18 11:36:44.783451 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1263/2592] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:44 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1477 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:44.937133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4194f25f-8625-4f5b-9d4b-c84b862db5dd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:44.938843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fd8d089b-0f1c-4f10-8fdf-8db24144a558 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:44.939660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fd8d089b-0f1c-4f10-8fdf-8db24144a558 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:44.947153 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4194f25f-8625-4f5b-9d4b-c84b862db5dd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1313 microversion: 2.1 time: 0.308326 Aug 18 11:36:44.950449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fd8d089b-0f1c-4f10-8fdf-8db24144a558 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:44.950856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fd8d089b-0f1c-4f10-8fdf-8db24144a558 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:44.951560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fd8d089b-0f1c-4f10-8fdf-8db24144a558 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:44.952059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fd8d089b-0f1c-4f10-8fdf-8db24144a558 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:44.952519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fd8d089b-0f1c-4f10-8fdf-8db24144a558 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:44.952948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fd8d089b-0f1c-4f10-8fdf-8db24144a558 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:44.961686 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1330/2593] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:44 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:45.012664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cdbc8bdc-573b-4ba6-901a-8f95a1dd2cde tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:45.013371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cdbc8bdc-573b-4ba6-901a-8f95a1dd2cde tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:45.021058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdbc8bdc-573b-4ba6-901a-8f95a1dd2cde tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:45.021561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdbc8bdc-573b-4ba6-901a-8f95a1dd2cde tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:45.022092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdbc8bdc-573b-4ba6-901a-8f95a1dd2cde tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:45.023157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdbc8bdc-573b-4ba6-901a-8f95a1dd2cde tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:45.023954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdbc8bdc-573b-4ba6-901a-8f95a1dd2cde tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:45.024619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdbc8bdc-573b-4ba6-901a-8f95a1dd2cde tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:45.093689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fd8d089b-0f1c-4f10-8fdf-8db24144a558 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:45.102920 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fd8d089b-0f1c-4f10-8fdf-8db24144a558 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1265 microversion: 2.1 time: 0.168025 Aug 18 11:36:45.103766 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1264/2594] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:44 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:45.140542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-7b6ed3a0-b3a6-4ff6-9fde-9a83866ea3de req-1ececccf-5c29-414e-a643-c38619bee27f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c13227-b6f4-49d7-b40b-2ec356ca3f92", "tag": "630a62a3-889b-4229-8783-b230eb367435"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:45.152283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7b6ed3a0-b3a6-4ff6-9fde-9a83866ea3de req-1ececccf-5c29-414e-a643-c38619bee27f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:45.153045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7b6ed3a0-b3a6-4ff6-9fde-9a83866ea3de req-1ececccf-5c29-414e-a643-c38619bee27f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:45.153752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7b6ed3a0-b3a6-4ff6-9fde-9a83866ea3de req-1ececccf-5c29-414e-a643-c38619bee27f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:45.170777 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-7b6ed3a0-b3a6-4ff6-9fde-9a83866ea3de req-1ececccf-5c29-414e-a643-c38619bee27f service nova] Creating event network-changed:630a62a3-889b-4229-8783-b230eb367435 for instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 on n-h1-853611-3 Aug 18 11:36:45.178135 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-7b6ed3a0-b3a6-4ff6-9fde-9a83866ea3de req-1ececccf-5c29-414e-a643-c38619bee27f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044467 Aug 18 11:36:45.179085 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1265/2595] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:36:45.291462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cdbc8bdc-573b-4ba6-901a-8f95a1dd2cde tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:45.299229 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cdbc8bdc-573b-4ba6-901a-8f95a1dd2cde tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1322 microversion: 2.1 time: 0.291020 Aug 18 11:36:45.299804 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1331/2596] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:45 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:45.575692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0435714c-487d-4643-afa0-45b63273cce7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:45.577447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0435714c-487d-4643-afa0-45b63273cce7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:45.585744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0435714c-487d-4643-afa0-45b63273cce7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:45.586609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0435714c-487d-4643-afa0-45b63273cce7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:45.587285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0435714c-487d-4643-afa0-45b63273cce7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:45.588210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0435714c-487d-4643-afa0-45b63273cce7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:45.588870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0435714c-487d-4643-afa0-45b63273cce7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:45.589502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0435714c-487d-4643-afa0-45b63273cce7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:45.809838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f95efc38-6485-4445-a8e1-6d30b96c473c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:45.811688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f95efc38-6485-4445-a8e1-6d30b96c473c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:45.831381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f95efc38-6485-4445-a8e1-6d30b96c473c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:45.833467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f95efc38-6485-4445-a8e1-6d30b96c473c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:45.834168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f95efc38-6485-4445-a8e1-6d30b96c473c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:45.838176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f95efc38-6485-4445-a8e1-6d30b96c473c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:45.838923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f95efc38-6485-4445-a8e1-6d30b96c473c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:45.843762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f95efc38-6485-4445-a8e1-6d30b96c473c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:45.863591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0435714c-487d-4643-afa0-45b63273cce7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:45.875103 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0435714c-487d-4643-afa0-45b63273cce7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.300890 Aug 18 11:36:45.878298 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1266/2597] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:45 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:45.971517 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-85d0fb19-9bc9-4ea1-b6ac-adc3859e8a2c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:45.972142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-85d0fb19-9bc9-4ea1-b6ac-adc3859e8a2c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:45.987416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85d0fb19-9bc9-4ea1-b6ac-adc3859e8a2c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:45.987925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85d0fb19-9bc9-4ea1-b6ac-adc3859e8a2c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:45.988392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85d0fb19-9bc9-4ea1-b6ac-adc3859e8a2c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:45.989194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85d0fb19-9bc9-4ea1-b6ac-adc3859e8a2c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:45.989826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85d0fb19-9bc9-4ea1-b6ac-adc3859e8a2c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:45.990557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85d0fb19-9bc9-4ea1-b6ac-adc3859e8a2c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:46.262167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f95efc38-6485-4445-a8e1-6d30b96c473c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:46.273857 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f95efc38-6485-4445-a8e1-6d30b96c473c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1477 microversion: 2.1 time: 0.470825 Aug 18 11:36:46.276481 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1332/2598] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:45 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1477 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:46.284613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d23282d0-91a8-426d-a4e2-d8c64e60e19c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:46.285650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d23282d0-91a8-426d-a4e2-d8c64e60e19c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:46.295976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d23282d0-91a8-426d-a4e2-d8c64e60e19c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:46.296582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d23282d0-91a8-426d-a4e2-d8c64e60e19c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:46.298223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d23282d0-91a8-426d-a4e2-d8c64e60e19c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:46.299848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d23282d0-91a8-426d-a4e2-d8c64e60e19c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:46.300540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d23282d0-91a8-426d-a4e2-d8c64e60e19c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:46.301014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d23282d0-91a8-426d-a4e2-d8c64e60e19c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:46.438756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d23282d0-91a8-426d-a4e2-d8c64e60e19c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:46.452555 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d23282d0-91a8-426d-a4e2-d8c64e60e19c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1283 microversion: 2.1 time: 0.174378 Aug 18 11:36:46.453486 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1333/2599] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:46 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1283 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:46.471579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-97f8dc9a-6d2b-4dc8-9a17-bf65e2877f76 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:46.472202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-97f8dc9a-6d2b-4dc8-9a17-bf65e2877f76 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:46.478519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97f8dc9a-6d2b-4dc8-9a17-bf65e2877f76 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:46.479017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97f8dc9a-6d2b-4dc8-9a17-bf65e2877f76 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:46.479450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97f8dc9a-6d2b-4dc8-9a17-bf65e2877f76 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:46.480160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97f8dc9a-6d2b-4dc8-9a17-bf65e2877f76 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:46.480615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97f8dc9a-6d2b-4dc8-9a17-bf65e2877f76 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:46.481211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97f8dc9a-6d2b-4dc8-9a17-bf65e2877f76 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:46.815329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-97f8dc9a-6d2b-4dc8-9a17-bf65e2877f76 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:46.824851 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-97f8dc9a-6d2b-4dc8-9a17-bf65e2877f76 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1322 microversion: 2.1 time: 0.356897 Aug 18 11:36:46.825701 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1334/2600] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:46 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:46.868302 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-85d0fb19-9bc9-4ea1-b6ac-adc3859e8a2c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:46.877955 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-85d0fb19-9bc9-4ea1-b6ac-adc3859e8a2c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1313 microversion: 2.1 time: 0.911690 Aug 18 11:36:46.879773 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1267/2601] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:45 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1313 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:46.907641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5f388995-6a19-4945-9888-1d9ad17ce409 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:46.909184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5f388995-6a19-4945-9888-1d9ad17ce409 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:46.918338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f388995-6a19-4945-9888-1d9ad17ce409 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:46.920405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f388995-6a19-4945-9888-1d9ad17ce409 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:46.921106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f388995-6a19-4945-9888-1d9ad17ce409 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:46.922136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f388995-6a19-4945-9888-1d9ad17ce409 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:46.922879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f388995-6a19-4945-9888-1d9ad17ce409 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:46.923546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f388995-6a19-4945-9888-1d9ad17ce409 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:47.302917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-01ed450f-b52f-4944-b196-308455b58375 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:47.306982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-01ed450f-b52f-4944-b196-308455b58375 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:47.311654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:47.318619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5f388995-6a19-4945-9888-1d9ad17ce409 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:47.326111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01ed450f-b52f-4944-b196-308455b58375 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:47.327239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01ed450f-b52f-4944-b196-308455b58375 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:47.327731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01ed450f-b52f-4944-b196-308455b58375 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:47.330167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01ed450f-b52f-4944-b196-308455b58375 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:47.330545 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5f388995-6a19-4945-9888-1d9ad17ce409 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.430995 Aug 18 11:36:47.331104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01ed450f-b52f-4944-b196-308455b58375 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:47.344802 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1335/2602] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:46 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:47.345949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01ed450f-b52f-4944-b196-308455b58375 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:47.473762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5dfdd7c6-8cb3-4416-b48a-54a290529ad2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:47.475314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5dfdd7c6-8cb3-4416-b48a-54a290529ad2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:47.484130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7c6-8cb3-4416-b48a-54a290529ad2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:47.485016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7c6-8cb3-4416-b48a-54a290529ad2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:47.485755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7c6-8cb3-4416-b48a-54a290529ad2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:47.486695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7c6-8cb3-4416-b48a-54a290529ad2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:47.487346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7c6-8cb3-4416-b48a-54a290529ad2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:47.488330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dfdd7c6-8cb3-4416-b48a-54a290529ad2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:47.607594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5dfdd7c6-8cb3-4416-b48a-54a290529ad2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:47.622197 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5dfdd7c6-8cb3-4416-b48a-54a290529ad2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1271 microversion: 2.1 time: 0.148484 Aug 18 11:36:47.636852 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1336/2603] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:47 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:47.690256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-01ed450f-b52f-4944-b196-308455b58375 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:47.704868 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-01ed450f-b52f-4944-b196-308455b58375 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1477 microversion: 2.1 time: 0.411828 Aug 18 11:36:47.716458 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1268/2604] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:47 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1477 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:47.847590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c90f1832-460b-4729-b23e-96138995b97a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:47.848357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c90f1832-460b-4729-b23e-96138995b97a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:47.862414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c90f1832-460b-4729-b23e-96138995b97a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:47.863320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c90f1832-460b-4729-b23e-96138995b97a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:47.863994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c90f1832-460b-4729-b23e-96138995b97a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:47.865245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c90f1832-460b-4729-b23e-96138995b97a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:47.868974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c90f1832-460b-4729-b23e-96138995b97a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:47.869715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c90f1832-460b-4729-b23e-96138995b97a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:47.905944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0cb6b65b-2253-47f5-a5e6-81820bf172fa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:47.907856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0cb6b65b-2253-47f5-a5e6-81820bf172fa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:47.918934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0cb6b65b-2253-47f5-a5e6-81820bf172fa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:47.920835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0cb6b65b-2253-47f5-a5e6-81820bf172fa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:47.936389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0cb6b65b-2253-47f5-a5e6-81820bf172fa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:47.942158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0cb6b65b-2253-47f5-a5e6-81820bf172fa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:47.944238 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0cb6b65b-2253-47f5-a5e6-81820bf172fa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:47.944909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0cb6b65b-2253-47f5-a5e6-81820bf172fa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:48.173367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:48.255964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0cb6b65b-2253-47f5-a5e6-81820bf172fa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:48.266528 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0cb6b65b-2253-47f5-a5e6-81820bf172fa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1462 microversion: 2.1 time: 0.367270 Aug 18 11:36:48.279889 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1269/2605] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:47 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1462 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:48.580585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-557b3f80-0c68-4b95-8382-861c8dd8e1cf tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:48.588864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-557b3f80-0c68-4b95-8382-861c8dd8e1cf tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Searching by: {'deleted': False, 'project_id': '698592cb656e421eae23b4c505a3348e'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:36:48.593277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c90f1832-460b-4729-b23e-96138995b97a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:48.596604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-557b3f80-0c68-4b95-8382-861c8dd8e1cf tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:48.597265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-557b3f80-0c68-4b95-8382-861c8dd8e1cf tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:48.597859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-557b3f80-0c68-4b95-8382-861c8dd8e1cf tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:48.599050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-557b3f80-0c68-4b95-8382-861c8dd8e1cf tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:48.599717 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-557b3f80-0c68-4b95-8382-861c8dd8e1cf tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:48.600339 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-557b3f80-0c68-4b95-8382-861c8dd8e1cf tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:48.607295 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c90f1832-460b-4729-b23e-96138995b97a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1322 microversion: 2.1 time: 0.765202 Aug 18 11:36:48.621352 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1337/2606] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:47 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1322 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:48.621352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f0e9c30-317d-4d8a-9d7a-09ed34f50ecf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:48.622295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f0e9c30-317d-4d8a-9d7a-09ed34f50ecf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:48.643359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f0e9c30-317d-4d8a-9d7a-09ed34f50ecf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:48.644166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f0e9c30-317d-4d8a-9d7a-09ed34f50ecf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:48.646460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f0e9c30-317d-4d8a-9d7a-09ed34f50ecf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:48.647604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f0e9c30-317d-4d8a-9d7a-09ed34f50ecf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:48.649872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f0e9c30-317d-4d8a-9d7a-09ed34f50ecf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:48.656484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f0e9c30-317d-4d8a-9d7a-09ed34f50ecf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:48.669439 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-557b3f80-0c68-4b95-8382-861c8dd8e1cf tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.378773 Aug 18 11:36:48.688148 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1270/2607] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:36:48 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:36:48.694158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2270f2f9-09a7-46f8-b068-1043c0097827 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:48.695269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2270f2f9-09a7-46f8-b068-1043c0097827 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:48.708417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2270f2f9-09a7-46f8-b068-1043c0097827 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:48.709145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2270f2f9-09a7-46f8-b068-1043c0097827 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:48.709744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2270f2f9-09a7-46f8-b068-1043c0097827 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:48.710688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2270f2f9-09a7-46f8-b068-1043c0097827 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:48.711304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2270f2f9-09a7-46f8-b068-1043c0097827 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:48.711875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2270f2f9-09a7-46f8-b068-1043c0097827 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:49.005112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2f0e9c30-317d-4d8a-9d7a-09ed34f50ecf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:49.021927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2270f2f9-09a7-46f8-b068-1043c0097827 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:49.023650 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f0e9c30-317d-4d8a-9d7a-09ed34f50ecf tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.413023 Aug 18 11:36:49.024565 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1338/2608] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:48 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:49.030324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bd779b38-2734-4bc2-8177-607807a1e9d1 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:49.039283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bd779b38-2734-4bc2-8177-607807a1e9d1 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Searching by: {'deleted': False} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:36:49.045933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd779b38-2734-4bc2-8177-607807a1e9d1 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:49.046718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd779b38-2734-4bc2-8177-607807a1e9d1 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:49.047375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd779b38-2734-4bc2-8177-607807a1e9d1 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:49.048289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd779b38-2734-4bc2-8177-607807a1e9d1 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:49.048917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd779b38-2734-4bc2-8177-607807a1e9d1 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:49.049521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd779b38-2734-4bc2-8177-607807a1e9d1 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:49.059764 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2270f2f9-09a7-46f8-b068-1043c0097827 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1313 microversion: 2.1 time: 0.360144 Aug 18 11:36:49.061297 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1271/2609] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:48 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:49.069848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-87e171a3-7751-4941-b611-a5b3e699616d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:49.071218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-87e171a3-7751-4941-b611-a5b3e699616d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:49.079922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87e171a3-7751-4941-b611-a5b3e699616d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:49.080762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87e171a3-7751-4941-b611-a5b3e699616d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:49.081536 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87e171a3-7751-4941-b611-a5b3e699616d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:49.082544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87e171a3-7751-4941-b611-a5b3e699616d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:49.083190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87e171a3-7751-4941-b611-a5b3e699616d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:49.083771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87e171a3-7751-4941-b611-a5b3e699616d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:49.192526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-bd779b38-2734-4bc2-8177-607807a1e9d1 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:36:49.198005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:49.281130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd779b38-2734-4bc2-8177-607807a1e9d1 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:49.281885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd779b38-2734-4bc2-8177-607807a1e9d1 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:49.282519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd779b38-2734-4bc2-8177-607807a1e9d1 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:49.454034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-87e171a3-7751-4941-b611-a5b3e699616d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:49.469826 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-87e171a3-7751-4941-b611-a5b3e699616d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1476 microversion: 2.1 time: 0.406709 Aug 18 11:36:49.470468 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1272/2610] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:49 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1476 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:49.477043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-c1e5e0e8-25c0-4ff2-ae26-e471364083fe req-26e144ec-716d-4f4f-b542-edd6e891d426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a776f65-9e1f-42e1-93d9-68500a17e6c2", "name": "network-vif-unplugged", "status": "completed", "tag": "d808536d-6bce-46ed-a111-e4d891c6dd78"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:49.497383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c1e5e0e8-25c0-4ff2-ae26-e471364083fe req-26e144ec-716d-4f4f-b542-edd6e891d426 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:49.498407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c1e5e0e8-25c0-4ff2-ae26-e471364083fe req-26e144ec-716d-4f4f-b542-edd6e891d426 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:49.499565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-c1e5e0e8-25c0-4ff2-ae26-e471364083fe req-26e144ec-716d-4f4f-b542-edd6e891d426 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:49.523893 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-c1e5e0e8-25c0-4ff2-ae26-e471364083fe req-26e144ec-716d-4f4f-b542-edd6e891d426 service nova] Creating event network-vif-unplugged:d808536d-6bce-46ed-a111-e4d891c6dd78 for instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 on n-h1-853611-3 Aug 18 11:36:49.549037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [req-c1e5e0e8-25c0-4ff2-ae26-e471364083fe req-26e144ec-716d-4f4f-b542-edd6e891d426 service nova] Instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122209) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 11:36:49.568751 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-c1e5e0e8-25c0-4ff2-ae26-e471364083fe req-26e144ec-716d-4f4f-b542-edd6e891d426 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094718 Aug 18 11:36:49.570328 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1273/2611] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:49.641722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e6f55179-140b-4820-953c-7ad30cfbe11c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:49.642864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e6f55179-140b-4820-953c-7ad30cfbe11c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:49.663772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6f55179-140b-4820-953c-7ad30cfbe11c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:49.664356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6f55179-140b-4820-953c-7ad30cfbe11c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:49.664785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6f55179-140b-4820-953c-7ad30cfbe11c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:49.665804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6f55179-140b-4820-953c-7ad30cfbe11c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:49.666300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6f55179-140b-4820-953c-7ad30cfbe11c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:49.666821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6f55179-140b-4820-953c-7ad30cfbe11c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.012498 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bd779b38-2734-4bc2-8177-607807a1e9d1 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19388 microversion: 2.1 time: 0.986666 Aug 18 11:36:50.014305 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1339/2612] 10.222.0.73 () {58 vars in 1171 bytes} [Thu Aug 18 11:36:49 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19388 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:36:50.052863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2bf4597b-9c81-4992-8032-73d22a5e3487 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:50.053483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2bf4597b-9c81-4992-8032-73d22a5e3487 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:50.063964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bf4597b-9c81-4992-8032-73d22a5e3487 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:50.064501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bf4597b-9c81-4992-8032-73d22a5e3487 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:50.068728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bf4597b-9c81-4992-8032-73d22a5e3487 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.071240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bf4597b-9c81-4992-8032-73d22a5e3487 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:50.072381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bf4597b-9c81-4992-8032-73d22a5e3487 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:50.073055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bf4597b-9c81-4992-8032-73d22a5e3487 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.173464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e6f55179-140b-4820-953c-7ad30cfbe11c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:50.181203 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e6f55179-140b-4820-953c-7ad30cfbe11c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1322 microversion: 2.1 time: 0.554502 Aug 18 11:36:50.195900 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1274/2613] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:49 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1322 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:50.203271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4d38b4d2-7982-4d31-9901-40e6f5cc53d2 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:50.209163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4d38b4d2-7982-4d31-9901-40e6f5cc53d2 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Searching by: {'deleted': False, 'project_id': '698592cb656e421eae23b4c505a3348e'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:36:50.214639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d38b4d2-7982-4d31-9901-40e6f5cc53d2 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:50.215481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d38b4d2-7982-4d31-9901-40e6f5cc53d2 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:50.216993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d38b4d2-7982-4d31-9901-40e6f5cc53d2 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.218813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d38b4d2-7982-4d31-9901-40e6f5cc53d2 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:50.219610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d38b4d2-7982-4d31-9901-40e6f5cc53d2 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:50.220283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d38b4d2-7982-4d31-9901-40e6f5cc53d2 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.257869 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4d38b4d2-7982-4d31-9901-40e6f5cc53d2 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/detail?tenant_id=894e2bd813f444e9bb6075a02985e347" status: 200 len: 15 microversion: 2.1 time: 0.060340 Aug 18 11:36:50.258887 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1275/2614] 10.222.0.73 () {58 vars in 1231 bytes} [Thu Aug 18 11:36:50 2022] GET /compute/v2.1/servers/detail?tenant_id=894e2bd813f444e9bb6075a02985e347 => generated 15 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:36:50.281199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c922f668-7282-4094-8abb-efefe0f1db09 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:50.282193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c922f668-7282-4094-8abb-efefe0f1db09 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:50.295456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c922f668-7282-4094-8abb-efefe0f1db09 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:50.296491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c922f668-7282-4094-8abb-efefe0f1db09 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:50.297255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c922f668-7282-4094-8abb-efefe0f1db09 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.298178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c922f668-7282-4094-8abb-efefe0f1db09 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:50.299057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c922f668-7282-4094-8abb-efefe0f1db09 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:50.299890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c922f668-7282-4094-8abb-efefe0f1db09 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.340342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2bf4597b-9c81-4992-8032-73d22a5e3487 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:50.352964 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2bf4597b-9c81-4992-8032-73d22a5e3487 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.304024 Aug 18 11:36:50.355842 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1340/2615] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:50 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:50.365665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f3c14e26-4f59-4fc4-91ba-6a4fddba735d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:50.380457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f3c14e26-4f59-4fc4-91ba-6a4fddba735d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Searching by: {'tenant_id': '894e2bd813f444e9bb6075a02985e347', 'deleted': False} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:36:50.387845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c14e26-4f59-4fc4-91ba-6a4fddba735d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:50.389355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c14e26-4f59-4fc4-91ba-6a4fddba735d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:50.389974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c14e26-4f59-4fc4-91ba-6a4fddba735d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.391788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c14e26-4f59-4fc4-91ba-6a4fddba735d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:50.392296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c14e26-4f59-4fc4-91ba-6a4fddba735d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:50.392948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c14e26-4f59-4fc4-91ba-6a4fddba735d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.438412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-f3c14e26-4f59-4fc4-91ba-6a4fddba735d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:36:50.518561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c14e26-4f59-4fc4-91ba-6a4fddba735d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:50.519456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c14e26-4f59-4fc4-91ba-6a4fddba735d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:50.520095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c14e26-4f59-4fc4-91ba-6a4fddba735d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.724515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c922f668-7282-4094-8abb-efefe0f1db09 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:50.727606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:50.735973 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c922f668-7282-4094-8abb-efefe0f1db09 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1313 microversion: 2.1 time: 0.471092 Aug 18 11:36:50.744631 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1276/2616] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:50 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1313 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:50.759086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-b7974f05-6f48-41a9-9747-672433c98447 req-5e95eb37-bd7e-43fb-b170-81b2af2e49ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f665d8-ddd8-4030-be59-efb1140ef80e", "name": "network-vif-plugged", "status": "completed", "tag": "c56130e0-5b17-4391-828c-7beff1aa7e98"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:50.775585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b7974f05-6f48-41a9-9747-672433c98447 req-5e95eb37-bd7e-43fb-b170-81b2af2e49ad service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:50.785330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b7974f05-6f48-41a9-9747-672433c98447 req-5e95eb37-bd7e-43fb-b170-81b2af2e49ad service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:50.786080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b7974f05-6f48-41a9-9747-672433c98447 req-5e95eb37-bd7e-43fb-b170-81b2af2e49ad service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.807213 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-b7974f05-6f48-41a9-9747-672433c98447 req-5e95eb37-bd7e-43fb-b170-81b2af2e49ad service nova] Creating event network-vif-plugged:c56130e0-5b17-4391-828c-7beff1aa7e98 for instance d6f665d8-ddd8-4030-be59-efb1140ef80e on n-h1-853611-3 Aug 18 11:36:50.812901 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f3c14e26-4f59-4fc4-91ba-6a4fddba735d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=894e2bd813f444e9bb6075a02985e347" status: 200 len: 4824 microversion: 2.1 time: 0.452703 Aug 18 11:36:50.813520 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1341/2617] 10.222.0.73 () {58 vars in 1257 bytes} [Thu Aug 18 11:36:50 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=894e2bd813f444e9bb6075a02985e347 => generated 4824 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:50.822862 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-b7974f05-6f48-41a9-9747-672433c98447 req-5e95eb37-bd7e-43fb-b170-81b2af2e49ad service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074034 Aug 18 11:36:50.822862 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1277/2618] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:50.838267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c2008001-5742-48b9-8337-9e3d778d5189 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:50.840883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c2008001-5742-48b9-8337-9e3d778d5189 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:50.841219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f20b325-e412-4d3a-835c-f2f122077942 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:50.860683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f20b325-e412-4d3a-835c-f2f122077942 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Searching by: {'tenant_id': '698592cb656e421eae23b4c505a3348e', 'deleted': False} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:36:50.863400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2008001-5742-48b9-8337-9e3d778d5189 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:50.864430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2008001-5742-48b9-8337-9e3d778d5189 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:50.865814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2008001-5742-48b9-8337-9e3d778d5189 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.866606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2008001-5742-48b9-8337-9e3d778d5189 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:50.867082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2008001-5742-48b9-8337-9e3d778d5189 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:50.869689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2008001-5742-48b9-8337-9e3d778d5189 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.881596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f20b325-e412-4d3a-835c-f2f122077942 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:50.885280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f20b325-e412-4d3a-835c-f2f122077942 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:50.889426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f20b325-e412-4d3a-835c-f2f122077942 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.890580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f20b325-e412-4d3a-835c-f2f122077942 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:50.892184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f20b325-e412-4d3a-835c-f2f122077942 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:50.894049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f20b325-e412-4d3a-835c-f2f122077942 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:50.969324 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f20b325-e412-4d3a-835c-f2f122077942 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=698592cb656e421eae23b4c505a3348e" status: 200 len: 15 microversion: 2.1 time: 0.132564 Aug 18 11:36:50.971699 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1342/2619] 10.222.0.73 () {58 vars in 1257 bytes} [Thu Aug 18 11:36:50 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=698592cb656e421eae23b4c505a3348e => generated 15 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 11:36:51.001351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-91a7686a-e307-4aab-8e4d-8e70863328bf tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:51.010727 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-91a7686a-e307-4aab-8e4d-8e70863328bf tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.014696 Aug 18 11:36:51.015170 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1343/2620] 10.222.0.73 () {58 vars in 1189 bytes} [Thu Aug 18 11:36:50 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:36:51.042309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f7cc2fab-db51-4c84-8dd5-44a4d1e783fc tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:51.045398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f7cc2fab-db51-4c84-8dd5-44a4d1e783fc tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:51.064678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7cc2fab-db51-4c84-8dd5-44a4d1e783fc tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:51.065347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7cc2fab-db51-4c84-8dd5-44a4d1e783fc tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:51.066069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7cc2fab-db51-4c84-8dd5-44a4d1e783fc tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:51.071046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7cc2fab-db51-4c84-8dd5-44a4d1e783fc tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:51.071596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7cc2fab-db51-4c84-8dd5-44a4d1e783fc tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:51.072833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7cc2fab-db51-4c84-8dd5-44a4d1e783fc tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:51.195991 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f7cc2fab-db51-4c84-8dd5-44a4d1e783fc tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831/action" status: 202 len: 0 microversion: 2.1 time: 0.157963 Aug 18 11:36:51.204093 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1344/2621] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:36:51 2022] POST /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:36:51.209540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99bf1844-7209-4f82-acc1-92a494f952e2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:51.210475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-99bf1844-7209-4f82-acc1-92a494f952e2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:51.219626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99bf1844-7209-4f82-acc1-92a494f952e2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:51.220502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99bf1844-7209-4f82-acc1-92a494f952e2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:51.221178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99bf1844-7209-4f82-acc1-92a494f952e2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:51.222485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99bf1844-7209-4f82-acc1-92a494f952e2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:51.223158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99bf1844-7209-4f82-acc1-92a494f952e2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:51.223802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99bf1844-7209-4f82-acc1-92a494f952e2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:51.254871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c2008001-5742-48b9-8337-9e3d778d5189 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:51.263899 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c2008001-5742-48b9-8337-9e3d778d5189 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1476 microversion: 2.1 time: 0.440650 Aug 18 11:36:51.268903 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1278/2622] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:50 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1476 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:51.288217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2c9dbdd3-1a02-42ac-a3bb-7521af7eacff tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:51.308550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2c9dbdd3-1a02-42ac-a3bb-7521af7eacff tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:51.313507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2c9dbdd3-1a02-42ac-a3bb-7521af7eacff tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '894e2bd813f444e9bb6075a02985e347'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:36:51.327529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9dbdd3-1a02-42ac-a3bb-7521af7eacff tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:51.330535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9dbdd3-1a02-42ac-a3bb-7521af7eacff tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:51.330872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9dbdd3-1a02-42ac-a3bb-7521af7eacff tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:51.333703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9dbdd3-1a02-42ac-a3bb-7521af7eacff tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:51.337658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9dbdd3-1a02-42ac-a3bb-7521af7eacff tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:51.338209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9dbdd3-1a02-42ac-a3bb-7521af7eacff tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:51.463608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-99bf1844-7209-4f82-acc1-92a494f952e2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:51.470253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-2c9dbdd3-1a02-42ac-a3bb-7521af7eacff tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:36:51.473466 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-99bf1844-7209-4f82-acc1-92a494f952e2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1322 microversion: 2.1 time: 0.267796 Aug 18 11:36:51.476754 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1345/2623] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:51 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:51.552808 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2c9dbdd3-1a02-42ac-a3bb-7521af7eacff tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.282598 Aug 18 11:36:51.558635 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1279/2624] 10.222.0.73 () {58 vars in 1150 bytes} [Thu Aug 18 11:36:51 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:51.567486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0c7bed65-fdcb-4df3-885a-518f395cff71 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:51.571378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0c7bed65-fdcb-4df3-885a-518f395cff71 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:51.581545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c7bed65-fdcb-4df3-885a-518f395cff71 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:51.582252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c7bed65-fdcb-4df3-885a-518f395cff71 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:51.582811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c7bed65-fdcb-4df3-885a-518f395cff71 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:51.583782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c7bed65-fdcb-4df3-885a-518f395cff71 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:51.584360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c7bed65-fdcb-4df3-885a-518f395cff71 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:51.585070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c7bed65-fdcb-4df3-885a-518f395cff71 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:51.757959 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0c7bed65-fdcb-4df3-885a-518f395cff71 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831/action" status: 202 len: 0 microversion: 2.1 time: 0.196484 Aug 18 11:36:51.759289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7d9c87f-5945-442d-b76a-1c7409e2faf5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:51.760479 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1280/2625] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:36:51 2022] POST /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:36:51.763897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e7d9c87f-5945-442d-b76a-1c7409e2faf5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:51.775631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7d9c87f-5945-442d-b76a-1c7409e2faf5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:51.779275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7d9c87f-5945-442d-b76a-1c7409e2faf5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:51.780060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7d9c87f-5945-442d-b76a-1c7409e2faf5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:51.781087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7d9c87f-5945-442d-b76a-1c7409e2faf5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:51.783586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7d9c87f-5945-442d-b76a-1c7409e2faf5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:51.784045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7d9c87f-5945-442d-b76a-1c7409e2faf5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:51.786699 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-a0a6d3f8-b613-4aff-95ea-1597f5cb9521 req-4ad17dbb-00db-4595-bad1-c98a2da7e1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a776f65-9e1f-42e1-93d9-68500a17e6c2", "tag": "d808536d-6bce-46ed-a111-e4d891c6dd78"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:51.815911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a0a6d3f8-b613-4aff-95ea-1597f5cb9521 req-4ad17dbb-00db-4595-bad1-c98a2da7e1e0 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:51.815911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a0a6d3f8-b613-4aff-95ea-1597f5cb9521 req-4ad17dbb-00db-4595-bad1-c98a2da7e1e0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:51.815911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a0a6d3f8-b613-4aff-95ea-1597f5cb9521 req-4ad17dbb-00db-4595-bad1-c98a2da7e1e0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:51.847505 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-a0a6d3f8-b613-4aff-95ea-1597f5cb9521 req-4ad17dbb-00db-4595-bad1-c98a2da7e1e0 service nova] Creating event network-changed:d808536d-6bce-46ed-a111-e4d891c6dd78 for instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 on n-h1-853611-3 Aug 18 11:36:51.864527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [req-a0a6d3f8-b613-4aff-95ea-1597f5cb9521 req-4ad17dbb-00db-4595-bad1-c98a2da7e1e0 service nova] Instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122209) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 11:36:51.883223 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-a0a6d3f8-b613-4aff-95ea-1597f5cb9521 req-4ad17dbb-00db-4595-bad1-c98a2da7e1e0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113105 Aug 18 11:36:51.891229 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1281/2626] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:51.899405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e346397e-ddde-4112-be1c-09bd30b32569 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:51.900454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e346397e-ddde-4112-be1c-09bd30b32569 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:51.908033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e346397e-ddde-4112-be1c-09bd30b32569 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:51.910972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e346397e-ddde-4112-be1c-09bd30b32569 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:51.912303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e346397e-ddde-4112-be1c-09bd30b32569 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:51.913959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e346397e-ddde-4112-be1c-09bd30b32569 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:51.914849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e346397e-ddde-4112-be1c-09bd30b32569 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:51.915505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e346397e-ddde-4112-be1c-09bd30b32569 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:52.084940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e7d9c87f-5945-442d-b76a-1c7409e2faf5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:52.098872 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e7d9c87f-5945-442d-b76a-1c7409e2faf5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.610713 Aug 18 11:36:52.099477 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1346/2627] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:51 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:52.118378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6e83532e-080e-47f8-be7b-4e92a4897954 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:52.123559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6e83532e-080e-47f8-be7b-4e92a4897954 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:52.135688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e83532e-080e-47f8-be7b-4e92a4897954 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:52.137651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e83532e-080e-47f8-be7b-4e92a4897954 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:52.138999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e83532e-080e-47f8-be7b-4e92a4897954 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:52.143786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e83532e-080e-47f8-be7b-4e92a4897954 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:52.144618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e83532e-080e-47f8-be7b-4e92a4897954 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:52.145668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e83532e-080e-47f8-be7b-4e92a4897954 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:52.468917 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6e83532e-080e-47f8-be7b-4e92a4897954 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1615 microversion: 2.1 time: 0.361628 Aug 18 11:36:52.472155 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1347/2628] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:52 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1615 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:52.498038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e50b69c-12bd-4a47-bdcf-84c9610c276b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:52.498997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1e50b69c-12bd-4a47-bdcf-84c9610c276b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:52.505783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e50b69c-12bd-4a47-bdcf-84c9610c276b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:52.506291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e50b69c-12bd-4a47-bdcf-84c9610c276b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:52.506767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e50b69c-12bd-4a47-bdcf-84c9610c276b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:52.507485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e50b69c-12bd-4a47-bdcf-84c9610c276b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:52.507939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e50b69c-12bd-4a47-bdcf-84c9610c276b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:52.510920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e50b69c-12bd-4a47-bdcf-84c9610c276b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:52.702237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1e50b69c-12bd-4a47-bdcf-84c9610c276b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:52.731558 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1e50b69c-12bd-4a47-bdcf-84c9610c276b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1474 microversion: 2.1 time: 0.240233 Aug 18 11:36:52.732693 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1348/2629] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:52 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1474 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:52.748743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-930d9c9a-be74-40ad-8cae-bb6167bcfde2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:52.749705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-930d9c9a-be74-40ad-8cae-bb6167bcfde2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:52.756079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-930d9c9a-be74-40ad-8cae-bb6167bcfde2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:52.756634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-930d9c9a-be74-40ad-8cae-bb6167bcfde2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:52.757317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-930d9c9a-be74-40ad-8cae-bb6167bcfde2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:52.758025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-930d9c9a-be74-40ad-8cae-bb6167bcfde2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:52.758574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-930d9c9a-be74-40ad-8cae-bb6167bcfde2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:52.759442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-930d9c9a-be74-40ad-8cae-bb6167bcfde2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:52.813904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e346397e-ddde-4112-be1c-09bd30b32569 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:52.823043 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e346397e-ddde-4112-be1c-09bd30b32569 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1334 microversion: 2.1 time: 0.930088 Aug 18 11:36:52.824348 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1282/2630] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:51 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1334 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:52.829370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7c383b97-723b-4b5c-8e5f-e07685f1f913 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:52.830337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7c383b97-723b-4b5c-8e5f-e07685f1f913 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:52.836546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c383b97-723b-4b5c-8e5f-e07685f1f913 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:52.837253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c383b97-723b-4b5c-8e5f-e07685f1f913 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:52.837693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c383b97-723b-4b5c-8e5f-e07685f1f913 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:52.838402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c383b97-723b-4b5c-8e5f-e07685f1f913 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:52.838907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c383b97-723b-4b5c-8e5f-e07685f1f913 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:52.839338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c383b97-723b-4b5c-8e5f-e07685f1f913 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:52.923532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-930d9c9a-be74-40ad-8cae-bb6167bcfde2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:52.931381 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-930d9c9a-be74-40ad-8cae-bb6167bcfde2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1322 microversion: 2.1 time: 0.187367 Aug 18 11:36:52.932376 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1349/2631] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:52 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:52.988519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-25f0257c-6177-468d-ab3b-d3216f824601 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Calling method '.version_select at 0x7f519f8ef3a0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:53.011349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-25f0257c-6177-468d-ab3b-d3216f824601 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d28c4699-9533-45ea-8a11-d2ae9925637c does not exist", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:36:53.011965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.security_group_api [None req-25f0257c-6177-468d-ab3b-d3216f824601 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Neutron security group d28c4699-9533-45ea-8a11-d2ae9925637c not found {{(pid=122210) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:36:53.012502 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-25f0257c-6177-468d-ab3b-d3216f824601 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] HTTP exception thrown: Security group d28c4699-9533-45ea-8a11-d2ae9925637c does not exist Aug 18 11:36:53.012502 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-d9974ad3-da73-45a9-907c-37300ecd44f5'] Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-25f0257c-6177-468d-ab3b-d3216f824601 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Request method failure captured: Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/os-security-groups/d28c4699-9533-45ea-8a11-d2ae9925637c HTTP/1.1 Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iRUl97ao_rgTXoZC4AqSDM1uNgo9M2hHg6Fr9jW8l3KRGnB52L57NKuPwa6CNG0963piXVHMLtGzTulfVerRbxdpOPecxZpnrP4ssgcmioShmwtXDfS26lDiH8fxhhMr4wBfZGadNc9CiKhOCVcmizmNGHikVstiIt74biq61ZPWVM Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 15ba754136b94c9a94e21c283b17198d Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1818647675 Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15ba754136b94c9a94e21c283b17198d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15ba754136b94c9a94e21c283b17198d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15ba754136b94c9a94e21c283b17198d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15ba754136b94c9a94e21c283b17198d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1818647675 Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 15ba754136b94c9a94e21c283b17198d Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1818647675 Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupsNegativeTestJSON-1818647675-project Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 8edeb9b0d9c3438b9aec84efbd5a628e Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1818647675-project Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: exception: Security group d28c4699-9533-45ea-8a11-d2ae9925637c does not exist Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-d9974ad3-da73-45a9-907c-37300ecd44f5'] Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'd28c4699-9533-45ea-8a11-d2ae9925637c'} Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:36:53.014948 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d28c4699-9533-45ea-8a11-d2ae9925637c does not exist Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9974ad3-da73-45a9-907c-37300ecd44f5'] Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d28c4699-9533-45ea-8a11-d2ae9925637c does not exist Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9974ad3-da73-45a9-907c-37300ecd44f5'] Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d28c4699-9533-45ea-8a11-d2ae9925637c does not exist Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9974ad3-da73-45a9-907c-37300ecd44f5'] Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d28c4699-9533-45ea-8a11-d2ae9925637c does not exist Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9974ad3-da73-45a9-907c-37300ecd44f5'] Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-25f0257c-6177-468d-ab3b-d3216f824601 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Returning 404 to user: Security group d28c4699-9533-45ea-8a11-d2ae9925637c does not exist Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-d9974ad3-da73-45a9-907c-37300ecd44f5'] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-25f0257c-6177-468d-ab3b-d3216f824601 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/d28c4699-9533-45ea-8a11-d2ae9925637c" status: 404 len: 194 microversion: 2.1 time: 0.083123 Aug 18 11:36:53.019063 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1350/2632] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:36:52 2022] DELETE /compute/v2.1/os-security-groups/d28c4699-9533-45ea-8a11-d2ae9925637c => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:36:53.027982 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bf3ac9a4-98bb-4d98-b0e3-ed92f72dec05 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003769 Aug 18 11:36:53.028444 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1351/2633] 10.222.0.73 () {58 vars in 1164 bytes} [Thu Aug 18 11:36:53 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 11:36:53.038196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-719af100-79e4-49d8-9c63-f4ee3411672a tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Calling method '.version_select at 0x7f51b0de08b0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:53.207315 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-719af100-79e4-49d8-9c63-f4ee3411672a tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] 10.222.0.73 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.172889 Aug 18 11:36:53.212248 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1352/2634] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:36:53 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:53.214007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f2a371af-d438-447d-a007-edd69f23175d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:53.215872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f2a371af-d438-447d-a007-edd69f23175d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:53.219274 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7c383b97-723b-4b5c-8e5f-e07685f1f913 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1615 microversion: 2.1 time: 0.392347 Aug 18 11:36:53.220107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:53.222384 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1283/2635] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:52 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1615 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:53.223995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2a371af-d438-447d-a007-edd69f23175d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:53.225058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2a371af-d438-447d-a007-edd69f23175d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:53.225512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2a371af-d438-447d-a007-edd69f23175d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:53.226219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2a371af-d438-447d-a007-edd69f23175d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:53.226751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2a371af-d438-447d-a007-edd69f23175d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:53.227358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2a371af-d438-447d-a007-edd69f23175d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:53.231058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3b2d101-6177-4ddf-bf3d-59906e25fbf3 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Calling method '.version_select at 0x7f519f83de50>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:53.375846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f2a371af-d438-447d-a007-edd69f23175d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:53.390149 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f2a371af-d438-447d-a007-edd69f23175d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.180343 Aug 18 11:36:53.390791 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1353/2636] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:53 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:53.395342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b3801da-13d3-4f01-a20c-94240714b204 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:53.402595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b3801da-13d3-4f01-a20c-94240714b204 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Searching by: {'host': 'n-h2-853611-3', 'deleted': False} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:36:53.408112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b3801da-13d3-4f01-a20c-94240714b204 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:53.408813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b3801da-13d3-4f01-a20c-94240714b204 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:53.409413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b3801da-13d3-4f01-a20c-94240714b204 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:53.410309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b3801da-13d3-4f01-a20c-94240714b204 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:53.411102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b3801da-13d3-4f01-a20c-94240714b204 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:53.411688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b3801da-13d3-4f01-a20c-94240714b204 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:53.516664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-5b3801da-13d3-4f01-a20c-94240714b204 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:36:53.581333 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b3801da-13d3-4f01-a20c-94240714b204 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "GET /compute/v2.1/servers?host=n-h2-853611-3&all_tenants=1" status: 200 len: 1963 microversion: 2.1 time: 0.189465 Aug 18 11:36:53.581928 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1354/2637] 10.222.0.73 () {58 vars in 1190 bytes} [Thu Aug 18 11:36:53 2022] GET /compute/v2.1/servers?host=n-h2-853611-3&all_tenants=1 => generated 1963 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:53.596120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-36b1e1b3-0ed4-413d-989c-d4947bf00c3d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:53.602254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-36b1e1b3-0ed4-413d-989c-d4947bf00c3d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:36:53.607553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36b1e1b3-0ed4-413d-989c-d4947bf00c3d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:53.608110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36b1e1b3-0ed4-413d-989c-d4947bf00c3d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:53.608610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36b1e1b3-0ed4-413d-989c-d4947bf00c3d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:53.609398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36b1e1b3-0ed4-413d-989c-d4947bf00c3d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:53.609919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36b1e1b3-0ed4-413d-989c-d4947bf00c3d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:53.610480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36b1e1b3-0ed4-413d-989c-d4947bf00c3d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:53.641831 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-36b1e1b3-0ed4-413d-989c-d4947bf00c3d tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.050523 Aug 18 11:36:53.642374 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1355/2638] 10.222.0.73 () {58 vars in 1196 bytes} [Thu Aug 18 11:36:53 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:36:53.654758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-336f2df9-a3fd-4993-9651-dda6217f3179 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:53.657205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-336f2df9-a3fd-4993-9651-dda6217f3179 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:53.680415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-336f2df9-a3fd-4993-9651-dda6217f3179 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:53.680918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-336f2df9-a3fd-4993-9651-dda6217f3179 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:53.681358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-336f2df9-a3fd-4993-9651-dda6217f3179 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:53.682078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-336f2df9-a3fd-4993-9651-dda6217f3179 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:53.682766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-336f2df9-a3fd-4993-9651-dda6217f3179 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:53.683032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-336f2df9-a3fd-4993-9651-dda6217f3179 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:53.736797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG neutronclient.v2_0.client [None req-d3b2d101-6177-4ddf-bf3d-59906e25fbf3 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122209) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:36:53.737742 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-d3b2d101-6177-4ddf-bf3d-59906e25fbf3 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 18 11:36:53.737742 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-33b72cb1-8e52-40d0-bded-9acb4434bf57'] Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3b2d101-6177-4ddf-bf3d-59906e25fbf3 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Request method failure captured: Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-security-groups/6e62ae67-86ff-40f4-84b6-6290b1e11e3a HTTP/1.1 Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iRUl97ao_rgTXoZC4AqSDM1uNgo9M2hHg6Fr9jW8l3KRGnB52L57NKuPwa6CNG0963piXVHMLtGzTulfVerRbxdpOPecxZpnrP4ssgcmioShmwtXDfS26lDiH8fxhhMr4wBfZGadNc9CiKhOCVcmizmNGHikVstiIt74biq61ZPWVM Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 15ba754136b94c9a94e21c283b17198d Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1818647675 Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15ba754136b94c9a94e21c283b17198d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15ba754136b94c9a94e21c283b17198d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15ba754136b94c9a94e21c283b17198d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15ba754136b94c9a94e21c283b17198d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1818647675 Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 15ba754136b94c9a94e21c283b17198d Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1818647675 Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-SecurityGroupsNegativeTestJSON-1818647675-project Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 8edeb9b0d9c3438b9aec84efbd5a628e Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1818647675-project Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: exception: Insufficient rights for removing default security group. Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-33b72cb1-8e52-40d0-bded-9acb4434bf57'] Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '6e62ae67-86ff-40f4-84b6-6290b1e11e3a'} Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:36:53.740819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33b72cb1-8e52-40d0-bded-9acb4434bf57'] Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33b72cb1-8e52-40d0-bded-9acb4434bf57'] Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33b72cb1-8e52-40d0-bded-9acb4434bf57'] Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33b72cb1-8e52-40d0-bded-9acb4434bf57'] Aug 18 11:36:53.744855 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.754323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3b2d101-6177-4ddf-bf3d-59906e25fbf3 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 18 11:36:53.754323 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-33b72cb1-8e52-40d0-bded-9acb4434bf57'] {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:36:53.756112 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d3b2d101-6177-4ddf-bf3d-59906e25fbf3 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/6e62ae67-86ff-40f4-84b6-6290b1e11e3a" status: 400 len: 182 microversion: 2.1 time: 0.531351 Aug 18 11:36:53.756998 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1284/2639] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:36:53 2022] DELETE /compute/v2.1/os-security-groups/6e62ae67-86ff-40f4-84b6-6290b1e11e3a => generated 182 bytes in 533 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:36:53.773363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-450d52cf-ef8d-46e0-8fbb-4dacf0dd59f3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:53.774282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-450d52cf-ef8d-46e0-8fbb-4dacf0dd59f3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:53.784448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-450d52cf-ef8d-46e0-8fbb-4dacf0dd59f3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:53.785673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-450d52cf-ef8d-46e0-8fbb-4dacf0dd59f3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:53.786269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-450d52cf-ef8d-46e0-8fbb-4dacf0dd59f3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:53.787208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-450d52cf-ef8d-46e0-8fbb-4dacf0dd59f3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:53.787876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-450d52cf-ef8d-46e0-8fbb-4dacf0dd59f3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:53.788458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-450d52cf-ef8d-46e0-8fbb-4dacf0dd59f3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:53.838881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:53.855486 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-336f2df9-a3fd-4993-9651-dda6217f3179 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831/action" status: 202 len: 0 microversion: 2.1 time: 0.205115 Aug 18 11:36:53.857399 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1356/2640] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:36:53 2022] POST /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:36:53.862716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8c7860b2-ff80-4a4f-be75-dd7eecfe746d tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Calling method '.version_select at 0x7f519f8ef040>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:53.891584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-8c7860b2-ff80-4a4f-be75-dd7eecfe746d tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9bc21ae4-b9ef-4221-873b-2c3cd8ee22d0 does not exist", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:36:53.892185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.security_group_api [None req-8c7860b2-ff80-4a4f-be75-dd7eecfe746d tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Neutron security group 9bc21ae4-b9ef-4221-873b-2c3cd8ee22d0 not found {{(pid=122210) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:36:53.892705 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-8c7860b2-ff80-4a4f-be75-dd7eecfe746d tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] HTTP exception thrown: Security group 9bc21ae4-b9ef-4221-873b-2c3cd8ee22d0 does not exist Aug 18 11:36:53.892705 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-efcd4f15-e307-4720-9da5-b2d0f5a13284'] Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8c7860b2-ff80-4a4f-be75-dd7eecfe746d tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Request method failure captured: Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-security-groups/9bc21ae4-b9ef-4221-873b-2c3cd8ee22d0 HTTP/1.1 Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iRUl97ao_rgTXoZC4AqSDM1uNgo9M2hHg6Fr9jW8l3KRGnB52L57NKuPwa6CNG0963piXVHMLtGzTulfVerRbxdpOPecxZpnrP4ssgcmioShmwtXDfS26lDiH8fxhhMr4wBfZGadNc9CiKhOCVcmizmNGHikVstiIt74biq61ZPWVM Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 15ba754136b94c9a94e21c283b17198d Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1818647675 Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15ba754136b94c9a94e21c283b17198d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15ba754136b94c9a94e21c283b17198d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15ba754136b94c9a94e21c283b17198d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15ba754136b94c9a94e21c283b17198d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1818647675 Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 15ba754136b94c9a94e21c283b17198d Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1818647675 Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupsNegativeTestJSON-1818647675-project Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 8edeb9b0d9c3438b9aec84efbd5a628e Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1818647675-project Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: exception: Security group 9bc21ae4-b9ef-4221-873b-2c3cd8ee22d0 does not exist Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-efcd4f15-e307-4720-9da5-b2d0f5a13284'] Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '9bc21ae4-b9ef-4221-873b-2c3cd8ee22d0'} Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:36:53.895022 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9bc21ae4-b9ef-4221-873b-2c3cd8ee22d0 does not exist Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efcd4f15-e307-4720-9da5-b2d0f5a13284'] Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9bc21ae4-b9ef-4221-873b-2c3cd8ee22d0 does not exist Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efcd4f15-e307-4720-9da5-b2d0f5a13284'] Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9bc21ae4-b9ef-4221-873b-2c3cd8ee22d0 does not exist Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efcd4f15-e307-4720-9da5-b2d0f5a13284'] Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9bc21ae4-b9ef-4221-873b-2c3cd8ee22d0 does not exist Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efcd4f15-e307-4720-9da5-b2d0f5a13284'] Aug 18 11:36:53.899040 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:53.902413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8c7860b2-ff80-4a4f-be75-dd7eecfe746d tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Returning 404 to user: Security group 9bc21ae4-b9ef-4221-873b-2c3cd8ee22d0 does not exist Aug 18 11:36:53.902413 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-efcd4f15-e307-4720-9da5-b2d0f5a13284'] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:36:53.905008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=14 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:53.905822 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8c7860b2-ff80-4a4f-be75-dd7eecfe746d tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] 10.222.0.73 "GET /compute/v2.1/os-security-groups/9bc21ae4-b9ef-4221-873b-2c3cd8ee22d0" status: 404 len: 194 microversion: 2.1 time: 0.044745 Aug 18 11:36:53.906620 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1357/2641] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:36:53 2022] GET /compute/v2.1/os-security-groups/9bc21ae4-b9ef-4221-873b-2c3cd8ee22d0 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:36:53.913812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b7dbb8ef-b8b3-40ac-81e5-c5a886d60247 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:53.914803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b7dbb8ef-b8b3-40ac-81e5-c5a886d60247 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:53.923088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7dbb8ef-b8b3-40ac-81e5-c5a886d60247 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:53.924008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7dbb8ef-b8b3-40ac-81e5-c5a886d60247 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:53.924598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7dbb8ef-b8b3-40ac-81e5-c5a886d60247 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:53.925473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7dbb8ef-b8b3-40ac-81e5-c5a886d60247 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:53.926263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7dbb8ef-b8b3-40ac-81e5-c5a886d60247 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:53.926857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7dbb8ef-b8b3-40ac-81e5-c5a886d60247 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:54.063734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-450d52cf-ef8d-46e0-8fbb-4dacf0dd59f3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:54.074022 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-450d52cf-ef8d-46e0-8fbb-4dacf0dd59f3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1474 microversion: 2.1 time: 0.315781 Aug 18 11:36:54.076240 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1285/2642] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:53 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1474 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:54.091773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:54.095007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:54.110521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:54.111066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:54.111468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:54.112187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:54.112646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:54.113074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:54.142367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b7dbb8ef-b8b3-40ac-81e5-c5a886d60247 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:54.165159 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b7dbb8ef-b8b3-40ac-81e5-c5a886d60247 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1334 microversion: 2.1 time: 0.257314 Aug 18 11:36:54.166649 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1358/2643] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:53 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1334 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:54.175003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-511cbe97-27ce-4c63-8d37-a18cd34bc761 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Action: 'update', calling method: .version_select at 0x7f519f962ca0>, body: {"security_group": {"name": "tempest-sg-1004888436", "description": "tempest-description-2084900468"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:54.209330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-511cbe97-27ce-4c63-8d37-a18cd34bc761 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9a5f72dc-8406-43f6-963f-0570b46cc68c does not exist", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:36:54.211126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.security_group_api [None req-511cbe97-27ce-4c63-8d37-a18cd34bc761 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Neutron security group 9a5f72dc-8406-43f6-963f-0570b46cc68c not found {{(pid=122210) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:36:54.211846 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-511cbe97-27ce-4c63-8d37-a18cd34bc761 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] HTTP exception thrown: Security group 9a5f72dc-8406-43f6-963f-0570b46cc68c does not exist Aug 18 11:36:54.211846 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-43f7f929-89b9-4e8b-b994-df71aa05bd70'] Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-511cbe97-27ce-4c63-8d37-a18cd34bc761 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Request method failure captured: Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: request: PUT /compute/v2.1/os-security-groups/9a5f72dc-8406-43f6-963f-0570b46cc68c HTTP/1.1 Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 102 Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iRUl97ao_rgTXoZC4AqSDM1uNgo9M2hHg6Fr9jW8l3KRGnB52L57NKuPwa6CNG0963piXVHMLtGzTulfVerRbxdpOPecxZpnrP4ssgcmioShmwtXDfS26lDiH8fxhhMr4wBfZGadNc9CiKhOCVcmizmNGHikVstiIt74biq61ZPWVM Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 15ba754136b94c9a94e21c283b17198d Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1818647675 Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15ba754136b94c9a94e21c283b17198d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15ba754136b94c9a94e21c283b17198d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15ba754136b94c9a94e21c283b17198d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15ba754136b94c9a94e21c283b17198d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1818647675 Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 15ba754136b94c9a94e21c283b17198d Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1818647675 Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupsNegativeTestJSON-1818647675-project Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 8edeb9b0d9c3438b9aec84efbd5a628e Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1818647675-project Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: {"security_group": {"name": "tempest-sg-1004888436", "description": "tempest-description-2084900468"}} Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: exception: Security group 9a5f72dc-8406-43f6-963f-0570b46cc68c does not exist Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-43f7f929-89b9-4e8b-b994-df71aa05bd70'] Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '9a5f72dc-8406-43f6-963f-0570b46cc68c', 'body': {'security_group': {'name': 'tempest-sg-1004888436', 'description': 'tempest-description-2084900468'}}} Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:36:54.214882 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9a5f72dc-8406-43f6-963f-0570b46cc68c does not exist Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43f7f929-89b9-4e8b-b994-df71aa05bd70'] Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9a5f72dc-8406-43f6-963f-0570b46cc68c does not exist Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43f7f929-89b9-4e8b-b994-df71aa05bd70'] Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9a5f72dc-8406-43f6-963f-0570b46cc68c does not exist Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43f7f929-89b9-4e8b-b994-df71aa05bd70'] Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9a5f72dc-8406-43f6-963f-0570b46cc68c does not exist Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-43f7f929-89b9-4e8b-b994-df71aa05bd70'] Aug 18 11:36:54.220924 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:36:54.229366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-511cbe97-27ce-4c63-8d37-a18cd34bc761 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] Returning 404 to user: Security group 9a5f72dc-8406-43f6-963f-0570b46cc68c does not exist Aug 18 11:36:54.229366 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-43f7f929-89b9-4e8b-b994-df71aa05bd70'] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:36:54.229366 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-511cbe97-27ce-4c63-8d37-a18cd34bc761 tempest-SecurityGroupsNegativeTestJSON-1818647675 tempest-SecurityGroupsNegativeTestJSON-1818647675-project] 10.222.0.73 "PUT /compute/v2.1/os-security-groups/9a5f72dc-8406-43f6-963f-0570b46cc68c" status: 404 len: 194 microversion: 2.1 time: 0.060614 Aug 18 11:36:54.232445 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1359/2644] 10.222.0.73 () {60 vars in 1290 bytes} [Thu Aug 18 11:36:54 2022] PUT /compute/v2.1/os-security-groups/9a5f72dc-8406-43f6-963f-0570b46cc68c => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:36:54.239838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-905d1892-e5d3-4609-a562-83712f0b5fc0 req-b36107fc-fe8a-435c-8228-edb18fe4f9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb63b82-28e4-406d-99a1-7db826bdbdba", "tag": "8c0e9b28-a496-42b5-9c34-aa959d63c0b6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:54.261087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-905d1892-e5d3-4609-a562-83712f0b5fc0 req-b36107fc-fe8a-435c-8228-edb18fe4f9ce service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:54.266040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-905d1892-e5d3-4609-a562-83712f0b5fc0 req-b36107fc-fe8a-435c-8228-edb18fe4f9ce service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:54.267919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-905d1892-e5d3-4609-a562-83712f0b5fc0 req-b36107fc-fe8a-435c-8228-edb18fe4f9ce service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:54.268646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:36:54.269311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:36:54.270171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:36:54.270831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:36:54.271453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:36:54.296458 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-905d1892-e5d3-4609-a562-83712f0b5fc0 req-b36107fc-fe8a-435c-8228-edb18fe4f9ce service nova] Creating event network-changed:8c0e9b28-a496-42b5-9c34-aa959d63c0b6 for instance 7cb63b82-28e4-406d-99a1-7db826bdbdba on n-h2-853611-3 Aug 18 11:36:54.313230 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-905d1892-e5d3-4609-a562-83712f0b5fc0 req-b36107fc-fe8a-435c-8228-edb18fe4f9ce service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079233 Aug 18 11:36:54.314537 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1360/2645] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:54.320897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3697de90-30a2-4466-82fc-aad4cefecee5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:54.324640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3697de90-30a2-4466-82fc-aad4cefecee5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:54.341127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3697de90-30a2-4466-82fc-aad4cefecee5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:54.342589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3697de90-30a2-4466-82fc-aad4cefecee5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:54.343228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3697de90-30a2-4466-82fc-aad4cefecee5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:54.345312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3697de90-30a2-4466-82fc-aad4cefecee5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:54.347284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3697de90-30a2-4466-82fc-aad4cefecee5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:54.347964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3697de90-30a2-4466-82fc-aad4cefecee5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:54.401003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:54.416545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:54.417053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:54.419348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:54.422982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:54.425100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:54.425632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:54.491376 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e80da69a-dbfd-4e85-a5d6-d271137d2292 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "POST /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831/action" status: 202 len: 1068 microversion: 2.1 time: 0.408845 Aug 18 11:36:54.492268 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1286/2646] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:36:54 2022] POST /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831/action => generated 1068 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 18 11:36:54.504481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-a509c9cf-da08-42f3-b294-ee084fd0ed7f req-f38e2167-aeeb-454e-b90e-8bdafe039a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c13227-b6f4-49d7-b40b-2ec356ca3f92", "name": "network-vif-plugged", "status": "completed", "tag": "630a62a3-889b-4229-8783-b230eb367435"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:54.526661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a509c9cf-da08-42f3-b294-ee084fd0ed7f req-f38e2167-aeeb-454e-b90e-8bdafe039a89 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:54.530713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a509c9cf-da08-42f3-b294-ee084fd0ed7f req-f38e2167-aeeb-454e-b90e-8bdafe039a89 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:54.531257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a509c9cf-da08-42f3-b294-ee084fd0ed7f req-f38e2167-aeeb-454e-b90e-8bdafe039a89 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:54.572008 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-a509c9cf-da08-42f3-b294-ee084fd0ed7f req-f38e2167-aeeb-454e-b90e-8bdafe039a89 service nova] Creating event network-vif-plugged:630a62a3-889b-4229-8783-b230eb367435 for instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 on n-h1-853611-3 Aug 18 11:36:54.590922 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-a509c9cf-da08-42f3-b294-ee084fd0ed7f req-f38e2167-aeeb-454e-b90e-8bdafe039a89 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097136 Aug 18 11:36:54.592342 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1287/2647] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:54.599704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4a800626-5b51-4c85-b487-6806a8d1b1ef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:54.600560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4a800626-5b51-4c85-b487-6806a8d1b1ef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:54.611550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a800626-5b51-4c85-b487-6806a8d1b1ef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:54.612227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a800626-5b51-4c85-b487-6806a8d1b1ef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:54.612742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a800626-5b51-4c85-b487-6806a8d1b1ef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:54.614538 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a800626-5b51-4c85-b487-6806a8d1b1ef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:54.615234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a800626-5b51-4c85-b487-6806a8d1b1ef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:54.615860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a800626-5b51-4c85-b487-6806a8d1b1ef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:54.770675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3697de90-30a2-4466-82fc-aad4cefecee5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:54.783901 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3697de90-30a2-4466-82fc-aad4cefecee5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1322 microversion: 2.1 time: 0.467964 Aug 18 11:36:54.784890 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1361/2648] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:54 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1322 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:54.790042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b5db7628-8e17-402a-a463-8dde49ec469d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:54.790975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b5db7628-8e17-402a-a463-8dde49ec469d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:54.797869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5db7628-8e17-402a-a463-8dde49ec469d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:54.798699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5db7628-8e17-402a-a463-8dde49ec469d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:54.799408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5db7628-8e17-402a-a463-8dde49ec469d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:54.800399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5db7628-8e17-402a-a463-8dde49ec469d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:54.801143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5db7628-8e17-402a-a463-8dde49ec469d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:54.801786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5db7628-8e17-402a-a463-8dde49ec469d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:55.054943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4a800626-5b51-4c85-b487-6806a8d1b1ef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:55.085809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b5db7628-8e17-402a-a463-8dde49ec469d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:55.093231 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4a800626-5b51-4c85-b487-6806a8d1b1ef tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.484599 Aug 18 11:36:55.099000 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b5db7628-8e17-402a-a463-8dde49ec469d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1472 microversion: 2.1 time: 0.312724 Aug 18 11:36:55.113075 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1362/2649] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:54 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:55.116144 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1288/2650] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:54 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:55.117900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f5204cd0-1a43-4645-93f2-0a61c3c7a65e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:55.121029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f5204cd0-1a43-4645-93f2-0a61c3c7a65e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:55.127580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5204cd0-1a43-4645-93f2-0a61c3c7a65e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:55.128423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5204cd0-1a43-4645-93f2-0a61c3c7a65e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:55.129079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5204cd0-1a43-4645-93f2-0a61c3c7a65e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:55.129991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5204cd0-1a43-4645-93f2-0a61c3c7a65e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:55.131385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5204cd0-1a43-4645-93f2-0a61c3c7a65e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:55.133309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5204cd0-1a43-4645-93f2-0a61c3c7a65e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:55.193728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4e82bc7a-4feb-45fe-b2c1-456bfdb61920 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:55.194350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4e82bc7a-4feb-45fe-b2c1-456bfdb61920 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:55.202973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e82bc7a-4feb-45fe-b2c1-456bfdb61920 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:55.203491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e82bc7a-4feb-45fe-b2c1-456bfdb61920 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:55.204253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e82bc7a-4feb-45fe-b2c1-456bfdb61920 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:55.204980 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e82bc7a-4feb-45fe-b2c1-456bfdb61920 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:55.205489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e82bc7a-4feb-45fe-b2c1-456bfdb61920 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:55.206821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e82bc7a-4feb-45fe-b2c1-456bfdb61920 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:55.381822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f5204cd0-1a43-4645-93f2-0a61c3c7a65e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:55.404179 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f5204cd0-1a43-4645-93f2-0a61c3c7a65e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1474 microversion: 2.1 time: 0.289288 Aug 18 11:36:55.412864 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1363/2651] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:55 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1474 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:55.540492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4e82bc7a-4feb-45fe-b2c1-456bfdb61920 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:55.552113 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4e82bc7a-4feb-45fe-b2c1-456bfdb61920 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1334 microversion: 2.1 time: 0.367067 Aug 18 11:36:55.552713 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1289/2652] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:55 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1334 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:55.809812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3e7a3764-5c58-4359-8715-5edabc8191c8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:55.812201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3e7a3764-5c58-4359-8715-5edabc8191c8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:55.819955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e7a3764-5c58-4359-8715-5edabc8191c8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:55.822611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e7a3764-5c58-4359-8715-5edabc8191c8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:55.823139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e7a3764-5c58-4359-8715-5edabc8191c8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:55.826913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e7a3764-5c58-4359-8715-5edabc8191c8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:55.829776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e7a3764-5c58-4359-8715-5edabc8191c8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:55.830236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e7a3764-5c58-4359-8715-5edabc8191c8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:56.115246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fb28b5b8-c0e3-4f47-b9a7-0449cf99fdb7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:56.116858 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fb28b5b8-c0e3-4f47-b9a7-0449cf99fdb7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:56.148732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb28b5b8-c0e3-4f47-b9a7-0449cf99fdb7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:56.150381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb28b5b8-c0e3-4f47-b9a7-0449cf99fdb7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:56.151835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb28b5b8-c0e3-4f47-b9a7-0449cf99fdb7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:56.157493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb28b5b8-c0e3-4f47-b9a7-0449cf99fdb7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:56.158640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb28b5b8-c0e3-4f47-b9a7-0449cf99fdb7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:56.159485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb28b5b8-c0e3-4f47-b9a7-0449cf99fdb7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:56.197396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3e7a3764-5c58-4359-8715-5edabc8191c8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:56.211336 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3e7a3764-5c58-4359-8715-5edabc8191c8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1322 microversion: 2.1 time: 0.405668 Aug 18 11:36:56.225759 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1364/2653] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:55 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:56.230717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e45c4466-b416-4f8a-ac8e-830c527deca8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:56.231334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e45c4466-b416-4f8a-ac8e-830c527deca8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:56.238716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e45c4466-b416-4f8a-ac8e-830c527deca8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:56.239717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e45c4466-b416-4f8a-ac8e-830c527deca8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:56.240378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e45c4466-b416-4f8a-ac8e-830c527deca8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:56.241326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e45c4466-b416-4f8a-ac8e-830c527deca8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:56.242013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e45c4466-b416-4f8a-ac8e-830c527deca8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:56.242699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e45c4466-b416-4f8a-ac8e-830c527deca8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:56.598809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e45c4466-b416-4f8a-ac8e-830c527deca8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:56.617820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e45c4466-b416-4f8a-ac8e-830c527deca8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1472 microversion: 2.1 time: 0.390942 Aug 18 11:36:56.619689 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1365/2654] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:56 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:56.638605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3486f25f-f791-4394-8dd2-f0ebb42b2164 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:56.639810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3486f25f-f791-4394-8dd2-f0ebb42b2164 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:56.647694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3486f25f-f791-4394-8dd2-f0ebb42b2164 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:56.648525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3486f25f-f791-4394-8dd2-f0ebb42b2164 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:56.648962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3486f25f-f791-4394-8dd2-f0ebb42b2164 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:56.649698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3486f25f-f791-4394-8dd2-f0ebb42b2164 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:56.650159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3486f25f-f791-4394-8dd2-f0ebb42b2164 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:56.650629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3486f25f-f791-4394-8dd2-f0ebb42b2164 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:56.815923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fb28b5b8-c0e3-4f47-b9a7-0449cf99fdb7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:56.830392 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fb28b5b8-c0e3-4f47-b9a7-0449cf99fdb7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1512 microversion: 2.1 time: 0.719230 Aug 18 11:36:56.844433 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1290/2655] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:56 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1512 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:56.844433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-ea3dcfd6-d2ce-4483-955c-c4fe68fbc433 req-d8c5422f-cbcb-481c-95a9-7578380b3035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cb63b82-28e4-406d-99a1-7db826bdbdba", "tag": "71c242f8-d0aa-4cf7-ae41-4a9b10c9f1e1"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:56.853421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ea3dcfd6-d2ce-4483-955c-c4fe68fbc433 req-d8c5422f-cbcb-481c-95a9-7578380b3035 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:56.853955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ea3dcfd6-d2ce-4483-955c-c4fe68fbc433 req-d8c5422f-cbcb-481c-95a9-7578380b3035 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:56.854771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ea3dcfd6-d2ce-4483-955c-c4fe68fbc433 req-d8c5422f-cbcb-481c-95a9-7578380b3035 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:56.868259 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ea3dcfd6-d2ce-4483-955c-c4fe68fbc433 req-d8c5422f-cbcb-481c-95a9-7578380b3035 service nova] Creating event network-changed:71c242f8-d0aa-4cf7-ae41-4a9b10c9f1e1 for instance 7cb63b82-28e4-406d-99a1-7db826bdbdba on n-h2-853611-3 Aug 18 11:36:56.874674 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-ea3dcfd6-d2ce-4483-955c-c4fe68fbc433 req-d8c5422f-cbcb-481c-95a9-7578380b3035 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037609 Aug 18 11:36:56.878585 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1291/2656] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:56.887245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bf6d2b03-4cd1-4f11-866b-a8b06b2b3816 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:56.888259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bf6d2b03-4cd1-4f11-866b-a8b06b2b3816 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:56.895388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf6d2b03-4cd1-4f11-866b-a8b06b2b3816 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:56.896239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf6d2b03-4cd1-4f11-866b-a8b06b2b3816 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:56.897029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf6d2b03-4cd1-4f11-866b-a8b06b2b3816 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:56.897936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf6d2b03-4cd1-4f11-866b-a8b06b2b3816 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:56.898638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf6d2b03-4cd1-4f11-866b-a8b06b2b3816 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:56.899235 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf6d2b03-4cd1-4f11-866b-a8b06b2b3816 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:56.959567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3486f25f-f791-4394-8dd2-f0ebb42b2164 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:56.984406 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3486f25f-f791-4394-8dd2-f0ebb42b2164 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1471 microversion: 2.1 time: 0.358431 Aug 18 11:36:56.987645 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1366/2657] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:56 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1471 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:57.018762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1eb7c85d-bc76-4c45-aba0-0f1e09bf8cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:57.019598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1eb7c85d-bc76-4c45-aba0-0f1e09bf8cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:57.027803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eb7c85d-bc76-4c45-aba0-0f1e09bf8cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:57.028942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eb7c85d-bc76-4c45-aba0-0f1e09bf8cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:57.029571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eb7c85d-bc76-4c45-aba0-0f1e09bf8cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:57.030300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eb7c85d-bc76-4c45-aba0-0f1e09bf8cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:57.031251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eb7c85d-bc76-4c45-aba0-0f1e09bf8cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:57.031704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eb7c85d-bc76-4c45-aba0-0f1e09bf8cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:57.103613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bf6d2b03-4cd1-4f11-866b-a8b06b2b3816 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:57.107791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:57.115700 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bf6d2b03-4cd1-4f11-866b-a8b06b2b3816 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1334 microversion: 2.1 time: 0.234795 Aug 18 11:36:57.121792 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1292/2658] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:56 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1334 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:57.156108 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1eb7c85d-bc76-4c45-aba0-0f1e09bf8cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "POST /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2/action" status: 204 len: 0 microversion: 2.1 time: 0.146846 Aug 18 11:36:57.156770 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1367/2659] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:36:57 2022] POST /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2/action => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:36:57.165129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-71a38d2e-c536-44bd-b2a4-429b57cbbc40 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:57.165781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-71a38d2e-c536-44bd-b2a4-429b57cbbc40 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:57.175509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71a38d2e-c536-44bd-b2a4-429b57cbbc40 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:57.176248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71a38d2e-c536-44bd-b2a4-429b57cbbc40 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:57.176872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71a38d2e-c536-44bd-b2a4-429b57cbbc40 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:57.178115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71a38d2e-c536-44bd-b2a4-429b57cbbc40 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:57.178795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71a38d2e-c536-44bd-b2a4-429b57cbbc40 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:57.179353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71a38d2e-c536-44bd-b2a4-429b57cbbc40 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:57.233216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f185679-18b5-41d8-b015-e019c16fcc5d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:57.233989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f185679-18b5-41d8-b015-e019c16fcc5d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:57.247669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f185679-18b5-41d8-b015-e019c16fcc5d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:57.248266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f185679-18b5-41d8-b015-e019c16fcc5d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:57.248559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f185679-18b5-41d8-b015-e019c16fcc5d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:57.249241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f185679-18b5-41d8-b015-e019c16fcc5d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:57.249735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f185679-18b5-41d8-b015-e019c16fcc5d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:57.250168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f185679-18b5-41d8-b015-e019c16fcc5d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:57.357008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-71a38d2e-c536-44bd-b2a4-429b57cbbc40 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:57.365519 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-71a38d2e-c536-44bd-b2a4-429b57cbbc40 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1471 microversion: 2.1 time: 0.204411 Aug 18 11:36:57.374128 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1293/2660] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:57 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1471 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:57.488948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2f185679-18b5-41d8-b015-e019c16fcc5d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:57.496481 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f185679-18b5-41d8-b015-e019c16fcc5d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1322 microversion: 2.1 time: 0.268154 Aug 18 11:36:57.497854 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1368/2661] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:57 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:57.640056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f2c655df-9450-49ac-a530-f5a97970c5a8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:57.640957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f2c655df-9450-49ac-a530-f5a97970c5a8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:57.647549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2c655df-9450-49ac-a530-f5a97970c5a8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:57.648362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2c655df-9450-49ac-a530-f5a97970c5a8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:57.649244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2c655df-9450-49ac-a530-f5a97970c5a8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:57.650180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2c655df-9450-49ac-a530-f5a97970c5a8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:57.650890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2c655df-9450-49ac-a530-f5a97970c5a8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:57.651669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2c655df-9450-49ac-a530-f5a97970c5a8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:57.834639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f2c655df-9450-49ac-a530-f5a97970c5a8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:57.843841 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f2c655df-9450-49ac-a530-f5a97970c5a8 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1472 microversion: 2.1 time: 0.207672 Aug 18 11:36:57.844568 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1294/2662] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:57 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1472 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:57.858687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f33a7df4-23b6-4655-afa2-bf1a4585ecb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:57.858687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f33a7df4-23b6-4655-afa2-bf1a4585ecb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:57.860671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f33a7df4-23b6-4655-afa2-bf1a4585ecb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:57.861345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f33a7df4-23b6-4655-afa2-bf1a4585ecb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:57.861828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f33a7df4-23b6-4655-afa2-bf1a4585ecb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:57.862561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f33a7df4-23b6-4655-afa2-bf1a4585ecb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:57.863723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f33a7df4-23b6-4655-afa2-bf1a4585ecb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:57.864333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f33a7df4-23b6-4655-afa2-bf1a4585ecb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:58.092596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f33a7df4-23b6-4655-afa2-bf1a4585ecb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:58.101499 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f33a7df4-23b6-4655-afa2-bf1a4585ecb9 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1489 microversion: 2.1 time: 0.253390 Aug 18 11:36:58.113079 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1369/2663] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:57 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1489 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:58.125765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cb6f65b0-1a5a-4f95-b99a-7d6389c9f06b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:58.126304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cb6f65b0-1a5a-4f95-b99a-7d6389c9f06b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:58.137163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2382bc5f-9e6f-42f0-b76c-423b8ffc669b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:58.139274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2382bc5f-9e6f-42f0-b76c-423b8ffc669b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:58.144240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb6f65b0-1a5a-4f95-b99a-7d6389c9f06b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:58.146791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb6f65b0-1a5a-4f95-b99a-7d6389c9f06b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:58.147484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb6f65b0-1a5a-4f95-b99a-7d6389c9f06b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:58.153911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb6f65b0-1a5a-4f95-b99a-7d6389c9f06b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:58.156147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb6f65b0-1a5a-4f95-b99a-7d6389c9f06b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:58.157943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2382bc5f-9e6f-42f0-b76c-423b8ffc669b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:58.158744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb6f65b0-1a5a-4f95-b99a-7d6389c9f06b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:58.161446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2382bc5f-9e6f-42f0-b76c-423b8ffc669b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:58.162201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2382bc5f-9e6f-42f0-b76c-423b8ffc669b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:58.163067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2382bc5f-9e6f-42f0-b76c-423b8ffc669b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:58.165802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2382bc5f-9e6f-42f0-b76c-423b8ffc669b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:58.166393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2382bc5f-9e6f-42f0-b76c-423b8ffc669b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:58.221262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cb6f65b0-1a5a-4f95-b99a-7d6389c9f06b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:36:58.377656 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cb6f65b0-1a5a-4f95-b99a-7d6389c9f06b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 204 len: 0 microversion: 2.1 time: 0.248570 Aug 18 11:36:58.383292 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1295/2664] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:36:58 2022] DELETE /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:36:58.392572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-07d14984-f599-47f5-a295-4bcf9b83050a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:58.393675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-07d14984-f599-47f5-a295-4bcf9b83050a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:58.406174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07d14984-f599-47f5-a295-4bcf9b83050a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:58.406799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07d14984-f599-47f5-a295-4bcf9b83050a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:58.408005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07d14984-f599-47f5-a295-4bcf9b83050a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:58.408786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07d14984-f599-47f5-a295-4bcf9b83050a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:58.409927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07d14984-f599-47f5-a295-4bcf9b83050a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:58.411068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07d14984-f599-47f5-a295-4bcf9b83050a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:58.541321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2382bc5f-9e6f-42f0-b76c-423b8ffc669b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:58.553304 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2382bc5f-9e6f-42f0-b76c-423b8ffc669b tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1334 microversion: 2.1 time: 0.419847 Aug 18 11:36:58.568510 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1370/2665] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:58 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1334 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:36:58.574273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4e0af49a-7c93-4b1f-982f-feb800f80758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:58.575661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4e0af49a-7c93-4b1f-982f-feb800f80758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:58.583838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e0af49a-7c93-4b1f-982f-feb800f80758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:58.584636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e0af49a-7c93-4b1f-982f-feb800f80758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:58.585230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e0af49a-7c93-4b1f-982f-feb800f80758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:58.586295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e0af49a-7c93-4b1f-982f-feb800f80758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:58.586932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e0af49a-7c93-4b1f-982f-feb800f80758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:58.587582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e0af49a-7c93-4b1f-982f-feb800f80758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:58.717552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-07d14984-f599-47f5-a295-4bcf9b83050a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:58.729523 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-07d14984-f599-47f5-a295-4bcf9b83050a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1471 microversion: 2.1 time: 0.344689 Aug 18 11:36:58.730489 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1296/2666] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:58 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1471 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:58.737036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-76496ebe-973e-4717-a307-a7ee99816406 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:58.738221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-76496ebe-973e-4717-a307-a7ee99816406 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:58.744156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76496ebe-973e-4717-a307-a7ee99816406 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:58.744747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76496ebe-973e-4717-a307-a7ee99816406 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:58.745266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76496ebe-973e-4717-a307-a7ee99816406 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:58.746131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76496ebe-973e-4717-a307-a7ee99816406 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:58.749639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76496ebe-973e-4717-a307-a7ee99816406 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:58.749639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76496ebe-973e-4717-a307-a7ee99816406 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:58.864052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4e0af49a-7c93-4b1f-982f-feb800f80758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:58.882167 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4e0af49a-7c93-4b1f-982f-feb800f80758 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1495 microversion: 2.1 time: 0.312138 Aug 18 11:36:58.883031 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1371/2667] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:58 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1495 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:58.892755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7a1cd008-a4d5-49ad-8725-23d41e3b7147 req-11ea0673-c68e-43ab-ab6e-401eecf5b38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a776f65-9e1f-42e1-93d9-68500a17e6c2", "name": "network-vif-plugged", "status": "completed", "tag": "d808536d-6bce-46ed-a111-e4d891c6dd78"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:58.905562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a1cd008-a4d5-49ad-8725-23d41e3b7147 req-11ea0673-c68e-43ab-ab6e-401eecf5b38f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:58.906313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a1cd008-a4d5-49ad-8725-23d41e3b7147 req-11ea0673-c68e-43ab-ab6e-401eecf5b38f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:58.906935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a1cd008-a4d5-49ad-8725-23d41e3b7147 req-11ea0673-c68e-43ab-ab6e-401eecf5b38f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:58.929671 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7a1cd008-a4d5-49ad-8725-23d41e3b7147 req-11ea0673-c68e-43ab-ab6e-401eecf5b38f service nova] Creating event network-vif-plugged:d808536d-6bce-46ed-a111-e4d891c6dd78 for instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 on n-h1-853611-3 Aug 18 11:36:58.937226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-7a1cd008-a4d5-49ad-8725-23d41e3b7147 req-11ea0673-c68e-43ab-ab6e-401eecf5b38f service nova] Instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 11:36:58.951663 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7a1cd008-a4d5-49ad-8725-23d41e3b7147 req-11ea0673-c68e-43ab-ab6e-401eecf5b38f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067053 Aug 18 11:36:58.952757 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1372/2668] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:58.958637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-513c3c66-8920-4a88-a770-94bb940f4f94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:58.959411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-513c3c66-8920-4a88-a770-94bb940f4f94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:58.967724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-513c3c66-8920-4a88-a770-94bb940f4f94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:58.968272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-513c3c66-8920-4a88-a770-94bb940f4f94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:58.968824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-513c3c66-8920-4a88-a770-94bb940f4f94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:58.969942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-513c3c66-8920-4a88-a770-94bb940f4f94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:58.970539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-513c3c66-8920-4a88-a770-94bb940f4f94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:58.971065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-513c3c66-8920-4a88-a770-94bb940f4f94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:59.197559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-513c3c66-8920-4a88-a770-94bb940f4f94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:59.207783 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-513c3c66-8920-4a88-a770-94bb940f4f94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1472 microversion: 2.1 time: 0.253789 Aug 18 11:36:59.208735 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1373/2669] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:58 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:59.444752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-76496ebe-973e-4717-a307-a7ee99816406 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:59.461423 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-76496ebe-973e-4717-a307-a7ee99816406 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1516 microversion: 2.1 time: 0.729891 Aug 18 11:36:59.463309 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1297/2670] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:58 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1516 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:36:59.480714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fe648ac4-39b9-43fa-86ba-0018dfb554ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:59.484043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-36dbee36-c280-4724-b8e1-fc862b46daee tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:36:59.487291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-36dbee36-c280-4724-b8e1-fc862b46daee tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:59.487802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fe648ac4-39b9-43fa-86ba-0018dfb554ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:59.488767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fe648ac4-39b9-43fa-86ba-0018dfb554ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Searching by: {'deleted': False, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:36:59.508467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe648ac4-39b9-43fa-86ba-0018dfb554ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:59.509977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36dbee36-c280-4724-b8e1-fc862b46daee tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:59.510695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe648ac4-39b9-43fa-86ba-0018dfb554ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:59.511298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36dbee36-c280-4724-b8e1-fc862b46daee tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:59.511839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe648ac4-39b9-43fa-86ba-0018dfb554ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:59.513732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36dbee36-c280-4724-b8e1-fc862b46daee tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:59.514819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe648ac4-39b9-43fa-86ba-0018dfb554ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:59.515282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe648ac4-39b9-43fa-86ba-0018dfb554ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:59.516106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36dbee36-c280-4724-b8e1-fc862b46daee tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:59.516576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36dbee36-c280-4724-b8e1-fc862b46daee tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:59.517009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36dbee36-c280-4724-b8e1-fc862b46daee tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:59.520017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe648ac4-39b9-43fa-86ba-0018dfb554ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:59.566355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-fe648ac4-39b9-43fa-86ba-0018dfb554ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:36:59.571103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-36dbee36-c280-4724-b8e1-fc862b46daee tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lazy-loading 'flavor' on Instance uuid 77c13227-b6f4-49d7-b40b-2ec356ca3f92 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:36:59.612532 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fe648ac4-39b9-43fa-86ba-0018dfb554ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.131806 Aug 18 11:36:59.626527 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1374/2671] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 18 11:36:59 2022] GET /compute/v2.1/servers => generated 334 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:36:59.632765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c15f21fd-8ce9-49b6-b9a1-84728a968b04 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:59.633396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c15f21fd-8ce9-49b6-b9a1-84728a968b04 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:36:59.653931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c15f21fd-8ce9-49b6-b9a1-84728a968b04 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:59.654370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c15f21fd-8ce9-49b6-b9a1-84728a968b04 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:59.654861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c15f21fd-8ce9-49b6-b9a1-84728a968b04 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:59.655548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c15f21fd-8ce9-49b6-b9a1-84728a968b04 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:59.656010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c15f21fd-8ce9-49b6-b9a1-84728a968b04 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:59.656443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c15f21fd-8ce9-49b6-b9a1-84728a968b04 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:59.666190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:36:59.752663 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-36dbee36-c280-4724-b8e1-fc862b46daee tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92/action" status: 200 len: 32 microversion: 2.1 time: 0.272773 Aug 18 11:36:59.753111 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1298/2672] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:36:59 2022] POST /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92/action => generated 32 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:36:59.763451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:36:59.770916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:59.771967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Searching by: {'deleted': False, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:36:59.781407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:59.782727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:59.783713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:59.785588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:59.786194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:59.786740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:36:59.832961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:36:59.871896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:36:59.882620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:36:59.883272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:36:59.883790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:00.016966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c15f21fd-8ce9-49b6-b9a1-84728a968b04 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:00.056066 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c15f21fd-8ce9-49b6-b9a1-84728a968b04 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1334 microversion: 2.1 time: 0.427853 Aug 18 11:37:00.064783 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1375/2673] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:36:59 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1334 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:00.078651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d0150caa-a16e-4362-a476-334f34e1f1b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:00.080435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d0150caa-a16e-4362-a476-334f34e1f1b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:00.091328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0150caa-a16e-4362-a476-334f34e1f1b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:00.092284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0150caa-a16e-4362-a476-334f34e1f1b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:00.110966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0150caa-a16e-4362-a476-334f34e1f1b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:00.113362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0150caa-a16e-4362-a476-334f34e1f1b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:00.114220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0150caa-a16e-4362-a476-334f34e1f1b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:00.115049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0150caa-a16e-4362-a476-334f34e1f1b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:00.152836 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-513498b8-1f8f-4f42-bb0e-9e8c155f3c28 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.398509 Aug 18 11:37:00.154790 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1299/2674] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:36:59 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:00.169745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a177de4d-56e3-4f0f-97d5-c850c40c51a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:00.172298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a177de4d-56e3-4f0f-97d5-c850c40c51a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:00.184046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a177de4d-56e3-4f0f-97d5-c850c40c51a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:00.195791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a177de4d-56e3-4f0f-97d5-c850c40c51a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:00.196500 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a177de4d-56e3-4f0f-97d5-c850c40c51a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:00.197553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a177de4d-56e3-4f0f-97d5-c850c40c51a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:00.198320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a177de4d-56e3-4f0f-97d5-c850c40c51a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:00.198932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a177de4d-56e3-4f0f-97d5-c850c40c51a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:00.492950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=20 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:00.498420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a177de4d-56e3-4f0f-97d5-c850c40c51a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:00.507808 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a177de4d-56e3-4f0f-97d5-c850c40c51a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.351712 Aug 18 11:37:00.511487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d0150caa-a16e-4362-a476-334f34e1f1b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:00.512025 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1300/2675] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:00 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:00.519622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f89b8e4f-a5ce-4d37-ba8d-693789dd2e67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:00.520591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f89b8e4f-a5ce-4d37-ba8d-693789dd2e67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:00.521325 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d0150caa-a16e-4362-a476-334f34e1f1b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1471 microversion: 2.1 time: 0.453740 Aug 18 11:37:00.523278 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1376/2676] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:00 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1471 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:00.535417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a1dec80-f306-4f64-a272-86d505c9ba7c tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:00.538544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f89b8e4f-a5ce-4d37-ba8d-693789dd2e67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:00.539311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f89b8e4f-a5ce-4d37-ba8d-693789dd2e67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:00.540534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f89b8e4f-a5ce-4d37-ba8d-693789dd2e67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:00.541578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f89b8e4f-a5ce-4d37-ba8d-693789dd2e67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:00.542366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f89b8e4f-a5ce-4d37-ba8d-693789dd2e67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:00.544795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f89b8e4f-a5ce-4d37-ba8d-693789dd2e67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:00.563686 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4a1dec80-f306-4f64-a272-86d505c9ba7c tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038832 Aug 18 11:37:00.564276 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1377/2677] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:37:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:37:00.576921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-655a0ac9-0146-4e2e-b7b5-55e78d31d6cf tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:00.577600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-655a0ac9-0146-4e2e-b7b5-55e78d31d6cf tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:00.601613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-655a0ac9-0146-4e2e-b7b5-55e78d31d6cf tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:00.602144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-655a0ac9-0146-4e2e-b7b5-55e78d31d6cf tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:00.602689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-655a0ac9-0146-4e2e-b7b5-55e78d31d6cf tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:00.603464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-655a0ac9-0146-4e2e-b7b5-55e78d31d6cf tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:00.603867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-655a0ac9-0146-4e2e-b7b5-55e78d31d6cf tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:00.604444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-655a0ac9-0146-4e2e-b7b5-55e78d31d6cf tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:00.868986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f89b8e4f-a5ce-4d37-ba8d-693789dd2e67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:00.886381 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f89b8e4f-a5ce-4d37-ba8d-693789dd2e67 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1495 microversion: 2.1 time: 0.363860 Aug 18 11:37:00.887913 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1301/2678] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:00 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1495 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:00.896609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-655a0ac9-0146-4e2e-b7b5-55e78d31d6cf tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:00.909537 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-655a0ac9-0146-4e2e-b7b5-55e78d31d6cf tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1472 microversion: 2.1 time: 0.341321 Aug 18 11:37:00.911264 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1378/2679] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:00 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1472 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:01.082730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0c701f4e-47f8-469e-b051-edf39206d95d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:01.083345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0c701f4e-47f8-469e-b051-edf39206d95d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:01.102321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c701f4e-47f8-469e-b051-edf39206d95d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:01.102925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c701f4e-47f8-469e-b051-edf39206d95d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:01.108389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c701f4e-47f8-469e-b051-edf39206d95d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:01.109416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c701f4e-47f8-469e-b051-edf39206d95d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:01.109905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c701f4e-47f8-469e-b051-edf39206d95d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:01.111036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c701f4e-47f8-469e-b051-edf39206d95d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:01.249030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1c6e5abb-9eba-47ca-a6c9-67c652814cc0 req-1eb411d1-66e9-47a2-89b3-ab05e80db656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee89e61-02ed-4624-bbbe-898aac54e492", "name": "network-vif-deleted", "tag": "37af06aa-0d3d-4f65-9b48-b4c97e8f72f3"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:01.273951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1c6e5abb-9eba-47ca-a6c9-67c652814cc0 req-1eb411d1-66e9-47a2-89b3-ab05e80db656 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:01.288525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1c6e5abb-9eba-47ca-a6c9-67c652814cc0 req-1eb411d1-66e9-47a2-89b3-ab05e80db656 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:01.289226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1c6e5abb-9eba-47ca-a6c9-67c652814cc0 req-1eb411d1-66e9-47a2-89b3-ab05e80db656 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:01.315847 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1c6e5abb-9eba-47ca-a6c9-67c652814cc0 req-1eb411d1-66e9-47a2-89b3-ab05e80db656 service nova] Creating event network-vif-deleted:37af06aa-0d3d-4f65-9b48-b4c97e8f72f3 for instance 2ee89e61-02ed-4624-bbbe-898aac54e492 on n-h1-853611-3 Aug 18 11:37:01.324523 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1c6e5abb-9eba-47ca-a6c9-67c652814cc0 req-1eb411d1-66e9-47a2-89b3-ab05e80db656 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079386 Aug 18 11:37:01.330938 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1379/2680] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:37:01.427912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0c701f4e-47f8-469e-b051-edf39206d95d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:01.440190 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0c701f4e-47f8-469e-b051-edf39206d95d tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1334 microversion: 2.1 time: 0.359876 Aug 18 11:37:01.441097 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1302/2681] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:01 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1334 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:01.535607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-824120d1-2b40-41b8-b4bf-04c0efba4e52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:01.536304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-824120d1-2b40-41b8-b4bf-04c0efba4e52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:01.542668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-824120d1-2b40-41b8-b4bf-04c0efba4e52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:01.543152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-824120d1-2b40-41b8-b4bf-04c0efba4e52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:01.544176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-824120d1-2b40-41b8-b4bf-04c0efba4e52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:01.545095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-824120d1-2b40-41b8-b4bf-04c0efba4e52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:01.545547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0c886bfc-9b8f-4fb5-97a3-f3d5e165cb82 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:01.545994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-824120d1-2b40-41b8-b4bf-04c0efba4e52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:01.545994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-824120d1-2b40-41b8-b4bf-04c0efba4e52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:01.546245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0c886bfc-9b8f-4fb5-97a3-f3d5e165cb82 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:01.552259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c886bfc-9b8f-4fb5-97a3-f3d5e165cb82 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:01.552896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c886bfc-9b8f-4fb5-97a3-f3d5e165cb82 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:01.553443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c886bfc-9b8f-4fb5-97a3-f3d5e165cb82 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:01.554196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c886bfc-9b8f-4fb5-97a3-f3d5e165cb82 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:01.554783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c886bfc-9b8f-4fb5-97a3-f3d5e165cb82 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:01.555270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c886bfc-9b8f-4fb5-97a3-f3d5e165cb82 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:01.707611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-824120d1-2b40-41b8-b4bf-04c0efba4e52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:01.718119 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-824120d1-2b40-41b8-b4bf-04c0efba4e52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.186723 Aug 18 11:37:01.719060 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1380/2682] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:01 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:01.734479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0c886bfc-9b8f-4fb5-97a3-f3d5e165cb82 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:01.742922 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0c886bfc-9b8f-4fb5-97a3-f3d5e165cb82 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1463 microversion: 2.1 time: 0.202768 Aug 18 11:37:01.743630 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1303/2683] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:01 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1463 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:01.765138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bf2bab45-2f67-49e9-9298-4eebb2bd2107 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:01.765944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bf2bab45-2f67-49e9-9298-4eebb2bd2107 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:01.772461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf2bab45-2f67-49e9-9298-4eebb2bd2107 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:01.780805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf2bab45-2f67-49e9-9298-4eebb2bd2107 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:01.783495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf2bab45-2f67-49e9-9298-4eebb2bd2107 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:01.783495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf2bab45-2f67-49e9-9298-4eebb2bd2107 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:01.783495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf2bab45-2f67-49e9-9298-4eebb2bd2107 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:01.783495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf2bab45-2f67-49e9-9298-4eebb2bd2107 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:01.822158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7187d104-193b-4f91-92ec-ab70d9e71255 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:01.822722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7187d104-193b-4f91-92ec-ab70d9e71255 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:01.830753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7187d104-193b-4f91-92ec-ab70d9e71255 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:01.830753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7187d104-193b-4f91-92ec-ab70d9e71255 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:01.830753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7187d104-193b-4f91-92ec-ab70d9e71255 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:01.831542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7187d104-193b-4f91-92ec-ab70d9e71255 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:01.834361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7187d104-193b-4f91-92ec-ab70d9e71255 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:01.834870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7187d104-193b-4f91-92ec-ab70d9e71255 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:01.871619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7187d104-193b-4f91-92ec-ab70d9e71255 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:37:01.887804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:01.951919 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bf2bab45-2f67-49e9-9298-4eebb2bd2107 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1614 microversion: 2.1 time: 0.191547 Aug 18 11:37:01.952635 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1381/2684] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:01 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1614 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:01.961549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fd615a90-269d-4b6f-8b78-8157dfbf0255 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:01.962564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fd615a90-269d-4b6f-8b78-8157dfbf0255 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:01.970468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd615a90-269d-4b6f-8b78-8157dfbf0255 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:01.971378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd615a90-269d-4b6f-8b78-8157dfbf0255 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:01.972043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd615a90-269d-4b6f-8b78-8157dfbf0255 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:01.972951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd615a90-269d-4b6f-8b78-8157dfbf0255 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:01.973782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd615a90-269d-4b6f-8b78-8157dfbf0255 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:01.974566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd615a90-269d-4b6f-8b78-8157dfbf0255 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:02.001723 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7187d104-193b-4f91-92ec-ab70d9e71255 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "DELETE /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 204 len: 0 microversion: 2.1 time: 0.184585 Aug 18 11:37:02.005562 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1304/2685] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:37:01 2022] DELETE /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:37:02.013182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9d74f35e-a70d-4666-a2af-204c907734af tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:02.014114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9d74f35e-a70d-4666-a2af-204c907734af tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:02.020137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd615a90-269d-4b6f-8b78-8157dfbf0255 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:02.021097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd615a90-269d-4b6f-8b78-8157dfbf0255 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:02.021609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd615a90-269d-4b6f-8b78-8157dfbf0255 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:02.022196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-fd615a90-269d-4b6f-8b78-8157dfbf0255 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lazy-loading 'fault' on Instance uuid 2ee89e61-02ed-4624-bbbe-898aac54e492 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:37:02.022599 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d74f35e-a70d-4666-a2af-204c907734af tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:02.023364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d74f35e-a70d-4666-a2af-204c907734af tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:02.024249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d74f35e-a70d-4666-a2af-204c907734af tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:02.025596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d74f35e-a70d-4666-a2af-204c907734af tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:02.026266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d74f35e-a70d-4666-a2af-204c907734af tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:02.027246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d74f35e-a70d-4666-a2af-204c907734af tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:02.075467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fd615a90-269d-4b6f-8b78-8157dfbf0255 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:02.084830 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fd615a90-269d-4b6f-8b78-8157dfbf0255 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 200 len: 1304 microversion: 2.1 time: 0.130420 Aug 18 11:37:02.086695 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1382/2686] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:01 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:02.095615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aaf4cc98-06ab-41ec-b096-bd427b344712 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Calling method '.version_select at 0x7f519f0125e0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:02.102899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaf4cc98-06ab-41ec-b096-bd427b344712 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:02.103522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaf4cc98-06ab-41ec-b096-bd427b344712 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:02.103982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaf4cc98-06ab-41ec-b096-bd427b344712 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:02.113910 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aaf4cc98-06ab-41ec-b096-bd427b344712 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] 10.222.0.73 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.022057 Aug 18 11:37:02.114536 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1383/2687] 10.222.0.73 () {58 vars in 1143 bytes} [Thu Aug 18 11:37:02 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:37:02.120468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a358a0c9-78b3-4b32-a7ff-7b79f4fe1980 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:02.121078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a358a0c9-78b3-4b32-a7ff-7b79f4fe1980 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:02.130269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a358a0c9-78b3-4b32-a7ff-7b79f4fe1980 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:02.131103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a358a0c9-78b3-4b32-a7ff-7b79f4fe1980 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:02.131710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a358a0c9-78b3-4b32-a7ff-7b79f4fe1980 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:02.132608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a358a0c9-78b3-4b32-a7ff-7b79f4fe1980 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:02.133251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a358a0c9-78b3-4b32-a7ff-7b79f4fe1980 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:02.133844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a358a0c9-78b3-4b32-a7ff-7b79f4fe1980 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:02.246146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9d74f35e-a70d-4666-a2af-204c907734af tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:02.254536 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9d74f35e-a70d-4666-a2af-204c907734af tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1472 microversion: 2.1 time: 0.247044 Aug 18 11:37:02.265355 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1305/2688] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:02 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1472 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:02.319073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-796020031", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:02.337254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a358a0c9-78b3-4b32-a7ff-7b79f4fe1980 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:02.347759 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a358a0c9-78b3-4b32-a7ff-7b79f4fe1980 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 200 len: 1700 microversion: 2.1 time: 0.231781 Aug 18 11:37:02.348868 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1384/2689] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:02 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 1700 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:02.375544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:37:02.469487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c87975ba-cad9-4734-8d2e-594499b67561 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:02.470460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c87975ba-cad9-4734-8d2e-594499b67561 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:02.476984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c87975ba-cad9-4734-8d2e-594499b67561 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:02.477676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c87975ba-cad9-4734-8d2e-594499b67561 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:02.478148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c87975ba-cad9-4734-8d2e-594499b67561 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:02.479314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c87975ba-cad9-4734-8d2e-594499b67561 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:02.479837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c87975ba-cad9-4734-8d2e-594499b67561 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:02.480311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c87975ba-cad9-4734-8d2e-594499b67561 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:02.607805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:37:02.608440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:37:02.609073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:37:02.609489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:37:02.609969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:37:02.619007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:02.619545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:02.620026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:02.620899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:02.621487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:02.622031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:02.634743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:02.642894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Getting quotas for project 6387896b424840deb9ef97aae02edd99. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:37:02.649180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Getting quotas for user 9269fc4d233c42a590bfcbfaa7f2e895 and project 6387896b424840deb9ef97aae02edd99. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:37:02.664382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:37:02.666521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:37:02.703878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c87975ba-cad9-4734-8d2e-594499b67561 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:02.712732 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c87975ba-cad9-4734-8d2e-594499b67561 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1334 microversion: 2.1 time: 0.247345 Aug 18 11:37:02.713613 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1385/2690] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:02 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1334 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:02.729717 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-50b6d4ee-492c-4104-aa20-2817355425b4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.414373 Aug 18 11:37:02.732151 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1306/2691] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:37:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:37:02.740459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26bbebab-16e1-4cc2-be44-8275143de957 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:02.741100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26bbebab-16e1-4cc2-be44-8275143de957 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:02.742723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d530094d-3553-48d8-b408-4c05f60e86a3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:02.743344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d530094d-3553-48d8-b408-4c05f60e86a3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:02.758478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26bbebab-16e1-4cc2-be44-8275143de957 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:02.759285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26bbebab-16e1-4cc2-be44-8275143de957 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:02.759958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26bbebab-16e1-4cc2-be44-8275143de957 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:02.760872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26bbebab-16e1-4cc2-be44-8275143de957 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:02.761524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26bbebab-16e1-4cc2-be44-8275143de957 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:02.762215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26bbebab-16e1-4cc2-be44-8275143de957 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:02.821059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d530094d-3553-48d8-b408-4c05f60e86a3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:02.836871 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d530094d-3553-48d8-b408-4c05f60e86a3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1212 microversion: 2.1 time: 0.093992 Aug 18 11:37:02.837711 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1307/2692] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:02 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1212 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:02.923414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-26bbebab-16e1-4cc2-be44-8275143de957 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:02.932302 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-26bbebab-16e1-4cc2-be44-8275143de957 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.196078 Aug 18 11:37:02.933068 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1386/2693] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:02 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:03.116456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1898cdbd-6756-4002-8a7f-3954859fd3cb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:03.117960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1898cdbd-6756-4002-8a7f-3954859fd3cb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:03.128802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1898cdbd-6756-4002-8a7f-3954859fd3cb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:03.129880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1898cdbd-6756-4002-8a7f-3954859fd3cb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:03.130138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1898cdbd-6756-4002-8a7f-3954859fd3cb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:03.131659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1898cdbd-6756-4002-8a7f-3954859fd3cb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:03.132533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1898cdbd-6756-4002-8a7f-3954859fd3cb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:03.133285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1898cdbd-6756-4002-8a7f-3954859fd3cb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:03.158709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-524d79eb-700e-4427-af86-1de91ba7c485 req-f705b383-97fd-4b32-b4e8-3f5d713e42d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb63b82-28e4-406d-99a1-7db826bdbdba", "name": "network-vif-plugged", "status": "completed", "tag": "71c242f8-d0aa-4cf7-ae41-4a9b10c9f1e1"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:03.169706 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-1898cdbd-6756-4002-8a7f-3954859fd3cb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:03.170749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-524d79eb-700e-4427-af86-1de91ba7c485 req-f705b383-97fd-4b32-b4e8-3f5d713e42d4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:03.171507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-524d79eb-700e-4427-af86-1de91ba7c485 req-f705b383-97fd-4b32-b4e8-3f5d713e42d4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:03.172191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-524d79eb-700e-4427-af86-1de91ba7c485 req-f705b383-97fd-4b32-b4e8-3f5d713e42d4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1898cdbd-6756-4002-8a7f-3954859fd3cb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 HTTP/1.1 Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '2ee89e61-02ed-4624-bbbe-898aac54e492'} Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:03.173751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:03.190491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:03.190491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:03.190491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:03.190491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:03.190491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:03.190491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:03.190491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:03.190491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1898cdbd-6756-4002-8a7f-3954859fd3cb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:03.190491 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1898cdbd-6756-4002-8a7f-3954859fd3cb tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 404 len: 111 microversion: 2.1 time: 0.069546 Aug 18 11:37:03.190491 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1308/2694] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:03 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:03.211370 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-524d79eb-700e-4427-af86-1de91ba7c485 req-f705b383-97fd-4b32-b4e8-3f5d713e42d4 service nova] Creating event network-vif-plugged:71c242f8-d0aa-4cf7-ae41-4a9b10c9f1e1 for instance 7cb63b82-28e4-406d-99a1-7db826bdbdba on n-h2-853611-3 Aug 18 11:37:03.218575 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-524d79eb-700e-4427-af86-1de91ba7c485 req-f705b383-97fd-4b32-b4e8-3f5d713e42d4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063772 Aug 18 11:37:03.219466 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1387/2695] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:37:03.281661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-690970dd-9c8a-4ec6-86e8-58c048c93ecd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:03.282689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-690970dd-9c8a-4ec6-86e8-58c048c93ecd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:03.302335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-690970dd-9c8a-4ec6-86e8-58c048c93ecd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:03.304343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-690970dd-9c8a-4ec6-86e8-58c048c93ecd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:03.304981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-690970dd-9c8a-4ec6-86e8-58c048c93ecd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:03.306076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-690970dd-9c8a-4ec6-86e8-58c048c93ecd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:03.306586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-690970dd-9c8a-4ec6-86e8-58c048c93ecd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:03.307024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-690970dd-9c8a-4ec6-86e8-58c048c93ecd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:03.345532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1867115127", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "22608490-9e6a-4848-bc6d-66289c233bc1"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:03.419575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] validate_networks() for [('22608490-9e6a-4848-bc6d-66289c233bc1', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:37:03.572388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-690970dd-9c8a-4ec6-86e8-58c048c93ecd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:03.581804 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-690970dd-9c8a-4ec6-86e8-58c048c93ecd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1472 microversion: 2.1 time: 0.308216 Aug 18 11:37:03.588387 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1309/2696] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:03 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1472 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:03.594263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-531e92b5-5c8a-46b2-9f36-c777e04ca4ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:03.598657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-531e92b5-5c8a-46b2-9f36-c777e04ca4ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:03.613316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-531e92b5-5c8a-46b2-9f36-c777e04ca4ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:03.614718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-531e92b5-5c8a-46b2-9f36-c777e04ca4ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:03.615460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-531e92b5-5c8a-46b2-9f36-c777e04ca4ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:03.616200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-531e92b5-5c8a-46b2-9f36-c777e04ca4ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:03.616653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-531e92b5-5c8a-46b2-9f36-c777e04ca4ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:03.617234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-531e92b5-5c8a-46b2-9f36-c777e04ca4ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:03.872435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-531e92b5-5c8a-46b2-9f36-c777e04ca4ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:03.884341 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-531e92b5-5c8a-46b2-9f36-c777e04ca4ca tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 200 len: 1700 microversion: 2.1 time: 0.294540 Aug 18 11:37:03.885459 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1310/2697] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:03 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 1700 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:03.891931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f44f6f47-aaa1-44f2-8f60-ee631eac421a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:03.893134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f44f6f47-aaa1-44f2-8f60-ee631eac421a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:03.908365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f44f6f47-aaa1-44f2-8f60-ee631eac421a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:03.909070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f44f6f47-aaa1-44f2-8f60-ee631eac421a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:03.910539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f44f6f47-aaa1-44f2-8f60-ee631eac421a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:03.911904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f44f6f47-aaa1-44f2-8f60-ee631eac421a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:03.912966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f44f6f47-aaa1-44f2-8f60-ee631eac421a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:03.913133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f44f6f47-aaa1-44f2-8f60-ee631eac421a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:04.367339 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f44f6f47-aaa1-44f2-8f60-ee631eac421a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:04.382466 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f44f6f47-aaa1-44f2-8f60-ee631eac421a tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1334 microversion: 2.1 time: 0.495605 Aug 18 11:37:04.383361 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1311/2698] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:03 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1334 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:04.389675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fbb41166-9d48-41e5-a2a5-9ff88bf59753 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:04.391436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fbb41166-9d48-41e5-a2a5-9ff88bf59753 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:04.398917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbb41166-9d48-41e5-a2a5-9ff88bf59753 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:04.400617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbb41166-9d48-41e5-a2a5-9ff88bf59753 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:04.404129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbb41166-9d48-41e5-a2a5-9ff88bf59753 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:04.407721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbb41166-9d48-41e5-a2a5-9ff88bf59753 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:04.408579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbb41166-9d48-41e5-a2a5-9ff88bf59753 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:04.409435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbb41166-9d48-41e5-a2a5-9ff88bf59753 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:04.544438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fbb41166-9d48-41e5-a2a5-9ff88bf59753 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:04.563933 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fbb41166-9d48-41e5-a2a5-9ff88bf59753 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1270 microversion: 2.1 time: 0.179260 Aug 18 11:37:04.565780 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1312/2699] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:04 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1270 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:04.572420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c14cf413-59be-48cd-930f-01dda60ea4b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:04.573340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c14cf413-59be-48cd-930f-01dda60ea4b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:04.581694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c14cf413-59be-48cd-930f-01dda60ea4b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:04.582797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c14cf413-59be-48cd-930f-01dda60ea4b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:04.586965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c14cf413-59be-48cd-930f-01dda60ea4b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:04.587657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c14cf413-59be-48cd-930f-01dda60ea4b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:04.589033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c14cf413-59be-48cd-930f-01dda60ea4b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:04.589033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c14cf413-59be-48cd-930f-01dda60ea4b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:04.676841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:37:04.677520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:37:04.678629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:37:04.679755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:37:04.680685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:37:04.697830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:04.702100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:04.702973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:04.704244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:04.704907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:04.705511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:04.726451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Getting quotas for project a98846d5998440dd87f3d85de0bf9d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:37:04.734991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Getting quotas for user 7bf7b0cd3d8740aca2d71944bc371d75 and project a98846d5998440dd87f3d85de0bf9d3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:37:04.753542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:37:04.757850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:37:04.827033 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bfed6c17-c470-4521-8726-dde78a8835be tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.487895 Aug 18 11:37:04.834113 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1388/2700] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:37:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:37:04.842739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2edbf6dd-0952-45d6-bbd7-9dfcb39a987d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:04.843992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2edbf6dd-0952-45d6-bbd7-9dfcb39a987d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:04.854309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edbf6dd-0952-45d6-bbd7-9dfcb39a987d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:04.855037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edbf6dd-0952-45d6-bbd7-9dfcb39a987d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:04.855609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edbf6dd-0952-45d6-bbd7-9dfcb39a987d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:04.857038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edbf6dd-0952-45d6-bbd7-9dfcb39a987d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:04.857786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edbf6dd-0952-45d6-bbd7-9dfcb39a987d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:04.858327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edbf6dd-0952-45d6-bbd7-9dfcb39a987d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:04.979490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c14cf413-59be-48cd-930f-01dda60ea4b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:04.992162 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c14cf413-59be-48cd-930f-01dda60ea4b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.424710 Aug 18 11:37:04.993589 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1313/2701] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:04 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:05.000380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4ca20fa5-3556-4b45-8fa9-a5cc1876cd04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:05.001288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4ca20fa5-3556-4b45-8fa9-a5cc1876cd04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:05.112462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4ca20fa5-3556-4b45-8fa9-a5cc1876cd04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:05.129140 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4ca20fa5-3556-4b45-8fa9-a5cc1876cd04 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1215 microversion: 2.1 time: 0.133986 Aug 18 11:37:05.135293 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1314/2702] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:04 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:05.141175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-501a0744-b4b3-41de-b1fe-092e806cac81 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:05.142130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-501a0744-b4b3-41de-b1fe-092e806cac81 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:05.151541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-501a0744-b4b3-41de-b1fe-092e806cac81 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:05.152374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-501a0744-b4b3-41de-b1fe-092e806cac81 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:05.153679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-501a0744-b4b3-41de-b1fe-092e806cac81 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:05.154671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-501a0744-b4b3-41de-b1fe-092e806cac81 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:05.155463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-501a0744-b4b3-41de-b1fe-092e806cac81 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:05.156320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-501a0744-b4b3-41de-b1fe-092e806cac81 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:05.264116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-501a0744-b4b3-41de-b1fe-092e806cac81 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:05.273066 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-501a0744-b4b3-41de-b1fe-092e806cac81 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 200 len: 1632 microversion: 2.1 time: 0.136406 Aug 18 11:37:05.274247 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1315/2703] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:05 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 1632 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:05.282893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-80110616-b25c-4713-aac9-11e213700f34 req-212cbccd-680e-430b-9a4a-8fba41274a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb63b82-28e4-406d-99a1-7db826bdbdba", "name": "network-vif-plugged", "status": "completed", "tag": "8c0e9b28-a496-42b5-9c34-aa959d63c0b6"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:05.296989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-80110616-b25c-4713-aac9-11e213700f34 req-212cbccd-680e-430b-9a4a-8fba41274a67 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:05.297927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-80110616-b25c-4713-aac9-11e213700f34 req-212cbccd-680e-430b-9a4a-8fba41274a67 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:05.298665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-80110616-b25c-4713-aac9-11e213700f34 req-212cbccd-680e-430b-9a4a-8fba41274a67 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:05.316639 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-80110616-b25c-4713-aac9-11e213700f34 req-212cbccd-680e-430b-9a4a-8fba41274a67 service nova] Creating event network-vif-plugged:8c0e9b28-a496-42b5-9c34-aa959d63c0b6 for instance 7cb63b82-28e4-406d-99a1-7db826bdbdba on n-h2-853611-3 Aug 18 11:37:05.328497 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-80110616-b25c-4713-aac9-11e213700f34 req-212cbccd-680e-430b-9a4a-8fba41274a67 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051996 Aug 18 11:37:05.329623 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1316/2704] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:37:05.334104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2edbf6dd-0952-45d6-bbd7-9dfcb39a987d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:05.345056 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2edbf6dd-0952-45d6-bbd7-9dfcb39a987d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1472 microversion: 2.1 time: 0.509170 Aug 18 11:37:05.346372 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1389/2705] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:04 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1472 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:05.407881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ab9c9473-d711-4fed-a376-368a426a4aa7 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:05.410649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ab9c9473-d711-4fed-a376-368a426a4aa7 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:05.423339 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab9c9473-d711-4fed-a376-368a426a4aa7 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:05.423976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab9c9473-d711-4fed-a376-368a426a4aa7 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:05.438541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab9c9473-d711-4fed-a376-368a426a4aa7 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:05.440338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab9c9473-d711-4fed-a376-368a426a4aa7 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:05.441052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab9c9473-d711-4fed-a376-368a426a4aa7 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:05.441754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab9c9473-d711-4fed-a376-368a426a4aa7 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:05.594747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b046956-b1a2-4e7b-84e4-218f2d4703b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:05.595761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3b046956-b1a2-4e7b-84e4-218f2d4703b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:05.609152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b046956-b1a2-4e7b-84e4-218f2d4703b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:05.610056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b046956-b1a2-4e7b-84e4-218f2d4703b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:05.612813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b046956-b1a2-4e7b-84e4-218f2d4703b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:05.614547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b046956-b1a2-4e7b-84e4-218f2d4703b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:05.615356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b046956-b1a2-4e7b-84e4-218f2d4703b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:05.616378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b046956-b1a2-4e7b-84e4-218f2d4703b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:05.796173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3b046956-b1a2-4e7b-84e4-218f2d4703b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:05.816285 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3b046956-b1a2-4e7b-84e4-218f2d4703b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1270 microversion: 2.1 time: 0.231411 Aug 18 11:37:05.841882 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1390/2706] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:05 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1270 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:05.912683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ab9c9473-d711-4fed-a376-368a426a4aa7 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:05.924131 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ab9c9473-d711-4fed-a376-368a426a4aa7 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1334 microversion: 2.1 time: 0.522295 Aug 18 11:37:05.935571 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1317/2707] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:05 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1334 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:06.015541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1c015f76-094e-4099-8a20-b0067eec0ffc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:06.016218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1c015f76-094e-4099-8a20-b0067eec0ffc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:06.025140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c015f76-094e-4099-8a20-b0067eec0ffc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:06.025755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c015f76-094e-4099-8a20-b0067eec0ffc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:06.026389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c015f76-094e-4099-8a20-b0067eec0ffc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:06.028040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c015f76-094e-4099-8a20-b0067eec0ffc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:06.028908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c015f76-094e-4099-8a20-b0067eec0ffc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:06.030536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c015f76-094e-4099-8a20-b0067eec0ffc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:06.133626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-bd0d5edf-b258-429f-b6e5-9cbd8652ba31 req-4df76da5-f183-4518-9563-3f785e0c399a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43cef527-b63e-455e-bb59-0af5ce753dd2", "name": "network-vif-deleted", "tag": "234ff5c5-55d2-4c13-bb2c-a900c736a26b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:06.155076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bd0d5edf-b258-429f-b6e5-9cbd8652ba31 req-4df76da5-f183-4518-9563-3f785e0c399a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:06.158790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bd0d5edf-b258-429f-b6e5-9cbd8652ba31 req-4df76da5-f183-4518-9563-3f785e0c399a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:06.159486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bd0d5edf-b258-429f-b6e5-9cbd8652ba31 req-4df76da5-f183-4518-9563-3f785e0c399a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:06.189909 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-bd0d5edf-b258-429f-b6e5-9cbd8652ba31 req-4df76da5-f183-4518-9563-3f785e0c399a service nova] Creating event network-vif-deleted:234ff5c5-55d2-4c13-bb2c-a900c736a26b for instance 43cef527-b63e-455e-bb59-0af5ce753dd2 on n-h2-853611-3 Aug 18 11:37:06.204420 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-bd0d5edf-b258-429f-b6e5-9cbd8652ba31 req-4df76da5-f183-4518-9563-3f785e0c399a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074980 Aug 18 11:37:06.207845 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1318/2708] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:37:06.215590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9d96e0c6-3347-451e-8870-fa4c708ee788 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:06.216630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9d96e0c6-3347-451e-8870-fa4c708ee788 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:06.223735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d96e0c6-3347-451e-8870-fa4c708ee788 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:06.224584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d96e0c6-3347-451e-8870-fa4c708ee788 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:06.225419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d96e0c6-3347-451e-8870-fa4c708ee788 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:06.226320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d96e0c6-3347-451e-8870-fa4c708ee788 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:06.226996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d96e0c6-3347-451e-8870-fa4c708ee788 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:06.227611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d96e0c6-3347-451e-8870-fa4c708ee788 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:06.372990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9d96e0c6-3347-451e-8870-fa4c708ee788 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:06.387682 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9d96e0c6-3347-451e-8870-fa4c708ee788 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1267 microversion: 2.1 time: 0.177189 Aug 18 11:37:06.401277 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1319/2709] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:06 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:06.401277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c377a994-79a4-4948-b3a8-bad688f776cb tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:06.406094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c377a994-79a4-4948-b3a8-bad688f776cb tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:06.414645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c377a994-79a4-4948-b3a8-bad688f776cb tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:06.415319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c377a994-79a4-4948-b3a8-bad688f776cb tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:06.417681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c377a994-79a4-4948-b3a8-bad688f776cb tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:06.419031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c377a994-79a4-4948-b3a8-bad688f776cb tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:06.419872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c377a994-79a4-4948-b3a8-bad688f776cb tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:06.431522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c377a994-79a4-4948-b3a8-bad688f776cb tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:06.615989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c377a994-79a4-4948-b3a8-bad688f776cb tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7f8d720a3b14f698850489ae40b9d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '344f7f9d319f4a3fb6d2089c02e8c5a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:06.628549 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c377a994-79a4-4948-b3a8-bad688f776cb tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 200 len: 1354 microversion: 2.1 time: 0.237196 Aug 18 11:37:06.643131 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1320/2710] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:06 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 1354 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:06.649841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5e641ef5-a224-4582-be52-bfab7e5f5b41 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:06.650634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5e641ef5-a224-4582-be52-bfab7e5f5b41 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:06.659947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1c015f76-094e-4099-8a20-b0067eec0ffc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:06.660948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e641ef5-a224-4582-be52-bfab7e5f5b41 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:06.661369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e641ef5-a224-4582-be52-bfab7e5f5b41 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:06.661818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e641ef5-a224-4582-be52-bfab7e5f5b41 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:06.662628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e641ef5-a224-4582-be52-bfab7e5f5b41 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:06.663577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e641ef5-a224-4582-be52-bfab7e5f5b41 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:06.664021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e641ef5-a224-4582-be52-bfab7e5f5b41 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:06.673362 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1c015f76-094e-4099-8a20-b0067eec0ffc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.662503 Aug 18 11:37:06.676111 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1391/2711] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:06 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:06.842910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-62840d96-0ef8-40b0-beb4-c88ec081350d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:06.844391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-62840d96-0ef8-40b0-beb4-c88ec081350d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:06.860178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62840d96-0ef8-40b0-beb4-c88ec081350d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:06.861033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62840d96-0ef8-40b0-beb4-c88ec081350d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:06.863553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62840d96-0ef8-40b0-beb4-c88ec081350d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:06.867032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62840d96-0ef8-40b0-beb4-c88ec081350d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:06.867754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62840d96-0ef8-40b0-beb4-c88ec081350d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:06.868346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62840d96-0ef8-40b0-beb4-c88ec081350d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:07.110971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5e641ef5-a224-4582-be52-bfab7e5f5b41 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:07.122518 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5e641ef5-a224-4582-be52-bfab7e5f5b41 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1472 microversion: 2.1 time: 0.476944 Aug 18 11:37:07.127599 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1321/2712] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:06 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1472 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:07.141775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3c6ceb58-fc5f-41c4-9974-0adecf5929c3 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:07.145098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3c6ceb58-fc5f-41c4-9974-0adecf5929c3 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:07.160006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c6ceb58-fc5f-41c4-9974-0adecf5929c3 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:07.163615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c6ceb58-fc5f-41c4-9974-0adecf5929c3 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:07.164402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c6ceb58-fc5f-41c4-9974-0adecf5929c3 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:07.165898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c6ceb58-fc5f-41c4-9974-0adecf5929c3 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:07.166614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c6ceb58-fc5f-41c4-9974-0adecf5929c3 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:07.170165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c6ceb58-fc5f-41c4-9974-0adecf5929c3 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:07.184790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-62840d96-0ef8-40b0-beb4-c88ec081350d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:07.196074 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-62840d96-0ef8-40b0-beb4-c88ec081350d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1312 microversion: 2.1 time: 0.358283 Aug 18 11:37:07.198265 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1392/2713] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:06 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1312 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:07.415424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e4184e4e-62cd-4ade-8911-04c9a3726a26 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:07.421372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e4184e4e-62cd-4ade-8911-04c9a3726a26 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:07.451317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4184e4e-62cd-4ade-8911-04c9a3726a26 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:07.456882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4184e4e-62cd-4ade-8911-04c9a3726a26 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:07.457838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4184e4e-62cd-4ade-8911-04c9a3726a26 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:07.460634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4184e4e-62cd-4ade-8911-04c9a3726a26 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:07.463316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4184e4e-62cd-4ade-8911-04c9a3726a26 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:07.469780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4184e4e-62cd-4ade-8911-04c9a3726a26 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:07.911899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e4184e4e-62cd-4ade-8911-04c9a3726a26 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:07.928083 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e4184e4e-62cd-4ade-8911-04c9a3726a26 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1275 microversion: 2.1 time: 0.521526 Aug 18 11:37:07.933901 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1393/2714] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:07 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1275 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:07.942599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d96bca34-f0f0-4f87-8021-a3403868a2b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:07.947668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d96bca34-f0f0-4f87-8021-a3403868a2b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] [instance: 43cef527-b63e-455e-bb59-0af5ce753dd2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:07.971696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d96bca34-f0f0-4f87-8021-a3403868a2b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:07.973322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d96bca34-f0f0-4f87-8021-a3403868a2b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:07.973776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d96bca34-f0f0-4f87-8021-a3403868a2b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:07.974572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d96bca34-f0f0-4f87-8021-a3403868a2b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:07.977585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d96bca34-f0f0-4f87-8021-a3403868a2b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:07.979370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d96bca34-f0f0-4f87-8021-a3403868a2b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:07.996847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3c6ceb58-fc5f-41c4-9974-0adecf5929c3 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:08.008801 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-d96bca34-f0f0-4f87-8021-a3403868a2b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] HTTP exception thrown: Instance 43cef527-b63e-455e-bb59-0af5ce753dd2 could not be found. Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d96bca34-f0f0-4f87-8021-a3403868a2b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Request method failure captured: Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 HTTP/1.1 Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iQOcBkil12S5_h4Je4FRom9Ppx40ZPFPgOHNt5y9hvUAqPXXggVoc7mKnBTeA71UCnkodIBHWS0Mvzlz-C2LNal-x8Vdkfsi6yqxy02FtKIJCvXmp1F6XywlybsYwKeowv3ck4EsxfZ__YyFNlBPifpdo6WQMrG2__AvPW4gcDcDz0 Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 344f7f9d319f4a3fb6d2089c02e8c5a9 Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestJSON-526386122 Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/344f7f9d319f4a3fb6d2089c02e8c5a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/344f7f9d319f4a3fb6d2089c02e8c5a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_344f7f9d319f4a3fb6d2089c02e8c5a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/344f7f9d319f4a3fb6d2089c02e8c5a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestJSON-526386122 Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 344f7f9d319f4a3fb6d2089c02e8c5a9 Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestJSON-526386122 Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestJSON-526386122-project Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: f7f8d720a3b14f698850489ae40b9d44 Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestJSON-526386122-project Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 43cef527-b63e-455e-bb59-0af5ce753dd2 could not be found. Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '43cef527-b63e-455e-bb59-0af5ce753dd2'} Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43cef527-b63e-455e-bb59-0af5ce753dd2 could not be found. Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43cef527-b63e-455e-bb59-0af5ce753dd2 could not be found. Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:08.011117 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:08.015322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:08.015322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:08.015322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:08.015322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:08.015322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43cef527-b63e-455e-bb59-0af5ce753dd2 could not be found. Aug 18 11:37:08.015322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:08.015669 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3c6ceb58-fc5f-41c4-9974-0adecf5929c3 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1334 microversion: 2.1 time: 0.877927 Aug 18 11:37:08.015669 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1322/2715] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:07 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1334 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:08.019112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d96bca34-f0f0-4f87-8021-a3403868a2b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Returning 404 to user: Instance 43cef527-b63e-455e-bb59-0af5ce753dd2 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:08.020668 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d96bca34-f0f0-4f87-8021-a3403868a2b8 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2" status: 404 len: 111 microversion: 2.1 time: 0.085286 Aug 18 11:37:08.022379 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1394/2716] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:07 2022] GET /compute/v2.1/servers/43cef527-b63e-455e-bb59-0af5ce753dd2 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:08.027725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e5a98d7f-c48e-4128-bfd8-2643f2733d37 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:08.028449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e5a98d7f-c48e-4128-bfd8-2643f2733d37 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:08.033132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd589f3a-db4b-4508-9f02-48b8fe21b8e4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] Calling method '.version_select at 0x7f519f060940>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:08.048798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5a98d7f-c48e-4128-bfd8-2643f2733d37 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:08.049550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5a98d7f-c48e-4128-bfd8-2643f2733d37 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:08.050219 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5a98d7f-c48e-4128-bfd8-2643f2733d37 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:08.051389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5a98d7f-c48e-4128-bfd8-2643f2733d37 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:08.052015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5a98d7f-c48e-4128-bfd8-2643f2733d37 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:08.054034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5a98d7f-c48e-4128-bfd8-2643f2733d37 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:08.070249 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd589f3a-db4b-4508-9f02-48b8fe21b8e4 tempest-ServersTestJSON-526386122 tempest-ServersTestJSON-526386122-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-859566373" status: 202 len: 0 microversion: 2.1 time: 0.043019 Aug 18 11:37:08.072635 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1395/2717] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 18 11:37:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-859566373 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:37:08.150825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ded1d132-609f-479f-b10e-7e78d26b249e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:08.153152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ded1d132-609f-479f-b10e-7e78d26b249e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:08.161145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded1d132-609f-479f-b10e-7e78d26b249e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:08.164016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded1d132-609f-479f-b10e-7e78d26b249e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:08.164840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded1d132-609f-479f-b10e-7e78d26b249e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:08.169000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded1d132-609f-479f-b10e-7e78d26b249e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:08.170061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded1d132-609f-479f-b10e-7e78d26b249e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:08.171109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded1d132-609f-479f-b10e-7e78d26b249e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:08.433518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e5a98d7f-c48e-4128-bfd8-2643f2733d37 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:08.446713 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e5a98d7f-c48e-4128-bfd8-2643f2733d37 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.432040 Aug 18 11:37:08.447392 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1323/2718] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:08 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:08.452648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6999946e-a477-4d40-90eb-357b86df0bb4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:08.459060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6999946e-a477-4d40-90eb-357b86df0bb4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:08.473731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6999946e-a477-4d40-90eb-357b86df0bb4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:08.474223 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6999946e-a477-4d40-90eb-357b86df0bb4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:08.474756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6999946e-a477-4d40-90eb-357b86df0bb4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:08.475460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6999946e-a477-4d40-90eb-357b86df0bb4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:08.475912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6999946e-a477-4d40-90eb-357b86df0bb4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:08.476333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6999946e-a477-4d40-90eb-357b86df0bb4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:08.604325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ded1d132-609f-479f-b10e-7e78d26b249e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:08.613845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:08.618856 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ded1d132-609f-479f-b10e-7e78d26b249e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1472 microversion: 2.1 time: 0.473291 Aug 18 11:37:08.620374 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1396/2719] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:08 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1472 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:08.860952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6999946e-a477-4d40-90eb-357b86df0bb4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:08.865736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:08.879067 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6999946e-a477-4d40-90eb-357b86df0bb4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1312 microversion: 2.1 time: 0.427331 Aug 18 11:37:08.879972 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1324/2720] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:08 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1312 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:08.956606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-10861abf-41b4-4211-ac2a-e61d66b5ea10 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:08.958630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-10861abf-41b4-4211-ac2a-e61d66b5ea10 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:08.963779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:08.972861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10861abf-41b4-4211-ac2a-e61d66b5ea10 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:08.973810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10861abf-41b4-4211-ac2a-e61d66b5ea10 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:08.974493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10861abf-41b4-4211-ac2a-e61d66b5ea10 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:08.975445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10861abf-41b4-4211-ac2a-e61d66b5ea10 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:08.976293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10861abf-41b4-4211-ac2a-e61d66b5ea10 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:08.977058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10861abf-41b4-4211-ac2a-e61d66b5ea10 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:09.040485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3c3f4072-1ff5-445d-85db-772d6e1b11d2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:09.041348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3c3f4072-1ff5-445d-85db-772d6e1b11d2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:09.051166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c3f4072-1ff5-445d-85db-772d6e1b11d2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:09.052849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c3f4072-1ff5-445d-85db-772d6e1b11d2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:09.053608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c3f4072-1ff5-445d-85db-772d6e1b11d2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:09.055162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c3f4072-1ff5-445d-85db-772d6e1b11d2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:09.056456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c3f4072-1ff5-445d-85db-772d6e1b11d2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:09.057097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3c3f4072-1ff5-445d-85db-772d6e1b11d2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:09.081422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-10861abf-41b4-4211-ac2a-e61d66b5ea10 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:09.098517 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-10861abf-41b4-4211-ac2a-e61d66b5ea10 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1273 microversion: 2.1 time: 0.144546 Aug 18 11:37:09.099165 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1397/2721] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:08 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:09.232984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-981c4e66-b3a1-46b7-9ffc-85dee1cd79fe req-1d9ca6a8-1c6a-4674-9725-72db3f4df234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd", "tag": "00724f9e-9d67-4b16-bdb4-8f9550b2f963"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:09.255783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-981c4e66-b3a1-46b7-9ffc-85dee1cd79fe req-1d9ca6a8-1c6a-4674-9725-72db3f4df234 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:09.256989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-981c4e66-b3a1-46b7-9ffc-85dee1cd79fe req-1d9ca6a8-1c6a-4674-9725-72db3f4df234 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:09.257643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-981c4e66-b3a1-46b7-9ffc-85dee1cd79fe req-1d9ca6a8-1c6a-4674-9725-72db3f4df234 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:09.271324 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-981c4e66-b3a1-46b7-9ffc-85dee1cd79fe req-1d9ca6a8-1c6a-4674-9725-72db3f4df234 service nova] Creating event network-changed:00724f9e-9d67-4b16-bdb4-8f9550b2f963 for instance 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd on n-h1-853611-3 Aug 18 11:37:09.277317 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-981c4e66-b3a1-46b7-9ffc-85dee1cd79fe req-1d9ca6a8-1c6a-4674-9725-72db3f4df234 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048150 Aug 18 11:37:09.280143 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1398/2722] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:37:09.469769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6193ad68-87fe-4249-95ca-9510dea1e75d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:09.470172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6193ad68-87fe-4249-95ca-9510dea1e75d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:09.481615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6193ad68-87fe-4249-95ca-9510dea1e75d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:09.482399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6193ad68-87fe-4249-95ca-9510dea1e75d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:09.483142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6193ad68-87fe-4249-95ca-9510dea1e75d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:09.484171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6193ad68-87fe-4249-95ca-9510dea1e75d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:09.487273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6193ad68-87fe-4249-95ca-9510dea1e75d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:09.488038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6193ad68-87fe-4249-95ca-9510dea1e75d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:09.488666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3c3f4072-1ff5-445d-85db-772d6e1b11d2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:09.504068 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3c3f4072-1ff5-445d-85db-772d6e1b11d2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1669 microversion: 2.1 time: 0.469193 Aug 18 11:37:09.505702 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1325/2723] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:09 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1669 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:09.534785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2450f27a-f657-4f2a-81b4-1cacb39e7063 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:09.535591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2450f27a-f657-4f2a-81b4-1cacb39e7063 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:09.543993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2450f27a-f657-4f2a-81b4-1cacb39e7063 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:09.544746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2450f27a-f657-4f2a-81b4-1cacb39e7063 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:09.545342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2450f27a-f657-4f2a-81b4-1cacb39e7063 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:09.546518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2450f27a-f657-4f2a-81b4-1cacb39e7063 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:09.547271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2450f27a-f657-4f2a-81b4-1cacb39e7063 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:09.547877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2450f27a-f657-4f2a-81b4-1cacb39e7063 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:09.585709 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2450f27a-f657-4f2a-81b4-1cacb39e7063 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba/ips" status: 200 len: 179 microversion: 2.1 time: 0.058633 Aug 18 11:37:09.587217 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1326/2724] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:37:09 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba/ips => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:37:09.617397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-931f5a66-3305-4a31-875a-6a79ef7dd9cc tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:09.617916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-931f5a66-3305-4a31-875a-6a79ef7dd9cc tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:09.627093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-931f5a66-3305-4a31-875a-6a79ef7dd9cc tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:09.627603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-931f5a66-3305-4a31-875a-6a79ef7dd9cc tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:09.628039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-931f5a66-3305-4a31-875a-6a79ef7dd9cc tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:09.647056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-931f5a66-3305-4a31-875a-6a79ef7dd9cc tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:09.647999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-931f5a66-3305-4a31-875a-6a79ef7dd9cc tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:09.648608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-931f5a66-3305-4a31-875a-6a79ef7dd9cc tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:09.694669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-931f5a66-3305-4a31-875a-6a79ef7dd9cc tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:37:09.888474 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-931f5a66-3305-4a31-875a-6a79ef7dd9cc tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 204 len: 0 microversion: 2.1 time: 0.276054 Aug 18 11:37:09.896273 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1327/2725] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:37:09 2022] DELETE /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:37:09.915829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0c29d8c5-488b-47b4-abc0-d7990b80d138 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:09.918106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0c29d8c5-488b-47b4-abc0-d7990b80d138 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:09.927455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c29d8c5-488b-47b4-abc0-d7990b80d138 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:09.928160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c29d8c5-488b-47b4-abc0-d7990b80d138 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:09.928795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c29d8c5-488b-47b4-abc0-d7990b80d138 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:09.929699 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c29d8c5-488b-47b4-abc0-d7990b80d138 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:09.931892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c29d8c5-488b-47b4-abc0-d7990b80d138 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:09.932366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6193ad68-87fe-4249-95ca-9510dea1e75d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:09.932790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0c29d8c5-488b-47b4-abc0-d7990b80d138 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:09.941352 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6193ad68-87fe-4249-95ca-9510dea1e75d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.476676 Aug 18 11:37:09.942276 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1399/2726] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:09 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:09.947580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e67ca785-eee6-4e15-822a-efe56ca7a26e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:09.948200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e67ca785-eee6-4e15-822a-efe56ca7a26e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:09.964418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e67ca785-eee6-4e15-822a-efe56ca7a26e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:09.966260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e67ca785-eee6-4e15-822a-efe56ca7a26e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:09.966885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e67ca785-eee6-4e15-822a-efe56ca7a26e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:09.967747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e67ca785-eee6-4e15-822a-efe56ca7a26e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:09.968476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e67ca785-eee6-4e15-822a-efe56ca7a26e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:09.969132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e67ca785-eee6-4e15-822a-efe56ca7a26e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:10.379709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0c29d8c5-488b-47b4-abc0-d7990b80d138 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:10.389211 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0c29d8c5-488b-47b4-abc0-d7990b80d138 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1472 microversion: 2.1 time: 0.490279 Aug 18 11:37:10.391021 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1328/2727] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:09 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1472 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:10.410201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c7107a39-d536-4cb6-a1b1-94e03f043e17 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:10.411109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c7107a39-d536-4cb6-a1b1-94e03f043e17 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:10.415938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e67ca785-eee6-4e15-822a-efe56ca7a26e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:10.420319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c7107a39-d536-4cb6-a1b1-94e03f043e17 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:10.421099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c7107a39-d536-4cb6-a1b1-94e03f043e17 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:10.422851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c7107a39-d536-4cb6-a1b1-94e03f043e17 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:10.424167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c7107a39-d536-4cb6-a1b1-94e03f043e17 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:10.425016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c7107a39-d536-4cb6-a1b1-94e03f043e17 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:10.426260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c7107a39-d536-4cb6-a1b1-94e03f043e17 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:10.434990 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e67ca785-eee6-4e15-822a-efe56ca7a26e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1312 microversion: 2.1 time: 0.487975 Aug 18 11:37:10.454857 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1400/2728] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:09 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1312 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:10.462944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1877a9f9-cb13-4cc3-bbc9-2b4647aca0df tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:10.464242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1877a9f9-cb13-4cc3-bbc9-2b4647aca0df tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:10.475782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1877a9f9-cb13-4cc3-bbc9-2b4647aca0df tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:10.476642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1877a9f9-cb13-4cc3-bbc9-2b4647aca0df tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:10.477399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1877a9f9-cb13-4cc3-bbc9-2b4647aca0df tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:10.478991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1877a9f9-cb13-4cc3-bbc9-2b4647aca0df tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:10.479782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1877a9f9-cb13-4cc3-bbc9-2b4647aca0df tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:10.482109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1877a9f9-cb13-4cc3-bbc9-2b4647aca0df tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:10.713154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c7107a39-d536-4cb6-a1b1-94e03f043e17 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:10.726302 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c7107a39-d536-4cb6-a1b1-94e03f043e17 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1675 microversion: 2.1 time: 0.322194 Aug 18 11:37:10.727845 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1329/2729] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:10 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1675 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:10.896732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1877a9f9-cb13-4cc3-bbc9-2b4647aca0df tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:10.908931 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1877a9f9-cb13-4cc3-bbc9-2b4647aca0df tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1315 microversion: 2.1 time: 0.451111 Aug 18 11:37:10.909704 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1401/2730] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:10 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:10.963890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4d943f7a-2f88-4942-8299-c10163d6c5da tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:10.964797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4d943f7a-2f88-4942-8299-c10163d6c5da tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:10.974776 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d943f7a-2f88-4942-8299-c10163d6c5da tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:10.975879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d943f7a-2f88-4942-8299-c10163d6c5da tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:10.977127 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d943f7a-2f88-4942-8299-c10163d6c5da tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:10.978291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d943f7a-2f88-4942-8299-c10163d6c5da tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:10.981216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d943f7a-2f88-4942-8299-c10163d6c5da tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:10.983645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d943f7a-2f88-4942-8299-c10163d6c5da tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:11.192243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4d943f7a-2f88-4942-8299-c10163d6c5da tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:11.201398 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4d943f7a-2f88-4942-8299-c10163d6c5da tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.241302 Aug 18 11:37:11.201996 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1330/2731] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:10 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:11.312741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-eb1a4028-557f-419d-851b-8d0dcc4ef070 req-f8d68ae4-cdc9-412b-a254-3ff2a303c6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1faf71d-d10a-439f-90dc-f8e9e8127cbb", "tag": "0fef1d0b-7117-439f-a946-2ac519e45e27"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:11.329793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eb1a4028-557f-419d-851b-8d0dcc4ef070 req-f8d68ae4-cdc9-412b-a254-3ff2a303c6e9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:11.331211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eb1a4028-557f-419d-851b-8d0dcc4ef070 req-f8d68ae4-cdc9-412b-a254-3ff2a303c6e9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:11.331838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eb1a4028-557f-419d-851b-8d0dcc4ef070 req-f8d68ae4-cdc9-412b-a254-3ff2a303c6e9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:11.352298 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-eb1a4028-557f-419d-851b-8d0dcc4ef070 req-f8d68ae4-cdc9-412b-a254-3ff2a303c6e9 service nova] Creating event network-changed:0fef1d0b-7117-439f-a946-2ac519e45e27 for instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb on n-h2-853611-3 Aug 18 11:37:11.358041 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-eb1a4028-557f-419d-851b-8d0dcc4ef070 req-f8d68ae4-cdc9-412b-a254-3ff2a303c6e9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050605 Aug 18 11:37:11.358895 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1402/2732] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:37:11.417103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-759bf737-0201-4a77-940d-9cfd21599871 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:11.418826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-759bf737-0201-4a77-940d-9cfd21599871 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:11.425195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-759bf737-0201-4a77-940d-9cfd21599871 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:11.425943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-759bf737-0201-4a77-940d-9cfd21599871 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:11.426634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-759bf737-0201-4a77-940d-9cfd21599871 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:11.427702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-759bf737-0201-4a77-940d-9cfd21599871 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:11.428406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-759bf737-0201-4a77-940d-9cfd21599871 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:11.429023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-759bf737-0201-4a77-940d-9cfd21599871 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:11.465965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-139f1bb8-4afe-47c7-8dd8-2b2451f45b3e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:11.466726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-139f1bb8-4afe-47c7-8dd8-2b2451f45b3e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:11.478638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-139f1bb8-4afe-47c7-8dd8-2b2451f45b3e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:11.479523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-139f1bb8-4afe-47c7-8dd8-2b2451f45b3e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:11.480595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-139f1bb8-4afe-47c7-8dd8-2b2451f45b3e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:11.482775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-139f1bb8-4afe-47c7-8dd8-2b2451f45b3e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:11.484705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-139f1bb8-4afe-47c7-8dd8-2b2451f45b3e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:11.485973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-139f1bb8-4afe-47c7-8dd8-2b2451f45b3e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:11.598412 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-759bf737-0201-4a77-940d-9cfd21599871 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:11.608292 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-759bf737-0201-4a77-940d-9cfd21599871 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1472 microversion: 2.1 time: 0.196348 Aug 18 11:37:11.610348 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1331/2733] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:11 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1472 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:11.748776 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d8d10ef3-bf0e-4aad-b087-a9d303c21933 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:11.750192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-139f1bb8-4afe-47c7-8dd8-2b2451f45b3e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:11.754563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d8d10ef3-bf0e-4aad-b087-a9d303c21933 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:11.774981 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-139f1bb8-4afe-47c7-8dd8-2b2451f45b3e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1312 microversion: 2.1 time: 0.317219 Aug 18 11:37:11.777556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8d10ef3-bf0e-4aad-b087-a9d303c21933 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:11.778337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8d10ef3-bf0e-4aad-b087-a9d303c21933 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:11.778815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8d10ef3-bf0e-4aad-b087-a9d303c21933 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:11.779534 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1403/2734] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:11 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1312 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:11.780213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8d10ef3-bf0e-4aad-b087-a9d303c21933 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:11.780741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8d10ef3-bf0e-4aad-b087-a9d303c21933 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:11.789718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8d10ef3-bf0e-4aad-b087-a9d303c21933 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:11.948228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c7c1f56-ee9e-4260-b7c6-b98102411360 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:11.949967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4c7c1f56-ee9e-4260-b7c6-b98102411360 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:11.977386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c7c1f56-ee9e-4260-b7c6-b98102411360 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:11.978481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c7c1f56-ee9e-4260-b7c6-b98102411360 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:11.978641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c7c1f56-ee9e-4260-b7c6-b98102411360 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:11.989626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c7c1f56-ee9e-4260-b7c6-b98102411360 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:11.990404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c7c1f56-ee9e-4260-b7c6-b98102411360 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:11.991113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c7c1f56-ee9e-4260-b7c6-b98102411360 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:12.228146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d8d10ef3-bf0e-4aad-b087-a9d303c21933 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:12.239050 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d8d10ef3-bf0e-4aad-b087-a9d303c21933 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1675 microversion: 2.1 time: 0.495392 Aug 18 11:37:12.248085 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1332/2735] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:11 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1675 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:12.263277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d5e28562-f2da-48f8-928b-aba7400593e8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:12.264750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d5e28562-f2da-48f8-928b-aba7400593e8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:12.270493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4c7c1f56-ee9e-4260-b7c6-b98102411360 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:12.274962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5e28562-f2da-48f8-928b-aba7400593e8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:12.276141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5e28562-f2da-48f8-928b-aba7400593e8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:12.276989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5e28562-f2da-48f8-928b-aba7400593e8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:12.278987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5e28562-f2da-48f8-928b-aba7400593e8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:12.279928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5e28562-f2da-48f8-928b-aba7400593e8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:12.280593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5e28562-f2da-48f8-928b-aba7400593e8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:12.281423 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4c7c1f56-ee9e-4260-b7c6-b98102411360 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1315 microversion: 2.1 time: 0.352825 Aug 18 11:37:12.282835 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1404/2736] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:11 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:12.630052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=14 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:12.632955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-69fae2f3-b068-44b8-aa5b-b4ad67049b3d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:12.634546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-69fae2f3-b068-44b8-aa5b-b4ad67049b3d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:12.643034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d5e28562-f2da-48f8-928b-aba7400593e8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:12.649721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69fae2f3-b068-44b8-aa5b-b4ad67049b3d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:12.650224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69fae2f3-b068-44b8-aa5b-b4ad67049b3d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:12.650682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69fae2f3-b068-44b8-aa5b-b4ad67049b3d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:12.651392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69fae2f3-b068-44b8-aa5b-b4ad67049b3d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:12.652454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69fae2f3-b068-44b8-aa5b-b4ad67049b3d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:12.652882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69fae2f3-b068-44b8-aa5b-b4ad67049b3d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:12.668949 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d5e28562-f2da-48f8-928b-aba7400593e8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.416861 Aug 18 11:37:12.670085 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1333/2737] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:12 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:12.799869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e18cd067-c4cc-48d2-b96b-d8c844a8ec05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:12.800610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e18cd067-c4cc-48d2-b96b-d8c844a8ec05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:12.811061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e18cd067-c4cc-48d2-b96b-d8c844a8ec05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:12.811558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e18cd067-c4cc-48d2-b96b-d8c844a8ec05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:12.812022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e18cd067-c4cc-48d2-b96b-d8c844a8ec05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:12.817393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e18cd067-c4cc-48d2-b96b-d8c844a8ec05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:12.818103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e18cd067-c4cc-48d2-b96b-d8c844a8ec05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:12.819118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e18cd067-c4cc-48d2-b96b-d8c844a8ec05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:12.924097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-69fae2f3-b068-44b8-aa5b-b4ad67049b3d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:12.935972 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-69fae2f3-b068-44b8-aa5b-b4ad67049b3d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1472 microversion: 2.1 time: 0.306395 Aug 18 11:37:12.951845 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1405/2738] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:12 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1472 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:13.272410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-43f3e92f-3ec0-4c9b-ab9a-b0ad28e0e184 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:13.272410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-43f3e92f-3ec0-4c9b-ab9a-b0ad28e0e184 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:13.288207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43f3e92f-3ec0-4c9b-ab9a-b0ad28e0e184 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:13.288697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43f3e92f-3ec0-4c9b-ab9a-b0ad28e0e184 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:13.289315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43f3e92f-3ec0-4c9b-ab9a-b0ad28e0e184 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:13.290179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43f3e92f-3ec0-4c9b-ab9a-b0ad28e0e184 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:13.290810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43f3e92f-3ec0-4c9b-ab9a-b0ad28e0e184 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:13.295152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43f3e92f-3ec0-4c9b-ab9a-b0ad28e0e184 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:13.488997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-43f3e92f-3ec0-4c9b-ab9a-b0ad28e0e184 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:13.498713 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-43f3e92f-3ec0-4c9b-ab9a-b0ad28e0e184 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1675 microversion: 2.1 time: 0.232296 Aug 18 11:37:13.499814 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1406/2739] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:13 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:13.508417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-07b2fae8-68b1-4a9b-8047-cdbfc6abab5c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:13.509206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-07b2fae8-68b1-4a9b-8047-cdbfc6abab5c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:13.518249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07b2fae8-68b1-4a9b-8047-cdbfc6abab5c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:13.518928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07b2fae8-68b1-4a9b-8047-cdbfc6abab5c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:13.519465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07b2fae8-68b1-4a9b-8047-cdbfc6abab5c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:13.520933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07b2fae8-68b1-4a9b-8047-cdbfc6abab5c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:13.521630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07b2fae8-68b1-4a9b-8047-cdbfc6abab5c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:13.522164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07b2fae8-68b1-4a9b-8047-cdbfc6abab5c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:13.709011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-07b2fae8-68b1-4a9b-8047-cdbfc6abab5c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:13.723918 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-07b2fae8-68b1-4a9b-8047-cdbfc6abab5c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1315 microversion: 2.1 time: 0.222896 Aug 18 11:37:13.725259 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1407/2740] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:13 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:13.750033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2d10787-43b0-4f8f-b209-280ffc0f8eb3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:13.750976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b2d10787-43b0-4f8f-b209-280ffc0f8eb3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:13.758352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2d10787-43b0-4f8f-b209-280ffc0f8eb3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:13.759005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2d10787-43b0-4f8f-b209-280ffc0f8eb3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:13.759536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2d10787-43b0-4f8f-b209-280ffc0f8eb3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:13.760722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2d10787-43b0-4f8f-b209-280ffc0f8eb3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:13.761656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2d10787-43b0-4f8f-b209-280ffc0f8eb3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:13.762364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2d10787-43b0-4f8f-b209-280ffc0f8eb3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:13.796114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e18cd067-c4cc-48d2-b96b-d8c844a8ec05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:13.811104 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e18cd067-c4cc-48d2-b96b-d8c844a8ec05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1312 microversion: 2.1 time: 1.014444 Aug 18 11:37:13.815300 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1334/2741] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:12 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1312 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:13.961896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9483532c-f455-443d-aed8-93cc082c0a08 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:13.965396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9483532c-f455-443d-aed8-93cc082c0a08 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:13.984592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9483532c-f455-443d-aed8-93cc082c0a08 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:13.987697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9483532c-f455-443d-aed8-93cc082c0a08 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:13.988998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9483532c-f455-443d-aed8-93cc082c0a08 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:13.991329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9483532c-f455-443d-aed8-93cc082c0a08 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:13.992023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9483532c-f455-443d-aed8-93cc082c0a08 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:13.992651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9483532c-f455-443d-aed8-93cc082c0a08 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:14.051058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b2d10787-43b0-4f8f-b209-280ffc0f8eb3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:14.062941 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b2d10787-43b0-4f8f-b209-280ffc0f8eb3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.336325 Aug 18 11:37:14.063966 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1408/2742] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:13 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:14.521217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24dc904a-f6f7-47cd-b1d2-27fd1a93ce95 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:14.522217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-24dc904a-f6f7-47cd-b1d2-27fd1a93ce95 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:14.530638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24dc904a-f6f7-47cd-b1d2-27fd1a93ce95 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:14.531449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24dc904a-f6f7-47cd-b1d2-27fd1a93ce95 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:14.532121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24dc904a-f6f7-47cd-b1d2-27fd1a93ce95 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:14.533891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24dc904a-f6f7-47cd-b1d2-27fd1a93ce95 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:14.534696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24dc904a-f6f7-47cd-b1d2-27fd1a93ce95 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:14.535350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24dc904a-f6f7-47cd-b1d2-27fd1a93ce95 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:14.717182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=14 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:14.746011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:14.833769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9483532c-f455-443d-aed8-93cc082c0a08 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:14.846419 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9483532c-f455-443d-aed8-93cc082c0a08 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1478 microversion: 2.1 time: 0.887669 Aug 18 11:37:14.850104 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1335/2743] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:13 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1478 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:14.859885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-beb33806-6dbb-4fe6-a353-1c17587c054d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:14.871616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-beb33806-6dbb-4fe6-a353-1c17587c054d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:14.889566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-beb33806-6dbb-4fe6-a353-1c17587c054d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:14.890480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-beb33806-6dbb-4fe6-a353-1c17587c054d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:14.891181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-beb33806-6dbb-4fe6-a353-1c17587c054d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:14.892132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-beb33806-6dbb-4fe6-a353-1c17587c054d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:14.896344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-beb33806-6dbb-4fe6-a353-1c17587c054d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:14.897193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-beb33806-6dbb-4fe6-a353-1c17587c054d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:14.944620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-24dc904a-f6f7-47cd-b1d2-27fd1a93ce95 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:14.956954 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-24dc904a-f6f7-47cd-b1d2-27fd1a93ce95 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1675 microversion: 2.1 time: 0.438201 Aug 18 11:37:14.960177 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1409/2744] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:14 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1675 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:14.966135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-75310a70-cdaf-4407-8a24-0790003b0ede tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:14.966792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-75310a70-cdaf-4407-8a24-0790003b0ede tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:14.981877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75310a70-cdaf-4407-8a24-0790003b0ede tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:14.982707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75310a70-cdaf-4407-8a24-0790003b0ede tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:14.983340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75310a70-cdaf-4407-8a24-0790003b0ede tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:14.984228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75310a70-cdaf-4407-8a24-0790003b0ede tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:14.984840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75310a70-cdaf-4407-8a24-0790003b0ede tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:14.985434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75310a70-cdaf-4407-8a24-0790003b0ede tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:15.123011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=12 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:15.205382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-75310a70-cdaf-4407-8a24-0790003b0ede tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:15.215649 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-75310a70-cdaf-4407-8a24-0790003b0ede tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1312 microversion: 2.1 time: 0.254024 Aug 18 11:37:15.220208 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1410/2745] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:14 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:15.236708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-63dcc424-0dc9-401f-9df7-82e7599223a5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:15.237335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-63dcc424-0dc9-401f-9df7-82e7599223a5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:15.243595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63dcc424-0dc9-401f-9df7-82e7599223a5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:15.244096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63dcc424-0dc9-401f-9df7-82e7599223a5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:15.244537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63dcc424-0dc9-401f-9df7-82e7599223a5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:15.245289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63dcc424-0dc9-401f-9df7-82e7599223a5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:15.246378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63dcc424-0dc9-401f-9df7-82e7599223a5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:15.246734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63dcc424-0dc9-401f-9df7-82e7599223a5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:15.522162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-beb33806-6dbb-4fe6-a353-1c17587c054d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:15.538884 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-beb33806-6dbb-4fe6-a353-1c17587c054d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1315 microversion: 2.1 time: 0.686665 Aug 18 11:37:15.540105 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1336/2746] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:14 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:15.874763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-62e5c61d-fb3f-4eb0-b9c5-0272ec9a1673 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:15.875449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-62e5c61d-fb3f-4eb0-b9c5-0272ec9a1673 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:15.889821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-62e5c61d-fb3f-4eb0-b9c5-0272ec9a1673 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:15.890787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-62e5c61d-fb3f-4eb0-b9c5-0272ec9a1673 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:15.891421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-62e5c61d-fb3f-4eb0-b9c5-0272ec9a1673 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:15.893419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-62e5c61d-fb3f-4eb0-b9c5-0272ec9a1673 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:15.904042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-62e5c61d-fb3f-4eb0-b9c5-0272ec9a1673 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:15.907445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-62e5c61d-fb3f-4eb0-b9c5-0272ec9a1673 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:16.033219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-63dcc424-0dc9-401f-9df7-82e7599223a5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:16.079474 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-63dcc424-0dc9-401f-9df7-82e7599223a5 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.855473 Aug 18 11:37:16.081999 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1411/2747] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:15 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:16.106077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76498beb-2833-4de2-824f-b8239ca65795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:16.110302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-76498beb-2833-4de2-824f-b8239ca65795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:16.126214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76498beb-2833-4de2-824f-b8239ca65795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:16.128591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76498beb-2833-4de2-824f-b8239ca65795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:16.131210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76498beb-2833-4de2-824f-b8239ca65795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:16.132772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76498beb-2833-4de2-824f-b8239ca65795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:16.137142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76498beb-2833-4de2-824f-b8239ca65795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:16.137684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76498beb-2833-4de2-824f-b8239ca65795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:16.427852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-62e5c61d-fb3f-4eb0-b9c5-0272ec9a1673 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:16.457512 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-62e5c61d-fb3f-4eb0-b9c5-0272ec9a1673 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1478 microversion: 2.1 time: 0.586669 Aug 18 11:37:16.459881 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1337/2748] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:15 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1478 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:16.478688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-67de29ac-2d23-4cfa-957d-e666e0942c37 req-00a84c5c-1beb-47db-bd6d-ef2894398a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb63b82-28e4-406d-99a1-7db826bdbdba", "name": "network-vif-deleted", "tag": "8c0e9b28-a496-42b5-9c34-aa959d63c0b6"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:16.521114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-67de29ac-2d23-4cfa-957d-e666e0942c37 req-00a84c5c-1beb-47db-bd6d-ef2894398a9d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:16.521695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-67de29ac-2d23-4cfa-957d-e666e0942c37 req-00a84c5c-1beb-47db-bd6d-ef2894398a9d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:16.522172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-67de29ac-2d23-4cfa-957d-e666e0942c37 req-00a84c5c-1beb-47db-bd6d-ef2894398a9d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:16.524071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-76498beb-2833-4de2-824f-b8239ca65795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:16.540672 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76498beb-2833-4de2-824f-b8239ca65795 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1654 microversion: 2.1 time: 0.457267 Aug 18 11:37:16.546648 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1412/2749] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:16 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1654 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:16.550731 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-67de29ac-2d23-4cfa-957d-e666e0942c37 req-00a84c5c-1beb-47db-bd6d-ef2894398a9d service nova] Creating event network-vif-deleted:8c0e9b28-a496-42b5-9c34-aa959d63c0b6 for instance 7cb63b82-28e4-406d-99a1-7db826bdbdba on n-h2-853611-3 Aug 18 11:37:16.563381 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-67de29ac-2d23-4cfa-957d-e666e0942c37 req-00a84c5c-1beb-47db-bd6d-ef2894398a9d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101376 Aug 18 11:37:16.568075 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1338/2750] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:37:16.574414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4f0e3e9b-759b-4004-b6ee-aa22281c2faf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:16.574902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0d8ea6d8-5d69-4f5e-b4f1-27353d993e33 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:16.575615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0d8ea6d8-5d69-4f5e-b4f1-27353d993e33 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:16.578560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4f0e3e9b-759b-4004-b6ee-aa22281c2faf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:16.595995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d8ea6d8-5d69-4f5e-b4f1-27353d993e33 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:16.596509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d8ea6d8-5d69-4f5e-b4f1-27353d993e33 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:16.601815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d8ea6d8-5d69-4f5e-b4f1-27353d993e33 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:16.602659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d8ea6d8-5d69-4f5e-b4f1-27353d993e33 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:16.603365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d8ea6d8-5d69-4f5e-b4f1-27353d993e33 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:16.603809 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d8ea6d8-5d69-4f5e-b4f1-27353d993e33 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:16.604250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f0e3e9b-759b-4004-b6ee-aa22281c2faf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:16.605392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f0e3e9b-759b-4004-b6ee-aa22281c2faf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:16.605835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f0e3e9b-759b-4004-b6ee-aa22281c2faf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:16.607384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f0e3e9b-759b-4004-b6ee-aa22281c2faf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:16.611128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f0e3e9b-759b-4004-b6ee-aa22281c2faf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:16.612017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f0e3e9b-759b-4004-b6ee-aa22281c2faf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:16.950921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4f0e3e9b-759b-4004-b6ee-aa22281c2faf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:16.957980 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0d8ea6d8-5d69-4f5e-b4f1-27353d993e33 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:16.962079 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4f0e3e9b-759b-4004-b6ee-aa22281c2faf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1312 microversion: 2.1 time: 0.412404 Aug 18 11:37:16.965282 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1413/2751] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:16 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:16.974115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ac1dfae6-7f43-4898-9a2a-c9d683037812 req-cbf061b2-352a-4916-9cc9-522cdc004f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aee369f-2ece-4b53-a7db-efe946936831", "name": "network-vif-unplugged", "status": "completed", "tag": "fdd9010d-de96-4f58-8fc4-5c78c661a107"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:16.986014 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0d8ea6d8-5d69-4f5e-b4f1-27353d993e33 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1315 microversion: 2.1 time: 0.414585 Aug 18 11:37:16.990280 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1339/2752] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:16 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:17.014462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ac1dfae6-7f43-4898-9a2a-c9d683037812 req-cbf061b2-352a-4916-9cc9-522cdc004f6e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:17.014966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ac1dfae6-7f43-4898-9a2a-c9d683037812 req-cbf061b2-352a-4916-9cc9-522cdc004f6e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:17.015410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ac1dfae6-7f43-4898-9a2a-c9d683037812 req-cbf061b2-352a-4916-9cc9-522cdc004f6e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:17.038050 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ac1dfae6-7f43-4898-9a2a-c9d683037812 req-cbf061b2-352a-4916-9cc9-522cdc004f6e service nova] Creating event network-vif-unplugged:fdd9010d-de96-4f58-8fc4-5c78c661a107 for instance 5aee369f-2ece-4b53-a7db-efe946936831 on n-h2-853611-3 Aug 18 11:37:17.058109 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ac1dfae6-7f43-4898-9a2a-c9d683037812 req-cbf061b2-352a-4916-9cc9-522cdc004f6e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088953 Aug 18 11:37:17.063943 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1414/2753] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:37:17.108108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b74a8324-7f92-4307-ab2c-0c54bb9df65c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:17.108745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b74a8324-7f92-4307-ab2c-0c54bb9df65c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:17.115965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b74a8324-7f92-4307-ab2c-0c54bb9df65c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:17.116470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b74a8324-7f92-4307-ab2c-0c54bb9df65c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:17.127625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b74a8324-7f92-4307-ab2c-0c54bb9df65c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:17.128472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b74a8324-7f92-4307-ab2c-0c54bb9df65c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:17.128954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b74a8324-7f92-4307-ab2c-0c54bb9df65c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:17.129695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b74a8324-7f92-4307-ab2c-0c54bb9df65c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:17.483115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4aa87250-b5f2-4218-895c-bac76f49d1fd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:17.483824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4aa87250-b5f2-4218-895c-bac76f49d1fd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:17.507662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aa87250-b5f2-4218-895c-bac76f49d1fd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:17.513590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aa87250-b5f2-4218-895c-bac76f49d1fd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:17.514805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aa87250-b5f2-4218-895c-bac76f49d1fd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:17.516373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aa87250-b5f2-4218-895c-bac76f49d1fd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:17.517131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aa87250-b5f2-4218-895c-bac76f49d1fd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:17.517730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aa87250-b5f2-4218-895c-bac76f49d1fd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:17.571538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:17.656375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b74a8324-7f92-4307-ab2c-0c54bb9df65c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:17.668870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:17.679062 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b74a8324-7f92-4307-ab2c-0c54bb9df65c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.576402 Aug 18 11:37:17.680433 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1340/2754] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:17 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:17.699799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4d61287d-2b93-4a4c-b7fd-b1acc183a8be tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:17.703004 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4d61287d-2b93-4a4c-b7fd-b1acc183a8be tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:17.716495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d61287d-2b93-4a4c-b7fd-b1acc183a8be tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:17.717443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d61287d-2b93-4a4c-b7fd-b1acc183a8be tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:17.717443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d61287d-2b93-4a4c-b7fd-b1acc183a8be tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:17.718288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d61287d-2b93-4a4c-b7fd-b1acc183a8be tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:17.718807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d61287d-2b93-4a4c-b7fd-b1acc183a8be tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:17.719234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d61287d-2b93-4a4c-b7fd-b1acc183a8be tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:17.854214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4aa87250-b5f2-4218-895c-bac76f49d1fd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:17.868554 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4aa87250-b5f2-4218-895c-bac76f49d1fd tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1478 microversion: 2.1 time: 0.389535 Aug 18 11:37:17.870834 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1415/2755] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:17 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1478 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:17.987166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b8cfaac7-6b74-48b6-947c-640bb09e0493 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:17.988769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b8cfaac7-6b74-48b6-947c-640bb09e0493 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:17.995771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8cfaac7-6b74-48b6-947c-640bb09e0493 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:17.996533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8cfaac7-6b74-48b6-947c-640bb09e0493 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:17.997158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8cfaac7-6b74-48b6-947c-640bb09e0493 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:17.998647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8cfaac7-6b74-48b6-947c-640bb09e0493 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:17.999387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8cfaac7-6b74-48b6-947c-640bb09e0493 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:18.000737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8cfaac7-6b74-48b6-947c-640bb09e0493 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:18.303202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8cfaac7-6b74-48b6-947c-640bb09e0493 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:18.321655 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b8cfaac7-6b74-48b6-947c-640bb09e0493 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1312 microversion: 2.1 time: 0.339462 Aug 18 11:37:18.346451 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1416/2756] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:17 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:18.346451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-997369e3-7aff-4b82-a61e-f3e0025cd292 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:18.346804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-997369e3-7aff-4b82-a61e-f3e0025cd292 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:18.361390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-997369e3-7aff-4b82-a61e-f3e0025cd292 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:18.362245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-997369e3-7aff-4b82-a61e-f3e0025cd292 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:18.362951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-997369e3-7aff-4b82-a61e-f3e0025cd292 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:18.373462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-997369e3-7aff-4b82-a61e-f3e0025cd292 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:18.376501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-997369e3-7aff-4b82-a61e-f3e0025cd292 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:18.377201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-997369e3-7aff-4b82-a61e-f3e0025cd292 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:18.621886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4d61287d-2b93-4a4c-b7fd-b1acc183a8be tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31512cf212247b59aa951006f887d02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31cf551fa744480b3aeb24d97f9c7ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:18.633702 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4d61287d-2b93-4a4c-b7fd-b1acc183a8be tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 200 len: 1496 microversion: 2.1 time: 0.952214 Aug 18 11:37:18.634342 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1341/2757] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:17 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 1496 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:18.702011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-21db2362-c195-4587-a423-98c655974156 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:18.703397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-21db2362-c195-4587-a423-98c655974156 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:18.714744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21db2362-c195-4587-a423-98c655974156 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:18.715246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21db2362-c195-4587-a423-98c655974156 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:18.715687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21db2362-c195-4587-a423-98c655974156 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:18.716842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21db2362-c195-4587-a423-98c655974156 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:18.719990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21db2362-c195-4587-a423-98c655974156 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:18.721280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21db2362-c195-4587-a423-98c655974156 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:18.800866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-997369e3-7aff-4b82-a61e-f3e0025cd292 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:18.818627 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-997369e3-7aff-4b82-a61e-f3e0025cd292 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1315 microversion: 2.1 time: 0.479052 Aug 18 11:37:18.820615 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1417/2758] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:18 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:18.852121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7011e709-363f-42a0-b88d-4f2baef7f679 req-8de61792-0583-4a0c-96fe-3302ec1fbef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb63b82-28e4-406d-99a1-7db826bdbdba", "name": "network-vif-deleted", "tag": "71c242f8-d0aa-4cf7-ae41-4a9b10c9f1e1"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:18.867442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7011e709-363f-42a0-b88d-4f2baef7f679 req-8de61792-0583-4a0c-96fe-3302ec1fbef0 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:18.868253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7011e709-363f-42a0-b88d-4f2baef7f679 req-8de61792-0583-4a0c-96fe-3302ec1fbef0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:18.869413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7011e709-363f-42a0-b88d-4f2baef7f679 req-8de61792-0583-4a0c-96fe-3302ec1fbef0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:18.888579 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7011e709-363f-42a0-b88d-4f2baef7f679 req-8de61792-0583-4a0c-96fe-3302ec1fbef0 service nova] Creating event network-vif-deleted:71c242f8-d0aa-4cf7-ae41-4a9b10c9f1e1 for instance 7cb63b82-28e4-406d-99a1-7db826bdbdba on n-h2-853611-3 Aug 18 11:37:18.895535 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7011e709-363f-42a0-b88d-4f2baef7f679 req-8de61792-0583-4a0c-96fe-3302ec1fbef0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048594 Aug 18 11:37:18.897499 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1418/2759] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:37:18.908610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-866a0268-f2e3-4a22-b0f5-bb8dfd8c83b2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:18.910175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-866a0268-f2e3-4a22-b0f5-bb8dfd8c83b2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:18.921318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-866a0268-f2e3-4a22-b0f5-bb8dfd8c83b2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:18.922146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-866a0268-f2e3-4a22-b0f5-bb8dfd8c83b2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:18.922848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-866a0268-f2e3-4a22-b0f5-bb8dfd8c83b2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:18.923810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-866a0268-f2e3-4a22-b0f5-bb8dfd8c83b2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:18.924675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-866a0268-f2e3-4a22-b0f5-bb8dfd8c83b2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:18.925293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-866a0268-f2e3-4a22-b0f5-bb8dfd8c83b2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:19.176119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-21db2362-c195-4587-a423-98c655974156 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:19.194922 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-21db2362-c195-4587-a423-98c655974156 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.497463 Aug 18 11:37:19.195478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-866a0268-f2e3-4a22-b0f5-bb8dfd8c83b2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:19.196412 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1342/2760] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:18 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:19.206868 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-866a0268-f2e3-4a22-b0f5-bb8dfd8c83b2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1478 microversion: 2.1 time: 0.306758 Aug 18 11:37:19.222527 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1419/2761] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:18 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1478 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:19.227783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-ab3414cb-53fc-4f28-9306-46e9c32a9a97 req-327e9796-83ab-48b7-990f-d0b0cd471a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cb63b82-28e4-406d-99a1-7db826bdbdba", "name": "network-vif-unplugged", "status": "completed", "tag": "71c242f8-d0aa-4cf7-ae41-4a9b10c9f1e1"}, {"server_uuid": "1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd", "name": "network-vif-plugged", "status": "completed", "tag": "00724f9e-9d67-4b16-bdb4-8f9550b2f963"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:19.246919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ab3414cb-53fc-4f28-9306-46e9c32a9a97 req-327e9796-83ab-48b7-990f-d0b0cd471a64 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:19.247781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ab3414cb-53fc-4f28-9306-46e9c32a9a97 req-327e9796-83ab-48b7-990f-d0b0cd471a64 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:19.248545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ab3414cb-53fc-4f28-9306-46e9c32a9a97 req-327e9796-83ab-48b7-990f-d0b0cd471a64 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:19.268839 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ab3414cb-53fc-4f28-9306-46e9c32a9a97 req-327e9796-83ab-48b7-990f-d0b0cd471a64 service nova] Creating event network-vif-unplugged:71c242f8-d0aa-4cf7-ae41-4a9b10c9f1e1 for instance 7cb63b82-28e4-406d-99a1-7db826bdbdba on n-h2-853611-3 Aug 18 11:37:19.269593 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ab3414cb-53fc-4f28-9306-46e9c32a9a97 req-327e9796-83ab-48b7-990f-d0b0cd471a64 service nova] Creating event network-vif-plugged:00724f9e-9d67-4b16-bdb4-8f9550b2f963 for instance 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd on n-h1-853611-3 Aug 18 11:37:19.280099 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-ab3414cb-53fc-4f28-9306-46e9c32a9a97 req-327e9796-83ab-48b7-990f-d0b0cd471a64 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.081196 Aug 18 11:37:19.282102 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1343/2762] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:37:19.365166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-74378d04-5129-47b1-b5ba-e090365842c4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:19.365807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-74378d04-5129-47b1-b5ba-e090365842c4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:19.373443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74378d04-5129-47b1-b5ba-e090365842c4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:19.374019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74378d04-5129-47b1-b5ba-e090365842c4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:19.374722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74378d04-5129-47b1-b5ba-e090365842c4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:19.375662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74378d04-5129-47b1-b5ba-e090365842c4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:19.377245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74378d04-5129-47b1-b5ba-e090365842c4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:19.388922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74378d04-5129-47b1-b5ba-e090365842c4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:19.658178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3afe6712-6b06-4adc-8753-1cfa1c767df2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:19.659600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3afe6712-6b06-4adc-8753-1cfa1c767df2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:19.671575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3afe6712-6b06-4adc-8753-1cfa1c767df2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:19.674821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3afe6712-6b06-4adc-8753-1cfa1c767df2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:19.675525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3afe6712-6b06-4adc-8753-1cfa1c767df2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:19.676458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3afe6712-6b06-4adc-8753-1cfa1c767df2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:19.687252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3afe6712-6b06-4adc-8753-1cfa1c767df2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:19.687957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3afe6712-6b06-4adc-8753-1cfa1c767df2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:19.717353 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-3afe6712-6b06-4adc-8753-1cfa1c767df2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] HTTP exception thrown: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3afe6712-6b06-4adc-8753-1cfa1c767df2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Request method failure captured: Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba HTTP/1.1 Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iQDeZ3vTQ5lUqeMii3qX57oborv4EjBm23fJ3fdlpgg_xyg4ZfS1P3NNt9NRwiHSsYfPMkw_xl4by97cwPjPN8FjwAlYw7mtE8gvGpkhRgBFmITXnZrPwO4TSenN3nBmXrYrA1xDb2_59enfLW6RS80rIj1updNoUXDpDYSIA4_jv0 Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: f31cf551fa744480b3aeb24d97f9c7ae Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: f31cf551fa744480b3aeb24d97f9c7ae Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersTestMultiNic-220166442-project Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: a31512cf212247b59aa951006f887d02 Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersTestMultiNic-220166442-project Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '7cb63b82-28e4-406d-99a1-7db826bdbdba'} Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:19.719651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:19.723640 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:19.723640 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:19.723640 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:19.723640 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:19.723640 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:19.723640 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:19.723640 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:19.725901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3afe6712-6b06-4adc-8753-1cfa1c767df2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Returning 404 to user: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:19.727042 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3afe6712-6b06-4adc-8753-1cfa1c767df2 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 404 len: 111 microversion: 2.1 time: 0.074432 Aug 18 11:37:19.728169 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1344/2763] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:19 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:19.767319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-74378d04-5129-47b1-b5ba-e090365842c4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:19.773430 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-74378d04-5129-47b1-b5ba-e090365842c4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1312 microversion: 2.1 time: 0.416265 Aug 18 11:37:19.778053 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1420/2764] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:19 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1312 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:19.840883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-105dca69-4fe9-4180-a23d-8f06ec3ddaee tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:19.841605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-105dca69-4fe9-4180-a23d-8f06ec3ddaee tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:19.848021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-105dca69-4fe9-4180-a23d-8f06ec3ddaee tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:19.848635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-105dca69-4fe9-4180-a23d-8f06ec3ddaee tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:19.849174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-105dca69-4fe9-4180-a23d-8f06ec3ddaee tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:19.850549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-105dca69-4fe9-4180-a23d-8f06ec3ddaee tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:19.851250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-105dca69-4fe9-4180-a23d-8f06ec3ddaee tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:19.851950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-105dca69-4fe9-4180-a23d-8f06ec3ddaee tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:20.105987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-105dca69-4fe9-4180-a23d-8f06ec3ddaee tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:20.118606 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-105dca69-4fe9-4180-a23d-8f06ec3ddaee tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1315 microversion: 2.1 time: 0.281699 Aug 18 11:37:20.123178 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1345/2765] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:19 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:20.221352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f53eac31-46f3-49f1-a961-f285069e8fa3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:20.222247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f53eac31-46f3-49f1-a961-f285069e8fa3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:20.233077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a21ef612-a631-40d0-8b16-339759c420b4 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:20.234556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a21ef612-a631-40d0-8b16-339759c420b4 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:20.248013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:20.259451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f53eac31-46f3-49f1-a961-f285069e8fa3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:20.260093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f53eac31-46f3-49f1-a961-f285069e8fa3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:20.262571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a21ef612-a631-40d0-8b16-339759c420b4 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:20.263298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f53eac31-46f3-49f1-a961-f285069e8fa3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:20.264151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f53eac31-46f3-49f1-a961-f285069e8fa3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:20.264720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f53eac31-46f3-49f1-a961-f285069e8fa3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:20.265288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f53eac31-46f3-49f1-a961-f285069e8fa3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:20.265883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a21ef612-a631-40d0-8b16-339759c420b4 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:20.267420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a21ef612-a631-40d0-8b16-339759c420b4 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:20.269411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a21ef612-a631-40d0-8b16-339759c420b4 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:20.269983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a21ef612-a631-40d0-8b16-339759c420b4 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:20.271575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a21ef612-a631-40d0-8b16-339759c420b4 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:20.648143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a21ef612-a631-40d0-8b16-339759c420b4 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:20.662074 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a21ef612-a631-40d0-8b16-339759c420b4 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1478 microversion: 2.1 time: 0.435931 Aug 18 11:37:20.668143 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1346/2766] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:20 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1478 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:20.703930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f53eac31-46f3-49f1-a961-f285069e8fa3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:20.723934 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f53eac31-46f3-49f1-a961-f285069e8fa3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.507628 Aug 18 11:37:20.725532 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1421/2767] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:20 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:20.801260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cb7e2689-c321-4521-9875-813293a98597 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:20.802368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cb7e2689-c321-4521-9875-813293a98597 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:20.815062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb7e2689-c321-4521-9875-813293a98597 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:20.815488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb7e2689-c321-4521-9875-813293a98597 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:20.816103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb7e2689-c321-4521-9875-813293a98597 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:20.816982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb7e2689-c321-4521-9875-813293a98597 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:20.817600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb7e2689-c321-4521-9875-813293a98597 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:20.822191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cb7e2689-c321-4521-9875-813293a98597 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:21.150818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b8bebf0f-e9f0-44bc-8897-05c061916094 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:21.154592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b8bebf0f-e9f0-44bc-8897-05c061916094 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:21.165987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8bebf0f-e9f0-44bc-8897-05c061916094 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:21.169187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8bebf0f-e9f0-44bc-8897-05c061916094 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:21.170266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8bebf0f-e9f0-44bc-8897-05c061916094 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:21.172166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8bebf0f-e9f0-44bc-8897-05c061916094 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:21.173312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8bebf0f-e9f0-44bc-8897-05c061916094 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:21.174701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8bebf0f-e9f0-44bc-8897-05c061916094 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:21.359027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cb7e2689-c321-4521-9875-813293a98597 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:21.371478 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cb7e2689-c321-4521-9875-813293a98597 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1312 microversion: 2.1 time: 0.573908 Aug 18 11:37:21.373474 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1347/2768] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:20 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1312 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:21.507833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8bebf0f-e9f0-44bc-8897-05c061916094 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:21.516693 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b8bebf0f-e9f0-44bc-8897-05c061916094 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1315 microversion: 2.1 time: 0.374819 Aug 18 11:37:21.517286 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1422/2769] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:21 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:21.685582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2c77148f-286c-4430-9b38-a4b0e21d3462 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:21.690757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2c77148f-286c-4430-9b38-a4b0e21d3462 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:21.703572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c77148f-286c-4430-9b38-a4b0e21d3462 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:21.706078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c77148f-286c-4430-9b38-a4b0e21d3462 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:21.709744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c77148f-286c-4430-9b38-a4b0e21d3462 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:21.710620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c77148f-286c-4430-9b38-a4b0e21d3462 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:21.715889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c77148f-286c-4430-9b38-a4b0e21d3462 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:21.716655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c77148f-286c-4430-9b38-a4b0e21d3462 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:21.748630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-748a0137-5d8f-421e-93cf-def5ef4eeb6c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:21.749424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-748a0137-5d8f-421e-93cf-def5ef4eeb6c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:21.778782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-748a0137-5d8f-421e-93cf-def5ef4eeb6c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:21.784466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-748a0137-5d8f-421e-93cf-def5ef4eeb6c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:21.784939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-748a0137-5d8f-421e-93cf-def5ef4eeb6c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:21.789466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-748a0137-5d8f-421e-93cf-def5ef4eeb6c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:21.789466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-748a0137-5d8f-421e-93cf-def5ef4eeb6c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:21.793977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-748a0137-5d8f-421e-93cf-def5ef4eeb6c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:21.993957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2c77148f-286c-4430-9b38-a4b0e21d3462 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:22.007766 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2c77148f-286c-4430-9b38-a4b0e21d3462 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1478 microversion: 2.1 time: 0.327476 Aug 18 11:37:22.008800 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1348/2770] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:21 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1478 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:22.059859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-5e2cac6e-70c2-4168-9a48-7e22d84e1a76 req-ba5f3d68-5219-4b0f-bb83-ecd2e32357c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aee369f-2ece-4b53-a7db-efe946936831", "name": "network-vif-plugged", "status": "completed", "tag": "fdd9010d-de96-4f58-8fc4-5c78c661a107"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:22.090745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5e2cac6e-70c2-4168-9a48-7e22d84e1a76 req-ba5f3d68-5219-4b0f-bb83-ecd2e32357c8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:22.093490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5e2cac6e-70c2-4168-9a48-7e22d84e1a76 req-ba5f3d68-5219-4b0f-bb83-ecd2e32357c8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:22.094089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5e2cac6e-70c2-4168-9a48-7e22d84e1a76 req-ba5f3d68-5219-4b0f-bb83-ecd2e32357c8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:22.106795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-748a0137-5d8f-421e-93cf-def5ef4eeb6c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:22.117886 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5e2cac6e-70c2-4168-9a48-7e22d84e1a76 req-ba5f3d68-5219-4b0f-bb83-ecd2e32357c8 service nova] Creating event network-vif-plugged:fdd9010d-de96-4f58-8fc4-5c78c661a107 for instance 5aee369f-2ece-4b53-a7db-efe946936831 on n-h2-853611-3 Aug 18 11:37:22.118417 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-748a0137-5d8f-421e-93cf-def5ef4eeb6c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.374767 Aug 18 11:37:22.120720 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1423/2771] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:21 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:22.159650 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-5e2cac6e-70c2-4168-9a48-7e22d84e1a76 req-ba5f3d68-5219-4b0f-bb83-ecd2e32357c8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104959 Aug 18 11:37:22.161369 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1349/2772] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:37:22.418720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-79e583a2-98e2-4804-8298-e98234ebe1fe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:22.419635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-79e583a2-98e2-4804-8298-e98234ebe1fe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:22.436789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79e583a2-98e2-4804-8298-e98234ebe1fe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:22.443972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79e583a2-98e2-4804-8298-e98234ebe1fe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:22.444791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79e583a2-98e2-4804-8298-e98234ebe1fe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:22.447635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79e583a2-98e2-4804-8298-e98234ebe1fe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:22.449199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79e583a2-98e2-4804-8298-e98234ebe1fe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:22.451059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79e583a2-98e2-4804-8298-e98234ebe1fe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:22.541273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c4114fee-02b1-4bd6-b4fe-8d3189d06d92 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:22.542879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c4114fee-02b1-4bd6-b4fe-8d3189d06d92 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:22.562457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4114fee-02b1-4bd6-b4fe-8d3189d06d92 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:22.562998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4114fee-02b1-4bd6-b4fe-8d3189d06d92 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:22.563442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4114fee-02b1-4bd6-b4fe-8d3189d06d92 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:22.564229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4114fee-02b1-4bd6-b4fe-8d3189d06d92 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:22.564596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4114fee-02b1-4bd6-b4fe-8d3189d06d92 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:22.565028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4114fee-02b1-4bd6-b4fe-8d3189d06d92 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:22.827319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-79e583a2-98e2-4804-8298-e98234ebe1fe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:22.839128 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-79e583a2-98e2-4804-8298-e98234ebe1fe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1462 microversion: 2.1 time: 0.426260 Aug 18 11:37:22.842525 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1424/2773] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:22 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1462 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:22.868739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:22.873904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:22.890098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:22.893125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:22.893848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:22.894871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:22.897582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:22.898256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:22.977373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c4114fee-02b1-4bd6-b4fe-8d3189d06d92 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:22.996778 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c4114fee-02b1-4bd6-b4fe-8d3189d06d92 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1315 microversion: 2.1 time: 0.457273 Aug 18 11:37:22.997541 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1350/2774] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:22 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:23.034595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fe441dbf-9ab0-4aa0-9ad2-572f97a1aaeb tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:23.035676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fe441dbf-9ab0-4aa0-9ad2-572f97a1aaeb tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:23.047723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe441dbf-9ab0-4aa0-9ad2-572f97a1aaeb tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:23.048220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe441dbf-9ab0-4aa0-9ad2-572f97a1aaeb tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:23.048662 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe441dbf-9ab0-4aa0-9ad2-572f97a1aaeb tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:23.049381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe441dbf-9ab0-4aa0-9ad2-572f97a1aaeb tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:23.049831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe441dbf-9ab0-4aa0-9ad2-572f97a1aaeb tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:23.050255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe441dbf-9ab0-4aa0-9ad2-572f97a1aaeb tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:23.168273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:23.187068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Old instance type m1.heat2, new instance type m1.heat {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 11:37:23.215737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:37:23.216926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:37:23.217434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:37:23.217854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:37:23.218271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:37:23.327058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fe441dbf-9ab0-4aa0-9ad2-572f97a1aaeb tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:23.337653 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fe441dbf-9ab0-4aa0-9ad2-572f97a1aaeb tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1478 microversion: 2.1 time: 0.308640 Aug 18 11:37:23.339385 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1351/2775] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:23 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1478 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:23.345489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-85b08fc0-4668-461c-ae72-029db4731f3d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:23.346108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-85b08fc0-4668-461c-ae72-029db4731f3d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:23.353391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85b08fc0-4668-461c-ae72-029db4731f3d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:23.358731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85b08fc0-4668-461c-ae72-029db4731f3d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:23.359505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85b08fc0-4668-461c-ae72-029db4731f3d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:23.378228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85b08fc0-4668-461c-ae72-029db4731f3d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:23.380086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85b08fc0-4668-461c-ae72-029db4731f3d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:23.380564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85b08fc0-4668-461c-ae72-029db4731f3d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:23.523145 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0bce2a6f-0f21-411c-ad38-429e1ddaede4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "POST /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd/action" status: 202 len: 0 microversion: 2.1 time: 0.659163 Aug 18 11:37:23.527046 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1425/2776] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:37:22 2022] POST /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:37:23.538064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-355d8cbf-8b7f-4e8c-93ab-3d1106abe72c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:23.539139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-355d8cbf-8b7f-4e8c-93ab-3d1106abe72c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:23.551269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-355d8cbf-8b7f-4e8c-93ab-3d1106abe72c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:23.552080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-355d8cbf-8b7f-4e8c-93ab-3d1106abe72c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:23.552690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-355d8cbf-8b7f-4e8c-93ab-3d1106abe72c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:23.555408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-355d8cbf-8b7f-4e8c-93ab-3d1106abe72c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:23.556123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-355d8cbf-8b7f-4e8c-93ab-3d1106abe72c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:23.556743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-355d8cbf-8b7f-4e8c-93ab-3d1106abe72c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:23.602963 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-355d8cbf-8b7f-4e8c-93ab-3d1106abe72c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] HTTP exception thrown: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-355d8cbf-8b7f-4e8c-93ab-3d1106abe72c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Request method failure captured: Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba HTTP/1.1 Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iQDeZ3vTQ5lUqeMii3qX57oborv4EjBm23fJ3fdlpgg_xyg4ZfS1P3NNt9NRwiHSsYfPMkw_xl4by97cwPjPN8FjwAlYw7mtE8gvGpkhRgBFmITXnZrPwO4TSenN3nBmXrYrA1xDb2_59enfLW6RS80rIj1updNoUXDpDYSIA4_jv0 Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f31cf551fa744480b3aeb24d97f9c7ae Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f31cf551fa744480b3aeb24d97f9c7ae Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestMultiNic-220166442-project Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: a31512cf212247b59aa951006f887d02 Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestMultiNic-220166442-project Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '7cb63b82-28e4-406d-99a1-7db826bdbdba'} Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:23.606085 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:23.610859 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:23.610859 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.610859 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:23.610859 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.610859 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:23.610859 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:23.610859 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:23.610859 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:23.610859 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:23.610859 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:23.610859 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.612781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-355d8cbf-8b7f-4e8c-93ab-3d1106abe72c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Returning 404 to user: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:23.614256 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-355d8cbf-8b7f-4e8c-93ab-3d1106abe72c tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 404 len: 111 microversion: 2.1 time: 0.085820 Aug 18 11:37:23.615215 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1426/2777] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:37:23 2022] DELETE /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:23.621739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0167fd5a-90bd-4224-9c9d-a4f0a707182b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:23.622293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0167fd5a-90bd-4224-9c9d-a4f0a707182b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:23.631123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0167fd5a-90bd-4224-9c9d-a4f0a707182b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:23.631619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0167fd5a-90bd-4224-9c9d-a4f0a707182b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:23.632054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0167fd5a-90bd-4224-9c9d-a4f0a707182b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:23.632777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0167fd5a-90bd-4224-9c9d-a4f0a707182b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:23.633620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0167fd5a-90bd-4224-9c9d-a4f0a707182b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:23.634056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0167fd5a-90bd-4224-9c9d-a4f0a707182b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:23.784605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-85b08fc0-4668-461c-ae72-029db4731f3d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:23.797049 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-85b08fc0-4668-461c-ae72-029db4731f3d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.455863 Aug 18 11:37:23.797533 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1352/2778] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:23 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:23.817017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fe032a2b-1df9-4908-8d1d-83cf7e9d3fef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:23.817650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fe032a2b-1df9-4908-8d1d-83cf7e9d3fef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 7cb63b82-28e4-406d-99a1-7db826bdbdba] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:23.825669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe032a2b-1df9-4908-8d1d-83cf7e9d3fef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:23.826170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe032a2b-1df9-4908-8d1d-83cf7e9d3fef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:23.826655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe032a2b-1df9-4908-8d1d-83cf7e9d3fef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:23.827372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe032a2b-1df9-4908-8d1d-83cf7e9d3fef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:23.827831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe032a2b-1df9-4908-8d1d-83cf7e9d3fef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:23.828254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe032a2b-1df9-4908-8d1d-83cf7e9d3fef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:23.850890 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-fe032a2b-1df9-4908-8d1d-83cf7e9d3fef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] HTTP exception thrown: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fe032a2b-1df9-4908-8d1d-83cf7e9d3fef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Request method failure captured: Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba HTTP/1.1 Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iQDeZ3vTQ5lUqeMii3qX57oborv4EjBm23fJ3fdlpgg_xyg4ZfS1P3NNt9NRwiHSsYfPMkw_xl4by97cwPjPN8FjwAlYw7mtE8gvGpkhRgBFmITXnZrPwO4TSenN3nBmXrYrA1xDb2_59enfLW6RS80rIj1updNoUXDpDYSIA4_jv0 Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: f31cf551fa744480b3aeb24d97f9c7ae Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: f31cf551fa744480b3aeb24d97f9c7ae Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersTestMultiNic-220166442-project Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: a31512cf212247b59aa951006f887d02 Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersTestMultiNic-220166442-project Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '7cb63b82-28e4-406d-99a1-7db826bdbdba'} Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:23.852887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.859074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:23.859074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:23.859074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:23.859074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:23.859074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:23.859074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. Aug 18 11:37:23.859074 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.859074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fe032a2b-1df9-4908-8d1d-83cf7e9d3fef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Returning 404 to user: Instance 7cb63b82-28e4-406d-99a1-7db826bdbdba could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:23.859074 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fe032a2b-1df9-4908-8d1d-83cf7e9d3fef tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba" status: 404 len: 111 microversion: 2.1 time: 0.056674 Aug 18 11:37:23.859074 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1353/2779] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:23 2022] GET /compute/v2.1/servers/7cb63b82-28e4-406d-99a1-7db826bdbdba => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:23.868908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e94724ba-11b8-4299-b75d-664aa71acc83 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:23.870935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e94724ba-11b8-4299-b75d-664aa71acc83 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:23.881151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e94724ba-11b8-4299-b75d-664aa71acc83 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:23.882103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e94724ba-11b8-4299-b75d-664aa71acc83 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:23.882847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e94724ba-11b8-4299-b75d-664aa71acc83 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:23.884114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e94724ba-11b8-4299-b75d-664aa71acc83 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:23.884899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e94724ba-11b8-4299-b75d-664aa71acc83 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:23.887970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e94724ba-11b8-4299-b75d-664aa71acc83 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:23.934296 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-e94724ba-11b8-4299-b75d-664aa71acc83 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] HTTP exception thrown: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:37:23.944332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0167fd5a-90bd-4224-9c9d-a4f0a707182b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e94724ba-11b8-4299-b75d-664aa71acc83 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Request method failure captured: Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e HTTP/1.1 Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iQDeZ3vTQ5lUqeMii3qX57oborv4EjBm23fJ3fdlpgg_xyg4ZfS1P3NNt9NRwiHSsYfPMkw_xl4by97cwPjPN8FjwAlYw7mtE8gvGpkhRgBFmITXnZrPwO4TSenN3nBmXrYrA1xDb2_59enfLW6RS80rIj1updNoUXDpDYSIA4_jv0 Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: f31cf551fa744480b3aeb24d97f9c7ae Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: f31cf551fa744480b3aeb24d97f9c7ae Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersTestMultiNic-220166442-project Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: a31512cf212247b59aa951006f887d02 Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersTestMultiNic-220166442-project Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3ed2bb36-0499-4abd-b690-93bbafd53c4e'} Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:23.952771 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:23.960047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:37:23.960047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.960047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:23.960047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.960047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:23.960047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:23.960047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:23.960047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:23.960047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:23.960047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:37:23.960047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:23.960047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e94724ba-11b8-4299-b75d-664aa71acc83 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Returning 404 to user: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:23.960047 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e94724ba-11b8-4299-b75d-664aa71acc83 tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 404 len: 111 microversion: 2.1 time: 0.092301 Aug 18 11:37:23.961335 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0167fd5a-90bd-4224-9c9d-a4f0a707182b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1471 microversion: 2.1 time: 0.337536 Aug 18 11:37:23.961501 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1354/2780] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:37:23 2022] DELETE /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:37:23.961667 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1427/2781] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:23 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1471 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:23.983364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3aac90f6-cf4b-4bc3-9db1-72af19f449ff tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:23.985220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3aac90f6-cf4b-4bc3-9db1-72af19f449ff tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] [instance: 3ed2bb36-0499-4abd-b690-93bbafd53c4e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:24.009741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3aac90f6-cf4b-4bc3-9db1-72af19f449ff tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:24.010320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3aac90f6-cf4b-4bc3-9db1-72af19f449ff tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:24.010797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3aac90f6-cf4b-4bc3-9db1-72af19f449ff tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:24.011701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3aac90f6-cf4b-4bc3-9db1-72af19f449ff tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:24.011982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3aac90f6-cf4b-4bc3-9db1-72af19f449ff tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:24.012410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3aac90f6-cf4b-4bc3-9db1-72af19f449ff tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:24.019482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f13f5038-426a-4abd-ad4b-12653af649c7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:24.022796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f13f5038-426a-4abd-ad4b-12653af649c7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:24.046361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f13f5038-426a-4abd-ad4b-12653af649c7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:24.047371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f13f5038-426a-4abd-ad4b-12653af649c7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:24.052209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f13f5038-426a-4abd-ad4b-12653af649c7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:24.053409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f13f5038-426a-4abd-ad4b-12653af649c7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:24.054298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f13f5038-426a-4abd-ad4b-12653af649c7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:24.054983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f13f5038-426a-4abd-ad4b-12653af649c7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:24.081463 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-3aac90f6-cf4b-4bc3-9db1-72af19f449ff tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] HTTP exception thrown: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3aac90f6-cf4b-4bc3-9db1-72af19f449ff tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Request method failure captured: Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e HTTP/1.1 Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iQDeZ3vTQ5lUqeMii3qX57oborv4EjBm23fJ3fdlpgg_xyg4ZfS1P3NNt9NRwiHSsYfPMkw_xl4by97cwPjPN8FjwAlYw7mtE8gvGpkhRgBFmITXnZrPwO4TSenN3nBmXrYrA1xDb2_59enfLW6RS80rIj1updNoUXDpDYSIA4_jv0 Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: f31cf551fa744480b3aeb24d97f9c7ae Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f31cf551fa744480b3aeb24d97f9c7ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: f31cf551fa744480b3aeb24d97f9c7ae Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersTestMultiNic-220166442 Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersTestMultiNic-220166442-project Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: a31512cf212247b59aa951006f887d02 Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersTestMultiNic-220166442-project Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3ed2bb36-0499-4abd-b690-93bbafd53c4e'} Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:24.090361 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:24.094153 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:24.094153 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:24.094153 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:24.094153 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:24.094153 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:24.094153 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. Aug 18 11:37:24.094153 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:24.095380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3aac90f6-cf4b-4bc3-9db1-72af19f449ff tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] Returning 404 to user: Instance 3ed2bb36-0499-4abd-b690-93bbafd53c4e could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:24.096149 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3aac90f6-cf4b-4bc3-9db1-72af19f449ff tempest-ServersTestMultiNic-220166442 tempest-ServersTestMultiNic-220166442-project] 10.222.0.73 "GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e" status: 404 len: 111 microversion: 2.1 time: 0.123797 Aug 18 11:37:24.097088 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1355/2782] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:23 2022] GET /compute/v2.1/servers/3ed2bb36-0499-4abd-b690-93bbafd53c4e => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:24.367389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a9065c8e-2a6f-45a0-a9bf-5c9ea9da87ca tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:24.370257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a9065c8e-2a6f-45a0-a9bf-5c9ea9da87ca tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:24.394596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9065c8e-2a6f-45a0-a9bf-5c9ea9da87ca tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:24.395103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9065c8e-2a6f-45a0-a9bf-5c9ea9da87ca tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:24.395549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9065c8e-2a6f-45a0-a9bf-5c9ea9da87ca tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:24.396658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9065c8e-2a6f-45a0-a9bf-5c9ea9da87ca tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:24.396758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9065c8e-2a6f-45a0-a9bf-5c9ea9da87ca tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:24.397131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9065c8e-2a6f-45a0-a9bf-5c9ea9da87ca tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:25.060839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a9065c8e-2a6f-45a0-a9bf-5c9ea9da87ca tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:25.080675 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a9065c8e-2a6f-45a0-a9bf-5c9ea9da87ca tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1464 microversion: 2.1 time: 0.717698 Aug 18 11:37:25.083060 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1356/2783] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:24 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1464 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:25.097462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-aa78f7cf-d2fa-4c46-9a87-e73ed4672601 req-54c8e336-0056-4258-89ee-9364f9b3b3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1faf71d-d10a-439f-90dc-f8e9e8127cbb", "name": "network-vif-plugged", "status": "completed", "tag": "0fef1d0b-7117-439f-a946-2ac519e45e27"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:25.128317 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-aa78f7cf-d2fa-4c46-9a87-e73ed4672601 req-54c8e336-0056-4258-89ee-9364f9b3b3e5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:25.129051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-aa78f7cf-d2fa-4c46-9a87-e73ed4672601 req-54c8e336-0056-4258-89ee-9364f9b3b3e5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:25.130712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-aa78f7cf-d2fa-4c46-9a87-e73ed4672601 req-54c8e336-0056-4258-89ee-9364f9b3b3e5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:25.168053 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-aa78f7cf-d2fa-4c46-9a87-e73ed4672601 req-54c8e336-0056-4258-89ee-9364f9b3b3e5 service nova] Creating event network-vif-plugged:0fef1d0b-7117-439f-a946-2ac519e45e27 for instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb on n-h2-853611-3 Aug 18 11:37:25.173699 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-aa78f7cf-d2fa-4c46-9a87-e73ed4672601 req-54c8e336-0056-4258-89ee-9364f9b3b3e5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088408 Aug 18 11:37:25.175009 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1357/2784] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:37:25.181576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-191730ca-0970-4e4e-8f6b-9f70e7727f32 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:25.183291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-191730ca-0970-4e4e-8f6b-9f70e7727f32 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:25.207214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-191730ca-0970-4e4e-8f6b-9f70e7727f32 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:25.207999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-191730ca-0970-4e4e-8f6b-9f70e7727f32 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:25.208611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-191730ca-0970-4e4e-8f6b-9f70e7727f32 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:25.209521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-191730ca-0970-4e4e-8f6b-9f70e7727f32 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:25.210142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-191730ca-0970-4e4e-8f6b-9f70e7727f32 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:25.210951 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-191730ca-0970-4e4e-8f6b-9f70e7727f32 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:25.411429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f13f5038-426a-4abd-ad4b-12653af649c7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:25.432914 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f13f5038-426a-4abd-ad4b-12653af649c7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1315 microversion: 2.1 time: 1.417853 Aug 18 11:37:25.433425 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1428/2785] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:24 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1315 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:25.452359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-85dcab94-8676-4b15-86fe-13b3bbb27e6d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:25.452965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-85dcab94-8676-4b15-86fe-13b3bbb27e6d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:25.480576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85dcab94-8676-4b15-86fe-13b3bbb27e6d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:25.482175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85dcab94-8676-4b15-86fe-13b3bbb27e6d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:25.486293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85dcab94-8676-4b15-86fe-13b3bbb27e6d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:25.488573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85dcab94-8676-4b15-86fe-13b3bbb27e6d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:25.491847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85dcab94-8676-4b15-86fe-13b3bbb27e6d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:25.493086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85dcab94-8676-4b15-86fe-13b3bbb27e6d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:25.689440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-191730ca-0970-4e4e-8f6b-9f70e7727f32 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:25.700462 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-191730ca-0970-4e4e-8f6b-9f70e7727f32 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.523988 Aug 18 11:37:25.701050 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1358/2786] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:25 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:25.728097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-474d0628-2316-4892-a379-702ee76a2153 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:25.728657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-474d0628-2316-4892-a379-702ee76a2153 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:25.770684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-474d0628-2316-4892-a379-702ee76a2153 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:25.774963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-474d0628-2316-4892-a379-702ee76a2153 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:25.775637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-474d0628-2316-4892-a379-702ee76a2153 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:25.777550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-474d0628-2316-4892-a379-702ee76a2153 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:25.780050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-474d0628-2316-4892-a379-702ee76a2153 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:25.780686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-474d0628-2316-4892-a379-702ee76a2153 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:26.019900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-85dcab94-8676-4b15-86fe-13b3bbb27e6d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:26.039774 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-85dcab94-8676-4b15-86fe-13b3bbb27e6d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1471 microversion: 2.1 time: 0.595895 Aug 18 11:37:26.044533 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1429/2787] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:25 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1471 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:26.353066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-474d0628-2316-4892-a379-702ee76a2153 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:26.369298 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-474d0628-2316-4892-a379-702ee76a2153 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1464 microversion: 2.1 time: 0.661053 Aug 18 11:37:26.382496 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1359/2788] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:25 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1464 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:26.392285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:26.401271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:26.409782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:26.410523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:26.411138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:26.412131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:26.412719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:26.413108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:26.459144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aeb78990-a7ab-43e2-a63c-c197cc59d0a4 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:26.459876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-aeb78990-a7ab-43e2-a63c-c197cc59d0a4 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:26.476245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb78990-a7ab-43e2-a63c-c197cc59d0a4 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:26.477969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb78990-a7ab-43e2-a63c-c197cc59d0a4 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:26.486703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb78990-a7ab-43e2-a63c-c197cc59d0a4 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:26.489324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb78990-a7ab-43e2-a63c-c197cc59d0a4 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:26.490770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb78990-a7ab-43e2-a63c-c197cc59d0a4 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:26.493018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeb78990-a7ab-43e2-a63c-c197cc59d0a4 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:26.630072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:37:26.636701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:37:26.637201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:37:26.637629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:37:26.638047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:37:26.784343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:26.837383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:26.856130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:26.861917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:26.862729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:26.863782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:26.868139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:26.870844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:26.941723 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7288a336-8e5b-4c04-a752-0f5bd9fe623a tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "POST /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831/action" status: 202 len: 1068 microversion: 2.1 time: 0.554190 Aug 18 11:37:26.954216 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1430/2789] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:37:26 2022] POST /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831/action => generated 1068 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 18 11:37:26.962718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-44eb1be1-cca5-4b8f-9ea3-bb919b2485a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:26.966956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-44eb1be1-cca5-4b8f-9ea3-bb919b2485a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:26.975042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44eb1be1-cca5-4b8f-9ea3-bb919b2485a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:26.975948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44eb1be1-cca5-4b8f-9ea3-bb919b2485a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:26.976605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44eb1be1-cca5-4b8f-9ea3-bb919b2485a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:26.977582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44eb1be1-cca5-4b8f-9ea3-bb919b2485a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:26.978472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44eb1be1-cca5-4b8f-9ea3-bb919b2485a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:26.979983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44eb1be1-cca5-4b8f-9ea3-bb919b2485a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:27.086535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aeb78990-a7ab-43e2-a63c-c197cc59d0a4 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:27.096332 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aeb78990-a7ab-43e2-a63c-c197cc59d0a4 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1315 microversion: 2.1 time: 0.641655 Aug 18 11:37:27.105038 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1360/2790] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:26 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:27.118988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-79fa016f-dc79-460a-b223-8fdb30570c7d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:27.119973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-79fa016f-dc79-460a-b223-8fdb30570c7d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:27.127977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-79fa016f-dc79-460a-b223-8fdb30570c7d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:27.130827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-79fa016f-dc79-460a-b223-8fdb30570c7d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:27.131451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-79fa016f-dc79-460a-b223-8fdb30570c7d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:27.132340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-79fa016f-dc79-460a-b223-8fdb30570c7d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:27.133906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-79fa016f-dc79-460a-b223-8fdb30570c7d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:27.136261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-79fa016f-dc79-460a-b223-8fdb30570c7d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:27.365608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-44eb1be1-cca5-4b8f-9ea3-bb919b2485a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:27.375814 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-44eb1be1-cca5-4b8f-9ea3-bb919b2485a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.419395 Aug 18 11:37:27.402127 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1431/2791] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:26 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:27.407425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d9850716-e82f-4b53-a80c-a7380adef679 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:27.411237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d9850716-e82f-4b53-a80c-a7380adef679 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:27.430573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9850716-e82f-4b53-a80c-a7380adef679 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:27.437426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9850716-e82f-4b53-a80c-a7380adef679 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:27.438324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9850716-e82f-4b53-a80c-a7380adef679 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:27.439421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9850716-e82f-4b53-a80c-a7380adef679 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:27.440119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9850716-e82f-4b53-a80c-a7380adef679 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:27.440771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9850716-e82f-4b53-a80c-a7380adef679 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:27.831951 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-79fa016f-dc79-460a-b223-8fdb30570c7d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:27.846349 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-79fa016f-dc79-460a-b223-8fdb30570c7d tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 0.739399 Aug 18 11:37:27.848105 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1361/2792] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:27 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:28.129773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-55c45f9e-a042-4708-9e03-f1281193b34c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:28.131027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-55c45f9e-a042-4708-9e03-f1281193b34c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:28.150092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55c45f9e-a042-4708-9e03-f1281193b34c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:28.151029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d9850716-e82f-4b53-a80c-a7380adef679 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:28.151369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55c45f9e-a042-4708-9e03-f1281193b34c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:28.151878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55c45f9e-a042-4708-9e03-f1281193b34c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:28.152712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55c45f9e-a042-4708-9e03-f1281193b34c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:28.153179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55c45f9e-a042-4708-9e03-f1281193b34c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:28.153874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55c45f9e-a042-4708-9e03-f1281193b34c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:28.161390 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d9850716-e82f-4b53-a80c-a7380adef679 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1471 microversion: 2.1 time: 0.757667 Aug 18 11:37:28.167192 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1432/2793] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:27 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1471 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:28.195058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:28.405051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-82777a58-660d-43a0-a147-2d499dd8a589 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:28.405655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-82777a58-660d-43a0-a147-2d499dd8a589 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:28.421328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82777a58-660d-43a0-a147-2d499dd8a589 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:28.425270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82777a58-660d-43a0-a147-2d499dd8a589 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:28.429192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82777a58-660d-43a0-a147-2d499dd8a589 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:28.430618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82777a58-660d-43a0-a147-2d499dd8a589 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:28.431198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82777a58-660d-43a0-a147-2d499dd8a589 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:28.442228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82777a58-660d-43a0-a147-2d499dd8a589 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:29.062244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-82777a58-660d-43a0-a147-2d499dd8a589 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:29.082519 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-82777a58-660d-43a0-a147-2d499dd8a589 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.682998 Aug 18 11:37:29.089241 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1433/2794] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:28 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:29.101784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-603d38c9-93ef-4b4b-ba04-7df92c155f0c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:29.105975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-603d38c9-93ef-4b4b-ba04-7df92c155f0c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:29.127123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-603d38c9-93ef-4b4b-ba04-7df92c155f0c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:29.128384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-603d38c9-93ef-4b4b-ba04-7df92c155f0c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:29.129000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-603d38c9-93ef-4b4b-ba04-7df92c155f0c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:29.132555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-603d38c9-93ef-4b4b-ba04-7df92c155f0c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:29.133872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-603d38c9-93ef-4b4b-ba04-7df92c155f0c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:29.135852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-603d38c9-93ef-4b4b-ba04-7df92c155f0c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:29.364586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-55c45f9e-a042-4708-9e03-f1281193b34c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:29.381347 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-55c45f9e-a042-4708-9e03-f1281193b34c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1502 microversion: 2.1 time: 1.252402 Aug 18 11:37:29.399425 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1362/2795] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:28 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1502 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:29.429456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ace826b8-53a1-4427-a558-d5189fa1f8ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:29.429456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ace826b8-53a1-4427-a558-d5189fa1f8ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:29.442047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ace826b8-53a1-4427-a558-d5189fa1f8ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:29.443228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ace826b8-53a1-4427-a558-d5189fa1f8ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:29.443687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ace826b8-53a1-4427-a558-d5189fa1f8ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:29.444434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ace826b8-53a1-4427-a558-d5189fa1f8ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:29.445317 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ace826b8-53a1-4427-a558-d5189fa1f8ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:29.445752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ace826b8-53a1-4427-a558-d5189fa1f8ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:29.687806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-603d38c9-93ef-4b4b-ba04-7df92c155f0c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:29.703118 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-603d38c9-93ef-4b4b-ba04-7df92c155f0c tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 0.610889 Aug 18 11:37:29.705796 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1434/2796] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:29 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:29.723310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a262201-2a63-48c1-b1dc-fb0424902da3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:29.738734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a262201-2a63-48c1-b1dc-fb0424902da3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:29.752811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a262201-2a63-48c1-b1dc-fb0424902da3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:29.753305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a262201-2a63-48c1-b1dc-fb0424902da3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:29.753743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a262201-2a63-48c1-b1dc-fb0424902da3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:29.754486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a262201-2a63-48c1-b1dc-fb0424902da3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:29.754928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a262201-2a63-48c1-b1dc-fb0424902da3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:29.755355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a262201-2a63-48c1-b1dc-fb0424902da3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:29.844667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-1a262201-2a63-48c1-b1dc-fb0424902da3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lazy-loading 'flavor' on Instance uuid d1faf71d-d10a-439f-90dc-f8e9e8127cbb {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:37:29.987965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ace826b8-53a1-4427-a558-d5189fa1f8ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:29.999434 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ace826b8-53a1-4427-a558-d5189fa1f8ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1471 microversion: 2.1 time: 0.592087 Aug 18 11:37:30.003748 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1363/2797] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:29 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1471 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:30.110072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d8fce0d0-87ac-4fdc-8dbd-33cb39d19500 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:30.111005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d8fce0d0-87ac-4fdc-8dbd-33cb39d19500 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:30.122303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8fce0d0-87ac-4fdc-8dbd-33cb39d19500 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:30.135433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8fce0d0-87ac-4fdc-8dbd-33cb39d19500 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:30.136220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8fce0d0-87ac-4fdc-8dbd-33cb39d19500 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:30.137150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8fce0d0-87ac-4fdc-8dbd-33cb39d19500 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:30.137766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8fce0d0-87ac-4fdc-8dbd-33cb39d19500 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:30.143268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8fce0d0-87ac-4fdc-8dbd-33cb39d19500 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:30.632182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d8fce0d0-87ac-4fdc-8dbd-33cb39d19500 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:30.645789 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d8fce0d0-87ac-4fdc-8dbd-33cb39d19500 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.539591 Aug 18 11:37:30.648789 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1364/2798] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:30 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:30.714710 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a262201-2a63-48c1-b1dc-fb0424902da3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "POST /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb/action" status: 202 len: 0 microversion: 2.1 time: 1.007109 Aug 18 11:37:30.716070 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1435/2799] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:37:29 2022] POST /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb/action => generated 0 bytes in 1009 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:37:30.723952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3bd9c23f-bb5d-4327-a73d-0fc3c1b288da tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:30.725450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3bd9c23f-bb5d-4327-a73d-0fc3c1b288da tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:30.736761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bd9c23f-bb5d-4327-a73d-0fc3c1b288da tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:30.745702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bd9c23f-bb5d-4327-a73d-0fc3c1b288da tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:30.746028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bd9c23f-bb5d-4327-a73d-0fc3c1b288da tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:30.747069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bd9c23f-bb5d-4327-a73d-0fc3c1b288da tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:30.747822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bd9c23f-bb5d-4327-a73d-0fc3c1b288da tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:30.748350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bd9c23f-bb5d-4327-a73d-0fc3c1b288da tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:30.769245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e7d368b-d31e-4127-8d6e-47e39aa428c2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:30.773320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2e7d368b-d31e-4127-8d6e-47e39aa428c2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:30.792076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e7d368b-d31e-4127-8d6e-47e39aa428c2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:30.792855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e7d368b-d31e-4127-8d6e-47e39aa428c2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:30.794378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e7d368b-d31e-4127-8d6e-47e39aa428c2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:30.799687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e7d368b-d31e-4127-8d6e-47e39aa428c2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:30.801624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e7d368b-d31e-4127-8d6e-47e39aa428c2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:30.809692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e7d368b-d31e-4127-8d6e-47e39aa428c2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:31.183160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2e7d368b-d31e-4127-8d6e-47e39aa428c2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:31.195192 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2e7d368b-d31e-4127-8d6e-47e39aa428c2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 0.454087 Aug 18 11:37:31.210586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3bd9c23f-bb5d-4327-a73d-0fc3c1b288da tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:31.210839 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1436/2800] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:30 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:31.224667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-79fc3da5-219b-4e20-8770-78b1509f8040 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:31.226239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-79fc3da5-219b-4e20-8770-78b1509f8040 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:31.231063 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3bd9c23f-bb5d-4327-a73d-0fc3c1b288da tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1510 microversion: 2.1 time: 0.511097 Aug 18 11:37:31.235835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79fc3da5-219b-4e20-8770-78b1509f8040 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:31.236327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79fc3da5-219b-4e20-8770-78b1509f8040 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:31.237700 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1365/2801] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:30 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1510 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:31.239946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79fc3da5-219b-4e20-8770-78b1509f8040 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:31.243682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79fc3da5-219b-4e20-8770-78b1509f8040 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:31.243682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79fc3da5-219b-4e20-8770-78b1509f8040 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:31.243682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79fc3da5-219b-4e20-8770-78b1509f8040 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:31.679370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-330426d8-601e-461f-bfde-17a315aabe93 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:31.680977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-330426d8-601e-461f-bfde-17a315aabe93 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:31.702784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-330426d8-601e-461f-bfde-17a315aabe93 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:31.705573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-330426d8-601e-461f-bfde-17a315aabe93 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:31.706904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-330426d8-601e-461f-bfde-17a315aabe93 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:31.712255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-330426d8-601e-461f-bfde-17a315aabe93 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:31.714797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-330426d8-601e-461f-bfde-17a315aabe93 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:31.715462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-330426d8-601e-461f-bfde-17a315aabe93 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:31.716127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-79fc3da5-219b-4e20-8770-78b1509f8040 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:31.724790 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-79fc3da5-219b-4e20-8770-78b1509f8040 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.509075 Aug 18 11:37:31.725372 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1437/2802] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:31 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:32.231078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3c37185f-be0b-432a-9a0f-fdd3061b09d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:32.232722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3c37185f-be0b-432a-9a0f-fdd3061b09d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:32.266810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c37185f-be0b-432a-9a0f-fdd3061b09d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:32.267792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c37185f-be0b-432a-9a0f-fdd3061b09d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:32.268510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c37185f-be0b-432a-9a0f-fdd3061b09d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:32.269806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c37185f-be0b-432a-9a0f-fdd3061b09d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:32.270704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c37185f-be0b-432a-9a0f-fdd3061b09d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:32.271468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c37185f-be0b-432a-9a0f-fdd3061b09d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:32.467026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-330426d8-601e-461f-bfde-17a315aabe93 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:32.480144 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-330426d8-601e-461f-bfde-17a315aabe93 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.812937 Aug 18 11:37:32.480552 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1366/2803] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:31 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:32.505206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-884329ee-e094-4e49-9e3b-f02f8d41ed3b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:32.509897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-884329ee-e094-4e49-9e3b-f02f8d41ed3b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:32.528379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-884329ee-e094-4e49-9e3b-f02f8d41ed3b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:32.534412 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-884329ee-e094-4e49-9e3b-f02f8d41ed3b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:32.535059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-884329ee-e094-4e49-9e3b-f02f8d41ed3b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:32.535985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-884329ee-e094-4e49-9e3b-f02f8d41ed3b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:32.536605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-884329ee-e094-4e49-9e3b-f02f8d41ed3b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:32.537215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-884329ee-e094-4e49-9e3b-f02f8d41ed3b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:32.624065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3c37185f-be0b-432a-9a0f-fdd3061b09d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:32.645047 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3c37185f-be0b-432a-9a0f-fdd3061b09d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 0.424202 Aug 18 11:37:32.646801 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1438/2804] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:32 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:32.750365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6531a0c-c242-4c1e-8c11-cea90af45251 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:32.751152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c6531a0c-c242-4c1e-8c11-cea90af45251 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:32.762299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6531a0c-c242-4c1e-8c11-cea90af45251 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:32.764219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6531a0c-c242-4c1e-8c11-cea90af45251 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:32.766415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6531a0c-c242-4c1e-8c11-cea90af45251 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:32.767507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6531a0c-c242-4c1e-8c11-cea90af45251 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:32.771008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6531a0c-c242-4c1e-8c11-cea90af45251 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:32.772162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6531a0c-c242-4c1e-8c11-cea90af45251 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:33.105038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c6531a0c-c242-4c1e-8c11-cea90af45251 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:33.117909 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c6531a0c-c242-4c1e-8c11-cea90af45251 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.371432 Aug 18 11:37:33.125763 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1439/2805] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:32 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:33.181861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-884329ee-e094-4e49-9e3b-f02f8d41ed3b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:33.191584 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-884329ee-e094-4e49-9e3b-f02f8d41ed3b tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1493 microversion: 2.1 time: 0.691893 Aug 18 11:37:33.202816 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1367/2806] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:32 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1493 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:33.223298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5aa58f67-5d46-417a-8c93-6faafeb05b97 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:33.224024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5aa58f67-5d46-417a-8c93-6faafeb05b97 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:33.236570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5aa58f67-5d46-417a-8c93-6faafeb05b97 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:33.237388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5aa58f67-5d46-417a-8c93-6faafeb05b97 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:33.238006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5aa58f67-5d46-417a-8c93-6faafeb05b97 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:33.241463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5aa58f67-5d46-417a-8c93-6faafeb05b97 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:33.242217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5aa58f67-5d46-417a-8c93-6faafeb05b97 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:33.242892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5aa58f67-5d46-417a-8c93-6faafeb05b97 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:33.309980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5aa58f67-5d46-417a-8c93-6faafeb05b97 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:37:33.481953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:33.497445 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5aa58f67-5d46-417a-8c93-6faafeb05b97 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 204 len: 0 microversion: 2.1 time: 0.277876 Aug 18 11:37:33.503034 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1440/2807] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:37:33 2022] DELETE /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:37:33.508740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-089b97cb-85b9-451d-b898-9702ce1db90f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:33.510160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-089b97cb-85b9-451d-b898-9702ce1db90f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:33.513448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bb607778-70fc-4eac-8821-92e7884117fd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:33.514937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bb607778-70fc-4eac-8821-92e7884117fd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:33.525413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-089b97cb-85b9-451d-b898-9702ce1db90f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:33.528415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bb607778-70fc-4eac-8821-92e7884117fd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:33.529232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-089b97cb-85b9-451d-b898-9702ce1db90f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:33.530013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bb607778-70fc-4eac-8821-92e7884117fd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:33.530703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-089b97cb-85b9-451d-b898-9702ce1db90f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:33.531125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bb607778-70fc-4eac-8821-92e7884117fd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:33.531900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bb607778-70fc-4eac-8821-92e7884117fd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:33.533943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-089b97cb-85b9-451d-b898-9702ce1db90f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:33.536703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-089b97cb-85b9-451d-b898-9702ce1db90f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:33.537883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-089b97cb-85b9-451d-b898-9702ce1db90f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:33.539300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bb607778-70fc-4eac-8821-92e7884117fd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:33.541668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bb607778-70fc-4eac-8821-92e7884117fd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:33.865759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-089b97cb-85b9-451d-b898-9702ce1db90f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:33.876605 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-089b97cb-85b9-451d-b898-9702ce1db90f tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1499 microversion: 2.1 time: 0.372155 Aug 18 11:37:33.891089 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1441/2808] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:33 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1499 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:33.899450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a38cb6db-e66a-456b-94dd-b91c5a58a8e5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:33.908378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a38cb6db-e66a-456b-94dd-b91c5a58a8e5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:33.919831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a38cb6db-e66a-456b-94dd-b91c5a58a8e5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:33.924575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a38cb6db-e66a-456b-94dd-b91c5a58a8e5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:33.928215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a38cb6db-e66a-456b-94dd-b91c5a58a8e5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:33.931323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a38cb6db-e66a-456b-94dd-b91c5a58a8e5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:33.934734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a38cb6db-e66a-456b-94dd-b91c5a58a8e5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:33.937075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a38cb6db-e66a-456b-94dd-b91c5a58a8e5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:34.058871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bb607778-70fc-4eac-8821-92e7884117fd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:34.078236 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bb607778-70fc-4eac-8821-92e7884117fd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.575433 Aug 18 11:37:34.079868 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1368/2809] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:33 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:34.148411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ba8bc126-132a-471e-a7a0-e6e3e223d772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:34.149048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ba8bc126-132a-471e-a7a0-e6e3e223d772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:34.158564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba8bc126-132a-471e-a7a0-e6e3e223d772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:34.159090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba8bc126-132a-471e-a7a0-e6e3e223d772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:34.159533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba8bc126-132a-471e-a7a0-e6e3e223d772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:34.164429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba8bc126-132a-471e-a7a0-e6e3e223d772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:34.170903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba8bc126-132a-471e-a7a0-e6e3e223d772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:34.171480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ba8bc126-132a-471e-a7a0-e6e3e223d772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:34.368885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a38cb6db-e66a-456b-94dd-b91c5a58a8e5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:34.378191 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a38cb6db-e66a-456b-94dd-b91c5a58a8e5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 0.485889 Aug 18 11:37:34.378812 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1442/2810] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:33 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:34.572578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ba8bc126-132a-471e-a7a0-e6e3e223d772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:34.584698 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ba8bc126-132a-471e-a7a0-e6e3e223d772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.439381 Aug 18 11:37:34.602688 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1369/2811] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:34 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:34.904151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-676a0ade-fd7f-40b2-97cf-531243b5fcc3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:34.904777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-676a0ade-fd7f-40b2-97cf-531243b5fcc3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:34.922312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-676a0ade-fd7f-40b2-97cf-531243b5fcc3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:34.922756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-676a0ade-fd7f-40b2-97cf-531243b5fcc3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:34.924791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-676a0ade-fd7f-40b2-97cf-531243b5fcc3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:34.926098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-676a0ade-fd7f-40b2-97cf-531243b5fcc3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:34.926614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-676a0ade-fd7f-40b2-97cf-531243b5fcc3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:34.927048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-676a0ade-fd7f-40b2-97cf-531243b5fcc3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:34.979763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:35.103725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0517058b-e69f-49c7-acc4-5de34c5cce6a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:35.104467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0517058b-e69f-49c7-acc4-5de34c5cce6a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:35.121988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0517058b-e69f-49c7-acc4-5de34c5cce6a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:35.122530 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0517058b-e69f-49c7-acc4-5de34c5cce6a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:35.122969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0517058b-e69f-49c7-acc4-5de34c5cce6a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:35.123694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0517058b-e69f-49c7-acc4-5de34c5cce6a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:35.124154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0517058b-e69f-49c7-acc4-5de34c5cce6a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:35.124597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0517058b-e69f-49c7-acc4-5de34c5cce6a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:35.222056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-676a0ade-fd7f-40b2-97cf-531243b5fcc3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:35.241417 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-676a0ade-fd7f-40b2-97cf-531243b5fcc3 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1499 microversion: 2.1 time: 0.341986 Aug 18 11:37:35.243361 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1443/2812] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:34 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1499 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:35.482761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8a1ec71f-8558-4484-8bc3-97c0413bac24 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Action: 'create', calling method: .version_select at 0x7f519efebc10>, body: {"keypair": {"name": "tempest-keypair-396525055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKR1v3/V8HcV8jLFmRVvVyX9xA+N3BH9wHlRyT/ehlOF57lV0Iq6DueL3ssjm/w0Ce377EnHz8fo9JmEB0hiMfAatNNUcUVLRjgz+9SWoZBrdLtoeEsrflEFz6abQr0IIg=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:35.511131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-8a1ec71f-8558-4484-8bc3-97c0413bac24 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Getting quotas for project 6dd47af6f12647688be7ca8b48bd696f. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:37:35.517871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-8a1ec71f-8558-4484-8bc3-97c0413bac24 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Getting quotas for user 5bd01fe65b2b45828e0925aa49200fd1 and project 6dd47af6f12647688be7ca8b48bd696f. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:37:35.552715 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8a1ec71f-8558-4484-8bc3-97c0413bac24 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.307007 Aug 18 11:37:35.554028 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1444/2813] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:37:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:37:35.561185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-502e0d4f-a0ea-4b93-ae62-9e260db323b7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:35.562041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-502e0d4f-a0ea-4b93-ae62-9e260db323b7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:35.570147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-502e0d4f-a0ea-4b93-ae62-9e260db323b7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:35.571327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-502e0d4f-a0ea-4b93-ae62-9e260db323b7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:35.572432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-502e0d4f-a0ea-4b93-ae62-9e260db323b7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:35.573248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-502e0d4f-a0ea-4b93-ae62-9e260db323b7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:35.573742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-502e0d4f-a0ea-4b93-ae62-9e260db323b7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:35.574335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-502e0d4f-a0ea-4b93-ae62-9e260db323b7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:35.618489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0517058b-e69f-49c7-acc4-5de34c5cce6a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:35.627689 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0517058b-e69f-49c7-acc4-5de34c5cce6a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.528960 Aug 18 11:37:35.629791 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1370/2814] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:35 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:35.635609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3044d3e-e98a-4b08-b11b-12a6bc90c4da tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:35.636983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d3044d3e-e98a-4b08-b11b-12a6bc90c4da tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:35.655114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3044d3e-e98a-4b08-b11b-12a6bc90c4da tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:35.656238 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3044d3e-e98a-4b08-b11b-12a6bc90c4da tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:35.656770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3044d3e-e98a-4b08-b11b-12a6bc90c4da tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:35.657617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3044d3e-e98a-4b08-b11b-12a6bc90c4da tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:35.658196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3044d3e-e98a-4b08-b11b-12a6bc90c4da tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:35.658780 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3044d3e-e98a-4b08-b11b-12a6bc90c4da tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:35.877975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-502e0d4f-a0ea-4b93-ae62-9e260db323b7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:35.903082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d3044d3e-e98a-4b08-b11b-12a6bc90c4da tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:35.917789 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-502e0d4f-a0ea-4b93-ae62-9e260db323b7 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 0.361713 Aug 18 11:37:35.918550 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d3044d3e-e98a-4b08-b11b-12a6bc90c4da tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.286859 Aug 18 11:37:35.919672 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1445/2816] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:35 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:35.920569 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1371/2816] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:35 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:36.175907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-3775bacc-57de-4db5-9f0c-0706f08e0b26 req-43a9ac9c-3a29-41e0-a008-749f2c769e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1faf71d-d10a-439f-90dc-f8e9e8127cbb", "name": "network-vif-deleted", "tag": "0fef1d0b-7117-439f-a946-2ac519e45e27"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:36.202558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3775bacc-57de-4db5-9f0c-0706f08e0b26 req-43a9ac9c-3a29-41e0-a008-749f2c769e7e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:36.203173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3775bacc-57de-4db5-9f0c-0706f08e0b26 req-43a9ac9c-3a29-41e0-a008-749f2c769e7e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:36.203990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3775bacc-57de-4db5-9f0c-0706f08e0b26 req-43a9ac9c-3a29-41e0-a008-749f2c769e7e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:36.220299 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-3775bacc-57de-4db5-9f0c-0706f08e0b26 req-43a9ac9c-3a29-41e0-a008-749f2c769e7e service nova] Creating event network-vif-deleted:0fef1d0b-7117-439f-a946-2ac519e45e27 for instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb on n-h2-853611-3 Aug 18 11:37:36.228861 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-3775bacc-57de-4db5-9f0c-0706f08e0b26 req-43a9ac9c-3a29-41e0-a008-749f2c769e7e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056094 Aug 18 11:37:36.230144 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1446/2817] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:37:36.268802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f03bd51a-fb6e-4042-a516-b912d8af3b6e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:36.271107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f03bd51a-fb6e-4042-a516-b912d8af3b6e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:36.296785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f03bd51a-fb6e-4042-a516-b912d8af3b6e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:36.297296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f03bd51a-fb6e-4042-a516-b912d8af3b6e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:36.297746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f03bd51a-fb6e-4042-a516-b912d8af3b6e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:36.307292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f03bd51a-fb6e-4042-a516-b912d8af3b6e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:36.309135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f03bd51a-fb6e-4042-a516-b912d8af3b6e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:36.310922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f03bd51a-fb6e-4042-a516-b912d8af3b6e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:36.417635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f03bd51a-fb6e-4042-a516-b912d8af3b6e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:36.418291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f03bd51a-fb6e-4042-a516-b912d8af3b6e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:36.418831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f03bd51a-fb6e-4042-a516-b912d8af3b6e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:36.419364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-f03bd51a-fb6e-4042-a516-b912d8af3b6e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lazy-loading 'fault' on Instance uuid d1faf71d-d10a-439f-90dc-f8e9e8127cbb {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:37:36.483051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f03bd51a-fb6e-4042-a516-b912d8af3b6e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bf7b0cd3d8740aca2d71944bc371d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98846d5998440dd87f3d85de0bf9d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:36.492013 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f03bd51a-fb6e-4042-a516-b912d8af3b6e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 200 len: 1305 microversion: 2.1 time: 0.229853 Aug 18 11:37:36.492643 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1372/2818] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:36 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 1305 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:36.672794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d5cd3e80-341a-4ff4-a328-3f29b28d3cff tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:36.680229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d5cd3e80-341a-4ff4-a328-3f29b28d3cff tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:36.703949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5cd3e80-341a-4ff4-a328-3f29b28d3cff tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:36.708847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5cd3e80-341a-4ff4-a328-3f29b28d3cff tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:36.709927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5cd3e80-341a-4ff4-a328-3f29b28d3cff tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:36.710731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5cd3e80-341a-4ff4-a328-3f29b28d3cff tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:36.711213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5cd3e80-341a-4ff4-a328-3f29b28d3cff tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:36.711688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5cd3e80-341a-4ff4-a328-3f29b28d3cff tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:36.949418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1973eed4-8bff-40fd-a9ab-2ad8bbc564de tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:36.951049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1973eed4-8bff-40fd-a9ab-2ad8bbc564de tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:36.967209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1973eed4-8bff-40fd-a9ab-2ad8bbc564de tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:36.967594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1973eed4-8bff-40fd-a9ab-2ad8bbc564de tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:36.968049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1973eed4-8bff-40fd-a9ab-2ad8bbc564de tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:36.968876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1973eed4-8bff-40fd-a9ab-2ad8bbc564de tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:36.969268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1973eed4-8bff-40fd-a9ab-2ad8bbc564de tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:36.969690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1973eed4-8bff-40fd-a9ab-2ad8bbc564de tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.057790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d5cd3e80-341a-4ff4-a328-3f29b28d3cff tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:37.069424 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d5cd3e80-341a-4ff4-a328-3f29b28d3cff tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.413366 Aug 18 11:37:37.087077 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1447/2819] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:36 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:37.095957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5e841e9f-6ded-4c55-a71f-4e2033be9279 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:37.097452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5e841e9f-6ded-4c55-a71f-4e2033be9279 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:37.104797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e841e9f-6ded-4c55-a71f-4e2033be9279 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.105875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e841e9f-6ded-4c55-a71f-4e2033be9279 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.107292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e841e9f-6ded-4c55-a71f-4e2033be9279 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.108478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e841e9f-6ded-4c55-a71f-4e2033be9279 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.109110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e841e9f-6ded-4c55-a71f-4e2033be9279 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.109753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e841e9f-6ded-4c55-a71f-4e2033be9279 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.281073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1973eed4-8bff-40fd-a9ab-2ad8bbc564de tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:37.294898 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1973eed4-8bff-40fd-a9ab-2ad8bbc564de tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 0.349622 Aug 18 11:37:37.297787 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1373/2820] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:36 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:37.488102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5e841e9f-6ded-4c55-a71f-4e2033be9279 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:37.500184 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5e841e9f-6ded-4c55-a71f-4e2033be9279 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.409403 Aug 18 11:37:37.501420 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1448/2821] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:37 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:37.521062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-576b6cd2-8ae1-4c28-9fcb-1fd3d39cce31 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:37.521856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-576b6cd2-8ae1-4c28-9fcb-1fd3d39cce31 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:37.535403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-576b6cd2-8ae1-4c28-9fcb-1fd3d39cce31 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.535910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-576b6cd2-8ae1-4c28-9fcb-1fd3d39cce31 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.536356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-576b6cd2-8ae1-4c28-9fcb-1fd3d39cce31 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.537081 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-576b6cd2-8ae1-4c28-9fcb-1fd3d39cce31 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.537546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-576b6cd2-8ae1-4c28-9fcb-1fd3d39cce31 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.537979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-576b6cd2-8ae1-4c28-9fcb-1fd3d39cce31 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.575247 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-576b6cd2-8ae1-4c28-9fcb-1fd3d39cce31 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-576b6cd2-8ae1-4c28-9fcb-1fd3d39cce31 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb HTTP/1.1 Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'd1faf71d-d10a-439f-90dc-f8e9e8127cbb'} Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:37.577639 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.581751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.581751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:37.581751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:37.581751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:37.581751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:37.581751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.581751 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.589030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-576b6cd2-8ae1-4c28-9fcb-1fd3d39cce31 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:37.590241 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-576b6cd2-8ae1-4c28-9fcb-1fd3d39cce31 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 404 len: 111 microversion: 2.1 time: 0.074053 Aug 18 11:37:37.591401 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1374/2822] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:37 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:37.605131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a8f4be0b-4ade-47d5-bdcd-eca481a691b5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:37.605918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a8f4be0b-4ade-47d5-bdcd-eca481a691b5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:37.619683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8f4be0b-4ade-47d5-bdcd-eca481a691b5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.620281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8f4be0b-4ade-47d5-bdcd-eca481a691b5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.621310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8f4be0b-4ade-47d5-bdcd-eca481a691b5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.622663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8f4be0b-4ade-47d5-bdcd-eca481a691b5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.623590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8f4be0b-4ade-47d5-bdcd-eca481a691b5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.624333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8f4be0b-4ade-47d5-bdcd-eca481a691b5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.652725 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-a8f4be0b-4ade-47d5-bdcd-eca481a691b5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a8f4be0b-4ade-47d5-bdcd-eca481a691b5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb HTTP/1.1 Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'd1faf71d-d10a-439f-90dc-f8e9e8127cbb'} Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:37.654630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:37.658351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.658351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.658351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:37.658351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.658351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.658351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:37.658351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:37.658351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:37.658351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:37.658351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.658351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.661588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a8f4be0b-4ade-47d5-bdcd-eca481a691b5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:37.662917 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a8f4be0b-4ade-47d5-bdcd-eca481a691b5 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 404 len: 111 microversion: 2.1 time: 0.062577 Aug 18 11:37:37.663807 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1449/2823] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:37:37 2022] DELETE /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:37:37.674302 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-07ef916b-b6da-40c6-9378-1151e8eabc23 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:37.675129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-07ef916b-b6da-40c6-9378-1151e8eabc23 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: d1faf71d-d10a-439f-90dc-f8e9e8127cbb] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:37.684477 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ef916b-b6da-40c6-9378-1151e8eabc23 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.686609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ef916b-b6da-40c6-9378-1151e8eabc23 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.691189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ef916b-b6da-40c6-9378-1151e8eabc23 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.692050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ef916b-b6da-40c6-9378-1151e8eabc23 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.692858 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ef916b-b6da-40c6-9378-1151e8eabc23 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.695056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ef916b-b6da-40c6-9378-1151e8eabc23 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.746030 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-07ef916b-b6da-40c6-9378-1151e8eabc23 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-07ef916b-b6da-40c6-9378-1151e8eabc23 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb HTTP/1.1 Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'd1faf71d-d10a-439f-90dc-f8e9e8127cbb'} Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:37.747683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.751554 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.751554 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:37.751554 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:37.751554 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:37.751554 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:37.751554 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. Aug 18 11:37:37.751554 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.751554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-07ef916b-b6da-40c6-9378-1151e8eabc23 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance d1faf71d-d10a-439f-90dc-f8e9e8127cbb could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:37.751554 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-07ef916b-b6da-40c6-9378-1151e8eabc23 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb" status: 404 len: 111 microversion: 2.1 time: 0.079794 Aug 18 11:37:37.751554 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1375/2824] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:37 2022] GET /compute/v2.1/servers/d1faf71d-d10a-439f-90dc-f8e9e8127cbb => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:37:37.758125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f3252de9-b50d-4b55-b886-8d415b42d77e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:37.759140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f3252de9-b50d-4b55-b886-8d415b42d77e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:37.767281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3252de9-b50d-4b55-b886-8d415b42d77e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.768156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3252de9-b50d-4b55-b886-8d415b42d77e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.768785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3252de9-b50d-4b55-b886-8d415b42d77e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.769862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3252de9-b50d-4b55-b886-8d415b42d77e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.770582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3252de9-b50d-4b55-b886-8d415b42d77e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.771238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3252de9-b50d-4b55-b886-8d415b42d77e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.791751 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-f3252de9-b50d-4b55-b886-8d415b42d77e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f3252de9-b50d-4b55-b886-8d415b42d77e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 HTTP/1.1 Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '2ee89e61-02ed-4624-bbbe-898aac54e492'} Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:37.800375 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:37.804218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:37.804218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.804218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:37.804218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.804218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.804218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:37.804218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:37.804218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:37.804218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:37.804218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:37.804218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.807441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f3252de9-b50d-4b55-b886-8d415b42d77e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:37.808592 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f3252de9-b50d-4b55-b886-8d415b42d77e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 404 len: 111 microversion: 2.1 time: 0.054488 Aug 18 11:37:37.809740 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1450/2825] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:37:37 2022] DELETE /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:37.819367 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a081c7ef-6836-4747-a95e-576822ce1e7d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:37.820001 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a081c7ef-6836-4747-a95e-576822ce1e7d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 2ee89e61-02ed-4624-bbbe-898aac54e492] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:37.829263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a081c7ef-6836-4747-a95e-576822ce1e7d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.829775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a081c7ef-6836-4747-a95e-576822ce1e7d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.830225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a081c7ef-6836-4747-a95e-576822ce1e7d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.830994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a081c7ef-6836-4747-a95e-576822ce1e7d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.831785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a081c7ef-6836-4747-a95e-576822ce1e7d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.832486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a081c7ef-6836-4747-a95e-576822ce1e7d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.852469 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-a081c7ef-6836-4747-a95e-576822ce1e7d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a081c7ef-6836-4747-a95e-576822ce1e7d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 HTTP/1.1 Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '2ee89e61-02ed-4624-bbbe-898aac54e492'} Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:37.856187 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.860591 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.860591 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:37.860591 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:37.860591 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:37.860591 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:37.860591 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. Aug 18 11:37:37.860591 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.860591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a081c7ef-6836-4747-a95e-576822ce1e7d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 2ee89e61-02ed-4624-bbbe-898aac54e492 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:37.860591 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a081c7ef-6836-4747-a95e-576822ce1e7d tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492" status: 404 len: 111 microversion: 2.1 time: 0.043979 Aug 18 11:37:37.870767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8572ce69-2ed6-4aff-b9de-3d2f0cdffaf1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:37.871572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8572ce69-2ed6-4aff-b9de-3d2f0cdffaf1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:37.875546 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1376/2826] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:37 2022] GET /compute/v2.1/servers/2ee89e61-02ed-4624-bbbe-898aac54e492 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:37.878949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8572ce69-2ed6-4aff-b9de-3d2f0cdffaf1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.879463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8572ce69-2ed6-4aff-b9de-3d2f0cdffaf1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.879968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8572ce69-2ed6-4aff-b9de-3d2f0cdffaf1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.880781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8572ce69-2ed6-4aff-b9de-3d2f0cdffaf1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.882072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8572ce69-2ed6-4aff-b9de-3d2f0cdffaf1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.882764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8572ce69-2ed6-4aff-b9de-3d2f0cdffaf1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.905160 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-8572ce69-2ed6-4aff-b9de-3d2f0cdffaf1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8572ce69-2ed6-4aff-b9de-3d2f0cdffaf1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 HTTP/1.1 Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '23ad9e5e-ca95-4e76-9823-3d357ca17f37'} Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:37.907090 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:37.911029 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:37:37.911029 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.911029 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:37.911029 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.911029 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.911029 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:37.911029 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:37.911029 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:37.911029 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:37.911029 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:37:37.911029 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.911029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8572ce69-2ed6-4aff-b9de-3d2f0cdffaf1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:37.911029 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8572ce69-2ed6-4aff-b9de-3d2f0cdffaf1 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "DELETE /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 404 len: 111 microversion: 2.1 time: 0.045119 Aug 18 11:37:37.919186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-58927100-6076-4ab7-bf75-b184e3b453b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:37.920393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-58927100-6076-4ab7-bf75-b184e3b453b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 23ad9e5e-ca95-4e76-9823-3d357ca17f37] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:37.925939 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1451/2827] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:37:37 2022] DELETE /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:37.933376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58927100-6076-4ab7-bf75-b184e3b453b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.933892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58927100-6076-4ab7-bf75-b184e3b453b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.934350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58927100-6076-4ab7-bf75-b184e3b453b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.935267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58927100-6076-4ab7-bf75-b184e3b453b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.935744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58927100-6076-4ab7-bf75-b184e3b453b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.936183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58927100-6076-4ab7-bf75-b184e3b453b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.952968 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-58927100-6076-4ab7-bf75-b184e3b453b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-58927100-6076-4ab7-bf75-b184e3b453b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 HTTP/1.1 Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '23ad9e5e-ca95-4e76-9823-3d357ca17f37'} Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:37.954996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.960820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:37.960820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:37.960820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:37.960820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:37.960820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:37.960820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. Aug 18 11:37:37.960820 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:37.968165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-58927100-6076-4ab7-bf75-b184e3b453b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 23ad9e5e-ca95-4e76-9823-3d357ca17f37 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:37.969656 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-58927100-6076-4ab7-bf75-b184e3b453b0 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37" status: 404 len: 111 microversion: 2.1 time: 0.055760 Aug 18 11:37:37.980685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9af0a9ad-5433-4e02-879f-979b5a94970c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:37.981487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9af0a9ad-5433-4e02-879f-979b5a94970c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:37.984891 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1377/2828] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:37 2022] GET /compute/v2.1/servers/23ad9e5e-ca95-4e76-9823-3d357ca17f37 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:37.990151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af0a9ad-5433-4e02-879f-979b5a94970c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.991669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af0a9ad-5433-4e02-879f-979b5a94970c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.993073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af0a9ad-5433-4e02-879f-979b5a94970c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:37.995391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af0a9ad-5433-4e02-879f-979b5a94970c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:37.996326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af0a9ad-5433-4e02-879f-979b5a94970c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:37.997327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af0a9ad-5433-4e02-879f-979b5a94970c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:38.019327 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-9af0a9ad-5433-4e02-879f-979b5a94970c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9af0a9ad-5433-4e02-879f-979b5a94970c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 HTTP/1.1 Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '071f6b87-653b-4d66-b1b8-c9cc2a4a82a4'} Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:38.023599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:38.030700 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:37:38.030700 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.030700 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:38.030700 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.030700 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:38.030700 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:38.030700 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:38.030700 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:38.030700 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:38.030700 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:37:38.030700 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.034497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9af0a9ad-5433-4e02-879f-979b5a94970c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:38.036928 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9af0a9ad-5433-4e02-879f-979b5a94970c tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "DELETE /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 404 len: 111 microversion: 2.1 time: 0.060801 Aug 18 11:37:38.049107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1589bb33-fa6c-461c-bb7b-5dc9649c5438 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:38.050154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1589bb33-fa6c-461c-bb7b-5dc9649c5438 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:38.059663 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1452/2829] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:37:37 2022] DELETE /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:38.063574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1589bb33-fa6c-461c-bb7b-5dc9649c5438 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:38.066280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1589bb33-fa6c-461c-bb7b-5dc9649c5438 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:38.067530 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1589bb33-fa6c-461c-bb7b-5dc9649c5438 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:38.068881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1589bb33-fa6c-461c-bb7b-5dc9649c5438 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:38.069801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1589bb33-fa6c-461c-bb7b-5dc9649c5438 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:38.070590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1589bb33-fa6c-461c-bb7b-5dc9649c5438 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:38.101401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c57b492-b58d-4621-8059-6db06bad1108 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:38.102244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4c57b492-b58d-4621-8059-6db06bad1108 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:38.119829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c57b492-b58d-4621-8059-6db06bad1108 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:38.123434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c57b492-b58d-4621-8059-6db06bad1108 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:38.124584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c57b492-b58d-4621-8059-6db06bad1108 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:38.125417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c57b492-b58d-4621-8059-6db06bad1108 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:38.125883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c57b492-b58d-4621-8059-6db06bad1108 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:38.128007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c57b492-b58d-4621-8059-6db06bad1108 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:38.133645 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-1589bb33-fa6c-461c-bb7b-5dc9649c5438 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1589bb33-fa6c-461c-bb7b-5dc9649c5438 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 HTTP/1.1 Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '071f6b87-653b-4d66-b1b8-c9cc2a4a82a4'} Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:38.143603 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.152506 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:38.152506 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:38.152506 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:38.152506 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:38.152506 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:38.152506 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. Aug 18 11:37:38.152506 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.152506 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1589bb33-fa6c-461c-bb7b-5dc9649c5438 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:38.156821 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1589bb33-fa6c-461c-bb7b-5dc9649c5438 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4" status: 404 len: 111 microversion: 2.1 time: 0.113020 Aug 18 11:37:38.161790 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1378/2830] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:38 2022] GET /compute/v2.1/servers/071f6b87-653b-4d66-b1b8-c9cc2a4a82a4 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:38.174686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9b4da6bf-183c-4d91-a6f8-4cf60c3965b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:38.178282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9b4da6bf-183c-4d91-a6f8-4cf60c3965b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: a78df714-e554-4024-a8ad-625d14ed6b0c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:38.195067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b4da6bf-183c-4d91-a6f8-4cf60c3965b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:38.197774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b4da6bf-183c-4d91-a6f8-4cf60c3965b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:38.198696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b4da6bf-183c-4d91-a6f8-4cf60c3965b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:38.201084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b4da6bf-183c-4d91-a6f8-4cf60c3965b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:38.204580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b4da6bf-183c-4d91-a6f8-4cf60c3965b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:38.205390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b4da6bf-183c-4d91-a6f8-4cf60c3965b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:38.267360 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-9b4da6bf-183c-4d91-a6f8-4cf60c3965b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9b4da6bf-183c-4d91-a6f8-4cf60c3965b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c HTTP/1.1 Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'a78df714-e554-4024-a8ad-625d14ed6b0c'} Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:38.278176 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:38.287242 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:37:38.287242 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.287242 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:38.287242 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.287242 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:38.287242 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:38.287242 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:38.287242 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:38.287242 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:38.287242 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:37:38.287242 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.287242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9b4da6bf-183c-4d91-a6f8-4cf60c3965b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:38.287242 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9b4da6bf-183c-4d91-a6f8-4cf60c3965b7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c" status: 404 len: 111 microversion: 2.1 time: 0.113968 Aug 18 11:37:38.295645 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1379/2831] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:37:38 2022] DELETE /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:37:38.300232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e97a54e4-6cdd-46a4-88cd-0ec554a31625 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:38.302677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e97a54e4-6cdd-46a4-88cd-0ec554a31625 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: a78df714-e554-4024-a8ad-625d14ed6b0c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:38.319018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e97a54e4-6cdd-46a4-88cd-0ec554a31625 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:38.322161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e97a54e4-6cdd-46a4-88cd-0ec554a31625 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:38.324452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e97a54e4-6cdd-46a4-88cd-0ec554a31625 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:38.327397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e97a54e4-6cdd-46a4-88cd-0ec554a31625 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:38.328205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e97a54e4-6cdd-46a4-88cd-0ec554a31625 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:38.329677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e97a54e4-6cdd-46a4-88cd-0ec554a31625 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:38.370900 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-e97a54e4-6cdd-46a4-88cd-0ec554a31625 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e97a54e4-6cdd-46a4-88cd-0ec554a31625 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c HTTP/1.1 Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'a78df714-e554-4024-a8ad-625d14ed6b0c'} Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:38.372866 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.377146 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:38.377146 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:38.377146 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:38.377146 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:38.377146 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:38.377146 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. Aug 18 11:37:38.377146 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:37:38.381517 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e97a54e4-6cdd-46a4-88cd-0ec554a31625 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance a78df714-e554-4024-a8ad-625d14ed6b0c could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:38.385753 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e97a54e4-6cdd-46a4-88cd-0ec554a31625 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c" status: 404 len: 111 microversion: 2.1 time: 0.091825 Aug 18 11:37:38.386627 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1380/2832] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:38 2022] GET /compute/v2.1/servers/a78df714-e554-4024-a8ad-625d14ed6b0c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:38.419523 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2daef32e-9290-4648-a5ca-c58f153c7fab tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:38.420459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2daef32e-9290-4648-a5ca-c58f153c7fab tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:38.444269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2daef32e-9290-4648-a5ca-c58f153c7fab tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:38.445033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2daef32e-9290-4648-a5ca-c58f153c7fab tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:38.450177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2daef32e-9290-4648-a5ca-c58f153c7fab tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:38.451135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2daef32e-9290-4648-a5ca-c58f153c7fab tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:38.451697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2daef32e-9290-4648-a5ca-c58f153c7fab tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:38.457691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2daef32e-9290-4648-a5ca-c58f153c7fab tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:38.960018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2daef32e-9290-4648-a5ca-c58f153c7fab tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:38.978466 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2daef32e-9290-4648-a5ca-c58f153c7fab tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 0.587079 Aug 18 11:37:38.980341 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1381/2833] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:38 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:38.987622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d98ec8d4-e342-4b52-bdb5-804cf2454533 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:38.997817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d98ec8d4-e342-4b52-bdb5-804cf2454533 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:39.019595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d98ec8d4-e342-4b52-bdb5-804cf2454533 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:39.020797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d98ec8d4-e342-4b52-bdb5-804cf2454533 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:39.021437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d98ec8d4-e342-4b52-bdb5-804cf2454533 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:39.023563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d98ec8d4-e342-4b52-bdb5-804cf2454533 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:39.024210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d98ec8d4-e342-4b52-bdb5-804cf2454533 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:39.026398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d98ec8d4-e342-4b52-bdb5-804cf2454533 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:39.323656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4c57b492-b58d-4621-8059-6db06bad1108 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:39.345993 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4c57b492-b58d-4621-8059-6db06bad1108 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 1.249232 Aug 18 11:37:39.347294 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1453/2834] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:38 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:39.534885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1996770574", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f679a1b2-160d-4a70-be22-61ae35c222cb"}], "security_groups": [{"name": "tempest-securitygroup--252511030"}], "key_name": "tempest-keypair-396525055", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:39.559183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d98ec8d4-e342-4b52-bdb5-804cf2454533 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:39.571026 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d98ec8d4-e342-4b52-bdb5-804cf2454533 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.589298 Aug 18 11:37:39.575730 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1382/2835] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:38 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:39.819363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] validate_networks() for [('f679a1b2-160d-4a70-be22-61ae35c222cb', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:37:40.005443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ca6fc9d4-1011-4686-934c-3399140c9784 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:40.008071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ca6fc9d4-1011-4686-934c-3399140c9784 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:40.018197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca6fc9d4-1011-4686-934c-3399140c9784 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:40.020460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca6fc9d4-1011-4686-934c-3399140c9784 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:40.021390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca6fc9d4-1011-4686-934c-3399140c9784 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:40.023236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca6fc9d4-1011-4686-934c-3399140c9784 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:40.023925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca6fc9d4-1011-4686-934c-3399140c9784 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:40.029183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca6fc9d4-1011-4686-934c-3399140c9784 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:40.090894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:40.783393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Getting quotas for project 6dd47af6f12647688be7ca8b48bd696f. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:37:40.800052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Getting quotas for user 5bd01fe65b2b45828e0925aa49200fd1 and project 6dd47af6f12647688be7ca8b48bd696f. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:37:40.849793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:37:40.850633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:37:40.851337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:37:40.851985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:37:40.853376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:37:40.868985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:40.869887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:40.870605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:40.871607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:40.872313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:40.872973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:40.921244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Getting quotas for project 6dd47af6f12647688be7ca8b48bd696f. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:37:40.951562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Getting quotas for user 5bd01fe65b2b45828e0925aa49200fd1 and project 6dd47af6f12647688be7ca8b48bd696f. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:37:40.998635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:37:41.006263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:37:41.135973 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b146d78-6a02-4199-9731-dc58032d59ad tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.612109 Aug 18 11:37:41.143906 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1454/2836] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:37:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:37:41.149052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-539fc925-e689-4462-9422-94ce4124c217 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:41.154572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-539fc925-e689-4462-9422-94ce4124c217 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:41.177384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-539fc925-e689-4462-9422-94ce4124c217 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:41.189944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-539fc925-e689-4462-9422-94ce4124c217 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:41.191136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-539fc925-e689-4462-9422-94ce4124c217 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:41.192093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-539fc925-e689-4462-9422-94ce4124c217 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:41.192965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-539fc925-e689-4462-9422-94ce4124c217 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:41.193600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-539fc925-e689-4462-9422-94ce4124c217 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:41.211176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ca6fc9d4-1011-4686-934c-3399140c9784 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:41.223216 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ca6fc9d4-1011-4686-934c-3399140c9784 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 1.223874 Aug 18 11:37:41.224104 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1383/2837] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:39 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:41.234355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0fbd0818-605f-4a23-bd51-0773af756648 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:41.235008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0fbd0818-605f-4a23-bd51-0773af756648 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:41.260190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fbd0818-605f-4a23-bd51-0773af756648 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:41.260688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fbd0818-605f-4a23-bd51-0773af756648 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:41.261122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fbd0818-605f-4a23-bd51-0773af756648 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:41.266290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fbd0818-605f-4a23-bd51-0773af756648 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:41.268115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fbd0818-605f-4a23-bd51-0773af756648 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:41.268723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0fbd0818-605f-4a23-bd51-0773af756648 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:41.540165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-539fc925-e689-4462-9422-94ce4124c217 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:41.562761 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-539fc925-e689-4462-9422-94ce4124c217 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.417153 Aug 18 11:37:41.564324 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1455/2838] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:41 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:41.569401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-971b8982-26fa-4efc-9762-0a161abdf328 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:41.570158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-971b8982-26fa-4efc-9762-0a161abdf328 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:41.715223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-971b8982-26fa-4efc-9762-0a161abdf328 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:41.732776 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-971b8982-26fa-4efc-9762-0a161abdf328 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1277 microversion: 2.1 time: 0.166934 Aug 18 11:37:41.733730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0fbd0818-605f-4a23-bd51-0773af756648 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:41.737281 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1456/2839] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:41 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:41.749800 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0fbd0818-605f-4a23-bd51-0773af756648 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.522365 Aug 18 11:37:41.763774 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1384/2840] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:41 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:42.245552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3a548bd1-21ac-4a13-8352-1a6efb8ab800 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:42.247065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3a548bd1-21ac-4a13-8352-1a6efb8ab800 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:42.260358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a548bd1-21ac-4a13-8352-1a6efb8ab800 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:42.262002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a548bd1-21ac-4a13-8352-1a6efb8ab800 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:42.265921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a548bd1-21ac-4a13-8352-1a6efb8ab800 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:42.267262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a548bd1-21ac-4a13-8352-1a6efb8ab800 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:42.267905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a548bd1-21ac-4a13-8352-1a6efb8ab800 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:42.269935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a548bd1-21ac-4a13-8352-1a6efb8ab800 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:42.568226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3a548bd1-21ac-4a13-8352-1a6efb8ab800 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:42.581712 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3a548bd1-21ac-4a13-8352-1a6efb8ab800 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 0.340738 Aug 18 11:37:42.584408 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1457/2841] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:42 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:42.607464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-efa9da57-d041-446f-8b63-add7f3fad574 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:42.608710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-efa9da57-d041-446f-8b63-add7f3fad574 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:42.627721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-efa9da57-d041-446f-8b63-add7f3fad574 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:42.629093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-efa9da57-d041-446f-8b63-add7f3fad574 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:42.629963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-efa9da57-d041-446f-8b63-add7f3fad574 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:42.631118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-efa9da57-d041-446f-8b63-add7f3fad574 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:42.633419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-efa9da57-d041-446f-8b63-add7f3fad574 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:42.634034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-efa9da57-d041-446f-8b63-add7f3fad574 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:42.758197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2b3ea41-5dbd-4366-b577-6c962254bb48 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:42.759023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b2b3ea41-5dbd-4366-b577-6c962254bb48 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:42.766014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2b3ea41-5dbd-4366-b577-6c962254bb48 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:42.767271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2b3ea41-5dbd-4366-b577-6c962254bb48 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:42.768039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2b3ea41-5dbd-4366-b577-6c962254bb48 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:42.769066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2b3ea41-5dbd-4366-b577-6c962254bb48 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:42.769802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2b3ea41-5dbd-4366-b577-6c962254bb48 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:42.770239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2b3ea41-5dbd-4366-b577-6c962254bb48 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:42.929238 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-efa9da57-d041-446f-8b63-add7f3fad574 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:42.934624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b2b3ea41-5dbd-4366-b577-6c962254bb48 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:42.957178 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-efa9da57-d041-446f-8b63-add7f3fad574 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.361488 Aug 18 11:37:42.960719 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b2b3ea41-5dbd-4366-b577-6c962254bb48 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1329 microversion: 2.1 time: 0.205863 Aug 18 11:37:42.978319 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1385/2842] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:42 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:42.980145 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1458/2843] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:42 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1329 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:43.014121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6abdbc9e-acd2-45b8-914b-8502b3605229 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:43.015329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6abdbc9e-acd2-45b8-914b-8502b3605229 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:43.031823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6abdbc9e-acd2-45b8-914b-8502b3605229 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:43.038735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6abdbc9e-acd2-45b8-914b-8502b3605229 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:43.040386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6abdbc9e-acd2-45b8-914b-8502b3605229 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:43.041316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6abdbc9e-acd2-45b8-914b-8502b3605229 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:43.042233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6abdbc9e-acd2-45b8-914b-8502b3605229 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:43.042995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6abdbc9e-acd2-45b8-914b-8502b3605229 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:43.271799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3095008b-14e0-4672-ab43-350e419c91c9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:43.272820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3095008b-14e0-4672-ab43-350e419c91c9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:43.313722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3095008b-14e0-4672-ab43-350e419c91c9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:43.314644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3095008b-14e0-4672-ab43-350e419c91c9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:43.315434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3095008b-14e0-4672-ab43-350e419c91c9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:43.316768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3095008b-14e0-4672-ab43-350e419c91c9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:43.317911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3095008b-14e0-4672-ab43-350e419c91c9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:43.318780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3095008b-14e0-4672-ab43-350e419c91c9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:43.662969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3095008b-14e0-4672-ab43-350e419c91c9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:43.693254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6abdbc9e-acd2-45b8-914b-8502b3605229 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:43.717018 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6abdbc9e-acd2-45b8-914b-8502b3605229 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.724808 Aug 18 11:37:43.719064 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1386/2844] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:42 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:43.725687 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3095008b-14e0-4672-ab43-350e419c91c9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.460536 Aug 18 11:37:43.730067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7ebe3103-651b-4aed-b752-3a91232195ee tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:43.732479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7ebe3103-651b-4aed-b752-3a91232195ee tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:43.749016 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1459/2845] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:43 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:43.769398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ebe3103-651b-4aed-b752-3a91232195ee tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:43.771686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ebe3103-651b-4aed-b752-3a91232195ee tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:43.773355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8f2821bf-3b89-4709-8bca-a3057665bfec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:43.775096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ebe3103-651b-4aed-b752-3a91232195ee tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:43.778285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ebe3103-651b-4aed-b752-3a91232195ee tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:43.779306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8f2821bf-3b89-4709-8bca-a3057665bfec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:43.780349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ebe3103-651b-4aed-b752-3a91232195ee tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:43.784648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ebe3103-651b-4aed-b752-3a91232195ee tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:43.812699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f2821bf-3b89-4709-8bca-a3057665bfec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:43.815031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f2821bf-3b89-4709-8bca-a3057665bfec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:43.818640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f2821bf-3b89-4709-8bca-a3057665bfec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:43.828545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f2821bf-3b89-4709-8bca-a3057665bfec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:43.829973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f2821bf-3b89-4709-8bca-a3057665bfec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:43.832237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f2821bf-3b89-4709-8bca-a3057665bfec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:44.043493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8f2821bf-3b89-4709-8bca-a3057665bfec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:44.054706 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8f2821bf-3b89-4709-8bca-a3057665bfec tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.304116 Aug 18 11:37:44.056320 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1460/2846] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:43 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:44.061426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b8122fcd-8a12-49aa-ab21-ffd072c7ffad tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:44.062377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b8122fcd-8a12-49aa-ab21-ffd072c7ffad tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:44.073724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8122fcd-8a12-49aa-ab21-ffd072c7ffad tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:44.074331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8122fcd-8a12-49aa-ab21-ffd072c7ffad tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:44.074701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8122fcd-8a12-49aa-ab21-ffd072c7ffad tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:44.075613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8122fcd-8a12-49aa-ab21-ffd072c7ffad tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:44.076407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8122fcd-8a12-49aa-ab21-ffd072c7ffad tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:44.077802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8122fcd-8a12-49aa-ab21-ffd072c7ffad tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:44.267062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8122fcd-8a12-49aa-ab21-ffd072c7ffad tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:44.281560 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b8122fcd-8a12-49aa-ab21-ffd072c7ffad tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.223518 Aug 18 11:37:44.296141 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1461/2847] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:44 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:44.307691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b0e0df97-2aa2-438d-a871-db91a14ca722 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:44.308719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b0e0df97-2aa2-438d-a871-db91a14ca722 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:44.317391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0e0df97-2aa2-438d-a871-db91a14ca722 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:44.318212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0e0df97-2aa2-438d-a871-db91a14ca722 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:44.319026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0e0df97-2aa2-438d-a871-db91a14ca722 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:44.319973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0e0df97-2aa2-438d-a871-db91a14ca722 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:44.321572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0e0df97-2aa2-438d-a871-db91a14ca722 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:44.322320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0e0df97-2aa2-438d-a871-db91a14ca722 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:44.371352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7ebe3103-651b-4aed-b752-3a91232195ee tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:44.400688 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7ebe3103-651b-4aed-b752-3a91232195ee tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 0.675062 Aug 18 11:37:44.403911 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1387/2848] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:43 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:44.416914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a99fbd48-85c3-4f42-b85a-a08c2947e4de tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:44.417797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a99fbd48-85c3-4f42-b85a-a08c2947e4de tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:44.433039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a99fbd48-85c3-4f42-b85a-a08c2947e4de tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:44.433565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a99fbd48-85c3-4f42-b85a-a08c2947e4de tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:44.434014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a99fbd48-85c3-4f42-b85a-a08c2947e4de tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:44.434778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a99fbd48-85c3-4f42-b85a-a08c2947e4de tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:44.435241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a99fbd48-85c3-4f42-b85a-a08c2947e4de tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:44.435663 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a99fbd48-85c3-4f42-b85a-a08c2947e4de tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:44.438639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b0e0df97-2aa2-438d-a871-db91a14ca722 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:44.451401 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b0e0df97-2aa2-438d-a871-db91a14ca722 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1335 microversion: 2.1 time: 0.152973 Aug 18 11:37:44.454637 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1462/2849] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:44 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1335 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:44.472588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e584f42a-20b2-4710-a19e-1930c7d95842 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:44.473423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e584f42a-20b2-4710-a19e-1930c7d95842 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:44.489275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e584f42a-20b2-4710-a19e-1930c7d95842 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:44.494019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e584f42a-20b2-4710-a19e-1930c7d95842 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:44.496784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e584f42a-20b2-4710-a19e-1930c7d95842 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:44.502764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e584f42a-20b2-4710-a19e-1930c7d95842 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:44.504027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e584f42a-20b2-4710-a19e-1930c7d95842 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:44.506291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e584f42a-20b2-4710-a19e-1930c7d95842 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:44.568216 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-e584f42a-20b2-4710-a19e-1930c7d95842 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e584f42a-20b2-4710-a19e-1930c7d95842 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 HTTP/1.1 Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5ecc4c6b-9de9-497a-8421-657f7f6a4cb0'} Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:44.574990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:44.578913 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:37:44.578913 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.578913 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:44.578913 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.578913 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:44.578913 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:44.578913 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:44.578913 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:44.578913 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:44.578913 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:37:44.578913 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.578913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e584f42a-20b2-4710-a19e-1930c7d95842 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:44.578913 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e584f42a-20b2-4710-a19e-1930c7d95842 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 404 len: 111 microversion: 2.1 time: 0.120759 Aug 18 11:37:44.589766 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1463/2850] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:37:44 2022] DELETE /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:44.597760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-23542bf2-425b-4ed5-a10c-8929f98ebe7e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:44.598647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-23542bf2-425b-4ed5-a10c-8929f98ebe7e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:44.620323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23542bf2-425b-4ed5-a10c-8929f98ebe7e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:44.621097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23542bf2-425b-4ed5-a10c-8929f98ebe7e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:44.622031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23542bf2-425b-4ed5-a10c-8929f98ebe7e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:44.622991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23542bf2-425b-4ed5-a10c-8929f98ebe7e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:44.623664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23542bf2-425b-4ed5-a10c-8929f98ebe7e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:44.624272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23542bf2-425b-4ed5-a10c-8929f98ebe7e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:44.653210 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-23542bf2-425b-4ed5-a10c-8929f98ebe7e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-23542bf2-425b-4ed5-a10c-8929f98ebe7e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 HTTP/1.1 Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5ecc4c6b-9de9-497a-8421-657f7f6a4cb0'} Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:44.655218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.663095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:44.663095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:44.663095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:44.663095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:44.663095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:44.663095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. Aug 18 11:37:44.663095 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.668554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-23542bf2-425b-4ed5-a10c-8929f98ebe7e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:44.668554 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-23542bf2-425b-4ed5-a10c-8929f98ebe7e tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0" status: 404 len: 111 microversion: 2.1 time: 0.075788 Aug 18 11:37:44.668554 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1464/2851] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:44 2022] GET /compute/v2.1/servers/5ecc4c6b-9de9-497a-8421-657f7f6a4cb0 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:44.679033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-54dd2280-71ff-41e5-93cf-7877ef510194 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:44.703083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-54dd2280-71ff-41e5-93cf-7877ef510194 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:44.722880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54dd2280-71ff-41e5-93cf-7877ef510194 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:44.723297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54dd2280-71ff-41e5-93cf-7877ef510194 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:44.724079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54dd2280-71ff-41e5-93cf-7877ef510194 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:44.731285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54dd2280-71ff-41e5-93cf-7877ef510194 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:44.732023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54dd2280-71ff-41e5-93cf-7877ef510194 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:44.732490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54dd2280-71ff-41e5-93cf-7877ef510194 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:44.771312 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-54dd2280-71ff-41e5-93cf-7877ef510194 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-54dd2280-71ff-41e5-93cf-7877ef510194 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d HTTP/1.1 Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '625fceb4-de53-4e6b-849d-98873e81773d'} Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:44.778990 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:44.788277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:37:44.788277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.788277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:44.788277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.788277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:44.788277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:44.788277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:44.788277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:44.788277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:44.788277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:37:44.788277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:44.788277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-54dd2280-71ff-41e5-93cf-7877ef510194 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:44.788277 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-54dd2280-71ff-41e5-93cf-7877ef510194 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "DELETE /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 404 len: 111 microversion: 2.1 time: 0.105277 Aug 18 11:37:44.788277 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1465/2852] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:37:44 2022] DELETE /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:44.795120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b3e6f8f4-8c68-4b74-96da-41ef44f6ab05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:44.804211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b3e6f8f4-8c68-4b74-96da-41ef44f6ab05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:44.825035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3e6f8f4-8c68-4b74-96da-41ef44f6ab05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:44.829086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3e6f8f4-8c68-4b74-96da-41ef44f6ab05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:44.829980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3e6f8f4-8c68-4b74-96da-41ef44f6ab05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:44.831021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3e6f8f4-8c68-4b74-96da-41ef44f6ab05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:44.831814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3e6f8f4-8c68-4b74-96da-41ef44f6ab05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:44.834159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3e6f8f4-8c68-4b74-96da-41ef44f6ab05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:45.116206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b3e6f8f4-8c68-4b74-96da-41ef44f6ab05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:45.128240 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b3e6f8f4-8c68-4b74-96da-41ef44f6ab05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.344690 Aug 18 11:37:45.134315 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1466/2853] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:44 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:45.139742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fb7aceba-5f46-4843-bcdf-b151414407a7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:45.144217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fb7aceba-5f46-4843-bcdf-b151414407a7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] [instance: 625fceb4-de53-4e6b-849d-98873e81773d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:45.152890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb7aceba-5f46-4843-bcdf-b151414407a7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:45.153875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb7aceba-5f46-4843-bcdf-b151414407a7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:45.155133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb7aceba-5f46-4843-bcdf-b151414407a7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:45.156417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb7aceba-5f46-4843-bcdf-b151414407a7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:45.156975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb7aceba-5f46-4843-bcdf-b151414407a7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:45.157501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb7aceba-5f46-4843-bcdf-b151414407a7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:45.176365 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-fb7aceba-5f46-4843-bcdf-b151414407a7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] HTTP exception thrown: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fb7aceba-5f46-4843-bcdf-b151414407a7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Request method failure captured: Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d HTTP/1.1 Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iMnum34t_G_nEIaVsqwSTnJg8Nqs_IDFsiacVZBBr5coEygRargu3v-KyCjoN8dRINS2C7GnBPqRi2r_hssC6DRb_1VjW45Z8Z1BXWPuNJIKgm9gG39fDt9iCUMmJbKc2FLDVG9_n_Z5MlXwaPLeclkktv-1cFHg02iqZKU8VOg39c Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a98846d5998440dd87f3d85de0bf9d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a98846d5998440dd87f3d85de0bf9d3c Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-DeleteServersTestJSON-966066328 Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7bf7b0cd3d8740aca2d71944bc371d75 Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-DeleteServersTestJSON-966066328-project Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '625fceb4-de53-4e6b-849d-98873e81773d'} Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:45.178222 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:45.182957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:45.182957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:45.182957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:45.182957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:45.182957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:45.182957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. Aug 18 11:37:45.182957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:45.182957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fb7aceba-5f46-4843-bcdf-b151414407a7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] Returning 404 to user: Instance 625fceb4-de53-4e6b-849d-98873e81773d could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:45.182957 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fb7aceba-5f46-4843-bcdf-b151414407a7 tempest-DeleteServersTestJSON-966066328 tempest-DeleteServersTestJSON-966066328-project] 10.222.0.73 "GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d" status: 404 len: 111 microversion: 2.1 time: 0.043956 Aug 18 11:37:45.185560 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1467/2854] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:45 2022] GET /compute/v2.1/servers/625fceb4-de53-4e6b-849d-98873e81773d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:45.309027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-516493b4-8b47-4f29-a04d-9dffbe70e856 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:45.311562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-516493b4-8b47-4f29-a04d-9dffbe70e856 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:45.336202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-516493b4-8b47-4f29-a04d-9dffbe70e856 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:45.337172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-516493b4-8b47-4f29-a04d-9dffbe70e856 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:45.337619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-516493b4-8b47-4f29-a04d-9dffbe70e856 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:45.347538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-516493b4-8b47-4f29-a04d-9dffbe70e856 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:45.351793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-516493b4-8b47-4f29-a04d-9dffbe70e856 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:45.352409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-516493b4-8b47-4f29-a04d-9dffbe70e856 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:45.502649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a99fbd48-85c3-4f42-b85a-a08c2947e4de tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:45.517273 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a99fbd48-85c3-4f42-b85a-a08c2947e4de tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 1.109741 Aug 18 11:37:45.518882 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1388/2855] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:44 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:45.540402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8998481b-08e3-4bdb-9943-1070a7983317 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:45.541655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8998481b-08e3-4bdb-9943-1070a7983317 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:45.563547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8998481b-08e3-4bdb-9943-1070a7983317 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:45.564411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8998481b-08e3-4bdb-9943-1070a7983317 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:45.565016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8998481b-08e3-4bdb-9943-1070a7983317 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:45.565959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8998481b-08e3-4bdb-9943-1070a7983317 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:45.568267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8998481b-08e3-4bdb-9943-1070a7983317 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:45.568937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8998481b-08e3-4bdb-9943-1070a7983317 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:45.732063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-516493b4-8b47-4f29-a04d-9dffbe70e856 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:45.735689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:45.748814 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-516493b4-8b47-4f29-a04d-9dffbe70e856 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1522 microversion: 2.1 time: 0.443937 Aug 18 11:37:45.755973 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1468/2856] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:45 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:45.773276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b963c691-96e1-4922-960d-b5830f71556d tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:45.775629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b963c691-96e1-4922-960d-b5830f71556d tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:45.790996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b963c691-96e1-4922-960d-b5830f71556d tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:45.797717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b963c691-96e1-4922-960d-b5830f71556d tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:45.798476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b963c691-96e1-4922-960d-b5830f71556d tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:45.801899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b963c691-96e1-4922-960d-b5830f71556d tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:45.806451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b963c691-96e1-4922-960d-b5830f71556d tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:45.807201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b963c691-96e1-4922-960d-b5830f71556d tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:46.023287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b963c691-96e1-4922-960d-b5830f71556d tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:46.035123 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b963c691-96e1-4922-960d-b5830f71556d tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1335 microversion: 2.1 time: 0.277544 Aug 18 11:37:46.036015 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1469/2857] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:45 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1335 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:46.053975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-53de787b-12ab-4847-bfd0-49b0f3384d1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:46.058625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-53de787b-12ab-4847-bfd0-49b0f3384d1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:46.097209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53de787b-12ab-4847-bfd0-49b0f3384d1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:46.098178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53de787b-12ab-4847-bfd0-49b0f3384d1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:46.099222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53de787b-12ab-4847-bfd0-49b0f3384d1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:46.103017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53de787b-12ab-4847-bfd0-49b0f3384d1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:46.103638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53de787b-12ab-4847-bfd0-49b0f3384d1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:46.106470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53de787b-12ab-4847-bfd0-49b0f3384d1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:46.350305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8998481b-08e3-4bdb-9943-1070a7983317 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:46.364143 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8998481b-08e3-4bdb-9943-1070a7983317 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 0.841023 Aug 18 11:37:46.367226 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1389/2858] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:45 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:46.373695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fb5badf7-2f98-4b6b-90f6-488e26efb89b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:46.388150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fb5badf7-2f98-4b6b-90f6-488e26efb89b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:46.396957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb5badf7-2f98-4b6b-90f6-488e26efb89b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:46.398179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb5badf7-2f98-4b6b-90f6-488e26efb89b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:46.398283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb5badf7-2f98-4b6b-90f6-488e26efb89b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:46.404735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb5badf7-2f98-4b6b-90f6-488e26efb89b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:46.405444 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb5badf7-2f98-4b6b-90f6-488e26efb89b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:46.406054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb5badf7-2f98-4b6b-90f6-488e26efb89b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:46.641986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-53de787b-12ab-4847-bfd0-49b0f3384d1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:46.654117 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-53de787b-12ab-4847-bfd0-49b0f3384d1a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.604088 Aug 18 11:37:46.657495 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1470/2859] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:46 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:46.788749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08eecb3e-ff92-48a1-b6a1-3617499f87dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:46.790702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-08eecb3e-ff92-48a1-b6a1-3617499f87dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:46.801409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08eecb3e-ff92-48a1-b6a1-3617499f87dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:46.808789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08eecb3e-ff92-48a1-b6a1-3617499f87dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:46.809514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08eecb3e-ff92-48a1-b6a1-3617499f87dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:46.812629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08eecb3e-ff92-48a1-b6a1-3617499f87dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:46.813649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08eecb3e-ff92-48a1-b6a1-3617499f87dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:46.814285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08eecb3e-ff92-48a1-b6a1-3617499f87dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:47.012938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fb5badf7-2f98-4b6b-90f6-488e26efb89b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:47.021696 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fb5badf7-2f98-4b6b-90f6-488e26efb89b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.652631 Aug 18 11:37:47.027691 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1390/2860] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:46 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:47.041588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-770849304", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "2420cd87-a1af-4a7a-8baa-ea2c21853a49"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:47.119540 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] validate_networks() for [('2420cd87-a1af-4a7a-8baa-ea2c21853a49', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:37:47.154911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-08eecb3e-ff92-48a1-b6a1-3617499f87dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:47.163792 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-08eecb3e-ff92-48a1-b6a1-3617499f87dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1502 microversion: 2.1 time: 0.387876 Aug 18 11:37:47.174728 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1471/2861] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:46 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1502 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:47.187140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-701f8e96-db06-43c5-8fb9-350ad9ee8ad3 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:47.188006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-701f8e96-db06-43c5-8fb9-350ad9ee8ad3 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:47.208142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:47.212183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-701f8e96-db06-43c5-8fb9-350ad9ee8ad3 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:47.215149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-701f8e96-db06-43c5-8fb9-350ad9ee8ad3 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:47.215817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-701f8e96-db06-43c5-8fb9-350ad9ee8ad3 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:47.216778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-701f8e96-db06-43c5-8fb9-350ad9ee8ad3 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:47.219165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-701f8e96-db06-43c5-8fb9-350ad9ee8ad3 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:47.219808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-701f8e96-db06-43c5-8fb9-350ad9ee8ad3 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:47.664976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-701f8e96-db06-43c5-8fb9-350ad9ee8ad3 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:47.682966 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-701f8e96-db06-43c5-8fb9-350ad9ee8ad3 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1402 microversion: 2.1 time: 0.510956 Aug 18 11:37:47.683570 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1472/2862] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:47 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1402 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:47.719033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8e2436c4-327e-4573-a9c1-b53553c83167 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:47.719674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8e2436c4-327e-4573-a9c1-b53553c83167 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:47.730114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e2436c4-327e-4573-a9c1-b53553c83167 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:47.731366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e2436c4-327e-4573-a9c1-b53553c83167 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:47.731978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e2436c4-327e-4573-a9c1-b53553c83167 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:47.734491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e2436c4-327e-4573-a9c1-b53553c83167 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:47.735464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e2436c4-327e-4573-a9c1-b53553c83167 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:47.736092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e2436c4-327e-4573-a9c1-b53553c83167 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:48.031395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8e2436c4-327e-4573-a9c1-b53553c83167 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:48.041482 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8e2436c4-327e-4573-a9c1-b53553c83167 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1514 microversion: 2.1 time: 0.356349 Aug 18 11:37:48.048514 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1473/2863] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:47 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1514 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:48.062596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6d307950-2f53-4145-bd51-89970d32ac8e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:48.063757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6d307950-2f53-4145-bd51-89970d32ac8e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:48.084396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d307950-2f53-4145-bd51-89970d32ac8e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:48.085108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d307950-2f53-4145-bd51-89970d32ac8e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:48.085648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d307950-2f53-4145-bd51-89970d32ac8e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:48.087049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d307950-2f53-4145-bd51-89970d32ac8e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:48.087619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d307950-2f53-4145-bd51-89970d32ac8e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:48.088161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6d307950-2f53-4145-bd51-89970d32ac8e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:48.468133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6d307950-2f53-4145-bd51-89970d32ac8e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:48.478533 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6d307950-2f53-4145-bd51-89970d32ac8e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 0.428445 Aug 18 11:37:48.483728 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1474/2864] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:48 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:48.496425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-985511fc-c075-4fa2-9d34-58a67b816b04 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:48.497051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-985511fc-c075-4fa2-9d34-58a67b816b04 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:48.523355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-985511fc-c075-4fa2-9d34-58a67b816b04 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:48.524574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-985511fc-c075-4fa2-9d34-58a67b816b04 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:48.525527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-985511fc-c075-4fa2-9d34-58a67b816b04 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:48.526282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-985511fc-c075-4fa2-9d34-58a67b816b04 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:48.526795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-985511fc-c075-4fa2-9d34-58a67b816b04 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:48.527455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-985511fc-c075-4fa2-9d34-58a67b816b04 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:48.983009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-985511fc-c075-4fa2-9d34-58a67b816b04 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:48.996690 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-985511fc-c075-4fa2-9d34-58a67b816b04 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.511731 Aug 18 11:37:49.008974 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1475/2865] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:48 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:49.019164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ce72f9f5-20f8-44ab-9639-f8d229fc101b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:49.030040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:37:49.030040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:37:49.030040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:37:49.030040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:37:49.030774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:37:49.031913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ce72f9f5-20f8-44ab-9639-f8d229fc101b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 15a34967-1532-444e-8200-b729460d7616] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:49.044625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:49.045428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:49.046165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:49.046793 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-ce72f9f5-20f8-44ab-9639-f8d229fc101b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] HTTP exception thrown: Instance 15a34967-1532-444e-8200-b729460d7616 could not be found. Aug 18 11:37:49.047457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:49.049099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:49.049767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ce72f9f5-20f8-44ab-9639-f8d229fc101b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Request method failure captured: Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/15a34967-1532-444e-8200-b729460d7616/action HTTP/1.1 Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 14 Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iRDccV-wQBjWbehYJnvnYrqtEvDPnmmRi9FdLn90jlDwmLP7Yu8AV-Xjh3sRI2h6VdTdDxREaF_4Uw5JAlLnmy-pOyTW0C8AnpTCeGTveMx08cuhXqa0wk4T8c8YQiDTyaAtMLbCc_qByCh4ZjwOdEPthe4EaqbP1499Gbu30qZ6g8 Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 4eea5599d0754399a32a3ae3431ff18f Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: {"rescue": {}} Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 15a34967-1532-444e-8200-b729460d7616 could not be found. Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '15a34967-1532-444e-8200-b729460d7616', 'body': {'rescue': {}}} Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a34967-1532-444e-8200-b729460d7616 could not be found. Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a34967-1532-444e-8200-b729460d7616 could not be found. Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:49.056307 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:49.060516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:49.060516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:49.060516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:49.060516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:49.060516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a34967-1532-444e-8200-b729460d7616 could not be found. Aug 18 11:37:49.060516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:49.060516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ce72f9f5-20f8-44ab-9639-f8d229fc101b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Returning 404 to user: Instance 15a34967-1532-444e-8200-b729460d7616 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:49.060516 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ce72f9f5-20f8-44ab-9639-f8d229fc101b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers/15a34967-1532-444e-8200-b729460d7616/action" status: 404 len: 111 microversion: 2.1 time: 0.047894 Aug 18 11:37:49.060516 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1476/2866] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:37:49 2022] POST /compute/v2.1/servers/15a34967-1532-444e-8200-b729460d7616/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:37:49.063130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a7cdf6c-c1b6-4a89-a71b-dcf1a6874f0e tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:49.063909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a7cdf6c-c1b6-4a89-a71b-dcf1a6874f0e tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:49.083665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a7cdf6c-c1b6-4a89-a71b-dcf1a6874f0e tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:49.084445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a7cdf6c-c1b6-4a89-a71b-dcf1a6874f0e tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:49.085041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a7cdf6c-c1b6-4a89-a71b-dcf1a6874f0e tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:49.085945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a7cdf6c-c1b6-4a89-a71b-dcf1a6874f0e tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:49.087092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a7cdf6c-c1b6-4a89-a71b-dcf1a6874f0e tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:49.087871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a7cdf6c-c1b6-4a89-a71b-dcf1a6874f0e tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:49.088897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Getting quotas for project c1a985dc6f824e5b847a2d966c0f79af. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:37:49.098939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Getting quotas for user 0cd8451c50d941409a66864cbc1c7201 and project c1a985dc6f824e5b847a2d966c0f79af. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:37:49.108070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:49.147959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:37:49.160142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:37:49.292276 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b3cab198-1ae5-40b3-9827-1f4e13631009 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.263047 Aug 18 11:37:49.295376 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1391/2867] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:37:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:37:49.313873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fc359f26-dd50-42da-8cec-e76b6ee318f9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:49.314486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fc359f26-dd50-42da-8cec-e76b6ee318f9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:49.329476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc359f26-dd50-42da-8cec-e76b6ee318f9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:49.330041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc359f26-dd50-42da-8cec-e76b6ee318f9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:49.330505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc359f26-dd50-42da-8cec-e76b6ee318f9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:49.331224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc359f26-dd50-42da-8cec-e76b6ee318f9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:49.336127 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc359f26-dd50-42da-8cec-e76b6ee318f9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:49.336794 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc359f26-dd50-42da-8cec-e76b6ee318f9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:49.549293 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fc359f26-dd50-42da-8cec-e76b6ee318f9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e/action" status: 202 len: 0 microversion: 2.1 time: 0.245798 Aug 18 11:37:49.570153 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1392/2868] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:37:49 2022] POST /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:37:49.601966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6497a9ce-8dec-4cda-9668-ce7f0b4ff1ee tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:49.604638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6497a9ce-8dec-4cda-9668-ce7f0b4ff1ee tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:49.804419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6497a9ce-8dec-4cda-9668-ce7f0b4ff1ee tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:49.839002 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6497a9ce-8dec-4cda-9668-ce7f0b4ff1ee tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1214 microversion: 2.1 time: 0.263149 Aug 18 11:37:49.856761 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1393/2869] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:49 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1214 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:49.875055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-371c783e-6761-4950-9253-2dd7e5922328 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:49.878799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-371c783e-6761-4950-9253-2dd7e5922328 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:49.880413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a7cdf6c-c1b6-4a89-a71b-dcf1a6874f0e tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:49.899150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-371c783e-6761-4950-9253-2dd7e5922328 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:49.900393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-371c783e-6761-4950-9253-2dd7e5922328 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:49.901748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-371c783e-6761-4950-9253-2dd7e5922328 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:49.903228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-371c783e-6761-4950-9253-2dd7e5922328 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:49.904449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-371c783e-6761-4950-9253-2dd7e5922328 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:49.905443 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a7cdf6c-c1b6-4a89-a71b-dcf1a6874f0e tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1402 microversion: 2.1 time: 0.844441 Aug 18 11:37:49.908236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-371c783e-6761-4950-9253-2dd7e5922328 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:49.908721 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1477/2870] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:49 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1402 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:49.928263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-834f7da4-b8bb-404a-84be-b0e15bcf85ed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:49.928909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-834f7da4-b8bb-404a-84be-b0e15bcf85ed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:49.970498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-834f7da4-b8bb-404a-84be-b0e15bcf85ed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:49.971319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-834f7da4-b8bb-404a-84be-b0e15bcf85ed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:49.974235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-834f7da4-b8bb-404a-84be-b0e15bcf85ed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:49.980350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-834f7da4-b8bb-404a-84be-b0e15bcf85ed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:49.982390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-834f7da4-b8bb-404a-84be-b0e15bcf85ed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:49.983538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-834f7da4-b8bb-404a-84be-b0e15bcf85ed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:50.373480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-834f7da4-b8bb-404a-84be-b0e15bcf85ed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:50.396794 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-834f7da4-b8bb-404a-84be-b0e15bcf85ed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1499 microversion: 2.1 time: 0.473627 Aug 18 11:37:50.398018 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1478/2871] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:49 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1499 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:50.404343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d77983af-4bf9-4151-b5a1-6d1efc32a6dd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:50.405656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d77983af-4bf9-4151-b5a1-6d1efc32a6dd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:50.412605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d77983af-4bf9-4151-b5a1-6d1efc32a6dd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:50.413487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d77983af-4bf9-4151-b5a1-6d1efc32a6dd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:50.414252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d77983af-4bf9-4151-b5a1-6d1efc32a6dd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:50.415718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d77983af-4bf9-4151-b5a1-6d1efc32a6dd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:50.416740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d77983af-4bf9-4151-b5a1-6d1efc32a6dd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:50.417452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d77983af-4bf9-4151-b5a1-6d1efc32a6dd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:50.740075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d77983af-4bf9-4151-b5a1-6d1efc32a6dd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:50.749770 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d77983af-4bf9-4151-b5a1-6d1efc32a6dd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.349804 Aug 18 11:37:50.756140 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1479/2872] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:50 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:50.761239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ba2ad80b-4b94-457b-a967-a330d169cdbc req-1a0f30ae-f622-4fff-ac05-ee2aaa2be56e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89052d85-6a54-433c-8b86-88e2835c2f28", "tag": "6b64a832-bb8d-4ca3-9d19-22572472748b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:50.791271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ba2ad80b-4b94-457b-a967-a330d169cdbc req-1a0f30ae-f622-4fff-ac05-ee2aaa2be56e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:50.791752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ba2ad80b-4b94-457b-a967-a330d169cdbc req-1a0f30ae-f622-4fff-ac05-ee2aaa2be56e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:50.799744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ba2ad80b-4b94-457b-a967-a330d169cdbc req-1a0f30ae-f622-4fff-ac05-ee2aaa2be56e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:50.833162 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ba2ad80b-4b94-457b-a967-a330d169cdbc req-1a0f30ae-f622-4fff-ac05-ee2aaa2be56e service nova] Creating event network-changed:6b64a832-bb8d-4ca3-9d19-22572472748b for instance 89052d85-6a54-433c-8b86-88e2835c2f28 on n-h2-853611-3 Aug 18 11:37:50.844436 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ba2ad80b-4b94-457b-a967-a330d169cdbc req-1a0f30ae-f622-4fff-ac05-ee2aaa2be56e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086881 Aug 18 11:37:50.845157 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1480/2873] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:37:50.870970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4f93b724-c4f2-4798-a5a5-c0783c5fa5b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:50.872883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-371c783e-6761-4950-9253-2dd7e5922328 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:50.873619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4f93b724-c4f2-4798-a5a5-c0783c5fa5b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:50.888357 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-371c783e-6761-4950-9253-2dd7e5922328 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 1.023669 Aug 18 11:37:50.890901 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1394/2874] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:49 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:50.892910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:50.895251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f93b724-c4f2-4798-a5a5-c0783c5fa5b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:50.895974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f93b724-c4f2-4798-a5a5-c0783c5fa5b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:50.898667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f93b724-c4f2-4798-a5a5-c0783c5fa5b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:50.899799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f93b724-c4f2-4798-a5a5-c0783c5fa5b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:50.900496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f93b724-c4f2-4798-a5a5-c0783c5fa5b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:50.907140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f93b724-c4f2-4798-a5a5-c0783c5fa5b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:50.907356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b826e5f-4a74-4d67-a315-726244e5a560 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:50.907955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5b826e5f-4a74-4d67-a315-726244e5a560 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:50.916926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b826e5f-4a74-4d67-a315-726244e5a560 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:50.917430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b826e5f-4a74-4d67-a315-726244e5a560 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:50.917858 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b826e5f-4a74-4d67-a315-726244e5a560 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:50.918618 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b826e5f-4a74-4d67-a315-726244e5a560 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:50.919084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b826e5f-4a74-4d67-a315-726244e5a560 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:50.919518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b826e5f-4a74-4d67-a315-726244e5a560 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:50.987910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-4f93b724-c4f2-4798-a5a5-c0783c5fa5b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lazy-loading 'flavor' on Instance uuid d6f665d8-ddd8-4030-be59-efb1140ef80e {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:37:51.019770 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-4f93b724-c4f2-4798-a5a5-c0783c5fa5b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] HTTP exception thrown: Cannot 'rescue' instance d6f665d8-ddd8-4030-be59-efb1140ef80e while it is in vm_state paused Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4f93b724-c4f2-4798-a5a5-c0783c5fa5b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Request method failure captured: Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e/action HTTP/1.1 Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 14 Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iRDccV-wQBjWbehYJnvnYrqtEvDPnmmRi9FdLn90jlDwmLP7Yu8AV-Xjh3sRI2h6VdTdDxREaF_4Uw5JAlLnmy-pOyTW0C8AnpTCeGTveMx08cuhXqa0wk4T8c8YQiDTyaAtMLbCc_qByCh4ZjwOdEPthe4EaqbP1499Gbu30qZ6g8 Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 4eea5599d0754399a32a3ae3431ff18f Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: {"rescue": {}} Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: exception: Cannot 'rescue' instance d6f665d8-ddd8-4030-be59-efb1140ef80e while it is in vm_state paused Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'd6f665d8-ddd8-4030-be59-efb1140ef80e', 'body': {'rescue': {}}} Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d6f665d8-ddd8-4030-be59-efb1140ef80e in vm_state paused. Cannot rescue while the instance is in this state. Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance d6f665d8-ddd8-4030-be59-efb1140ef80e while it is in vm_state paused Aug 18 11:37:51.033657 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:51.042935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:37:51.042935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:51.042935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:37:51.042935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:37:51.042935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:37:51.042935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:37:51.042935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:37:51.042935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance d6f665d8-ddd8-4030-be59-efb1140ef80e while it is in vm_state paused Aug 18 11:37:51.042935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:37:51.045479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4f93b724-c4f2-4798-a5a5-c0783c5fa5b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Returning 409 to user: Cannot 'rescue' instance d6f665d8-ddd8-4030-be59-efb1140ef80e while it is in vm_state paused {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:37:51.046779 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4f93b724-c4f2-4798-a5a5-c0783c5fa5b3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e/action" status: 409 len: 144 microversion: 2.1 time: 0.200630 Aug 18 11:37:51.048006 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1481/2875] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:37:50 2022] POST /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e/action => generated 144 bytes in 202 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:37:51.065324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3e13e96f-27b1-47b9-85d0-cbb2b08fa84c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:51.066374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3e13e96f-27b1-47b9-85d0-cbb2b08fa84c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:51.082996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e13e96f-27b1-47b9-85d0-cbb2b08fa84c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:51.083849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e13e96f-27b1-47b9-85d0-cbb2b08fa84c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:51.084767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e13e96f-27b1-47b9-85d0-cbb2b08fa84c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:51.087565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e13e96f-27b1-47b9-85d0-cbb2b08fa84c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:51.088322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e13e96f-27b1-47b9-85d0-cbb2b08fa84c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:51.088983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e13e96f-27b1-47b9-85d0-cbb2b08fa84c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:51.125157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5b826e5f-4a74-4d67-a315-726244e5a560 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:51.140876 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5b826e5f-4a74-4d67-a315-726244e5a560 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1266 microversion: 2.1 time: 0.247970 Aug 18 11:37:51.142072 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1395/2876] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:50 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:51.168365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f09ad73d-1a01-4621-8a44-3f67d0604609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:51.169461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f09ad73d-1a01-4621-8a44-3f67d0604609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:51.183542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f09ad73d-1a01-4621-8a44-3f67d0604609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:51.184045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f09ad73d-1a01-4621-8a44-3f67d0604609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:51.184494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f09ad73d-1a01-4621-8a44-3f67d0604609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:51.185769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f09ad73d-1a01-4621-8a44-3f67d0604609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:51.185769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f09ad73d-1a01-4621-8a44-3f67d0604609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:51.186110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f09ad73d-1a01-4621-8a44-3f67d0604609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:51.325632 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f09ad73d-1a01-4621-8a44-3f67d0604609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e/action" status: 202 len: 0 microversion: 2.1 time: 0.174899 Aug 18 11:37:51.326628 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1396/2877] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:37:51 2022] POST /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:37:51.343350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-19784e67-6dca-4e77-96f1-dfee961e060c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:51.343996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-19784e67-6dca-4e77-96f1-dfee961e060c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:51.357982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19784e67-6dca-4e77-96f1-dfee961e060c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:51.358525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19784e67-6dca-4e77-96f1-dfee961e060c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:51.358976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19784e67-6dca-4e77-96f1-dfee961e060c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:51.359700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19784e67-6dca-4e77-96f1-dfee961e060c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:51.360191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19784e67-6dca-4e77-96f1-dfee961e060c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:51.360626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19784e67-6dca-4e77-96f1-dfee961e060c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:51.472341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3e13e96f-27b1-47b9-85d0-cbb2b08fa84c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:51.490926 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3e13e96f-27b1-47b9-85d0-cbb2b08fa84c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1402 microversion: 2.1 time: 0.441480 Aug 18 11:37:51.495798 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1482/2878] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:51 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1402 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:51.771670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1bc949b0-1e0f-4b89-b26b-aef66273ce7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:51.772643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1bc949b0-1e0f-4b89-b26b-aef66273ce7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:51.781390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=16 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:51.785237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bc949b0-1e0f-4b89-b26b-aef66273ce7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:51.785943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bc949b0-1e0f-4b89-b26b-aef66273ce7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:51.788371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bc949b0-1e0f-4b89-b26b-aef66273ce7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:51.792590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bc949b0-1e0f-4b89-b26b-aef66273ce7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:51.793678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bc949b0-1e0f-4b89-b26b-aef66273ce7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:51.794352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bc949b0-1e0f-4b89-b26b-aef66273ce7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:52.218889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1bc949b0-1e0f-4b89-b26b-aef66273ce7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:52.230885 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1bc949b0-1e0f-4b89-b26b-aef66273ce7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.463125 Aug 18 11:37:52.233157 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1483/2879] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:51 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:52.250730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03fa45b4-d53e-4148-86cf-c5a477cdb533 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:52.251934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-03fa45b4-d53e-4148-86cf-c5a477cdb533 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:52.268646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03fa45b4-d53e-4148-86cf-c5a477cdb533 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:52.288429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03fa45b4-d53e-4148-86cf-c5a477cdb533 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:52.289916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03fa45b4-d53e-4148-86cf-c5a477cdb533 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:52.303621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03fa45b4-d53e-4148-86cf-c5a477cdb533 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:52.304677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03fa45b4-d53e-4148-86cf-c5a477cdb533 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:52.305466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03fa45b4-d53e-4148-86cf-c5a477cdb533 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:52.533311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-19784e67-6dca-4e77-96f1-dfee961e060c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:52.555466 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-19784e67-6dca-4e77-96f1-dfee961e060c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1506 microversion: 2.1 time: 1.216633 Aug 18 11:37:52.556079 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1397/2880] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:51 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1506 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:52.566047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e584c775-5b6a-4ad8-8f44-20f1f8b23cfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:52.572760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e584c775-5b6a-4ad8-8f44-20f1f8b23cfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:52.624081 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e584c775-5b6a-4ad8-8f44-20f1f8b23cfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:52.624520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e584c775-5b6a-4ad8-8f44-20f1f8b23cfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:52.625171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e584c775-5b6a-4ad8-8f44-20f1f8b23cfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:52.625941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e584c775-5b6a-4ad8-8f44-20f1f8b23cfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:52.626356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e584c775-5b6a-4ad8-8f44-20f1f8b23cfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:52.626801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e584c775-5b6a-4ad8-8f44-20f1f8b23cfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:52.907825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-03fa45b4-d53e-4148-86cf-c5a477cdb533 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:52.917845 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-03fa45b4-d53e-4148-86cf-c5a477cdb533 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 0.683269 Aug 18 11:37:52.921480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e584c775-5b6a-4ad8-8f44-20f1f8b23cfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:52.935604 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1484/2881] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:52 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:52.940713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-73906b92-b927-4da8-9cc6-3b73fe8733d1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:52.941343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-73906b92-b927-4da8-9cc6-3b73fe8733d1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:52.942573 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e584c775-5b6a-4ad8-8f44-20f1f8b23cfc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1272 microversion: 2.1 time: 0.385005 Aug 18 11:37:52.956118 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1398/2882] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:52 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1272 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:52.966298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73906b92-b927-4da8-9cc6-3b73fe8733d1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:52.975121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73906b92-b927-4da8-9cc6-3b73fe8733d1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:52.975640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73906b92-b927-4da8-9cc6-3b73fe8733d1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:52.976952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73906b92-b927-4da8-9cc6-3b73fe8733d1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:52.977453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73906b92-b927-4da8-9cc6-3b73fe8733d1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:52.977895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73906b92-b927-4da8-9cc6-3b73fe8733d1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:53.261017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0851c1f6-b07e-4c2c-94e1-b358f1a4059b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:53.262135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0851c1f6-b07e-4c2c-94e1-b358f1a4059b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:53.280003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0851c1f6-b07e-4c2c-94e1-b358f1a4059b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:53.281589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0851c1f6-b07e-4c2c-94e1-b358f1a4059b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:53.293313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0851c1f6-b07e-4c2c-94e1-b358f1a4059b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:53.303405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0851c1f6-b07e-4c2c-94e1-b358f1a4059b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:53.307338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0851c1f6-b07e-4c2c-94e1-b358f1a4059b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:53.308191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-73906b92-b927-4da8-9cc6-3b73fe8733d1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:53.309188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0851c1f6-b07e-4c2c-94e1-b358f1a4059b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:53.318343 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-73906b92-b927-4da8-9cc6-3b73fe8733d1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1402 microversion: 2.1 time: 0.381482 Aug 18 11:37:53.324236 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1485/2883] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:52 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1402 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:53.401533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:53.583392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-96d771aa-ea49-457c-a1d2-f923dcdbf136 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:53.584117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-96d771aa-ea49-457c-a1d2-f923dcdbf136 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:53.609991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96d771aa-ea49-457c-a1d2-f923dcdbf136 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:53.609991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96d771aa-ea49-457c-a1d2-f923dcdbf136 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:53.610730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96d771aa-ea49-457c-a1d2-f923dcdbf136 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:53.611587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96d771aa-ea49-457c-a1d2-f923dcdbf136 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:53.612147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96d771aa-ea49-457c-a1d2-f923dcdbf136 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:53.612825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96d771aa-ea49-457c-a1d2-f923dcdbf136 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:53.871711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0851c1f6-b07e-4c2c-94e1-b358f1a4059b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:53.894820 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0851c1f6-b07e-4c2c-94e1-b358f1a4059b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.638923 Aug 18 11:37:53.897193 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1399/2884] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:53 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:53.963106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-920f4f9a-0445-4416-9eeb-7ff9b05cb911 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:53.963926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-920f4f9a-0445-4416-9eeb-7ff9b05cb911 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:53.975119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-920f4f9a-0445-4416-9eeb-7ff9b05cb911 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:53.975629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-920f4f9a-0445-4416-9eeb-7ff9b05cb911 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:53.976121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-920f4f9a-0445-4416-9eeb-7ff9b05cb911 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:53.981121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-920f4f9a-0445-4416-9eeb-7ff9b05cb911 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:53.981640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-920f4f9a-0445-4416-9eeb-7ff9b05cb911 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:53.982100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-920f4f9a-0445-4416-9eeb-7ff9b05cb911 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:54.261410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-920f4f9a-0445-4416-9eeb-7ff9b05cb911 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:54.273841 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-920f4f9a-0445-4416-9eeb-7ff9b05cb911 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1473 microversion: 2.1 time: 0.315090 Aug 18 11:37:54.292246 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1400/2885] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:53 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1473 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:54.298772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b318d0eb-4df5-4cc7-b90a-69063769cc0e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:54.299759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b318d0eb-4df5-4cc7-b90a-69063769cc0e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:54.308344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b318d0eb-4df5-4cc7-b90a-69063769cc0e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:54.310866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b318d0eb-4df5-4cc7-b90a-69063769cc0e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:54.312000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b318d0eb-4df5-4cc7-b90a-69063769cc0e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:54.313144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b318d0eb-4df5-4cc7-b90a-69063769cc0e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:54.314194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b318d0eb-4df5-4cc7-b90a-69063769cc0e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:54.314926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b318d0eb-4df5-4cc7-b90a-69063769cc0e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:54.531076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b318d0eb-4df5-4cc7-b90a-69063769cc0e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:54.543343 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b318d0eb-4df5-4cc7-b90a-69063769cc0e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1314 microversion: 2.1 time: 0.248368 Aug 18 11:37:54.562485 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1401/2886] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:54 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:54.563002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9bc99c2c-a035-4cee-a2b7-40ce16e97208 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:54.567331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9bc99c2c-a035-4cee-a2b7-40ce16e97208 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:54.594196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9bc99c2c-a035-4cee-a2b7-40ce16e97208 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:54.595005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9bc99c2c-a035-4cee-a2b7-40ce16e97208 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:54.595600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9bc99c2c-a035-4cee-a2b7-40ce16e97208 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:54.596505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9bc99c2c-a035-4cee-a2b7-40ce16e97208 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:54.597116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9bc99c2c-a035-4cee-a2b7-40ce16e97208 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:54.597701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9bc99c2c-a035-4cee-a2b7-40ce16e97208 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:54.865018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-96d771aa-ea49-457c-a1d2-f923dcdbf136 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:54.901585 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-96d771aa-ea49-457c-a1d2-f923dcdbf136 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1514 microversion: 2.1 time: 1.310776 Aug 18 11:37:54.904329 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1486/2887] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:53 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1514 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:37:54.934579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6897e9d4-8844-488b-a036-08b9f72ef764 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:54.937945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6897e9d4-8844-488b-a036-08b9f72ef764 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:54.985293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6897e9d4-8844-488b-a036-08b9f72ef764 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:54.985709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6897e9d4-8844-488b-a036-08b9f72ef764 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:54.992889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6897e9d4-8844-488b-a036-08b9f72ef764 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:54.997706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6897e9d4-8844-488b-a036-08b9f72ef764 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:55.005044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6897e9d4-8844-488b-a036-08b9f72ef764 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:55.008901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6897e9d4-8844-488b-a036-08b9f72ef764 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:55.028981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:55.277871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9bc99c2c-a035-4cee-a2b7-40ce16e97208 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:55.292605 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9bc99c2c-a035-4cee-a2b7-40ce16e97208 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1402 microversion: 2.1 time: 0.740220 Aug 18 11:37:55.294088 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1402/2888] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:54 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1402 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:55.315306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e30875f0-5c42-4e23-82ad-ced2f71f9af2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:55.322350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e30875f0-5c42-4e23-82ad-ced2f71f9af2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:55.350685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e30875f0-5c42-4e23-82ad-ced2f71f9af2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:55.359834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e30875f0-5c42-4e23-82ad-ced2f71f9af2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:55.360651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e30875f0-5c42-4e23-82ad-ced2f71f9af2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:55.361747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e30875f0-5c42-4e23-82ad-ced2f71f9af2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:55.362834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e30875f0-5c42-4e23-82ad-ced2f71f9af2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:55.364314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e30875f0-5c42-4e23-82ad-ced2f71f9af2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:55.486897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6897e9d4-8844-488b-a036-08b9f72ef764 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:55.500178 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6897e9d4-8844-488b-a036-08b9f72ef764 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.582103 Aug 18 11:37:55.510497 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1487/2889] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:54 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:55.581253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5bf7d860-6eb2-4eae-80d0-11cca8a55dbc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:55.582197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5bf7d860-6eb2-4eae-80d0-11cca8a55dbc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:55.596019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bf7d860-6eb2-4eae-80d0-11cca8a55dbc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:55.597703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bf7d860-6eb2-4eae-80d0-11cca8a55dbc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:55.605247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bf7d860-6eb2-4eae-80d0-11cca8a55dbc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:55.608984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bf7d860-6eb2-4eae-80d0-11cca8a55dbc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:55.610044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bf7d860-6eb2-4eae-80d0-11cca8a55dbc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:55.619061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bf7d860-6eb2-4eae-80d0-11cca8a55dbc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:55.950713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5bf7d860-6eb2-4eae-80d0-11cca8a55dbc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:55.968014 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5bf7d860-6eb2-4eae-80d0-11cca8a55dbc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1314 microversion: 2.1 time: 0.391630 Aug 18 11:37:55.969794 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1488/2890] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:55 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:56.008652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e30875f0-5c42-4e23-82ad-ced2f71f9af2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:56.030030 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e30875f0-5c42-4e23-82ad-ced2f71f9af2 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1479 microversion: 2.1 time: 0.725835 Aug 18 11:37:56.035004 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1403/2891] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:55 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1479 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:56.315669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-066b6c22-1cb2-4aa6-a39c-57b01d125e67 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:56.316556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-066b6c22-1cb2-4aa6-a39c-57b01d125e67 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:56.327884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-066b6c22-1cb2-4aa6-a39c-57b01d125e67 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:56.328525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-066b6c22-1cb2-4aa6-a39c-57b01d125e67 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:56.329396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-066b6c22-1cb2-4aa6-a39c-57b01d125e67 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:56.329829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-066b6c22-1cb2-4aa6-a39c-57b01d125e67 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:56.330299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-066b6c22-1cb2-4aa6-a39c-57b01d125e67 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:56.331094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-066b6c22-1cb2-4aa6-a39c-57b01d125e67 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:56.533018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-189db77c-6d01-4948-b159-6b71d839f86c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:56.533646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-189db77c-6d01-4948-b159-6b71d839f86c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:56.543610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-189db77c-6d01-4948-b159-6b71d839f86c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:56.552534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-189db77c-6d01-4948-b159-6b71d839f86c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:56.552985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-189db77c-6d01-4948-b159-6b71d839f86c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:56.553786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-189db77c-6d01-4948-b159-6b71d839f86c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:56.554382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-189db77c-6d01-4948-b159-6b71d839f86c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:56.554990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-189db77c-6d01-4948-b159-6b71d839f86c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:57.026009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-066b6c22-1cb2-4aa6-a39c-57b01d125e67 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:57.034101 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-066b6c22-1cb2-4aa6-a39c-57b01d125e67 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1402 microversion: 2.1 time: 0.722946 Aug 18 11:37:57.050872 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1489/2892] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:56 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1402 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:57.059946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3c7afefc-10de-4119-8f42-b9cc51669c09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:57.060588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3c7afefc-10de-4119-8f42-b9cc51669c09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:57.081136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c7afefc-10de-4119-8f42-b9cc51669c09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:57.087832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c7afefc-10de-4119-8f42-b9cc51669c09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:57.088470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c7afefc-10de-4119-8f42-b9cc51669c09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:57.089531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c7afefc-10de-4119-8f42-b9cc51669c09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:57.090169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c7afefc-10de-4119-8f42-b9cc51669c09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:57.090805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c7afefc-10de-4119-8f42-b9cc51669c09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:57.266999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-189db77c-6d01-4948-b159-6b71d839f86c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:57.275300 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-189db77c-6d01-4948-b159-6b71d839f86c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.746709 Aug 18 11:37:57.284685 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1404/2893] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:56 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:57.294578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8b365a13-6fdb-41ab-a20d-a0396a184d91 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:57.295210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8b365a13-6fdb-41ab-a20d-a0396a184d91 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:57.331454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b365a13-6fdb-41ab-a20d-a0396a184d91 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:57.332628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b365a13-6fdb-41ab-a20d-a0396a184d91 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:57.333054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b365a13-6fdb-41ab-a20d-a0396a184d91 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:57.333966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b365a13-6fdb-41ab-a20d-a0396a184d91 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:57.334636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b365a13-6fdb-41ab-a20d-a0396a184d91 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:57.335261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b365a13-6fdb-41ab-a20d-a0396a184d91 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:58.232627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3c7afefc-10de-4119-8f42-b9cc51669c09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:58.247869 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3c7afefc-10de-4119-8f42-b9cc51669c09 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1314 microversion: 2.1 time: 1.195421 Aug 18 11:37:58.267618 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1490/2894] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:57 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1314 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:58.282226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5c0feef8-246c-4bd1-b523-9d658d2fb5cf req-6e47564d-5644-4ef1-9d0d-2a5129285849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7270699d-e0c4-4276-b522-8aee7925f99b", "tag": "a9cec86b-72ec-4294-9b6c-597cc6c33d0c"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:58.283534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8b365a13-6fdb-41ab-a20d-a0396a184d91 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:58.296300 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8b365a13-6fdb-41ab-a20d-a0396a184d91 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1479 microversion: 2.1 time: 1.010335 Aug 18 11:37:58.299269 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1405/2895] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:57 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1479 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:58.306685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c0feef8-246c-4bd1-b523-9d658d2fb5cf req-6e47564d-5644-4ef1-9d0d-2a5129285849 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:58.306685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c0feef8-246c-4bd1-b523-9d658d2fb5cf req-6e47564d-5644-4ef1-9d0d-2a5129285849 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:58.306685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c0feef8-246c-4bd1-b523-9d658d2fb5cf req-6e47564d-5644-4ef1-9d0d-2a5129285849 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:58.320206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e5766888-0a13-42c3-9740-c6db1600c0b0 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:58.321313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e5766888-0a13-42c3-9740-c6db1600c0b0 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:58.331922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5766888-0a13-42c3-9740-c6db1600c0b0 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:58.332898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5766888-0a13-42c3-9740-c6db1600c0b0 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:58.333499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5766888-0a13-42c3-9740-c6db1600c0b0 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:58.334595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5766888-0a13-42c3-9740-c6db1600c0b0 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:58.335331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5766888-0a13-42c3-9740-c6db1600c0b0 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:58.335975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e5766888-0a13-42c3-9740-c6db1600c0b0 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:58.347604 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5c0feef8-246c-4bd1-b523-9d658d2fb5cf req-6e47564d-5644-4ef1-9d0d-2a5129285849 service nova] Creating event network-changed:a9cec86b-72ec-4294-9b6c-597cc6c33d0c for instance 7270699d-e0c4-4276-b522-8aee7925f99b on n-h2-853611-3 Aug 18 11:37:58.368063 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5c0feef8-246c-4bd1-b523-9d658d2fb5cf req-6e47564d-5644-4ef1-9d0d-2a5129285849 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098568 Aug 18 11:37:58.378652 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1491/2896] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:37:58.396713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-141a954f-e251-4e88-a0db-f736c54dacc8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:58.398549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-141a954f-e251-4e88-a0db-f736c54dacc8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:58.408321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-141a954f-e251-4e88-a0db-f736c54dacc8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:58.408951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-141a954f-e251-4e88-a0db-f736c54dacc8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:58.409517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-141a954f-e251-4e88-a0db-f736c54dacc8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:58.410246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-141a954f-e251-4e88-a0db-f736c54dacc8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:58.412092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-141a954f-e251-4e88-a0db-f736c54dacc8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:58.412592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-141a954f-e251-4e88-a0db-f736c54dacc8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:58.856103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e5766888-0a13-42c3-9740-c6db1600c0b0 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:58.864989 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e5766888-0a13-42c3-9740-c6db1600c0b0 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1402 microversion: 2.1 time: 0.556614 Aug 18 11:37:58.882654 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1406/2897] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:58 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1402 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:58.893845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-141a954f-e251-4e88-a0db-f736c54dacc8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:37:58.905106 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-141a954f-e251-4e88-a0db-f736c54dacc8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1476 microversion: 2.1 time: 0.524616 Aug 18 11:37:58.919316 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1492/2898] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:58 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1476 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:37:59.208980 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-91409be8-11da-4b5c-ba6c-6de135393f59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:59.215596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-91409be8-11da-4b5c-ba6c-6de135393f59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:59.231541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:59.234868 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91409be8-11da-4b5c-ba6c-6de135393f59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:59.239401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91409be8-11da-4b5c-ba6c-6de135393f59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:59.240098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91409be8-11da-4b5c-ba6c-6de135393f59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:59.241018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91409be8-11da-4b5c-ba6c-6de135393f59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:59.241210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-74f050d6-6698-4cd6-bb82-29fab99e5d2d req-e5db02fc-496d-4174-a9bf-4634fa4984e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aee369f-2ece-4b53-a7db-efe946936831", "name": "network-vif-unplugged", "status": "completed", "tag": "fdd9010d-de96-4f58-8fc4-5c78c661a107"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:37:59.250421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91409be8-11da-4b5c-ba6c-6de135393f59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:59.251121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91409be8-11da-4b5c-ba6c-6de135393f59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:59.260462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-74f050d6-6698-4cd6-bb82-29fab99e5d2d req-e5db02fc-496d-4174-a9bf-4634fa4984e1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:59.261275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-74f050d6-6698-4cd6-bb82-29fab99e5d2d req-e5db02fc-496d-4174-a9bf-4634fa4984e1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:59.261940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-74f050d6-6698-4cd6-bb82-29fab99e5d2d req-e5db02fc-496d-4174-a9bf-4634fa4984e1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:59.287490 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-74f050d6-6698-4cd6-bb82-29fab99e5d2d req-e5db02fc-496d-4174-a9bf-4634fa4984e1 service nova] Creating event network-vif-unplugged:fdd9010d-de96-4f58-8fc4-5c78c661a107 for instance 5aee369f-2ece-4b53-a7db-efe946936831 on n-h2-853611-3 Aug 18 11:37:59.301981 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-74f050d6-6698-4cd6-bb82-29fab99e5d2d req-e5db02fc-496d-4174-a9bf-4634fa4984e1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064287 Aug 18 11:37:59.302616 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1493/2899] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:37:59.308159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-91409be8-11da-4b5c-ba6c-6de135393f59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lazy-loading 'flavor' on Instance uuid d6f665d8-ddd8-4030-be59-efb1140ef80e {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:37:59.321223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f6f641ac-d33c-4f74-81d1-6c47718fe79e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:59.322350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f6f641ac-d33c-4f74-81d1-6c47718fe79e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:59.336171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6f641ac-d33c-4f74-81d1-6c47718fe79e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:59.336675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6f641ac-d33c-4f74-81d1-6c47718fe79e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:59.337119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6f641ac-d33c-4f74-81d1-6c47718fe79e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:59.337838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6f641ac-d33c-4f74-81d1-6c47718fe79e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:59.342844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6f641ac-d33c-4f74-81d1-6c47718fe79e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:59.343306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6f641ac-d33c-4f74-81d1-6c47718fe79e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:59.488154 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-91409be8-11da-4b5c-ba6c-6de135393f59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e/action" status: 200 len: 32 microversion: 2.1 time: 0.286497 Aug 18 11:37:59.489290 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1407/2900] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:37:59 2022] POST /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e/action => generated 32 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 11:37:59.504124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-890296f4-2089-47af-b6ea-a8e42ff5e939 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:37:59.506331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-890296f4-2089-47af-b6ea-a8e42ff5e939 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:37:59.526029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-890296f4-2089-47af-b6ea-a8e42ff5e939 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:59.528264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-890296f4-2089-47af-b6ea-a8e42ff5e939 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:59.528952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-890296f4-2089-47af-b6ea-a8e42ff5e939 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:59.531103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-890296f4-2089-47af-b6ea-a8e42ff5e939 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:37:59.531757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-890296f4-2089-47af-b6ea-a8e42ff5e939 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:37:59.532360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-890296f4-2089-47af-b6ea-a8e42ff5e939 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:37:59.812757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=8 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:37:59.992795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-890296f4-2089-47af-b6ea-a8e42ff5e939 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:00.004630 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-890296f4-2089-47af-b6ea-a8e42ff5e939 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1479 microversion: 2.1 time: 0.512745 Aug 18 11:38:00.014997 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1408/2901] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:59 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1479 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:00.019931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-19d9047d-2bba-401a-91c0-728567698d36 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:00.021068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-19d9047d-2bba-401a-91c0-728567698d36 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:00.033977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19d9047d-2bba-401a-91c0-728567698d36 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:00.034539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19d9047d-2bba-401a-91c0-728567698d36 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:00.047067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19d9047d-2bba-401a-91c0-728567698d36 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:00.048163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19d9047d-2bba-401a-91c0-728567698d36 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:00.048731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19d9047d-2bba-401a-91c0-728567698d36 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:00.049274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19d9047d-2bba-401a-91c0-728567698d36 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:00.232706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f6f641ac-d33c-4f74-81d1-6c47718fe79e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:00.251202 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f6f641ac-d33c-4f74-81d1-6c47718fe79e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1314 microversion: 2.1 time: 0.945094 Aug 18 11:38:00.254248 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1494/2902] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:37:59 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1314 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:00.274588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f302ee79-a209-46fb-92fa-49f1732d4f87 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:00.275821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f302ee79-a209-46fb-92fa-49f1732d4f87 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:00.306078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f302ee79-a209-46fb-92fa-49f1732d4f87 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:00.306958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f302ee79-a209-46fb-92fa-49f1732d4f87 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:00.307831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f302ee79-a209-46fb-92fa-49f1732d4f87 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:00.308754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f302ee79-a209-46fb-92fa-49f1732d4f87 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:00.314070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f302ee79-a209-46fb-92fa-49f1732d4f87 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:00.314850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f302ee79-a209-46fb-92fa-49f1732d4f87 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:00.700571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-19d9047d-2bba-401a-91c0-728567698d36 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:00.712700 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-19d9047d-2bba-401a-91c0-728567698d36 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1520 microversion: 2.1 time: 0.695712 Aug 18 11:38:00.713652 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1409/2903] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:00 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1520 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:00.723623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-08a17555-00e4-459e-a1d3-97654dec8e05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:00.724268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-08a17555-00e4-459e-a1d3-97654dec8e05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:00.742927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a17555-00e4-459e-a1d3-97654dec8e05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:00.743497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a17555-00e4-459e-a1d3-97654dec8e05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:00.743951 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a17555-00e4-459e-a1d3-97654dec8e05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:00.747937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f302ee79-a209-46fb-92fa-49f1732d4f87 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:00.751483 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a17555-00e4-459e-a1d3-97654dec8e05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:00.752001 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a17555-00e4-459e-a1d3-97654dec8e05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:00.752450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08a17555-00e4-459e-a1d3-97654dec8e05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:00.790022 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f302ee79-a209-46fb-92fa-49f1732d4f87 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1402 microversion: 2.1 time: 0.525320 Aug 18 11:38:00.809310 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1495/2904] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:00 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1402 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:01.039229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ebda99c9-3a6e-4fff-8de3-0d57b6a819d0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:01.039978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ebda99c9-3a6e-4fff-8de3-0d57b6a819d0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:01.051213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebda99c9-3a6e-4fff-8de3-0d57b6a819d0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:01.051996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebda99c9-3a6e-4fff-8de3-0d57b6a819d0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:01.052642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebda99c9-3a6e-4fff-8de3-0d57b6a819d0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:01.055366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebda99c9-3a6e-4fff-8de3-0d57b6a819d0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:01.056094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebda99c9-3a6e-4fff-8de3-0d57b6a819d0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:01.058065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebda99c9-3a6e-4fff-8de3-0d57b6a819d0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:01.301216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-08a17555-00e4-459e-a1d3-97654dec8e05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:01.349629 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-08a17555-00e4-459e-a1d3-97654dec8e05 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1475 microversion: 2.1 time: 0.634864 Aug 18 11:38:01.352604 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1410/2905] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:00 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1475 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:01.363199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-1cc3a5dc-58c8-4aaf-b368-c662106e259b req-8572838e-1c2d-4030-922c-c08fac00ed9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd", "name": "network-vif-unplugged", "status": "completed", "tag": "00724f9e-9d67-4b16-bdb4-8f9550b2f963"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:01.393744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1cc3a5dc-58c8-4aaf-b368-c662106e259b req-8572838e-1c2d-4030-922c-c08fac00ed9b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:01.394233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1cc3a5dc-58c8-4aaf-b368-c662106e259b req-8572838e-1c2d-4030-922c-c08fac00ed9b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:01.394695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1cc3a5dc-58c8-4aaf-b368-c662106e259b req-8572838e-1c2d-4030-922c-c08fac00ed9b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:01.433758 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-1cc3a5dc-58c8-4aaf-b368-c662106e259b req-8572838e-1c2d-4030-922c-c08fac00ed9b service nova] Creating event network-vif-unplugged:00724f9e-9d67-4b16-bdb4-8f9550b2f963 for instance 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd on n-h2-853611-3 Aug 18 11:38:01.452689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [req-1cc3a5dc-58c8-4aaf-b368-c662106e259b req-8572838e-1c2d-4030-922c-c08fac00ed9b service nova] Instance 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122209) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 11:38:01.478390 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-1cc3a5dc-58c8-4aaf-b368-c662106e259b req-8572838e-1c2d-4030-922c-c08fac00ed9b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124295 Aug 18 11:38:01.480989 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1411/2906] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:01.488759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-549a6a60-b0ac-4002-b433-da472615a080 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:01.490452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-549a6a60-b0ac-4002-b433-da472615a080 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:01.509739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-549a6a60-b0ac-4002-b433-da472615a080 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:01.510606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-549a6a60-b0ac-4002-b433-da472615a080 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:01.511241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-549a6a60-b0ac-4002-b433-da472615a080 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:01.512161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-549a6a60-b0ac-4002-b433-da472615a080 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:01.512787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-549a6a60-b0ac-4002-b433-da472615a080 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:01.513485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-549a6a60-b0ac-4002-b433-da472615a080 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:01.559948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ebda99c9-3a6e-4fff-8de3-0d57b6a819d0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:01.577096 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ebda99c9-3a6e-4fff-8de3-0d57b6a819d0 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1479 microversion: 2.1 time: 0.542437 Aug 18 11:38:01.579486 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1496/2907] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:01 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1479 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:38:01.740379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8b49234-43c5-4c6e-a1e0-5089c45b940f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:01.741057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f8b49234-43c5-4c6e-a1e0-5089c45b940f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:01.749277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8b49234-43c5-4c6e-a1e0-5089c45b940f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:01.749780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8b49234-43c5-4c6e-a1e0-5089c45b940f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:01.750222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8b49234-43c5-4c6e-a1e0-5089c45b940f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:01.751482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8b49234-43c5-4c6e-a1e0-5089c45b940f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:01.751950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8b49234-43c5-4c6e-a1e0-5089c45b940f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:01.752382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8b49234-43c5-4c6e-a1e0-5089c45b940f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:02.004002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-549a6a60-b0ac-4002-b433-da472615a080 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:02.016984 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-549a6a60-b0ac-4002-b433-da472615a080 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1314 microversion: 2.1 time: 0.534506 Aug 18 11:38:02.017707 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1412/2908] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:01 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:02.034752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e07f784b-b7fc-4d2a-801c-bc36ab31d20f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:02.035764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e07f784b-b7fc-4d2a-801c-bc36ab31d20f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:02.049518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e07f784b-b7fc-4d2a-801c-bc36ab31d20f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:02.050144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e07f784b-b7fc-4d2a-801c-bc36ab31d20f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:02.050702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e07f784b-b7fc-4d2a-801c-bc36ab31d20f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:02.051651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e07f784b-b7fc-4d2a-801c-bc36ab31d20f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:02.052160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e07f784b-b7fc-4d2a-801c-bc36ab31d20f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:02.052526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e07f784b-b7fc-4d2a-801c-bc36ab31d20f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:02.245503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f8b49234-43c5-4c6e-a1e0-5089c45b940f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:02.292761 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8b49234-43c5-4c6e-a1e0-5089c45b940f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1520 microversion: 2.1 time: 0.546926 Aug 18 11:38:02.293478 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1497/2909] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:01 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1520 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:02.305315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-12bbfaac-b913-4c2e-bd54-f938a03a9378 req-b79955f8-9dc9-4436-a9d8-4945d1536c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aee369f-2ece-4b53-a7db-efe946936831", "name": "network-vif-plugged", "status": "completed", "tag": "fdd9010d-de96-4f58-8fc4-5c78c661a107"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:02.318132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-12bbfaac-b913-4c2e-bd54-f938a03a9378 req-b79955f8-9dc9-4436-a9d8-4945d1536c74 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:02.318918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-12bbfaac-b913-4c2e-bd54-f938a03a9378 req-b79955f8-9dc9-4436-a9d8-4945d1536c74 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:02.320238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-12bbfaac-b913-4c2e-bd54-f938a03a9378 req-b79955f8-9dc9-4436-a9d8-4945d1536c74 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:02.338671 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-12bbfaac-b913-4c2e-bd54-f938a03a9378 req-b79955f8-9dc9-4436-a9d8-4945d1536c74 service nova] Creating event network-vif-plugged:fdd9010d-de96-4f58-8fc4-5c78c661a107 for instance 5aee369f-2ece-4b53-a7db-efe946936831 on n-h2-853611-3 Aug 18 11:38:02.345061 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-12bbfaac-b913-4c2e-bd54-f938a03a9378 req-b79955f8-9dc9-4436-a9d8-4945d1536c74 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048476 Aug 18 11:38:02.346403 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1498/2910] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:02.381379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d2781b2d-b429-440b-a195-cc34b758ef25 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:02.382996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d2781b2d-b429-440b-a195-cc34b758ef25 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:02.391610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2781b2d-b429-440b-a195-cc34b758ef25 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:02.392376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2781b2d-b429-440b-a195-cc34b758ef25 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:02.393029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2781b2d-b429-440b-a195-cc34b758ef25 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:02.393964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2781b2d-b429-440b-a195-cc34b758ef25 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:02.394738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2781b2d-b429-440b-a195-cc34b758ef25 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:02.395382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2781b2d-b429-440b-a195-cc34b758ef25 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:02.652718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2781b2d-b429-440b-a195-cc34b758ef25 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:02.722172 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d2781b2d-b429-440b-a195-cc34b758ef25 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1475 microversion: 2.1 time: 0.350642 Aug 18 11:38:02.737668 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1499/2911] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:02 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1475 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:02.750554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5111fc2b-5cae-43b2-b7bf-279fcf49eba9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:02.751425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5111fc2b-5cae-43b2-b7bf-279fcf49eba9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:02.761788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5111fc2b-5cae-43b2-b7bf-279fcf49eba9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:02.762754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5111fc2b-5cae-43b2-b7bf-279fcf49eba9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:02.763685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5111fc2b-5cae-43b2-b7bf-279fcf49eba9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:02.764713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5111fc2b-5cae-43b2-b7bf-279fcf49eba9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:02.765466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5111fc2b-5cae-43b2-b7bf-279fcf49eba9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:02.766682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5111fc2b-5cae-43b2-b7bf-279fcf49eba9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:02.896054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e07f784b-b7fc-4d2a-801c-bc36ab31d20f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:02.911062 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e07f784b-b7fc-4d2a-801c-bc36ab31d20f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1402 microversion: 2.1 time: 0.891988 Aug 18 11:38:02.924858 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1413/2912] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:02 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1402 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:03.048110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3add3d21-8dc8-4f15-ae9d-20453608dbf0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:03.050310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3add3d21-8dc8-4f15-ae9d-20453608dbf0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:03.062821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3add3d21-8dc8-4f15-ae9d-20453608dbf0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:03.063739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3add3d21-8dc8-4f15-ae9d-20453608dbf0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:03.064364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3add3d21-8dc8-4f15-ae9d-20453608dbf0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:03.067401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3add3d21-8dc8-4f15-ae9d-20453608dbf0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:03.068251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3add3d21-8dc8-4f15-ae9d-20453608dbf0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:03.068924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3add3d21-8dc8-4f15-ae9d-20453608dbf0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:03.098422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:03.189046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5111fc2b-5cae-43b2-b7bf-279fcf49eba9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:03.200008 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5111fc2b-5cae-43b2-b7bf-279fcf49eba9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1479 microversion: 2.1 time: 0.461872 Aug 18 11:38:03.221955 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1500/2913] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:02 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1479 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:03.321570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b9bd697f-a35a-4e14-b2dc-48566e478f7c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:03.322290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b9bd697f-a35a-4e14-b2dc-48566e478f7c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:03.334294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9bd697f-a35a-4e14-b2dc-48566e478f7c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:03.339618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9bd697f-a35a-4e14-b2dc-48566e478f7c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:03.340559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9bd697f-a35a-4e14-b2dc-48566e478f7c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:03.341153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9bd697f-a35a-4e14-b2dc-48566e478f7c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:03.341705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9bd697f-a35a-4e14-b2dc-48566e478f7c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:03.342183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9bd697f-a35a-4e14-b2dc-48566e478f7c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:03.576039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b9bd697f-a35a-4e14-b2dc-48566e478f7c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:03.584321 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b9bd697f-a35a-4e14-b2dc-48566e478f7c tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1520 microversion: 2.1 time: 0.269653 Aug 18 11:38:03.585149 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1501/2914] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:03 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:03.745476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-98a5a0df-2e1b-498c-98b3-c9e06a224e7a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:03.746169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-98a5a0df-2e1b-498c-98b3-c9e06a224e7a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:03.755775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98a5a0df-2e1b-498c-98b3-c9e06a224e7a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:03.757606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98a5a0df-2e1b-498c-98b3-c9e06a224e7a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:03.758308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98a5a0df-2e1b-498c-98b3-c9e06a224e7a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:03.759390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98a5a0df-2e1b-498c-98b3-c9e06a224e7a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:03.761804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98a5a0df-2e1b-498c-98b3-c9e06a224e7a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:03.762819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98a5a0df-2e1b-498c-98b3-c9e06a224e7a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:04.235973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-98a5a0df-2e1b-498c-98b3-c9e06a224e7a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:04.237636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3add3d21-8dc8-4f15-ae9d-20453608dbf0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:04.244554 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-98a5a0df-2e1b-498c-98b3-c9e06a224e7a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1475 microversion: 2.1 time: 0.503013 Aug 18 11:38:04.245154 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1502/2915] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:03 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1475 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:38:04.260039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-eb5d72cb-da42-4516-8612-fe6982e366a8 req-6d232437-4efc-4b86-9c87-b8505f8e908d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd", "tag": "00724f9e-9d67-4b16-bdb4-8f9550b2f963"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:04.287264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eb5d72cb-da42-4516-8612-fe6982e366a8 req-6d232437-4efc-4b86-9c87-b8505f8e908d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:04.288617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eb5d72cb-da42-4516-8612-fe6982e366a8 req-6d232437-4efc-4b86-9c87-b8505f8e908d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:04.295337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eb5d72cb-da42-4516-8612-fe6982e366a8 req-6d232437-4efc-4b86-9c87-b8505f8e908d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:04.297168 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3add3d21-8dc8-4f15-ae9d-20453608dbf0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1314 microversion: 2.1 time: 1.257042 Aug 18 11:38:04.312753 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1414/2916] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:03 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1314 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:04.325597 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-eb5d72cb-da42-4516-8612-fe6982e366a8 req-6d232437-4efc-4b86-9c87-b8505f8e908d service nova] Creating event network-changed:00724f9e-9d67-4b16-bdb4-8f9550b2f963 for instance 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd on n-h2-853611-3 Aug 18 11:38:04.331853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-71088531-0b2c-430f-a5cd-7a222d436878 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:04.335226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-71088531-0b2c-430f-a5cd-7a222d436878 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:04.348926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71088531-0b2c-430f-a5cd-7a222d436878 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:04.351854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71088531-0b2c-430f-a5cd-7a222d436878 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:04.352559 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71088531-0b2c-430f-a5cd-7a222d436878 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:04.356062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71088531-0b2c-430f-a5cd-7a222d436878 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:04.356973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-eb5d72cb-da42-4516-8612-fe6982e366a8 req-6d232437-4efc-4b86-9c87-b8505f8e908d service nova] Instance 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 11:38:04.357102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71088531-0b2c-430f-a5cd-7a222d436878 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:04.357864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71088531-0b2c-430f-a5cd-7a222d436878 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:04.404341 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-eb5d72cb-da42-4516-8612-fe6982e366a8 req-6d232437-4efc-4b86-9c87-b8505f8e908d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157916 Aug 18 11:38:04.405277 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1503/2917] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:04.420883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a17112f5-920d-46e7-8ef2-e86cdf50ff46 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:04.425782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a17112f5-920d-46e7-8ef2-e86cdf50ff46 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:04.446073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a17112f5-920d-46e7-8ef2-e86cdf50ff46 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:04.447239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a17112f5-920d-46e7-8ef2-e86cdf50ff46 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:04.449326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a17112f5-920d-46e7-8ef2-e86cdf50ff46 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:04.453533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a17112f5-920d-46e7-8ef2-e86cdf50ff46 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:04.455110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a17112f5-920d-46e7-8ef2-e86cdf50ff46 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:04.457757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a17112f5-920d-46e7-8ef2-e86cdf50ff46 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:04.782078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-71088531-0b2c-430f-a5cd-7a222d436878 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:04.800354 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-71088531-0b2c-430f-a5cd-7a222d436878 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1402 microversion: 2.1 time: 0.486167 Aug 18 11:38:04.808639 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1415/2918] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:04 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1402 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:04.827258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-2776d698-10a1-4955-8a72-0dda4f888e1c req-6d7ced9f-ad38-44fa-87f6-e799d2d8d979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89052d85-6a54-433c-8b86-88e2835c2f28", "name": "network-vif-plugged", "status": "completed", "tag": "6b64a832-bb8d-4ca3-9d19-22572472748b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:04.839333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2776d698-10a1-4955-8a72-0dda4f888e1c req-6d7ced9f-ad38-44fa-87f6-e799d2d8d979 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:04.840223 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2776d698-10a1-4955-8a72-0dda4f888e1c req-6d7ced9f-ad38-44fa-87f6-e799d2d8d979 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:04.840827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2776d698-10a1-4955-8a72-0dda4f888e1c req-6d7ced9f-ad38-44fa-87f6-e799d2d8d979 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:04.854693 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-2776d698-10a1-4955-8a72-0dda4f888e1c req-6d7ced9f-ad38-44fa-87f6-e799d2d8d979 service nova] Creating event network-vif-plugged:6b64a832-bb8d-4ca3-9d19-22572472748b for instance 89052d85-6a54-433c-8b86-88e2835c2f28 on n-h2-853611-3 Aug 18 11:38:04.860105 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-2776d698-10a1-4955-8a72-0dda4f888e1c req-6d7ced9f-ad38-44fa-87f6-e799d2d8d979 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048478 Aug 18 11:38:04.861232 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1416/2919] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:04.867314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7561ebb6-435d-4988-b871-fb9b846b6cdb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:04.868268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7561ebb6-435d-4988-b871-fb9b846b6cdb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:04.875353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7561ebb6-435d-4988-b871-fb9b846b6cdb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:04.876315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7561ebb6-435d-4988-b871-fb9b846b6cdb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:04.877469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7561ebb6-435d-4988-b871-fb9b846b6cdb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:04.878550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7561ebb6-435d-4988-b871-fb9b846b6cdb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:04.879469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7561ebb6-435d-4988-b871-fb9b846b6cdb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:04.880072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7561ebb6-435d-4988-b871-fb9b846b6cdb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:05.057731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a17112f5-920d-46e7-8ef2-e86cdf50ff46 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:05.078895 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a17112f5-920d-46e7-8ef2-e86cdf50ff46 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1479 microversion: 2.1 time: 0.667410 Aug 18 11:38:05.097594 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1504/2920] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:04 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1479 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:05.284552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c22b01b-b24a-4e1f-9ada-71de7cf267af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:05.285637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c22b01b-b24a-4e1f-9ada-71de7cf267af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:05.303894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c22b01b-b24a-4e1f-9ada-71de7cf267af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:05.306915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c22b01b-b24a-4e1f-9ada-71de7cf267af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:05.311161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c22b01b-b24a-4e1f-9ada-71de7cf267af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:05.312663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c22b01b-b24a-4e1f-9ada-71de7cf267af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:05.317326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c22b01b-b24a-4e1f-9ada-71de7cf267af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:05.319232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c22b01b-b24a-4e1f-9ada-71de7cf267af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:05.323242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7561ebb6-435d-4988-b871-fb9b846b6cdb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:05.341596 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7561ebb6-435d-4988-b871-fb9b846b6cdb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1520 microversion: 2.1 time: 0.478958 Aug 18 11:38:05.351470 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1417/2921] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:04 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1520 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:05.371063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-31c200b1-c879-402b-bfc8-9d752cf3a8e8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:05.371695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-31c200b1-c879-402b-bfc8-9d752cf3a8e8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:05.394069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31c200b1-c879-402b-bfc8-9d752cf3a8e8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:05.397935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31c200b1-c879-402b-bfc8-9d752cf3a8e8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:05.398680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31c200b1-c879-402b-bfc8-9d752cf3a8e8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:05.399453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31c200b1-c879-402b-bfc8-9d752cf3a8e8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:05.399931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31c200b1-c879-402b-bfc8-9d752cf3a8e8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:05.404982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31c200b1-c879-402b-bfc8-9d752cf3a8e8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:05.782916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9c22b01b-b24a-4e1f-9ada-71de7cf267af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:05.793812 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c22b01b-b24a-4e1f-9ada-71de7cf267af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1473 microversion: 2.1 time: 0.525742 Aug 18 11:38:05.794773 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1505/2922] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:05 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1473 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:05.829839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a901896-3c95-4fa6-85e5-d4b691037cf1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:05.831444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6a901896-3c95-4fa6-85e5-d4b691037cf1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:05.853440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a901896-3c95-4fa6-85e5-d4b691037cf1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:05.856114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a901896-3c95-4fa6-85e5-d4b691037cf1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:05.856680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a901896-3c95-4fa6-85e5-d4b691037cf1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:05.857435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a901896-3c95-4fa6-85e5-d4b691037cf1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:05.857900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a901896-3c95-4fa6-85e5-d4b691037cf1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:05.858335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a901896-3c95-4fa6-85e5-d4b691037cf1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:05.872164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:05.973183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-31c200b1-c879-402b-bfc8-9d752cf3a8e8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:05.986971 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-31c200b1-c879-402b-bfc8-9d752cf3a8e8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1314 microversion: 2.1 time: 0.634057 Aug 18 11:38:05.987871 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1418/2923] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:05 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:06.124374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-889bc24e-35bb-4672-899e-fbc26020c10b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:06.125229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-889bc24e-35bb-4672-899e-fbc26020c10b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:06.144767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-889bc24e-35bb-4672-899e-fbc26020c10b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:06.145539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-889bc24e-35bb-4672-899e-fbc26020c10b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:06.146255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-889bc24e-35bb-4672-899e-fbc26020c10b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:06.147830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-889bc24e-35bb-4672-899e-fbc26020c10b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:06.148604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-889bc24e-35bb-4672-899e-fbc26020c10b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:06.149249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-889bc24e-35bb-4672-899e-fbc26020c10b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:06.342932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6a901896-3c95-4fa6-85e5-d4b691037cf1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:06.358114 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6a901896-3c95-4fa6-85e5-d4b691037cf1 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1402 microversion: 2.1 time: 0.532608 Aug 18 11:38:06.358997 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1506/2924] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:05 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1402 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:06.383303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d12eff1d-ac9d-4c8f-ac41-8b277093bd58 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:06.383484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d12eff1d-ac9d-4c8f-ac41-8b277093bd58 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:06.398050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d12eff1d-ac9d-4c8f-ac41-8b277093bd58 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:06.398881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d12eff1d-ac9d-4c8f-ac41-8b277093bd58 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:06.399343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d12eff1d-ac9d-4c8f-ac41-8b277093bd58 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:06.400086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d12eff1d-ac9d-4c8f-ac41-8b277093bd58 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:06.400556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d12eff1d-ac9d-4c8f-ac41-8b277093bd58 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:06.400988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d12eff1d-ac9d-4c8f-ac41-8b277093bd58 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:06.708211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d12eff1d-ac9d-4c8f-ac41-8b277093bd58 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:06.719841 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d12eff1d-ac9d-4c8f-ac41-8b277093bd58 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1520 microversion: 2.1 time: 0.345806 Aug 18 11:38:06.721462 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1507/2925] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:06 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1520 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:06.751130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-889bc24e-35bb-4672-899e-fbc26020c10b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:06.763982 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-889bc24e-35bb-4672-899e-fbc26020c10b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1464 microversion: 2.1 time: 0.641858 Aug 18 11:38:06.764950 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1419/2926] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:06 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1464 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:38:06.805881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4cbc0eaf-62fc-44bf-8242-d06529330aca tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:06.808788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4cbc0eaf-62fc-44bf-8242-d06529330aca tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:06.821742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9931ae62-b478-436d-b950-cdca4da6c83d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:06.822988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9931ae62-b478-436d-b950-cdca4da6c83d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:06.838196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cbc0eaf-62fc-44bf-8242-d06529330aca tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:06.839647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9931ae62-b478-436d-b950-cdca4da6c83d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:06.842811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9931ae62-b478-436d-b950-cdca4da6c83d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:06.843680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9931ae62-b478-436d-b950-cdca4da6c83d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:06.844640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cbc0eaf-62fc-44bf-8242-d06529330aca tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:06.845397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9931ae62-b478-436d-b950-cdca4da6c83d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:06.845872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9931ae62-b478-436d-b950-cdca4da6c83d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:06.846300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9931ae62-b478-436d-b950-cdca4da6c83d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:06.853602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cbc0eaf-62fc-44bf-8242-d06529330aca tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:06.854394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cbc0eaf-62fc-44bf-8242-d06529330aca tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:06.854903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cbc0eaf-62fc-44bf-8242-d06529330aca tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:06.855344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cbc0eaf-62fc-44bf-8242-d06529330aca tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:07.056754 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4cbc0eaf-62fc-44bf-8242-d06529330aca tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831/action" status: 202 len: 0 microversion: 2.1 time: 0.254862 Aug 18 11:38:07.060628 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1508/2927] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:38:06 2022] POST /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:38:07.063637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bf88d815-d289-414e-a363-275401eb40ee tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:07.064267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bf88d815-d289-414e-a363-275401eb40ee tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:07.088808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf88d815-d289-414e-a363-275401eb40ee tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:07.089542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf88d815-d289-414e-a363-275401eb40ee tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:07.090185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf88d815-d289-414e-a363-275401eb40ee tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:07.091197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf88d815-d289-414e-a363-275401eb40ee tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:07.091838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf88d815-d289-414e-a363-275401eb40ee tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:07.092510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf88d815-d289-414e-a363-275401eb40ee tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:07.430862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bf88d815-d289-414e-a363-275401eb40ee tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:07.442122 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bf88d815-d289-414e-a363-275401eb40ee tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1314 microversion: 2.1 time: 0.383015 Aug 18 11:38:07.443181 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1509/2928] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:07 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:07.464727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7148a99c-6137-485f-aef8-fdffb3c88c40 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:07.466666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7148a99c-6137-485f-aef8-fdffb3c88c40 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:07.481307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7148a99c-6137-485f-aef8-fdffb3c88c40 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:07.482097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7148a99c-6137-485f-aef8-fdffb3c88c40 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:07.483068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7148a99c-6137-485f-aef8-fdffb3c88c40 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:07.483987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7148a99c-6137-485f-aef8-fdffb3c88c40 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:07.484669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7148a99c-6137-485f-aef8-fdffb3c88c40 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:07.485257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7148a99c-6137-485f-aef8-fdffb3c88c40 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:07.517185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9931ae62-b478-436d-b950-cdca4da6c83d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:07.532499 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9931ae62-b478-436d-b950-cdca4da6c83d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1473 microversion: 2.1 time: 0.715963 Aug 18 11:38:07.536541 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1420/2929] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:06 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1473 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:38:07.559473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3ec2673c-589c-4abd-9b53-bc82fa12045f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:07.560101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3ec2673c-589c-4abd-9b53-bc82fa12045f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:07.575011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7148a99c-6137-485f-aef8-fdffb3c88c40 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:07.575845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7148a99c-6137-485f-aef8-fdffb3c88c40 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:07.576449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7148a99c-6137-485f-aef8-fdffb3c88c40 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:07.577072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-7148a99c-6137-485f-aef8-fdffb3c88c40 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lazy-loading 'fault' on Instance uuid 5aee369f-2ece-4b53-a7db-efe946936831 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:38:07.602602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3ec2673c-589c-4abd-9b53-bc82fa12045f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:07.611321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3ec2673c-589c-4abd-9b53-bc82fa12045f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:07.614080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3ec2673c-589c-4abd-9b53-bc82fa12045f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:07.614786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3ec2673c-589c-4abd-9b53-bc82fa12045f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:07.615274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3ec2673c-589c-4abd-9b53-bc82fa12045f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:07.615746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3ec2673c-589c-4abd-9b53-bc82fa12045f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:07.836601 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7148a99c-6137-485f-aef8-fdffb3c88c40 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1598 microversion: 2.1 time: 0.377469 Aug 18 11:38:07.836869 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1510/2930] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:07 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1598 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:07.842180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9dcec191-1766-4c9f-8fee-ba5ee51c6254 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:07.843201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9dcec191-1766-4c9f-8fee-ba5ee51c6254 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:07.861944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9dcec191-1766-4c9f-8fee-ba5ee51c6254 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:07.862939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9dcec191-1766-4c9f-8fee-ba5ee51c6254 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:07.863631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9dcec191-1766-4c9f-8fee-ba5ee51c6254 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:07.864800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9dcec191-1766-4c9f-8fee-ba5ee51c6254 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:07.866422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9dcec191-1766-4c9f-8fee-ba5ee51c6254 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:07.867089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9dcec191-1766-4c9f-8fee-ba5ee51c6254 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:08.117699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9dcec191-1766-4c9f-8fee-ba5ee51c6254 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:08.127334 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9dcec191-1766-4c9f-8fee-ba5ee51c6254 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1520 microversion: 2.1 time: 0.288756 Aug 18 11:38:08.141796 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1511/2931] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:07 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:08.141796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a29fea04-4ff1-4975-ba00-239a214ce83b tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:08.141796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a29fea04-4ff1-4975-ba00-239a214ce83b tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:08.144054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a29fea04-4ff1-4975-ba00-239a214ce83b tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:08.144801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a29fea04-4ff1-4975-ba00-239a214ce83b tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:08.145388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a29fea04-4ff1-4975-ba00-239a214ce83b tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:08.146252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a29fea04-4ff1-4975-ba00-239a214ce83b tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:08.147985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a29fea04-4ff1-4975-ba00-239a214ce83b tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:08.148603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a29fea04-4ff1-4975-ba00-239a214ce83b tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:08.278138 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a29fea04-4ff1-4975-ba00-239a214ce83b tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831/action" status: 202 len: 0 microversion: 2.1 time: 0.148410 Aug 18 11:38:08.278955 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1512/2932] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:38:08 2022] POST /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:38:08.288586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59bf2c31-6140-4822-a59c-60ddbf26b3a6 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:08.289606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59bf2c31-6140-4822-a59c-60ddbf26b3a6 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:08.304300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59bf2c31-6140-4822-a59c-60ddbf26b3a6 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:08.305201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59bf2c31-6140-4822-a59c-60ddbf26b3a6 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:08.305880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59bf2c31-6140-4822-a59c-60ddbf26b3a6 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:08.306909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59bf2c31-6140-4822-a59c-60ddbf26b3a6 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:08.309675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59bf2c31-6140-4822-a59c-60ddbf26b3a6 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:08.310224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59bf2c31-6140-4822-a59c-60ddbf26b3a6 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:08.723462 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59bf2c31-6140-4822-a59c-60ddbf26b3a6 tempest-ServersAdminTestJSON-705991258 tempest-ServersAdminTestJSON-705991258-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1615 microversion: 2.1 time: 0.439290 Aug 18 11:38:08.733173 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1513/2933] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:08 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1615 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:38:08.750833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-415e7dfc-e8ce-4070-8339-ab3591128d28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:08.762467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-415e7dfc-e8ce-4070-8339-ab3591128d28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:08.776848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-415e7dfc-e8ce-4070-8339-ab3591128d28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:08.778601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-415e7dfc-e8ce-4070-8339-ab3591128d28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:08.779396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-415e7dfc-e8ce-4070-8339-ab3591128d28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:08.780177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-415e7dfc-e8ce-4070-8339-ab3591128d28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:08.780659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-415e7dfc-e8ce-4070-8339-ab3591128d28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:08.786131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-415e7dfc-e8ce-4070-8339-ab3591128d28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:09.087644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-415e7dfc-e8ce-4070-8339-ab3591128d28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:09.097755 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-415e7dfc-e8ce-4070-8339-ab3591128d28 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1314 microversion: 2.1 time: 0.362746 Aug 18 11:38:09.117650 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1514/2934] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:08 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:09.123469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a31b79ed-4339-4e99-a995-cbdf8591a005 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:09.124406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a31b79ed-4339-4e99-a995-cbdf8591a005 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:09.133509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a31b79ed-4339-4e99-a995-cbdf8591a005 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:09.134301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a31b79ed-4339-4e99-a995-cbdf8591a005 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:09.134923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a31b79ed-4339-4e99-a995-cbdf8591a005 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:09.135803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a31b79ed-4339-4e99-a995-cbdf8591a005 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:09.141072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a31b79ed-4339-4e99-a995-cbdf8591a005 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:09.141867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a31b79ed-4339-4e99-a995-cbdf8591a005 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:09.411574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a31b79ed-4339-4e99-a995-cbdf8591a005 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:09.442296 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a31b79ed-4339-4e99-a995-cbdf8591a005 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1470 microversion: 2.1 time: 0.323161 Aug 18 11:38:09.442950 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1515/2935] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:09 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1470 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:09.471013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-e753649f-dca4-4309-b8af-eaab9bfdae18 req-cf45f751-5b5f-4338-913a-340d13107dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7270699d-e0c4-4276-b522-8aee7925f99b", "name": "network-vif-plugged", "status": "completed", "tag": "a9cec86b-72ec-4294-9b6c-597cc6c33d0c"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:09.497055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e753649f-dca4-4309-b8af-eaab9bfdae18 req-cf45f751-5b5f-4338-913a-340d13107dfe service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:09.497612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e753649f-dca4-4309-b8af-eaab9bfdae18 req-cf45f751-5b5f-4338-913a-340d13107dfe service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:09.498110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e753649f-dca4-4309-b8af-eaab9bfdae18 req-cf45f751-5b5f-4338-913a-340d13107dfe service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:09.517417 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e753649f-dca4-4309-b8af-eaab9bfdae18 req-cf45f751-5b5f-4338-913a-340d13107dfe service nova] Creating event network-vif-plugged:a9cec86b-72ec-4294-9b6c-597cc6c33d0c for instance 7270699d-e0c4-4276-b522-8aee7925f99b on n-h2-853611-3 Aug 18 11:38:09.527350 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-e753649f-dca4-4309-b8af-eaab9bfdae18 req-cf45f751-5b5f-4338-913a-340d13107dfe service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058708 Aug 18 11:38:09.528708 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1516/2936] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:09.557455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2bf57751-7b58-4896-a808-9af5bd362a33 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:09.564001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2bf57751-7b58-4896-a808-9af5bd362a33 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:09.590134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bf57751-7b58-4896-a808-9af5bd362a33 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:09.593799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bf57751-7b58-4896-a808-9af5bd362a33 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:09.598391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bf57751-7b58-4896-a808-9af5bd362a33 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:09.599564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bf57751-7b58-4896-a808-9af5bd362a33 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:09.601400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bf57751-7b58-4896-a808-9af5bd362a33 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:09.602258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bf57751-7b58-4896-a808-9af5bd362a33 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:09.660735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2bf57751-7b58-4896-a808-9af5bd362a33 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:38:09.693153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3ec2673c-589c-4abd-9b53-bc82fa12045f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:09.704429 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3ec2673c-589c-4abd-9b53-bc82fa12045f tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1402 microversion: 2.1 time: 2.162968 Aug 18 11:38:09.722886 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1421/2937] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:07 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1402 bytes in 2186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:09.732363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-caff45cd-de34-43ab-baed-f85f7807c609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:09.736760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-caff45cd-de34-43ab-baed-f85f7807c609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:09.745402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-caff45cd-de34-43ab-baed-f85f7807c609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:09.746370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-caff45cd-de34-43ab-baed-f85f7807c609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:09.747183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-caff45cd-de34-43ab-baed-f85f7807c609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:09.748143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-caff45cd-de34-43ab-baed-f85f7807c609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:09.748839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-caff45cd-de34-43ab-baed-f85f7807c609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:09.749536 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-caff45cd-de34-43ab-baed-f85f7807c609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:09.978286 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2bf57751-7b58-4896-a808-9af5bd362a33 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 204 len: 0 microversion: 2.1 time: 0.447210 Aug 18 11:38:09.979263 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1517/2938] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:38:09 2022] DELETE /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:38:09.993138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d35cc342-755d-4c5a-af45-f83a9c61b43a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:09.995730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d35cc342-755d-4c5a-af45-f83a9c61b43a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:10.011162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:10.013073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d35cc342-755d-4c5a-af45-f83a9c61b43a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:10.013716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d35cc342-755d-4c5a-af45-f83a9c61b43a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:10.014282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d35cc342-755d-4c5a-af45-f83a9c61b43a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:10.018654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d35cc342-755d-4c5a-af45-f83a9c61b43a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:10.019043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d35cc342-755d-4c5a-af45-f83a9c61b43a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:10.019485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d35cc342-755d-4c5a-af45-f83a9c61b43a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:10.069416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:10.220431 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d35cc342-755d-4c5a-af45-f83a9c61b43a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "POST /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd/action" status: 204 len: 0 microversion: 2.1 time: 0.239519 Aug 18 11:38:10.221395 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1518/2939] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:38:09 2022] POST /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd/action => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:38:10.251138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1261f9db-1229-452e-b020-932c9fdfd36b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:10.256110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1261f9db-1229-452e-b020-932c9fdfd36b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:10.265962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1261f9db-1229-452e-b020-932c9fdfd36b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:10.267179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1261f9db-1229-452e-b020-932c9fdfd36b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:10.268935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1261f9db-1229-452e-b020-932c9fdfd36b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:10.270859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1261f9db-1229-452e-b020-932c9fdfd36b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:10.272658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1261f9db-1229-452e-b020-932c9fdfd36b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:10.274110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1261f9db-1229-452e-b020-932c9fdfd36b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:10.751383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-caff45cd-de34-43ab-baed-f85f7807c609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:10.775436 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-caff45cd-de34-43ab-baed-f85f7807c609 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1520 microversion: 2.1 time: 1.050727 Aug 18 11:38:10.797224 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1422/2940] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:09 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1520 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:10.820466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3b363477-3b64-49b6-abef-816fa911e3b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:10.821399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3b363477-3b64-49b6-abef-816fa911e3b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:10.841789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b363477-3b64-49b6-abef-816fa911e3b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:10.845337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b363477-3b64-49b6-abef-816fa911e3b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:10.848087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b363477-3b64-49b6-abef-816fa911e3b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:10.850629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b363477-3b64-49b6-abef-816fa911e3b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:10.853042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b363477-3b64-49b6-abef-816fa911e3b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:10.853755 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b363477-3b64-49b6-abef-816fa911e3b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:11.096305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1261f9db-1229-452e-b020-932c9fdfd36b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:11.125669 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1261f9db-1229-452e-b020-932c9fdfd36b tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1468 microversion: 2.1 time: 0.892449 Aug 18 11:38:11.127733 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1519/2941] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:10 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1468 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:11.140842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0200f69b-9dd6-4443-8386-456d2ab3bfee tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:11.158758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0200f69b-9dd6-4443-8386-456d2ab3bfee tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:11.174113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0200f69b-9dd6-4443-8386-456d2ab3bfee tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:11.181779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0200f69b-9dd6-4443-8386-456d2ab3bfee tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:11.182654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0200f69b-9dd6-4443-8386-456d2ab3bfee tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:11.186609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0200f69b-9dd6-4443-8386-456d2ab3bfee tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:11.187329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0200f69b-9dd6-4443-8386-456d2ab3bfee tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:11.188219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0200f69b-9dd6-4443-8386-456d2ab3bfee tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:11.455355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3b363477-3b64-49b6-abef-816fa911e3b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:11.464565 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3b363477-3b64-49b6-abef-816fa911e3b4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1314 microversion: 2.1 time: 0.657913 Aug 18 11:38:11.465043 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1423/2942] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:10 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:11.492148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3b2ec6ad-081f-4bd1-83cc-2fe1c21617a2 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:11.494003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3b2ec6ad-081f-4bd1-83cc-2fe1c21617a2 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:11.531167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b2ec6ad-081f-4bd1-83cc-2fe1c21617a2 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:11.531949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b2ec6ad-081f-4bd1-83cc-2fe1c21617a2 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:11.533261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b2ec6ad-081f-4bd1-83cc-2fe1c21617a2 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:11.535726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b2ec6ad-081f-4bd1-83cc-2fe1c21617a2 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:11.536208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b2ec6ad-081f-4bd1-83cc-2fe1c21617a2 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:11.536645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b2ec6ad-081f-4bd1-83cc-2fe1c21617a2 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:12.380410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0200f69b-9dd6-4443-8386-456d2ab3bfee tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:12.400202 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0200f69b-9dd6-4443-8386-456d2ab3bfee tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1470 microversion: 2.1 time: 1.271100 Aug 18 11:38:12.402073 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1520/2943] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:11 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1470 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:12.417805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3b2ec6ad-081f-4bd1-83cc-2fe1c21617a2 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:12.431441 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3b2ec6ad-081f-4bd1-83cc-2fe1c21617a2 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1588 microversion: 2.1 time: 0.961601 Aug 18 11:38:12.435598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-126e2ba2-a81a-49fc-b3f3-aad5ee1643b0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:12.435899 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1424/2944] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:11 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1588 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:12.439299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-126e2ba2-a81a-49fc-b3f3-aad5ee1643b0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:12.452334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-18531bb7-df7e-49bf-a552-be7df411698e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:12.453724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-18531bb7-df7e-49bf-a552-be7df411698e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:12.466591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-126e2ba2-a81a-49fc-b3f3-aad5ee1643b0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:12.468097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-126e2ba2-a81a-49fc-b3f3-aad5ee1643b0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:12.469418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-126e2ba2-a81a-49fc-b3f3-aad5ee1643b0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:12.472974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-126e2ba2-a81a-49fc-b3f3-aad5ee1643b0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:12.474272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-126e2ba2-a81a-49fc-b3f3-aad5ee1643b0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:12.475917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-126e2ba2-a81a-49fc-b3f3-aad5ee1643b0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:12.476552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18531bb7-df7e-49bf-a552-be7df411698e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:12.486639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18531bb7-df7e-49bf-a552-be7df411698e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:12.488777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18531bb7-df7e-49bf-a552-be7df411698e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:12.489864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18531bb7-df7e-49bf-a552-be7df411698e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:12.491900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18531bb7-df7e-49bf-a552-be7df411698e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:12.492614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-18531bb7-df7e-49bf-a552-be7df411698e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:12.782407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-126e2ba2-a81a-49fc-b3f3-aad5ee1643b0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:12.793707 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-126e2ba2-a81a-49fc-b3f3-aad5ee1643b0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1520 microversion: 2.1 time: 0.390236 Aug 18 11:38:12.808090 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1521/2945] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:12 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1520 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:12.808090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-22d8a095-5a87-4de1-921c-74934645577b tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:12.808090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-22d8a095-5a87-4de1-921c-74934645577b tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:12.809755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22d8a095-5a87-4de1-921c-74934645577b tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:12.810265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22d8a095-5a87-4de1-921c-74934645577b tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:12.810732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22d8a095-5a87-4de1-921c-74934645577b tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:12.811450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22d8a095-5a87-4de1-921c-74934645577b tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:12.811912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22d8a095-5a87-4de1-921c-74934645577b tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:12.812370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22d8a095-5a87-4de1-921c-74934645577b tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:12.969775 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-22d8a095-5a87-4de1-921c-74934645577b tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173617 Aug 18 11:38:12.970375 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1522/2946] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:38:12 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:12.976363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d2aaa43d-0f3a-4799-8afe-2d11d7afe184 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:12.977254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d2aaa43d-0f3a-4799-8afe-2d11d7afe184 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:12.996521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2aaa43d-0f3a-4799-8afe-2d11d7afe184 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:12.997026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2aaa43d-0f3a-4799-8afe-2d11d7afe184 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:12.997467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2aaa43d-0f3a-4799-8afe-2d11d7afe184 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:12.998187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2aaa43d-0f3a-4799-8afe-2d11d7afe184 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:13.001842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2aaa43d-0f3a-4799-8afe-2d11d7afe184 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:13.002309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2aaa43d-0f3a-4799-8afe-2d11d7afe184 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:13.361595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2aaa43d-0f3a-4799-8afe-2d11d7afe184 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:13.379847 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d2aaa43d-0f3a-4799-8afe-2d11d7afe184 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1501 microversion: 2.1 time: 0.407819 Aug 18 11:38:13.384216 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1523/2947] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:12 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1501 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:13.415151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a3a2c088-db30-4ab5-a9f9-a6c38668cf4d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:13.417053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a3a2c088-db30-4ab5-a9f9-a6c38668cf4d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:13.441122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3a2c088-db30-4ab5-a9f9-a6c38668cf4d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:13.441688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3a2c088-db30-4ab5-a9f9-a6c38668cf4d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:13.442364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3a2c088-db30-4ab5-a9f9-a6c38668cf4d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:13.443571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3a2c088-db30-4ab5-a9f9-a6c38668cf4d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:13.444210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3a2c088-db30-4ab5-a9f9-a6c38668cf4d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:13.444796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3a2c088-db30-4ab5-a9f9-a6c38668cf4d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:13.449084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-18531bb7-df7e-49bf-a552-be7df411698e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:13.470859 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-18531bb7-df7e-49bf-a552-be7df411698e tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1468 microversion: 2.1 time: 1.032614 Aug 18 11:38:13.473541 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1425/2948] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:12 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1468 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:13.485521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e432fbdb-581a-4c68-8e1f-e56a63e0b25d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:13.495709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e432fbdb-581a-4c68-8e1f-e56a63e0b25d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:13.514746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e432fbdb-581a-4c68-8e1f-e56a63e0b25d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:13.518351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e432fbdb-581a-4c68-8e1f-e56a63e0b25d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:13.521007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e432fbdb-581a-4c68-8e1f-e56a63e0b25d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:13.524706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e432fbdb-581a-4c68-8e1f-e56a63e0b25d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:13.527152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e432fbdb-581a-4c68-8e1f-e56a63e0b25d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:13.528427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e432fbdb-581a-4c68-8e1f-e56a63e0b25d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:14.067567 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.network.security_group_api [None req-a3a2c088-db30-4ab5-a9f9-a6c38668cf4d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Removing security group f396f2aa-4beb-43fd-aec0-9a7c6bbde064 from port a9cec86b-72ec-4294-9b6c-597cc6c33d0c Aug 18 11:38:14.422574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e432fbdb-581a-4c68-8e1f-e56a63e0b25d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:14.434977 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e432fbdb-581a-4c68-8e1f-e56a63e0b25d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1462 microversion: 2.1 time: 0.956736 Aug 18 11:38:14.454002 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1426/2949] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:13 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1462 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:14.454002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c209526e-46f7-4887-bf67-57f55d6fc99a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:14.454002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c209526e-46f7-4887-bf67-57f55d6fc99a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:14.468108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c209526e-46f7-4887-bf67-57f55d6fc99a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:14.468909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c209526e-46f7-4887-bf67-57f55d6fc99a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:14.469426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c209526e-46f7-4887-bf67-57f55d6fc99a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:14.471697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c209526e-46f7-4887-bf67-57f55d6fc99a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:14.473735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c209526e-46f7-4887-bf67-57f55d6fc99a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:14.474784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c209526e-46f7-4887-bf67-57f55d6fc99a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:15.140112 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a3a2c088-db30-4ab5-a9f9-a6c38668cf4d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b/action" status: 202 len: 0 microversion: 2.1 time: 1.734997 Aug 18 11:38:15.141328 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1524/2950] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:38:13 2022] POST /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b/action => generated 0 bytes in 1738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:38:15.146314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08e4f79d-4805-4814-bedb-908d81f8786c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:15.147373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-08e4f79d-4805-4814-bedb-908d81f8786c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:15.163297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e4f79d-4805-4814-bedb-908d81f8786c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:15.176642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e4f79d-4805-4814-bedb-908d81f8786c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:15.177971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e4f79d-4805-4814-bedb-908d81f8786c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:15.180688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e4f79d-4805-4814-bedb-908d81f8786c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:15.192023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e4f79d-4805-4814-bedb-908d81f8786c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:15.202147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e4f79d-4805-4814-bedb-908d81f8786c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:15.376267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c209526e-46f7-4887-bf67-57f55d6fc99a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:15.405293 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c209526e-46f7-4887-bf67-57f55d6fc99a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1520 microversion: 2.1 time: 0.965276 Aug 18 11:38:15.424258 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1427/2951] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:14 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1520 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:15.442589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fddc95a1-77db-4657-9a14-bf5ee97e22ad tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:15.443232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fddc95a1-77db-4657-9a14-bf5ee97e22ad tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:15.463701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fddc95a1-77db-4657-9a14-bf5ee97e22ad tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:15.464352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fddc95a1-77db-4657-9a14-bf5ee97e22ad tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:15.468394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fddc95a1-77db-4657-9a14-bf5ee97e22ad tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:15.473579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fddc95a1-77db-4657-9a14-bf5ee97e22ad tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:15.474647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fddc95a1-77db-4657-9a14-bf5ee97e22ad tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:15.475109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fddc95a1-77db-4657-9a14-bf5ee97e22ad tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:15.561619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-08e4f79d-4805-4814-bedb-908d81f8786c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:15.583321 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-08e4f79d-4805-4814-bedb-908d81f8786c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1462 microversion: 2.1 time: 0.439598 Aug 18 11:38:15.593234 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1525/2952] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:15 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1462 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:15.602178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7b4bdd68-f976-4e50-8113-80a999a3b9a6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:15.603439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7b4bdd68-f976-4e50-8113-80a999a3b9a6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:15.632403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b4bdd68-f976-4e50-8113-80a999a3b9a6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:15.632910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b4bdd68-f976-4e50-8113-80a999a3b9a6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:15.633359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b4bdd68-f976-4e50-8113-80a999a3b9a6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:15.634081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b4bdd68-f976-4e50-8113-80a999a3b9a6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:15.641546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b4bdd68-f976-4e50-8113-80a999a3b9a6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:15.642150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b4bdd68-f976-4e50-8113-80a999a3b9a6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:15.774974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fddc95a1-77db-4657-9a14-bf5ee97e22ad tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:15.792881 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fddc95a1-77db-4657-9a14-bf5ee97e22ad tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 200 len: 1426 microversion: 2.1 time: 0.367225 Aug 18 11:38:15.793600 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1428/2953] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:15 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 1426 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:15.820024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-618b7887-22c4-4030-8051-725f4e965a58 req-fa17ec84-bb8f-42e9-8c8f-1e4673ecbab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7270699d-e0c4-4276-b522-8aee7925f99b", "tag": "a9cec86b-72ec-4294-9b6c-597cc6c33d0c"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:15.843325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-618b7887-22c4-4030-8051-725f4e965a58 req-fa17ec84-bb8f-42e9-8c8f-1e4673ecbab1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:15.843817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-618b7887-22c4-4030-8051-725f4e965a58 req-fa17ec84-bb8f-42e9-8c8f-1e4673ecbab1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:15.844250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-618b7887-22c4-4030-8051-725f4e965a58 req-fa17ec84-bb8f-42e9-8c8f-1e4673ecbab1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:15.881130 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-618b7887-22c4-4030-8051-725f4e965a58 req-fa17ec84-bb8f-42e9-8c8f-1e4673ecbab1 service nova] Creating event network-changed:a9cec86b-72ec-4294-9b6c-597cc6c33d0c for instance 7270699d-e0c4-4276-b522-8aee7925f99b on n-h2-853611-3 Aug 18 11:38:15.892965 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-618b7887-22c4-4030-8051-725f4e965a58 req-fa17ec84-bb8f-42e9-8c8f-1e4673ecbab1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085002 Aug 18 11:38:15.894839 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1429/2954] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:15.907397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7b4bdd68-f976-4e50-8113-80a999a3b9a6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:15.929720 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7b4bdd68-f976-4e50-8113-80a999a3b9a6 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1459 microversion: 2.1 time: 0.334555 Aug 18 11:38:15.939582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-440079cb-a1db-46f8-99ee-9d447c1c66af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Action: 'create', calling method: .version_select at 0x7f519f7e1430>, body: {"keypair": {"name": "tempest-keypair-1728338481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqnoYEAYatWTNYTr04HxhWpEe2ZMcLCcC5reSgRLm9CrYm0FgNyHV4Fpwel2eMvrimaNfWFhZV7X3t7g0wUWLM05k2l0yXu1Xz+WsfqUixH+DS1syy/75SFhSDjMgAm2w=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:15.945639 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1526/2955] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:15 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1459 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:15.957410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5dd59c22-2dde-4028-b3b9-9281f95eaa44 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:15.959375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5dd59c22-2dde-4028-b3b9-9281f95eaa44 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:15.963365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-440079cb-a1db-46f8-99ee-9d447c1c66af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Getting quotas for project 6387896b424840deb9ef97aae02edd99. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:38:15.971875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-440079cb-a1db-46f8-99ee-9d447c1c66af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Getting quotas for user 9269fc4d233c42a590bfcbfaa7f2e895 and project 6387896b424840deb9ef97aae02edd99. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:38:15.980213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dd59c22-2dde-4028-b3b9-9281f95eaa44 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:15.980716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dd59c22-2dde-4028-b3b9-9281f95eaa44 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:15.981206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dd59c22-2dde-4028-b3b9-9281f95eaa44 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:15.981882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dd59c22-2dde-4028-b3b9-9281f95eaa44 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:15.982333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dd59c22-2dde-4028-b3b9-9281f95eaa44 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:15.982978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dd59c22-2dde-4028-b3b9-9281f95eaa44 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:16.007012 n-d-853611-3 devstack@n-api.service[122209]: ERROR oslo.messaging._drivers.impl_rabbit [None req-440079cb-a1db-46f8-99ee-9d447c1c66af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [dc51c71b-51c9-4b5b-b3c5-0629c3d44f8f] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 11:38:16.335765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5dd59c22-2dde-4028-b3b9-9281f95eaa44 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:16.347715 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5dd59c22-2dde-4028-b3b9-9281f95eaa44 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.399241 Aug 18 11:38:16.368098 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1527/2956] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:15 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:16.375678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fb204055-0dbb-45a8-a679-6a3e5e988b15 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:16.376574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fb204055-0dbb-45a8-a679-6a3e5e988b15 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:16.385710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb204055-0dbb-45a8-a679-6a3e5e988b15 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:16.386523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb204055-0dbb-45a8-a679-6a3e5e988b15 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:16.387153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb204055-0dbb-45a8-a679-6a3e5e988b15 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:16.390912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb204055-0dbb-45a8-a679-6a3e5e988b15 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:16.391778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb204055-0dbb-45a8-a679-6a3e5e988b15 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:16.392565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb204055-0dbb-45a8-a679-6a3e5e988b15 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:16.844326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fb204055-0dbb-45a8-a679-6a3e5e988b15 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:16.886047 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fb204055-0dbb-45a8-a679-6a3e5e988b15 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1588 microversion: 2.1 time: 0.516369 Aug 18 11:38:16.907618 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1528/2957] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:16 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1588 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:16.919503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-967c6a1a-a1d9-4c06-9bbd-e8d335e03681 req-fd41b1fe-a736-4b86-a08e-e2a78bb3d2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ade0e1d-521a-435b-bf64-c9b5da703862", "name": "network-vif-deleted", "tag": "d9b4162d-a9be-46e0-80ab-1abf1b8713e9"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:16.959622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-967c6a1a-a1d9-4c06-9bbd-e8d335e03681 req-fd41b1fe-a736-4b86-a08e-e2a78bb3d2a8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:16.963779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-967c6a1a-a1d9-4c06-9bbd-e8d335e03681 req-fd41b1fe-a736-4b86-a08e-e2a78bb3d2a8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:16.964960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-967c6a1a-a1d9-4c06-9bbd-e8d335e03681 req-fd41b1fe-a736-4b86-a08e-e2a78bb3d2a8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:16.997969 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-967c6a1a-a1d9-4c06-9bbd-e8d335e03681 req-fd41b1fe-a736-4b86-a08e-e2a78bb3d2a8 service nova] Creating event network-vif-deleted:d9b4162d-a9be-46e0-80ab-1abf1b8713e9 for instance 3ade0e1d-521a-435b-bf64-c9b5da703862 on n-h2-853611-3 Aug 18 11:38:17.011041 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-967c6a1a-a1d9-4c06-9bbd-e8d335e03681 req-fd41b1fe-a736-4b86-a08e-e2a78bb3d2a8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099778 Aug 18 11:38:17.015802 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1529/2958] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:17.018229 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [None req-440079cb-a1db-46f8-99ee-9d447c1c66af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [dc51c71b-51c9-4b5b-b3c5-0629c3d44f8f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58572. Aug 18 11:38:17.050796 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-440079cb-a1db-46f8-99ee-9d447c1c66af tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.154466 Aug 18 11:38:17.054259 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1430/2959] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:38:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:17.055506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-96534ac8-eaa7-48ea-b0dd-2dd95eedf3e9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:17.059668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-96534ac8-eaa7-48ea-b0dd-2dd95eedf3e9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:17.074937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4b6cd8d7-31ba-4eab-bb58-dc6c54b4b258 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:17.077989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4b6cd8d7-31ba-4eab-bb58-dc6c54b4b258 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:17.086576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96534ac8-eaa7-48ea-b0dd-2dd95eedf3e9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:17.088859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96534ac8-eaa7-48ea-b0dd-2dd95eedf3e9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:17.090668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96534ac8-eaa7-48ea-b0dd-2dd95eedf3e9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:17.092560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96534ac8-eaa7-48ea-b0dd-2dd95eedf3e9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:17.096200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96534ac8-eaa7-48ea-b0dd-2dd95eedf3e9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:17.099793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96534ac8-eaa7-48ea-b0dd-2dd95eedf3e9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:17.101696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b6cd8d7-31ba-4eab-bb58-dc6c54b4b258 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:17.105005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b6cd8d7-31ba-4eab-bb58-dc6c54b4b258 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:17.109739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b6cd8d7-31ba-4eab-bb58-dc6c54b4b258 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:17.111277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b6cd8d7-31ba-4eab-bb58-dc6c54b4b258 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:17.112729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b6cd8d7-31ba-4eab-bb58-dc6c54b4b258 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:17.116395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b6cd8d7-31ba-4eab-bb58-dc6c54b4b258 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:17.820366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4b6cd8d7-31ba-4eab-bb58-dc6c54b4b258 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:17.829862 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4b6cd8d7-31ba-4eab-bb58-dc6c54b4b258 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1520 microversion: 2.1 time: 0.772032 Aug 18 11:38:17.837356 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1431/2960] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:17 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1520 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:17.845843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-24d322be-8b68-4a90-a92c-fe285fe864aa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:17.859422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-24d322be-8b68-4a90-a92c-fe285fe864aa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 3ade0e1d-521a-435b-bf64-c9b5da703862] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:17.870262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:17.872133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-24d322be-8b68-4a90-a92c-fe285fe864aa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:17.876510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-24d322be-8b68-4a90-a92c-fe285fe864aa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:17.877189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-24d322be-8b68-4a90-a92c-fe285fe864aa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:17.879678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-24d322be-8b68-4a90-a92c-fe285fe864aa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:17.885936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-24d322be-8b68-4a90-a92c-fe285fe864aa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:17.890648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-24d322be-8b68-4a90-a92c-fe285fe864aa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:17.922704 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-24d322be-8b68-4a90-a92c-fe285fe864aa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] HTTP exception thrown: Instance 3ade0e1d-521a-435b-bf64-c9b5da703862 could not be found. Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-24d322be-8b68-4a90-a92c-fe285fe864aa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Request method failure captured: Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 HTTP/1.1 Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iQfg3Kg5wkLTEa5KD_ZPjKo6Wumr7AVow0sHmuUtWbPmFkwlKrNwhGjdZpK0GwscJJp4kKPmCTvTHkkNDUQ2b3Zu6gRdJDbQo0OLbeBTFor6QTntuUvKdbHej8rwxOsl1cKxiJWwycfNMirTZjJs2em76ljLlTLHCovAf-6XZsk-Vg Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 894e2bd813f444e9bb6075a02985e347 Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersAdminTestJSON-1808578324 Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/894e2bd813f444e9bb6075a02985e347"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/894e2bd813f444e9bb6075a02985e347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_894e2bd813f444e9bb6075a02985e347"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/894e2bd813f444e9bb6075a02985e347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersAdminTestJSON-1808578324 Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 894e2bd813f444e9bb6075a02985e347 Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersAdminTestJSON-1808578324 Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersAdminTestJSON-1808578324-project Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 44b470d4e29048bbbeb3c107f2ee42dc Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersAdminTestJSON-1808578324-project Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 3ade0e1d-521a-435b-bf64-c9b5da703862 could not be found. Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3ade0e1d-521a-435b-bf64-c9b5da703862'} Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ade0e1d-521a-435b-bf64-c9b5da703862 could not be found. Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ade0e1d-521a-435b-bf64-c9b5da703862 could not be found. Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:38:17.924597 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:38:17.928773 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:38:17.928773 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:38:17.928773 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:38:17.928773 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:38:17.928773 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:38:17.928773 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ade0e1d-521a-435b-bf64-c9b5da703862 could not be found. Aug 18 11:38:17.928773 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:38:17.932237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-24d322be-8b68-4a90-a92c-fe285fe864aa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Returning 404 to user: Instance 3ade0e1d-521a-435b-bf64-c9b5da703862 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:38:17.937187 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-24d322be-8b68-4a90-a92c-fe285fe864aa tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862" status: 404 len: 111 microversion: 2.1 time: 0.098423 Aug 18 11:38:17.937972 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1432/2961] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:17 2022] GET /compute/v2.1/servers/3ade0e1d-521a-435b-bf64-c9b5da703862 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:38:17.948514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-1a298092-2582-40f7-9cca-e63e36d9f907 req-11c956fa-dcac-4140-922b-ede114545bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd", "name": "network-vif-plugged", "status": "completed", "tag": "00724f9e-9d67-4b16-bdb4-8f9550b2f963"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:17.973657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1a298092-2582-40f7-9cca-e63e36d9f907 req-11c956fa-dcac-4140-922b-ede114545bd1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:17.982727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1a298092-2582-40f7-9cca-e63e36d9f907 req-11c956fa-dcac-4140-922b-ede114545bd1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:17.984196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1a298092-2582-40f7-9cca-e63e36d9f907 req-11c956fa-dcac-4140-922b-ede114545bd1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:18.007498 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-1a298092-2582-40f7-9cca-e63e36d9f907 req-11c956fa-dcac-4140-922b-ede114545bd1 service nova] Creating event network-vif-plugged:00724f9e-9d67-4b16-bdb4-8f9550b2f963 for instance 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd on n-h2-853611-3 Aug 18 11:38:18.021454 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-1a298092-2582-40f7-9cca-e63e36d9f907 req-11c956fa-dcac-4140-922b-ede114545bd1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081442 Aug 18 11:38:18.028092 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1433/2962] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:18.037903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4da967f4-bfcf-4a62-b831-46998d04a942 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:18.039048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4da967f4-bfcf-4a62-b831-46998d04a942 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:18.056965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4da967f4-bfcf-4a62-b831-46998d04a942 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:18.058038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4da967f4-bfcf-4a62-b831-46998d04a942 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:18.058731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4da967f4-bfcf-4a62-b831-46998d04a942 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:18.059707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4da967f4-bfcf-4a62-b831-46998d04a942 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:18.060404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4da967f4-bfcf-4a62-b831-46998d04a942 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:18.064816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4da967f4-bfcf-4a62-b831-46998d04a942 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:18.129948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4da967f4-bfcf-4a62-b831-46998d04a942 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:38:18.133781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:18.290310 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4da967f4-bfcf-4a62-b831-46998d04a942 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 204 len: 0 microversion: 2.1 time: 0.260307 Aug 18 11:38:18.291725 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1434/2963] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:38:18 2022] DELETE /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:38:18.305800 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-23bca606-c4d6-4776-a0ee-4c42db563a94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:18.306832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-23bca606-c4d6-4776-a0ee-4c42db563a94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:18.317324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23bca606-c4d6-4776-a0ee-4c42db563a94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:18.318410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23bca606-c4d6-4776-a0ee-4c42db563a94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:18.318917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23bca606-c4d6-4776-a0ee-4c42db563a94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:18.319756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23bca606-c4d6-4776-a0ee-4c42db563a94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:18.325919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23bca606-c4d6-4776-a0ee-4c42db563a94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:18.326714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23bca606-c4d6-4776-a0ee-4c42db563a94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:18.667782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-23bca606-c4d6-4776-a0ee-4c42db563a94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:18.678163 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-23bca606-c4d6-4776-a0ee-4c42db563a94 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1468 microversion: 2.1 time: 0.381716 Aug 18 11:38:18.698940 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1435/2964] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:18 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1468 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:18.715520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-76f9437d-789e-497a-b1d2-ebc8ef62c932 req-a8643ceb-715b-4086-84ec-aeea6e6a05ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89052d85-6a54-433c-8b86-88e2835c2f28", "tag": "6b64a832-bb8d-4ca3-9d19-22572472748b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:18.719202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-76f9437d-789e-497a-b1d2-ebc8ef62c932 req-a8643ceb-715b-4086-84ec-aeea6e6a05ed service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:18.725299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-76f9437d-789e-497a-b1d2-ebc8ef62c932 req-a8643ceb-715b-4086-84ec-aeea6e6a05ed service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:18.726251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-76f9437d-789e-497a-b1d2-ebc8ef62c932 req-a8643ceb-715b-4086-84ec-aeea6e6a05ed service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:18.758728 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-76f9437d-789e-497a-b1d2-ebc8ef62c932 req-a8643ceb-715b-4086-84ec-aeea6e6a05ed service nova] Creating event network-changed:6b64a832-bb8d-4ca3-9d19-22572472748b for instance 89052d85-6a54-433c-8b86-88e2835c2f28 on n-h2-853611-3 Aug 18 11:38:18.764188 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-76f9437d-789e-497a-b1d2-ebc8ef62c932 req-a8643ceb-715b-4086-84ec-aeea6e6a05ed service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063748 Aug 18 11:38:18.764964 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1436/2965] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:18.866038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-96534ac8-eaa7-48ea-b0dd-2dd95eedf3e9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:18.868133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7b0b22f1-c098-4696-b09b-9fb4bebc298b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:18.869180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7b0b22f1-c098-4696-b09b-9fb4bebc298b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:18.882382 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-96534ac8-eaa7-48ea-b0dd-2dd95eedf3e9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 1.849424 Aug 18 11:38:18.886223 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1530/2966] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:17 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:18.912675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b0b22f1-c098-4696-b09b-9fb4bebc298b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:18.913174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b5f2f53-cbea-4dde-9f73-0640c3f0ca94 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:18.913292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b0b22f1-c098-4696-b09b-9fb4bebc298b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:18.913676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b0b22f1-c098-4696-b09b-9fb4bebc298b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:18.914349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8b5f2f53-cbea-4dde-9f73-0640c3f0ca94 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:18.914488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b0b22f1-c098-4696-b09b-9fb4bebc298b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:18.914884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b0b22f1-c098-4696-b09b-9fb4bebc298b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:18.915311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b0b22f1-c098-4696-b09b-9fb4bebc298b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:18.929109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b5f2f53-cbea-4dde-9f73-0640c3f0ca94 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:18.938502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b5f2f53-cbea-4dde-9f73-0640c3f0ca94 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:18.939278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b5f2f53-cbea-4dde-9f73-0640c3f0ca94 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:18.946083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b5f2f53-cbea-4dde-9f73-0640c3f0ca94 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:18.946913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b5f2f53-cbea-4dde-9f73-0640c3f0ca94 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:18.947547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b5f2f53-cbea-4dde-9f73-0640c3f0ca94 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:19.363729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8b5f2f53-cbea-4dde-9f73-0640c3f0ca94 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:19.374551 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8b5f2f53-cbea-4dde-9f73-0640c3f0ca94 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.466836 Aug 18 11:38:19.387416 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1531/2967] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:18 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:38:19.690686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1302507228", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "ce8567ca-6e19-499c-8a23-37988a209b75"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:19.724660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7b0b22f1-c098-4696-b09b-9fb4bebc298b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:19.737547 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7b0b22f1-c098-4696-b09b-9fb4bebc298b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1520 microversion: 2.1 time: 0.878088 Aug 18 11:38:19.741277 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1437/2968] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:18 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1520 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:38:19.751714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bda003a6-7261-40e7-9c86-9c7346cf8bca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:19.752643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bda003a6-7261-40e7-9c86-9c7346cf8bca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:19.772532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bda003a6-7261-40e7-9c86-9c7346cf8bca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:19.775705 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bda003a6-7261-40e7-9c86-9c7346cf8bca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:19.778017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bda003a6-7261-40e7-9c86-9c7346cf8bca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:19.785570 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bda003a6-7261-40e7-9c86-9c7346cf8bca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:19.786623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bda003a6-7261-40e7-9c86-9c7346cf8bca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:19.788336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bda003a6-7261-40e7-9c86-9c7346cf8bca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:19.816781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] validate_networks() for [('ce8567ca-6e19-499c-8a23-37988a209b75', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:38:20.687316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bda003a6-7261-40e7-9c86-9c7346cf8bca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:20.712190 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bda003a6-7261-40e7-9c86-9c7346cf8bca tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.968890 Aug 18 11:38:20.713188 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1438/2969] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:19 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:20.732603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e2669b58-cd2e-4e14-b55c-a98224cc6688 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Action: 'create', calling method: .version_select at 0x7f51b0c54790>, body: {"keypair": {"name": "tempest-keypair-40434335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9z5UZBXTO3vz9O++ePSPWFW+SmqONv9FjcsWjrCr7ESjUvCvcaLcIr8oWooCdVaK/KPWingB3p7TCjXnihetd8Ieh6eayIwpBplCX2SWYXnNVIfkLrtlj3cqqzmkwkYQ=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:20.805397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-e2669b58-cd2e-4e14-b55c-a98224cc6688 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Getting quotas for project d32aff83e4a644a59a1e1e8f0000864a. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:38:20.819759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-e2669b58-cd2e-4e14-b55c-a98224cc6688 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Getting quotas for user 4d6302ebc22e490bbac83b5b218b3b84 and project d32aff83e4a644a59a1e1e8f0000864a. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:38:20.879223 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e2669b58-cd2e-4e14-b55c-a98224cc6688 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.42 time: 0.164109 Aug 18 11:38:20.883761 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1439/2970] 10.222.0.73 () {62 vars in 1200 bytes} [Thu Aug 18 11:38:20 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 170 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 11:38:20.913735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bef3d8c9-cff2-4edb-a26e-19ca8b7365ae tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:20.931069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bef3d8c9-cff2-4edb-a26e-19ca8b7365ae tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:20.943241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bef3d8c9-cff2-4edb-a26e-19ca8b7365ae tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:20.945062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bef3d8c9-cff2-4edb-a26e-19ca8b7365ae tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:20.945713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:38:20.946144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:38:20.946329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bef3d8c9-cff2-4edb-a26e-19ca8b7365ae tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:20.946859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:38:20.947275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:38:20.947693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:38:20.947982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bef3d8c9-cff2-4edb-a26e-19ca8b7365ae tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:20.948784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bef3d8c9-cff2-4edb-a26e-19ca8b7365ae tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:20.949664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bef3d8c9-cff2-4edb-a26e-19ca8b7365ae tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:20.966253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:20.967181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:20.968155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:20.971759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:20.975580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:20.976737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:21.057483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Getting quotas for project 538a71f94fd54403a20347030509ef69. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:38:21.075905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Getting quotas for user 25a235b1ba7e4f7d8d7a7c424b80c823 and project 538a71f94fd54403a20347030509ef69. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:38:21.115803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:38:21.118323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:38:21.236624 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab702a55-c983-4545-8efc-a0ec06a02790 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.854039 Aug 18 11:38:21.237728 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1532/2971] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:38:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:38:21.244842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8dd74a19-9b52-41b5-b3e1-7852288281dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:21.245822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8dd74a19-9b52-41b5-b3e1-7852288281dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:21.269202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dd74a19-9b52-41b5-b3e1-7852288281dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:21.270164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dd74a19-9b52-41b5-b3e1-7852288281dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:21.271326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dd74a19-9b52-41b5-b3e1-7852288281dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:21.272543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dd74a19-9b52-41b5-b3e1-7852288281dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:21.273826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dd74a19-9b52-41b5-b3e1-7852288281dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:21.274738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dd74a19-9b52-41b5-b3e1-7852288281dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:21.490910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bef3d8c9-cff2-4edb-a26e-19ca8b7365ae tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:21.525949 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bef3d8c9-cff2-4edb-a26e-19ca8b7365ae tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1468 microversion: 2.1 time: 0.632141 Aug 18 11:38:21.527069 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1440/2972] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:20 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1468 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:21.581575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-212082740", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "2420cd87-a1af-4a7a-8baa-ea2c21853a49"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:21.712955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] validate_networks() for [('2420cd87-a1af-4a7a-8baa-ea2c21853a49', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:38:21.780610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8dd74a19-9b52-41b5-b3e1-7852288281dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:21.797012 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8dd74a19-9b52-41b5-b3e1-7852288281dc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1500 microversion: 2.1 time: 0.556426 Aug 18 11:38:21.799655 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1533/2973] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:21 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1500 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:21.816448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e64cbd8-1795-4ac0-95d8-b09b454a7303 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:21.819341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1e64cbd8-1795-4ac0-95d8-b09b454a7303 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:21.961233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1e64cbd8-1795-4ac0-95d8-b09b454a7303 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:21.982641 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1e64cbd8-1795-4ac0-95d8-b09b454a7303 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1218 microversion: 2.1 time: 0.181103 Aug 18 11:38:21.986586 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1534/2974] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:21 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:21.996144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3d67f96-f68b-4969-b697-1efd370c54aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "260c38fb-0be4-418b-bf6c-adf916087364"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:22.001259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3d67f96-f68b-4969-b697-1efd370c54aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:22.025160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3d67f96-f68b-4969-b697-1efd370c54aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:22.026443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3d67f96-f68b-4969-b697-1efd370c54aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:22.027359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3d67f96-f68b-4969-b697-1efd370c54aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:22.028359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3d67f96-f68b-4969-b697-1efd370c54aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:22.029177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3d67f96-f68b-4969-b697-1efd370c54aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:22.029798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3d67f96-f68b-4969-b697-1efd370c54aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:22.101207 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-d3d67f96-f68b-4969-b697-1efd370c54aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] HTTP exception thrown: Cannot 'attach_volume' instance d6f665d8-ddd8-4030-be59-efb1140ef80e while it is in vm_state rescued Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3d67f96-f68b-4969-b697-1efd370c54aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Request method failure captured: Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e/os-volume_attachments HTTP/1.1 Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 74 Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iRDccV-wQBjWbehYJnvnYrqtEvDPnmmRi9FdLn90jlDwmLP7Yu8AV-Xjh3sRI2h6VdTdDxREaF_4Uw5JAlLnmy-pOyTW0C8AnpTCeGTveMx08cuhXqa0wk4T8c8YQiDTyaAtMLbCc_qByCh4ZjwOdEPthe4EaqbP1499Gbu30qZ6g8 Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 4eea5599d0754399a32a3ae3431ff18f Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: {"volumeAttachment": {"volumeId": "260c38fb-0be4-418b-bf6c-adf916087364"}} Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: exception: Cannot 'attach_volume' instance d6f665d8-ddd8-4030-be59-efb1140ef80e while it is in vm_state rescued Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': 'd6f665d8-ddd8-4030-be59-efb1140ef80e', 'body': {'volumeAttachment': {'volumeId': '260c38fb-0be4-418b-bf6c-adf916087364'}}} Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d6f665d8-ddd8-4030-be59-efb1140ef80e in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 18 11:38:22.103208 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d6f665d8-ddd8-4030-be59-efb1140ef80e while it is in vm_state rescued Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d6f665d8-ddd8-4030-be59-efb1140ef80e while it is in vm_state rescued Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3d67f96-f68b-4969-b697-1efd370c54aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Returning 409 to user: Cannot 'attach_volume' instance d6f665d8-ddd8-4030-be59-efb1140ef80e while it is in vm_state rescued {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:38:22.107531 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3d67f96-f68b-4969-b697-1efd370c54aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.118013 Aug 18 11:38:22.116747 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1535/2975] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:38:21 2022] POST /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e/os-volume_attachments => generated 152 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:38:22.126843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cda7ae5e-49ed-47fe-9731-d4fe8f845636 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:22.127657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cda7ae5e-49ed-47fe-9731-d4fe8f845636 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:22.146790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cda7ae5e-49ed-47fe-9731-d4fe8f845636 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:22.147703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cda7ae5e-49ed-47fe-9731-d4fe8f845636 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:22.148168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cda7ae5e-49ed-47fe-9731-d4fe8f845636 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:22.150397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cda7ae5e-49ed-47fe-9731-d4fe8f845636 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:22.150906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cda7ae5e-49ed-47fe-9731-d4fe8f845636 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:22.151341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cda7ae5e-49ed-47fe-9731-d4fe8f845636 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:22.268578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:22.341890 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cda7ae5e-49ed-47fe-9731-d4fe8f845636 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e/action" status: 202 len: 0 microversion: 2.1 time: 0.218992 Aug 18 11:38:22.343313 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1536/2976] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:38:22 2022] POST /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:38:22.353942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9eea7d48-0667-443c-9675-cd29c4705479 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:22.355750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9eea7d48-0667-443c-9675-cd29c4705479 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:22.371114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9eea7d48-0667-443c-9675-cd29c4705479 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:22.371854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9eea7d48-0667-443c-9675-cd29c4705479 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:22.372461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9eea7d48-0667-443c-9675-cd29c4705479 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:22.373417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9eea7d48-0667-443c-9675-cd29c4705479 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:22.374024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9eea7d48-0667-443c-9675-cd29c4705479 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:22.374640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9eea7d48-0667-443c-9675-cd29c4705479 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:22.874460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:38:22.875049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:38:22.875384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:38:22.876420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:38:22.876923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:38:22.904530 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:22.915122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:22.917823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:22.919243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:22.923968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:22.926592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:22.981029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Getting quotas for project c1a985dc6f824e5b847a2d966c0f79af. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:38:22.995471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Getting quotas for user 0cd8451c50d941409a66864cbc1c7201 and project c1a985dc6f824e5b847a2d966c0f79af. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:38:23.065524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9eea7d48-0667-443c-9675-cd29c4705479 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:23.068507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:38:23.074087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:38:23.090320 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9eea7d48-0667-443c-9675-cd29c4705479 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1508 microversion: 2.1 time: 0.742840 Aug 18 11:38:23.096631 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1537/2977] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:22 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1508 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:23.109456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-234e17a2-2c89-4938-8824-9ac04bf945d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:23.110111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-234e17a2-2c89-4938-8824-9ac04bf945d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:23.137885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-234e17a2-2c89-4938-8824-9ac04bf945d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:23.139119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-234e17a2-2c89-4938-8824-9ac04bf945d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:23.141875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-234e17a2-2c89-4938-8824-9ac04bf945d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:23.144959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-234e17a2-2c89-4938-8824-9ac04bf945d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:23.146223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-234e17a2-2c89-4938-8824-9ac04bf945d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:23.148105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-234e17a2-2c89-4938-8824-9ac04bf945d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:23.212543 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0a63673b-0522-4edd-8fd6-a08daf008260 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.645252 Aug 18 11:38:23.219556 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1441/2978] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:38:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:38:23.240905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-82fa7d0a-801a-4143-ba47-3fc8a8034d75 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:23.242513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-82fa7d0a-801a-4143-ba47-3fc8a8034d75 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:23.255462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82fa7d0a-801a-4143-ba47-3fc8a8034d75 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:23.256377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82fa7d0a-801a-4143-ba47-3fc8a8034d75 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:23.257194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82fa7d0a-801a-4143-ba47-3fc8a8034d75 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:23.258265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82fa7d0a-801a-4143-ba47-3fc8a8034d75 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:23.259395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82fa7d0a-801a-4143-ba47-3fc8a8034d75 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:23.260426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82fa7d0a-801a-4143-ba47-3fc8a8034d75 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:23.774927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-82fa7d0a-801a-4143-ba47-3fc8a8034d75 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:23.781065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-234e17a2-2c89-4938-8824-9ac04bf945d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:23.795387 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-82fa7d0a-801a-4143-ba47-3fc8a8034d75 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1278 microversion: 2.1 time: 0.563567 Aug 18 11:38:23.797625 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1442/2979] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:23 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1278 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:23.802373 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-234e17a2-2c89-4938-8824-9ac04bf945d5 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 200 len: 1298 microversion: 2.1 time: 0.702301 Aug 18 11:38:23.804999 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1538/2980] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:23 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 1298 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:23.819913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5f008fba-7cbc-4680-a398-e15c6f075224 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:23.821973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5f008fba-7cbc-4680-a398-e15c6f075224 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:23.829528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-5cd8c387-c878-4a8f-b127-d7fd038a55e2 req-49f70299-b7e8-4b98-8a1c-6369ef2f582f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11f7372-0d2e-4159-8c18-a86d32428841", "name": "network-vif-deleted", "tag": "cb2d2511-5c49-464c-be36-c45456072cfb"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:23.871015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5cd8c387-c878-4a8f-b127-d7fd038a55e2 req-49f70299-b7e8-4b98-8a1c-6369ef2f582f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:23.876214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5cd8c387-c878-4a8f-b127-d7fd038a55e2 req-49f70299-b7e8-4b98-8a1c-6369ef2f582f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:23.880958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5cd8c387-c878-4a8f-b127-d7fd038a55e2 req-49f70299-b7e8-4b98-8a1c-6369ef2f582f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:23.930040 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5cd8c387-c878-4a8f-b127-d7fd038a55e2 req-49f70299-b7e8-4b98-8a1c-6369ef2f582f service nova] Creating event network-vif-deleted:cb2d2511-5c49-464c-be36-c45456072cfb for instance f11f7372-0d2e-4159-8c18-a86d32428841 on n-h1-853611-3 Aug 18 11:38:23.955655 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-5cd8c387-c878-4a8f-b127-d7fd038a55e2 req-49f70299-b7e8-4b98-8a1c-6369ef2f582f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152716 Aug 18 11:38:23.956274 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1443/2981] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:24.125025 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f0a118ef-ad5f-45dc-b1dd-4a3445aed4a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:24.127359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f0a118ef-ad5f-45dc-b1dd-4a3445aed4a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:24.143750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0a118ef-ad5f-45dc-b1dd-4a3445aed4a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:24.144687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0a118ef-ad5f-45dc-b1dd-4a3445aed4a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:24.148681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0a118ef-ad5f-45dc-b1dd-4a3445aed4a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:24.151956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0a118ef-ad5f-45dc-b1dd-4a3445aed4a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:24.154153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0a118ef-ad5f-45dc-b1dd-4a3445aed4a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:24.155998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0a118ef-ad5f-45dc-b1dd-4a3445aed4a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:24.231919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5f008fba-7cbc-4680-a398-e15c6f075224 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:24.247157 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5f008fba-7cbc-4680-a398-e15c6f075224 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1214 microversion: 2.1 time: 0.440727 Aug 18 11:38:24.247791 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1539/2982] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:23 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1214 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:24.820387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7bf83712-7320-4a2b-aac4-bb51a05e8ca9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:24.821331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7bf83712-7320-4a2b-aac4-bb51a05e8ca9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:24.831308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bf83712-7320-4a2b-aac4-bb51a05e8ca9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:24.834219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bf83712-7320-4a2b-aac4-bb51a05e8ca9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:24.835040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bf83712-7320-4a2b-aac4-bb51a05e8ca9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:24.835961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bf83712-7320-4a2b-aac4-bb51a05e8ca9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:24.838010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bf83712-7320-4a2b-aac4-bb51a05e8ca9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:24.839506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bf83712-7320-4a2b-aac4-bb51a05e8ca9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:24.874890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f0a118ef-ad5f-45dc-b1dd-4a3445aed4a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:24.893127 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f0a118ef-ad5f-45dc-b1dd-4a3445aed4a7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1508 microversion: 2.1 time: 0.779565 Aug 18 11:38:24.894854 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1444/2983] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:24 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1508 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:38:24.900587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-131a2e9d-14b6-49a8-9dff-eede7082be92 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:24.911403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-131a2e9d-14b6-49a8-9dff-eede7082be92 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: f11f7372-0d2e-4159-8c18-a86d32428841] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:24.919090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131a2e9d-14b6-49a8-9dff-eede7082be92 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:24.919737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131a2e9d-14b6-49a8-9dff-eede7082be92 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:24.920617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131a2e9d-14b6-49a8-9dff-eede7082be92 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:24.921610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131a2e9d-14b6-49a8-9dff-eede7082be92 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:24.922234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131a2e9d-14b6-49a8-9dff-eede7082be92 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:24.923426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131a2e9d-14b6-49a8-9dff-eede7082be92 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:24.959028 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-131a2e9d-14b6-49a8-9dff-eede7082be92 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] HTTP exception thrown: Instance f11f7372-0d2e-4159-8c18-a86d32428841 could not be found. Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-131a2e9d-14b6-49a8-9dff-eede7082be92 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Request method failure captured: Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 HTTP/1.1 Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iQfg3Kg5wkLTEa5KD_ZPjKo6Wumr7AVow0sHmuUtWbPmFkwlKrNwhGjdZpK0GwscJJp4kKPmCTvTHkkNDUQ2b3Zu6gRdJDbQo0OLbeBTFor6QTntuUvKdbHej8rwxOsl1cKxiJWwycfNMirTZjJs2em76ljLlTLHCovAf-6XZsk-Vg Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 894e2bd813f444e9bb6075a02985e347 Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersAdminTestJSON-1808578324 Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/894e2bd813f444e9bb6075a02985e347"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/894e2bd813f444e9bb6075a02985e347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_894e2bd813f444e9bb6075a02985e347"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/894e2bd813f444e9bb6075a02985e347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersAdminTestJSON-1808578324 Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 894e2bd813f444e9bb6075a02985e347 Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersAdminTestJSON-1808578324 Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersAdminTestJSON-1808578324-project Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 44b470d4e29048bbbeb3c107f2ee42dc Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersAdminTestJSON-1808578324-project Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance f11f7372-0d2e-4159-8c18-a86d32428841 could not be found. Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'f11f7372-0d2e-4159-8c18-a86d32428841'} Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f11f7372-0d2e-4159-8c18-a86d32428841 could not be found. Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f11f7372-0d2e-4159-8c18-a86d32428841 could not be found. Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:38:24.962947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:38:24.967406 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:38:24.967406 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:38:24.967406 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:38:24.967406 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:38:24.967406 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:38:24.967406 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f11f7372-0d2e-4159-8c18-a86d32428841 could not be found. Aug 18 11:38:24.967406 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:38:24.967406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-131a2e9d-14b6-49a8-9dff-eede7082be92 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Returning 404 to user: Instance f11f7372-0d2e-4159-8c18-a86d32428841 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:38:24.967406 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-131a2e9d-14b6-49a8-9dff-eede7082be92 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841" status: 404 len: 111 microversion: 2.1 time: 0.067675 Aug 18 11:38:24.971829 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1445/2984] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:24 2022] GET /compute/v2.1/servers/f11f7372-0d2e-4159-8c18-a86d32428841 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:38:24.982469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9036a032-0013-4c55-ad0f-adde7a695264 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:24.984105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9036a032-0013-4c55-ad0f-adde7a695264 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:24.999827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9036a032-0013-4c55-ad0f-adde7a695264 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:25.000329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9036a032-0013-4c55-ad0f-adde7a695264 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:25.000763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9036a032-0013-4c55-ad0f-adde7a695264 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:25.007672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9036a032-0013-4c55-ad0f-adde7a695264 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:25.008827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9036a032-0013-4c55-ad0f-adde7a695264 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:25.009706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9036a032-0013-4c55-ad0f-adde7a695264 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:25.061449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9036a032-0013-4c55-ad0f-adde7a695264 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:38:25.137375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7bf83712-7320-4a2b-aac4-bb51a05e8ca9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:25.149938 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7bf83712-7320-4a2b-aac4-bb51a05e8ca9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1276 microversion: 2.1 time: 0.333528 Aug 18 11:38:25.167435 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1540/2985] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:24 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1276 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:38:25.188494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-106d7fda-3974-4e25-855c-d96565453381 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Calling method '.version_select at 0x7f519f9ec1f0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:25.198754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-106d7fda-3974-4e25-855c-d96565453381 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:25.199740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-106d7fda-3974-4e25-855c-d96565453381 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:25.200593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-106d7fda-3974-4e25-855c-d96565453381 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:25.214878 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-106d7fda-3974-4e25-855c-d96565453381 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] 10.222.0.73 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.029967 Aug 18 11:38:25.237513 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1541/2986] 10.222.0.73 () {58 vars in 1143 bytes} [Thu Aug 18 11:38:25 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:25.256742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cefa5292-b4d6-43f4-8d5d-d4fc0b3c58a0 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:25.266102 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cefa5292-b4d6-43f4-8d5d-d4fc0b3c58a0 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014060 Aug 18 11:38:25.267193 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1542/2987] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:38:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:38:25.273399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-498ca08a-ef63-446a-89e6-99593bc77524 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:25.274287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-498ca08a-ef63-446a-89e6-99593bc77524 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:25.276504 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9036a032-0013-4c55-ad0f-adde7a695264 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 204 len: 0 microversion: 2.1 time: 0.303224 Aug 18 11:38:25.278234 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1446/2988] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:38:24 2022] DELETE /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:38:25.282660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-498ca08a-ef63-446a-89e6-99593bc77524 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:25.284076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-498ca08a-ef63-446a-89e6-99593bc77524 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:25.284487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-498ca08a-ef63-446a-89e6-99593bc77524 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:25.285297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-498ca08a-ef63-446a-89e6-99593bc77524 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:25.286808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-498ca08a-ef63-446a-89e6-99593bc77524 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:25.287469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-498ca08a-ef63-446a-89e6-99593bc77524 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:25.291249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e3cf9b44-6b51-43fb-9050-afe68c5fd24e tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1874133541", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:25.298983 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:38:25.298983 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:38:25.344424 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e3cf9b44-6b51-43fb-9050-afe68c5fd24e tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.062880 Aug 18 11:38:25.345329 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1447/2989] 10.222.0.73 () {60 vars in 1146 bytes} [Thu Aug 18 11:38:25 2022] POST /compute/v2.1/flavors => generated 499 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:25.352041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f1fc2187-da1d-43ad-947c-20ab81aba008 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:25.353138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f1fc2187-da1d-43ad-947c-20ab81aba008 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:25.362979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1fc2187-da1d-43ad-947c-20ab81aba008 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:25.365010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1fc2187-da1d-43ad-947c-20ab81aba008 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:25.366090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1fc2187-da1d-43ad-947c-20ab81aba008 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:25.368049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1fc2187-da1d-43ad-947c-20ab81aba008 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:25.369022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1fc2187-da1d-43ad-947c-20ab81aba008 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:25.371984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1fc2187-da1d-43ad-947c-20ab81aba008 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:25.432259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-498ca08a-ef63-446a-89e6-99593bc77524 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:25.486412 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-498ca08a-ef63-446a-89e6-99593bc77524 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1284 microversion: 2.1 time: 0.209876 Aug 18 11:38:25.488671 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1543/2990] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:25 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:25.499023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fb772251-fc04-417c-93d9-c8f307f538ac tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:25.517437 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fb772251-fc04-417c-93d9-c8f307f538ac tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025424 Aug 18 11:38:25.518034 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1544/2991] 10.222.0.73 () {58 vars in 1182 bytes} [Thu Aug 18 11:38:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:38:25.682026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f1fc2187-da1d-43ad-947c-20ab81aba008 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:25.696200 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f1fc2187-da1d-43ad-947c-20ab81aba008 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1470 microversion: 2.1 time: 0.349398 Aug 18 11:38:25.696756 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1448/2992] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:25 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1470 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:25.728211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-504872728", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "f9035438-2b8a-4310-b3dd-acd834add8e6"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:25.822237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-645559862", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "fc51d62a-0bf2-4f07-9254-ea3ee2ca47d4"}, {"port": "7aa0fec2-35fb-4c23-afdd-c14e58f79ef8", "tag": "port-1"}, {"port": "4a2069c0-71e1-43d0-8277-fb9b9a43de8b", "tag": "port-2"}, {"uuid": "a103fdb8-9f42-4686-bf49-ef1935a94b46", "tag": "net-1"}, {"uuid": "a103fdb8-9f42-4686-bf49-ef1935a94b46"}, {"uuid": "37ca7bc4-0abe-42a3-9e38-5a3e6c15e448", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "37ca7bc4-0abe-42a3-9e38-5a3e6c15e448", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c91b93fb-0868-44fd-a208-58bf915d1cc1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "5c235485-ac61-4382-b3c1-9659f42924cb", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "bf9e4331-51f4-4759-9093-064923545a77", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1976892232"}], "key_name": "tempest-keypair-40434335", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:25.823500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:38:26.051109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] validate_networks() for [('fc51d62a-0bf2-4f07-9254-ea3ee2ca47d4', None, None, None, None, None), (None, None, '7aa0fec2-35fb-4c23-afdd-c14e58f79ef8', None, None, None), (None, None, '4a2069c0-71e1-43d0-8277-fb9b9a43de8b', None, None, None), ('a103fdb8-9f42-4686-bf49-ef1935a94b46', None, None, None, None, None), ('a103fdb8-9f42-4686-bf49-ef1935a94b46', None, None, None, None, None), ('37ca7bc4-0abe-42a3-9e38-5a3e6c15e448', '10.2.2.100', None, None, None, None), ('37ca7bc4-0abe-42a3-9e38-5a3e6c15e448', '10.2.2.200', None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:38:26.577468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:38:26.578763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:38:26.579683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:38:26.580327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:38:26.580976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:38:26.592860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:26.593729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:26.595173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:26.596713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:26.597436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:26.598173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:26.657692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Getting quotas for project 6387896b424840deb9ef97aae02edd99. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:38:26.668044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Getting quotas for user 9269fc4d233c42a590bfcbfaa7f2e895 and project 6387896b424840deb9ef97aae02edd99. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:38:26.696791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:38:26.699837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:38:26.810181 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6f1c1d87-b5ca-4653-a523-983b4d430dfe tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085713 Aug 18 11:38:26.815248 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1545/2993] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:38:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:38:26.837309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d4e3f91b-e884-49b6-ac76-e607ef591fe0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:26.859152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d4e3f91b-e884-49b6-ac76-e607ef591fe0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:26.924540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4e3f91b-e884-49b6-ac76-e607ef591fe0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:26.927176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4e3f91b-e884-49b6-ac76-e607ef591fe0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:26.929466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4e3f91b-e884-49b6-ac76-e607ef591fe0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:26.939162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4e3f91b-e884-49b6-ac76-e607ef591fe0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:26.942804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4e3f91b-e884-49b6-ac76-e607ef591fe0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:26.943664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4e3f91b-e884-49b6-ac76-e607ef591fe0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:27.391071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d4e3f91b-e884-49b6-ac76-e607ef591fe0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:27.414052 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d4e3f91b-e884-49b6-ac76-e607ef591fe0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1508 microversion: 2.1 time: 0.589188 Aug 18 11:38:27.415904 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1546/2994] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:26 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1508 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:27.424430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-108217c1-6a13-47e0-9c4b-410071692d20 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:27.425300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-108217c1-6a13-47e0-9c4b-410071692d20 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:27.455332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-108217c1-6a13-47e0-9c4b-410071692d20 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:27.455826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-108217c1-6a13-47e0-9c4b-410071692d20 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:27.456263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-108217c1-6a13-47e0-9c4b-410071692d20 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:27.457098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-108217c1-6a13-47e0-9c4b-410071692d20 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:27.458179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-108217c1-6a13-47e0-9c4b-410071692d20 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:27.459099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-108217c1-6a13-47e0-9c4b-410071692d20 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:27.794183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-108217c1-6a13-47e0-9c4b-410071692d20 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:27.805444 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-108217c1-6a13-47e0-9c4b-410071692d20 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1318 microversion: 2.1 time: 0.387833 Aug 18 11:38:27.807929 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1547/2995] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:27 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:27.815577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0f096185-c266-4bb4-acda-7ad7678be355 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:27.819090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0f096185-c266-4bb4-acda-7ad7678be355 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:27.828085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f096185-c266-4bb4-acda-7ad7678be355 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:27.828613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f096185-c266-4bb4-acda-7ad7678be355 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:27.828999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f096185-c266-4bb4-acda-7ad7678be355 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:27.829907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f096185-c266-4bb4-acda-7ad7678be355 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:27.830564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f096185-c266-4bb4-acda-7ad7678be355 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:27.831155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f096185-c266-4bb4-acda-7ad7678be355 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:28.078560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0f096185-c266-4bb4-acda-7ad7678be355 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:28.087327 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0f096185-c266-4bb4-acda-7ad7678be355 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1314 microversion: 2.1 time: 0.275753 Aug 18 11:38:28.105927 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1548/2996] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:27 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:28.111570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-95ed54ea-8e5f-4c76-8db5-2be42a37ed51 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:28.112711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-95ed54ea-8e5f-4c76-8db5-2be42a37ed51 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:28.119692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95ed54ea-8e5f-4c76-8db5-2be42a37ed51 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:28.120555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95ed54ea-8e5f-4c76-8db5-2be42a37ed51 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:28.121160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95ed54ea-8e5f-4c76-8db5-2be42a37ed51 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:28.122027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95ed54ea-8e5f-4c76-8db5-2be42a37ed51 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:28.122743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95ed54ea-8e5f-4c76-8db5-2be42a37ed51 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:28.123325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95ed54ea-8e5f-4c76-8db5-2be42a37ed51 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:28.396236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-95ed54ea-8e5f-4c76-8db5-2be42a37ed51 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:28.408724 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-95ed54ea-8e5f-4c76-8db5-2be42a37ed51 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1470 microversion: 2.1 time: 0.300604 Aug 18 11:38:28.409872 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1549/2997] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:28 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1470 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:28.422453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1402f5a3-b312-4e18-a3e0-88d7631e774f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:28.424442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1402f5a3-b312-4e18-a3e0-88d7631e774f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:28.440156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1402f5a3-b312-4e18-a3e0-88d7631e774f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:28.440987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1402f5a3-b312-4e18-a3e0-88d7631e774f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:28.442160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1402f5a3-b312-4e18-a3e0-88d7631e774f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:28.443719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1402f5a3-b312-4e18-a3e0-88d7631e774f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:28.444546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1402f5a3-b312-4e18-a3e0-88d7631e774f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:28.445347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1402f5a3-b312-4e18-a3e0-88d7631e774f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:28.564939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1402f5a3-b312-4e18-a3e0-88d7631e774f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:28.577612 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1402f5a3-b312-4e18-a3e0-88d7631e774f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1330 microversion: 2.1 time: 0.165473 Aug 18 11:38:28.578686 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1550/2998] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:28 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1330 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:28.583952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-42333135-947f-49ff-8b57-93e1b82a580e req-7a5d2dec-44d4-424d-80aa-9eed43ffca50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf75dc7-00eb-4c1b-986d-3a59443571b7", "tag": "f6a21f93-cae9-4f96-9796-025f2beba9c3"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:28.596819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-42333135-947f-49ff-8b57-93e1b82a580e req-7a5d2dec-44d4-424d-80aa-9eed43ffca50 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:28.597735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-42333135-947f-49ff-8b57-93e1b82a580e req-7a5d2dec-44d4-424d-80aa-9eed43ffca50 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:28.599204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-42333135-947f-49ff-8b57-93e1b82a580e req-7a5d2dec-44d4-424d-80aa-9eed43ffca50 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:28.617990 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-42333135-947f-49ff-8b57-93e1b82a580e req-7a5d2dec-44d4-424d-80aa-9eed43ffca50 service nova] Creating event network-changed:f6a21f93-cae9-4f96-9796-025f2beba9c3 for instance caf75dc7-00eb-4c1b-986d-3a59443571b7 on n-h1-853611-3 Aug 18 11:38:28.626913 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-42333135-947f-49ff-8b57-93e1b82a580e req-7a5d2dec-44d4-424d-80aa-9eed43ffca50 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046776 Aug 18 11:38:28.628086 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1551/2999] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:28.635425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bf2218d2-61a8-4856-accf-78cc8250b7a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:28.636400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bf2218d2-61a8-4856-accf-78cc8250b7a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:28.644606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf2218d2-61a8-4856-accf-78cc8250b7a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:28.646502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf2218d2-61a8-4856-accf-78cc8250b7a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:28.647214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf2218d2-61a8-4856-accf-78cc8250b7a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:28.648562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf2218d2-61a8-4856-accf-78cc8250b7a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:28.649604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf2218d2-61a8-4856-accf-78cc8250b7a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:28.650511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf2218d2-61a8-4856-accf-78cc8250b7a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:28.963033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bf2218d2-61a8-4856-accf-78cc8250b7a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:28.974757 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bf2218d2-61a8-4856-accf-78cc8250b7a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1514 microversion: 2.1 time: 0.343437 Aug 18 11:38:28.975721 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1552/3000] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:28 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1514 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:28.982456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d570208a-6f5b-4410-8d4a-47d58f61fdf4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:28.983346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d570208a-6f5b-4410-8d4a-47d58f61fdf4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:28.987420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:29.001557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d570208a-6f5b-4410-8d4a-47d58f61fdf4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:29.002458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d570208a-6f5b-4410-8d4a-47d58f61fdf4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:29.003189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d570208a-6f5b-4410-8d4a-47d58f61fdf4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:29.003927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d570208a-6f5b-4410-8d4a-47d58f61fdf4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:29.005147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d570208a-6f5b-4410-8d4a-47d58f61fdf4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:29.005597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d570208a-6f5b-4410-8d4a-47d58f61fdf4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:29.330493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d570208a-6f5b-4410-8d4a-47d58f61fdf4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:29.365751 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d570208a-6f5b-4410-8d4a-47d58f61fdf4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1318 microversion: 2.1 time: 0.388619 Aug 18 11:38:29.372955 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1553/3001] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:28 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:29.386162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8493c407-8a3d-4511-b326-939249ad8208 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:29.387094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8493c407-8a3d-4511-b326-939249ad8208 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:29.398366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8493c407-8a3d-4511-b326-939249ad8208 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:29.401223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8493c407-8a3d-4511-b326-939249ad8208 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:29.411902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8493c407-8a3d-4511-b326-939249ad8208 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:29.414854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8493c407-8a3d-4511-b326-939249ad8208 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:29.416191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8493c407-8a3d-4511-b326-939249ad8208 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:29.417695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8493c407-8a3d-4511-b326-939249ad8208 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:29.657301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8493c407-8a3d-4511-b326-939249ad8208 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:29.671167 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8493c407-8a3d-4511-b326-939249ad8208 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1314 microversion: 2.1 time: 0.295506 Aug 18 11:38:29.672642 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1554/3002] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:29 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:29.687580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-6d0e8237-6a1e-4aa4-84a6-5cabb5322ea1 req-f5008a48-8f81-47db-a805-432530ee0d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aee369f-2ece-4b53-a7db-efe946936831", "name": "network-vif-deleted", "tag": "fdd9010d-de96-4f58-8fc4-5c78c661a107"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:29.700120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6d0e8237-6a1e-4aa4-84a6-5cabb5322ea1 req-f5008a48-8f81-47db-a805-432530ee0d55 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:29.700967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6d0e8237-6a1e-4aa4-84a6-5cabb5322ea1 req-f5008a48-8f81-47db-a805-432530ee0d55 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:29.701678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6d0e8237-6a1e-4aa4-84a6-5cabb5322ea1 req-f5008a48-8f81-47db-a805-432530ee0d55 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:29.727175 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6d0e8237-6a1e-4aa4-84a6-5cabb5322ea1 req-f5008a48-8f81-47db-a805-432530ee0d55 service nova] Creating event network-vif-deleted:fdd9010d-de96-4f58-8fc4-5c78c661a107 for instance 5aee369f-2ece-4b53-a7db-efe946936831 on n-h2-853611-3 Aug 18 11:38:29.732908 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-6d0e8237-6a1e-4aa4-84a6-5cabb5322ea1 req-f5008a48-8f81-47db-a805-432530ee0d55 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058199 Aug 18 11:38:29.734313 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1555/3003] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:29.741308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e5b1fd95-568c-4817-b2d4-b1a8acb69967 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:29.742623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e5b1fd95-568c-4817-b2d4-b1a8acb69967 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:29.768182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b1fd95-568c-4817-b2d4-b1a8acb69967 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:29.769122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b1fd95-568c-4817-b2d4-b1a8acb69967 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:29.771199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b1fd95-568c-4817-b2d4-b1a8acb69967 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:29.772534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b1fd95-568c-4817-b2d4-b1a8acb69967 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:29.774899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b1fd95-568c-4817-b2d4-b1a8acb69967 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:29.776438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b1fd95-568c-4817-b2d4-b1a8acb69967 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:29.872027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b1fd95-568c-4817-b2d4-b1a8acb69967 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:29.876861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b1fd95-568c-4817-b2d4-b1a8acb69967 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:29.880075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5b1fd95-568c-4817-b2d4-b1a8acb69967 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:29.880592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-e5b1fd95-568c-4817-b2d4-b1a8acb69967 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lazy-loading 'fault' on Instance uuid 5aee369f-2ece-4b53-a7db-efe946936831 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:38:30.027948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e5b1fd95-568c-4817-b2d4-b1a8acb69967 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b470d4e29048bbbeb3c107f2ee42dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e2bd813f444e9bb6075a02985e347', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:30.040655 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e5b1fd95-568c-4817-b2d4-b1a8acb69967 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 200 len: 1304 microversion: 2.1 time: 0.304600 Aug 18 11:38:30.071175 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1556/3004] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:29 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 1304 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:30.079981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c5d74395-ea63-4368-a23b-f52253676598 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:30.081507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c5d74395-ea63-4368-a23b-f52253676598 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:30.100771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5d74395-ea63-4368-a23b-f52253676598 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:30.104139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5d74395-ea63-4368-a23b-f52253676598 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:30.104852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5d74395-ea63-4368-a23b-f52253676598 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:30.110730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5d74395-ea63-4368-a23b-f52253676598 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:30.111421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5d74395-ea63-4368-a23b-f52253676598 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:30.112027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5d74395-ea63-4368-a23b-f52253676598 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:30.277967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c5d74395-ea63-4368-a23b-f52253676598 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:30.288064 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c5d74395-ea63-4368-a23b-f52253676598 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1336 microversion: 2.1 time: 0.215419 Aug 18 11:38:30.291917 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1557/3005] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:30 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1336 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:30.397876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e5151ef-5dac-4065-a911-b985e0f1b075 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:30.398845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9e5151ef-5dac-4065-a911-b985e0f1b075 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:30.411268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e5151ef-5dac-4065-a911-b985e0f1b075 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:30.412101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e5151ef-5dac-4065-a911-b985e0f1b075 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:30.417777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e5151ef-5dac-4065-a911-b985e0f1b075 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:30.419013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e5151ef-5dac-4065-a911-b985e0f1b075 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:30.419656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e5151ef-5dac-4065-a911-b985e0f1b075 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:30.428777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e5151ef-5dac-4065-a911-b985e0f1b075 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:30.484630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:30.867785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9e5151ef-5dac-4065-a911-b985e0f1b075 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:30.887436 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9e5151ef-5dac-4065-a911-b985e0f1b075 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1318 microversion: 2.1 time: 0.494067 Aug 18 11:38:30.889800 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1558/3006] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:30 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:38:30.896697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-72e7fbed-bd0a-4e5c-a1e8-f54e8866bd29 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:30.897387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-72e7fbed-bd0a-4e5c-a1e8-f54e8866bd29 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:30.904484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72e7fbed-bd0a-4e5c-a1e8-f54e8866bd29 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:30.904994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72e7fbed-bd0a-4e5c-a1e8-f54e8866bd29 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:30.905880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72e7fbed-bd0a-4e5c-a1e8-f54e8866bd29 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:30.906158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72e7fbed-bd0a-4e5c-a1e8-f54e8866bd29 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:30.906721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72e7fbed-bd0a-4e5c-a1e8-f54e8866bd29 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:30.907161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72e7fbed-bd0a-4e5c-a1e8-f54e8866bd29 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:31.187849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-72e7fbed-bd0a-4e5c-a1e8-f54e8866bd29 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:31.199577 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-72e7fbed-bd0a-4e5c-a1e8-f54e8866bd29 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1314 microversion: 2.1 time: 0.308241 Aug 18 11:38:31.200180 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1559/3007] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:30 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:31.214680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3bdf141b-a26e-4ca0-9790-ad48fc98d2d9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:31.215707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3bdf141b-a26e-4ca0-9790-ad48fc98d2d9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] [instance: 5aee369f-2ece-4b53-a7db-efe946936831] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:31.230161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bdf141b-a26e-4ca0-9790-ad48fc98d2d9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:31.230970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bdf141b-a26e-4ca0-9790-ad48fc98d2d9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:31.231601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bdf141b-a26e-4ca0-9790-ad48fc98d2d9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:31.232496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bdf141b-a26e-4ca0-9790-ad48fc98d2d9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:31.233119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bdf141b-a26e-4ca0-9790-ad48fc98d2d9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:31.233712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bdf141b-a26e-4ca0-9790-ad48fc98d2d9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:31.255695 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-3bdf141b-a26e-4ca0-9790-ad48fc98d2d9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] HTTP exception thrown: Instance 5aee369f-2ece-4b53-a7db-efe946936831 could not be found. Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3bdf141b-a26e-4ca0-9790-ad48fc98d2d9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Request method failure captured: Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 HTTP/1.1 Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iQfg3Kg5wkLTEa5KD_ZPjKo6Wumr7AVow0sHmuUtWbPmFkwlKrNwhGjdZpK0GwscJJp4kKPmCTvTHkkNDUQ2b3Zu6gRdJDbQo0OLbeBTFor6QTntuUvKdbHej8rwxOsl1cKxiJWwycfNMirTZjJs2em76ljLlTLHCovAf-6XZsk-Vg Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 894e2bd813f444e9bb6075a02985e347 Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersAdminTestJSON-1808578324 Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/894e2bd813f444e9bb6075a02985e347"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/894e2bd813f444e9bb6075a02985e347"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_894e2bd813f444e9bb6075a02985e347"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/894e2bd813f444e9bb6075a02985e347"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersAdminTestJSON-1808578324 Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 894e2bd813f444e9bb6075a02985e347 Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersAdminTestJSON-1808578324 Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersAdminTestJSON-1808578324-project Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 44b470d4e29048bbbeb3c107f2ee42dc Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersAdminTestJSON-1808578324-project Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5aee369f-2ece-4b53-a7db-efe946936831 could not be found. Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5aee369f-2ece-4b53-a7db-efe946936831'} Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aee369f-2ece-4b53-a7db-efe946936831 could not be found. Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aee369f-2ece-4b53-a7db-efe946936831 could not be found. Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:38:31.257433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:38:31.261600 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:38:31.261600 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:38:31.261600 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:38:31.261600 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:38:31.261600 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:38:31.261600 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aee369f-2ece-4b53-a7db-efe946936831 could not be found. Aug 18 11:38:31.261600 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:38:31.261600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3bdf141b-a26e-4ca0-9790-ad48fc98d2d9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] Returning 404 to user: Instance 5aee369f-2ece-4b53-a7db-efe946936831 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:38:31.275224 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3bdf141b-a26e-4ca0-9790-ad48fc98d2d9 tempest-ServersAdminTestJSON-1808578324 tempest-ServersAdminTestJSON-1808578324-project] 10.222.0.73 "GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831" status: 404 len: 111 microversion: 2.1 time: 0.048663 Aug 18 11:38:31.278599 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1560/3008] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:31 2022] GET /compute/v2.1/servers/5aee369f-2ece-4b53-a7db-efe946936831 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:38:31.315833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0159c2bb-aba1-456b-a764-5b84efd06652 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:31.316764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0159c2bb-aba1-456b-a764-5b84efd06652 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:31.337536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0159c2bb-aba1-456b-a764-5b84efd06652 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:31.338044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0159c2bb-aba1-456b-a764-5b84efd06652 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:31.338570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0159c2bb-aba1-456b-a764-5b84efd06652 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:31.339253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0159c2bb-aba1-456b-a764-5b84efd06652 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:31.339897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0159c2bb-aba1-456b-a764-5b84efd06652 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:31.341475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0159c2bb-aba1-456b-a764-5b84efd06652 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:31.614166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0159c2bb-aba1-456b-a764-5b84efd06652 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:31.629627 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0159c2bb-aba1-456b-a764-5b84efd06652 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1378 microversion: 2.1 time: 0.319844 Aug 18 11:38:31.641614 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1561/3009] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:31 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1378 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:38:31.748185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8776ed06-7ed9-4bc0-a6b0-2bead32c4c7b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'create', calling method: .version_select at 0x7f519f91c550>, body: {"keypair": {"name": "tempest-keypair-1968131135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/tIBDqSW2clpCPc9QU9LXe9PsVkS5W1s2NfJPlmV7vyv3/evDK8IX+ePf9ykh+XT2uKvez9A3utLeLPacflCJHMgmSGDzsJi4o/YZ+qP1NHq+H7ytcimK8tLSmd4FPew=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:31.792981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-8776ed06-7ed9-4bc0-a6b0-2bead32c4c7b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Getting quotas for project 00d9eeb4297f442694052b28a297d9a3. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:38:31.821008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-8776ed06-7ed9-4bc0-a6b0-2bead32c4c7b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Getting quotas for user 4eea5599d0754399a32a3ae3431ff18f and project 00d9eeb4297f442694052b28a297d9a3. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:38:31.891211 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8776ed06-7ed9-4bc0-a6b0-2bead32c4c7b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145411 Aug 18 11:38:31.892457 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1562/3010] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:38:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:31.905505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-64d3f15f-6c04-4256-af26-ac055ab92c2f req-5ca898bc-fd31-47c9-a4e0-6329a3a7b8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f65b4f-2652-4d50-b868-5d7258fa7cb4", "tag": "d3a33b84-c6d1-47fc-a6d8-29d57933f772"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:31.938924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-64d3f15f-6c04-4256-af26-ac055ab92c2f req-5ca898bc-fd31-47c9-a4e0-6329a3a7b8d7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:31.939824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-64d3f15f-6c04-4256-af26-ac055ab92c2f req-5ca898bc-fd31-47c9-a4e0-6329a3a7b8d7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:31.940286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-64d3f15f-6c04-4256-af26-ac055ab92c2f req-5ca898bc-fd31-47c9-a4e0-6329a3a7b8d7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:31.975392 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-64d3f15f-6c04-4256-af26-ac055ab92c2f req-5ca898bc-fd31-47c9-a4e0-6329a3a7b8d7 service nova] Creating event network-changed:d3a33b84-c6d1-47fc-a6d8-29d57933f772 for instance 73f65b4f-2652-4d50-b868-5d7258fa7cb4 on n-h1-853611-3 Aug 18 11:38:31.987178 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-64d3f15f-6c04-4256-af26-ac055ab92c2f req-5ca898bc-fd31-47c9-a4e0-6329a3a7b8d7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093306 Aug 18 11:38:31.987808 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1563/3011] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:32.017370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02fa2c06-7051-475b-8d2b-7c9b6924db3d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:32.018308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-02fa2c06-7051-475b-8d2b-7c9b6924db3d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:32.038618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02fa2c06-7051-475b-8d2b-7c9b6924db3d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:32.039621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02fa2c06-7051-475b-8d2b-7c9b6924db3d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:32.040332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02fa2c06-7051-475b-8d2b-7c9b6924db3d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:32.041329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02fa2c06-7051-475b-8d2b-7c9b6924db3d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:32.042023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02fa2c06-7051-475b-8d2b-7c9b6924db3d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:32.048055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02fa2c06-7051-475b-8d2b-7c9b6924db3d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:32.846070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-02fa2c06-7051-475b-8d2b-7c9b6924db3d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:32.857688 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-02fa2c06-7051-475b-8d2b-7c9b6924db3d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1318 microversion: 2.1 time: 0.862554 Aug 18 11:38:32.872387 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1564/3012] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:31 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1318 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:32.877822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-793d8f80-1096-4fea-9fe3-e2abb971c46d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:32.878801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-793d8f80-1096-4fea-9fe3-e2abb971c46d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:32.886412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-793d8f80-1096-4fea-9fe3-e2abb971c46d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:32.887223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-793d8f80-1096-4fea-9fe3-e2abb971c46d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:32.887847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-793d8f80-1096-4fea-9fe3-e2abb971c46d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:32.888735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-793d8f80-1096-4fea-9fe3-e2abb971c46d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:32.889417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-793d8f80-1096-4fea-9fe3-e2abb971c46d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:32.890012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-793d8f80-1096-4fea-9fe3-e2abb971c46d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:32.946566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:33.048855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=14 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:33.283080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-793d8f80-1096-4fea-9fe3-e2abb971c46d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:33.295754 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-793d8f80-1096-4fea-9fe3-e2abb971c46d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1314 microversion: 2.1 time: 0.421773 Aug 18 11:38:33.296548 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1565/3013] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:32 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:33.328630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8f47d640-77c5-41fe-8be6-14167805711a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:33.334479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8f47d640-77c5-41fe-8be6-14167805711a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:33.353098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f47d640-77c5-41fe-8be6-14167805711a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:33.355185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f47d640-77c5-41fe-8be6-14167805711a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:33.356768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f47d640-77c5-41fe-8be6-14167805711a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:33.361075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f47d640-77c5-41fe-8be6-14167805711a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:33.361565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f47d640-77c5-41fe-8be6-14167805711a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:33.362013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f47d640-77c5-41fe-8be6-14167805711a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:33.796328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8f47d640-77c5-41fe-8be6-14167805711a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:33.807139 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8f47d640-77c5-41fe-8be6-14167805711a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1378 microversion: 2.1 time: 0.509204 Aug 18 11:38:33.807890 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1566/3014] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:33 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1378 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:33.827437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-6741fe74-3fe6-4da9-b661-3ea0e3c1b9ea req-513c07d7-054d-4f35-894a-134c5d6667ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf75dc7-00eb-4c1b-986d-3a59443571b7", "name": "network-vif-plugged", "status": "completed", "tag": "f6a21f93-cae9-4f96-9796-025f2beba9c3"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:33.838972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6741fe74-3fe6-4da9-b661-3ea0e3c1b9ea req-513c07d7-054d-4f35-894a-134c5d6667ba service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:33.839465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6741fe74-3fe6-4da9-b661-3ea0e3c1b9ea req-513c07d7-054d-4f35-894a-134c5d6667ba service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:33.840025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6741fe74-3fe6-4da9-b661-3ea0e3c1b9ea req-513c07d7-054d-4f35-894a-134c5d6667ba service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:33.858974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:38:33.859667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:38:33.861037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:38:33.862230 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:38:33.862921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:38:33.869754 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6741fe74-3fe6-4da9-b661-3ea0e3c1b9ea req-513c07d7-054d-4f35-894a-134c5d6667ba service nova] Creating event network-vif-plugged:f6a21f93-cae9-4f96-9796-025f2beba9c3 for instance caf75dc7-00eb-4c1b-986d-3a59443571b7 on n-h1-853611-3 Aug 18 11:38:33.883421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:33.885561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:33.888544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:33.889160 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-6741fe74-3fe6-4da9-b661-3ea0e3c1b9ea req-513c07d7-054d-4f35-894a-134c5d6667ba service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065598 Aug 18 11:38:33.890142 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1567/3015] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:33.891162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:33.892866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:33.893543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:33.906338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76c31575-f3fd-47b6-b9d2-c7e137dd9a98 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:33.907118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-76c31575-f3fd-47b6-b9d2-c7e137dd9a98 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:33.921435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c31575-f3fd-47b6-b9d2-c7e137dd9a98 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:33.921935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c31575-f3fd-47b6-b9d2-c7e137dd9a98 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:33.922382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c31575-f3fd-47b6-b9d2-c7e137dd9a98 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:33.923764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c31575-f3fd-47b6-b9d2-c7e137dd9a98 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:33.924227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c31575-f3fd-47b6-b9d2-c7e137dd9a98 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:33.924658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c31575-f3fd-47b6-b9d2-c7e137dd9a98 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:34.010622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Getting quotas for project d32aff83e4a644a59a1e1e8f0000864a. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:38:34.017817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Getting quotas for user 4d6302ebc22e490bbac83b5b218b3b84 and project d32aff83e4a644a59a1e1e8f0000864a. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:38:34.282740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:38:34.287455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c91b93fb-0868-44fd-a208-58bf915d1cc1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='5c235485-ac61-4382-b3c1-9659f42924cb',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf9e4331-51f4-4759-9093-064923545a77',volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:38:34.312399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-76c31575-f3fd-47b6-b9d2-c7e137dd9a98 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:34.324214 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76c31575-f3fd-47b6-b9d2-c7e137dd9a98 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1318 microversion: 2.1 time: 0.433191 Aug 18 11:38:34.340093 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1568/3016] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:33 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:34.345723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a51f225f-3acb-4936-83e3-18e301ff505d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:34.347394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a51f225f-3acb-4936-83e3-18e301ff505d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:34.355869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51f225f-3acb-4936-83e3-18e301ff505d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:34.356936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51f225f-3acb-4936-83e3-18e301ff505d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:34.357603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51f225f-3acb-4936-83e3-18e301ff505d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:34.358567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51f225f-3acb-4936-83e3-18e301ff505d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:34.359266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51f225f-3acb-4936-83e3-18e301ff505d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:34.360077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51f225f-3acb-4936-83e3-18e301ff505d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:34.657691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a51f225f-3acb-4936-83e3-18e301ff505d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:34.672662 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a51f225f-3acb-4936-83e3-18e301ff505d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1314 microversion: 2.1 time: 0.330962 Aug 18 11:38:34.676837 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1569/3017] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:34 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:34.698884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-fe78f92e-fc90-48f5-8b1d-bda869f768a6 req-fa569b2d-dd4c-4adb-9a80-616581558b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d7183ab-d769-4b94-9b9b-545a3eb459d7", "tag": "71abe44d-4829-45bc-98f7-b6337e80396d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:34.713097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fe78f92e-fc90-48f5-8b1d-bda869f768a6 req-fa569b2d-dd4c-4adb-9a80-616581558b60 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:34.713831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fe78f92e-fc90-48f5-8b1d-bda869f768a6 req-fa569b2d-dd4c-4adb-9a80-616581558b60 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:34.714489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fe78f92e-fc90-48f5-8b1d-bda869f768a6 req-fa569b2d-dd4c-4adb-9a80-616581558b60 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:34.731613 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-fe78f92e-fc90-48f5-8b1d-bda869f768a6 req-fa569b2d-dd4c-4adb-9a80-616581558b60 service nova] Creating event network-changed:71abe44d-4829-45bc-98f7-b6337e80396d for instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 on n-h2-853611-3 Aug 18 11:38:34.743028 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-fe78f92e-fc90-48f5-8b1d-bda869f768a6 req-fa569b2d-dd4c-4adb-9a80-616581558b60 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063908 Aug 18 11:38:34.745277 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1570/3018] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:34.832639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-895f6338-01f4-47ce-92b3-527d20c9aff9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:34.835077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-895f6338-01f4-47ce-92b3-527d20c9aff9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:34.845619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-895f6338-01f4-47ce-92b3-527d20c9aff9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:34.846172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-895f6338-01f4-47ce-92b3-527d20c9aff9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:34.846863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-895f6338-01f4-47ce-92b3-527d20c9aff9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:34.848436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-895f6338-01f4-47ce-92b3-527d20c9aff9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:34.849352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-895f6338-01f4-47ce-92b3-527d20c9aff9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:34.850017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-895f6338-01f4-47ce-92b3-527d20c9aff9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:34.895336 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a35590fc-5c24-43be-a952-12aec8fb73b1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 9.078254 Aug 18 11:38:34.904811 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1449/3019] 10.222.0.73 () {62 vars in 1189 bytes} [Thu Aug 18 11:38:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 9089 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 11:38:34.911853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3404d9c3-9a1b-4859-ad68-e1f8e485f293 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:34.913178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3404d9c3-9a1b-4859-ad68-e1f8e485f293 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:35.031756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3404d9c3-9a1b-4859-ad68-e1f8e485f293 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:35.042687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3404d9c3-9a1b-4859-ad68-e1f8e485f293 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:35.046570 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3404d9c3-9a1b-4859-ad68-e1f8e485f293 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:35.048258 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3404d9c3-9a1b-4859-ad68-e1f8e485f293 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1283 microversion: 2.42 time: 0.141869 Aug 18 11:38:35.063020 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1450/3020] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:38:34 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1283 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:38:35.228706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-895f6338-01f4-47ce-92b3-527d20c9aff9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:35.241908 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-895f6338-01f4-47ce-92b3-527d20c9aff9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1378 microversion: 2.1 time: 0.415432 Aug 18 11:38:35.243564 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1571/3021] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:34 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1378 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:35.349101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e1acba9d-bbed-4f89-bd3f-bfa67712c7cc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:35.349668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e1acba9d-bbed-4f89-bd3f-bfa67712c7cc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:35.373626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1acba9d-bbed-4f89-bd3f-bfa67712c7cc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:35.374811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1acba9d-bbed-4f89-bd3f-bfa67712c7cc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:35.375773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1acba9d-bbed-4f89-bd3f-bfa67712c7cc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:35.376867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1acba9d-bbed-4f89-bd3f-bfa67712c7cc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:35.380735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1acba9d-bbed-4f89-bd3f-bfa67712c7cc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:35.383160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1acba9d-bbed-4f89-bd3f-bfa67712c7cc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:35.698677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ae984070-401b-491a-aa5a-a772671a2851 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:35.699642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ae984070-401b-491a-aa5a-a772671a2851 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:35.719218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae984070-401b-491a-aa5a-a772671a2851 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:35.721095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae984070-401b-491a-aa5a-a772671a2851 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:35.721846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae984070-401b-491a-aa5a-a772671a2851 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:35.727094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae984070-401b-491a-aa5a-a772671a2851 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:35.727747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae984070-401b-491a-aa5a-a772671a2851 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:35.728353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae984070-401b-491a-aa5a-a772671a2851 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:35.729183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e1acba9d-bbed-4f89-bd3f-bfa67712c7cc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:35.739820 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e1acba9d-bbed-4f89-bd3f-bfa67712c7cc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1318 microversion: 2.1 time: 0.398314 Aug 18 11:38:35.745098 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1451/3022] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:35 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:35.990760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ae984070-401b-491a-aa5a-a772671a2851 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:36.013995 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ae984070-401b-491a-aa5a-a772671a2851 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1314 microversion: 2.1 time: 0.304552 Aug 18 11:38:36.016676 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1572/3023] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:35 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:38:36.081321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-273680c5-408f-4966-b4a3-c5499886d7cd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:36.082671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-273680c5-408f-4966-b4a3-c5499886d7cd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:36.112502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-273680c5-408f-4966-b4a3-c5499886d7cd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:36.116440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-273680c5-408f-4966-b4a3-c5499886d7cd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:36.117334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-273680c5-408f-4966-b4a3-c5499886d7cd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:36.118489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-273680c5-408f-4966-b4a3-c5499886d7cd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:36.119221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-273680c5-408f-4966-b4a3-c5499886d7cd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:36.123203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-273680c5-408f-4966-b4a3-c5499886d7cd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:36.265459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7de78b9-6c83-4885-9bb9-b3bcb3556435 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:36.266680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e7de78b9-6c83-4885-9bb9-b3bcb3556435 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:36.276056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7de78b9-6c83-4885-9bb9-b3bcb3556435 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:36.278566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7de78b9-6c83-4885-9bb9-b3bcb3556435 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:36.279714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7de78b9-6c83-4885-9bb9-b3bcb3556435 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:36.280621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7de78b9-6c83-4885-9bb9-b3bcb3556435 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:36.283448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7de78b9-6c83-4885-9bb9-b3bcb3556435 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:36.284084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7de78b9-6c83-4885-9bb9-b3bcb3556435 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:36.465909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-273680c5-408f-4966-b4a3-c5499886d7cd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:36.480095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-273680c5-408f-4966-b4a3-c5499886d7cd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:36.481626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-273680c5-408f-4966-b4a3-c5499886d7cd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:36.485300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e7de78b9-6c83-4885-9bb9-b3bcb3556435 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:36.488181 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-273680c5-408f-4966-b4a3-c5499886d7cd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1525 microversion: 2.42 time: 0.412714 Aug 18 11:38:36.490098 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1452/3024] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:38:36 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1525 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:38:36.498260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-176023750", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26f1b349-d280-46a0-801f-2b32d525fe0e"}], "security_groups": [{"name": "tempest-securitygroup--1809828145"}], "key_name": "tempest-keypair-1968131135", "user_data": "}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:36.515058 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e7de78b9-6c83-4885-9bb9-b3bcb3556435 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1378 microversion: 2.1 time: 0.254622 Aug 18 11:38:36.517015 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1573/3025] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:36 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1378 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:36.690657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] validate_networks() for [('26f1b349-d280-46a0-801f-2b32d525fe0e', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:38:36.768906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bab5be88-07fd-407e-b2fd-94e69d4e92a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:36.770676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bab5be88-07fd-407e-b2fd-94e69d4e92a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:36.772867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:36.779853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bab5be88-07fd-407e-b2fd-94e69d4e92a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:36.780527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bab5be88-07fd-407e-b2fd-94e69d4e92a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:36.780978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bab5be88-07fd-407e-b2fd-94e69d4e92a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:36.781695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bab5be88-07fd-407e-b2fd-94e69d4e92a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:36.782330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bab5be88-07fd-407e-b2fd-94e69d4e92a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:36.782813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bab5be88-07fd-407e-b2fd-94e69d4e92a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:37.054594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bab5be88-07fd-407e-b2fd-94e69d4e92a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:37.064887 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bab5be88-07fd-407e-b2fd-94e69d4e92a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1508 microversion: 2.1 time: 0.302164 Aug 18 11:38:37.082024 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1574/3026] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:36 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:38:37.088708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26b42177-6b82-45b5-82e3-248ed107a1ed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:37.089493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26b42177-6b82-45b5-82e3-248ed107a1ed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:37.096833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26b42177-6b82-45b5-82e3-248ed107a1ed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:37.098388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26b42177-6b82-45b5-82e3-248ed107a1ed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:37.099177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26b42177-6b82-45b5-82e3-248ed107a1ed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:37.100289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26b42177-6b82-45b5-82e3-248ed107a1ed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:37.101058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26b42177-6b82-45b5-82e3-248ed107a1ed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:37.102238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26b42177-6b82-45b5-82e3-248ed107a1ed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:37.390197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=8 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:37.426304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-26b42177-6b82-45b5-82e3-248ed107a1ed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:37.436503 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-26b42177-6b82-45b5-82e3-248ed107a1ed tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1314 microversion: 2.1 time: 0.352793 Aug 18 11:38:37.451564 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1575/3027] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:37 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:37.457423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f6af0482-5341-4ab3-8707-0bfbc20a308b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:37.458824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f6af0482-5341-4ab3-8707-0bfbc20a308b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:37.476110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6af0482-5341-4ab3-8707-0bfbc20a308b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:37.476945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6af0482-5341-4ab3-8707-0bfbc20a308b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:37.477613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6af0482-5341-4ab3-8707-0bfbc20a308b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:37.478602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6af0482-5341-4ab3-8707-0bfbc20a308b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:37.479311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6af0482-5341-4ab3-8707-0bfbc20a308b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:37.480029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6af0482-5341-4ab3-8707-0bfbc20a308b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:37.789400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f6af0482-5341-4ab3-8707-0bfbc20a308b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:37.805051 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f6af0482-5341-4ab3-8707-0bfbc20a308b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1508 microversion: 2.1 time: 0.351973 Aug 18 11:38:37.805656 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1576/3028] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:37 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1508 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:37.810369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-46ae8a65-523b-4e38-8774-e93694c4e358 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:37.811020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-46ae8a65-523b-4e38-8774-e93694c4e358 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:37.840484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46ae8a65-523b-4e38-8774-e93694c4e358 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:37.841300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46ae8a65-523b-4e38-8774-e93694c4e358 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:37.841963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46ae8a65-523b-4e38-8774-e93694c4e358 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:37.843018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46ae8a65-523b-4e38-8774-e93694c4e358 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:37.843691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46ae8a65-523b-4e38-8774-e93694c4e358 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:37.844334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46ae8a65-523b-4e38-8774-e93694c4e358 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:37.990700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:38:37.991424 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:38:37.992093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:38:37.992671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:38:37.993248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:38:38.014584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:38.015845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:38.016661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:38.021033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:38.023240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:38.025561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:38.111181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Getting quotas for project 00d9eeb4297f442694052b28a297d9a3. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:38:38.129800 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Getting quotas for user 4eea5599d0754399a32a3ae3431ff18f and project 00d9eeb4297f442694052b28a297d9a3. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:38:38.152970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:38:38.156206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:38:38.209519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-46ae8a65-523b-4e38-8774-e93694c4e358 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:38.224067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-46ae8a65-523b-4e38-8774-e93694c4e358 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:38.231298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-46ae8a65-523b-4e38-8774-e93694c4e358 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:38.232531 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-46ae8a65-523b-4e38-8774-e93694c4e358 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1591 microversion: 2.42 time: 0.425924 Aug 18 11:38:38.242554 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1577/3029] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:38:37 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1591 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:38:38.250467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-378dd8b4-bb14-49aa-ac22-afa51b44c1c3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:38.250467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-378dd8b4-bb14-49aa-ac22-afa51b44c1c3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:38.257664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-378dd8b4-bb14-49aa-ac22-afa51b44c1c3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:38.258159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-378dd8b4-bb14-49aa-ac22-afa51b44c1c3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:38.258635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-378dd8b4-bb14-49aa-ac22-afa51b44c1c3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:38.259354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-378dd8b4-bb14-49aa-ac22-afa51b44c1c3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:38.270585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-378dd8b4-bb14-49aa-ac22-afa51b44c1c3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:38.270945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-378dd8b4-bb14-49aa-ac22-afa51b44c1c3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:38.279496 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-27e78d61-0601-442a-9b6c-d9ab2fddfb02 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.786964 Aug 18 11:38:38.280186 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1453/3030] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:38:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:38:38.304701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:38.307814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:38.316867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:38.317174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:38.317822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:38.318770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:38.319539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:38.320549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:38.352491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:38.456852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:38:38.457917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:38:38.458696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:38:38.459278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:38:38.459807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:38:38.558335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:38.614348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:38.632766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:38.639592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:38.640062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:38.640826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:38.641882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:38.641882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:38.799734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-378dd8b4-bb14-49aa-ac22-afa51b44c1c3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:38.825020 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-378dd8b4-bb14-49aa-ac22-afa51b44c1c3 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1378 microversion: 2.1 time: 0.586133 Aug 18 11:38:38.827046 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1578/3031] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:38 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1378 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:38.846584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-aa092c34-b07f-49c4-8b3c-6d688793b498 req-5699fe99-66fb-452f-9477-8ab15ac95a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f65b4f-2652-4d50-b868-5d7258fa7cb4", "name": "network-vif-plugged", "status": "completed", "tag": "d3a33b84-c6d1-47fc-a6d8-29d57933f772"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:38.888307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aa092c34-b07f-49c4-8b3c-6d688793b498 req-5699fe99-66fb-452f-9477-8ab15ac95a48 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:38.895499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aa092c34-b07f-49c4-8b3c-6d688793b498 req-5699fe99-66fb-452f-9477-8ab15ac95a48 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:38.898742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aa092c34-b07f-49c4-8b3c-6d688793b498 req-5699fe99-66fb-452f-9477-8ab15ac95a48 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:38.969217 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-aa092c34-b07f-49c4-8b3c-6d688793b498 req-5699fe99-66fb-452f-9477-8ab15ac95a48 service nova] Creating event network-vif-plugged:d3a33b84-c6d1-47fc-a6d8-29d57933f772 for instance 73f65b4f-2652-4d50-b868-5d7258fa7cb4 on n-h1-853611-3 Aug 18 11:38:38.988772 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-aa092c34-b07f-49c4-8b3c-6d688793b498 req-5699fe99-66fb-452f-9477-8ab15ac95a48 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158815 Aug 18 11:38:38.997962 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1579/3032] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:39.018335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cad5e662-c849-4638-8f87-a01a20b5d9f7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:39.021617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cad5e662-c849-4638-8f87-a01a20b5d9f7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:39.300294 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0897eac1-ecd9-4614-aa78-4e7389943025 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "POST /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7/action" status: 202 len: 1110 microversion: 2.1 time: 1.016204 Aug 18 11:38:39.302840 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1454/3033] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:38:38 2022] POST /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7/action => generated 1110 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 18 11:38:39.320045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-861e936d-6964-4519-bbb2-748c8ddc26d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:39.320859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-861e936d-6964-4519-bbb2-748c8ddc26d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:39.333236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-861e936d-6964-4519-bbb2-748c8ddc26d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:39.335128 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-861e936d-6964-4519-bbb2-748c8ddc26d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:39.335880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-861e936d-6964-4519-bbb2-748c8ddc26d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:39.337259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-861e936d-6964-4519-bbb2-748c8ddc26d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:39.338465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-861e936d-6964-4519-bbb2-748c8ddc26d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:39.339158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-861e936d-6964-4519-bbb2-748c8ddc26d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:39.448521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cad5e662-c849-4638-8f87-a01a20b5d9f7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:39.466356 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cad5e662-c849-4638-8f87-a01a20b5d9f7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1245 microversion: 2.1 time: 0.464498 Aug 18 11:38:39.469625 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1580/3034] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:38 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1245 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:39.478261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-93b977d7-3390-4f6e-8018-ba94a0fa3431 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:39.479286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-93b977d7-3390-4f6e-8018-ba94a0fa3431 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:39.502471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93b977d7-3390-4f6e-8018-ba94a0fa3431 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:39.512766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93b977d7-3390-4f6e-8018-ba94a0fa3431 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:39.514813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93b977d7-3390-4f6e-8018-ba94a0fa3431 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:39.515792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93b977d7-3390-4f6e-8018-ba94a0fa3431 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:39.518229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93b977d7-3390-4f6e-8018-ba94a0fa3431 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:39.519555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93b977d7-3390-4f6e-8018-ba94a0fa3431 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:39.882972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-861e936d-6964-4519-bbb2-748c8ddc26d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:39.895844 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-861e936d-6964-4519-bbb2-748c8ddc26d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1314 microversion: 2.1 time: 0.590873 Aug 18 11:38:39.896466 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1455/3035] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:39 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:39.911601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a80c80b-b674-4eb3-b2ab-1f524327006c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:39.913433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0a80c80b-b674-4eb3-b2ab-1f524327006c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:39.933775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a80c80b-b674-4eb3-b2ab-1f524327006c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:39.934313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a80c80b-b674-4eb3-b2ab-1f524327006c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:39.937797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a80c80b-b674-4eb3-b2ab-1f524327006c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:39.938654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a80c80b-b674-4eb3-b2ab-1f524327006c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:39.939532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a80c80b-b674-4eb3-b2ab-1f524327006c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:39.940001 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a80c80b-b674-4eb3-b2ab-1f524327006c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:40.523514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0a80c80b-b674-4eb3-b2ab-1f524327006c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:40.535396 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0a80c80b-b674-4eb3-b2ab-1f524327006c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1515 microversion: 2.1 time: 0.633531 Aug 18 11:38:40.539241 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1456/3036] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:39 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1515 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:40.558409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6cb89985-db4a-4caf-b268-6ab0f4d1c26d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:40.565768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6cb89985-db4a-4caf-b268-6ab0f4d1c26d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:40.592195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6cb89985-db4a-4caf-b268-6ab0f4d1c26d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:40.592623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6cb89985-db4a-4caf-b268-6ab0f4d1c26d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:40.593079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6cb89985-db4a-4caf-b268-6ab0f4d1c26d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:40.593833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6cb89985-db4a-4caf-b268-6ab0f4d1c26d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:40.594303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6cb89985-db4a-4caf-b268-6ab0f4d1c26d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:40.599352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6cb89985-db4a-4caf-b268-6ab0f4d1c26d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:40.735142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-93b977d7-3390-4f6e-8018-ba94a0fa3431 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:40.773081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-93b977d7-3390-4f6e-8018-ba94a0fa3431 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:40.775483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-93b977d7-3390-4f6e-8018-ba94a0fa3431 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:40.776903 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-93b977d7-3390-4f6e-8018-ba94a0fa3431 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1659 microversion: 2.42 time: 1.305930 Aug 18 11:38:40.782779 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1581/3037] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:38:39 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1659 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:38:40.798921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6adf05f2-b428-434a-94dc-e98aeb2bd95e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:40.800227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6adf05f2-b428-434a-94dc-e98aeb2bd95e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:40.826273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6adf05f2-b428-434a-94dc-e98aeb2bd95e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:40.829091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6adf05f2-b428-434a-94dc-e98aeb2bd95e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:40.829880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6adf05f2-b428-434a-94dc-e98aeb2bd95e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:40.833325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6adf05f2-b428-434a-94dc-e98aeb2bd95e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:40.833877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6adf05f2-b428-434a-94dc-e98aeb2bd95e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:40.834336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6adf05f2-b428-434a-94dc-e98aeb2bd95e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:40.982642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6adf05f2-b428-434a-94dc-e98aeb2bd95e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:41.002009 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6adf05f2-b428-434a-94dc-e98aeb2bd95e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1305 microversion: 2.1 time: 0.214708 Aug 18 11:38:41.019308 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1582/3038] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:40 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1305 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:41.031817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e3bd64ce-57ea-4db7-b50a-410f438ee682 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:41.032448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e3bd64ce-57ea-4db7-b50a-410f438ee682 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:41.051333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3bd64ce-57ea-4db7-b50a-410f438ee682 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:41.058180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3bd64ce-57ea-4db7-b50a-410f438ee682 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:41.063035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3bd64ce-57ea-4db7-b50a-410f438ee682 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:41.064368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3bd64ce-57ea-4db7-b50a-410f438ee682 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:41.065046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3bd64ce-57ea-4db7-b50a-410f438ee682 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:41.065908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3bd64ce-57ea-4db7-b50a-410f438ee682 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:41.208700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6cb89985-db4a-4caf-b268-6ab0f4d1c26d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:41.218749 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6cb89985-db4a-4caf-b268-6ab0f4d1c26d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1378 microversion: 2.1 time: 0.678069 Aug 18 11:38:41.219593 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1457/3039] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:40 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1378 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:41.470737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e3bd64ce-57ea-4db7-b50a-410f438ee682 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:41.483453 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e3bd64ce-57ea-4db7-b50a-410f438ee682 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1314 microversion: 2.1 time: 0.464528 Aug 18 11:38:41.484551 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1583/3040] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:41 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:41.570675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-93bfa374-aae1-40cf-aab3-2840e289f961 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:41.571298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-93bfa374-aae1-40cf-aab3-2840e289f961 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:41.577656 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93bfa374-aae1-40cf-aab3-2840e289f961 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:41.578146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93bfa374-aae1-40cf-aab3-2840e289f961 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:41.578620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93bfa374-aae1-40cf-aab3-2840e289f961 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:41.598027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93bfa374-aae1-40cf-aab3-2840e289f961 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:41.598800 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93bfa374-aae1-40cf-aab3-2840e289f961 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:41.599109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93bfa374-aae1-40cf-aab3-2840e289f961 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:41.817004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e5dea147-35d1-418a-8575-c7c6404a4672 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:41.817618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e5dea147-35d1-418a-8575-c7c6404a4672 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:41.834072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5dea147-35d1-418a-8575-c7c6404a4672 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:41.834938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5dea147-35d1-418a-8575-c7c6404a4672 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:41.835702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5dea147-35d1-418a-8575-c7c6404a4672 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:41.838997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5dea147-35d1-418a-8575-c7c6404a4672 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:41.839580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5dea147-35d1-418a-8575-c7c6404a4672 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:41.840145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5dea147-35d1-418a-8575-c7c6404a4672 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:42.334549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-93bfa374-aae1-40cf-aab3-2840e289f961 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:42.347711 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-93bfa374-aae1-40cf-aab3-2840e289f961 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1515 microversion: 2.1 time: 0.780537 Aug 18 11:38:42.349023 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1458/3041] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:41 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1515 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:42.368451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3e2180d9-639c-4ec4-9800-5ab63e204d59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:42.369459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3e2180d9-639c-4ec4-9800-5ab63e204d59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:42.390109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e2180d9-639c-4ec4-9800-5ab63e204d59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:42.390658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e2180d9-639c-4ec4-9800-5ab63e204d59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:42.391107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e2180d9-639c-4ec4-9800-5ab63e204d59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:42.391860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e2180d9-639c-4ec4-9800-5ab63e204d59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:42.392311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e2180d9-639c-4ec4-9800-5ab63e204d59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:42.392747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e2180d9-639c-4ec4-9800-5ab63e204d59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:42.577114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3e2180d9-639c-4ec4-9800-5ab63e204d59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:42.597903 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3e2180d9-639c-4ec4-9800-5ab63e204d59 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1303 microversion: 2.1 time: 0.243011 Aug 18 11:38:42.600300 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1459/3042] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:42 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1303 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:42.618084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9c837773-a074-4c8f-b8ce-871006a51226 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:42.619447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9c837773-a074-4c8f-b8ce-871006a51226 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:42.634055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9c837773-a074-4c8f-b8ce-871006a51226 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:42.636467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9c837773-a074-4c8f-b8ce-871006a51226 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:42.637786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9c837773-a074-4c8f-b8ce-871006a51226 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:42.639089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9c837773-a074-4c8f-b8ce-871006a51226 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:42.639860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9c837773-a074-4c8f-b8ce-871006a51226 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:42.641749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9c837773-a074-4c8f-b8ce-871006a51226 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:42.792850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e5dea147-35d1-418a-8575-c7c6404a4672 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:42.809469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e5dea147-35d1-418a-8575-c7c6404a4672 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:42.812328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e5dea147-35d1-418a-8575-c7c6404a4672 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:42.814148 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e5dea147-35d1-418a-8575-c7c6404a4672 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1706 microversion: 2.42 time: 1.001309 Aug 18 11:38:42.815514 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1584/3043] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:38:41 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1706 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:38:42.826576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f9745c8b-a4a2-4314-83eb-9d8152f362b1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:42.827957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f9745c8b-a4a2-4314-83eb-9d8152f362b1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:42.837259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9745c8b-a4a2-4314-83eb-9d8152f362b1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:42.838064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9745c8b-a4a2-4314-83eb-9d8152f362b1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:42.838720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9745c8b-a4a2-4314-83eb-9d8152f362b1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:42.840957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9745c8b-a4a2-4314-83eb-9d8152f362b1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:42.842365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9745c8b-a4a2-4314-83eb-9d8152f362b1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:42.843478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9745c8b-a4a2-4314-83eb-9d8152f362b1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:43.138451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9c837773-a074-4c8f-b8ce-871006a51226 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:43.156849 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9c837773-a074-4c8f-b8ce-871006a51226 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1378 microversion: 2.1 time: 0.544887 Aug 18 11:38:43.157781 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1460/3044] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:42 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1378 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:43.205826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f9745c8b-a4a2-4314-83eb-9d8152f362b1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:43.214293 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f9745c8b-a4a2-4314-83eb-9d8152f362b1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1500 microversion: 2.1 time: 0.397074 Aug 18 11:38:43.222904 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1585/3045] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:42 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1500 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:43.249757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-45b191c6-0347-44f1-aac3-a76042496395 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:43.250692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-45b191c6-0347-44f1-aac3-a76042496395 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:43.259330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45b191c6-0347-44f1-aac3-a76042496395 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:43.262093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45b191c6-0347-44f1-aac3-a76042496395 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:43.262452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45b191c6-0347-44f1-aac3-a76042496395 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:43.270126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45b191c6-0347-44f1-aac3-a76042496395 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:43.270901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45b191c6-0347-44f1-aac3-a76042496395 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:43.271599 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45b191c6-0347-44f1-aac3-a76042496395 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:43.375734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6dd2a76f-0f73-4756-a262-5d9ec7354548 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:43.376693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6dd2a76f-0f73-4756-a262-5d9ec7354548 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:43.387222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6dd2a76f-0f73-4756-a262-5d9ec7354548 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:43.389579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6dd2a76f-0f73-4756-a262-5d9ec7354548 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:43.391152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6dd2a76f-0f73-4756-a262-5d9ec7354548 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:43.399002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6dd2a76f-0f73-4756-a262-5d9ec7354548 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:43.399804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6dd2a76f-0f73-4756-a262-5d9ec7354548 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:43.400419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6dd2a76f-0f73-4756-a262-5d9ec7354548 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:43.421729 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-45b191c6-0347-44f1-aac3-a76042496395 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4/action" status: 202 len: 0 microversion: 2.1 time: 0.175880 Aug 18 11:38:43.423360 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1461/3046] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:38:43 2022] POST /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:38:43.433171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-69e5313f-24b4-4a7e-bcee-f4f8de0b6e0a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:43.443546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-69e5313f-24b4-4a7e-bcee-f4f8de0b6e0a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:43.451159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e5313f-24b4-4a7e-bcee-f4f8de0b6e0a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:43.451921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e5313f-24b4-4a7e-bcee-f4f8de0b6e0a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:43.452549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e5313f-24b4-4a7e-bcee-f4f8de0b6e0a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:43.453453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e5313f-24b4-4a7e-bcee-f4f8de0b6e0a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:43.454766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e5313f-24b4-4a7e-bcee-f4f8de0b6e0a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:43.467200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e5313f-24b4-4a7e-bcee-f4f8de0b6e0a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:43.738393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6dd2a76f-0f73-4756-a262-5d9ec7354548 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:43.770190 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6dd2a76f-0f73-4756-a262-5d9ec7354548 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1515 microversion: 2.1 time: 0.398091 Aug 18 11:38:43.782001 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1586/3047] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:43 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1515 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:43.802326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-333b4477-47ec-49f1-94ff-ef656755817e req-514f81c1-2b98-4010-b054-ba5e356ea228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7183ab-d769-4b94-9b9b-545a3eb459d7", "name": "network-vif-plugged", "status": "completed", "tag": "71abe44d-4829-45bc-98f7-b6337e80396d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:43.833141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-333b4477-47ec-49f1-94ff-ef656755817e req-514f81c1-2b98-4010-b054-ba5e356ea228 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:43.834987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-333b4477-47ec-49f1-94ff-ef656755817e req-514f81c1-2b98-4010-b054-ba5e356ea228 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:43.835983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-333b4477-47ec-49f1-94ff-ef656755817e req-514f81c1-2b98-4010-b054-ba5e356ea228 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:43.856831 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-333b4477-47ec-49f1-94ff-ef656755817e req-514f81c1-2b98-4010-b054-ba5e356ea228 service nova] Creating event network-vif-plugged:71abe44d-4829-45bc-98f7-b6337e80396d for instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 on n-h2-853611-3 Aug 18 11:38:43.865455 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-333b4477-47ec-49f1-94ff-ef656755817e req-514f81c1-2b98-4010-b054-ba5e356ea228 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080786 Aug 18 11:38:43.866734 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1587/3048] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:43.873463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f80fe12-aa00-48b8-8163-fdabb40f7593 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:43.874621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6f80fe12-aa00-48b8-8163-fdabb40f7593 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:43.885018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f80fe12-aa00-48b8-8163-fdabb40f7593 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:43.886112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f80fe12-aa00-48b8-8163-fdabb40f7593 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:43.886899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f80fe12-aa00-48b8-8163-fdabb40f7593 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:43.888092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f80fe12-aa00-48b8-8163-fdabb40f7593 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:43.889040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f80fe12-aa00-48b8-8163-fdabb40f7593 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:43.889450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-69e5313f-24b4-4a7e-bcee-f4f8de0b6e0a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:43.889932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f80fe12-aa00-48b8-8163-fdabb40f7593 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:43.907568 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-69e5313f-24b4-4a7e-bcee-f4f8de0b6e0a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1505 microversion: 2.1 time: 0.474989 Aug 18 11:38:43.908721 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1462/3049] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:43 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:38:43.914397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a4202754-96bb-4f00-9d96-61e75e2f341a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:43.920666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a4202754-96bb-4f00-9d96-61e75e2f341a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:43.934514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4202754-96bb-4f00-9d96-61e75e2f341a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:43.943047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4202754-96bb-4f00-9d96-61e75e2f341a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:43.943642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4202754-96bb-4f00-9d96-61e75e2f341a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:43.944510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4202754-96bb-4f00-9d96-61e75e2f341a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:43.945062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4202754-96bb-4f00-9d96-61e75e2f341a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:43.945565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4202754-96bb-4f00-9d96-61e75e2f341a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:44.392905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a4202754-96bb-4f00-9d96-61e75e2f341a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:44.411899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a4202754-96bb-4f00-9d96-61e75e2f341a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:44.413440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a4202754-96bb-4f00-9d96-61e75e2f341a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:44.415160 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a4202754-96bb-4f00-9d96-61e75e2f341a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1753 microversion: 2.42 time: 0.504567 Aug 18 11:38:44.416200 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1463/3050] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:38:43 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1753 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:38:44.421778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a6d466c7-713a-40d4-8134-d69ce392e88e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:44.423100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a6d466c7-713a-40d4-8134-d69ce392e88e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:44.431509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6d466c7-713a-40d4-8134-d69ce392e88e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:44.432350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6d466c7-713a-40d4-8134-d69ce392e88e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:44.433042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6d466c7-713a-40d4-8134-d69ce392e88e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:44.434013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6d466c7-713a-40d4-8134-d69ce392e88e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:44.434728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6d466c7-713a-40d4-8134-d69ce392e88e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:44.435377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6d466c7-713a-40d4-8134-d69ce392e88e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:44.669506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6f80fe12-aa00-48b8-8163-fdabb40f7593 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:44.692578 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6f80fe12-aa00-48b8-8163-fdabb40f7593 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1371 microversion: 2.1 time: 0.823694 Aug 18 11:38:44.716840 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1588/3051] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:43 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1371 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:44.802720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3b85c86-5255-4fc2-9790-fb479075ec57 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:44.803685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3b85c86-5255-4fc2-9790-fb479075ec57 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:44.815411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3b85c86-5255-4fc2-9790-fb479075ec57 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:44.816222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3b85c86-5255-4fc2-9790-fb479075ec57 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:44.817057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3b85c86-5255-4fc2-9790-fb479075ec57 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:44.817986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3b85c86-5255-4fc2-9790-fb479075ec57 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:44.818963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3b85c86-5255-4fc2-9790-fb479075ec57 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:44.819658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3b85c86-5255-4fc2-9790-fb479075ec57 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:45.089581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a6d466c7-713a-40d4-8134-d69ce392e88e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:45.098819 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a6d466c7-713a-40d4-8134-d69ce392e88e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1378 microversion: 2.1 time: 0.680685 Aug 18 11:38:45.099392 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1464/3052] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:44 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1378 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:45.104482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-405fe967-4197-4539-9aa9-a826755e004d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:45.105421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-405fe967-4197-4539-9aa9-a826755e004d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:45.111904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-405fe967-4197-4539-9aa9-a826755e004d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:45.112753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-405fe967-4197-4539-9aa9-a826755e004d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:45.113389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-405fe967-4197-4539-9aa9-a826755e004d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:45.114317 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-405fe967-4197-4539-9aa9-a826755e004d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:45.114992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-405fe967-4197-4539-9aa9-a826755e004d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:45.115605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-405fe967-4197-4539-9aa9-a826755e004d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:45.339458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d3b85c86-5255-4fc2-9790-fb479075ec57 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:45.349086 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3b85c86-5255-4fc2-9790-fb479075ec57 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1515 microversion: 2.1 time: 0.551399 Aug 18 11:38:45.355609 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1589/3053] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:44 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1515 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:45.444362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4692f597-e811-40e0-9721-61036df6f7af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:45.444991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4692f597-e811-40e0-9721-61036df6f7af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:45.455584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4692f597-e811-40e0-9721-61036df6f7af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:45.456165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4692f597-e811-40e0-9721-61036df6f7af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:45.456609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4692f597-e811-40e0-9721-61036df6f7af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:45.457331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4692f597-e811-40e0-9721-61036df6f7af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:45.463577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4692f597-e811-40e0-9721-61036df6f7af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:45.464376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4692f597-e811-40e0-9721-61036df6f7af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:45.645258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-405fe967-4197-4539-9aa9-a826755e004d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:45.666504 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-405fe967-4197-4539-9aa9-a826755e004d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1485 microversion: 2.1 time: 0.565527 Aug 18 11:38:45.667202 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1465/3054] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:45 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1485 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:45.688131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64749fe9-ff90-4437-b06f-86c272689960 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:45.689399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-64749fe9-ff90-4437-b06f-86c272689960 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:45.696089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64749fe9-ff90-4437-b06f-86c272689960 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:45.696933 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64749fe9-ff90-4437-b06f-86c272689960 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:45.697642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64749fe9-ff90-4437-b06f-86c272689960 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:45.700165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64749fe9-ff90-4437-b06f-86c272689960 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:45.700926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64749fe9-ff90-4437-b06f-86c272689960 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:45.703249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64749fe9-ff90-4437-b06f-86c272689960 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:45.742996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-64749fe9-ff90-4437-b06f-86c272689960 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lazy-loading 'flavor' on Instance uuid 73f65b4f-2652-4d50-b868-5d7258fa7cb4 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:38:45.874968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:46.068259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4692f597-e811-40e0-9721-61036df6f7af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:46.082794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4692f597-e811-40e0-9721-61036df6f7af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:46.084570 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-64749fe9-ff90-4437-b06f-86c272689960 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4/action" status: 202 len: 0 microversion: 2.1 time: 0.400584 Aug 18 11:38:46.090758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4692f597-e811-40e0-9721-61036df6f7af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:46.091401 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1466/3055] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:38:45 2022] POST /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:38:46.092973 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4692f597-e811-40e0-9721-61036df6f7af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1753 microversion: 2.42 time: 0.653553 Aug 18 11:38:46.096823 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1590/3056] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:38:45 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1753 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:38:46.108355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d73aecd4-8995-4653-a8d2-65bfb2524d33 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:46.110552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d73aecd4-8995-4653-a8d2-65bfb2524d33 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:46.111823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a285d5b0-8ac2-41ce-b91f-a5f6e620f233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:46.113567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a285d5b0-8ac2-41ce-b91f-a5f6e620f233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:46.127196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a285d5b0-8ac2-41ce-b91f-a5f6e620f233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:46.130919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a285d5b0-8ac2-41ce-b91f-a5f6e620f233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:46.132975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d73aecd4-8995-4653-a8d2-65bfb2524d33 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:46.133147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d73aecd4-8995-4653-a8d2-65bfb2524d33 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:46.135602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a285d5b0-8ac2-41ce-b91f-a5f6e620f233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:46.136813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a285d5b0-8ac2-41ce-b91f-a5f6e620f233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:46.138798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a285d5b0-8ac2-41ce-b91f-a5f6e620f233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:46.139659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a285d5b0-8ac2-41ce-b91f-a5f6e620f233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:46.141549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d73aecd4-8995-4653-a8d2-65bfb2524d33 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:46.147845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d73aecd4-8995-4653-a8d2-65bfb2524d33 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:46.148354 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d73aecd4-8995-4653-a8d2-65bfb2524d33 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:46.151983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d73aecd4-8995-4653-a8d2-65bfb2524d33 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:46.500737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d73aecd4-8995-4653-a8d2-65bfb2524d33 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:46.514798 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d73aecd4-8995-4653-a8d2-65bfb2524d33 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1371 microversion: 2.1 time: 0.420828 Aug 18 11:38:46.515894 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1467/3057] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:46 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1371 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:46.525184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ec97c3bf-d5c2-4ec4-a3b7-bb16494e9d54 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:46.529667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ec97c3bf-d5c2-4ec4-a3b7-bb16494e9d54 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:46.540077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec97c3bf-d5c2-4ec4-a3b7-bb16494e9d54 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:46.540655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec97c3bf-d5c2-4ec4-a3b7-bb16494e9d54 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:46.541109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec97c3bf-d5c2-4ec4-a3b7-bb16494e9d54 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:46.542289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec97c3bf-d5c2-4ec4-a3b7-bb16494e9d54 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:46.542786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec97c3bf-d5c2-4ec4-a3b7-bb16494e9d54 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:46.543268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec97c3bf-d5c2-4ec4-a3b7-bb16494e9d54 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:46.573953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a285d5b0-8ac2-41ce-b91f-a5f6e620f233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:46.590011 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a285d5b0-8ac2-41ce-b91f-a5f6e620f233 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1491 microversion: 2.1 time: 0.489738 Aug 18 11:38:46.594555 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1591/3058] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:46 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1491 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:46.604841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-764cc882-fe67-4e43-9fcd-04c790efff5b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:46.609021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-764cc882-fe67-4e43-9fcd-04c790efff5b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:46.625041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-764cc882-fe67-4e43-9fcd-04c790efff5b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:46.626728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-764cc882-fe67-4e43-9fcd-04c790efff5b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:46.627327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-764cc882-fe67-4e43-9fcd-04c790efff5b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:46.630173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-764cc882-fe67-4e43-9fcd-04c790efff5b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:46.632337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-764cc882-fe67-4e43-9fcd-04c790efff5b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:46.634186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-764cc882-fe67-4e43-9fcd-04c790efff5b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:47.078058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ec97c3bf-d5c2-4ec4-a3b7-bb16494e9d54 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:47.101518 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ec97c3bf-d5c2-4ec4-a3b7-bb16494e9d54 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1528 microversion: 2.1 time: 0.583269 Aug 18 11:38:47.104464 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1468/3059] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:46 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1528 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:47.120584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-704d5b4e-7359-4eb6-a6dc-3d1423ad3236 req-cbce7cb5-1815-46b2-8016-fdebc18dbfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c22c788-0180-43df-aa4e-48363a89fa79", "tag": "3e914982-c66b-4b57-9305-0f9bbe300f7e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:47.146353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-704d5b4e-7359-4eb6-a6dc-3d1423ad3236 req-cbce7cb5-1815-46b2-8016-fdebc18dbfc8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:47.147220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-704d5b4e-7359-4eb6-a6dc-3d1423ad3236 req-cbce7cb5-1815-46b2-8016-fdebc18dbfc8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:47.153046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-704d5b4e-7359-4eb6-a6dc-3d1423ad3236 req-cbce7cb5-1815-46b2-8016-fdebc18dbfc8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:47.179148 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-704d5b4e-7359-4eb6-a6dc-3d1423ad3236 req-cbce7cb5-1815-46b2-8016-fdebc18dbfc8 service nova] Creating event network-changed:3e914982-c66b-4b57-9305-0f9bbe300f7e for instance 7c22c788-0180-43df-aa4e-48363a89fa79 on n-h1-853611-3 Aug 18 11:38:47.187189 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-704d5b4e-7359-4eb6-a6dc-3d1423ad3236 req-cbce7cb5-1815-46b2-8016-fdebc18dbfc8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081050 Aug 18 11:38:47.193821 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1469/3060] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:47.199464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eb455b77-43a6-4ed4-bfed-16937bacb61e tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:47.211613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-eb455b77-43a6-4ed4-bfed-16937bacb61e tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:47.218327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb455b77-43a6-4ed4-bfed-16937bacb61e tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:47.219173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb455b77-43a6-4ed4-bfed-16937bacb61e tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:47.219800 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb455b77-43a6-4ed4-bfed-16937bacb61e tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:47.220711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb455b77-43a6-4ed4-bfed-16937bacb61e tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:47.221963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb455b77-43a6-4ed4-bfed-16937bacb61e tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:47.227214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb455b77-43a6-4ed4-bfed-16937bacb61e tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:47.466111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-764cc882-fe67-4e43-9fcd-04c790efff5b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:47.482981 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-764cc882-fe67-4e43-9fcd-04c790efff5b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1515 microversion: 2.1 time: 0.884965 Aug 18 11:38:47.497837 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1592/3061] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:46 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1515 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:47.497837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1f9a3bab-a150-444e-8533-5547eda04ed6 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:47.498510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1f9a3bab-a150-444e-8533-5547eda04ed6 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:47.511876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f9a3bab-a150-444e-8533-5547eda04ed6 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:47.512689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f9a3bab-a150-444e-8533-5547eda04ed6 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:47.513146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f9a3bab-a150-444e-8533-5547eda04ed6 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:47.514106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f9a3bab-a150-444e-8533-5547eda04ed6 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:47.514705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f9a3bab-a150-444e-8533-5547eda04ed6 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:47.515148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f9a3bab-a150-444e-8533-5547eda04ed6 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:47.941184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1f9a3bab-a150-444e-8533-5547eda04ed6 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:47.949434 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1f9a3bab-a150-444e-8533-5547eda04ed6 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1528 microversion: 2.1 time: 0.460320 Aug 18 11:38:47.949979 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1593/3062] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:47 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1528 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:47.963326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d36f8c83-9f3c-4993-b3cc-278c974f0540 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:47.967129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d36f8c83-9f3c-4993-b3cc-278c974f0540 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:47.970701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eb455b77-43a6-4ed4-bfed-16937bacb61e tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:47.981067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36f8c83-9f3c-4993-b3cc-278c974f0540 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:47.981681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36f8c83-9f3c-4993-b3cc-278c974f0540 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:47.982925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36f8c83-9f3c-4993-b3cc-278c974f0540 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:47.984467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eb455b77-43a6-4ed4-bfed-16937bacb61e tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:47.985026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36f8c83-9f3c-4993-b3cc-278c974f0540 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:47.986043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36f8c83-9f3c-4993-b3cc-278c974f0540 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:47.989279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eb455b77-43a6-4ed4-bfed-16937bacb61e tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:47.989963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36f8c83-9f3c-4993-b3cc-278c974f0540 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:47.998070 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eb455b77-43a6-4ed4-bfed-16937bacb61e tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1800 microversion: 2.42 time: 0.802675 Aug 18 11:38:47.999337 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1470/3063] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:38:47 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1800 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:38:48.005006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-689788ef-3257-4277-8512-5e249973039d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:48.015498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-689788ef-3257-4277-8512-5e249973039d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:48.030762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-689788ef-3257-4277-8512-5e249973039d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:48.036912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-689788ef-3257-4277-8512-5e249973039d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:48.037668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-689788ef-3257-4277-8512-5e249973039d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:48.038627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-689788ef-3257-4277-8512-5e249973039d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:48.039262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-689788ef-3257-4277-8512-5e249973039d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:48.047018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-689788ef-3257-4277-8512-5e249973039d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:48.093143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:48.152502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=14 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:48.308432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-689788ef-3257-4277-8512-5e249973039d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:48.317229 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-689788ef-3257-4277-8512-5e249973039d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1512 microversion: 2.1 time: 0.316517 Aug 18 11:38:48.317813 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1471/3064] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:47 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1512 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:48.332028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-886ab4d5-b7d8-4aeb-8dc7-cd30850fd567 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:48.333168 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:38:48.333168 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:38:48.365822 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-886ab4d5-b7d8-4aeb-8dc7-cd30850fd567 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/f9035438-2b8a-4310-b3dd-acd834add8e6" status: 202 len: 0 microversion: 2.1 time: 0.046835 Aug 18 11:38:48.369590 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1472/3065] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:38:48 2022] DELETE /compute/v2.1/flavors/f9035438-2b8a-4310-b3dd-acd834add8e6 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:38:48.382303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1437fbe0-6e3c-4560-9bbd-0d6b2cda3757 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:48.421799 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1437fbe0-6e3c-4560-9bbd-0d6b2cda3757 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050958 Aug 18 11:38:48.422408 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1473/3066] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:38:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:48.444152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:48.457495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:48.470463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:48.471634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:48.471634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:48.472161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:48.472752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:48.473037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:48.774795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:48.781750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Old instance type tempest-test_resize_flavor_-1874133541, new instance type m1.heat {{(pid=122209) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 11:38:48.800148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:38:48.811455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:38:48.814589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:38:48.816617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:38:48.822667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:38:49.146871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d36f8c83-9f3c-4993-b3cc-278c974f0540 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:49.162089 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d36f8c83-9f3c-4993-b3cc-278c974f0540 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1371 microversion: 2.1 time: 1.206939 Aug 18 11:38:49.175228 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3788afb8-a79a-44b8-8330-a584da6441a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "POST /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7/action" status: 202 len: 0 microversion: 2.1 time: 0.738914 Aug 18 11:38:49.176530 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1474/3067] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:38:48 2022] POST /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7/action => generated 0 bytes in 741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:38:49.182234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-09a1ffc7-b02b-4421-9522-0cc5f6eda2ea tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:49.183195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-09a1ffc7-b02b-4421-9522-0cc5f6eda2ea tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:49.193299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09a1ffc7-b02b-4421-9522-0cc5f6eda2ea tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:49.194062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09a1ffc7-b02b-4421-9522-0cc5f6eda2ea tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:49.194766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09a1ffc7-b02b-4421-9522-0cc5f6eda2ea tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:49.199751 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1594/3068] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:47 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1371 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:49.200148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09a1ffc7-b02b-4421-9522-0cc5f6eda2ea tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:49.201013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09a1ffc7-b02b-4421-9522-0cc5f6eda2ea tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:49.201658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09a1ffc7-b02b-4421-9522-0cc5f6eda2ea tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:49.216947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1027cf9b-fdec-4976-af28-5d310443b4ba tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:49.219725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1027cf9b-fdec-4976-af28-5d310443b4ba tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:49.244086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1027cf9b-fdec-4976-af28-5d310443b4ba tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:49.265676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1027cf9b-fdec-4976-af28-5d310443b4ba tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:49.267173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1027cf9b-fdec-4976-af28-5d310443b4ba tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:49.269429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1027cf9b-fdec-4976-af28-5d310443b4ba tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:49.270116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1027cf9b-fdec-4976-af28-5d310443b4ba tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:49.271495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1027cf9b-fdec-4976-af28-5d310443b4ba tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:49.462289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=22 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:50.063062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1027cf9b-fdec-4976-af28-5d310443b4ba tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:50.115217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1027cf9b-fdec-4976-af28-5d310443b4ba tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:50.117182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1027cf9b-fdec-4976-af28-5d310443b4ba tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:50.123341 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1027cf9b-fdec-4976-af28-5d310443b4ba tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1847 microversion: 2.42 time: 0.922424 Aug 18 11:38:50.127980 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1595/3069] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:38:49 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1847 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:38:50.145469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-579fe60f-ef3e-4adf-907c-28fc05474817 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:50.153042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-579fe60f-ef3e-4adf-907c-28fc05474817 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:50.179966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:50.214476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-579fe60f-ef3e-4adf-907c-28fc05474817 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:50.215028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-579fe60f-ef3e-4adf-907c-28fc05474817 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:50.215488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-579fe60f-ef3e-4adf-907c-28fc05474817 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:50.223568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-579fe60f-ef3e-4adf-907c-28fc05474817 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:50.224067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-579fe60f-ef3e-4adf-907c-28fc05474817 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:50.224512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-579fe60f-ef3e-4adf-907c-28fc05474817 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:50.698204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-09a1ffc7-b02b-4421-9522-0cc5f6eda2ea tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:50.721976 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-09a1ffc7-b02b-4421-9522-0cc5f6eda2ea tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1515 microversion: 2.1 time: 1.543416 Aug 18 11:38:50.723023 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1475/3070] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:49 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1515 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:50.741668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-96624f59-fea8-49fb-a8e9-676a05f36d5f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:50.742308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-96624f59-fea8-49fb-a8e9-676a05f36d5f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:50.752671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96624f59-fea8-49fb-a8e9-676a05f36d5f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:50.753434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96624f59-fea8-49fb-a8e9-676a05f36d5f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:50.753837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96624f59-fea8-49fb-a8e9-676a05f36d5f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:50.762896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96624f59-fea8-49fb-a8e9-676a05f36d5f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:50.763773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96624f59-fea8-49fb-a8e9-676a05f36d5f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:50.765364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96624f59-fea8-49fb-a8e9-676a05f36d5f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:51.315277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-579fe60f-ef3e-4adf-907c-28fc05474817 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:51.332405 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-579fe60f-ef3e-4adf-907c-28fc05474817 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1537 microversion: 2.1 time: 1.200013 Aug 18 11:38:51.334240 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1596/3071] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:50 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1537 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:51.346618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6b13c56a-f01d-4e8a-acac-877868d6ee74 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:51.348592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6b13c56a-f01d-4e8a-acac-877868d6ee74 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:51.370999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b13c56a-f01d-4e8a-acac-877868d6ee74 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:51.373070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b13c56a-f01d-4e8a-acac-877868d6ee74 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:51.373843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b13c56a-f01d-4e8a-acac-877868d6ee74 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:51.375142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b13c56a-f01d-4e8a-acac-877868d6ee74 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:51.378241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b13c56a-f01d-4e8a-acac-877868d6ee74 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:51.378999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b13c56a-f01d-4e8a-acac-877868d6ee74 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:51.506419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:52.165432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-96624f59-fea8-49fb-a8e9-676a05f36d5f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:52.174527 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-96624f59-fea8-49fb-a8e9-676a05f36d5f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1507 microversion: 2.1 time: 1.438153 Aug 18 11:38:52.175511 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1476/3072] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:50 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1507 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:52.238809 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-16813b3d-2e99-4706-9e92-9e9cc396d7bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:52.240413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-16813b3d-2e99-4706-9e92-9e9cc396d7bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:52.271055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16813b3d-2e99-4706-9e92-9e9cc396d7bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:52.271866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16813b3d-2e99-4706-9e92-9e9cc396d7bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:52.272170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16813b3d-2e99-4706-9e92-9e9cc396d7bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:52.277157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16813b3d-2e99-4706-9e92-9e9cc396d7bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:52.280017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16813b3d-2e99-4706-9e92-9e9cc396d7bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:52.290536 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16813b3d-2e99-4706-9e92-9e9cc396d7bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:53.064546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6b13c56a-f01d-4e8a-acac-877868d6ee74 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:53.079564 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6b13c56a-f01d-4e8a-acac-877868d6ee74 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1371 microversion: 2.1 time: 1.743678 Aug 18 11:38:53.082044 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1597/3073] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:51 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1371 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:53.094040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d1ad57bf-e047-41bb-b02a-f6958b5b8a55 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:53.099130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d1ad57bf-e047-41bb-b02a-f6958b5b8a55 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:53.136738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1ad57bf-e047-41bb-b02a-f6958b5b8a55 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:53.137656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1ad57bf-e047-41bb-b02a-f6958b5b8a55 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:53.138573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1ad57bf-e047-41bb-b02a-f6958b5b8a55 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:53.140247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1ad57bf-e047-41bb-b02a-f6958b5b8a55 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:53.140968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1ad57bf-e047-41bb-b02a-f6958b5b8a55 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:53.141708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1ad57bf-e047-41bb-b02a-f6958b5b8a55 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:53.578107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d1ad57bf-e047-41bb-b02a-f6958b5b8a55 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:53.591792 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d1ad57bf-e047-41bb-b02a-f6958b5b8a55 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1515 microversion: 2.1 time: 0.506664 Aug 18 11:38:53.592963 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1598/3074] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:53 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1515 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:53.605028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2b8689f-cc58-4373-abb9-a25e95a28792 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:53.617059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b2b8689f-cc58-4373-abb9-a25e95a28792 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:53.618242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b2b8689f-cc58-4373-abb9-a25e95a28792 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Searching by: {'deleted': False, 'project_id': '6dd47af6f12647688be7ca8b48bd696f'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:38:53.630021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2b8689f-cc58-4373-abb9-a25e95a28792 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:53.634960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2b8689f-cc58-4373-abb9-a25e95a28792 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:53.635659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2b8689f-cc58-4373-abb9-a25e95a28792 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:53.636702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2b8689f-cc58-4373-abb9-a25e95a28792 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:53.637745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2b8689f-cc58-4373-abb9-a25e95a28792 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:53.638486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2b8689f-cc58-4373-abb9-a25e95a28792 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:53.695853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-b2b8689f-cc58-4373-abb9-a25e95a28792 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:38:53.778952 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b2b8689f-cc58-4373-abb9-a25e95a28792 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.184435 Aug 18 11:38:53.785412 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1599/3075] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 18 11:38:53 2022] GET /compute/v2.1/servers => generated 340 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:53.820659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e1067f1a-2d20-4583-bd2b-58da1d6b9fa5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:53.826268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e1067f1a-2d20-4583-bd2b-58da1d6b9fa5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:53.852546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1067f1a-2d20-4583-bd2b-58da1d6b9fa5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:53.853313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1067f1a-2d20-4583-bd2b-58da1d6b9fa5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:53.853911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1067f1a-2d20-4583-bd2b-58da1d6b9fa5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:53.854868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1067f1a-2d20-4583-bd2b-58da1d6b9fa5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:53.855526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1067f1a-2d20-4583-bd2b-58da1d6b9fa5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:53.856126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1067f1a-2d20-4583-bd2b-58da1d6b9fa5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:53.968320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-16813b3d-2e99-4706-9e92-9e9cc396d7bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:53.995064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-16813b3d-2e99-4706-9e92-9e9cc396d7bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:53.997186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-16813b3d-2e99-4706-9e92-9e9cc396d7bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:53.998477 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-16813b3d-2e99-4706-9e92-9e9cc396d7bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1847 microversion: 2.42 time: 1.794392 Aug 18 11:38:53.999035 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1477/3076] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:38:52 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1847 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:38:54.024139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dff900ad-4ea5-4dcc-bc72-982562a61073 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Action: 'create', calling method: .version_select at 0x7f519f43ea60>, body: {"keypair": {"name": "tempest-keypair-1913082647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECy0wwuIQIQfv54IdYJrb2UTNji5cFxuOgHfAIFptcbr8ENL1efaRl0OgO6HhMbeJfayQM4iWFjJkwrlTUGgxbGLB+TMGl9Ai8mMplSyNb06k1qcv/Yq7X2APr9TrT4Pg=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:54.052304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-dff900ad-4ea5-4dcc-bc72-982562a61073 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Getting quotas for project f185d17297d14e608e8b5f1040c2510b. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:38:54.067948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-dff900ad-4ea5-4dcc-bc72-982562a61073 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Getting quotas for user f79a445f2f764e6e9f6d9916ffca05de and project f185d17297d14e608e8b5f1040c2510b. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:38:54.093106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e1067f1a-2d20-4583-bd2b-58da1d6b9fa5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:54.109218 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e1067f1a-2d20-4583-bd2b-58da1d6b9fa5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1537 microversion: 2.1 time: 0.322284 Aug 18 11:38:54.113985 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1600/3077] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:53 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1537 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:54.122744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59b119ad-720d-4fd8-b8b1-e97a1a00a09e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:54.123985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59b119ad-720d-4fd8-b8b1-e97a1a00a09e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:54.132877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59b119ad-720d-4fd8-b8b1-e97a1a00a09e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:54.133831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59b119ad-720d-4fd8-b8b1-e97a1a00a09e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:54.134470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59b119ad-720d-4fd8-b8b1-e97a1a00a09e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:54.134769 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dff900ad-4ea5-4dcc-bc72-982562a61073 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.134441 Aug 18 11:38:54.135386 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1478/3078] 10.222.0.73 () {62 vars in 1200 bytes} [Thu Aug 18 11:38:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 11:38:54.136522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59b119ad-720d-4fd8-b8b1-e97a1a00a09e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:54.137168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59b119ad-720d-4fd8-b8b1-e97a1a00a09e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:54.137964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59b119ad-720d-4fd8-b8b1-e97a1a00a09e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:54.141412 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:54.162954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:54.163994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Searching by: {'deleted': False, 'project_id': '6dd47af6f12647688be7ca8b48bd696f'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:38:54.169916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:54.170409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:54.170882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:54.171626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:54.172093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:54.172535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:54.254052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:38:54.342641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:54.358017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:54.358533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:54.360402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:54.520575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-59b119ad-720d-4fd8-b8b1-e97a1a00a09e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:54.537534 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59b119ad-720d-4fd8-b8b1-e97a1a00a09e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1507 microversion: 2.1 time: 0.414813 Aug 18 11:38:54.541210 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1601/3079] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:54 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1507 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:54.553415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-562d2887-a0f0-4a23-a336-bf826f75110e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:54.557499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-562d2887-a0f0-4a23-a336-bf826f75110e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:54.586006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-562d2887-a0f0-4a23-a336-bf826f75110e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:54.591497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-562d2887-a0f0-4a23-a336-bf826f75110e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:54.595696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-562d2887-a0f0-4a23-a336-bf826f75110e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:54.598018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-562d2887-a0f0-4a23-a336-bf826f75110e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:54.598748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-562d2887-a0f0-4a23-a336-bf826f75110e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:54.599344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-562d2887-a0f0-4a23-a336-bf826f75110e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:54.943137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-562d2887-a0f0-4a23-a336-bf826f75110e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:54.957820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-562d2887-a0f0-4a23-a336-bf826f75110e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1371 microversion: 2.1 time: 0.415076 Aug 18 11:38:54.977562 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1602/3080] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:54 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1371 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:54.995023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eb6c9478-0525-42a4-a6d3-c389f7487e3e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:54.995689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eb6c9478-0525-42a4-a6d3-c389f7487e3e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:55.028065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb6c9478-0525-42a4-a6d3-c389f7487e3e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:55.033703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb6c9478-0525-42a4-a6d3-c389f7487e3e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:55.034548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb6c9478-0525-42a4-a6d3-c389f7487e3e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:55.036434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb6c9478-0525-42a4-a6d3-c389f7487e3e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:55.040479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb6c9478-0525-42a4-a6d3-c389f7487e3e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:55.044130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb6c9478-0525-42a4-a6d3-c389f7487e3e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:55.512197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-eb6c9478-0525-42a4-a6d3-c389f7487e3e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:55.538848 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eb6c9478-0525-42a4-a6d3-c389f7487e3e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1515 microversion: 2.1 time: 0.557773 Aug 18 11:38:55.540201 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1603/3081] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:54 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1515 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:55.554519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e4d0946-77b5-4724-848d-0c72cfbc12d8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:55.559746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2e4d0946-77b5-4724-848d-0c72cfbc12d8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:55.582086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e4d0946-77b5-4724-848d-0c72cfbc12d8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:55.583586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e4d0946-77b5-4724-848d-0c72cfbc12d8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:55.585570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e4d0946-77b5-4724-848d-0c72cfbc12d8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:55.587219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e4d0946-77b5-4724-848d-0c72cfbc12d8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:55.588599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e4d0946-77b5-4724-848d-0c72cfbc12d8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:55.590079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e4d0946-77b5-4724-848d-0c72cfbc12d8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:56.108443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2e4d0946-77b5-4724-848d-0c72cfbc12d8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:56.128035 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c66bd019-838a-46e3-8e7c-75ffd49c20ca tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 1.990684 Aug 18 11:38:56.129637 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1479/3082] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:38:54 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:56.135793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-389eeb8a-774a-4f75-bc4b-6997903698ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:56.136701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-389eeb8a-774a-4f75-bc4b-6997903698ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:56.164537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-389eeb8a-774a-4f75-bc4b-6997903698ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:56.165162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-389eeb8a-774a-4f75-bc4b-6997903698ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:56.166014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-389eeb8a-774a-4f75-bc4b-6997903698ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:56.168160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-389eeb8a-774a-4f75-bc4b-6997903698ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:56.170202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-389eeb8a-774a-4f75-bc4b-6997903698ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:56.170710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-389eeb8a-774a-4f75-bc4b-6997903698ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:56.173139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2e4d0946-77b5-4724-848d-0c72cfbc12d8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:56.192163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2e4d0946-77b5-4724-848d-0c72cfbc12d8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:56.196257 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2e4d0946-77b5-4724-848d-0c72cfbc12d8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1847 microversion: 2.42 time: 0.653240 Aug 18 11:38:56.201342 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1604/3083] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:38:55 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1847 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:38:56.225202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2810aaab-6dd8-47c7-a634-fdcec47c8c45 req-fac50296-b1fe-4be2-b30d-90797e5fcdec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "tag": "87e91856-1edc-454b-ad68-ad91d5cc3042"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:56.269522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2810aaab-6dd8-47c7-a634-fdcec47c8c45 req-fac50296-b1fe-4be2-b30d-90797e5fcdec service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:56.270386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2810aaab-6dd8-47c7-a634-fdcec47c8c45 req-fac50296-b1fe-4be2-b30d-90797e5fcdec service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:56.272219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2810aaab-6dd8-47c7-a634-fdcec47c8c45 req-fac50296-b1fe-4be2-b30d-90797e5fcdec service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:56.343399 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2810aaab-6dd8-47c7-a634-fdcec47c8c45 req-fac50296-b1fe-4be2-b30d-90797e5fcdec service nova] Creating event network-changed:87e91856-1edc-454b-ad68-ad91d5cc3042 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:38:56.377182 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2810aaab-6dd8-47c7-a634-fdcec47c8c45 req-fac50296-b1fe-4be2-b30d-90797e5fcdec service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166810 Aug 18 11:38:56.379283 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1605/3084] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:56.408770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3b13975-9eae-4669-8b4b-aad50f379806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:56.409919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3b13975-9eae-4669-8b4b-aad50f379806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:56.428986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3b13975-9eae-4669-8b4b-aad50f379806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:56.434456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3b13975-9eae-4669-8b4b-aad50f379806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:56.436434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3b13975-9eae-4669-8b4b-aad50f379806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:56.439786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3b13975-9eae-4669-8b4b-aad50f379806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:56.444642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3b13975-9eae-4669-8b4b-aad50f379806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:56.445325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3b13975-9eae-4669-8b4b-aad50f379806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:56.879978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d3b13975-9eae-4669-8b4b-aad50f379806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:56.898563 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3b13975-9eae-4669-8b4b-aad50f379806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1507 microversion: 2.1 time: 0.513188 Aug 18 11:38:56.900286 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1606/3085] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:56 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1507 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:56.917802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7e33c36-e5ec-4dbb-bfe4-76673868a4aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:56.921618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a7e33c36-e5ec-4dbb-bfe4-76673868a4aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:56.948322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7e33c36-e5ec-4dbb-bfe4-76673868a4aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:56.949527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7e33c36-e5ec-4dbb-bfe4-76673868a4aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:56.951580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7e33c36-e5ec-4dbb-bfe4-76673868a4aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:56.963147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7e33c36-e5ec-4dbb-bfe4-76673868a4aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:56.964543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7e33c36-e5ec-4dbb-bfe4-76673868a4aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:56.968038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7e33c36-e5ec-4dbb-bfe4-76673868a4aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:57.827851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-389eeb8a-774a-4f75-bc4b-6997903698ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:57.837015 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-389eeb8a-774a-4f75-bc4b-6997903698ea tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1537 microversion: 2.1 time: 1.706092 Aug 18 11:38:57.854863 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1480/3086] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:56 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1537 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:57.871425 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-40df56fc-a55f-4995-9e43-a087ee1fdd71 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:57.885757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a7e33c36-e5ec-4dbb-bfe4-76673868a4aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:57.899700 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a7e33c36-e5ec-4dbb-bfe4-76673868a4aa tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1371 microversion: 2.1 time: 0.994223 Aug 18 11:38:57.900524 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1607/3087] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:56 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1371 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:57.923341 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-40df56fc-a55f-4995-9e43-a087ee1fdd71 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.067010 Aug 18 11:38:57.946536 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1481/3088] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:38:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:57.967945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d14c694a-529e-4a34-99ea-00f56f7267cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:57.982873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d14c694a-529e-4a34-99ea-00f56f7267cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:58.046266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d14c694a-529e-4a34-99ea-00f56f7267cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:58.047343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d14c694a-529e-4a34-99ea-00f56f7267cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:58.062374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d14c694a-529e-4a34-99ea-00f56f7267cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:58.069217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d14c694a-529e-4a34-99ea-00f56f7267cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:58.069217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d14c694a-529e-4a34-99ea-00f56f7267cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:58.069217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d14c694a-529e-4a34-99ea-00f56f7267cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:58.352742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b5791718-be55-432c-9b1d-1309ee598904 tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] Action: 'create', calling method: .version_select at 0x7f519fb2a0d0>, body: {"pool": null} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:58.689659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d14c694a-529e-4a34-99ea-00f56f7267cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:58.714764 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d14c694a-529e-4a34-99ea-00f56f7267cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1515 microversion: 2.1 time: 0.762231 Aug 18 11:38:58.735343 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1482/3089] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:57 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1515 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:38:58.751983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-b4b79ae7-2be5-48db-825f-196a9d30f24e req-b79d9849-5b5e-40ef-8c69-8343eed8e01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f65b4f-2652-4d50-b868-5d7258fa7cb4", "name": "network-vif-plugged", "status": "completed", "tag": "d3a33b84-c6d1-47fc-a6d8-29d57933f772"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:38:58.764902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:38:58.768783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b4b79ae7-2be5-48db-825f-196a9d30f24e req-b79d9849-5b5e-40ef-8c69-8343eed8e01b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:58.772315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b4b79ae7-2be5-48db-825f-196a9d30f24e req-b79d9849-5b5e-40ef-8c69-8343eed8e01b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:58.775172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b4b79ae7-2be5-48db-825f-196a9d30f24e req-b79d9849-5b5e-40ef-8c69-8343eed8e01b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:58.797850 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-b4b79ae7-2be5-48db-825f-196a9d30f24e req-b79d9849-5b5e-40ef-8c69-8343eed8e01b service nova] Creating event network-vif-plugged:d3a33b84-c6d1-47fc-a6d8-29d57933f772 for instance 73f65b4f-2652-4d50-b868-5d7258fa7cb4 on n-h1-853611-3 Aug 18 11:38:58.816296 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-b4b79ae7-2be5-48db-825f-196a9d30f24e req-b79d9849-5b5e-40ef-8c69-8343eed8e01b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074998 Aug 18 11:38:58.822891 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1483/3090] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:38:58.838276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cc54e3dc-a17b-40a6-837a-f9d42c28ebb1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:58.840245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cc54e3dc-a17b-40a6-837a-f9d42c28ebb1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:58.859191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc54e3dc-a17b-40a6-837a-f9d42c28ebb1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:58.860113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc54e3dc-a17b-40a6-837a-f9d42c28ebb1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:58.861435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc54e3dc-a17b-40a6-837a-f9d42c28ebb1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:58.862468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc54e3dc-a17b-40a6-837a-f9d42c28ebb1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:58.863560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc54e3dc-a17b-40a6-837a-f9d42c28ebb1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:58.865384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cc54e3dc-a17b-40a6-837a-f9d42c28ebb1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:59.286229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cc54e3dc-a17b-40a6-837a-f9d42c28ebb1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:59.313810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cc54e3dc-a17b-40a6-837a-f9d42c28ebb1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:59.321395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cc54e3dc-a17b-40a6-837a-f9d42c28ebb1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:38:59.323076 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cc54e3dc-a17b-40a6-837a-f9d42c28ebb1 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1868 microversion: 2.42 time: 0.495341 Aug 18 11:38:59.323943 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1484/3091] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:38:58 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1868 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:38:59.331051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e126dac8-bb7b-473f-af61-924930e466eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:38:59.332205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e126dac8-bb7b-473f-af61-924930e466eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:38:59.339506 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e126dac8-bb7b-473f-af61-924930e466eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:59.340814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e126dac8-bb7b-473f-af61-924930e466eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:59.342697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e126dac8-bb7b-473f-af61-924930e466eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:38:59.343871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e126dac8-bb7b-473f-af61-924930e466eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:38:59.344670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e126dac8-bb7b-473f-af61-924930e466eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:38:59.346100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e126dac8-bb7b-473f-af61-924930e466eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:00.504753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e126dac8-bb7b-473f-af61-924930e466eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:00.517850 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e126dac8-bb7b-473f-af61-924930e466eb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1507 microversion: 2.1 time: 1.191961 Aug 18 11:39:00.523188 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1485/3092] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:38:59 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1507 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:00.531939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-54a65643-bbcb-483e-94a6-92c5f6587c41 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:00.535427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-54a65643-bbcb-483e-94a6-92c5f6587c41 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:00.554663 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54a65643-bbcb-483e-94a6-92c5f6587c41 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:00.555610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54a65643-bbcb-483e-94a6-92c5f6587c41 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:00.557101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54a65643-bbcb-483e-94a6-92c5f6587c41 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:00.561927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54a65643-bbcb-483e-94a6-92c5f6587c41 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:00.564696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54a65643-bbcb-483e-94a6-92c5f6587c41 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:00.565628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-54a65643-bbcb-483e-94a6-92c5f6587c41 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:00.645249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-54a65643-bbcb-483e-94a6-92c5f6587c41 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:39:00.652067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:00.913094 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-54a65643-bbcb-483e-94a6-92c5f6587c41 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "DELETE /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 204 len: 0 microversion: 2.1 time: 0.384447 Aug 18 11:39:00.913775 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1486/3093] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:39:00 2022] DELETE /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:39:00.933487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cd81f3a5-1778-4a98-b18b-e8cfd431f330 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:00.936749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cd81f3a5-1778-4a98-b18b-e8cfd431f330 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:00.968321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd81f3a5-1778-4a98-b18b-e8cfd431f330 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:00.969864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd81f3a5-1778-4a98-b18b-e8cfd431f330 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:00.976178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd81f3a5-1778-4a98-b18b-e8cfd431f330 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:00.977053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd81f3a5-1778-4a98-b18b-e8cfd431f330 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:00.977616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd81f3a5-1778-4a98-b18b-e8cfd431f330 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:00.978294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd81f3a5-1778-4a98-b18b-e8cfd431f330 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:01.317002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cd81f3a5-1778-4a98-b18b-e8cfd431f330 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:01.327897 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cd81f3a5-1778-4a98-b18b-e8cfd431f330 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1542 microversion: 2.1 time: 0.409114 Aug 18 11:39:01.329151 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1487/3094] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:00 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1542 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:01.336217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-93362542-22a1-4130-8166-b4da3f49e272 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:01.337145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-93362542-22a1-4130-8166-b4da3f49e272 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:01.346197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93362542-22a1-4130-8166-b4da3f49e272 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:01.347105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93362542-22a1-4130-8166-b4da3f49e272 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:01.347822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93362542-22a1-4130-8166-b4da3f49e272 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:01.348808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93362542-22a1-4130-8166-b4da3f49e272 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:01.349549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93362542-22a1-4130-8166-b4da3f49e272 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:01.350381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-93362542-22a1-4130-8166-b4da3f49e272 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:01.617786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-93362542-22a1-4130-8166-b4da3f49e272 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:01.633976 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-93362542-22a1-4130-8166-b4da3f49e272 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1371 microversion: 2.1 time: 0.300990 Aug 18 11:39:01.634899 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1488/3095] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:01 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:01.640890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-62b84577-4707-4b26-92d6-b012d1ed97e7 req-f9eff165-80c3-4fa3-9fe5-57207092267e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "tag": "7aa0fec2-35fb-4c23-afdd-c14e58f79ef8"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:01.655783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-62b84577-4707-4b26-92d6-b012d1ed97e7 req-f9eff165-80c3-4fa3-9fe5-57207092267e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:01.656677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-62b84577-4707-4b26-92d6-b012d1ed97e7 req-f9eff165-80c3-4fa3-9fe5-57207092267e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:01.661229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-62b84577-4707-4b26-92d6-b012d1ed97e7 req-f9eff165-80c3-4fa3-9fe5-57207092267e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:01.677063 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-62b84577-4707-4b26-92d6-b012d1ed97e7 req-f9eff165-80c3-4fa3-9fe5-57207092267e service nova] Creating event network-changed:7aa0fec2-35fb-4c23-afdd-c14e58f79ef8 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:39:01.683266 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-62b84577-4707-4b26-92d6-b012d1ed97e7 req-f9eff165-80c3-4fa3-9fe5-57207092267e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046349 Aug 18 11:39:01.691675 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1489/3096] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:01.700333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-880d8953-19bb-4625-b7e5-0471e2e708ee tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:01.701453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-880d8953-19bb-4625-b7e5-0471e2e708ee tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:01.713113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-880d8953-19bb-4625-b7e5-0471e2e708ee tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:01.714103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-880d8953-19bb-4625-b7e5-0471e2e708ee tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:01.714863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-880d8953-19bb-4625-b7e5-0471e2e708ee tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:01.722917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-880d8953-19bb-4625-b7e5-0471e2e708ee tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:01.723815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-880d8953-19bb-4625-b7e5-0471e2e708ee tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:01.727516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-880d8953-19bb-4625-b7e5-0471e2e708ee tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:01.950710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-880d8953-19bb-4625-b7e5-0471e2e708ee tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:01.960543 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-880d8953-19bb-4625-b7e5-0471e2e708ee tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1515 microversion: 2.1 time: 0.266958 Aug 18 11:39:01.961140 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1490/3097] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:01 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1515 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:01.968465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-addcf683-22b1-40a2-9151-5de1285a2fa9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:01.969090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-addcf683-22b1-40a2-9151-5de1285a2fa9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:01.988882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-addcf683-22b1-40a2-9151-5de1285a2fa9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:01.990073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-addcf683-22b1-40a2-9151-5de1285a2fa9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:01.990810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-addcf683-22b1-40a2-9151-5de1285a2fa9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:01.993141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-addcf683-22b1-40a2-9151-5de1285a2fa9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:01.993957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-addcf683-22b1-40a2-9151-5de1285a2fa9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:01.998117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-addcf683-22b1-40a2-9151-5de1285a2fa9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:02.083600 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b5791718-be55-432c-9b1d-1309ee598904 tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.181468 Aug 18 11:39:02.084250 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1608/3098] 10.222.0.73 () {60 vars in 1170 bytes} [Thu Aug 18 11:38:57 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:02.092213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2058163802", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8c594f0f-ed54-4542-9fe3-353c47d1c6dc"}, {"port": "859fae89-a340-43ad-b582-571eb9a2c528", "tag": "port-1"}, {"port": "7e93816f-c07f-4c92-8bba-fbb519c88407", "tag": "port-2"}, {"uuid": "146fabbf-090d-4382-83a0-2591a1855b6e", "tag": "net-1"}, {"uuid": "146fabbf-090d-4382-83a0-2591a1855b6e"}, {"uuid": "0fb91d85-8e61-4b9d-a5bd-59ae88b9f41a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0fb91d85-8e61-4b9d-a5bd-59ae88b9f41a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "4dce1942-7658-428c-9fb0-dc4e113f7b89", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "34d1ac58-1921-4f39-9127-0739ae82a75a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "1ea3b466-d3f3-4653-879a-7ad50b715ff6", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1813575852"}], "key_name": "tempest-keypair-1913082647", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:02.256643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] validate_networks() for [('8c594f0f-ed54-4542-9fe3-353c47d1c6dc', None, None, None, None, None), (None, None, '859fae89-a340-43ad-b582-571eb9a2c528', None, None, None), (None, None, '7e93816f-c07f-4c92-8bba-fbb519c88407', None, None, None), ('146fabbf-090d-4382-83a0-2591a1855b6e', None, None, None, None, None), ('146fabbf-090d-4382-83a0-2591a1855b6e', None, None, None, None, None), ('0fb91d85-8e61-4b9d-a5bd-59ae88b9f41a', '10.2.2.100', None, None, None, None), ('0fb91d85-8e61-4b9d-a5bd-59ae88b9f41a', '10.2.2.200', None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:39:03.012776 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-addcf683-22b1-40a2-9151-5de1285a2fa9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:03.023914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-addcf683-22b1-40a2-9151-5de1285a2fa9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:03.036636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-addcf683-22b1-40a2-9151-5de1285a2fa9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:03.040667 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-addcf683-22b1-40a2-9151-5de1285a2fa9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1889 microversion: 2.42 time: 1.076102 Aug 18 11:39:03.043571 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1491/3099] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:01 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1889 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:03.058664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-69e23511-44ec-4928-a7e1-49171815af60 req-146d9c83-58a7-4b63-89ae-61c8a16e0dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c22c788-0180-43df-aa4e-48363a89fa79", "name": "network-vif-plugged", "status": "completed", "tag": "3e914982-c66b-4b57-9305-0f9bbe300f7e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:03.082167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-69e23511-44ec-4928-a7e1-49171815af60 req-146d9c83-58a7-4b63-89ae-61c8a16e0dc2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:03.085991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-69e23511-44ec-4928-a7e1-49171815af60 req-146d9c83-58a7-4b63-89ae-61c8a16e0dc2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:03.087780 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-69e23511-44ec-4928-a7e1-49171815af60 req-146d9c83-58a7-4b63-89ae-61c8a16e0dc2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:03.116338 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-69e23511-44ec-4928-a7e1-49171815af60 req-146d9c83-58a7-4b63-89ae-61c8a16e0dc2 service nova] Creating event network-vif-plugged:3e914982-c66b-4b57-9305-0f9bbe300f7e for instance 7c22c788-0180-43df-aa4e-48363a89fa79 on n-h1-853611-3 Aug 18 11:39:03.132585 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-69e23511-44ec-4928-a7e1-49171815af60 req-146d9c83-58a7-4b63-89ae-61c8a16e0dc2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086773 Aug 18 11:39:03.136971 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1492/3100] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:03.143611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fe559800-bb81-4cdf-a706-abda2bfd517c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:03.152894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fe559800-bb81-4cdf-a706-abda2bfd517c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:03.163438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe559800-bb81-4cdf-a706-abda2bfd517c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:03.167973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe559800-bb81-4cdf-a706-abda2bfd517c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:03.168647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe559800-bb81-4cdf-a706-abda2bfd517c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:03.169607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe559800-bb81-4cdf-a706-abda2bfd517c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:03.170283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe559800-bb81-4cdf-a706-abda2bfd517c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:03.173292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe559800-bb81-4cdf-a706-abda2bfd517c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:03.670136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:03.772643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fe559800-bb81-4cdf-a706-abda2bfd517c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd01fe65b2b45828e0925aa49200fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd47af6f12647688be7ca8b48bd696f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:03.788005 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fe559800-bb81-4cdf-a706-abda2bfd517c tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 200 len: 1713 microversion: 2.1 time: 0.649440 Aug 18 11:39:03.801516 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1493/3101] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:03 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 1713 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:03.801516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a59670e2-50e1-422e-919a-18ea217658c1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:03.801516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a59670e2-50e1-422e-919a-18ea217658c1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:03.820559 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a59670e2-50e1-422e-919a-18ea217658c1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:03.821057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a59670e2-50e1-422e-919a-18ea217658c1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:03.821498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a59670e2-50e1-422e-919a-18ea217658c1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:03.822220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a59670e2-50e1-422e-919a-18ea217658c1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:03.822711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a59670e2-50e1-422e-919a-18ea217658c1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:03.823146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a59670e2-50e1-422e-919a-18ea217658c1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:04.179593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:04.237223 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a59670e2-50e1-422e-919a-18ea217658c1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:04.255866 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a59670e2-50e1-422e-919a-18ea217658c1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1507 microversion: 2.1 time: 0.459935 Aug 18 11:39:04.256965 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1494/3102] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:03 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1507 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:04.269566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2db2afe0-5385-463f-9402-4bff5b7a49cc tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] Action: 'create', calling method: .version_select at 0x7f519f771dc0>, body: {"pool": null} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:04.341095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:05.556670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:39:05.557803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:39:05.558615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:39:05.559440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:39:05.560244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:39:05.592005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:05.592887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:05.593712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:05.595590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:05.600889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:05.601715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:05.647942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Getting quotas for project f185d17297d14e608e8b5f1040c2510b. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:05.661111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Getting quotas for user f79a445f2f764e6e9f6d9916ffca05de and project f185d17297d14e608e8b5f1040c2510b. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:05.884581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:39:05.888387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='4dce1942-7658-428c-9fb0-dc4e113f7b89',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='34d1ac58-1921-4f39-9127-0739ae82a75a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ea3b466-d3f3-4653-879a-7ad50b715ff6',volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:39:06.596392 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fcef5862-ac7e-4f93-95a9-9851ead8df0d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 4.510875 Aug 18 11:39:06.597638 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1609/3103] 10.222.0.73 () {62 vars in 1189 bytes} [Thu Aug 18 11:39:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 4513 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 11:39:06.603760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-622abe1c-6d32-4b1d-9c97-2785761c4d8e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:06.605202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-622abe1c-6d32-4b1d-9c97-2785761c4d8e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:06.612715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-622abe1c-6d32-4b1d-9c97-2785761c4d8e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:06.613216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-622abe1c-6d32-4b1d-9c97-2785761c4d8e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:06.613658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-622abe1c-6d32-4b1d-9c97-2785761c4d8e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:06.614644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-622abe1c-6d32-4b1d-9c97-2785761c4d8e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:06.615114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-622abe1c-6d32-4b1d-9c97-2785761c4d8e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:06.615545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-622abe1c-6d32-4b1d-9c97-2785761c4d8e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:06.997052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-622abe1c-6d32-4b1d-9c97-2785761c4d8e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:07.014161 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-622abe1c-6d32-4b1d-9c97-2785761c4d8e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1542 microversion: 2.1 time: 0.415393 Aug 18 11:39:07.014976 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1610/3104] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:06 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1542 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:07.034145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4b91f568-0532-42ac-bf32-8be47dae6993 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:07.035307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4b91f568-0532-42ac-bf32-8be47dae6993 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:07.047452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b91f568-0532-42ac-bf32-8be47dae6993 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:07.064715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b91f568-0532-42ac-bf32-8be47dae6993 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:07.068658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b91f568-0532-42ac-bf32-8be47dae6993 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:07.070840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b91f568-0532-42ac-bf32-8be47dae6993 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:07.070840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b91f568-0532-42ac-bf32-8be47dae6993 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:07.072246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b91f568-0532-42ac-bf32-8be47dae6993 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:07.392830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4b91f568-0532-42ac-bf32-8be47dae6993 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:07.403587 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4b91f568-0532-42ac-bf32-8be47dae6993 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1565 microversion: 2.1 time: 0.385943 Aug 18 11:39:07.404985 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1611/3105] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:07 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1565 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:07.411184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-079f0e4a-02b2-4386-aa33-84bea7e9f5f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:07.411981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-079f0e4a-02b2-4386-aa33-84bea7e9f5f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:07.423111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-079f0e4a-02b2-4386-aa33-84bea7e9f5f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:07.424048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-079f0e4a-02b2-4386-aa33-84bea7e9f5f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:07.424874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-079f0e4a-02b2-4386-aa33-84bea7e9f5f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:07.425916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-079f0e4a-02b2-4386-aa33-84bea7e9f5f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:07.438471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-079f0e4a-02b2-4386-aa33-84bea7e9f5f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:07.439311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-079f0e4a-02b2-4386-aa33-84bea7e9f5f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:07.834716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-079f0e4a-02b2-4386-aa33-84bea7e9f5f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:07.834716 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-079f0e4a-02b2-4386-aa33-84bea7e9f5f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1515 microversion: 2.1 time: 0.403640 Aug 18 11:39:07.834716 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1612/3106] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:07 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1515 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:07.834716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f3aafe65-2f0a-4adf-84c2-ac5753808c3e req-88850379-33ac-4dec-9663-6d96d09500b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "tag": "4a2069c0-71e1-43d0-8277-fb9b9a43de8b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:07.834716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f3aafe65-2f0a-4adf-84c2-ac5753808c3e req-88850379-33ac-4dec-9663-6d96d09500b8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:07.834716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f3aafe65-2f0a-4adf-84c2-ac5753808c3e req-88850379-33ac-4dec-9663-6d96d09500b8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:07.834716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f3aafe65-2f0a-4adf-84c2-ac5753808c3e req-88850379-33ac-4dec-9663-6d96d09500b8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:07.855581 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f3aafe65-2f0a-4adf-84c2-ac5753808c3e req-88850379-33ac-4dec-9663-6d96d09500b8 service nova] Creating event network-changed:4a2069c0-71e1-43d0-8277-fb9b9a43de8b for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:39:07.871464 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f3aafe65-2f0a-4adf-84c2-ac5753808c3e req-88850379-33ac-4dec-9663-6d96d09500b8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050026 Aug 18 11:39:07.874081 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1613/3107] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:07.889733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3bcc9766-5451-4edb-82f3-d02bf10ab0af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:07.890543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3bcc9766-5451-4edb-82f3-d02bf10ab0af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:07.898283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bcc9766-5451-4edb-82f3-d02bf10ab0af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:07.900409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bcc9766-5451-4edb-82f3-d02bf10ab0af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:07.900919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bcc9766-5451-4edb-82f3-d02bf10ab0af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:07.901817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bcc9766-5451-4edb-82f3-d02bf10ab0af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:07.905792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bcc9766-5451-4edb-82f3-d02bf10ab0af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:07.906257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bcc9766-5451-4edb-82f3-d02bf10ab0af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:08.290515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3bcc9766-5451-4edb-82f3-d02bf10ab0af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:08.305760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3bcc9766-5451-4edb-82f3-d02bf10ab0af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:08.307598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3bcc9766-5451-4edb-82f3-d02bf10ab0af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:08.311447 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3bcc9766-5451-4edb-82f3-d02bf10ab0af tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1889 microversion: 2.42 time: 0.435806 Aug 18 11:39:08.323685 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1614/3108] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:07 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1889 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:08.337351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bc2e46d2-3257-4696-9421-9c985f18eed9 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:08.338218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bc2e46d2-3257-4696-9421-9c985f18eed9 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] [instance: 89052d85-6a54-433c-8b86-88e2835c2f28] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:08.364597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc2e46d2-3257-4696-9421-9c985f18eed9 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:08.365184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc2e46d2-3257-4696-9421-9c985f18eed9 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:08.365697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc2e46d2-3257-4696-9421-9c985f18eed9 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:08.366498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc2e46d2-3257-4696-9421-9c985f18eed9 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:08.367038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc2e46d2-3257-4696-9421-9c985f18eed9 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:08.367509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc2e46d2-3257-4696-9421-9c985f18eed9 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:08.407515 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-bc2e46d2-3257-4696-9421-9c985f18eed9 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] HTTP exception thrown: Instance 89052d85-6a54-433c-8b86-88e2835c2f28 could not be found. Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bc2e46d2-3257-4696-9421-9c985f18eed9 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Request method failure captured: Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 HTTP/1.1 Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iR-8f-8jjL8dVN83fYlyfS5TWnvMKDbQWqBDvfR2VV4yB6nJQmcXLNeRB9ku24Wmgx4UbhEt0xRnt6TYcEmSZRAzjPfuQ2ZPfs5ZkNymb-sjh8x0zC74dAh91-NTuHNtltIZrlCONNW6Tot-lJwSJewDv1lHGlQBqG8l0tm9xfGZLk Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6dd47af6f12647688be7ca8b48bd696f Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestManualDisk-2061445002 Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6dd47af6f12647688be7ca8b48bd696f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6dd47af6f12647688be7ca8b48bd696f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6dd47af6f12647688be7ca8b48bd696f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6dd47af6f12647688be7ca8b48bd696f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestManualDisk-2061445002 Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6dd47af6f12647688be7ca8b48bd696f Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestManualDisk-2061445002 Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestManualDisk-2061445002-project Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 5bd01fe65b2b45828e0925aa49200fd1 Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestManualDisk-2061445002-project Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 89052d85-6a54-433c-8b86-88e2835c2f28 could not be found. Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '89052d85-6a54-433c-8b86-88e2835c2f28'} Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89052d85-6a54-433c-8b86-88e2835c2f28 could not be found. Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89052d85-6a54-433c-8b86-88e2835c2f28 could not be found. Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:08.416560 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:08.422068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:08.422068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:08.422068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:08.422068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:39:08.422068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:39:08.422068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89052d85-6a54-433c-8b86-88e2835c2f28 could not be found. Aug 18 11:39:08.422068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:08.422068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bc2e46d2-3257-4696-9421-9c985f18eed9 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Returning 404 to user: Instance 89052d85-6a54-433c-8b86-88e2835c2f28 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:39:08.422068 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bc2e46d2-3257-4696-9421-9c985f18eed9 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28" status: 404 len: 111 microversion: 2.1 time: 0.092498 Aug 18 11:39:08.422068 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1615/3109] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:08 2022] GET /compute/v2.1/servers/89052d85-6a54-433c-8b86-88e2835c2f28 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:39:08.444676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9619f985-6e4c-40dc-bef3-72468644e2d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:08.451076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9619f985-6e4c-40dc-bef3-72468644e2d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:08.462120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9619f985-6e4c-40dc-bef3-72468644e2d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:08.463551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9619f985-6e4c-40dc-bef3-72468644e2d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:08.465613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9619f985-6e4c-40dc-bef3-72468644e2d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:08.470706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9619f985-6e4c-40dc-bef3-72468644e2d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:08.471742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9619f985-6e4c-40dc-bef3-72468644e2d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:08.472424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9619f985-6e4c-40dc-bef3-72468644e2d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:08.692564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9619f985-6e4c-40dc-bef3-72468644e2d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:08.702453 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9619f985-6e4c-40dc-bef3-72468644e2d4 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1507 microversion: 2.1 time: 0.278782 Aug 18 11:39:08.704208 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1616/3110] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:08 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:08.709554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-883870c5-a30d-4974-a42c-0f944a876ec4 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:08.710343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-883870c5-a30d-4974-a42c-0f944a876ec4 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:08.729878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-883870c5-a30d-4974-a42c-0f944a876ec4 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:08.738076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-883870c5-a30d-4974-a42c-0f944a876ec4 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:08.740001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-883870c5-a30d-4974-a42c-0f944a876ec4 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:08.742470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-883870c5-a30d-4974-a42c-0f944a876ec4 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:08.743687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-883870c5-a30d-4974-a42c-0f944a876ec4 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:08.744948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-883870c5-a30d-4974-a42c-0f944a876ec4 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:08.813660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:08.894908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-883870c5-a30d-4974-a42c-0f944a876ec4 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:08.906352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-883870c5-a30d-4974-a42c-0f944a876ec4 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:08.908536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-883870c5-a30d-4974-a42c-0f944a876ec4 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:08.910014 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-883870c5-a30d-4974-a42c-0f944a876ec4 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1576 microversion: 2.32 time: 0.204350 Aug 18 11:39:08.911303 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1617/3111] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:08 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:08.916351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-80936c8e-171a-4d80-a013-321ea14ec166 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:08.916993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-80936c8e-171a-4d80-a013-321ea14ec166 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:08.923981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80936c8e-171a-4d80-a013-321ea14ec166 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:08.924750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80936c8e-171a-4d80-a013-321ea14ec166 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:08.925379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80936c8e-171a-4d80-a013-321ea14ec166 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:08.926406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80936c8e-171a-4d80-a013-321ea14ec166 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:08.927057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80936c8e-171a-4d80-a013-321ea14ec166 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:08.927675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80936c8e-171a-4d80-a013-321ea14ec166 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:09.041476 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-80936c8e-171a-4d80-a013-321ea14ec166 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128797 Aug 18 11:39:09.042166 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1618/3112] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:39:08 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:09.047826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-38d48e3a-f31d-46cf-b349-318a1779e152 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:09.049921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-38d48e3a-f31d-46cf-b349-318a1779e152 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:09.060822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38d48e3a-f31d-46cf-b349-318a1779e152 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:09.063706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38d48e3a-f31d-46cf-b349-318a1779e152 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:09.070072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38d48e3a-f31d-46cf-b349-318a1779e152 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:09.073600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38d48e3a-f31d-46cf-b349-318a1779e152 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:09.074102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38d48e3a-f31d-46cf-b349-318a1779e152 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:09.074584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38d48e3a-f31d-46cf-b349-318a1779e152 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:09.131527 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2db2afe0-5385-463f-9402-4bff5b7a49cc tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.873334 Aug 18 11:39:09.132593 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1495/3113] 10.222.0.73 () {60 vars in 1170 bytes} [Thu Aug 18 11:39:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:09.138359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-50061426-a77c-4fc7-b468-91b4d5532e06 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] Calling method '.version_select at 0x7f519f931820>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:09.206647 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-50061426-a77c-4fc7-b468-91b4d5532e06 tempest-ServersTestManualDisk-2061445002 tempest-ServersTestManualDisk-2061445002-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-396525055" status: 202 len: 0 microversion: 2.1 time: 0.072788 Aug 18 11:39:09.207925 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1496/3114] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 18 11:39:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-396525055 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:39:09.213101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-51dae4b1-037b-461d-9fdd-8827caeb0ca0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:09.214051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-51dae4b1-037b-461d-9fdd-8827caeb0ca0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:09.239391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51dae4b1-037b-461d-9fdd-8827caeb0ca0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:09.240984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51dae4b1-037b-461d-9fdd-8827caeb0ca0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:09.243526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51dae4b1-037b-461d-9fdd-8827caeb0ca0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:09.244442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51dae4b1-037b-461d-9fdd-8827caeb0ca0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:09.245874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51dae4b1-037b-461d-9fdd-8827caeb0ca0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:09.247733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51dae4b1-037b-461d-9fdd-8827caeb0ca0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:09.468696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-38d48e3a-f31d-46cf-b349-318a1779e152 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:09.482830 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-38d48e3a-f31d-46cf-b349-318a1779e152 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1542 microversion: 2.1 time: 0.439311 Aug 18 11:39:09.488180 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1619/3115] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:09 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1542 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:09.494243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b7f2c98e-0fd8-4e62-9826-4e5dfa6e1505 tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] Action: 'create', calling method: .version_select at 0x7f519f78a8b0>, body: {"pool": null} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:10.098911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-51dae4b1-037b-461d-9fdd-8827caeb0ca0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:10.108576 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-51dae4b1-037b-461d-9fdd-8827caeb0ca0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1515 microversion: 2.1 time: 0.899401 Aug 18 11:39:10.111969 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1497/3116] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:09 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1515 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:10.118998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-96131543-9110-4436-b2fd-552d0b80253c tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:10.131344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-96131543-9110-4436-b2fd-552d0b80253c tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:10.137545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96131543-9110-4436-b2fd-552d0b80253c tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:10.138752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96131543-9110-4436-b2fd-552d0b80253c tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:10.139353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96131543-9110-4436-b2fd-552d0b80253c tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:10.140253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96131543-9110-4436-b2fd-552d0b80253c tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:10.140860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96131543-9110-4436-b2fd-552d0b80253c tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:10.142048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96131543-9110-4436-b2fd-552d0b80253c tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:10.852680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-96131543-9110-4436-b2fd-552d0b80253c tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:10.862485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-96131543-9110-4436-b2fd-552d0b80253c tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:10.864011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-96131543-9110-4436-b2fd-552d0b80253c tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:10.865181 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-96131543-9110-4436-b2fd-552d0b80253c tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.752087 Aug 18 11:39:10.888290 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1498/3117] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:10 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:10.897904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3aeac474-b352-4b2d-bb66-cbe597b6347f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:10.898823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3aeac474-b352-4b2d-bb66-cbe597b6347f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:10.917948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3aeac474-b352-4b2d-bb66-cbe597b6347f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:10.925190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3aeac474-b352-4b2d-bb66-cbe597b6347f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:10.925962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3aeac474-b352-4b2d-bb66-cbe597b6347f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:10.928691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3aeac474-b352-4b2d-bb66-cbe597b6347f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:10.933379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3aeac474-b352-4b2d-bb66-cbe597b6347f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:10.934020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3aeac474-b352-4b2d-bb66-cbe597b6347f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:11.536399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3aeac474-b352-4b2d-bb66-cbe597b6347f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:11.545009 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3aeac474-b352-4b2d-bb66-cbe597b6347f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1507 microversion: 2.1 time: 0.655271 Aug 18 11:39:11.547738 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1499/3118] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:10 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1507 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:11.576804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fc91e7d3-cfb4-479e-9842-61965e9dceca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:11.580711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fc91e7d3-cfb4-479e-9842-61965e9dceca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:11.596265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc91e7d3-cfb4-479e-9842-61965e9dceca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:11.597092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc91e7d3-cfb4-479e-9842-61965e9dceca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:11.597703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc91e7d3-cfb4-479e-9842-61965e9dceca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:11.598967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc91e7d3-cfb4-479e-9842-61965e9dceca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:11.600741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc91e7d3-cfb4-479e-9842-61965e9dceca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:11.601362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc91e7d3-cfb4-479e-9842-61965e9dceca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:11.734311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fc91e7d3-cfb4-479e-9842-61965e9dceca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:11.757066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fc91e7d3-cfb4-479e-9842-61965e9dceca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:11.758928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fc91e7d3-cfb4-479e-9842-61965e9dceca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:11.760101 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fc91e7d3-cfb4-479e-9842-61965e9dceca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1594 microversion: 2.32 time: 0.194654 Aug 18 11:39:11.776713 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1500/3119] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:11 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1594 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:11.776713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-376c5170-bb4c-462b-a833-7acc3ac23e0e req-2c76e49c-e2df-4bf4-93cf-8070fab59749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "tag": "a8cc0ae7-4375-4ddf-bae4-66fb1bc368e4"}, {"server_uuid": "89052d85-6a54-433c-8b86-88e2835c2f28", "name": "network-vif-deleted", "tag": "6b64a832-bb8d-4ca3-9d19-22572472748b"}, {"name": "network-changed", "server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "tag": "cd3590e3-c7bc-46ed-9406-3be3fdd8f424"}, {"name": "network-changed", "server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "tag": "e2a4d3da-f8cb-4b7f-8b3f-325a41f5e8de"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:11.796792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-376c5170-bb4c-462b-a833-7acc3ac23e0e req-2c76e49c-e2df-4bf4-93cf-8070fab59749 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:11.797304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-376c5170-bb4c-462b-a833-7acc3ac23e0e req-2c76e49c-e2df-4bf4-93cf-8070fab59749 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:11.803158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-376c5170-bb4c-462b-a833-7acc3ac23e0e req-2c76e49c-e2df-4bf4-93cf-8070fab59749 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:11.830758 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-376c5170-bb4c-462b-a833-7acc3ac23e0e req-2c76e49c-e2df-4bf4-93cf-8070fab59749 service nova] Creating event network-changed:a8cc0ae7-4375-4ddf-bae4-66fb1bc368e4 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:39:11.831529 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-376c5170-bb4c-462b-a833-7acc3ac23e0e req-2c76e49c-e2df-4bf4-93cf-8070fab59749 service nova] Creating event network-vif-deleted:6b64a832-bb8d-4ca3-9d19-22572472748b for instance 89052d85-6a54-433c-8b86-88e2835c2f28 on n-h2-853611-3 Aug 18 11:39:11.832214 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-376c5170-bb4c-462b-a833-7acc3ac23e0e req-2c76e49c-e2df-4bf4-93cf-8070fab59749 service nova] Creating event network-changed:cd3590e3-c7bc-46ed-9406-3be3fdd8f424 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:39:11.833997 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-376c5170-bb4c-462b-a833-7acc3ac23e0e req-2c76e49c-e2df-4bf4-93cf-8070fab59749 service nova] Creating event network-changed:e2a4d3da-f8cb-4b7f-8b3f-325a41f5e8de for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:39:11.857863 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-376c5170-bb4c-462b-a833-7acc3ac23e0e req-2c76e49c-e2df-4bf4-93cf-8070fab59749 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 684 microversion: 2.1 time: 0.086124 Aug 18 11:39:11.858984 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1501/3120] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 684 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:11.872037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4e755c79-d769-4c27-8c02-960adff998f9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:11.873364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4e755c79-d769-4c27-8c02-960adff998f9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:11.890216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e755c79-d769-4c27-8c02-960adff998f9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:11.891864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e755c79-d769-4c27-8c02-960adff998f9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:11.893281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e755c79-d769-4c27-8c02-960adff998f9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:11.894422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e755c79-d769-4c27-8c02-960adff998f9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:11.896511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e755c79-d769-4c27-8c02-960adff998f9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:11.898349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e755c79-d769-4c27-8c02-960adff998f9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:12.457635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4e755c79-d769-4c27-8c02-960adff998f9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:12.466150 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4e755c79-d769-4c27-8c02-960adff998f9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1542 microversion: 2.1 time: 0.605370 Aug 18 11:39:12.467082 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1502/3121] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:11 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1542 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:12.501526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5ab5c5eb-f69b-464d-8575-a040d04a5ade tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:12.502636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5ab5c5eb-f69b-464d-8575-a040d04a5ade tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:12.518320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ab5c5eb-f69b-464d-8575-a040d04a5ade tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:12.519226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ab5c5eb-f69b-464d-8575-a040d04a5ade tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:12.519895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ab5c5eb-f69b-464d-8575-a040d04a5ade tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:12.520865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ab5c5eb-f69b-464d-8575-a040d04a5ade tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:12.521571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ab5c5eb-f69b-464d-8575-a040d04a5ade tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:12.522220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ab5c5eb-f69b-464d-8575-a040d04a5ade tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:12.909414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5ab5c5eb-f69b-464d-8575-a040d04a5ade tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:12.925745 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5ab5c5eb-f69b-464d-8575-a040d04a5ade tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1521 microversion: 2.1 time: 0.437660 Aug 18 11:39:12.943299 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1503/3122] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:12 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:12.954250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b4a12062-fa9e-45b7-9806-690c4a5d4d56 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:12.958143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b4a12062-fa9e-45b7-9806-690c4a5d4d56 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:12.968614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b4a12062-fa9e-45b7-9806-690c4a5d4d56 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:12.973950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b4a12062-fa9e-45b7-9806-690c4a5d4d56 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:12.976655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b4a12062-fa9e-45b7-9806-690c4a5d4d56 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:12.977790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b4a12062-fa9e-45b7-9806-690c4a5d4d56 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:12.978511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b4a12062-fa9e-45b7-9806-690c4a5d4d56 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:12.981147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b4a12062-fa9e-45b7-9806-690c4a5d4d56 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:14.036982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b4a12062-fa9e-45b7-9806-690c4a5d4d56 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:14.046486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b4a12062-fa9e-45b7-9806-690c4a5d4d56 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:14.057282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b4a12062-fa9e-45b7-9806-690c4a5d4d56 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:14.065115 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b4a12062-fa9e-45b7-9806-690c4a5d4d56 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 1.119768 Aug 18 11:39:14.091108 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1504/3123] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:12 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:14.099120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-5d7868c4-70ce-4724-b059-1ba288628634 req-fcefdfdc-db11-4153-8adc-f2bc1a715ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c22c788-0180-43df-aa4e-48363a89fa79", "tag": "3e914982-c66b-4b57-9305-0f9bbe300f7e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:14.151303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5d7868c4-70ce-4724-b059-1ba288628634 req-fcefdfdc-db11-4153-8adc-f2bc1a715ad1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:14.151805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5d7868c4-70ce-4724-b059-1ba288628634 req-fcefdfdc-db11-4153-8adc-f2bc1a715ad1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:14.152246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5d7868c4-70ce-4724-b059-1ba288628634 req-fcefdfdc-db11-4153-8adc-f2bc1a715ad1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:14.211351 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5d7868c4-70ce-4724-b059-1ba288628634 req-fcefdfdc-db11-4153-8adc-f2bc1a715ad1 service nova] Creating event network-changed:3e914982-c66b-4b57-9305-0f9bbe300f7e for instance 7c22c788-0180-43df-aa4e-48363a89fa79 on n-h1-853611-3 Aug 18 11:39:14.215331 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b7f2c98e-0fd8-4e62-9826-4e5dfa6e1505 tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.725634 Aug 18 11:39:14.216885 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1620/3124] 10.222.0.73 () {60 vars in 1170 bytes} [Thu Aug 18 11:39:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:14.223258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6ac0b1f-75c3-48f8-8859-f1f90f380b00 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:14.224115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c6ac0b1f-75c3-48f8-8859-f1f90f380b00 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:14.225889 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-5d7868c4-70ce-4724-b059-1ba288628634 req-fcefdfdc-db11-4153-8adc-f2bc1a715ad1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133029 Aug 18 11:39:14.227224 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1505/3125] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:14.234137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7c2ed537-1d29-43d5-8f5d-ec905dae1fca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:14.239493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7c2ed537-1d29-43d5-8f5d-ec905dae1fca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:14.254372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6ac0b1f-75c3-48f8-8859-f1f90f380b00 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:14.254881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c2ed537-1d29-43d5-8f5d-ec905dae1fca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:14.255544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6ac0b1f-75c3-48f8-8859-f1f90f380b00 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:14.255690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c2ed537-1d29-43d5-8f5d-ec905dae1fca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:14.256776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6ac0b1f-75c3-48f8-8859-f1f90f380b00 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:14.257362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c2ed537-1d29-43d5-8f5d-ec905dae1fca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:14.258189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c2ed537-1d29-43d5-8f5d-ec905dae1fca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:14.258590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6ac0b1f-75c3-48f8-8859-f1f90f380b00 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:14.259176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c2ed537-1d29-43d5-8f5d-ec905dae1fca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:14.259420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6ac0b1f-75c3-48f8-8859-f1f90f380b00 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:14.260501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6ac0b1f-75c3-48f8-8859-f1f90f380b00 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:14.261064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c2ed537-1d29-43d5-8f5d-ec905dae1fca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:14.342103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:14.615479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7c2ed537-1d29-43d5-8f5d-ec905dae1fca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:14.631459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7c2ed537-1d29-43d5-8f5d-ec905dae1fca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:14.633743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7c2ed537-1d29-43d5-8f5d-ec905dae1fca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:14.635807 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7c2ed537-1d29-43d5-8f5d-ec905dae1fca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1662 microversion: 2.32 time: 0.405641 Aug 18 11:39:14.657579 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1506/3126] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:14 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1662 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:14.663674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e6bc741f-9666-4cf2-9ae0-f1074989e569 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:14.664648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e6bc741f-9666-4cf2-9ae0-f1074989e569 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:14.692868 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6bc741f-9666-4cf2-9ae0-f1074989e569 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:14.693659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6bc741f-9666-4cf2-9ae0-f1074989e569 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:14.694349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6bc741f-9666-4cf2-9ae0-f1074989e569 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:14.695456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6bc741f-9666-4cf2-9ae0-f1074989e569 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:14.696142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6bc741f-9666-4cf2-9ae0-f1074989e569 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:14.696794 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6bc741f-9666-4cf2-9ae0-f1074989e569 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:14.827114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c6ac0b1f-75c3-48f8-8859-f1f90f380b00 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:14.837343 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c6ac0b1f-75c3-48f8-8859-f1f90f380b00 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1507 microversion: 2.1 time: 0.619257 Aug 18 11:39:14.857208 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1621/3127] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:14 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1507 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:14.866103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9d59b6a0-aeef-4bef-a1c7-53dd356be882 req-3d9b509e-89de-4e76-820b-cc25cf033796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "tag": "b6b82b42-049e-4313-85b7-b7b6ccd6e554"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:14.907155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9d59b6a0-aeef-4bef-a1c7-53dd356be882 req-3d9b509e-89de-4e76-820b-cc25cf033796 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:14.908402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9d59b6a0-aeef-4bef-a1c7-53dd356be882 req-3d9b509e-89de-4e76-820b-cc25cf033796 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:14.909025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9d59b6a0-aeef-4bef-a1c7-53dd356be882 req-3d9b509e-89de-4e76-820b-cc25cf033796 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:14.928204 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9d59b6a0-aeef-4bef-a1c7-53dd356be882 req-3d9b509e-89de-4e76-820b-cc25cf033796 service nova] Creating event network-changed:b6b82b42-049e-4313-85b7-b7b6ccd6e554 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:39:14.949854 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9d59b6a0-aeef-4bef-a1c7-53dd356be882 req-3d9b509e-89de-4e76-820b-cc25cf033796 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091175 Aug 18 11:39:14.951054 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1622/3128] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:14.957591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2657ad78-695b-4576-a63c-b5a888c07da5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:14.973165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2657ad78-695b-4576-a63c-b5a888c07da5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:14.990892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2657ad78-695b-4576-a63c-b5a888c07da5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:14.991711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2657ad78-695b-4576-a63c-b5a888c07da5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:14.992365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2657ad78-695b-4576-a63c-b5a888c07da5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:14.993545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2657ad78-695b-4576-a63c-b5a888c07da5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:14.994194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2657ad78-695b-4576-a63c-b5a888c07da5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:14.994883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2657ad78-695b-4576-a63c-b5a888c07da5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:15.083112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e6bc741f-9666-4cf2-9ae0-f1074989e569 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:15.104911 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e6bc741f-9666-4cf2-9ae0-f1074989e569 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1542 microversion: 2.1 time: 0.445301 Aug 18 11:39:15.105804 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1507/3129] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:14 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1542 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:15.113883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2a69c26-e1ee-49f4-abfc-011d17823146 tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] Action: 'create', calling method: .version_select at 0x7f519f771dc0>, body: {"pool": null} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:15.432498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2657ad78-695b-4576-a63c-b5a888c07da5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:15.445920 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2657ad78-695b-4576-a63c-b5a888c07da5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1521 microversion: 2.1 time: 0.493474 Aug 18 11:39:15.446536 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1623/3130] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:14 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:15.455381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-361d184b-f720-426c-8593-a0b5be52dcfc tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:15.459293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-361d184b-f720-426c-8593-a0b5be52dcfc tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:15.477083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-361d184b-f720-426c-8593-a0b5be52dcfc tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:15.477880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-361d184b-f720-426c-8593-a0b5be52dcfc tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:15.478520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-361d184b-f720-426c-8593-a0b5be52dcfc tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:15.479416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-361d184b-f720-426c-8593-a0b5be52dcfc tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:15.481714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-361d184b-f720-426c-8593-a0b5be52dcfc tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:15.482358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-361d184b-f720-426c-8593-a0b5be52dcfc tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:15.621841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:15.673338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:16.427106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-361d184b-f720-426c-8593-a0b5be52dcfc tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:16.462018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-361d184b-f720-426c-8593-a0b5be52dcfc tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:16.463768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-361d184b-f720-426c-8593-a0b5be52dcfc tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:16.467312 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-361d184b-f720-426c-8593-a0b5be52dcfc tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 1.017364 Aug 18 11:39:16.472843 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1624/3131] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:15 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:16.477815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a77d29ef-f699-43a4-b7fb-8590ba5ba95e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:16.478466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a77d29ef-f699-43a4-b7fb-8590ba5ba95e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:16.507906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a77d29ef-f699-43a4-b7fb-8590ba5ba95e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:16.508698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a77d29ef-f699-43a4-b7fb-8590ba5ba95e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:16.509402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a77d29ef-f699-43a4-b7fb-8590ba5ba95e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:16.510564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a77d29ef-f699-43a4-b7fb-8590ba5ba95e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:16.511364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a77d29ef-f699-43a4-b7fb-8590ba5ba95e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:16.511959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a77d29ef-f699-43a4-b7fb-8590ba5ba95e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:17.270565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a77d29ef-f699-43a4-b7fb-8590ba5ba95e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:17.290647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a77d29ef-f699-43a4-b7fb-8590ba5ba95e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:17.296267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a77d29ef-f699-43a4-b7fb-8590ba5ba95e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:17.299050 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a77d29ef-f699-43a4-b7fb-8590ba5ba95e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1709 microversion: 2.32 time: 0.824880 Aug 18 11:39:17.300089 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1625/3132] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:16 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1709 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:17.320188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8dccc821-d22b-43f4-a657-538b701c895c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:17.320812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8dccc821-d22b-43f4-a657-538b701c895c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:17.329772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dccc821-d22b-43f4-a657-538b701c895c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:17.330836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dccc821-d22b-43f4-a657-538b701c895c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:17.331462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dccc821-d22b-43f4-a657-538b701c895c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:17.332356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dccc821-d22b-43f4-a657-538b701c895c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:17.332984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dccc821-d22b-43f4-a657-538b701c895c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:17.333591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dccc821-d22b-43f4-a657-538b701c895c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:17.719536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8dccc821-d22b-43f4-a657-538b701c895c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:17.731669 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8dccc821-d22b-43f4-a657-538b701c895c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1504 microversion: 2.1 time: 0.415233 Aug 18 11:39:17.746982 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1626/3133] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:17 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1504 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:17.758077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f83c9853-5c0d-4192-9fcf-78053001070e req-60cb8295-6888-4892-a63d-98abebb46f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf75dc7-00eb-4c1b-986d-3a59443571b7", "name": "network-vif-unplugged", "status": "completed", "tag": "f6a21f93-cae9-4f96-9796-025f2beba9c3"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:17.781377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f83c9853-5c0d-4192-9fcf-78053001070e req-60cb8295-6888-4892-a63d-98abebb46f9c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:17.781862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f83c9853-5c0d-4192-9fcf-78053001070e req-60cb8295-6888-4892-a63d-98abebb46f9c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:17.782296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f83c9853-5c0d-4192-9fcf-78053001070e req-60cb8295-6888-4892-a63d-98abebb46f9c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:17.803354 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f83c9853-5c0d-4192-9fcf-78053001070e req-60cb8295-6888-4892-a63d-98abebb46f9c service nova] Creating event network-vif-unplugged:f6a21f93-cae9-4f96-9796-025f2beba9c3 for instance caf75dc7-00eb-4c1b-986d-3a59443571b7 on n-h1-853611-3 Aug 18 11:39:17.814156 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f83c9853-5c0d-4192-9fcf-78053001070e req-60cb8295-6888-4892-a63d-98abebb46f9c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062178 Aug 18 11:39:17.815553 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1627/3134] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:17.820982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1d31995b-c04c-46d1-810f-1da70c51e77d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:17.821681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1d31995b-c04c-46d1-810f-1da70c51e77d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:17.841987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d31995b-c04c-46d1-810f-1da70c51e77d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:17.842787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d31995b-c04c-46d1-810f-1da70c51e77d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:17.843968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d31995b-c04c-46d1-810f-1da70c51e77d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:17.846347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d31995b-c04c-46d1-810f-1da70c51e77d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:17.855928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d31995b-c04c-46d1-810f-1da70c51e77d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:17.856383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d31995b-c04c-46d1-810f-1da70c51e77d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:18.255149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1d31995b-c04c-46d1-810f-1da70c51e77d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:18.268414 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1d31995b-c04c-46d1-810f-1da70c51e77d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1542 microversion: 2.1 time: 0.451365 Aug 18 11:39:18.268826 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1628/3135] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:17 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1542 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:18.273633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34193206-2611-43d7-bdf8-b587ab02e4ab tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:18.279922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-34193206-2611-43d7-bdf8-b587ab02e4ab tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:18.291422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34193206-2611-43d7-bdf8-b587ab02e4ab tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:18.291913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34193206-2611-43d7-bdf8-b587ab02e4ab tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:18.292347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34193206-2611-43d7-bdf8-b587ab02e4ab tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:18.293050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34193206-2611-43d7-bdf8-b587ab02e4ab tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:18.293503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34193206-2611-43d7-bdf8-b587ab02e4ab tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:18.293931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34193206-2611-43d7-bdf8-b587ab02e4ab tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:18.841782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-34193206-2611-43d7-bdf8-b587ab02e4ab tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:18.862612 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34193206-2611-43d7-bdf8-b587ab02e4ab tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1521 microversion: 2.1 time: 0.591421 Aug 18 11:39:18.864376 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1629/3136] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:18 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1521 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:18.870594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-80dd6014-6cdb-4a55-b206-8987241de6fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:18.871632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-80dd6014-6cdb-4a55-b206-8987241de6fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:18.879929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80dd6014-6cdb-4a55-b206-8987241de6fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:18.880721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80dd6014-6cdb-4a55-b206-8987241de6fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:18.881502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80dd6014-6cdb-4a55-b206-8987241de6fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:18.882522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80dd6014-6cdb-4a55-b206-8987241de6fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:18.883219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80dd6014-6cdb-4a55-b206-8987241de6fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:18.883883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80dd6014-6cdb-4a55-b206-8987241de6fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:18.990825 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a2a69c26-e1ee-49f4-abfc-011d17823146 tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] 10.222.0.73 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.882145 Aug 18 11:39:18.991424 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1508/3137] 10.222.0.73 () {60 vars in 1170 bytes} [Thu Aug 18 11:39:15 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:19.008180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f5144ec2-c159-4bbb-93c7-f8d4f11ed8cc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:19.008931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f5144ec2-c159-4bbb-93c7-f8d4f11ed8cc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:19.023580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5144ec2-c159-4bbb-93c7-f8d4f11ed8cc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:19.024086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5144ec2-c159-4bbb-93c7-f8d4f11ed8cc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:19.024539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5144ec2-c159-4bbb-93c7-f8d4f11ed8cc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:19.025279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5144ec2-c159-4bbb-93c7-f8d4f11ed8cc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:19.025749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5144ec2-c159-4bbb-93c7-f8d4f11ed8cc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:19.026186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5144ec2-c159-4bbb-93c7-f8d4f11ed8cc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:19.206788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f5144ec2-c159-4bbb-93c7-f8d4f11ed8cc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:19.216742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f5144ec2-c159-4bbb-93c7-f8d4f11ed8cc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:19.219142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f5144ec2-c159-4bbb-93c7-f8d4f11ed8cc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:19.220826 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f5144ec2-c159-4bbb-93c7-f8d4f11ed8cc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1756 microversion: 2.32 time: 0.228073 Aug 18 11:39:19.221874 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1509/3138] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:18 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1756 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:19.226607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2a79c3c8-d42f-4b59-b5a3-44e39c0a5b2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:19.227541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2a79c3c8-d42f-4b59-b5a3-44e39c0a5b2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:19.237648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a79c3c8-d42f-4b59-b5a3-44e39c0a5b2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:19.238502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a79c3c8-d42f-4b59-b5a3-44e39c0a5b2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:19.239336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a79c3c8-d42f-4b59-b5a3-44e39c0a5b2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:19.240295 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a79c3c8-d42f-4b59-b5a3-44e39c0a5b2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:19.241031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a79c3c8-d42f-4b59-b5a3-44e39c0a5b2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:19.241581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a79c3c8-d42f-4b59-b5a3-44e39c0a5b2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:19.309022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-80dd6014-6cdb-4a55-b206-8987241de6fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:19.325596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-80dd6014-6cdb-4a55-b206-8987241de6fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:19.327869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-80dd6014-6cdb-4a55-b206-8987241de6fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:19.329613 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-80dd6014-6cdb-4a55-b206-8987241de6fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.463558 Aug 18 11:39:19.332012 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1630/3139] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:18 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:19.338676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-86b09f25-72d9-4364-94f3-a759ba241608 tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] Calling method '.version_select at 0x7f519faa75e0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:19.431783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2a79c3c8-d42f-4b59-b5a3-44e39c0a5b2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:19.442306 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2a79c3c8-d42f-4b59-b5a3-44e39c0a5b2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1504 microversion: 2.1 time: 0.219029 Aug 18 11:39:19.442948 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1510/3140] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:19 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:19.448719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-be214af2-e2a5-4cdf-9c4a-ee87e3c4fa64 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:19.449549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-be214af2-e2a5-4cdf-9c4a-ee87e3c4fa64 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:19.461531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be214af2-e2a5-4cdf-9c4a-ee87e3c4fa64 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:19.463219 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be214af2-e2a5-4cdf-9c4a-ee87e3c4fa64 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:19.463920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be214af2-e2a5-4cdf-9c4a-ee87e3c4fa64 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:19.464982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be214af2-e2a5-4cdf-9c4a-ee87e3c4fa64 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:19.465836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be214af2-e2a5-4cdf-9c4a-ee87e3c4fa64 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:19.466612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be214af2-e2a5-4cdf-9c4a-ee87e3c4fa64 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:19.643724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-be214af2-e2a5-4cdf-9c4a-ee87e3c4fa64 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:19.651076 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-86b09f25-72d9-4364-94f3-a759ba241608 tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] 10.222.0.73 "GET /compute/v2.1/os-floating-ips/eb679f4d-11fc-40ab-bc99-5effdab9f71d" status: 200 len: 141 microversion: 2.1 time: 0.317212 Aug 18 11:39:19.659762 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1631/3141] 10.222.0.73 () {58 vars in 1260 bytes} [Thu Aug 18 11:39:19 2022] GET /compute/v2.1/os-floating-ips/eb679f4d-11fc-40ab-bc99-5effdab9f71d => generated 141 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:19.665367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99c5af11-6b29-41c7-a37f-b9c1d1749c45 tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] Calling method '.version_select at 0x7f519fab2f70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:19.670174 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-be214af2-e2a5-4cdf-9c4a-ee87e3c4fa64 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1542 microversion: 2.1 time: 0.225894 Aug 18 11:39:19.671147 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1511/3142] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:19 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1542 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:19.902724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-2f295b75-eaab-4a1c-b603-a5beb0291326 req-0212d89b-c79f-461d-ac17-3e2e41767e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf75dc7-00eb-4c1b-986d-3a59443571b7", "name": "network-vif-plugged", "status": "completed", "tag": "f6a21f93-cae9-4f96-9796-025f2beba9c3"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:19.930014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2f295b75-eaab-4a1c-b603-a5beb0291326 req-0212d89b-c79f-461d-ac17-3e2e41767e5d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:19.931158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2f295b75-eaab-4a1c-b603-a5beb0291326 req-0212d89b-c79f-461d-ac17-3e2e41767e5d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:19.931869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2f295b75-eaab-4a1c-b603-a5beb0291326 req-0212d89b-c79f-461d-ac17-3e2e41767e5d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:19.963733 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-2f295b75-eaab-4a1c-b603-a5beb0291326 req-0212d89b-c79f-461d-ac17-3e2e41767e5d service nova] Creating event network-vif-plugged:f6a21f93-cae9-4f96-9796-025f2beba9c3 for instance caf75dc7-00eb-4c1b-986d-3a59443571b7 on n-h1-853611-3 Aug 18 11:39:19.971291 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-2f295b75-eaab-4a1c-b603-a5beb0291326 req-0212d89b-c79f-461d-ac17-3e2e41767e5d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088813 Aug 18 11:39:19.976162 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1512/3143] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:19.995307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-116b4544-fe80-456a-9c80-f137b2819b4d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:19.996992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-116b4544-fe80-456a-9c80-f137b2819b4d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:20.007259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-116b4544-fe80-456a-9c80-f137b2819b4d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:20.008514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-116b4544-fe80-456a-9c80-f137b2819b4d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:20.009583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-116b4544-fe80-456a-9c80-f137b2819b4d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:20.010849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-116b4544-fe80-456a-9c80-f137b2819b4d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:20.011681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-116b4544-fe80-456a-9c80-f137b2819b4d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:20.012347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-116b4544-fe80-456a-9c80-f137b2819b4d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:20.275612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-116b4544-fe80-456a-9c80-f137b2819b4d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:20.290601 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-116b4544-fe80-456a-9c80-f137b2819b4d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1521 microversion: 2.1 time: 0.310926 Aug 18 11:39:20.292325 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1513/3144] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:19 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:20.340721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-412bd881-59de-4967-ac97-e5a8e3be9f4e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:20.349726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-412bd881-59de-4967-ac97-e5a8e3be9f4e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:20.372726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-412bd881-59de-4967-ac97-e5a8e3be9f4e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:20.379298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-412bd881-59de-4967-ac97-e5a8e3be9f4e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:20.379763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-412bd881-59de-4967-ac97-e5a8e3be9f4e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:20.380516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-412bd881-59de-4967-ac97-e5a8e3be9f4e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:20.381161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-412bd881-59de-4967-ac97-e5a8e3be9f4e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:20.381768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-412bd881-59de-4967-ac97-e5a8e3be9f4e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:20.959610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-412bd881-59de-4967-ac97-e5a8e3be9f4e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:20.974268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-412bd881-59de-4967-ac97-e5a8e3be9f4e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:20.975806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-412bd881-59de-4967-ac97-e5a8e3be9f4e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:20.983609 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-412bd881-59de-4967-ac97-e5a8e3be9f4e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1756 microversion: 2.32 time: 0.689950 Aug 18 11:39:20.984313 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1514/3145] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:20 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1756 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:20.988905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f30b3dd6-ac0f-421b-ac1f-1a9a90b84945 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:20.991149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f30b3dd6-ac0f-421b-ac1f-1a9a90b84945 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:21.008438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f30b3dd6-ac0f-421b-ac1f-1a9a90b84945 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:21.009994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f30b3dd6-ac0f-421b-ac1f-1a9a90b84945 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:21.010670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f30b3dd6-ac0f-421b-ac1f-1a9a90b84945 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:21.011640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f30b3dd6-ac0f-421b-ac1f-1a9a90b84945 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:21.012253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f30b3dd6-ac0f-421b-ac1f-1a9a90b84945 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:21.012945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f30b3dd6-ac0f-421b-ac1f-1a9a90b84945 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:21.592088 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-99c5af11-6b29-41c7-a37f-b9c1d1749c45 tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/eb679f4d-11fc-40ab-bc99-5effdab9f71d" status: 202 len: 0 microversion: 2.1 time: 1.930604 Aug 18 11:39:21.593153 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1632/3146] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:39:19 2022] DELETE /compute/v2.1/os-floating-ips/eb679f4d-11fc-40ab-bc99-5effdab9f71d => generated 0 bytes in 1933 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:39:21.602285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8d9ea50-c2d4-474d-a341-b49753fa91a7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:21.603254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e8d9ea50-c2d4-474d-a341-b49753fa91a7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:21.605885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:21.616301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8d9ea50-c2d4-474d-a341-b49753fa91a7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:21.617081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8d9ea50-c2d4-474d-a341-b49753fa91a7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:21.617757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8d9ea50-c2d4-474d-a341-b49753fa91a7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:21.619155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8d9ea50-c2d4-474d-a341-b49753fa91a7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:21.619893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8d9ea50-c2d4-474d-a341-b49753fa91a7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:21.621617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8d9ea50-c2d4-474d-a341-b49753fa91a7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:21.782147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f30b3dd6-ac0f-421b-ac1f-1a9a90b84945 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:21.800601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f30b3dd6-ac0f-421b-ac1f-1a9a90b84945 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:21.805476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f30b3dd6-ac0f-421b-ac1f-1a9a90b84945 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:21.811358 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f30b3dd6-ac0f-421b-ac1f-1a9a90b84945 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.825980 Aug 18 11:39:21.817202 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1515/3147] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:20 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:21.826122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c2d53ae5-170a-421d-9a05-b71aa5ff0403 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:21.833258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c2d53ae5-170a-421d-9a05-b71aa5ff0403 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:21.850311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2d53ae5-170a-421d-9a05-b71aa5ff0403 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:21.851547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2d53ae5-170a-421d-9a05-b71aa5ff0403 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:21.852238 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2d53ae5-170a-421d-9a05-b71aa5ff0403 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:21.853245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2d53ae5-170a-421d-9a05-b71aa5ff0403 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:21.853965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2d53ae5-170a-421d-9a05-b71aa5ff0403 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:21.860196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c2d53ae5-170a-421d-9a05-b71aa5ff0403 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:21.873459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e8d9ea50-c2d4-474d-a341-b49753fa91a7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:21.883200 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e8d9ea50-c2d4-474d-a341-b49753fa91a7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 200 len: 1447 microversion: 2.1 time: 0.288539 Aug 18 11:39:21.897363 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1633/3148] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:21 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 1447 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:21.903787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-399430e6-4076-40b4-b20f-ad03aec1dec1 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:21.908954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-399430e6-4076-40b4-b20f-ad03aec1dec1 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:21.933130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-399430e6-4076-40b4-b20f-ad03aec1dec1 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:21.935540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-399430e6-4076-40b4-b20f-ad03aec1dec1 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:21.936271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-399430e6-4076-40b4-b20f-ad03aec1dec1 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:21.943313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-399430e6-4076-40b4-b20f-ad03aec1dec1 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:21.943918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-399430e6-4076-40b4-b20f-ad03aec1dec1 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:21.944441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-399430e6-4076-40b4-b20f-ad03aec1dec1 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:22.122701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-399430e6-4076-40b4-b20f-ad03aec1dec1 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:22.132579 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-399430e6-4076-40b4-b20f-ad03aec1dec1 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1521 microversion: 2.1 time: 0.233692 Aug 18 11:39:22.133835 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1634/3149] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:21 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:22.142610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-20ebd503-893d-4ebf-8f3e-53b50141ee4e tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] Calling method '.version_select at 0x7f519fb2af70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:22.380245 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-20ebd503-893d-4ebf-8f3e-53b50141ee4e tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] 10.222.0.73 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.244819 Aug 18 11:39:22.381258 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1635/3150] 10.222.0.73 () {58 vars in 1164 bytes} [Thu Aug 18 11:39:22 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:39:22.386478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c8418a59-1ecc-4f90-b0fc-cdc5c89d0b8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:22.387297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c8418a59-1ecc-4f90-b0fc-cdc5c89d0b8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:22.395263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8418a59-1ecc-4f90-b0fc-cdc5c89d0b8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:22.395996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8418a59-1ecc-4f90-b0fc-cdc5c89d0b8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:22.396440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8418a59-1ecc-4f90-b0fc-cdc5c89d0b8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:22.397153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8418a59-1ecc-4f90-b0fc-cdc5c89d0b8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:22.397608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8418a59-1ecc-4f90-b0fc-cdc5c89d0b8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:22.398644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8418a59-1ecc-4f90-b0fc-cdc5c89d0b8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:22.474782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c2d53ae5-170a-421d-9a05-b71aa5ff0403 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:22.490500 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c2d53ae5-170a-421d-9a05-b71aa5ff0403 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1541 microversion: 2.1 time: 0.670835 Aug 18 11:39:22.492906 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1516/3151] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:21 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1541 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:22.509053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-2f25c878-eb6c-4bdc-8615-25c45162f1fe req-a0caa84d-f1c1-45ca-8dd2-0bc51bc80046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f65b4f-2652-4d50-b868-5d7258fa7cb4", "name": "network-vif-unplugged", "status": "completed", "tag": "d3a33b84-c6d1-47fc-a6d8-29d57933f772"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:22.519988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2f25c878-eb6c-4bdc-8615-25c45162f1fe req-a0caa84d-f1c1-45ca-8dd2-0bc51bc80046 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:22.520692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2f25c878-eb6c-4bdc-8615-25c45162f1fe req-a0caa84d-f1c1-45ca-8dd2-0bc51bc80046 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:22.521295 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2f25c878-eb6c-4bdc-8615-25c45162f1fe req-a0caa84d-f1c1-45ca-8dd2-0bc51bc80046 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:22.550059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.compute.server_external_events [req-2f25c878-eb6c-4bdc-8615-25c45162f1fe req-a0caa84d-f1c1-45ca-8dd2-0bc51bc80046 service nova] Unable to find a host for instance 73f65b4f-2652-4d50-b868-5d7258fa7cb4. Dropping event network-vif-unplugged {{(pid=122209) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 11:39:22.551798 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-2f25c878-eb6c-4bdc-8615-25c45162f1fe req-a0caa84d-f1c1-45ca-8dd2-0bc51bc80046 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.056627 Aug 18 11:39:22.557387 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1517/3152] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 18 11:39:22.560323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c8418a59-1ecc-4f90-b0fc-cdc5c89d0b8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:22.564111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d29ff933-a3c3-4a5b-bd21-07e1fcd31a52 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:22.565050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d29ff933-a3c3-4a5b-bd21-07e1fcd31a52 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:22.572126 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c8418a59-1ecc-4f90-b0fc-cdc5c89d0b8b tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.189138 Aug 18 11:39:22.572325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d29ff933-a3c3-4a5b-bd21-07e1fcd31a52 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:22.572704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d29ff933-a3c3-4a5b-bd21-07e1fcd31a52 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:22.573232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d29ff933-a3c3-4a5b-bd21-07e1fcd31a52 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:22.574014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d29ff933-a3c3-4a5b-bd21-07e1fcd31a52 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:22.575526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d29ff933-a3c3-4a5b-bd21-07e1fcd31a52 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:22.576179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d29ff933-a3c3-4a5b-bd21-07e1fcd31a52 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:22.588999 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1636/3153] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:22 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:22.599870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-db09724b-836e-44f7-8811-7c4f4728f5ec tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] Calling method '.version_select at 0x7f519faa75e0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:22.908699 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-db09724b-836e-44f7-8811-7c4f4728f5ec tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] 10.222.0.73 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.312267 Aug 18 11:39:22.909886 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1637/3154] 10.222.0.73 () {58 vars in 1149 bytes} [Thu Aug 18 11:39:22 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:22.921369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c51032d0-3ff0-4a0f-82a7-96f53bc4409e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:22.922323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c51032d0-3ff0-4a0f-82a7-96f53bc4409e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:22.931242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c51032d0-3ff0-4a0f-82a7-96f53bc4409e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:22.931974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c51032d0-3ff0-4a0f-82a7-96f53bc4409e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:22.942911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c51032d0-3ff0-4a0f-82a7-96f53bc4409e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:22.944071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c51032d0-3ff0-4a0f-82a7-96f53bc4409e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:22.945341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c51032d0-3ff0-4a0f-82a7-96f53bc4409e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:22.946664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c51032d0-3ff0-4a0f-82a7-96f53bc4409e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:22.970581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d29ff933-a3c3-4a5b-bd21-07e1fcd31a52 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:22.984736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d29ff933-a3c3-4a5b-bd21-07e1fcd31a52 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:22.992285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d29ff933-a3c3-4a5b-bd21-07e1fcd31a52 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:22.993693 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d29ff933-a3c3-4a5b-bd21-07e1fcd31a52 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1803 microversion: 2.32 time: 0.435253 Aug 18 11:39:22.996684 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1518/3155] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:22 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1803 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:23.006485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3faba3a-7631-4895-b33f-c716c9849f70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:23.008629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d3faba3a-7631-4895-b33f-c716c9849f70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:23.022055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3faba3a-7631-4895-b33f-c716c9849f70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:23.022598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3faba3a-7631-4895-b33f-c716c9849f70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:23.023042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3faba3a-7631-4895-b33f-c716c9849f70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:23.023759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3faba3a-7631-4895-b33f-c716c9849f70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:23.024223 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3faba3a-7631-4895-b33f-c716c9849f70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:23.024654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3faba3a-7631-4895-b33f-c716c9849f70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:23.222147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c51032d0-3ff0-4a0f-82a7-96f53bc4409e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:23.230803 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c51032d0-3ff0-4a0f-82a7-96f53bc4409e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.319342 Aug 18 11:39:23.231393 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1638/3156] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:22 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:23.243712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ce304a07-811c-4372-aaa1-5c20afc77eb6 tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] Calling method '.version_select at 0x7f519fbc7dc0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:23.549477 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d3faba3a-7631-4895-b33f-c716c9849f70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:23.567624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d3faba3a-7631-4895-b33f-c716c9849f70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:23.573355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d3faba3a-7631-4895-b33f-c716c9849f70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:23.575015 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d3faba3a-7631-4895-b33f-c716c9849f70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.576182 Aug 18 11:39:23.590837 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1519/3157] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:22 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:23.593150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-95ac77e5-db3d-4429-8840-f062fdc5d02d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:23.594334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-95ac77e5-db3d-4429-8840-f062fdc5d02d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:23.602544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-95ac77e5-db3d-4429-8840-f062fdc5d02d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:23.603295 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-95ac77e5-db3d-4429-8840-f062fdc5d02d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:23.603960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-95ac77e5-db3d-4429-8840-f062fdc5d02d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:23.605569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-95ac77e5-db3d-4429-8840-f062fdc5d02d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:23.606198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-95ac77e5-db3d-4429-8840-f062fdc5d02d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:23.606849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-95ac77e5-db3d-4429-8840-f062fdc5d02d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:24.135074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-95ac77e5-db3d-4429-8840-f062fdc5d02d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:24.146754 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-95ac77e5-db3d-4429-8840-f062fdc5d02d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1506 microversion: 2.1 time: 0.559050 Aug 18 11:39:24.152015 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1520/3158] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:23 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:24.157328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f8834209-edc2-4cc9-98f4-faee1f6e3957 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:24.158144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f8834209-edc2-4cc9-98f4-faee1f6e3957 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:24.165068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8834209-edc2-4cc9-98f4-faee1f6e3957 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:24.165638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8834209-edc2-4cc9-98f4-faee1f6e3957 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:24.165995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8834209-edc2-4cc9-98f4-faee1f6e3957 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:24.166802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8834209-edc2-4cc9-98f4-faee1f6e3957 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:24.167272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8834209-edc2-4cc9-98f4-faee1f6e3957 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:24.168192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8834209-edc2-4cc9-98f4-faee1f6e3957 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:24.332306 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ce304a07-811c-4372-aaa1-5c20afc77eb6 tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/38964bb8-6b6c-48fc-911f-00d6afc3a020" status: 202 len: 0 microversion: 2.1 time: 1.098604 Aug 18 11:39:24.334976 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1639/3159] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:39:23 2022] DELETE /compute/v2.1/os-floating-ips/38964bb8-6b6c-48fc-911f-00d6afc3a020 => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:39:24.345688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3971276f-b320-493c-9726-ec25dcb1dcb0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:24.347157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3971276f-b320-493c-9726-ec25dcb1dcb0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:24.365327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3971276f-b320-493c-9726-ec25dcb1dcb0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:24.366339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3971276f-b320-493c-9726-ec25dcb1dcb0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:24.367100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3971276f-b320-493c-9726-ec25dcb1dcb0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:24.368491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3971276f-b320-493c-9726-ec25dcb1dcb0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:24.369235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3971276f-b320-493c-9726-ec25dcb1dcb0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:24.373449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3971276f-b320-493c-9726-ec25dcb1dcb0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:24.430100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f8834209-edc2-4cc9-98f4-faee1f6e3957 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:24.445268 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f8834209-edc2-4cc9-98f4-faee1f6e3957 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.296098 Aug 18 11:39:24.447274 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1521/3160] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:24 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:24.454240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-187c3f47-1fba-4686-bdb3-c015dc0726ee tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:24.455622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-187c3f47-1fba-4686-bdb3-c015dc0726ee tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:24.465383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-187c3f47-1fba-4686-bdb3-c015dc0726ee tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:24.466008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-187c3f47-1fba-4686-bdb3-c015dc0726ee tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:24.466484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-187c3f47-1fba-4686-bdb3-c015dc0726ee tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:24.469226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-187c3f47-1fba-4686-bdb3-c015dc0726ee tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:24.469723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-187c3f47-1fba-4686-bdb3-c015dc0726ee tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:24.470161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-187c3f47-1fba-4686-bdb3-c015dc0726ee tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:24.654734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3971276f-b320-493c-9726-ec25dcb1dcb0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:24.668867 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3971276f-b320-493c-9726-ec25dcb1dcb0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1473 microversion: 2.1 time: 0.332330 Aug 18 11:39:24.670046 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1640/3161] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:24 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1473 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:24.692366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-988b4b95-858c-4539-99f5-b7a254c0d5e4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:24.696424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-988b4b95-858c-4539-99f5-b7a254c0d5e4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:24.708436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-988b4b95-858c-4539-99f5-b7a254c0d5e4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:24.709195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-988b4b95-858c-4539-99f5-b7a254c0d5e4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:24.709814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-988b4b95-858c-4539-99f5-b7a254c0d5e4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:24.711207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-988b4b95-858c-4539-99f5-b7a254c0d5e4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:24.711827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-988b4b95-858c-4539-99f5-b7a254c0d5e4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:24.712431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-988b4b95-858c-4539-99f5-b7a254c0d5e4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:24.865924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-187c3f47-1fba-4686-bdb3-c015dc0726ee tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:24.883039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-187c3f47-1fba-4686-bdb3-c015dc0726ee tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:24.884483 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-187c3f47-1fba-4686-bdb3-c015dc0726ee tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:24.885709 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-187c3f47-1fba-4686-bdb3-c015dc0726ee tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1803 microversion: 2.32 time: 0.437349 Aug 18 11:39:24.889204 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1522/3162] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:24 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1803 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:24.901542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-806953a7-728c-4817-9fb9-ecde32814c68 tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] Calling method '.version_select at 0x7f519f7e1e50>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:25.160840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-988b4b95-858c-4539-99f5-b7a254c0d5e4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:25.166575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:25.177738 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-988b4b95-858c-4539-99f5-b7a254c0d5e4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 200 len: 1506 microversion: 2.1 time: 0.490303 Aug 18 11:39:25.182260 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1641/3163] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:24 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:25.193628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dcedbd28-1360-46c4-a079-65e232a12623 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:25.194673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dcedbd28-1360-46c4-a079-65e232a12623 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:25.217023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcedbd28-1360-46c4-a079-65e232a12623 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:25.222104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcedbd28-1360-46c4-a079-65e232a12623 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:25.225177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcedbd28-1360-46c4-a079-65e232a12623 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:25.228349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcedbd28-1360-46c4-a079-65e232a12623 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:25.228349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcedbd28-1360-46c4-a079-65e232a12623 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:25.228349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcedbd28-1360-46c4-a079-65e232a12623 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:25.785573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dcedbd28-1360-46c4-a079-65e232a12623 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:25.802721 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dcedbd28-1360-46c4-a079-65e232a12623 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.618778 Aug 18 11:39:25.820101 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1642/3164] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:25 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:25.828037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-05a366da-1f27-4094-bcf4-93dcc4f2ba70 req-1bb3ff34-ff76-43b5-b648-c33d4823d411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7183ab-d769-4b94-9b9b-545a3eb459d7", "name": "network-vif-unplugged", "status": "completed", "tag": "71abe44d-4829-45bc-98f7-b6337e80396d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:25.868991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-05a366da-1f27-4094-bcf4-93dcc4f2ba70 req-1bb3ff34-ff76-43b5-b648-c33d4823d411 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:25.871111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-05a366da-1f27-4094-bcf4-93dcc4f2ba70 req-1bb3ff34-ff76-43b5-b648-c33d4823d411 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:25.872279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-05a366da-1f27-4094-bcf4-93dcc4f2ba70 req-1bb3ff34-ff76-43b5-b648-c33d4823d411 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:25.909197 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-05a366da-1f27-4094-bcf4-93dcc4f2ba70 req-1bb3ff34-ff76-43b5-b648-c33d4823d411 service nova] Creating event network-vif-unplugged:71abe44d-4829-45bc-98f7-b6337e80396d for instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 on n-h2-853611-3 Aug 18 11:39:25.927930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-05a366da-1f27-4094-bcf4-93dcc4f2ba70 req-1bb3ff34-ff76-43b5-b648-c33d4823d411 service nova] Instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 11:39:25.942865 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-05a366da-1f27-4094-bcf4-93dcc4f2ba70 req-1bb3ff34-ff76-43b5-b648-c33d4823d411 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117513 Aug 18 11:39:25.945437 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1643/3165] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:25.962501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5dcbe694-fa18-4e68-bbc2-b6b5d64f79ee tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:25.963752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5dcbe694-fa18-4e68-bbc2-b6b5d64f79ee tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:25.987509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dcbe694-fa18-4e68-bbc2-b6b5d64f79ee tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:25.988453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dcbe694-fa18-4e68-bbc2-b6b5d64f79ee tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:25.989173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dcbe694-fa18-4e68-bbc2-b6b5d64f79ee tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:25.990138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dcbe694-fa18-4e68-bbc2-b6b5d64f79ee tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:25.991540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dcbe694-fa18-4e68-bbc2-b6b5d64f79ee tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:25.992643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dcbe694-fa18-4e68-bbc2-b6b5d64f79ee tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:26.497311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5dcbe694-fa18-4e68-bbc2-b6b5d64f79ee tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:26.519356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5dcbe694-fa18-4e68-bbc2-b6b5d64f79ee tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:26.523903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5dcbe694-fa18-4e68-bbc2-b6b5d64f79ee tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:26.526516 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5dcbe694-fa18-4e68-bbc2-b6b5d64f79ee tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.576858 Aug 18 11:39:26.527920 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1644/3166] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:25 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:26.536565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7c6830f-886e-427a-8b30-51f8b608a71b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:26.537484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e7c6830f-886e-427a-8b30-51f8b608a71b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:26.546779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7c6830f-886e-427a-8b30-51f8b608a71b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:26.547794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7c6830f-886e-427a-8b30-51f8b608a71b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:26.548985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7c6830f-886e-427a-8b30-51f8b608a71b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:26.550265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7c6830f-886e-427a-8b30-51f8b608a71b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:26.551211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7c6830f-886e-427a-8b30-51f8b608a71b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:26.552000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7c6830f-886e-427a-8b30-51f8b608a71b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:26.617711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e7c6830f-886e-427a-8b30-51f8b608a71b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:39:26.779814 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e7c6830f-886e-427a-8b30-51f8b608a71b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "DELETE /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 204 len: 0 microversion: 2.1 time: 0.249835 Aug 18 11:39:26.785960 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1645/3167] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:39:26 2022] DELETE /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:39:26.799835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ea49dbaa-2525-4498-aa31-d87451c67192 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:26.801428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ea49dbaa-2525-4498-aa31-d87451c67192 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:26.811180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea49dbaa-2525-4498-aa31-d87451c67192 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:26.812741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea49dbaa-2525-4498-aa31-d87451c67192 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:26.813672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea49dbaa-2525-4498-aa31-d87451c67192 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:26.815138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea49dbaa-2525-4498-aa31-d87451c67192 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:26.815838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea49dbaa-2525-4498-aa31-d87451c67192 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:26.816524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea49dbaa-2525-4498-aa31-d87451c67192 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:27.368175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ea49dbaa-2525-4498-aa31-d87451c67192 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:27.384310 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ea49dbaa-2525-4498-aa31-d87451c67192 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1470 microversion: 2.1 time: 0.595684 Aug 18 11:39:27.394631 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1646/3168] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:26 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1470 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:27.418913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d48a2b56-ef58-4f96-81b2-7885df1598fc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:27.432507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d48a2b56-ef58-4f96-81b2-7885df1598fc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:27.433880 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-806953a7-728c-4817-9fb9-ecde32814c68 tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/fc75de7e-1328-4fa1-9a29-cfe3c5ed8cdf" status: 202 len: 0 microversion: 2.1 time: 2.542040 Aug 18 11:39:27.434846 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1523/3169] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:39:24 2022] DELETE /compute/v2.1/os-floating-ips/fc75de7e-1328-4fa1-9a29-cfe3c5ed8cdf => generated 0 bytes in 2543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:39:27.434986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d48a2b56-ef58-4f96-81b2-7885df1598fc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:27.435987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d48a2b56-ef58-4f96-81b2-7885df1598fc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:27.448256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-033fd457-257b-43ed-9015-c967634804d7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:27.448889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-033fd457-257b-43ed-9015-c967634804d7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:27.478402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-033fd457-257b-43ed-9015-c967634804d7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:27.478943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-033fd457-257b-43ed-9015-c967634804d7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:27.479393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-033fd457-257b-43ed-9015-c967634804d7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:27.480143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-033fd457-257b-43ed-9015-c967634804d7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:27.480616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-033fd457-257b-43ed-9015-c967634804d7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:27.481051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-033fd457-257b-43ed-9015-c967634804d7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:27.501059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d48a2b56-ef58-4f96-81b2-7885df1598fc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Going to try to stop instance {{(pid=122210) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 11:39:27.623585 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d48a2b56-ef58-4f96-81b2-7885df1598fc tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.227061 Aug 18 11:39:27.640106 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1647/3170] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:39:27 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:39:27.657808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-215039461", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "ce8567ca-6e19-499c-8a23-37988a209b75"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:27.805613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] validate_networks() for [('ce8567ca-6e19-499c-8a23-37988a209b75', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:39:28.193445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-033fd457-257b-43ed-9015-c967634804d7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:28.213768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-033fd457-257b-43ed-9015-c967634804d7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:28.216142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-033fd457-257b-43ed-9015-c967634804d7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:28.219606 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-033fd457-257b-43ed-9015-c967634804d7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1850 microversion: 2.32 time: 0.782751 Aug 18 11:39:28.220231 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1524/3171] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:27 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1850 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:28.230960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:28.231516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:28.258385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:28.258926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:28.259574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:28.260509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:28.261149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:28.261742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:28.388718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:28.390818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:28.392042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:28.398679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:28.399357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:28.399975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:28.467395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:28.472577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Getting quotas for project 6387896b424840deb9ef97aae02edd99. Resources: {'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:28.484705 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Getting quotas for user 9269fc4d233c42a590bfcbfaa7f2e895 and project 6387896b424840deb9ef97aae02edd99. Resources: {'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:28.530346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:28.721356 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4866f351-72c2-4e6c-815f-b48035e612b5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "POST /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7/action" status: 202 len: 0 microversion: 2.1 time: 0.499792 Aug 18 11:39:28.722488 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1525/3172] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:39:28 2022] POST /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:39:28.749089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1ebf8f55-1583-489d-8fe8-6aeda0776a2b tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] Calling method '.version_select at 0x7f519f929ee0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:30.002011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:39:30.002727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:39:30.003818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:39:30.004831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:39:30.005713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:39:30.039309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:30.041612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:30.043629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:30.048660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:30.049741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:30.057238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:30.112179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Getting quotas for project 538a71f94fd54403a20347030509ef69. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:30.120106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Getting quotas for user 25a235b1ba7e4f7d8d7a7c424b80c823 and project 538a71f94fd54403a20347030509ef69. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:30.161467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:39:30.168919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:39:30.294202 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2a3da18d-3afc-4879-abb2-bb25d23bc901 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.652431 Aug 18 11:39:30.295414 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1648/3173] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:39:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:39:30.300896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3cef4eb1-b735-4f17-8d80-33b5ae3bcc17 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:30.301518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3cef4eb1-b735-4f17-8d80-33b5ae3bcc17 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:30.319949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cef4eb1-b735-4f17-8d80-33b5ae3bcc17 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:30.319949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cef4eb1-b735-4f17-8d80-33b5ae3bcc17 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:30.320328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cef4eb1-b735-4f17-8d80-33b5ae3bcc17 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:30.321116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cef4eb1-b735-4f17-8d80-33b5ae3bcc17 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:30.321665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cef4eb1-b735-4f17-8d80-33b5ae3bcc17 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:30.322282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cef4eb1-b735-4f17-8d80-33b5ae3bcc17 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:31.118776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3cef4eb1-b735-4f17-8d80-33b5ae3bcc17 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:31.135899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3cef4eb1-b735-4f17-8d80-33b5ae3bcc17 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:31.138359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3cef4eb1-b735-4f17-8d80-33b5ae3bcc17 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:31.145412 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3cef4eb1-b735-4f17-8d80-33b5ae3bcc17 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.846115 Aug 18 11:39:31.147961 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1649/3174] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:30 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:31.168728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-186a4eb9-1bd7-4854-92a8-9ce5b376ad04 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:31.169667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-186a4eb9-1bd7-4854-92a8-9ce5b376ad04 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:31.179985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-186a4eb9-1bd7-4854-92a8-9ce5b376ad04 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:31.181131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-186a4eb9-1bd7-4854-92a8-9ce5b376ad04 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:31.181984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-186a4eb9-1bd7-4854-92a8-9ce5b376ad04 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:31.182918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-186a4eb9-1bd7-4854-92a8-9ce5b376ad04 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:31.184447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-186a4eb9-1bd7-4854-92a8-9ce5b376ad04 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:31.185587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-186a4eb9-1bd7-4854-92a8-9ce5b376ad04 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:31.879851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-186a4eb9-1bd7-4854-92a8-9ce5b376ad04 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:31.888739 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-186a4eb9-1bd7-4854-92a8-9ce5b376ad04 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1679 microversion: 2.1 time: 0.738242 Aug 18 11:39:31.906172 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1650/3175] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:31 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1679 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:31.918061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ccb69341-453b-4e0b-a739-f436820ce915 req-d1f42366-15a2-42ba-933c-10e31ce6c45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "tag": "24885c1e-8ab4-4480-b962-978b2d7e12d7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:31.957056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ccb69341-453b-4e0b-a739-f436820ce915 req-d1f42366-15a2-42ba-933c-10e31ce6c45f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:31.960605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ccb69341-453b-4e0b-a739-f436820ce915 req-d1f42366-15a2-42ba-933c-10e31ce6c45f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:31.961636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ccb69341-453b-4e0b-a739-f436820ce915 req-d1f42366-15a2-42ba-933c-10e31ce6c45f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:32.014689 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ccb69341-453b-4e0b-a739-f436820ce915 req-d1f42366-15a2-42ba-933c-10e31ce6c45f service nova] Creating event network-changed:24885c1e-8ab4-4480-b962-978b2d7e12d7 for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:39:32.034231 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ccb69341-453b-4e0b-a739-f436820ce915 req-d1f42366-15a2-42ba-933c-10e31ce6c45f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124927 Aug 18 11:39:32.035792 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1651/3176] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:32.058470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-341f17ce-0c27-4749-9a11-1ce4f594b55b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:32.064559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-341f17ce-0c27-4749-9a11-1ce4f594b55b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:32.087259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-341f17ce-0c27-4749-9a11-1ce4f594b55b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:32.091791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-341f17ce-0c27-4749-9a11-1ce4f594b55b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:32.093035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-341f17ce-0c27-4749-9a11-1ce4f594b55b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:32.095830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-341f17ce-0c27-4749-9a11-1ce4f594b55b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:32.099047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-341f17ce-0c27-4749-9a11-1ce4f594b55b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:32.101939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-341f17ce-0c27-4749-9a11-1ce4f594b55b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:33.089787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-341f17ce-0c27-4749-9a11-1ce4f594b55b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:33.106018 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-341f17ce-0c27-4749-9a11-1ce4f594b55b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1469 microversion: 2.1 time: 1.064746 Aug 18 11:39:33.107520 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1652/3177] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:32 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1469 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:33.115670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7537324f-69e5-41ee-941c-3494a6198c20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:33.117514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7537324f-69e5-41ee-941c-3494a6198c20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:33.130110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7537324f-69e5-41ee-941c-3494a6198c20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:33.131104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7537324f-69e5-41ee-941c-3494a6198c20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:33.131569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7537324f-69e5-41ee-941c-3494a6198c20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:33.132432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7537324f-69e5-41ee-941c-3494a6198c20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:33.133262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7537324f-69e5-41ee-941c-3494a6198c20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:33.133856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7537324f-69e5-41ee-941c-3494a6198c20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:33.508292 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1ebf8f55-1583-489d-8fe8-6aeda0776a2b tempest-FloatingIPDetailsTestJSON-437216530 tempest-FloatingIPDetailsTestJSON-437216530-project] 10.222.0.73 "DELETE /compute/v2.1/os-floating-ips/fad48f6d-b5d2-4d03-8f3b-80c848e57504" status: 202 len: 0 microversion: 2.1 time: 4.784075 Aug 18 11:39:33.512151 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1526/3178] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:39:28 2022] DELETE /compute/v2.1/os-floating-ips/fad48f6d-b5d2-4d03-8f3b-80c848e57504 => generated 0 bytes in 4789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:39:33.517686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-2e5e1da6-33a3-42f9-b035-e3bfe7af2f08 req-211b363e-c516-4995-98d4-69b200e721df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7183ab-d769-4b94-9b9b-545a3eb459d7", "name": "network-vif-plugged", "status": "completed", "tag": "71abe44d-4829-45bc-98f7-b6337e80396d"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:33.539688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2e5e1da6-33a3-42f9-b035-e3bfe7af2f08 req-211b363e-c516-4995-98d4-69b200e721df service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:33.540251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2e5e1da6-33a3-42f9-b035-e3bfe7af2f08 req-211b363e-c516-4995-98d4-69b200e721df service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:33.540701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2e5e1da6-33a3-42f9-b035-e3bfe7af2f08 req-211b363e-c516-4995-98d4-69b200e721df service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:33.569843 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-2e5e1da6-33a3-42f9-b035-e3bfe7af2f08 req-211b363e-c516-4995-98d4-69b200e721df service nova] Creating event network-vif-plugged:71abe44d-4829-45bc-98f7-b6337e80396d for instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 on n-h2-853611-3 Aug 18 11:39:33.585281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [req-2e5e1da6-33a3-42f9-b035-e3bfe7af2f08 req-211b363e-c516-4995-98d4-69b200e721df service nova] Instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3'} {{(pid=122209) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 11:39:33.599242 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-2e5e1da6-33a3-42f9-b035-e3bfe7af2f08 req-211b363e-c516-4995-98d4-69b200e721df service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084923 Aug 18 11:39:33.613141 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1527/3179] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:33.619468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f2481f52-c739-4805-9aaa-09e4d720845c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:33.620447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f2481f52-c739-4805-9aaa-09e4d720845c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:33.631877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2481f52-c739-4805-9aaa-09e4d720845c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:33.633201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2481f52-c739-4805-9aaa-09e4d720845c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:33.633810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2481f52-c739-4805-9aaa-09e4d720845c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:33.634773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2481f52-c739-4805-9aaa-09e4d720845c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:33.635395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2481f52-c739-4805-9aaa-09e4d720845c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:33.635987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f2481f52-c739-4805-9aaa-09e4d720845c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:33.744768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7537324f-69e5-41ee-941c-3494a6198c20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:33.757883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7537324f-69e5-41ee-941c-3494a6198c20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:33.765896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7537324f-69e5-41ee-941c-3494a6198c20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:33.767187 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7537324f-69e5-41ee-941c-3494a6198c20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1871 microversion: 2.32 time: 0.657645 Aug 18 11:39:33.773867 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1653/3180] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:33 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1871 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:33.780670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4197cb11-a0ca-4bf0-b5f0-208d452d419b req-97358051-6f12-4c26-ab33-6a8c4a17b068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf75dc7-00eb-4c1b-986d-3a59443571b7", "name": "network-vif-deleted", "tag": "f6a21f93-cae9-4f96-9796-025f2beba9c3"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:33.797415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4197cb11-a0ca-4bf0-b5f0-208d452d419b req-97358051-6f12-4c26-ab33-6a8c4a17b068 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:33.802413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4197cb11-a0ca-4bf0-b5f0-208d452d419b req-97358051-6f12-4c26-ab33-6a8c4a17b068 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:33.803356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4197cb11-a0ca-4bf0-b5f0-208d452d419b req-97358051-6f12-4c26-ab33-6a8c4a17b068 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:33.842992 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4197cb11-a0ca-4bf0-b5f0-208d452d419b req-97358051-6f12-4c26-ab33-6a8c4a17b068 service nova] Creating event network-vif-deleted:f6a21f93-cae9-4f96-9796-025f2beba9c3 for instance caf75dc7-00eb-4c1b-986d-3a59443571b7 on n-h1-853611-3 Aug 18 11:39:33.855373 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4197cb11-a0ca-4bf0-b5f0-208d452d419b req-97358051-6f12-4c26-ab33-6a8c4a17b068 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078644 Aug 18 11:39:33.857987 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1654/3181] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:33.872884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-27280a42-0b66-43a7-b2cf-a1de81b308ca tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:33.873649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f2481f52-c739-4805-9aaa-09e4d720845c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:33.875582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-27280a42-0b66-43a7-b2cf-a1de81b308ca tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:33.893515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27280a42-0b66-43a7-b2cf-a1de81b308ca tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:33.895352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27280a42-0b66-43a7-b2cf-a1de81b308ca tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:33.897124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27280a42-0b66-43a7-b2cf-a1de81b308ca tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:33.898419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27280a42-0b66-43a7-b2cf-a1de81b308ca tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:33.900631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27280a42-0b66-43a7-b2cf-a1de81b308ca tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:33.901324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27280a42-0b66-43a7-b2cf-a1de81b308ca tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:33.905761 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f2481f52-c739-4805-9aaa-09e4d720845c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1275 microversion: 2.1 time: 0.290962 Aug 18 11:39:33.907463 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1528/3182] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:33 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:33.921084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9aca2ba2-4769-4f3c-8c91-3626023cfee8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:33.922299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9aca2ba2-4769-4f3c-8c91-3626023cfee8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:33.938270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9aca2ba2-4769-4f3c-8c91-3626023cfee8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:33.938841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9aca2ba2-4769-4f3c-8c91-3626023cfee8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:33.939932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9aca2ba2-4769-4f3c-8c91-3626023cfee8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:33.942330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9aca2ba2-4769-4f3c-8c91-3626023cfee8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:33.943573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9aca2ba2-4769-4f3c-8c91-3626023cfee8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:33.944197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9aca2ba2-4769-4f3c-8c91-3626023cfee8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:34.343073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9aca2ba2-4769-4f3c-8c91-3626023cfee8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:34.351870 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9aca2ba2-4769-4f3c-8c91-3626023cfee8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1679 microversion: 2.1 time: 0.441441 Aug 18 11:39:34.372508 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1529/3183] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:33 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1679 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:34.390836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-775ee9fe-498e-4c25-8940-046bb3d42714 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:34.392010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-775ee9fe-498e-4c25-8940-046bb3d42714 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:34.403496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-775ee9fe-498e-4c25-8940-046bb3d42714 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:34.405304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-775ee9fe-498e-4c25-8940-046bb3d42714 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:34.409830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-775ee9fe-498e-4c25-8940-046bb3d42714 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:34.411584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-775ee9fe-498e-4c25-8940-046bb3d42714 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:34.412788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-775ee9fe-498e-4c25-8940-046bb3d42714 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:34.413917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-775ee9fe-498e-4c25-8940-046bb3d42714 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:34.765911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-27280a42-0b66-43a7-b2cf-a1de81b308ca tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:34.780094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-27280a42-0b66-43a7-b2cf-a1de81b308ca tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:34.781848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-27280a42-0b66-43a7-b2cf-a1de81b308ca tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:34.783923 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-27280a42-0b66-43a7-b2cf-a1de81b308ca tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.921984 Aug 18 11:39:34.806288 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1655/3184] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:33 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:34.812511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-df7728c6-292f-4982-a439-3474dcebd524 req-a143b86d-7141-4d9c-8717-e43ce7f42589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "tag": "859fae89-a340-43ad-b582-571eb9a2c528"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:34.824535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-df7728c6-292f-4982-a439-3474dcebd524 req-a143b86d-7141-4d9c-8717-e43ce7f42589 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:34.825340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-df7728c6-292f-4982-a439-3474dcebd524 req-a143b86d-7141-4d9c-8717-e43ce7f42589 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:34.826391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-df7728c6-292f-4982-a439-3474dcebd524 req-a143b86d-7141-4d9c-8717-e43ce7f42589 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:34.843898 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-df7728c6-292f-4982-a439-3474dcebd524 req-a143b86d-7141-4d9c-8717-e43ce7f42589 service nova] Creating event network-changed:859fae89-a340-43ad-b582-571eb9a2c528 for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:39:34.851843 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-df7728c6-292f-4982-a439-3474dcebd524 req-a143b86d-7141-4d9c-8717-e43ce7f42589 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044078 Aug 18 11:39:34.853625 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1656/3185] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:34.861265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ef0ad8c4-864b-4a66-b280-40c105a84ff9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:34.863699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef0ad8c4-864b-4a66-b280-40c105a84ff9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:34.875774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef0ad8c4-864b-4a66-b280-40c105a84ff9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:34.877114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef0ad8c4-864b-4a66-b280-40c105a84ff9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:34.877889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef0ad8c4-864b-4a66-b280-40c105a84ff9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:34.878889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef0ad8c4-864b-4a66-b280-40c105a84ff9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:34.879899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef0ad8c4-864b-4a66-b280-40c105a84ff9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:34.880714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef0ad8c4-864b-4a66-b280-40c105a84ff9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:35.294168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-775ee9fe-498e-4c25-8940-046bb3d42714 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:35.306764 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-775ee9fe-498e-4c25-8940-046bb3d42714 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1469 microversion: 2.1 time: 0.931267 Aug 18 11:39:35.310242 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1530/3186] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:34 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1469 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:35.316449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1d85f21c-d1b9-43e4-b786-6efdb94a1082 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:35.320786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ef0ad8c4-864b-4a66-b280-40c105a84ff9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:35.334473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1d85f21c-d1b9-43e4-b786-6efdb94a1082 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:35.337712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ef0ad8c4-864b-4a66-b280-40c105a84ff9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:35.340556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ef0ad8c4-864b-4a66-b280-40c105a84ff9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:35.344156 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ef0ad8c4-864b-4a66-b280-40c105a84ff9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1892 microversion: 2.32 time: 0.488187 Aug 18 11:39:35.346833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d85f21c-d1b9-43e4-b786-6efdb94a1082 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:35.347344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d85f21c-d1b9-43e4-b786-6efdb94a1082 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:35.347790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d85f21c-d1b9-43e4-b786-6efdb94a1082 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:35.348597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d85f21c-d1b9-43e4-b786-6efdb94a1082 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:35.348986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d85f21c-d1b9-43e4-b786-6efdb94a1082 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:35.349423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d85f21c-d1b9-43e4-b786-6efdb94a1082 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:35.364471 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1657/3187] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:34 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1892 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:35.391807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-30d7653d-e679-454c-b319-7fde110fde90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:35.392512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-30d7653d-e679-454c-b319-7fde110fde90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:35.408076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d7653d-e679-454c-b319-7fde110fde90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:35.410704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d7653d-e679-454c-b319-7fde110fde90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:35.411251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d7653d-e679-454c-b319-7fde110fde90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:35.413210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d7653d-e679-454c-b319-7fde110fde90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:35.413751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d7653d-e679-454c-b319-7fde110fde90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:35.415030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d7653d-e679-454c-b319-7fde110fde90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:35.848643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-30d7653d-e679-454c-b319-7fde110fde90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:35.852293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:35.859947 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-30d7653d-e679-454c-b319-7fde110fde90 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1679 microversion: 2.1 time: 0.478226 Aug 18 11:39:35.870975 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1658/3188] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:35 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1679 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:35.870975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d02b2764-f23f-4fa7-8cbd-7bb5e55d8da5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:35.870975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d02b2764-f23f-4fa7-8cbd-7bb5e55d8da5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:35.876763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d02b2764-f23f-4fa7-8cbd-7bb5e55d8da5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:35.879121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d02b2764-f23f-4fa7-8cbd-7bb5e55d8da5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:35.880613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d02b2764-f23f-4fa7-8cbd-7bb5e55d8da5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:35.884663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d02b2764-f23f-4fa7-8cbd-7bb5e55d8da5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:35.885405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d02b2764-f23f-4fa7-8cbd-7bb5e55d8da5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:35.886254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d02b2764-f23f-4fa7-8cbd-7bb5e55d8da5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:36.148576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1d85f21c-d1b9-43e4-b786-6efdb94a1082 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:36.162417 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1d85f21c-d1b9-43e4-b786-6efdb94a1082 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1317 microversion: 2.1 time: 0.846155 Aug 18 11:39:36.164823 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1531/3189] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:35 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1317 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:36.336553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c6ba8263-c9e6-45a6-b354-12e7f8a78503 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:36.337971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c6ba8263-c9e6-45a6-b354-12e7f8a78503 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:36.347061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6ba8263-c9e6-45a6-b354-12e7f8a78503 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:36.347561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6ba8263-c9e6-45a6-b354-12e7f8a78503 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:36.350162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6ba8263-c9e6-45a6-b354-12e7f8a78503 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:36.351321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6ba8263-c9e6-45a6-b354-12e7f8a78503 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:36.352042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6ba8263-c9e6-45a6-b354-12e7f8a78503 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:36.352710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6ba8263-c9e6-45a6-b354-12e7f8a78503 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:36.360779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d02b2764-f23f-4fa7-8cbd-7bb5e55d8da5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:36.373750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d02b2764-f23f-4fa7-8cbd-7bb5e55d8da5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:36.380524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d02b2764-f23f-4fa7-8cbd-7bb5e55d8da5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:36.383756 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d02b2764-f23f-4fa7-8cbd-7bb5e55d8da5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.521892 Aug 18 11:39:36.389609 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1659/3190] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:35 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:36.394967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e80bd5f0-90a4-4250-8890-da039bc5b77a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:36.399187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e80bd5f0-90a4-4250-8890-da039bc5b77a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:36.420715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e80bd5f0-90a4-4250-8890-da039bc5b77a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:36.421227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e80bd5f0-90a4-4250-8890-da039bc5b77a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:36.421668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e80bd5f0-90a4-4250-8890-da039bc5b77a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:36.422685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e80bd5f0-90a4-4250-8890-da039bc5b77a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:36.423223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e80bd5f0-90a4-4250-8890-da039bc5b77a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:36.423722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e80bd5f0-90a4-4250-8890-da039bc5b77a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:37.000630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e80bd5f0-90a4-4250-8890-da039bc5b77a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:37.013809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e80bd5f0-90a4-4250-8890-da039bc5b77a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:37.025262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e80bd5f0-90a4-4250-8890-da039bc5b77a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:37.027004 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e80bd5f0-90a4-4250-8890-da039bc5b77a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.635881 Aug 18 11:39:37.028244 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1660/3191] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:36 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:37.036640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fcf71926-ff9d-47fb-b0ee-7994f2d0c805 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:37.042282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fcf71926-ff9d-47fb-b0ee-7994f2d0c805 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:37.053683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcf71926-ff9d-47fb-b0ee-7994f2d0c805 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:37.054188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcf71926-ff9d-47fb-b0ee-7994f2d0c805 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:37.061999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcf71926-ff9d-47fb-b0ee-7994f2d0c805 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:37.063786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcf71926-ff9d-47fb-b0ee-7994f2d0c805 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:37.064487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcf71926-ff9d-47fb-b0ee-7994f2d0c805 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:37.065129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcf71926-ff9d-47fb-b0ee-7994f2d0c805 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:37.180091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c6ba8263-c9e6-45a6-b354-12e7f8a78503 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:37.195360 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c6ba8263-c9e6-45a6-b354-12e7f8a78503 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1535 microversion: 2.1 time: 0.865261 Aug 18 11:39:37.199745 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1532/3192] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:36 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1535 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:37.210323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-39a09188-8aa6-40c9-9445-bd466b9b7369 req-d7e1c2d0-cb95-4ff2-97f0-4cfbb7ac9c26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "tag": "7e93816f-c07f-4c92-8bba-fbb519c88407"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:37.244546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-39a09188-8aa6-40c9-9445-bd466b9b7369 req-d7e1c2d0-cb95-4ff2-97f0-4cfbb7ac9c26 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:37.245400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-39a09188-8aa6-40c9-9445-bd466b9b7369 req-d7e1c2d0-cb95-4ff2-97f0-4cfbb7ac9c26 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:37.246145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-39a09188-8aa6-40c9-9445-bd466b9b7369 req-d7e1c2d0-cb95-4ff2-97f0-4cfbb7ac9c26 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:37.272364 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-39a09188-8aa6-40c9-9445-bd466b9b7369 req-d7e1c2d0-cb95-4ff2-97f0-4cfbb7ac9c26 service nova] Creating event network-changed:7e93816f-c07f-4c92-8bba-fbb519c88407 for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:39:37.277821 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-39a09188-8aa6-40c9-9445-bd466b9b7369 req-d7e1c2d0-cb95-4ff2-97f0-4cfbb7ac9c26 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071192 Aug 18 11:39:37.279936 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1533/3193] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:37.425133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fcf71926-ff9d-47fb-b0ee-7994f2d0c805 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:37.441051 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fcf71926-ff9d-47fb-b0ee-7994f2d0c805 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1679 microversion: 2.1 time: 0.410403 Aug 18 11:39:37.443897 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1661/3194] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:37 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1679 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:37.458227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-51cee9b5-a54d-4c71-8934-97738fb514b4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:37.458899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-51cee9b5-a54d-4c71-8934-97738fb514b4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:37.467656 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-07d137c6-1a31-44bb-b39f-2552ca290cc4 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Action: 'create', calling method: .version_select at 0x7f519f7e1e50>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-2081371742", "policies": ["affinity"]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:37.487065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51cee9b5-a54d-4c71-8934-97738fb514b4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:37.487625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51cee9b5-a54d-4c71-8934-97738fb514b4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:37.488074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51cee9b5-a54d-4c71-8934-97738fb514b4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:37.489705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51cee9b5-a54d-4c71-8934-97738fb514b4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:37.490176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51cee9b5-a54d-4c71-8934-97738fb514b4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:37.492798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51cee9b5-a54d-4c71-8934-97738fb514b4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:37.508567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-07d137c6-1a31-44bb-b39f-2552ca290cc4 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:37.526404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-07d137c6-1a31-44bb-b39f-2552ca290cc4 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for user 4db3fcd22a44469ca290875379b747f9 and project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:37.612972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-07d137c6-1a31-44bb-b39f-2552ca290cc4 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:37.619596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-07d137c6-1a31-44bb-b39f-2552ca290cc4 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for user 4db3fcd22a44469ca290875379b747f9 and project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:37.636267 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-07d137c6-1a31-44bb-b39f-2552ca290cc4 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.354564 Aug 18 11:39:37.637727 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1534/3195] 10.222.0.73 () {60 vars in 1174 bytes} [Thu Aug 18 11:39:37 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:37.643787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b63999d7-56a6-4934-8f01-6ca58d3a2190 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:37.644974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b63999d7-56a6-4934-8f01-6ca58d3a2190 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:37.653190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b63999d7-56a6-4934-8f01-6ca58d3a2190 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:37.654816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b63999d7-56a6-4934-8f01-6ca58d3a2190 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:37.655706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b63999d7-56a6-4934-8f01-6ca58d3a2190 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:37.656903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b63999d7-56a6-4934-8f01-6ca58d3a2190 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:37.657621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b63999d7-56a6-4934-8f01-6ca58d3a2190 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:37.658411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b63999d7-56a6-4934-8f01-6ca58d3a2190 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:38.012736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b63999d7-56a6-4934-8f01-6ca58d3a2190 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:38.028637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b63999d7-56a6-4934-8f01-6ca58d3a2190 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:38.033687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b63999d7-56a6-4934-8f01-6ca58d3a2190 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:38.037195 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b63999d7-56a6-4934-8f01-6ca58d3a2190 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.397356 Aug 18 11:39:38.038764 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1535/3196] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:37 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:38.043934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e36fc1fe-95a9-46cc-bec1-639b39dc30e5 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Action: 'create', calling method: .version_select at 0x7f519f7e10d0>, body: {"server_group": {"name": "tempest-server-group-1202310380", "policies": ["affinity"]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:38.073989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-e36fc1fe-95a9-46cc-bec1-639b39dc30e5 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:38.083993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-e36fc1fe-95a9-46cc-bec1-639b39dc30e5 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for user 4db3fcd22a44469ca290875379b747f9 and project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:38.168913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-e36fc1fe-95a9-46cc-bec1-639b39dc30e5 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:38.182883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-e36fc1fe-95a9-46cc-bec1-639b39dc30e5 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for user 4db3fcd22a44469ca290875379b747f9 and project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:38.205070 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e36fc1fe-95a9-46cc-bec1-639b39dc30e5 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.164881 Aug 18 11:39:38.205290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-51cee9b5-a54d-4c71-8934-97738fb514b4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:38.213575 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1536/3197] 10.222.0.73 () {60 vars in 1173 bytes} [Thu Aug 18 11:39:38 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:38.217551 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-51cee9b5-a54d-4c71-8934-97738fb514b4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1317 microversion: 2.1 time: 0.771138 Aug 18 11:39:38.218214 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1662/3198] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:37 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1317 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:38.229513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-94bbb0df-8109-4192-886c-1ee91e4dd101 req-95092f9c-3dbf-4093-9b75-ea282ba11a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3cf4491-1d85-4cb5-bee0-b99814a14635", "tag": "e724b4d0-2e09-4dc2-8433-c5394839ba16"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:38.248816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-983f2ea6-9027-4c6b-a345-e89c431fb4e1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:38.249507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-983f2ea6-9027-4c6b-a345-e89c431fb4e1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:38.251547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-94bbb0df-8109-4192-886c-1ee91e4dd101 req-95092f9c-3dbf-4093-9b75-ea282ba11a61 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:38.260780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-94bbb0df-8109-4192-886c-1ee91e4dd101 req-95092f9c-3dbf-4093-9b75-ea282ba11a61 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:38.261774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-94bbb0df-8109-4192-886c-1ee91e4dd101 req-95092f9c-3dbf-4093-9b75-ea282ba11a61 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:38.267166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-983f2ea6-9027-4c6b-a345-e89c431fb4e1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:38.267903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-983f2ea6-9027-4c6b-a345-e89c431fb4e1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:38.268412 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-983f2ea6-9027-4c6b-a345-e89c431fb4e1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:38.269780 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-983f2ea6-9027-4c6b-a345-e89c431fb4e1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:38.270314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-983f2ea6-9027-4c6b-a345-e89c431fb4e1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:38.270778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-983f2ea6-9027-4c6b-a345-e89c431fb4e1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:38.283225 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-94bbb0df-8109-4192-886c-1ee91e4dd101 req-95092f9c-3dbf-4093-9b75-ea282ba11a61 service nova] Creating event network-changed:e724b4d0-2e09-4dc2-8433-c5394839ba16 for instance b3cf4491-1d85-4cb5-bee0-b99814a14635 on n-h1-853611-3 Aug 18 11:39:38.296078 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-94bbb0df-8109-4192-886c-1ee91e4dd101 req-95092f9c-3dbf-4093-9b75-ea282ba11a61 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073449 Aug 18 11:39:38.299052 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1663/3199] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:38.314469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e0407402-77b8-47bc-9a3d-0c3efa3dce81 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Action: 'create', calling method: .version_select at 0x7f51b0dc3d30>, body: {"server_group": {"name": "tempest-server-group-1202310380", "policies": ["affinity"]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:38.349699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-e0407402-77b8-47bc-9a3d-0c3efa3dce81 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:38.357468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-e0407402-77b8-47bc-9a3d-0c3efa3dce81 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for user 4db3fcd22a44469ca290875379b747f9 and project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:38.431418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:38.470132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-e0407402-77b8-47bc-9a3d-0c3efa3dce81 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:38.477858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-e0407402-77b8-47bc-9a3d-0c3efa3dce81 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for user 4db3fcd22a44469ca290875379b747f9 and project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:38.481487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:38.502974 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e0407402-77b8-47bc-9a3d-0c3efa3dce81 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.202314 Aug 18 11:39:38.509976 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1664/3200] 10.222.0.73 () {60 vars in 1173 bytes} [Thu Aug 18 11:39:38 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:38.516859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-58d19804-c24f-490d-9ef1-b0a707479b76 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:38.518081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-58d19804-c24f-490d-9ef1-b0a707479b76 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:38.525264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58d19804-c24f-490d-9ef1-b0a707479b76 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:38.525961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58d19804-c24f-490d-9ef1-b0a707479b76 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:38.526610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58d19804-c24f-490d-9ef1-b0a707479b76 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:38.527491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58d19804-c24f-490d-9ef1-b0a707479b76 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:38.528189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58d19804-c24f-490d-9ef1-b0a707479b76 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:38.528796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58d19804-c24f-490d-9ef1-b0a707479b76 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:38.682015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-983f2ea6-9027-4c6b-a345-e89c431fb4e1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:38.696497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-983f2ea6-9027-4c6b-a345-e89c431fb4e1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:38.698550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-983f2ea6-9027-4c6b-a345-e89c431fb4e1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:38.700145 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-983f2ea6-9027-4c6b-a345-e89c431fb4e1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.484121 Aug 18 11:39:38.701395 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1537/3201] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:38 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:38.733834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c71a5d6e-28c9-4a01-9308-58d6847e8d18 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:38.734775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c71a5d6e-28c9-4a01-9308-58d6847e8d18 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:38.742867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c71a5d6e-28c9-4a01-9308-58d6847e8d18 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:38.743607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c71a5d6e-28c9-4a01-9308-58d6847e8d18 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:38.744308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c71a5d6e-28c9-4a01-9308-58d6847e8d18 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:38.745212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c71a5d6e-28c9-4a01-9308-58d6847e8d18 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:38.745838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c71a5d6e-28c9-4a01-9308-58d6847e8d18 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:38.746474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c71a5d6e-28c9-4a01-9308-58d6847e8d18 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:38.790697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-58d19804-c24f-490d-9ef1-b0a707479b76 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:38.799941 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-58d19804-c24f-490d-9ef1-b0a707479b76 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1535 microversion: 2.1 time: 0.288613 Aug 18 11:39:38.802069 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1665/3202] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:38 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1535 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:38.807179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4da59a92-5f1f-4247-b41d-a328cf5c99c7 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:38.856430 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4da59a92-5f1f-4247-b41d-a328cf5c99c7 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "DELETE /compute/v2.1/os-server-groups/949a3630-396e-4a34-8695-6fd9f8fe3516" status: 204 len: 0 microversion: 2.1 time: 0.052933 Aug 18 11:39:38.862274 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1666/3203] 10.222.0.73 () {58 vars in 1266 bytes} [Thu Aug 18 11:39:38 2022] DELETE /compute/v2.1/os-server-groups/949a3630-396e-4a34-8695-6fd9f8fe3516 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:39:38.868518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f89023b9-f294-44b5-8bc6-60dc3fc9f6f8 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:38.890744 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f89023b9-f294-44b5-8bc6-60dc3fc9f6f8 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.026887 Aug 18 11:39:38.891647 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1667/3204] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:39:38 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:38.907738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec817f12-6bae-43f0-9fce-c6d49b943589 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:38.948906 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ec817f12-6bae-43f0-9fce-c6d49b943589 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "DELETE /compute/v2.1/os-server-groups/1c333b43-d36a-4a32-9b14-d02ee2d467fa" status: 204 len: 0 microversion: 2.1 time: 0.050185 Aug 18 11:39:38.953710 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1668/3205] 10.222.0.73 () {58 vars in 1266 bytes} [Thu Aug 18 11:39:38 2022] DELETE /compute/v2.1/os-server-groups/1c333b43-d36a-4a32-9b14-d02ee2d467fa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:39:38.967504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c632f288-0a52-4f2b-b890-88fc98e2ee3a tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:38.981445 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c632f288-0a52-4f2b-b890-88fc98e2ee3a tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.025487 Aug 18 11:39:38.988573 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1669/3206] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:39:38 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:38.997636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-09370240-8cd6-45ee-8f72-c7ab3eaf6ad5 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Action: 'create', calling method: .version_select at 0x7f519faa7310>, body: {"server_group": {"name": "tempest-server-group-1975459331", "policies": ["affinity"]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:39.045753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-09370240-8cd6-45ee-8f72-c7ab3eaf6ad5 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:39.062390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-09370240-8cd6-45ee-8f72-c7ab3eaf6ad5 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for user 4db3fcd22a44469ca290875379b747f9 and project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:39.138662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-09370240-8cd6-45ee-8f72-c7ab3eaf6ad5 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:39.145786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-09370240-8cd6-45ee-8f72-c7ab3eaf6ad5 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for user 4db3fcd22a44469ca290875379b747f9 and project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:39.163609 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-09370240-8cd6-45ee-8f72-c7ab3eaf6ad5 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.173584 Aug 18 11:39:39.164593 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1670/3207] 10.222.0.73 () {60 vars in 1173 bytes} [Thu Aug 18 11:39:38 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:39.173420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d2625ec1-d096-44f4-ba3d-0fc146dcd739 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:39.174047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d2625ec1-d096-44f4-ba3d-0fc146dcd739 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:39.183311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2625ec1-d096-44f4-ba3d-0fc146dcd739 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:39.184584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2625ec1-d096-44f4-ba3d-0fc146dcd739 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:39.185036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2625ec1-d096-44f4-ba3d-0fc146dcd739 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:39.186865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2625ec1-d096-44f4-ba3d-0fc146dcd739 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:39.187178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2625ec1-d096-44f4-ba3d-0fc146dcd739 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:39.187910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2625ec1-d096-44f4-ba3d-0fc146dcd739 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:39.491718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c71a5d6e-28c9-4a01-9308-58d6847e8d18 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:39.508704 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c71a5d6e-28c9-4a01-9308-58d6847e8d18 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1656 microversion: 2.1 time: 0.806040 Aug 18 11:39:39.510120 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1538/3208] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:38 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1656 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:39.515681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b5f658cb-de21-4d88-81b3-dc9c6420f810 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:39.579423 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b5f658cb-de21-4d88-81b3-dc9c6420f810 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "DELETE /compute/v2.1/os-server-groups/e8ca166b-7cc4-4717-9688-e9134081f269" status: 204 len: 0 microversion: 2.1 time: 0.067979 Aug 18 11:39:39.580406 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1539/3209] 10.222.0.73 () {58 vars in 1266 bytes} [Thu Aug 18 11:39:39 2022] DELETE /compute/v2.1/os-server-groups/e8ca166b-7cc4-4717-9688-e9134081f269 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:39:39.585568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-33487d06-7539-4c81-bb92-7e98842484cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:39.586206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-33487d06-7539-4c81-bb92-7e98842484cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:39.612207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33487d06-7539-4c81-bb92-7e98842484cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:39.612838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33487d06-7539-4c81-bb92-7e98842484cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:39.613311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33487d06-7539-4c81-bb92-7e98842484cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:39.614086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33487d06-7539-4c81-bb92-7e98842484cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:39.614591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33487d06-7539-4c81-bb92-7e98842484cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:39.615058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33487d06-7539-4c81-bb92-7e98842484cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:39.702168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2625ec1-d096-44f4-ba3d-0fc146dcd739 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:39.727929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2625ec1-d096-44f4-ba3d-0fc146dcd739 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:39.729529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2625ec1-d096-44f4-ba3d-0fc146dcd739 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:39.736383 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d2625ec1-d096-44f4-ba3d-0fc146dcd739 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.565103 Aug 18 11:39:39.737068 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1671/3210] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:39 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:39.755458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-651d3a7d-e7c2-4b5e-8a6e-7b1919f37d37 req-0b10dc3b-93af-4f2a-ba51-b4cdf997b0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "tag": "d41345fd-e890-44f2-bb0d-38e0419cb39a"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:39.777844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-651d3a7d-e7c2-4b5e-8a6e-7b1919f37d37 req-0b10dc3b-93af-4f2a-ba51-b4cdf997b0e6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:39.780620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-651d3a7d-e7c2-4b5e-8a6e-7b1919f37d37 req-0b10dc3b-93af-4f2a-ba51-b4cdf997b0e6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:39.781707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-651d3a7d-e7c2-4b5e-8a6e-7b1919f37d37 req-0b10dc3b-93af-4f2a-ba51-b4cdf997b0e6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:39.817135 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-651d3a7d-e7c2-4b5e-8a6e-7b1919f37d37 req-0b10dc3b-93af-4f2a-ba51-b4cdf997b0e6 service nova] Creating event network-changed:d41345fd-e890-44f2-bb0d-38e0419cb39a for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:39:39.831046 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-651d3a7d-e7c2-4b5e-8a6e-7b1919f37d37 req-0b10dc3b-93af-4f2a-ba51-b4cdf997b0e6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092518 Aug 18 11:39:39.834107 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1672/3211] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:39.870146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f1269692-5e2e-4c86-b8f4-1933d5d60f7a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:39.881693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1269692-5e2e-4c86-b8f4-1933d5d60f7a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:39.882252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1269692-5e2e-4c86-b8f4-1933d5d60f7a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:39.883551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1269692-5e2e-4c86-b8f4-1933d5d60f7a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:39.910023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f1269692-5e2e-4c86-b8f4-1933d5d60f7a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Going to try to start instance {{(pid=122210) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 18 11:39:40.014097 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f1269692-5e2e-4c86-b8f4-1933d5d60f7a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.177645 Aug 18 11:39:40.014538 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1673/3212] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:39:39 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:39:40.044003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ed04f934-a499-460b-a421-6f82ff234e87 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:40.069541 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ed04f934-a499-460b-a421-6f82ff234e87 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035593 Aug 18 11:39:40.080518 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1674/3213] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:39:40 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:40.080518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-635f57f2-8894-4683-bf6e-72665ab7f7cd req-e5803a6b-ede3-4b7c-9292-ddf7594cf54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7183ab-d769-4b94-9b9b-545a3eb459d7", "name": "network-vif-unplugged", "status": "completed", "tag": "71abe44d-4829-45bc-98f7-b6337e80396d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:40.092760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:40.114712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-635f57f2-8894-4683-bf6e-72665ab7f7cd req-e5803a6b-ede3-4b7c-9292-ddf7594cf54b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:40.114712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-635f57f2-8894-4683-bf6e-72665ab7f7cd req-e5803a6b-ede3-4b7c-9292-ddf7594cf54b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:40.114712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-635f57f2-8894-4683-bf6e-72665ab7f7cd req-e5803a6b-ede3-4b7c-9292-ddf7594cf54b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:40.132187 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-635f57f2-8894-4683-bf6e-72665ab7f7cd req-e5803a6b-ede3-4b7c-9292-ddf7594cf54b service nova] Creating event network-vif-unplugged:71abe44d-4829-45bc-98f7-b6337e80396d for instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 on n-h2-853611-3 Aug 18 11:39:40.139788 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-635f57f2-8894-4683-bf6e-72665ab7f7cd req-e5803a6b-ede3-4b7c-9292-ddf7594cf54b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065999 Aug 18 11:39:40.141224 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1675/3214] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:40.147081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a72ff2f-e41c-42c3-8071-5fcc33c42fd7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:40.147799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4a72ff2f-e41c-42c3-8071-5fcc33c42fd7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:40.154722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a72ff2f-e41c-42c3-8071-5fcc33c42fd7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:40.154951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a72ff2f-e41c-42c3-8071-5fcc33c42fd7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:40.155684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a72ff2f-e41c-42c3-8071-5fcc33c42fd7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:40.156475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a72ff2f-e41c-42c3-8071-5fcc33c42fd7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:40.157586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a72ff2f-e41c-42c3-8071-5fcc33c42fd7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:40.158028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a72ff2f-e41c-42c3-8071-5fcc33c42fd7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:40.490523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4a72ff2f-e41c-42c3-8071-5fcc33c42fd7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:40.511860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4a72ff2f-e41c-42c3-8071-5fcc33c42fd7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:40.514588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4a72ff2f-e41c-42c3-8071-5fcc33c42fd7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:40.516363 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4a72ff2f-e41c-42c3-8071-5fcc33c42fd7 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.373548 Aug 18 11:39:40.517168 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1676/3215] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:40 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:40.522386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-17e2df76-fe03-4e4f-ac4c-062a52d9e5bd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:40.523201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-17e2df76-fe03-4e4f-ac4c-062a52d9e5bd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:40.538118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17e2df76-fe03-4e4f-ac4c-062a52d9e5bd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:40.538776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17e2df76-fe03-4e4f-ac4c-062a52d9e5bd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:40.539426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17e2df76-fe03-4e4f-ac4c-062a52d9e5bd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:40.540408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17e2df76-fe03-4e4f-ac4c-062a52d9e5bd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:40.540938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17e2df76-fe03-4e4f-ac4c-062a52d9e5bd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:40.541445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17e2df76-fe03-4e4f-ac4c-062a52d9e5bd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:40.627388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-33487d06-7539-4c81-bb92-7e98842484cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:40.640909 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-33487d06-7539-4c81-bb92-7e98842484cf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1317 microversion: 2.1 time: 1.059234 Aug 18 11:39:40.641717 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1540/3216] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:39 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1317 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:40.658083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-711ffc4d-c3de-48b2-8377-d697764813f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:40.658749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-711ffc4d-c3de-48b2-8377-d697764813f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:40.679123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-711ffc4d-c3de-48b2-8377-d697764813f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:40.680046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-711ffc4d-c3de-48b2-8377-d697764813f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:40.680829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-711ffc4d-c3de-48b2-8377-d697764813f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:40.681785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-711ffc4d-c3de-48b2-8377-d697764813f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:40.682640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-711ffc4d-c3de-48b2-8377-d697764813f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:40.683320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-711ffc4d-c3de-48b2-8377-d697764813f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:40.819665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-17e2df76-fe03-4e4f-ac4c-062a52d9e5bd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:40.834779 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-17e2df76-fe03-4e4f-ac4c-062a52d9e5bd tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1528 microversion: 2.1 time: 0.316294 Aug 18 11:39:40.837976 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1677/3217] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:40 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1528 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:40.844144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c227fee9-84e7-4deb-a040-933e5eed5bb7 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Action: 'create', calling method: .version_select at 0x7f519fe8f0d0>, body: {"server_group": {"name": "tempest-server-group-1236195880", "policies": ["anti-affinity"]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:40.865138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c227fee9-84e7-4deb-a040-933e5eed5bb7 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:40.876935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c227fee9-84e7-4deb-a040-933e5eed5bb7 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for user 4db3fcd22a44469ca290875379b747f9 and project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:40.972272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c227fee9-84e7-4deb-a040-933e5eed5bb7 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:40.979987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c227fee9-84e7-4deb-a040-933e5eed5bb7 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for user 4db3fcd22a44469ca290875379b747f9 and project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_groups'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:40.998116 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c227fee9-84e7-4deb-a040-933e5eed5bb7 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.157801 Aug 18 11:39:40.999613 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1678/3218] 10.222.0.73 () {60 vars in 1173 bytes} [Thu Aug 18 11:39:40 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:41.003967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-28ef63bd-95e9-4f0b-a5ef-578b9de3d5a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:41.004745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-28ef63bd-95e9-4f0b-a5ef-578b9de3d5a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:41.015795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28ef63bd-95e9-4f0b-a5ef-578b9de3d5a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:41.017424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28ef63bd-95e9-4f0b-a5ef-578b9de3d5a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:41.017943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28ef63bd-95e9-4f0b-a5ef-578b9de3d5a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:41.018793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28ef63bd-95e9-4f0b-a5ef-578b9de3d5a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:41.019212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28ef63bd-95e9-4f0b-a5ef-578b9de3d5a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:41.019595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28ef63bd-95e9-4f0b-a5ef-578b9de3d5a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:41.235664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-711ffc4d-c3de-48b2-8377-d697764813f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:41.244564 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-711ffc4d-c3de-48b2-8377-d697764813f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1665 microversion: 2.1 time: 0.592591 Aug 18 11:39:41.259350 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1541/3219] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:40 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1665 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:41.265802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-044291eb-8e5c-4b49-b241-575c1344676d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:41.266018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-28ef63bd-95e9-4f0b-a5ef-578b9de3d5a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:41.266929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-044291eb-8e5c-4b49-b241-575c1344676d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:41.276437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-28ef63bd-95e9-4f0b-a5ef-578b9de3d5a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:41.278056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-28ef63bd-95e9-4f0b-a5ef-578b9de3d5a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:41.279498 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-28ef63bd-95e9-4f0b-a5ef-578b9de3d5a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.279235 Aug 18 11:39:41.280301 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1679/3220] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:40 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:41.285908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-27a61a72-0da8-49a4-9537-c34240eb4139 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:41.292439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-044291eb-8e5c-4b49-b241-575c1344676d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:41.295760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-044291eb-8e5c-4b49-b241-575c1344676d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:41.298348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-044291eb-8e5c-4b49-b241-575c1344676d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:41.299271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-044291eb-8e5c-4b49-b241-575c1344676d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:41.303850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-044291eb-8e5c-4b49-b241-575c1344676d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:41.307045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-044291eb-8e5c-4b49-b241-575c1344676d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:41.311806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=7,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:41.330630 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-27a61a72-0da8-49a4-9537-c34240eb4139 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "DELETE /compute/v2.1/os-server-groups/58ea3811-3d9e-479c-b7d9-49ce6045b514" status: 204 len: 0 microversion: 2.1 time: 0.048998 Aug 18 11:39:41.331780 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1680/3221] 10.222.0.73 () {58 vars in 1266 bytes} [Thu Aug 18 11:39:41 2022] DELETE /compute/v2.1/os-server-groups/58ea3811-3d9e-479c-b7d9-49ce6045b514 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:39:41.342853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-95680ee3-8adf-4282-8e52-173b2bc8d9f1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:41.359657 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-95680ee3-8adf-4282-8e52-173b2bc8d9f1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.023206 Aug 18 11:39:41.367472 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1681/3222] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:39:41 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:41.422555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-987953170", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "85b8e075-00c7-4194-a821-f8f376da7861"}]}, "os:scheduler_hints": {"group": "7c6f08bd-611f-40ed-a134-9347b89426a0"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:41.519954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] validate_networks() for [('85b8e075-00c7-4194-a821-f8f376da7861', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:39:41.847263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-044291eb-8e5c-4b49-b241-575c1344676d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:41.855999 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-044291eb-8e5c-4b49-b241-575c1344676d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1528 microversion: 2.1 time: 0.595089 Aug 18 11:39:41.870870 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1542/3223] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:41 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1528 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:41.879031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-952187c8-a16a-4026-b374-60d94e315d9e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:41.880117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-952187c8-a16a-4026-b374-60d94e315d9e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:41.886726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952187c8-a16a-4026-b374-60d94e315d9e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:41.887621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952187c8-a16a-4026-b374-60d94e315d9e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:41.889087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952187c8-a16a-4026-b374-60d94e315d9e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:41.890158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952187c8-a16a-4026-b374-60d94e315d9e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:41.890924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952187c8-a16a-4026-b374-60d94e315d9e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:41.891625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952187c8-a16a-4026-b374-60d94e315d9e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:42.082609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:39:42.083245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:39:42.083621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:39:42.084216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:39:42.084815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:39:42.108609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:42.110332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:42.111162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:42.112088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:42.112728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:42.113315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:42.142732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:42.148988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for user 4db3fcd22a44469ca290875379b747f9 and project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:42.164514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:39:42.167355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:39:42.230344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_group_members'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:42.238235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for user 4db3fcd22a44469ca290875379b747f9 and project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_group_members'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:42.289065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_group_members'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:42.297564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Getting quotas for user 4db3fcd22a44469ca290875379b747f9 and project 6de0753e6c9e4ddab2fd34f0c71c1678. Resources: {'server_group_members'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:42.339461 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d5a18634-640c-4227-b3eb-a2e6d6211c74 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.922574 Aug 18 11:39:42.340871 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1682/3224] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:39:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:39:42.350537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e42b4765-ae38-40a6-943f-281abb5d3d99 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:42.350785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e42b4765-ae38-40a6-943f-281abb5d3d99 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:42.376821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e42b4765-ae38-40a6-943f-281abb5d3d99 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:42.377597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e42b4765-ae38-40a6-943f-281abb5d3d99 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:42.378670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e42b4765-ae38-40a6-943f-281abb5d3d99 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:42.379775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e42b4765-ae38-40a6-943f-281abb5d3d99 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:42.380499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e42b4765-ae38-40a6-943f-281abb5d3d99 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:42.381166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e42b4765-ae38-40a6-943f-281abb5d3d99 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:42.554572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-952187c8-a16a-4026-b374-60d94e315d9e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:42.568409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-952187c8-a16a-4026-b374-60d94e315d9e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:42.570671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-952187c8-a16a-4026-b374-60d94e315d9e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:42.572244 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-952187c8-a16a-4026-b374-60d94e315d9e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.699898 Aug 18 11:39:42.592373 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1543/3225] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:41 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:42.599839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-257c1812-1de6-4632-84ca-e10f428996fb tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:42.600887 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:39:42.600887 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:39:42.608372 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-257c1812-1de6-4632-84ca-e10f428996fb tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] HTTP exception thrown: Flavor f9035438-2b8a-4310-b3dd-acd834add8e6 could not be found. Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-257c1812-1de6-4632-84ca-e10f428996fb tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Request method failure captured: Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/flavors/f9035438-2b8a-4310-b3dd-acd834add8e6 HTTP/1.1 Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iQUeKRSCJMLRzhHjZ0EUtK_Qg3N8tCYoth11MPE39y9F6wfOu0I0wEk-xotaTzka6iBEnzjZ8mgJl38EJ6JM96cliU8dwjqKSaHPQTJeYT9Ca8Q60yUZJa3_XIY6m3e-K4gaRk5vuX2dCI9ZX77o9E_ydBFm6eVu_erpWbwdvc89Rs Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a6cdef501fd64db9ad001e62a302ccca Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-MigrationsAdminTest-47954829 Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Role: admin,member,reader Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: admin,member,reader Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a6cdef501fd64db9ad001e62a302ccca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a6cdef501fd64db9ad001e62a302ccca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a6cdef501fd64db9ad001e62a302ccca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a6cdef501fd64db9ad001e62a302ccca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-MigrationsAdminTest-47954829 Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a6cdef501fd64db9ad001e62a302ccca Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-MigrationsAdminTest-47954829 Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-MigrationsAdminTest-47954829-project-admin Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 0b1fc7f260154f4e90bdd7aad924eef2 Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-MigrationsAdminTest-47954829-project-admin Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: exception: Flavor f9035438-2b8a-4310-b3dd-acd834add8e6 could not be found. Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'f9035438-2b8a-4310-b3dd-acd834add8e6'} Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f9035438-2b8a-4310-b3dd-acd834add8e6 could not be found. Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor f9035438-2b8a-4310-b3dd-acd834add8e6 could not be found. Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:42.619889 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:42.627613 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:42.627613 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:42.627613 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:42.627613 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:42.627613 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:39:42.627613 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:39:42.627613 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f9035438-2b8a-4310-b3dd-acd834add8e6 could not be found. Aug 18 11:39:42.627613 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:42.629028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e42b4765-ae38-40a6-943f-281abb5d3d99 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:42.630638 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e42b4765-ae38-40a6-943f-281abb5d3d99 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1317 microversion: 2.1 time: 0.287453 Aug 18 11:39:42.631614 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1683/3226] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:42 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:42.639199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b4b006c9-85b7-4b5c-b970-4c979ae5563f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:42.640123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b4b006c9-85b7-4b5c-b970-4c979ae5563f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:42.644452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-257c1812-1de6-4632-84ca-e10f428996fb tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Returning 404 to user: Flavor f9035438-2b8a-4310-b3dd-acd834add8e6 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:39:42.645586 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-257c1812-1de6-4632-84ca-e10f428996fb tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/f9035438-2b8a-4310-b3dd-acd834add8e6" status: 404 len: 109 microversion: 2.1 time: 0.051651 Aug 18 11:39:42.647721 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1544/3227] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:39:42 2022] DELETE /compute/v2.1/flavors/f9035438-2b8a-4310-b3dd-acd834add8e6 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:39:42.655176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-743149ca-2f9d-4552-9876-245a7d91ec78 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:42.656228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-743149ca-2f9d-4552-9876-245a7d91ec78 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:42.660821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4b006c9-85b7-4b5c-b970-4c979ae5563f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:42.661331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4b006c9-85b7-4b5c-b970-4c979ae5563f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:42.661787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4b006c9-85b7-4b5c-b970-4c979ae5563f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:42.671188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4b006c9-85b7-4b5c-b970-4c979ae5563f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:42.671286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4b006c9-85b7-4b5c-b970-4c979ae5563f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:42.671825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4b006c9-85b7-4b5c-b970-4c979ae5563f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:42.689106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-743149ca-2f9d-4552-9876-245a7d91ec78 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:42.692521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-743149ca-2f9d-4552-9876-245a7d91ec78 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:42.693507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-743149ca-2f9d-4552-9876-245a7d91ec78 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:42.695355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-743149ca-2f9d-4552-9876-245a7d91ec78 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:42.695701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-743149ca-2f9d-4552-9876-245a7d91ec78 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:42.696834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-743149ca-2f9d-4552-9876-245a7d91ec78 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:43.016742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b4b006c9-85b7-4b5c-b970-4c979ae5563f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:43.027214 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b4b006c9-85b7-4b5c-b970-4c979ae5563f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1665 microversion: 2.1 time: 0.394203 Aug 18 11:39:43.042152 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1684/3228] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:42 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1665 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:43.042152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b5844d1-bb62-4466-920e-d8728ddaa74c tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:43.042152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2b5844d1-bb62-4466-920e-d8728ddaa74c tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:43.121568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-743149ca-2f9d-4552-9876-245a7d91ec78 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:43.139386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-743149ca-2f9d-4552-9876-245a7d91ec78 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:43.143975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2b5844d1-bb62-4466-920e-d8728ddaa74c tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db3fcd22a44469ca290875379b747f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de0753e6c9e4ddab2fd34f0c71c1678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:43.155365 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2b5844d1-bb62-4466-920e-d8728ddaa74c tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 200 len: 1212 microversion: 2.1 time: 0.121352 Aug 18 11:39:43.157041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-743149ca-2f9d-4552-9876-245a7d91ec78 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:43.158306 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-743149ca-2f9d-4552-9876-245a7d91ec78 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.509580 Aug 18 11:39:43.172072 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1685/3229] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:43 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 1212 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:43.172072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-944dc405-d66e-44bc-97cd-815013b8d6ca req-202a7ceb-cc98-4e9b-9480-2ae3903957ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "tag": "7e3a32b5-0288-4b94-9154-5891994bd66b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:43.172374 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1545/3230] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:42 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:43.174249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-382704019", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:43.196347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-944dc405-d66e-44bc-97cd-815013b8d6ca req-202a7ceb-cc98-4e9b-9480-2ae3903957ec service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:43.197200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-944dc405-d66e-44bc-97cd-815013b8d6ca req-202a7ceb-cc98-4e9b-9480-2ae3903957ec service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:43.197912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-944dc405-d66e-44bc-97cd-815013b8d6ca req-202a7ceb-cc98-4e9b-9480-2ae3903957ec service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:43.213577 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-944dc405-d66e-44bc-97cd-815013b8d6ca req-202a7ceb-cc98-4e9b-9480-2ae3903957ec service nova] Creating event network-changed:7e3a32b5-0288-4b94-9154-5891994bd66b for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:39:43.219155 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-944dc405-d66e-44bc-97cd-815013b8d6ca req-202a7ceb-cc98-4e9b-9480-2ae3903957ec service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058050 Aug 18 11:39:43.220091 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1686/3231] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:43.288111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:39:43.599999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-41d9e368-9040-4b5f-9dab-dbce027eadab tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:43.600922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-41d9e368-9040-4b5f-9dab-dbce027eadab tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:43.616679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41d9e368-9040-4b5f-9dab-dbce027eadab tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:43.617355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41d9e368-9040-4b5f-9dab-dbce027eadab tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:43.617958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41d9e368-9040-4b5f-9dab-dbce027eadab tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:43.618911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41d9e368-9040-4b5f-9dab-dbce027eadab tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:43.619543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41d9e368-9040-4b5f-9dab-dbce027eadab tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:43.620193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41d9e368-9040-4b5f-9dab-dbce027eadab tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:43.980460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-41d9e368-9040-4b5f-9dab-dbce027eadab tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:43.991462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-41d9e368-9040-4b5f-9dab-dbce027eadab tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:43.993418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-41d9e368-9040-4b5f-9dab-dbce027eadab tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:43.995055 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-41d9e368-9040-4b5f-9dab-dbce027eadab tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.399956 Aug 18 11:39:43.996562 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1687/3232] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:43 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:44.002017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-be7bff25-9754-4c38-aafa-5e6ebd185c81 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:44.003100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-be7bff25-9754-4c38-aafa-5e6ebd185c81 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:44.009509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be7bff25-9754-4c38-aafa-5e6ebd185c81 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:44.010539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be7bff25-9754-4c38-aafa-5e6ebd185c81 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:44.011225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be7bff25-9754-4c38-aafa-5e6ebd185c81 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:44.012349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be7bff25-9754-4c38-aafa-5e6ebd185c81 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:44.013622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be7bff25-9754-4c38-aafa-5e6ebd185c81 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:44.014327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be7bff25-9754-4c38-aafa-5e6ebd185c81 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:44.475671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:39:44.475671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:39:44.475671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:39:44.475671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:39:44.475671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:39:44.493676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:44.494286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:44.494930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:44.496211 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:44.497136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:44.499064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:44.503071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-be7bff25-9754-4c38-aafa-5e6ebd185c81 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:44.525826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:44.541355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:44.551550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:44.558193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Getting quotas for project 6387896b424840deb9ef97aae02edd99. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:39:44.569873 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-be7bff25-9754-4c38-aafa-5e6ebd185c81 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1317 microversion: 2.1 time: 0.570875 Aug 18 11:39:44.575008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Getting quotas for user 9269fc4d233c42a590bfcbfaa7f2e895 and project 6387896b424840deb9ef97aae02edd99. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:39:44.579090 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1688/3233] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:43 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:44.595175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fd758cab-b7d3-4a63-94a1-b922fee54f2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:44.596961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fd758cab-b7d3-4a63-94a1-b922fee54f2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:44.614777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:39:44.617352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:39:44.620930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd758cab-b7d3-4a63-94a1-b922fee54f2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:44.622030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd758cab-b7d3-4a63-94a1-b922fee54f2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:44.623758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd758cab-b7d3-4a63-94a1-b922fee54f2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:44.625414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd758cab-b7d3-4a63-94a1-b922fee54f2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:44.626769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd758cab-b7d3-4a63-94a1-b922fee54f2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:44.627873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd758cab-b7d3-4a63-94a1-b922fee54f2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:44.701561 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2a1ee92c-d4e7-4bf5-a96f-f4ad8ebc321a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.533226 Aug 18 11:39:44.703206 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1546/3234] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:39:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:39:44.722199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e16e9824-d78c-4688-b653-709cfb9fdf00 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:44.723394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e16e9824-d78c-4688-b653-709cfb9fdf00 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:44.745623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e16e9824-d78c-4688-b653-709cfb9fdf00 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:44.746272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e16e9824-d78c-4688-b653-709cfb9fdf00 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:44.747007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e16e9824-d78c-4688-b653-709cfb9fdf00 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:44.748019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e16e9824-d78c-4688-b653-709cfb9fdf00 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:44.749962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e16e9824-d78c-4688-b653-709cfb9fdf00 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:44.749962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e16e9824-d78c-4688-b653-709cfb9fdf00 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:44.897518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e16e9824-d78c-4688-b653-709cfb9fdf00 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db3fcd22a44469ca290875379b747f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de0753e6c9e4ddab2fd34f0c71c1678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:44.906211 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e16e9824-d78c-4688-b653-709cfb9fdf00 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 200 len: 1270 microversion: 2.1 time: 0.201190 Aug 18 11:39:44.906869 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1547/3235] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:44 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 1270 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:44.919723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-38ae983b-f93c-4ada-8ca7-47929814c48a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:44.924360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-38ae983b-f93c-4ada-8ca7-47929814c48a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:44.935763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38ae983b-f93c-4ada-8ca7-47929814c48a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:44.947248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38ae983b-f93c-4ada-8ca7-47929814c48a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:44.947992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38ae983b-f93c-4ada-8ca7-47929814c48a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:44.949130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38ae983b-f93c-4ada-8ca7-47929814c48a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:44.949873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38ae983b-f93c-4ada-8ca7-47929814c48a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:44.951086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38ae983b-f93c-4ada-8ca7-47929814c48a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:45.003332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fd758cab-b7d3-4a63-94a1-b922fee54f2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:45.012067 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fd758cab-b7d3-4a63-94a1-b922fee54f2a tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.430594 Aug 18 11:39:45.014718 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1689/3236] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:44 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:45.019950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-495e7d71-1597-4bcc-9768-f679daa66489 req-8d28328f-015b-41ca-b4a5-5ce03df15d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7183ab-d769-4b94-9b9b-545a3eb459d7", "name": "network-vif-plugged", "status": "completed", "tag": "71abe44d-4829-45bc-98f7-b6337e80396d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:45.066720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-495e7d71-1597-4bcc-9768-f679daa66489 req-8d28328f-015b-41ca-b4a5-5ce03df15d96 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:45.067373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-495e7d71-1597-4bcc-9768-f679daa66489 req-8d28328f-015b-41ca-b4a5-5ce03df15d96 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:45.068352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-495e7d71-1597-4bcc-9768-f679daa66489 req-8d28328f-015b-41ca-b4a5-5ce03df15d96 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:45.085649 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-495e7d71-1597-4bcc-9768-f679daa66489 req-8d28328f-015b-41ca-b4a5-5ce03df15d96 service nova] Creating event network-vif-plugged:71abe44d-4829-45bc-98f7-b6337e80396d for instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 on n-h2-853611-3 Aug 18 11:39:45.103595 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-495e7d71-1597-4bcc-9768-f679daa66489 req-8d28328f-015b-41ca-b4a5-5ce03df15d96 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086820 Aug 18 11:39:45.110858 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1690/3237] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:45.117936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-88ab562f-0db1-446f-923e-4e27bb0ea818 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58a2bf56-93ad-40b0-9822-db418848d42f"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:45.123167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88ab562f-0db1-446f-923e-4e27bb0ea818 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:45.131409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88ab562f-0db1-446f-923e-4e27bb0ea818 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:45.132124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88ab562f-0db1-446f-923e-4e27bb0ea818 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:45.132734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88ab562f-0db1-446f-923e-4e27bb0ea818 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:45.133628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88ab562f-0db1-446f-923e-4e27bb0ea818 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:45.134266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88ab562f-0db1-446f-923e-4e27bb0ea818 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:45.135070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88ab562f-0db1-446f-923e-4e27bb0ea818 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:45.666553 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-88ab562f-0db1-446f-923e-4e27bb0ea818 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.554225 Aug 18 11:39:45.687710 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1691/3238] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:39:45 2022] POST /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments => generated 194 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:45.695069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-38ae983b-f93c-4ada-8ca7-47929814c48a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:45.703640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8784b1c5-b875-4317-befe-6e230ffc593d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:45.704745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8784b1c5-b875-4317-befe-6e230ffc593d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:45.717299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-38ae983b-f93c-4ada-8ca7-47929814c48a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:45.720981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-38ae983b-f93c-4ada-8ca7-47929814c48a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:45.722225 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-38ae983b-f93c-4ada-8ca7-47929814c48a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.807163 Aug 18 11:39:45.727757 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1548/3239] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:44 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:45.730912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8784b1c5-b875-4317-befe-6e230ffc593d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:45.732078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8784b1c5-b875-4317-befe-6e230ffc593d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:45.733670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0f139b7a-adf6-4308-9e6e-8722480def56 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:45.734300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0f139b7a-adf6-4308-9e6e-8722480def56 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:45.735105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8784b1c5-b875-4317-befe-6e230ffc593d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:45.737537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8784b1c5-b875-4317-befe-6e230ffc593d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:45.738274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8784b1c5-b875-4317-befe-6e230ffc593d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:45.739314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8784b1c5-b875-4317-befe-6e230ffc593d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:45.766036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f139b7a-adf6-4308-9e6e-8722480def56 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:45.767323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f139b7a-adf6-4308-9e6e-8722480def56 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:45.768995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f139b7a-adf6-4308-9e6e-8722480def56 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:45.770338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f139b7a-adf6-4308-9e6e-8722480def56 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:45.771635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f139b7a-adf6-4308-9e6e-8722480def56 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:45.779257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f139b7a-adf6-4308-9e6e-8722480def56 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:45.924317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8784b1c5-b875-4317-befe-6e230ffc593d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:45.933477 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8784b1c5-b875-4317-befe-6e230ffc593d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1216 microversion: 2.1 time: 0.243858 Aug 18 11:39:45.936609 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1692/3240] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:45 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1216 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:45.941965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6152838e-c356-41e4-95f7-437e169bfeaa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:45.942610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6152838e-c356-41e4-95f7-437e169bfeaa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:45.961038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6152838e-c356-41e4-95f7-437e169bfeaa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:45.963201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6152838e-c356-41e4-95f7-437e169bfeaa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:45.963771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6152838e-c356-41e4-95f7-437e169bfeaa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:45.967135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6152838e-c356-41e4-95f7-437e169bfeaa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:45.967732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6152838e-c356-41e4-95f7-437e169bfeaa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:45.968272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6152838e-c356-41e4-95f7-437e169bfeaa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:46.220299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6152838e-c356-41e4-95f7-437e169bfeaa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:46.230575 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6152838e-c356-41e4-95f7-437e169bfeaa tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.292764 Aug 18 11:39:46.247477 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1693/3241] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:45 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:46.254624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f9738389-50a4-4e68-b19e-251ae0365a6c req-b86a0b21-a28f-4ba8-87db-9125a1392388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "tag": "d548862d-96b8-4389-b950-c025f882d608"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:46.267671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f9738389-50a4-4e68-b19e-251ae0365a6c req-b86a0b21-a28f-4ba8-87db-9125a1392388 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:46.268514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f9738389-50a4-4e68-b19e-251ae0365a6c req-b86a0b21-a28f-4ba8-87db-9125a1392388 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:46.269161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f9738389-50a4-4e68-b19e-251ae0365a6c req-b86a0b21-a28f-4ba8-87db-9125a1392388 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:46.284232 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f9738389-50a4-4e68-b19e-251ae0365a6c req-b86a0b21-a28f-4ba8-87db-9125a1392388 service nova] Creating event network-changed:d548862d-96b8-4389-b950-c025f882d608 for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:39:46.290256 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f9738389-50a4-4e68-b19e-251ae0365a6c req-b86a0b21-a28f-4ba8-87db-9125a1392388 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040931 Aug 18 11:39:46.292144 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1694/3242] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:46.299894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd19f258-e2cd-49cc-a037-5ef1745b2ad8 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:46.301192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dd19f258-e2cd-49cc-a037-5ef1745b2ad8 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:46.309264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd19f258-e2cd-49cc-a037-5ef1745b2ad8 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:46.311246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd19f258-e2cd-49cc-a037-5ef1745b2ad8 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:46.311933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd19f258-e2cd-49cc-a037-5ef1745b2ad8 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:46.312863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd19f258-e2cd-49cc-a037-5ef1745b2ad8 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:46.313563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd19f258-e2cd-49cc-a037-5ef1745b2ad8 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:46.314202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd19f258-e2cd-49cc-a037-5ef1745b2ad8 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:46.611544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd19f258-e2cd-49cc-a037-5ef1745b2ad8 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:46.626029 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd19f258-e2cd-49cc-a037-5ef1745b2ad8 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1317 microversion: 2.1 time: 0.332267 Aug 18 11:39:46.629913 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1695/3243] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:46 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:46.637421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0ca600f4-e738-4371-829e-189cd3d10f35 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:46.647461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0ca600f4-e738-4371-829e-189cd3d10f35 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:46.677331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ca600f4-e738-4371-829e-189cd3d10f35 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:46.678027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ca600f4-e738-4371-829e-189cd3d10f35 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:46.678611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ca600f4-e738-4371-829e-189cd3d10f35 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:46.683025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ca600f4-e738-4371-829e-189cd3d10f35 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:46.684197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ca600f4-e738-4371-829e-189cd3d10f35 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:46.685676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ca600f4-e738-4371-829e-189cd3d10f35 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:46.823646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0ca600f4-e738-4371-829e-189cd3d10f35 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db3fcd22a44469ca290875379b747f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de0753e6c9e4ddab2fd34f0c71c1678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:46.837762 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0ca600f4-e738-4371-829e-189cd3d10f35 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 200 len: 1270 microversion: 2.1 time: 0.206075 Aug 18 11:39:46.838716 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1696/3244] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:46 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 1270 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:46.848358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-29ba80d7-a7dc-42af-9fb8-b9fd49aabc19 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:46.851346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-29ba80d7-a7dc-42af-9fb8-b9fd49aabc19 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:46.864854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29ba80d7-a7dc-42af-9fb8-b9fd49aabc19 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:46.868388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29ba80d7-a7dc-42af-9fb8-b9fd49aabc19 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:46.869770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29ba80d7-a7dc-42af-9fb8-b9fd49aabc19 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:46.871774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29ba80d7-a7dc-42af-9fb8-b9fd49aabc19 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:46.872554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29ba80d7-a7dc-42af-9fb8-b9fd49aabc19 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:46.888435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29ba80d7-a7dc-42af-9fb8-b9fd49aabc19 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:47.062115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0f139b7a-adf6-4308-9e6e-8722480def56 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:47.072721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0f139b7a-adf6-4308-9e6e-8722480def56 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:47.074254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0f139b7a-adf6-4308-9e6e-8722480def56 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:47.075552 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0f139b7a-adf6-4308-9e6e-8722480def56 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 1.346786 Aug 18 11:39:47.086932 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1549/3245] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:45 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:47.092568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-55468934-404f-4625-83b0-99e5eab49edb tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:47.093322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-55468934-404f-4625-83b0-99e5eab49edb tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:47.111064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55468934-404f-4625-83b0-99e5eab49edb tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:47.119285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55468934-404f-4625-83b0-99e5eab49edb tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:47.119873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55468934-404f-4625-83b0-99e5eab49edb tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:47.120666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55468934-404f-4625-83b0-99e5eab49edb tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:47.121156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55468934-404f-4625-83b0-99e5eab49edb tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:47.121602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55468934-404f-4625-83b0-99e5eab49edb tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:47.220821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-29ba80d7-a7dc-42af-9fb8-b9fd49aabc19 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:47.235320 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-29ba80d7-a7dc-42af-9fb8-b9fd49aabc19 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.395286 Aug 18 11:39:47.250479 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1697/3246] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:46 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:47.266983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-769ed432-f5f7-4f9e-a185-c06f28996ae0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:47.268155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-769ed432-f5f7-4f9e-a185-c06f28996ae0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:47.284882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-769ed432-f5f7-4f9e-a185-c06f28996ae0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:47.288039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-769ed432-f5f7-4f9e-a185-c06f28996ae0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:47.288732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-769ed432-f5f7-4f9e-a185-c06f28996ae0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:47.290202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-769ed432-f5f7-4f9e-a185-c06f28996ae0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:47.291029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-769ed432-f5f7-4f9e-a185-c06f28996ae0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:47.293030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-769ed432-f5f7-4f9e-a185-c06f28996ae0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:47.482652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-769ed432-f5f7-4f9e-a185-c06f28996ae0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:47.512288 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-769ed432-f5f7-4f9e-a185-c06f28996ae0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1270 microversion: 2.1 time: 0.261746 Aug 18 11:39:47.526698 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1698/3247] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:47 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1270 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:47.729464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a0d5615-9144-43a6-80f9-a083c25e9246 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Calling method '.version_select at 0x7f51b0d69280>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:47.764501 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-1a0d5615-9144-43a6-80f9-a083c25e9246 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] HTTP exception thrown: Image not found. Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a0d5615-9144-43a6-80f9-a083c25e9246 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Request method failure captured: Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/images/78f7050d-a25d-4d9a-8bd5-07127f4b9748/metadata/os_distro HTTP/1.1 Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iUCULDm5DnSLtEkOcYTji7t538DQ2Q_TZEQ3pXzVDD4mNQSpp39Xcdi-7snjKjnt262ofnh9l9rgrRhbbP1mGj4o3b12h6QvFF6D_OipT_vPez53qtBkUkgxZWIAfKSsnL_tRnZ2ySz5ZqjDM6WZfIp9cZH1zhRzY0T-SIXmiAEhwE Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c02e8ed8707e4d3ba7515f4429bde9c2 Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c02e8ed8707e4d3ba7515f4429bde9c2 Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesMetadataNegativeTestJSON-135369768-project Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6db31caf334840e39c842b9b1413d6ce Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-135369768-project Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: exception: Image not found. Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'image_id': '78f7050d-a25d-4d9a-8bd5-07127f4b9748', 'id': 'os_distro'} Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 78f7050d-a25d-4d9a-8bd5-07127f4b9748 Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 18 11:39:47.779762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 78f7050d-a25d-4d9a-8bd5-07127f4b9748 could not be found. Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:39:47.785511 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:47.795239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a0d5615-9144-43a6-80f9-a083c25e9246 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Returning 404 to user: Image not found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:39:47.796355 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a0d5615-9144-43a6-80f9-a083c25e9246 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] 10.222.0.73 "DELETE /compute/v2.1/images/78f7050d-a25d-4d9a-8bd5-07127f4b9748/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.268325 Aug 18 11:39:47.797542 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1699/3248] 10.222.0.73 () {58 vars in 1293 bytes} [Thu Aug 18 11:39:47 2022] DELETE /compute/v2.1/images/78f7050d-a25d-4d9a-8bd5-07127f4b9748/metadata/os_distro => generated 62 bytes in 270 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:39:47.805211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2c754d67-7a46-482e-804f-323fe07b97fb req-1590962d-9627-4894-b3f2-592a00dd3a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3cf4491-1d85-4cb5-bee0-b99814a14635", "name": "network-vif-plugged", "status": "completed", "tag": "e724b4d0-2e09-4dc2-8433-c5394839ba16"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:47.811015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-55468934-404f-4625-83b0-99e5eab49edb tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:47.831596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-55468934-404f-4625-83b0-99e5eab49edb tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:47.838020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-55468934-404f-4625-83b0-99e5eab49edb tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:47.844283 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-55468934-404f-4625-83b0-99e5eab49edb tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.755917 Aug 18 11:39:47.847054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2c754d67-7a46-482e-804f-323fe07b97fb req-1590962d-9627-4894-b3f2-592a00dd3a2d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:47.848511 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1550/3249] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:47 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:47.852434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2c754d67-7a46-482e-804f-323fe07b97fb req-1590962d-9627-4894-b3f2-592a00dd3a2d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:47.854119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2c754d67-7a46-482e-804f-323fe07b97fb req-1590962d-9627-4894-b3f2-592a00dd3a2d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:47.860081 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e9ee0580-987f-4c1b-843c-c6eb5b977e15 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:47.863256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e9ee0580-987f-4c1b-843c-c6eb5b977e15 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:47.877498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9ee0580-987f-4c1b-843c-c6eb5b977e15 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:47.881559 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9ee0580-987f-4c1b-843c-c6eb5b977e15 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:47.882532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9ee0580-987f-4c1b-843c-c6eb5b977e15 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:47.883264 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2c754d67-7a46-482e-804f-323fe07b97fb req-1590962d-9627-4894-b3f2-592a00dd3a2d service nova] Creating event network-vif-plugged:e724b4d0-2e09-4dc2-8433-c5394839ba16 for instance b3cf4491-1d85-4cb5-bee0-b99814a14635 on n-h1-853611-3 Aug 18 11:39:47.905135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9ee0580-987f-4c1b-843c-c6eb5b977e15 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:47.908919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9ee0580-987f-4c1b-843c-c6eb5b977e15 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:47.910800 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9ee0580-987f-4c1b-843c-c6eb5b977e15 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:47.923871 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2c754d67-7a46-482e-804f-323fe07b97fb req-1590962d-9627-4894-b3f2-592a00dd3a2d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121044 Aug 18 11:39:47.928273 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1700/3250] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:47.961355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a4bf9ab3-7419-4951-85dc-6a1e63485e8c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:47.963011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a4bf9ab3-7419-4951-85dc-6a1e63485e8c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:47.988739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4bf9ab3-7419-4951-85dc-6a1e63485e8c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:48.000947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4bf9ab3-7419-4951-85dc-6a1e63485e8c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:48.001651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4bf9ab3-7419-4951-85dc-6a1e63485e8c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:48.002300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4bf9ab3-7419-4951-85dc-6a1e63485e8c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:48.002801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4bf9ab3-7419-4951-85dc-6a1e63485e8c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:48.007161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4bf9ab3-7419-4951-85dc-6a1e63485e8c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:48.451071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e9ee0580-987f-4c1b-843c-c6eb5b977e15 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:48.461372 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e9ee0580-987f-4c1b-843c-c6eb5b977e15 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.610831 Aug 18 11:39:48.462652 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1551/3251] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:47 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:48.468379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e81065f9-da59-4b0c-ab4b-8b767e4196d9 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Calling method '.version_select at 0x7f519f9b41f0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:48.496151 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-e81065f9-da59-4b0c-ab4b-8b767e4196d9 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] HTTP exception thrown: Image not found. Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e81065f9-da59-4b0c-ab4b-8b767e4196d9 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Request method failure captured: Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/images/32a5e16a-d7a2-4fc7-a653-0686db925c49/metadata/os_version HTTP/1.1 Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iUCULDm5DnSLtEkOcYTji7t538DQ2Q_TZEQ3pXzVDD4mNQSpp39Xcdi-7snjKjnt262ofnh9l9rgrRhbbP1mGj4o3b12h6QvFF6D_OipT_vPez53qtBkUkgxZWIAfKSsnL_tRnZ2ySz5ZqjDM6WZfIp9cZH1zhRzY0T-SIXmiAEhwE Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: c02e8ed8707e4d3ba7515f4429bde9c2 Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: c02e8ed8707e4d3ba7515f4429bde9c2 Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesMetadataNegativeTestJSON-135369768-project Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 6db31caf334840e39c842b9b1413d6ce Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-135369768-project Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: exception: Image not found. Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'image_id': '32a5e16a-d7a2-4fc7-a653-0686db925c49', 'id': 'os_version'} Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 32a5e16a-d7a2-4fc7-a653-0686db925c49 Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 18 11:39:48.500182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 32a5e16a-d7a2-4fc7-a653-0686db925c49 could not be found. Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:39:48.504747 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:48.509964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e81065f9-da59-4b0c-ab4b-8b767e4196d9 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Returning 404 to user: Image not found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:39:48.511056 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e81065f9-da59-4b0c-ab4b-8b767e4196d9 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] 10.222.0.73 "GET /compute/v2.1/images/32a5e16a-d7a2-4fc7-a653-0686db925c49/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.047224 Aug 18 11:39:48.513348 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1552/3252] 10.222.0.73 () {58 vars in 1293 bytes} [Thu Aug 18 11:39:48 2022] GET /compute/v2.1/images/32a5e16a-d7a2-4fc7-a653-0686db925c49/metadata/os_version => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:39:48.520845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e909e35b-f28b-42a3-836b-21b46aa61412 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:48.521701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e909e35b-f28b-42a3-836b-21b46aa61412 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:48.533889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e909e35b-f28b-42a3-836b-21b46aa61412 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:48.535397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e909e35b-f28b-42a3-836b-21b46aa61412 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:48.536161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e909e35b-f28b-42a3-836b-21b46aa61412 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:48.537329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e909e35b-f28b-42a3-836b-21b46aa61412 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:48.538805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e909e35b-f28b-42a3-836b-21b46aa61412 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:48.540456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e909e35b-f28b-42a3-836b-21b46aa61412 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:48.616869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a4bf9ab3-7419-4951-85dc-6a1e63485e8c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:48.626592 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a4bf9ab3-7419-4951-85dc-6a1e63485e8c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1317 microversion: 2.1 time: 0.696800 Aug 18 11:39:48.641036 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1701/3253] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:47 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1317 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:48.642936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-35482649-2e7d-458f-8d28-c5ebabdd255c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:48.643651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-35482649-2e7d-458f-8d28-c5ebabdd255c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:48.650154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35482649-2e7d-458f-8d28-c5ebabdd255c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:48.650782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35482649-2e7d-458f-8d28-c5ebabdd255c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:48.651340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35482649-2e7d-458f-8d28-c5ebabdd255c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:48.652302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35482649-2e7d-458f-8d28-c5ebabdd255c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:48.652847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35482649-2e7d-458f-8d28-c5ebabdd255c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:48.654607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35482649-2e7d-458f-8d28-c5ebabdd255c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:49.250027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-35482649-2e7d-458f-8d28-c5ebabdd255c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:49.261877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-35482649-2e7d-458f-8d28-c5ebabdd255c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:49.265998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-35482649-2e7d-458f-8d28-c5ebabdd255c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:49.267704 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-35482649-2e7d-458f-8d28-c5ebabdd255c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.636054 Aug 18 11:39:49.268658 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1702/3254] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:48 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:49.290209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-bfd29f5c-e92a-4e64-bff0-7a1bfa1dc63d req-b55f4435-f88b-43d3-b37f-bb0e42926952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "tag": "b3b7c180-3e64-4262-a77c-687b117445ae"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:49.306286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bfd29f5c-e92a-4e64-bff0-7a1bfa1dc63d req-b55f4435-f88b-43d3-b37f-bb0e42926952 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:49.306844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bfd29f5c-e92a-4e64-bff0-7a1bfa1dc63d req-b55f4435-f88b-43d3-b37f-bb0e42926952 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:49.307517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bfd29f5c-e92a-4e64-bff0-7a1bfa1dc63d req-b55f4435-f88b-43d3-b37f-bb0e42926952 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:49.327157 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-bfd29f5c-e92a-4e64-bff0-7a1bfa1dc63d req-b55f4435-f88b-43d3-b37f-bb0e42926952 service nova] Creating event network-changed:b3b7c180-3e64-4262-a77c-687b117445ae for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:39:49.332689 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-bfd29f5c-e92a-4e64-bff0-7a1bfa1dc63d req-b55f4435-f88b-43d3-b37f-bb0e42926952 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062223 Aug 18 11:39:49.333630 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1703/3255] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:49.339917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e9a422a-0f34-4a62-a9c3-85b3f878458c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:49.341928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7e9a422a-0f34-4a62-a9c3-85b3f878458c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:49.350157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e9a422a-0f34-4a62-a9c3-85b3f878458c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:49.351069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e9a422a-0f34-4a62-a9c3-85b3f878458c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:49.351916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e9a422a-0f34-4a62-a9c3-85b3f878458c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:49.352981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e9a422a-0f34-4a62-a9c3-85b3f878458c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:49.353732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e9a422a-0f34-4a62-a9c3-85b3f878458c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:49.354583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e9a422a-0f34-4a62-a9c3-85b3f878458c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:49.480298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e909e35b-f28b-42a3-836b-21b46aa61412 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db3fcd22a44469ca290875379b747f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de0753e6c9e4ddab2fd34f0c71c1678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:49.496498 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e909e35b-f28b-42a3-836b-21b46aa61412 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 200 len: 1312 microversion: 2.1 time: 0.979613 Aug 18 11:39:49.510459 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1553/3256] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:48 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 1312 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:49.510459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1f5e5860-62ca-4a2d-aaee-9877eee5caa3 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Calling method '.version_select at 0x7f519f811790>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:49.545475 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-1f5e5860-62ca-4a2d-aaee-9877eee5caa3 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] HTTP exception thrown: Image not found. Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1f5e5860-62ca-4a2d-aaee-9877eee5caa3 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Request method failure captured: Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/images/96f8bd92-ccbc-45f7-bba5-2c5061c6662f/metadata HTTP/1.1 Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iUCULDm5DnSLtEkOcYTji7t538DQ2Q_TZEQ3pXzVDD4mNQSpp39Xcdi-7snjKjnt262ofnh9l9rgrRhbbP1mGj4o3b12h6QvFF6D_OipT_vPez53qtBkUkgxZWIAfKSsnL_tRnZ2ySz5ZqjDM6WZfIp9cZH1zhRzY0T-SIXmiAEhwE Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: c02e8ed8707e4d3ba7515f4429bde9c2 Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: c02e8ed8707e4d3ba7515f4429bde9c2 Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesMetadataNegativeTestJSON-135369768-project Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 6db31caf334840e39c842b9b1413d6ce Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-135369768-project Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: exception: Image not found. Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'image_id': '96f8bd92-ccbc-45f7-bba5-2c5061c6662f'} Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 96f8bd92-ccbc-45f7-bba5-2c5061c6662f Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 18 11:39:49.547775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 96f8bd92-ccbc-45f7-bba5-2c5061c6662f could not be found. Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1f5e5860-62ca-4a2d-aaee-9877eee5caa3 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Returning 404 to user: Image not found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1f5e5860-62ca-4a2d-aaee-9877eee5caa3 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] 10.222.0.73 "GET /compute/v2.1/images/96f8bd92-ccbc-45f7-bba5-2c5061c6662f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048130 Aug 18 11:39:49.551894 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1554/3257] 10.222.0.73 () {58 vars in 1260 bytes} [Thu Aug 18 11:39:49 2022] GET /compute/v2.1/images/96f8bd92-ccbc-45f7-bba5-2c5061c6662f/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:39:49.567062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a8b0ec11-dd2a-4655-b763-c2c0a8a237a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:49.567897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a8b0ec11-dd2a-4655-b763-c2c0a8a237a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:49.580194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8b0ec11-dd2a-4655-b763-c2c0a8a237a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:49.580682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8b0ec11-dd2a-4655-b763-c2c0a8a237a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:49.581132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8b0ec11-dd2a-4655-b763-c2c0a8a237a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:49.581861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8b0ec11-dd2a-4655-b763-c2c0a8a237a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:49.582386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8b0ec11-dd2a-4655-b763-c2c0a8a237a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:49.582888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8b0ec11-dd2a-4655-b763-c2c0a8a237a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:49.906883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7e9a422a-0f34-4a62-a9c3-85b3f878458c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:49.920143 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e9a422a-0f34-4a62-a9c3-85b3f878458c tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.584413 Aug 18 11:39:49.947463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a8b0ec11-dd2a-4655-b763-c2c0a8a237a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:49.962752 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1704/3258] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:49 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:49.968337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1d8b029e-ed31-458c-8ebe-c72ce727a855 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:49.968950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1d8b029e-ed31-458c-8ebe-c72ce727a855 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:49.972934 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a8b0ec11-dd2a-4655-b763-c2c0a8a237a7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1312 microversion: 2.1 time: 0.422069 Aug 18 11:39:49.973846 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1555/3259] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:49 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1312 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:49.984351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cd8cc1d2-b64f-451c-a430-21f74a0ca776 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Action: 'update_all', calling method: .version_select at 0x7f519f8da040>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:49.999532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d8b029e-ed31-458c-8ebe-c72ce727a855 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:49.999813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d8b029e-ed31-458c-8ebe-c72ce727a855 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:50.000077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d8b029e-ed31-458c-8ebe-c72ce727a855 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:50.000829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d8b029e-ed31-458c-8ebe-c72ce727a855 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:50.001292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d8b029e-ed31-458c-8ebe-c72ce727a855 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:50.001721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d8b029e-ed31-458c-8ebe-c72ce727a855 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:50.027641 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-cd8cc1d2-b64f-451c-a430-21f74a0ca776 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] HTTP exception thrown: Image not found. Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cd8cc1d2-b64f-451c-a430-21f74a0ca776 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Request method failure captured: Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: request: PUT /compute/v2.1/images/30d746dd-77de-443f-a81c-effea98a31d6/metadata HTTP/1.1 Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 57 Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iUCULDm5DnSLtEkOcYTji7t538DQ2Q_TZEQ3pXzVDD4mNQSpp39Xcdi-7snjKjnt262ofnh9l9rgrRhbbP1mGj4o3b12h6QvFF6D_OipT_vPez53qtBkUkgxZWIAfKSsnL_tRnZ2ySz5ZqjDM6WZfIp9cZH1zhRzY0T-SIXmiAEhwE Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: c02e8ed8707e4d3ba7515f4429bde9c2 Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: c02e8ed8707e4d3ba7515f4429bde9c2 Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ImagesMetadataNegativeTestJSON-135369768-project Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 6db31caf334840e39c842b9b1413d6ce Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-135369768-project Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: exception: Image not found. Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'image_id': '30d746dd-77de-443f-a81c-effea98a31d6', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 30d746dd-77de-443f-a81c-effea98a31d6 Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 18 11:39:50.042696 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 30d746dd-77de-443f-a81c-effea98a31d6 could not be found. Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cd8cc1d2-b64f-451c-a430-21f74a0ca776 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Returning 404 to user: Image not found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cd8cc1d2-b64f-451c-a430-21f74a0ca776 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] 10.222.0.73 "PUT /compute/v2.1/images/30d746dd-77de-443f-a81c-effea98a31d6/metadata" status: 404 len: 62 microversion: 2.1 time: 0.070563 Aug 18 11:39:50.048331 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1556/3260] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:39:49 2022] PUT /compute/v2.1/images/30d746dd-77de-443f-a81c-effea98a31d6/metadata => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:39:50.052152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dcd0a3cf-29ca-4276-844c-89857bb62342 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:50.052152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dcd0a3cf-29ca-4276-844c-89857bb62342 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:50.065292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcd0a3cf-29ca-4276-844c-89857bb62342 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:50.065702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcd0a3cf-29ca-4276-844c-89857bb62342 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:50.071907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcd0a3cf-29ca-4276-844c-89857bb62342 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:50.072699 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcd0a3cf-29ca-4276-844c-89857bb62342 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:50.080462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcd0a3cf-29ca-4276-844c-89857bb62342 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:50.081212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcd0a3cf-29ca-4276-844c-89857bb62342 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:50.372780 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dcd0a3cf-29ca-4276-844c-89857bb62342 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:50.380548 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dcd0a3cf-29ca-4276-844c-89857bb62342 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1317 microversion: 2.1 time: 0.332654 Aug 18 11:39:50.385938 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1557/3261] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:50 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:50.391577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-808cb150-b68e-4259-9080-72839ab692cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:50.396129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-808cb150-b68e-4259-9080-72839ab692cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:50.410470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1d8b029e-ed31-458c-8ebe-c72ce727a855 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:50.412662 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808cb150-b68e-4259-9080-72839ab692cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:50.416457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808cb150-b68e-4259-9080-72839ab692cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:50.417171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808cb150-b68e-4259-9080-72839ab692cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:50.418078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808cb150-b68e-4259-9080-72839ab692cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:50.419012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808cb150-b68e-4259-9080-72839ab692cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:50.426114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1d8b029e-ed31-458c-8ebe-c72ce727a855 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:50.426990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-808cb150-b68e-4259-9080-72839ab692cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:50.432434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1d8b029e-ed31-458c-8ebe-c72ce727a855 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:50.436053 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1d8b029e-ed31-458c-8ebe-c72ce727a855 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.472258 Aug 18 11:39:50.440093 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1705/3262] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:49 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:50.454870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8a6e2dfb-8cdc-43b8-8c1c-4460fe3388d1 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Action: 'update', calling method: .version_select at 0x7f519f5980d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:50.469750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-808cb150-b68e-4259-9080-72839ab692cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lazy-loading 'flavor' on Instance uuid a2a906b8-26ea-4413-bed0-9c6f7a6be35c {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:39:50.504846 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-8a6e2dfb-8cdc-43b8-8c1c-4460fe3388d1 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] HTTP exception thrown: Image not found. Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8a6e2dfb-8cdc-43b8-8c1c-4460fe3388d1 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Request method failure captured: Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: request: PUT /compute/v2.1/images/029f676e-e948-4e12-a19a-37d987ddce7b/metadata/os_distro HTTP/1.1 Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 30 Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iUCULDm5DnSLtEkOcYTji7t538DQ2Q_TZEQ3pXzVDD4mNQSpp39Xcdi-7snjKjnt262ofnh9l9rgrRhbbP1mGj4o3b12h6QvFF6D_OipT_vPez53qtBkUkgxZWIAfKSsnL_tRnZ2ySz5ZqjDM6WZfIp9cZH1zhRzY0T-SIXmiAEhwE Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c02e8ed8707e4d3ba7515f4429bde9c2 Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c02e8ed8707e4d3ba7515f4429bde9c2 Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesMetadataNegativeTestJSON-135369768-project Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6db31caf334840e39c842b9b1413d6ce Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-135369768-project Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: {"meta": {"os_distro": "alt"}} Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: exception: Image not found. Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'image_id': '029f676e-e948-4e12-a19a-37d987ddce7b', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 029f676e-e948-4e12-a19a-37d987ddce7b Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 18 11:39:50.507866 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 029f676e-e948-4e12-a19a-37d987ddce7b could not be found. Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:39:50.512951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:50.519571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8a6e2dfb-8cdc-43b8-8c1c-4460fe3388d1 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Returning 404 to user: Image not found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:39:50.519571 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8a6e2dfb-8cdc-43b8-8c1c-4460fe3388d1 tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] 10.222.0.73 "PUT /compute/v2.1/images/029f676e-e948-4e12-a19a-37d987ddce7b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.074546 Aug 18 11:39:50.520086 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1706/3263] 10.222.0.73 () {60 vars in 1310 bytes} [Thu Aug 18 11:39:50 2022] PUT /compute/v2.1/images/029f676e-e948-4e12-a19a-37d987ddce7b/metadata/os_distro => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:39:50.527500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b151fda-9eaf-4bca-a8b1-2944d6d8007d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:50.530119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2b151fda-9eaf-4bca-a8b1-2944d6d8007d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:50.540671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b151fda-9eaf-4bca-a8b1-2944d6d8007d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:50.541585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b151fda-9eaf-4bca-a8b1-2944d6d8007d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:50.542310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b151fda-9eaf-4bca-a8b1-2944d6d8007d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:50.544133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b151fda-9eaf-4bca-a8b1-2944d6d8007d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:50.545177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b151fda-9eaf-4bca-a8b1-2944d6d8007d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:50.545882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b151fda-9eaf-4bca-a8b1-2944d6d8007d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:50.640544 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-808cb150-b68e-4259-9080-72839ab692cf tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.252954 Aug 18 11:39:50.641344 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1558/3264] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:39:50 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:39:50.647388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c41eb25d-6cea-4ef2-b72f-70c6b9977339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:50.648428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c41eb25d-6cea-4ef2-b72f-70c6b9977339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:50.668039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c41eb25d-6cea-4ef2-b72f-70c6b9977339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:50.669521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c41eb25d-6cea-4ef2-b72f-70c6b9977339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:50.670423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c41eb25d-6cea-4ef2-b72f-70c6b9977339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:50.671381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c41eb25d-6cea-4ef2-b72f-70c6b9977339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:50.671934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c41eb25d-6cea-4ef2-b72f-70c6b9977339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:50.672384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c41eb25d-6cea-4ef2-b72f-70c6b9977339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:51.070148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2b151fda-9eaf-4bca-a8b1-2944d6d8007d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:51.087433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2b151fda-9eaf-4bca-a8b1-2944d6d8007d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:51.089235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2b151fda-9eaf-4bca-a8b1-2944d6d8007d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:51.091661 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2b151fda-9eaf-4bca-a8b1-2944d6d8007d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.568908 Aug 18 11:39:51.091959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c41eb25d-6cea-4ef2-b72f-70c6b9977339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db3fcd22a44469ca290875379b747f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de0753e6c9e4ddab2fd34f0c71c1678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:51.092638 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1707/3265] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:50 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:51.099611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ceb1a13-1b71-4739-9b57-5fe100b7dc5b tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Action: 'create', calling method: .version_select at 0x7f519fbc70d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:51.107344 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c41eb25d-6cea-4ef2-b72f-70c6b9977339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 200 len: 1312 microversion: 2.1 time: 0.464315 Aug 18 11:39:51.118556 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1559/3266] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:50 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 1312 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:51.124253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-01c2f678-17fd-4974-8ea0-45299386eb62 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:51.124253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-01c2f678-17fd-4974-8ea0-45299386eb62 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:51.134834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01c2f678-17fd-4974-8ea0-45299386eb62 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:51.135405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01c2f678-17fd-4974-8ea0-45299386eb62 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:51.135969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01c2f678-17fd-4974-8ea0-45299386eb62 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:51.136938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01c2f678-17fd-4974-8ea0-45299386eb62 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:51.137847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01c2f678-17fd-4974-8ea0-45299386eb62 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:51.139626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-01c2f678-17fd-4974-8ea0-45299386eb62 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:51.142732 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-9ceb1a13-1b71-4739-9b57-5fe100b7dc5b tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] HTTP exception thrown: Image not found. Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ceb1a13-1b71-4739-9b57-5fe100b7dc5b tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Request method failure captured: Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/images/1fdf4ec7-a2af-4637-884f-2c6861b26736/metadata HTTP/1.1 Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 57 Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iUCULDm5DnSLtEkOcYTji7t538DQ2Q_TZEQ3pXzVDD4mNQSpp39Xcdi-7snjKjnt262ofnh9l9rgrRhbbP1mGj4o3b12h6QvFF6D_OipT_vPez53qtBkUkgxZWIAfKSsnL_tRnZ2ySz5ZqjDM6WZfIp9cZH1zhRzY0T-SIXmiAEhwE Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c02e8ed8707e4d3ba7515f4429bde9c2 Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c02e8ed8707e4d3ba7515f4429bde9c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c02e8ed8707e4d3ba7515f4429bde9c2 Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-135369768 Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ImagesMetadataNegativeTestJSON-135369768-project Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6db31caf334840e39c842b9b1413d6ce Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-135369768-project Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: exception: Image not found. Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'image_id': '1fdf4ec7-a2af-4637-884f-2c6861b26736', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1fdf4ec7-a2af-4637-884f-2c6861b26736 Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 18 11:39:51.145168 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1fdf4ec7-a2af-4637-884f-2c6861b26736 could not be found. Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 18 11:39:51.149887 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:39:51.156437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ceb1a13-1b71-4739-9b57-5fe100b7dc5b tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] Returning 404 to user: Image not found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:39:51.159095 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9ceb1a13-1b71-4739-9b57-5fe100b7dc5b tempest-ImagesMetadataNegativeTestJSON-135369768 tempest-ImagesMetadataNegativeTestJSON-135369768-project] 10.222.0.73 "POST /compute/v2.1/images/1fdf4ec7-a2af-4637-884f-2c6861b26736/metadata" status: 404 len: 62 microversion: 2.1 time: 0.063475 Aug 18 11:39:51.159095 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1708/3267] 10.222.0.73 () {60 vars in 1281 bytes} [Thu Aug 18 11:39:51 2022] POST /compute/v2.1/images/1fdf4ec7-a2af-4637-884f-2c6861b26736/metadata => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:39:51.170554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9ebe47a8-bc30-4d69-8eb4-340a9c780387 req-cb5b54e4-491d-4cac-922c-204671852594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da67cf3-bc5d-4b71-9c07-6234c22493bc", "tag": "061756b5-9fa0-425c-99c6-d5be70f85abe"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:51.197931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9ebe47a8-bc30-4d69-8eb4-340a9c780387 req-cb5b54e4-491d-4cac-922c-204671852594 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:51.202743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9ebe47a8-bc30-4d69-8eb4-340a9c780387 req-cb5b54e4-491d-4cac-922c-204671852594 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:51.204599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9ebe47a8-bc30-4d69-8eb4-340a9c780387 req-cb5b54e4-491d-4cac-922c-204671852594 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:51.237665 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9ebe47a8-bc30-4d69-8eb4-340a9c780387 req-cb5b54e4-491d-4cac-922c-204671852594 service nova] Creating event network-changed:061756b5-9fa0-425c-99c6-d5be70f85abe for instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc on n-h2-853611-3 Aug 18 11:39:51.247128 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9ebe47a8-bc30-4d69-8eb4-340a9c780387 req-cb5b54e4-491d-4cac-922c-204671852594 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086640 Aug 18 11:39:51.248474 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1709/3268] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:51.255642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-32542944-c19f-45be-9e13-02bf62f49e38 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:51.256813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-32542944-c19f-45be-9e13-02bf62f49e38 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:51.266115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32542944-c19f-45be-9e13-02bf62f49e38 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:51.267607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32542944-c19f-45be-9e13-02bf62f49e38 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:51.268300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32542944-c19f-45be-9e13-02bf62f49e38 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:51.269300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32542944-c19f-45be-9e13-02bf62f49e38 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:51.269988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32542944-c19f-45be-9e13-02bf62f49e38 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:51.270527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32542944-c19f-45be-9e13-02bf62f49e38 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:51.320903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:51.649882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-32542944-c19f-45be-9e13-02bf62f49e38 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:51.661193 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-32542944-c19f-45be-9e13-02bf62f49e38 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1312 microversion: 2.1 time: 0.411276 Aug 18 11:39:51.661799 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1710/3269] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:51 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1312 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:51.671049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1b0e0ca1-3720-4bb9-9c5e-26565c7581ff req-78e04d65-caad-44bd-bbfa-f180ca69a562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b981016-2c6d-4f5e-b95d-d5579667d3f4", "tag": "b64ac802-7e92-46b4-ac99-b4227589e8f5"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:51.705473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:51.707799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1b0e0ca1-3720-4bb9-9c5e-26565c7581ff req-78e04d65-caad-44bd-bbfa-f180ca69a562 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:51.708575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1b0e0ca1-3720-4bb9-9c5e-26565c7581ff req-78e04d65-caad-44bd-bbfa-f180ca69a562 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:51.709309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1b0e0ca1-3720-4bb9-9c5e-26565c7581ff req-78e04d65-caad-44bd-bbfa-f180ca69a562 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:51.725067 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1b0e0ca1-3720-4bb9-9c5e-26565c7581ff req-78e04d65-caad-44bd-bbfa-f180ca69a562 service nova] Creating event network-changed:b64ac802-7e92-46b4-ac99-b4227589e8f5 for instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 on n-h1-853611-3 Aug 18 11:39:51.740419 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1b0e0ca1-3720-4bb9-9c5e-26565c7581ff req-78e04d65-caad-44bd-bbfa-f180ca69a562 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073549 Aug 18 11:39:51.750013 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1711/3270] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:51.755690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e83c6405-8f7d-47e4-b1f7-9f944f0b8e9e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:51.756695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e83c6405-8f7d-47e4-b1f7-9f944f0b8e9e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:51.771275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e83c6405-8f7d-47e4-b1f7-9f944f0b8e9e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:51.772955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e83c6405-8f7d-47e4-b1f7-9f944f0b8e9e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:51.775884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e83c6405-8f7d-47e4-b1f7-9f944f0b8e9e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:51.776894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e83c6405-8f7d-47e4-b1f7-9f944f0b8e9e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:51.777573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e83c6405-8f7d-47e4-b1f7-9f944f0b8e9e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:51.779723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e83c6405-8f7d-47e4-b1f7-9f944f0b8e9e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:51.807622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-01c2f678-17fd-4974-8ea0-45299386eb62 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:51.822752 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-01c2f678-17fd-4974-8ea0-45299386eb62 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1677 microversion: 2.1 time: 0.706130 Aug 18 11:39:51.823351 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1560/3271] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:51 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1677 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:51.839272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-10e252b5-bfc0-4594-862e-0264a8bc2d34 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:51.840891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-10e252b5-bfc0-4594-862e-0264a8bc2d34 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:51.853400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10e252b5-bfc0-4594-862e-0264a8bc2d34 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:51.862541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10e252b5-bfc0-4594-862e-0264a8bc2d34 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:51.863421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10e252b5-bfc0-4594-862e-0264a8bc2d34 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:51.864267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10e252b5-bfc0-4594-862e-0264a8bc2d34 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:51.864965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10e252b5-bfc0-4594-862e-0264a8bc2d34 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:51.865471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10e252b5-bfc0-4594-862e-0264a8bc2d34 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:52.010339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e83c6405-8f7d-47e4-b1f7-9f944f0b8e9e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:52.031156 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e83c6405-8f7d-47e4-b1f7-9f944f0b8e9e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1508 microversion: 2.1 time: 0.279420 Aug 18 11:39:52.032098 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1712/3272] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:51 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:52.059148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4065281a-fc3a-495f-b968-d9b2fb780ada tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:52.060527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4065281a-fc3a-495f-b968-d9b2fb780ada tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:52.066751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4065281a-fc3a-495f-b968-d9b2fb780ada tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:52.067244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4065281a-fc3a-495f-b968-d9b2fb780ada tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:52.067684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4065281a-fc3a-495f-b968-d9b2fb780ada tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:52.068402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4065281a-fc3a-495f-b968-d9b2fb780ada tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:52.068858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4065281a-fc3a-495f-b968-d9b2fb780ada tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:52.069284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4065281a-fc3a-495f-b968-d9b2fb780ada tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:52.124637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:52.269146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-10e252b5-bfc0-4594-862e-0264a8bc2d34 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:52.280045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-10e252b5-bfc0-4594-862e-0264a8bc2d34 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:52.281937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-10e252b5-bfc0-4594-862e-0264a8bc2d34 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:52.283450 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-10e252b5-bfc0-4594-862e-0264a8bc2d34 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.458904 Aug 18 11:39:52.284817 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1561/3273] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:51 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:52.291660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fdaa7cdf-12ff-4c4e-8347-e33991656ad1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:52.293834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fdaa7cdf-12ff-4c4e-8347-e33991656ad1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:52.302915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdaa7cdf-12ff-4c4e-8347-e33991656ad1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:52.303740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdaa7cdf-12ff-4c4e-8347-e33991656ad1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:52.304417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdaa7cdf-12ff-4c4e-8347-e33991656ad1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:52.305378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdaa7cdf-12ff-4c4e-8347-e33991656ad1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:52.306131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdaa7cdf-12ff-4c4e-8347-e33991656ad1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:52.306956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fdaa7cdf-12ff-4c4e-8347-e33991656ad1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:52.339546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4065281a-fc3a-495f-b968-d9b2fb780ada tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:52.356292 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4065281a-fc3a-495f-b968-d9b2fb780ada tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1508 microversion: 2.1 time: 0.300596 Aug 18 11:39:52.357836 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1713/3274] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:52 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:39:52.372570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aae9e34e-72c2-46d8-9053-e9fe5eb2d070 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:52.373782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aae9e34e-72c2-46d8-9053-e9fe5eb2d070 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:52.386918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9e34e-72c2-46d8-9053-e9fe5eb2d070 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:52.387881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9e34e-72c2-46d8-9053-e9fe5eb2d070 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:52.388688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9e34e-72c2-46d8-9053-e9fe5eb2d070 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:52.389635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9e34e-72c2-46d8-9053-e9fe5eb2d070 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:52.390447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9e34e-72c2-46d8-9053-e9fe5eb2d070 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:52.390971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9e34e-72c2-46d8-9053-e9fe5eb2d070 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:52.620116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fdaa7cdf-12ff-4c4e-8347-e33991656ad1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:52.622287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aae9e34e-72c2-46d8-9053-e9fe5eb2d070 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db3fcd22a44469ca290875379b747f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de0753e6c9e4ddab2fd34f0c71c1678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:52.634005 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aae9e34e-72c2-46d8-9053-e9fe5eb2d070 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 200 len: 1312 microversion: 2.1 time: 0.274589 Aug 18 11:39:52.635303 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1714/3275] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:52 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 1312 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:52.639920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fdaa7cdf-12ff-4c4e-8347-e33991656ad1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:52.643310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fdaa7cdf-12ff-4c4e-8347-e33991656ad1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:52.644249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a228bd6-4660-4b2a-8805-047d195494ac tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:52.647509 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fdaa7cdf-12ff-4c4e-8347-e33991656ad1 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.360988 Aug 18 11:39:52.647759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a228bd6-4660-4b2a-8805-047d195494ac tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:52.649597 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1562/3276] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:52 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:52.660044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a228bd6-4660-4b2a-8805-047d195494ac tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:52.661566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a228bd6-4660-4b2a-8805-047d195494ac tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:52.662158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a228bd6-4660-4b2a-8805-047d195494ac tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:52.663162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a228bd6-4660-4b2a-8805-047d195494ac tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:52.663769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a228bd6-4660-4b2a-8805-047d195494ac tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:52.664339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a228bd6-4660-4b2a-8805-047d195494ac tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:52.698566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aa1ac100-9568-461c-88e3-823bb2f2d859 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:52.700516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-aa1ac100-9568-461c-88e3-823bb2f2d859 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:52.730998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa1ac100-9568-461c-88e3-823bb2f2d859 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:52.730998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa1ac100-9568-461c-88e3-823bb2f2d859 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:52.732185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa1ac100-9568-461c-88e3-823bb2f2d859 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:52.733032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa1ac100-9568-461c-88e3-823bb2f2d859 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:52.733659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa1ac100-9568-461c-88e3-823bb2f2d859 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:52.735090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa1ac100-9568-461c-88e3-823bb2f2d859 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:52.801122 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a228bd6-4660-4b2a-8805-047d195494ac tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "PUT /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1080 microversion: 2.1 time: 0.163702 Aug 18 11:39:52.806483 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1715/3277] 10.222.0.73 () {60 vars in 1256 bytes} [Thu Aug 18 11:39:52 2022] PUT /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1080 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:52.822753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c88317ba-ea16-4f48-bca7-1a4061efa495 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:52.823470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c88317ba-ea16-4f48-bca7-1a4061efa495 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:52.831895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c88317ba-ea16-4f48-bca7-1a4061efa495 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:52.832410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c88317ba-ea16-4f48-bca7-1a4061efa495 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:52.832862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c88317ba-ea16-4f48-bca7-1a4061efa495 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:52.833596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c88317ba-ea16-4f48-bca7-1a4061efa495 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:52.834072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c88317ba-ea16-4f48-bca7-1a4061efa495 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:52.834532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c88317ba-ea16-4f48-bca7-1a4061efa495 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:52.921987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aa1ac100-9568-461c-88e3-823bb2f2d859 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:52.930149 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aa1ac100-9568-461c-88e3-823bb2f2d859 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1312 microversion: 2.1 time: 0.238400 Aug 18 11:39:52.930760 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1563/3278] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:52 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:52.936952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f01ec18a-a89a-45d2-a8cc-37d2493438f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:52.937972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f01ec18a-a89a-45d2-a8cc-37d2493438f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:52.945028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f01ec18a-a89a-45d2-a8cc-37d2493438f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:52.945956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f01ec18a-a89a-45d2-a8cc-37d2493438f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:52.946478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f01ec18a-a89a-45d2-a8cc-37d2493438f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:52.947255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f01ec18a-a89a-45d2-a8cc-37d2493438f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:52.947736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f01ec18a-a89a-45d2-a8cc-37d2493438f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:52.948174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f01ec18a-a89a-45d2-a8cc-37d2493438f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:53.149994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=46 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:53.174689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c88317ba-ea16-4f48-bca7-1a4061efa495 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:53.185852 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c88317ba-ea16-4f48-bca7-1a4061efa495 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1506 microversion: 2.1 time: 0.368316 Aug 18 11:39:53.202566 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1716/3279] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:52 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:39:53.216755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-376c4e2e-dcb5-4be2-a981-40db6442444c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:53.217482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-376c4e2e-dcb5-4be2-a981-40db6442444c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:53.231350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-376c4e2e-dcb5-4be2-a981-40db6442444c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:53.231940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-376c4e2e-dcb5-4be2-a981-40db6442444c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:53.233817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-376c4e2e-dcb5-4be2-a981-40db6442444c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:53.234516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-376c4e2e-dcb5-4be2-a981-40db6442444c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:53.239557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-376c4e2e-dcb5-4be2-a981-40db6442444c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:53.240094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-376c4e2e-dcb5-4be2-a981-40db6442444c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:53.312675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f01ec18a-a89a-45d2-a8cc-37d2493438f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:53.316329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:53.323328 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f01ec18a-a89a-45d2-a8cc-37d2493438f2 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1660 microversion: 2.1 time: 0.390559 Aug 18 11:39:53.330909 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1564/3280] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:52 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1660 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:53.340935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c6847fb5-0d8e-41e5-bad9-dc25c62f44c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:53.344788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c6847fb5-0d8e-41e5-bad9-dc25c62f44c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:53.365835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6847fb5-0d8e-41e5-bad9-dc25c62f44c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:53.368163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6847fb5-0d8e-41e5-bad9-dc25c62f44c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:53.369344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6847fb5-0d8e-41e5-bad9-dc25c62f44c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:53.372681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6847fb5-0d8e-41e5-bad9-dc25c62f44c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:53.374041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6847fb5-0d8e-41e5-bad9-dc25c62f44c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:53.375160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c6847fb5-0d8e-41e5-bad9-dc25c62f44c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:53.633148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-376c4e2e-dcb5-4be2-a981-40db6442444c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:53.646371 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-376c4e2e-dcb5-4be2-a981-40db6442444c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1506 microversion: 2.1 time: 0.432974 Aug 18 11:39:53.647365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1717/3281] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:53 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:53.659912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c59a8cb9-537a-4873-b113-9675426fc4a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:53.660487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c59a8cb9-537a-4873-b113-9675426fc4a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:53.671572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c59a8cb9-537a-4873-b113-9675426fc4a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:53.672082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c59a8cb9-537a-4873-b113-9675426fc4a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:53.672722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c59a8cb9-537a-4873-b113-9675426fc4a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:53.674282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c59a8cb9-537a-4873-b113-9675426fc4a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:53.674282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c59a8cb9-537a-4873-b113-9675426fc4a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:53.674482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c59a8cb9-537a-4873-b113-9675426fc4a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:53.808258 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c59a8cb9-537a-4873-b113-9675426fc4a1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action" status: 202 len: 0 microversion: 2.1 time: 0.159297 Aug 18 11:39:53.811716 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1718/3282] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:39:53 2022] POST /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:39:53.820688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5cd4e551-ca54-400f-8602-38af50046b6d tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:53.822566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5cd4e551-ca54-400f-8602-38af50046b6d tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:53.833717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cd4e551-ca54-400f-8602-38af50046b6d tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:53.834720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cd4e551-ca54-400f-8602-38af50046b6d tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:53.835572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cd4e551-ca54-400f-8602-38af50046b6d tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:53.836760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cd4e551-ca54-400f-8602-38af50046b6d tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:53.837432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cd4e551-ca54-400f-8602-38af50046b6d tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:53.838164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cd4e551-ca54-400f-8602-38af50046b6d tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:53.975760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c6847fb5-0d8e-41e5-bad9-dc25c62f44c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:54.001165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c6847fb5-0d8e-41e5-bad9-dc25c62f44c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:54.005040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c6847fb5-0d8e-41e5-bad9-dc25c62f44c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:54.008258 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c6847fb5-0d8e-41e5-bad9-dc25c62f44c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.682052 Aug 18 11:39:54.010461 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1565/3283] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:53 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:54.017099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-04e37f61-38c1-468b-b3d3-55463a5c047d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:54.017883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-04e37f61-38c1-468b-b3d3-55463a5c047d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:54.026973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04e37f61-38c1-468b-b3d3-55463a5c047d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:54.028681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04e37f61-38c1-468b-b3d3-55463a5c047d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:54.032916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04e37f61-38c1-468b-b3d3-55463a5c047d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:54.034177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04e37f61-38c1-468b-b3d3-55463a5c047d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:54.035921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04e37f61-38c1-468b-b3d3-55463a5c047d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:54.036759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04e37f61-38c1-468b-b3d3-55463a5c047d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:54.263187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5cd4e551-ca54-400f-8602-38af50046b6d tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db3fcd22a44469ca290875379b747f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de0753e6c9e4ddab2fd34f0c71c1678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:54.276805 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5cd4e551-ca54-400f-8602-38af50046b6d tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 200 len: 1312 microversion: 2.1 time: 0.462048 Aug 18 11:39:54.277845 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1719/3284] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:53 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 1312 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:54.282474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:54.285200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:54.292281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:54.292786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:54.293767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:54.294633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:54.295162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:54.296053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:54.399472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:39:54.400176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:39:54.400664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:39:54.401078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:39:54.401492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:39:54.474944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:54.483433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:54.484770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:54.485350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:54.486111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:54.486832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:54.487682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:54.522948 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e91618c-7619-4d74-b75d-89fb59fbd3c5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "POST /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635/action" status: 202 len: 1112 microversion: 2.1 time: 0.244206 Aug 18 11:39:54.523627 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1720/3285] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:39:54 2022] POST /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635/action => generated 1112 bytes in 246 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 18 11:39:54.527100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:54.529725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e4d864e-d0c8-47e0-9ac7-a21ee6fc9280 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:54.530411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e4d864e-d0c8-47e0-9ac7-a21ee6fc9280 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:54.549439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4d864e-d0c8-47e0-9ac7-a21ee6fc9280 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:54.550208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4d864e-d0c8-47e0-9ac7-a21ee6fc9280 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:54.550776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4d864e-d0c8-47e0-9ac7-a21ee6fc9280 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:54.551806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4d864e-d0c8-47e0-9ac7-a21ee6fc9280 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:54.552365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4d864e-d0c8-47e0-9ac7-a21ee6fc9280 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:54.552890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4d864e-d0c8-47e0-9ac7-a21ee6fc9280 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:54.609611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=22 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:54.935438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e4d864e-d0c8-47e0-9ac7-a21ee6fc9280 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:54.952602 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e4d864e-d0c8-47e0-9ac7-a21ee6fc9280 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1666 microversion: 2.1 time: 0.427631 Aug 18 11:39:54.954172 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1721/3286] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:54 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1666 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:54.961713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ef595225-e3c1-4361-894b-36585fa4adaf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:54.962683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef595225-e3c1-4361-894b-36585fa4adaf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:54.978032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef595225-e3c1-4361-894b-36585fa4adaf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:54.979989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef595225-e3c1-4361-894b-36585fa4adaf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:54.981516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef595225-e3c1-4361-894b-36585fa4adaf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:54.982952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef595225-e3c1-4361-894b-36585fa4adaf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:54.984011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef595225-e3c1-4361-894b-36585fa4adaf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:54.984525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef595225-e3c1-4361-894b-36585fa4adaf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:55.179960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ef595225-e3c1-4361-894b-36585fa4adaf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:55.182003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-04e37f61-38c1-468b-b3d3-55463a5c047d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:55.188985 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ef595225-e3c1-4361-894b-36585fa4adaf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1312 microversion: 2.1 time: 0.233327 Aug 18 11:39:55.202523 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1722/3287] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:54 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1312 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:55.202785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-04e37f61-38c1-468b-b3d3-55463a5c047d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:55.202785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-04e37f61-38c1-468b-b3d3-55463a5c047d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:55.202785 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-04e37f61-38c1-468b-b3d3-55463a5c047d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 1.182571 Aug 18 11:39:55.202785 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1566/3288] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:54 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:55.204493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c3a7e773-bfac-4986-9f15-274b60f2710a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:55.205252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c3a7e773-bfac-4986-9f15-274b60f2710a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:55.211785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4a1f0e8d-20c8-4958-aaaa-9b428a7dbf70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:55.212640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3a7e773-bfac-4986-9f15-274b60f2710a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:55.213163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3a7e773-bfac-4986-9f15-274b60f2710a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:55.213342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4a1f0e8d-20c8-4958-aaaa-9b428a7dbf70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:55.213621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3a7e773-bfac-4986-9f15-274b60f2710a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:55.214840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3a7e773-bfac-4986-9f15-274b60f2710a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:55.216338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3a7e773-bfac-4986-9f15-274b60f2710a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:55.216784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3a7e773-bfac-4986-9f15-274b60f2710a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:55.223325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a1f0e8d-20c8-4958-aaaa-9b428a7dbf70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:55.223325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a1f0e8d-20c8-4958-aaaa-9b428a7dbf70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:55.223325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a1f0e8d-20c8-4958-aaaa-9b428a7dbf70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:55.223940 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a1f0e8d-20c8-4958-aaaa-9b428a7dbf70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:55.224470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a1f0e8d-20c8-4958-aaaa-9b428a7dbf70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:55.224983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a1f0e8d-20c8-4958-aaaa-9b428a7dbf70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:55.374835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c3a7e773-bfac-4986-9f15-274b60f2710a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:55.383014 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c3a7e773-bfac-4986-9f15-274b60f2710a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.192097 Aug 18 11:39:55.383621 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1723/3289] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:55 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:55.389053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-42c2ab7f-041c-4fa4-862d-478cc08512ee tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:55.389681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-42c2ab7f-041c-4fa4-862d-478cc08512ee tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:55.396819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42c2ab7f-041c-4fa4-862d-478cc08512ee tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:55.397182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42c2ab7f-041c-4fa4-862d-478cc08512ee tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:55.397518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42c2ab7f-041c-4fa4-862d-478cc08512ee tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:55.398262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42c2ab7f-041c-4fa4-862d-478cc08512ee tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:55.398811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42c2ab7f-041c-4fa4-862d-478cc08512ee tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:55.399248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42c2ab7f-041c-4fa4-862d-478cc08512ee tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:55.404533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:39:55.560362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-42c2ab7f-041c-4fa4-862d-478cc08512ee tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db3fcd22a44469ca290875379b747f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de0753e6c9e4ddab2fd34f0c71c1678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:55.570507 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-42c2ab7f-041c-4fa4-862d-478cc08512ee tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 200 len: 1312 microversion: 2.1 time: 0.185671 Aug 18 11:39:55.578507 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1724/3290] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:55 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:55.947329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4a1f0e8d-20c8-4958-aaaa-9b428a7dbf70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:55.958906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4a1f0e8d-20c8-4958-aaaa-9b428a7dbf70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:55.961095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4a1f0e8d-20c8-4958-aaaa-9b428a7dbf70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:55.962762 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4a1f0e8d-20c8-4958-aaaa-9b428a7dbf70 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.766001 Aug 18 11:39:55.963714 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1567/3291] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:55 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:55.984400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7dd5ec12-06be-41c4-b762-22cfc69b5acb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:55.985541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dd5ec12-06be-41c4-b762-22cfc69b5acb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:55.992892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd5ec12-06be-41c4-b762-22cfc69b5acb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:55.993111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd5ec12-06be-41c4-b762-22cfc69b5acb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:55.993670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd5ec12-06be-41c4-b762-22cfc69b5acb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:55.994499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd5ec12-06be-41c4-b762-22cfc69b5acb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:55.995124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd5ec12-06be-41c4-b762-22cfc69b5acb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:55.995570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dd5ec12-06be-41c4-b762-22cfc69b5acb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:56.159532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7dd5ec12-06be-41c4-b762-22cfc69b5acb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:56.178200 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7dd5ec12-06be-41c4-b762-22cfc69b5acb tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.204314 Aug 18 11:39:56.180043 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1725/3292] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:55 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:56.222128 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6960ba29-acb9-4e85-981d-4ee3975effda tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:56.227647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6960ba29-acb9-4e85-981d-4ee3975effda tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:56.231394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-be47007b-6ed6-480a-ba34-63a1eaf2d60e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:56.232663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-be47007b-6ed6-480a-ba34-63a1eaf2d60e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:56.244604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6960ba29-acb9-4e85-981d-4ee3975effda tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:56.250895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6960ba29-acb9-4e85-981d-4ee3975effda tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:56.251741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6960ba29-acb9-4e85-981d-4ee3975effda tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:56.252471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6960ba29-acb9-4e85-981d-4ee3975effda tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:56.253170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6960ba29-acb9-4e85-981d-4ee3975effda tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:56.253626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6960ba29-acb9-4e85-981d-4ee3975effda tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:56.256054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be47007b-6ed6-480a-ba34-63a1eaf2d60e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:56.260009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be47007b-6ed6-480a-ba34-63a1eaf2d60e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:56.263544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be47007b-6ed6-480a-ba34-63a1eaf2d60e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:56.265466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be47007b-6ed6-480a-ba34-63a1eaf2d60e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:56.270336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be47007b-6ed6-480a-ba34-63a1eaf2d60e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:56.271632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be47007b-6ed6-480a-ba34-63a1eaf2d60e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:56.604817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-be47007b-6ed6-480a-ba34-63a1eaf2d60e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:56.619818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-be47007b-6ed6-480a-ba34-63a1eaf2d60e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:56.621828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-be47007b-6ed6-480a-ba34-63a1eaf2d60e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:56.623318 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-be47007b-6ed6-480a-ba34-63a1eaf2d60e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.406935 Aug 18 11:39:56.634920 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1726/3293] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:56 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:56.645532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e339873-275c-4576-80cf-ceef146985d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:56.646554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9e339873-275c-4576-80cf-ceef146985d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:56.654261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e339873-275c-4576-80cf-ceef146985d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:56.655048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e339873-275c-4576-80cf-ceef146985d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:56.655683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e339873-275c-4576-80cf-ceef146985d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:56.656877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e339873-275c-4576-80cf-ceef146985d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:56.657550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e339873-275c-4576-80cf-ceef146985d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:56.658308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e339873-275c-4576-80cf-ceef146985d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:56.705397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6960ba29-acb9-4e85-981d-4ee3975effda tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:56.715508 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6960ba29-acb9-4e85-981d-4ee3975effda tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1312 microversion: 2.1 time: 0.505464 Aug 18 11:39:56.716120 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1568/3294] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:56 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1312 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:56.725261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-69f04189-b90b-4fb0-aa82-79bd615da91c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:56.725883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-69f04189-b90b-4fb0-aa82-79bd615da91c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:56.742936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69f04189-b90b-4fb0-aa82-79bd615da91c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:56.742936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69f04189-b90b-4fb0-aa82-79bd615da91c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:56.743278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69f04189-b90b-4fb0-aa82-79bd615da91c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:56.743955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69f04189-b90b-4fb0-aa82-79bd615da91c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:56.744437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69f04189-b90b-4fb0-aa82-79bd615da91c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:56.744878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69f04189-b90b-4fb0-aa82-79bd615da91c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:57.036707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9e339873-275c-4576-80cf-ceef146985d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:57.053250 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9e339873-275c-4576-80cf-ceef146985d1 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1669 microversion: 2.1 time: 0.416425 Aug 18 11:39:57.067499 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1727/3295] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:56 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1669 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:57.083105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-69f04189-b90b-4fb0-aa82-79bd615da91c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:57.097423 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-69f04189-b90b-4fb0-aa82-79bd615da91c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.370364 Aug 18 11:39:57.097423 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1569/3296] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:56 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:57.101504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0642abc7-138f-463f-a504-986d006e3215 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:57.102792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0642abc7-138f-463f-a504-986d006e3215 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:57.114978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0642abc7-138f-463f-a504-986d006e3215 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:57.116452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0642abc7-138f-463f-a504-986d006e3215 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:57.117658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0642abc7-138f-463f-a504-986d006e3215 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:57.119740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0642abc7-138f-463f-a504-986d006e3215 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:57.120859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0642abc7-138f-463f-a504-986d006e3215 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:57.122415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0642abc7-138f-463f-a504-986d006e3215 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:57.127398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4cfb91b2-114e-45dc-bb4e-075f2c5c132a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:57.128716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4cfb91b2-114e-45dc-bb4e-075f2c5c132a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:57.140963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cfb91b2-114e-45dc-bb4e-075f2c5c132a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:57.141585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cfb91b2-114e-45dc-bb4e-075f2c5c132a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:57.142135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cfb91b2-114e-45dc-bb4e-075f2c5c132a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:57.143061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cfb91b2-114e-45dc-bb4e-075f2c5c132a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:57.143697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cfb91b2-114e-45dc-bb4e-075f2c5c132a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:57.144365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cfb91b2-114e-45dc-bb4e-075f2c5c132a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:57.464373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4cfb91b2-114e-45dc-bb4e-075f2c5c132a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:57.481893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4cfb91b2-114e-45dc-bb4e-075f2c5c132a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:57.484475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4cfb91b2-114e-45dc-bb4e-075f2c5c132a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:57.486296 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4cfb91b2-114e-45dc-bb4e-075f2c5c132a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.370588 Aug 18 11:39:57.487491 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1570/3297] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:57 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:57.504228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:57.505065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:57.520122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:57.520932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:57.521547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:57.522252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0642abc7-138f-463f-a504-986d006e3215 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db3fcd22a44469ca290875379b747f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de0753e6c9e4ddab2fd34f0c71c1678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:57.522867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:57.523716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:57.524503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:57.535984 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0642abc7-138f-463f-a504-986d006e3215 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 200 len: 1312 microversion: 2.1 time: 0.463992 Aug 18 11:39:57.543444 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1728/3298] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:57 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 1312 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:57.548735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-00c3176f-5d24-4b21-9ebc-88a2acab136b req-0533b469-732c-40be-9922-50de7f5ada61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-plugged", "status": "completed", "tag": "87e91856-1edc-454b-ad68-ad91d5cc3042"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:39:57.567260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:39:57.579417 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.compute.api [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Working on deleting snapshot a401c8f3-7566-4878-8a5f-9c419240734e from shelved instance... Aug 18 11:39:57.580952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-00c3176f-5d24-4b21-9ebc-88a2acab136b req-0533b469-732c-40be-9922-50de7f5ada61 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:57.581566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-00c3176f-5d24-4b21-9ebc-88a2acab136b req-0533b469-732c-40be-9922-50de7f5ada61 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:57.582124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-00c3176f-5d24-4b21-9ebc-88a2acab136b req-0533b469-732c-40be-9922-50de7f5ada61 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:57.609553 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-00c3176f-5d24-4b21-9ebc-88a2acab136b req-0533b469-732c-40be-9922-50de7f5ada61 service nova] Creating event network-vif-plugged:87e91856-1edc-454b-ad68-ad91d5cc3042 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:39:57.629962 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-00c3176f-5d24-4b21-9ebc-88a2acab136b req-0533b469-732c-40be-9922-50de7f5ada61 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084854 Aug 18 11:39:57.630704 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1729/3299] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:39:57.659156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5a0296d4-62fe-4ccc-b9cb-89581aa5f7dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:57.660721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5a0296d4-62fe-4ccc-b9cb-89581aa5f7dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:57.673693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a0296d4-62fe-4ccc-b9cb-89581aa5f7dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:57.675009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a0296d4-62fe-4ccc-b9cb-89581aa5f7dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:57.675979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a0296d4-62fe-4ccc-b9cb-89581aa5f7dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:57.677462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a0296d4-62fe-4ccc-b9cb-89581aa5f7dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:57.678754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a0296d4-62fe-4ccc-b9cb-89581aa5f7dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:57.680050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a0296d4-62fe-4ccc-b9cb-89581aa5f7dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:58.212952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5a0296d4-62fe-4ccc-b9cb-89581aa5f7dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:58.247619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5a0296d4-62fe-4ccc-b9cb-89581aa5f7dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:58.258013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5a0296d4-62fe-4ccc-b9cb-89581aa5f7dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:58.262792 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5a0296d4-62fe-4ccc-b9cb-89581aa5f7dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.610697 Aug 18 11:39:58.265331 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1730/3300] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:57 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:58.280603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7a7f225f-8db9-4e33-9505-72fb8bc8418b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:58.281681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7a7f225f-8db9-4e33-9505-72fb8bc8418b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:58.310109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a7f225f-8db9-4e33-9505-72fb8bc8418b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:58.316337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a7f225f-8db9-4e33-9505-72fb8bc8418b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:58.317260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a7f225f-8db9-4e33-9505-72fb8bc8418b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:58.318530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a7f225f-8db9-4e33-9505-72fb8bc8418b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:58.319313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a7f225f-8db9-4e33-9505-72fb8bc8418b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:58.320069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a7f225f-8db9-4e33-9505-72fb8bc8418b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:58.890913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Doing local delete in cell 68989ef7-340f-4449-87c1-932f111c2bdb(cell1) {{(pid=122209) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 18 11:39:58.892638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:58.893420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:58.894096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:58.894793 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.compute.api [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 18 11:39:58.901885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] deallocate_for_instance() {{(pid=122209) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 18 11:39:59.094920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7a7f225f-8db9-4e33-9505-72fb8bc8418b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:59.108792 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7a7f225f-8db9-4e33-9505-72fb8bc8418b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1312 microversion: 2.1 time: 0.839447 Aug 18 11:39:59.110019 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1731/3301] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:58 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1312 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:59.115205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f0296f6a-cd47-4577-8fa3-343683849b23 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:59.118027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f0296f6a-cd47-4577-8fa3-343683849b23 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:59.137540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0296f6a-cd47-4577-8fa3-343683849b23 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:59.138060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0296f6a-cd47-4577-8fa3-343683849b23 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:59.138536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0296f6a-cd47-4577-8fa3-343683849b23 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:59.139282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0296f6a-cd47-4577-8fa3-343683849b23 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:59.139743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0296f6a-cd47-4577-8fa3-343683849b23 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:59.140171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0296f6a-cd47-4577-8fa3-343683849b23 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:59.458228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f0296f6a-cd47-4577-8fa3-343683849b23 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:59.468629 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f0296f6a-cd47-4577-8fa3-343683849b23 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.357274 Aug 18 11:39:59.473773 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1732/3302] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:59 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:39:59.479037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7854bff4-8d3b-422a-b8bb-c7e8d659e937 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:59.479654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7854bff4-8d3b-422a-b8bb-c7e8d659e937 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:39:59.490507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7854bff4-8d3b-422a-b8bb-c7e8d659e937 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:59.491010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7854bff4-8d3b-422a-b8bb-c7e8d659e937 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:59.491446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7854bff4-8d3b-422a-b8bb-c7e8d659e937 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:59.492164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7854bff4-8d3b-422a-b8bb-c7e8d659e937 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:39:59.492619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7854bff4-8d3b-422a-b8bb-c7e8d659e937 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:39:59.499673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7854bff4-8d3b-422a-b8bb-c7e8d659e937 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:39:59.928352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7854bff4-8d3b-422a-b8bb-c7e8d659e937 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:59.945339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7854bff4-8d3b-422a-b8bb-c7e8d659e937 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:59.951936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7854bff4-8d3b-422a-b8bb-c7e8d659e937 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:39:59.954359 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7854bff4-8d3b-422a-b8bb-c7e8d659e937 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.478312 Aug 18 11:39:59.955529 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1733/3303] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:39:59 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:39:59.973129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Updating instance_info_cache with network_info: [] {{(pid=122209) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 18 11:39:59.997566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ad0cd83e-c4c8-4a19-99e8-f82fb5efc169 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:39:59.999936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ad0cd83e-c4c8-4a19-99e8-f82fb5efc169 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:00.014775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad0cd83e-c4c8-4a19-99e8-f82fb5efc169 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:00.017195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad0cd83e-c4c8-4a19-99e8-f82fb5efc169 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:00.018364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad0cd83e-c4c8-4a19-99e8-f82fb5efc169 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:00.019453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad0cd83e-c4c8-4a19-99e8-f82fb5efc169 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:00.022291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad0cd83e-c4c8-4a19-99e8-f82fb5efc169 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:00.022998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad0cd83e-c4c8-4a19-99e8-f82fb5efc169 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:00.481713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ad0cd83e-c4c8-4a19-99e8-f82fb5efc169 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db3fcd22a44469ca290875379b747f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de0753e6c9e4ddab2fd34f0c71c1678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:00.497986 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ad0cd83e-c4c8-4a19-99e8-f82fb5efc169 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 200 len: 1312 microversion: 2.1 time: 0.541148 Aug 18 11:40:00.513439 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1734/3304] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:39:59 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 1312 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:00.520603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b12a884-a501-4a37-a4d1-c86bb9a4aa41 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:00.521230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b12a884-a501-4a37-a4d1-c86bb9a4aa41 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:00.540402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b12a884-a501-4a37-a4d1-c86bb9a4aa41 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:00.540898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b12a884-a501-4a37-a4d1-c86bb9a4aa41 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:00.541342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b12a884-a501-4a37-a4d1-c86bb9a4aa41 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:00.542273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b12a884-a501-4a37-a4d1-c86bb9a4aa41 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:00.543550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b12a884-a501-4a37-a4d1-c86bb9a4aa41 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:00.547117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b12a884-a501-4a37-a4d1-c86bb9a4aa41 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:00.772055 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-633f030b-c19a-451c-a151-954d8b9bdbc7 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "DELETE /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 204 len: 0 microversion: 2.1 time: 3.282133 Aug 18 11:40:00.773246 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1571/3305] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:39:57 2022] DELETE /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 0 bytes in 3285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:40:00.783029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-94d17fd1-4a39-4b2d-ac64-0c664bcf8eed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:00.786273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-94d17fd1-4a39-4b2d-ac64-0c664bcf8eed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:00.799123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94d17fd1-4a39-4b2d-ac64-0c664bcf8eed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:00.799646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94d17fd1-4a39-4b2d-ac64-0c664bcf8eed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:00.800566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94d17fd1-4a39-4b2d-ac64-0c664bcf8eed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:00.801313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94d17fd1-4a39-4b2d-ac64-0c664bcf8eed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:00.801829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94d17fd1-4a39-4b2d-ac64-0c664bcf8eed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:00.802480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94d17fd1-4a39-4b2d-ac64-0c664bcf8eed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:00.845132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-94d17fd1-4a39-4b2d-ac64-0c664bcf8eed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lazy-loading 'flavor' on Instance uuid 7c22c788-0180-43df-aa4e-48363a89fa79 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:40:00.988692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5b12a884-a501-4a37-a4d1-c86bb9a4aa41 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:01.004833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5b12a884-a501-4a37-a4d1-c86bb9a4aa41 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:01.006718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5b12a884-a501-4a37-a4d1-c86bb9a4aa41 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:01.008116 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b12a884-a501-4a37-a4d1-c86bb9a4aa41 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.493603 Aug 18 11:40:01.010651 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1735/3306] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:00 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:01.037869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8fc76b04-730d-44ef-8e9c-56b36792dade req-91ea9edf-963d-46cc-bdf2-c4db633dcf90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f65b4f-2652-4d50-b868-5d7258fa7cb4", "name": "network-vif-deleted", "tag": "d3a33b84-c6d1-47fc-a6d8-29d57933f772"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:01.073486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8fc76b04-730d-44ef-8e9c-56b36792dade req-91ea9edf-963d-46cc-bdf2-c4db633dcf90 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:01.082474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8fc76b04-730d-44ef-8e9c-56b36792dade req-91ea9edf-963d-46cc-bdf2-c4db633dcf90 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:01.083145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8fc76b04-730d-44ef-8e9c-56b36792dade req-91ea9edf-963d-46cc-bdf2-c4db633dcf90 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:01.091952 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-94d17fd1-4a39-4b2d-ac64-0c664bcf8eed tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/action" status: 200 len: 32 microversion: 2.1 time: 0.317170 Aug 18 11:40:01.093206 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1572/3307] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:40:00 2022] POST /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/action => generated 32 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:40:01.104126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.compute.server_external_events [req-8fc76b04-730d-44ef-8e9c-56b36792dade req-91ea9edf-963d-46cc-bdf2-c4db633dcf90 service nova] Unable to find a host for instance 73f65b4f-2652-4d50-b868-5d7258fa7cb4. Dropping event network-vif-deleted {{(pid=122210) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 11:40:01.112165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-ff417ee6-93e7-49c8-a2a5-f6834725f6cc req-c04b0c7d-4fef-4da1-92c5-418e83c60b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-plugged", "status": "completed", "tag": "cd3590e3-c7bc-46ed-9406-3be3fdd8f424"}, {"server_uuid": "4b981016-2c6d-4f5e-b95d-d5579667d3f4", "name": "network-vif-plugged", "status": "completed", "tag": "b64ac802-7e92-46b4-ac99-b4227589e8f5"}, {"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-plugged", "status": "completed", "tag": "4a2069c0-71e1-43d0-8277-fb9b9a43de8b"}, {"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-plugged", "status": "completed", "tag": "b6b82b42-049e-4313-85b7-b7b6ccd6e554"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:01.119726 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8fc76b04-730d-44ef-8e9c-56b36792dade req-91ea9edf-963d-46cc-bdf2-c4db633dcf90 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.091685 Aug 18 11:40:01.122180 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1736/3308] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 95 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 18 11:40:01.132698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-419c051a-c9f8-4849-9799-ea2a0eb7df11 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:01.135091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ff417ee6-93e7-49c8-a2a5-f6834725f6cc req-c04b0c7d-4fef-4da1-92c5-418e83c60b60 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:01.136403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-419c051a-c9f8-4849-9799-ea2a0eb7df11 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:01.139607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ff417ee6-93e7-49c8-a2a5-f6834725f6cc req-c04b0c7d-4fef-4da1-92c5-418e83c60b60 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:01.140273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ff417ee6-93e7-49c8-a2a5-f6834725f6cc req-c04b0c7d-4fef-4da1-92c5-418e83c60b60 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:01.149068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=18,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:01.152922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-419c051a-c9f8-4849-9799-ea2a0eb7df11 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:01.153819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-419c051a-c9f8-4849-9799-ea2a0eb7df11 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:01.156019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-419c051a-c9f8-4849-9799-ea2a0eb7df11 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:01.157311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-419c051a-c9f8-4849-9799-ea2a0eb7df11 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:01.162002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-419c051a-c9f8-4849-9799-ea2a0eb7df11 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:01.162863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-419c051a-c9f8-4849-9799-ea2a0eb7df11 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:01.183009 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ff417ee6-93e7-49c8-a2a5-f6834725f6cc req-c04b0c7d-4fef-4da1-92c5-418e83c60b60 service nova] Creating event network-vif-plugged:cd3590e3-c7bc-46ed-9406-3be3fdd8f424 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:40:01.188423 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ff417ee6-93e7-49c8-a2a5-f6834725f6cc req-c04b0c7d-4fef-4da1-92c5-418e83c60b60 service nova] Creating event network-vif-plugged:b64ac802-7e92-46b4-ac99-b4227589e8f5 for instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 on n-h1-853611-3 Aug 18 11:40:01.189471 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ff417ee6-93e7-49c8-a2a5-f6834725f6cc req-c04b0c7d-4fef-4da1-92c5-418e83c60b60 service nova] Creating event network-vif-plugged:4a2069c0-71e1-43d0-8277-fb9b9a43de8b for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:40:01.190202 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ff417ee6-93e7-49c8-a2a5-f6834725f6cc req-c04b0c7d-4fef-4da1-92c5-418e83c60b60 service nova] Creating event network-vif-plugged:b6b82b42-049e-4313-85b7-b7b6ccd6e554 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:40:01.204711 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-ff417ee6-93e7-49c8-a2a5-f6834725f6cc req-c04b0c7d-4fef-4da1-92c5-418e83c60b60 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.109852 Aug 18 11:40:01.206365 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1573/3309] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:01.212219 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e324e610-9011-414a-896c-e51a4beaffd2 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:01.213345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e324e610-9011-414a-896c-e51a4beaffd2 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:01.221633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e324e610-9011-414a-896c-e51a4beaffd2 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:01.222666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e324e610-9011-414a-896c-e51a4beaffd2 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:01.223369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e324e610-9011-414a-896c-e51a4beaffd2 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:01.224346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e324e610-9011-414a-896c-e51a4beaffd2 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:01.225061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e324e610-9011-414a-896c-e51a4beaffd2 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:01.225705 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e324e610-9011-414a-896c-e51a4beaffd2 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:01.474054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e324e610-9011-414a-896c-e51a4beaffd2 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:01.482747 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e324e610-9011-414a-896c-e51a4beaffd2 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.274772 Aug 18 11:40:01.495282 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1574/3310] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:01 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:01.502397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4df25897-5ebd-4003-98f8-47c18b5f36bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:01.503075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4df25897-5ebd-4003-98f8-47c18b5f36bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 73f65b4f-2652-4d50-b868-5d7258fa7cb4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:01.511122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4df25897-5ebd-4003-98f8-47c18b5f36bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:01.512175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4df25897-5ebd-4003-98f8-47c18b5f36bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:01.512615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4df25897-5ebd-4003-98f8-47c18b5f36bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:01.514757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4df25897-5ebd-4003-98f8-47c18b5f36bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:01.514757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4df25897-5ebd-4003-98f8-47c18b5f36bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:01.514757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4df25897-5ebd-4003-98f8-47c18b5f36bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:01.532129 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-4df25897-5ebd-4003-98f8-47c18b5f36bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] HTTP exception thrown: Instance 73f65b4f-2652-4d50-b868-5d7258fa7cb4 could not be found. Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4df25897-5ebd-4003-98f8-47c18b5f36bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Request method failure captured: Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 HTTP/1.1 Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iLmk9InP0duM3a0KDx_rtZKV8FK6L1K2bxM2FY_EgJYqIM7l6-dvd1lSerO55Wyi5U4yj1fTG6Vc3OaZITag4LeT6S8IZr53KJqlR_jcP3WXpPplfH-I6YY1lxUr6Gwpsy1_3hY6Dk0Yq1AVixRwd4iEqTkfityyzTwlhBMvpVDaIo Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: c1a985dc6f824e5b847a2d966c0f79af Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: c1a985dc6f824e5b847a2d966c0f79af Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerActionsTestJSON-998907994-project Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 0cd8451c50d941409a66864cbc1c7201 Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerActionsTestJSON-998907994-project Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 73f65b4f-2652-4d50-b868-5d7258fa7cb4 could not be found. Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '73f65b4f-2652-4d50-b868-5d7258fa7cb4'} Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f65b4f-2652-4d50-b868-5d7258fa7cb4 could not be found. Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f65b4f-2652-4d50-b868-5d7258fa7cb4 could not be found. Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:01.533921 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:01.545095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:01.545095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:01.545095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:01.545095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:01.545095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:01.545095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f65b4f-2652-4d50-b868-5d7258fa7cb4 could not be found. Aug 18 11:40:01.545095 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:01.545095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4df25897-5ebd-4003-98f8-47c18b5f36bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Returning 404 to user: Instance 73f65b4f-2652-4d50-b868-5d7258fa7cb4 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:01.545095 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4df25897-5ebd-4003-98f8-47c18b5f36bd tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4" status: 404 len: 111 microversion: 2.1 time: 0.038239 Aug 18 11:40:01.545095 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1575/3311] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:01 2022] GET /compute/v2.1/servers/73f65b4f-2652-4d50-b868-5d7258fa7cb4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:40:01.546021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-419c051a-c9f8-4849-9799-ea2a0eb7df11 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:01.553161 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-419c051a-c9f8-4849-9799-ea2a0eb7df11 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1312 microversion: 2.1 time: 0.429600 Aug 18 11:40:01.554278 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1737/3312] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:01 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1312 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:01.557656 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7774b2d4-f7a7-4cb7-afa8-6977af28d408 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:01.565527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7774b2d4-f7a7-4cb7-afa8-6977af28d408 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:01.577969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-49d2a681-a4d8-4df1-a877-17ad18dbf328 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:01.579409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-49d2a681-a4d8-4df1-a877-17ad18dbf328 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:01.581955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7774b2d4-f7a7-4cb7-afa8-6977af28d408 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:01.582628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7774b2d4-f7a7-4cb7-afa8-6977af28d408 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:01.583179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7774b2d4-f7a7-4cb7-afa8-6977af28d408 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:01.584011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7774b2d4-f7a7-4cb7-afa8-6977af28d408 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:01.584582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7774b2d4-f7a7-4cb7-afa8-6977af28d408 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:01.585505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7774b2d4-f7a7-4cb7-afa8-6977af28d408 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:01.610335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49d2a681-a4d8-4df1-a877-17ad18dbf328 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:01.612022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49d2a681-a4d8-4df1-a877-17ad18dbf328 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:01.613109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49d2a681-a4d8-4df1-a877-17ad18dbf328 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:01.614783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49d2a681-a4d8-4df1-a877-17ad18dbf328 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:01.619741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49d2a681-a4d8-4df1-a877-17ad18dbf328 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:01.621303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49d2a681-a4d8-4df1-a877-17ad18dbf328 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:01.891052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7774b2d4-f7a7-4cb7-afa8-6977af28d408 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:01.903921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7774b2d4-f7a7-4cb7-afa8-6977af28d408 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:01.906203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7774b2d4-f7a7-4cb7-afa8-6977af28d408 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:01.907427 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7774b2d4-f7a7-4cb7-afa8-6977af28d408 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.370124 Aug 18 11:40:01.908390 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1576/3313] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:01 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:01.913224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b2dcaa6f-f6c9-4696-b10f-f31d7b743507 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:01.913859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b2dcaa6f-f6c9-4696-b10f-f31d7b743507 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:01.921445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2dcaa6f-f6c9-4696-b10f-f31d7b743507 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:01.922234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2dcaa6f-f6c9-4696-b10f-f31d7b743507 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:01.923369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2dcaa6f-f6c9-4696-b10f-f31d7b743507 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:01.924777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2dcaa6f-f6c9-4696-b10f-f31d7b743507 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:01.925761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2dcaa6f-f6c9-4696-b10f-f31d7b743507 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:01.926450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2dcaa6f-f6c9-4696-b10f-f31d7b743507 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:02.052014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-49d2a681-a4d8-4df1-a877-17ad18dbf328 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:02.063163 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-49d2a681-a4d8-4df1-a877-17ad18dbf328 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1736 microversion: 2.1 time: 0.503062 Aug 18 11:40:02.078973 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1738/3314] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:01 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1736 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:02.085598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b2dcaa6f-f6c9-4696-b10f-f31d7b743507 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db3fcd22a44469ca290875379b747f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de0753e6c9e4ddab2fd34f0c71c1678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:02.086713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-65ebef7f-4e51-4ac3-8775-9a7de1716911 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:02.087962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-65ebef7f-4e51-4ac3-8775-9a7de1716911 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:02.096986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65ebef7f-4e51-4ac3-8775-9a7de1716911 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:02.097827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65ebef7f-4e51-4ac3-8775-9a7de1716911 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:02.111539 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b2dcaa6f-f6c9-4696-b10f-f31d7b743507 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 200 len: 1312 microversion: 2.1 time: 0.188496 Aug 18 11:40:02.111539 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1577/3315] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:01 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:02.111539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-44b8654e-b8b4-4910-86df-c7a4747a4669 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:02.111539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-44b8654e-b8b4-4910-86df-c7a4747a4669 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:02.114220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65ebef7f-4e51-4ac3-8775-9a7de1716911 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:02.115053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44b8654e-b8b4-4910-86df-c7a4747a4669 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:02.115551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44b8654e-b8b4-4910-86df-c7a4747a4669 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:02.115992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44b8654e-b8b4-4910-86df-c7a4747a4669 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:02.116368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65ebef7f-4e51-4ac3-8775-9a7de1716911 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:02.116997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44b8654e-b8b4-4910-86df-c7a4747a4669 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:02.117396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44b8654e-b8b4-4910-86df-c7a4747a4669 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:02.117799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65ebef7f-4e51-4ac3-8775-9a7de1716911 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:02.117918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44b8654e-b8b4-4910-86df-c7a4747a4669 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:02.118604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65ebef7f-4e51-4ac3-8775-9a7de1716911 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:02.148495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-65ebef7f-4e51-4ac3-8775-9a7de1716911 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:40:02.284107 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-65ebef7f-4e51-4ac3-8775-9a7de1716911 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 204 len: 0 microversion: 2.1 time: 0.201292 Aug 18 11:40:02.288909 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1739/3316] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:40:02 2022] DELETE /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:40:02.297131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-180fab81-2d21-416f-a638-35e0a11ee44d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:02.298202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-180fab81-2d21-416f-a638-35e0a11ee44d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:02.311830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-180fab81-2d21-416f-a638-35e0a11ee44d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:02.312336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-180fab81-2d21-416f-a638-35e0a11ee44d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:02.313171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-180fab81-2d21-416f-a638-35e0a11ee44d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:02.313938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-180fab81-2d21-416f-a638-35e0a11ee44d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:02.314395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-180fab81-2d21-416f-a638-35e0a11ee44d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:02.314850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-180fab81-2d21-416f-a638-35e0a11ee44d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:02.348860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:02.391372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-44b8654e-b8b4-4910-86df-c7a4747a4669 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:02.406170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-44b8654e-b8b4-4910-86df-c7a4747a4669 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:02.408328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-44b8654e-b8b4-4910-86df-c7a4747a4669 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:02.409512 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-44b8654e-b8b4-4910-86df-c7a4747a4669 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.309116 Aug 18 11:40:02.418037 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1578/3317] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:02 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:02.499356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-180fab81-2d21-416f-a638-35e0a11ee44d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:02.504204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-97a3a3cc-c521-4fb8-81a6-538b41a21578 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:02.504827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-97a3a3cc-c521-4fb8-81a6-538b41a21578 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:02.509927 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-180fab81-2d21-416f-a638-35e0a11ee44d tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1465 microversion: 2.1 time: 0.219317 Aug 18 11:40:02.510802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97a3a3cc-c521-4fb8-81a6-538b41a21578 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:02.524060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97a3a3cc-c521-4fb8-81a6-538b41a21578 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:02.524060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97a3a3cc-c521-4fb8-81a6-538b41a21578 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:02.524060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97a3a3cc-c521-4fb8-81a6-538b41a21578 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:02.524060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97a3a3cc-c521-4fb8-81a6-538b41a21578 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:02.524060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97a3a3cc-c521-4fb8-81a6-538b41a21578 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:02.526309 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1740/3318] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:02 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1465 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:02.577807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9a2c8941-4887-4302-bc0f-3b421358d658 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:02.578932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9a2c8941-4887-4302-bc0f-3b421358d658 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:02.585860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a2c8941-4887-4302-bc0f-3b421358d658 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:02.586835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a2c8941-4887-4302-bc0f-3b421358d658 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:02.587305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a2c8941-4887-4302-bc0f-3b421358d658 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:02.588064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a2c8941-4887-4302-bc0f-3b421358d658 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:02.588761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a2c8941-4887-4302-bc0f-3b421358d658 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:02.588950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a2c8941-4887-4302-bc0f-3b421358d658 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:02.723407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-97a3a3cc-c521-4fb8-81a6-538b41a21578 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:02.737321 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-97a3a3cc-c521-4fb8-81a6-538b41a21578 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.236672 Aug 18 11:40:02.739143 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1579/3319] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:02 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:02.932248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d4cd308f-e58f-4a10-907e-dfed70e6b890 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:02.932901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d4cd308f-e58f-4a10-907e-dfed70e6b890 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:02.943409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d4cd308f-e58f-4a10-907e-dfed70e6b890 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:02.944682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d4cd308f-e58f-4a10-907e-dfed70e6b890 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:02.951868 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d4cd308f-e58f-4a10-907e-dfed70e6b890 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:02.956347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d4cd308f-e58f-4a10-907e-dfed70e6b890 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:02.957574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d4cd308f-e58f-4a10-907e-dfed70e6b890 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:02.959634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d4cd308f-e58f-4a10-907e-dfed70e6b890 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:03.105307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9a2c8941-4887-4302-bc0f-3b421358d658 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:03.142879 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9a2c8941-4887-4302-bc0f-3b421358d658 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1312 microversion: 2.1 time: 0.563388 Aug 18 11:40:03.144660 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1741/3320] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:02 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1312 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:03.150179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b066c05-6c17-418e-ba80-f984ecc40123 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:03.151249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3b066c05-6c17-418e-ba80-f984ecc40123 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:03.159905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b066c05-6c17-418e-ba80-f984ecc40123 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:03.160738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b066c05-6c17-418e-ba80-f984ecc40123 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:03.161447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b066c05-6c17-418e-ba80-f984ecc40123 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:03.162418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b066c05-6c17-418e-ba80-f984ecc40123 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:03.163193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b066c05-6c17-418e-ba80-f984ecc40123 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:03.163846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b066c05-6c17-418e-ba80-f984ecc40123 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:03.262121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d4cd308f-e58f-4a10-907e-dfed70e6b890 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:03.272638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d4cd308f-e58f-4a10-907e-dfed70e6b890 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:03.274825 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d4cd308f-e58f-4a10-907e-dfed70e6b890 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:03.276246 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d4cd308f-e58f-4a10-907e-dfed70e6b890 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.348260 Aug 18 11:40:03.290677 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1580/3321] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:02 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:03.299253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-49df9c0f-833a-4183-9f5c-f484e13cd3e1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:03.300123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-49df9c0f-833a-4183-9f5c-f484e13cd3e1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:03.307102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49df9c0f-833a-4183-9f5c-f484e13cd3e1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:03.307930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49df9c0f-833a-4183-9f5c-f484e13cd3e1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:03.309082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49df9c0f-833a-4183-9f5c-f484e13cd3e1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:03.310227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49df9c0f-833a-4183-9f5c-f484e13cd3e1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:03.310891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49df9c0f-833a-4183-9f5c-f484e13cd3e1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:03.311497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49df9c0f-833a-4183-9f5c-f484e13cd3e1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:03.532960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-49df9c0f-833a-4183-9f5c-f484e13cd3e1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db3fcd22a44469ca290875379b747f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de0753e6c9e4ddab2fd34f0c71c1678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:03.544124 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-49df9c0f-833a-4183-9f5c-f484e13cd3e1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 200 len: 1495 microversion: 2.1 time: 0.251553 Aug 18 11:40:03.545485 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1581/3322] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:03 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 1495 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:03.560518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6baa2631-d4ad-44fc-bb35-c9a1a538b73c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:03.561615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6baa2631-d4ad-44fc-bb35-c9a1a538b73c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:03.572129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6baa2631-d4ad-44fc-bb35-c9a1a538b73c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:03.573050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6baa2631-d4ad-44fc-bb35-c9a1a538b73c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:03.574209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6baa2631-d4ad-44fc-bb35-c9a1a538b73c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:03.575484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6baa2631-d4ad-44fc-bb35-c9a1a538b73c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:03.576138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6baa2631-d4ad-44fc-bb35-c9a1a538b73c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:03.576778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6baa2631-d4ad-44fc-bb35-c9a1a538b73c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:03.582067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3b066c05-6c17-418e-ba80-f984ecc40123 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:03.596429 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3b066c05-6c17-418e-ba80-f984ecc40123 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1736 microversion: 2.1 time: 0.450148 Aug 18 11:40:03.597638 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1742/3323] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:03 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1736 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:03.603168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1eb54699-0f61-4e82-889e-7a8a2b634bcb req-cdc84035-14e4-47b6-839a-fe549d054f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-plugged", "status": "completed", "tag": "e2a4d3da-f8cb-4b7f-8b3f-325a41f5e8de"}, {"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-plugged", "status": "completed", "tag": "7aa0fec2-35fb-4c23-afdd-c14e58f79ef8"}, {"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-plugged", "status": "completed", "tag": "a8cc0ae7-4375-4ddf-bae4-66fb1bc368e4"}, {"server_uuid": "1da67cf3-bc5d-4b71-9c07-6234c22493bc", "name": "network-vif-plugged", "status": "completed", "tag": "061756b5-9fa0-425c-99c6-d5be70f85abe"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:03.621833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1eb54699-0f61-4e82-889e-7a8a2b634bcb req-cdc84035-14e4-47b6-839a-fe549d054f91 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:03.622593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1eb54699-0f61-4e82-889e-7a8a2b634bcb req-cdc84035-14e4-47b6-839a-fe549d054f91 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:03.623435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1eb54699-0f61-4e82-889e-7a8a2b634bcb req-cdc84035-14e4-47b6-839a-fe549d054f91 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:03.642881 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1eb54699-0f61-4e82-889e-7a8a2b634bcb req-cdc84035-14e4-47b6-839a-fe549d054f91 service nova] Creating event network-vif-plugged:e2a4d3da-f8cb-4b7f-8b3f-325a41f5e8de for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:40:03.649759 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1eb54699-0f61-4e82-889e-7a8a2b634bcb req-cdc84035-14e4-47b6-839a-fe549d054f91 service nova] Creating event network-vif-plugged:7aa0fec2-35fb-4c23-afdd-c14e58f79ef8 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:40:03.650860 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1eb54699-0f61-4e82-889e-7a8a2b634bcb req-cdc84035-14e4-47b6-839a-fe549d054f91 service nova] Creating event network-vif-plugged:a8cc0ae7-4375-4ddf-bae4-66fb1bc368e4 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:40:03.652306 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1eb54699-0f61-4e82-889e-7a8a2b634bcb req-cdc84035-14e4-47b6-839a-fe549d054f91 service nova] Creating event network-vif-plugged:061756b5-9fa0-425c-99c6-d5be70f85abe for instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc on n-h2-853611-3 Aug 18 11:40:03.660959 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1eb54699-0f61-4e82-889e-7a8a2b634bcb req-cdc84035-14e4-47b6-839a-fe549d054f91 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.061444 Aug 18 11:40:03.662578 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1743/3324] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:03.669589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-19133739-94c1-4346-a4e5-5fadb526c6a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:03.670763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-19133739-94c1-4346-a4e5-5fadb526c6a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:03.687200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19133739-94c1-4346-a4e5-5fadb526c6a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:03.687712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19133739-94c1-4346-a4e5-5fadb526c6a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:03.688156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19133739-94c1-4346-a4e5-5fadb526c6a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:03.688889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19133739-94c1-4346-a4e5-5fadb526c6a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:03.692840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19133739-94c1-4346-a4e5-5fadb526c6a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:03.699458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19133739-94c1-4346-a4e5-5fadb526c6a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:03.851761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-19133739-94c1-4346-a4e5-5fadb526c6a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:03.863203 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-19133739-94c1-4346-a4e5-5fadb526c6a9 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1465 microversion: 2.1 time: 0.197821 Aug 18 11:40:03.865003 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1744/3325] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:03 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1465 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:03.882021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3c229981-983e-48eb-99ac-e2b4ccff6339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:03.903110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.compute.server_groups [None req-3c229981-983e-48eb-99ac-e2b4ccff6339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Querying cell 68989ef7-340f-4449-87c1-932f111c2bdb(cell1) for 1 instances {{(pid=122210) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 18 11:40:03.903842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c229981-983e-48eb-99ac-e2b4ccff6339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:03.904811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c229981-983e-48eb-99ac-e2b4ccff6339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:03.905427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c229981-983e-48eb-99ac-e2b4ccff6339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:03.949563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6baa2631-d4ad-44fc-bb35-c9a1a538b73c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:03.951301 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3c229981-983e-48eb-99ac-e2b4ccff6339 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/os-server-groups/7c6f08bd-611f-40ed-a134-9347b89426a0" status: 200 len: 222 microversion: 2.1 time: 0.084424 Aug 18 11:40:03.952070 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1745/3326] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:40:03 2022] GET /compute/v2.1/os-server-groups/7c6f08bd-611f-40ed-a134-9347b89426a0 => generated 222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:03.957471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b71872fd-d5da-4dac-ad4d-2766e2943e7b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:03.958769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b71872fd-d5da-4dac-ad4d-2766e2943e7b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:03.967265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b71872fd-d5da-4dac-ad4d-2766e2943e7b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:03.968223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b71872fd-d5da-4dac-ad4d-2766e2943e7b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:03.968865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b71872fd-d5da-4dac-ad4d-2766e2943e7b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:03.970149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b71872fd-d5da-4dac-ad4d-2766e2943e7b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:03.970555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6baa2631-d4ad-44fc-bb35-c9a1a538b73c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:03.971065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b71872fd-d5da-4dac-ad4d-2766e2943e7b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:03.971651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b71872fd-d5da-4dac-ad4d-2766e2943e7b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:03.972111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6baa2631-d4ad-44fc-bb35-c9a1a538b73c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:03.974051 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6baa2631-d4ad-44fc-bb35-c9a1a538b73c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.427248 Aug 18 11:40:03.974725 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1582/3327] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:03 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:03.981943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-465e3689-123f-449e-b8ac-b02653000f8f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:03.985040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-465e3689-123f-449e-b8ac-b02653000f8f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:03.993397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-465e3689-123f-449e-b8ac-b02653000f8f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:03.994149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-465e3689-123f-449e-b8ac-b02653000f8f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:03.994785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-465e3689-123f-449e-b8ac-b02653000f8f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:03.995826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-465e3689-123f-449e-b8ac-b02653000f8f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:03.996801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-465e3689-123f-449e-b8ac-b02653000f8f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:03.997424 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-465e3689-123f-449e-b8ac-b02653000f8f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:04.030342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-465e3689-123f-449e-b8ac-b02653000f8f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:40:04.133171 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-465e3689-123f-449e-b8ac-b02653000f8f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 204 len: 0 microversion: 2.1 time: 0.155784 Aug 18 11:40:04.133872 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1583/3328] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:40:03 2022] DELETE /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:40:04.143844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f881ea3b-fbd5-4f15-a4a6-966e776457da tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:04.144553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f881ea3b-fbd5-4f15-a4a6-966e776457da tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:04.151153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f881ea3b-fbd5-4f15-a4a6-966e776457da tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:04.152515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f881ea3b-fbd5-4f15-a4a6-966e776457da tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:04.153118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f881ea3b-fbd5-4f15-a4a6-966e776457da tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:04.154009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f881ea3b-fbd5-4f15-a4a6-966e776457da tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:04.154714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f881ea3b-fbd5-4f15-a4a6-966e776457da tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:04.155414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f881ea3b-fbd5-4f15-a4a6-966e776457da tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:04.269321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b71872fd-d5da-4dac-ad4d-2766e2943e7b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:04.281589 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b71872fd-d5da-4dac-ad4d-2766e2943e7b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.328059 Aug 18 11:40:04.294460 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1746/3329] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:03 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:04.294460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b9272c0-898c-407d-b5e6-083763401772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:04.294460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b9272c0-898c-407d-b5e6-083763401772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:04.298504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b9272c0-898c-407d-b5e6-083763401772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:04.302600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b9272c0-898c-407d-b5e6-083763401772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:04.302600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b9272c0-898c-407d-b5e6-083763401772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:04.302600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b9272c0-898c-407d-b5e6-083763401772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:04.302600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b9272c0-898c-407d-b5e6-083763401772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:04.302600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b9272c0-898c-407d-b5e6-083763401772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:04.575963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f881ea3b-fbd5-4f15-a4a6-966e776457da tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db3fcd22a44469ca290875379b747f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de0753e6c9e4ddab2fd34f0c71c1678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:04.585719 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f881ea3b-fbd5-4f15-a4a6-966e776457da tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 200 len: 1501 microversion: 2.1 time: 0.446102 Aug 18 11:40:04.587347 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1584/3330] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:04 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 1501 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:04.607761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-40f309c3-8393-4398-8321-483e62fd12f5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:04.608651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-40f309c3-8393-4398-8321-483e62fd12f5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:04.621763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40f309c3-8393-4398-8321-483e62fd12f5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:04.622606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40f309c3-8393-4398-8321-483e62fd12f5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:04.623213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40f309c3-8393-4398-8321-483e62fd12f5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:04.624159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40f309c3-8393-4398-8321-483e62fd12f5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:04.625069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40f309c3-8393-4398-8321-483e62fd12f5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:04.625680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40f309c3-8393-4398-8321-483e62fd12f5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:04.930909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-40f309c3-8393-4398-8321-483e62fd12f5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:04.945545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-40f309c3-8393-4398-8321-483e62fd12f5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:04.947275 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-40f309c3-8393-4398-8321-483e62fd12f5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:04.951069 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-40f309c3-8393-4398-8321-483e62fd12f5 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.350269 Aug 18 11:40:04.953104 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1585/3331] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:04 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:04.963898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-390de92d-7eaa-4c04-a589-d29def080a34 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:04.964835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-390de92d-7eaa-4c04-a589-d29def080a34 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:04.973543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-390de92d-7eaa-4c04-a589-d29def080a34 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:04.974084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-390de92d-7eaa-4c04-a589-d29def080a34 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:04.974633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-390de92d-7eaa-4c04-a589-d29def080a34 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:04.975560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-390de92d-7eaa-4c04-a589-d29def080a34 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:04.976143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-390de92d-7eaa-4c04-a589-d29def080a34 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:04.976592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-390de92d-7eaa-4c04-a589-d29def080a34 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:05.001463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5b9272c0-898c-407d-b5e6-083763401772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:05.021178 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b9272c0-898c-407d-b5e6-083763401772 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1312 microversion: 2.1 time: 0.734984 Aug 18 11:40:05.022065 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1747/3332] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:04 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1312 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:05.042142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d2bcfc1a-2716-4a6a-91b6-f2760e9ce867 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:05.043084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d2bcfc1a-2716-4a6a-91b6-f2760e9ce867 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:05.056129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2bcfc1a-2716-4a6a-91b6-f2760e9ce867 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:05.056631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2bcfc1a-2716-4a6a-91b6-f2760e9ce867 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:05.057095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2bcfc1a-2716-4a6a-91b6-f2760e9ce867 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:05.057810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2bcfc1a-2716-4a6a-91b6-f2760e9ce867 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:05.059666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2bcfc1a-2716-4a6a-91b6-f2760e9ce867 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:05.060126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2bcfc1a-2716-4a6a-91b6-f2760e9ce867 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:05.251336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2bcfc1a-2716-4a6a-91b6-f2760e9ce867 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:05.274536 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d2bcfc1a-2716-4a6a-91b6-f2760e9ce867 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1465 microversion: 2.1 time: 0.251486 Aug 18 11:40:05.293644 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1748/3333] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:05 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1465 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:05.314920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-90824128-15d5-493d-aef8-14d80aa1cf20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:05.316069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-90824128-15d5-493d-aef8-14d80aa1cf20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:05.337671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90824128-15d5-493d-aef8-14d80aa1cf20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:05.339256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90824128-15d5-493d-aef8-14d80aa1cf20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:05.340424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90824128-15d5-493d-aef8-14d80aa1cf20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:05.341611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-390de92d-7eaa-4c04-a589-d29def080a34 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:05.342717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90824128-15d5-493d-aef8-14d80aa1cf20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:05.345477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90824128-15d5-493d-aef8-14d80aa1cf20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:05.346606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90824128-15d5-493d-aef8-14d80aa1cf20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:05.354670 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-390de92d-7eaa-4c04-a589-d29def080a34 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1736 microversion: 2.1 time: 0.398636 Aug 18 11:40:05.355279 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1586/3334] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:04 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1736 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:05.367066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-613ceccf-47fb-437b-b938-126d70002daa req-eb5439ed-67f8-49a9-9458-f1261536dc85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7270699d-e0c4-4276-b522-8aee7925f99b", "name": "network-vif-deleted", "tag": "a9cec86b-72ec-4294-9b6c-597cc6c33d0c"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:05.367066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:05.385186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-613ceccf-47fb-437b-b938-126d70002daa req-eb5439ed-67f8-49a9-9458-f1261536dc85 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:05.387885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-613ceccf-47fb-437b-b938-126d70002daa req-eb5439ed-67f8-49a9-9458-f1261536dc85 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:05.389692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-613ceccf-47fb-437b-b938-126d70002daa req-eb5439ed-67f8-49a9-9458-f1261536dc85 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:05.443665 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-613ceccf-47fb-437b-b938-126d70002daa req-eb5439ed-67f8-49a9-9458-f1261536dc85 service nova] Creating event network-vif-deleted:a9cec86b-72ec-4294-9b6c-597cc6c33d0c for instance 7270699d-e0c4-4276-b522-8aee7925f99b on n-h2-853611-3 Aug 18 11:40:05.454560 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-613ceccf-47fb-437b-b938-126d70002daa req-eb5439ed-67f8-49a9-9458-f1261536dc85 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097929 Aug 18 11:40:05.459774 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1587/3335] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:05.467070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6c6e553d-530b-4c97-ace6-1e47a33ce962 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:05.467795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6c6e553d-530b-4c97-ace6-1e47a33ce962 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:05.477731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c6e553d-530b-4c97-ace6-1e47a33ce962 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:05.481321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c6e553d-530b-4c97-ace6-1e47a33ce962 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:05.485953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c6e553d-530b-4c97-ace6-1e47a33ce962 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:05.486801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c6e553d-530b-4c97-ace6-1e47a33ce962 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:05.487301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c6e553d-530b-4c97-ace6-1e47a33ce962 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:05.487751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c6e553d-530b-4c97-ace6-1e47a33ce962 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:05.663995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6c6e553d-530b-4c97-ace6-1e47a33ce962 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:05.673766 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6c6e553d-530b-4c97-ace6-1e47a33ce962 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.212625 Aug 18 11:40:05.674590 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1588/3336] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:05 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:05.679307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e65e1d8c-f8a7-4c36-b938-6eb194c4b981 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:05.679985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e65e1d8c-f8a7-4c36-b938-6eb194c4b981 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:05.698161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e65e1d8c-f8a7-4c36-b938-6eb194c4b981 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:05.698777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e65e1d8c-f8a7-4c36-b938-6eb194c4b981 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:05.699145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e65e1d8c-f8a7-4c36-b938-6eb194c4b981 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:05.699852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e65e1d8c-f8a7-4c36-b938-6eb194c4b981 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:05.701113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e65e1d8c-f8a7-4c36-b938-6eb194c4b981 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:05.701543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e65e1d8c-f8a7-4c36-b938-6eb194c4b981 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:05.721122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-90824128-15d5-493d-aef8-14d80aa1cf20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:05.731068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-90824128-15d5-493d-aef8-14d80aa1cf20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:05.732608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-90824128-15d5-493d-aef8-14d80aa1cf20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:05.733794 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-90824128-15d5-493d-aef8-14d80aa1cf20 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.438987 Aug 18 11:40:05.735015 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1749/3337] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:05 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:05.888662 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e65e1d8c-f8a7-4c36-b938-6eb194c4b981 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4db3fcd22a44469ca290875379b747f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de0753e6c9e4ddab2fd34f0c71c1678', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:05.896890 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e65e1d8c-f8a7-4c36-b938-6eb194c4b981 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 200 len: 1501 microversion: 2.1 time: 0.221445 Aug 18 11:40:05.910746 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1589/3338] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:05 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 1501 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:05.968728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b4357e73-7701-4e9a-8399-addec3ee6506 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Action: 'create', calling method: .version_select at 0x7f519faf14c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-244667337", "description": "tempest-description-573874682"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:05.975610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e98dbbcd-5279-4e35-bf47-dab6250f75c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:05.976442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e98dbbcd-5279-4e35-bf47-dab6250f75c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:05.988120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e98dbbcd-5279-4e35-bf47-dab6250f75c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:05.988625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e98dbbcd-5279-4e35-bf47-dab6250f75c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:05.989264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e98dbbcd-5279-4e35-bf47-dab6250f75c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:05.989995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e98dbbcd-5279-4e35-bf47-dab6250f75c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:05.990489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e98dbbcd-5279-4e35-bf47-dab6250f75c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:05.990927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e98dbbcd-5279-4e35-bf47-dab6250f75c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:05.997839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:06.227985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e98dbbcd-5279-4e35-bf47-dab6250f75c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:06.238773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e98dbbcd-5279-4e35-bf47-dab6250f75c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:06.247510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e98dbbcd-5279-4e35-bf47-dab6250f75c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:06.249370 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e98dbbcd-5279-4e35-bf47-dab6250f75c7 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1877 microversion: 2.42 time: 0.278152 Aug 18 11:40:06.254489 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1590/3339] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:05 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1877 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:06.256437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b81c4bcd-404b-44af-8ff2-85d11b6a5ad1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:06.256589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b81c4bcd-404b-44af-8ff2-85d11b6a5ad1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:06.266054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b81c4bcd-404b-44af-8ff2-85d11b6a5ad1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:06.268109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b81c4bcd-404b-44af-8ff2-85d11b6a5ad1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:06.268559 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b81c4bcd-404b-44af-8ff2-85d11b6a5ad1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:06.269319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b81c4bcd-404b-44af-8ff2-85d11b6a5ad1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:06.269803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b81c4bcd-404b-44af-8ff2-85d11b6a5ad1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:06.270267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b81c4bcd-404b-44af-8ff2-85d11b6a5ad1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:06.464363 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b4357e73-7701-4e9a-8399-addec3ee6506 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.633730 Aug 18 11:40:06.465723 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1750/3340] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:40:05 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:40:06.475151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dbd2ad98-8a68-48cd-90c2-0d06456cc29e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:06.478244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dbd2ad98-8a68-48cd-90c2-0d06456cc29e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:06.488812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b81c4bcd-404b-44af-8ff2-85d11b6a5ad1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:06.497596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd2ad98-8a68-48cd-90c2-0d06456cc29e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:06.501262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd2ad98-8a68-48cd-90c2-0d06456cc29e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:06.502187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd2ad98-8a68-48cd-90c2-0d06456cc29e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:06.503292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd2ad98-8a68-48cd-90c2-0d06456cc29e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:06.504117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd2ad98-8a68-48cd-90c2-0d06456cc29e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:06.504772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd2ad98-8a68-48cd-90c2-0d06456cc29e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:06.507659 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b81c4bcd-404b-44af-8ff2-85d11b6a5ad1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1462 microversion: 2.1 time: 0.256272 Aug 18 11:40:06.520125 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1591/3341] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:06 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1462 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:06.534076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e4a1d25a-8265-496e-8711-232e815565f4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:06.534902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e4a1d25a-8265-496e-8711-232e815565f4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:06.544175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4a1d25a-8265-496e-8711-232e815565f4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:06.544851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4a1d25a-8265-496e-8711-232e815565f4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:06.546243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4a1d25a-8265-496e-8711-232e815565f4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:06.547140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4a1d25a-8265-496e-8711-232e815565f4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:06.547819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4a1d25a-8265-496e-8711-232e815565f4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:06.548535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4a1d25a-8265-496e-8711-232e815565f4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:06.554054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd2ad98-8a68-48cd-90c2-0d06456cc29e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:06.555383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd2ad98-8a68-48cd-90c2-0d06456cc29e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:06.555738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd2ad98-8a68-48cd-90c2-0d06456cc29e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:06.556303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-dbd2ad98-8a68-48cd-90c2-0d06456cc29e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lazy-loading 'fault' on Instance uuid 7270699d-e0c4-4276-b522-8aee7925f99b {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:40:06.625431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dbd2ad98-8a68-48cd-90c2-0d06456cc29e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:06.640108 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dbd2ad98-8a68-48cd-90c2-0d06456cc29e tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 200 len: 1304 microversion: 2.1 time: 0.173147 Aug 18 11:40:06.641421 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1751/3342] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:06 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:06.674228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ad422bba-adfa-4dfe-b9f6-0c9d3805baf5 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Action: 'create', calling method: .version_select at 0x7f519efa1af0>, body: {"security_group_rule": {"parent_group_id": "35111956-85d0-462f-8034-5fe96cbec88d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:06.751290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e4a1d25a-8265-496e-8711-232e815565f4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:06.760198 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e4a1d25a-8265-496e-8711-232e815565f4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1736 microversion: 2.1 time: 0.238797 Aug 18 11:40:06.774235 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1592/3343] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:06 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:06.780235 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-2069ed0a-8996-4197-a3aa-695b53ce0dee req-1ad4fb60-d9ee-4e55-bbcf-3e3d45d8e45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b981016-2c6d-4f5e-b95d-d5579667d3f4", "name": "network-vif-deleted", "tag": "b64ac802-7e92-46b4-ac99-b4227589e8f5"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:06.790743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2069ed0a-8996-4197-a3aa-695b53ce0dee req-1ad4fb60-d9ee-4e55-bbcf-3e3d45d8e45b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:06.791514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2069ed0a-8996-4197-a3aa-695b53ce0dee req-1ad4fb60-d9ee-4e55-bbcf-3e3d45d8e45b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:06.792654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-2069ed0a-8996-4197-a3aa-695b53ce0dee req-1ad4fb60-d9ee-4e55-bbcf-3e3d45d8e45b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:06.806637 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-2069ed0a-8996-4197-a3aa-695b53ce0dee req-1ad4fb60-d9ee-4e55-bbcf-3e3d45d8e45b service nova] Creating event network-vif-deleted:b64ac802-7e92-46b4-ac99-b4227589e8f5 for instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 on n-h1-853611-3 Aug 18 11:40:06.812705 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-2069ed0a-8996-4197-a3aa-695b53ce0dee req-1ad4fb60-d9ee-4e55-bbcf-3e3d45d8e45b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036916 Aug 18 11:40:06.813564 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1593/3344] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:06.819998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-13e2704c-1803-483c-bc82-928514bd2951 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:06.820906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-13e2704c-1803-483c-bc82-928514bd2951 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:06.827523 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13e2704c-1803-483c-bc82-928514bd2951 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:06.828001 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13e2704c-1803-483c-bc82-928514bd2951 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:06.828444 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13e2704c-1803-483c-bc82-928514bd2951 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:06.829160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13e2704c-1803-483c-bc82-928514bd2951 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:06.829622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13e2704c-1803-483c-bc82-928514bd2951 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:06.830049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13e2704c-1803-483c-bc82-928514bd2951 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:06.982213 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ad422bba-adfa-4dfe-b9f6-0c9d3805baf5 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.339488 Aug 18 11:40:06.984588 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1752/3345] 10.222.0.73 () {60 vars in 1195 bytes} [Thu Aug 18 11:40:06 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:06.992076 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-13e2704c-1803-483c-bc82-928514bd2951 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1613 microversion: 2.1 time: 0.175412 Aug 18 11:40:06.992076 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1594/3346] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:06 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1613 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:06.999640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8a654d72-2730-4b67-8f3c-94cd11e37d17 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:07.003502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8a654d72-2730-4b67-8f3c-94cd11e37d17 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:07.008862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a30dc01b-8ebb-4a04-b14f-bb578aa80cbc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:07.009642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a30dc01b-8ebb-4a04-b14f-bb578aa80cbc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:07.019815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a30dc01b-8ebb-4a04-b14f-bb578aa80cbc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.021143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a654d72-2730-4b67-8f3c-94cd11e37d17 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.022124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a654d72-2730-4b67-8f3c-94cd11e37d17 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.023354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a654d72-2730-4b67-8f3c-94cd11e37d17 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.024673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a654d72-2730-4b67-8f3c-94cd11e37d17 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.024805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a30dc01b-8ebb-4a04-b14f-bb578aa80cbc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.025211 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a30dc01b-8ebb-4a04-b14f-bb578aa80cbc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.025911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a654d72-2730-4b67-8f3c-94cd11e37d17 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.026031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a30dc01b-8ebb-4a04-b14f-bb578aa80cbc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.026412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a654d72-2730-4b67-8f3c-94cd11e37d17 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.026718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a30dc01b-8ebb-4a04-b14f-bb578aa80cbc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.030845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a30dc01b-8ebb-4a04-b14f-bb578aa80cbc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.276257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a30dc01b-8ebb-4a04-b14f-bb578aa80cbc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:07.285393 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a30dc01b-8ebb-4a04-b14f-bb578aa80cbc tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.292136 Aug 18 11:40:07.298456 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1595/3347] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:06 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:07.298456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a5c948b4-aa00-40fe-885a-399c6e673193 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:07.303625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a5c948b4-aa00-40fe-885a-399c6e673193 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:07.312700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5c948b4-aa00-40fe-885a-399c6e673193 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.313510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5c948b4-aa00-40fe-885a-399c6e673193 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.314315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5c948b4-aa00-40fe-885a-399c6e673193 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.315165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5c948b4-aa00-40fe-885a-399c6e673193 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.315725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5c948b4-aa00-40fe-885a-399c6e673193 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.316255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5c948b4-aa00-40fe-885a-399c6e673193 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.332347 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-a5c948b4-aa00-40fe-885a-399c6e673193 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] HTTP exception thrown: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a5c948b4-aa00-40fe-885a-399c6e673193 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Request method failure captured: Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 HTTP/1.1 Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iT4rr_HmIPg6oJSCHEIA9-iAs_KvtdnGmcqAHFZ7uooIOR68YDIg_yNBOKiM2meZLWku7pHg9mvRGVVP1niwoQt0k1G4OPDApYN6o-GxuT--4Z1sXkk8Vfm3stvcLykjKxB2CwvM03K7oPolHw8AswRhMc8UAhMCAVKz0mLfxvxwsU Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6de0753e6c9e4ddab2fd34f0c71c1678 Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6de0753e6c9e4ddab2fd34f0c71c1678 Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerGroupTestJSON-1166968715-project Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4db3fcd22a44469ca290875379b747f9 Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerGroupTestJSON-1166968715-project Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '4b981016-2c6d-4f5e-b95d-d5579667d3f4'} Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:07.334625 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:07.341461 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:07.341461 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:07.341461 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:07.341461 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:07.341461 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:07.341461 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:07.341461 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:07.341461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a5c948b4-aa00-40fe-885a-399c6e673193 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Returning 404 to user: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:07.342320 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a5c948b4-aa00-40fe-885a-399c6e673193 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 404 len: 111 microversion: 2.1 time: 0.049836 Aug 18 11:40:07.343400 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1596/3348] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:07 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:40:07.353832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2db46918-2f39-4d42-b488-ec93c344299b tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Action: 'create', calling method: .version_select at 0x7f519fa94310>, body: {"security_group_rule": {"parent_group_id": "35111956-85d0-462f-8034-5fe96cbec88d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:07.411966 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-2db46918-2f39-4d42-b488-ec93c344299b tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] HTTP exception thrown: This rule already exists in group 35111956-85d0-462f-8034-5fe96cbec88d Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2db46918-2f39-4d42-b488-ec93c344299b tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Request method failure captured: Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 138 Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iUVQFQqhljlb1lPJe3rGQmlhLXUFcnH_ORjmTF9d7peKz6k7DenQk_TH2Dxswi6UQ4XJP58cLCqgC7GRJ00axZaMNhdHm2deG53nR3W5EFKxpAb-HIyjKhzvpLUI7Vi13o-CKS2KpxkG0Ox7Z1luXQK0xowGJ924ANI8HeJEOZU1VE Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b425229949714dd1bbae5ff12397c4b3 Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: {"security_group_rule": {"parent_group_id": "35111956-85d0-462f-8034-5fe96cbec88d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: exception: This rule already exists in group 35111956-85d0-462f-8034-5fe96cbec88d Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'security_group_rule': {'parent_group_id': '35111956-85d0-462f-8034-5fe96cbec88d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 35111956-85d0-462f-8034-5fe96cbec88d Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 35111956-85d0-462f-8034-5fe96cbec88d Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:07.413660 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:07.419461 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:07.419461 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:07.419461 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 35111956-85d0-462f-8034-5fe96cbec88d Aug 18 11:40:07.419461 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:07.419461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2db46918-2f39-4d42-b488-ec93c344299b tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Returning 400 to user: This rule already exists in group 35111956-85d0-462f-8034-5fe96cbec88d {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:07.419461 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2db46918-2f39-4d42-b488-ec93c344299b tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.065929 Aug 18 11:40:07.420383 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1597/3349] 10.222.0.73 () {60 vars in 1195 bytes} [Thu Aug 18 11:40:07 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:40:07.421620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8a654d72-2730-4b67-8f3c-94cd11e37d17 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:07.424629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cfa1a905-06b7-4ddd-a654-c0934ed506f4 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:07.425655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cfa1a905-06b7-4ddd-a654-c0934ed506f4 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:07.432586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8a654d72-2730-4b67-8f3c-94cd11e37d17 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:07.433627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cfa1a905-06b7-4ddd-a654-c0934ed506f4 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.434383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cfa1a905-06b7-4ddd-a654-c0934ed506f4 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.434854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cfa1a905-06b7-4ddd-a654-c0934ed506f4 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.435769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cfa1a905-06b7-4ddd-a654-c0934ed506f4 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.436425 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cfa1a905-06b7-4ddd-a654-c0934ed506f4 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.436592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8a654d72-2730-4b67-8f3c-94cd11e37d17 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:07.436843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cfa1a905-06b7-4ddd-a654-c0934ed506f4 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.437637 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8a654d72-2730-4b67-8f3c-94cd11e37d17 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.443281 Aug 18 11:40:07.438593 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1753/3350] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:06 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:07.445565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b6568e6d-e320-4757-bf32-ea2d4fd1e996 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:07.446506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b6568e6d-e320-4757-bf32-ea2d4fd1e996 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:07.452783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6568e6d-e320-4757-bf32-ea2d4fd1e996 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.453555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6568e6d-e320-4757-bf32-ea2d4fd1e996 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.454001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6568e6d-e320-4757-bf32-ea2d4fd1e996 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.454752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6568e6d-e320-4757-bf32-ea2d4fd1e996 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.455218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6568e6d-e320-4757-bf32-ea2d4fd1e996 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.455646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6568e6d-e320-4757-bf32-ea2d4fd1e996 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.485392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cfa1a905-06b7-4ddd-a654-c0934ed506f4 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0b1fc7f260154f4e90bdd7aad924eef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6cdef501fd64db9ad001e62a302ccca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:07.486099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cfa1a905-06b7-4ddd-a654-c0934ed506f4 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] flavor_id is None. Assuming migration. {{(pid=122209) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 18 11:40:07.486764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cfa1a905-06b7-4ddd-a654-c0934ed506f4 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122209) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 11:40:07.618868 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cfa1a905-06b7-4ddd-a654-c0934ed506f4 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc/action" status: 202 len: 0 microversion: 2.1 time: 0.197781 Aug 18 11:40:07.619791 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1598/3351] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:40:07 2022] POST /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:40:07.625154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f8923d36-b5c0-4dbc-a332-f04c0c44d2fc tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:07.649571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.compute.server_groups [None req-f8923d36-b5c0-4dbc-a332-f04c0c44d2fc tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Querying cell 68989ef7-340f-4449-87c1-932f111c2bdb(cell1) for 1 instances {{(pid=122209) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 18 11:40:07.650312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8923d36-b5c0-4dbc-a332-f04c0c44d2fc tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.651205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8923d36-b5c0-4dbc-a332-f04c0c44d2fc tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.651971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8923d36-b5c0-4dbc-a332-f04c0c44d2fc tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.669221 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f8923d36-b5c0-4dbc-a332-f04c0c44d2fc tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.047712 Aug 18 11:40:07.670235 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1599/3352] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:40:07 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:07.676541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64385e57-daa6-4227-b017-8bb154a44902 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Calling method '.version_select at 0x7f519ffbbee0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:07.696887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b6568e6d-e320-4757-bf32-ea2d4fd1e996 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:07.719229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b6568e6d-e320-4757-bf32-ea2d4fd1e996 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:07.721434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b6568e6d-e320-4757-bf32-ea2d4fd1e996 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:07.723014 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b6568e6d-e320-4757-bf32-ea2d4fd1e996 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 2835 microversion: 2.42 time: 0.283264 Aug 18 11:40:07.724153 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1754/3353] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:07 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 2835 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:07.732545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6d588c4-cee8-42de-97c1-2772526efeb9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:07.733475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c6d588c4-cee8-42de-97c1-2772526efeb9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:07.741579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6d588c4-cee8-42de-97c1-2772526efeb9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.742749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6d588c4-cee8-42de-97c1-2772526efeb9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.743485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6d588c4-cee8-42de-97c1-2772526efeb9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.744374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6d588c4-cee8-42de-97c1-2772526efeb9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.744830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6d588c4-cee8-42de-97c1-2772526efeb9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.745552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6d588c4-cee8-42de-97c1-2772526efeb9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.933945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c6d588c4-cee8-42de-97c1-2772526efeb9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:07.944316 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c6d588c4-cee8-42de-97c1-2772526efeb9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1471 microversion: 2.1 time: 0.218848 Aug 18 11:40:07.945416 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1755/3354] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:07 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:07.963469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7072a51-5ded-4a21-8fac-f8410e267d72 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:07.964334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e7072a51-5ded-4a21-8fac-f8410e267d72 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 7270699d-e0c4-4276-b522-8aee7925f99b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:07.969788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:07.975268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7072a51-5ded-4a21-8fac-f8410e267d72 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.976227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7072a51-5ded-4a21-8fac-f8410e267d72 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.976899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7072a51-5ded-4a21-8fac-f8410e267d72 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.978473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7072a51-5ded-4a21-8fac-f8410e267d72 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:07.979296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7072a51-5ded-4a21-8fac-f8410e267d72 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:07.980481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7072a51-5ded-4a21-8fac-f8410e267d72 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:07.987240 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-64385e57-daa6-4227-b017-8bb154a44902 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-group-rules/24739afe-7de3-4d91-ba2a-ed430f10117b" status: 202 len: 0 microversion: 2.1 time: 0.315761 Aug 18 11:40:07.988196 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1600/3355] 10.222.0.73 () {58 vars in 1287 bytes} [Thu Aug 18 11:40:07 2022] DELETE /compute/v2.1/os-security-group-rules/24739afe-7de3-4d91-ba2a-ed430f10117b => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:40:07.994543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-66f3df51-7ef0-4457-ae1e-da2fd50a1715 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:08.021694 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-e7072a51-5ded-4a21-8fac-f8410e267d72 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] HTTP exception thrown: Instance 7270699d-e0c4-4276-b522-8aee7925f99b could not be found. Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7072a51-5ded-4a21-8fac-f8410e267d72 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Request method failure captured: Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b HTTP/1.1 Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iLmk9InP0duM3a0KDx_rtZKV8FK6L1K2bxM2FY_EgJYqIM7l6-dvd1lSerO55Wyi5U4yj1fTG6Vc3OaZITag4LeT6S8IZr53KJqlR_jcP3WXpPplfH-I6YY1lxUr6Gwpsy1_3hY6Dk0Yq1AVixRwd4iEqTkfityyzTwlhBMvpVDaIo Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c1a985dc6f824e5b847a2d966c0f79af Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c1a985dc6f824e5b847a2d966c0f79af Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-998907994-project Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 0cd8451c50d941409a66864cbc1c7201 Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-998907994-project Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 7270699d-e0c4-4276-b522-8aee7925f99b could not be found. Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '7270699d-e0c4-4276-b522-8aee7925f99b'} Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7270699d-e0c4-4276-b522-8aee7925f99b could not be found. Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7270699d-e0c4-4276-b522-8aee7925f99b could not be found. Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:08.023698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:08.029509 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:08.029509 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:08.029509 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:08.029509 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:08.029509 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:08.029509 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7270699d-e0c4-4276-b522-8aee7925f99b could not be found. Aug 18 11:40:08.029509 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:08.029509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7072a51-5ded-4a21-8fac-f8410e267d72 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Returning 404 to user: Instance 7270699d-e0c4-4276-b522-8aee7925f99b could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:08.029509 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e7072a51-5ded-4a21-8fac-f8410e267d72 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b" status: 404 len: 111 microversion: 2.1 time: 0.078855 Aug 18 11:40:08.030844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.compute.server_groups [None req-66f3df51-7ef0-4457-ae1e-da2fd50a1715 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Querying cell 68989ef7-340f-4449-87c1-932f111c2bdb(cell1) for 1 instances {{(pid=122209) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 18 11:40:08.031008 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1756/3356] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:07 2022] GET /compute/v2.1/servers/7270699d-e0c4-4276-b522-8aee7925f99b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:40:08.031167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66f3df51-7ef0-4457-ae1e-da2fd50a1715 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.031167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66f3df51-7ef0-4457-ae1e-da2fd50a1715 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.031470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66f3df51-7ef0-4457-ae1e-da2fd50a1715 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:08.035362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-124ca9ed-a113-43ec-8c2a-1d57413922d2 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:08.035872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-124ca9ed-a113-43ec-8c2a-1d57413922d2 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:08.042146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124ca9ed-a113-43ec-8c2a-1d57413922d2 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.043429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124ca9ed-a113-43ec-8c2a-1d57413922d2 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.044079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124ca9ed-a113-43ec-8c2a-1d57413922d2 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:08.045322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124ca9ed-a113-43ec-8c2a-1d57413922d2 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.045962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124ca9ed-a113-43ec-8c2a-1d57413922d2 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.046564 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-66f3df51-7ef0-4457-ae1e-da2fd50a1715 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/os-server-groups/7c6f08bd-611f-40ed-a134-9347b89426a0" status: 200 len: 184 microversion: 2.1 time: 0.057090 Aug 18 11:40:08.046738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124ca9ed-a113-43ec-8c2a-1d57413922d2 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:08.047477 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1601/3357] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:40:07 2022] GET /compute/v2.1/os-server-groups/7c6f08bd-611f-40ed-a134-9347b89426a0 => generated 184 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:08.052136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1717b6e6-982e-4197-892a-9ace177cde29 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:08.052948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1717b6e6-982e-4197-892a-9ace177cde29 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:08.073677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1717b6e6-982e-4197-892a-9ace177cde29 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.074076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1717b6e6-982e-4197-892a-9ace177cde29 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.077183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1717b6e6-982e-4197-892a-9ace177cde29 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:08.078218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1717b6e6-982e-4197-892a-9ace177cde29 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.078907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1717b6e6-982e-4197-892a-9ace177cde29 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.079496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1717b6e6-982e-4197-892a-9ace177cde29 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:08.233930 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-124ca9ed-a113-43ec-8c2a-1d57413922d2 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.203001 Aug 18 11:40:08.234727 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1757/3358] 10.222.0.73 () {60 vars in 1316 bytes} [Thu Aug 18 11:40:08 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce/os-interface => generated 1830 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:08.239661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-870bfc0e-33a3-4899-a2e0-f660b25d00b2 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Action: 'create', calling method: .version_select at 0x7f519ef2b040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1557528475", "description": "tempest-description-2098788204"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:08.267041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1717b6e6-982e-4197-892a-9ace177cde29 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:08.277301 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1717b6e6-982e-4197-892a-9ace177cde29 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1736 microversion: 2.1 time: 0.228678 Aug 18 11:40:08.278130 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1602/3359] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:08 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:08.283262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f9214223-4d61-4085-aa23-ab0a2dd8d644 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:08.283751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f9214223-4d61-4085-aa23-ab0a2dd8d644 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:08.289808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9214223-4d61-4085-aa23-ab0a2dd8d644 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.290475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9214223-4d61-4085-aa23-ab0a2dd8d644 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.291017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9214223-4d61-4085-aa23-ab0a2dd8d644 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:08.291727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9214223-4d61-4085-aa23-ab0a2dd8d644 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.292298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9214223-4d61-4085-aa23-ab0a2dd8d644 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.292725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9214223-4d61-4085-aa23-ab0a2dd8d644 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:08.331437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f9214223-4d61-4085-aa23-ab0a2dd8d644 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:40:08.465634 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f9214223-4d61-4085-aa23-ab0a2dd8d644 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 204 len: 0 microversion: 2.1 time: 0.185828 Aug 18 11:40:08.471083 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1603/3360] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:40:08 2022] DELETE /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:40:08.481595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6a389606-114c-4c9e-b2be-b4a85f3e2231 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:08.482589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6a389606-114c-4c9e-b2be-b4a85f3e2231 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:08.493564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6a389606-114c-4c9e-b2be-b4a85f3e2231 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.494504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6a389606-114c-4c9e-b2be-b4a85f3e2231 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.496973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6a389606-114c-4c9e-b2be-b4a85f3e2231 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:08.498212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6a389606-114c-4c9e-b2be-b4a85f3e2231 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.498910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6a389606-114c-4c9e-b2be-b4a85f3e2231 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.499513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6a389606-114c-4c9e-b2be-b4a85f3e2231 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:08.529059 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-6a389606-114c-4c9e-b2be-b4a85f3e2231 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] HTTP exception thrown: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6a389606-114c-4c9e-b2be-b4a85f3e2231 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Request method failure captured: Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 HTTP/1.1 Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iT4rr_HmIPg6oJSCHEIA9-iAs_KvtdnGmcqAHFZ7uooIOR68YDIg_yNBOKiM2meZLWku7pHg9mvRGVVP1niwoQt0k1G4OPDApYN6o-GxuT--4Z1sXkk8Vfm3stvcLykjKxB2CwvM03K7oPolHw8AswRhMc8UAhMCAVKz0mLfxvxwsU Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6de0753e6c9e4ddab2fd34f0c71c1678 Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6de0753e6c9e4ddab2fd34f0c71c1678 Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerGroupTestJSON-1166968715-project Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4db3fcd22a44469ca290875379b747f9 Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerGroupTestJSON-1166968715-project Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '4b981016-2c6d-4f5e-b95d-d5579667d3f4'} Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:40:08.532964 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:40:08.537910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:08.537910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:08.537910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:08.537910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:08.537910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:08.537910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:08.537910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:08.537910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:08.537910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:08.537910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:08.537910 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:08.537910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6a389606-114c-4c9e-b2be-b4a85f3e2231 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Returning 404 to user: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:08.537910 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6a389606-114c-4c9e-b2be-b4a85f3e2231 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 404 len: 111 microversion: 2.1 time: 0.062521 Aug 18 11:40:08.540585 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1604/3361] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:40:08 2022] DELETE /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:40:08.548032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9505a9a1-e2e4-4aad-8488-e9e929219e0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:08.548742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9505a9a1-e2e4-4aad-8488-e9e929219e0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:08.558639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9505a9a1-e2e4-4aad-8488-e9e929219e0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.559617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9505a9a1-e2e4-4aad-8488-e9e929219e0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.560065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9505a9a1-e2e4-4aad-8488-e9e929219e0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:08.561322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9505a9a1-e2e4-4aad-8488-e9e929219e0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.565360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9505a9a1-e2e4-4aad-8488-e9e929219e0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.565831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9505a9a1-e2e4-4aad-8488-e9e929219e0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:08.812974 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-870bfc0e-33a3-4899-a2e0-f660b25d00b2 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.577183 Aug 18 11:40:08.821783 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1758/3362] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:40:08 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:08.827677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dbd9ab19-4115-4d78-9c2f-485ea161c3de tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:08.828711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dbd9ab19-4115-4d78-9c2f-485ea161c3de tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:08.849537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd9ab19-4115-4d78-9c2f-485ea161c3de tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.851004 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9505a9a1-e2e4-4aad-8488-e9e929219e0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:08.853147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd9ab19-4115-4d78-9c2f-485ea161c3de tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.853835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd9ab19-4115-4d78-9c2f-485ea161c3de tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:08.856220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd9ab19-4115-4d78-9c2f-485ea161c3de tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.856953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd9ab19-4115-4d78-9c2f-485ea161c3de tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.863893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbd9ab19-4115-4d78-9c2f-485ea161c3de tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:08.875166 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9505a9a1-e2e4-4aad-8488-e9e929219e0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.333500 Aug 18 11:40:08.877184 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1605/3363] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:08 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:08.889332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aab5e864-4d41-422f-bef9-fb1ebc9cf041 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:08.890246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-aab5e864-4d41-422f-bef9-fb1ebc9cf041 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:08.918111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aab5e864-4d41-422f-bef9-fb1ebc9cf041 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.918674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aab5e864-4d41-422f-bef9-fb1ebc9cf041 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.919182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aab5e864-4d41-422f-bef9-fb1ebc9cf041 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:08.923059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aab5e864-4d41-422f-bef9-fb1ebc9cf041 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:08.924359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aab5e864-4d41-422f-bef9-fb1ebc9cf041 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:08.925181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aab5e864-4d41-422f-bef9-fb1ebc9cf041 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:09.138034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aab5e864-4d41-422f-bef9-fb1ebc9cf041 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:09.155560 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aab5e864-4d41-422f-bef9-fb1ebc9cf041 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1507 microversion: 2.1 time: 0.273784 Aug 18 11:40:09.166585 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1606/3364] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:08 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1507 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:09.170831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f8b4e1bb-6675-424c-9414-312601582b5e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:09.173545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f8b4e1bb-6675-424c-9414-312601582b5e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] [instance: 4b981016-2c6d-4f5e-b95d-d5579667d3f4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:09.194723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8b4e1bb-6675-424c-9414-312601582b5e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:09.195347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8b4e1bb-6675-424c-9414-312601582b5e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:09.195862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8b4e1bb-6675-424c-9414-312601582b5e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:09.201583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8b4e1bb-6675-424c-9414-312601582b5e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:09.202154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8b4e1bb-6675-424c-9414-312601582b5e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:09.202704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8b4e1bb-6675-424c-9414-312601582b5e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:09.236839 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-f8b4e1bb-6675-424c-9414-312601582b5e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] HTTP exception thrown: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f8b4e1bb-6675-424c-9414-312601582b5e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Request method failure captured: Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 HTTP/1.1 Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iT4rr_HmIPg6oJSCHEIA9-iAs_KvtdnGmcqAHFZ7uooIOR68YDIg_yNBOKiM2meZLWku7pHg9mvRGVVP1niwoQt0k1G4OPDApYN6o-GxuT--4Z1sXkk8Vfm3stvcLykjKxB2CwvM03K7oPolHw8AswRhMc8UAhMCAVKz0mLfxvxwsU Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6de0753e6c9e4ddab2fd34f0c71c1678 Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6de0753e6c9e4ddab2fd34f0c71c1678 Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerGroupTestJSON-1166968715-project Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4db3fcd22a44469ca290875379b747f9 Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerGroupTestJSON-1166968715-project Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '4b981016-2c6d-4f5e-b95d-d5579667d3f4'} Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:09.239958 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.244621 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.244621 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:09.244621 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:09.244621 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:09.244621 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:09.244621 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. Aug 18 11:40:09.244621 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.244621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f8b4e1bb-6675-424c-9414-312601582b5e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Returning 404 to user: Instance 4b981016-2c6d-4f5e-b95d-d5579667d3f4 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:09.244621 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f8b4e1bb-6675-424c-9414-312601582b5e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4" status: 404 len: 111 microversion: 2.1 time: 0.080774 Aug 18 11:40:09.248178 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1607/3365] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:09 2022] GET /compute/v2.1/servers/4b981016-2c6d-4f5e-b95d-d5579667d3f4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:40:09.260434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3b10ce7-929f-480f-a239-3b2db1f7d530 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Action: 'create', calling method: .version_select at 0x7f519f8924c0>, body: {"security_group_rule": {"parent_group_id": "5f01986d-5bb0-4453-b67f-9368d7c840b0", "ip_protocol": "tcp", "from_port": 273316309, "to_port": 22}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:09.407150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dbd9ab19-4115-4d78-9c2f-485ea161c3de tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:09.428638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dbd9ab19-4115-4d78-9c2f-485ea161c3de tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:09.431064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dbd9ab19-4115-4d78-9c2f-485ea161c3de tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:09.432953 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dbd9ab19-4115-4d78-9c2f-485ea161c3de tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.609206 Aug 18 11:40:09.450883 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1759/3366] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:08 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:09.457300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8c4bf720-83d7-49dc-9608-56cbbe65bc24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:09.458130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8c4bf720-83d7-49dc-9608-56cbbe65bc24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:09.465311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c4bf720-83d7-49dc-9608-56cbbe65bc24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:09.466096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c4bf720-83d7-49dc-9608-56cbbe65bc24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:09.466783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c4bf720-83d7-49dc-9608-56cbbe65bc24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:09.467833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c4bf720-83d7-49dc-9608-56cbbe65bc24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:09.468599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c4bf720-83d7-49dc-9608-56cbbe65bc24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:09.469207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c4bf720-83d7-49dc-9608-56cbbe65bc24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:09.685451 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-d3b10ce7-929f-480f-a239-3b2db1f7d530 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] HTTP exception thrown: Invalid port range 273316309:22. Former value cannot be greater than the later Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3b10ce7-929f-480f-a239-3b2db1f7d530 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Request method failure captured: Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 145 Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iUVQFQqhljlb1lPJe3rGQmlhLXUFcnH_ORjmTF9d7peKz6k7DenQk_TH2Dxswi6UQ4XJP58cLCqgC7GRJ00axZaMNhdHm2deG53nR3W5EFKxpAb-HIyjKhzvpLUI7Vi13o-CKS2KpxkG0Ox7Z1luXQK0xowGJ924ANI8HeJEOZU1VE Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b425229949714dd1bbae5ff12397c4b3 Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: {"security_group_rule": {"parent_group_id": "5f01986d-5bb0-4453-b67f-9368d7c840b0", "ip_protocol": "tcp", "from_port": 273316309, "to_port": 22}} Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid port range 273316309:22. Former value cannot be greater than the later Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5f01986d-5bb0-4453-b67f-9368d7c840b0', 'ip_protocol': 'tcp', 'from_port': 273316309, 'to_port': 22}}} Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 273316309:22. Former value cannot be greater than the later Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 273316309:22. Former value cannot be greater than the later Aug 18 11:40:09.687184 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.691084 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:09.691084 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.691084 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.691084 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:09.691084 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:09.691084 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:09.691084 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:09.691084 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 273316309:22. Former value cannot be greater than the later Aug 18 11:40:09.691084 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.691084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3b10ce7-929f-480f-a239-3b2db1f7d530 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Returning 400 to user: Invalid port range 273316309:22. Former value cannot be greater than the later {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:09.691084 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d3b10ce7-929f-480f-a239-3b2db1f7d530 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.439296 Aug 18 11:40:09.693581 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1608/3367] 10.222.0.73 () {60 vars in 1195 bytes} [Thu Aug 18 11:40:09 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 445 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:40:09.699357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fe736f84-417a-4633-b527-589c32a6629c tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:09.718305 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-fe736f84-417a-4633-b527-589c32a6629c tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] HTTP exception thrown: Instance group 58ea3811-3d9e-479c-b7d9-49ce6045b514 could not be found. Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fe736f84-417a-4633-b527-589c32a6629c tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Request method failure captured: Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-server-groups/58ea3811-3d9e-479c-b7d9-49ce6045b514 HTTP/1.1 Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iT4rr_HmIPg6oJSCHEIA9-iAs_KvtdnGmcqAHFZ7uooIOR68YDIg_yNBOKiM2meZLWku7pHg9mvRGVVP1niwoQt0k1G4OPDApYN6o-GxuT--4Z1sXkk8Vfm3stvcLykjKxB2CwvM03K7oPolHw8AswRhMc8UAhMCAVKz0mLfxvxwsU Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6de0753e6c9e4ddab2fd34f0c71c1678 Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6de0753e6c9e4ddab2fd34f0c71c1678 Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerGroupTestJSON-1166968715-project Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4db3fcd22a44469ca290875379b747f9 Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerGroupTestJSON-1166968715-project Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance group 58ea3811-3d9e-479c-b7d9-49ce6045b514 could not be found. Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '58ea3811-3d9e-479c-b7d9-49ce6045b514'} Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 58ea3811-3d9e-479c-b7d9-49ce6045b514 could not be found. Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 58ea3811-3d9e-479c-b7d9-49ce6045b514 could not be found. Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.724173 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.728991 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:09.728991 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:09.728991 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:09.728991 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:09.728991 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 58ea3811-3d9e-479c-b7d9-49ce6045b514 could not be found. Aug 18 11:40:09.728991 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.728991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fe736f84-417a-4633-b527-589c32a6629c tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Returning 404 to user: Instance group 58ea3811-3d9e-479c-b7d9-49ce6045b514 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:09.728991 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fe736f84-417a-4633-b527-589c32a6629c tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "DELETE /compute/v2.1/os-server-groups/58ea3811-3d9e-479c-b7d9-49ce6045b514" status: 404 len: 117 microversion: 2.1 time: 0.030653 Aug 18 11:40:09.730538 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1609/3368] 10.222.0.73 () {58 vars in 1266 bytes} [Thu Aug 18 11:40:09 2022] DELETE /compute/v2.1/os-server-groups/58ea3811-3d9e-479c-b7d9-49ce6045b514 => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:40:09.735435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7ccb00ed-b4a4-442d-8dd7-cfa393a8a60e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:09.736337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7ccb00ed-b4a4-442d-8dd7-cfa393a8a60e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:09.743426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ccb00ed-b4a4-442d-8dd7-cfa393a8a60e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:09.743947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ccb00ed-b4a4-442d-8dd7-cfa393a8a60e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:09.744484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ccb00ed-b4a4-442d-8dd7-cfa393a8a60e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:09.745910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ccb00ed-b4a4-442d-8dd7-cfa393a8a60e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:09.746496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ccb00ed-b4a4-442d-8dd7-cfa393a8a60e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:09.746944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ccb00ed-b4a4-442d-8dd7-cfa393a8a60e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:09.757541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8c4bf720-83d7-49dc-9608-56cbbe65bc24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:09.770901 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8c4bf720-83d7-49dc-9608-56cbbe65bc24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1471 microversion: 2.1 time: 0.317886 Aug 18 11:40:09.771939 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1760/3369] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:09 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1471 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:09.778646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4ede4513-9453-4417-8277-bd2158051f99 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Action: 'create', calling method: .version_select at 0x7f519faf10d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1458613885", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:09.782811 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-4ede4513-9453-4417-8277-bd2158051f99 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] HTTP exception thrown: Security group id should be uuid Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4ede4513-9453-4417-8277-bd2158051f99 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Request method failure captured: Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 131 Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iUVQFQqhljlb1lPJe3rGQmlhLXUFcnH_ORjmTF9d7peKz6k7DenQk_TH2Dxswi6UQ4XJP58cLCqgC7GRJ00axZaMNhdHm2deG53nR3W5EFKxpAb-HIyjKhzvpLUI7Vi13o-CKS2KpxkG0Ox7Z1luXQK0xowGJ924ANI8HeJEOZU1VE Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: b425229949714dd1bbae5ff12397c4b3 Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1458613885", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: exception: Security group id should be uuid Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1458613885', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:09.786253 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:09.796231 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 18 11:40:09.796231 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.796231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4ede4513-9453-4417-8277-bd2158051f99 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Returning 400 to user: Security group id should be uuid {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:09.796231 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4ede4513-9453-4417-8277-bd2158051f99 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.015242 Aug 18 11:40:09.796231 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1761/3370] 10.222.0.73 () {60 vars in 1195 bytes} [Thu Aug 18 11:40:09 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:40:09.796231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bf656aeb-c5cd-417d-bc64-0946ff56c27f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:09.806101 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-bf656aeb-c5cd-417d-bc64-0946ff56c27f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] HTTP exception thrown: Instance group e8ca166b-7cc4-4717-9688-e9134081f269 could not be found. Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bf656aeb-c5cd-417d-bc64-0946ff56c27f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Request method failure captured: Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/os-server-groups/e8ca166b-7cc4-4717-9688-e9134081f269 HTTP/1.1 Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iT4rr_HmIPg6oJSCHEIA9-iAs_KvtdnGmcqAHFZ7uooIOR68YDIg_yNBOKiM2meZLWku7pHg9mvRGVVP1niwoQt0k1G4OPDApYN6o-GxuT--4Z1sXkk8Vfm3stvcLykjKxB2CwvM03K7oPolHw8AswRhMc8UAhMCAVKz0mLfxvxwsU Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6de0753e6c9e4ddab2fd34f0c71c1678 Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6de0753e6c9e4ddab2fd34f0c71c1678 Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerGroupTestJSON-1166968715-project Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 4db3fcd22a44469ca290875379b747f9 Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerGroupTestJSON-1166968715-project Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance group e8ca166b-7cc4-4717-9688-e9134081f269 could not be found. Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'e8ca166b-7cc4-4717-9688-e9134081f269'} Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e8ca166b-7cc4-4717-9688-e9134081f269 could not be found. Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e8ca166b-7cc4-4717-9688-e9134081f269 could not be found. Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.811468 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:09.818856 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:09.818856 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:09.818856 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:09.818856 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:09.818856 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e8ca166b-7cc4-4717-9688-e9134081f269 could not be found. Aug 18 11:40:09.818856 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:09.818856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bf656aeb-c5cd-417d-bc64-0946ff56c27f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Returning 404 to user: Instance group e8ca166b-7cc4-4717-9688-e9134081f269 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:09.818856 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bf656aeb-c5cd-417d-bc64-0946ff56c27f tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "DELETE /compute/v2.1/os-server-groups/e8ca166b-7cc4-4717-9688-e9134081f269" status: 404 len: 117 microversion: 2.1 time: 0.022508 Aug 18 11:40:09.818856 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1762/3371] 10.222.0.73 () {58 vars in 1266 bytes} [Thu Aug 18 11:40:09 2022] DELETE /compute/v2.1/os-server-groups/e8ca166b-7cc4-4717-9688-e9134081f269 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:40:09.825579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6c18a712-508e-41db-b2e1-df6a86e84dba tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Action: 'create', calling method: .version_select at 0x7f519faf1e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-663543349", "description": "tempest-description-393990535"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:10.075696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7ccb00ed-b4a4-442d-8dd7-cfa393a8a60e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:10.086833 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7ccb00ed-b4a4-442d-8dd7-cfa393a8a60e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1736 microversion: 2.1 time: 0.355012 Aug 18 11:40:10.101348 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1610/3372] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:09 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1736 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:10.104019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa673b55-a946-4047-8271-49147422d1d1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:10.117673 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-fa673b55-a946-4047-8271-49147422d1d1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] HTTP exception thrown: Instance group 1c333b43-d36a-4a32-9b14-d02ee2d467fa could not be found. Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa673b55-a946-4047-8271-49147422d1d1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Request method failure captured: Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-server-groups/1c333b43-d36a-4a32-9b14-d02ee2d467fa HTTP/1.1 Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iT4rr_HmIPg6oJSCHEIA9-iAs_KvtdnGmcqAHFZ7uooIOR68YDIg_yNBOKiM2meZLWku7pHg9mvRGVVP1niwoQt0k1G4OPDApYN6o-GxuT--4Z1sXkk8Vfm3stvcLykjKxB2CwvM03K7oPolHw8AswRhMc8UAhMCAVKz0mLfxvxwsU Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6de0753e6c9e4ddab2fd34f0c71c1678 Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6de0753e6c9e4ddab2fd34f0c71c1678 Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerGroupTestJSON-1166968715-project Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4db3fcd22a44469ca290875379b747f9 Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerGroupTestJSON-1166968715-project Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance group 1c333b43-d36a-4a32-9b14-d02ee2d467fa could not be found. Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '1c333b43-d36a-4a32-9b14-d02ee2d467fa'} Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1c333b43-d36a-4a32-9b14-d02ee2d467fa could not be found. Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1c333b43-d36a-4a32-9b14-d02ee2d467fa could not be found. Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.120402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:10.124514 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:10.124514 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:10.124514 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:10.124514 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:10.124514 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1c333b43-d36a-4a32-9b14-d02ee2d467fa could not be found. Aug 18 11:40:10.124514 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.126071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa673b55-a946-4047-8271-49147422d1d1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Returning 404 to user: Instance group 1c333b43-d36a-4a32-9b14-d02ee2d467fa could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:10.127658 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fa673b55-a946-4047-8271-49147422d1d1 tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "DELETE /compute/v2.1/os-server-groups/1c333b43-d36a-4a32-9b14-d02ee2d467fa" status: 404 len: 117 microversion: 2.1 time: 0.030565 Aug 18 11:40:10.128729 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1611/3373] 10.222.0.73 () {58 vars in 1266 bytes} [Thu Aug 18 11:40:10 2022] DELETE /compute/v2.1/os-server-groups/1c333b43-d36a-4a32-9b14-d02ee2d467fa => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:40:10.134743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8b18138c-995a-4ed2-86f9-f9efbb733374 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:10.136403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8b18138c-995a-4ed2-86f9-f9efbb733374 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:10.144405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b18138c-995a-4ed2-86f9-f9efbb733374 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:10.145070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b18138c-995a-4ed2-86f9-f9efbb733374 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:10.145562 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b18138c-995a-4ed2-86f9-f9efbb733374 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:10.146681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b18138c-995a-4ed2-86f9-f9efbb733374 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:10.147101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b18138c-995a-4ed2-86f9-f9efbb733374 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:10.147758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b18138c-995a-4ed2-86f9-f9efbb733374 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:10.172174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:10.367422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8b18138c-995a-4ed2-86f9-f9efbb733374 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:10.377773 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8b18138c-995a-4ed2-86f9-f9efbb733374 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.247355 Aug 18 11:40:10.379262 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1612/3374] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:10 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:10.394631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-12c1e766-fac5-48e7-986c-c2297173bd3e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:10.401845 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-12c1e766-fac5-48e7-986c-c2297173bd3e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] HTTP exception thrown: Instance group 949a3630-396e-4a34-8695-6fd9f8fe3516 could not be found. Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-12c1e766-fac5-48e7-986c-c2297173bd3e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Request method failure captured: Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-server-groups/949a3630-396e-4a34-8695-6fd9f8fe3516 HTTP/1.1 Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iT4rr_HmIPg6oJSCHEIA9-iAs_KvtdnGmcqAHFZ7uooIOR68YDIg_yNBOKiM2meZLWku7pHg9mvRGVVP1niwoQt0k1G4OPDApYN6o-GxuT--4Z1sXkk8Vfm3stvcLykjKxB2CwvM03K7oPolHw8AswRhMc8UAhMCAVKz0mLfxvxwsU Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6de0753e6c9e4ddab2fd34f0c71c1678 Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6de0753e6c9e4ddab2fd34f0c71c1678"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6de0753e6c9e4ddab2fd34f0c71c1678 Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerGroupTestJSON-1166968715 Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerGroupTestJSON-1166968715-project Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4db3fcd22a44469ca290875379b747f9 Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerGroupTestJSON-1166968715-project Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance group 949a3630-396e-4a34-8695-6fd9f8fe3516 could not be found. Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '949a3630-396e-4a34-8695-6fd9f8fe3516'} Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 949a3630-396e-4a34-8695-6fd9f8fe3516 could not be found. Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 949a3630-396e-4a34-8695-6fd9f8fe3516 could not be found. Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.403887 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:10.407896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:10.407896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:10.407896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:10.407896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:10.407896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 949a3630-396e-4a34-8695-6fd9f8fe3516 could not be found. Aug 18 11:40:10.407896 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.410135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-12c1e766-fac5-48e7-986c-c2297173bd3e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Returning 404 to user: Instance group 949a3630-396e-4a34-8695-6fd9f8fe3516 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:10.411295 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-12c1e766-fac5-48e7-986c-c2297173bd3e tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "DELETE /compute/v2.1/os-server-groups/949a3630-396e-4a34-8695-6fd9f8fe3516" status: 404 len: 117 microversion: 2.1 time: 0.030853 Aug 18 11:40:10.412249 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1613/3375] 10.222.0.73 () {58 vars in 1266 bytes} [Thu Aug 18 11:40:10 2022] DELETE /compute/v2.1/os-server-groups/949a3630-396e-4a34-8695-6fd9f8fe3516 => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:40:10.417395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b0ff416f-a83b-42e3-a40c-7e5484777e34 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:10.418378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b0ff416f-a83b-42e3-a40c-7e5484777e34 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:10.426026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0ff416f-a83b-42e3-a40c-7e5484777e34 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:10.427020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0ff416f-a83b-42e3-a40c-7e5484777e34 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:10.427725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0ff416f-a83b-42e3-a40c-7e5484777e34 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:10.428701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0ff416f-a83b-42e3-a40c-7e5484777e34 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:10.429394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0ff416f-a83b-42e3-a40c-7e5484777e34 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:10.430051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0ff416f-a83b-42e3-a40c-7e5484777e34 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:10.551638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b0ff416f-a83b-42e3-a40c-7e5484777e34 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:10.563735 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b0ff416f-a83b-42e3-a40c-7e5484777e34 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 200 len: 1465 microversion: 2.1 time: 0.150128 Aug 18 11:40:10.565059 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1614/3376] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:10 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 1465 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:10.572667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2d4737c3-cae3-48b4-9e10-247d753cf6ff tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:10.631670 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2d4737c3-cae3-48b4-9e10-247d753cf6ff tempest-ServerGroupTestJSON-1166968715 tempest-ServerGroupTestJSON-1166968715-project] 10.222.0.73 "DELETE /compute/v2.1/os-server-groups/7c6f08bd-611f-40ed-a134-9347b89426a0" status: 204 len: 0 microversion: 2.1 time: 0.064373 Aug 18 11:40:10.632858 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1615/3377] 10.222.0.73 () {58 vars in 1266 bytes} [Thu Aug 18 11:40:10 2022] DELETE /compute/v2.1/os-server-groups/7c6f08bd-611f-40ed-a134-9347b89426a0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:40:10.639226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-55a85b1f-15d7-4bd2-b14d-3a4ddfee3735 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:10.640072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-55a85b1f-15d7-4bd2-b14d-3a4ddfee3735 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:10.650730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55a85b1f-15d7-4bd2-b14d-3a4ddfee3735 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:10.652675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55a85b1f-15d7-4bd2-b14d-3a4ddfee3735 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:10.653494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55a85b1f-15d7-4bd2-b14d-3a4ddfee3735 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:10.655007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55a85b1f-15d7-4bd2-b14d-3a4ddfee3735 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:10.655655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55a85b1f-15d7-4bd2-b14d-3a4ddfee3735 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:10.656497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55a85b1f-15d7-4bd2-b14d-3a4ddfee3735 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:10.747606 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6c18a712-508e-41db-b2e1-df6a86e84dba tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.928974 Aug 18 11:40:10.748244 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1763/3378] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:40:09 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:10.758990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-3f938c9c-cfde-4e34-9303-21000f1ca141 req-cc829680-c0c9-4149-aa2a-f5973f4b7c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda29354-2be3-4b36-aa1e-4a96b0954806", "name": "network-vif-deleted", "tag": "40179a13-a7d9-43a4-b12f-bec53ae16fd6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:10.780091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3f938c9c-cfde-4e34-9303-21000f1ca141 req-cc829680-c0c9-4149-aa2a-f5973f4b7c27 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:10.780916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3f938c9c-cfde-4e34-9303-21000f1ca141 req-cc829680-c0c9-4149-aa2a-f5973f4b7c27 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:10.788274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3f938c9c-cfde-4e34-9303-21000f1ca141 req-cc829680-c0c9-4149-aa2a-f5973f4b7c27 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:10.805783 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-3f938c9c-cfde-4e34-9303-21000f1ca141 req-cc829680-c0c9-4149-aa2a-f5973f4b7c27 service nova] Creating event network-vif-deleted:40179a13-a7d9-43a4-b12f-bec53ae16fd6 for instance fda29354-2be3-4b36-aa1e-4a96b0954806 on n-h2-853611-3 Aug 18 11:40:10.817637 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-3f938c9c-cfde-4e34-9303-21000f1ca141 req-cc829680-c0c9-4149-aa2a-f5973f4b7c27 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065318 Aug 18 11:40:10.819373 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1764/3379] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:10.825730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7134dd0-5cdd-47aa-af41-19c65e5b441b tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Action: 'create', calling method: .version_select at 0x7f519f598430>, body: {"security_group_rule": {"parent_group_id": "7924da74-2926-417f-8236-04a3591747fb", "ip_protocol": "tempest-999-396032938", "from_port": 22, "to_port": 22}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:10.954589 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-a7134dd0-5cdd-47aa-af41-19c65e5b441b tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] HTTP exception thrown: Invalid IP protocol tempest-999-396032938. Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7134dd0-5cdd-47aa-af41-19c65e5b441b tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Request method failure captured: Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 156 Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iUVQFQqhljlb1lPJe3rGQmlhLXUFcnH_ORjmTF9d7peKz6k7DenQk_TH2Dxswi6UQ4XJP58cLCqgC7GRJ00axZaMNhdHm2deG53nR3W5EFKxpAb-HIyjKhzvpLUI7Vi13o-CKS2KpxkG0Ox7Z1luXQK0xowGJ924ANI8HeJEOZU1VE Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: b425229949714dd1bbae5ff12397c4b3 Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: {"security_group_rule": {"parent_group_id": "7924da74-2926-417f-8236-04a3591747fb", "ip_protocol": "tempest-999-396032938", "from_port": 22, "to_port": 22}} Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid IP protocol tempest-999-396032938. Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7924da74-2926-417f-8236-04a3591747fb', 'ip_protocol': 'tempest-999-396032938', 'from_port': 22, 'to_port': 22}}} Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-396032938. Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-396032938. Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.956258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:10.961008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.961008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:10.961008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:10.961008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:10.961008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:10.961008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:10.961008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-396032938. Aug 18 11:40:10.961008 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:10.961008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7134dd0-5cdd-47aa-af41-19c65e5b441b tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Returning 400 to user: Invalid IP protocol tempest-999-396032938. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:10.961008 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a7134dd0-5cdd-47aa-af41-19c65e5b441b tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.136781 Aug 18 11:40:10.970142 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1765/3380] 10.222.0.73 () {60 vars in 1195 bytes} [Thu Aug 18 11:40:10 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:40:10.975514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ea86ac93-ac03-4553-82ba-2850c28ef1a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:10.976291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ea86ac93-ac03-4553-82ba-2850c28ef1a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:11.002578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea86ac93-ac03-4553-82ba-2850c28ef1a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:11.003090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea86ac93-ac03-4553-82ba-2850c28ef1a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:11.003534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea86ac93-ac03-4553-82ba-2850c28ef1a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:11.004256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea86ac93-ac03-4553-82ba-2850c28ef1a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:11.004718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea86ac93-ac03-4553-82ba-2850c28ef1a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:11.005151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea86ac93-ac03-4553-82ba-2850c28ef1a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:11.012799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-55a85b1f-15d7-4bd2-b14d-3a4ddfee3735 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:11.030510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:11.031446 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-55a85b1f-15d7-4bd2-b14d-3a4ddfee3735 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:11.037357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-55a85b1f-15d7-4bd2-b14d-3a4ddfee3735 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:11.044977 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-55a85b1f-15d7-4bd2-b14d-3a4ddfee3735 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.410578 Aug 18 11:40:11.052953 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1616/3381] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:10 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:11.062266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f4493914-2706-460a-ba25-9983c0ce6ea0 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Action: 'create', calling method: .version_select at 0x7f519fa620d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-474180878", "description": "tempest-description-138704728"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:11.273333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ea86ac93-ac03-4553-82ba-2850c28ef1a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:11.283761 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ea86ac93-ac03-4553-82ba-2850c28ef1a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1471 microversion: 2.1 time: 0.312304 Aug 18 11:40:11.284372 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1766/3382] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:10 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1471 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:11.306912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a283886-207d-4a27-9b32-8be2d7ad35a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:11.313003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6a283886-207d-4a27-9b32-8be2d7ad35a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:11.326702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a283886-207d-4a27-9b32-8be2d7ad35a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:11.330267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a283886-207d-4a27-9b32-8be2d7ad35a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:11.337372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a283886-207d-4a27-9b32-8be2d7ad35a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:11.339531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a283886-207d-4a27-9b32-8be2d7ad35a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:11.340399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a283886-207d-4a27-9b32-8be2d7ad35a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:11.341585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a283886-207d-4a27-9b32-8be2d7ad35a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:11.508647 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f4493914-2706-460a-ba25-9983c0ce6ea0 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.454296 Aug 18 11:40:11.520884 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1617/3383] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:40:11 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:11.520884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-b1d12ca0-77b0-46af-a000-cf858cac1004 req-859d87fe-d0cc-4d4d-a816-966612a8a720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "tag": "87e91856-1edc-454b-ad68-ad91d5cc3042"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:11.535094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b1d12ca0-77b0-46af-a000-cf858cac1004 req-859d87fe-d0cc-4d4d-a816-966612a8a720 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:11.535725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b1d12ca0-77b0-46af-a000-cf858cac1004 req-859d87fe-d0cc-4d4d-a816-966612a8a720 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:11.536279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b1d12ca0-77b0-46af-a000-cf858cac1004 req-859d87fe-d0cc-4d4d-a816-966612a8a720 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:11.551694 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-b1d12ca0-77b0-46af-a000-cf858cac1004 req-859d87fe-d0cc-4d4d-a816-966612a8a720 service nova] Creating event network-changed:87e91856-1edc-454b-ad68-ad91d5cc3042 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:40:11.558555 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-b1d12ca0-77b0-46af-a000-cf858cac1004 req-859d87fe-d0cc-4d4d-a816-966612a8a720 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047640 Aug 18 11:40:11.559970 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1618/3384] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:11.568474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-80a43bd5-3356-495e-b916-5bd3010ad87a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:11.569679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-80a43bd5-3356-495e-b916-5bd3010ad87a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:11.580239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80a43bd5-3356-495e-b916-5bd3010ad87a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:11.581141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80a43bd5-3356-495e-b916-5bd3010ad87a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:11.581834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80a43bd5-3356-495e-b916-5bd3010ad87a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:11.582836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80a43bd5-3356-495e-b916-5bd3010ad87a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:11.583528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80a43bd5-3356-495e-b916-5bd3010ad87a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:11.585170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80a43bd5-3356-495e-b916-5bd3010ad87a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:11.632041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6a283886-207d-4a27-9b32-8be2d7ad35a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:11.642355 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6a283886-207d-4a27-9b32-8be2d7ad35a1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1736 microversion: 2.1 time: 0.340242 Aug 18 11:40:11.642995 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1767/3385] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:11 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1736 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:11.648371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5396acb2-b0a2-4c12-88f0-b7b5fb0254f8 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Action: 'create', calling method: .version_select at 0x7f519efa1ca0>, body: {"security_group_rule": {"parent_group_id": "7835a302-c51f-42d0-99cd-9451c27ca2ef", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:11.720521 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-5396acb2-b0a2-4c12-88f0-b7b5fb0254f8 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5396acb2-b0a2-4c12-88f0-b7b5fb0254f8 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Request method failure captured: Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 138 Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iUVQFQqhljlb1lPJe3rGQmlhLXUFcnH_ORjmTF9d7peKz6k7DenQk_TH2Dxswi6UQ4XJP58cLCqgC7GRJ00axZaMNhdHm2deG53nR3W5EFKxpAb-HIyjKhzvpLUI7Vi13o-CKS2KpxkG0Ox7Z1luXQK0xowGJ924ANI8HeJEOZU1VE Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: b425229949714dd1bbae5ff12397c4b3 Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: {"security_group_rule": {"parent_group_id": "7835a302-c51f-42d0-99cd-9451c27ca2ef", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7835a302-c51f-42d0-99cd-9451c27ca2ef', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 18 11:40:11.722904 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:11.726834 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:11.726834 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:11.726834 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:11.726834 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:11.726834 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:11.726834 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:11.726834 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:11.726834 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 18 11:40:11.726834 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:11.726834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5396acb2-b0a2-4c12-88f0-b7b5fb0254f8 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:11.726834 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5396acb2-b0a2-4c12-88f0-b7b5fb0254f8 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.080152 Aug 18 11:40:11.726834 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1768/3386] 10.222.0.73 () {60 vars in 1195 bytes} [Thu Aug 18 11:40:11 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:40:11.732060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6e00ee28-5d9a-46e0-82ef-3c3d575f3ad3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:11.732703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6e00ee28-5d9a-46e0-82ef-3c3d575f3ad3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: fda29354-2be3-4b36-aa1e-4a96b0954806] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:11.742002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e00ee28-5d9a-46e0-82ef-3c3d575f3ad3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:11.742798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e00ee28-5d9a-46e0-82ef-3c3d575f3ad3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:11.743435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e00ee28-5d9a-46e0-82ef-3c3d575f3ad3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:11.745650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e00ee28-5d9a-46e0-82ef-3c3d575f3ad3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:11.746237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e00ee28-5d9a-46e0-82ef-3c3d575f3ad3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:11.747461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e00ee28-5d9a-46e0-82ef-3c3d575f3ad3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:11.773957 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-6e00ee28-5d9a-46e0-82ef-3c3d575f3ad3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] HTTP exception thrown: Instance fda29354-2be3-4b36-aa1e-4a96b0954806 could not be found. Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6e00ee28-5d9a-46e0-82ef-3c3d575f3ad3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Request method failure captured: Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 HTTP/1.1 Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iLmk9InP0duM3a0KDx_rtZKV8FK6L1K2bxM2FY_EgJYqIM7l6-dvd1lSerO55Wyi5U4yj1fTG6Vc3OaZITag4LeT6S8IZr53KJqlR_jcP3WXpPplfH-I6YY1lxUr6Gwpsy1_3hY6Dk0Yq1AVixRwd4iEqTkfityyzTwlhBMvpVDaIo Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c1a985dc6f824e5b847a2d966c0f79af Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c1a985dc6f824e5b847a2d966c0f79af Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-998907994-project Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 0cd8451c50d941409a66864cbc1c7201 Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-998907994-project Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance fda29354-2be3-4b36-aa1e-4a96b0954806 could not be found. Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'fda29354-2be3-4b36-aa1e-4a96b0954806'} Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda29354-2be3-4b36-aa1e-4a96b0954806 could not be found. Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda29354-2be3-4b36-aa1e-4a96b0954806 could not be found. Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:11.786758 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:11.795943 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:11.795943 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:11.795943 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:11.795943 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:11.795943 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:11.795943 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda29354-2be3-4b36-aa1e-4a96b0954806 could not be found. Aug 18 11:40:11.795943 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:11.795943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6e00ee28-5d9a-46e0-82ef-3c3d575f3ad3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Returning 404 to user: Instance fda29354-2be3-4b36-aa1e-4a96b0954806 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:11.795943 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6e00ee28-5d9a-46e0-82ef-3c3d575f3ad3 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806" status: 404 len: 111 microversion: 2.1 time: 0.062363 Aug 18 11:40:11.795943 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1769/3387] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:11 2022] GET /compute/v2.1/servers/fda29354-2be3-4b36-aa1e-4a96b0954806 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:40:11.809065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-60767ce6-62a2-4440-83f0-e662d199863d tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Action: 'create', calling method: .version_select at 0x7f519efa1af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1173797559", "description": "tempest-description-1999284011"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:11.985561 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-60767ce6-62a2-4440-83f0-e662d199863d tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.194308 Aug 18 11:40:11.995376 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1770/3388] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:40:11 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:11.998473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-828ec0af-787f-4ecc-9154-4ad5c2add332 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:11.998986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-828ec0af-787f-4ecc-9154-4ad5c2add332 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:12.008887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-828ec0af-787f-4ecc-9154-4ad5c2add332 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:12.009597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-828ec0af-787f-4ecc-9154-4ad5c2add332 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:12.010278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-828ec0af-787f-4ecc-9154-4ad5c2add332 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:12.011222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-828ec0af-787f-4ecc-9154-4ad5c2add332 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:12.012006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-80a43bd5-3356-495e-b916-5bd3010ad87a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:12.012550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-828ec0af-787f-4ecc-9154-4ad5c2add332 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:12.013350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-828ec0af-787f-4ecc-9154-4ad5c2add332 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:12.028222 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-80a43bd5-3356-495e-b916-5bd3010ad87a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.464514 Aug 18 11:40:12.042783 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1619/3389] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:11 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:12.042783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64f38e28-562b-4609-984a-2522bfa9eb0e tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Action: 'create', calling method: .version_select at 0x7f519f5cbe50>, body: {"security_group_rule": {"parent_group_id": "75ad696a-49cb-4fcf-9703-5b9d28fcf810", "ip_protocol": "tcp", "from_port": 22, "to_port": 662707990}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:12.053143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-828ec0af-787f-4ecc-9154-4ad5c2add332 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:40:12.159717 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-828ec0af-787f-4ecc-9154-4ad5c2add332 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 204 len: 0 microversion: 2.1 time: 0.166918 Aug 18 11:40:12.163743 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1771/3390] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:40:11 2022] DELETE /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:40:12.175364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d469f7b8-2114-4b61-8f63-c6f934e42633 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:12.176577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d469f7b8-2114-4b61-8f63-c6f934e42633 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:12.189417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d469f7b8-2114-4b61-8f63-c6f934e42633 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:12.189831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d469f7b8-2114-4b61-8f63-c6f934e42633 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:12.190271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d469f7b8-2114-4b61-8f63-c6f934e42633 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:12.191085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d469f7b8-2114-4b61-8f63-c6f934e42633 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:12.191550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d469f7b8-2114-4b61-8f63-c6f934e42633 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:12.192166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d469f7b8-2114-4b61-8f63-c6f934e42633 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:12.237852 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-64f38e28-562b-4609-984a-2522bfa9eb0e tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] HTTP exception thrown: Invalid port range 22:662707990. Valid TCP ports should be between 1-65535 Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64f38e28-562b-4609-984a-2522bfa9eb0e tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Request method failure captured: Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 145 Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iUVQFQqhljlb1lPJe3rGQmlhLXUFcnH_ORjmTF9d7peKz6k7DenQk_TH2Dxswi6UQ4XJP58cLCqgC7GRJ00axZaMNhdHm2deG53nR3W5EFKxpAb-HIyjKhzvpLUI7Vi13o-CKS2KpxkG0Ox7Z1luXQK0xowGJ924ANI8HeJEOZU1VE Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b425229949714dd1bbae5ff12397c4b3 Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: {"security_group_rule": {"parent_group_id": "75ad696a-49cb-4fcf-9703-5b9d28fcf810", "ip_protocol": "tcp", "from_port": 22, "to_port": 662707990}} Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid port range 22:662707990. Valid TCP ports should be between 1-65535 Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'security_group_rule': {'parent_group_id': '75ad696a-49cb-4fcf-9703-5b9d28fcf810', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 662707990}}} Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:662707990. Valid TCP ports should be between 1-65535 Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:662707990. Valid TCP ports should be between 1-65535 Aug 18 11:40:12.239821 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.243914 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:12.243914 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.243914 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:12.243914 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:12.243914 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:12.243914 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:12.243914 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:12.243914 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:662707990. Valid TCP ports should be between 1-65535 Aug 18 11:40:12.243914 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.245548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64f38e28-562b-4609-984a-2522bfa9eb0e tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Returning 400 to user: Invalid port range 22:662707990. Valid TCP ports should be between 1-65535 {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:12.246615 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-64f38e28-562b-4609-984a-2522bfa9eb0e tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.210353 Aug 18 11:40:12.247300 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1620/3391] 10.222.0.73 () {60 vars in 1195 bytes} [Thu Aug 18 11:40:12 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:40:12.255047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b1d336e5-6716-4c43-9bf0-fc8a6d74a044 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:12.255947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b1d336e5-6716-4c43-9bf0-fc8a6d74a044 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:12.269646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b1d336e5-6716-4c43-9bf0-fc8a6d74a044 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:12.270155 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b1d336e5-6716-4c43-9bf0-fc8a6d74a044 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:12.270651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b1d336e5-6716-4c43-9bf0-fc8a6d74a044 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:12.271385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b1d336e5-6716-4c43-9bf0-fc8a6d74a044 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:12.271850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b1d336e5-6716-4c43-9bf0-fc8a6d74a044 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:12.275258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b1d336e5-6716-4c43-9bf0-fc8a6d74a044 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:12.430244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d469f7b8-2114-4b61-8f63-c6f934e42633 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:12.441267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d469f7b8-2114-4b61-8f63-c6f934e42633 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:12.443039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d469f7b8-2114-4b61-8f63-c6f934e42633 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:12.444365 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d469f7b8-2114-4b61-8f63-c6f934e42633 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.278629 Aug 18 11:40:12.459256 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1772/3392] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:12 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:12.465324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c4e2ea1d-ffcd-45d7-9396-5dfd69f3a77d tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Action: 'create', calling method: .version_select at 0x7f519ee6caf0>, body: {"security_group_rule": {"parent_group_id": "2702a758-f050-4c39-b4c8-cef05d8fdadd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:12.512061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-c4e2ea1d-ffcd-45d7-9396-5dfd69f3a77d tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2702a758-f050-4c39-b4c8-cef05d8fdadd does not exist", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:40:12.513820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.security_group_api [None req-c4e2ea1d-ffcd-45d7-9396-5dfd69f3a77d tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Neutron security group 2702a758-f050-4c39-b4c8-cef05d8fdadd not found {{(pid=122210) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:40:12.514523 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-c4e2ea1d-ffcd-45d7-9396-5dfd69f3a77d tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] HTTP exception thrown: Security group 2702a758-f050-4c39-b4c8-cef05d8fdadd does not exist Aug 18 11:40:12.514523 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-d19cae5c-7c48-4af9-979c-07fcbc02bc92'] Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c4e2ea1d-ffcd-45d7-9396-5dfd69f3a77d tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Request method failure captured: Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 138 Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iUVQFQqhljlb1lPJe3rGQmlhLXUFcnH_ORjmTF9d7peKz6k7DenQk_TH2Dxswi6UQ4XJP58cLCqgC7GRJ00axZaMNhdHm2deG53nR3W5EFKxpAb-HIyjKhzvpLUI7Vi13o-CKS2KpxkG0Ox7Z1luXQK0xowGJ924ANI8HeJEOZU1VE Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: b425229949714dd1bbae5ff12397c4b3 Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: {"security_group_rule": {"parent_group_id": "2702a758-f050-4c39-b4c8-cef05d8fdadd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: exception: Security group 2702a758-f050-4c39-b4c8-cef05d8fdadd does not exist Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-d19cae5c-7c48-4af9-979c-07fcbc02bc92'] Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2702a758-f050-4c39-b4c8-cef05d8fdadd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:40:12.520184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2702a758-f050-4c39-b4c8-cef05d8fdadd does not exist Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d19cae5c-7c48-4af9-979c-07fcbc02bc92'] Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2702a758-f050-4c39-b4c8-cef05d8fdadd does not exist Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d19cae5c-7c48-4af9-979c-07fcbc02bc92'] Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2702a758-f050-4c39-b4c8-cef05d8fdadd does not exist Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d19cae5c-7c48-4af9-979c-07fcbc02bc92'] Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2702a758-f050-4c39-b4c8-cef05d8fdadd does not exist Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d19cae5c-7c48-4af9-979c-07fcbc02bc92'] Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c4e2ea1d-ffcd-45d7-9396-5dfd69f3a77d tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Returning 404 to user: Security group 2702a758-f050-4c39-b4c8-cef05d8fdadd does not exist Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-d19cae5c-7c48-4af9-979c-07fcbc02bc92'] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:12.524735 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c4e2ea1d-ffcd-45d7-9396-5dfd69f3a77d tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.064192 Aug 18 11:40:12.532238 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1773/3393] 10.222.0.73 () {60 vars in 1195 bytes} [Thu Aug 18 11:40:12 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:40:12.538406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ccbbd19e-e243-4ab0-a43e-f252ea6dc71c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:12.539905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ccbbd19e-e243-4ab0-a43e-f252ea6dc71c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:12.550878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccbbd19e-e243-4ab0-a43e-f252ea6dc71c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:12.551380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccbbd19e-e243-4ab0-a43e-f252ea6dc71c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:12.551829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccbbd19e-e243-4ab0-a43e-f252ea6dc71c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:12.552539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccbbd19e-e243-4ab0-a43e-f252ea6dc71c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:12.553181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccbbd19e-e243-4ab0-a43e-f252ea6dc71c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:12.553761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccbbd19e-e243-4ab0-a43e-f252ea6dc71c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:12.709334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b1d336e5-6716-4c43-9bf0-fc8a6d74a044 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:12.725559 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b1d336e5-6716-4c43-9bf0-fc8a6d74a044 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1493 microversion: 2.1 time: 0.476863 Aug 18 11:40:12.726478 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1621/3394] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:12 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1493 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:12.734167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a8106c93-c332-40fe-9408-6b3ded07e444 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Calling method '.version_select at 0x7f519f5cbee0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:12.808522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG neutronclient.v2_0.client [None req-a8106c93-c332-40fe-9408-6b3ded07e444 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 3c7a91af-368a-43bd-a642-b9a32068ea42 does not exist", "detail": ""}} {{(pid=122209) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:40:12.810450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.security_group_api [None req-a8106c93-c332-40fe-9408-6b3ded07e444 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Neutron security group rule 3c7a91af-368a-43bd-a642-b9a32068ea42 not found {{(pid=122209) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 18 11:40:12.811048 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-a8106c93-c332-40fe-9408-6b3ded07e444 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] HTTP exception thrown: Security group rule 3c7a91af-368a-43bd-a642-b9a32068ea42 does not exist Aug 18 11:40:12.811048 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-944ba6dd-8779-421e-9ca4-59a7500734ce'] Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a8106c93-c332-40fe-9408-6b3ded07e444 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Request method failure captured: Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-security-group-rules/3c7a91af-368a-43bd-a642-b9a32068ea42 HTTP/1.1 Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iUVQFQqhljlb1lPJe3rGQmlhLXUFcnH_ORjmTF9d7peKz6k7DenQk_TH2Dxswi6UQ4XJP58cLCqgC7GRJ00axZaMNhdHm2deG53nR3W5EFKxpAb-HIyjKhzvpLUI7Vi13o-CKS2KpxkG0Ox7Z1luXQK0xowGJ924ANI8HeJEOZU1VE Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf602a41c454b068d9d5760c4f0833b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: caf602a41c454b068d9d5760c4f0833b Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935 Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: b425229949714dd1bbae5ff12397c4b3 Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-659209935-project Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: exception: Security group rule 3c7a91af-368a-43bd-a642-b9a32068ea42 does not exist Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-944ba6dd-8779-421e-9ca4-59a7500734ce'] Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3c7a91af-368a-43bd-a642-b9a32068ea42'} Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:40:12.812932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 3c7a91af-368a-43bd-a642-b9a32068ea42 does not exist Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-944ba6dd-8779-421e-9ca4-59a7500734ce'] Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 3c7a91af-368a-43bd-a642-b9a32068ea42 does not exist Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-944ba6dd-8779-421e-9ca4-59a7500734ce'] Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 3c7a91af-368a-43bd-a642-b9a32068ea42 does not exist Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-944ba6dd-8779-421e-9ca4-59a7500734ce'] Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 3c7a91af-368a-43bd-a642-b9a32068ea42 does not exist Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-944ba6dd-8779-421e-9ca4-59a7500734ce'] Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a8106c93-c332-40fe-9408-6b3ded07e444 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Returning 404 to user: Security group rule 3c7a91af-368a-43bd-a642-b9a32068ea42 does not exist Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-944ba6dd-8779-421e-9ca4-59a7500734ce'] {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:12.819205 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a8106c93-c332-40fe-9408-6b3ded07e444 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-group-rules/3c7a91af-368a-43bd-a642-b9a32068ea42" status: 404 len: 199 microversion: 2.1 time: 0.087215 Aug 18 11:40:12.824981 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1622/3395] 10.222.0.73 () {58 vars in 1287 bytes} [Thu Aug 18 11:40:12 2022] DELETE /compute/v2.1/os-security-group-rules/3c7a91af-368a-43bd-a642-b9a32068ea42 => generated 199 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:40:12.827785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ccbbd19e-e243-4ab0-a43e-f252ea6dc71c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:12.829650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fad6dac3-ad2a-4122-a916-620b7f094710 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:12.830281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fad6dac3-ad2a-4122-a916-620b7f094710 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:12.837541 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ccbbd19e-e243-4ab0-a43e-f252ea6dc71c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.305854 Aug 18 11:40:12.837791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fad6dac3-ad2a-4122-a916-620b7f094710 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:12.838168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fad6dac3-ad2a-4122-a916-620b7f094710 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:12.838866 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1774/3396] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:12 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:12.839353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fad6dac3-ad2a-4122-a916-620b7f094710 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:12.839970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fad6dac3-ad2a-4122-a916-620b7f094710 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:12.841032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fad6dac3-ad2a-4122-a916-620b7f094710 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:12.841032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fad6dac3-ad2a-4122-a916-620b7f094710 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:12.858843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1904c3ca-2544-47c7-8edb-8ce8e0442712 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Calling method '.version_select at 0x7f519f01e700>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:13.227012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fad6dac3-ad2a-4122-a916-620b7f094710 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:13.245380 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fad6dac3-ad2a-4122-a916-620b7f094710 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1736 microversion: 2.1 time: 0.418628 Aug 18 11:40:13.246074 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1623/3397] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:12 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1736 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:13.265685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c80bf4b3-efd3-4877-9425-37c0b8434d1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:13.266231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c80bf4b3-efd3-4877-9425-37c0b8434d1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:13.274542 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1904c3ca-2544-47c7-8edb-8ce8e0442712 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/75ad696a-49cb-4fcf-9703-5b9d28fcf810" status: 202 len: 0 microversion: 2.1 time: 0.420489 Aug 18 11:40:13.276557 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1775/3398] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:40:12 2022] DELETE /compute/v2.1/os-security-groups/75ad696a-49cb-4fcf-9703-5b9d28fcf810 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:40:13.286488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c80bf4b3-efd3-4877-9425-37c0b8434d1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:13.287215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c80bf4b3-efd3-4877-9425-37c0b8434d1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:13.287668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c80bf4b3-efd3-4877-9425-37c0b8434d1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:13.288425 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c80bf4b3-efd3-4877-9425-37c0b8434d1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:13.289657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c80bf4b3-efd3-4877-9425-37c0b8434d1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:13.291389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c80bf4b3-efd3-4877-9425-37c0b8434d1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:13.308024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-acf0280a-a2fd-422f-90bd-78c8cf34002a tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Calling method '.version_select at 0x7f519f598430>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:13.663834 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-acf0280a-a2fd-422f-90bd-78c8cf34002a tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/7835a302-c51f-42d0-99cd-9451c27ca2ef" status: 202 len: 0 microversion: 2.1 time: 0.378733 Aug 18 11:40:13.665161 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1776/3399] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:40:13 2022] DELETE /compute/v2.1/os-security-groups/7835a302-c51f-42d0-99cd-9451c27ca2ef => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:40:13.673260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ff3eeed6-8c07-45b4-a175-3822fe13a6a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:13.674217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ff3eeed6-8c07-45b4-a175-3822fe13a6a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:13.690355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff3eeed6-8c07-45b4-a175-3822fe13a6a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:13.691148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff3eeed6-8c07-45b4-a175-3822fe13a6a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:13.691780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff3eeed6-8c07-45b4-a175-3822fe13a6a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:13.692730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff3eeed6-8c07-45b4-a175-3822fe13a6a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:13.693216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff3eeed6-8c07-45b4-a175-3822fe13a6a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:13.693647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff3eeed6-8c07-45b4-a175-3822fe13a6a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:13.906310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c80bf4b3-efd3-4877-9425-37c0b8434d1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:13.914457 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c80bf4b3-efd3-4877-9425-37c0b8434d1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.662026 Aug 18 11:40:13.915089 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1624/3400] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:13 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:13.920929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-306e5be4-ed94-44a9-89b6-047f77ba4f03 req-5141be25-b103-4b8a-933f-9663a78e4d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4596fe-66e9-4fe7-bb85-433fc508040d", "name": "network-vif-deleted", "tag": "950eb03a-fc74-48ad-b320-fd8a36ea6c4e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:13.931157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ff3eeed6-8c07-45b4-a175-3822fe13a6a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:13.931890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-306e5be4-ed94-44a9-89b6-047f77ba4f03 req-5141be25-b103-4b8a-933f-9663a78e4d73 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:13.932585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-306e5be4-ed94-44a9-89b6-047f77ba4f03 req-5141be25-b103-4b8a-933f-9663a78e4d73 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:13.933309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-306e5be4-ed94-44a9-89b6-047f77ba4f03 req-5141be25-b103-4b8a-933f-9663a78e4d73 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:13.945983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ff3eeed6-8c07-45b4-a175-3822fe13a6a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:13.950075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ff3eeed6-8c07-45b4-a175-3822fe13a6a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:13.952914 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-306e5be4-ed94-44a9-89b6-047f77ba4f03 req-5141be25-b103-4b8a-933f-9663a78e4d73 service nova] Creating event network-vif-deleted:950eb03a-fc74-48ad-b320-fd8a36ea6c4e for instance 3c4596fe-66e9-4fe7-bb85-433fc508040d on n-h2-853611-3 Aug 18 11:40:13.953097 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ff3eeed6-8c07-45b4-a175-3822fe13a6a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.286333 Aug 18 11:40:13.953528 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1777/3401] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:13 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:13.973765 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-306e5be4-ed94-44a9-89b6-047f77ba4f03 req-5141be25-b103-4b8a-933f-9663a78e4d73 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054439 Aug 18 11:40:13.975861 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1625/3402] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:13.976180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-70bae142-35cb-447b-8d19-34d12b35ae69 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Calling method '.version_select at 0x7f519f598280>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:13.986368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ec9272f6-6d9f-4bc3-8096-6bed9f8abba0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:13.987720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ec9272f6-6d9f-4bc3-8096-6bed9f8abba0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:13.997139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec9272f6-6d9f-4bc3-8096-6bed9f8abba0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:13.997654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec9272f6-6d9f-4bc3-8096-6bed9f8abba0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:13.998095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec9272f6-6d9f-4bc3-8096-6bed9f8abba0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:13.999173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec9272f6-6d9f-4bc3-8096-6bed9f8abba0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:13.999647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec9272f6-6d9f-4bc3-8096-6bed9f8abba0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:14.000084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec9272f6-6d9f-4bc3-8096-6bed9f8abba0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:14.050464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec9272f6-6d9f-4bc3-8096-6bed9f8abba0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:14.051265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec9272f6-6d9f-4bc3-8096-6bed9f8abba0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:14.051715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec9272f6-6d9f-4bc3-8096-6bed9f8abba0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:14.052180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-ec9272f6-6d9f-4bc3-8096-6bed9f8abba0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lazy-loading 'fault' on Instance uuid 3c4596fe-66e9-4fe7-bb85-433fc508040d {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:40:14.118189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ec9272f6-6d9f-4bc3-8096-6bed9f8abba0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:14.131896 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ec9272f6-6d9f-4bc3-8096-6bed9f8abba0 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 200 len: 1304 microversion: 2.1 time: 0.151784 Aug 18 11:40:14.142492 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1626/3403] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:13 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:14.149999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-49502103-06e3-4faf-ac4b-46b3bb29935e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:14.151304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-49502103-06e3-4faf-ac4b-46b3bb29935e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:14.162569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49502103-06e3-4faf-ac4b-46b3bb29935e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:14.163245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49502103-06e3-4faf-ac4b-46b3bb29935e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:14.164546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49502103-06e3-4faf-ac4b-46b3bb29935e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:14.165416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49502103-06e3-4faf-ac4b-46b3bb29935e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:14.165986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49502103-06e3-4faf-ac4b-46b3bb29935e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:14.167383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49502103-06e3-4faf-ac4b-46b3bb29935e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:14.200049 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-70bae142-35cb-447b-8d19-34d12b35ae69 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/7924da74-2926-417f-8236-04a3591747fb" status: 202 len: 0 microversion: 2.1 time: 0.240099 Aug 18 11:40:14.200982 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1778/3404] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:40:13 2022] DELETE /compute/v2.1/os-security-groups/7924da74-2926-417f-8236-04a3591747fb => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:40:14.211009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8c1a5e0a-8cad-4d10-802b-8678e8735e38 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Calling method '.version_select at 0x7f519fbfdee0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:14.417811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-49502103-06e3-4faf-ac4b-46b3bb29935e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:14.425900 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-49502103-06e3-4faf-ac4b-46b3bb29935e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.287813 Aug 18 11:40:14.426692 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1627/3405] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:14 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:14.432583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-53a58022-05bd-43f4-a35a-0343a5f611c4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:14.433423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-53a58022-05bd-43f4-a35a-0343a5f611c4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:14.439736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53a58022-05bd-43f4-a35a-0343a5f611c4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:14.440234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53a58022-05bd-43f4-a35a-0343a5f611c4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:14.440679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53a58022-05bd-43f4-a35a-0343a5f611c4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:14.441403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53a58022-05bd-43f4-a35a-0343a5f611c4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:14.441889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53a58022-05bd-43f4-a35a-0343a5f611c4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:14.442325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53a58022-05bd-43f4-a35a-0343a5f611c4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:14.606765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-53a58022-05bd-43f4-a35a-0343a5f611c4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:14.615767 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-53a58022-05bd-43f4-a35a-0343a5f611c4 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1736 microversion: 2.1 time: 0.188158 Aug 18 11:40:14.616375 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1628/3406] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:14 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:14.647301 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8c1a5e0a-8cad-4d10-802b-8678e8735e38 tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/5f01986d-5bb0-4453-b67f-9368d7c840b0" status: 202 len: 0 microversion: 2.1 time: 0.440475 Aug 18 11:40:14.649686 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1779/3407] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:40:14 2022] DELETE /compute/v2.1/os-security-groups/5f01986d-5bb0-4453-b67f-9368d7c840b0 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:40:14.659288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-79460a9c-ab71-4f0f-a1b7-e9ddf0676deb tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] Calling method '.version_select at 0x7f519f5cb940>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:14.904205 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-79460a9c-ab71-4f0f-a1b7-e9ddf0676deb tempest-SecurityGroupRulesNegativeTestJSON-659209935 tempest-SecurityGroupRulesNegativeTestJSON-659209935-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/35111956-85d0-462f-8034-5fe96cbec88d" status: 202 len: 0 microversion: 2.1 time: 0.248628 Aug 18 11:40:14.907344 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1629/3408] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:40:14 2022] DELETE /compute/v2.1/os-security-groups/35111956-85d0-462f-8034-5fe96cbec88d => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:40:14.937023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1ce120f2-9c0e-4666-83ad-2352e2b893f7 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:14.938248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1ce120f2-9c0e-4666-83ad-2352e2b893f7 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:14.954110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ce120f2-9c0e-4666-83ad-2352e2b893f7 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:14.954673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ce120f2-9c0e-4666-83ad-2352e2b893f7 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:14.955152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ce120f2-9c0e-4666-83ad-2352e2b893f7 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:14.959289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ce120f2-9c0e-4666-83ad-2352e2b893f7 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:14.959800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ce120f2-9c0e-4666-83ad-2352e2b893f7 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:14.962912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ce120f2-9c0e-4666-83ad-2352e2b893f7 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:14.979825 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fab0aba0-79cd-4ce6-a801-a7d0e78623c9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:14.980670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fab0aba0-79cd-4ce6-a801-a7d0e78623c9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:14.993196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fab0aba0-79cd-4ce6-a801-a7d0e78623c9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:14.993712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fab0aba0-79cd-4ce6-a801-a7d0e78623c9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:14.994162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fab0aba0-79cd-4ce6-a801-a7d0e78623c9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:14.995124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fab0aba0-79cd-4ce6-a801-a7d0e78623c9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:14.995713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fab0aba0-79cd-4ce6-a801-a7d0e78623c9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:14.996156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fab0aba0-79cd-4ce6-a801-a7d0e78623c9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:15.375383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fab0aba0-79cd-4ce6-a801-a7d0e78623c9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:15.389325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fab0aba0-79cd-4ce6-a801-a7d0e78623c9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:15.391007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fab0aba0-79cd-4ce6-a801-a7d0e78623c9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:15.392261 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fab0aba0-79cd-4ce6-a801-a7d0e78623c9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.418495 Aug 18 11:40:15.393088 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1630/3409] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:14 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:40:15.409270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1ce120f2-9c0e-4666-83ad-2352e2b893f7 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:15.416726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ee8adeec-1b4e-4db8-a39d-6c7716c53d89 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:15.417459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ee8adeec-1b4e-4db8-a39d-6c7716c53d89 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: 3c4596fe-66e9-4fe7-bb85-433fc508040d] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:15.418282 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1ce120f2-9c0e-4666-83ad-2352e2b893f7 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.485350 Aug 18 11:40:15.419484 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1780/3410] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:14 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:15.448170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee8adeec-1b4e-4db8-a39d-6c7716c53d89 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:15.449116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee8adeec-1b4e-4db8-a39d-6c7716c53d89 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:15.449784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee8adeec-1b4e-4db8-a39d-6c7716c53d89 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:15.450835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee8adeec-1b4e-4db8-a39d-6c7716c53d89 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:15.451514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee8adeec-1b4e-4db8-a39d-6c7716c53d89 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:15.452183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee8adeec-1b4e-4db8-a39d-6c7716c53d89 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:15.454401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bcf3b568-fee5-4d4c-bd6d-1b482cbcca2b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:15.455059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bcf3b568-fee5-4d4c-bd6d-1b482cbcca2b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:15.463847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcf3b568-fee5-4d4c-bd6d-1b482cbcca2b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:15.465001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcf3b568-fee5-4d4c-bd6d-1b482cbcca2b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:15.465861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcf3b568-fee5-4d4c-bd6d-1b482cbcca2b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:15.466950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcf3b568-fee5-4d4c-bd6d-1b482cbcca2b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:15.467660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcf3b568-fee5-4d4c-bd6d-1b482cbcca2b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:15.468280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcf3b568-fee5-4d4c-bd6d-1b482cbcca2b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:15.495900 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-ee8adeec-1b4e-4db8-a39d-6c7716c53d89 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] HTTP exception thrown: Instance 3c4596fe-66e9-4fe7-bb85-433fc508040d could not be found. Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ee8adeec-1b4e-4db8-a39d-6c7716c53d89 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Request method failure captured: Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d HTTP/1.1 Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iLmk9InP0duM3a0KDx_rtZKV8FK6L1K2bxM2FY_EgJYqIM7l6-dvd1lSerO55Wyi5U4yj1fTG6Vc3OaZITag4LeT6S8IZr53KJqlR_jcP3WXpPplfH-I6YY1lxUr6Gwpsy1_3hY6Dk0Yq1AVixRwd4iEqTkfityyzTwlhBMvpVDaIo Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: c1a985dc6f824e5b847a2d966c0f79af Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: c1a985dc6f824e5b847a2d966c0f79af Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerActionsTestJSON-998907994-project Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 0cd8451c50d941409a66864cbc1c7201 Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerActionsTestJSON-998907994-project Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 3c4596fe-66e9-4fe7-bb85-433fc508040d could not be found. Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3c4596fe-66e9-4fe7-bb85-433fc508040d'} Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c4596fe-66e9-4fe7-bb85-433fc508040d could not be found. Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c4596fe-66e9-4fe7-bb85-433fc508040d could not be found. Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:15.503901 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:15.508001 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:15.508001 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:15.508001 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:15.508001 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:15.508001 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:15.508001 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c4596fe-66e9-4fe7-bb85-433fc508040d could not be found. Aug 18 11:40:15.508001 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:40:15.508001 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ee8adeec-1b4e-4db8-a39d-6c7716c53d89 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Returning 404 to user: Instance 3c4596fe-66e9-4fe7-bb85-433fc508040d could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:15.508001 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ee8adeec-1b4e-4db8-a39d-6c7716c53d89 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d" status: 404 len: 111 microversion: 2.1 time: 0.111166 Aug 18 11:40:15.509060 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1631/3411] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:15 2022] GET /compute/v2.1/servers/3c4596fe-66e9-4fe7-bb85-433fc508040d => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:40:15.521405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6bcb86b1-a2e1-4735-a99f-d8a95419f34f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:15.525669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6bcb86b1-a2e1-4735-a99f-d8a95419f34f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:15.545999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bcb86b1-a2e1-4735-a99f-d8a95419f34f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:15.546952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bcb86b1-a2e1-4735-a99f-d8a95419f34f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:15.547643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bcb86b1-a2e1-4735-a99f-d8a95419f34f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:15.549317 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bcb86b1-a2e1-4735-a99f-d8a95419f34f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:15.550139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bcb86b1-a2e1-4735-a99f-d8a95419f34f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:15.550872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bcb86b1-a2e1-4735-a99f-d8a95419f34f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:15.585747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6bcb86b1-a2e1-4735-a99f-d8a95419f34f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:40:15.766187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:15.783899 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6bcb86b1-a2e1-4735-a99f-d8a95419f34f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 204 len: 0 microversion: 2.1 time: 0.268896 Aug 18 11:40:15.790157 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1632/3412] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:40:15 2022] DELETE /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:40:15.797160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ebb24815-dd20-43aa-89d0-15705e6b68f8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:15.797908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ebb24815-dd20-43aa-89d0-15705e6b68f8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:15.805943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ebb24815-dd20-43aa-89d0-15705e6b68f8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:15.806774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ebb24815-dd20-43aa-89d0-15705e6b68f8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:15.807971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ebb24815-dd20-43aa-89d0-15705e6b68f8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:15.808991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ebb24815-dd20-43aa-89d0-15705e6b68f8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:15.809974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ebb24815-dd20-43aa-89d0-15705e6b68f8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:15.809974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ebb24815-dd20-43aa-89d0-15705e6b68f8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:15.869199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bcf3b568-fee5-4d4c-bd6d-1b482cbcca2b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:15.882269 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bcf3b568-fee5-4d4c-bd6d-1b482cbcca2b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.431560 Aug 18 11:40:15.886200 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1781/3413] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:15 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:15.890801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f76abc3-8076-4761-b174-96153d3b8a55 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:15.891678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7f76abc3-8076-4761-b174-96153d3b8a55 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:15.899252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f76abc3-8076-4761-b174-96153d3b8a55 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:15.900148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f76abc3-8076-4761-b174-96153d3b8a55 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:15.901453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f76abc3-8076-4761-b174-96153d3b8a55 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:15.902413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f76abc3-8076-4761-b174-96153d3b8a55 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:15.902899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f76abc3-8076-4761-b174-96153d3b8a55 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:15.903493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f76abc3-8076-4761-b174-96153d3b8a55 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:16.081890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ebb24815-dd20-43aa-89d0-15705e6b68f8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:16.102369 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ebb24815-dd20-43aa-89d0-15705e6b68f8 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1736 microversion: 2.1 time: 0.313369 Aug 18 11:40:16.104700 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1633/3414] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:15 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1736 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:16.185955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7f76abc3-8076-4761-b174-96153d3b8a55 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:16.213740 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7f76abc3-8076-4761-b174-96153d3b8a55 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1675 microversion: 2.1 time: 0.328894 Aug 18 11:40:16.219292 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1782/3415] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:15 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1675 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:16.417855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f4c023c9-1cb4-4722-babc-ded36eacc8b0 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:16.418939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f4c023c9-1cb4-4722-babc-ded36eacc8b0 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:16.427769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4c023c9-1cb4-4722-babc-ded36eacc8b0 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:16.428277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4c023c9-1cb4-4722-babc-ded36eacc8b0 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:16.428918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4c023c9-1cb4-4722-babc-ded36eacc8b0 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:16.429701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4c023c9-1cb4-4722-babc-ded36eacc8b0 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:16.430343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4c023c9-1cb4-4722-babc-ded36eacc8b0 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:16.430976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4c023c9-1cb4-4722-babc-ded36eacc8b0 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:16.441863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ceaee687-2255-4704-883d-153736e0d00d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:16.442620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ceaee687-2255-4704-883d-153736e0d00d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:16.453166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceaee687-2255-4704-883d-153736e0d00d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:16.453981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceaee687-2255-4704-883d-153736e0d00d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:16.455230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceaee687-2255-4704-883d-153736e0d00d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:16.457376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceaee687-2255-4704-883d-153736e0d00d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:16.458362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceaee687-2255-4704-883d-153736e0d00d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:16.459119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceaee687-2255-4704-883d-153736e0d00d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:16.783564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ceaee687-2255-4704-883d-153736e0d00d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:16.793130 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ceaee687-2255-4704-883d-153736e0d00d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.355216 Aug 18 11:40:16.794421 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1783/3416] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:16 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:16.913491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-63ddaa6c-0739-457f-a7e3-179072850136 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:16.916229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-63ddaa6c-0739-457f-a7e3-179072850136 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:16.933768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63ddaa6c-0739-457f-a7e3-179072850136 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:16.935371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63ddaa6c-0739-457f-a7e3-179072850136 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:16.936521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63ddaa6c-0739-457f-a7e3-179072850136 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:16.947013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63ddaa6c-0739-457f-a7e3-179072850136 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:16.950638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63ddaa6c-0739-457f-a7e3-179072850136 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:16.951637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63ddaa6c-0739-457f-a7e3-179072850136 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:16.999914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f4c023c9-1cb4-4722-babc-ded36eacc8b0 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:17.009095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f4c023c9-1cb4-4722-babc-ded36eacc8b0 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:17.011204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f4c023c9-1cb4-4722-babc-ded36eacc8b0 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:17.019583 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f4c023c9-1cb4-4722-babc-ded36eacc8b0 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.599357 Aug 18 11:40:17.020517 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1634/3417] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:16 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:17.132731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-976030d8-3ee6-41bb-a342-99a5a46b8bcf tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:17.136512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-976030d8-3ee6-41bb-a342-99a5a46b8bcf tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:17.163742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-976030d8-3ee6-41bb-a342-99a5a46b8bcf tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:17.175681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-976030d8-3ee6-41bb-a342-99a5a46b8bcf tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:17.176942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-976030d8-3ee6-41bb-a342-99a5a46b8bcf tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:17.178568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-976030d8-3ee6-41bb-a342-99a5a46b8bcf tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:17.180375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-976030d8-3ee6-41bb-a342-99a5a46b8bcf tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:17.184100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-976030d8-3ee6-41bb-a342-99a5a46b8bcf tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:17.205358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-63ddaa6c-0739-457f-a7e3-179072850136 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:17.225316 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-63ddaa6c-0739-457f-a7e3-179072850136 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.323205 Aug 18 11:40:17.257370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:17.275146 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1784/3418] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:16 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:17.285341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3bad1342-b897-48a1-8bb5-0083ac9e8806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:17.286518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3bad1342-b897-48a1-8bb5-0083ac9e8806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:17.300829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bad1342-b897-48a1-8bb5-0083ac9e8806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:17.301726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bad1342-b897-48a1-8bb5-0083ac9e8806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:17.302838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bad1342-b897-48a1-8bb5-0083ac9e8806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:17.304066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bad1342-b897-48a1-8bb5-0083ac9e8806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:17.304865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bad1342-b897-48a1-8bb5-0083ac9e8806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:17.305617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bad1342-b897-48a1-8bb5-0083ac9e8806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:17.634293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-976030d8-3ee6-41bb-a342-99a5a46b8bcf tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:17.640474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3bad1342-b897-48a1-8bb5-0083ac9e8806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:17.655237 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-976030d8-3ee6-41bb-a342-99a5a46b8bcf tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1736 microversion: 2.1 time: 0.532551 Aug 18 11:40:17.655947 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1635/3419] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:17 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1736 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:17.678353 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3bad1342-b897-48a1-8bb5-0083ac9e8806 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1675 microversion: 2.1 time: 0.396896 Aug 18 11:40:17.687202 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1785/3420] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:17 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1675 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:17.815740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-239b6b3f-e392-4e41-a0f9-e1597805ebc9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:17.816725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-239b6b3f-e392-4e41-a0f9-e1597805ebc9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:17.825413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-239b6b3f-e392-4e41-a0f9-e1597805ebc9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:17.826256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-239b6b3f-e392-4e41-a0f9-e1597805ebc9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:17.826731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-239b6b3f-e392-4e41-a0f9-e1597805ebc9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:17.827488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-239b6b3f-e392-4e41-a0f9-e1597805ebc9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:17.827954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-239b6b3f-e392-4e41-a0f9-e1597805ebc9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:17.828383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-239b6b3f-e392-4e41-a0f9-e1597805ebc9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:18.076619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2dd25ad8-2a26-40f4-a572-4a3037e68555 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:18.081304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2dd25ad8-2a26-40f4-a572-4a3037e68555 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:18.122177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2dd25ad8-2a26-40f4-a572-4a3037e68555 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:18.123907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2dd25ad8-2a26-40f4-a572-4a3037e68555 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:18.126862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2dd25ad8-2a26-40f4-a572-4a3037e68555 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:18.131894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2dd25ad8-2a26-40f4-a572-4a3037e68555 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:18.139063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2dd25ad8-2a26-40f4-a572-4a3037e68555 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:18.147778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2dd25ad8-2a26-40f4-a572-4a3037e68555 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:18.220268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-239b6b3f-e392-4e41-a0f9-e1597805ebc9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:18.232176 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-239b6b3f-e392-4e41-a0f9-e1597805ebc9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.421067 Aug 18 11:40:18.247629 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1636/3421] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:17 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:18.263589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d8465b87-eb5a-4085-84cf-263f5db0f988 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:18.264583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d8465b87-eb5a-4085-84cf-263f5db0f988 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:18.272069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8465b87-eb5a-4085-84cf-263f5db0f988 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:18.272849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8465b87-eb5a-4085-84cf-263f5db0f988 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:18.273525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8465b87-eb5a-4085-84cf-263f5db0f988 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:18.274676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8465b87-eb5a-4085-84cf-263f5db0f988 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:18.275495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8465b87-eb5a-4085-84cf-263f5db0f988 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:18.277177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d8465b87-eb5a-4085-84cf-263f5db0f988 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:18.702750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2dd25ad8-2a26-40f4-a572-4a3037e68555 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:18.721569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2dd25ad8-2a26-40f4-a572-4a3037e68555 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:18.723177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2dd25ad8-2a26-40f4-a572-4a3037e68555 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:18.734892 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2dd25ad8-2a26-40f4-a572-4a3037e68555 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.683443 Aug 18 11:40:18.735601 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1786/3422] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:18 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:18.743134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-32023772-cdcf-4438-8a0e-3d4ae419dc85 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:18.748475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-32023772-cdcf-4438-8a0e-3d4ae419dc85 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:18.765795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32023772-cdcf-4438-8a0e-3d4ae419dc85 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:18.766568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32023772-cdcf-4438-8a0e-3d4ae419dc85 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:18.767220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32023772-cdcf-4438-8a0e-3d4ae419dc85 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:18.768130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32023772-cdcf-4438-8a0e-3d4ae419dc85 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:18.768772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32023772-cdcf-4438-8a0e-3d4ae419dc85 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:18.769379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32023772-cdcf-4438-8a0e-3d4ae419dc85 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:18.987301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d8465b87-eb5a-4085-84cf-263f5db0f988 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:19.003453 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d8465b87-eb5a-4085-84cf-263f5db0f988 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.745586 Aug 18 11:40:19.006401 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1637/3423] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:18 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:19.019895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1fc51494-8e7f-4015-ade4-81aba85e079f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:19.021589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1fc51494-8e7f-4015-ade4-81aba85e079f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:19.043106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fc51494-8e7f-4015-ade4-81aba85e079f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:19.044212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fc51494-8e7f-4015-ade4-81aba85e079f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:19.046210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fc51494-8e7f-4015-ade4-81aba85e079f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:19.047952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fc51494-8e7f-4015-ade4-81aba85e079f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:19.049271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fc51494-8e7f-4015-ade4-81aba85e079f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:19.050044 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fc51494-8e7f-4015-ade4-81aba85e079f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:19.179454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-32023772-cdcf-4438-8a0e-3d4ae419dc85 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:19.191680 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-32023772-cdcf-4438-8a0e-3d4ae419dc85 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1736 microversion: 2.1 time: 0.454736 Aug 18 11:40:19.192303 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1787/3424] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:18 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1736 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:19.265659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d4f49aeb-5034-43b9-adcc-7c959e12eff4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:19.267730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d4f49aeb-5034-43b9-adcc-7c959e12eff4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:19.303112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4f49aeb-5034-43b9-adcc-7c959e12eff4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:19.308018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4f49aeb-5034-43b9-adcc-7c959e12eff4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:19.311097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4f49aeb-5034-43b9-adcc-7c959e12eff4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:19.312405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4f49aeb-5034-43b9-adcc-7c959e12eff4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:19.316311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4f49aeb-5034-43b9-adcc-7c959e12eff4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:19.319100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4f49aeb-5034-43b9-adcc-7c959e12eff4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:19.467371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1fc51494-8e7f-4015-ade4-81aba85e079f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:19.510797 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1fc51494-8e7f-4015-ade4-81aba85e079f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1675 microversion: 2.1 time: 0.501575 Aug 18 11:40:19.512194 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1638/3425] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:19 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1675 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:19.766845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-53df3dfe-4ce9-4911-a12e-d9edc983f997 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:19.773501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-53df3dfe-4ce9-4911-a12e-d9edc983f997 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:19.803231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d4f49aeb-5034-43b9-adcc-7c959e12eff4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:19.813038 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d4f49aeb-5034-43b9-adcc-7c959e12eff4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.559492 Aug 18 11:40:19.818489 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1788/3426] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:19 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:19.826933 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53df3dfe-4ce9-4911-a12e-d9edc983f997 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:19.829420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53df3dfe-4ce9-4911-a12e-d9edc983f997 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:19.832458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53df3dfe-4ce9-4911-a12e-d9edc983f997 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:19.848231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53df3dfe-4ce9-4911-a12e-d9edc983f997 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:19.849671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53df3dfe-4ce9-4911-a12e-d9edc983f997 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:19.850746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53df3dfe-4ce9-4911-a12e-d9edc983f997 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:20.042474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c55be4c2-e8ff-42fd-a5bc-2e55da53611f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:20.045619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c55be4c2-e8ff-42fd-a5bc-2e55da53611f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:20.060385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c55be4c2-e8ff-42fd-a5bc-2e55da53611f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:20.060899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c55be4c2-e8ff-42fd-a5bc-2e55da53611f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:20.061347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c55be4c2-e8ff-42fd-a5bc-2e55da53611f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:20.064357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c55be4c2-e8ff-42fd-a5bc-2e55da53611f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:20.067493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c55be4c2-e8ff-42fd-a5bc-2e55da53611f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:20.068278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c55be4c2-e8ff-42fd-a5bc-2e55da53611f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:20.079084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:20.380904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-53df3dfe-4ce9-4911-a12e-d9edc983f997 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:20.404561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-53df3dfe-4ce9-4911-a12e-d9edc983f997 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:20.408315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-53df3dfe-4ce9-4911-a12e-d9edc983f997 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:20.410515 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-53df3dfe-4ce9-4911-a12e-d9edc983f997 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.653814 Aug 18 11:40:20.411484 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1639/3427] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:19 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:40:20.438549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2bc7f64-1c8e-48e3-a987-0a29bd2113fb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:20.454531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a2bc7f64-1c8e-48e3-a987-0a29bd2113fb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:20.491621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2bc7f64-1c8e-48e3-a987-0a29bd2113fb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:20.492485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2bc7f64-1c8e-48e3-a987-0a29bd2113fb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:20.493243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2bc7f64-1c8e-48e3-a987-0a29bd2113fb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:20.495192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2bc7f64-1c8e-48e3-a987-0a29bd2113fb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:20.495959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2bc7f64-1c8e-48e3-a987-0a29bd2113fb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:20.496724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a2bc7f64-1c8e-48e3-a987-0a29bd2113fb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:20.664564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c55be4c2-e8ff-42fd-a5bc-2e55da53611f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:20.689835 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c55be4c2-e8ff-42fd-a5bc-2e55da53611f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.641772 Aug 18 11:40:20.692137 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1789/3428] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:20 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:20.711002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-741d92d1-cffc-47c1-96ce-8e9a2bca1c92 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:20.711978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-741d92d1-cffc-47c1-96ce-8e9a2bca1c92 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:20.726697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-741d92d1-cffc-47c1-96ce-8e9a2bca1c92 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:20.727376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-741d92d1-cffc-47c1-96ce-8e9a2bca1c92 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:20.728073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-741d92d1-cffc-47c1-96ce-8e9a2bca1c92 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:20.730012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-741d92d1-cffc-47c1-96ce-8e9a2bca1c92 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:20.730760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-741d92d1-cffc-47c1-96ce-8e9a2bca1c92 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:20.731404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-741d92d1-cffc-47c1-96ce-8e9a2bca1c92 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:20.787891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a2bc7f64-1c8e-48e3-a987-0a29bd2113fb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:20.812734 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a2bc7f64-1c8e-48e3-a987-0a29bd2113fb tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1736 microversion: 2.1 time: 0.397266 Aug 18 11:40:20.814310 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1640/3429] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:20 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1736 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:20.824550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-d8dcc944-13a2-4c83-b426-e1a9f84d5a51 req-b1b1c1dc-d0ca-409f-ad08-5723b385b6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a906b8-26ea-4413-bed0-9c6f7a6be35c", "name": "network-vif-deleted", "tag": "6b2318ca-00cc-4182-8517-7647cceb2c66"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:20.847402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d8dcc944-13a2-4c83-b426-e1a9f84d5a51 req-b1b1c1dc-d0ca-409f-ad08-5723b385b6c3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:20.848874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d8dcc944-13a2-4c83-b426-e1a9f84d5a51 req-b1b1c1dc-d0ca-409f-ad08-5723b385b6c3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:20.849697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d8dcc944-13a2-4c83-b426-e1a9f84d5a51 req-b1b1c1dc-d0ca-409f-ad08-5723b385b6c3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:20.885554 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-d8dcc944-13a2-4c83-b426-e1a9f84d5a51 req-b1b1c1dc-d0ca-409f-ad08-5723b385b6c3 service nova] Creating event network-vif-deleted:6b2318ca-00cc-4182-8517-7647cceb2c66 for instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c on n-h1-853611-3 Aug 18 11:40:20.900660 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-d8dcc944-13a2-4c83-b426-e1a9f84d5a51 req-b1b1c1dc-d0ca-409f-ad08-5723b385b6c3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082818 Aug 18 11:40:20.908439 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1641/3430] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:20.914932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-df2ab126-2db4-478c-ada6-0c7693a1e309 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:20.917470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-df2ab126-2db4-478c-ada6-0c7693a1e309 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:20.936098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-741d92d1-cffc-47c1-96ce-8e9a2bca1c92 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:20.948244 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-741d92d1-cffc-47c1-96ce-8e9a2bca1c92 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1607 microversion: 2.1 time: 0.254663 Aug 18 11:40:20.948905 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1790/3431] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:20 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1607 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:20.950764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df2ab126-2db4-478c-ada6-0c7693a1e309 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:20.951365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df2ab126-2db4-478c-ada6-0c7693a1e309 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:20.951822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df2ab126-2db4-478c-ada6-0c7693a1e309 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:20.952579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df2ab126-2db4-478c-ada6-0c7693a1e309 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:20.953042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df2ab126-2db4-478c-ada6-0c7693a1e309 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:20.953473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df2ab126-2db4-478c-ada6-0c7693a1e309 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:21.323608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-df2ab126-2db4-478c-ada6-0c7693a1e309 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:21.340155 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-df2ab126-2db4-478c-ada6-0c7693a1e309 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1517 microversion: 2.1 time: 0.430257 Aug 18 11:40:21.342774 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1642/3432] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:20 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1517 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:21.461273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8283ef68-22ca-48fe-aceb-e12d6969fe21 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:21.461902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8283ef68-22ca-48fe-aceb-e12d6969fe21 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:21.473379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8283ef68-22ca-48fe-aceb-e12d6969fe21 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:21.474258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8283ef68-22ca-48fe-aceb-e12d6969fe21 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:21.474937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8283ef68-22ca-48fe-aceb-e12d6969fe21 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:21.475861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8283ef68-22ca-48fe-aceb-e12d6969fe21 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:21.476889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8283ef68-22ca-48fe-aceb-e12d6969fe21 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:21.477539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8283ef68-22ca-48fe-aceb-e12d6969fe21 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:21.717690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7c910516-43f2-4a7f-8068-3ebd3cd76c7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:21.718318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7c910516-43f2-4a7f-8068-3ebd3cd76c7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:21.738613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c910516-43f2-4a7f-8068-3ebd3cd76c7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:21.739606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c910516-43f2-4a7f-8068-3ebd3cd76c7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:21.740176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c910516-43f2-4a7f-8068-3ebd3cd76c7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:21.741577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c910516-43f2-4a7f-8068-3ebd3cd76c7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:21.745946 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c910516-43f2-4a7f-8068-3ebd3cd76c7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:21.746750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c910516-43f2-4a7f-8068-3ebd3cd76c7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:21.809935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8283ef68-22ca-48fe-aceb-e12d6969fe21 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:21.820913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8283ef68-22ca-48fe-aceb-e12d6969fe21 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:21.828719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8283ef68-22ca-48fe-aceb-e12d6969fe21 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:21.834232 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8283ef68-22ca-48fe-aceb-e12d6969fe21 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.374928 Aug 18 11:40:21.835160 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1791/3433] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:21 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:21.845796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-16b1a02d-0c34-4d84-809b-30fd82311414 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:21.848150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-16b1a02d-0c34-4d84-809b-30fd82311414 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:21.865315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16b1a02d-0c34-4d84-809b-30fd82311414 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:21.869733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16b1a02d-0c34-4d84-809b-30fd82311414 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:21.870537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16b1a02d-0c34-4d84-809b-30fd82311414 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:21.871514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16b1a02d-0c34-4d84-809b-30fd82311414 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:21.871986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16b1a02d-0c34-4d84-809b-30fd82311414 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:21.872417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16b1a02d-0c34-4d84-809b-30fd82311414 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:22.273161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7c910516-43f2-4a7f-8068-3ebd3cd76c7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:22.285220 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7c910516-43f2-4a7f-8068-3ebd3cd76c7d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.571542 Aug 18 11:40:22.297912 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1643/3434] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:21 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:22.303664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-16b1a02d-0c34-4d84-809b-30fd82311414 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:22.304980 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4952182e-494b-4563-8130-3bd49249f60f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:22.305601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4952182e-494b-4563-8130-3bd49249f60f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:22.325798 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-16b1a02d-0c34-4d84-809b-30fd82311414 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1736 microversion: 2.1 time: 0.483490 Aug 18 11:40:22.344641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4952182e-494b-4563-8130-3bd49249f60f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:22.346472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4952182e-494b-4563-8130-3bd49249f60f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:22.346776 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1792/3435] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:21 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1736 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:22.348312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4952182e-494b-4563-8130-3bd49249f60f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:22.349488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4952182e-494b-4563-8130-3bd49249f60f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:22.359038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4952182e-494b-4563-8130-3bd49249f60f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:22.359918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4952182e-494b-4563-8130-3bd49249f60f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:22.364664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd34e70d-04a5-4327-be26-e2de8883defb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:22.365609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dd34e70d-04a5-4327-be26-e2de8883defb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:22.379141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd34e70d-04a5-4327-be26-e2de8883defb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:22.383964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd34e70d-04a5-4327-be26-e2de8883defb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:22.385064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd34e70d-04a5-4327-be26-e2de8883defb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:22.386177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd34e70d-04a5-4327-be26-e2de8883defb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:22.388507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd34e70d-04a5-4327-be26-e2de8883defb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:22.389193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd34e70d-04a5-4327-be26-e2de8883defb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:22.488227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4952182e-494b-4563-8130-3bd49249f60f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:22.493346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4952182e-494b-4563-8130-3bd49249f60f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:22.497883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4952182e-494b-4563-8130-3bd49249f60f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:22.502840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-4952182e-494b-4563-8130-3bd49249f60f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lazy-loading 'fault' on Instance uuid a2a906b8-26ea-4413-bed0-9c6f7a6be35c {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:40:22.615719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4952182e-494b-4563-8130-3bd49249f60f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd8451c50d941409a66864cbc1c7201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a985dc6f824e5b847a2d966c0f79af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:22.633029 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4952182e-494b-4563-8130-3bd49249f60f tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 200 len: 1329 microversion: 2.1 time: 0.333570 Aug 18 11:40:22.635578 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1644/3436] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:22 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 1329 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:22.865168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-71698fd9-a0e9-4b25-a13d-1c324fb9af30 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:22.867601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-71698fd9-a0e9-4b25-a13d-1c324fb9af30 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:22.882919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71698fd9-a0e9-4b25-a13d-1c324fb9af30 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:22.885505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71698fd9-a0e9-4b25-a13d-1c324fb9af30 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:22.886905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71698fd9-a0e9-4b25-a13d-1c324fb9af30 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:22.889463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71698fd9-a0e9-4b25-a13d-1c324fb9af30 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:22.891211 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71698fd9-a0e9-4b25-a13d-1c324fb9af30 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:22.892419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71698fd9-a0e9-4b25-a13d-1c324fb9af30 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:23.241063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd34e70d-04a5-4327-be26-e2de8883defb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:23.256696 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd34e70d-04a5-4327-be26-e2de8883defb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1523 microversion: 2.1 time: 0.896298 Aug 18 11:40:23.270832 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1793/3437] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:22 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1523 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:23.321068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8c78f31-5f88-44b2-b77d-2b82a78563b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:23.324002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e8c78f31-5f88-44b2-b77d-2b82a78563b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:23.335966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-71698fd9-a0e9-4b25-a13d-1c324fb9af30 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:23.339778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8c78f31-5f88-44b2-b77d-2b82a78563b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:23.341791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8c78f31-5f88-44b2-b77d-2b82a78563b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:23.344403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8c78f31-5f88-44b2-b77d-2b82a78563b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:23.346676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8c78f31-5f88-44b2-b77d-2b82a78563b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:23.347919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8c78f31-5f88-44b2-b77d-2b82a78563b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:23.348748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8c78f31-5f88-44b2-b77d-2b82a78563b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:23.354321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-71698fd9-a0e9-4b25-a13d-1c324fb9af30 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:23.359206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-71698fd9-a0e9-4b25-a13d-1c324fb9af30 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:23.362771 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-71698fd9-a0e9-4b25-a13d-1c324fb9af30 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.501502 Aug 18 11:40:23.364800 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1645/3438] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:22 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:40:23.373987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-37c55645-5625-40f9-81b2-74a6713c1882 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:23.379465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-37c55645-5625-40f9-81b2-74a6713c1882 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:23.394764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37c55645-5625-40f9-81b2-74a6713c1882 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:23.395654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37c55645-5625-40f9-81b2-74a6713c1882 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:23.396736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37c55645-5625-40f9-81b2-74a6713c1882 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:23.398196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37c55645-5625-40f9-81b2-74a6713c1882 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:23.399104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37c55645-5625-40f9-81b2-74a6713c1882 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:23.400588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37c55645-5625-40f9-81b2-74a6713c1882 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:23.611434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e8c78f31-5f88-44b2-b77d-2b82a78563b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:23.626305 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e8c78f31-5f88-44b2-b77d-2b82a78563b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.312850 Aug 18 11:40:23.628391 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1794/3439] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:23 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:23.661303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2308e4d-db0f-4e4c-9d98-deaca377d807 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:23.662970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b2308e4d-db0f-4e4c-9d98-deaca377d807 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] [instance: a2a906b8-26ea-4413-bed0-9c6f7a6be35c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:23.671673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2308e4d-db0f-4e4c-9d98-deaca377d807 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:23.673157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2308e4d-db0f-4e4c-9d98-deaca377d807 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:23.673959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2308e4d-db0f-4e4c-9d98-deaca377d807 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:23.675014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2308e4d-db0f-4e4c-9d98-deaca377d807 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:23.675637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2308e4d-db0f-4e4c-9d98-deaca377d807 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:23.676439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2308e4d-db0f-4e4c-9d98-deaca377d807 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:23.726759 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-b2308e4d-db0f-4e4c-9d98-deaca377d807 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] HTTP exception thrown: Instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c could not be found. Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2308e4d-db0f-4e4c-9d98-deaca377d807 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Request method failure captured: Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c HTTP/1.1 Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iLmk9InP0duM3a0KDx_rtZKV8FK6L1K2bxM2FY_EgJYqIM7l6-dvd1lSerO55Wyi5U4yj1fTG6Vc3OaZITag4LeT6S8IZr53KJqlR_jcP3WXpPplfH-I6YY1lxUr6Gwpsy1_3hY6Dk0Yq1AVixRwd4iEqTkfityyzTwlhBMvpVDaIo Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c1a985dc6f824e5b847a2d966c0f79af Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c1a985dc6f824e5b847a2d966c0f79af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c1a985dc6f824e5b847a2d966c0f79af Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-998907994 Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-998907994-project Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 0cd8451c50d941409a66864cbc1c7201 Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-998907994-project Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c could not be found. Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'a2a906b8-26ea-4413-bed0-9c6f7a6be35c'} Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c could not be found. Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c could not be found. Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:23.730351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:23.734761 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:23.734761 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:23.734761 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:23.734761 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:23.734761 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:23.734761 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c could not be found. Aug 18 11:40:23.734761 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:23.741172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2308e4d-db0f-4e4c-9d98-deaca377d807 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Returning 404 to user: Instance a2a906b8-26ea-4413-bed0-9c6f7a6be35c could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:23.744560 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b2308e4d-db0f-4e4c-9d98-deaca377d807 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c" status: 404 len: 111 microversion: 2.1 time: 0.085612 Aug 18 11:40:23.745613 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1795/3440] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:23 2022] GET /compute/v2.1/servers/a2a906b8-26ea-4413-bed0-9c6f7a6be35c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:40:23.758372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34909a42-1057-4c20-bc85-315362567ba8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] Calling method '.version_select at 0x7f519fe8fca0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:23.799246 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34909a42-1057-4c20-bc85-315362567ba8 tempest-ServerActionsTestJSON-998907994 tempest-ServerActionsTestJSON-998907994-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643977109" status: 202 len: 0 microversion: 2.1 time: 0.046183 Aug 18 11:40:23.800761 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1796/3441] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 11:40:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643977109 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:40:23.839386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-37c55645-5625-40f9-81b2-74a6713c1882 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:23.865846 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-37c55645-5625-40f9-81b2-74a6713c1882 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1716 microversion: 2.1 time: 0.498499 Aug 18 11:40:23.871556 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1646/3442] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:23 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1716 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:24.024110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94ed6507-52c6-408b-8481-71fb7b249433 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:24.025358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-94ed6507-52c6-408b-8481-71fb7b249433 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:24.036024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ed6507-52c6-408b-8481-71fb7b249433 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:24.037293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ed6507-52c6-408b-8481-71fb7b249433 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:24.038030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ed6507-52c6-408b-8481-71fb7b249433 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:24.038980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ed6507-52c6-408b-8481-71fb7b249433 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:24.041290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ed6507-52c6-408b-8481-71fb7b249433 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:24.042782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ed6507-52c6-408b-8481-71fb7b249433 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:24.204550 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-94ed6507-52c6-408b-8481-71fb7b249433 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] HTTP exception thrown: Cannot 'detach_volume' instance 7c22c788-0180-43df-aa4e-48363a89fa79 while it is in vm_state rescued Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94ed6507-52c6-408b-8481-71fb7b249433 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Request method failure captured: Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments/58a2bf56-93ad-40b0-9822-db418848d42f HTTP/1.1 Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iRDccV-wQBjWbehYJnvnYrqtEvDPnmmRi9FdLn90jlDwmLP7Yu8AV-Xjh3sRI2h6VdTdDxREaF_4Uw5JAlLnmy-pOyTW0C8AnpTCeGTveMx08cuhXqa0wk4T8c8YQiDTyaAtMLbCc_qByCh4ZjwOdEPthe4EaqbP1499Gbu30qZ6g8 Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 4eea5599d0754399a32a3ae3431ff18f Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: exception: Cannot 'detach_volume' instance 7c22c788-0180-43df-aa4e-48363a89fa79 while it is in vm_state rescued Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': '7c22c788-0180-43df-aa4e-48363a89fa79', 'id': '58a2bf56-93ad-40b0-9822-db418848d42f'} Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c22c788-0180-43df-aa4e-48363a89fa79 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7c22c788-0180-43df-aa4e-48363a89fa79 while it is in vm_state rescued Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:24.217111 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:40:24.226750 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:40:24.226750 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:40:24.226750 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:40:24.226750 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:40:24.226750 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7c22c788-0180-43df-aa4e-48363a89fa79 while it is in vm_state rescued Aug 18 11:40:24.226750 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:40:24.226750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94ed6507-52c6-408b-8481-71fb7b249433 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Returning 409 to user: Cannot 'detach_volume' instance 7c22c788-0180-43df-aa4e-48363a89fa79 while it is in vm_state rescued {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:40:24.226750 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-94ed6507-52c6-408b-8481-71fb7b249433 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments/58a2bf56-93ad-40b0-9822-db418848d42f" status: 409 len: 152 microversion: 2.1 time: 0.203418 Aug 18 11:40:24.226750 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1797/3443] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 11:40:24 2022] DELETE /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments/58a2bf56-93ad-40b0-9822-db418848d42f => generated 152 bytes in 205 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:40:24.233952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d7a25abf-150a-4563-b735-6bacdcc69f4b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:24.234836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d7a25abf-150a-4563-b735-6bacdcc69f4b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:24.252581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7a25abf-150a-4563-b735-6bacdcc69f4b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:24.253903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7a25abf-150a-4563-b735-6bacdcc69f4b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:24.254598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7a25abf-150a-4563-b735-6bacdcc69f4b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:24.255665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7a25abf-150a-4563-b735-6bacdcc69f4b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:24.256375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7a25abf-150a-4563-b735-6bacdcc69f4b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:24.257005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7a25abf-150a-4563-b735-6bacdcc69f4b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:24.284342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cc8e79b9-888c-4147-9c0f-66aa4f7035f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:24.285059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cc8e79b9-888c-4147-9c0f-66aa4f7035f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:24.299815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc8e79b9-888c-4147-9c0f-66aa4f7035f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:24.300619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc8e79b9-888c-4147-9c0f-66aa4f7035f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:24.301575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc8e79b9-888c-4147-9c0f-66aa4f7035f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:24.305125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc8e79b9-888c-4147-9c0f-66aa4f7035f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:24.307000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc8e79b9-888c-4147-9c0f-66aa4f7035f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:24.307792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc8e79b9-888c-4147-9c0f-66aa4f7035f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:24.376019 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d7a25abf-150a-4563-b735-6bacdcc69f4b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/action" status: 202 len: 0 microversion: 2.1 time: 0.149271 Aug 18 11:40:24.376691 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1647/3444] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:40:24 2022] POST /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:40:24.392782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a1c9933b-448b-48d1-9773-af3a5a8f26b9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:24.395522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a1c9933b-448b-48d1-9773-af3a5a8f26b9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:24.410729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1c9933b-448b-48d1-9773-af3a5a8f26b9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:24.411823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1c9933b-448b-48d1-9773-af3a5a8f26b9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:24.412696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1c9933b-448b-48d1-9773-af3a5a8f26b9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:24.413974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1c9933b-448b-48d1-9773-af3a5a8f26b9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:24.415030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1c9933b-448b-48d1-9773-af3a5a8f26b9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:24.415913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1c9933b-448b-48d1-9773-af3a5a8f26b9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:24.757506 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a1c9933b-448b-48d1-9773-af3a5a8f26b9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:24.770178 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a1c9933b-448b-48d1-9773-af3a5a8f26b9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1724 microversion: 2.1 time: 0.388184 Aug 18 11:40:24.771223 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1648/3445] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:24 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1724 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:24.787000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-48c48e87-beb9-4436-88c7-08b81e092adb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:24.788194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-48c48e87-beb9-4436-88c7-08b81e092adb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:24.797011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48c48e87-beb9-4436-88c7-08b81e092adb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:24.797890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48c48e87-beb9-4436-88c7-08b81e092adb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:24.798694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48c48e87-beb9-4436-88c7-08b81e092adb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:24.799710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48c48e87-beb9-4436-88c7-08b81e092adb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:24.800481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48c48e87-beb9-4436-88c7-08b81e092adb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:24.801322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48c48e87-beb9-4436-88c7-08b81e092adb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:24.815683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cc8e79b9-888c-4147-9c0f-66aa4f7035f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:24.831110 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cc8e79b9-888c-4147-9c0f-66aa4f7035f0 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1523 microversion: 2.1 time: 0.552116 Aug 18 11:40:24.831980 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1798/3446] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:24 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1523 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:24.846393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5ad03460-570a-44c7-9cd0-4de8d9914af4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:24.847304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5ad03460-570a-44c7-9cd0-4de8d9914af4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:24.858388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ad03460-570a-44c7-9cd0-4de8d9914af4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:24.871262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ad03460-570a-44c7-9cd0-4de8d9914af4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:24.871725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ad03460-570a-44c7-9cd0-4de8d9914af4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:24.872487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ad03460-570a-44c7-9cd0-4de8d9914af4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:24.872959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ad03460-570a-44c7-9cd0-4de8d9914af4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:24.873399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ad03460-570a-44c7-9cd0-4de8d9914af4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:25.170031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-48c48e87-beb9-4436-88c7-08b81e092adb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:25.186943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-48c48e87-beb9-4436-88c7-08b81e092adb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:25.188959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-48c48e87-beb9-4436-88c7-08b81e092adb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:25.190633 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-48c48e87-beb9-4436-88c7-08b81e092adb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.418079 Aug 18 11:40:25.191850 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1649/3447] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:24 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:25.461262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5ad03460-570a-44c7-9cd0-4de8d9914af4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:25.480411 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5ad03460-570a-44c7-9cd0-4de8d9914af4 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.644690 Aug 18 11:40:25.482137 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1799/3448] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:24 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:25.812582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d1372895-0b4d-4d6f-85d4-09b31dabdd9d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:25.814035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d1372895-0b4d-4d6f-85d4-09b31dabdd9d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:25.828376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1372895-0b4d-4d6f-85d4-09b31dabdd9d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:25.829527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1372895-0b4d-4d6f-85d4-09b31dabdd9d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:25.830337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1372895-0b4d-4d6f-85d4-09b31dabdd9d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:25.831646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1372895-0b4d-4d6f-85d4-09b31dabdd9d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:25.832797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1372895-0b4d-4d6f-85d4-09b31dabdd9d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:25.833836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d1372895-0b4d-4d6f-85d4-09b31dabdd9d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:25.874379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-993f89ed-a509-4282-b10a-81469f5dc403 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:25.875062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-993f89ed-a509-4282-b10a-81469f5dc403 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:25.891536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-993f89ed-a509-4282-b10a-81469f5dc403 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:25.892051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-993f89ed-a509-4282-b10a-81469f5dc403 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:25.892686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-993f89ed-a509-4282-b10a-81469f5dc403 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:25.893616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-993f89ed-a509-4282-b10a-81469f5dc403 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:25.894276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-993f89ed-a509-4282-b10a-81469f5dc403 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:25.894924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-993f89ed-a509-4282-b10a-81469f5dc403 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:26.194244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-993f89ed-a509-4282-b10a-81469f5dc403 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:26.208784 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-993f89ed-a509-4282-b10a-81469f5dc403 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1523 microversion: 2.1 time: 0.339894 Aug 18 11:40:26.209391 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1800/3449] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:25 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:26.219739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-388703dd-56b4-4e8d-be94-f011141bf66d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:26.220627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-388703dd-56b4-4e8d-be94-f011141bf66d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:26.231552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-388703dd-56b4-4e8d-be94-f011141bf66d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:26.232400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-388703dd-56b4-4e8d-be94-f011141bf66d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:26.233211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-388703dd-56b4-4e8d-be94-f011141bf66d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:26.234959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-388703dd-56b4-4e8d-be94-f011141bf66d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:26.235603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-388703dd-56b4-4e8d-be94-f011141bf66d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:26.236407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-388703dd-56b4-4e8d-be94-f011141bf66d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:26.286521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d1372895-0b4d-4d6f-85d4-09b31dabdd9d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:26.303168 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d1372895-0b4d-4d6f-85d4-09b31dabdd9d tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1724 microversion: 2.1 time: 0.491446 Aug 18 11:40:26.304195 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1650/3450] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:25 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1724 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:26.320972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-4ae8b7e8-9e9f-407f-8b82-ec0de185b705 req-65dd4bfd-3674-45b0-b590-135443432658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3cf4491-1d85-4cb5-bee0-b99814a14635", "name": "network-vif-unplugged", "status": "completed", "tag": "e724b4d0-2e09-4dc2-8433-c5394839ba16"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:26.334924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4ae8b7e8-9e9f-407f-8b82-ec0de185b705 req-65dd4bfd-3674-45b0-b590-135443432658 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:26.335860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4ae8b7e8-9e9f-407f-8b82-ec0de185b705 req-65dd4bfd-3674-45b0-b590-135443432658 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:26.336524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4ae8b7e8-9e9f-407f-8b82-ec0de185b705 req-65dd4bfd-3674-45b0-b590-135443432658 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:26.350513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:26.353515 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-4ae8b7e8-9e9f-407f-8b82-ec0de185b705 req-65dd4bfd-3674-45b0-b590-135443432658 service nova] Creating event network-vif-unplugged:e724b4d0-2e09-4dc2-8433-c5394839ba16 for instance b3cf4491-1d85-4cb5-bee0-b99814a14635 on n-h1-853611-3 Aug 18 11:40:26.360641 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-4ae8b7e8-9e9f-407f-8b82-ec0de185b705 req-65dd4bfd-3674-45b0-b590-135443432658 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055018 Aug 18 11:40:26.361949 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1651/3451] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:26.506585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e83b9ba3-4deb-4741-8aca-365b2fea6c41 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:26.508383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e83b9ba3-4deb-4741-8aca-365b2fea6c41 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:26.523024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e83b9ba3-4deb-4741-8aca-365b2fea6c41 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:26.525630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e83b9ba3-4deb-4741-8aca-365b2fea6c41 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:26.526390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e83b9ba3-4deb-4741-8aca-365b2fea6c41 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:26.527429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e83b9ba3-4deb-4741-8aca-365b2fea6c41 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:26.528155 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e83b9ba3-4deb-4741-8aca-365b2fea6c41 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:26.528809 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e83b9ba3-4deb-4741-8aca-365b2fea6c41 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:26.726492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-388703dd-56b4-4e8d-be94-f011141bf66d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:26.746966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-388703dd-56b4-4e8d-be94-f011141bf66d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:26.750686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-388703dd-56b4-4e8d-be94-f011141bf66d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:26.752696 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-388703dd-56b4-4e8d-be94-f011141bf66d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.537091 Aug 18 11:40:26.753987 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1801/3452] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:26 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:27.237898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-651848e3-6010-48f4-818b-ad7eb7754846 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:27.239194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-651848e3-6010-48f4-818b-ad7eb7754846 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:27.242194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e83b9ba3-4deb-4741-8aca-365b2fea6c41 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:27.252386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-651848e3-6010-48f4-818b-ad7eb7754846 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:27.253243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-651848e3-6010-48f4-818b-ad7eb7754846 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:27.254127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-651848e3-6010-48f4-818b-ad7eb7754846 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:27.259499 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e83b9ba3-4deb-4741-8aca-365b2fea6c41 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.759064 Aug 18 11:40:27.260090 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1652/3453] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:26 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:27.276726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-651848e3-6010-48f4-818b-ad7eb7754846 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:27.276726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-651848e3-6010-48f4-818b-ad7eb7754846 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:27.277095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-651848e3-6010-48f4-818b-ad7eb7754846 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:27.324733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-00933a67-75c2-47f8-979e-8ff26ad8aad1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:27.325604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-00933a67-75c2-47f8-979e-8ff26ad8aad1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:27.332433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00933a67-75c2-47f8-979e-8ff26ad8aad1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:27.333106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00933a67-75c2-47f8-979e-8ff26ad8aad1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:27.333789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00933a67-75c2-47f8-979e-8ff26ad8aad1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:27.334720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00933a67-75c2-47f8-979e-8ff26ad8aad1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:27.336702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00933a67-75c2-47f8-979e-8ff26ad8aad1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:27.337376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00933a67-75c2-47f8-979e-8ff26ad8aad1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:27.630991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-00933a67-75c2-47f8-979e-8ff26ad8aad1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:27.657815 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-00933a67-75c2-47f8-979e-8ff26ad8aad1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1724 microversion: 2.1 time: 0.337150 Aug 18 11:40:27.676246 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1653/3454] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:27 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:27.784424 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-34b943b0-b5e7-4f5d-aaaf-ca1e30d8310b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:27.785687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-34b943b0-b5e7-4f5d-aaaf-ca1e30d8310b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:27.794089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34b943b0-b5e7-4f5d-aaaf-ca1e30d8310b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:27.795091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34b943b0-b5e7-4f5d-aaaf-ca1e30d8310b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:27.795828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34b943b0-b5e7-4f5d-aaaf-ca1e30d8310b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:27.796928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34b943b0-b5e7-4f5d-aaaf-ca1e30d8310b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:27.797718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34b943b0-b5e7-4f5d-aaaf-ca1e30d8310b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:27.798466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34b943b0-b5e7-4f5d-aaaf-ca1e30d8310b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:28.215351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-34b943b0-b5e7-4f5d-aaaf-ca1e30d8310b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:28.226296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-34b943b0-b5e7-4f5d-aaaf-ca1e30d8310b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:28.231791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-34b943b0-b5e7-4f5d-aaaf-ca1e30d8310b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:28.240880 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-34b943b0-b5e7-4f5d-aaaf-ca1e30d8310b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.460487 Aug 18 11:40:28.247517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-651848e3-6010-48f4-818b-ad7eb7754846 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:28.259370 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1654/3455] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:27 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:40:28.277177 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-651848e3-6010-48f4-818b-ad7eb7754846 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1523 microversion: 2.1 time: 1.043543 Aug 18 11:40:28.278163 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1802/3456] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:27 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1523 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:28.286577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e01ca4db-f0ff-4209-ac2c-6033686dd2ac tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:28.290259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e01ca4db-f0ff-4209-ac2c-6033686dd2ac tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:28.306253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e01ca4db-f0ff-4209-ac2c-6033686dd2ac tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:28.310861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e01ca4db-f0ff-4209-ac2c-6033686dd2ac tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:28.314000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e01ca4db-f0ff-4209-ac2c-6033686dd2ac tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:28.314762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e01ca4db-f0ff-4209-ac2c-6033686dd2ac tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:28.315513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e01ca4db-f0ff-4209-ac2c-6033686dd2ac tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:28.316808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e01ca4db-f0ff-4209-ac2c-6033686dd2ac tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:28.696250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f3a0ee0-fe4a-46fb-bf7f-1a7681f04e51 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:28.697353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7f3a0ee0-fe4a-46fb-bf7f-1a7681f04e51 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:28.704302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f3a0ee0-fe4a-46fb-bf7f-1a7681f04e51 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:28.705049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f3a0ee0-fe4a-46fb-bf7f-1a7681f04e51 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:28.705818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f3a0ee0-fe4a-46fb-bf7f-1a7681f04e51 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:28.717133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f3a0ee0-fe4a-46fb-bf7f-1a7681f04e51 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:28.717861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f3a0ee0-fe4a-46fb-bf7f-1a7681f04e51 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:28.718517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f3a0ee0-fe4a-46fb-bf7f-1a7681f04e51 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:28.802512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e01ca4db-f0ff-4209-ac2c-6033686dd2ac tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:28.834696 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e01ca4db-f0ff-4209-ac2c-6033686dd2ac tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.552628 Aug 18 11:40:28.838223 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1655/3457] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:28 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:29.284438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eb831f9b-d226-456f-9bbd-e6ce3ae7812c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:29.288926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-eb831f9b-d226-456f-9bbd-e6ce3ae7812c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:29.320352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb831f9b-d226-456f-9bbd-e6ce3ae7812c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:29.322507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb831f9b-d226-456f-9bbd-e6ce3ae7812c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:29.327622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb831f9b-d226-456f-9bbd-e6ce3ae7812c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:29.329086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb831f9b-d226-456f-9bbd-e6ce3ae7812c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:29.329962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb831f9b-d226-456f-9bbd-e6ce3ae7812c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:29.343221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb831f9b-d226-456f-9bbd-e6ce3ae7812c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:29.401457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7f3a0ee0-fe4a-46fb-bf7f-1a7681f04e51 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:29.453646 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7f3a0ee0-fe4a-46fb-bf7f-1a7681f04e51 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1730 microversion: 2.1 time: 0.752734 Aug 18 11:40:29.466189 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1803/3458] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:28 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1730 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:29.478718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d9a553ad-83b7-4764-9fb1-b34d096bd305 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:29.485570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d9a553ad-83b7-4764-9fb1-b34d096bd305 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:29.500500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9a553ad-83b7-4764-9fb1-b34d096bd305 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:29.501356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9a553ad-83b7-4764-9fb1-b34d096bd305 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:29.502053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9a553ad-83b7-4764-9fb1-b34d096bd305 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:29.503101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9a553ad-83b7-4764-9fb1-b34d096bd305 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:29.503830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9a553ad-83b7-4764-9fb1-b34d096bd305 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:29.515630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9a553ad-83b7-4764-9fb1-b34d096bd305 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:30.289461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eb831f9b-d226-456f-9bbd-e6ce3ae7812c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:30.333391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eb831f9b-d226-456f-9bbd-e6ce3ae7812c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:30.336551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eb831f9b-d226-456f-9bbd-e6ce3ae7812c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:30.338546 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eb831f9b-d226-456f-9bbd-e6ce3ae7812c tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 1.070528 Aug 18 11:40:30.355655 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1656/3459] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:29 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:40:30.369817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f06f5f80-4212-4205-8e5b-454605926b03 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:30.370875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f06f5f80-4212-4205-8e5b-454605926b03 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:30.381828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f06f5f80-4212-4205-8e5b-454605926b03 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:30.384962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f06f5f80-4212-4205-8e5b-454605926b03 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:30.394355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f06f5f80-4212-4205-8e5b-454605926b03 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:30.395635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f06f5f80-4212-4205-8e5b-454605926b03 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:30.396303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f06f5f80-4212-4205-8e5b-454605926b03 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:30.397275 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f06f5f80-4212-4205-8e5b-454605926b03 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:30.492257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d9a553ad-83b7-4764-9fb1-b34d096bd305 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:30.501666 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d9a553ad-83b7-4764-9fb1-b34d096bd305 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1523 microversion: 2.1 time: 1.030045 Aug 18 11:40:30.503205 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1804/3460] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:29 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1523 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:30.507868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f9bc2fbe-bc1b-43cb-bac8-9e37527970a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:30.517985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f9bc2fbe-bc1b-43cb-bac8-9e37527970a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:30.525331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9bc2fbe-bc1b-43cb-bac8-9e37527970a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:30.532109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9bc2fbe-bc1b-43cb-bac8-9e37527970a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:30.532882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9bc2fbe-bc1b-43cb-bac8-9e37527970a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:30.533831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9bc2fbe-bc1b-43cb-bac8-9e37527970a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:30.534498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9bc2fbe-bc1b-43cb-bac8-9e37527970a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:30.535101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9bc2fbe-bc1b-43cb-bac8-9e37527970a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:30.909539 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f06f5f80-4212-4205-8e5b-454605926b03 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.552107 Aug 18 11:40:30.911222 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1657/3461] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:40:30 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-interface => generated 285 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:30.917742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-b2f3148e-3998-4280-9055-7694dc5d8ab9 req-50811ba8-338e-4ca1-b101-6a39c931b393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3cf4491-1d85-4cb5-bee0-b99814a14635", "name": "network-vif-plugged", "status": "completed", "tag": "e724b4d0-2e09-4dc2-8433-c5394839ba16"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:30.954766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b2f3148e-3998-4280-9055-7694dc5d8ab9 req-50811ba8-338e-4ca1-b101-6a39c931b393 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:30.955861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b2f3148e-3998-4280-9055-7694dc5d8ab9 req-50811ba8-338e-4ca1-b101-6a39c931b393 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:30.956552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b2f3148e-3998-4280-9055-7694dc5d8ab9 req-50811ba8-338e-4ca1-b101-6a39c931b393 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:30.993812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f9bc2fbe-bc1b-43cb-bac8-9e37527970a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:31.017959 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f9bc2fbe-bc1b-43cb-bac8-9e37527970a9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.513736 Aug 18 11:40:31.027170 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1805/3462] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:30 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:31.029387 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-b2f3148e-3998-4280-9055-7694dc5d8ab9 req-50811ba8-338e-4ca1-b101-6a39c931b393 service nova] Creating event network-vif-plugged:e724b4d0-2e09-4dc2-8433-c5394839ba16 for instance b3cf4491-1d85-4cb5-bee0-b99814a14635 on n-h1-853611-3 Aug 18 11:40:31.063053 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-b2f3148e-3998-4280-9055-7694dc5d8ab9 req-50811ba8-338e-4ca1-b101-6a39c931b393 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125653 Aug 18 11:40:31.081556 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1658/3463] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:31.375807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-23713d8f-e80f-411f-a818-ef12ee490dcb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:31.384765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-23713d8f-e80f-411f-a818-ef12ee490dcb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:31.421685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23713d8f-e80f-411f-a818-ef12ee490dcb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:31.422932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23713d8f-e80f-411f-a818-ef12ee490dcb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:31.423839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23713d8f-e80f-411f-a818-ef12ee490dcb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:31.424809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23713d8f-e80f-411f-a818-ef12ee490dcb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:31.425722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23713d8f-e80f-411f-a818-ef12ee490dcb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:31.426363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23713d8f-e80f-411f-a818-ef12ee490dcb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:31.532362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-db607d77-634d-43ca-ad1d-49b7afc1a0a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:31.542009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-db607d77-634d-43ca-ad1d-49b7afc1a0a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:31.559347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db607d77-634d-43ca-ad1d-49b7afc1a0a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:31.560605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db607d77-634d-43ca-ad1d-49b7afc1a0a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:31.561263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db607d77-634d-43ca-ad1d-49b7afc1a0a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:31.562023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db607d77-634d-43ca-ad1d-49b7afc1a0a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:31.562715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db607d77-634d-43ca-ad1d-49b7afc1a0a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:31.563351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db607d77-634d-43ca-ad1d-49b7afc1a0a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:32.201070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-db607d77-634d-43ca-ad1d-49b7afc1a0a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:32.224060 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-db607d77-634d-43ca-ad1d-49b7afc1a0a4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1523 microversion: 2.1 time: 0.702296 Aug 18 11:40:32.224676 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1659/3464] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:31 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1523 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:32.236551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-92a373bb-0ef5-4496-8ae0-03c15dc63e19 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:32.237184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-92a373bb-0ef5-4496-8ae0-03c15dc63e19 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:32.255068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92a373bb-0ef5-4496-8ae0-03c15dc63e19 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:32.256286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92a373bb-0ef5-4496-8ae0-03c15dc63e19 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:32.256794 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92a373bb-0ef5-4496-8ae0-03c15dc63e19 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:32.260368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92a373bb-0ef5-4496-8ae0-03c15dc63e19 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:32.261220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92a373bb-0ef5-4496-8ae0-03c15dc63e19 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:32.261976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92a373bb-0ef5-4496-8ae0-03c15dc63e19 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:32.751177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-23713d8f-e80f-411f-a818-ef12ee490dcb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:32.773270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-23713d8f-e80f-411f-a818-ef12ee490dcb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:32.780041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-23713d8f-e80f-411f-a818-ef12ee490dcb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:32.782069 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-23713d8f-e80f-411f-a818-ef12ee490dcb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 1.410694 Aug 18 11:40:32.800183 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1806/3465] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:31 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:33.172189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2754ba0a-9b27-4524-b9aa-2f54d712fa1e req-3629e6a6-84de-42a2-825b-438472752be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-plugged", "status": "completed", "tag": "7e3a32b5-0288-4b94-9154-5891994bd66b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:33.232200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2754ba0a-9b27-4524-b9aa-2f54d712fa1e req-3629e6a6-84de-42a2-825b-438472752be8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:33.233077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2754ba0a-9b27-4524-b9aa-2f54d712fa1e req-3629e6a6-84de-42a2-825b-438472752be8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:33.235044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2754ba0a-9b27-4524-b9aa-2f54d712fa1e req-3629e6a6-84de-42a2-825b-438472752be8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:33.285640 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2754ba0a-9b27-4524-b9aa-2f54d712fa1e req-3629e6a6-84de-42a2-825b-438472752be8 service nova] Creating event network-vif-plugged:7e3a32b5-0288-4b94-9154-5891994bd66b for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:40:33.317944 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2754ba0a-9b27-4524-b9aa-2f54d712fa1e req-3629e6a6-84de-42a2-825b-438472752be8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150069 Aug 18 11:40:33.324898 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1807/3466] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:40:33.340732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94724ab1-6965-4f5d-ac51-d86527f66aa4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:33.343480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-94724ab1-6965-4f5d-ac51-d86527f66aa4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:33.372517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94724ab1-6965-4f5d-ac51-d86527f66aa4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:33.373158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94724ab1-6965-4f5d-ac51-d86527f66aa4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:33.373760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94724ab1-6965-4f5d-ac51-d86527f66aa4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:33.379310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94724ab1-6965-4f5d-ac51-d86527f66aa4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:33.381038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94724ab1-6965-4f5d-ac51-d86527f66aa4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:33.382085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94724ab1-6965-4f5d-ac51-d86527f66aa4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:33.447132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:33.474459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-92a373bb-0ef5-4496-8ae0-03c15dc63e19 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:33.489001 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-92a373bb-0ef5-4496-8ae0-03c15dc63e19 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 1.262756 Aug 18 11:40:33.493500 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1660/3467] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:32 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:33.809996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fbb94dc1-c78f-402c-af4f-4e46c2f1744f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:33.810654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fbb94dc1-c78f-402c-af4f-4e46c2f1744f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:33.826989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbb94dc1-c78f-402c-af4f-4e46c2f1744f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:33.827493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbb94dc1-c78f-402c-af4f-4e46c2f1744f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:33.827941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbb94dc1-c78f-402c-af4f-4e46c2f1744f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:33.828688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbb94dc1-c78f-402c-af4f-4e46c2f1744f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:33.829154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbb94dc1-c78f-402c-af4f-4e46c2f1744f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:33.829591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbb94dc1-c78f-402c-af4f-4e46c2f1744f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:34.182113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-94724ab1-6965-4f5d-ac51-d86527f66aa4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:34.213309 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-94724ab1-6965-4f5d-ac51-d86527f66aa4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1508 microversion: 2.1 time: 0.884850 Aug 18 11:40:34.215570 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1808/3468] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:33 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1508 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:34.235943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5693e7ed-493d-450e-8252-ffd6e46f5d50 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:34.236513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5693e7ed-493d-450e-8252-ffd6e46f5d50 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:34.243743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5693e7ed-493d-450e-8252-ffd6e46f5d50 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:34.244241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5693e7ed-493d-450e-8252-ffd6e46f5d50 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:34.244906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5693e7ed-493d-450e-8252-ffd6e46f5d50 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:34.245837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5693e7ed-493d-450e-8252-ffd6e46f5d50 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:34.246500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5693e7ed-493d-450e-8252-ffd6e46f5d50 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:34.247101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5693e7ed-493d-450e-8252-ffd6e46f5d50 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:34.356581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fbb94dc1-c78f-402c-af4f-4e46c2f1744f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:34.408617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fbb94dc1-c78f-402c-af4f-4e46c2f1744f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:34.424031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fbb94dc1-c78f-402c-af4f-4e46c2f1744f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:34.428093 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fbb94dc1-c78f-402c-af4f-4e46c2f1744f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.621892 Aug 18 11:40:34.431252 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1661/3469] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:33 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:40:34.464493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-1d1c4c3a-4671-4ad1-8ddc-4ccbb8bc39aa req-fbad1635-b8a5-408a-997c-c223df20d310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c22c788-0180-43df-aa4e-48363a89fa79", "tag": "3e914982-c66b-4b57-9305-0f9bbe300f7e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:34.516967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1d1c4c3a-4671-4ad1-8ddc-4ccbb8bc39aa req-fbad1635-b8a5-408a-997c-c223df20d310 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:34.519859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1d1c4c3a-4671-4ad1-8ddc-4ccbb8bc39aa req-fbad1635-b8a5-408a-997c-c223df20d310 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:34.521777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1d1c4c3a-4671-4ad1-8ddc-4ccbb8bc39aa req-fbad1635-b8a5-408a-997c-c223df20d310 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:34.553368 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-1d1c4c3a-4671-4ad1-8ddc-4ccbb8bc39aa req-fbad1635-b8a5-408a-997c-c223df20d310 service nova] Creating event network-changed:3e914982-c66b-4b57-9305-0f9bbe300f7e for instance 7c22c788-0180-43df-aa4e-48363a89fa79 on n-h1-853611-3 Aug 18 11:40:34.566102 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-1d1c4c3a-4671-4ad1-8ddc-4ccbb8bc39aa req-fbad1635-b8a5-408a-997c-c223df20d310 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109709 Aug 18 11:40:34.575284 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1662/3470] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:40:34.640041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bf773a62-d247-4259-9f7d-2ca410c91a3c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:34.645727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bf773a62-d247-4259-9f7d-2ca410c91a3c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:34.697999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf773a62-d247-4259-9f7d-2ca410c91a3c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:34.700102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf773a62-d247-4259-9f7d-2ca410c91a3c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:34.703378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf773a62-d247-4259-9f7d-2ca410c91a3c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:34.706241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf773a62-d247-4259-9f7d-2ca410c91a3c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:34.708517 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf773a62-d247-4259-9f7d-2ca410c91a3c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:34.711827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf773a62-d247-4259-9f7d-2ca410c91a3c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:35.003465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5693e7ed-493d-450e-8252-ffd6e46f5d50 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:35.023194 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5693e7ed-493d-450e-8252-ffd6e46f5d50 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 200 len: 1508 microversion: 2.1 time: 0.782897 Aug 18 11:40:35.024814 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1809/3471] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:34 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 1508 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:35.050818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d10c59e-ff2c-48a8-af56-d80a63577289 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:35.051683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2d10c59e-ff2c-48a8-af56-d80a63577289 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:35.059102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d10c59e-ff2c-48a8-af56-d80a63577289 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:35.059904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d10c59e-ff2c-48a8-af56-d80a63577289 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:35.060498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d10c59e-ff2c-48a8-af56-d80a63577289 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:35.061417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d10c59e-ff2c-48a8-af56-d80a63577289 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:35.062059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d10c59e-ff2c-48a8-af56-d80a63577289 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:35.062705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d10c59e-ff2c-48a8-af56-d80a63577289 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:35.105319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2d10c59e-ff2c-48a8-af56-d80a63577289 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:40:35.216966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bf773a62-d247-4259-9f7d-2ca410c91a3c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:35.250942 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bf773a62-d247-4259-9f7d-2ca410c91a3c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.668364 Aug 18 11:40:35.267961 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1663/3472] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:34 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:35.296890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:35.309169 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d10c59e-ff2c-48a8-af56-d80a63577289 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 204 len: 0 microversion: 2.1 time: 0.263720 Aug 18 11:40:35.317097 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1810/3473] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:40:35 2022] DELETE /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:40:35.401932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-5abd0282-6160-4e17-b254-45040b8be1e1 req-9bb6861b-b8a6-44ce-a902-92100822c6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-plugged", "status": "completed", "tag": "7e93816f-c07f-4c92-8bba-fbb519c88407"}, {"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-plugged", "status": "completed", "tag": "859fae89-a340-43ad-b582-571eb9a2c528"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:35.421327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5abd0282-6160-4e17-b254-45040b8be1e1 req-9bb6861b-b8a6-44ce-a902-92100822c6e9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:35.423270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5abd0282-6160-4e17-b254-45040b8be1e1 req-9bb6861b-b8a6-44ce-a902-92100822c6e9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:35.425179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5abd0282-6160-4e17-b254-45040b8be1e1 req-9bb6861b-b8a6-44ce-a902-92100822c6e9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:35.446646 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5abd0282-6160-4e17-b254-45040b8be1e1 req-9bb6861b-b8a6-44ce-a902-92100822c6e9 service nova] Creating event network-vif-plugged:7e93816f-c07f-4c92-8bba-fbb519c88407 for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:40:35.447610 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5abd0282-6160-4e17-b254-45040b8be1e1 req-9bb6861b-b8a6-44ce-a902-92100822c6e9 service nova] Creating event network-vif-plugged:859fae89-a340-43ad-b582-571eb9a2c528 for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:40:35.457642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-953b1cce-66b2-4340-9c09-3d42c1b25e59 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:35.458767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-953b1cce-66b2-4340-9c09-3d42c1b25e59 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:35.459845 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-5abd0282-6160-4e17-b254-45040b8be1e1 req-9bb6861b-b8a6-44ce-a902-92100822c6e9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066809 Aug 18 11:40:35.461841 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1664/3474] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:35.486802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-953b1cce-66b2-4340-9c09-3d42c1b25e59 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:35.489859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-953b1cce-66b2-4340-9c09-3d42c1b25e59 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:35.492214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-953b1cce-66b2-4340-9c09-3d42c1b25e59 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:35.496261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-953b1cce-66b2-4340-9c09-3d42c1b25e59 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:35.499520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-953b1cce-66b2-4340-9c09-3d42c1b25e59 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:35.501048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-953b1cce-66b2-4340-9c09-3d42c1b25e59 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:35.625136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1554688560", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "ce8567ca-6e19-499c-8a23-37988a209b75"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:35.718203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] validate_networks() for [('ce8567ca-6e19-499c-8a23-37988a209b75', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:40:36.334737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-953b1cce-66b2-4340-9c09-3d42c1b25e59 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:36.357061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-953b1cce-66b2-4340-9c09-3d42c1b25e59 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:36.368848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-953b1cce-66b2-4340-9c09-3d42c1b25e59 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:36.372387 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-953b1cce-66b2-4340-9c09-3d42c1b25e59 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.919927 Aug 18 11:40:36.376227 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1811/3475] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:35 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:40:36.391953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94dd9c99-1f84-4be1-8833-21356b418674 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:36.393632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-94dd9c99-1f84-4be1-8833-21356b418674 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:36.432028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94dd9c99-1f84-4be1-8833-21356b418674 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:36.433159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94dd9c99-1f84-4be1-8833-21356b418674 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:36.433803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94dd9c99-1f84-4be1-8833-21356b418674 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:36.435733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94dd9c99-1f84-4be1-8833-21356b418674 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:36.446592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94dd9c99-1f84-4be1-8833-21356b418674 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:36.447639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94dd9c99-1f84-4be1-8833-21356b418674 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:37.044917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-94dd9c99-1f84-4be1-8833-21356b418674 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:37.054704 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-94dd9c99-1f84-4be1-8833-21356b418674 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.673256 Aug 18 11:40:37.062352 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1812/3476] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:36 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:37.080979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-52b68dcd-f570-4eb1-b32a-7c25fe202350 req-4c25ad72-4d75-4e71-a1a7-41aef715f0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c22c788-0180-43df-aa4e-48363a89fa79", "tag": "3e914982-c66b-4b57-9305-0f9bbe300f7e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:37.118539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-52b68dcd-f570-4eb1-b32a-7c25fe202350 req-4c25ad72-4d75-4e71-a1a7-41aef715f0a0 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:37.120073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-52b68dcd-f570-4eb1-b32a-7c25fe202350 req-4c25ad72-4d75-4e71-a1a7-41aef715f0a0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:37.128594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-52b68dcd-f570-4eb1-b32a-7c25fe202350 req-4c25ad72-4d75-4e71-a1a7-41aef715f0a0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:37.152257 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-52b68dcd-f570-4eb1-b32a-7c25fe202350 req-4c25ad72-4d75-4e71-a1a7-41aef715f0a0 service nova] Creating event network-changed:3e914982-c66b-4b57-9305-0f9bbe300f7e for instance 7c22c788-0180-43df-aa4e-48363a89fa79 on n-h1-853611-3 Aug 18 11:40:37.158944 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-52b68dcd-f570-4eb1-b32a-7c25fe202350 req-4c25ad72-4d75-4e71-a1a7-41aef715f0a0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093768 Aug 18 11:40:37.160253 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1813/3477] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:37.472497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1206527246", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:37.614530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] validate_networks() for [('a5e24502-ae41-41ef-a275-de04ab0068ad', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:40:37.810408 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:40:37.812836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:40:37.814067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:40:37.814847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:40:37.815564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:40:37.882161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:37.884081 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:37.884898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:37.887276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:37.890549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:37.892840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:37.951117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Getting quotas for project 538a71f94fd54403a20347030509ef69. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:40:37.969856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Getting quotas for user 25a235b1ba7e4f7d8d7a7c424b80c823 and project 538a71f94fd54403a20347030509ef69. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:40:38.019993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:40:38.032228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:40:38.161227 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-40d46d86-f397-4b6d-9260-2da6c87aaef4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.544581 Aug 18 11:40:38.162397 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1665/3478] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:40:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:40:38.169189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d15d8d8a-69f4-4aa1-98f2-07426b4d93f9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:38.170282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d15d8d8a-69f4-4aa1-98f2-07426b4d93f9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:38.180432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d15d8d8a-69f4-4aa1-98f2-07426b4d93f9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:38.181330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d15d8d8a-69f4-4aa1-98f2-07426b4d93f9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:38.182167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d15d8d8a-69f4-4aa1-98f2-07426b4d93f9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:38.183508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d15d8d8a-69f4-4aa1-98f2-07426b4d93f9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:38.184199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d15d8d8a-69f4-4aa1-98f2-07426b4d93f9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:38.184791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d15d8d8a-69f4-4aa1-98f2-07426b4d93f9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:38.686797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d15d8d8a-69f4-4aa1-98f2-07426b4d93f9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:38.707243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d15d8d8a-69f4-4aa1-98f2-07426b4d93f9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:38.710177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d15d8d8a-69f4-4aa1-98f2-07426b4d93f9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:38.715894 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d15d8d8a-69f4-4aa1-98f2-07426b4d93f9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.551012 Aug 18 11:40:38.717256 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1666/3479] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:38 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:38.744408 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-023bcec6-2f83-4a2c-8e14-4a75e78efe5e req-be8bf93a-5d78-4eef-99bf-dc363aad9978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-plugged", "status": "completed", "tag": "24885c1e-8ab4-4480-b962-978b2d7e12d7"}, {"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-plugged", "status": "completed", "tag": "b3b7c180-3e64-4262-a77c-687b117445ae"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:38.778512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-023bcec6-2f83-4a2c-8e14-4a75e78efe5e req-be8bf93a-5d78-4eef-99bf-dc363aad9978 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:38.781455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-023bcec6-2f83-4a2c-8e14-4a75e78efe5e req-be8bf93a-5d78-4eef-99bf-dc363aad9978 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:38.784177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-023bcec6-2f83-4a2c-8e14-4a75e78efe5e req-be8bf93a-5d78-4eef-99bf-dc363aad9978 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:38.839416 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-023bcec6-2f83-4a2c-8e14-4a75e78efe5e req-be8bf93a-5d78-4eef-99bf-dc363aad9978 service nova] Creating event network-vif-plugged:24885c1e-8ab4-4480-b962-978b2d7e12d7 for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:40:38.843882 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-023bcec6-2f83-4a2c-8e14-4a75e78efe5e req-be8bf93a-5d78-4eef-99bf-dc363aad9978 service nova] Creating event network-vif-plugged:b3b7c180-3e64-4262-a77c-687b117445ae for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:40:38.859019 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-023bcec6-2f83-4a2c-8e14-4a75e78efe5e req-be8bf93a-5d78-4eef-99bf-dc363aad9978 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.124075 Aug 18 11:40:38.863935 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1667/3480] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:38.880313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4f933806-c666-4336-86bf-f6f8fa44098c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:38.881140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4f933806-c666-4336-86bf-f6f8fa44098c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:38.896112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f933806-c666-4336-86bf-f6f8fa44098c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:38.900174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f933806-c666-4336-86bf-f6f8fa44098c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:38.900799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f933806-c666-4336-86bf-f6f8fa44098c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:38.901829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f933806-c666-4336-86bf-f6f8fa44098c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:38.903211 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f933806-c666-4336-86bf-f6f8fa44098c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:38.905130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f933806-c666-4336-86bf-f6f8fa44098c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:39.474285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4f933806-c666-4336-86bf-f6f8fa44098c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:39.489970 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4f933806-c666-4336-86bf-f6f8fa44098c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.624013 Aug 18 11:40:39.496506 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1668/3481] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:38 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:39.516772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-403b2562-c5e2-454d-84d3-3fe47ef2aa7d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:39.517864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-403b2562-c5e2-454d-84d3-3fe47ef2aa7d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:39.532241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-403b2562-c5e2-454d-84d3-3fe47ef2aa7d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:39.538117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-403b2562-c5e2-454d-84d3-3fe47ef2aa7d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:39.538682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-403b2562-c5e2-454d-84d3-3fe47ef2aa7d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:39.539908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-403b2562-c5e2-454d-84d3-3fe47ef2aa7d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:39.540416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-403b2562-c5e2-454d-84d3-3fe47ef2aa7d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:39.540847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-403b2562-c5e2-454d-84d3-3fe47ef2aa7d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:39.626840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:40:39.627878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:40:39.628710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:40:39.629299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:40:39.630597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:40:39.642664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-403b2562-c5e2-454d-84d3-3fe47ef2aa7d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:39.655024 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-403b2562-c5e2-454d-84d3-3fe47ef2aa7d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1270 microversion: 2.1 time: 0.156556 Aug 18 11:40:39.663100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:39.665349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:39.665545 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1669/3482] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:39 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:39.673102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:39.673959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:39.677607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-43f7cd50-19a8-4604-93cc-3c605a3f49ce req-5049ea21-8c4e-4488-9629-43555e433dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3cf4491-1d85-4cb5-bee0-b99814a14635", "name": "network-vif-deleted", "tag": "e724b4d0-2e09-4dc2-8433-c5394839ba16"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:39.682149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:39.683032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:39.707865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-43f7cd50-19a8-4604-93cc-3c605a3f49ce req-5049ea21-8c4e-4488-9629-43555e433dfb service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:39.709370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-43f7cd50-19a8-4604-93cc-3c605a3f49ce req-5049ea21-8c4e-4488-9629-43555e433dfb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:39.710080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-43f7cd50-19a8-4604-93cc-3c605a3f49ce req-5049ea21-8c4e-4488-9629-43555e433dfb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:39.730269 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-43f7cd50-19a8-4604-93cc-3c605a3f49ce req-5049ea21-8c4e-4488-9629-43555e433dfb service nova] Creating event network-vif-deleted:e724b4d0-2e09-4dc2-8433-c5394839ba16 for instance b3cf4491-1d85-4cb5-bee0-b99814a14635 on n-h1-853611-3 Aug 18 11:40:39.734476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Getting quotas for project c2e348204c8d444fa46deb880043c565. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:40:39.745194 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-43f7cd50-19a8-4604-93cc-3c605a3f49ce req-5049ea21-8c4e-4488-9629-43555e433dfb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076817 Aug 18 11:40:39.747612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Getting quotas for user d7326372f966413d82aea488ca4a0742 and project c2e348204c8d444fa46deb880043c565. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:40:39.752536 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1670/3483] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:39.762611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-48141170-6dbe-43ef-91da-d995e4917fec tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:39.769015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-48141170-6dbe-43ef-91da-d995e4917fec tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:39.777569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:40:39.781744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:40:39.785272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48141170-6dbe-43ef-91da-d995e4917fec tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:39.785819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48141170-6dbe-43ef-91da-d995e4917fec tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:39.786228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48141170-6dbe-43ef-91da-d995e4917fec tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:39.787207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48141170-6dbe-43ef-91da-d995e4917fec tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:39.787848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48141170-6dbe-43ef-91da-d995e4917fec tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:39.788446 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48141170-6dbe-43ef-91da-d995e4917fec tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:39.876347 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e0c1c778-6189-4217-b068-4356e21dbcbc tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.694653 Aug 18 11:40:39.879968 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1814/3484] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:40:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:40:39.905306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-77c74edc-d823-451f-ba44-813938f20a6a tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:39.906141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-77c74edc-d823-451f-ba44-813938f20a6a tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:40.318023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-48141170-6dbe-43ef-91da-d995e4917fec tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:40.338940 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-48141170-6dbe-43ef-91da-d995e4917fec tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:40.341480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-48141170-6dbe-43ef-91da-d995e4917fec tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:40.346827 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-48141170-6dbe-43ef-91da-d995e4917fec tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.586320 Aug 18 11:40:40.348205 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1671/3485] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:39 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:40.532378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bbf65952-5347-446f-8340-684100e364b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:40.539762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bbf65952-5347-446f-8340-684100e364b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:40.543721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-77c74edc-d823-451f-ba44-813938f20a6a tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:40.552443 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-77c74edc-d823-451f-ba44-813938f20a6a tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1214 microversion: 2.1 time: 0.660155 Aug 18 11:40:40.553037 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1815/3486] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:39 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1214 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:40.562151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bbf65952-5347-446f-8340-684100e364b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:40.564466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bbf65952-5347-446f-8340-684100e364b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:40.565742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bbf65952-5347-446f-8340-684100e364b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:40.572936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bbf65952-5347-446f-8340-684100e364b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:40.573832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bbf65952-5347-446f-8340-684100e364b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:40.577334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bbf65952-5347-446f-8340-684100e364b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:40.680586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-936553d7-5c80-48db-8b55-9621422572b9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:40.681922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-936553d7-5c80-48db-8b55-9621422572b9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:40.709354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-936553d7-5c80-48db-8b55-9621422572b9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:40.713967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-936553d7-5c80-48db-8b55-9621422572b9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:40.721155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-936553d7-5c80-48db-8b55-9621422572b9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:40.723800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-936553d7-5c80-48db-8b55-9621422572b9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:40.727210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-936553d7-5c80-48db-8b55-9621422572b9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:40.731390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-936553d7-5c80-48db-8b55-9621422572b9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:40.988682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-936553d7-5c80-48db-8b55-9621422572b9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:41.009945 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-936553d7-5c80-48db-8b55-9621422572b9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1276 microversion: 2.1 time: 0.333477 Aug 18 11:40:41.030648 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1816/3487] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:40 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1276 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:41.085345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bbf65952-5347-446f-8340-684100e364b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:41.093607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:41.145766 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bbf65952-5347-446f-8340-684100e364b9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.619319 Aug 18 11:40:41.149585 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1672/3488] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:40 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:41.187528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-4ebc6ddb-b1b8-4f37-a07e-d0f5965a9b3a req-47137c3e-d8c4-4071-872e-993609eeeb0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-plugged", "status": "completed", "tag": "d548862d-96b8-4389-b950-c025f882d608"}, {"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-plugged", "status": "completed", "tag": "d41345fd-e890-44f2-bb0d-38e0419cb39a"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:41.230237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:41.253291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4ebc6ddb-b1b8-4f37-a07e-d0f5965a9b3a req-47137c3e-d8c4-4071-872e-993609eeeb0c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:41.254186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4ebc6ddb-b1b8-4f37-a07e-d0f5965a9b3a req-47137c3e-d8c4-4071-872e-993609eeeb0c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:41.255250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4ebc6ddb-b1b8-4f37-a07e-d0f5965a9b3a req-47137c3e-d8c4-4071-872e-993609eeeb0c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:41.298001 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-4ebc6ddb-b1b8-4f37-a07e-d0f5965a9b3a req-47137c3e-d8c4-4071-872e-993609eeeb0c service nova] Creating event network-vif-plugged:d548862d-96b8-4389-b950-c025f882d608 for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:40:41.298556 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-4ebc6ddb-b1b8-4f37-a07e-d0f5965a9b3a req-47137c3e-d8c4-4071-872e-993609eeeb0c service nova] Creating event network-vif-plugged:d41345fd-e890-44f2-bb0d-38e0419cb39a for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:40:41.311482 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-4ebc6ddb-b1b8-4f37-a07e-d0f5965a9b3a req-47137c3e-d8c4-4071-872e-993609eeeb0c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.158504 Aug 18 11:40:41.314792 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1673/3489] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:41.379703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-109c7d5c-4c45-46c7-89df-37ffcf35131f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:41.381384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-109c7d5c-4c45-46c7-89df-37ffcf35131f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:41.402217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-109c7d5c-4c45-46c7-89df-37ffcf35131f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:41.403715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-109c7d5c-4c45-46c7-89df-37ffcf35131f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:41.406885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-109c7d5c-4c45-46c7-89df-37ffcf35131f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:41.410925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-109c7d5c-4c45-46c7-89df-37ffcf35131f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:41.411708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-109c7d5c-4c45-46c7-89df-37ffcf35131f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:41.412519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-109c7d5c-4c45-46c7-89df-37ffcf35131f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:41.437705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-597590c7-f498-4392-ad20-7efe48e47800 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'create', calling method: .version_select at 0x7f519ee1f790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-944498934", "description": "tempest-description-1563918196"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:41.953022 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-597590c7-f498-4392-ad20-7efe48e47800 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.918053 Aug 18 11:40:41.955330 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1817/3490] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:40:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:41.960597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-715e69e5-3c02-4728-972e-e292998264d7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:41.961421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-715e69e5-3c02-4728-972e-e292998264d7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:41.978571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-715e69e5-3c02-4728-972e-e292998264d7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:41.981508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-715e69e5-3c02-4728-972e-e292998264d7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:41.983428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-715e69e5-3c02-4728-972e-e292998264d7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:41.985704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-715e69e5-3c02-4728-972e-e292998264d7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:41.987438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-715e69e5-3c02-4728-972e-e292998264d7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:41.988067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-715e69e5-3c02-4728-972e-e292998264d7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:42.150664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-715e69e5-3c02-4728-972e-e292998264d7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:42.162815 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-715e69e5-3c02-4728-972e-e292998264d7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1284 microversion: 2.1 time: 0.206095 Aug 18 11:40:42.165417 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1818/3491] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:41 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:42.186739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e279ed76-aa44-426b-95f2-64b0e3d092f0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'create', calling method: .version_select at 0x7f519ee1f820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1685163163", "description": "tempest-description-1649188340"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:42.515974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-109c7d5c-4c45-46c7-89df-37ffcf35131f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:42.534671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-109c7d5c-4c45-46c7-89df-37ffcf35131f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:42.550985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-109c7d5c-4c45-46c7-89df-37ffcf35131f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:42.553748 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-109c7d5c-4c45-46c7-89df-37ffcf35131f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 1.181003 Aug 18 11:40:42.601843 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1674/3492] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:41 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:42.659049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-962a38ff-943c-4b75-8e1d-1d7b5ef8b3e9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:42.661443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-962a38ff-943c-4b75-8e1d-1d7b5ef8b3e9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:42.678639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-962a38ff-943c-4b75-8e1d-1d7b5ef8b3e9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:42.689351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-962a38ff-943c-4b75-8e1d-1d7b5ef8b3e9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:42.689351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-962a38ff-943c-4b75-8e1d-1d7b5ef8b3e9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:42.689351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-962a38ff-943c-4b75-8e1d-1d7b5ef8b3e9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:42.689351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-962a38ff-943c-4b75-8e1d-1d7b5ef8b3e9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:42.689351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-962a38ff-943c-4b75-8e1d-1d7b5ef8b3e9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:42.949260 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e279ed76-aa44-426b-95f2-64b0e3d092f0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.782508 Aug 18 11:40:42.950645 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1819/3493] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:40:42 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:42.955780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9daf8fdc-6c6e-4d84-8105-30029b4215e9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:42.957359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9daf8fdc-6c6e-4d84-8105-30029b4215e9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:42.973586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9daf8fdc-6c6e-4d84-8105-30029b4215e9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:42.974235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9daf8fdc-6c6e-4d84-8105-30029b4215e9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:42.977089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9daf8fdc-6c6e-4d84-8105-30029b4215e9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:42.979078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9daf8fdc-6c6e-4d84-8105-30029b4215e9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:42.979078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9daf8fdc-6c6e-4d84-8105-30029b4215e9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:42.980091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9daf8fdc-6c6e-4d84-8105-30029b4215e9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:43.338854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9daf8fdc-6c6e-4d84-8105-30029b4215e9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:43.351570 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9daf8fdc-6c6e-4d84-8105-30029b4215e9 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.398360 Aug 18 11:40:43.353967 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1820/3494] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:42 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:43.363025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-772581258", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "9a5e4939-7f57-40c9-a9b5-d9fbe3deca0d"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:43.485670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] validate_networks() for [('9a5e4939-7f57-40c9-a9b5-d9fbe3deca0d', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:40:43.626012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-962a38ff-943c-4b75-8e1d-1d7b5ef8b3e9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:43.650833 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-962a38ff-943c-4b75-8e1d-1d7b5ef8b3e9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1318 microversion: 2.1 time: 1.046329 Aug 18 11:40:43.652584 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1675/3495] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:42 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1318 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:43.703041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-92ea47fb-ea4b-413e-90ba-ab37a1b691e3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:43.703745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-92ea47fb-ea4b-413e-90ba-ab37a1b691e3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:43.727985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92ea47fb-ea4b-413e-90ba-ab37a1b691e3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:43.728532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92ea47fb-ea4b-413e-90ba-ab37a1b691e3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:43.730687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92ea47fb-ea4b-413e-90ba-ab37a1b691e3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:43.733740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92ea47fb-ea4b-413e-90ba-ab37a1b691e3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:43.735737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92ea47fb-ea4b-413e-90ba-ab37a1b691e3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:43.736469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92ea47fb-ea4b-413e-90ba-ab37a1b691e3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:44.285223 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-92ea47fb-ea4b-413e-90ba-ab37a1b691e3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:44.297856 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-92ea47fb-ea4b-413e-90ba-ab37a1b691e3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1314 microversion: 2.1 time: 0.643134 Aug 18 11:40:44.299690 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1676/3496] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:43 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:44.323592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e00fe1d2-324f-412c-80cf-5b04c1426d15 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:44.325130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e00fe1d2-324f-412c-80cf-5b04c1426d15 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:44.334362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e00fe1d2-324f-412c-80cf-5b04c1426d15 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:44.335836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e00fe1d2-324f-412c-80cf-5b04c1426d15 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:44.336579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e00fe1d2-324f-412c-80cf-5b04c1426d15 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:44.337696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e00fe1d2-324f-412c-80cf-5b04c1426d15 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:44.338487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e00fe1d2-324f-412c-80cf-5b04c1426d15 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:44.339174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e00fe1d2-324f-412c-80cf-5b04c1426d15 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:44.935016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e00fe1d2-324f-412c-80cf-5b04c1426d15 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:44.978009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e00fe1d2-324f-412c-80cf-5b04c1426d15 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:44.985812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e00fe1d2-324f-412c-80cf-5b04c1426d15 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:44.992683 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e00fe1d2-324f-412c-80cf-5b04c1426d15 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1880 microversion: 2.32 time: 0.682939 Aug 18 11:40:45.010647 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1677/3497] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:44 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1880 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:45.018807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-36286d36-655d-4635-a9c5-b6a4f427cb29 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:45.019233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-36286d36-655d-4635-a9c5-b6a4f427cb29 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:45.034048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36286d36-655d-4635-a9c5-b6a4f427cb29 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:45.034579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36286d36-655d-4635-a9c5-b6a4f427cb29 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:45.037920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36286d36-655d-4635-a9c5-b6a4f427cb29 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:45.039730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36286d36-655d-4635-a9c5-b6a4f427cb29 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:45.041050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36286d36-655d-4635-a9c5-b6a4f427cb29 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:45.041513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36286d36-655d-4635-a9c5-b6a4f427cb29 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:45.287012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:40:45.288136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:40:45.290081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:40:45.290806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:40:45.292347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:40:45.328468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:45.329110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:45.329732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:45.331738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:45.332387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:45.333143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:45.368910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Getting quotas for project 6e4deaca35e548218df7f8358b79ecb9. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:40:45.376648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Getting quotas for user 3a7b07fb7b4d459e8f09ffc731a779fd and project 6e4deaca35e548218df7f8358b79ecb9. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:40:45.404461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-36286d36-655d-4635-a9c5-b6a4f427cb29 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:45.412932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:40:45.413147 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-36286d36-655d-4635-a9c5-b6a4f427cb29 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1476 microversion: 2.1 time: 0.408283 Aug 18 11:40:45.413864 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1678/3498] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:45 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1476 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:45.416988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:40:45.433309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a28acc48-bb69-4cb7-8a0f-f7bf40c19373 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:45.434402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a28acc48-bb69-4cb7-8a0f-f7bf40c19373 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:45.441758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a28acc48-bb69-4cb7-8a0f-f7bf40c19373 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:45.442958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a28acc48-bb69-4cb7-8a0f-f7bf40c19373 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:45.444159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a28acc48-bb69-4cb7-8a0f-f7bf40c19373 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:45.445507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a28acc48-bb69-4cb7-8a0f-f7bf40c19373 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:45.446187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a28acc48-bb69-4cb7-8a0f-f7bf40c19373 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:45.446860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a28acc48-bb69-4cb7-8a0f-f7bf40c19373 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:45.522266 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-88d189c8-1a1e-4eab-a1fa-8d9ef9b49eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.165438 Aug 18 11:40:45.523892 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1821/3499] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:40:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:40:45.534929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-6d1e2de3-5c13-4b8f-ac29-db471a919c21 req-2f3ab063-2d04-43bb-b464-7ee2763b1876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7daadf54-276a-4e9e-98f1-b53b20e1c309", "tag": "ed675b6d-3eaa-4ea9-8963-76adda0f207d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:45.572146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6d1e2de3-5c13-4b8f-ac29-db471a919c21 req-2f3ab063-2d04-43bb-b464-7ee2763b1876 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:45.572583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6d1e2de3-5c13-4b8f-ac29-db471a919c21 req-2f3ab063-2d04-43bb-b464-7ee2763b1876 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:45.573266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6d1e2de3-5c13-4b8f-ac29-db471a919c21 req-2f3ab063-2d04-43bb-b464-7ee2763b1876 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:45.590638 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6d1e2de3-5c13-4b8f-ac29-db471a919c21 req-2f3ab063-2d04-43bb-b464-7ee2763b1876 service nova] Creating event network-changed:ed675b6d-3eaa-4ea9-8963-76adda0f207d for instance 7daadf54-276a-4e9e-98f1-b53b20e1c309 on n-h1-853611-3 Aug 18 11:40:45.599141 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-6d1e2de3-5c13-4b8f-ac29-db471a919c21 req-2f3ab063-2d04-43bb-b464-7ee2763b1876 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073115 Aug 18 11:40:45.600696 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1822/3500] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:45.607000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f8bbec9-635a-447d-8845-a9480fa6ab9e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:45.607703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f8bbec9-635a-447d-8845-a9480fa6ab9e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:45.618296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f8bbec9-635a-447d-8845-a9480fa6ab9e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:45.619060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f8bbec9-635a-447d-8845-a9480fa6ab9e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:45.619647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f8bbec9-635a-447d-8845-a9480fa6ab9e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:45.620551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f8bbec9-635a-447d-8845-a9480fa6ab9e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:45.621161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f8bbec9-635a-447d-8845-a9480fa6ab9e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:45.621742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f8bbec9-635a-447d-8845-a9480fa6ab9e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:45.865476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a28acc48-bb69-4cb7-8a0f-f7bf40c19373 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:45.881863 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a28acc48-bb69-4cb7-8a0f-f7bf40c19373 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1318 microversion: 2.1 time: 0.450647 Aug 18 11:40:45.883531 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1679/3501] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:45 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:45.890524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-73b2b849-1807-48da-bd99-738d27dcb4ea tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:45.902819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-73b2b849-1807-48da-bd99-738d27dcb4ea tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:46.062714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-73b2b849-1807-48da-bd99-738d27dcb4ea tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:46.074920 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-73b2b849-1807-48da-bd99-738d27dcb4ea tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1215 microversion: 2.1 time: 0.187860 Aug 18 11:40:46.078260 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1680/3502] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:45 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1215 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:46.087069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-021818c2-d9c8-4dac-b58f-0491268215dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:46.088115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-021818c2-d9c8-4dac-b58f-0491268215dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:46.109721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-021818c2-d9c8-4dac-b58f-0491268215dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:46.110465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-021818c2-d9c8-4dac-b58f-0491268215dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:46.111052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-021818c2-d9c8-4dac-b58f-0491268215dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:46.111962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-021818c2-d9c8-4dac-b58f-0491268215dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:46.112761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-021818c2-d9c8-4dac-b58f-0491268215dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:46.113688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-021818c2-d9c8-4dac-b58f-0491268215dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:46.698767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2f8bbec9-635a-447d-8845-a9480fa6ab9e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:46.728119 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f8bbec9-635a-447d-8845-a9480fa6ab9e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1314 microversion: 2.1 time: 1.125595 Aug 18 11:40:46.729274 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1823/3503] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:45 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1314 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:46.737216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c345a473-b3dc-4612-b0eb-89a5879a59b1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:46.737851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c345a473-b3dc-4612-b0eb-89a5879a59b1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:46.746000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c345a473-b3dc-4612-b0eb-89a5879a59b1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:46.747043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c345a473-b3dc-4612-b0eb-89a5879a59b1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:46.747765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c345a473-b3dc-4612-b0eb-89a5879a59b1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:46.748844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c345a473-b3dc-4612-b0eb-89a5879a59b1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:46.749496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c345a473-b3dc-4612-b0eb-89a5879a59b1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:46.750302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c345a473-b3dc-4612-b0eb-89a5879a59b1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:46.900115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-021818c2-d9c8-4dac-b58f-0491268215dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:46.915989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-021818c2-d9c8-4dac-b58f-0491268215dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:46.921843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-021818c2-d9c8-4dac-b58f-0491268215dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:46.925325 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-021818c2-d9c8-4dac-b58f-0491268215dd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 2835 microversion: 2.32 time: 0.845204 Aug 18 11:40:46.927323 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1681/3504] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:40:46 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 2835 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:46.933962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-768389ca-70aa-4078-8278-d53da8a2d09d req-decdc963-df43-4cdf-9f3b-ff35f9a939d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a0c8a6-415b-4702-a260-13ff9be3fd57", "tag": "77f6cdf6-27ca-4442-87a9-d496b7fb4ea5"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:46.957929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-768389ca-70aa-4078-8278-d53da8a2d09d req-decdc963-df43-4cdf-9f3b-ff35f9a939d9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:46.958610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-768389ca-70aa-4078-8278-d53da8a2d09d req-decdc963-df43-4cdf-9f3b-ff35f9a939d9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:46.959056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-768389ca-70aa-4078-8278-d53da8a2d09d req-decdc963-df43-4cdf-9f3b-ff35f9a939d9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:46.987693 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-768389ca-70aa-4078-8278-d53da8a2d09d req-decdc963-df43-4cdf-9f3b-ff35f9a939d9 service nova] Creating event network-changed:77f6cdf6-27ca-4442-87a9-d496b7fb4ea5 for instance c6a0c8a6-415b-4702-a260-13ff9be3fd57 on n-h1-853611-3 Aug 18 11:40:47.010906 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-768389ca-70aa-4078-8278-d53da8a2d09d req-decdc963-df43-4cdf-9f3b-ff35f9a939d9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071820 Aug 18 11:40:47.013358 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1682/3505] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:47.021649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3517b5cc-884d-442e-a721-ce1b7aae74fb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:47.023422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3517b5cc-884d-442e-a721-ce1b7aae74fb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:47.031263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3517b5cc-884d-442e-a721-ce1b7aae74fb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:47.031876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3517b5cc-884d-442e-a721-ce1b7aae74fb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:47.032454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3517b5cc-884d-442e-a721-ce1b7aae74fb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:47.033279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3517b5cc-884d-442e-a721-ce1b7aae74fb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:47.033862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3517b5cc-884d-442e-a721-ce1b7aae74fb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:47.034376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3517b5cc-884d-442e-a721-ce1b7aae74fb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:47.136965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c345a473-b3dc-4612-b0eb-89a5879a59b1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:47.148109 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c345a473-b3dc-4612-b0eb-89a5879a59b1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1475 microversion: 2.1 time: 0.415668 Aug 18 11:40:47.149410 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1824/3506] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:46 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1475 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:47.154647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-46f8483a-3d76-444a-b606-234bb0419e14 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:47.155406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-46f8483a-3d76-444a-b606-234bb0419e14 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:47.169764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46f8483a-3d76-444a-b606-234bb0419e14 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:47.170569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46f8483a-3d76-444a-b606-234bb0419e14 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:47.171175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46f8483a-3d76-444a-b606-234bb0419e14 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:47.172103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46f8483a-3d76-444a-b606-234bb0419e14 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:47.172826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46f8483a-3d76-444a-b606-234bb0419e14 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:47.173434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46f8483a-3d76-444a-b606-234bb0419e14 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:47.282692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3517b5cc-884d-442e-a721-ce1b7aae74fb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:47.305858 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3517b5cc-884d-442e-a721-ce1b7aae74fb tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1318 microversion: 2.1 time: 0.289933 Aug 18 11:40:47.306716 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1683/3507] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:47 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:47.312256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-74ca8a62-0d1e-4378-949e-23d512cf2fdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:47.313202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-74ca8a62-0d1e-4378-949e-23d512cf2fdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:47.321739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-74ca8a62-0d1e-4378-949e-23d512cf2fdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:47.322337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-74ca8a62-0d1e-4378-949e-23d512cf2fdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:47.322879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-74ca8a62-0d1e-4378-949e-23d512cf2fdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:47.323780 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-74ca8a62-0d1e-4378-949e-23d512cf2fdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:47.324086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-74ca8a62-0d1e-4378-949e-23d512cf2fdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:47.324473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-74ca8a62-0d1e-4378-949e-23d512cf2fdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:47.428414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-74ca8a62-0d1e-4378-949e-23d512cf2fdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:47.428578 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-46f8483a-3d76-444a-b606-234bb0419e14 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.275140 Aug 18 11:40:47.431328 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1825/3508] 10.222.0.73 () {60 vars in 1316 bytes} [Thu Aug 18 11:40:47 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab/os-interface => generated 1832 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:40:47.464736 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-74ca8a62-0d1e-4378-949e-23d512cf2fdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1267 microversion: 2.1 time: 0.156073 Aug 18 11:40:47.465483 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1684/3509] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:47 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:47.736096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c0d6592b-4356-410d-8972-f59a21d1e35b req-564d939c-2247-4c95-9f68-19559d99969a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da67cf3-bc5d-4b71-9c07-6234c22493bc", "name": "network-vif-unplugged", "status": "completed", "tag": "061756b5-9fa0-425c-99c6-d5be70f85abe"}, {"name": "network-changed", "server_uuid": "1da67cf3-bc5d-4b71-9c07-6234c22493bc", "tag": "061756b5-9fa0-425c-99c6-d5be70f85abe"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:47.750349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-96c48511-8fef-497c-a368-1589fea63098 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:47.751198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-96c48511-8fef-497c-a368-1589fea63098 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:47.762989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c0d6592b-4356-410d-8972-f59a21d1e35b req-564d939c-2247-4c95-9f68-19559d99969a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:47.765977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c0d6592b-4356-410d-8972-f59a21d1e35b req-564d939c-2247-4c95-9f68-19559d99969a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:47.766883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96c48511-8fef-497c-a368-1589fea63098 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:47.767360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96c48511-8fef-497c-a368-1589fea63098 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:47.767806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96c48511-8fef-497c-a368-1589fea63098 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:47.768458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c0d6592b-4356-410d-8972-f59a21d1e35b req-564d939c-2247-4c95-9f68-19559d99969a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:47.768582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96c48511-8fef-497c-a368-1589fea63098 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:47.768971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96c48511-8fef-497c-a368-1589fea63098 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:47.769403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96c48511-8fef-497c-a368-1589fea63098 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:47.809343 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c0d6592b-4356-410d-8972-f59a21d1e35b req-564d939c-2247-4c95-9f68-19559d99969a service nova] Creating event network-vif-unplugged:061756b5-9fa0-425c-99c6-d5be70f85abe for instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc on n-h1-853611-3 Aug 18 11:40:47.810146 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c0d6592b-4356-410d-8972-f59a21d1e35b req-564d939c-2247-4c95-9f68-19559d99969a service nova] Creating event network-changed:061756b5-9fa0-425c-99c6-d5be70f85abe for instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc on n-h1-853611-3 Aug 18 11:40:47.817334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-c0d6592b-4356-410d-8972-f59a21d1e35b req-564d939c-2247-4c95-9f68-19559d99969a service nova] Instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 11:40:47.831924 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c0d6592b-4356-410d-8972-f59a21d1e35b req-564d939c-2247-4c95-9f68-19559d99969a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.099908 Aug 18 11:40:47.838595 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1826/3510] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:47.926419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:48.177053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a514fd90-59f4-4301-b5a8-1163bf788402 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:48.177911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a514fd90-59f4-4301-b5a8-1163bf788402 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:48.192749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a514fd90-59f4-4301-b5a8-1163bf788402 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:48.196837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a514fd90-59f4-4301-b5a8-1163bf788402 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:48.197619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a514fd90-59f4-4301-b5a8-1163bf788402 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:48.199490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a514fd90-59f4-4301-b5a8-1163bf788402 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:48.202166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a514fd90-59f4-4301-b5a8-1163bf788402 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:48.202674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a514fd90-59f4-4301-b5a8-1163bf788402 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:48.381575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-96c48511-8fef-497c-a368-1589fea63098 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:48.395823 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-96c48511-8fef-497c-a368-1589fea63098 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1314 microversion: 2.1 time: 0.649144 Aug 18 11:40:48.398114 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1685/3511] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:47 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:48.416693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5432d04f-8fee-422c-8b30-dbac22dc560b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:48.417770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5432d04f-8fee-422c-8b30-dbac22dc560b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:48.428566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5432d04f-8fee-422c-8b30-dbac22dc560b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:48.429626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5432d04f-8fee-422c-8b30-dbac22dc560b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:48.430619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5432d04f-8fee-422c-8b30-dbac22dc560b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:48.432357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5432d04f-8fee-422c-8b30-dbac22dc560b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:48.433136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5432d04f-8fee-422c-8b30-dbac22dc560b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:48.435293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5432d04f-8fee-422c-8b30-dbac22dc560b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:48.958599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a514fd90-59f4-4301-b5a8-1163bf788402 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:48.970140 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a514fd90-59f4-4301-b5a8-1163bf788402 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1475 microversion: 2.1 time: 0.798040 Aug 18 11:40:48.985346 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1827/3512] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:48 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1475 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:48.990979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3daa4f7-f9a7-4a97-9fe0-72bcd8f0282f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:48.992639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3daa4f7-f9a7-4a97-9fe0-72bcd8f0282f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:49.000753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3daa4f7-f9a7-4a97-9fe0-72bcd8f0282f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:49.001936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3daa4f7-f9a7-4a97-9fe0-72bcd8f0282f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:49.002673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3daa4f7-f9a7-4a97-9fe0-72bcd8f0282f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:49.004508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3daa4f7-f9a7-4a97-9fe0-72bcd8f0282f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:49.005753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3daa4f7-f9a7-4a97-9fe0-72bcd8f0282f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:49.007823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3daa4f7-f9a7-4a97-9fe0-72bcd8f0282f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:49.302905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5432d04f-8fee-422c-8b30-dbac22dc560b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:49.314590 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5432d04f-8fee-422c-8b30-dbac22dc560b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1318 microversion: 2.1 time: 0.914624 Aug 18 11:40:49.315673 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1686/3513] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:48 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1318 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:49.417846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b9ae37b4-a3c3-43a7-83a5-f3f7e63e2623 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:49.418676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b9ae37b4-a3c3-43a7-83a5-f3f7e63e2623 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:49.425456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9ae37b4-a3c3-43a7-83a5-f3f7e63e2623 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:49.425950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9ae37b4-a3c3-43a7-83a5-f3f7e63e2623 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:49.426392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9ae37b4-a3c3-43a7-83a5-f3f7e63e2623 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:49.427127 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9ae37b4-a3c3-43a7-83a5-f3f7e63e2623 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:49.430183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9ae37b4-a3c3-43a7-83a5-f3f7e63e2623 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:49.434836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9ae37b4-a3c3-43a7-83a5-f3f7e63e2623 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:49.533792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d3daa4f7-f9a7-4a97-9fe0-72bcd8f0282f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:49.546613 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3daa4f7-f9a7-4a97-9fe0-72bcd8f0282f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1273 microversion: 2.1 time: 0.558765 Aug 18 11:40:49.547338 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1828/3514] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:48 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1273 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:50.076550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b9ae37b4-a3c3-43a7-83a5-f3f7e63e2623 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:50.097267 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b9ae37b4-a3c3-43a7-83a5-f3f7e63e2623 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1314 microversion: 2.1 time: 0.682581 Aug 18 11:40:50.101408 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1687/3515] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:49 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:50.202154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d24d169-05cf-4dc0-ba4f-428a65db17f1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:50.202959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9d24d169-05cf-4dc0-ba4f-428a65db17f1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:50.212801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d24d169-05cf-4dc0-ba4f-428a65db17f1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:50.213480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d24d169-05cf-4dc0-ba4f-428a65db17f1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:50.214019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d24d169-05cf-4dc0-ba4f-428a65db17f1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:50.216703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d24d169-05cf-4dc0-ba4f-428a65db17f1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:50.217320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d24d169-05cf-4dc0-ba4f-428a65db17f1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:50.218040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d24d169-05cf-4dc0-ba4f-428a65db17f1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:50.251095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:50.337106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cd29a58e-84d9-4fd6-b4ca-b69b6594490e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:50.337885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cd29a58e-84d9-4fd6-b4ca-b69b6594490e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:50.350476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd29a58e-84d9-4fd6-b4ca-b69b6594490e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:50.351803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd29a58e-84d9-4fd6-b4ca-b69b6594490e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:50.352510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd29a58e-84d9-4fd6-b4ca-b69b6594490e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:50.354188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd29a58e-84d9-4fd6-b4ca-b69b6594490e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:50.354919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd29a58e-84d9-4fd6-b4ca-b69b6594490e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:50.355720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd29a58e-84d9-4fd6-b4ca-b69b6594490e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:50.604851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9d24d169-05cf-4dc0-ba4f-428a65db17f1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:50.615222 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9d24d169-05cf-4dc0-ba4f-428a65db17f1 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1475 microversion: 2.1 time: 0.626985 Aug 18 11:40:50.618932 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1829/3516] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:49 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1475 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:50.624751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d680bf57-4285-489d-ba33-44ea2e2c8e0f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:50.625634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d680bf57-4285-489d-ba33-44ea2e2c8e0f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:50.634077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d680bf57-4285-489d-ba33-44ea2e2c8e0f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:50.634690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d680bf57-4285-489d-ba33-44ea2e2c8e0f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:50.635237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d680bf57-4285-489d-ba33-44ea2e2c8e0f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:50.636027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d680bf57-4285-489d-ba33-44ea2e2c8e0f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:50.636552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d680bf57-4285-489d-ba33-44ea2e2c8e0f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:50.637898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d680bf57-4285-489d-ba33-44ea2e2c8e0f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:50.765680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cd29a58e-84d9-4fd6-b4ca-b69b6594490e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:50.780059 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cd29a58e-84d9-4fd6-b4ca-b69b6594490e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1318 microversion: 2.1 time: 0.447482 Aug 18 11:40:50.781062 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1688/3517] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:50 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:50.794714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d680bf57-4285-489d-ba33-44ea2e2c8e0f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:50.804061 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d680bf57-4285-489d-ba33-44ea2e2c8e0f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1273 microversion: 2.1 time: 0.183436 Aug 18 11:40:50.805648 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1830/3518] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:50 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:50.936475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-273f6ef1-5aac-4cef-90ea-e6db74a8ea7f req-aec8c7f2-7555-40d2-8734-3676aab185e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "tag": "24885c1e-8ab4-4480-b962-978b2d7e12d7"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:50.953033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-273f6ef1-5aac-4cef-90ea-e6db74a8ea7f req-aec8c7f2-7555-40d2-8734-3676aab185e3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:50.953932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-273f6ef1-5aac-4cef-90ea-e6db74a8ea7f req-aec8c7f2-7555-40d2-8734-3676aab185e3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:50.954825 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-273f6ef1-5aac-4cef-90ea-e6db74a8ea7f req-aec8c7f2-7555-40d2-8734-3676aab185e3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:50.987800 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-273f6ef1-5aac-4cef-90ea-e6db74a8ea7f req-aec8c7f2-7555-40d2-8734-3676aab185e3 service nova] Creating event network-changed:24885c1e-8ab4-4480-b962-978b2d7e12d7 for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:40:50.995197 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-273f6ef1-5aac-4cef-90ea-e6db74a8ea7f req-aec8c7f2-7555-40d2-8734-3676aab185e3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063128 Aug 18 11:40:50.996617 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1689/3519] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:51.123113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4488c56a-2697-4b29-965f-dbe9a60d7cff tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:51.129294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4488c56a-2697-4b29-965f-dbe9a60d7cff tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:51.144383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4488c56a-2697-4b29-965f-dbe9a60d7cff tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:51.148446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4488c56a-2697-4b29-965f-dbe9a60d7cff tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:51.149137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4488c56a-2697-4b29-965f-dbe9a60d7cff tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:51.149921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4488c56a-2697-4b29-965f-dbe9a60d7cff tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:51.150412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4488c56a-2697-4b29-965f-dbe9a60d7cff tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:51.150885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4488c56a-2697-4b29-965f-dbe9a60d7cff tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:51.639260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fc09ccf0-754b-4b4a-9654-81e32c0f876d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:51.639988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fc09ccf0-754b-4b4a-9654-81e32c0f876d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:51.650368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc09ccf0-754b-4b4a-9654-81e32c0f876d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:51.651182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc09ccf0-754b-4b4a-9654-81e32c0f876d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:51.651802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc09ccf0-754b-4b4a-9654-81e32c0f876d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:51.652689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc09ccf0-754b-4b4a-9654-81e32c0f876d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:51.653335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc09ccf0-754b-4b4a-9654-81e32c0f876d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:51.654347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc09ccf0-754b-4b4a-9654-81e32c0f876d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:52.073131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4488c56a-2697-4b29-965f-dbe9a60d7cff tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:52.107423 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4488c56a-2697-4b29-965f-dbe9a60d7cff tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1314 microversion: 2.1 time: 0.986272 Aug 18 11:40:52.110997 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1831/3520] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:51 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1314 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:52.127978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34ee03cf-8727-43ea-8987-a1b51f80f09e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:52.139058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-34ee03cf-8727-43ea-8987-a1b51f80f09e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:52.166354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34ee03cf-8727-43ea-8987-a1b51f80f09e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:52.167621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34ee03cf-8727-43ea-8987-a1b51f80f09e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:52.180384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34ee03cf-8727-43ea-8987-a1b51f80f09e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:52.182229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34ee03cf-8727-43ea-8987-a1b51f80f09e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:52.183264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34ee03cf-8727-43ea-8987-a1b51f80f09e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:52.184219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34ee03cf-8727-43ea-8987-a1b51f80f09e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:52.271829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fc09ccf0-754b-4b4a-9654-81e32c0f876d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:52.288967 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fc09ccf0-754b-4b4a-9654-81e32c0f876d tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1473 microversion: 2.1 time: 0.653111 Aug 18 11:40:52.300681 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1690/3521] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:51 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1473 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:52.325289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-be43d4fd-96db-4c10-ba98-96ee58ab3ba8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:52.326390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-be43d4fd-96db-4c10-ba98-96ee58ab3ba8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:52.351193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be43d4fd-96db-4c10-ba98-96ee58ab3ba8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:52.352408 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be43d4fd-96db-4c10-ba98-96ee58ab3ba8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:52.353393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be43d4fd-96db-4c10-ba98-96ee58ab3ba8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:52.355744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be43d4fd-96db-4c10-ba98-96ee58ab3ba8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:52.356781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be43d4fd-96db-4c10-ba98-96ee58ab3ba8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:52.358701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be43d4fd-96db-4c10-ba98-96ee58ab3ba8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:52.652464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-34ee03cf-8727-43ea-8987-a1b51f80f09e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:52.664846 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34ee03cf-8727-43ea-8987-a1b51f80f09e tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1318 microversion: 2.1 time: 0.551544 Aug 18 11:40:52.678225 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1832/3522] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:52 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1318 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:52.684458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8d13f833-7a27-4662-82dc-fb822e7293e0 req-883c29e9-58c5-428f-b32e-219fd06565c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7daadf54-276a-4e9e-98f1-b53b20e1c309", "name": "network-vif-plugged", "status": "completed", "tag": "ed675b6d-3eaa-4ea9-8963-76adda0f207d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:52.687893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-be43d4fd-96db-4c10-ba98-96ee58ab3ba8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:52.702665 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-be43d4fd-96db-4c10-ba98-96ee58ab3ba8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1315 microversion: 2.1 time: 0.396953 Aug 18 11:40:52.713072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8d13f833-7a27-4662-82dc-fb822e7293e0 req-883c29e9-58c5-428f-b32e-219fd06565c1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:52.713575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8d13f833-7a27-4662-82dc-fb822e7293e0 req-883c29e9-58c5-428f-b32e-219fd06565c1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:52.714014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8d13f833-7a27-4662-82dc-fb822e7293e0 req-883c29e9-58c5-428f-b32e-219fd06565c1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:52.738705 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1691/3523] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:52 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:52.742296 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8d13f833-7a27-4662-82dc-fb822e7293e0 req-883c29e9-58c5-428f-b32e-219fd06565c1 service nova] Creating event network-vif-plugged:ed675b6d-3eaa-4ea9-8963-76adda0f207d for instance 7daadf54-276a-4e9e-98f1-b53b20e1c309 on n-h1-853611-3 Aug 18 11:40:52.760589 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8d13f833-7a27-4662-82dc-fb822e7293e0 req-883c29e9-58c5-428f-b32e-219fd06565c1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090544 Aug 18 11:40:52.761910 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1833/3524] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:53.140236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0198c693-a79a-4f68-a41a-ab0218deb595 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:53.141308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0198c693-a79a-4f68-a41a-ab0218deb595 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:53.151440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0198c693-a79a-4f68-a41a-ab0218deb595 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:53.152126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0198c693-a79a-4f68-a41a-ab0218deb595 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:53.152676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0198c693-a79a-4f68-a41a-ab0218deb595 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:53.153556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0198c693-a79a-4f68-a41a-ab0218deb595 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:53.154122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0198c693-a79a-4f68-a41a-ab0218deb595 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:53.154687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0198c693-a79a-4f68-a41a-ab0218deb595 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:53.176695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:53.318177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-43d7552b-f966-4bd7-94fa-e7923f82119c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:53.320262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-43d7552b-f966-4bd7-94fa-e7923f82119c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:53.329476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43d7552b-f966-4bd7-94fa-e7923f82119c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:53.329974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43d7552b-f966-4bd7-94fa-e7923f82119c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:53.330835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43d7552b-f966-4bd7-94fa-e7923f82119c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:53.331939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43d7552b-f966-4bd7-94fa-e7923f82119c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:53.332591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43d7552b-f966-4bd7-94fa-e7923f82119c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:53.333347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43d7552b-f966-4bd7-94fa-e7923f82119c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:53.627369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-43d7552b-f966-4bd7-94fa-e7923f82119c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:53.649143 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-43d7552b-f966-4bd7-94fa-e7923f82119c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1473 microversion: 2.1 time: 0.336949 Aug 18 11:40:53.651929 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1834/3525] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:53 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1473 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:53.696945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-77c75ead-408c-4441-82d0-3a830e585c32 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:53.699394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-77c75ead-408c-4441-82d0-3a830e585c32 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:53.708312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77c75ead-408c-4441-82d0-3a830e585c32 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:53.724040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77c75ead-408c-4441-82d0-3a830e585c32 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:53.724835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77c75ead-408c-4441-82d0-3a830e585c32 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:53.726603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77c75ead-408c-4441-82d0-3a830e585c32 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:53.727388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77c75ead-408c-4441-82d0-3a830e585c32 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:53.728263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77c75ead-408c-4441-82d0-3a830e585c32 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:53.854980 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0198c693-a79a-4f68-a41a-ab0218deb595 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:53.866405 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0198c693-a79a-4f68-a41a-ab0218deb595 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1314 microversion: 2.1 time: 0.732682 Aug 18 11:40:53.870899 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1692/3526] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:53 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:53.886291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-60d7ff35-1f3f-4b80-afc9-001702979248 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:53.891068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-60d7ff35-1f3f-4b80-afc9-001702979248 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:53.904558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60d7ff35-1f3f-4b80-afc9-001702979248 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:53.905485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60d7ff35-1f3f-4b80-afc9-001702979248 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:53.906142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60d7ff35-1f3f-4b80-afc9-001702979248 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:53.907232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60d7ff35-1f3f-4b80-afc9-001702979248 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:53.907928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60d7ff35-1f3f-4b80-afc9-001702979248 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:53.908557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60d7ff35-1f3f-4b80-afc9-001702979248 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:54.052778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-77c75ead-408c-4441-82d0-3a830e585c32 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:54.070160 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-77c75ead-408c-4441-82d0-3a830e585c32 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1318 microversion: 2.1 time: 0.380122 Aug 18 11:40:54.087783 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1835/3527] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:53 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:54.172707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8f8ad370-a665-4951-8751-ce5a68dd984b req-ace8f35f-a994-4317-8c1e-356eed8f8119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c5530b-64fd-465c-a52c-9e81b68a3f2a", "tag": "363c1787-80ec-405e-872b-dff4d89afcb2"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:54.191980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8f8ad370-a665-4951-8751-ce5a68dd984b req-ace8f35f-a994-4317-8c1e-356eed8f8119 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:54.192868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8f8ad370-a665-4951-8751-ce5a68dd984b req-ace8f35f-a994-4317-8c1e-356eed8f8119 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:54.194681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8f8ad370-a665-4951-8751-ce5a68dd984b req-ace8f35f-a994-4317-8c1e-356eed8f8119 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:54.211494 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8f8ad370-a665-4951-8751-ce5a68dd984b req-ace8f35f-a994-4317-8c1e-356eed8f8119 service nova] Creating event network-changed:363c1787-80ec-405e-872b-dff4d89afcb2 for instance 69c5530b-64fd-465c-a52c-9e81b68a3f2a on n-h1-853611-3 Aug 18 11:40:54.219012 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8f8ad370-a665-4951-8751-ce5a68dd984b req-ace8f35f-a994-4317-8c1e-356eed8f8119 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127365 Aug 18 11:40:54.219996 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1836/3528] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:54.374960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-60d7ff35-1f3f-4b80-afc9-001702979248 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:54.386244 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-60d7ff35-1f3f-4b80-afc9-001702979248 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1315 microversion: 2.1 time: 0.513948 Aug 18 11:40:54.387585 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1693/3529] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:53 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:54.677335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-15572f3f-a992-425d-87f0-d75e3c2ef16e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:54.679417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-15572f3f-a992-425d-87f0-d75e3c2ef16e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:54.700147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15572f3f-a992-425d-87f0-d75e3c2ef16e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:54.703204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15572f3f-a992-425d-87f0-d75e3c2ef16e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:54.704014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15572f3f-a992-425d-87f0-d75e3c2ef16e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:54.707489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15572f3f-a992-425d-87f0-d75e3c2ef16e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:54.708963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15572f3f-a992-425d-87f0-d75e3c2ef16e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:54.710020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15572f3f-a992-425d-87f0-d75e3c2ef16e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:54.891327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-78bbb725-8d40-419f-b9b7-37fd5ad40c5c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:54.901854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-78bbb725-8d40-419f-b9b7-37fd5ad40c5c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:54.917629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78bbb725-8d40-419f-b9b7-37fd5ad40c5c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:54.919554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78bbb725-8d40-419f-b9b7-37fd5ad40c5c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:54.920016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78bbb725-8d40-419f-b9b7-37fd5ad40c5c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:54.922602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78bbb725-8d40-419f-b9b7-37fd5ad40c5c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:54.923595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78bbb725-8d40-419f-b9b7-37fd5ad40c5c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:54.924306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78bbb725-8d40-419f-b9b7-37fd5ad40c5c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:55.031266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-15572f3f-a992-425d-87f0-d75e3c2ef16e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:55.045141 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-15572f3f-a992-425d-87f0-d75e3c2ef16e tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1470 microversion: 2.1 time: 0.373403 Aug 18 11:40:55.059420 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1837/3530] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:54 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1470 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:55.074333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a03af2d6-35e4-4579-949d-49e831f3d78a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:55.075158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a03af2d6-35e4-4579-949d-49e831f3d78a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:55.096007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a03af2d6-35e4-4579-949d-49e831f3d78a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:55.096749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a03af2d6-35e4-4579-949d-49e831f3d78a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:55.097525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a03af2d6-35e4-4579-949d-49e831f3d78a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:55.098519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a03af2d6-35e4-4579-949d-49e831f3d78a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:55.099880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a03af2d6-35e4-4579-949d-49e831f3d78a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:55.100597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a03af2d6-35e4-4579-949d-49e831f3d78a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:55.252533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-78bbb725-8d40-419f-b9b7-37fd5ad40c5c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:55.262617 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-78bbb725-8d40-419f-b9b7-37fd5ad40c5c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1314 microversion: 2.1 time: 0.377681 Aug 18 11:40:55.278957 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1694/3531] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:54 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:55.285049 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a03af2d6-35e4-4579-949d-49e831f3d78a tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "POST /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc/action" status: 202 len: 0 microversion: 2.1 time: 0.220541 Aug 18 11:40:55.285633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e08427e6-e90e-458c-96f0-b4b37150de3a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:55.286467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e08427e6-e90e-458c-96f0-b4b37150de3a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:55.290088 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1838/3532] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:40:55 2022] POST /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:40:55.294113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e08427e6-e90e-458c-96f0-b4b37150de3a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:55.294966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e08427e6-e90e-458c-96f0-b4b37150de3a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:55.295574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e08427e6-e90e-458c-96f0-b4b37150de3a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:55.296527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e08427e6-e90e-458c-96f0-b4b37150de3a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:55.297152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e08427e6-e90e-458c-96f0-b4b37150de3a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:55.297770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e08427e6-e90e-458c-96f0-b4b37150de3a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:55.354639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:55.402083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=14 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:55.419902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-166447714", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "1655878e-d613-42d5-9a31-f477da5623a1"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:55.538487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] validate_networks() for [('1655878e-d613-42d5-9a31-f477da5623a1', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:40:55.620866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e08427e6-e90e-458c-96f0-b4b37150de3a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:55.633081 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e08427e6-e90e-458c-96f0-b4b37150de3a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1509 microversion: 2.1 time: 0.352360 Aug 18 11:40:55.634875 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1695/3533] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:55 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1509 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:55.650791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1d2858f8-b3b3-4cf8-98e4-1fe12ad42f24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:55.653829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1d2858f8-b3b3-4cf8-98e4-1fe12ad42f24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:55.668048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d2858f8-b3b3-4cf8-98e4-1fe12ad42f24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:55.668550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d2858f8-b3b3-4cf8-98e4-1fe12ad42f24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:55.669254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d2858f8-b3b3-4cf8-98e4-1fe12ad42f24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:55.670375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d2858f8-b3b3-4cf8-98e4-1fe12ad42f24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:55.670928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d2858f8-b3b3-4cf8-98e4-1fe12ad42f24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:55.671388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d2858f8-b3b3-4cf8-98e4-1fe12ad42f24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:55.844745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1d2858f8-b3b3-4cf8-98e4-1fe12ad42f24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:55.854659 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1d2858f8-b3b3-4cf8-98e4-1fe12ad42f24 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1469 microversion: 2.1 time: 0.218234 Aug 18 11:40:55.856056 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1696/3534] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:55 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:55.861057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cd682165-5411-4045-9122-08f2129e818c tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:55.861864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cd682165-5411-4045-9122-08f2129e818c tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:55.868957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd682165-5411-4045-9122-08f2129e818c tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:55.869341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd682165-5411-4045-9122-08f2129e818c tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:55.870035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd682165-5411-4045-9122-08f2129e818c tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:55.871131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd682165-5411-4045-9122-08f2129e818c tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:55.871769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd682165-5411-4045-9122-08f2129e818c tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:55.872222 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd682165-5411-4045-9122-08f2129e818c tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:56.063412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:40:56.064625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:40:56.065533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:40:56.066241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:40:56.067177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:40:56.070346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cd682165-5411-4045-9122-08f2129e818c tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:56.072865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=8 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:56.078362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:56.078992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:56.079482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:56.080238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:56.080842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:56.081083 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cd682165-5411-4045-9122-08f2129e818c tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1315 microversion: 2.1 time: 0.223631 Aug 18 11:40:56.081349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:56.081931 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1697/3535] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:55 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:56.092121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-235a8fe6-5b44-4fef-a08b-0005de46158a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:56.093182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-235a8fe6-5b44-4fef-a08b-0005de46158a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:56.103449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-235a8fe6-5b44-4fef-a08b-0005de46158a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:56.104472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-235a8fe6-5b44-4fef-a08b-0005de46158a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:56.105704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-235a8fe6-5b44-4fef-a08b-0005de46158a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:56.106878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-235a8fe6-5b44-4fef-a08b-0005de46158a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:56.107500 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-235a8fe6-5b44-4fef-a08b-0005de46158a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:56.108078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-235a8fe6-5b44-4fef-a08b-0005de46158a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:56.110787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Getting quotas for project f7229c8e66644559b6c87363133796a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:40:56.117818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Getting quotas for user 1b6e5f634ee34e718e7014c1dcaec202 and project f7229c8e66644559b6c87363133796a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:40:56.133220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:40:56.135922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:40:56.149836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:56.201622 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f69df5ee-7b68-453f-a2c8-eb4fe1357688 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909442 Aug 18 11:40:56.203116 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1839/3536] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:40:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:40:56.224840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d0248231-926c-4a81-90f1-433154070f40 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:56.226661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d0248231-926c-4a81-90f1-433154070f40 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:56.322127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d0248231-926c-4a81-90f1-433154070f40 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:56.322778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-235a8fe6-5b44-4fef-a08b-0005de46158a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:56.331094 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d0248231-926c-4a81-90f1-433154070f40 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1215 microversion: 2.1 time: 0.118557 Aug 18 11:40:56.331768 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1840/3537] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:56 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1215 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:56.338743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-23797cea-f4fa-4bba-bbf8-5763a2099bc1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:56.339869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-23797cea-f4fa-4bba-bbf8-5763a2099bc1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:56.348298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23797cea-f4fa-4bba-bbf8-5763a2099bc1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:56.348783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23797cea-f4fa-4bba-bbf8-5763a2099bc1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:56.349465 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-235a8fe6-5b44-4fef-a08b-0005de46158a tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1509 microversion: 2.1 time: 0.265478 Aug 18 11:40:56.349634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23797cea-f4fa-4bba-bbf8-5763a2099bc1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:56.351257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23797cea-f4fa-4bba-bbf8-5763a2099bc1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:56.351784 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1698/3538] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:56 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1509 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:56.351913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23797cea-f4fa-4bba-bbf8-5763a2099bc1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:56.352355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23797cea-f4fa-4bba-bbf8-5763a2099bc1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:56.398774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f4399fd9-ed2c-4f50-bdb9-a9c6c76cae1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:56.403889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f4399fd9-ed2c-4f50-bdb9-a9c6c76cae1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:56.425377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4399fd9-ed2c-4f50-bdb9-a9c6c76cae1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:56.425953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4399fd9-ed2c-4f50-bdb9-a9c6c76cae1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:56.426468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4399fd9-ed2c-4f50-bdb9-a9c6c76cae1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:56.428996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4399fd9-ed2c-4f50-bdb9-a9c6c76cae1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:56.429767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4399fd9-ed2c-4f50-bdb9-a9c6c76cae1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:56.430468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f4399fd9-ed2c-4f50-bdb9-a9c6c76cae1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:56.559556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-23797cea-f4fa-4bba-bbf8-5763a2099bc1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:56.570532 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-23797cea-f4fa-4bba-bbf8-5763a2099bc1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1314 microversion: 2.1 time: 0.236945 Aug 18 11:40:56.577203 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f4399fd9-ed2c-4f50-bdb9-a9c6c76cae1c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "PUT /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1081 microversion: 2.1 time: 0.192977 Aug 18 11:40:56.589760 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1841/3540] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:56 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:56.590519 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1699/3540] 10.222.0.73 () {60 vars in 1256 bytes} [Thu Aug 18 11:40:56 2022] PUT /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1081 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:56.620411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7853dd6-39dd-4924-b4f6-dae88fdd0379 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:56.621124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a7853dd6-39dd-4924-b4f6-dae88fdd0379 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:56.629457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7853dd6-39dd-4924-b4f6-dae88fdd0379 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:56.630188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7853dd6-39dd-4924-b4f6-dae88fdd0379 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:56.631375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7853dd6-39dd-4924-b4f6-dae88fdd0379 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:56.632571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7853dd6-39dd-4924-b4f6-dae88fdd0379 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:56.633258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7853dd6-39dd-4924-b4f6-dae88fdd0379 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:56.634027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7853dd6-39dd-4924-b4f6-dae88fdd0379 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:56.882722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a0432b54-248a-4cc1-8cf1-36cacd24581b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:56.883492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a0432b54-248a-4cc1-8cf1-36cacd24581b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:56.899663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a7853dd6-39dd-4924-b4f6-dae88fdd0379 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:56.900224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0432b54-248a-4cc1-8cf1-36cacd24581b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:56.900730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0432b54-248a-4cc1-8cf1-36cacd24581b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:56.907723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0432b54-248a-4cc1-8cf1-36cacd24581b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:56.908752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0432b54-248a-4cc1-8cf1-36cacd24581b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:56.909585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0432b54-248a-4cc1-8cf1-36cacd24581b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:56.911385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0432b54-248a-4cc1-8cf1-36cacd24581b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:56.916263 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a7853dd6-39dd-4924-b4f6-dae88fdd0379 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1507 microversion: 2.1 time: 0.315880 Aug 18 11:40:56.917412 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1842/3541] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:56 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:56.943232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e2506c5-802d-498d-a134-53e652a591f3 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:56.944236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7e2506c5-802d-498d-a134-53e652a591f3 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:56.961203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e2506c5-802d-498d-a134-53e652a591f3 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:56.961811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e2506c5-802d-498d-a134-53e652a591f3 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:56.962307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e2506c5-802d-498d-a134-53e652a591f3 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:56.963280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e2506c5-802d-498d-a134-53e652a591f3 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:56.963905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e2506c5-802d-498d-a134-53e652a591f3 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:56.964324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e2506c5-802d-498d-a134-53e652a591f3 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:57.200828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7e2506c5-802d-498d-a134-53e652a591f3 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:57.215078 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e2506c5-802d-498d-a134-53e652a591f3 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1507 microversion: 2.1 time: 0.279122 Aug 18 11:40:57.235903 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1843/3542] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:56 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1507 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:57.243879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a881b2ec-e9b0-48d4-8fea-9456ec532fcb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:57.245073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a881b2ec-e9b0-48d4-8fea-9456ec532fcb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:57.255509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a881b2ec-e9b0-48d4-8fea-9456ec532fcb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:57.258180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a881b2ec-e9b0-48d4-8fea-9456ec532fcb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:57.259477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a881b2ec-e9b0-48d4-8fea-9456ec532fcb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:57.261593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a881b2ec-e9b0-48d4-8fea-9456ec532fcb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:57.262377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a881b2ec-e9b0-48d4-8fea-9456ec532fcb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:57.263644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a881b2ec-e9b0-48d4-8fea-9456ec532fcb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:57.329592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a0432b54-248a-4cc1-8cf1-36cacd24581b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:57.357152 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a0432b54-248a-4cc1-8cf1-36cacd24581b tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1469 microversion: 2.1 time: 0.481122 Aug 18 11:40:57.359187 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1700/3543] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:56 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1469 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:57.368646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0b1cdcc8-4706-4a77-bb0f-a0fffbbd33bf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:57.386283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0b1cdcc8-4706-4a77-bb0f-a0fffbbd33bf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:57.420845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b1cdcc8-4706-4a77-bb0f-a0fffbbd33bf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:57.423607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b1cdcc8-4706-4a77-bb0f-a0fffbbd33bf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:57.424063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b1cdcc8-4706-4a77-bb0f-a0fffbbd33bf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:57.441992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b1cdcc8-4706-4a77-bb0f-a0fffbbd33bf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:57.443131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b1cdcc8-4706-4a77-bb0f-a0fffbbd33bf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:57.443887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b1cdcc8-4706-4a77-bb0f-a0fffbbd33bf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:57.606691 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0b1cdcc8-4706-4a77-bb0f-a0fffbbd33bf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "PUT /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1083 microversion: 2.1 time: 0.245821 Aug 18 11:40:57.608291 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1701/3544] 10.222.0.73 () {60 vars in 1256 bytes} [Thu Aug 18 11:40:57 2022] PUT /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1083 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:57.630320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-45cda449-4fde-4189-aa1e-b9bbe7bf34c7 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:57.632681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-45cda449-4fde-4189-aa1e-b9bbe7bf34c7 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:57.651006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45cda449-4fde-4189-aa1e-b9bbe7bf34c7 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:57.651621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45cda449-4fde-4189-aa1e-b9bbe7bf34c7 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:57.652170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45cda449-4fde-4189-aa1e-b9bbe7bf34c7 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:57.653456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45cda449-4fde-4189-aa1e-b9bbe7bf34c7 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:57.653860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45cda449-4fde-4189-aa1e-b9bbe7bf34c7 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:57.654668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45cda449-4fde-4189-aa1e-b9bbe7bf34c7 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:57.737798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a881b2ec-e9b0-48d4-8fea-9456ec532fcb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:57.757754 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a881b2ec-e9b0-48d4-8fea-9456ec532fcb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1315 microversion: 2.1 time: 0.518681 Aug 18 11:40:57.791585 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1844/3545] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:57 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:57.797780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9a8fc5ce-e113-4949-ae64-f0d6288ac37c req-67417c7d-7946-4b9f-9e97-0aad514872a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da67cf3-bc5d-4b71-9c07-6234c22493bc", "name": "network-vif-plugged", "status": "completed", "tag": "061756b5-9fa0-425c-99c6-d5be70f85abe"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:57.811957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9a8fc5ce-e113-4949-ae64-f0d6288ac37c req-67417c7d-7946-4b9f-9e97-0aad514872a8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:57.812594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9a8fc5ce-e113-4949-ae64-f0d6288ac37c req-67417c7d-7946-4b9f-9e97-0aad514872a8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:57.813256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9a8fc5ce-e113-4949-ae64-f0d6288ac37c req-67417c7d-7946-4b9f-9e97-0aad514872a8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:57.831808 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9a8fc5ce-e113-4949-ae64-f0d6288ac37c req-67417c7d-7946-4b9f-9e97-0aad514872a8 service nova] Creating event network-vif-plugged:061756b5-9fa0-425c-99c6-d5be70f85abe for instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc on n-h1-853611-3 Aug 18 11:40:57.857038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-9a8fc5ce-e113-4949-ae64-f0d6288ac37c req-67417c7d-7946-4b9f-9e97-0aad514872a8 service nova] Instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 11:40:57.876959 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9a8fc5ce-e113-4949-ae64-f0d6288ac37c req-67417c7d-7946-4b9f-9e97-0aad514872a8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082362 Aug 18 11:40:57.878631 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1845/3546] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:40:57.886076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4fbd6555-977e-4c51-ba63-95188162015f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:57.887276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4fbd6555-977e-4c51-ba63-95188162015f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:57.898650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fbd6555-977e-4c51-ba63-95188162015f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:57.900361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fbd6555-977e-4c51-ba63-95188162015f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:57.901256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fbd6555-977e-4c51-ba63-95188162015f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:57.902731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fbd6555-977e-4c51-ba63-95188162015f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:57.903475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fbd6555-977e-4c51-ba63-95188162015f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:57.904232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fbd6555-977e-4c51-ba63-95188162015f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:57.908766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-45cda449-4fde-4189-aa1e-b9bbe7bf34c7 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:57.917038 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-45cda449-4fde-4189-aa1e-b9bbe7bf34c7 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1211 microversion: 2.1 time: 0.307509 Aug 18 11:40:57.918492 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1702/3547] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:57 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1211 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:57.925950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a97bb8e4-130d-4dd2-a9a9-120ecc638bcd tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:57.928557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a97bb8e4-130d-4dd2-a9a9-120ecc638bcd tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:57.956263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a97bb8e4-130d-4dd2-a9a9-120ecc638bcd tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:57.957256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a97bb8e4-130d-4dd2-a9a9-120ecc638bcd tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:57.958422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a97bb8e4-130d-4dd2-a9a9-120ecc638bcd tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:57.961583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a97bb8e4-130d-4dd2-a9a9-120ecc638bcd tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:57.962281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a97bb8e4-130d-4dd2-a9a9-120ecc638bcd tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:57.963105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a97bb8e4-130d-4dd2-a9a9-120ecc638bcd tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:58.114635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4fbd6555-977e-4c51-ba63-95188162015f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:58.124503 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4fbd6555-977e-4c51-ba63-95188162015f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1314 microversion: 2.1 time: 0.244185 Aug 18 11:40:58.147786 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1846/3548] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:57 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:58.384516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f338d4d7-59e7-4023-8add-cdc22cd517f0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:58.385468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f338d4d7-59e7-4023-8add-cdc22cd517f0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:58.400346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f338d4d7-59e7-4023-8add-cdc22cd517f0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:58.401141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f338d4d7-59e7-4023-8add-cdc22cd517f0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:58.401768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f338d4d7-59e7-4023-8add-cdc22cd517f0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:58.402695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f338d4d7-59e7-4023-8add-cdc22cd517f0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:58.406662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f338d4d7-59e7-4023-8add-cdc22cd517f0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:58.407124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f338d4d7-59e7-4023-8add-cdc22cd517f0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:58.411348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a97bb8e4-130d-4dd2-a9a9-120ecc638bcd tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:58.433555 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a97bb8e4-130d-4dd2-a9a9-120ecc638bcd tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1509 microversion: 2.1 time: 0.513480 Aug 18 11:40:58.454653 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1703/3549] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:57 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1509 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:58.483804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-74dff644-1557-4e3f-af02-d83e798568b5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:58.490020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-74dff644-1557-4e3f-af02-d83e798568b5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:58.503935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-74dff644-1557-4e3f-af02-d83e798568b5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:58.507512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-74dff644-1557-4e3f-af02-d83e798568b5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:58.508852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-74dff644-1557-4e3f-af02-d83e798568b5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:58.509681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-74dff644-1557-4e3f-af02-d83e798568b5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:58.514402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-74dff644-1557-4e3f-af02-d83e798568b5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:58.515143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-74dff644-1557-4e3f-af02-d83e798568b5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:58.669427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f338d4d7-59e7-4023-8add-cdc22cd517f0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:58.672107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:58.686486 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f338d4d7-59e7-4023-8add-cdc22cd517f0 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1469 microversion: 2.1 time: 0.306628 Aug 18 11:40:58.687438 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1847/3550] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:58 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1469 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:58.813262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-74dff644-1557-4e3f-af02-d83e798568b5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:58.820287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1cf6bcea-a497-4f44-87a4-18eaf98ba12e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:58.821834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1cf6bcea-a497-4f44-87a4-18eaf98ba12e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:58.825006 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-74dff644-1557-4e3f-af02-d83e798568b5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1509 microversion: 2.1 time: 0.366608 Aug 18 11:40:58.832816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cf6bcea-a497-4f44-87a4-18eaf98ba12e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:58.833667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cf6bcea-a497-4f44-87a4-18eaf98ba12e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:58.834492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cf6bcea-a497-4f44-87a4-18eaf98ba12e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:58.836550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cf6bcea-a497-4f44-87a4-18eaf98ba12e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:58.837290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cf6bcea-a497-4f44-87a4-18eaf98ba12e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:58.838109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cf6bcea-a497-4f44-87a4-18eaf98ba12e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:58.841550 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1704/3551] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:58 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1509 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:58.849017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-952df132-7b88-4f43-b416-3bdf8fd0305c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:58.850192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-952df132-7b88-4f43-b416-3bdf8fd0305c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:58.857059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952df132-7b88-4f43-b416-3bdf8fd0305c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:58.857675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952df132-7b88-4f43-b416-3bdf8fd0305c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:58.858267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952df132-7b88-4f43-b416-3bdf8fd0305c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:58.859148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952df132-7b88-4f43-b416-3bdf8fd0305c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:58.859805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952df132-7b88-4f43-b416-3bdf8fd0305c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:58.860320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952df132-7b88-4f43-b416-3bdf8fd0305c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:58.891690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-952df132-7b88-4f43-b416-3bdf8fd0305c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:40:58.996346 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-952df132-7b88-4f43-b416-3bdf8fd0305c tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 204 len: 0 microversion: 2.1 time: 0.152425 Aug 18 11:40:58.996690 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1705/3552] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:40:58 2022] DELETE /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:40:59.003409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-28db86de-32ad-4453-ba0a-1d3f7efce0b9 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:59.004228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-28db86de-32ad-4453-ba0a-1d3f7efce0b9 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:59.014373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28db86de-32ad-4453-ba0a-1d3f7efce0b9 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:59.014995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28db86de-32ad-4453-ba0a-1d3f7efce0b9 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:59.015479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28db86de-32ad-4453-ba0a-1d3f7efce0b9 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:59.016205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28db86de-32ad-4453-ba0a-1d3f7efce0b9 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:59.024250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28db86de-32ad-4453-ba0a-1d3f7efce0b9 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:59.024759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-28db86de-32ad-4453-ba0a-1d3f7efce0b9 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:59.042319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:40:59.061737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1cf6bcea-a497-4f44-87a4-18eaf98ba12e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:59.074976 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1cf6bcea-a497-4f44-87a4-18eaf98ba12e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1315 microversion: 2.1 time: 0.280702 Aug 18 11:40:59.077026 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1848/3553] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:58 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:59.083769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-010cf0ee-7334-496d-aa60-24fa46c08870 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:59.086899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-010cf0ee-7334-496d-aa60-24fa46c08870 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:59.095754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-010cf0ee-7334-496d-aa60-24fa46c08870 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:59.097582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-010cf0ee-7334-496d-aa60-24fa46c08870 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:59.098414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-010cf0ee-7334-496d-aa60-24fa46c08870 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:59.104730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-010cf0ee-7334-496d-aa60-24fa46c08870 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:59.106121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-010cf0ee-7334-496d-aa60-24fa46c08870 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:59.108079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-010cf0ee-7334-496d-aa60-24fa46c08870 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:59.108315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-28db86de-32ad-4453-ba0a-1d3f7efce0b9 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:59.120569 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-28db86de-32ad-4453-ba0a-1d3f7efce0b9 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1273 microversion: 2.1 time: 0.121840 Aug 18 11:40:59.134372 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1706/3554] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:58 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:59.147594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-010cf0ee-7334-496d-aa60-24fa46c08870 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:40:59.148685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-26b4ee63-f5a6-4aed-9035-cc0b1f0e4a3c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:59.149592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-26b4ee63-f5a6-4aed-9035-cc0b1f0e4a3c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:59.158589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26b4ee63-f5a6-4aed-9035-cc0b1f0e4a3c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:59.159103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26b4ee63-f5a6-4aed-9035-cc0b1f0e4a3c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:59.159604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26b4ee63-f5a6-4aed-9035-cc0b1f0e4a3c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:59.160386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26b4ee63-f5a6-4aed-9035-cc0b1f0e4a3c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:59.160852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26b4ee63-f5a6-4aed-9035-cc0b1f0e4a3c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:59.161356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26b4ee63-f5a6-4aed-9035-cc0b1f0e4a3c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:59.216054 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.compute.api [None req-010cf0ee-7334-496d-aa60-24fa46c08870 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Instance is already in deleting state, ignoring this request Aug 18 11:40:59.217292 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-010cf0ee-7334-496d-aa60-24fa46c08870 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 204 len: 0 microversion: 2.1 time: 0.138221 Aug 18 11:40:59.218165 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1849/3555] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:40:59 2022] DELETE /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:40:59.228198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7720a9c-1b12-443a-8e6b-f7f150b5d574 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:59.229221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a7720a9c-1b12-443a-8e6b-f7f150b5d574 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:59.236184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7720a9c-1b12-443a-8e6b-f7f150b5d574 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:59.236714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7720a9c-1b12-443a-8e6b-f7f150b5d574 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:59.237161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7720a9c-1b12-443a-8e6b-f7f150b5d574 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:59.237883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7720a9c-1b12-443a-8e6b-f7f150b5d574 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:59.238350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7720a9c-1b12-443a-8e6b-f7f150b5d574 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:59.238863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7720a9c-1b12-443a-8e6b-f7f150b5d574 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:59.469848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-26b4ee63-f5a6-4aed-9035-cc0b1f0e4a3c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:59.485858 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-26b4ee63-f5a6-4aed-9035-cc0b1f0e4a3c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1314 microversion: 2.1 time: 0.340101 Aug 18 11:40:59.496756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a7720a9c-1b12-443a-8e6b-f7f150b5d574 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:40:59.498860 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1707/3556] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:59 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:40:59.507156 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a7720a9c-1b12-443a-8e6b-f7f150b5d574 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1515 microversion: 2.1 time: 0.283588 Aug 18 11:40:59.511308 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1850/3557] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:59 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1515 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:40:59.710942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-391ffdf6-2590-4066-8e02-81db71c1eade tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:40:59.711976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-391ffdf6-2590-4066-8e02-81db71c1eade tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:40:59.721543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391ffdf6-2590-4066-8e02-81db71c1eade tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:59.722507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391ffdf6-2590-4066-8e02-81db71c1eade tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:59.723245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391ffdf6-2590-4066-8e02-81db71c1eade tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:59.724094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391ffdf6-2590-4066-8e02-81db71c1eade tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:59.725196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391ffdf6-2590-4066-8e02-81db71c1eade tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:59.725728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391ffdf6-2590-4066-8e02-81db71c1eade tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:59.917808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-21e07b15-9a77-4d9b-b6d2-5db014e0cc02 req-eb0c5022-0a7b-42c5-8b3c-f24d19a515d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a0c8a6-415b-4702-a260-13ff9be3fd57", "name": "network-vif-plugged", "status": "completed", "tag": "77f6cdf6-27ca-4442-87a9-d496b7fb4ea5"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:40:59.931456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-21e07b15-9a77-4d9b-b6d2-5db014e0cc02 req-eb0c5022-0a7b-42c5-8b3c-f24d19a515d6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:40:59.932207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-21e07b15-9a77-4d9b-b6d2-5db014e0cc02 req-eb0c5022-0a7b-42c5-8b3c-f24d19a515d6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:40:59.933413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-21e07b15-9a77-4d9b-b6d2-5db014e0cc02 req-eb0c5022-0a7b-42c5-8b3c-f24d19a515d6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:40:59.950298 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-21e07b15-9a77-4d9b-b6d2-5db014e0cc02 req-eb0c5022-0a7b-42c5-8b3c-f24d19a515d6 service nova] Creating event network-vif-plugged:77f6cdf6-27ca-4442-87a9-d496b7fb4ea5 for instance c6a0c8a6-415b-4702-a260-13ff9be3fd57 on n-h1-853611-3 Aug 18 11:40:59.960123 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-21e07b15-9a77-4d9b-b6d2-5db014e0cc02 req-eb0c5022-0a7b-42c5-8b3c-f24d19a515d6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046080 Aug 18 11:40:59.961586 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1851/3558] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:41:00.076315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-391ffdf6-2590-4066-8e02-81db71c1eade tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:00.085259 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-391ffdf6-2590-4066-8e02-81db71c1eade tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1469 microversion: 2.1 time: 0.378979 Aug 18 11:41:00.098932 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1708/3559] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:40:59 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1469 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:00.103053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03627f81-93ad-4e89-b5e3-e8ae99740a52 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:00.103921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-03627f81-93ad-4e89-b5e3-e8ae99740a52 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:00.110743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03627f81-93ad-4e89-b5e3-e8ae99740a52 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:00.111491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03627f81-93ad-4e89-b5e3-e8ae99740a52 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:00.111680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03627f81-93ad-4e89-b5e3-e8ae99740a52 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:00.112395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03627f81-93ad-4e89-b5e3-e8ae99740a52 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:00.112892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03627f81-93ad-4e89-b5e3-e8ae99740a52 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:00.113327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03627f81-93ad-4e89-b5e3-e8ae99740a52 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:00.144200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9b917f7d-d57a-48a3-b41d-08b13ac26b79 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:00.144826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9b917f7d-d57a-48a3-b41d-08b13ac26b79 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:00.152179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b917f7d-d57a-48a3-b41d-08b13ac26b79 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:00.152944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b917f7d-d57a-48a3-b41d-08b13ac26b79 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:00.153580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b917f7d-d57a-48a3-b41d-08b13ac26b79 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:00.154597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b917f7d-d57a-48a3-b41d-08b13ac26b79 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:00.155554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b917f7d-d57a-48a3-b41d-08b13ac26b79 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:00.156639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9b917f7d-d57a-48a3-b41d-08b13ac26b79 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:00.306799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-03627f81-93ad-4e89-b5e3-e8ae99740a52 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:00.316456 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-03627f81-93ad-4e89-b5e3-e8ae99740a52 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1315 microversion: 2.1 time: 0.220483 Aug 18 11:41:00.317057 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1852/3560] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:00 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:00.394269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9b917f7d-d57a-48a3-b41d-08b13ac26b79 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:00.404120 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9b917f7d-d57a-48a3-b41d-08b13ac26b79 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1315 microversion: 2.1 time: 0.263742 Aug 18 11:41:00.404742 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1709/3561] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:00 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:00.512708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cb3279a3-e785-416e-b710-957df6d09922 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:00.513614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cb3279a3-e785-416e-b710-957df6d09922 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:00.526237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb3279a3-e785-416e-b710-957df6d09922 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:00.530681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb3279a3-e785-416e-b710-957df6d09922 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:00.531215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb3279a3-e785-416e-b710-957df6d09922 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:00.532194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb3279a3-e785-416e-b710-957df6d09922 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:00.532749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb3279a3-e785-416e-b710-957df6d09922 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:00.533251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb3279a3-e785-416e-b710-957df6d09922 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:00.535047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bf8b5557-b021-42d3-a635-606e05f48f0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:00.535598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bf8b5557-b021-42d3-a635-606e05f48f0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:00.546709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf8b5557-b021-42d3-a635-606e05f48f0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:00.554393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf8b5557-b021-42d3-a635-606e05f48f0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:00.556808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf8b5557-b021-42d3-a635-606e05f48f0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:00.559639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf8b5557-b021-42d3-a635-606e05f48f0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:00.560359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf8b5557-b021-42d3-a635-606e05f48f0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:00.562367 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf8b5557-b021-42d3-a635-606e05f48f0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:00.732006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cb3279a3-e785-416e-b710-957df6d09922 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:00.741659 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cb3279a3-e785-416e-b710-957df6d09922 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1314 microversion: 2.1 time: 0.233950 Aug 18 11:41:00.742877 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1853/3562] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:00 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:00.748240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f49a8868-5d07-4bc7-b417-083e5e69ed11 req-e200e7e3-8e66-4854-aca0-0e7d6d23c346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6076f702-2b3c-488e-aa41-0c3a2f63ec26", "tag": "7b29d6db-3458-46ed-bbb6-599fb1ac5724"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:00.758913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f49a8868-5d07-4bc7-b417-083e5e69ed11 req-e200e7e3-8e66-4854-aca0-0e7d6d23c346 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:00.759579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f49a8868-5d07-4bc7-b417-083e5e69ed11 req-e200e7e3-8e66-4854-aca0-0e7d6d23c346 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:00.760125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f49a8868-5d07-4bc7-b417-083e5e69ed11 req-e200e7e3-8e66-4854-aca0-0e7d6d23c346 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:00.773388 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f49a8868-5d07-4bc7-b417-083e5e69ed11 req-e200e7e3-8e66-4854-aca0-0e7d6d23c346 service nova] Creating event network-changed:7b29d6db-3458-46ed-bbb6-599fb1ac5724 for instance 6076f702-2b3c-488e-aa41-0c3a2f63ec26 on n-h2-853611-3 Aug 18 11:41:00.778820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f49a8868-5d07-4bc7-b417-083e5e69ed11 req-e200e7e3-8e66-4854-aca0-0e7d6d23c346 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034352 Aug 18 11:41:00.779896 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1854/3563] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:00.870262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bf8b5557-b021-42d3-a635-606e05f48f0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:00.879913 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bf8b5557-b021-42d3-a635-606e05f48f0b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1515 microversion: 2.1 time: 0.350401 Aug 18 11:41:00.888882 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1710/3564] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:00 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1515 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:01.109211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ff922585-51b0-43b6-b48a-a0798cb9d633 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:01.110015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ff922585-51b0-43b6-b48a-a0798cb9d633 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:01.120991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff922585-51b0-43b6-b48a-a0798cb9d633 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:01.122132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff922585-51b0-43b6-b48a-a0798cb9d633 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:01.122940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff922585-51b0-43b6-b48a-a0798cb9d633 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:01.123928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff922585-51b0-43b6-b48a-a0798cb9d633 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:01.124767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff922585-51b0-43b6-b48a-a0798cb9d633 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:01.125519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff922585-51b0-43b6-b48a-a0798cb9d633 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:01.279653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ff922585-51b0-43b6-b48a-a0798cb9d633 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:01.289987 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ff922585-51b0-43b6-b48a-a0798cb9d633 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1469 microversion: 2.1 time: 0.185872 Aug 18 11:41:01.291127 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1855/3565] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:01 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1469 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:01.337947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2f11d557-df74-4806-97f7-64ed49329c31 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:01.338646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2f11d557-df74-4806-97f7-64ed49329c31 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:01.346192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f11d557-df74-4806-97f7-64ed49329c31 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:01.347189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f11d557-df74-4806-97f7-64ed49329c31 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:01.348158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f11d557-df74-4806-97f7-64ed49329c31 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:01.349309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f11d557-df74-4806-97f7-64ed49329c31 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:01.350115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f11d557-df74-4806-97f7-64ed49329c31 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:01.350755 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f11d557-df74-4806-97f7-64ed49329c31 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:01.426086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a7fa01e-5ae3-4fc4-8361-911bc092b496 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:01.426735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6a7fa01e-5ae3-4fc4-8361-911bc092b496 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:01.433847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a7fa01e-5ae3-4fc4-8361-911bc092b496 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:01.434393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a7fa01e-5ae3-4fc4-8361-911bc092b496 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:01.434964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a7fa01e-5ae3-4fc4-8361-911bc092b496 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:01.435673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a7fa01e-5ae3-4fc4-8361-911bc092b496 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:01.436127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a7fa01e-5ae3-4fc4-8361-911bc092b496 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:01.436551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a7fa01e-5ae3-4fc4-8361-911bc092b496 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:01.619440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6a7fa01e-5ae3-4fc4-8361-911bc092b496 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:01.639234 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6a7fa01e-5ae3-4fc4-8361-911bc092b496 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1315 microversion: 2.1 time: 0.216946 Aug 18 11:41:01.639844 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1856/3566] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:01 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:01.735874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2f11d557-df74-4806-97f7-64ed49329c31 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:01.746137 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2f11d557-df74-4806-97f7-64ed49329c31 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1315 microversion: 2.1 time: 0.412592 Aug 18 11:41:01.747140 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1711/3567] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:01 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:01.766718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-75825cf7-da9c-4207-a41a-80349472f810 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:01.767337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-75825cf7-da9c-4207-a41a-80349472f810 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:01.774453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75825cf7-da9c-4207-a41a-80349472f810 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:01.774964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75825cf7-da9c-4207-a41a-80349472f810 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:01.775457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75825cf7-da9c-4207-a41a-80349472f810 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:01.776150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75825cf7-da9c-4207-a41a-80349472f810 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:01.776611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75825cf7-da9c-4207-a41a-80349472f810 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:01.777043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75825cf7-da9c-4207-a41a-80349472f810 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:01.903186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-46b9a7c3-a763-4a26-912c-61fb749cbbcf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:01.903819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-46b9a7c3-a763-4a26-912c-61fb749cbbcf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:01.915188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46b9a7c3-a763-4a26-912c-61fb749cbbcf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:01.916018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46b9a7c3-a763-4a26-912c-61fb749cbbcf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:01.916467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46b9a7c3-a763-4a26-912c-61fb749cbbcf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:01.917242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46b9a7c3-a763-4a26-912c-61fb749cbbcf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:01.917700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46b9a7c3-a763-4a26-912c-61fb749cbbcf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:01.918174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46b9a7c3-a763-4a26-912c-61fb749cbbcf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:01.953900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-75825cf7-da9c-4207-a41a-80349472f810 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:01.963405 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-75825cf7-da9c-4207-a41a-80349472f810 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1314 microversion: 2.1 time: 0.200747 Aug 18 11:41:01.964523 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1857/3568] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:01 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:01.995805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c400baf1-e42e-4c0b-bb0d-21b76d9c21c7 req-2701db60-c8e2-41b6-be7e-1013f7af6d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c5530b-64fd-465c-a52c-9e81b68a3f2a", "name": "network-vif-plugged", "status": "completed", "tag": "363c1787-80ec-405e-872b-dff4d89afcb2"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:02.005434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c400baf1-e42e-4c0b-bb0d-21b76d9c21c7 req-2701db60-c8e2-41b6-be7e-1013f7af6d80 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:02.009954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c400baf1-e42e-4c0b-bb0d-21b76d9c21c7 req-2701db60-c8e2-41b6-be7e-1013f7af6d80 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:02.010406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c400baf1-e42e-4c0b-bb0d-21b76d9c21c7 req-2701db60-c8e2-41b6-be7e-1013f7af6d80 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:02.024432 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c400baf1-e42e-4c0b-bb0d-21b76d9c21c7 req-2701db60-c8e2-41b6-be7e-1013f7af6d80 service nova] Creating event network-vif-plugged:363c1787-80ec-405e-872b-dff4d89afcb2 for instance 69c5530b-64fd-465c-a52c-9e81b68a3f2a on n-h1-853611-3 Aug 18 11:41:02.029412 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c400baf1-e42e-4c0b-bb0d-21b76d9c21c7 req-2701db60-c8e2-41b6-be7e-1013f7af6d80 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037396 Aug 18 11:41:02.030154 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1858/3569] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:02.185037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-46b9a7c3-a763-4a26-912c-61fb749cbbcf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:02.193726 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-46b9a7c3-a763-4a26-912c-61fb749cbbcf tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1515 microversion: 2.1 time: 0.293828 Aug 18 11:41:02.194324 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1712/3570] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:01 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1515 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:02.314656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f562d9b1-336d-4010-9e58-8c0e7a4bfe4f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:02.315362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f562d9b1-336d-4010-9e58-8c0e7a4bfe4f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:02.322924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f562d9b1-336d-4010-9e58-8c0e7a4bfe4f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:02.323414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f562d9b1-336d-4010-9e58-8c0e7a4bfe4f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:02.324054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f562d9b1-336d-4010-9e58-8c0e7a4bfe4f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:02.324763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f562d9b1-336d-4010-9e58-8c0e7a4bfe4f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:02.325217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f562d9b1-336d-4010-9e58-8c0e7a4bfe4f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:02.325867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f562d9b1-336d-4010-9e58-8c0e7a4bfe4f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:02.468982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f562d9b1-336d-4010-9e58-8c0e7a4bfe4f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:02.477434 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f562d9b1-336d-4010-9e58-8c0e7a4bfe4f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1469 microversion: 2.1 time: 0.168085 Aug 18 11:41:02.478070 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1859/3571] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:02 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:02.661412 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2383b503-615b-41ab-9e24-40bb634040d8 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:02.662814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2383b503-615b-41ab-9e24-40bb634040d8 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:02.669932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2383b503-615b-41ab-9e24-40bb634040d8 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:02.670422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2383b503-615b-41ab-9e24-40bb634040d8 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:02.670895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2383b503-615b-41ab-9e24-40bb634040d8 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:02.671598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2383b503-615b-41ab-9e24-40bb634040d8 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:02.672055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2383b503-615b-41ab-9e24-40bb634040d8 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:02.672480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2383b503-615b-41ab-9e24-40bb634040d8 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:02.768829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dab4a64d-1c4e-4e2c-92d0-936ba5fd159d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:02.769453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dab4a64d-1c4e-4e2c-92d0-936ba5fd159d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:02.775990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dab4a64d-1c4e-4e2c-92d0-936ba5fd159d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:02.776587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dab4a64d-1c4e-4e2c-92d0-936ba5fd159d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:02.777068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dab4a64d-1c4e-4e2c-92d0-936ba5fd159d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:02.777823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dab4a64d-1c4e-4e2c-92d0-936ba5fd159d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:02.778283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dab4a64d-1c4e-4e2c-92d0-936ba5fd159d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:02.778772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dab4a64d-1c4e-4e2c-92d0-936ba5fd159d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:02.824270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2383b503-615b-41ab-9e24-40bb634040d8 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:02.832054 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2383b503-615b-41ab-9e24-40bb634040d8 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1315 microversion: 2.1 time: 0.174672 Aug 18 11:41:02.832649 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1713/3572] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:02 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:02.837692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-0ceb78a1-c4b3-47ae-8906-413ce621ec6e req-b3b4f81c-8b19-4d14-a8df-11f8b379d5ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7daadf54-276a-4e9e-98f1-b53b20e1c309", "name": "network-vif-deleted", "tag": "ed675b6d-3eaa-4ea9-8963-76adda0f207d"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:02.847429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0ceb78a1-c4b3-47ae-8906-413ce621ec6e req-b3b4f81c-8b19-4d14-a8df-11f8b379d5ba service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:02.847909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0ceb78a1-c4b3-47ae-8906-413ce621ec6e req-b3b4f81c-8b19-4d14-a8df-11f8b379d5ba service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:02.848349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0ceb78a1-c4b3-47ae-8906-413ce621ec6e req-b3b4f81c-8b19-4d14-a8df-11f8b379d5ba service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:02.860559 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-0ceb78a1-c4b3-47ae-8906-413ce621ec6e req-b3b4f81c-8b19-4d14-a8df-11f8b379d5ba service nova] Creating event network-vif-deleted:ed675b6d-3eaa-4ea9-8963-76adda0f207d for instance 7daadf54-276a-4e9e-98f1-b53b20e1c309 on n-h1-853611-3 Aug 18 11:41:02.866062 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-0ceb78a1-c4b3-47ae-8906-413ce621ec6e req-b3b4f81c-8b19-4d14-a8df-11f8b379d5ba service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031393 Aug 18 11:41:02.866725 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1714/3573] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:02.930353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dab4a64d-1c4e-4e2c-92d0-936ba5fd159d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:02.940362 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dab4a64d-1c4e-4e2c-92d0-936ba5fd159d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1315 microversion: 2.1 time: 0.175213 Aug 18 11:41:02.941463 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1860/3574] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:02 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:02.985535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f911f448-60cd-4543-beb5-4156a2d6bbf4 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:02.986803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f911f448-60cd-4543-beb5-4156a2d6bbf4 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:03.010734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f911f448-60cd-4543-beb5-4156a2d6bbf4 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:03.011237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f911f448-60cd-4543-beb5-4156a2d6bbf4 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:03.013519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f911f448-60cd-4543-beb5-4156a2d6bbf4 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:03.014495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f911f448-60cd-4543-beb5-4156a2d6bbf4 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:03.015136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f911f448-60cd-4543-beb5-4156a2d6bbf4 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:03.015771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f911f448-60cd-4543-beb5-4156a2d6bbf4 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:03.215920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-733533e1-488b-4d50-8f22-11b12ec2236b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:03.216540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-733533e1-488b-4d50-8f22-11b12ec2236b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:03.227127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733533e1-488b-4d50-8f22-11b12ec2236b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:03.227698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733533e1-488b-4d50-8f22-11b12ec2236b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:03.228885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733533e1-488b-4d50-8f22-11b12ec2236b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:03.229642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733533e1-488b-4d50-8f22-11b12ec2236b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:03.230926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733533e1-488b-4d50-8f22-11b12ec2236b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:03.231385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733533e1-488b-4d50-8f22-11b12ec2236b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:03.268651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733533e1-488b-4d50-8f22-11b12ec2236b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:03.269146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733533e1-488b-4d50-8f22-11b12ec2236b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:03.269651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-733533e1-488b-4d50-8f22-11b12ec2236b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:03.270123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-733533e1-488b-4d50-8f22-11b12ec2236b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lazy-loading 'fault' on Instance uuid 7daadf54-276a-4e9e-98f1-b53b20e1c309 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:41:03.316368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f911f448-60cd-4543-beb5-4156a2d6bbf4 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:03.329089 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f911f448-60cd-4543-beb5-4156a2d6bbf4 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1499 microversion: 2.1 time: 0.347604 Aug 18 11:41:03.330013 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1715/3575] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:02 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1499 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:03.340548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-733533e1-488b-4d50-8f22-11b12ec2236b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a235b1ba7e4f7d8d7a7c424b80c823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538a71f94fd54403a20347030509ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:03.356579 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-733533e1-488b-4d50-8f22-11b12ec2236b tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 200 len: 1308 microversion: 2.1 time: 0.144053 Aug 18 11:41:03.358568 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1861/3576] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:03 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 1308 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:03.364990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7134506e-bb99-4ea6-8dc3-d1554e63e9be tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:03.368268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7134506e-bb99-4ea6-8dc3-d1554e63e9be tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:03.375005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7134506e-bb99-4ea6-8dc3-d1554e63e9be tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:03.375763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7134506e-bb99-4ea6-8dc3-d1554e63e9be tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:03.376210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7134506e-bb99-4ea6-8dc3-d1554e63e9be tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:03.377083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7134506e-bb99-4ea6-8dc3-d1554e63e9be tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:03.377721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7134506e-bb99-4ea6-8dc3-d1554e63e9be tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:03.378153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7134506e-bb99-4ea6-8dc3-d1554e63e9be tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:03.403122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-7134506e-bb99-4ea6-8dc3-d1554e63e9be tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lazy-loading 'flavor' on Instance uuid c6a0c8a6-415b-4702-a260-13ff9be3fd57 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:41:03.486599 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7134506e-bb99-4ea6-8dc3-d1554e63e9be tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "POST /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57/action" status: 200 len: 32 microversion: 2.1 time: 0.138661 Aug 18 11:41:03.488000 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1716/3577] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:41:03 2022] POST /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57/action => generated 32 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 11:41:03.497885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0592ec98-7a5d-4cab-a0f1-ed4ab583b4ec tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:03.498923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0592ec98-7a5d-4cab-a0f1-ed4ab583b4ec tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:03.501414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7fcd9ddf-f035-49b4-85cc-89b8db694472 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:03.502978 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7fcd9ddf-f035-49b4-85cc-89b8db694472 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:03.508557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0592ec98-7a5d-4cab-a0f1-ed4ab583b4ec tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:03.510381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0592ec98-7a5d-4cab-a0f1-ed4ab583b4ec tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:03.511117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0592ec98-7a5d-4cab-a0f1-ed4ab583b4ec tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:03.512469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fcd9ddf-f035-49b4-85cc-89b8db694472 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:03.512627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fcd9ddf-f035-49b4-85cc-89b8db694472 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:03.512966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fcd9ddf-f035-49b4-85cc-89b8db694472 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:03.513349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0592ec98-7a5d-4cab-a0f1-ed4ab583b4ec tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:03.513688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fcd9ddf-f035-49b4-85cc-89b8db694472 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:03.514264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0592ec98-7a5d-4cab-a0f1-ed4ab583b4ec tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:03.514401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fcd9ddf-f035-49b4-85cc-89b8db694472 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:03.514770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7fcd9ddf-f035-49b4-85cc-89b8db694472 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:03.516179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0592ec98-7a5d-4cab-a0f1-ed4ab583b4ec tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:03.706253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7fcd9ddf-f035-49b4-85cc-89b8db694472 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:03.725932 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7fcd9ddf-f035-49b4-85cc-89b8db694472 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1469 microversion: 2.1 time: 0.229789 Aug 18 11:41:03.730336 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1717/3578] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:03 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1469 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:03.799914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0592ec98-7a5d-4cab-a0f1-ed4ab583b4ec tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:03.812453 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0592ec98-7a5d-4cab-a0f1-ed4ab583b4ec tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.318675 Aug 18 11:41:03.814053 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1862/3579] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:03 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:03.859714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e3cb5f2a-0222-4e8e-a599-ab432b6b4784 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:03.860497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e3cb5f2a-0222-4e8e-a599-ab432b6b4784 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:03.867825 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3cb5f2a-0222-4e8e-a599-ab432b6b4784 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:03.868420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3cb5f2a-0222-4e8e-a599-ab432b6b4784 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:03.868849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3cb5f2a-0222-4e8e-a599-ab432b6b4784 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:03.869662 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3cb5f2a-0222-4e8e-a599-ab432b6b4784 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:03.870033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3cb5f2a-0222-4e8e-a599-ab432b6b4784 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:03.870684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3cb5f2a-0222-4e8e-a599-ab432b6b4784 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:03.969120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-e4bca9e4-dc28-417a-bc69-186947a2fe03 req-8ffc8b75-456a-4434-bb9c-405ad546d200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da67cf3-bc5d-4b71-9c07-6234c22493bc", "name": "network-vif-unplugged", "status": "completed", "tag": "061756b5-9fa0-425c-99c6-d5be70f85abe"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:03.980601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e4bca9e4-dc28-417a-bc69-186947a2fe03 req-8ffc8b75-456a-4434-bb9c-405ad546d200 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:03.982117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e4bca9e4-dc28-417a-bc69-186947a2fe03 req-8ffc8b75-456a-4434-bb9c-405ad546d200 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:03.982768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e4bca9e4-dc28-417a-bc69-186947a2fe03 req-8ffc8b75-456a-4434-bb9c-405ad546d200 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.000079 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e4bca9e4-dc28-417a-bc69-186947a2fe03 req-8ffc8b75-456a-4434-bb9c-405ad546d200 service nova] Creating event network-vif-unplugged:061756b5-9fa0-425c-99c6-d5be70f85abe for instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc on n-h2-853611-3 Aug 18 11:41:04.007007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-e4bca9e4-dc28-417a-bc69-186947a2fe03 req-8ffc8b75-456a-4434-bb9c-405ad546d200 service nova] Instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 11:41:04.023821 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-e4bca9e4-dc28-417a-bc69-186947a2fe03 req-8ffc8b75-456a-4434-bb9c-405ad546d200 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145477 Aug 18 11:41:04.024726 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1863/3580] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:04.033132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b67b06cc-e331-4259-8ab5-b71e00347eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:04.034071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b67b06cc-e331-4259-8ab5-b71e00347eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:04.045425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b67b06cc-e331-4259-8ab5-b71e00347eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.046321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b67b06cc-e331-4259-8ab5-b71e00347eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.046986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b67b06cc-e331-4259-8ab5-b71e00347eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.047869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b67b06cc-e331-4259-8ab5-b71e00347eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.048475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b67b06cc-e331-4259-8ab5-b71e00347eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.049255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b67b06cc-e331-4259-8ab5-b71e00347eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.310356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b67b06cc-e331-4259-8ab5-b71e00347eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:04.312021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e3cb5f2a-0222-4e8e-a599-ab432b6b4784 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:04.321722 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e3cb5f2a-0222-4e8e-a599-ab432b6b4784 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1315 microversion: 2.1 time: 0.469508 Aug 18 11:41:04.322041 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b67b06cc-e331-4259-8ab5-b71e00347eb6 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1315 microversion: 2.1 time: 0.295602 Aug 18 11:41:04.323434 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1718/3581] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:03 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:04.337567 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1864/3582] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:04 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:04.341122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-97143fd8-e323-47e1-8954-50824149aafc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:04.342161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-97143fd8-e323-47e1-8954-50824149aafc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:04.344796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:04.354710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97143fd8-e323-47e1-8954-50824149aafc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.355659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97143fd8-e323-47e1-8954-50824149aafc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.356950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97143fd8-e323-47e1-8954-50824149aafc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.357905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97143fd8-e323-47e1-8954-50824149aafc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.358595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97143fd8-e323-47e1-8954-50824149aafc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.359336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-97143fd8-e323-47e1-8954-50824149aafc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.385662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e287b9b-d65c-4ea5-b0c2-14d6e4d294e5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:04.386278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1e287b9b-d65c-4ea5-b0c2-14d6e4d294e5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: 7daadf54-276a-4e9e-98f1-b53b20e1c309] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:04.392904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e287b9b-d65c-4ea5-b0c2-14d6e4d294e5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.393390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e287b9b-d65c-4ea5-b0c2-14d6e4d294e5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.393837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e287b9b-d65c-4ea5-b0c2-14d6e4d294e5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.394558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e287b9b-d65c-4ea5-b0c2-14d6e4d294e5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.395359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e287b9b-d65c-4ea5-b0c2-14d6e4d294e5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.395854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e287b9b-d65c-4ea5-b0c2-14d6e4d294e5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.400849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:04.442017 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-1e287b9b-d65c-4ea5-b0c2-14d6e4d294e5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] HTTP exception thrown: Instance 7daadf54-276a-4e9e-98f1-b53b20e1c309 could not be found. Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e287b9b-d65c-4ea5-b0c2-14d6e4d294e5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Request method failure captured: Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 HTTP/1.1 Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iSqpv3foRFubLkcFEOcOXRDFSoyQA93N7zGxIC1L69pcMrN39LsvbE0PwSLJZHWKFZknNA4WoW9KCjJvWhGdX-Eqj7c9q0P4hI-7j6iWqTCHlP_1VqwxvhkN2rhFdbrEPPTuqRjPKzs-kcF5jtSV-4ga6T270IDEyAlQEu_cgUL21c Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 538a71f94fd54403a20347030509ef69 Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/538a71f94fd54403a20347030509ef69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/538a71f94fd54403a20347030509ef69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_538a71f94fd54403a20347030509ef69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/538a71f94fd54403a20347030509ef69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 538a71f94fd54403a20347030509ef69 Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerDiskConfigTestJSON-2018059519-project Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 25a235b1ba7e4f7d8d7a7c424b80c823 Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerDiskConfigTestJSON-2018059519-project Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 7daadf54-276a-4e9e-98f1-b53b20e1c309 could not be found. Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '7daadf54-276a-4e9e-98f1-b53b20e1c309'} Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7daadf54-276a-4e9e-98f1-b53b20e1c309 could not be found. Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7daadf54-276a-4e9e-98f1-b53b20e1c309 could not be found. Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:04.446132 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.451184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.451184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:04.451184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:04.451184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:04.451184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:04.451184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7daadf54-276a-4e9e-98f1-b53b20e1c309 could not be found. Aug 18 11:41:04.451184 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.457138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e287b9b-d65c-4ea5-b0c2-14d6e4d294e5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Returning 404 to user: Instance 7daadf54-276a-4e9e-98f1-b53b20e1c309 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:04.458391 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1e287b9b-d65c-4ea5-b0c2-14d6e4d294e5 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309" status: 404 len: 111 microversion: 2.1 time: 0.076517 Aug 18 11:41:04.459830 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1865/3583] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:04 2022] GET /compute/v2.1/servers/7daadf54-276a-4e9e-98f1-b53b20e1c309 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:41:04.471476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d36521b4-5b79-4af5-8a2c-658eee1f87ce tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:04.476453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d36521b4-5b79-4af5-8a2c-658eee1f87ce tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:04.494654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36521b4-5b79-4af5-8a2c-658eee1f87ce tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.495162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36521b4-5b79-4af5-8a2c-658eee1f87ce tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.497525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36521b4-5b79-4af5-8a2c-658eee1f87ce tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.498459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36521b4-5b79-4af5-8a2c-658eee1f87ce tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.499083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36521b4-5b79-4af5-8a2c-658eee1f87ce tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.500753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d36521b4-5b79-4af5-8a2c-658eee1f87ce tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.510556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-97143fd8-e323-47e1-8954-50824149aafc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lazy-loading 'services' on Instance uuid 7c22c788-0180-43df-aa4e-48363a89fa79 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:41:04.518742 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-d36521b4-5b79-4af5-8a2c-658eee1f87ce tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] HTTP exception thrown: Instance b3cf4491-1d85-4cb5-bee0-b99814a14635 could not be found. Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d36521b4-5b79-4af5-8a2c-658eee1f87ce tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Request method failure captured: Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 HTTP/1.1 Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iSqpv3foRFubLkcFEOcOXRDFSoyQA93N7zGxIC1L69pcMrN39LsvbE0PwSLJZHWKFZknNA4WoW9KCjJvWhGdX-Eqj7c9q0P4hI-7j6iWqTCHlP_1VqwxvhkN2rhFdbrEPPTuqRjPKzs-kcF5jtSV-4ga6T270IDEyAlQEu_cgUL21c Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 538a71f94fd54403a20347030509ef69 Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/538a71f94fd54403a20347030509ef69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/538a71f94fd54403a20347030509ef69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_538a71f94fd54403a20347030509ef69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/538a71f94fd54403a20347030509ef69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 538a71f94fd54403a20347030509ef69 Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerDiskConfigTestJSON-2018059519-project Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 25a235b1ba7e4f7d8d7a7c424b80c823 Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerDiskConfigTestJSON-2018059519-project Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance b3cf4491-1d85-4cb5-bee0-b99814a14635 could not be found. Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'b3cf4491-1d85-4cb5-bee0-b99814a14635'} Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3cf4491-1d85-4cb5-bee0-b99814a14635 could not be found. Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:04.520559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:04.525451 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3cf4491-1d85-4cb5-bee0-b99814a14635 could not be found. Aug 18 11:41:04.525451 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.525451 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:04.525451 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.525451 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.525451 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:04.525451 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:04.525451 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:04.525451 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:04.525451 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3cf4491-1d85-4cb5-bee0-b99814a14635 could not be found. Aug 18 11:41:04.525451 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.527322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d36521b4-5b79-4af5-8a2c-658eee1f87ce tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Returning 404 to user: Instance b3cf4491-1d85-4cb5-bee0-b99814a14635 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:04.528346 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d36521b4-5b79-4af5-8a2c-658eee1f87ce tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 404 len: 111 microversion: 2.1 time: 0.064058 Aug 18 11:41:04.529441 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1866/3584] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:41:04 2022] DELETE /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:04.537827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-92f3b2ac-8fef-47aa-9efd-15e007e9639d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:04.538849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-92f3b2ac-8fef-47aa-9efd-15e007e9639d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: b3cf4491-1d85-4cb5-bee0-b99814a14635] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:04.546292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-92f3b2ac-8fef-47aa-9efd-15e007e9639d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.547957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-92f3b2ac-8fef-47aa-9efd-15e007e9639d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.548615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-92f3b2ac-8fef-47aa-9efd-15e007e9639d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.549569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-92f3b2ac-8fef-47aa-9efd-15e007e9639d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.550495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-92f3b2ac-8fef-47aa-9efd-15e007e9639d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.551122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-92f3b2ac-8fef-47aa-9efd-15e007e9639d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.577958 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-92f3b2ac-8fef-47aa-9efd-15e007e9639d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] HTTP exception thrown: Instance b3cf4491-1d85-4cb5-bee0-b99814a14635 could not be found. Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-92f3b2ac-8fef-47aa-9efd-15e007e9639d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Request method failure captured: Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 HTTP/1.1 Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iSqpv3foRFubLkcFEOcOXRDFSoyQA93N7zGxIC1L69pcMrN39LsvbE0PwSLJZHWKFZknNA4WoW9KCjJvWhGdX-Eqj7c9q0P4hI-7j6iWqTCHlP_1VqwxvhkN2rhFdbrEPPTuqRjPKzs-kcF5jtSV-4ga6T270IDEyAlQEu_cgUL21c Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 538a71f94fd54403a20347030509ef69 Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/538a71f94fd54403a20347030509ef69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/538a71f94fd54403a20347030509ef69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_538a71f94fd54403a20347030509ef69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/538a71f94fd54403a20347030509ef69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 538a71f94fd54403a20347030509ef69 Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerDiskConfigTestJSON-2018059519-project Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 25a235b1ba7e4f7d8d7a7c424b80c823 Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerDiskConfigTestJSON-2018059519-project Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance b3cf4491-1d85-4cb5-bee0-b99814a14635 could not be found. Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'b3cf4491-1d85-4cb5-bee0-b99814a14635'} Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3cf4491-1d85-4cb5-bee0-b99814a14635 could not be found. Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3cf4491-1d85-4cb5-bee0-b99814a14635 could not be found. Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:04.587604 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.591897 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.591897 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:04.591897 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:04.591897 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:04.591897 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:04.591897 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3cf4491-1d85-4cb5-bee0-b99814a14635 could not be found. Aug 18 11:41:04.591897 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.594551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-92f3b2ac-8fef-47aa-9efd-15e007e9639d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Returning 404 to user: Instance b3cf4491-1d85-4cb5-bee0-b99814a14635 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:04.598949 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-92f3b2ac-8fef-47aa-9efd-15e007e9639d tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635" status: 404 len: 111 microversion: 2.1 time: 0.065784 Aug 18 11:41:04.602138 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1867/3585] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:04 2022] GET /compute/v2.1/servers/b3cf4491-1d85-4cb5-bee0-b99814a14635 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:41:04.608741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06e042d0-1f9f-45cd-bc84-8f8d6b469ce4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:04.618069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-06e042d0-1f9f-45cd-bc84-8f8d6b469ce4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:04.631471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06e042d0-1f9f-45cd-bc84-8f8d6b469ce4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.632467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06e042d0-1f9f-45cd-bc84-8f8d6b469ce4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.633560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06e042d0-1f9f-45cd-bc84-8f8d6b469ce4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.634576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06e042d0-1f9f-45cd-bc84-8f8d6b469ce4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.635255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06e042d0-1f9f-45cd-bc84-8f8d6b469ce4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.635858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06e042d0-1f9f-45cd-bc84-8f8d6b469ce4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.657104 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-06e042d0-1f9f-45cd-bc84-8f8d6b469ce4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] HTTP exception thrown: Instance caf75dc7-00eb-4c1b-986d-3a59443571b7 could not be found. Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06e042d0-1f9f-45cd-bc84-8f8d6b469ce4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Request method failure captured: Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 HTTP/1.1 Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iSqpv3foRFubLkcFEOcOXRDFSoyQA93N7zGxIC1L69pcMrN39LsvbE0PwSLJZHWKFZknNA4WoW9KCjJvWhGdX-Eqj7c9q0P4hI-7j6iWqTCHlP_1VqwxvhkN2rhFdbrEPPTuqRjPKzs-kcF5jtSV-4ga6T270IDEyAlQEu_cgUL21c Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 538a71f94fd54403a20347030509ef69 Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/538a71f94fd54403a20347030509ef69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/538a71f94fd54403a20347030509ef69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_538a71f94fd54403a20347030509ef69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/538a71f94fd54403a20347030509ef69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 538a71f94fd54403a20347030509ef69 Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerDiskConfigTestJSON-2018059519-project Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 25a235b1ba7e4f7d8d7a7c424b80c823 Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerDiskConfigTestJSON-2018059519-project Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance caf75dc7-00eb-4c1b-986d-3a59443571b7 could not be found. Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'caf75dc7-00eb-4c1b-986d-3a59443571b7'} Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf75dc7-00eb-4c1b-986d-3a59443571b7 could not be found. Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:04.661001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:04.666710 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf75dc7-00eb-4c1b-986d-3a59443571b7 could not be found. Aug 18 11:41:04.666710 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.666710 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:04.666710 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.666710 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.666710 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:04.666710 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:04.666710 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:04.666710 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:04.666710 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf75dc7-00eb-4c1b-986d-3a59443571b7 could not be found. Aug 18 11:41:04.666710 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.670950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06e042d0-1f9f-45cd-bc84-8f8d6b469ce4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Returning 404 to user: Instance caf75dc7-00eb-4c1b-986d-3a59443571b7 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:04.671965 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-97143fd8-e323-47e1-8954-50824149aafc tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments/58a2bf56-93ad-40b0-9822-db418848d42f" status: 202 len: 0 microversion: 2.1 time: 0.346153 Aug 18 11:41:04.672709 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-06e042d0-1f9f-45cd-bc84-8f8d6b469ce4 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "DELETE /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 404 len: 111 microversion: 2.1 time: 0.067826 Aug 18 11:41:04.673252 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1719/3586] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 11:41:04 2022] DELETE /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments/58a2bf56-93ad-40b0-9822-db418848d42f => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:41:04.683027 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1868/3587] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:41:04 2022] DELETE /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:04.695145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a111eb3b-1cb4-4537-8f8e-67ee1917f9d9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:04.699381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a111eb3b-1cb4-4537-8f8e-67ee1917f9d9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] [instance: caf75dc7-00eb-4c1b-986d-3a59443571b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:04.704591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2e0f8900-2073-426b-99eb-14c6f5cd003a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:04.709696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a111eb3b-1cb4-4537-8f8e-67ee1917f9d9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.710732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a111eb3b-1cb4-4537-8f8e-67ee1917f9d9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.711368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a111eb3b-1cb4-4537-8f8e-67ee1917f9d9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.712349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a111eb3b-1cb4-4537-8f8e-67ee1917f9d9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.712978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a111eb3b-1cb4-4537-8f8e-67ee1917f9d9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.713594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a111eb3b-1cb4-4537-8f8e-67ee1917f9d9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.714640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2e0f8900-2073-426b-99eb-14c6f5cd003a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:04.722487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e0f8900-2073-426b-99eb-14c6f5cd003a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.723140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e0f8900-2073-426b-99eb-14c6f5cd003a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.723685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e0f8900-2073-426b-99eb-14c6f5cd003a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.725244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e0f8900-2073-426b-99eb-14c6f5cd003a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.725870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e0f8900-2073-426b-99eb-14c6f5cd003a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.732328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e0f8900-2073-426b-99eb-14c6f5cd003a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.736178 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-a111eb3b-1cb4-4537-8f8e-67ee1917f9d9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] HTTP exception thrown: Instance caf75dc7-00eb-4c1b-986d-3a59443571b7 could not be found. Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a111eb3b-1cb4-4537-8f8e-67ee1917f9d9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Request method failure captured: Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 HTTP/1.1 Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iSqpv3foRFubLkcFEOcOXRDFSoyQA93N7zGxIC1L69pcMrN39LsvbE0PwSLJZHWKFZknNA4WoW9KCjJvWhGdX-Eqj7c9q0P4hI-7j6iWqTCHlP_1VqwxvhkN2rhFdbrEPPTuqRjPKzs-kcF5jtSV-4ga6T270IDEyAlQEu_cgUL21c Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 538a71f94fd54403a20347030509ef69 Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/538a71f94fd54403a20347030509ef69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/538a71f94fd54403a20347030509ef69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_538a71f94fd54403a20347030509ef69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/538a71f94fd54403a20347030509ef69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 538a71f94fd54403a20347030509ef69 Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2018059519 Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerDiskConfigTestJSON-2018059519-project Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 25a235b1ba7e4f7d8d7a7c424b80c823 Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerDiskConfigTestJSON-2018059519-project Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance caf75dc7-00eb-4c1b-986d-3a59443571b7 could not be found. Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'caf75dc7-00eb-4c1b-986d-3a59443571b7'} Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf75dc7-00eb-4c1b-986d-3a59443571b7 could not be found. Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf75dc7-00eb-4c1b-986d-3a59443571b7 could not be found. Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:04.740555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.745569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:04.745569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:04.745569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:04.745569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:04.745569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:04.745569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf75dc7-00eb-4c1b-986d-3a59443571b7 could not be found. Aug 18 11:41:04.745569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:04.747034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a111eb3b-1cb4-4537-8f8e-67ee1917f9d9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] Returning 404 to user: Instance caf75dc7-00eb-4c1b-986d-3a59443571b7 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:04.748681 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a111eb3b-1cb4-4537-8f8e-67ee1917f9d9 tempest-ServerDiskConfigTestJSON-2018059519 tempest-ServerDiskConfigTestJSON-2018059519-project] 10.222.0.73 "GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7" status: 404 len: 111 microversion: 2.1 time: 0.061601 Aug 18 11:41:04.749699 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1869/3588] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:04 2022] GET /compute/v2.1/servers/caf75dc7-00eb-4c1b-986d-3a59443571b7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:41:04.758593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0a9d60b-d30a-4d4f-afbe-0dfa29905800 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:04.759443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a0a9d60b-d30a-4d4f-afbe-0dfa29905800 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:04.768077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0a9d60b-d30a-4d4f-afbe-0dfa29905800 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.769171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0a9d60b-d30a-4d4f-afbe-0dfa29905800 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.769798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0a9d60b-d30a-4d4f-afbe-0dfa29905800 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.771612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0a9d60b-d30a-4d4f-afbe-0dfa29905800 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.772435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0a9d60b-d30a-4d4f-afbe-0dfa29905800 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.773368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0a9d60b-d30a-4d4f-afbe-0dfa29905800 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.810742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:04.815619 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2e0f8900-2073-426b-99eb-14c6f5cd003a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135747 Aug 18 11:41:04.821918 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1720/3589] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:41:04 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:41:04.837946 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0612bf33-97b0-4e43-bf9e-346a654d4b86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:04.838244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0612bf33-97b0-4e43-bf9e-346a654d4b86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:04.848543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0612bf33-97b0-4e43-bf9e-346a654d4b86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.850398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0612bf33-97b0-4e43-bf9e-346a654d4b86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.851633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0612bf33-97b0-4e43-bf9e-346a654d4b86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:04.852600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0612bf33-97b0-4e43-bf9e-346a654d4b86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:04.853079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0612bf33-97b0-4e43-bf9e-346a654d4b86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:04.853883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0612bf33-97b0-4e43-bf9e-346a654d4b86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:05.074030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0612bf33-97b0-4e43-bf9e-346a654d4b86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:05.081829 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0612bf33-97b0-4e43-bf9e-346a654d4b86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.251013 Aug 18 11:41:05.082418 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1721/3590] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:04 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:05.177593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a0a9d60b-d30a-4d4f-afbe-0dfa29905800 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:05.186729 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a0a9d60b-d30a-4d4f-afbe-0dfa29905800 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1469 microversion: 2.1 time: 0.435534 Aug 18 11:41:05.187248 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1870/3591] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:04 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1469 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:05.353176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8dd769ec-2e04-423c-a417-4d08e7efed00 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:05.354620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d7ea4c35-4dc6-4f65-bda9-824dcccf8096 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:05.355400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d7ea4c35-4dc6-4f65-bda9-824dcccf8096 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:05.355653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8dd769ec-2e04-423c-a417-4d08e7efed00 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:05.368845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dd769ec-2e04-423c-a417-4d08e7efed00 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:05.370630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7ea4c35-4dc6-4f65-bda9-824dcccf8096 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:05.371207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7ea4c35-4dc6-4f65-bda9-824dcccf8096 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:05.372401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dd769ec-2e04-423c-a417-4d08e7efed00 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:05.372673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7ea4c35-4dc6-4f65-bda9-824dcccf8096 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:05.373556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7ea4c35-4dc6-4f65-bda9-824dcccf8096 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:05.374237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dd769ec-2e04-423c-a417-4d08e7efed00 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:05.374855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7ea4c35-4dc6-4f65-bda9-824dcccf8096 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:05.375878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dd769ec-2e04-423c-a417-4d08e7efed00 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:05.376484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7ea4c35-4dc6-4f65-bda9-824dcccf8096 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:05.377242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dd769ec-2e04-423c-a417-4d08e7efed00 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:05.379701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dd769ec-2e04-423c-a417-4d08e7efed00 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:05.589221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d7ea4c35-4dc6-4f65-bda9-824dcccf8096 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:05.596813 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d7ea4c35-4dc6-4f65-bda9-824dcccf8096 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1503 microversion: 2.1 time: 0.255781 Aug 18 11:41:05.597393 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1722/3592] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:05 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:05.620407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9398610c-fe6c-4e6a-9595-77f743f416d7 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-944498934"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:05.621154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9398610c-fe6c-4e6a-9595-77f743f416d7 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:05.627747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9398610c-fe6c-4e6a-9595-77f743f416d7 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:05.628422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9398610c-fe6c-4e6a-9595-77f743f416d7 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:05.628922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9398610c-fe6c-4e6a-9595-77f743f416d7 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:05.629730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9398610c-fe6c-4e6a-9595-77f743f416d7 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:05.630291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9398610c-fe6c-4e6a-9595-77f743f416d7 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:05.630852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9398610c-fe6c-4e6a-9595-77f743f416d7 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:05.749012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8dd769ec-2e04-423c-a417-4d08e7efed00 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:05.761571 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8dd769ec-2e04-423c-a417-4d08e7efed00 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1315 microversion: 2.1 time: 0.416140 Aug 18 11:41:05.762493 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1871/3593] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:05 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:05.803483 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.network.security_group_api [None req-9398610c-fe6c-4e6a-9595-77f743f416d7 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Adding security group 52cc9053-9ded-4cbb-a3fe-34928682b225 to port 363c1787-80ec-405e-872b-dff4d89afcb2 Aug 18 11:41:05.830817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-792bb760-f8ab-4c62-bd9c-65b3d8e18898 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:05.835856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-792bb760-f8ab-4c62-bd9c-65b3d8e18898 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:05.852446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-792bb760-f8ab-4c62-bd9c-65b3d8e18898 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:05.853011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-792bb760-f8ab-4c62-bd9c-65b3d8e18898 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:05.854194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-792bb760-f8ab-4c62-bd9c-65b3d8e18898 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:05.856143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-792bb760-f8ab-4c62-bd9c-65b3d8e18898 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:05.856663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-792bb760-f8ab-4c62-bd9c-65b3d8e18898 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:05.857116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-792bb760-f8ab-4c62-bd9c-65b3d8e18898 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:05.906087 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-792bb760-f8ab-4c62-bd9c-65b3d8e18898 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080399 Aug 18 11:41:05.912286 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1872/3594] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:41:05 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:06.047194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-273eed5a-076c-4e9a-9e88-7bb700acc7af req-7127440e-b3ff-4487-88c9-ed313c39e312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da67cf3-bc5d-4b71-9c07-6234c22493bc", "tag": "061756b5-9fa0-425c-99c6-d5be70f85abe"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:06.058823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-273eed5a-076c-4e9a-9e88-7bb700acc7af req-7127440e-b3ff-4487-88c9-ed313c39e312 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:06.059312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-273eed5a-076c-4e9a-9e88-7bb700acc7af req-7127440e-b3ff-4487-88c9-ed313c39e312 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:06.059738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-273eed5a-076c-4e9a-9e88-7bb700acc7af req-7127440e-b3ff-4487-88c9-ed313c39e312 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:06.074462 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-273eed5a-076c-4e9a-9e88-7bb700acc7af req-7127440e-b3ff-4487-88c9-ed313c39e312 service nova] Creating event network-changed:061756b5-9fa0-425c-99c6-d5be70f85abe for instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc on n-h2-853611-3 Aug 18 11:41:06.081273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-273eed5a-076c-4e9a-9e88-7bb700acc7af req-7127440e-b3ff-4487-88c9-ed313c39e312 service nova] Instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 11:41:06.092731 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-273eed5a-076c-4e9a-9e88-7bb700acc7af req-7127440e-b3ff-4487-88c9-ed313c39e312 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048989 Aug 18 11:41:06.093520 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1873/3595] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:41:06.102660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:06.109072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bd5e2abb-c6ed-4c64-a1a1-e71b0b8ee131 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:06.110136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bd5e2abb-c6ed-4c64-a1a1-e71b0b8ee131 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:06.117961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd5e2abb-c6ed-4c64-a1a1-e71b0b8ee131 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:06.119093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd5e2abb-c6ed-4c64-a1a1-e71b0b8ee131 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:06.119539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd5e2abb-c6ed-4c64-a1a1-e71b0b8ee131 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:06.124032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd5e2abb-c6ed-4c64-a1a1-e71b0b8ee131 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:06.124990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd5e2abb-c6ed-4c64-a1a1-e71b0b8ee131 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:06.125670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd5e2abb-c6ed-4c64-a1a1-e71b0b8ee131 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:06.330955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:06.359044 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9398610c-fe6c-4e6a-9595-77f743f416d7 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a/action" status: 202 len: 0 microversion: 2.1 time: 0.744222 Aug 18 11:41:06.364003 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1723/3596] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:41:05 2022] POST /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a/action => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:41:06.370016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f0bd3d9c-48b5-48df-9763-54c55ff813ce tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:06.370881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f0bd3d9c-48b5-48df-9763-54c55ff813ce tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:06.378288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0bd3d9c-48b5-48df-9763-54c55ff813ce tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:06.379008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0bd3d9c-48b5-48df-9763-54c55ff813ce tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:06.379767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0bd3d9c-48b5-48df-9763-54c55ff813ce tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:06.381253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0bd3d9c-48b5-48df-9763-54c55ff813ce tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:06.382099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0bd3d9c-48b5-48df-9763-54c55ff813ce tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:06.382756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f0bd3d9c-48b5-48df-9763-54c55ff813ce tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:06.401396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bd5e2abb-c6ed-4c64-a1a1-e71b0b8ee131 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:06.409679 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bd5e2abb-c6ed-4c64-a1a1-e71b0b8ee131 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.308315 Aug 18 11:41:06.426466 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1874/3597] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:06 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:06.432422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1a714f9-d9c8-4f20-95b6-5a259f7924b9 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1685163163"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:06.432978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1a714f9-d9c8-4f20-95b6-5a259f7924b9 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:06.452129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1a714f9-d9c8-4f20-95b6-5a259f7924b9 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:06.452964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1a714f9-d9c8-4f20-95b6-5a259f7924b9 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:06.453606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1a714f9-d9c8-4f20-95b6-5a259f7924b9 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:06.454639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1a714f9-d9c8-4f20-95b6-5a259f7924b9 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:06.455275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1a714f9-d9c8-4f20-95b6-5a259f7924b9 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:06.455934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1a714f9-d9c8-4f20-95b6-5a259f7924b9 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:06.609931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f0bd3d9c-48b5-48df-9763-54c55ff813ce tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:06.624778 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f0bd3d9c-48b5-48df-9763-54c55ff813ce tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1469 microversion: 2.1 time: 0.259353 Aug 18 11:41:06.625396 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1724/3598] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:06 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1469 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:06.636514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-6a6f71a0-99ea-456a-99d0-18975876e547 req-dafdf910-f596-426b-bb06-5cbdf377ec9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c5530b-64fd-465c-a52c-9e81b68a3f2a", "tag": "363c1787-80ec-405e-872b-dff4d89afcb2"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:06.656644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6a6f71a0-99ea-456a-99d0-18975876e547 req-dafdf910-f596-426b-bb06-5cbdf377ec9c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:06.663067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6a6f71a0-99ea-456a-99d0-18975876e547 req-dafdf910-f596-426b-bb06-5cbdf377ec9c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:06.663791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6a6f71a0-99ea-456a-99d0-18975876e547 req-dafdf910-f596-426b-bb06-5cbdf377ec9c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:06.692570 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-6a6f71a0-99ea-456a-99d0-18975876e547 req-dafdf910-f596-426b-bb06-5cbdf377ec9c service nova] Creating event network-changed:363c1787-80ec-405e-872b-dff4d89afcb2 for instance 69c5530b-64fd-465c-a52c-9e81b68a3f2a on n-h1-853611-3 Aug 18 11:41:06.711158 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-6a6f71a0-99ea-456a-99d0-18975876e547 req-dafdf910-f596-426b-bb06-5cbdf377ec9c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083875 Aug 18 11:41:06.714592 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1725/3599] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:06.741051 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.network.security_group_api [None req-a1a714f9-d9c8-4f20-95b6-5a259f7924b9 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Adding security group 0bd4b543-016b-45d0-be43-fca5d544de96 to port 363c1787-80ec-405e-872b-dff4d89afcb2 Aug 18 11:41:06.786412 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7114e782-d7b4-40a6-b6dc-3a897a9032fd tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:06.787927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7114e782-d7b4-40a6-b6dc-3a897a9032fd tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:06.800519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7114e782-d7b4-40a6-b6dc-3a897a9032fd tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:06.804274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7114e782-d7b4-40a6-b6dc-3a897a9032fd tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:06.804793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7114e782-d7b4-40a6-b6dc-3a897a9032fd tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:06.805563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7114e782-d7b4-40a6-b6dc-3a897a9032fd tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:06.806322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7114e782-d7b4-40a6-b6dc-3a897a9032fd tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:06.811435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7114e782-d7b4-40a6-b6dc-3a897a9032fd tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:07.632761 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1a714f9-d9c8-4f20-95b6-5a259f7924b9 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a/action" status: 202 len: 0 microversion: 2.1 time: 1.217215 Aug 18 11:41:07.634214 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1875/3600] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:41:06 2022] POST /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a/action => generated 0 bytes in 1219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:41:07.647479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a6fa60fe-65ab-4fe8-82b2-e818275b454e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:07.652136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a6fa60fe-65ab-4fe8-82b2-e818275b454e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:07.665914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6fa60fe-65ab-4fe8-82b2-e818275b454e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:07.666967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6fa60fe-65ab-4fe8-82b2-e818275b454e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:07.667868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6fa60fe-65ab-4fe8-82b2-e818275b454e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:07.669272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6fa60fe-65ab-4fe8-82b2-e818275b454e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:07.670287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6fa60fe-65ab-4fe8-82b2-e818275b454e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:07.670996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6fa60fe-65ab-4fe8-82b2-e818275b454e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:07.730538 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a6fa60fe-65ab-4fe8-82b2-e818275b454e tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089670 Aug 18 11:41:07.731741 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1876/3601] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:41:07 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:07.739614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e9d68570-af0f-4d79-8a21-d1f9981f4559 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:07.741073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e9d68570-af0f-4d79-8a21-d1f9981f4559 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:07.750186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9d68570-af0f-4d79-8a21-d1f9981f4559 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:07.751401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9d68570-af0f-4d79-8a21-d1f9981f4559 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:07.754006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9d68570-af0f-4d79-8a21-d1f9981f4559 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:07.755680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9d68570-af0f-4d79-8a21-d1f9981f4559 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:07.756999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9d68570-af0f-4d79-8a21-d1f9981f4559 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:07.757749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9d68570-af0f-4d79-8a21-d1f9981f4559 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:07.843246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7114e782-d7b4-40a6-b6dc-3a897a9032fd tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:07.861756 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7114e782-d7b4-40a6-b6dc-3a897a9032fd tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1315 microversion: 2.1 time: 1.080258 Aug 18 11:41:07.868093 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1726/3602] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:06 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1315 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:07.880206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-3b77bb6a-64ec-4ed2-aa0d-6744a3a87c09 req-7a09b5d7-87dc-4058-96d1-da8578fb3d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6076f702-2b3c-488e-aa41-0c3a2f63ec26", "name": "network-vif-plugged", "status": "completed", "tag": "7b29d6db-3458-46ed-bbb6-599fb1ac5724"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:07.898840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-3b77bb6a-64ec-4ed2-aa0d-6744a3a87c09 req-7a09b5d7-87dc-4058-96d1-da8578fb3d0f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:07.910798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-3b77bb6a-64ec-4ed2-aa0d-6744a3a87c09 req-7a09b5d7-87dc-4058-96d1-da8578fb3d0f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:07.913322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-3b77bb6a-64ec-4ed2-aa0d-6744a3a87c09 req-7a09b5d7-87dc-4058-96d1-da8578fb3d0f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:07.935535 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-3b77bb6a-64ec-4ed2-aa0d-6744a3a87c09 req-7a09b5d7-87dc-4058-96d1-da8578fb3d0f service nova] Creating event network-vif-plugged:7b29d6db-3458-46ed-bbb6-599fb1ac5724 for instance 6076f702-2b3c-488e-aa41-0c3a2f63ec26 on n-h2-853611-3 Aug 18 11:41:07.942979 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-3b77bb6a-64ec-4ed2-aa0d-6744a3a87c09 req-7a09b5d7-87dc-4058-96d1-da8578fb3d0f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072421 Aug 18 11:41:07.945543 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1727/3603] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:07.957148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b2579b02-fc26-4fcf-8c8a-6a2f4ced6a09 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:07.960667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b2579b02-fc26-4fcf-8c8a-6a2f4ced6a09 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:07.972639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2579b02-fc26-4fcf-8c8a-6a2f4ced6a09 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:07.975496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2579b02-fc26-4fcf-8c8a-6a2f4ced6a09 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:07.977332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2579b02-fc26-4fcf-8c8a-6a2f4ced6a09 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:07.978746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2579b02-fc26-4fcf-8c8a-6a2f4ced6a09 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:07.981034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2579b02-fc26-4fcf-8c8a-6a2f4ced6a09 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:07.981725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2579b02-fc26-4fcf-8c8a-6a2f4ced6a09 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:08.407569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b2579b02-fc26-4fcf-8c8a-6a2f4ced6a09 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:08.420811 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b2579b02-fc26-4fcf-8c8a-6a2f4ced6a09 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.473606 Aug 18 11:41:08.424700 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1728/3604] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:07 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:08.437148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e0db2350-674a-4330-966c-d02f314f24cf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:08.445038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e0db2350-674a-4330-966c-d02f314f24cf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:08.454490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0db2350-674a-4330-966c-d02f314f24cf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:08.455000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0db2350-674a-4330-966c-d02f314f24cf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:08.455471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0db2350-674a-4330-966c-d02f314f24cf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:08.456217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0db2350-674a-4330-966c-d02f314f24cf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:08.456634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0db2350-674a-4330-966c-d02f314f24cf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:08.457269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0db2350-674a-4330-966c-d02f314f24cf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:08.472869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e9d68570-af0f-4d79-8a21-d1f9981f4559 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:08.491417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e9d68570-af0f-4d79-8a21-d1f9981f4559 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:08.493001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e9d68570-af0f-4d79-8a21-d1f9981f4559 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:08.494291 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e9d68570-af0f-4d79-8a21-d1f9981f4559 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 2954 microversion: 2.42 time: 0.760010 Aug 18 11:41:08.506074 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1877/3605] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:07 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 2954 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:08.518854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2fe6a113-60d0-4461-9d14-e9461ea2bf7f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:08.519837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2fe6a113-60d0-4461-9d14-e9461ea2bf7f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:08.526514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fe6a113-60d0-4461-9d14-e9461ea2bf7f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:08.527103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fe6a113-60d0-4461-9d14-e9461ea2bf7f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:08.527570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fe6a113-60d0-4461-9d14-e9461ea2bf7f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:08.528396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fe6a113-60d0-4461-9d14-e9461ea2bf7f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:08.529101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fe6a113-60d0-4461-9d14-e9461ea2bf7f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:08.535964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fe6a113-60d0-4461-9d14-e9461ea2bf7f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:08.684054 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e0db2350-674a-4330-966c-d02f314f24cf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.254528 Aug 18 11:41:08.685303 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1729/3606] 10.222.0.73 () {58 vars in 1293 bytes} [Thu Aug 18 11:41:08 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a/os-security-groups => generated 1158 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:08.690050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-ad6467a6-a57f-4057-b09a-4ce70096e265 req-040376b7-4c53-48be-83d4-67fefcd2decc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c5530b-64fd-465c-a52c-9e81b68a3f2a", "tag": "363c1787-80ec-405e-872b-dff4d89afcb2"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:08.722628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ad6467a6-a57f-4057-b09a-4ce70096e265 req-040376b7-4c53-48be-83d4-67fefcd2decc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:08.723112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ad6467a6-a57f-4057-b09a-4ce70096e265 req-040376b7-4c53-48be-83d4-67fefcd2decc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:08.723550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ad6467a6-a57f-4057-b09a-4ce70096e265 req-040376b7-4c53-48be-83d4-67fefcd2decc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:08.737871 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ad6467a6-a57f-4057-b09a-4ce70096e265 req-040376b7-4c53-48be-83d4-67fefcd2decc service nova] Creating event network-changed:363c1787-80ec-405e-872b-dff4d89afcb2 for instance 69c5530b-64fd-465c-a52c-9e81b68a3f2a on n-h1-853611-3 Aug 18 11:41:08.743774 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-ad6467a6-a57f-4057-b09a-4ce70096e265 req-040376b7-4c53-48be-83d4-67fefcd2decc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057062 Aug 18 11:41:08.744695 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1730/3607] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:08.750315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-192edcce-d921-4c6c-b364-d4d5e97af7fa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:08.751264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-192edcce-d921-4c6c-b364-d4d5e97af7fa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:08.759447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-192edcce-d921-4c6c-b364-d4d5e97af7fa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:08.760216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-192edcce-d921-4c6c-b364-d4d5e97af7fa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:08.760821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-192edcce-d921-4c6c-b364-d4d5e97af7fa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:08.761734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-192edcce-d921-4c6c-b364-d4d5e97af7fa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:08.762576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-192edcce-d921-4c6c-b364-d4d5e97af7fa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:08.763432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-192edcce-d921-4c6c-b364-d4d5e97af7fa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:08.918767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2fe6a113-60d0-4461-9d14-e9461ea2bf7f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:08.928357 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2fe6a113-60d0-4461-9d14-e9461ea2bf7f tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1462 microversion: 2.1 time: 0.420941 Aug 18 11:41:08.928988 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1878/3608] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:08 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1462 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:08.952532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f3c34a34-2688-442f-b93b-a9e7c35be389 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'create', calling method: .version_select at 0x7f519eda1550>, body: {"security_group": {"name": " tempest-securitygroup -1669299715 ", "description": "tempest-description-619824208"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:09.308176 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-192edcce-d921-4c6c-b364-d4d5e97af7fa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.562000 Aug 18 11:41:09.309481 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1731/3609] 10.222.0.73 () {60 vars in 1316 bytes} [Thu Aug 18 11:41:08 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce/os-interface => generated 1830 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:09.314305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7a8d6e67-f3de-4e6c-95a6-e214d47e50c2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:09.316679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7a8d6e67-f3de-4e6c-95a6-e214d47e50c2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:09.320094 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f3c34a34-2688-442f-b93b-a9e7c35be389 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.372462 Aug 18 11:41:09.329731 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1879/3610] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:41:08 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:09.332585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a8d6e67-f3de-4e6c-95a6-e214d47e50c2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:09.333130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a8d6e67-f3de-4e6c-95a6-e214d47e50c2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:09.333677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a8d6e67-f3de-4e6c-95a6-e214d47e50c2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:09.334301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a8d6e67-f3de-4e6c-95a6-e214d47e50c2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:09.334827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a8d6e67-f3de-4e6c-95a6-e214d47e50c2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:09.335265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a8d6e67-f3de-4e6c-95a6-e214d47e50c2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:09.336656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3bb856d4-5533-4003-bda2-c12723d704cb tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:09.337284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3bb856d4-5533-4003-bda2-c12723d704cb tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:09.355352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bb856d4-5533-4003-bda2-c12723d704cb tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:09.355856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bb856d4-5533-4003-bda2-c12723d704cb tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:09.356307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bb856d4-5533-4003-bda2-c12723d704cb tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:09.357038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bb856d4-5533-4003-bda2-c12723d704cb tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:09.357672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bb856d4-5533-4003-bda2-c12723d704cb tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:09.358150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bb856d4-5533-4003-bda2-c12723d704cb tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:09.384014 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7a8d6e67-f3de-4e6c-95a6-e214d47e50c2 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073603 Aug 18 11:41:09.385490 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1732/3611] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:41:09 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:09.392398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3e75152a-873e-4b01-a83f-3ddb88d39850 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:09.393704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3e75152a-873e-4b01-a83f-3ddb88d39850 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:09.403346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e75152a-873e-4b01-a83f-3ddb88d39850 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:09.404851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e75152a-873e-4b01-a83f-3ddb88d39850 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:09.405741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e75152a-873e-4b01-a83f-3ddb88d39850 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:09.407180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e75152a-873e-4b01-a83f-3ddb88d39850 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:09.408150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e75152a-873e-4b01-a83f-3ddb88d39850 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:09.408943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e75152a-873e-4b01-a83f-3ddb88d39850 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:09.840750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3bb856d4-5533-4003-bda2-c12723d704cb tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:09.857858 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3bb856d4-5533-4003-bda2-c12723d704cb tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1315 microversion: 2.1 time: 0.524864 Aug 18 11:41:09.860793 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1880/3612] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:09 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:09.881672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-012aafd3-7c9f-4ec9-ab16-b9ebe8e440e8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519eda1b80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:09.986901 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-012aafd3-7c9f-4ec9-ab16-b9ebe8e440e8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/os-security-groups/730785a5-8cb1-4d15-99ea-b545f9af1069" status: 200 len: 223 microversion: 2.1 time: 0.122431 Aug 18 11:41:09.987673 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1881/3613] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:41:09 2022] GET /compute/v2.1/os-security-groups/730785a5-8cb1-4d15-99ea-b545f9af1069 => generated 223 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:09.994978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f49a7dd5-807f-4c54-8600-bf6a329d75f5 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:09.996156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f49a7dd5-807f-4c54-8600-bf6a329d75f5 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:10.043860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f49a7dd5-807f-4c54-8600-bf6a329d75f5 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:10.044397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f49a7dd5-807f-4c54-8600-bf6a329d75f5 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:10.044871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f49a7dd5-807f-4c54-8600-bf6a329d75f5 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:10.045649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f49a7dd5-807f-4c54-8600-bf6a329d75f5 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:10.046148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f49a7dd5-807f-4c54-8600-bf6a329d75f5 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:10.046613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f49a7dd5-807f-4c54-8600-bf6a329d75f5 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:10.280994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f49a7dd5-807f-4c54-8600-bf6a329d75f5 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:10.292620 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f49a7dd5-807f-4c54-8600-bf6a329d75f5 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.303568 Aug 18 11:41:10.293501 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1882/3614] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:09 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:10.298655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c75fad13-da90-41d4-b356-c23e6295eb58 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519ed8adc0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:10.330331 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3e75152a-873e-4b01-a83f-3ddb88d39850 tempest-MigrationsAdminTest-47954829 tempest-MigrationsAdminTest-47954829-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1613 microversion: 2.1 time: 0.943385 Aug 18 11:41:10.351939 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1733/3615] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:09 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1613 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:10.366110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fc2067a2-db6f-4723-a35d-edf5fe7fc014 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:10.366723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fc2067a2-db6f-4723-a35d-edf5fe7fc014 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:10.386593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2067a2-db6f-4723-a35d-edf5fe7fc014 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:10.387135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2067a2-db6f-4723-a35d-edf5fe7fc014 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:10.389368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2067a2-db6f-4723-a35d-edf5fe7fc014 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:10.390166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2067a2-db6f-4723-a35d-edf5fe7fc014 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:10.391158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2067a2-db6f-4723-a35d-edf5fe7fc014 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:10.391600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fc2067a2-db6f-4723-a35d-edf5fe7fc014 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:10.450454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fc2067a2-db6f-4723-a35d-edf5fe7fc014 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:41:10.584084 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c75fad13-da90-41d4-b356-c23e6295eb58 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/730785a5-8cb1-4d15-99ea-b545f9af1069" status: 202 len: 0 microversion: 2.1 time: 0.288776 Aug 18 11:41:10.585668 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1883/3616] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:10 2022] DELETE /compute/v2.1/os-security-groups/730785a5-8cb1-4d15-99ea-b545f9af1069 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:41:10.592548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e342cc18-84da-41d9-abf3-fc455107de52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:10.600623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e342cc18-84da-41d9-abf3-fc455107de52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:10.627226 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fc2067a2-db6f-4723-a35d-edf5fe7fc014 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 204 len: 0 microversion: 2.1 time: 0.264796 Aug 18 11:41:10.637731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e342cc18-84da-41d9-abf3-fc455107de52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:10.638788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e342cc18-84da-41d9-abf3-fc455107de52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:10.641003 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1734/3617] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:41:10 2022] DELETE /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:41:10.650757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0cb737b4-09f5-4d98-bd85-060971c298fa tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f51b0c9c160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:10.653074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e342cc18-84da-41d9-abf3-fc455107de52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:10.654111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e342cc18-84da-41d9-abf3-fc455107de52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:10.656325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e342cc18-84da-41d9-abf3-fc455107de52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:10.677834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e342cc18-84da-41d9-abf3-fc455107de52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:10.724571 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e342cc18-84da-41d9-abf3-fc455107de52 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136781 Aug 18 11:41:10.725169 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1884/3618] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:41:10 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:10.734324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ced5a47c-e888-42df-a91f-a6af56a4d2dc tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:10.734959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ced5a47c-e888-42df-a91f-a6af56a4d2dc tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:10.738604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG neutronclient.v2_0.client [None req-0cb737b4-09f5-4d98-bd85-060971c298fa tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist", "detail": ""}} {{(pid=122209) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:41:10.740852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.security_group_api [None req-0cb737b4-09f5-4d98-bd85-060971c298fa tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Neutron security group 730785a5-8cb1-4d15-99ea-b545f9af1069 not found {{(pid=122209) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:41:10.742152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ced5a47c-e888-42df-a91f-a6af56a4d2dc tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:10.742921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ced5a47c-e888-42df-a91f-a6af56a4d2dc tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:10.743052 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-0cb737b4-09f5-4d98-bd85-060971c298fa tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist Aug 18 11:41:10.743052 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-3fe1330a-3735-4dba-a014-699b10f06daf'] Aug 18 11:41:10.743728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ced5a47c-e888-42df-a91f-a6af56a4d2dc tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:10.744639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ced5a47c-e888-42df-a91f-a6af56a4d2dc tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:10.745289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ced5a47c-e888-42df-a91f-a6af56a4d2dc tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:10.745872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ced5a47c-e888-42df-a91f-a6af56a4d2dc tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0cb737b4-09f5-4d98-bd85-060971c298fa tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-security-groups/730785a5-8cb1-4d15-99ea-b545f9af1069 HTTP/1.1 Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: exception: Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-3fe1330a-3735-4dba-a014-699b10f06daf'] Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '730785a5-8cb1-4d15-99ea-b545f9af1069'} Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:41:10.747543 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fe1330a-3735-4dba-a014-699b10f06daf'] Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fe1330a-3735-4dba-a014-699b10f06daf'] Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fe1330a-3735-4dba-a014-699b10f06daf'] Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fe1330a-3735-4dba-a014-699b10f06daf'] Aug 18 11:41:10.751996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:10.765049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0cb737b4-09f5-4d98-bd85-060971c298fa tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 404 to user: Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist Aug 18 11:41:10.765049 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-3fe1330a-3735-4dba-a014-699b10f06daf'] {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:10.768885 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0cb737b4-09f5-4d98-bd85-060971c298fa tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/os-security-groups/730785a5-8cb1-4d15-99ea-b545f9af1069" status: 404 len: 194 microversion: 2.1 time: 0.124364 Aug 18 11:41:10.773698 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1735/3619] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:41:10 2022] GET /compute/v2.1/os-security-groups/730785a5-8cb1-4d15-99ea-b545f9af1069 => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:10.785906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2d6603b-8591-467d-ba50-0f2750d4634f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'create', calling method: .version_select at 0x7f51b0c690d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-693001991", "description": "tempest-description-1671443351"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:10.943456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ced5a47c-e888-42df-a91f-a6af56a4d2dc tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:10.957876 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ced5a47c-e888-42df-a91f-a6af56a4d2dc tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1468 microversion: 2.1 time: 0.227410 Aug 18 11:41:10.965882 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1885/3620] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:10 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1468 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:10.980873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-41e5f1d8-0523-435c-9839-469b7334f895 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:10.983052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-41e5f1d8-0523-435c-9839-469b7334f895 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:10.997163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41e5f1d8-0523-435c-9839-469b7334f895 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:11.000476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41e5f1d8-0523-435c-9839-469b7334f895 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:11.001982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41e5f1d8-0523-435c-9839-469b7334f895 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:11.004293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41e5f1d8-0523-435c-9839-469b7334f895 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:11.007856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41e5f1d8-0523-435c-9839-469b7334f895 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:11.010273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41e5f1d8-0523-435c-9839-469b7334f895 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:11.162209 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a2d6603b-8591-467d-ba50-0f2750d4634f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.385780 Aug 18 11:41:11.163848 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1736/3621] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:41:10 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:11.182512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f4aa490d-090e-47fc-83d0-a05ae4a9a900 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'create', calling method: .version_select at 0x7f519f5c6c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-583019951", "description": "tempest-description-2105138888"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:11.271708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-41e5f1d8-0523-435c-9839-469b7334f895 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:11.284291 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-41e5f1d8-0523-435c-9839-469b7334f895 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1503 microversion: 2.1 time: 0.316859 Aug 18 11:41:11.285503 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1886/3622] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:10 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1503 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:11.309588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-81edf9a9-ee3a-48ba-948d-6ee696e084be tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:11.310599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-81edf9a9-ee3a-48ba-948d-6ee696e084be tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:11.317856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81edf9a9-ee3a-48ba-948d-6ee696e084be tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:11.318993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81edf9a9-ee3a-48ba-948d-6ee696e084be tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:11.319853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81edf9a9-ee3a-48ba-948d-6ee696e084be tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:11.320746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81edf9a9-ee3a-48ba-948d-6ee696e084be tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:11.321365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81edf9a9-ee3a-48ba-948d-6ee696e084be tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:11.322155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81edf9a9-ee3a-48ba-948d-6ee696e084be tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:11.415561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:11.432985 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-81edf9a9-ee3a-48ba-948d-6ee696e084be tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.127994 Aug 18 11:41:11.441248 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1887/3623] 10.222.0.73 () {58 vars in 1296 bytes} [Thu Aug 18 11:41:11 2022] DELETE /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26/os-server-password => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:41:11.448050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-98133efe-24a7-4e69-9e8b-c369420fceb7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:11.448897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-98133efe-24a7-4e69-9e8b-c369420fceb7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:11.461036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98133efe-24a7-4e69-9e8b-c369420fceb7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:11.461800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98133efe-24a7-4e69-9e8b-c369420fceb7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:11.462716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98133efe-24a7-4e69-9e8b-c369420fceb7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:11.465348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98133efe-24a7-4e69-9e8b-c369420fceb7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:11.467806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98133efe-24a7-4e69-9e8b-c369420fceb7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:11.468587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98133efe-24a7-4e69-9e8b-c369420fceb7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:11.601083 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f4aa490d-090e-47fc-83d0-a05ae4a9a900 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.429418 Aug 18 11:41:11.601686 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1737/3624] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:41:11 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:41:11.606659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1ff6daec-5360-45a1-8b9a-cda683fabbb6 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:11.607272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1ff6daec-5360-45a1-8b9a-cda683fabbb6 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:11.626453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ff6daec-5360-45a1-8b9a-cda683fabbb6 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:11.628833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ff6daec-5360-45a1-8b9a-cda683fabbb6 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:11.630305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ff6daec-5360-45a1-8b9a-cda683fabbb6 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:11.631270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ff6daec-5360-45a1-8b9a-cda683fabbb6 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:11.631746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ff6daec-5360-45a1-8b9a-cda683fabbb6 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:11.632187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ff6daec-5360-45a1-8b9a-cda683fabbb6 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:11.704858 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1ff6daec-5360-45a1-8b9a-cda683fabbb6 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.095026 Aug 18 11:41:11.704858 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1738/3625] 10.222.0.73 () {58 vars in 1293 bytes} [Thu Aug 18 11:41:11 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26/os-server-password => generated 16 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:41:11.716841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-642f78a7-dcac-4ef6-b784-a4bdf1be23fa tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'create', calling method: .version_select at 0x7f519f7a4c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1062256679", "description": "tempest-description-2038019522"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:11.737236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-98133efe-24a7-4e69-9e8b-c369420fceb7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:11.757472 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-98133efe-24a7-4e69-9e8b-c369420fceb7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.314565 Aug 18 11:41:11.758338 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1888/3626] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:11 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:11.764439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8d83dc3d-d3aa-4818-8687-f9c2ea4f9870 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:11.765413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8d83dc3d-d3aa-4818-8687-f9c2ea4f9870 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:11.771744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:11.774051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d83dc3d-d3aa-4818-8687-f9c2ea4f9870 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:11.774668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d83dc3d-d3aa-4818-8687-f9c2ea4f9870 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:11.775257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d83dc3d-d3aa-4818-8687-f9c2ea4f9870 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:11.775979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d83dc3d-d3aa-4818-8687-f9c2ea4f9870 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:11.777370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d83dc3d-d3aa-4818-8687-f9c2ea4f9870 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:11.778035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d83dc3d-d3aa-4818-8687-f9c2ea4f9870 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:11.812325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8d83dc3d-d3aa-4818-8687-f9c2ea4f9870 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:41:11.931568 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8d83dc3d-d3aa-4818-8687-f9c2ea4f9870 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 204 len: 0 microversion: 2.1 time: 0.170182 Aug 18 11:41:11.932201 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1889/3627] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:41:11 2022] DELETE /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:41:11.942038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34f64d71-6ef9-480f-8256-da72a07c615f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:11.946028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-34f64d71-6ef9-480f-8256-da72a07c615f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:11.954360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34f64d71-6ef9-480f-8256-da72a07c615f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:11.955100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34f64d71-6ef9-480f-8256-da72a07c615f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:11.955616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34f64d71-6ef9-480f-8256-da72a07c615f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:11.956458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34f64d71-6ef9-480f-8256-da72a07c615f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:11.956913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34f64d71-6ef9-480f-8256-da72a07c615f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:11.957614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34f64d71-6ef9-480f-8256-da72a07c615f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:11.998991 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34f64d71-6ef9-480f-8256-da72a07c615f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062552 Aug 18 11:41:11.999954 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1890/3628] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:41:11 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:41:12.005599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-767801c3-366b-4792-bb01-55333ae39695 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:12.006305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-767801c3-366b-4792-bb01-55333ae39695 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:12.013316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767801c3-366b-4792-bb01-55333ae39695 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:12.016325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767801c3-366b-4792-bb01-55333ae39695 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:12.016325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767801c3-366b-4792-bb01-55333ae39695 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:12.016325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767801c3-366b-4792-bb01-55333ae39695 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:12.016325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767801c3-366b-4792-bb01-55333ae39695 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:12.018009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767801c3-366b-4792-bb01-55333ae39695 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:12.116202 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-642f78a7-dcac-4ef6-b784-a4bdf1be23fa tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.413274 Aug 18 11:41:12.117139 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1739/3629] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:41:11 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:12.131357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e2feb2af-10d8-40f5-a6a3-9c5afdcea1ad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:12.132107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e2feb2af-10d8-40f5-a6a3-9c5afdcea1ad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:12.138914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2feb2af-10d8-40f5-a6a3-9c5afdcea1ad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:12.139403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2feb2af-10d8-40f5-a6a3-9c5afdcea1ad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:12.139870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2feb2af-10d8-40f5-a6a3-9c5afdcea1ad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:12.140619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2feb2af-10d8-40f5-a6a3-9c5afdcea1ad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:12.141235 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2feb2af-10d8-40f5-a6a3-9c5afdcea1ad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:12.141658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2feb2af-10d8-40f5-a6a3-9c5afdcea1ad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:12.237976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-767801c3-366b-4792-bb01-55333ae39695 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:12.246157 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-767801c3-366b-4792-bb01-55333ae39695 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1509 microversion: 2.1 time: 0.244783 Aug 18 11:41:12.254756 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1891/3630] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:11 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:12.254756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c39c204b-9db3-4881-bf15-7af02150761f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:12.254756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c39c204b-9db3-4881-bf15-7af02150761f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:12.261067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c39c204b-9db3-4881-bf15-7af02150761f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:12.261562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c39c204b-9db3-4881-bf15-7af02150761f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:12.262046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c39c204b-9db3-4881-bf15-7af02150761f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:12.262974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c39c204b-9db3-4881-bf15-7af02150761f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:12.263438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c39c204b-9db3-4881-bf15-7af02150761f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:12.263870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c39c204b-9db3-4881-bf15-7af02150761f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:12.296530 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-c39c204b-9db3-4881-bf15-7af02150761f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] HTTP exception thrown: Cannot 'reboot' instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 while it is in vm_state rescued Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c39c204b-9db3-4881-bf15-7af02150761f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Request method failure captured: Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92/action HTTP/1.1 Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 28 Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iRDccV-wQBjWbehYJnvnYrqtEvDPnmmRi9FdLn90jlDwmLP7Yu8AV-Xjh3sRI2h6VdTdDxREaF_4Uw5JAlLnmy-pOyTW0C8AnpTCeGTveMx08cuhXqa0wk4T8c8YQiDTyaAtMLbCc_qByCh4ZjwOdEPthe4EaqbP1499Gbu30qZ6g8 Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 4eea5599d0754399a32a3ae3431ff18f Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: {"reboot": {"type": "HARD"}} Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: exception: Cannot 'reboot' instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 while it is in vm_state rescued Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '77c13227-b6f4-49d7-b40b-2ec356ca3f92', 'body': {'reboot': {'type': 'HARD'}}} Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:41:12.298258 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:41:12.308285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 while it is in vm_state rescued Aug 18 11:41:12.308285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:12.308285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:12.308285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:12.308285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:12.308285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:12.308285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:12.308285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:12.308285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:12.308285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 while it is in vm_state rescued Aug 18 11:41:12.308285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:12.308285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c39c204b-9db3-4881-bf15-7af02150761f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Returning 409 to user: Cannot 'reboot' instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 while it is in vm_state rescued {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:12.308285 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c39c204b-9db3-4881-bf15-7af02150761f tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92/action" status: 409 len: 145 microversion: 2.1 time: 0.051989 Aug 18 11:41:12.308285 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1892/3631] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:41:12 2022] POST /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92/action => generated 145 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:41:12.310735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3a05d114-1635-433c-be9d-59c48f7a25b8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519edc0b80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:12.356288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e2feb2af-10d8-40f5-a6a3-9c5afdcea1ad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:12.365962 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e2feb2af-10d8-40f5-a6a3-9c5afdcea1ad tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1468 microversion: 2.1 time: 0.243288 Aug 18 11:41:12.366583 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1740/3632] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:12 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1468 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:12.376319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-73179500-9091-49b0-8a0a-79ab5c7edbf0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:12.379350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-73179500-9091-49b0-8a0a-79ab5c7edbf0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:12.389860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-73179500-9091-49b0-8a0a-79ab5c7edbf0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:12.390501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-73179500-9091-49b0-8a0a-79ab5c7edbf0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:12.391050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-73179500-9091-49b0-8a0a-79ab5c7edbf0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:12.391843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-73179500-9091-49b0-8a0a-79ab5c7edbf0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:12.392309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-73179500-9091-49b0-8a0a-79ab5c7edbf0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:12.392738 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-73179500-9091-49b0-8a0a-79ab5c7edbf0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:12.424195 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-73179500-9091-49b0-8a0a-79ab5c7edbf0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] HTTP exception thrown: Cannot 'rebuild' instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 while it is in vm_state rescued Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-73179500-9091-49b0-8a0a-79ab5c7edbf0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Request method failure captured: Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92/action HTTP/1.1 Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 65 Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iRDccV-wQBjWbehYJnvnYrqtEvDPnmmRi9FdLn90jlDwmLP7Yu8AV-Xjh3sRI2h6VdTdDxREaF_4Uw5JAlLnmy-pOyTW0C8AnpTCeGTveMx08cuhXqa0wk4T8c8YQiDTyaAtMLbCc_qByCh4ZjwOdEPthe4EaqbP1499Gbu30qZ6g8 Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4eea5599d0754399a32a3ae3431ff18f Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: {"rebuild": {"imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a"}} Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: exception: Cannot 'rebuild' instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 while it is in vm_state rescued Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '77c13227-b6f4-49d7-b40b-2ec356ca3f92', 'body': {'rebuild': {'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a'}}} Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:41:12.425861 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 while it is in vm_state rescued Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 while it is in vm_state rescued Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-73179500-9091-49b0-8a0a-79ab5c7edbf0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Returning 409 to user: Cannot 'rebuild' instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 while it is in vm_state rescued {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-73179500-9091-49b0-8a0a-79ab5c7edbf0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "POST /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92/action" status: 409 len: 146 microversion: 2.1 time: 0.056014 Aug 18 11:41:12.433403 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1741/3633] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:41:12 2022] POST /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92/action => generated 146 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:41:12.438249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3d863336-f7aa-4b79-bb33-9b54754d0702 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:12.438779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3d863336-f7aa-4b79-bb33-9b54754d0702 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:12.445072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d863336-f7aa-4b79-bb33-9b54754d0702 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:12.445565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d863336-f7aa-4b79-bb33-9b54754d0702 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:12.446058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d863336-f7aa-4b79-bb33-9b54754d0702 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:12.446819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d863336-f7aa-4b79-bb33-9b54754d0702 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:12.447277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d863336-f7aa-4b79-bb33-9b54754d0702 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:12.447725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d863336-f7aa-4b79-bb33-9b54754d0702 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:12.476147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3d863336-f7aa-4b79-bb33-9b54754d0702 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:41:12.514269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:12.588584 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3d863336-f7aa-4b79-bb33-9b54754d0702 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 204 len: 0 microversion: 2.1 time: 0.154454 Aug 18 11:41:12.592634 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1742/3634] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:41:12 2022] DELETE /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:41:12.605944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-33fd583c-7740-4ed6-8010-c4dc6aa2ee54 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:12.606666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-33fd583c-7740-4ed6-8010-c4dc6aa2ee54 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:12.613511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33fd583c-7740-4ed6-8010-c4dc6aa2ee54 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:12.615542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33fd583c-7740-4ed6-8010-c4dc6aa2ee54 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:12.616087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33fd583c-7740-4ed6-8010-c4dc6aa2ee54 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:12.616993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33fd583c-7740-4ed6-8010-c4dc6aa2ee54 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:12.617457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33fd583c-7740-4ed6-8010-c4dc6aa2ee54 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:12.618084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33fd583c-7740-4ed6-8010-c4dc6aa2ee54 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:12.707472 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3a05d114-1635-433c-be9d-59c48f7a25b8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.405504 Aug 18 11:41:12.709059 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1893/3635] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:41:12 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:12.809461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-33fd583c-7740-4ed6-8010-c4dc6aa2ee54 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:12.818867 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-33fd583c-7740-4ed6-8010-c4dc6aa2ee54 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1690 microversion: 2.1 time: 0.224420 Aug 18 11:41:12.820152 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1743/3636] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:12 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1690 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:12.825256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-327f4ccf-807e-4838-a1e9-ece2a9b2b653 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f51b0c69430>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:13.005202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2958356f-24f5-4c35-a56b-eae70556fb7e req-933379a6-b917-4c26-8297-ff4abb01ec6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da67cf3-bc5d-4b71-9c07-6234c22493bc", "name": "network-vif-plugged", "status": "completed", "tag": "061756b5-9fa0-425c-99c6-d5be70f85abe"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:13.019302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2958356f-24f5-4c35-a56b-eae70556fb7e req-933379a6-b917-4c26-8297-ff4abb01ec6e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:13.020881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2958356f-24f5-4c35-a56b-eae70556fb7e req-933379a6-b917-4c26-8297-ff4abb01ec6e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:13.021730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2958356f-24f5-4c35-a56b-eae70556fb7e req-933379a6-b917-4c26-8297-ff4abb01ec6e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:13.034996 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2958356f-24f5-4c35-a56b-eae70556fb7e req-933379a6-b917-4c26-8297-ff4abb01ec6e service nova] Creating event network-vif-plugged:061756b5-9fa0-425c-99c6-d5be70f85abe for instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc on n-h2-853611-3 Aug 18 11:41:13.041266 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2958356f-24f5-4c35-a56b-eae70556fb7e req-933379a6-b917-4c26-8297-ff4abb01ec6e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.331003 Aug 18 11:41:13.041873 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1894/3637] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:13.048961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c330e925-db50-4332-b029-91df452ba879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:13.049770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c330e925-db50-4332-b029-91df452ba879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:13.060692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c330e925-db50-4332-b029-91df452ba879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:13.061373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c330e925-db50-4332-b029-91df452ba879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:13.061926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c330e925-db50-4332-b029-91df452ba879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:13.063356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c330e925-db50-4332-b029-91df452ba879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:13.063837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c330e925-db50-4332-b029-91df452ba879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:13.064739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c330e925-db50-4332-b029-91df452ba879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:13.069985 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-327f4ccf-807e-4838-a1e9-ece2a9b2b653 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/ca1ce1fb-f0b1-4b14-bc29-4e64eb476565" status: 202 len: 0 microversion: 2.1 time: 0.248554 Aug 18 11:41:13.070778 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1744/3638] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:12 2022] DELETE /compute/v2.1/os-security-groups/ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:41:13.093049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f7497a8e-f758-4709-a1bf-b61679a6c567 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519f546a60>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:13.126511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG neutronclient.v2_0.client [None req-f7497a8e-f758-4709-a1bf-b61679a6c567 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist", "detail": ""}} {{(pid=122209) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:41:13.127180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.security_group_api [None req-f7497a8e-f758-4709-a1bf-b61679a6c567 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Neutron security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 not found {{(pid=122209) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:41:13.127776 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-f7497a8e-f758-4709-a1bf-b61679a6c567 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist Aug 18 11:41:13.127776 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-229360d2-cb72-416b-9a69-764dcaac93ee'] Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f7497a8e-f758-4709-a1bf-b61679a6c567 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-security-groups/ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 HTTP/1.1 Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: exception: Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-229360d2-cb72-416b-9a69-764dcaac93ee'] Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'ca1ce1fb-f0b1-4b14-bc29-4e64eb476565'} Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:41:13.130713 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-229360d2-cb72-416b-9a69-764dcaac93ee'] Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-229360d2-cb72-416b-9a69-764dcaac93ee'] Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-229360d2-cb72-416b-9a69-764dcaac93ee'] Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-229360d2-cb72-416b-9a69-764dcaac93ee'] Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f7497a8e-f758-4709-a1bf-b61679a6c567 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 404 to user: Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-229360d2-cb72-416b-9a69-764dcaac93ee'] {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f7497a8e-f758-4709-a1bf-b61679a6c567 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/os-security-groups/ca1ce1fb-f0b1-4b14-bc29-4e64eb476565" status: 404 len: 194 microversion: 2.1 time: 0.057742 Aug 18 11:41:13.135589 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1745/3639] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:41:13 2022] GET /compute/v2.1/os-security-groups/ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:13.142063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8e14e83e-3788-4018-976b-ccc5a72a1b24 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519f3b0ca0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:13.258399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c330e925-db50-4332-b029-91df452ba879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:13.271694 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c330e925-db50-4332-b029-91df452ba879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.228384 Aug 18 11:41:13.273867 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1895/3640] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:13 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:13.281705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e3730639-55ae-406e-b69b-28a91a6332b2 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:13.283107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e3730639-55ae-406e-b69b-28a91a6332b2 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:13.291477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3730639-55ae-406e-b69b-28a91a6332b2 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:13.292357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3730639-55ae-406e-b69b-28a91a6332b2 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:13.292987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3730639-55ae-406e-b69b-28a91a6332b2 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:13.293941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3730639-55ae-406e-b69b-28a91a6332b2 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:13.294493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3730639-55ae-406e-b69b-28a91a6332b2 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:13.295433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3730639-55ae-406e-b69b-28a91a6332b2 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:13.396813 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8e14e83e-3788-4018-976b-ccc5a72a1b24 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/f55c13d1-4703-4f9c-acae-87e8ed76dd84" status: 202 len: 0 microversion: 2.1 time: 0.257200 Aug 18 11:41:13.400344 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1746/3641] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:13 2022] DELETE /compute/v2.1/os-security-groups/f55c13d1-4703-4f9c-acae-87e8ed76dd84 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:41:13.403756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a9055d1d-fdd8-4306-9fd0-2ffe371da902 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:13.404373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a9055d1d-fdd8-4306-9fd0-2ffe371da902 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:13.425609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9055d1d-fdd8-4306-9fd0-2ffe371da902 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:13.429315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9055d1d-fdd8-4306-9fd0-2ffe371da902 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:13.430018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9055d1d-fdd8-4306-9fd0-2ffe371da902 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:13.431465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9055d1d-fdd8-4306-9fd0-2ffe371da902 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:13.432099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9055d1d-fdd8-4306-9fd0-2ffe371da902 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:13.432604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9055d1d-fdd8-4306-9fd0-2ffe371da902 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:13.525572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e3730639-55ae-406e-b69b-28a91a6332b2 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:13.546414 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e3730639-55ae-406e-b69b-28a91a6332b2 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1509 microversion: 2.1 time: 0.270784 Aug 18 11:41:13.548100 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1896/3642] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:13 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:13.554299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-47d11cc8-b765-4f85-9742-d4afbafd6703 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519eda1ca0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:13.585883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-47d11cc8-b765-4f85-9742-d4afbafd6703 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:41:13.585883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.security_group_api [None req-47d11cc8-b765-4f85-9742-d4afbafd6703 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Neutron security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 not found {{(pid=122210) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:41:13.586468 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-47d11cc8-b765-4f85-9742-d4afbafd6703 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist Aug 18 11:41:13.586468 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-b79d7265-5388-43f6-8f7f-3e607a446be0'] Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-47d11cc8-b765-4f85-9742-d4afbafd6703 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-security-groups/f55c13d1-4703-4f9c-acae-87e8ed76dd84 HTTP/1.1 Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: exception: Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-b79d7265-5388-43f6-8f7f-3e607a446be0'] Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'f55c13d1-4703-4f9c-acae-87e8ed76dd84'} Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:41:13.588464 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b79d7265-5388-43f6-8f7f-3e607a446be0'] Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b79d7265-5388-43f6-8f7f-3e607a446be0'] Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b79d7265-5388-43f6-8f7f-3e607a446be0'] Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b79d7265-5388-43f6-8f7f-3e607a446be0'] Aug 18 11:41:13.594115 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.601047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-47d11cc8-b765-4f85-9742-d4afbafd6703 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 404 to user: Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist Aug 18 11:41:13.601047 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-b79d7265-5388-43f6-8f7f-3e607a446be0'] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:13.602292 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-47d11cc8-b765-4f85-9742-d4afbafd6703 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/os-security-groups/f55c13d1-4703-4f9c-acae-87e8ed76dd84" status: 404 len: 194 microversion: 2.1 time: 0.053100 Aug 18 11:41:13.603601 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1897/3643] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:41:13 2022] GET /compute/v2.1/os-security-groups/f55c13d1-4703-4f9c-acae-87e8ed76dd84 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:13.612166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-feb49562-10a8-47ac-a253-e494b1cd3d0b tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519edbb280>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:13.639051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a9055d1d-fdd8-4306-9fd0-2ffe371da902 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:13.650939 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a9055d1d-fdd8-4306-9fd0-2ffe371da902 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1468 microversion: 2.1 time: 0.251985 Aug 18 11:41:13.655944 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1747/3644] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:13 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1468 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:13.837803 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-feb49562-10a8-47ac-a253-e494b1cd3d0b tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/31184eb3-4d54-4a9f-bf13-ed4be8d4b9be" status: 202 len: 0 microversion: 2.1 time: 0.229944 Aug 18 11:41:13.838669 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1898/3645] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:13 2022] DELETE /compute/v2.1/os-security-groups/31184eb3-4d54-4a9f-bf13-ed4be8d4b9be => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:41:13.850064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b702790-a10a-4d1c-8931-655c798eb302 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519eda1790>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:13.858109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f9c910db-79a2-4630-baa1-5a4069ef2190 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:13.858698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f9c910db-79a2-4630-baa1-5a4069ef2190 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:13.888161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-8b702790-a10a-4d1c-8931-655c798eb302 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:41:13.888891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.security_group_api [None req-8b702790-a10a-4d1c-8931-655c798eb302 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Neutron security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be not found {{(pid=122210) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:41:13.889732 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-8b702790-a10a-4d1c-8931-655c798eb302 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist Aug 18 11:41:13.889732 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-e9cc20ad-470e-4172-9d29-032090da2033'] Aug 18 11:41:13.889953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9c910db-79a2-4630-baa1-5a4069ef2190 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:13.890651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9c910db-79a2-4630-baa1-5a4069ef2190 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:13.892165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9c910db-79a2-4630-baa1-5a4069ef2190 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b702790-a10a-4d1c-8931-655c798eb302 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-security-groups/31184eb3-4d54-4a9f-bf13-ed4be8d4b9be HTTP/1.1 Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: exception: Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-e9cc20ad-470e-4172-9d29-032090da2033'] Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '31184eb3-4d54-4a9f-bf13-ed4be8d4b9be'} Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:41:13.892475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9cc20ad-470e-4172-9d29-032090da2033'] Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9cc20ad-470e-4172-9d29-032090da2033'] Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9cc20ad-470e-4172-9d29-032090da2033'] Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9cc20ad-470e-4172-9d29-032090da2033'] Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b702790-a10a-4d1c-8931-655c798eb302 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 404 to user: Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-e9cc20ad-470e-4172-9d29-032090da2033'] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:13.901542 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8b702790-a10a-4d1c-8931-655c798eb302 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/os-security-groups/31184eb3-4d54-4a9f-bf13-ed4be8d4b9be" status: 404 len: 194 microversion: 2.1 time: 0.052378 Aug 18 11:41:13.908816 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1899/3646] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:41:13 2022] GET /compute/v2.1/os-security-groups/31184eb3-4d54-4a9f-bf13-ed4be8d4b9be => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:13.909276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9c910db-79a2-4630-baa1-5a4069ef2190 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:13.909276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9c910db-79a2-4630-baa1-5a4069ef2190 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:13.909276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9c910db-79a2-4630-baa1-5a4069ef2190 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:13.912045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-33eb12be-b3a9-42ee-891a-37fc7c8b7e40 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519edbbf70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:14.120569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f9c910db-79a2-4630-baa1-5a4069ef2190 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:14.130144 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f9c910db-79a2-4630-baa1-5a4069ef2190 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1690 microversion: 2.1 time: 0.292018 Aug 18 11:41:14.131099 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1748/3647] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:13 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1690 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:14.176963 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-33eb12be-b3a9-42ee-891a-37fc7c8b7e40 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.270799 Aug 18 11:41:14.178267 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1900/3648] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:41:13 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:14.195529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3fd7c632-5453-4284-807c-e8c06b04b79a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'create', calling method: .version_select at 0x7f519f3db4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1938972680", "description": "tempest-description-1184468631"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:14.294821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2670e3e6-919c-460f-8b39-e562468bdd07 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:14.295460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2670e3e6-919c-460f-8b39-e562468bdd07 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:14.306601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2670e3e6-919c-460f-8b39-e562468bdd07 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:14.306601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2670e3e6-919c-460f-8b39-e562468bdd07 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:14.307015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2670e3e6-919c-460f-8b39-e562468bdd07 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:14.307677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2670e3e6-919c-460f-8b39-e562468bdd07 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:14.308176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2670e3e6-919c-460f-8b39-e562468bdd07 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:14.308766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2670e3e6-919c-460f-8b39-e562468bdd07 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:14.594487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2670e3e6-919c-460f-8b39-e562468bdd07 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:14.609087 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2670e3e6-919c-460f-8b39-e562468bdd07 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.318364 Aug 18 11:41:14.611146 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1901/3649] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:14 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:14.619706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cb3719a7-ad64-4275-bcf9-01773a55369a tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:14.620797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cb3719a7-ad64-4275-bcf9-01773a55369a tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:14.632029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb3719a7-ad64-4275-bcf9-01773a55369a tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:14.632836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb3719a7-ad64-4275-bcf9-01773a55369a tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:14.633712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb3719a7-ad64-4275-bcf9-01773a55369a tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:14.634473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb3719a7-ad64-4275-bcf9-01773a55369a tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:14.634969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb3719a7-ad64-4275-bcf9-01773a55369a tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:14.635607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb3719a7-ad64-4275-bcf9-01773a55369a tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:15.061818 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3fd7c632-5453-4284-807c-e8c06b04b79a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.871273 Aug 18 11:41:15.062516 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1749/3650] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:41:14 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:41:15.067706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-165d0149-28bd-491e-a973-e07030155983 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:15.070375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-165d0149-28bd-491e-a973-e07030155983 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:15.097325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-165d0149-28bd-491e-a973-e07030155983 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:15.100056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-165d0149-28bd-491e-a973-e07030155983 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:15.100976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-165d0149-28bd-491e-a973-e07030155983 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:15.118699 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-165d0149-28bd-491e-a973-e07030155983 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:15.121398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-165d0149-28bd-491e-a973-e07030155983 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:15.122250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-165d0149-28bd-491e-a973-e07030155983 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:15.342708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cb3719a7-ad64-4275-bcf9-01773a55369a tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:15.359208 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cb3719a7-ad64-4275-bcf9-01773a55369a tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1509 microversion: 2.1 time: 0.745939 Aug 18 11:41:15.361089 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1902/3651] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:14 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1509 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:15.370688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-52c421ef-b1c8-4b9f-920e-9120fff396b8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'create', calling method: .version_select at 0x7f519edbbdc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-94106184", "description": "tempest-description-1283626423"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:15.542360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-165d0149-28bd-491e-a973-e07030155983 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:15.557101 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-165d0149-28bd-491e-a973-e07030155983 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 200 len: 1468 microversion: 2.1 time: 0.493249 Aug 18 11:41:15.558880 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1750/3652] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:15 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 1468 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:15.564611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b5433bf2-ede0-45f2-8552-4643cab2c461 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:15.565480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b5433bf2-ede0-45f2-8552-4643cab2c461 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:15.584363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5433bf2-ede0-45f2-8552-4643cab2c461 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:15.585453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5433bf2-ede0-45f2-8552-4643cab2c461 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:15.586010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5433bf2-ede0-45f2-8552-4643cab2c461 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:15.586916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5433bf2-ede0-45f2-8552-4643cab2c461 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:15.587677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5433bf2-ede0-45f2-8552-4643cab2c461 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:15.591171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5433bf2-ede0-45f2-8552-4643cab2c461 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:15.619965 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-52c421ef-b1c8-4b9f-920e-9120fff396b8 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.256473 Aug 18 11:41:15.620733 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1903/3653] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:41:15 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:15.629103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-32b1252d-122b-4f89-8d30-6987c287abdc req-19bcd447-3d58-447d-928d-d933c1c6ee25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da67cf3-bc5d-4b71-9c07-6234c22493bc", "name": "network-vif-deleted", "tag": "061756b5-9fa0-425c-99c6-d5be70f85abe"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:15.688911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-32b1252d-122b-4f89-8d30-6987c287abdc req-19bcd447-3d58-447d-928d-d933c1c6ee25 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:15.693378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-32b1252d-122b-4f89-8d30-6987c287abdc req-19bcd447-3d58-447d-928d-d933c1c6ee25 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:15.693850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-32b1252d-122b-4f89-8d30-6987c287abdc req-19bcd447-3d58-447d-928d-d933c1c6ee25 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:15.737717 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-32b1252d-122b-4f89-8d30-6987c287abdc req-19bcd447-3d58-447d-928d-d933c1c6ee25 service nova] Creating event network-vif-deleted:061756b5-9fa0-425c-99c6-d5be70f85abe for instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc on n-h2-853611-3 Aug 18 11:41:15.756515 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-32b1252d-122b-4f89-8d30-6987c287abdc req-19bcd447-3d58-447d-928d-d933c1c6ee25 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133134 Aug 18 11:41:15.760488 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1904/3654] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:15.776304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f531ecbc-b0fe-48dd-9173-69dc91de77d8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:15.777545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f531ecbc-b0fe-48dd-9173-69dc91de77d8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:15.787505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f531ecbc-b0fe-48dd-9173-69dc91de77d8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:15.788438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f531ecbc-b0fe-48dd-9173-69dc91de77d8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:15.789097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f531ecbc-b0fe-48dd-9173-69dc91de77d8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:15.790053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f531ecbc-b0fe-48dd-9173-69dc91de77d8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:15.790766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f531ecbc-b0fe-48dd-9173-69dc91de77d8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:15.791576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f531ecbc-b0fe-48dd-9173-69dc91de77d8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:15.989347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f531ecbc-b0fe-48dd-9173-69dc91de77d8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:15.997802 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f531ecbc-b0fe-48dd-9173-69dc91de77d8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.235626 Aug 18 11:41:15.998385 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1905/3655] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:15 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:16.008256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2084211143", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "9a5e4939-7f57-40c9-a9b5-d9fbe3deca0d"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:16.054657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b5433bf2-ede0-45f2-8552-4643cab2c461 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:16.071927 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b5433bf2-ede0-45f2-8552-4643cab2c461 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1690 microversion: 2.1 time: 0.511683 Aug 18 11:41:16.074136 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1751/3656] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:15 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1690 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:16.098076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] validate_networks() for [('9a5e4939-7f57-40c9-a9b5-d9fbe3deca0d', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:41:16.231374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-56c8104d-e194-4aa2-a65b-f407ab6f19c3 req-bffabdee-845a-4ae5-9de2-4cd6cd72597c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6076f702-2b3c-488e-aa41-0c3a2f63ec26", "name": "network-vif-deleted", "tag": "7b29d6db-3458-46ed-bbb6-599fb1ac5724"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:16.247954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-56c8104d-e194-4aa2-a65b-f407ab6f19c3 req-bffabdee-845a-4ae5-9de2-4cd6cd72597c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:16.248461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-56c8104d-e194-4aa2-a65b-f407ab6f19c3 req-bffabdee-845a-4ae5-9de2-4cd6cd72597c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:16.253744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-56c8104d-e194-4aa2-a65b-f407ab6f19c3 req-bffabdee-845a-4ae5-9de2-4cd6cd72597c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:16.276135 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-56c8104d-e194-4aa2-a65b-f407ab6f19c3 req-bffabdee-845a-4ae5-9de2-4cd6cd72597c service nova] Creating event network-vif-deleted:7b29d6db-3458-46ed-bbb6-599fb1ac5724 for instance 6076f702-2b3c-488e-aa41-0c3a2f63ec26 on n-h2-853611-3 Aug 18 11:41:16.300249 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-56c8104d-e194-4aa2-a65b-f407ab6f19c3 req-bffabdee-845a-4ae5-9de2-4cd6cd72597c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072399 Aug 18 11:41:16.300890 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1752/3657] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:41:16.387806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6c12c6e1-34f8-4cc3-bb4c-2d4e0309f829 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:16.388647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6c12c6e1-34f8-4cc3-bb4c-2d4e0309f829 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:16.411636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c12c6e1-34f8-4cc3-bb4c-2d4e0309f829 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:16.413094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c12c6e1-34f8-4cc3-bb4c-2d4e0309f829 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:16.415191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c12c6e1-34f8-4cc3-bb4c-2d4e0309f829 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:16.417798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c12c6e1-34f8-4cc3-bb4c-2d4e0309f829 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:16.419107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c12c6e1-34f8-4cc3-bb4c-2d4e0309f829 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:16.419670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c12c6e1-34f8-4cc3-bb4c-2d4e0309f829 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:16.493907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c12c6e1-34f8-4cc3-bb4c-2d4e0309f829 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:16.495704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c12c6e1-34f8-4cc3-bb4c-2d4e0309f829 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:16.496999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c12c6e1-34f8-4cc3-bb4c-2d4e0309f829 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:16.497779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-6c12c6e1-34f8-4cc3-bb4c-2d4e0309f829 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lazy-loading 'fault' on Instance uuid 6076f702-2b3c-488e-aa41-0c3a2f63ec26 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:41:16.558328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6c12c6e1-34f8-4cc3-bb4c-2d4e0309f829 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b6e5f634ee34e718e7014c1dcaec202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7229c8e66644559b6c87363133796a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:16.570070 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6c12c6e1-34f8-4cc3-bb4c-2d4e0309f829 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 200 len: 1305 microversion: 2.1 time: 0.189037 Aug 18 11:41:16.571410 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1753/3658] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:16 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 1305 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:16.585076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8c79f8fb-886d-47bb-88be-0d8a848ebac5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:16.585906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8c79f8fb-886d-47bb-88be-0d8a848ebac5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1da67cf3-bc5d-4b71-9c07-6234c22493bc] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:16.597504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c79f8fb-886d-47bb-88be-0d8a848ebac5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:16.598041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c79f8fb-886d-47bb-88be-0d8a848ebac5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:16.598959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c79f8fb-886d-47bb-88be-0d8a848ebac5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:16.600027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c79f8fb-886d-47bb-88be-0d8a848ebac5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:16.600616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c79f8fb-886d-47bb-88be-0d8a848ebac5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:16.601324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c79f8fb-886d-47bb-88be-0d8a848ebac5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:16.621776 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-8c79f8fb-886d-47bb-88be-0d8a848ebac5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] HTTP exception thrown: Instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc could not be found. Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8c79f8fb-886d-47bb-88be-0d8a848ebac5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Request method failure captured: Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc HTTP/1.1 Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iQS1HQLogwe8dbsHDcELBksrzeVG_Rg_-4tnlsiX2fQKj36yqWbFqXhPHKqvCRztqNwQO1JcjKIcSX24xt7JiNZ-T4SYzKPQkkE57Xg3jxzi1YFAXHrIKjbKZjb7FdumjW1FJmLqLpB3MahxAkPs5Cb0dbU9sNrhc8VeGi7DqDMP3Y Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6387896b424840deb9ef97aae02edd99 Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-MigrationsAdminTest-1679492724 Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6387896b424840deb9ef97aae02edd99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6387896b424840deb9ef97aae02edd99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6387896b424840deb9ef97aae02edd99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6387896b424840deb9ef97aae02edd99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-MigrationsAdminTest-1679492724 Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6387896b424840deb9ef97aae02edd99 Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-MigrationsAdminTest-1679492724 Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-MigrationsAdminTest-1679492724-project Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 9269fc4d233c42a590bfcbfaa7f2e895 Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-MigrationsAdminTest-1679492724-project Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc could not be found. Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '1da67cf3-bc5d-4b71-9c07-6234c22493bc'} Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc could not be found. Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc could not be found. Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:16.625118 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:16.632351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:16.632351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:16.632351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:16.632351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:16.632351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:16.632351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc could not be found. Aug 18 11:41:16.632351 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:16.634168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8c79f8fb-886d-47bb-88be-0d8a848ebac5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Returning 404 to user: Instance 1da67cf3-bc5d-4b71-9c07-6234c22493bc could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:16.635720 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8c79f8fb-886d-47bb-88be-0d8a848ebac5 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc" status: 404 len: 111 microversion: 2.1 time: 0.055352 Aug 18 11:41:16.640314 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1754/3659] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:16 2022] GET /compute/v2.1/servers/1da67cf3-bc5d-4b71-9c07-6234c22493bc => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:16.652995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f57601eb-b250-4d90-879a-1064237fa9b7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:16.656339 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f57601eb-b250-4d90-879a-1064237fa9b7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:16.666865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f57601eb-b250-4d90-879a-1064237fa9b7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:16.667371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f57601eb-b250-4d90-879a-1064237fa9b7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:16.667858 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f57601eb-b250-4d90-879a-1064237fa9b7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:16.668579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f57601eb-b250-4d90-879a-1064237fa9b7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:16.669031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f57601eb-b250-4d90-879a-1064237fa9b7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:16.669803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f57601eb-b250-4d90-879a-1064237fa9b7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:16.699576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f57601eb-b250-4d90-879a-1064237fa9b7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:41:16.836502 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f57601eb-b250-4d90-879a-1064237fa9b7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 204 len: 0 microversion: 2.1 time: 0.193003 Aug 18 11:41:16.837817 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1755/3660] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:41:16 2022] DELETE /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:41:16.846810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cad14deb-84e1-4843-97e9-6c0b583abf60 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:16.848831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cad14deb-84e1-4843-97e9-6c0b583abf60 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:16.857950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cad14deb-84e1-4843-97e9-6c0b583abf60 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:16.859642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cad14deb-84e1-4843-97e9-6c0b583abf60 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:16.860094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cad14deb-84e1-4843-97e9-6c0b583abf60 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:16.862901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cad14deb-84e1-4843-97e9-6c0b583abf60 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:16.863439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cad14deb-84e1-4843-97e9-6c0b583abf60 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:16.866280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cad14deb-84e1-4843-97e9-6c0b583abf60 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:17.010994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:41:17.011764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:41:17.012109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:41:17.012814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:41:17.013470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:41:17.025117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:17.026180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:17.026894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:17.027869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:17.028698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:17.029446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:17.052630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Getting quotas for project 6e4deaca35e548218df7f8358b79ecb9. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:41:17.060061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Getting quotas for user 3a7b07fb7b4d459e8f09ffc731a779fd and project 6e4deaca35e548218df7f8358b79ecb9. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:41:17.077215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:41:17.080523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:41:17.117384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cad14deb-84e1-4843-97e9-6c0b583abf60 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:17.141986 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cad14deb-84e1-4843-97e9-6c0b583abf60 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1534 microversion: 2.1 time: 0.297005 Aug 18 11:41:17.143438 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1756/3661] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:16 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1534 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:17.150078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6e78c56b-2786-4ac4-991c-f440493d65b3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:17.151032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6e78c56b-2786-4ac4-991c-f440493d65b3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:17.158764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6e78c56b-2786-4ac4-991c-f440493d65b3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:17.159364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6e78c56b-2786-4ac4-991c-f440493d65b3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:17.159534 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-95943f19-8c0b-4578-989a-493389de78bd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.159971 Aug 18 11:41:17.159941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6e78c56b-2786-4ac4-991c-f440493d65b3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:17.160246 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1906/3662] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:41:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:41:17.161168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6e78c56b-2786-4ac4-991c-f440493d65b3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:17.161711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6e78c56b-2786-4ac4-991c-f440493d65b3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:17.162153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6e78c56b-2786-4ac4-991c-f440493d65b3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:17.170653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c3a2b11-8abe-4893-a398-605fae055e12 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:17.171277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c3a2b11-8abe-4893-a398-605fae055e12 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:17.198882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c3a2b11-8abe-4893-a398-605fae055e12 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:17.199391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c3a2b11-8abe-4893-a398-605fae055e12 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:17.199840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c3a2b11-8abe-4893-a398-605fae055e12 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:17.200566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c3a2b11-8abe-4893-a398-605fae055e12 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:17.209674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c3a2b11-8abe-4893-a398-605fae055e12 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:17.211650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c3a2b11-8abe-4893-a398-605fae055e12 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:17.353620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9c3a2b11-8abe-4893-a398-605fae055e12 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:17.363259 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c3a2b11-8abe-4893-a398-605fae055e12 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1622 microversion: 2.1 time: 0.201559 Aug 18 11:41:17.365633 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1907/3663] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:17 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1622 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:17.371337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59fb606c-d326-4a41-8558-54fbb98b643f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:17.372425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59fb606c-d326-4a41-8558-54fbb98b643f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:17.437690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6e78c56b-2786-4ac4-991c-f440493d65b3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:17.448029 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6e78c56b-2786-4ac4-991c-f440493d65b3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.303230 Aug 18 11:41:17.448623 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1757/3664] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:17 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:17.542892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-59fb606c-d326-4a41-8558-54fbb98b643f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:17.556826 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59fb606c-d326-4a41-8558-54fbb98b643f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1216 microversion: 2.1 time: 0.189816 Aug 18 11:41:17.558794 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1908/3665] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:17 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1216 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:17.592801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-454263bf-80e9-47b3-8d38-5fd9f411b5e4 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:17.593439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-454263bf-80e9-47b3-8d38-5fd9f411b5e4 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] [instance: 6076f702-2b3c-488e-aa41-0c3a2f63ec26] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:17.643156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-454263bf-80e9-47b3-8d38-5fd9f411b5e4 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:17.643156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-454263bf-80e9-47b3-8d38-5fd9f411b5e4 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:17.643156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-454263bf-80e9-47b3-8d38-5fd9f411b5e4 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:17.643156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-454263bf-80e9-47b3-8d38-5fd9f411b5e4 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:17.643156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-454263bf-80e9-47b3-8d38-5fd9f411b5e4 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:17.643156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-454263bf-80e9-47b3-8d38-5fd9f411b5e4 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:17.676269 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-454263bf-80e9-47b3-8d38-5fd9f411b5e4 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] HTTP exception thrown: Instance 6076f702-2b3c-488e-aa41-0c3a2f63ec26 could not be found. Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-454263bf-80e9-47b3-8d38-5fd9f411b5e4 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Request method failure captured: Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 HTTP/1.1 Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iVG7khKUzZyN9xPz7WqrH7r6SoMN1Lft-UrqWBEm1FJJtbJ0nu-0GX25Gyq-BdZr_7MkfVHxJxCpzvrPCTbf1sQL4oPKp9qHQCf4Uqa1Zb3Uro4o7oXa_qZIUlOG3HHnM3TST6aEpNumHE3XpDHEqzJOTENZn31tMv9mUUfUaus27c Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: f7229c8e66644559b6c87363133796a7 Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerPasswordTestJSON-2008658877 Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f7229c8e66644559b6c87363133796a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f7229c8e66644559b6c87363133796a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f7229c8e66644559b6c87363133796a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f7229c8e66644559b6c87363133796a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerPasswordTestJSON-2008658877 Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: f7229c8e66644559b6c87363133796a7 Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2008658877 Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerPasswordTestJSON-2008658877-project Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1b6e5f634ee34e718e7014c1dcaec202 Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerPasswordTestJSON-2008658877-project Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 6076f702-2b3c-488e-aa41-0c3a2f63ec26 could not be found. Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '6076f702-2b3c-488e-aa41-0c3a2f63ec26'} Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6076f702-2b3c-488e-aa41-0c3a2f63ec26 could not be found. Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6076f702-2b3c-488e-aa41-0c3a2f63ec26 could not be found. Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:17.678899 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:17.685792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:17.685792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:17.685792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:17.685792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:17.685792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:17.685792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6076f702-2b3c-488e-aa41-0c3a2f63ec26 could not be found. Aug 18 11:41:17.685792 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:17.685792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-454263bf-80e9-47b3-8d38-5fd9f411b5e4 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] Returning 404 to user: Instance 6076f702-2b3c-488e-aa41-0c3a2f63ec26 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:17.685792 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-454263bf-80e9-47b3-8d38-5fd9f411b5e4 tempest-ServerPasswordTestJSON-2008658877 tempest-ServerPasswordTestJSON-2008658877-project] 10.222.0.73 "GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26" status: 404 len: 111 microversion: 2.1 time: 0.091962 Aug 18 11:41:17.687046 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1758/3666] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:17 2022] GET /compute/v2.1/servers/6076f702-2b3c-488e-aa41-0c3a2f63ec26 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:18.165378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b7fc50f7-13ed-40ea-b823-c600dbeb82c7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:18.166009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b7fc50f7-13ed-40ea-b823-c600dbeb82c7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:18.194602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7fc50f7-13ed-40ea-b823-c600dbeb82c7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:18.196279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7fc50f7-13ed-40ea-b823-c600dbeb82c7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:18.199578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7fc50f7-13ed-40ea-b823-c600dbeb82c7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:18.201140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7fc50f7-13ed-40ea-b823-c600dbeb82c7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:18.204303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7fc50f7-13ed-40ea-b823-c600dbeb82c7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:18.206724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7fc50f7-13ed-40ea-b823-c600dbeb82c7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:18.326677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-6058be1e-ba8e-4dd7-a217-8fc9764d1c06 req-05fdb05e-78f0-4465-9ed5-eefe482e75fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c22c788-0180-43df-aa4e-48363a89fa79", "name": "network-vif-deleted", "tag": "3e914982-c66b-4b57-9305-0f9bbe300f7e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:18.360931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6058be1e-ba8e-4dd7-a217-8fc9764d1c06 req-05fdb05e-78f0-4465-9ed5-eefe482e75fa service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:18.362640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6058be1e-ba8e-4dd7-a217-8fc9764d1c06 req-05fdb05e-78f0-4465-9ed5-eefe482e75fa service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:18.365340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6058be1e-ba8e-4dd7-a217-8fc9764d1c06 req-05fdb05e-78f0-4465-9ed5-eefe482e75fa service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:18.408208 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-6058be1e-ba8e-4dd7-a217-8fc9764d1c06 req-05fdb05e-78f0-4465-9ed5-eefe482e75fa service nova] Creating event network-vif-deleted:3e914982-c66b-4b57-9305-0f9bbe300f7e for instance 7c22c788-0180-43df-aa4e-48363a89fa79 on n-h1-853611-3 Aug 18 11:41:18.432234 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-6058be1e-ba8e-4dd7-a217-8fc9764d1c06 req-05fdb05e-78f0-4465-9ed5-eefe482e75fa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113043 Aug 18 11:41:18.435139 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1759/3667] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:18.452223 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-27b8b7cb-76a0-4942-a961-2b8d4ea8636a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:18.458101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-27b8b7cb-76a0-4942-a961-2b8d4ea8636a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:18.477179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27b8b7cb-76a0-4942-a961-2b8d4ea8636a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:18.488287 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27b8b7cb-76a0-4942-a961-2b8d4ea8636a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:18.491400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27b8b7cb-76a0-4942-a961-2b8d4ea8636a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:18.495949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27b8b7cb-76a0-4942-a961-2b8d4ea8636a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:18.499214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27b8b7cb-76a0-4942-a961-2b8d4ea8636a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:18.499879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27b8b7cb-76a0-4942-a961-2b8d4ea8636a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:18.618348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27b8b7cb-76a0-4942-a961-2b8d4ea8636a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:18.618983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27b8b7cb-76a0-4942-a961-2b8d4ea8636a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:18.619435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27b8b7cb-76a0-4942-a961-2b8d4ea8636a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:18.619899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-27b8b7cb-76a0-4942-a961-2b8d4ea8636a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lazy-loading 'fault' on Instance uuid 7c22c788-0180-43df-aa4e-48363a89fa79 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:41:18.807966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-27b8b7cb-76a0-4942-a961-2b8d4ea8636a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:18.824834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b7fc50f7-13ed-40ea-b823-c600dbeb82c7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:18.833485 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-27b8b7cb-76a0-4942-a961-2b8d4ea8636a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 200 len: 1335 microversion: 2.1 time: 0.392848 Aug 18 11:41:18.838693 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1760/3668] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:18 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 1335 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:18.840179 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b7fc50f7-13ed-40ea-b823-c600dbeb82c7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1534 microversion: 2.1 time: 0.679920 Aug 18 11:41:18.854459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-db708ea1-540b-48f2-a1a6-8a1aab3d4a70 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:18.854733 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1909/3669] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:18 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1534 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:18.860792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-db708ea1-540b-48f2-a1a6-8a1aab3d4a70 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:18.865360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-296737cd-8008-4aac-a0ca-a166b8a3b1ec tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:18.866362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-296737cd-8008-4aac-a0ca-a166b8a3b1ec tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:18.884358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-296737cd-8008-4aac-a0ca-a166b8a3b1ec tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:18.885215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-296737cd-8008-4aac-a0ca-a166b8a3b1ec tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:18.885968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-296737cd-8008-4aac-a0ca-a166b8a3b1ec tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:18.886863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-296737cd-8008-4aac-a0ca-a166b8a3b1ec tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:18.887607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-296737cd-8008-4aac-a0ca-a166b8a3b1ec tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:18.888164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-296737cd-8008-4aac-a0ca-a166b8a3b1ec tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:18.889449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db708ea1-540b-48f2-a1a6-8a1aab3d4a70 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:18.891967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db708ea1-540b-48f2-a1a6-8a1aab3d4a70 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:18.893719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db708ea1-540b-48f2-a1a6-8a1aab3d4a70 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:18.897005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db708ea1-540b-48f2-a1a6-8a1aab3d4a70 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:18.899388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db708ea1-540b-48f2-a1a6-8a1aab3d4a70 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:18.904123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db708ea1-540b-48f2-a1a6-8a1aab3d4a70 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:19.140034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-296737cd-8008-4aac-a0ca-a166b8a3b1ec tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:19.167525 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-296737cd-8008-4aac-a0ca-a166b8a3b1ec tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1268 microversion: 2.1 time: 0.318036 Aug 18 11:41:19.174377 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1910/3670] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:18 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1268 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:19.308033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-db708ea1-540b-48f2-a1a6-8a1aab3d4a70 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:19.324606 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-db708ea1-540b-48f2-a1a6-8a1aab3d4a70 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.484682 Aug 18 11:41:19.336911 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1761/3671] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:18 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:19.865573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0bca6b64-c540-462d-990b-49db67dcdefd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:19.867969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a7fad89d-9fb4-4426-917e-708848f5ecbf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:19.868653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a7fad89d-9fb4-4426-917e-708848f5ecbf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:19.874094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0bca6b64-c540-462d-990b-49db67dcdefd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 7c22c788-0180-43df-aa4e-48363a89fa79] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:19.898540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bca6b64-c540-462d-990b-49db67dcdefd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:19.900218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bca6b64-c540-462d-990b-49db67dcdefd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:19.903252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7fad89d-9fb4-4426-917e-708848f5ecbf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:19.903758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7fad89d-9fb4-4426-917e-708848f5ecbf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:19.904037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bca6b64-c540-462d-990b-49db67dcdefd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:19.905187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bca6b64-c540-462d-990b-49db67dcdefd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:19.906057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bca6b64-c540-462d-990b-49db67dcdefd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:19.907561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7fad89d-9fb4-4426-917e-708848f5ecbf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:19.909537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bca6b64-c540-462d-990b-49db67dcdefd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:19.911927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7fad89d-9fb4-4426-917e-708848f5ecbf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:19.913955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7fad89d-9fb4-4426-917e-708848f5ecbf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:19.914922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a7fad89d-9fb4-4426-917e-708848f5ecbf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:19.938756 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-0bca6b64-c540-462d-990b-49db67dcdefd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] HTTP exception thrown: Instance 7c22c788-0180-43df-aa4e-48363a89fa79 could not be found. Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0bca6b64-c540-462d-990b-49db67dcdefd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Request method failure captured: Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 HTTP/1.1 Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iRDccV-wQBjWbehYJnvnYrqtEvDPnmmRi9FdLn90jlDwmLP7Yu8AV-Xjh3sRI2h6VdTdDxREaF_4Uw5JAlLnmy-pOyTW0C8AnpTCeGTveMx08cuhXqa0wk4T8c8YQiDTyaAtMLbCc_qByCh4ZjwOdEPthe4EaqbP1499Gbu30qZ6g8 Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 4eea5599d0754399a32a3ae3431ff18f Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 7c22c788-0180-43df-aa4e-48363a89fa79 could not be found. Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '7c22c788-0180-43df-aa4e-48363a89fa79'} Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c22c788-0180-43df-aa4e-48363a89fa79 could not be found. Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c22c788-0180-43df-aa4e-48363a89fa79 could not be found. Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:19.943811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:19.948599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:19.948599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:19.948599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:19.948599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:19.948599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:19.948599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:19.948599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c22c788-0180-43df-aa4e-48363a89fa79 could not be found. Aug 18 11:41:19.948599 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:19.950703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0bca6b64-c540-462d-990b-49db67dcdefd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Returning 404 to user: Instance 7c22c788-0180-43df-aa4e-48363a89fa79 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:19.952114 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0bca6b64-c540-462d-990b-49db67dcdefd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79" status: 404 len: 111 microversion: 2.1 time: 0.097519 Aug 18 11:41:19.952873 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1911/3672] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:19 2022] GET /compute/v2.1/servers/7c22c788-0180-43df-aa4e-48363a89fa79 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:19.971516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7bb88d26-5462-4e4f-9bed-9793ef7caad0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '.version_select at 0x7f519ee1f310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:20.027726 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7bb88d26-5462-4e4f-9bed-9793ef7caad0 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1968131135" status: 202 len: 0 microversion: 2.1 time: 0.069856 Aug 18 11:41:20.029275 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1912/3673] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 11:41:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1968131135 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:41:20.105351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a7fad89d-9fb4-4426-917e-708848f5ecbf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:20.138964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:20.153656 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a7fad89d-9fb4-4426-917e-708848f5ecbf tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 200 len: 1363 microversion: 2.1 time: 0.293641 Aug 18 11:41:20.154704 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1762/3674] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:19 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:20.193255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6fe4f0c-2ee1-4388-9751-9afcd3dda2cb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:20.194626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c6fe4f0c-2ee1-4388-9751-9afcd3dda2cb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:20.207965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6fe4f0c-2ee1-4388-9751-9afcd3dda2cb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:20.208672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6fe4f0c-2ee1-4388-9751-9afcd3dda2cb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:20.209485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6fe4f0c-2ee1-4388-9751-9afcd3dda2cb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:20.210720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6fe4f0c-2ee1-4388-9751-9afcd3dda2cb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:20.211366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6fe4f0c-2ee1-4388-9751-9afcd3dda2cb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:20.211973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6fe4f0c-2ee1-4388-9751-9afcd3dda2cb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:20.236780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:20.357880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d959b205-2459-49ea-be70-7ad55c0c280e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:20.359166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d959b205-2459-49ea-be70-7ad55c0c280e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:20.395507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d959b205-2459-49ea-be70-7ad55c0c280e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:20.396633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d959b205-2459-49ea-be70-7ad55c0c280e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:20.397501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d959b205-2459-49ea-be70-7ad55c0c280e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:20.398793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d959b205-2459-49ea-be70-7ad55c0c280e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:20.399574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d959b205-2459-49ea-be70-7ad55c0c280e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:20.400307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d959b205-2459-49ea-be70-7ad55c0c280e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:20.516994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c6fe4f0c-2ee1-4388-9751-9afcd3dda2cb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:20.526880 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c6fe4f0c-2ee1-4388-9751-9afcd3dda2cb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1274 microversion: 2.1 time: 0.338459 Aug 18 11:41:20.531683 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1913/3675] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:20 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1274 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:20.542409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f3de8f0a-c2f8-4069-90e8-df2db841d5ed req-96173f69-b4d7-4448-9f38-466bdfee2a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7183ab-d769-4b94-9b9b-545a3eb459d7", "name": "network-vif-deleted", "tag": "71abe44d-4829-45bc-98f7-b6337e80396d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:20.570794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f3de8f0a-c2f8-4069-90e8-df2db841d5ed req-96173f69-b4d7-4448-9f38-466bdfee2a92 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:20.571715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f3de8f0a-c2f8-4069-90e8-df2db841d5ed req-96173f69-b4d7-4448-9f38-466bdfee2a92 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:20.572427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f3de8f0a-c2f8-4069-90e8-df2db841d5ed req-96173f69-b4d7-4448-9f38-466bdfee2a92 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:20.594367 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f3de8f0a-c2f8-4069-90e8-df2db841d5ed req-96173f69-b4d7-4448-9f38-466bdfee2a92 service nova] Creating event network-vif-deleted:71abe44d-4829-45bc-98f7-b6337e80396d for instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 on n-h2-853611-3 Aug 18 11:41:20.605250 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f3de8f0a-c2f8-4069-90e8-df2db841d5ed req-96173f69-b4d7-4448-9f38-466bdfee2a92 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071867 Aug 18 11:41:20.606290 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1914/3676] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:20.937947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d959b205-2459-49ea-be70-7ad55c0c280e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:20.966803 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d959b205-2459-49ea-be70-7ad55c0c280e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.620115 Aug 18 11:41:20.981483 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1763/3677] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:20 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:21.191771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc33f0c1-761a-4ef7-aeaf-07af586302eb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:21.193155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dc33f0c1-761a-4ef7-aeaf-07af586302eb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 8d7183ab-d769-4b94-9b9b-545a3eb459d7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:21.201753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc33f0c1-761a-4ef7-aeaf-07af586302eb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:21.203046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc33f0c1-761a-4ef7-aeaf-07af586302eb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:21.203693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc33f0c1-761a-4ef7-aeaf-07af586302eb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:21.204696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc33f0c1-761a-4ef7-aeaf-07af586302eb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:21.205380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc33f0c1-761a-4ef7-aeaf-07af586302eb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:21.205999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc33f0c1-761a-4ef7-aeaf-07af586302eb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:21.224622 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-dc33f0c1-761a-4ef7-aeaf-07af586302eb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] HTTP exception thrown: Instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 could not be found. Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc33f0c1-761a-4ef7-aeaf-07af586302eb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Request method failure captured: Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 HTTP/1.1 Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iQS1HQLogwe8dbsHDcELBksrzeVG_Rg_-4tnlsiX2fQKj36yqWbFqXhPHKqvCRztqNwQO1JcjKIcSX24xt7JiNZ-T4SYzKPQkkE57Xg3jxzi1YFAXHrIKjbKZjb7FdumjW1FJmLqLpB3MahxAkPs5Cb0dbU9sNrhc8VeGi7DqDMP3Y Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6387896b424840deb9ef97aae02edd99 Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-MigrationsAdminTest-1679492724 Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6387896b424840deb9ef97aae02edd99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6387896b424840deb9ef97aae02edd99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6387896b424840deb9ef97aae02edd99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6387896b424840deb9ef97aae02edd99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-MigrationsAdminTest-1679492724 Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6387896b424840deb9ef97aae02edd99 Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-MigrationsAdminTest-1679492724 Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-MigrationsAdminTest-1679492724-project Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 9269fc4d233c42a590bfcbfaa7f2e895 Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-MigrationsAdminTest-1679492724-project Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 could not be found. Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '8d7183ab-d769-4b94-9b9b-545a3eb459d7'} Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 could not be found. Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 could not be found. Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:21.226695 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:21.234318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:21.234318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:21.234318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:21.234318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:21.234318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:21.234318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 could not be found. Aug 18 11:41:21.234318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:21.236010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc33f0c1-761a-4ef7-aeaf-07af586302eb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Returning 404 to user: Instance 8d7183ab-d769-4b94-9b9b-545a3eb459d7 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:21.237628 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dc33f0c1-761a-4ef7-aeaf-07af586302eb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7" status: 404 len: 111 microversion: 2.1 time: 0.051062 Aug 18 11:41:21.239511 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1915/3678] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:21 2022] GET /compute/v2.1/servers/8d7183ab-d769-4b94-9b9b-545a3eb459d7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:21.248901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-18f62b7b-bcd6-46f5-8c8e-ee3c929f7f03 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '.version_select at 0x7f51b0c69310>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:21.288583 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-18f62b7b-bcd6-46f5-8c8e-ee3c929f7f03 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728338481" status: 202 len: 0 microversion: 2.1 time: 0.043121 Aug 18 11:41:21.290450 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1764/3679] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 11:41:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728338481 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:41:21.572952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c1c4e5e9-321f-4eb6-8d0f-889606e49ce0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:21.574524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c1c4e5e9-321f-4eb6-8d0f-889606e49ce0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:21.585770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c4e5e9-321f-4eb6-8d0f-889606e49ce0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:21.587030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c4e5e9-321f-4eb6-8d0f-889606e49ce0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:21.588075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c4e5e9-321f-4eb6-8d0f-889606e49ce0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:21.589601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c4e5e9-321f-4eb6-8d0f-889606e49ce0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:21.590760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c4e5e9-321f-4eb6-8d0f-889606e49ce0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:21.591785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c4e5e9-321f-4eb6-8d0f-889606e49ce0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:21.828771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c1c4e5e9-321f-4eb6-8d0f-889606e49ce0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:21.860685 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c1c4e5e9-321f-4eb6-8d0f-889606e49ce0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1274 microversion: 2.1 time: 0.295234 Aug 18 11:41:21.886636 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1916/3680] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:21 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1274 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:21.992218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-36f994b5-87e7-4050-91f6-147c3baa6100 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:21.994051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-36f994b5-87e7-4050-91f6-147c3baa6100 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:22.016615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:22.042949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36f994b5-87e7-4050-91f6-147c3baa6100 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:22.045643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36f994b5-87e7-4050-91f6-147c3baa6100 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:22.047174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36f994b5-87e7-4050-91f6-147c3baa6100 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:22.048529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36f994b5-87e7-4050-91f6-147c3baa6100 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:22.052497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36f994b5-87e7-4050-91f6-147c3baa6100 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:22.053335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-36f994b5-87e7-4050-91f6-147c3baa6100 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:22.909084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-852a45bf-f010-451b-ba68-9dac77da8973 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:22.912723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-852a45bf-f010-451b-ba68-9dac77da8973 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:22.922187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-36f994b5-87e7-4050-91f6-147c3baa6100 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:22.931273 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-36f994b5-87e7-4050-91f6-147c3baa6100 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.945082 Aug 18 11:41:22.948078 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1765/3681] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:21 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:22.951678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-852a45bf-f010-451b-ba68-9dac77da8973 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:22.953180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-852a45bf-f010-451b-ba68-9dac77da8973 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:22.954250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-852a45bf-f010-451b-ba68-9dac77da8973 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:22.959985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-852a45bf-f010-451b-ba68-9dac77da8973 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:22.961115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-852a45bf-f010-451b-ba68-9dac77da8973 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:22.964122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-852a45bf-f010-451b-ba68-9dac77da8973 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:23.310374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1af4ecf5-b7a3-401c-a216-a316e0565cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:23.312368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1af4ecf5-b7a3-401c-a216-a316e0565cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:23.327347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1af4ecf5-b7a3-401c-a216-a316e0565cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:23.328525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1af4ecf5-b7a3-401c-a216-a316e0565cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:23.329576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1af4ecf5-b7a3-401c-a216-a316e0565cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:23.331075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1af4ecf5-b7a3-401c-a216-a316e0565cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:23.332651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1af4ecf5-b7a3-401c-a216-a316e0565cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:23.333718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1af4ecf5-b7a3-401c-a216-a316e0565cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:23.408393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-852a45bf-f010-451b-ba68-9dac77da8973 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:23.429751 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-852a45bf-f010-451b-ba68-9dac77da8973 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1316 microversion: 2.1 time: 0.535349 Aug 18 11:41:23.431002 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1917/3682] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:22 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1316 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:23.451458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1af4ecf5-b7a3-401c-a216-a316e0565cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:41:23.738961 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1af4ecf5-b7a3-401c-a216-a316e0565cfa tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 204 len: 0 microversion: 2.1 time: 0.436599 Aug 18 11:41:23.742095 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1766/3683] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:41:23 2022] DELETE /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:41:23.751187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8dcb6b77-c21a-45e2-ad30-29c3d0d85aba tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:23.752131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8dcb6b77-c21a-45e2-ad30-29c3d0d85aba tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:23.764757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcb6b77-c21a-45e2-ad30-29c3d0d85aba tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:23.765565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcb6b77-c21a-45e2-ad30-29c3d0d85aba tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:23.766217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcb6b77-c21a-45e2-ad30-29c3d0d85aba tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:23.767205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcb6b77-c21a-45e2-ad30-29c3d0d85aba tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:23.767862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcb6b77-c21a-45e2-ad30-29c3d0d85aba tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:23.768939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcb6b77-c21a-45e2-ad30-29c3d0d85aba tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:23.957728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0e27a8c9-fc84-478f-8cc2-1ec886a2bf4a tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:23.959424 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0e27a8c9-fc84-478f-8cc2-1ec886a2bf4a tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:23.976684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e27a8c9-fc84-478f-8cc2-1ec886a2bf4a tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:23.977106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e27a8c9-fc84-478f-8cc2-1ec886a2bf4a tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:23.977559 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e27a8c9-fc84-478f-8cc2-1ec886a2bf4a tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:23.978311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e27a8c9-fc84-478f-8cc2-1ec886a2bf4a tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:23.978814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e27a8c9-fc84-478f-8cc2-1ec886a2bf4a tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:23.979252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e27a8c9-fc84-478f-8cc2-1ec886a2bf4a tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:23.997567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8dcb6b77-c21a-45e2-ad30-29c3d0d85aba tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:24.013807 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8dcb6b77-c21a-45e2-ad30-29c3d0d85aba tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1468 microversion: 2.1 time: 0.266415 Aug 18 11:41:24.014793 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1918/3684] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:23 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1468 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:24.396437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0e27a8c9-fc84-478f-8cc2-1ec886a2bf4a tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:24.410246 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0e27a8c9-fc84-478f-8cc2-1ec886a2bf4a tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.460845 Aug 18 11:41:24.410898 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1767/3685] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:23 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:24.484541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b6712b60-ab8c-4e4c-8bcc-796cd4674770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:24.486572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b6712b60-ab8c-4e4c-8bcc-796cd4674770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:24.523890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6712b60-ab8c-4e4c-8bcc-796cd4674770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:24.529063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6712b60-ab8c-4e4c-8bcc-796cd4674770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:24.530305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6712b60-ab8c-4e4c-8bcc-796cd4674770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:24.536548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6712b60-ab8c-4e4c-8bcc-796cd4674770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:24.540177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6712b60-ab8c-4e4c-8bcc-796cd4674770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:24.542612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6712b60-ab8c-4e4c-8bcc-796cd4674770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:24.953638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-70bae5b3-6e26-478a-807e-705389c1dc2f req-9b2bfb1a-ae72-4a5f-beb4-803a4955eaeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8347e97a-e013-461c-b858-2fc8c6a505d5", "tag": "b0ee35ef-ab7e-4ce7-a28a-562b36cc60d5"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:24.994923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-70bae5b3-6e26-478a-807e-705389c1dc2f req-9b2bfb1a-ae72-4a5f-beb4-803a4955eaeb service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:24.995784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-70bae5b3-6e26-478a-807e-705389c1dc2f req-9b2bfb1a-ae72-4a5f-beb4-803a4955eaeb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:24.996633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-70bae5b3-6e26-478a-807e-705389c1dc2f req-9b2bfb1a-ae72-4a5f-beb4-803a4955eaeb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:25.032580 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-70bae5b3-6e26-478a-807e-705389c1dc2f req-9b2bfb1a-ae72-4a5f-beb4-803a4955eaeb service nova] Creating event network-changed:b0ee35ef-ab7e-4ce7-a28a-562b36cc60d5 for instance 8347e97a-e013-461c-b858-2fc8c6a505d5 on n-h2-853611-3 Aug 18 11:41:25.049182 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-70bae5b3-6e26-478a-807e-705389c1dc2f req-9b2bfb1a-ae72-4a5f-beb4-803a4955eaeb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105655 Aug 18 11:41:25.054218 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1768/3686] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:25.071315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-61e28208-8d91-41e5-99af-5347384ae670 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:25.071643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-61e28208-8d91-41e5-99af-5347384ae670 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:25.091332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61e28208-8d91-41e5-99af-5347384ae670 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:25.091332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61e28208-8d91-41e5-99af-5347384ae670 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:25.091332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61e28208-8d91-41e5-99af-5347384ae670 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:25.091332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61e28208-8d91-41e5-99af-5347384ae670 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:25.095618 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61e28208-8d91-41e5-99af-5347384ae670 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:25.095905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-61e28208-8d91-41e5-99af-5347384ae670 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:25.122612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b6712b60-ab8c-4e4c-8bcc-796cd4674770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:25.137724 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b6712b60-ab8c-4e4c-8bcc-796cd4674770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1316 microversion: 2.1 time: 0.671489 Aug 18 11:41:25.141285 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1919/3687] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:24 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1316 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:25.432751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-46b443e5-2e7d-442a-92db-baa257489ada tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:25.433379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-46b443e5-2e7d-442a-92db-baa257489ada tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:25.452566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46b443e5-2e7d-442a-92db-baa257489ada tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:25.453861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46b443e5-2e7d-442a-92db-baa257489ada tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:25.457847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46b443e5-2e7d-442a-92db-baa257489ada tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:25.461963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46b443e5-2e7d-442a-92db-baa257489ada tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:25.462893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46b443e5-2e7d-442a-92db-baa257489ada tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:25.466616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46b443e5-2e7d-442a-92db-baa257489ada tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:25.746718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-61e28208-8d91-41e5-99af-5347384ae670 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:25.773073 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-61e28208-8d91-41e5-99af-5347384ae670 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1468 microversion: 2.1 time: 0.714606 Aug 18 11:41:25.774965 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1769/3688] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:25 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1468 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:26.137185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-46b443e5-2e7d-442a-92db-baa257489ada tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:26.150717 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-46b443e5-2e7d-442a-92db-baa257489ada tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.721340 Aug 18 11:41:26.154801 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1920/3689] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:25 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:26.170854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3b52fac5-e128-4291-8cf8-69e397036679 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:26.171492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3b52fac5-e128-4291-8cf8-69e397036679 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:26.188374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b52fac5-e128-4291-8cf8-69e397036679 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:26.189904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b52fac5-e128-4291-8cf8-69e397036679 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:26.190680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b52fac5-e128-4291-8cf8-69e397036679 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:26.192923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b52fac5-e128-4291-8cf8-69e397036679 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:26.193584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b52fac5-e128-4291-8cf8-69e397036679 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:26.198380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b52fac5-e128-4291-8cf8-69e397036679 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:26.798525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e575384e-5289-47aa-b658-b038cb6f9d43 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:26.804552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e575384e-5289-47aa-b658-b038cb6f9d43 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:26.818702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3b52fac5-e128-4291-8cf8-69e397036679 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:26.822666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e575384e-5289-47aa-b658-b038cb6f9d43 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:26.823167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e575384e-5289-47aa-b658-b038cb6f9d43 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:26.823615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e575384e-5289-47aa-b658-b038cb6f9d43 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:26.827437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e575384e-5289-47aa-b658-b038cb6f9d43 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:26.828511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e575384e-5289-47aa-b658-b038cb6f9d43 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:26.829169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e575384e-5289-47aa-b658-b038cb6f9d43 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:26.829361 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3b52fac5-e128-4291-8cf8-69e397036679 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1316 microversion: 2.1 time: 0.662296 Aug 18 11:41:26.830316 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1770/3690] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:26 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:27.013771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e575384e-5289-47aa-b658-b038cb6f9d43 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:27.027253 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e575384e-5289-47aa-b658-b038cb6f9d43 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1468 microversion: 2.1 time: 0.235029 Aug 18 11:41:27.028451 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1921/3691] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:26 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1468 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:27.173218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8b94e963-35d2-4503-a013-bf1f62bb764c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:27.174322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8b94e963-35d2-4503-a013-bf1f62bb764c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:27.183078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b94e963-35d2-4503-a013-bf1f62bb764c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:27.183940 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b94e963-35d2-4503-a013-bf1f62bb764c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:27.184606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b94e963-35d2-4503-a013-bf1f62bb764c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:27.185610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b94e963-35d2-4503-a013-bf1f62bb764c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:27.186354 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b94e963-35d2-4503-a013-bf1f62bb764c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:27.187291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b94e963-35d2-4503-a013-bf1f62bb764c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:27.864913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7583603-220b-4c86-ab48-fa408addc5e2 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:27.865580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a7583603-220b-4c86-ab48-fa408addc5e2 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:27.869647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:27.874170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:27.889443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7583603-220b-4c86-ab48-fa408addc5e2 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:27.890482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7583603-220b-4c86-ab48-fa408addc5e2 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:27.891182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7583603-220b-4c86-ab48-fa408addc5e2 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:27.892603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7583603-220b-4c86-ab48-fa408addc5e2 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:27.893304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7583603-220b-4c86-ab48-fa408addc5e2 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:27.895469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7583603-220b-4c86-ab48-fa408addc5e2 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:28.089404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8b94e963-35d2-4503-a013-bf1f62bb764c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:28.109785 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8b94e963-35d2-4503-a013-bf1f62bb764c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.939619 Aug 18 11:41:28.152127 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1771/3692] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:27 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:28.159405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2b1f29f8-e18e-4a41-8cdb-95eb1f12adeb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:28.161488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2b1f29f8-e18e-4a41-8cdb-95eb1f12adeb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:28.177142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b1f29f8-e18e-4a41-8cdb-95eb1f12adeb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:28.179222 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b1f29f8-e18e-4a41-8cdb-95eb1f12adeb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:28.180244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b1f29f8-e18e-4a41-8cdb-95eb1f12adeb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:28.181321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b1f29f8-e18e-4a41-8cdb-95eb1f12adeb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:28.181981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b1f29f8-e18e-4a41-8cdb-95eb1f12adeb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:28.182754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2b1f29f8-e18e-4a41-8cdb-95eb1f12adeb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:28.340814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2b1f29f8-e18e-4a41-8cdb-95eb1f12adeb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:28.355084 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2b1f29f8-e18e-4a41-8cdb-95eb1f12adeb tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 200 len: 1297 microversion: 2.1 time: 0.202125 Aug 18 11:41:28.358551 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1772/3693] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:28 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 1297 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:28.367577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-aa4ef7f0-ae96-4dda-95e8-c4105dfc349c req-a4633029-0d9e-4911-9d58-c6928e31ef07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd", "name": "network-vif-deleted", "tag": "00724f9e-9d67-4b16-bdb4-8f9550b2f963"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:28.380199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a7583603-220b-4c86-ab48-fa408addc5e2 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:28.391257 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a7583603-220b-4c86-ab48-fa408addc5e2 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1316 microversion: 2.1 time: 0.543738 Aug 18 11:41:28.392564 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1922/3694] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:27 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:28.409098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-aa4ef7f0-ae96-4dda-95e8-c4105dfc349c req-a4633029-0d9e-4911-9d58-c6928e31ef07 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:28.411233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-aa4ef7f0-ae96-4dda-95e8-c4105dfc349c req-a4633029-0d9e-4911-9d58-c6928e31ef07 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:28.411983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-aa4ef7f0-ae96-4dda-95e8-c4105dfc349c req-a4633029-0d9e-4911-9d58-c6928e31ef07 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:28.438279 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-aa4ef7f0-ae96-4dda-95e8-c4105dfc349c req-a4633029-0d9e-4911-9d58-c6928e31ef07 service nova] Creating event network-vif-deleted:00724f9e-9d67-4b16-bdb4-8f9550b2f963 for instance 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd on n-h2-853611-3 Aug 18 11:41:28.452730 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-aa4ef7f0-ae96-4dda-95e8-c4105dfc349c req-a4633029-0d9e-4911-9d58-c6928e31ef07 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091985 Aug 18 11:41:28.458639 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1773/3695] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:29.142972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a45013ce-b2c6-438e-9f8c-fc5fb46a6b14 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:29.145285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a45013ce-b2c6-438e-9f8c-fc5fb46a6b14 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:29.180424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a45013ce-b2c6-438e-9f8c-fc5fb46a6b14 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:29.184929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a45013ce-b2c6-438e-9f8c-fc5fb46a6b14 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:29.186731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a45013ce-b2c6-438e-9f8c-fc5fb46a6b14 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:29.188822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a45013ce-b2c6-438e-9f8c-fc5fb46a6b14 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:29.192689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a45013ce-b2c6-438e-9f8c-fc5fb46a6b14 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:29.196173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a45013ce-b2c6-438e-9f8c-fc5fb46a6b14 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:29.388046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e4fe8680-12f6-4307-aaf0-29e68f67ad62 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:29.388657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e4fe8680-12f6-4307-aaf0-29e68f67ad62 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:29.400693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4fe8680-12f6-4307-aaf0-29e68f67ad62 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:29.401203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4fe8680-12f6-4307-aaf0-29e68f67ad62 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:29.401648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4fe8680-12f6-4307-aaf0-29e68f67ad62 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:29.405828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4fe8680-12f6-4307-aaf0-29e68f67ad62 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:29.406692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4fe8680-12f6-4307-aaf0-29e68f67ad62 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:29.408917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4fe8680-12f6-4307-aaf0-29e68f67ad62 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:29.443294 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-e4fe8680-12f6-4307-aaf0-29e68f67ad62 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] HTTP exception thrown: Instance 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd could not be found. Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e4fe8680-12f6-4307-aaf0-29e68f67ad62 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Request method failure captured: Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd HTTP/1.1 Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iQS1HQLogwe8dbsHDcELBksrzeVG_Rg_-4tnlsiX2fQKj36yqWbFqXhPHKqvCRztqNwQO1JcjKIcSX24xt7JiNZ-T4SYzKPQkkE57Xg3jxzi1YFAXHrIKjbKZjb7FdumjW1FJmLqLpB3MahxAkPs5Cb0dbU9sNrhc8VeGi7DqDMP3Y Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6387896b424840deb9ef97aae02edd99 Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-MigrationsAdminTest-1679492724 Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6387896b424840deb9ef97aae02edd99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6387896b424840deb9ef97aae02edd99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6387896b424840deb9ef97aae02edd99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6387896b424840deb9ef97aae02edd99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-MigrationsAdminTest-1679492724 Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6387896b424840deb9ef97aae02edd99 Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-MigrationsAdminTest-1679492724 Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-MigrationsAdminTest-1679492724-project Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 9269fc4d233c42a590bfcbfaa7f2e895 Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-MigrationsAdminTest-1679492724-project Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd could not be found. Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd'} Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd could not be found. Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd could not be found. Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:29.445025 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:29.451393 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:29.451393 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:29.451393 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:29.451393 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:29.451393 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:29.451393 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd could not be found. Aug 18 11:41:29.451393 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:29.451393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e4fe8680-12f6-4307-aaf0-29e68f67ad62 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Returning 404 to user: Instance 1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:29.451393 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e4fe8680-12f6-4307-aaf0-29e68f67ad62 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd" status: 404 len: 111 microversion: 2.1 time: 0.064614 Aug 18 11:41:29.451393 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1774/3696] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:29 2022] GET /compute/v2.1/servers/1134c999-f0ae-4f3a-a4e2-d3c3763c2cbd => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:29.458529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-799ecb3a-60e4-41e6-b38e-65a5197bd4be tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:29.459240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-799ecb3a-60e4-41e6-b38e-65a5197bd4be tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:29.479912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-799ecb3a-60e4-41e6-b38e-65a5197bd4be tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:29.480424 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-799ecb3a-60e4-41e6-b38e-65a5197bd4be tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:29.480868 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-799ecb3a-60e4-41e6-b38e-65a5197bd4be tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:29.481771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-799ecb3a-60e4-41e6-b38e-65a5197bd4be tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:29.482281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-799ecb3a-60e4-41e6-b38e-65a5197bd4be tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:29.482683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-799ecb3a-60e4-41e6-b38e-65a5197bd4be tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:29.689704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a45013ce-b2c6-438e-9f8c-fc5fb46a6b14 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:29.697915 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a45013ce-b2c6-438e-9f8c-fc5fb46a6b14 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.560458 Aug 18 11:41:29.703417 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1923/3697] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:29 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:29.723187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-625270b1-23d6-45e3-ad0e-6506696c21a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:29.723779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-625270b1-23d6-45e3-ad0e-6506696c21a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:29.748537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-625270b1-23d6-45e3-ad0e-6506696c21a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:29.749099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-625270b1-23d6-45e3-ad0e-6506696c21a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:29.749554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-625270b1-23d6-45e3-ad0e-6506696c21a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:29.750280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-625270b1-23d6-45e3-ad0e-6506696c21a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:29.750803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-625270b1-23d6-45e3-ad0e-6506696c21a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:29.751343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-625270b1-23d6-45e3-ad0e-6506696c21a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:29.808076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-625270b1-23d6-45e3-ad0e-6506696c21a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:41:29.935079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-799ecb3a-60e4-41e6-b38e-65a5197bd4be tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:29.946739 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-799ecb3a-60e4-41e6-b38e-65a5197bd4be tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1316 microversion: 2.1 time: 0.495030 Aug 18 11:41:29.947328 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1775/3698] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:29 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:30.024063 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-625270b1-23d6-45e3-ad0e-6506696c21a8 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 204 len: 0 microversion: 2.1 time: 0.319159 Aug 18 11:41:30.027487 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1924/3699] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:41:29 2022] DELETE /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:41:30.047833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2f3f697c-93d6-406b-98a7-b81b62912df7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:30.048392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2f3f697c-93d6-406b-98a7-b81b62912df7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:30.055880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f3f697c-93d6-406b-98a7-b81b62912df7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:30.056578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f3f697c-93d6-406b-98a7-b81b62912df7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:30.057187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f3f697c-93d6-406b-98a7-b81b62912df7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:30.058905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f3f697c-93d6-406b-98a7-b81b62912df7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:30.062027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f3f697c-93d6-406b-98a7-b81b62912df7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:30.062027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f3f697c-93d6-406b-98a7-b81b62912df7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:30.437624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2f3f697c-93d6-406b-98a7-b81b62912df7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:30.449445 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2f3f697c-93d6-406b-98a7-b81b62912df7 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1469 microversion: 2.1 time: 0.405765 Aug 18 11:41:30.456313 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1776/3700] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:30 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1469 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:30.725606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ee99ee29-b1a0-4698-9f1b-a16e5029f0fe tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:30.727322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ee99ee29-b1a0-4698-9f1b-a16e5029f0fe tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:30.744083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee99ee29-b1a0-4698-9f1b-a16e5029f0fe tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:30.744735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee99ee29-b1a0-4698-9f1b-a16e5029f0fe tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:30.745417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee99ee29-b1a0-4698-9f1b-a16e5029f0fe tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:30.747043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee99ee29-b1a0-4698-9f1b-a16e5029f0fe tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:30.750670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee99ee29-b1a0-4698-9f1b-a16e5029f0fe tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:30.751482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee99ee29-b1a0-4698-9f1b-a16e5029f0fe tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:31.107451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1719042440", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "70bfbc57-7b9b-4a20-aca4-e83d6df7a237"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:31.185744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ee99ee29-b1a0-4698-9f1b-a16e5029f0fe tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:31.194049 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ee99ee29-b1a0-4698-9f1b-a16e5029f0fe tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.473392 Aug 18 11:41:31.195174 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1925/3701] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:30 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:31.200738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d26168a9-9e72-4500-8b35-ab2f66e66231 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:31.203276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d26168a9-9e72-4500-8b35-ab2f66e66231 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:31.213326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d26168a9-9e72-4500-8b35-ab2f66e66231 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:31.214239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d26168a9-9e72-4500-8b35-ab2f66e66231 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:31.214901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d26168a9-9e72-4500-8b35-ab2f66e66231 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:31.215999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d26168a9-9e72-4500-8b35-ab2f66e66231 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:31.216659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d26168a9-9e72-4500-8b35-ab2f66e66231 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:31.217326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d26168a9-9e72-4500-8b35-ab2f66e66231 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:31.219566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] validate_networks() for [('70bfbc57-7b9b-4a20-aca4-e83d6df7a237', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:41:31.491552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d26168a9-9e72-4500-8b35-ab2f66e66231 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:31.509702 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d26168a9-9e72-4500-8b35-ab2f66e66231 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1316 microversion: 2.1 time: 0.309041 Aug 18 11:41:31.510985 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1926/3702] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:31 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:31.523890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a9d7a482-e429-4c4a-b893-532aede68869 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:31.535815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a9d7a482-e429-4c4a-b893-532aede68869 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:31.557416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9d7a482-e429-4c4a-b893-532aede68869 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:31.559106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9d7a482-e429-4c4a-b893-532aede68869 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:31.561338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9d7a482-e429-4c4a-b893-532aede68869 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:31.568679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9d7a482-e429-4c4a-b893-532aede68869 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:31.571742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9d7a482-e429-4c4a-b893-532aede68869 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:31.573254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9d7a482-e429-4c4a-b893-532aede68869 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:32.018271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a9d7a482-e429-4c4a-b893-532aede68869 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:32.036469 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a9d7a482-e429-4c4a-b893-532aede68869 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1469 microversion: 2.1 time: 0.522162 Aug 18 11:41:32.038351 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1927/3703] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:31 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1469 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:32.128434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-b8e60492-ae56-44a6-997c-8cffe3e8d612 req-12471c63-47d3-43ba-bd27-044db602c251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8347e97a-e013-461c-b858-2fc8c6a505d5", "name": "network-vif-plugged", "status": "completed", "tag": "b0ee35ef-ab7e-4ce7-a28a-562b36cc60d5"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:32.171620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b8e60492-ae56-44a6-997c-8cffe3e8d612 req-12471c63-47d3-43ba-bd27-044db602c251 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:32.173657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b8e60492-ae56-44a6-997c-8cffe3e8d612 req-12471c63-47d3-43ba-bd27-044db602c251 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:32.176535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b8e60492-ae56-44a6-997c-8cffe3e8d612 req-12471c63-47d3-43ba-bd27-044db602c251 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:32.252541 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-b8e60492-ae56-44a6-997c-8cffe3e8d612 req-12471c63-47d3-43ba-bd27-044db602c251 service nova] Creating event network-vif-plugged:b0ee35ef-ab7e-4ce7-a28a-562b36cc60d5 for instance 8347e97a-e013-461c-b858-2fc8c6a505d5 on n-h2-853611-3 Aug 18 11:41:32.276128 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-b8e60492-ae56-44a6-997c-8cffe3e8d612 req-12471c63-47d3-43ba-bd27-044db602c251 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153181 Aug 18 11:41:32.276755 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1928/3704] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:32.295969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-412c3bc0-f89b-4572-ae51-d4a2b82820cf tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:32.303008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-412c3bc0-f89b-4572-ae51-d4a2b82820cf tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:32.318465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-412c3bc0-f89b-4572-ae51-d4a2b82820cf tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:32.321607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-412c3bc0-f89b-4572-ae51-d4a2b82820cf tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:32.324358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-412c3bc0-f89b-4572-ae51-d4a2b82820cf tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:32.326455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-412c3bc0-f89b-4572-ae51-d4a2b82820cf tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:32.327596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-412c3bc0-f89b-4572-ae51-d4a2b82820cf tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:32.329981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-412c3bc0-f89b-4572-ae51-d4a2b82820cf tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:32.863756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-412c3bc0-f89b-4572-ae51-d4a2b82820cf tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:32.878470 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-412c3bc0-f89b-4572-ae51-d4a2b82820cf tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.599772 Aug 18 11:41:32.880249 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1929/3705] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:32 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:32.888876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-60c4bad8-b7a4-48c2-bf09-2e3f7dc9d0d3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:32.889848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-60c4bad8-b7a4-48c2-bf09-2e3f7dc9d0d3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:32.900242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:32.904581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60c4bad8-b7a4-48c2-bf09-2e3f7dc9d0d3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:32.905478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60c4bad8-b7a4-48c2-bf09-2e3f7dc9d0d3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:32.906311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60c4bad8-b7a4-48c2-bf09-2e3f7dc9d0d3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:32.907369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60c4bad8-b7a4-48c2-bf09-2e3f7dc9d0d3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:32.908176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60c4bad8-b7a4-48c2-bf09-2e3f7dc9d0d3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:32.909459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60c4bad8-b7a4-48c2-bf09-2e3f7dc9d0d3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:32.936590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:32.958748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-60c4bad8-b7a4-48c2-bf09-2e3f7dc9d0d3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:41:33.141174 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-60c4bad8-b7a4-48c2-bf09-2e3f7dc9d0d3 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "DELETE /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 204 len: 0 microversion: 2.1 time: 0.259117 Aug 18 11:41:33.146673 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1930/3706] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:41:32 2022] DELETE /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:41:33.160985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-20179d0e-0126-4d44-b3fc-a6dc53f74338 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:33.162287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-20179d0e-0126-4d44-b3fc-a6dc53f74338 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:33.174460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20179d0e-0126-4d44-b3fc-a6dc53f74338 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:33.176730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20179d0e-0126-4d44-b3fc-a6dc53f74338 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:33.177550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20179d0e-0126-4d44-b3fc-a6dc53f74338 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:33.178700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20179d0e-0126-4d44-b3fc-a6dc53f74338 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:33.179729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20179d0e-0126-4d44-b3fc-a6dc53f74338 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:33.180798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20179d0e-0126-4d44-b3fc-a6dc53f74338 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:33.267550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:41:33.270964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:41:33.272682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:41:33.275841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:41:33.276742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:41:33.294807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:33.296098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:33.299079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:33.301558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:33.304715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:33.305580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:33.354641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Getting quotas for project defa9f3b14794929ab7b6d17a58f9c2a. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:41:33.364319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Getting quotas for user 058cb2c1f27d49c98efc70f28a66261b and project defa9f3b14794929ab7b6d17a58f9c2a. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:41:33.382377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:41:33.385316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:41:33.465910 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-25869aea-5b57-4ec5-ad33-1d5657616f20 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.643027 Aug 18 11:41:33.467265 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1777/3707] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:41:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2645 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 11:41:33.474159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cffd463b-4172-4820-83e3-50f30f28e9a2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:33.475359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cffd463b-4172-4820-83e3-50f30f28e9a2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:33.483787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cffd463b-4172-4820-83e3-50f30f28e9a2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:33.484696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cffd463b-4172-4820-83e3-50f30f28e9a2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:33.485502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cffd463b-4172-4820-83e3-50f30f28e9a2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:33.486530 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cffd463b-4172-4820-83e3-50f30f28e9a2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:33.487632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cffd463b-4172-4820-83e3-50f30f28e9a2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:33.488252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cffd463b-4172-4820-83e3-50f30f28e9a2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:33.542951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-20179d0e-0126-4d44-b3fc-a6dc53f74338 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:33.567715 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-20179d0e-0126-4d44-b3fc-a6dc53f74338 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1316 microversion: 2.1 time: 0.417207 Aug 18 11:41:33.569997 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1931/3708] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:33 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:33.579532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-41041f5b-e244-44a0-bf2b-5e0e2a105827 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:33.581728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-41041f5b-e244-44a0-bf2b-5e0e2a105827 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:33.591140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cffd463b-4172-4820-83e3-50f30f28e9a2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:33.593738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41041f5b-e244-44a0-bf2b-5e0e2a105827 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:33.595683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41041f5b-e244-44a0-bf2b-5e0e2a105827 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:33.597344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41041f5b-e244-44a0-bf2b-5e0e2a105827 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:33.599500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41041f5b-e244-44a0-bf2b-5e0e2a105827 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:33.600403 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cffd463b-4172-4820-83e3-50f30f28e9a2 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1427 microversion: 2.1 time: 0.131466 Aug 18 11:41:33.600735 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1778/3709] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:33 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:33.601861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41041f5b-e244-44a0-bf2b-5e0e2a105827 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:33.602986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41041f5b-e244-44a0-bf2b-5e0e2a105827 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:33.616546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-9ed835da-3d14-41aa-9dd7-c641863e122e req-57d0e72d-87af-4399-adc1-5ac857106058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a776f65-9e1f-42e1-93d9-68500a17e6c2", "name": "network-vif-deleted", "tag": "d808536d-6bce-46ed-a111-e4d891c6dd78"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:33.655135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9ed835da-3d14-41aa-9dd7-c641863e122e req-57d0e72d-87af-4399-adc1-5ac857106058 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:33.655879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9ed835da-3d14-41aa-9dd7-c641863e122e req-57d0e72d-87af-4399-adc1-5ac857106058 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:33.656406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9ed835da-3d14-41aa-9dd7-c641863e122e req-57d0e72d-87af-4399-adc1-5ac857106058 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:33.686768 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-9ed835da-3d14-41aa-9dd7-c641863e122e req-57d0e72d-87af-4399-adc1-5ac857106058 service nova] Creating event network-vif-deleted:d808536d-6bce-46ed-a111-e4d891c6dd78 for instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 on n-h1-853611-3 Aug 18 11:41:33.695395 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-9ed835da-3d14-41aa-9dd7-c641863e122e req-57d0e72d-87af-4399-adc1-5ac857106058 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089317 Aug 18 11:41:33.696378 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1779/3710] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:33.712560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-71830f7f-f5ee-425d-82c7-a1d0efda95f6 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:33.713272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-71830f7f-f5ee-425d-82c7-a1d0efda95f6 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:33.871822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-71830f7f-f5ee-425d-82c7-a1d0efda95f6 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:33.886668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-71830f7f-f5ee-425d-82c7-a1d0efda95f6 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:33.890593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-71830f7f-f5ee-425d-82c7-a1d0efda95f6 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:33.891789 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-71830f7f-f5ee-425d-82c7-a1d0efda95f6 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1259 microversion: 2.21 time: 0.194084 Aug 18 11:41:33.895536 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1780/3711] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:33 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:33.928494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9efcbf2c-e244-4e86-a9ce-50e2b01ad091 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:33.929017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9efcbf2c-e244-4e86-a9ce-50e2b01ad091 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:33.989621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9efcbf2c-e244-4e86-a9ce-50e2b01ad091 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:33.996233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9efcbf2c-e244-4e86-a9ce-50e2b01ad091 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:33.999197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9efcbf2c-e244-4e86-a9ce-50e2b01ad091 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:34.003613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9efcbf2c-e244-4e86-a9ce-50e2b01ad091 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:34.004486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9efcbf2c-e244-4e86-a9ce-50e2b01ad091 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:34.009077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9efcbf2c-e244-4e86-a9ce-50e2b01ad091 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:34.081626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-41041f5b-e244-44a0-bf2b-5e0e2a105827 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:34.095955 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-41041f5b-e244-44a0-bf2b-5e0e2a105827 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1508 microversion: 2.1 time: 0.521497 Aug 18 11:41:34.098776 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1932/3712] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:33 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1508 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:34.327995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9efcbf2c-e244-4e86-a9ce-50e2b01ad091 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:34.340133 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9efcbf2c-e244-4e86-a9ce-50e2b01ad091 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.426819 Aug 18 11:41:34.340723 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1781/3713] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:33 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:34.516365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-20683383", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": "none"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:34.590170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-87061390-67f7-40fb-a946-86e360c86a5e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:34.592218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-87061390-67f7-40fb-a946-86e360c86a5e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:34.608205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87061390-67f7-40fb-a946-86e360c86a5e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:34.608859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87061390-67f7-40fb-a946-86e360c86a5e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:34.611909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:41:34.612688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87061390-67f7-40fb-a946-86e360c86a5e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:34.613647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87061390-67f7-40fb-a946-86e360c86a5e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:34.614203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87061390-67f7-40fb-a946-86e360c86a5e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:34.614742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87061390-67f7-40fb-a946-86e360c86a5e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:34.621633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:41:34.622289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:41:34.623043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:41:34.623616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:41:34.647274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:34.648009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:34.648562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:34.649592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:34.652151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:34.653097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:34.720423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Getting quotas for project c78700431c154251840020bc606c7bf0. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:41:34.739589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Getting quotas for user 804763c6a7b84485b80da978df2df05b and project c78700431c154251840020bc606c7bf0. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:41:34.762107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:41:34.766186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:41:34.850870 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c0b50aac-519a-48ec-b787-4ffadc81fd2f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.527312 Aug 18 11:41:34.852541 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1933/3714] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:41:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 11:41:34.863842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f0e5154-dbde-4229-be26-256242fda39c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:34.865003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6f0e5154-dbde-4229-be26-256242fda39c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:34.880942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f0e5154-dbde-4229-be26-256242fda39c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:34.881990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f0e5154-dbde-4229-be26-256242fda39c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:34.882808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f0e5154-dbde-4229-be26-256242fda39c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:34.884088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f0e5154-dbde-4229-be26-256242fda39c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:34.884999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f0e5154-dbde-4229-be26-256242fda39c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:34.885784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f0e5154-dbde-4229-be26-256242fda39c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:34.908515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-87061390-67f7-40fb-a946-86e360c86a5e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:34.923815 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-87061390-67f7-40fb-a946-86e360c86a5e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1505 microversion: 2.1 time: 0.337852 Aug 18 11:41:34.925380 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1782/3715] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:34 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:34.947073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-80146019-1d8d-427d-9796-13a628d15600 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:34.948848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-80146019-1d8d-427d-9796-13a628d15600 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:35.042448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6f0e5154-dbde-4229-be26-256242fda39c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9269fc4d233c42a590bfcbfaa7f2e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6387896b424840deb9ef97aae02edd99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:35.058039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-80146019-1d8d-427d-9796-13a628d15600 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:35.071032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-80146019-1d8d-427d-9796-13a628d15600 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:35.073423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-80146019-1d8d-427d-9796-13a628d15600 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:35.075935 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-80146019-1d8d-427d-9796-13a628d15600 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1276 microversion: 2.57 time: 0.148847 Aug 18 11:41:35.077296 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1783/3716] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:34 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:35.083391 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6f0e5154-dbde-4229-be26-256242fda39c tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 200 len: 1427 microversion: 2.1 time: 0.228791 Aug 18 11:41:35.084561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a8c387e-c48e-4dfc-8fa9-74c406205329 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:35.084694 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1934/3717] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:34 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 1427 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:35.100951 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0a8c387e-c48e-4dfc-8fa9-74c406205329 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:35.101853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fec46b71-4022-447e-af50-929b67d4f66a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1938972680"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:35.103202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fec46b71-4022-447e-af50-929b67d4f66a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:35.110313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a8c387e-c48e-4dfc-8fa9-74c406205329 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:35.111134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a8c387e-c48e-4dfc-8fa9-74c406205329 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:35.111815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a8c387e-c48e-4dfc-8fa9-74c406205329 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:35.113739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a8c387e-c48e-4dfc-8fa9-74c406205329 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:35.114534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a8c387e-c48e-4dfc-8fa9-74c406205329 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:35.115265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a8c387e-c48e-4dfc-8fa9-74c406205329 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:35.123126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fec46b71-4022-447e-af50-929b67d4f66a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:35.124151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fec46b71-4022-447e-af50-929b67d4f66a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:35.124971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fec46b71-4022-447e-af50-929b67d4f66a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:35.126419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fec46b71-4022-447e-af50-929b67d4f66a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:35.126675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:35.128887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fec46b71-4022-447e-af50-929b67d4f66a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:35.133927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fec46b71-4022-447e-af50-929b67d4f66a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:35.211471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0a8c387e-c48e-4dfc-8fa9-74c406205329 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:35.220977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0a8c387e-c48e-4dfc-8fa9-74c406205329 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:35.223597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0a8c387e-c48e-4dfc-8fa9-74c406205329 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:35.224875 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0a8c387e-c48e-4dfc-8fa9-74c406205329 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1311 microversion: 2.21 time: 0.146358 Aug 18 11:41:35.225900 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1784/3718] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:35 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1311 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:35.497555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-90466d80-ceeb-468f-acda-7cb14505401b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:35.501392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-90466d80-ceeb-468f-acda-7cb14505401b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:35.539199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90466d80-ceeb-468f-acda-7cb14505401b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:35.542998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90466d80-ceeb-468f-acda-7cb14505401b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:35.548063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90466d80-ceeb-468f-acda-7cb14505401b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:35.551776 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90466d80-ceeb-468f-acda-7cb14505401b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:35.553310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90466d80-ceeb-468f-acda-7cb14505401b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:35.554815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90466d80-ceeb-468f-acda-7cb14505401b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:35.603382 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.network.security_group_api [None req-fec46b71-4022-447e-af50-929b67d4f66a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Adding security group 56d4c72d-132e-478a-b348-34b89ce085cc to port b0ee35ef-ab7e-4ce7-a28a-562b36cc60d5 Aug 18 11:41:36.021274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-90466d80-ceeb-468f-acda-7cb14505401b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:36.035582 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-90466d80-ceeb-468f-acda-7cb14505401b tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1508 microversion: 2.1 time: 0.807668 Aug 18 11:41:36.036933 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1785/3719] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:35 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1508 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:36.068630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eba24c1b-45f0-42a1-b669-1b1e1949a676 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:36.069726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-eba24c1b-45f0-42a1-b669-1b1e1949a676 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:36.076901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eba24c1b-45f0-42a1-b669-1b1e1949a676 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:36.077746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eba24c1b-45f0-42a1-b669-1b1e1949a676 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:36.078423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eba24c1b-45f0-42a1-b669-1b1e1949a676 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:36.084515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eba24c1b-45f0-42a1-b669-1b1e1949a676 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:36.085520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eba24c1b-45f0-42a1-b669-1b1e1949a676 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:36.086647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eba24c1b-45f0-42a1-b669-1b1e1949a676 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:36.330379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eba24c1b-45f0-42a1-b669-1b1e1949a676 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:36.345668 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eba24c1b-45f0-42a1-b669-1b1e1949a676 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.307008 Aug 18 11:41:36.347211 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1786/3720] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:36 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:36.357306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2cdc3b03-9f62-4809-91e0-86063acf28af tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:36.358879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2cdc3b03-9f62-4809-91e0-86063acf28af tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:36.370678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cdc3b03-9f62-4809-91e0-86063acf28af tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:36.371265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cdc3b03-9f62-4809-91e0-86063acf28af tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:36.371854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cdc3b03-9f62-4809-91e0-86063acf28af tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:36.374167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cdc3b03-9f62-4809-91e0-86063acf28af tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:36.374910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cdc3b03-9f62-4809-91e0-86063acf28af tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:36.375369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cdc3b03-9f62-4809-91e0-86063acf28af tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:36.451267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2cdc3b03-9f62-4809-91e0-86063acf28af tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:36.460413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2cdc3b03-9f62-4809-91e0-86063acf28af tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:36.462073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2cdc3b03-9f62-4809-91e0-86063acf28af tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:36.463271 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2cdc3b03-9f62-4809-91e0-86063acf28af tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1280 microversion: 2.57 time: 0.114292 Aug 18 11:41:36.478095 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1787/3721] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:36 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1280 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:36.486018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7359a6cf-1f06-4213-9c2e-ba81901d9d73 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:36.486698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7359a6cf-1f06-4213-9c2e-ba81901d9d73 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] [instance: 1a776f65-9e1f-42e1-93d9-68500a17e6c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:36.494684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7359a6cf-1f06-4213-9c2e-ba81901d9d73 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:36.495190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7359a6cf-1f06-4213-9c2e-ba81901d9d73 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:36.495641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7359a6cf-1f06-4213-9c2e-ba81901d9d73 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:36.496364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7359a6cf-1f06-4213-9c2e-ba81901d9d73 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:36.496836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7359a6cf-1f06-4213-9c2e-ba81901d9d73 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:36.497312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7359a6cf-1f06-4213-9c2e-ba81901d9d73 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:36.513717 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-7359a6cf-1f06-4213-9c2e-ba81901d9d73 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] HTTP exception thrown: Instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 could not be found. Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7359a6cf-1f06-4213-9c2e-ba81901d9d73 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Request method failure captured: Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 HTTP/1.1 Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iQS1HQLogwe8dbsHDcELBksrzeVG_Rg_-4tnlsiX2fQKj36yqWbFqXhPHKqvCRztqNwQO1JcjKIcSX24xt7JiNZ-T4SYzKPQkkE57Xg3jxzi1YFAXHrIKjbKZjb7FdumjW1FJmLqLpB3MahxAkPs5Cb0dbU9sNrhc8VeGi7DqDMP3Y Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6387896b424840deb9ef97aae02edd99 Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-MigrationsAdminTest-1679492724 Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6387896b424840deb9ef97aae02edd99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6387896b424840deb9ef97aae02edd99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6387896b424840deb9ef97aae02edd99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6387896b424840deb9ef97aae02edd99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-MigrationsAdminTest-1679492724 Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6387896b424840deb9ef97aae02edd99 Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-MigrationsAdminTest-1679492724 Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-MigrationsAdminTest-1679492724-project Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 9269fc4d233c42a590bfcbfaa7f2e895 Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-MigrationsAdminTest-1679492724-project Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 could not be found. Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '1a776f65-9e1f-42e1-93d9-68500a17e6c2'} Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 could not be found. Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 could not be found. Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:36.515644 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:36.523831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:36.523831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:36.523831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:36.523831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:36.523831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:36.523831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 could not be found. Aug 18 11:41:36.523831 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:36.523831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7359a6cf-1f06-4213-9c2e-ba81901d9d73 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] Returning 404 to user: Instance 1a776f65-9e1f-42e1-93d9-68500a17e6c2 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:36.523831 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7359a6cf-1f06-4213-9c2e-ba81901d9d73 tempest-MigrationsAdminTest-1679492724 tempest-MigrationsAdminTest-1679492724-project] 10.222.0.73 "GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2" status: 404 len: 111 microversion: 2.1 time: 0.037710 Aug 18 11:41:36.523831 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1788/3722] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:36 2022] GET /compute/v2.1/servers/1a776f65-9e1f-42e1-93d9-68500a17e6c2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:36.528456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2bd319bd-e074-4bc2-969c-2f4a97f8dfee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:36.529154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2bd319bd-e074-4bc2-969c-2f4a97f8dfee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:36.538897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2bd319bd-e074-4bc2-969c-2f4a97f8dfee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:36.539475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2bd319bd-e074-4bc2-969c-2f4a97f8dfee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:36.540156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2bd319bd-e074-4bc2-969c-2f4a97f8dfee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:36.541184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2bd319bd-e074-4bc2-969c-2f4a97f8dfee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:36.541731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2bd319bd-e074-4bc2-969c-2f4a97f8dfee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:36.542504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2bd319bd-e074-4bc2-969c-2f4a97f8dfee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:36.669631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2bd319bd-e074-4bc2-969c-2f4a97f8dfee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:36.685965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2bd319bd-e074-4bc2-969c-2f4a97f8dfee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:36.688139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2bd319bd-e074-4bc2-969c-2f4a97f8dfee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:36.689540 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2bd319bd-e074-4bc2-969c-2f4a97f8dfee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1317 microversion: 2.21 time: 0.169726 Aug 18 11:41:36.691766 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1789/3723] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:36 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:36.801134 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fec46b71-4022-447e-af50-929b67d4f66a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5/action" status: 202 len: 0 microversion: 2.1 time: 1.710880 Aug 18 11:41:36.805378 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1935/3724] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:41:35 2022] POST /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5/action => generated 0 bytes in 1720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:41:36.814616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4f2848c1-8101-4504-8ad2-3558736fcc62 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519f62da60>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:36.841884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-3d66cd10-3ede-4073-a6d3-1d2e330334b6 req-059d8183-e64f-40d5-a7f4-0582d1b3ada7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8347e97a-e013-461c-b858-2fc8c6a505d5", "tag": "b0ee35ef-ab7e-4ce7-a28a-562b36cc60d5"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:36.901351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3d66cd10-3ede-4073-a6d3-1d2e330334b6 req-059d8183-e64f-40d5-a7f4-0582d1b3ada7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:36.901772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3d66cd10-3ede-4073-a6d3-1d2e330334b6 req-059d8183-e64f-40d5-a7f4-0582d1b3ada7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:36.902213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3d66cd10-3ede-4073-a6d3-1d2e330334b6 req-059d8183-e64f-40d5-a7f4-0582d1b3ada7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:36.923684 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-3d66cd10-3ede-4073-a6d3-1d2e330334b6 req-059d8183-e64f-40d5-a7f4-0582d1b3ada7 service nova] Creating event network-changed:b0ee35ef-ab7e-4ce7-a28a-562b36cc60d5 for instance 8347e97a-e013-461c-b858-2fc8c6a505d5 on n-h2-853611-3 Aug 18 11:41:36.937809 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-3d66cd10-3ede-4073-a6d3-1d2e330334b6 req-059d8183-e64f-40d5-a7f4-0582d1b3ada7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109223 Aug 18 11:41:36.938799 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1936/3725] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:37.059074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f18c7698-e964-4971-952d-0bbfb00d4a7a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:37.059857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f18c7698-e964-4971-952d-0bbfb00d4a7a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:37.076628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f18c7698-e964-4971-952d-0bbfb00d4a7a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:37.077132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f18c7698-e964-4971-952d-0bbfb00d4a7a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:37.077588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f18c7698-e964-4971-952d-0bbfb00d4a7a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:37.078333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f18c7698-e964-4971-952d-0bbfb00d4a7a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:37.078826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f18c7698-e964-4971-952d-0bbfb00d4a7a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:37.085356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f18c7698-e964-4971-952d-0bbfb00d4a7a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:37.491519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG neutronclient.v2_0.client [None req-4f2848c1-8101-4504-8ad2-3558736fcc62 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 56d4c72d-132e-478a-b348-34b89ce085cc in use.", "detail": ""}} {{(pid=122209) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:41:37.492164 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-4f2848c1-8101-4504-8ad2-3558736fcc62 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Security Group 56d4c72d-132e-478a-b348-34b89ce085cc in use. Aug 18 11:41:37.492164 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-ac79645f-03d4-45f0-9871-cbb7143c3aa0'] Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4f2848c1-8101-4504-8ad2-3558736fcc62 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-security-groups/56d4c72d-132e-478a-b348-34b89ce085cc HTTP/1.1 Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: exception: Security Group 56d4c72d-132e-478a-b348-34b89ce085cc in use. Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-ac79645f-03d4-45f0-9871-cbb7143c3aa0'] Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '56d4c72d-132e-478a-b348-34b89ce085cc'} Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:41:37.494028 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 56d4c72d-132e-478a-b348-34b89ce085cc in use. Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac79645f-03d4-45f0-9871-cbb7143c3aa0'] Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 56d4c72d-132e-478a-b348-34b89ce085cc in use. Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac79645f-03d4-45f0-9871-cbb7143c3aa0'] Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 56d4c72d-132e-478a-b348-34b89ce085cc in use. Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac79645f-03d4-45f0-9871-cbb7143c3aa0'] Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 56d4c72d-132e-478a-b348-34b89ce085cc in use. Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac79645f-03d4-45f0-9871-cbb7143c3aa0'] Aug 18 11:41:37.498491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:37.509160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4f2848c1-8101-4504-8ad2-3558736fcc62 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 400 to user: Security Group 56d4c72d-132e-478a-b348-34b89ce085cc in use. Aug 18 11:41:37.509160 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-ac79645f-03d4-45f0-9871-cbb7143c3aa0'] {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:37.509160 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4f2848c1-8101-4504-8ad2-3558736fcc62 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/56d4c72d-132e-478a-b348-34b89ce085cc" status: 400 len: 185 microversion: 2.1 time: 0.695252 Aug 18 11:41:37.509160 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1790/3726] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:36 2022] DELETE /compute/v2.1/os-security-groups/56d4c72d-132e-478a-b348-34b89ce085cc => generated 185 bytes in 697 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:41:37.519506 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2d0a4293-9078-410a-81a3-79b69232a1e9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:37.527467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2d0a4293-9078-410a-81a3-79b69232a1e9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:37.540307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d0a4293-9078-410a-81a3-79b69232a1e9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:37.540825 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d0a4293-9078-410a-81a3-79b69232a1e9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:37.541325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d0a4293-9078-410a-81a3-79b69232a1e9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:37.546548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d0a4293-9078-410a-81a3-79b69232a1e9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:37.547255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d0a4293-9078-410a-81a3-79b69232a1e9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:37.547753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d0a4293-9078-410a-81a3-79b69232a1e9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:37.673233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f18c7698-e964-4971-952d-0bbfb00d4a7a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:37.698700 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f18c7698-e964-4971-952d-0bbfb00d4a7a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1508 microversion: 2.1 time: 0.644035 Aug 18 11:41:37.703276 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1937/3727] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:37 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:37.726284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-68402e0b-83a1-448b-9235-d086dd338265 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:37.727784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-68402e0b-83a1-448b-9235-d086dd338265 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:37.744020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68402e0b-83a1-448b-9235-d086dd338265 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:37.745295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68402e0b-83a1-448b-9235-d086dd338265 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:37.746417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68402e0b-83a1-448b-9235-d086dd338265 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:37.748022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68402e0b-83a1-448b-9235-d086dd338265 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:37.749127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68402e0b-83a1-448b-9235-d086dd338265 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:37.756730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68402e0b-83a1-448b-9235-d086dd338265 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:37.902760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2d0a4293-9078-410a-81a3-79b69232a1e9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:37.930196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-68402e0b-83a1-448b-9235-d086dd338265 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:37.936993 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2d0a4293-9078-410a-81a3-79b69232a1e9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1505 microversion: 2.1 time: 0.409292 Aug 18 11:41:37.962601 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1791/3728] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:37 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:37.980376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1c050dfc-2917-42c2-994b-199026a97e48 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:37.984933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-68402e0b-83a1-448b-9235-d086dd338265 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:37.987554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1c050dfc-2917-42c2-994b-199026a97e48 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:37.993447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-68402e0b-83a1-448b-9235-d086dd338265 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:37.995320 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-68402e0b-83a1-448b-9235-d086dd338265 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1334 microversion: 2.57 time: 0.290086 Aug 18 11:41:38.006827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1c050dfc-2917-42c2-994b-199026a97e48 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:38.007596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1c050dfc-2917-42c2-994b-199026a97e48 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:38.009270 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1938/3729] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:37 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1334 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:38.012807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1c050dfc-2917-42c2-994b-199026a97e48 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:38.014135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1c050dfc-2917-42c2-994b-199026a97e48 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:38.014819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1c050dfc-2917-42c2-994b-199026a97e48 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:38.015424 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1c050dfc-2917-42c2-994b-199026a97e48 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:38.019135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cef1ef5a-5681-492a-8b45-4310337f9239 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:38.021994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cef1ef5a-5681-492a-8b45-4310337f9239 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:38.032131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cef1ef5a-5681-492a-8b45-4310337f9239 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:38.032812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cef1ef5a-5681-492a-8b45-4310337f9239 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:38.033387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cef1ef5a-5681-492a-8b45-4310337f9239 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:38.035283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cef1ef5a-5681-492a-8b45-4310337f9239 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:38.037452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cef1ef5a-5681-492a-8b45-4310337f9239 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:38.039514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cef1ef5a-5681-492a-8b45-4310337f9239 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:38.290822 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1c050dfc-2917-42c2-994b-199026a97e48 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5/action" status: 202 len: 0 microversion: 2.1 time: 0.325201 Aug 18 11:41:38.297595 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1792/3730] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:41:37 2022] POST /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:41:38.311207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-e1297236-432d-4cbd-aae5-649a80517aae req-9d00edc9-26f2-4eb5-8440-b160644e74b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c13227-b6f4-49d7-b40b-2ec356ca3f92", "name": "network-vif-deleted", "tag": "630a62a3-889b-4229-8783-b230eb367435"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:38.339984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e1297236-432d-4cbd-aae5-649a80517aae req-9d00edc9-26f2-4eb5-8440-b160644e74b8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:38.343215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e1297236-432d-4cbd-aae5-649a80517aae req-9d00edc9-26f2-4eb5-8440-b160644e74b8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:38.347175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e1297236-432d-4cbd-aae5-649a80517aae req-9d00edc9-26f2-4eb5-8440-b160644e74b8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:38.396402 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-e1297236-432d-4cbd-aae5-649a80517aae req-9d00edc9-26f2-4eb5-8440-b160644e74b8 service nova] Creating event network-vif-deleted:630a62a3-889b-4229-8783-b230eb367435 for instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 on n-h1-853611-3 Aug 18 11:41:38.405854 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-e1297236-432d-4cbd-aae5-649a80517aae req-9d00edc9-26f2-4eb5-8440-b160644e74b8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105227 Aug 18 11:41:38.407691 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1793/3731] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:38.418421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5a700280-7361-4761-89fa-5c5a13ca9fac tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:38.420387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5a700280-7361-4761-89fa-5c5a13ca9fac tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:38.432653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cef1ef5a-5681-492a-8b45-4310337f9239 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:38.434494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a700280-7361-4761-89fa-5c5a13ca9fac tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:38.435659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a700280-7361-4761-89fa-5c5a13ca9fac tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:38.436704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a700280-7361-4761-89fa-5c5a13ca9fac tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:38.438127 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a700280-7361-4761-89fa-5c5a13ca9fac tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:38.439418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a700280-7361-4761-89fa-5c5a13ca9fac tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:38.441932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a700280-7361-4761-89fa-5c5a13ca9fac tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:38.456919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cef1ef5a-5681-492a-8b45-4310337f9239 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:38.465533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cef1ef5a-5681-492a-8b45-4310337f9239 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:38.486329 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cef1ef5a-5681-492a-8b45-4310337f9239 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1359 microversion: 2.21 time: 0.473679 Aug 18 11:41:38.491230 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1939/3732] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:38 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1359 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:38.746484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a23eaa83-9779-4ecb-beae-cb17b5aa35b7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:38.747424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a23eaa83-9779-4ecb-beae-cb17b5aa35b7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:38.772342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a23eaa83-9779-4ecb-beae-cb17b5aa35b7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:38.773409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a23eaa83-9779-4ecb-beae-cb17b5aa35b7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:38.778922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a23eaa83-9779-4ecb-beae-cb17b5aa35b7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:38.782477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a23eaa83-9779-4ecb-beae-cb17b5aa35b7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:38.785441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a23eaa83-9779-4ecb-beae-cb17b5aa35b7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:38.787058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a23eaa83-9779-4ecb-beae-cb17b5aa35b7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:38.881594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a23eaa83-9779-4ecb-beae-cb17b5aa35b7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:38.882116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a23eaa83-9779-4ecb-beae-cb17b5aa35b7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:38.882599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a23eaa83-9779-4ecb-beae-cb17b5aa35b7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:38.885237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-a23eaa83-9779-4ecb-beae-cb17b5aa35b7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lazy-loading 'fault' on Instance uuid 77c13227-b6f4-49d7-b40b-2ec356ca3f92 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:41:38.957192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5a700280-7361-4761-89fa-5c5a13ca9fac tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:38.975527 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5a700280-7361-4761-89fa-5c5a13ca9fac tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1576 microversion: 2.1 time: 0.564823 Aug 18 11:41:38.976800 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1794/3733] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:38 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1576 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:38.987344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a23eaa83-9779-4ecb-beae-cb17b5aa35b7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:38.991847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b135b4ed-b6ff-4e6c-8cf1-4a8dbab52c01 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:38.992496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b135b4ed-b6ff-4e6c-8cf1-4a8dbab52c01 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:39.008984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b135b4ed-b6ff-4e6c-8cf1-4a8dbab52c01 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:39.009788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b135b4ed-b6ff-4e6c-8cf1-4a8dbab52c01 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:39.010422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b135b4ed-b6ff-4e6c-8cf1-4a8dbab52c01 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:39.011467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b135b4ed-b6ff-4e6c-8cf1-4a8dbab52c01 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:39.012287 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b135b4ed-b6ff-4e6c-8cf1-4a8dbab52c01 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:39.013038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b135b4ed-b6ff-4e6c-8cf1-4a8dbab52c01 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:39.022881 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a23eaa83-9779-4ecb-beae-cb17b5aa35b7 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 200 len: 1312 microversion: 2.1 time: 0.281374 Aug 18 11:41:39.024029 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1940/3734] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:38 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 1312 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:39.046031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b73b9b39-4461-4cb3-9378-e2c17e61f3e1 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:39.047439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b73b9b39-4461-4cb3-9378-e2c17e61f3e1 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:39.056411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b73b9b39-4461-4cb3-9378-e2c17e61f3e1 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:39.056926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b73b9b39-4461-4cb3-9378-e2c17e61f3e1 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:39.057374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b73b9b39-4461-4cb3-9378-e2c17e61f3e1 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:39.058110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b73b9b39-4461-4cb3-9378-e2c17e61f3e1 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:39.058610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b73b9b39-4461-4cb3-9378-e2c17e61f3e1 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:39.059049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b73b9b39-4461-4cb3-9378-e2c17e61f3e1 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:39.183614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b73b9b39-4461-4cb3-9378-e2c17e61f3e1 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:39.205129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b73b9b39-4461-4cb3-9378-e2c17e61f3e1 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:39.211672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b73b9b39-4461-4cb3-9378-e2c17e61f3e1 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:39.213888 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b73b9b39-4461-4cb3-9378-e2c17e61f3e1 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1334 microversion: 2.57 time: 0.187994 Aug 18 11:41:39.215694 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1941/3735] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:39 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1334 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:39.355355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b135b4ed-b6ff-4e6c-8cf1-4a8dbab52c01 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:39.371179 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b135b4ed-b6ff-4e6c-8cf1-4a8dbab52c01 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1485 microversion: 2.1 time: 0.391438 Aug 18 11:41:39.372495 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1795/3736] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:38 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1485 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:39.538092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d705af36-525f-4970-81d1-2e034ade2769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:39.541898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d705af36-525f-4970-81d1-2e034ade2769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:39.569827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d705af36-525f-4970-81d1-2e034ade2769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:39.570784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d705af36-525f-4970-81d1-2e034ade2769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:39.571516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d705af36-525f-4970-81d1-2e034ade2769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:39.572784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d705af36-525f-4970-81d1-2e034ade2769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:39.573602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d705af36-525f-4970-81d1-2e034ade2769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:39.574317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d705af36-525f-4970-81d1-2e034ade2769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:39.624858 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1632721193", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:39.738298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] validate_networks() for [('a5e24502-ae41-41ef-a275-de04ab0068ad', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:41:40.036345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d705af36-525f-4970-81d1-2e034ade2769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:40.071953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d705af36-525f-4970-81d1-2e034ade2769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:40.075339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d705af36-525f-4970-81d1-2e034ade2769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:40.077634 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d705af36-525f-4970-81d1-2e034ade2769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1359 microversion: 2.21 time: 0.547266 Aug 18 11:41:40.087204 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1942/3737] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:39 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1359 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:40.112643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c5eee2f9-f6a1-490e-a5c2-a77d42c31fe1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:40.113852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c5eee2f9-f6a1-490e-a5c2-a77d42c31fe1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:40.128568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5eee2f9-f6a1-490e-a5c2-a77d42c31fe1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:40.129917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5eee2f9-f6a1-490e-a5c2-a77d42c31fe1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:40.130768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5eee2f9-f6a1-490e-a5c2-a77d42c31fe1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:40.132049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5eee2f9-f6a1-490e-a5c2-a77d42c31fe1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:40.132977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5eee2f9-f6a1-490e-a5c2-a77d42c31fe1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:40.133817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5eee2f9-f6a1-490e-a5c2-a77d42c31fe1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:40.649028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c5eee2f9-f6a1-490e-a5c2-a77d42c31fe1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:40.665045 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c5eee2f9-f6a1-490e-a5c2-a77d42c31fe1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1576 microversion: 2.1 time: 0.575902 Aug 18 11:41:40.697581 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1943/3738] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:40 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1576 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:40.715798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9db85d66-dfbc-4f57-be50-49112e7998d9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:40.716643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9db85d66-dfbc-4f57-be50-49112e7998d9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: 77c13227-b6f4-49d7-b40b-2ec356ca3f92] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:40.727523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9db85d66-dfbc-4f57-be50-49112e7998d9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:40.728354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9db85d66-dfbc-4f57-be50-49112e7998d9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:40.729345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9db85d66-dfbc-4f57-be50-49112e7998d9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:40.730244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9db85d66-dfbc-4f57-be50-49112e7998d9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:40.730767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9db85d66-dfbc-4f57-be50-49112e7998d9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:40.731919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9db85d66-dfbc-4f57-be50-49112e7998d9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:40.777865 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-9db85d66-dfbc-4f57-be50-49112e7998d9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] HTTP exception thrown: Instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 could not be found. Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9db85d66-dfbc-4f57-be50-49112e7998d9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Request method failure captured: Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 HTTP/1.1 Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iRDccV-wQBjWbehYJnvnYrqtEvDPnmmRi9FdLn90jlDwmLP7Yu8AV-Xjh3sRI2h6VdTdDxREaF_4Uw5JAlLnmy-pOyTW0C8AnpTCeGTveMx08cuhXqa0wk4T8c8YQiDTyaAtMLbCc_qByCh4ZjwOdEPthe4EaqbP1499Gbu30qZ6g8 Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 4eea5599d0754399a32a3ae3431ff18f Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 could not be found. Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '77c13227-b6f4-49d7-b40b-2ec356ca3f92'} Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 could not be found. Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 could not be found. Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:40.781839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:40.792660 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:40.792660 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:40.792660 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:40.792660 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:40.792660 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:40.792660 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:40.792660 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 could not be found. Aug 18 11:41:40.792660 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:40.796290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9db85d66-dfbc-4f57-be50-49112e7998d9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Returning 404 to user: Instance 77c13227-b6f4-49d7-b40b-2ec356ca3f92 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:40.798217 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9db85d66-dfbc-4f57-be50-49112e7998d9 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92" status: 404 len: 111 microversion: 2.1 time: 0.095635 Aug 18 11:41:40.799897 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1944/3739] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:40 2022] GET /compute/v2.1/servers/77c13227-b6f4-49d7-b40b-2ec356ca3f92 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:40.810779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-67b86b9d-0723-4352-a611-9a05a32d9fe5 req-7e3d1200-aa34-47d8-89f9-ce1045c337b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2faffeb5-20db-4e86-b94b-1c4e1125c8e4", "tag": "63113096-c75d-451f-8de7-d895a5c8a062"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:40.831522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-67b86b9d-0723-4352-a611-9a05a32d9fe5 req-7e3d1200-aa34-47d8-89f9-ce1045c337b0 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:40.833206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-67b86b9d-0723-4352-a611-9a05a32d9fe5 req-7e3d1200-aa34-47d8-89f9-ce1045c337b0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:40.834618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-67b86b9d-0723-4352-a611-9a05a32d9fe5 req-7e3d1200-aa34-47d8-89f9-ce1045c337b0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:40.871158 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-67b86b9d-0723-4352-a611-9a05a32d9fe5 req-7e3d1200-aa34-47d8-89f9-ce1045c337b0 service nova] Creating event network-changed:63113096-c75d-451f-8de7-d895a5c8a062 for instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 on n-h2-853611-3 Aug 18 11:41:40.882479 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-67b86b9d-0723-4352-a611-9a05a32d9fe5 req-7e3d1200-aa34-47d8-89f9-ce1045c337b0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079778 Aug 18 11:41:40.885287 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1945/3740] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:40.906023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94b6ac78-aa78-490b-8f76-9f8d58daba16 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:40.910414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-94b6ac78-aa78-490b-8f76-9f8d58daba16 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:40.923820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94b6ac78-aa78-490b-8f76-9f8d58daba16 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:40.926036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94b6ac78-aa78-490b-8f76-9f8d58daba16 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:40.928531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94b6ac78-aa78-490b-8f76-9f8d58daba16 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:40.930913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94b6ac78-aa78-490b-8f76-9f8d58daba16 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:40.933020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94b6ac78-aa78-490b-8f76-9f8d58daba16 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:40.936747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94b6ac78-aa78-490b-8f76-9f8d58daba16 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:41.012452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:41:41.013351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:41:41.013532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:41:41.014401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:41:41.014832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:41:41.032547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:41.033986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:41.034731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:41.035575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:41.036301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:41.036905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:41.064708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Getting quotas for project c2e348204c8d444fa46deb880043c565. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:41:41.071904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Getting quotas for user d7326372f966413d82aea488ca4a0742 and project c2e348204c8d444fa46deb880043c565. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:41:41.089512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:41:41.092021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:41:41.113875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-94b6ac78-aa78-490b-8f76-9f8d58daba16 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:41.138176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-94b6ac78-aa78-490b-8f76-9f8d58daba16 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:41.141916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-94b6ac78-aa78-490b-8f76-9f8d58daba16 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:41.149744 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-94b6ac78-aa78-490b-8f76-9f8d58daba16 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1355 microversion: 2.57 time: 0.259167 Aug 18 11:41:41.151482 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1946/3741] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:40 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1355 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:41.163718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-19a03556-3652-4854-a5b7-5ede9de85c1a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:41.166834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-19a03556-3652-4854-a5b7-5ede9de85c1a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:41.183119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19a03556-3652-4854-a5b7-5ede9de85c1a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:41.184361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19a03556-3652-4854-a5b7-5ede9de85c1a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:41.185332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19a03556-3652-4854-a5b7-5ede9de85c1a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:41.186891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19a03556-3652-4854-a5b7-5ede9de85c1a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:41.187908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19a03556-3652-4854-a5b7-5ede9de85c1a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:41.188899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19a03556-3652-4854-a5b7-5ede9de85c1a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:41.213960 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7263d546-cc45-4040-9551-c0c6583f0ab9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.592986 Aug 18 11:41:41.215705 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1796/3742] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:41:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:41:41.228336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-922b2c5c-1f5c-4906-95ea-8e26bd970c10 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:41.232333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-922b2c5c-1f5c-4906-95ea-8e26bd970c10 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:41.245907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:41.250953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-922b2c5c-1f5c-4906-95ea-8e26bd970c10 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:41.253462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-922b2c5c-1f5c-4906-95ea-8e26bd970c10 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:41.255081 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-922b2c5c-1f5c-4906-95ea-8e26bd970c10 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:41.256852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-922b2c5c-1f5c-4906-95ea-8e26bd970c10 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:41.258131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-922b2c5c-1f5c-4906-95ea-8e26bd970c10 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:41.259546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-922b2c5c-1f5c-4906-95ea-8e26bd970c10 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:41.264525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-19a03556-3652-4854-a5b7-5ede9de85c1a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:41:41.322582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:41.505130 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-19a03556-3652-4854-a5b7-5ede9de85c1a tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 204 len: 0 microversion: 2.1 time: 0.351199 Aug 18 11:41:41.510524 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1947/3743] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:41:41 2022] DELETE /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:41:41.529434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:41.545464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:41.561647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:41.562703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:41.563734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:41.566527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:41.567559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:41.568462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:41.579433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-922b2c5c-1f5c-4906-95ea-8e26bd970c10 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:41.597502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-922b2c5c-1f5c-4906-95ea-8e26bd970c10 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:41.601212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-922b2c5c-1f5c-4906-95ea-8e26bd970c10 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:41.604543 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-922b2c5c-1f5c-4906-95ea-8e26bd970c10 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1359 microversion: 2.21 time: 0.385955 Aug 18 11:41:41.605561 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1797/3744] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:41 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1359 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:41.615053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-789be637-aa44-48e2-9871-8f92d23ffa29 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:41.616217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-789be637-aa44-48e2-9871-8f92d23ffa29 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:41.751415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-789be637-aa44-48e2-9871-8f92d23ffa29 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:41.760680 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-789be637-aa44-48e2-9871-8f92d23ffa29 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1214 microversion: 2.1 time: 0.153611 Aug 18 11:41:41.761579 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1798/3745] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:41 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:41.762058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:41:41.763090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:41:41.764170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:41:41.765002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:41:41.765911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:41:41.767315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-44d8fc1b-d579-4cc1-b3ba-09c5bd5b3ec1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:41.768131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-44d8fc1b-d579-4cc1-b3ba-09c5bd5b3ec1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:41.786774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44d8fc1b-d579-4cc1-b3ba-09c5bd5b3ec1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:41.789143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44d8fc1b-d579-4cc1-b3ba-09c5bd5b3ec1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:41.789973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44d8fc1b-d579-4cc1-b3ba-09c5bd5b3ec1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:41.794574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44d8fc1b-d579-4cc1-b3ba-09c5bd5b3ec1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:41.796765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44d8fc1b-d579-4cc1-b3ba-09c5bd5b3ec1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:41.797822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44d8fc1b-d579-4cc1-b3ba-09c5bd5b3ec1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:41.904715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:41.914147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:41.914147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:41.914697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:41.915504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:41.916143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:41.916658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:41.951525 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3825355f-b508-49a2-a4fa-ff13b262e3f0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "POST /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2/action" status: 202 len: 1136 microversion: 2.57 time: 0.435860 Aug 18 11:41:41.952978 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1948/3746] 10.222.0.73 () {62 vars in 1320 bytes} [Thu Aug 18 11:41:41 2022] POST /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2/action => generated 1136 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 18 11:41:41.961312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-22b9373c-cb95-4a5e-87cc-e2886670ef15 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:41.962579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-22b9373c-cb95-4a5e-87cc-e2886670ef15 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:41.985687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22b9373c-cb95-4a5e-87cc-e2886670ef15 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:41.988163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22b9373c-cb95-4a5e-87cc-e2886670ef15 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:41.994366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22b9373c-cb95-4a5e-87cc-e2886670ef15 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:42.003183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22b9373c-cb95-4a5e-87cc-e2886670ef15 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:42.004070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22b9373c-cb95-4a5e-87cc-e2886670ef15 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:42.007202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22b9373c-cb95-4a5e-87cc-e2886670ef15 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:42.110351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-44d8fc1b-d579-4cc1-b3ba-09c5bd5b3ec1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:42.125914 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-44d8fc1b-d579-4cc1-b3ba-09c5bd5b3ec1 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1520 microversion: 2.1 time: 0.362224 Aug 18 11:41:42.131077 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1799/3747] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:41 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1520 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:42.139099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-96fe8fb2-d596-4141-9a24-b27012ab1f0f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:42.140346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-96fe8fb2-d596-4141-9a24-b27012ab1f0f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:42.153029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96fe8fb2-d596-4141-9a24-b27012ab1f0f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:42.154691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96fe8fb2-d596-4141-9a24-b27012ab1f0f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:42.155377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96fe8fb2-d596-4141-9a24-b27012ab1f0f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:42.156368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96fe8fb2-d596-4141-9a24-b27012ab1f0f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:42.157111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96fe8fb2-d596-4141-9a24-b27012ab1f0f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:42.160455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96fe8fb2-d596-4141-9a24-b27012ab1f0f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:42.262339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-22b9373c-cb95-4a5e-87cc-e2886670ef15 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:42.281291 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-22b9373c-cb95-4a5e-87cc-e2886670ef15 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1581 microversion: 2.1 time: 0.326168 Aug 18 11:41:42.282647 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1949/3748] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:41 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1581 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:42.308720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-96fe8fb2-d596-4141-9a24-b27012ab1f0f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:42.326931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-96fe8fb2-d596-4141-9a24-b27012ab1f0f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:42.326931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-96fe8fb2-d596-4141-9a24-b27012ab1f0f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:42.326931 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-96fe8fb2-d596-4141-9a24-b27012ab1f0f tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.192919 Aug 18 11:41:42.329243 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1800/3749] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:42 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:42.652092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9893d929-e365-4b84-9821-b208c62ab12c tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:42.653488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9893d929-e365-4b84-9821-b208c62ab12c tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:42.667649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9893d929-e365-4b84-9821-b208c62ab12c tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:42.668763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9893d929-e365-4b84-9821-b208c62ab12c tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:42.669638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9893d929-e365-4b84-9821-b208c62ab12c tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:42.671143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9893d929-e365-4b84-9821-b208c62ab12c tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:42.672178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9893d929-e365-4b84-9821-b208c62ab12c tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:42.672910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9893d929-e365-4b84-9821-b208c62ab12c tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:42.901952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c03cbe14-9a7d-481c-a91e-58cc988e4c32 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Action: 'update', calling method: .version_select at 0x7f519ffc5550>, body: {"quota_set": {"ram": "5120"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:43.046594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c03cbe14-9a7d-481c-a91e-58cc988e4c32 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.047938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c03cbe14-9a7d-481c-a91e-58cc988e4c32 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.050712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c03cbe14-9a7d-481c-a91e-58cc988e4c32 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.052793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c03cbe14-9a7d-481c-a91e-58cc988e4c32 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.053485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c03cbe14-9a7d-481c-a91e-58cc988e4c32 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.054902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c03cbe14-9a7d-481c-a91e-58cc988e4c32 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.114027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9893d929-e365-4b84-9821-b208c62ab12c tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:43.129238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9893d929-e365-4b84-9821-b208c62ab12c tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:43.129565 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c03cbe14-9a7d-481c-a91e-58cc988e4c32 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/6b1c09e3c50541e197cbed67ffcb3ed9" status: 200 len: 148 microversion: 2.57 time: 0.429652 Aug 18 11:41:43.130254 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1801/3750] 10.222.0.73 () {62 vars in 1303 bytes} [Thu Aug 18 11:41:42 2022] PUT /compute/v2.1/os-quota-sets/6b1c09e3c50541e197cbed67ffcb3ed9 => generated 148 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:41:43.132576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9893d929-e365-4b84-9821-b208c62ab12c tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:43.134786 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9893d929-e365-4b84-9821-b208c62ab12c tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1359 microversion: 2.21 time: 0.490313 Aug 18 11:41:43.135826 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1950/3751] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:42 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1359 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:43.150188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f463c000-d8df-4169-8c23-8595d8e983c0 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Calling method '.version_select at 0x7f519ee121f0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:43.152391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3181a1d5-6e4d-489a-b14a-f45e5842d4c9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:43.153829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3181a1d5-6e4d-489a-b14a-f45e5842d4c9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:43.169298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3181a1d5-6e4d-489a-b14a-f45e5842d4c9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.170180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3181a1d5-6e4d-489a-b14a-f45e5842d4c9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.170977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3181a1d5-6e4d-489a-b14a-f45e5842d4c9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.172376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3181a1d5-6e4d-489a-b14a-f45e5842d4c9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.173195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3181a1d5-6e4d-489a-b14a-f45e5842d4c9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.174523 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3181a1d5-6e4d-489a-b14a-f45e5842d4c9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.249570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f463c000-d8df-4169-8c23-8595d8e983c0 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.250295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f463c000-d8df-4169-8c23-8595d8e983c0 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.250945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f463c000-d8df-4169-8c23-8595d8e983c0 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.252637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f463c000-d8df-4169-8c23-8595d8e983c0 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.253910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f463c000-d8df-4169-8c23-8595d8e983c0 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.254598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f463c000-d8df-4169-8c23-8595d8e983c0 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.280669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3181a1d5-6e4d-489a-b14a-f45e5842d4c9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:43.280916 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f463c000-d8df-4169-8c23-8595d8e983c0 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/6b1c09e3c50541e197cbed67ffcb3ed9/detail" status: 200 len: 463 microversion: 2.57 time: 0.140990 Aug 18 11:41:43.281762 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1951/3752] 10.222.0.73 () {60 vars in 1304 bytes} [Thu Aug 18 11:41:43 2022] GET /compute/v2.1/os-quota-sets/6b1c09e3c50541e197cbed67ffcb3ed9/detail => generated 463 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:41:43.287677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7dc20bdf-51fa-458f-85d3-ee595c178767 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:43.288307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dc20bdf-51fa-458f-85d3-ee595c178767 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:43.298353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc20bdf-51fa-458f-85d3-ee595c178767 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.298970 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3181a1d5-6e4d-489a-b14a-f45e5842d4c9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1218 microversion: 2.1 time: 0.166872 Aug 18 11:41:43.299186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc20bdf-51fa-458f-85d3-ee595c178767 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.299425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc20bdf-51fa-458f-85d3-ee595c178767 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.300298 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1802/3753] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:43 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1218 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:43.302659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc20bdf-51fa-458f-85d3-ee595c178767 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.303191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc20bdf-51fa-458f-85d3-ee595c178767 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.303647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc20bdf-51fa-458f-85d3-ee595c178767 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.335255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-51dffbec-52e7-4af8-8689-4f3cfb4d5c18 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:43.343327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-51dffbec-52e7-4af8-8689-4f3cfb4d5c18 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:43.362386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51dffbec-52e7-4af8-8689-4f3cfb4d5c18 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.363762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51dffbec-52e7-4af8-8689-4f3cfb4d5c18 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.364616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51dffbec-52e7-4af8-8689-4f3cfb4d5c18 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.366121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51dffbec-52e7-4af8-8689-4f3cfb4d5c18 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.367260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51dffbec-52e7-4af8-8689-4f3cfb4d5c18 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.369725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-51dffbec-52e7-4af8-8689-4f3cfb4d5c18 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.610745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-51dffbec-52e7-4af8-8689-4f3cfb4d5c18 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:43.628595 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-51dffbec-52e7-4af8-8689-4f3cfb4d5c18 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1574 microversion: 2.1 time: 0.306277 Aug 18 11:41:43.629526 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1803/3754] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:43 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1574 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:43.639288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d79952f4-29c7-4092-804a-ff8fcba233ee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:43.640431 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d79952f4-29c7-4092-804a-ff8fcba233ee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:43.655198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d79952f4-29c7-4092-804a-ff8fcba233ee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.656129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d79952f4-29c7-4092-804a-ff8fcba233ee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.656952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d79952f4-29c7-4092-804a-ff8fcba233ee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.659022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d79952f4-29c7-4092-804a-ff8fcba233ee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.659912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d79952f4-29c7-4092-804a-ff8fcba233ee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.660721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d79952f4-29c7-4092-804a-ff8fcba233ee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.710501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:43.795563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d79952f4-29c7-4092-804a-ff8fcba233ee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:43.812305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d79952f4-29c7-4092-804a-ff8fcba233ee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:43.816695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d79952f4-29c7-4092-804a-ff8fcba233ee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:43.818967 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d79952f4-29c7-4092-804a-ff8fcba233ee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.187677 Aug 18 11:41:43.819991 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1804/3755] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:43 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:43.831365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-88af75db-6cc0-4f27-88b8-cdcb549512ce tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Action: 'update', calling method: .version_select at 0x7f519ec8f9d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:43.938841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88af75db-6cc0-4f27-88b8-cdcb549512ce tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.940269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88af75db-6cc0-4f27-88b8-cdcb549512ce tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.940865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88af75db-6cc0-4f27-88b8-cdcb549512ce tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.942038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88af75db-6cc0-4f27-88b8-cdcb549512ce tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.942819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88af75db-6cc0-4f27-88b8-cdcb549512ce tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.943449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88af75db-6cc0-4f27-88b8-cdcb549512ce tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.993570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7dc20bdf-51fa-458f-85d3-ee595c178767 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:43.993945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88af75db-6cc0-4f27-88b8-cdcb549512ce tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.994366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88af75db-6cc0-4f27-88b8-cdcb549512ce tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.994849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88af75db-6cc0-4f27-88b8-cdcb549512ce tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:43.995896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88af75db-6cc0-4f27-88b8-cdcb549512ce tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:43.996402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88af75db-6cc0-4f27-88b8-cdcb549512ce tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:43.996837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88af75db-6cc0-4f27-88b8-cdcb549512ce tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:44.010676 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7dc20bdf-51fa-458f-85d3-ee595c178767 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1520 microversion: 2.1 time: 0.727420 Aug 18 11:41:44.011866 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1952/3756] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:43 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1520 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:44.022583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-28a98a50-0395-4b70-ab9f-0ac45b0acb8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-94106184"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:44.024119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-28a98a50-0395-4b70-ab9f-0ac45b0acb8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:44.035410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28a98a50-0395-4b70-ab9f-0ac45b0acb8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:44.036349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28a98a50-0395-4b70-ab9f-0ac45b0acb8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:44.037217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28a98a50-0395-4b70-ab9f-0ac45b0acb8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:44.038914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28a98a50-0395-4b70-ab9f-0ac45b0acb8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:44.039836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28a98a50-0395-4b70-ab9f-0ac45b0acb8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:44.041296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28a98a50-0395-4b70-ab9f-0ac45b0acb8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:44.117292 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-88af75db-6cc0-4f27-88b8-cdcb549512ce tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-quota-sets/6b1c09e3c50541e197cbed67ffcb3ed9?user_id=d22772a7e252498797c26344bf18eabe" status: 200 len: 148 microversion: 2.57 time: 0.294886 Aug 18 11:41:44.119309 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1805/3757] 10.222.0.73 () {62 vars in 1384 bytes} [Thu Aug 18 11:41:43 2022] PUT /compute/v2.1/os-quota-sets/6b1c09e3c50541e197cbed67ffcb3ed9?user_id=d22772a7e252498797c26344bf18eabe => generated 148 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:41:44.137525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b11e23bc-e5b7-47c4-92fe-730f5968ae69 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] Calling method '.version_select at 0x7f519f5c6310>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:44.267089 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.network.security_group_api [None req-28a98a50-0395-4b70-ab9f-0ac45b0acb8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Adding security group a37b0cbe-d64d-464a-949e-e21c161b47cb to port b0ee35ef-ab7e-4ce7-a28a-562b36cc60d5 Aug 18 11:41:44.275359 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b11e23bc-e5b7-47c4-92fe-730f5968ae69 tempest-QuotasAdminTestV257-1057150238 tempest-QuotasAdminTestV257-1057150238-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/6b1c09e3c50541e197cbed67ffcb3ed9?user_id=d22772a7e252498797c26344bf18eabe" status: 200 len: 190 microversion: 2.57 time: 0.144227 Aug 18 11:41:44.276408 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1806/3758] 10.222.0.73 () {60 vars in 1364 bytes} [Thu Aug 18 11:41:44 2022] GET /compute/v2.1/os-quota-sets/6b1c09e3c50541e197cbed67ffcb3ed9?user_id=d22772a7e252498797c26344bf18eabe => generated 190 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:41:44.285918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5036686d-d5e0-4f51-b086-ae9e15b39769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:44.287108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5036686d-d5e0-4f51-b086-ae9e15b39769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:44.298303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5036686d-d5e0-4f51-b086-ae9e15b39769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:44.299439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5036686d-d5e0-4f51-b086-ae9e15b39769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:44.300221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5036686d-d5e0-4f51-b086-ae9e15b39769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:44.301440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5036686d-d5e0-4f51-b086-ae9e15b39769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:44.302282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5036686d-d5e0-4f51-b086-ae9e15b39769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:44.303107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5036686d-d5e0-4f51-b086-ae9e15b39769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:44.585552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5036686d-d5e0-4f51-b086-ae9e15b39769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:44.605076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5036686d-d5e0-4f51-b086-ae9e15b39769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:44.609128 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5036686d-d5e0-4f51-b086-ae9e15b39769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:44.624695 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5036686d-d5e0-4f51-b086-ae9e15b39769 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1359 microversion: 2.21 time: 0.346363 Aug 18 11:41:44.628852 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1807/3759] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:44 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1359 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:44.652232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6f4e0a6f-5936-41b4-aee7-af16b8978dc7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:44.653632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6f4e0a6f-5936-41b4-aee7-af16b8978dc7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:44.661365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f4e0a6f-5936-41b4-aee7-af16b8978dc7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:44.661870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f4e0a6f-5936-41b4-aee7-af16b8978dc7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:44.662891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f4e0a6f-5936-41b4-aee7-af16b8978dc7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:44.663960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f4e0a6f-5936-41b4-aee7-af16b8978dc7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:44.665039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f4e0a6f-5936-41b4-aee7-af16b8978dc7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:44.665755 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f4e0a6f-5936-41b4-aee7-af16b8978dc7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:44.791852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6f4e0a6f-5936-41b4-aee7-af16b8978dc7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:44.817374 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6f4e0a6f-5936-41b4-aee7-af16b8978dc7 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1218 microversion: 2.1 time: 0.184848 Aug 18 11:41:44.819697 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1808/3760] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:44 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1218 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:44.853988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-795563ea-55f5-4e3e-8833-2523adddfe60 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:44.855474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-795563ea-55f5-4e3e-8833-2523adddfe60 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:44.879940 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-795563ea-55f5-4e3e-8833-2523adddfe60 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:44.880875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-795563ea-55f5-4e3e-8833-2523adddfe60 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:44.881462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-795563ea-55f5-4e3e-8833-2523adddfe60 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:44.882293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-795563ea-55f5-4e3e-8833-2523adddfe60 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:44.883130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-795563ea-55f5-4e3e-8833-2523adddfe60 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:44.883992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-795563ea-55f5-4e3e-8833-2523adddfe60 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:44.992909 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-28a98a50-0395-4b70-ab9f-0ac45b0acb8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5/action" status: 202 len: 0 microversion: 2.1 time: 0.978705 Aug 18 11:41:44.994832 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1953/3761] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:41:44 2022] POST /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5/action => generated 0 bytes in 982 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:41:45.030971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59ed21d2-51fb-4034-97b3-2ea6a6e67d0a tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:45.032585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59ed21d2-51fb-4034-97b3-2ea6a6e67d0a tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:45.063012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59ed21d2-51fb-4034-97b3-2ea6a6e67d0a tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:45.064972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59ed21d2-51fb-4034-97b3-2ea6a6e67d0a tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:45.065793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59ed21d2-51fb-4034-97b3-2ea6a6e67d0a tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:45.067275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59ed21d2-51fb-4034-97b3-2ea6a6e67d0a tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:45.068346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59ed21d2-51fb-4034-97b3-2ea6a6e67d0a tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:45.069374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59ed21d2-51fb-4034-97b3-2ea6a6e67d0a tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:45.319222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-59ed21d2-51fb-4034-97b3-2ea6a6e67d0a tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:45.339111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-59ed21d2-51fb-4034-97b3-2ea6a6e67d0a tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:45.342881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-59ed21d2-51fb-4034-97b3-2ea6a6e67d0a tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:45.345785 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59ed21d2-51fb-4034-97b3-2ea6a6e67d0a tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.343885 Aug 18 11:41:45.347750 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1954/3762] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:45 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:45.368326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bababf1b-3017-490a-b375-ea89f8fa3245 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519eeb3310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:45.412473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-795563ea-55f5-4e3e-8833-2523adddfe60 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:45.428514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-795563ea-55f5-4e3e-8833-2523adddfe60 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:45.430846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-795563ea-55f5-4e3e-8833-2523adddfe60 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:45.438921 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-795563ea-55f5-4e3e-8833-2523adddfe60 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 2954 microversion: 2.32 time: 0.596107 Aug 18 11:41:45.441311 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1809/3763] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:44 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 2954 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:45.462593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-bcf0dae7-9e40-468b-85a1-07eb28949748 req-1ff1fc84-f02c-45bf-a73e-263cf221f84a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8347e97a-e013-461c-b858-2fc8c6a505d5", "tag": "b0ee35ef-ab7e-4ce7-a28a-562b36cc60d5"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:45.500612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bcf0dae7-9e40-468b-85a1-07eb28949748 req-1ff1fc84-f02c-45bf-a73e-263cf221f84a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:45.501053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bcf0dae7-9e40-468b-85a1-07eb28949748 req-1ff1fc84-f02c-45bf-a73e-263cf221f84a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:45.502041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bcf0dae7-9e40-468b-85a1-07eb28949748 req-1ff1fc84-f02c-45bf-a73e-263cf221f84a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:45.533735 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-bcf0dae7-9e40-468b-85a1-07eb28949748 req-1ff1fc84-f02c-45bf-a73e-263cf221f84a service nova] Creating event network-changed:b0ee35ef-ab7e-4ce7-a28a-562b36cc60d5 for instance 8347e97a-e013-461c-b858-2fc8c6a505d5 on n-h2-853611-3 Aug 18 11:41:45.548052 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-bcf0dae7-9e40-468b-85a1-07eb28949748 req-1ff1fc84-f02c-45bf-a73e-263cf221f84a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100837 Aug 18 11:41:45.549770 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1810/3764] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:45.555824 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cf7e1e08-1afd-4f0c-ae8d-3d873e156938 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:45.559568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cf7e1e08-1afd-4f0c-ae8d-3d873e156938 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:45.578666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cf7e1e08-1afd-4f0c-ae8d-3d873e156938 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:45.579471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cf7e1e08-1afd-4f0c-ae8d-3d873e156938 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:45.580932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cf7e1e08-1afd-4f0c-ae8d-3d873e156938 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:45.581913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cf7e1e08-1afd-4f0c-ae8d-3d873e156938 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:45.582624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cf7e1e08-1afd-4f0c-ae8d-3d873e156938 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:45.583428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cf7e1e08-1afd-4f0c-ae8d-3d873e156938 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:46.109672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cf7e1e08-1afd-4f0c-ae8d-3d873e156938 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:46.128932 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cf7e1e08-1afd-4f0c-ae8d-3d873e156938 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1520 microversion: 2.1 time: 0.577140 Aug 18 11:41:46.132104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-bababf1b-3017-490a-b375-ea89f8fa3245 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a37b0cbe-d64d-464a-949e-e21c161b47cb in use.", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:41:46.134109 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-bababf1b-3017-490a-b375-ea89f8fa3245 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Security Group a37b0cbe-d64d-464a-949e-e21c161b47cb in use. Aug 18 11:41:46.134109 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-d2fbc675-d67e-4e52-9cbf-8dd21475f9b8'] Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bababf1b-3017-490a-b375-ea89f8fa3245 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/os-security-groups/a37b0cbe-d64d-464a-949e-e21c161b47cb HTTP/1.1 Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: exception: Security Group a37b0cbe-d64d-464a-949e-e21c161b47cb in use. Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-d2fbc675-d67e-4e52-9cbf-8dd21475f9b8'] Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'a37b0cbe-d64d-464a-949e-e21c161b47cb'} Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:41:46.137183 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group a37b0cbe-d64d-464a-949e-e21c161b47cb in use. Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2fbc675-d67e-4e52-9cbf-8dd21475f9b8'] Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group a37b0cbe-d64d-464a-949e-e21c161b47cb in use. Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2fbc675-d67e-4e52-9cbf-8dd21475f9b8'] Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group a37b0cbe-d64d-464a-949e-e21c161b47cb in use. Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2fbc675-d67e-4e52-9cbf-8dd21475f9b8'] Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group a37b0cbe-d64d-464a-949e-e21c161b47cb in use. Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2fbc675-d67e-4e52-9cbf-8dd21475f9b8'] Aug 18 11:41:46.151406 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:46.163397 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1811/3765] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:45 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1520 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:46.164232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bababf1b-3017-490a-b375-ea89f8fa3245 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 400 to user: Security Group a37b0cbe-d64d-464a-949e-e21c161b47cb in use. Aug 18 11:41:46.164232 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-d2fbc675-d67e-4e52-9cbf-8dd21475f9b8'] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:46.166618 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bababf1b-3017-490a-b375-ea89f8fa3245 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/a37b0cbe-d64d-464a-949e-e21c161b47cb" status: 400 len: 185 microversion: 2.1 time: 0.816493 Aug 18 11:41:46.168012 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1955/3766] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:45 2022] DELETE /compute/v2.1/os-security-groups/a37b0cbe-d64d-464a-949e-e21c161b47cb => generated 185 bytes in 820 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:41:46.195071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6cab71eb-3712-4b45-a35a-ad97214b5466 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:46.199764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6cab71eb-3712-4b45-a35a-ad97214b5466 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:46.226666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cab71eb-3712-4b45-a35a-ad97214b5466 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:46.234716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cab71eb-3712-4b45-a35a-ad97214b5466 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:46.235951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cab71eb-3712-4b45-a35a-ad97214b5466 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:46.237608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ed7b59d6-2d67-4f9a-b2a7-fc0faa9bbba5 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:46.241313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cab71eb-3712-4b45-a35a-ad97214b5466 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:46.241993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ed7b59d6-2d67-4f9a-b2a7-fc0faa9bbba5 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:46.243719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cab71eb-3712-4b45-a35a-ad97214b5466 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:46.247910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cab71eb-3712-4b45-a35a-ad97214b5466 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:46.293735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed7b59d6-2d67-4f9a-b2a7-fc0faa9bbba5 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:46.302841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed7b59d6-2d67-4f9a-b2a7-fc0faa9bbba5 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:46.308818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed7b59d6-2d67-4f9a-b2a7-fc0faa9bbba5 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:46.313840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed7b59d6-2d67-4f9a-b2a7-fc0faa9bbba5 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:46.320694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed7b59d6-2d67-4f9a-b2a7-fc0faa9bbba5 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:46.323076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed7b59d6-2d67-4f9a-b2a7-fc0faa9bbba5 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:46.677456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6cab71eb-3712-4b45-a35a-ad97214b5466 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:46.694492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6cab71eb-3712-4b45-a35a-ad97214b5466 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:46.696970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6cab71eb-3712-4b45-a35a-ad97214b5466 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:46.699461 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6cab71eb-3712-4b45-a35a-ad97214b5466 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1359 microversion: 2.21 time: 0.523835 Aug 18 11:41:46.700598 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1956/3767] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:46 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1359 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:46.707055 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ed7b59d6-2d67-4f9a-b2a7-fc0faa9bbba5 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.549504 Aug 18 11:41:46.714780 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1812/3768] 10.222.0.73 () {60 vars in 1316 bytes} [Thu Aug 18 11:41:46 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab/os-interface => generated 1832 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:46.719283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3f9dcbb3-0db5-4e74-a2c0-73605cf4c036 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:46.720129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3f9dcbb3-0db5-4e74-a2c0-73605cf4c036 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:46.725556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-285ae4ec-f215-4240-b487-e938c2f26d13 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:46.726983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-285ae4ec-f215-4240-b487-e938c2f26d13 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:46.742465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-285ae4ec-f215-4240-b487-e938c2f26d13 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:46.743940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-285ae4ec-f215-4240-b487-e938c2f26d13 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:46.744814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f9dcbb3-0db5-4e74-a2c0-73605cf4c036 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:46.745988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f9dcbb3-0db5-4e74-a2c0-73605cf4c036 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:46.746970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-285ae4ec-f215-4240-b487-e938c2f26d13 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:46.747196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-285ae4ec-f215-4240-b487-e938c2f26d13 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:46.747620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f9dcbb3-0db5-4e74-a2c0-73605cf4c036 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:46.747805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-285ae4ec-f215-4240-b487-e938c2f26d13 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:46.748098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-285ae4ec-f215-4240-b487-e938c2f26d13 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:46.749191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f9dcbb3-0db5-4e74-a2c0-73605cf4c036 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:46.750179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f9dcbb3-0db5-4e74-a2c0-73605cf4c036 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:46.753641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f9dcbb3-0db5-4e74-a2c0-73605cf4c036 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:46.813098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3f9dcbb3-0db5-4e74-a2c0-73605cf4c036 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:41:46.896169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-285ae4ec-f215-4240-b487-e938c2f26d13 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:46.913324 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-285ae4ec-f215-4240-b487-e938c2f26d13 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1272 microversion: 2.1 time: 0.211173 Aug 18 11:41:46.913940 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1957/3769] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:46 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1272 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:46.942125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-31e3a31c-6e3a-41d8-928d-884d3e6fe43b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:46.947469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-31e3a31c-6e3a-41d8-928d-884d3e6fe43b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:46.978140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e3a31c-6e3a-41d8-928d-884d3e6fe43b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:46.980748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e3a31c-6e3a-41d8-928d-884d3e6fe43b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:46.981738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e3a31c-6e3a-41d8-928d-884d3e6fe43b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:46.982773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e3a31c-6e3a-41d8-928d-884d3e6fe43b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:46.983429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e3a31c-6e3a-41d8-928d-884d3e6fe43b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:46.984037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e3a31c-6e3a-41d8-928d-884d3e6fe43b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:47.073462 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3f9dcbb3-0db5-4e74-a2c0-73605cf4c036 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 204 len: 0 microversion: 2.1 time: 0.363640 Aug 18 11:41:47.078117 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1813/3770] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:41:46 2022] DELETE /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:41:47.105023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-bc06286a-5252-400b-b96a-9fc30bd7e138 req-7a23441a-1923-4098-9886-4a6e620b26fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f665d8-ddd8-4030-be59-efb1140ef80e", "name": "network-vif-deleted", "tag": "c56130e0-5b17-4391-828c-7beff1aa7e98"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:47.132427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bc06286a-5252-400b-b96a-9fc30bd7e138 req-7a23441a-1923-4098-9886-4a6e620b26fe service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:47.133322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bc06286a-5252-400b-b96a-9fc30bd7e138 req-7a23441a-1923-4098-9886-4a6e620b26fe service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:47.134067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bc06286a-5252-400b-b96a-9fc30bd7e138 req-7a23441a-1923-4098-9886-4a6e620b26fe service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:47.139092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-31e3a31c-6e3a-41d8-928d-884d3e6fe43b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:47.160092 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-bc06286a-5252-400b-b96a-9fc30bd7e138 req-7a23441a-1923-4098-9886-4a6e620b26fe service nova] Creating event network-vif-deleted:c56130e0-5b17-4391-828c-7beff1aa7e98 for instance d6f665d8-ddd8-4030-be59-efb1140ef80e on n-h1-853611-3 Aug 18 11:41:47.173913 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-bc06286a-5252-400b-b96a-9fc30bd7e138 req-7a23441a-1923-4098-9886-4a6e620b26fe service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087315 Aug 18 11:41:47.175267 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1814/3771] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:47.180989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-31e3a31c-6e3a-41d8-928d-884d3e6fe43b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:47.187990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-31e3a31c-6e3a-41d8-928d-884d3e6fe43b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:47.189887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-304a6b3b-b361-4b02-a6c5-9cf682e6452a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:47.191648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-304a6b3b-b361-4b02-a6c5-9cf682e6452a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:47.193057 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-31e3a31c-6e3a-41d8-928d-884d3e6fe43b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.265409 Aug 18 11:41:47.196098 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1958/3772] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:46 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:47.229045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-304a6b3b-b361-4b02-a6c5-9cf682e6452a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:47.229719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-304a6b3b-b361-4b02-a6c5-9cf682e6452a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:47.230269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-304a6b3b-b361-4b02-a6c5-9cf682e6452a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:47.231221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-304a6b3b-b361-4b02-a6c5-9cf682e6452a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:47.232427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-304a6b3b-b361-4b02-a6c5-9cf682e6452a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:47.241256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-304a6b3b-b361-4b02-a6c5-9cf682e6452a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:47.246656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e5ff96da-c517-4fdc-8a5f-f2fa1b5f1f91 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:47.248301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e5ff96da-c517-4fdc-8a5f-f2fa1b5f1f91 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:47.269432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5ff96da-c517-4fdc-8a5f-f2fa1b5f1f91 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:47.273141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5ff96da-c517-4fdc-8a5f-f2fa1b5f1f91 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:47.273882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5ff96da-c517-4fdc-8a5f-f2fa1b5f1f91 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:47.277539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5ff96da-c517-4fdc-8a5f-f2fa1b5f1f91 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:47.278295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5ff96da-c517-4fdc-8a5f-f2fa1b5f1f91 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:47.279021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5ff96da-c517-4fdc-8a5f-f2fa1b5f1f91 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:47.349851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5ff96da-c517-4fdc-8a5f-f2fa1b5f1f91 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:47.351008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5ff96da-c517-4fdc-8a5f-f2fa1b5f1f91 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:47.351980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5ff96da-c517-4fdc-8a5f-f2fa1b5f1f91 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:47.352906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-e5ff96da-c517-4fdc-8a5f-f2fa1b5f1f91 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lazy-loading 'fault' on Instance uuid d6f665d8-ddd8-4030-be59-efb1140ef80e {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:41:47.449218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e5ff96da-c517-4fdc-8a5f-f2fa1b5f1f91 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5599d0754399a32a3ae3431ff18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d9eeb4297f442694052b28a297d9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:47.490943 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e5ff96da-c517-4fdc-8a5f-f2fa1b5f1f91 tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 200 len: 1311 microversion: 2.1 time: 0.292558 Aug 18 11:41:47.492801 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1959/3773] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:47 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 1311 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:47.674932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-304a6b3b-b361-4b02-a6c5-9cf682e6452a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:47.726588 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-304a6b3b-b361-4b02-a6c5-9cf682e6452a tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1647 microversion: 2.1 time: 0.547548 Aug 18 11:41:47.746469 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1815/3774] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:47 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1647 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:47.751172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-71fab074-83a4-4cad-a085-d9193af81cd8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:47.752681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-71fab074-83a4-4cad-a085-d9193af81cd8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:47.774951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71fab074-83a4-4cad-a085-d9193af81cd8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:47.782003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71fab074-83a4-4cad-a085-d9193af81cd8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:47.784368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71fab074-83a4-4cad-a085-d9193af81cd8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:47.788087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71fab074-83a4-4cad-a085-d9193af81cd8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:47.792827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71fab074-83a4-4cad-a085-d9193af81cd8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:47.794462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71fab074-83a4-4cad-a085-d9193af81cd8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:47.960607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e582ea1d-5d82-4b75-8125-ccc5f23dce78 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:47.962413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e582ea1d-5d82-4b75-8125-ccc5f23dce78 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:47.990769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e582ea1d-5d82-4b75-8125-ccc5f23dce78 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:47.991379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e582ea1d-5d82-4b75-8125-ccc5f23dce78 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:47.995013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e582ea1d-5d82-4b75-8125-ccc5f23dce78 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:47.999421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e582ea1d-5d82-4b75-8125-ccc5f23dce78 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:48.011443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e582ea1d-5d82-4b75-8125-ccc5f23dce78 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:48.011919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e582ea1d-5d82-4b75-8125-ccc5f23dce78 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:48.144239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-71fab074-83a4-4cad-a085-d9193af81cd8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:48.155915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-71fab074-83a4-4cad-a085-d9193af81cd8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:48.160145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-71fab074-83a4-4cad-a085-d9193af81cd8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:48.161674 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-71fab074-83a4-4cad-a085-d9193af81cd8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1359 microversion: 2.21 time: 0.419645 Aug 18 11:41:48.179288 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1960/3775] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:47 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1359 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:41:48.233092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d45075d9-418f-4346-a544-f21393904eee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:48.234126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d45075d9-418f-4346-a544-f21393904eee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:48.249631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d45075d9-418f-4346-a544-f21393904eee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:48.251097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d45075d9-418f-4346-a544-f21393904eee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:48.254395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d45075d9-418f-4346-a544-f21393904eee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:48.256332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d45075d9-418f-4346-a544-f21393904eee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:48.258557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d45075d9-418f-4346-a544-f21393904eee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:48.260508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d45075d9-418f-4346-a544-f21393904eee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:48.362833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e582ea1d-5d82-4b75-8125-ccc5f23dce78 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:48.379478 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e582ea1d-5d82-4b75-8125-ccc5f23dce78 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1314 microversion: 2.1 time: 0.426573 Aug 18 11:41:48.384394 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1816/3776] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:47 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:48.399360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d45075d9-418f-4346-a544-f21393904eee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:48.413435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d45075d9-418f-4346-a544-f21393904eee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:48.415748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d45075d9-418f-4346-a544-f21393904eee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:48.417858 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d45075d9-418f-4346-a544-f21393904eee tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.189286 Aug 18 11:41:48.419440 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1961/3777] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:48 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:41:48.526079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9af7b97d-2a5e-499f-baa3-8471364cc2cd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:48.526886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9af7b97d-2a5e-499f-baa3-8471364cc2cd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] [instance: d6f665d8-ddd8-4030-be59-efb1140ef80e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:48.540761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9af7b97d-2a5e-499f-baa3-8471364cc2cd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:48.544030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9af7b97d-2a5e-499f-baa3-8471364cc2cd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:48.545847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9af7b97d-2a5e-499f-baa3-8471364cc2cd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:48.547976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9af7b97d-2a5e-499f-baa3-8471364cc2cd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:48.550274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9af7b97d-2a5e-499f-baa3-8471364cc2cd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:48.551559 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9af7b97d-2a5e-499f-baa3-8471364cc2cd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:48.615759 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-9af7b97d-2a5e-499f-baa3-8471364cc2cd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] HTTP exception thrown: Instance d6f665d8-ddd8-4030-be59-efb1140ef80e could not be found. Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9af7b97d-2a5e-499f-baa3-8471364cc2cd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Request method failure captured: Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e HTTP/1.1 Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iRDccV-wQBjWbehYJnvnYrqtEvDPnmmRi9FdLn90jlDwmLP7Yu8AV-Xjh3sRI2h6VdTdDxREaF_4Uw5JAlLnmy-pOyTW0C8AnpTCeGTveMx08cuhXqa0wk4T8c8YQiDTyaAtMLbCc_qByCh4ZjwOdEPthe4EaqbP1499Gbu30qZ6g8 Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/00d9eeb4297f442694052b28a297d9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 00d9eeb4297f442694052b28a297d9a3 Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201576400 Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4eea5599d0754399a32a3ae3431ff18f Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201576400-project Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance d6f665d8-ddd8-4030-be59-efb1140ef80e could not be found. Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'd6f665d8-ddd8-4030-be59-efb1140ef80e'} Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f665d8-ddd8-4030-be59-efb1140ef80e could not be found. Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f665d8-ddd8-4030-be59-efb1140ef80e could not be found. Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:48.623819 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:48.628320 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:48.628320 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:48.628320 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:48.628320 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:48.628320 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:48.628320 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:48.628320 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f665d8-ddd8-4030-be59-efb1140ef80e could not be found. Aug 18 11:41:48.628320 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:48.631638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9af7b97d-2a5e-499f-baa3-8471364cc2cd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] Returning 404 to user: Instance d6f665d8-ddd8-4030-be59-efb1140ef80e could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:48.634026 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9af7b97d-2a5e-499f-baa3-8471364cc2cd tempest-ServerRescueNegativeTestJSON-201576400 tempest-ServerRescueNegativeTestJSON-201576400-project] 10.222.0.73 "GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e" status: 404 len: 111 microversion: 2.1 time: 0.122081 Aug 18 11:41:48.637136 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1817/3778] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:48 2022] GET /compute/v2.1/servers/d6f665d8-ddd8-4030-be59-efb1140ef80e => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:48.762719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2dd18295-b5ce-43b6-94e0-d18073ff2461 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:48.763795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2dd18295-b5ce-43b6-94e0-d18073ff2461 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:48.770382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:48.782286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2dd18295-b5ce-43b6-94e0-d18073ff2461 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:48.784054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2dd18295-b5ce-43b6-94e0-d18073ff2461 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:48.784860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2dd18295-b5ce-43b6-94e0-d18073ff2461 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:48.785759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2dd18295-b5ce-43b6-94e0-d18073ff2461 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:48.788575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2dd18295-b5ce-43b6-94e0-d18073ff2461 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:48.790070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2dd18295-b5ce-43b6-94e0-d18073ff2461 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:48.976528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-713dee08-accd-45ca-8998-b1ce39c9c977 req-76ec0fa2-caae-4573-bc30-e862674a7214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2faffeb5-20db-4e86-b94b-1c4e1125c8e4", "name": "network-vif-plugged", "status": "completed", "tag": "63113096-c75d-451f-8de7-d895a5c8a062"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:49.000195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-713dee08-accd-45ca-8998-b1ce39c9c977 req-76ec0fa2-caae-4573-bc30-e862674a7214 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:49.001875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-713dee08-accd-45ca-8998-b1ce39c9c977 req-76ec0fa2-caae-4573-bc30-e862674a7214 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:49.003635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-713dee08-accd-45ca-8998-b1ce39c9c977 req-76ec0fa2-caae-4573-bc30-e862674a7214 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:49.022121 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-713dee08-accd-45ca-8998-b1ce39c9c977 req-76ec0fa2-caae-4573-bc30-e862674a7214 service nova] Creating event network-vif-plugged:63113096-c75d-451f-8de7-d895a5c8a062 for instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 on n-h2-853611-3 Aug 18 11:41:49.028341 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-713dee08-accd-45ca-8998-b1ce39c9c977 req-76ec0fa2-caae-4573-bc30-e862674a7214 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060894 Aug 18 11:41:49.029542 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1818/3779] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:49.187501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-26c3543c-d585-4a80-8f9b-163e6e583ab4 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:49.188222 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-26c3543c-d585-4a80-8f9b-163e6e583ab4 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:49.196003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26c3543c-d585-4a80-8f9b-163e6e583ab4 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:49.196486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26c3543c-d585-4a80-8f9b-163e6e583ab4 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:49.197062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26c3543c-d585-4a80-8f9b-163e6e583ab4 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:49.197749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26c3543c-d585-4a80-8f9b-163e6e583ab4 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:49.198204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26c3543c-d585-4a80-8f9b-163e6e583ab4 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:49.198674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26c3543c-d585-4a80-8f9b-163e6e583ab4 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:49.686930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-26c3543c-d585-4a80-8f9b-163e6e583ab4 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:49.725848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-26c3543c-d585-4a80-8f9b-163e6e583ab4 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:49.730350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-26c3543c-d585-4a80-8f9b-163e6e583ab4 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:49.732592 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-26c3543c-d585-4a80-8f9b-163e6e583ab4 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1359 microversion: 2.21 time: 0.550790 Aug 18 11:41:49.734016 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1819/3780] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:49 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1359 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:49.744998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-48fa06d5-5e20-451d-a721-706b64be0b7b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:49.747565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-48fa06d5-5e20-451d-a721-706b64be0b7b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:49.761100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48fa06d5-5e20-451d-a721-706b64be0b7b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:49.762129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48fa06d5-5e20-451d-a721-706b64be0b7b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:49.762327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2dd18295-b5ce-43b6-94e0-d18073ff2461 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:49.762959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48fa06d5-5e20-451d-a721-706b64be0b7b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:49.764227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48fa06d5-5e20-451d-a721-706b64be0b7b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:49.764643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:49.766100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48fa06d5-5e20-451d-a721-706b64be0b7b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:49.768057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48fa06d5-5e20-451d-a721-706b64be0b7b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:49.776189 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2dd18295-b5ce-43b6-94e0-d18073ff2461 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1647 microversion: 2.1 time: 1.017405 Aug 18 11:41:49.787133 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1962/3781] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:48 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1647 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:41:49.810400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-16e20a8c-147f-4ebb-a9a8-f6dcae3a822e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:49.816702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-16e20a8c-147f-4ebb-a9a8-f6dcae3a822e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:49.830173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16e20a8c-147f-4ebb-a9a8-f6dcae3a822e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:49.831891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16e20a8c-147f-4ebb-a9a8-f6dcae3a822e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:49.833051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16e20a8c-147f-4ebb-a9a8-f6dcae3a822e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:49.834660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16e20a8c-147f-4ebb-a9a8-f6dcae3a822e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:49.835859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16e20a8c-147f-4ebb-a9a8-f6dcae3a822e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:49.836996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16e20a8c-147f-4ebb-a9a8-f6dcae3a822e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:50.028930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-16e20a8c-147f-4ebb-a9a8-f6dcae3a822e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:50.040365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-16e20a8c-147f-4ebb-a9a8-f6dcae3a822e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:50.042030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-16e20a8c-147f-4ebb-a9a8-f6dcae3a822e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:50.043577 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-16e20a8c-147f-4ebb-a9a8-f6dcae3a822e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.254611 Aug 18 11:41:50.056830 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1963/3782] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:49 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:50.063814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-834f0bc3-6c03-49c3-b684-3ed1dbf6b0a5 req-0e613fec-5c8d-4f2f-b34d-402ec5d41276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3", "tag": "77b3ef64-9f58-4eb7-8e39-1baf558ebecc"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:50.075839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-834f0bc3-6c03-49c3-b684-3ed1dbf6b0a5 req-0e613fec-5c8d-4f2f-b34d-402ec5d41276 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:50.076552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-834f0bc3-6c03-49c3-b684-3ed1dbf6b0a5 req-0e613fec-5c8d-4f2f-b34d-402ec5d41276 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:50.077011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-834f0bc3-6c03-49c3-b684-3ed1dbf6b0a5 req-0e613fec-5c8d-4f2f-b34d-402ec5d41276 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:50.095661 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-834f0bc3-6c03-49c3-b684-3ed1dbf6b0a5 req-0e613fec-5c8d-4f2f-b34d-402ec5d41276 service nova] Creating event network-changed:77b3ef64-9f58-4eb7-8e39-1baf558ebecc for instance ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 on n-h1-853611-3 Aug 18 11:41:50.101268 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-834f0bc3-6c03-49c3-b684-3ed1dbf6b0a5 req-0e613fec-5c8d-4f2f-b34d-402ec5d41276 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041763 Aug 18 11:41:50.101723 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1964/3783] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:50.306465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-48fa06d5-5e20-451d-a721-706b64be0b7b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:50.322691 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-48fa06d5-5e20-451d-a721-706b64be0b7b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1314 microversion: 2.1 time: 0.586834 Aug 18 11:41:50.323608 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1820/3784] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:49 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:50.693689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-e8472f58-9d8b-466f-a7a6-873690f6a441 req-f53d8c7e-6a5c-4d72-b10c-48c5cbb9bb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8347e97a-e013-461c-b858-2fc8c6a505d5", "name": "network-vif-deleted", "tag": "b0ee35ef-ab7e-4ce7-a28a-562b36cc60d5"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:50.743225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e8472f58-9d8b-466f-a7a6-873690f6a441 req-f53d8c7e-6a5c-4d72-b10c-48c5cbb9bb93 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:50.752319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e8472f58-9d8b-466f-a7a6-873690f6a441 req-f53d8c7e-6a5c-4d72-b10c-48c5cbb9bb93 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:50.755601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e8472f58-9d8b-466f-a7a6-873690f6a441 req-f53d8c7e-6a5c-4d72-b10c-48c5cbb9bb93 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:50.784410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ca532f60-88cf-4ad0-bf18-237a43ac5789 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:50.785496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ca532f60-88cf-4ad0-bf18-237a43ac5789 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:50.814205 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e8472f58-9d8b-466f-a7a6-873690f6a441 req-f53d8c7e-6a5c-4d72-b10c-48c5cbb9bb93 service nova] Creating event network-vif-deleted:b0ee35ef-ab7e-4ce7-a28a-562b36cc60d5 for instance 8347e97a-e013-461c-b858-2fc8c6a505d5 on n-h2-853611-3 Aug 18 11:41:50.816346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca532f60-88cf-4ad0-bf18-237a43ac5789 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:50.817015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca532f60-88cf-4ad0-bf18-237a43ac5789 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:50.817585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca532f60-88cf-4ad0-bf18-237a43ac5789 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:50.818656 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca532f60-88cf-4ad0-bf18-237a43ac5789 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:50.819242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca532f60-88cf-4ad0-bf18-237a43ac5789 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:50.819812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca532f60-88cf-4ad0-bf18-237a43ac5789 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:50.846700 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-e8472f58-9d8b-466f-a7a6-873690f6a441 req-f53d8c7e-6a5c-4d72-b10c-48c5cbb9bb93 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164948 Aug 18 11:41:50.849318 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1965/3785] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:50.884136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c693ca84-f36f-4ce2-ab4f-0b0a01de1401 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:50.889005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c693ca84-f36f-4ce2-ab4f-0b0a01de1401 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:50.956342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c693ca84-f36f-4ce2-ab4f-0b0a01de1401 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:50.960089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c693ca84-f36f-4ce2-ab4f-0b0a01de1401 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:50.960997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c693ca84-f36f-4ce2-ab4f-0b0a01de1401 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:50.962324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c693ca84-f36f-4ce2-ab4f-0b0a01de1401 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:50.963215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c693ca84-f36f-4ce2-ab4f-0b0a01de1401 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:50.964013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c693ca84-f36f-4ce2-ab4f-0b0a01de1401 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:51.137644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c693ca84-f36f-4ce2-ab4f-0b0a01de1401 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:51.138311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c693ca84-f36f-4ce2-ab4f-0b0a01de1401 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:51.138814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c693ca84-f36f-4ce2-ab4f-0b0a01de1401 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:51.140700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-c693ca84-f36f-4ce2-ab4f-0b0a01de1401 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lazy-loading 'fault' on Instance uuid 8347e97a-e013-461c-b858-2fc8c6a505d5 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:41:51.216296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c693ca84-f36f-4ce2-ab4f-0b0a01de1401 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:51.227133 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c693ca84-f36f-4ce2-ab4f-0b0a01de1401 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 200 len: 1306 microversion: 2.1 time: 0.375015 Aug 18 11:41:51.231733 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1966/3786] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:50 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 1306 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:51.248277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b3296f24-3068-41ba-af63-278184478c9e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:51.249035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b3296f24-3068-41ba-af63-278184478c9e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:51.257090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ca532f60-88cf-4ad0-bf18-237a43ac5789 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:51.258476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3296f24-3068-41ba-af63-278184478c9e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:51.259846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3296f24-3068-41ba-af63-278184478c9e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:51.260888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3296f24-3068-41ba-af63-278184478c9e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:51.263844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3296f24-3068-41ba-af63-278184478c9e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:51.265479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3296f24-3068-41ba-af63-278184478c9e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:51.266604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3296f24-3068-41ba-af63-278184478c9e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:51.270678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ca532f60-88cf-4ad0-bf18-237a43ac5789 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:51.273280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ca532f60-88cf-4ad0-bf18-237a43ac5789 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:51.274967 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ca532f60-88cf-4ad0-bf18-237a43ac5789 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1359 microversion: 2.21 time: 0.498141 Aug 18 11:41:51.275582 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1821/3787] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:50 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1359 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:51.378204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-82c7d91f-d4d8-44d4-8b19-764321621e87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:51.380498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-82c7d91f-d4d8-44d4-8b19-764321621e87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:51.396209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82c7d91f-d4d8-44d4-8b19-764321621e87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:51.403108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82c7d91f-d4d8-44d4-8b19-764321621e87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:51.405306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82c7d91f-d4d8-44d4-8b19-764321621e87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:51.410761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82c7d91f-d4d8-44d4-8b19-764321621e87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:51.412639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82c7d91f-d4d8-44d4-8b19-764321621e87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:51.419653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b3296f24-3068-41ba-af63-278184478c9e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:51.419836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82c7d91f-d4d8-44d4-8b19-764321621e87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:51.431256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b3296f24-3068-41ba-af63-278184478c9e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:51.434209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b3296f24-3068-41ba-af63-278184478c9e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:51.436941 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b3296f24-3068-41ba-af63-278184478c9e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.201347 Aug 18 11:41:51.456196 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1967/3788] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:51 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:51.958672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-82c7d91f-d4d8-44d4-8b19-764321621e87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:51.975756 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-82c7d91f-d4d8-44d4-8b19-764321621e87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1314 microversion: 2.1 time: 0.619586 Aug 18 11:41:51.978185 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1822/3789] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:51 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:52.252848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8ac1fdcd-45d6-45a0-8700-c5ba0596e7bf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:52.254098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8ac1fdcd-45d6-45a0-8700-c5ba0596e7bf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:52.262768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ac1fdcd-45d6-45a0-8700-c5ba0596e7bf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:52.263664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ac1fdcd-45d6-45a0-8700-c5ba0596e7bf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:52.264330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ac1fdcd-45d6-45a0-8700-c5ba0596e7bf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:52.265322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ac1fdcd-45d6-45a0-8700-c5ba0596e7bf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:52.266112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ac1fdcd-45d6-45a0-8700-c5ba0596e7bf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:52.267343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ac1fdcd-45d6-45a0-8700-c5ba0596e7bf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:52.287244 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-8ac1fdcd-45d6-45a0-8700-c5ba0596e7bf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8ac1fdcd-45d6-45a0-8700-c5ba0596e7bf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 HTTP/1.1 Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '8347e97a-e013-461c-b858-2fc8c6a505d5'} Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:52.307798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:52.320606 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:52.320606 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:52.320606 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:52.320606 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:52.320606 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:52.320606 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:52.320606 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:52.325212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-020b007c-9e00-4e9c-9d8f-1fabb813da75 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:52.325212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-020b007c-9e00-4e9c-9d8f-1fabb813da75 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:52.326085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8ac1fdcd-45d6-45a0-8700-c5ba0596e7bf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 404 to user: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:52.326085 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8ac1fdcd-45d6-45a0-8700-c5ba0596e7bf tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 404 len: 111 microversion: 2.1 time: 0.074089 Aug 18 11:41:52.326085 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1968/3790] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:52 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:52.332003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7ac493ca-e979-4a31-8a6c-3b60a235e32f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519f598e50>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:52.344465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-020b007c-9e00-4e9c-9d8f-1fabb813da75 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:52.346586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-020b007c-9e00-4e9c-9d8f-1fabb813da75 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:52.348324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-020b007c-9e00-4e9c-9d8f-1fabb813da75 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:52.350058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-020b007c-9e00-4e9c-9d8f-1fabb813da75 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:52.351316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-020b007c-9e00-4e9c-9d8f-1fabb813da75 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:52.353031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-020b007c-9e00-4e9c-9d8f-1fabb813da75 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:52.898484 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7ac493ca-e979-4a31-8a6c-3b60a235e32f tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/56d4c72d-132e-478a-b348-34b89ce085cc" status: 202 len: 0 microversion: 2.1 time: 0.570657 Aug 18 11:41:52.899654 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1969/3791] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:52 2022] DELETE /compute/v2.1/os-security-groups/56d4c72d-132e-478a-b348-34b89ce085cc => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:41:52.908728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1eee46da-8db0-4c83-957c-b5322a2ba1fb tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:52.909367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1eee46da-8db0-4c83-957c-b5322a2ba1fb tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:52.919167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eee46da-8db0-4c83-957c-b5322a2ba1fb tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:52.919666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eee46da-8db0-4c83-957c-b5322a2ba1fb tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:52.920108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eee46da-8db0-4c83-957c-b5322a2ba1fb tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:52.920849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eee46da-8db0-4c83-957c-b5322a2ba1fb tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:52.926109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eee46da-8db0-4c83-957c-b5322a2ba1fb tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:52.926717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eee46da-8db0-4c83-957c-b5322a2ba1fb tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:53.142167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1eee46da-8db0-4c83-957c-b5322a2ba1fb tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:53.187105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1eee46da-8db0-4c83-957c-b5322a2ba1fb tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:53.197565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1eee46da-8db0-4c83-957c-b5322a2ba1fb tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:53.212563 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1eee46da-8db0-4c83-957c-b5322a2ba1fb tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.305203 Aug 18 11:41:53.214634 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1970/3792] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:52 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:53.227161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-18d3b5c8-432f-41e7-89fc-aae0fb096ac1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f51b0de0550>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:53.250662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:53.265259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:53.440521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-020b007c-9e00-4e9c-9d8f-1fabb813da75 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:53.448828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:53.490670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-020b007c-9e00-4e9c-9d8f-1fabb813da75 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:53.495426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-020b007c-9e00-4e9c-9d8f-1fabb813da75 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:53.500306 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-020b007c-9e00-4e9c-9d8f-1fabb813da75 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1553 microversion: 2.21 time: 1.203873 Aug 18 11:41:53.503526 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1823/3793] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:52 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1553 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:53.517685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4a71592e-dbbb-4647-bd74-465ac31ecfa3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:53.519502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4a71592e-dbbb-4647-bd74-465ac31ecfa3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:53.531495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:53.544292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a71592e-dbbb-4647-bd74-465ac31ecfa3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:53.545105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a71592e-dbbb-4647-bd74-465ac31ecfa3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:53.546161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a71592e-dbbb-4647-bd74-465ac31ecfa3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:53.546956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a71592e-dbbb-4647-bd74-465ac31ecfa3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:53.547415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a71592e-dbbb-4647-bd74-465ac31ecfa3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:53.547890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a71592e-dbbb-4647-bd74-465ac31ecfa3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:53.905579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4a71592e-dbbb-4647-bd74-465ac31ecfa3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:53.914228 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4a71592e-dbbb-4647-bd74-465ac31ecfa3 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1314 microversion: 2.1 time: 0.408847 Aug 18 11:41:53.915192 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1824/3794] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:53 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:53.951537 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-18d3b5c8-432f-41e7-89fc-aae0fb096ac1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/a37b0cbe-d64d-464a-949e-e21c161b47cb" status: 202 len: 0 microversion: 2.1 time: 0.734438 Aug 18 11:41:53.954671 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1971/3795] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:53 2022] DELETE /compute/v2.1/os-security-groups/a37b0cbe-d64d-464a-949e-e21c161b47cb => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:41:53.968665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e2665ac4-41d9-4979-b7bc-55fa4db8d8d8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:53.978101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e2665ac4-41d9-4979-b7bc-55fa4db8d8d8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:53.994792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2665ac4-41d9-4979-b7bc-55fa4db8d8d8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:53.995112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2665ac4-41d9-4979-b7bc-55fa4db8d8d8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:54.002995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2665ac4-41d9-4979-b7bc-55fa4db8d8d8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:54.004120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2665ac4-41d9-4979-b7bc-55fa4db8d8d8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:54.007582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2665ac4-41d9-4979-b7bc-55fa4db8d8d8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:54.008259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=11 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:54.010736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2665ac4-41d9-4979-b7bc-55fa4db8d8d8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:54.083788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e2665ac4-41d9-4979-b7bc-55fa4db8d8d8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:41:54.282793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1976586563", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:54.289928 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e2665ac4-41d9-4979-b7bc-55fa4db8d8d8 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 204 len: 0 microversion: 2.21 time: 0.333067 Aug 18 11:41:54.295435 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1972/3796] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:41:53 2022] DELETE /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:41:54.315924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-93abbb3a-39df-4262-a24a-f672cb468acb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'create', calling method: .version_select at 0x7f519ed42940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1254891455", "description": "tempest-description-680698494"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:54.317514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=42 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:54.419927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:41:54.670510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:41:54.671302 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:41:54.672787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:41:54.675411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:41:54.676354 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:41:54.703409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:54.704803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:54.705651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:54.708080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:54.709326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:54.717191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:54.775250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Getting quotas for project f2b7dd922df047a6bca547f351fc8336. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:41:54.789287 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Getting quotas for user cde3eaabd92348479ab9d0e994889e2d and project f2b7dd922df047a6bca547f351fc8336. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:41:54.813414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:41:54.816322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:41:54.892392 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-294d7012-0ea7-41ad-8fc5-a2b6256faf3d tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974730 Aug 18 11:41:54.896665 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1825/3797] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:41:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:41:54.904910 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-93abbb3a-39df-4262-a24a-f672cb468acb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.607932 Aug 18 11:41:54.909995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1212ccc2-1bad-41a8-9652-0114da608d72 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:54.911648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1212ccc2-1bad-41a8-9652-0114da608d72 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:54.914637 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1973/3798] 10.222.0.73 () {60 vars in 1180 bytes} [Thu Aug 18 11:41:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:54.919860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7c28b46a-5b57-4d7c-b641-b9e3c41d84ee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:54.921077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7c28b46a-5b57-4d7c-b641-b9e3c41d84ee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:54.921579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1212ccc2-1bad-41a8-9652-0114da608d72 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:54.922222 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1212ccc2-1bad-41a8-9652-0114da608d72 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:54.923574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1212ccc2-1bad-41a8-9652-0114da608d72 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:54.925286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1212ccc2-1bad-41a8-9652-0114da608d72 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:54.926965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1212ccc2-1bad-41a8-9652-0114da608d72 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:54.934351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c28b46a-5b57-4d7c-b641-b9e3c41d84ee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:54.935374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c28b46a-5b57-4d7c-b641-b9e3c41d84ee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:54.936094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c28b46a-5b57-4d7c-b641-b9e3c41d84ee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:54.937033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c28b46a-5b57-4d7c-b641-b9e3c41d84ee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:54.937904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c28b46a-5b57-4d7c-b641-b9e3c41d84ee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:54.939868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c28b46a-5b57-4d7c-b641-b9e3c41d84ee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:54.942837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1212ccc2-1bad-41a8-9652-0114da608d72 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:55.176441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c28b46a-5b57-4d7c-b641-b9e3c41d84ee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:55.186272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c28b46a-5b57-4d7c-b641-b9e3c41d84ee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:55.191612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1212ccc2-1bad-41a8-9652-0114da608d72 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:55.191918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c28b46a-5b57-4d7c-b641-b9e3c41d84ee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:55.193323 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7c28b46a-5b57-4d7c-b641-b9e3c41d84ee tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1559 microversion: 2.21 time: 0.277436 Aug 18 11:41:55.194641 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1974/3799] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:54 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1559 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:55.202470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1212ccc2-1bad-41a8-9652-0114da608d72 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:55.205108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1212ccc2-1bad-41a8-9652-0114da608d72 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:55.206754 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1212ccc2-1bad-41a8-9652-0114da608d72 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.308405 Aug 18 11:41:55.208167 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1826/3800] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:54 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:55.213755 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-de5f2ea0-17c5-4844-9538-dc18260cbb10 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Action: 'update', calling method: .version_select at 0x7f519ec8fdc0>, body: {"security_group": {"name": "tempest-sg-hth-208230921", "description": "tempest-description-hth-1577032967"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:55.224148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cba3a0d8-f9c4-4a61-a2d8-6bb8709c36a4 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:55.225189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cba3a0d8-f9c4-4a61-a2d8-6bb8709c36a4 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:55.319434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cba3a0d8-f9c4-4a61-a2d8-6bb8709c36a4 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:55.340661 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cba3a0d8-f9c4-4a61-a2d8-6bb8709c36a4 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1214 microversion: 2.1 time: 0.131323 Aug 18 11:41:55.341785 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1975/3801] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:55 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:55.348981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d5c5c0e4-e178-4d4d-a86d-66134f250694 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:55.350760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d5c5c0e4-e178-4d4d-a86d-66134f250694 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:55.374859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5c5c0e4-e178-4d4d-a86d-66134f250694 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:55.379172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5c5c0e4-e178-4d4d-a86d-66134f250694 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:55.393720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5c5c0e4-e178-4d4d-a86d-66134f250694 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:55.394965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5c5c0e4-e178-4d4d-a86d-66134f250694 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:55.399456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5c5c0e4-e178-4d4d-a86d-66134f250694 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:55.400247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5c5c0e4-e178-4d4d-a86d-66134f250694 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:55.576408 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-de5f2ea0-17c5-4844-9538-dc18260cbb10 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "PUT /compute/v2.1/os-security-groups/1622e8fd-e8d9-4c07-8849-97268e6d07f9" status: 200 len: 217 microversion: 2.1 time: 0.366490 Aug 18 11:41:55.578498 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1827/3802] 10.222.0.73 () {60 vars in 1290 bytes} [Thu Aug 18 11:41:55 2022] PUT /compute/v2.1/os-security-groups/1622e8fd-e8d9-4c07-8849-97268e6d07f9 => generated 217 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:55.585830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-28737a18-47da-4b4e-9b20-6049c0862128 req-31b7013e-b9fb-480b-a833-794f9ff72ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3", "name": "network-vif-plugged", "status": "completed", "tag": "77b3ef64-9f58-4eb7-8e39-1baf558ebecc"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:55.620348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-28737a18-47da-4b4e-9b20-6049c0862128 req-31b7013e-b9fb-480b-a833-794f9ff72ea9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:55.621038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-28737a18-47da-4b4e-9b20-6049c0862128 req-31b7013e-b9fb-480b-a833-794f9ff72ea9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:55.621886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-28737a18-47da-4b4e-9b20-6049c0862128 req-31b7013e-b9fb-480b-a833-794f9ff72ea9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:55.681424 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-28737a18-47da-4b4e-9b20-6049c0862128 req-31b7013e-b9fb-480b-a833-794f9ff72ea9 service nova] Creating event network-vif-plugged:77b3ef64-9f58-4eb7-8e39-1baf558ebecc for instance ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 on n-h1-853611-3 Aug 18 11:41:55.699120 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-28737a18-47da-4b4e-9b20-6049c0862128 req-31b7013e-b9fb-480b-a833-794f9ff72ea9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118029 Aug 18 11:41:55.700943 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1828/3803] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:55.727584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bbce38e7-d14a-4ea9-8013-ce5b0df9f88b tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519ec50820>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:55.941591 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bbce38e7-d14a-4ea9-8013-ce5b0df9f88b tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/os-security-groups/1622e8fd-e8d9-4c07-8849-97268e6d07f9" status: 200 len: 217 microversion: 2.1 time: 0.235417 Aug 18 11:41:55.956129 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1829/3804] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:41:55 2022] GET /compute/v2.1/os-security-groups/1622e8fd-e8d9-4c07-8849-97268e6d07f9 => generated 217 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:55.966002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d5c5c0e4-e178-4d4d-a86d-66134f250694 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:55.978691 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d5c5c0e4-e178-4d4d-a86d-66134f250694 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1314 microversion: 2.1 time: 0.632889 Aug 18 11:41:55.979776 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1976/3805] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:55 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:55.988749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-51385740-344e-4bb4-a143-438509e38a89 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519ec2a9d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:56.238196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-32de65a0-4d5a-417d-9f92-506777b97d3b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:56.239954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-32de65a0-4d5a-417d-9f92-506777b97d3b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:56.256547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32de65a0-4d5a-417d-9f92-506777b97d3b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:56.257449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32de65a0-4d5a-417d-9f92-506777b97d3b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:56.258138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32de65a0-4d5a-417d-9f92-506777b97d3b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:56.259165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32de65a0-4d5a-417d-9f92-506777b97d3b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:56.261778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32de65a0-4d5a-417d-9f92-506777b97d3b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:56.262261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32de65a0-4d5a-417d-9f92-506777b97d3b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:56.454019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-32de65a0-4d5a-417d-9f92-506777b97d3b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:56.472194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-32de65a0-4d5a-417d-9f92-506777b97d3b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:56.474744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-32de65a0-4d5a-417d-9f92-506777b97d3b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:56.477395 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-32de65a0-4d5a-417d-9f92-506777b97d3b tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.244538 Aug 18 11:41:56.478256 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1977/3806] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:56 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:56.507475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6372b3ea-8906-4eb0-9688-3452c8b9a333 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:56.512184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6372b3ea-8906-4eb0-9688-3452c8b9a333 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:56.533761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6372b3ea-8906-4eb0-9688-3452c8b9a333 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:56.534456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6372b3ea-8906-4eb0-9688-3452c8b9a333 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:56.535359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6372b3ea-8906-4eb0-9688-3452c8b9a333 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:56.535961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6372b3ea-8906-4eb0-9688-3452c8b9a333 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:56.536436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6372b3ea-8906-4eb0-9688-3452c8b9a333 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:56.543242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6372b3ea-8906-4eb0-9688-3452c8b9a333 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:56.547272 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-51385740-344e-4bb4-a143-438509e38a89 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/1622e8fd-e8d9-4c07-8849-97268e6d07f9" status: 202 len: 0 microversion: 2.1 time: 0.585929 Aug 18 11:41:56.548892 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1830/3807] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:55 2022] DELETE /compute/v2.1/os-security-groups/1622e8fd-e8d9-4c07-8849-97268e6d07f9 => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:41:56.556133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-59ab464c-ceb8-4866-9a53-ee14c79144d7 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:56.556875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-59ab464c-ceb8-4866-9a53-ee14c79144d7 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:56.566475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59ab464c-ceb8-4866-9a53-ee14c79144d7 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:56.566987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59ab464c-ceb8-4866-9a53-ee14c79144d7 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:56.567429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59ab464c-ceb8-4866-9a53-ee14c79144d7 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:56.568149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59ab464c-ceb8-4866-9a53-ee14c79144d7 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:56.568609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59ab464c-ceb8-4866-9a53-ee14c79144d7 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:56.569039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59ab464c-ceb8-4866-9a53-ee14c79144d7 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:56.732169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-59ab464c-ceb8-4866-9a53-ee14c79144d7 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:56.751477 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-59ab464c-ceb8-4866-9a53-ee14c79144d7 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1266 microversion: 2.1 time: 0.193351 Aug 18 11:41:56.752327 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1831/3808] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:56 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:56.768810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4eca9928-eda2-46ab-8235-37e039aebe92 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:56.769522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4eca9928-eda2-46ab-8235-37e039aebe92 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:56.777030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4eca9928-eda2-46ab-8235-37e039aebe92 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:56.777907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4eca9928-eda2-46ab-8235-37e039aebe92 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:56.778783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4eca9928-eda2-46ab-8235-37e039aebe92 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:56.780003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4eca9928-eda2-46ab-8235-37e039aebe92 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:56.780929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4eca9928-eda2-46ab-8235-37e039aebe92 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:56.781571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4eca9928-eda2-46ab-8235-37e039aebe92 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:56.800805 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-4eca9928-eda2-46ab-8235-37e039aebe92 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4eca9928-eda2-46ab-8235-37e039aebe92 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 HTTP/1.1 Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '8347e97a-e013-461c-b858-2fc8c6a505d5'} Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:56.804367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:56.808628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:56.808628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.808628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:56.808628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.808628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:56.808628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:56.808628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:56.808628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:56.808628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:56.808628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:56.808628 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.811019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4eca9928-eda2-46ab-8235-37e039aebe92 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 404 to user: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:56.812168 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4eca9928-eda2-46ab-8235-37e039aebe92 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 404 len: 111 microversion: 2.1 time: 0.054183 Aug 18 11:41:56.813732 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1832/3809] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:41:56 2022] DELETE /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:56.833003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-257b8bc5-b1f3-44a9-b9c9-2be7273f5adb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:56.835595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-257b8bc5-b1f3-44a9-b9c9-2be7273f5adb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 8347e97a-e013-461c-b858-2fc8c6a505d5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:56.852070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-257b8bc5-b1f3-44a9-b9c9-2be7273f5adb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:56.852459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-257b8bc5-b1f3-44a9-b9c9-2be7273f5adb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:56.853172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-257b8bc5-b1f3-44a9-b9c9-2be7273f5adb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:56.854192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-257b8bc5-b1f3-44a9-b9c9-2be7273f5adb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:56.854860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-257b8bc5-b1f3-44a9-b9c9-2be7273f5adb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:56.855878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-257b8bc5-b1f3-44a9-b9c9-2be7273f5adb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:56.880512 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-257b8bc5-b1f3-44a9-b9c9-2be7273f5adb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-257b8bc5-b1f3-44a9-b9c9-2be7273f5adb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 HTTP/1.1 Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '8347e97a-e013-461c-b858-2fc8c6a505d5'} Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:56.882086 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.887193 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:56.887193 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:56.887193 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:56.887193 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:56.887193 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:56.887193 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. Aug 18 11:41:56.887193 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.887193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-257b8bc5-b1f3-44a9-b9c9-2be7273f5adb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 404 to user: Instance 8347e97a-e013-461c-b858-2fc8c6a505d5 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:56.887193 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-257b8bc5-b1f3-44a9-b9c9-2be7273f5adb tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5" status: 404 len: 111 microversion: 2.1 time: 0.064908 Aug 18 11:41:56.887193 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1833/3810] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:56 2022] GET /compute/v2.1/servers/8347e97a-e013-461c-b858-2fc8c6a505d5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:56.898397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-76ae09e7-7baa-4add-bdb4-9bf89f190cdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519ec2c160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:56.965511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG neutronclient.v2_0.client [None req-76ae09e7-7baa-4add-bdb4-9bf89f190cdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a37b0cbe-d64d-464a-949e-e21c161b47cb does not exist", "detail": ""}} {{(pid=122209) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:41:56.966331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.security_group_api [None req-76ae09e7-7baa-4add-bdb4-9bf89f190cdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Neutron security group a37b0cbe-d64d-464a-949e-e21c161b47cb not found {{(pid=122209) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:41:56.966998 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-76ae09e7-7baa-4add-bdb4-9bf89f190cdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Security group a37b0cbe-d64d-464a-949e-e21c161b47cb does not exist Aug 18 11:41:56.966998 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-59ccbe29-9ace-428c-94f6-92a066b021d4'] Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-76ae09e7-7baa-4add-bdb4-9bf89f190cdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-security-groups/a37b0cbe-d64d-464a-949e-e21c161b47cb HTTP/1.1 Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: exception: Security group a37b0cbe-d64d-464a-949e-e21c161b47cb does not exist Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-59ccbe29-9ace-428c-94f6-92a066b021d4'] Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'a37b0cbe-d64d-464a-949e-e21c161b47cb'} Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:41:56.972278 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a37b0cbe-d64d-464a-949e-e21c161b47cb does not exist Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59ccbe29-9ace-428c-94f6-92a066b021d4'] Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a37b0cbe-d64d-464a-949e-e21c161b47cb does not exist Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59ccbe29-9ace-428c-94f6-92a066b021d4'] Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a37b0cbe-d64d-464a-949e-e21c161b47cb does not exist Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59ccbe29-9ace-428c-94f6-92a066b021d4'] Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a37b0cbe-d64d-464a-949e-e21c161b47cb does not exist Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59ccbe29-9ace-428c-94f6-92a066b021d4'] Aug 18 11:41:56.981518 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:56.987721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-76ae09e7-7baa-4add-bdb4-9bf89f190cdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 404 to user: Security group a37b0cbe-d64d-464a-949e-e21c161b47cb does not exist Aug 18 11:41:56.987721 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-59ccbe29-9ace-428c-94f6-92a066b021d4'] {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:56.988899 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-76ae09e7-7baa-4add-bdb4-9bf89f190cdd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/a37b0cbe-d64d-464a-949e-e21c161b47cb" status: 404 len: 194 microversion: 2.1 time: 0.098490 Aug 18 11:41:56.989807 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1834/3811] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:56 2022] DELETE /compute/v2.1/os-security-groups/a37b0cbe-d64d-464a-949e-e21c161b47cb => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:41:56.999644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-db7d3fc4-7858-4a46-a9ad-f3856b585e8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519ec43a60>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:57.120139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG neutronclient.v2_0.client [None req-db7d3fc4-7858-4a46-a9ad-f3856b585e8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 56d4c72d-132e-478a-b348-34b89ce085cc does not exist", "detail": ""}} {{(pid=122209) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:41:57.120867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.security_group_api [None req-db7d3fc4-7858-4a46-a9ad-f3856b585e8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Neutron security group 56d4c72d-132e-478a-b348-34b89ce085cc not found {{(pid=122209) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:41:57.122098 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-db7d3fc4-7858-4a46-a9ad-f3856b585e8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Security group 56d4c72d-132e-478a-b348-34b89ce085cc does not exist Aug 18 11:41:57.122098 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-bec18bd0-860f-4221-8cd8-9fa120f8995e'] Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-db7d3fc4-7858-4a46-a9ad-f3856b585e8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-security-groups/56d4c72d-132e-478a-b348-34b89ce085cc HTTP/1.1 Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: exception: Security group 56d4c72d-132e-478a-b348-34b89ce085cc does not exist Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-bec18bd0-860f-4221-8cd8-9fa120f8995e'] Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '56d4c72d-132e-478a-b348-34b89ce085cc'} Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:41:57.127474 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 56d4c72d-132e-478a-b348-34b89ce085cc does not exist Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bec18bd0-860f-4221-8cd8-9fa120f8995e'] Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 56d4c72d-132e-478a-b348-34b89ce085cc does not exist Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bec18bd0-860f-4221-8cd8-9fa120f8995e'] Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 56d4c72d-132e-478a-b348-34b89ce085cc does not exist Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bec18bd0-860f-4221-8cd8-9fa120f8995e'] Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 56d4c72d-132e-478a-b348-34b89ce085cc does not exist Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bec18bd0-860f-4221-8cd8-9fa120f8995e'] Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-db7d3fc4-7858-4a46-a9ad-f3856b585e8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 404 to user: Security group 56d4c72d-132e-478a-b348-34b89ce085cc does not exist Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: Neutron server returns request_ids: ['req-bec18bd0-860f-4221-8cd8-9fa120f8995e'] {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-db7d3fc4-7858-4a46-a9ad-f3856b585e8d tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/56d4c72d-132e-478a-b348-34b89ce085cc" status: 404 len: 194 microversion: 2.1 time: 0.133649 Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1835/3812] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:56 2022] DELETE /compute/v2.1/os-security-groups/56d4c72d-132e-478a-b348-34b89ce085cc => generated 194 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-84dc2a43-4911-4f16-8b29-e9a22030a40c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:57.146942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-84dc2a43-4911-4f16-8b29-e9a22030a40c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:57.156444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6372b3ea-8906-4eb0-9688-3452c8b9a333 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:57.167301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84dc2a43-4911-4f16-8b29-e9a22030a40c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:57.168227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84dc2a43-4911-4f16-8b29-e9a22030a40c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:57.168895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84dc2a43-4911-4f16-8b29-e9a22030a40c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:57.169860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84dc2a43-4911-4f16-8b29-e9a22030a40c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:57.170592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84dc2a43-4911-4f16-8b29-e9a22030a40c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:57.171266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84dc2a43-4911-4f16-8b29-e9a22030a40c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:57.177340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6372b3ea-8906-4eb0-9688-3452c8b9a333 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:57.179464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6372b3ea-8906-4eb0-9688-3452c8b9a333 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:57.180739 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6372b3ea-8906-4eb0-9688-3452c8b9a333 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1559 microversion: 2.21 time: 0.684431 Aug 18 11:41:57.190487 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1978/3813] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:56 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1559 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:57.196080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-361ef0e9-2c14-4bc8-b8b7-9f499d3423e1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519ed940d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:57.288228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-361ef0e9-2c14-4bc8-b8b7-9f499d3423e1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:41:57.289275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.security_group_api [None req-361ef0e9-2c14-4bc8-b8b7-9f499d3423e1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Neutron security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be not found {{(pid=122210) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:41:57.289980 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-361ef0e9-2c14-4bc8-b8b7-9f499d3423e1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist Aug 18 11:41:57.289980 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-ad5c20fb-191e-4b82-a171-1dfc50a2527f'] Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-361ef0e9-2c14-4bc8-b8b7-9f499d3423e1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/os-security-groups/31184eb3-4d54-4a9f-bf13-ed4be8d4b9be HTTP/1.1 Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: exception: Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-ad5c20fb-191e-4b82-a171-1dfc50a2527f'] Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '31184eb3-4d54-4a9f-bf13-ed4be8d4b9be'} Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:41:57.292073 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad5c20fb-191e-4b82-a171-1dfc50a2527f'] Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad5c20fb-191e-4b82-a171-1dfc50a2527f'] Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad5c20fb-191e-4b82-a171-1dfc50a2527f'] Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad5c20fb-191e-4b82-a171-1dfc50a2527f'] Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-361ef0e9-2c14-4bc8-b8b7-9f499d3423e1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 404 to user: Security group 31184eb3-4d54-4a9f-bf13-ed4be8d4b9be does not exist Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-ad5c20fb-191e-4b82-a171-1dfc50a2527f'] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-361ef0e9-2c14-4bc8-b8b7-9f499d3423e1 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/31184eb3-4d54-4a9f-bf13-ed4be8d4b9be" status: 404 len: 194 microversion: 2.1 time: 0.111064 Aug 18 11:41:57.304662 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1979/3814] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:57 2022] DELETE /compute/v2.1/os-security-groups/31184eb3-4d54-4a9f-bf13-ed4be8d4b9be => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:57.323625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f5dcdd0-7924-4f5f-8c8b-c2f62b72dff0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519f0608b0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:57.390054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-6f5dcdd0-7924-4f5f-8c8b-c2f62b72dff0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:41:57.392369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.security_group_api [None req-6f5dcdd0-7924-4f5f-8c8b-c2f62b72dff0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Neutron security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 not found {{(pid=122210) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:41:57.393257 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-6f5dcdd0-7924-4f5f-8c8b-c2f62b72dff0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist Aug 18 11:41:57.393257 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-010b6fe7-3444-4efd-8bd1-3a1ebcc70849'] Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f5dcdd0-7924-4f5f-8c8b-c2f62b72dff0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/os-security-groups/f55c13d1-4703-4f9c-acae-87e8ed76dd84 HTTP/1.1 Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: exception: Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-010b6fe7-3444-4efd-8bd1-3a1ebcc70849'] Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'f55c13d1-4703-4f9c-acae-87e8ed76dd84'} Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:41:57.406565 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-010b6fe7-3444-4efd-8bd1-3a1ebcc70849'] Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-010b6fe7-3444-4efd-8bd1-3a1ebcc70849'] Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-010b6fe7-3444-4efd-8bd1-3a1ebcc70849'] Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-010b6fe7-3444-4efd-8bd1-3a1ebcc70849'] Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f5dcdd0-7924-4f5f-8c8b-c2f62b72dff0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 404 to user: Security group f55c13d1-4703-4f9c-acae-87e8ed76dd84 does not exist Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-010b6fe7-3444-4efd-8bd1-3a1ebcc70849'] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6f5dcdd0-7924-4f5f-8c8b-c2f62b72dff0 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/f55c13d1-4703-4f9c-acae-87e8ed76dd84" status: 404 len: 194 microversion: 2.1 time: 0.108400 Aug 18 11:41:57.413902 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1980/3815] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:57 2022] DELETE /compute/v2.1/os-security-groups/f55c13d1-4703-4f9c-acae-87e8ed76dd84 => generated 194 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:57.426619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-21d71414-3107-461d-b6b3-21a301ebf9bc tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519ed943a0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:57.506158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-21d71414-3107-461d-b6b3-21a301ebf9bc tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:41:57.506949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.security_group_api [None req-21d71414-3107-461d-b6b3-21a301ebf9bc tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Neutron security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 not found {{(pid=122210) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:41:57.507498 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-21d71414-3107-461d-b6b3-21a301ebf9bc tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist Aug 18 11:41:57.507498 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-93b2e20c-3099-4d04-aa7b-f930a8b1b888'] Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-21d71414-3107-461d-b6b3-21a301ebf9bc tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/os-security-groups/ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 HTTP/1.1 Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: exception: Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-93b2e20c-3099-4d04-aa7b-f930a8b1b888'] Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'ca1ce1fb-f0b1-4b14-bc29-4e64eb476565'} Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:41:57.525003 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93b2e20c-3099-4d04-aa7b-f930a8b1b888'] Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93b2e20c-3099-4d04-aa7b-f930a8b1b888'] Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93b2e20c-3099-4d04-aa7b-f930a8b1b888'] Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93b2e20c-3099-4d04-aa7b-f930a8b1b888'] Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-21d71414-3107-461d-b6b3-21a301ebf9bc tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 404 to user: Security group ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 does not exist Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-93b2e20c-3099-4d04-aa7b-f930a8b1b888'] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:57.529873 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-21d71414-3107-461d-b6b3-21a301ebf9bc tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/ca1ce1fb-f0b1-4b14-bc29-4e64eb476565" status: 404 len: 194 microversion: 2.1 time: 0.111247 Aug 18 11:41:57.545529 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1981/3816] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:57 2022] DELETE /compute/v2.1/os-security-groups/ca1ce1fb-f0b1-4b14-bc29-4e64eb476565 => generated 194 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:57.573285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e7f7bf1-a6e6-4607-a65d-fb2e356cf7ed tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:57.574128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e7f7bf1-a6e6-4607-a65d-fb2e356cf7ed tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:57.589383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e7f7bf1-a6e6-4607-a65d-fb2e356cf7ed tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:57.589952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e7f7bf1-a6e6-4607-a65d-fb2e356cf7ed tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:57.590415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e7f7bf1-a6e6-4607-a65d-fb2e356cf7ed tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:57.591232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e7f7bf1-a6e6-4607-a65d-fb2e356cf7ed tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:57.591716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e7f7bf1-a6e6-4607-a65d-fb2e356cf7ed tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:57.592505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e7f7bf1-a6e6-4607-a65d-fb2e356cf7ed tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:57.747282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-84dc2a43-4911-4f16-8b29-e9a22030a40c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:57.770668 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-84dc2a43-4911-4f16-8b29-e9a22030a40c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1314 microversion: 2.1 time: 0.639130 Aug 18 11:41:57.787841 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1836/3817] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:57 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:57.788281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e7f7bf1-a6e6-4607-a65d-fb2e356cf7ed tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:57.801053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-87ca1587-7241-4a61-9ba8-ccf0a0444f3a req-5cfff5bd-fc93-4812-a58d-83cf2531c821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2faffeb5-20db-4e86-b94b-1c4e1125c8e4", "name": "network-vif-deleted", "tag": "63113096-c75d-451f-8de7-d895a5c8a062"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:57.804247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e7f7bf1-a6e6-4607-a65d-fb2e356cf7ed tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:57.807824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e7f7bf1-a6e6-4607-a65d-fb2e356cf7ed tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:57.810782 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e7f7bf1-a6e6-4607-a65d-fb2e356cf7ed tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.260324 Aug 18 11:41:57.812250 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1982/3818] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:57 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:57.815081 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-87ca1587-7241-4a61-9ba8-ccf0a0444f3a req-5cfff5bd-fc93-4812-a58d-83cf2531c821 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:57.816279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-87ca1587-7241-4a61-9ba8-ccf0a0444f3a req-5cfff5bd-fc93-4812-a58d-83cf2531c821 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:57.816967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-87ca1587-7241-4a61-9ba8-ccf0a0444f3a req-5cfff5bd-fc93-4812-a58d-83cf2531c821 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:57.820286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e45eeac0-1e3e-4921-9ae4-cfdae6b71dba tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519eeb3160>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:57.837965 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-87ca1587-7241-4a61-9ba8-ccf0a0444f3a req-5cfff5bd-fc93-4812-a58d-83cf2531c821 service nova] Creating event network-vif-deleted:63113096-c75d-451f-8de7-d895a5c8a062 for instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 on n-h2-853611-3 Aug 18 11:41:57.853726 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-87ca1587-7241-4a61-9ba8-ccf0a0444f3a req-5cfff5bd-fc93-4812-a58d-83cf2531c821 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064268 Aug 18 11:41:57.854360 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1837/3819] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:41:57.863855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aa4b1ec0-d6bd-4ede-a015-2b2de882cbaa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:57.864584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-aa4b1ec0-d6bd-4ede-a015-2b2de882cbaa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:57.871186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG neutronclient.v2_0.client [None req-e45eeac0-1e3e-4921-9ae4-cfdae6b71dba tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist", "detail": ""}} {{(pid=122210) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 18 11:41:57.872140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa4b1ec0-d6bd-4ede-a015-2b2de882cbaa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:57.872316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.security_group_api [None req-e45eeac0-1e3e-4921-9ae4-cfdae6b71dba tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Neutron security group 730785a5-8cb1-4d15-99ea-b545f9af1069 not found {{(pid=122210) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 18 11:41:57.872663 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa4b1ec0-d6bd-4ede-a015-2b2de882cbaa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:57.873023 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-e45eeac0-1e3e-4921-9ae4-cfdae6b71dba tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist Aug 18 11:41:57.873023 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-10c34748-9047-40fb-804c-804b1556fa73'] Aug 18 11:41:57.873234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa4b1ec0-d6bd-4ede-a015-2b2de882cbaa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:57.873856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa4b1ec0-d6bd-4ede-a015-2b2de882cbaa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:57.874335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa4b1ec0-d6bd-4ede-a015-2b2de882cbaa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:57.874803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa4b1ec0-d6bd-4ede-a015-2b2de882cbaa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e45eeac0-1e3e-4921-9ae4-cfdae6b71dba tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/os-security-groups/730785a5-8cb1-4d15-99ea-b545f9af1069 HTTP/1.1 Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: exception: Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-10c34748-9047-40fb-804c-804b1556fa73'] Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '730785a5-8cb1-4d15-99ea-b545f9af1069'} Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 18 11:41:57.877074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10c34748-9047-40fb-804c-804b1556fa73'] Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10c34748-9047-40fb-804c-804b1556fa73'] Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10c34748-9047-40fb-804c-804b1556fa73'] Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10c34748-9047-40fb-804c-804b1556fa73'] Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e45eeac0-1e3e-4921-9ae4-cfdae6b71dba tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 404 to user: Security group 730785a5-8cb1-4d15-99ea-b545f9af1069 does not exist Aug 18 11:41:57.881524 n-d-853611-3 devstack@n-api.service[122210]: Neutron server returns request_ids: ['req-10c34748-9047-40fb-804c-804b1556fa73'] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:57.886696 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e45eeac0-1e3e-4921-9ae4-cfdae6b71dba tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/730785a5-8cb1-4d15-99ea-b545f9af1069" status: 404 len: 194 microversion: 2.1 time: 0.066010 Aug 18 11:41:57.887674 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1983/3820] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:41:57 2022] DELETE /compute/v2.1/os-security-groups/730785a5-8cb1-4d15-99ea-b545f9af1069 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:41:57.904290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b0724b42-5c8e-4900-8092-89555006be4e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:57.906351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b0724b42-5c8e-4900-8092-89555006be4e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:57.921058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0724b42-5c8e-4900-8092-89555006be4e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:57.922255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0724b42-5c8e-4900-8092-89555006be4e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:57.923124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0724b42-5c8e-4900-8092-89555006be4e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:57.924566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0724b42-5c8e-4900-8092-89555006be4e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:57.925782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0724b42-5c8e-4900-8092-89555006be4e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:57.926523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0724b42-5c8e-4900-8092-89555006be4e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:57.960102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b0724b42-5c8e-4900-8092-89555006be4e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:41:57.979719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aa4b1ec0-d6bd-4ede-a015-2b2de882cbaa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:58.013079 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aa4b1ec0-d6bd-4ede-a015-2b2de882cbaa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1272 microversion: 2.1 time: 0.153542 Aug 18 11:41:58.017882 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1838/3821] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:57 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:58.067789 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b0724b42-5c8e-4900-8092-89555006be4e tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 204 len: 0 microversion: 2.1 time: 0.171433 Aug 18 11:41:58.069619 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1984/3822] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:41:57 2022] DELETE /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:41:58.086694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d00295f5-4b7b-4652-b7a5-e3c1d5ba0836 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:58.089246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d00295f5-4b7b-4652-b7a5-e3c1d5ba0836 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:58.105528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d00295f5-4b7b-4652-b7a5-e3c1d5ba0836 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:58.107033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d00295f5-4b7b-4652-b7a5-e3c1d5ba0836 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:58.108116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d00295f5-4b7b-4652-b7a5-e3c1d5ba0836 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:58.110368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d00295f5-4b7b-4652-b7a5-e3c1d5ba0836 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:58.115597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d00295f5-4b7b-4652-b7a5-e3c1d5ba0836 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:58.117247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d00295f5-4b7b-4652-b7a5-e3c1d5ba0836 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:58.209942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:58.211419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:58.226087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:58.227744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:58.228568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:58.229920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:58.230781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:58.231672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:58.303840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:58.304302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:58.304945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:58.305689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lazy-loading 'fault' on Instance uuid 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:41:58.308345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:41:58.365754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:58.375246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:58.377529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '058cb2c1f27d49c98efc70f28a66261b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'defa9f3b14794929ab7b6d17a58f9c2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:58.379178 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-723540c3-fea5-4a47-b216-ccf5b8aa9ae1 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 200 len: 1349 microversion: 2.21 time: 0.178279 Aug 18 11:41:58.394903 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1985/3823] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:58 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 1349 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:41:58.671185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d00295f5-4b7b-4652-b7a5-e3c1d5ba0836 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:58.684932 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d00295f5-4b7b-4652-b7a5-e3c1d5ba0836 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1646 microversion: 2.1 time: 0.608073 Aug 18 11:41:58.696716 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1839/3824] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:58 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1646 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:58.794035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-716e8a39-efa8-4eca-9531-d770e3de3bc8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:58.794806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-716e8a39-efa8-4eca-9531-d770e3de3bc8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:58.802788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-716e8a39-efa8-4eca-9531-d770e3de3bc8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:58.803840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-716e8a39-efa8-4eca-9531-d770e3de3bc8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:58.804294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-716e8a39-efa8-4eca-9531-d770e3de3bc8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:58.805017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-716e8a39-efa8-4eca-9531-d770e3de3bc8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:58.805471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-716e8a39-efa8-4eca-9531-d770e3de3bc8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:58.806159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-716e8a39-efa8-4eca-9531-d770e3de3bc8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:58.836426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8d34e5eb-af60-4396-8614-222f2ac50932 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:58.837742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8d34e5eb-af60-4396-8614-222f2ac50932 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:58.853113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d34e5eb-af60-4396-8614-222f2ac50932 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:58.853617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d34e5eb-af60-4396-8614-222f2ac50932 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:58.854065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d34e5eb-af60-4396-8614-222f2ac50932 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:58.854823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d34e5eb-af60-4396-8614-222f2ac50932 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:58.855289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d34e5eb-af60-4396-8614-222f2ac50932 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:58.855754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d34e5eb-af60-4396-8614-222f2ac50932 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:58.998647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-716e8a39-efa8-4eca-9531-d770e3de3bc8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:59.014747 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-716e8a39-efa8-4eca-9531-d770e3de3bc8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1500 microversion: 2.1 time: 0.224322 Aug 18 11:41:59.018011 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1986/3825] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:58 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1500 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:59.039995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cb7769fe-7e44-431c-88f4-4382d87be254 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:59.040648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cb7769fe-7e44-431c-88f4-4382d87be254 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:59.049730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb7769fe-7e44-431c-88f4-4382d87be254 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.049987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8d34e5eb-af60-4396-8614-222f2ac50932 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:59.050785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb7769fe-7e44-431c-88f4-4382d87be254 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.051453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb7769fe-7e44-431c-88f4-4382d87be254 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.052503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb7769fe-7e44-431c-88f4-4382d87be254 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.053444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb7769fe-7e44-431c-88f4-4382d87be254 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.054245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb7769fe-7e44-431c-88f4-4382d87be254 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.064967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8d34e5eb-af60-4396-8614-222f2ac50932 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:59.067203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8d34e5eb-af60-4396-8614-222f2ac50932 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:59.068677 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8d34e5eb-af60-4396-8614-222f2ac50932 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.236090 Aug 18 11:41:59.084398 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1840/3826] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:58 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:41:59.084398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5fe01802-d8f1-4bf6-9ea2-044b6b45b1d9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:41:59.084398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5fe01802-d8f1-4bf6-9ea2-044b6b45b1d9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:59.088728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fe01802-d8f1-4bf6-9ea2-044b6b45b1d9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.089461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fe01802-d8f1-4bf6-9ea2-044b6b45b1d9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.089913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fe01802-d8f1-4bf6-9ea2-044b6b45b1d9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.090683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fe01802-d8f1-4bf6-9ea2-044b6b45b1d9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.091147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fe01802-d8f1-4bf6-9ea2-044b6b45b1d9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.091777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fe01802-d8f1-4bf6-9ea2-044b6b45b1d9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.121708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-5fe01802-d8f1-4bf6-9ea2-044b6b45b1d9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lazy-loading 'flavor' on Instance uuid ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:41:59.140848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cb7769fe-7e44-431c-88f4-4382d87be254 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:59.151980 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cb7769fe-7e44-431c-88f4-4382d87be254 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1272 microversion: 2.1 time: 0.117030 Aug 18 11:41:59.152989 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1987/3827] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:59 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:59.255850 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5fe01802-d8f1-4bf6-9ea2-044b6b45b1d9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "POST /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3/action" status: 200 len: 32 microversion: 2.1 time: 0.184866 Aug 18 11:41:59.257405 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1841/3828] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:41:59 2022] POST /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:41:59.268748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d2c859ac-5180-4964-accc-c10c179821ed tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:59.269626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d2c859ac-5180-4964-accc-c10c179821ed tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:59.283916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2c859ac-5180-4964-accc-c10c179821ed tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.284840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2c859ac-5180-4964-accc-c10c179821ed tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.285643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2c859ac-5180-4964-accc-c10c179821ed tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.286914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2c859ac-5180-4964-accc-c10c179821ed tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.287672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2c859ac-5180-4964-accc-c10c179821ed tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.288414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2c859ac-5180-4964-accc-c10c179821ed tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.409539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4b4fee2f-6261-40b9-989c-9bfd16bbd496 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:59.410931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4b4fee2f-6261-40b9-989c-9bfd16bbd496 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:59.424287 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b4fee2f-6261-40b9-989c-9bfd16bbd496 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.425263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b4fee2f-6261-40b9-989c-9bfd16bbd496 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.425941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b4fee2f-6261-40b9-989c-9bfd16bbd496 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.427057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b4fee2f-6261-40b9-989c-9bfd16bbd496 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.429256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b4fee2f-6261-40b9-989c-9bfd16bbd496 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.430854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b4fee2f-6261-40b9-989c-9bfd16bbd496 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.464301 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-4b4fee2f-6261-40b9-989c-9bfd16bbd496 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] HTTP exception thrown: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4b4fee2f-6261-40b9-989c-9bfd16bbd496 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Request method failure captured: Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 HTTP/1.1 Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iVqfIyYl8C8fC5X6tkenhLZ8IWowx3SMGwOOUQ-CdfluqB5HgqZKemWdEhP9WpbZD4keJr464Zg1CH5hDbNxK2TQH88I7lJ4OzXDXt2O2D_wp09p_3wn9qMhPNXV9VTnMh5Fqi8AQHGFT2qBdBzQDNz4ANVg_MgISt6Sihf2Inl53E Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Openstack-Nova-Api-Version: 2.21 Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: defa9f3b14794929ab7b6d17a58f9c2a Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-InstanceActionsV221TestJSON-37983657 Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/defa9f3b14794929ab7b6d17a58f9c2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/defa9f3b14794929ab7b6d17a58f9c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_defa9f3b14794929ab7b6d17a58f9c2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/defa9f3b14794929ab7b6d17a58f9c2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-InstanceActionsV221TestJSON-37983657 Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: defa9f3b14794929ab7b6d17a58f9c2a Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-37983657 Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-InstanceActionsV221TestJSON-37983657-project Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 058cb2c1f27d49c98efc70f28a66261b Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-InstanceActionsV221TestJSON-37983657-project Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '2faffeb5-20db-4e86-b94b-1c4e1125c8e4'} Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.466611 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:59.473066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.473066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:59.473066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:59.473066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:59.473066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:59.473066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:59.473066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.473066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.475556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4b4fee2f-6261-40b9-989c-9bfd16bbd496 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Returning 404 to user: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:59.476682 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4b4fee2f-6261-40b9-989c-9bfd16bbd496 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 404 len: 111 microversion: 2.21 time: 0.074581 Aug 18 11:41:59.477487 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1842/3829] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:59 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 18 11:41:59.487617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9e068d63-6be5-4588-82f2-597682add1ff tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '.version_select at 0x7f519ec9e3a0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:59.488587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9e068d63-6be5-4588-82f2-597682add1ff tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:59.496588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e068d63-6be5-4588-82f2-597682add1ff tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.498702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e068d63-6be5-4588-82f2-597682add1ff tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.499614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e068d63-6be5-4588-82f2-597682add1ff tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.501037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e068d63-6be5-4588-82f2-597682add1ff tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.501770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e068d63-6be5-4588-82f2-597682add1ff tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.502463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9e068d63-6be5-4588-82f2-597682add1ff tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.628048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2c859ac-5180-4964-accc-c10c179821ed tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:41:59.650869 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d2c859ac-5180-4964-accc-c10c179821ed tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.387178 Aug 18 11:41:59.654465 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1988/3830] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:59 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:41:59.705980 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9e068d63-6be5-4588-82f2-597682add1ff tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.223519 Aug 18 11:41:59.706954 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1843/3831] 10.222.0.73 () {60 vars in 1337 bytes} [Thu Aug 18 11:41:59 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4/os-instance-actions => generated 611 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:41:59.725429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-472cfb59-ff29-40bc-bf70-fd0c7d13f5dd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:59.726064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-472cfb59-ff29-40bc-bf70-fd0c7d13f5dd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:59.735429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9252d2b-8f86-44a5-84f9-741085c1a823 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:59.735923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c9252d2b-8f86-44a5-84f9-741085c1a823 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:59.740462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-472cfb59-ff29-40bc-bf70-fd0c7d13f5dd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.740968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-472cfb59-ff29-40bc-bf70-fd0c7d13f5dd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.741643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-472cfb59-ff29-40bc-bf70-fd0c7d13f5dd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.742373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-472cfb59-ff29-40bc-bf70-fd0c7d13f5dd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.742895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-472cfb59-ff29-40bc-bf70-fd0c7d13f5dd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.743331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-472cfb59-ff29-40bc-bf70-fd0c7d13f5dd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.756697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9252d2b-8f86-44a5-84f9-741085c1a823 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.763216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9252d2b-8f86-44a5-84f9-741085c1a823 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.763888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9252d2b-8f86-44a5-84f9-741085c1a823 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.764963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9252d2b-8f86-44a5-84f9-741085c1a823 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.768743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9252d2b-8f86-44a5-84f9-741085c1a823 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.769567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9252d2b-8f86-44a5-84f9-741085c1a823 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.793515 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-c9252d2b-8f86-44a5-84f9-741085c1a823 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] HTTP exception thrown: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9252d2b-8f86-44a5-84f9-741085c1a823 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Request method failure captured: Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 HTTP/1.1 Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iVqfIyYl8C8fC5X6tkenhLZ8IWowx3SMGwOOUQ-CdfluqB5HgqZKemWdEhP9WpbZD4keJr464Zg1CH5hDbNxK2TQH88I7lJ4OzXDXt2O2D_wp09p_3wn9qMhPNXV9VTnMh5Fqi8AQHGFT2qBdBzQDNz4ANVg_MgISt6Sihf2Inl53E Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.21 Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: defa9f3b14794929ab7b6d17a58f9c2a Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-InstanceActionsV221TestJSON-37983657 Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/defa9f3b14794929ab7b6d17a58f9c2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/defa9f3b14794929ab7b6d17a58f9c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_defa9f3b14794929ab7b6d17a58f9c2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/defa9f3b14794929ab7b6d17a58f9c2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-InstanceActionsV221TestJSON-37983657 Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: defa9f3b14794929ab7b6d17a58f9c2a Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-37983657 Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-InstanceActionsV221TestJSON-37983657-project Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 058cb2c1f27d49c98efc70f28a66261b Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-InstanceActionsV221TestJSON-37983657-project Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '2faffeb5-20db-4e86-b94b-1c4e1125c8e4'} Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:59.795322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:59.802143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.802143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.802143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:59.802143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.802143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:59.802143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:59.802143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:59.802143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:59.802143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:59.802143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.802143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.806785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9252d2b-8f86-44a5-84f9-741085c1a823 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Returning 404 to user: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:59.819111 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c9252d2b-8f86-44a5-84f9-741085c1a823 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 404 len: 111 microversion: 2.21 time: 0.097312 Aug 18 11:41:59.820044 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1989/3832] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:41:59 2022] DELETE /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:41:59.858241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec4a9291-d2b5-4f15-8e8c-8ca6941d9651 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:41:59.858956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ec4a9291-d2b5-4f15-8e8c-8ca6941d9651 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] [instance: 2faffeb5-20db-4e86-b94b-1c4e1125c8e4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:41:59.868861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec4a9291-d2b5-4f15-8e8c-8ca6941d9651 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.869682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec4a9291-d2b5-4f15-8e8c-8ca6941d9651 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.870451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec4a9291-d2b5-4f15-8e8c-8ca6941d9651 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.871436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec4a9291-d2b5-4f15-8e8c-8ca6941d9651 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:41:59.872134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec4a9291-d2b5-4f15-8e8c-8ca6941d9651 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:41:59.872783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec4a9291-d2b5-4f15-8e8c-8ca6941d9651 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:41:59.895719 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-ec4a9291-d2b5-4f15-8e8c-8ca6941d9651 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] HTTP exception thrown: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec4a9291-d2b5-4f15-8e8c-8ca6941d9651 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Request method failure captured: Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 HTTP/1.1 Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iVqfIyYl8C8fC5X6tkenhLZ8IWowx3SMGwOOUQ-CdfluqB5HgqZKemWdEhP9WpbZD4keJr464Zg1CH5hDbNxK2TQH88I7lJ4OzXDXt2O2D_wp09p_3wn9qMhPNXV9VTnMh5Fqi8AQHGFT2qBdBzQDNz4ANVg_MgISt6Sihf2Inl53E Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.21 Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: defa9f3b14794929ab7b6d17a58f9c2a Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-InstanceActionsV221TestJSON-37983657 Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/defa9f3b14794929ab7b6d17a58f9c2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/defa9f3b14794929ab7b6d17a58f9c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_defa9f3b14794929ab7b6d17a58f9c2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/defa9f3b14794929ab7b6d17a58f9c2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-InstanceActionsV221TestJSON-37983657 Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: defa9f3b14794929ab7b6d17a58f9c2a Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-37983657 Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-InstanceActionsV221TestJSON-37983657-project Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 058cb2c1f27d49c98efc70f28a66261b Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-InstanceActionsV221TestJSON-37983657-project Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '2faffeb5-20db-4e86-b94b-1c4e1125c8e4'} Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.897771 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:41:59.908335 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.908335 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:41:59.908335 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:41:59.908335 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:41:59.908335 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:41:59.908335 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:41:59.908335 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. Aug 18 11:41:59.908335 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:41:59.908335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec4a9291-d2b5-4f15-8e8c-8ca6941d9651 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] Returning 404 to user: Instance 2faffeb5-20db-4e86-b94b-1c4e1125c8e4 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:41:59.908335 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ec4a9291-d2b5-4f15-8e8c-8ca6941d9651 tempest-InstanceActionsV221TestJSON-37983657 tempest-InstanceActionsV221TestJSON-37983657-project] 10.222.0.73 "GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4" status: 404 len: 111 microversion: 2.21 time: 0.070184 Aug 18 11:41:59.908335 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1990/3833] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:41:59 2022] GET /compute/v2.1/servers/2faffeb5-20db-4e86-b94b-1c4e1125c8e4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:42:00.117722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6e8a7582-c612-4976-8dab-db6cf3af73a4 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:00.119029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6e8a7582-c612-4976-8dab-db6cf3af73a4 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:00.130062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e8a7582-c612-4976-8dab-db6cf3af73a4 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:00.130814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e8a7582-c612-4976-8dab-db6cf3af73a4 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:00.131434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e8a7582-c612-4976-8dab-db6cf3af73a4 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:00.132483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e8a7582-c612-4976-8dab-db6cf3af73a4 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:00.133184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e8a7582-c612-4976-8dab-db6cf3af73a4 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:00.133837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e8a7582-c612-4976-8dab-db6cf3af73a4 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:00.276978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6e8a7582-c612-4976-8dab-db6cf3af73a4 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:00.297199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6e8a7582-c612-4976-8dab-db6cf3af73a4 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:00.300919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6e8a7582-c612-4976-8dab-db6cf3af73a4 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:00.303488 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6e8a7582-c612-4976-8dab-db6cf3af73a4 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.192041 Aug 18 11:42:00.304548 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1991/3834] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:00 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:00.315143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1f0c3508-dad1-408a-90b0-280759a7c755 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:00.316640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1f0c3508-dad1-408a-90b0-280759a7c755 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:00.327986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f0c3508-dad1-408a-90b0-280759a7c755 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:00.330028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f0c3508-dad1-408a-90b0-280759a7c755 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:00.331188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f0c3508-dad1-408a-90b0-280759a7c755 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:00.332684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f0c3508-dad1-408a-90b0-280759a7c755 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:00.333525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f0c3508-dad1-408a-90b0-280759a7c755 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:00.334374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f0c3508-dad1-408a-90b0-280759a7c755 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:00.735838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1f0c3508-dad1-408a-90b0-280759a7c755 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:00.753281 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1f0c3508-dad1-408a-90b0-280759a7c755 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1314 microversion: 2.1 time: 0.446470 Aug 18 11:42:00.754709 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1992/3835] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:00 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:00.768647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-86f8842f-307f-47a5-a46b-9e95a4f1a45d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:00.770579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-86f8842f-307f-47a5-a46b-9e95a4f1a45d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:00.786023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f8842f-307f-47a5-a46b-9e95a4f1a45d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:00.787461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f8842f-307f-47a5-a46b-9e95a4f1a45d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:00.788515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f8842f-307f-47a5-a46b-9e95a4f1a45d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:00.790183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f8842f-307f-47a5-a46b-9e95a4f1a45d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:00.791166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f8842f-307f-47a5-a46b-9e95a4f1a45d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:00.792033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f8842f-307f-47a5-a46b-9e95a4f1a45d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:00.835598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-472cfb59-ff29-40bc-bf70-fd0c7d13f5dd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:00.846205 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-472cfb59-ff29-40bc-bf70-fd0c7d13f5dd tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1646 microversion: 2.1 time: 1.124665 Aug 18 11:42:00.860363 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1844/3836] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:41:59 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1646 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:01.345939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9f3b659e-353d-479b-b448-7b5688797354 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:01.355137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9f3b659e-353d-479b-b448-7b5688797354 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:01.378628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f3b659e-353d-479b-b448-7b5688797354 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:01.380563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f3b659e-353d-479b-b448-7b5688797354 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:01.381704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f3b659e-353d-479b-b448-7b5688797354 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:01.385505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f3b659e-353d-479b-b448-7b5688797354 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:01.387027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f3b659e-353d-479b-b448-7b5688797354 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:01.388250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f3b659e-353d-479b-b448-7b5688797354 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:01.389350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-86f8842f-307f-47a5-a46b-9e95a4f1a45d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:01.413012 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-86f8842f-307f-47a5-a46b-9e95a4f1a45d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.656221 Aug 18 11:42:01.413618 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1993/3837] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:00 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:01.602334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9f3b659e-353d-479b-b448-7b5688797354 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:01.631712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9f3b659e-353d-479b-b448-7b5688797354 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:01.635841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9f3b659e-353d-479b-b448-7b5688797354 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:01.638213 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9f3b659e-353d-479b-b448-7b5688797354 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.310410 Aug 18 11:42:01.639940 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1845/3838] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:01 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:01.792242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-984d58e3-89f9-435d-b013-0b318f85032c tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:01.793392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-984d58e3-89f9-435d-b013-0b318f85032c tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:01.805413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-984d58e3-89f9-435d-b013-0b318f85032c tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:01.806659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-984d58e3-89f9-435d-b013-0b318f85032c tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:01.807386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-984d58e3-89f9-435d-b013-0b318f85032c tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:01.808478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-984d58e3-89f9-435d-b013-0b318f85032c tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:01.809955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-984d58e3-89f9-435d-b013-0b318f85032c tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:01.810805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-984d58e3-89f9-435d-b013-0b318f85032c tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:01.873429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-312a8f5d-d6bd-465e-80d2-249c18783797 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:01.877170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-312a8f5d-d6bd-465e-80d2-249c18783797 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:01.885839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-312a8f5d-d6bd-465e-80d2-249c18783797 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:01.887181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-312a8f5d-d6bd-465e-80d2-249c18783797 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:01.887840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-312a8f5d-d6bd-465e-80d2-249c18783797 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:01.889183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-312a8f5d-d6bd-465e-80d2-249c18783797 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:01.889870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-312a8f5d-d6bd-465e-80d2-249c18783797 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:01.891329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-312a8f5d-d6bd-465e-80d2-249c18783797 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:02.028587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-312a8f5d-d6bd-465e-80d2-249c18783797 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7b07fb7b4d459e8f09ffc731a779fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e4deaca35e548218df7f8358b79ecb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:02.047233 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-312a8f5d-d6bd-465e-80d2-249c18783797 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 200 len: 1467 microversion: 2.1 time: 0.179496 Aug 18 11:42:02.048151 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1846/3839] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:01 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 1467 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:42:02.059922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-ac869575-08e0-4a93-840b-05c5d8c650d1 req-79328775-cf89-4d85-a57e-b8765ecd281d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c5530b-64fd-465c-a52c-9e81b68a3f2a", "name": "network-vif-deleted", "tag": "363c1787-80ec-405e-872b-dff4d89afcb2"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:02.071596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ac869575-08e0-4a93-840b-05c5d8c650d1 req-79328775-cf89-4d85-a57e-b8765ecd281d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:02.072366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ac869575-08e0-4a93-840b-05c5d8c650d1 req-79328775-cf89-4d85-a57e-b8765ecd281d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:02.073005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ac869575-08e0-4a93-840b-05c5d8c650d1 req-79328775-cf89-4d85-a57e-b8765ecd281d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:02.094679 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ac869575-08e0-4a93-840b-05c5d8c650d1 req-79328775-cf89-4d85-a57e-b8765ecd281d service nova] Creating event network-vif-deleted:363c1787-80ec-405e-872b-dff4d89afcb2 for instance 69c5530b-64fd-465c-a52c-9e81b68a3f2a on n-h1-853611-3 Aug 18 11:42:02.103507 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-ac869575-08e0-4a93-840b-05c5d8c650d1 req-79328775-cf89-4d85-a57e-b8765ecd281d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053300 Aug 18 11:42:02.104679 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1847/3840] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:02.449024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a29536a9-e557-40e7-99c7-7738268ad23e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:02.452898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a29536a9-e557-40e7-99c7-7738268ad23e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:02.476130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a29536a9-e557-40e7-99c7-7738268ad23e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:02.477953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a29536a9-e557-40e7-99c7-7738268ad23e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:02.479606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a29536a9-e557-40e7-99c7-7738268ad23e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:02.483210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a29536a9-e557-40e7-99c7-7738268ad23e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:02.485745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a29536a9-e557-40e7-99c7-7738268ad23e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:02.487167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a29536a9-e557-40e7-99c7-7738268ad23e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:02.498948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:02.634980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-984d58e3-89f9-435d-b013-0b318f85032c tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:02.646153 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-984d58e3-89f9-435d-b013-0b318f85032c tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1314 microversion: 2.1 time: 0.858506 Aug 18 11:42:02.657572 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1994/3841] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:01 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1314 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:02.688697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8adf22f5-f1e0-4436-af82-ca97e2a9a2de tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:02.688697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8adf22f5-f1e0-4436-af82-ca97e2a9a2de tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:02.709401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8adf22f5-f1e0-4436-af82-ca97e2a9a2de tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:02.710311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8adf22f5-f1e0-4436-af82-ca97e2a9a2de tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:02.711574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8adf22f5-f1e0-4436-af82-ca97e2a9a2de tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:02.714366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8adf22f5-f1e0-4436-af82-ca97e2a9a2de tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:02.723362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8adf22f5-f1e0-4436-af82-ca97e2a9a2de tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:02.724189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8adf22f5-f1e0-4436-af82-ca97e2a9a2de tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:02.940185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8adf22f5-f1e0-4436-af82-ca97e2a9a2de tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:02.968205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a29536a9-e557-40e7-99c7-7738268ad23e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:02.980520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8adf22f5-f1e0-4436-af82-ca97e2a9a2de tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:02.982359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8adf22f5-f1e0-4436-af82-ca97e2a9a2de tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:02.989561 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8adf22f5-f1e0-4436-af82-ca97e2a9a2de tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.306628 Aug 18 11:42:02.990167 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1995/3842] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:02 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:42:02.991049 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a29536a9-e557-40e7-99c7-7738268ad23e tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.559314 Aug 18 11:42:02.994627 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1848/3843] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:02 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:03.069049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b2a4f3c9-fdc8-4c52-92bf-d98d6ddcc770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:03.069662 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b2a4f3c9-fdc8-4c52-92bf-d98d6ddcc770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] [instance: 69c5530b-64fd-465c-a52c-9e81b68a3f2a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:03.076409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2a4f3c9-fdc8-4c52-92bf-d98d6ddcc770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:03.077190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2a4f3c9-fdc8-4c52-92bf-d98d6ddcc770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:03.077613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2a4f3c9-fdc8-4c52-92bf-d98d6ddcc770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:03.078943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2a4f3c9-fdc8-4c52-92bf-d98d6ddcc770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:03.079623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2a4f3c9-fdc8-4c52-92bf-d98d6ddcc770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:03.080236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b2a4f3c9-fdc8-4c52-92bf-d98d6ddcc770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:03.096418 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-b2a4f3c9-fdc8-4c52-92bf-d98d6ddcc770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] HTTP exception thrown: Instance 69c5530b-64fd-465c-a52c-9e81b68a3f2a could not be found. Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b2a4f3c9-fdc8-4c52-92bf-d98d6ddcc770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Request method failure captured: Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a HTTP/1.1 Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iU4kLEYuH6jFngaGYi97TFzMA7JCZ6ZiZJXfGF_nO69X-Jdi91ggBkS9Xpsek8AhLm7Kh5XYMYjVAAtDa2qhVNsKqLp35b8ecRvkggx8cWnhEnF-MGI5b_SRlK9dM5GfC203ljtTf2AtXCIaifUo7LmoxRAHjAjqVtw8oPTPihhMXA Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6e4deaca35e548218df7f8358b79ecb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 6e4deaca35e548218df7f8358b79ecb9 Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1295456017 Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 3a7b07fb7b4d459e8f09ffc731a779fd Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-SecurityGroupsTestJSON-1295456017-project Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 69c5530b-64fd-465c-a52c-9e81b68a3f2a could not be found. Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '69c5530b-64fd-465c-a52c-9e81b68a3f2a'} Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c5530b-64fd-465c-a52c-9e81b68a3f2a could not be found. Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c5530b-64fd-465c-a52c-9e81b68a3f2a could not be found. Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:42:03.098292 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:42:03.111166 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:03.111166 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:42:03.111166 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:42:03.111166 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:42:03.111166 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:42:03.111166 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c5530b-64fd-465c-a52c-9e81b68a3f2a could not be found. Aug 18 11:42:03.111166 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:42:03.111166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b2a4f3c9-fdc8-4c52-92bf-d98d6ddcc770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Returning 404 to user: Instance 69c5530b-64fd-465c-a52c-9e81b68a3f2a could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:42:03.111166 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b2a4f3c9-fdc8-4c52-92bf-d98d6ddcc770 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a" status: 404 len: 111 microversion: 2.1 time: 0.034664 Aug 18 11:42:03.113468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-af389ee3-e86f-4a5d-a28b-ae7be60dda1c tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f51b0d9ab80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:03.114888 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1849/3844] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:03 2022] GET /compute/v2.1/servers/69c5530b-64fd-465c-a52c-9e81b68a3f2a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:42:03.687525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-346171dc-7fd1-4619-af7c-5e6db0bb3816 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:03.688888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-346171dc-7fd1-4619-af7c-5e6db0bb3816 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:03.701164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-346171dc-7fd1-4619-af7c-5e6db0bb3816 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:03.702465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-346171dc-7fd1-4619-af7c-5e6db0bb3816 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:03.704890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-346171dc-7fd1-4619-af7c-5e6db0bb3816 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:03.706393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-346171dc-7fd1-4619-af7c-5e6db0bb3816 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:03.707440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-346171dc-7fd1-4619-af7c-5e6db0bb3816 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:03.708642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-346171dc-7fd1-4619-af7c-5e6db0bb3816 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:04.006844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-346171dc-7fd1-4619-af7c-5e6db0bb3816 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:04.013987 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-af389ee3-e86f-4a5d-a28b-ae7be60dda1c tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/0bd4b543-016b-45d0-be43-fca5d544de96" status: 202 len: 0 microversion: 2.1 time: 0.909263 Aug 18 11:42:04.015665 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1996/3845] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:42:03 2022] DELETE /compute/v2.1/os-security-groups/0bd4b543-016b-45d0-be43-fca5d544de96 => generated 0 bytes in 912 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:42:04.024316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b8ecae59-6bce-419c-acfe-e48e3b642973 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:04.025220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b8ecae59-6bce-419c-acfe-e48e3b642973 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:04.025927 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-346171dc-7fd1-4619-af7c-5e6db0bb3816 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1314 microversion: 2.1 time: 0.344602 Aug 18 11:42:04.039229 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1850/3846] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:03 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:42:04.044538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8ecae59-6bce-419c-acfe-e48e3b642973 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:04.045242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8ecae59-6bce-419c-acfe-e48e3b642973 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:04.045723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8ecae59-6bce-419c-acfe-e48e3b642973 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:04.046758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8ecae59-6bce-419c-acfe-e48e3b642973 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:04.048128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8ecae59-6bce-419c-acfe-e48e3b642973 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:04.049816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8ecae59-6bce-419c-acfe-e48e3b642973 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:04.065267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2fd2b1b-13d2-4e0c-ad79-67bb8f845817 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] Calling method '.version_select at 0x7f519ec2cd30>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:04.318439 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a2fd2b1b-13d2-4e0c-ad79-67bb8f845817 tempest-SecurityGroupsTestJSON-1295456017 tempest-SecurityGroupsTestJSON-1295456017-project] 10.222.0.73 "DELETE /compute/v2.1/os-security-groups/52cc9053-9ded-4cbb-a3fe-34928682b225" status: 202 len: 0 microversion: 2.1 time: 0.262060 Aug 18 11:42:04.319924 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1851/3847] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:42:04 2022] DELETE /compute/v2.1/os-security-groups/52cc9053-9ded-4cbb-a3fe-34928682b225 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:42:04.331321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e27e2d10-8df5-405f-9ad2-b1b5c4d6edd9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:04.332924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e27e2d10-8df5-405f-9ad2-b1b5c4d6edd9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:04.343620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e27e2d10-8df5-405f-9ad2-b1b5c4d6edd9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:04.344252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e27e2d10-8df5-405f-9ad2-b1b5c4d6edd9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:04.345099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e27e2d10-8df5-405f-9ad2-b1b5c4d6edd9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:04.347306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e27e2d10-8df5-405f-9ad2-b1b5c4d6edd9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:04.348016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e27e2d10-8df5-405f-9ad2-b1b5c4d6edd9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:04.348681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e27e2d10-8df5-405f-9ad2-b1b5c4d6edd9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:04.440369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e27e2d10-8df5-405f-9ad2-b1b5c4d6edd9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:04.456298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e27e2d10-8df5-405f-9ad2-b1b5c4d6edd9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:04.459525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e27e2d10-8df5-405f-9ad2-b1b5c4d6edd9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:04.460992 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e27e2d10-8df5-405f-9ad2-b1b5c4d6edd9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.138968 Aug 18 11:42:04.462162 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1852/3848] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:04 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:04.468793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-59b7dd85-3828-4edc-b012-683dccfe3092 req-71dbfb35-9599-419c-b089-ed7287474216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a271f66-8a14-478f-8aca-cc98b70d1e32", "tag": "52a14f74-4c08-4475-8a96-3cb26fb1703e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:04.483083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-59b7dd85-3828-4edc-b012-683dccfe3092 req-71dbfb35-9599-419c-b089-ed7287474216 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:04.483947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-59b7dd85-3828-4edc-b012-683dccfe3092 req-71dbfb35-9599-419c-b089-ed7287474216 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:04.485958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-59b7dd85-3828-4edc-b012-683dccfe3092 req-71dbfb35-9599-419c-b089-ed7287474216 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:04.509648 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-59b7dd85-3828-4edc-b012-683dccfe3092 req-71dbfb35-9599-419c-b089-ed7287474216 service nova] Creating event network-changed:52a14f74-4c08-4475-8a96-3cb26fb1703e for instance 5a271f66-8a14-478f-8aca-cc98b70d1e32 on n-h2-853611-3 Aug 18 11:42:04.520056 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-59b7dd85-3828-4edc-b012-683dccfe3092 req-71dbfb35-9599-419c-b089-ed7287474216 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055504 Aug 18 11:42:04.521851 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1853/3849] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:04.547448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8ecae59-6bce-419c-acfe-e48e3b642973 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:04.564852 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b8ecae59-6bce-419c-acfe-e48e3b642973 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.542975 Aug 18 11:42:04.566914 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1997/3850] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:04 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:05.064757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:05.068752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:05.098534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aa2365fb-3d4d-4955-b9c2-b8b8195e5987 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:05.100542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-aa2365fb-3d4d-4955-b9c2-b8b8195e5987 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:05.133650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa2365fb-3d4d-4955-b9c2-b8b8195e5987 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:05.135722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa2365fb-3d4d-4955-b9c2-b8b8195e5987 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:05.136908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa2365fb-3d4d-4955-b9c2-b8b8195e5987 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:05.138861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa2365fb-3d4d-4955-b9c2-b8b8195e5987 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:05.140981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa2365fb-3d4d-4955-b9c2-b8b8195e5987 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:05.143273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aa2365fb-3d4d-4955-b9c2-b8b8195e5987 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:05.495799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-039615b4-df31-4cf5-bdbd-a37e33be59b7 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:05.501956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-039615b4-df31-4cf5-bdbd-a37e33be59b7 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:05.508085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:05.530513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-039615b4-df31-4cf5-bdbd-a37e33be59b7 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:05.537817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-039615b4-df31-4cf5-bdbd-a37e33be59b7 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:05.538757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-039615b4-df31-4cf5-bdbd-a37e33be59b7 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:05.540094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-039615b4-df31-4cf5-bdbd-a37e33be59b7 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:05.540941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-039615b4-df31-4cf5-bdbd-a37e33be59b7 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:05.541715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-039615b4-df31-4cf5-bdbd-a37e33be59b7 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:05.822527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-039615b4-df31-4cf5-bdbd-a37e33be59b7 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:05.857542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-039615b4-df31-4cf5-bdbd-a37e33be59b7 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:05.877896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-039615b4-df31-4cf5-bdbd-a37e33be59b7 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:05.892223 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-039615b4-df31-4cf5-bdbd-a37e33be59b7 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.403642 Aug 18 11:42:05.907084 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1998/3851] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:05 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:05.935715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d7dc8b51-392e-4e38-b04a-2c5d16a4c600 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:05.936791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d7dc8b51-392e-4e38-b04a-2c5d16a4c600 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:05.952276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7dc8b51-392e-4e38-b04a-2c5d16a4c600 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:05.953875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7dc8b51-392e-4e38-b04a-2c5d16a4c600 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:05.954715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7dc8b51-392e-4e38-b04a-2c5d16a4c600 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:05.955943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7dc8b51-392e-4e38-b04a-2c5d16a4c600 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:05.956751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7dc8b51-392e-4e38-b04a-2c5d16a4c600 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:05.957534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7dc8b51-392e-4e38-b04a-2c5d16a4c600 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:06.076325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aa2365fb-3d4d-4955-b9c2-b8b8195e5987 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:06.086941 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aa2365fb-3d4d-4955-b9c2-b8b8195e5987 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1314 microversion: 2.1 time: 1.026957 Aug 18 11:42:06.100933 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1854/3852] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:05 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1314 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:06.711909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d7dc8b51-392e-4e38-b04a-2c5d16a4c600 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:06.736666 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d7dc8b51-392e-4e38-b04a-2c5d16a4c600 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.826480 Aug 18 11:42:06.738797 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 1999/3853] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:05 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:06.967615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6d99541b-bf84-4272-9d94-34da43c1442e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:06.971777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6d99541b-bf84-4272-9d94-34da43c1442e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:07.012570 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d99541b-bf84-4272-9d94-34da43c1442e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:07.014701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d99541b-bf84-4272-9d94-34da43c1442e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:07.015849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d99541b-bf84-4272-9d94-34da43c1442e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:07.016196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d99541b-bf84-4272-9d94-34da43c1442e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:07.017285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d99541b-bf84-4272-9d94-34da43c1442e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:07.018081 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d99541b-bf84-4272-9d94-34da43c1442e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:07.123952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6fc48c6d-3246-4f24-b450-60bac918f6ce tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:07.125599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6fc48c6d-3246-4f24-b450-60bac918f6ce tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:07.142707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fc48c6d-3246-4f24-b450-60bac918f6ce tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:07.144594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fc48c6d-3246-4f24-b450-60bac918f6ce tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:07.146296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fc48c6d-3246-4f24-b450-60bac918f6ce tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:07.148357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fc48c6d-3246-4f24-b450-60bac918f6ce tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:07.150232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fc48c6d-3246-4f24-b450-60bac918f6ce tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:07.151609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fc48c6d-3246-4f24-b450-60bac918f6ce tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:07.231069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6d99541b-bf84-4272-9d94-34da43c1442e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:07.248818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6d99541b-bf84-4272-9d94-34da43c1442e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:07.254005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6d99541b-bf84-4272-9d94-34da43c1442e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:07.256458 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6d99541b-bf84-4272-9d94-34da43c1442e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.318734 Aug 18 11:42:07.259675 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1855/3854] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:06 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:42:07.563976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6fc48c6d-3246-4f24-b450-60bac918f6ce tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:07.598386 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6fc48c6d-3246-4f24-b450-60bac918f6ce tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1314 microversion: 2.1 time: 0.492180 Aug 18 11:42:07.609801 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2000/3855] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:07 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:07.775761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4b8fef11-7f88-4381-95ff-5248e0dc461b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:07.777835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4b8fef11-7f88-4381-95ff-5248e0dc461b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:07.804483 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b8fef11-7f88-4381-95ff-5248e0dc461b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:07.804991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b8fef11-7f88-4381-95ff-5248e0dc461b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:07.805445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b8fef11-7f88-4381-95ff-5248e0dc461b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:07.806174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b8fef11-7f88-4381-95ff-5248e0dc461b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:07.806748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b8fef11-7f88-4381-95ff-5248e0dc461b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:07.807185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b8fef11-7f88-4381-95ff-5248e0dc461b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:08.247452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4b8fef11-7f88-4381-95ff-5248e0dc461b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:08.275287 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4b8fef11-7f88-4381-95ff-5248e0dc461b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.515914 Aug 18 11:42:08.278676 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1856/3856] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:07 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:08.303827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3fdd6d23-d0ad-4a3d-bef8-df262d159369 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:08.304766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3fdd6d23-d0ad-4a3d-bef8-df262d159369 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:08.316022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3fdd6d23-d0ad-4a3d-bef8-df262d159369 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:08.317257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3fdd6d23-d0ad-4a3d-bef8-df262d159369 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:08.318404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3fdd6d23-d0ad-4a3d-bef8-df262d159369 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:08.320264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3fdd6d23-d0ad-4a3d-bef8-df262d159369 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:08.322618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3fdd6d23-d0ad-4a3d-bef8-df262d159369 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:08.324296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3fdd6d23-d0ad-4a3d-bef8-df262d159369 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:08.496715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3fdd6d23-d0ad-4a3d-bef8-df262d159369 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:08.511107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3fdd6d23-d0ad-4a3d-bef8-df262d159369 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:08.513606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3fdd6d23-d0ad-4a3d-bef8-df262d159369 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:08.517240 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3fdd6d23-d0ad-4a3d-bef8-df262d159369 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.215957 Aug 18 11:42:08.517731 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2001/3857] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:08 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:08.636247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-641150fa-3124-4b23-a1c8-ea69e4aff0ea tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:08.637439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-641150fa-3124-4b23-a1c8-ea69e4aff0ea tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:08.660651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-641150fa-3124-4b23-a1c8-ea69e4aff0ea tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:08.675868 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-641150fa-3124-4b23-a1c8-ea69e4aff0ea tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:08.677168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-641150fa-3124-4b23-a1c8-ea69e4aff0ea tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:08.679007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-641150fa-3124-4b23-a1c8-ea69e4aff0ea tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:08.680088 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-641150fa-3124-4b23-a1c8-ea69e4aff0ea tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:08.681141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-641150fa-3124-4b23-a1c8-ea69e4aff0ea tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:09.066101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-641150fa-3124-4b23-a1c8-ea69e4aff0ea tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:09.079993 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-641150fa-3124-4b23-a1c8-ea69e4aff0ea tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1314 microversion: 2.1 time: 0.451300 Aug 18 11:42:09.081267 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1857/3858] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:08 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:09.320937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7dc730a4-b9fd-4cfc-8a26-9fc78855de6b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:09.323505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dc730a4-b9fd-4cfc-8a26-9fc78855de6b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:09.353962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc730a4-b9fd-4cfc-8a26-9fc78855de6b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:09.354846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc730a4-b9fd-4cfc-8a26-9fc78855de6b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:09.355620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc730a4-b9fd-4cfc-8a26-9fc78855de6b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:09.357194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc730a4-b9fd-4cfc-8a26-9fc78855de6b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:09.359835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc730a4-b9fd-4cfc-8a26-9fc78855de6b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:09.366792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc730a4-b9fd-4cfc-8a26-9fc78855de6b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:09.562405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-340852dc-4a7f-4948-a1c6-675525f99440 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:09.563290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-340852dc-4a7f-4948-a1c6-675525f99440 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:09.576076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-340852dc-4a7f-4948-a1c6-675525f99440 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:09.576245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-340852dc-4a7f-4948-a1c6-675525f99440 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:09.576577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-340852dc-4a7f-4948-a1c6-675525f99440 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:09.580401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-340852dc-4a7f-4948-a1c6-675525f99440 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:09.581118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-340852dc-4a7f-4948-a1c6-675525f99440 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:09.582123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-340852dc-4a7f-4948-a1c6-675525f99440 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:09.928668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-340852dc-4a7f-4948-a1c6-675525f99440 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:09.941332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-340852dc-4a7f-4948-a1c6-675525f99440 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:09.947417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7dc730a4-b9fd-4cfc-8a26-9fc78855de6b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:09.951091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-340852dc-4a7f-4948-a1c6-675525f99440 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:09.953046 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-340852dc-4a7f-4948-a1c6-675525f99440 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1364 microversion: 2.57 time: 0.394644 Aug 18 11:42:09.967065 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1858/3859] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:09 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1364 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:09.967447 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7dc730a4-b9fd-4cfc-8a26-9fc78855de6b tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.648044 Aug 18 11:42:09.967447 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2002/3860] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:09 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:10.103942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa281ca3-ace6-44b3-b834-97d4f2beaab3 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:10.107653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fa281ca3-ace6-44b3-b834-97d4f2beaab3 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:10.130291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa281ca3-ace6-44b3-b834-97d4f2beaab3 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:10.131079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa281ca3-ace6-44b3-b834-97d4f2beaab3 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:10.132904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa281ca3-ace6-44b3-b834-97d4f2beaab3 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:10.134113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa281ca3-ace6-44b3-b834-97d4f2beaab3 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:10.141077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa281ca3-ace6-44b3-b834-97d4f2beaab3 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:10.141910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa281ca3-ace6-44b3-b834-97d4f2beaab3 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:10.599607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fa281ca3-ace6-44b3-b834-97d4f2beaab3 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:10.615104 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fa281ca3-ace6-44b3-b834-97d4f2beaab3 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1314 microversion: 2.1 time: 0.516220 Aug 18 11:42:10.618770 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1859/3861] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:10 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:10.998207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2ca71d79-78a3-4877-b7dd-eeb32bd95f8d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:10.998940 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2ca71d79-78a3-4877-b7dd-eeb32bd95f8d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:11.006227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-beacfc8c-8d99-4d42-8672-61d3e06ea22e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:11.010385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-beacfc8c-8d99-4d42-8672-61d3e06ea22e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:11.017813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ca71d79-78a3-4877-b7dd-eeb32bd95f8d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:11.018348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ca71d79-78a3-4877-b7dd-eeb32bd95f8d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:11.018837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ca71d79-78a3-4877-b7dd-eeb32bd95f8d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:11.021298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ca71d79-78a3-4877-b7dd-eeb32bd95f8d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:11.035123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ca71d79-78a3-4877-b7dd-eeb32bd95f8d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:11.035614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-beacfc8c-8d99-4d42-8672-61d3e06ea22e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:11.035773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ca71d79-78a3-4877-b7dd-eeb32bd95f8d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:11.038891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-beacfc8c-8d99-4d42-8672-61d3e06ea22e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:11.039850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-beacfc8c-8d99-4d42-8672-61d3e06ea22e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:11.051815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-beacfc8c-8d99-4d42-8672-61d3e06ea22e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:11.057747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-beacfc8c-8d99-4d42-8672-61d3e06ea22e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:11.058895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-beacfc8c-8d99-4d42-8672-61d3e06ea22e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:11.425472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-beacfc8c-8d99-4d42-8672-61d3e06ea22e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:11.434974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-beacfc8c-8d99-4d42-8672-61d3e06ea22e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:11.436541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-beacfc8c-8d99-4d42-8672-61d3e06ea22e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:11.438450 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-beacfc8c-8d99-4d42-8672-61d3e06ea22e tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1370 microversion: 2.57 time: 0.450818 Aug 18 11:42:11.458419 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2003/3862] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:10 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1370 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:11.543890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-91a3e3df-13df-494d-ae0d-3ea6f623dba4 req-478f4bac-232b-4b77-97b7-e89609cf567a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a271f66-8a14-478f-8aca-cc98b70d1e32", "name": "network-vif-plugged", "status": "completed", "tag": "52a14f74-4c08-4475-8a96-3cb26fb1703e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:11.582819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-91a3e3df-13df-494d-ae0d-3ea6f623dba4 req-478f4bac-232b-4b77-97b7-e89609cf567a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:11.583311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-91a3e3df-13df-494d-ae0d-3ea6f623dba4 req-478f4bac-232b-4b77-97b7-e89609cf567a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:11.586943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-91a3e3df-13df-494d-ae0d-3ea6f623dba4 req-478f4bac-232b-4b77-97b7-e89609cf567a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:11.629798 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-91a3e3df-13df-494d-ae0d-3ea6f623dba4 req-478f4bac-232b-4b77-97b7-e89609cf567a service nova] Creating event network-vif-plugged:52a14f74-4c08-4475-8a96-3cb26fb1703e for instance 5a271f66-8a14-478f-8aca-cc98b70d1e32 on n-h2-853611-3 Aug 18 11:42:11.651135 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-91a3e3df-13df-494d-ae0d-3ea6f623dba4 req-478f4bac-232b-4b77-97b7-e89609cf567a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106509 Aug 18 11:42:11.664792 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2004/3863] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:42:11.704763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7820e267-df84-4d59-b714-75db1477e162 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:11.705484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7820e267-df84-4d59-b714-75db1477e162 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:11.745695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7820e267-df84-4d59-b714-75db1477e162 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:11.746587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7820e267-df84-4d59-b714-75db1477e162 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:11.747564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7820e267-df84-4d59-b714-75db1477e162 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:11.748970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7820e267-df84-4d59-b714-75db1477e162 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:11.751076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7820e267-df84-4d59-b714-75db1477e162 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:11.752316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7820e267-df84-4d59-b714-75db1477e162 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:11.803833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:12.007103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2ca71d79-78a3-4877-b7dd-eeb32bd95f8d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:12.026076 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2ca71d79-78a3-4877-b7dd-eeb32bd95f8d tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 1.033051 Aug 18 11:42:12.026752 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1860/3864] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:10 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:12.216673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7820e267-df84-4d59-b714-75db1477e162 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:12.230302 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7820e267-df84-4d59-b714-75db1477e162 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1314 microversion: 2.1 time: 0.561105 Aug 18 11:42:12.231840 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2005/3865] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:11 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:12.470489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4bc9f81a-0f63-4705-9af4-e4689770edc2 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:12.476450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4bc9f81a-0f63-4705-9af4-e4689770edc2 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:12.488627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bc9f81a-0f63-4705-9af4-e4689770edc2 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:12.489449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bc9f81a-0f63-4705-9af4-e4689770edc2 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:12.490121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bc9f81a-0f63-4705-9af4-e4689770edc2 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:12.491403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bc9f81a-0f63-4705-9af4-e4689770edc2 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:12.492413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bc9f81a-0f63-4705-9af4-e4689770edc2 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:12.493048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4bc9f81a-0f63-4705-9af4-e4689770edc2 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:12.654820 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4bc9f81a-0f63-4705-9af4-e4689770edc2 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:12.670840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4bc9f81a-0f63-4705-9af4-e4689770edc2 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:12.673537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4bc9f81a-0f63-4705-9af4-e4689770edc2 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:12.679003 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4bc9f81a-0f63-4705-9af4-e4689770edc2 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1370 microversion: 2.57 time: 0.216997 Aug 18 11:42:12.681858 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1861/3866] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:12 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:13.049696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-385d2a9d-9262-4b4f-a2ad-e1041c05a9d1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:13.050316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-385d2a9d-9262-4b4f-a2ad-e1041c05a9d1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:13.094866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-385d2a9d-9262-4b4f-a2ad-e1041c05a9d1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:13.095379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-385d2a9d-9262-4b4f-a2ad-e1041c05a9d1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:13.095830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-385d2a9d-9262-4b4f-a2ad-e1041c05a9d1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:13.096831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-385d2a9d-9262-4b4f-a2ad-e1041c05a9d1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:13.097501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-385d2a9d-9262-4b4f-a2ad-e1041c05a9d1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:13.098124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-385d2a9d-9262-4b4f-a2ad-e1041c05a9d1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:13.268632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1725e21a-43bc-4be6-8afc-89a91e6b1c34 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:13.270624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1725e21a-43bc-4be6-8afc-89a91e6b1c34 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:13.319211 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1725e21a-43bc-4be6-8afc-89a91e6b1c34 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:13.328005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1725e21a-43bc-4be6-8afc-89a91e6b1c34 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:13.331208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1725e21a-43bc-4be6-8afc-89a91e6b1c34 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:13.344582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1725e21a-43bc-4be6-8afc-89a91e6b1c34 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:13.348318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1725e21a-43bc-4be6-8afc-89a91e6b1c34 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:13.348888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1725e21a-43bc-4be6-8afc-89a91e6b1c34 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:13.868650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-385d2a9d-9262-4b4f-a2ad-e1041c05a9d1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:13.885219 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-385d2a9d-9262-4b4f-a2ad-e1041c05a9d1 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.837668 Aug 18 11:42:13.886141 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2006/3867] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:13 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:13.903167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-add2f4e3-811a-4172-87f3-88a74bd9e432 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:13.903492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1725e21a-43bc-4be6-8afc-89a91e6b1c34 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:13.906715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-add2f4e3-811a-4172-87f3-88a74bd9e432 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:13.912975 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1725e21a-43bc-4be6-8afc-89a91e6b1c34 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1314 microversion: 2.1 time: 0.660157 Aug 18 11:42:13.913723 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1862/3868] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:13 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:13.929420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-add2f4e3-811a-4172-87f3-88a74bd9e432 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:13.930159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-add2f4e3-811a-4172-87f3-88a74bd9e432 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:13.930913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-add2f4e3-811a-4172-87f3-88a74bd9e432 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:13.932110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-add2f4e3-811a-4172-87f3-88a74bd9e432 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:13.932942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-add2f4e3-811a-4172-87f3-88a74bd9e432 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:13.933657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-add2f4e3-811a-4172-87f3-88a74bd9e432 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:14.126856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-add2f4e3-811a-4172-87f3-88a74bd9e432 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:14.172514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-add2f4e3-811a-4172-87f3-88a74bd9e432 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:14.185174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-add2f4e3-811a-4172-87f3-88a74bd9e432 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:14.189377 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-add2f4e3-811a-4172-87f3-88a74bd9e432 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1355 microversion: 2.57 time: 0.301317 Aug 18 11:42:14.208244 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2007/3869] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:13 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1355 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:14.251202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2db86756-cf5e-4c01-91ce-bba35b888de6 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:14.252641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2db86756-cf5e-4c01-91ce-bba35b888de6 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:14.271254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2db86756-cf5e-4c01-91ce-bba35b888de6 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:14.272561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2db86756-cf5e-4c01-91ce-bba35b888de6 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:14.273583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2db86756-cf5e-4c01-91ce-bba35b888de6 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:14.275180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2db86756-cf5e-4c01-91ce-bba35b888de6 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:14.278704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2db86756-cf5e-4c01-91ce-bba35b888de6 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:14.280022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2db86756-cf5e-4c01-91ce-bba35b888de6 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:14.333920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2db86756-cf5e-4c01-91ce-bba35b888de6 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:42:14.394652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-150716591", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "bb55cbdd-b03b-4fb1-9db4-db533cf97e8f"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:14.498740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:14.512561 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2db86756-cf5e-4c01-91ce-bba35b888de6 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 204 len: 0 microversion: 2.57 time: 0.275462 Aug 18 11:42:14.513371 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2008/3870] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:42:14 2022] DELETE /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:42:14.534531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-007bcd4f-885a-4aa8-a870-647e46e018c3 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:14.536055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-007bcd4f-885a-4aa8-a870-647e46e018c3 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:14.543362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-007bcd4f-885a-4aa8-a870-647e46e018c3 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:14.544318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-007bcd4f-885a-4aa8-a870-647e46e018c3 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:14.545052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-007bcd4f-885a-4aa8-a870-647e46e018c3 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:14.547209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-007bcd4f-885a-4aa8-a870-647e46e018c3 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:14.547970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-007bcd4f-885a-4aa8-a870-647e46e018c3 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:14.560077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-007bcd4f-885a-4aa8-a870-647e46e018c3 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:14.639097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] validate_networks() for [('bb55cbdd-b03b-4fb1-9db4-db533cf97e8f', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:42:14.757180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-007bcd4f-885a-4aa8-a870-647e46e018c3 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:14.769712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-007bcd4f-885a-4aa8-a870-647e46e018c3 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:14.771964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-007bcd4f-885a-4aa8-a870-647e46e018c3 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:14.773817 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-007bcd4f-885a-4aa8-a870-647e46e018c3 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1361 microversion: 2.57 time: 0.246669 Aug 18 11:42:14.778982 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2009/3871] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:14 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1361 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:14.912643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8c4bf2e3-190b-4494-a378-9d93e7668879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:14.914453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8c4bf2e3-190b-4494-a378-9d93e7668879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:14.922146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c4bf2e3-190b-4494-a378-9d93e7668879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:14.922908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c4bf2e3-190b-4494-a378-9d93e7668879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:14.923523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c4bf2e3-190b-4494-a378-9d93e7668879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:14.924465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c4bf2e3-190b-4494-a378-9d93e7668879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:14.925094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c4bf2e3-190b-4494-a378-9d93e7668879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:14.925715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c4bf2e3-190b-4494-a378-9d93e7668879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:15.086238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8c4bf2e3-190b-4494-a378-9d93e7668879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:15.099509 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8c4bf2e3-190b-4494-a378-9d93e7668879 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.191433 Aug 18 11:42:15.100124 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2010/3872] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:14 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:42:15.105154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1fc21ba5-54ee-44e1-a914-de812a7ced0a tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:15.105787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1fc21ba5-54ee-44e1-a914-de812a7ced0a tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:15.112704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fc21ba5-54ee-44e1-a914-de812a7ced0a tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:15.113475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fc21ba5-54ee-44e1-a914-de812a7ced0a tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:15.114090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fc21ba5-54ee-44e1-a914-de812a7ced0a tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:15.115116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fc21ba5-54ee-44e1-a914-de812a7ced0a tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:15.115767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fc21ba5-54ee-44e1-a914-de812a7ced0a tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:15.116365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fc21ba5-54ee-44e1-a914-de812a7ced0a tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:15.440492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1fc21ba5-54ee-44e1-a914-de812a7ced0a tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:15.459054 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1fc21ba5-54ee-44e1-a914-de812a7ced0a tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1463 microversion: 2.1 time: 0.357140 Aug 18 11:42:15.469949 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2011/3873] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:15 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1463 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:16.000024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9987b7e1-5b17-45f1-b2a4-72145522009a tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] Calling method '.version_select at 0x7f51ac4fc4c0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:16.019613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9987b7e1-5b17-45f1-b2a4-72145522009a tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:16.020101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9987b7e1-5b17-45f1-b2a4-72145522009a tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:16.022893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9987b7e1-5b17-45f1-b2a4-72145522009a tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:16.067500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9987b7e1-5b17-45f1-b2a4-72145522009a tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:16.068362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9987b7e1-5b17-45f1-b2a4-72145522009a tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:16.068832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9987b7e1-5b17-45f1-b2a4-72145522009a tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:16.117790 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9987b7e1-5b17-45f1-b2a4-72145522009a tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] 10.222.0.73 "GET /compute/v2.1/os-simple-tenant-usage/f2b7dd922df047a6bca547f351fc8336?start=2022-08-17T11%3A42%3A15.484127&end=2022-08-19T11%3A42%3A15.484127" status: 200 len: 695 microversion: 2.1 time: 0.626294 Aug 18 11:42:16.123508 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2012/3874] 10.222.0.73 () {58 vars in 1412 bytes} [Thu Aug 18 11:42:15 2022] GET /compute/v2.1/os-simple-tenant-usage/f2b7dd922df047a6bca547f351fc8336?start=2022-08-17T11%3A42%3A15.484127&end=2022-08-19T11%3A42%3A15.484127 => generated 695 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:16.134814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e878e92e-62c0-41d0-86f6-895d8b5d9460 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:16.135629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e878e92e-62c0-41d0-86f6-895d8b5d9460 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:16.140316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:42:16.141984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:42:16.143138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:42:16.144452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:42:16.145449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:42:16.145794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e878e92e-62c0-41d0-86f6-895d8b5d9460 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:16.146300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e878e92e-62c0-41d0-86f6-895d8b5d9460 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:16.146776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e878e92e-62c0-41d0-86f6-895d8b5d9460 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:16.147523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e878e92e-62c0-41d0-86f6-895d8b5d9460 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:16.147995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e878e92e-62c0-41d0-86f6-895d8b5d9460 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:16.148432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e878e92e-62c0-41d0-86f6-895d8b5d9460 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:16.164883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:16.166236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:16.167278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:16.168886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:16.170090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:16.171769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:16.228916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Getting quotas for project 025ca122152a4dd1928436f60f3aef36. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:42:16.244440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Getting quotas for user 1c0d507df31e4ac3929fc896a4cac68a and project 025ca122152a4dd1928436f60f3aef36. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:42:16.263687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:42:16.268406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:42:16.302476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e878e92e-62c0-41d0-86f6-895d8b5d9460 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:16.320423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e878e92e-62c0-41d0-86f6-895d8b5d9460 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:16.324920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e878e92e-62c0-41d0-86f6-895d8b5d9460 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:16.329225 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e878e92e-62c0-41d0-86f6-895d8b5d9460 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1361 microversion: 2.57 time: 0.203584 Aug 18 11:42:16.331295 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2013/3875] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:16 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:16.343170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e0417c73-7b82-48e0-b9a2-69ff5b7496b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:16.345248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e0417c73-7b82-48e0-b9a2-69ff5b7496b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:16.357875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0417c73-7b82-48e0-b9a2-69ff5b7496b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:16.360394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0417c73-7b82-48e0-b9a2-69ff5b7496b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:16.361490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0417c73-7b82-48e0-b9a2-69ff5b7496b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:16.369673 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1e867e5c-8b6f-454f-85d5-22f3e19ec097 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.246809 Aug 18 11:42:16.371129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0417c73-7b82-48e0-b9a2-69ff5b7496b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:16.371691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0417c73-7b82-48e0-b9a2-69ff5b7496b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:16.372579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0417c73-7b82-48e0-b9a2-69ff5b7496b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:16.373035 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1863/3876] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:42:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2251 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 18 11:42:16.391400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-892900e4-8e1f-4adc-97fe-8cacbad3e660 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '.version_select at 0x7f519ebac8b0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:16.416236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-892900e4-8e1f-4adc-97fe-8cacbad3e660 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:16.417288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-892900e4-8e1f-4adc-97fe-8cacbad3e660 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:16.418418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-892900e4-8e1f-4adc-97fe-8cacbad3e660 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:16.461163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-892900e4-8e1f-4adc-97fe-8cacbad3e660 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:16.462179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-892900e4-8e1f-4adc-97fe-8cacbad3e660 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:16.463133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-892900e4-8e1f-4adc-97fe-8cacbad3e660 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:16.516280 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-892900e4-8e1f-4adc-97fe-8cacbad3e660 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/os-simple-tenant-usage/f2b7dd922df047a6bca547f351fc8336?start=2022-08-17T11%3A42%3A15.484127&end=2022-08-19T11%3A42%3A15.484127" status: 200 len: 695 microversion: 2.1 time: 0.138697 Aug 18 11:42:16.518553 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1864/3877] 10.222.0.73 () {58 vars in 1412 bytes} [Thu Aug 18 11:42:16 2022] GET /compute/v2.1/os-simple-tenant-usage/f2b7dd922df047a6bca547f351fc8336?start=2022-08-17T11%3A42%3A15.484127&end=2022-08-19T11%3A42%3A15.484127 => generated 695 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:16.754856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e0417c73-7b82-48e0-b9a2-69ff5b7496b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:16.772480 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e0417c73-7b82-48e0-b9a2-69ff5b7496b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.438910 Aug 18 11:42:16.773197 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2014/3878] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:16 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:16.782516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-255ca010-c80d-4a92-86bd-6bede45a38a1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:16.789700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-255ca010-c80d-4a92-86bd-6bede45a38a1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:16.905355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-255ca010-c80d-4a92-86bd-6bede45a38a1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:16.915735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-255ca010-c80d-4a92-86bd-6bede45a38a1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:16.917781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-255ca010-c80d-4a92-86bd-6bede45a38a1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:16.919496 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-255ca010-c80d-4a92-86bd-6bede45a38a1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1261 microversion: 2.26 time: 0.145288 Aug 18 11:42:16.931569 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2015/3879] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:16 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:16.947757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-27495e91-7570-494e-8ada-70b8905c5066 tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] Calling method '.version_select at 0x7f519eebaf70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:16.959807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27495e91-7570-494e-8ada-70b8905c5066 tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:16.960341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27495e91-7570-494e-8ada-70b8905c5066 tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:16.961177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27495e91-7570-494e-8ada-70b8905c5066 tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:16.981749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27495e91-7570-494e-8ada-70b8905c5066 tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:16.982619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27495e91-7570-494e-8ada-70b8905c5066 tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:16.983911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27495e91-7570-494e-8ada-70b8905c5066 tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:17.266197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1544117582", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "63c48690-bd0f-4b5d-b87b-6dac29cdd74b"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:17.419347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] validate_networks() for [('63c48690-bd0f-4b5d-b87b-6dac29cdd74b', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:42:17.429267 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-27495e91-7570-494e-8ada-70b8905c5066 tempest-TenantUsagesTestJSON-332822050 tempest-TenantUsagesTestJSON-332822050-project-admin] 10.222.0.73 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-17T11%3A42%3A15.484127&end=2022-08-19T11%3A42%3A15.484127&detailed=1" status: 200 len: 46634 microversion: 2.1 time: 0.495994 Aug 18 11:42:17.431687 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2016/3880] 10.222.0.73 () {58 vars in 1335 bytes} [Thu Aug 18 11:42:16 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-17T11%3A42%3A15.484127&end=2022-08-19T11%3A42%3A15.484127&detailed=1 => generated 46634 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:42:17.442263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:17.443729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:17.455293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:17.456535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:17.457577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:17.459386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:17.460504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:17.462408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:17.560610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:17.562399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:17.563485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:17.564423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lazy-loading 'fault' on Instance uuid ed8238c2-8f3c-459a-a42b-4444271993c2 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:17.664338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:17.683381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:17.687605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '804763c6a7b84485b80da978df2df05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78700431c154251840020bc606c7bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:17.690411 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-508129da-23ce-4140-8599-1cf05068fbf0 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 200 len: 1366 microversion: 2.57 time: 0.256560 Aug 18 11:42:17.691863 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2017/3881] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:17 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:17.702376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c7b514a5-5783-4aab-b7cd-f590c3b2508e tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:17.703865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c7b514a5-5783-4aab-b7cd-f590c3b2508e tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:17.716506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7b514a5-5783-4aab-b7cd-f590c3b2508e tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:17.717901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7b514a5-5783-4aab-b7cd-f590c3b2508e tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:17.718933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7b514a5-5783-4aab-b7cd-f590c3b2508e tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:17.720343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7b514a5-5783-4aab-b7cd-f590c3b2508e tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:17.721420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7b514a5-5783-4aab-b7cd-f590c3b2508e tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:17.722417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7b514a5-5783-4aab-b7cd-f590c3b2508e tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:17.786305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c7b514a5-5783-4aab-b7cd-f590c3b2508e tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:42:17.922734 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c7b514a5-5783-4aab-b7cd-f590c3b2508e tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 204 len: 0 microversion: 2.1 time: 0.227955 Aug 18 11:42:17.923853 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2018/3882] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:42:17 2022] DELETE /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:42:17.941553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7637307-3081-42ed-a9e8-e70d2cb9f768 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:17.945605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a7637307-3081-42ed-a9e8-e70d2cb9f768 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:17.960455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7637307-3081-42ed-a9e8-e70d2cb9f768 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:17.961413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7637307-3081-42ed-a9e8-e70d2cb9f768 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:17.962078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7637307-3081-42ed-a9e8-e70d2cb9f768 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:17.963818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7637307-3081-42ed-a9e8-e70d2cb9f768 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:17.964528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7637307-3081-42ed-a9e8-e70d2cb9f768 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:17.965147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7637307-3081-42ed-a9e8-e70d2cb9f768 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:18.290421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:42:18.291389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:42:18.292180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:42:18.292862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:42:18.293692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:42:18.303949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:18.315543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:18.316331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:18.317062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:18.318182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a7637307-3081-42ed-a9e8-e70d2cb9f768 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:18.318462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:18.319249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:18.319986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:18.328761 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a7637307-3081-42ed-a9e8-e70d2cb9f768 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.403351 Aug 18 11:42:18.332890 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2019/3883] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:17 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:18.345234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-49da4ab0-0948-4515-946b-45b98ece2b46 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:18.345875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-49da4ab0-0948-4515-946b-45b98ece2b46 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:18.361788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49da4ab0-0948-4515-946b-45b98ece2b46 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:18.367869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49da4ab0-0948-4515-946b-45b98ece2b46 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:18.368454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49da4ab0-0948-4515-946b-45b98ece2b46 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:18.370601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49da4ab0-0948-4515-946b-45b98ece2b46 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:18.371448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49da4ab0-0948-4515-946b-45b98ece2b46 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:18.371860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49da4ab0-0948-4515-946b-45b98ece2b46 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:18.378075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Getting quotas for project ca7031777c74405f90c3d5e0ac5cb208. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:42:18.391503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Getting quotas for user c1196b55b2754c2d8ea983837330d827 and project ca7031777c74405f90c3d5e0ac5cb208. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:42:18.422134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:18.472095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:42:18.487090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:42:18.688085 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c1bc1b87-fd42-4470-a428-ce098a2fa6c5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.167076 Aug 18 11:42:18.704752 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1865/3884] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:42:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:42:18.750848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-96600469-cf37-4210-907c-19b5c9d69064 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:18.756246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-96600469-cf37-4210-907c-19b5c9d69064 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:18.788245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96600469-cf37-4210-907c-19b5c9d69064 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:18.789106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96600469-cf37-4210-907c-19b5c9d69064 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:18.804562 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96600469-cf37-4210-907c-19b5c9d69064 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:18.812325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96600469-cf37-4210-907c-19b5c9d69064 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:18.813470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96600469-cf37-4210-907c-19b5c9d69064 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:18.814942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-96600469-cf37-4210-907c-19b5c9d69064 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:18.945493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-49da4ab0-0948-4515-946b-45b98ece2b46 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:18.961649 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-49da4ab0-0948-4515-946b-45b98ece2b46 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1469 microversion: 2.1 time: 0.626938 Aug 18 11:42:18.963631 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2020/3885] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:18 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1469 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:18.975109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a0db441-5d2d-43be-82b0-f9e5be0395d9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:18.976521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4a0db441-5d2d-43be-82b0-f9e5be0395d9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] [instance: ed8238c2-8f3c-459a-a42b-4444271993c2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:18.990988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a0db441-5d2d-43be-82b0-f9e5be0395d9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:18.992327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a0db441-5d2d-43be-82b0-f9e5be0395d9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:18.993651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a0db441-5d2d-43be-82b0-f9e5be0395d9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:18.995322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a0db441-5d2d-43be-82b0-f9e5be0395d9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:18.996490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a0db441-5d2d-43be-82b0-f9e5be0395d9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:18.997514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a0db441-5d2d-43be-82b0-f9e5be0395d9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:19.033631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-96600469-cf37-4210-907c-19b5c9d69064 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:19.050329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-96600469-cf37-4210-907c-19b5c9d69064 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:19.052727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-96600469-cf37-4210-907c-19b5c9d69064 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:19.056509 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-96600469-cf37-4210-907c-19b5c9d69064 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1321 microversion: 2.26 time: 0.348707 Aug 18 11:42:19.058313 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1866/3886] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:18 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:19.059198 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-4a0db441-5d2d-43be-82b0-f9e5be0395d9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] HTTP exception thrown: Instance ed8238c2-8f3c-459a-a42b-4444271993c2 could not be found. Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a0db441-5d2d-43be-82b0-f9e5be0395d9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Request method failure captured: Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 HTTP/1.1 Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iVtr3MC2qp2N-ILPfwBfGolcGyWaMEJI0atsI5x1mhnSlmTaWzWXEIYKZWWgMh-2f9spMfPW79DLBlsLrO7zPzNwPULAl8alJnhL7n_sXBN5P_rOhNCWarSjuKQ2shqntmxGNJvpSbEodY6ME8oBNse5fMtljw9keVeZzCUaFU9IjM Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.57 Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c78700431c154251840020bc606c7bf0 Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerShowV257Test-1834035771 Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c78700431c154251840020bc606c7bf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c78700431c154251840020bc606c7bf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c78700431c154251840020bc606c7bf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c78700431c154251840020bc606c7bf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerShowV257Test-1834035771 Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c78700431c154251840020bc606c7bf0 Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerShowV257Test-1834035771 Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerShowV257Test-1834035771-project Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 804763c6a7b84485b80da978df2df05b Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerShowV257Test-1834035771-project Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance ed8238c2-8f3c-459a-a42b-4444271993c2 could not be found. Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'ed8238c2-8f3c-459a-a42b-4444271993c2'} Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed8238c2-8f3c-459a-a42b-4444271993c2 could not be found. Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed8238c2-8f3c-459a-a42b-4444271993c2 could not be found. Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:42:19.066199 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:19.071076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:19.071076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:42:19.071076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:42:19.071076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:42:19.071076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:42:19.071076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed8238c2-8f3c-459a-a42b-4444271993c2 could not be found. Aug 18 11:42:19.071076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:19.073878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a0db441-5d2d-43be-82b0-f9e5be0395d9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] Returning 404 to user: Instance ed8238c2-8f3c-459a-a42b-4444271993c2 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:42:19.075195 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4a0db441-5d2d-43be-82b0-f9e5be0395d9 tempest-ServerShowV257Test-1834035771 tempest-ServerShowV257Test-1834035771-project] 10.222.0.73 "GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2" status: 404 len: 111 microversion: 2.57 time: 0.109357 Aug 18 11:42:19.077507 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2021/3887] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:18 2022] GET /compute/v2.1/servers/ed8238c2-8f3c-459a-a42b-4444271993c2 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:42:19.082955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1193792341", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "63c48690-bd0f-4b5d-b87b-6dac29cdd74b"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:19.177663 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] validate_networks() for [('63c48690-bd0f-4b5d-b87b-6dac29cdd74b', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:42:19.377069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-329ab42f-5911-4626-8201-efd49d576349 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:19.382585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-329ab42f-5911-4626-8201-efd49d576349 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:19.442800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-329ab42f-5911-4626-8201-efd49d576349 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:19.446656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-329ab42f-5911-4626-8201-efd49d576349 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:19.447987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-329ab42f-5911-4626-8201-efd49d576349 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:19.450632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-329ab42f-5911-4626-8201-efd49d576349 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:19.453501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-329ab42f-5911-4626-8201-efd49d576349 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:19.458740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-329ab42f-5911-4626-8201-efd49d576349 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:20.286852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-329ab42f-5911-4626-8201-efd49d576349 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:20.302938 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-329ab42f-5911-4626-8201-efd49d576349 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.947757 Aug 18 11:42:20.321494 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2022/3888] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:19 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:42:20.334307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3e097538-e6ce-43e8-ae09-d6a7b107c378 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:20.335002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3e097538-e6ce-43e8-ae09-d6a7b107c378 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:20.361628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e097538-e6ce-43e8-ae09-d6a7b107c378 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:20.363185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e097538-e6ce-43e8-ae09-d6a7b107c378 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:20.363818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e097538-e6ce-43e8-ae09-d6a7b107c378 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:20.365796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e097538-e6ce-43e8-ae09-d6a7b107c378 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:20.367088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e097538-e6ce-43e8-ae09-d6a7b107c378 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:20.367886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e097538-e6ce-43e8-ae09-d6a7b107c378 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:20.928912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3e097538-e6ce-43e8-ae09-d6a7b107c378 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:20.962413 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3e097538-e6ce-43e8-ae09-d6a7b107c378 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1469 microversion: 2.1 time: 0.637086 Aug 18 11:42:20.978683 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2023/3889] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:20 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1469 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:20.991268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-070ad1e1-c3e8-489f-836c-d0ac23856b8b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:20.992626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-070ad1e1-c3e8-489f-836c-d0ac23856b8b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:21.007931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-070ad1e1-c3e8-489f-836c-d0ac23856b8b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:21.012776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-070ad1e1-c3e8-489f-836c-d0ac23856b8b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:21.014357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-070ad1e1-c3e8-489f-836c-d0ac23856b8b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:21.017476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-070ad1e1-c3e8-489f-836c-d0ac23856b8b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:21.018300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-070ad1e1-c3e8-489f-836c-d0ac23856b8b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:21.018979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-070ad1e1-c3e8-489f-836c-d0ac23856b8b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:21.145809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-070ad1e1-c3e8-489f-836c-d0ac23856b8b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:21.162820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-070ad1e1-c3e8-489f-836c-d0ac23856b8b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:21.165165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-070ad1e1-c3e8-489f-836c-d0ac23856b8b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:21.171063 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-070ad1e1-c3e8-489f-836c-d0ac23856b8b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1319 microversion: 2.26 time: 0.188034 Aug 18 11:42:21.172438 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2024/3890] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:20 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:21.326131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eba4df6f-a64e-4c98-95ff-800d08ff1ded tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:21.326983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eba4df6f-a64e-4c98-95ff-800d08ff1ded tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:21.343907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eba4df6f-a64e-4c98-95ff-800d08ff1ded tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:21.344586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eba4df6f-a64e-4c98-95ff-800d08ff1ded tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:21.345159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eba4df6f-a64e-4c98-95ff-800d08ff1ded tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:21.346010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eba4df6f-a64e-4c98-95ff-800d08ff1ded tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:21.346683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eba4df6f-a64e-4c98-95ff-800d08ff1ded tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:21.347228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eba4df6f-a64e-4c98-95ff-800d08ff1ded tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:21.769623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-eba4df6f-a64e-4c98-95ff-800d08ff1ded tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:21.779123 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eba4df6f-a64e-4c98-95ff-800d08ff1ded tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.456781 Aug 18 11:42:21.780900 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2025/3891] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:21 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:42:22.003066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9913693c-a835-4cc1-b8f9-bc7cc60eccfa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:22.004195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9913693c-a835-4cc1-b8f9-bc7cc60eccfa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:22.016528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9913693c-a835-4cc1-b8f9-bc7cc60eccfa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:22.017737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9913693c-a835-4cc1-b8f9-bc7cc60eccfa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:22.018546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9913693c-a835-4cc1-b8f9-bc7cc60eccfa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:22.019739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9913693c-a835-4cc1-b8f9-bc7cc60eccfa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:22.020438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9913693c-a835-4cc1-b8f9-bc7cc60eccfa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:22.021142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9913693c-a835-4cc1-b8f9-bc7cc60eccfa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:22.314062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9913693c-a835-4cc1-b8f9-bc7cc60eccfa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:22.342763 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9913693c-a835-4cc1-b8f9-bc7cc60eccfa tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1469 microversion: 2.1 time: 0.345373 Aug 18 11:42:22.345479 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2026/3892] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:21 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1469 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:22.354978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1beffe8a-1c48-4858-acbf-3fe9e9b58d41 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:22.356337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1beffe8a-1c48-4858-acbf-3fe9e9b58d41 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:22.382287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1beffe8a-1c48-4858-acbf-3fe9e9b58d41 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:22.388341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1beffe8a-1c48-4858-acbf-3fe9e9b58d41 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:22.391869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1beffe8a-1c48-4858-acbf-3fe9e9b58d41 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:22.400092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1beffe8a-1c48-4858-acbf-3fe9e9b58d41 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:22.401391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1beffe8a-1c48-4858-acbf-3fe9e9b58d41 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:22.402490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1beffe8a-1c48-4858-acbf-3fe9e9b58d41 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:22.616087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1beffe8a-1c48-4858-acbf-3fe9e9b58d41 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:22.644650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1beffe8a-1c48-4858-acbf-3fe9e9b58d41 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:22.648241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1beffe8a-1c48-4858-acbf-3fe9e9b58d41 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:22.651264 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1beffe8a-1c48-4858-acbf-3fe9e9b58d41 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1319 microversion: 2.26 time: 0.303283 Aug 18 11:42:22.653094 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2027/3893] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:22 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:22.745085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:42:22.746052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:42:22.749789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:42:22.753727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:42:22.757254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:42:22.819831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eb434b28-1376-4570-aaa1-4f933641a67c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:22.821373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eb434b28-1376-4570-aaa1-4f933641a67c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:22.824912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:22.829870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:22.831121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:22.838208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:22.841271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:22.842654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:22.852469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb434b28-1376-4570-aaa1-4f933641a67c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:22.853331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb434b28-1376-4570-aaa1-4f933641a67c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:22.854167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb434b28-1376-4570-aaa1-4f933641a67c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:22.860938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb434b28-1376-4570-aaa1-4f933641a67c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:22.861802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb434b28-1376-4570-aaa1-4f933641a67c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:22.862851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb434b28-1376-4570-aaa1-4f933641a67c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:23.017884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Getting quotas for project ca7031777c74405f90c3d5e0ac5cb208. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:42:23.042247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Getting quotas for user c1196b55b2754c2d8ea983837330d827 and project ca7031777c74405f90c3d5e0ac5cb208. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:42:23.086815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:42:23.092978 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 60edd382-8eec-45d5-a90b-eeb908026fc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:42:23.380866 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-64eee5fa-92df-4cd3-9b18-eb98d6d650e1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.320077 Aug 18 11:42:23.401891 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1867/3894] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:42:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 4342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:42:23.425413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-ec24323d-efca-4b3e-b86d-eed89391bbc9 req-80cbe1b6-6fc0-4ee3-ba87-b56e37e35a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a271f66-8a14-478f-8aca-cc98b70d1e32", "name": "network-vif-deleted", "tag": "52a14f74-4c08-4475-8a96-3cb26fb1703e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:23.469640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ec24323d-efca-4b3e-b86d-eed89391bbc9 req-80cbe1b6-6fc0-4ee3-ba87-b56e37e35a21 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:23.472574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ec24323d-efca-4b3e-b86d-eed89391bbc9 req-80cbe1b6-6fc0-4ee3-ba87-b56e37e35a21 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:23.474472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ec24323d-efca-4b3e-b86d-eed89391bbc9 req-80cbe1b6-6fc0-4ee3-ba87-b56e37e35a21 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:23.531996 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ec24323d-efca-4b3e-b86d-eed89391bbc9 req-80cbe1b6-6fc0-4ee3-ba87-b56e37e35a21 service nova] Creating event network-vif-deleted:52a14f74-4c08-4475-8a96-3cb26fb1703e for instance 5a271f66-8a14-478f-8aca-cc98b70d1e32 on n-h2-853611-3 Aug 18 11:42:23.546369 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-ec24323d-efca-4b3e-b86d-eed89391bbc9 req-80cbe1b6-6fc0-4ee3-ba87-b56e37e35a21 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142838 Aug 18 11:42:23.557043 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1868/3895] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:23.575572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-22b229f4-6e6d-4bb5-a5e8-8cef878a1a63 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:23.576355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-22b229f4-6e6d-4bb5-a5e8-8cef878a1a63 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:23.601734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22b229f4-6e6d-4bb5-a5e8-8cef878a1a63 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:23.602248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22b229f4-6e6d-4bb5-a5e8-8cef878a1a63 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:23.602733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22b229f4-6e6d-4bb5-a5e8-8cef878a1a63 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:23.603481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22b229f4-6e6d-4bb5-a5e8-8cef878a1a63 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:23.603947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22b229f4-6e6d-4bb5-a5e8-8cef878a1a63 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:23.604378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22b229f4-6e6d-4bb5-a5e8-8cef878a1a63 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:23.614902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-eb434b28-1376-4570-aaa1-4f933641a67c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:23.627086 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eb434b28-1376-4570-aaa1-4f933641a67c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.829342 Aug 18 11:42:23.631577 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2028/3896] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:22 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:23.696032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-73ca229b-4218-4fe8-9de2-02f6ec3b0b96 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:23.697078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-73ca229b-4218-4fe8-9de2-02f6ec3b0b96 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:23.726285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ca229b-4218-4fe8-9de2-02f6ec3b0b96 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:23.727102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ca229b-4218-4fe8-9de2-02f6ec3b0b96 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:23.732797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ca229b-4218-4fe8-9de2-02f6ec3b0b96 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:23.737227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ca229b-4218-4fe8-9de2-02f6ec3b0b96 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:23.737729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ca229b-4218-4fe8-9de2-02f6ec3b0b96 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:23.744182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ca229b-4218-4fe8-9de2-02f6ec3b0b96 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:23.752048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22b229f4-6e6d-4bb5-a5e8-8cef878a1a63 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:23.752534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22b229f4-6e6d-4bb5-a5e8-8cef878a1a63 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:23.758612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-22b229f4-6e6d-4bb5-a5e8-8cef878a1a63 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:23.759226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-22b229f4-6e6d-4bb5-a5e8-8cef878a1a63 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lazy-loading 'fault' on Instance uuid 5a271f66-8a14-478f-8aca-cc98b70d1e32 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:24.021532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-22b229f4-6e6d-4bb5-a5e8-8cef878a1a63 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde3eaabd92348479ab9d0e994889e2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b7dd922df047a6bca547f351fc8336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:24.034672 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-22b229f4-6e6d-4bb5-a5e8-8cef878a1a63 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 200 len: 1304 microversion: 2.1 time: 0.476160 Aug 18 11:42:24.035870 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1869/3897] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:23 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 1304 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:24.053700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-616882099", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "451", "networks": [{"uuid": "63c48690-bd0f-4b5d-b87b-6dac29cdd74b"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:24.199630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] validate_networks() for [('63c48690-bd0f-4b5d-b87b-6dac29cdd74b', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:42:25.118814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-73ca229b-4218-4fe8-9de2-02f6ec3b0b96 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:25.149104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-73ca229b-4218-4fe8-9de2-02f6ec3b0b96 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:25.152895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-73ca229b-4218-4fe8-9de2-02f6ec3b0b96 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:25.156418 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-73ca229b-4218-4fe8-9de2-02f6ec3b0b96 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1361 microversion: 2.26 time: 1.464030 Aug 18 11:42:25.157505 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2029/3898] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:23 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1361 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:42:25.358253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-655c9d01-d382-42c9-b5f4-c06f3aee9a0a tempest-ExtensionsTest-377998118 tempest-ExtensionsTest-377998118-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:25.362504 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-655c9d01-d382-42c9-b5f4-c06f3aee9a0a tempest-ExtensionsTest-377998118 tempest-ExtensionsTest-377998118-project] 10.222.0.73 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.202778 Aug 18 11:42:25.364447 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2030/3899] 10.222.0.73 () {58 vars in 1170 bytes} [Thu Aug 18 11:42:25 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:25.395811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-688dd191-7d5c-4fb6-b87e-b2655f24adc9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:25.398612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-688dd191-7d5c-4fb6-b87e-b2655f24adc9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:25.417230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-688dd191-7d5c-4fb6-b87e-b2655f24adc9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:25.419049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-688dd191-7d5c-4fb6-b87e-b2655f24adc9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:25.421058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-688dd191-7d5c-4fb6-b87e-b2655f24adc9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:25.433954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-688dd191-7d5c-4fb6-b87e-b2655f24adc9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:25.439508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-688dd191-7d5c-4fb6-b87e-b2655f24adc9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:25.440652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-688dd191-7d5c-4fb6-b87e-b2655f24adc9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:26.060782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-688dd191-7d5c-4fb6-b87e-b2655f24adc9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:26.088772 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-688dd191-7d5c-4fb6-b87e-b2655f24adc9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.722358 Aug 18 11:42:26.089399 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2031/3900] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:25 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:26.147130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8ee6c61-f699-4933-8a13-98b5114eebf6 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:26.153475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f8ee6c61-f699-4933-8a13-98b5114eebf6 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] [instance: 5a271f66-8a14-478f-8aca-cc98b70d1e32] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:26.171581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ee6c61-f699-4933-8a13-98b5114eebf6 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:26.173833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ee6c61-f699-4933-8a13-98b5114eebf6 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:26.174536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ee6c61-f699-4933-8a13-98b5114eebf6 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:26.198915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ee6c61-f699-4933-8a13-98b5114eebf6 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:26.202697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ee6c61-f699-4933-8a13-98b5114eebf6 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:26.203829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ee6c61-f699-4933-8a13-98b5114eebf6 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:26.261425 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-f8ee6c61-f699-4933-8a13-98b5114eebf6 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] HTTP exception thrown: Instance 5a271f66-8a14-478f-8aca-cc98b70d1e32 could not be found. Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8ee6c61-f699-4933-8a13-98b5114eebf6 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Request method failure captured: Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 HTTP/1.1 Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iV_9nRi196fhvo0XtdGiGoMZX27vux0WZCebFJbTQuyeN73fsUHpuw6nfi2Ydmx63a8colrTJbqNtjfBr5bVj-hbLsRBmerjBTfkBg32fLdIBWoUC2-gc11_UQ0iqQ3UWv0k7iVu3WcpT-BWRfLi5ptbbScfKTCOKlI2MXuVLD3jO4 Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f2b7dd922df047a6bca547f351fc8336 Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TenantUsagesTestJSON-1413159470 Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f2b7dd922df047a6bca547f351fc8336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f2b7dd922df047a6bca547f351fc8336"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f2b7dd922df047a6bca547f351fc8336"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f2b7dd922df047a6bca547f351fc8336"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TenantUsagesTestJSON-1413159470 Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f2b7dd922df047a6bca547f351fc8336 Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1413159470 Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TenantUsagesTestJSON-1413159470-project Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: cde3eaabd92348479ab9d0e994889e2d Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TenantUsagesTestJSON-1413159470-project Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5a271f66-8a14-478f-8aca-cc98b70d1e32 could not be found. Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5a271f66-8a14-478f-8aca-cc98b70d1e32'} Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a271f66-8a14-478f-8aca-cc98b70d1e32 could not be found. Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a271f66-8a14-478f-8aca-cc98b70d1e32 could not be found. Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:42:26.267246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:26.276077 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:26.276077 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:42:26.276077 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:42:26.276077 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:42:26.276077 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:42:26.276077 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a271f66-8a14-478f-8aca-cc98b70d1e32 could not be found. Aug 18 11:42:26.276077 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:26.282186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8ee6c61-f699-4933-8a13-98b5114eebf6 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] Returning 404 to user: Instance 5a271f66-8a14-478f-8aca-cc98b70d1e32 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:42:26.285053 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8ee6c61-f699-4933-8a13-98b5114eebf6 tempest-TenantUsagesTestJSON-1413159470 tempest-TenantUsagesTestJSON-1413159470-project] 10.222.0.73 "GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32" status: 404 len: 111 microversion: 2.1 time: 0.159995 Aug 18 11:42:26.286301 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2032/3901] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:26 2022] GET /compute/v2.1/servers/5a271f66-8a14-478f-8aca-cc98b70d1e32 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:42:26.328863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f49159c2-c714-4958-b343-ae7e7d221bef tempest-ExtensionsTest-377998118 tempest-ExtensionsTest-377998118-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:26.337920 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f49159c2-c714-4958-b343-ae7e7d221bef tempest-ExtensionsTest-377998118 tempest-ExtensionsTest-377998118-project] 10.222.0.73 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.028009 Aug 18 11:42:26.341702 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2033/3902] 10.222.0.73 () {58 vars in 1134 bytes} [Thu Aug 18 11:42:26 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:42:26.359662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55740b47-be20-49f3-b204-bed7c8329660 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:26.361329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-55740b47-be20-49f3-b204-bed7c8329660 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:26.381942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55740b47-be20-49f3-b204-bed7c8329660 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:26.386009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55740b47-be20-49f3-b204-bed7c8329660 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:26.386808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55740b47-be20-49f3-b204-bed7c8329660 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:26.387752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55740b47-be20-49f3-b204-bed7c8329660 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:26.392303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55740b47-be20-49f3-b204-bed7c8329660 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:26.393082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55740b47-be20-49f3-b204-bed7c8329660 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:26.895804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:42:26.896581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:42:26.897437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:42:26.898661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:42:26.900476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:42:26.910567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:26.977893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:26.982718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:26.982990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:26.985396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:26.989014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:26.994063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:26.996203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:27.038203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:27.090558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Getting quotas for project ca7031777c74405f90c3d5e0ac5cb208. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:42:27.113017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Getting quotas for user c1196b55b2754c2d8ea983837330d827 and project ca7031777c74405f90c3d5e0ac5cb208. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:42:27.171878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:42:27.176228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:42:27.395987 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6bee692a-1519-46e1-b0eb-e73405d6599e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.358370 Aug 18 11:42:27.417186 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1870/3903] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:42:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:42:27.430485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3b751d50-27bf-47e5-9f8d-0b01ccd2ab86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:27.431490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3b751d50-27bf-47e5-9f8d-0b01ccd2ab86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:27.498366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-55740b47-be20-49f3-b204-bed7c8329660 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:27.516602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-55740b47-be20-49f3-b204-bed7c8329660 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:27.522061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-55740b47-be20-49f3-b204-bed7c8329660 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:27.527558 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-55740b47-be20-49f3-b204-bed7c8329660 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1361 microversion: 2.26 time: 1.181121 Aug 18 11:42:27.528826 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2034/3904] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:26 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1361 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:27.539593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-038c765c-b76d-4535-80ea-2c1032ea401c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:27.540235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-038c765c-b76d-4535-80ea-2c1032ea401c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:27.703835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-038c765c-b76d-4535-80ea-2c1032ea401c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:27.722115 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-038c765c-b76d-4535-80ea-2c1032ea401c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1220 microversion: 2.1 time: 0.186967 Aug 18 11:42:27.739481 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2035/3905] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:27 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1220 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:28.052864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b751d50-27bf-47e5-9f8d-0b01ccd2ab86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:28.058477 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b751d50-27bf-47e5-9f8d-0b01ccd2ab86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:28.059263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b751d50-27bf-47e5-9f8d-0b01ccd2ab86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:28.062901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b751d50-27bf-47e5-9f8d-0b01ccd2ab86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:28.066107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b751d50-27bf-47e5-9f8d-0b01ccd2ab86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:28.066796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3b751d50-27bf-47e5-9f8d-0b01ccd2ab86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:28.558383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4d7663d9-469e-472c-9f86-4be59fd185a6 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:28.563477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4d7663d9-469e-472c-9f86-4be59fd185a6 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:28.590562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d7663d9-469e-472c-9f86-4be59fd185a6 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:28.596224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d7663d9-469e-472c-9f86-4be59fd185a6 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:28.596845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d7663d9-469e-472c-9f86-4be59fd185a6 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:28.597816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d7663d9-469e-472c-9f86-4be59fd185a6 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:28.598465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d7663d9-469e-472c-9f86-4be59fd185a6 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:28.599016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d7663d9-469e-472c-9f86-4be59fd185a6 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:28.984671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4d7663d9-469e-472c-9f86-4be59fd185a6 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:29.002149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3b751d50-27bf-47e5-9f8d-0b01ccd2ab86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:29.020184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4d7663d9-469e-472c-9f86-4be59fd185a6 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:29.025668 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3b751d50-27bf-47e5-9f8d-0b01ccd2ab86 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 1.604868 Aug 18 11:42:29.027883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4d7663d9-469e-472c-9f86-4be59fd185a6 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:29.028370 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1871/3906] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:27 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:29.035590 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4d7663d9-469e-472c-9f86-4be59fd185a6 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1361 microversion: 2.26 time: 0.487137 Aug 18 11:42:29.037506 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2036/3907] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:28 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1361 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:29.039837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-75d78400-acd6-4eee-b0a7-c74f4ea9f8e3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:29.041889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-75d78400-acd6-4eee-b0a7-c74f4ea9f8e3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:29.084479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75d78400-acd6-4eee-b0a7-c74f4ea9f8e3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:29.086759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75d78400-acd6-4eee-b0a7-c74f4ea9f8e3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:29.089270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75d78400-acd6-4eee-b0a7-c74f4ea9f8e3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:29.090654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75d78400-acd6-4eee-b0a7-c74f4ea9f8e3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:29.092113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75d78400-acd6-4eee-b0a7-c74f4ea9f8e3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:29.093472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75d78400-acd6-4eee-b0a7-c74f4ea9f8e3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:29.117986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2470c99b-95f2-4e6a-b789-6fbcdf5e083e req-5d857a9a-5556-42d8-a35c-fb2e5949f3dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3115980f-33d8-4f15-a6f3-a64c8d1b3016", "tag": "bbf23dea-fc53-4704-a016-8e0575a93aac"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:29.136968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2470c99b-95f2-4e6a-b789-6fbcdf5e083e req-5d857a9a-5556-42d8-a35c-fb2e5949f3dc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:29.137615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2470c99b-95f2-4e6a-b789-6fbcdf5e083e req-5d857a9a-5556-42d8-a35c-fb2e5949f3dc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:29.140609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2470c99b-95f2-4e6a-b789-6fbcdf5e083e req-5d857a9a-5556-42d8-a35c-fb2e5949f3dc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:29.159002 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2470c99b-95f2-4e6a-b789-6fbcdf5e083e req-5d857a9a-5556-42d8-a35c-fb2e5949f3dc service nova] Creating event network-changed:bbf23dea-fc53-4704-a016-8e0575a93aac for instance 3115980f-33d8-4f15-a6f3-a64c8d1b3016 on n-h1-853611-3 Aug 18 11:42:29.164955 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2470c99b-95f2-4e6a-b789-6fbcdf5e083e req-5d857a9a-5556-42d8-a35c-fb2e5949f3dc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050667 Aug 18 11:42:29.165910 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2037/3908] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:29.616549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-75d78400-acd6-4eee-b0a7-c74f4ea9f8e3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:29.632935 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-75d78400-acd6-4eee-b0a7-c74f4ea9f8e3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1272 microversion: 2.1 time: 0.597593 Aug 18 11:42:29.645315 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1872/3909] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:29 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1272 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:30.068796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a4db942e-b032-4540-a41e-2d891220cb7a tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:30.071118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a4db942e-b032-4540-a41e-2d891220cb7a tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:30.073355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eb14cb79-4d00-4cf0-b09a-c09ce04211f9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:30.074224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-eb14cb79-4d00-4cf0-b09a-c09ce04211f9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:30.083311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4db942e-b032-4540-a41e-2d891220cb7a tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:30.085718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4db942e-b032-4540-a41e-2d891220cb7a tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:30.086573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4db942e-b032-4540-a41e-2d891220cb7a tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:30.088509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4db942e-b032-4540-a41e-2d891220cb7a tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:30.089923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4db942e-b032-4540-a41e-2d891220cb7a tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:30.095427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4db942e-b032-4540-a41e-2d891220cb7a tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:30.110901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb14cb79-4d00-4cf0-b09a-c09ce04211f9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:30.112600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb14cb79-4d00-4cf0-b09a-c09ce04211f9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:30.113260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb14cb79-4d00-4cf0-b09a-c09ce04211f9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:30.114364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb14cb79-4d00-4cf0-b09a-c09ce04211f9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:30.115042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb14cb79-4d00-4cf0-b09a-c09ce04211f9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:30.115661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb14cb79-4d00-4cf0-b09a-c09ce04211f9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:30.609851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a4db942e-b032-4540-a41e-2d891220cb7a tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:30.652810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a4db942e-b032-4540-a41e-2d891220cb7a tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:30.676686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a4db942e-b032-4540-a41e-2d891220cb7a tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:30.685751 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a4db942e-b032-4540-a41e-2d891220cb7a tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1361 microversion: 2.26 time: 0.620500 Aug 18 11:42:30.701123 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2038/3910] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:30 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1361 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:31.016459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eb14cb79-4d00-4cf0-b09a-c09ce04211f9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:31.025361 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eb14cb79-4d00-4cf0-b09a-c09ce04211f9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1486 microversion: 2.1 time: 0.955843 Aug 18 11:42:31.032134 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1873/3911] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:30 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1486 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:31.065404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-16b6edb4-faae-48c4-9fb4-cbb24b7e2d06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:31.068811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-16b6edb4-faae-48c4-9fb4-cbb24b7e2d06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:31.093284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16b6edb4-faae-48c4-9fb4-cbb24b7e2d06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:31.094283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16b6edb4-faae-48c4-9fb4-cbb24b7e2d06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:31.095135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16b6edb4-faae-48c4-9fb4-cbb24b7e2d06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:31.110326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16b6edb4-faae-48c4-9fb4-cbb24b7e2d06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:31.111551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16b6edb4-faae-48c4-9fb4-cbb24b7e2d06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:31.112392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16b6edb4-faae-48c4-9fb4-cbb24b7e2d06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:31.370554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-845997616", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "53267c48-3217-41c6-a851-dd6e1521ee39"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:31.534896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] validate_networks() for [('53267c48-3217-41c6-a851-dd6e1521ee39', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:42:31.759724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-16b6edb4-faae-48c4-9fb4-cbb24b7e2d06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:31.781359 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-16b6edb4-faae-48c4-9fb4-cbb24b7e2d06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1278 microversion: 2.1 time: 0.743679 Aug 18 11:42:31.782678 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1874/3912] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:31 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1278 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:31.805457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64f23749-7d22-4ff9-9591-1179b0d6af24 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:31.809581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-64f23749-7d22-4ff9-9591-1179b0d6af24 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:31.837097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64f23749-7d22-4ff9-9591-1179b0d6af24 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:31.840673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64f23749-7d22-4ff9-9591-1179b0d6af24 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:31.842138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64f23749-7d22-4ff9-9591-1179b0d6af24 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:31.845566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64f23749-7d22-4ff9-9591-1179b0d6af24 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:31.846237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64f23749-7d22-4ff9-9591-1179b0d6af24 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:31.847380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-64f23749-7d22-4ff9-9591-1179b0d6af24 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:32.106144 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-64f23749-7d22-4ff9-9591-1179b0d6af24 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "POST /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3/action" status: 202 len: 0 microversion: 2.1 time: 0.317493 Aug 18 11:42:32.107684 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1875/3913] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:42:31 2022] POST /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:42:32.118464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-395aa8a4-ee98-4e11-bece-df4f930e1e53 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:32.120357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-395aa8a4-ee98-4e11-bece-df4f930e1e53 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:32.131726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-395aa8a4-ee98-4e11-bece-df4f930e1e53 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:32.133152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-395aa8a4-ee98-4e11-bece-df4f930e1e53 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:32.134470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-395aa8a4-ee98-4e11-bece-df4f930e1e53 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:32.135710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-395aa8a4-ee98-4e11-bece-df4f930e1e53 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:32.137219 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-395aa8a4-ee98-4e11-bece-df4f930e1e53 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:32.139212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-395aa8a4-ee98-4e11-bece-df4f930e1e53 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:33.175372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-395aa8a4-ee98-4e11-bece-df4f930e1e53 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:33.188690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-395aa8a4-ee98-4e11-bece-df4f930e1e53 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:33.191178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-395aa8a4-ee98-4e11-bece-df4f930e1e53 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:33.192817 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-395aa8a4-ee98-4e11-bece-df4f930e1e53 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1361 microversion: 2.26 time: 1.082790 Aug 18 11:42:33.193830 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1876/3914] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:32 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1361 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:33.217858 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:33.219198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:33.228552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:33.229390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:33.230936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:33.232584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:33.233254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:33.233874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:33.452989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:42:33.454307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:42:33.455292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:42:33.457247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:42:33.458691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:42:33.476979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:33.477932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:33.478530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:33.479756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:33.481762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:33.483428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:33.521342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Getting quotas for project d83400501e4a4f84a984b01b02bee8a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:42:33.530125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Getting quotas for user 59d2180ae68a4190803f531121a58cea and project d83400501e4a4f84a984b01b02bee8a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:42:33.549730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Going to run 2 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:42:33.553581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 74f0209d-fc88-441f-aac1-d0dddf3a37a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:42:33.608224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=74f0209d-fc88-441f-aac1-d0dddf3a37a3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:42:33.747626 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.026319 Aug 18 11:42:33.748682 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2039/3915] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:42:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:42:33.753057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:33.754395 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aa277f88-4125-4e13-873e-22d41b98d25e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003074 Aug 18 11:42:33.759775 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2040/3916] 10.222.0.73 () {56 vars in 886 bytes} [Thu Aug 18 11:42:33 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 18 11:42:33.771054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f045aeba-755e-4cd1-8472-d28625e4a076 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:33.773015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f045aeba-755e-4cd1-8472-d28625e4a076 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:33.801941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f045aeba-755e-4cd1-8472-d28625e4a076 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:33.804925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f045aeba-755e-4cd1-8472-d28625e4a076 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:33.805647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f045aeba-755e-4cd1-8472-d28625e4a076 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:33.806724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f045aeba-755e-4cd1-8472-d28625e4a076 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:33.807367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f045aeba-755e-4cd1-8472-d28625e4a076 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:33.824913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f045aeba-755e-4cd1-8472-d28625e4a076 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:33.965284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f045aeba-755e-4cd1-8472-d28625e4a076 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:33.979868 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f045aeba-755e-4cd1-8472-d28625e4a076 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1278 microversion: 2.1 time: 0.218272 Aug 18 11:42:33.981582 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2041/3917] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:33 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1278 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:33.995372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:34.003040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8f8cad53-1662-4b7f-b478-ec629a8ae81c tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:34.016071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8f8cad53-1662-4b7f-b478-ec629a8ae81c tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:34.021993 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1494 microversion: 2.1 time: 0.812436 Aug 18 11:42:34.023093 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1877/3918] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:33 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1494 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:34.024835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:34.026730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8f8cad53-1662-4b7f-b478-ec629a8ae81c tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Searching by: {'deleted': False, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:42:34.028581 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004066 Aug 18 11:42:34.030364 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1878/3919] 10.222.0.73 () {54 vars in 1035 bytes} [Thu Aug 18 11:42:34 2022] GET /compute/v2/ => generated 379 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 18 11:42:34.044036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:34.045225 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001644 Aug 18 11:42:34.050853 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1879/3920] 10.222.0.73 () {54 vars in 1041 bytes} [Thu Aug 18 11:42:34 2022] GET /compute/v2.1/ => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:34.065142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:34.068515 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0e3cdc0e-67f6-4bd5-9c8e-603537a45118 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001464 Aug 18 11:42:34.068928 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1880/3921] 10.222.0.73 () {56 vars in 886 bytes} [Thu Aug 18 11:42:34 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 18 11:42:34.109922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f8cad53-1662-4b7f-b478-ec629a8ae81c tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:34.110581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f8cad53-1662-4b7f-b478-ec629a8ae81c tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:34.111114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f8cad53-1662-4b7f-b478-ec629a8ae81c tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:34.111876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f8cad53-1662-4b7f-b478-ec629a8ae81c tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:34.112413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f8cad53-1662-4b7f-b478-ec629a8ae81c tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:34.112787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f8cad53-1662-4b7f-b478-ec629a8ae81c tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:34.168425 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8f8cad53-1662-4b7f-b478-ec629a8ae81c tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.184823 Aug 18 11:42:34.180951 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2042/3922] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 18 11:42:33 2022] GET /compute/v2.1/servers => generated 675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:34.183806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1a157c2d-e41b-4715-bf5d-d73a1214c35a tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:34.184970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1a157c2d-e41b-4715-bf5d-d73a1214c35a tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:34.225575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a9078252-dadf-4f99-a4e5-198ac03d4618 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:34.243055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a9078252-dadf-4f99-a4e5-198ac03d4618 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:34.280198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9078252-dadf-4f99-a4e5-198ac03d4618 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:34.281091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9078252-dadf-4f99-a4e5-198ac03d4618 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:34.281884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9078252-dadf-4f99-a4e5-198ac03d4618 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:34.295512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9078252-dadf-4f99-a4e5-198ac03d4618 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:34.296357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9078252-dadf-4f99-a4e5-198ac03d4618 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:34.297104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9078252-dadf-4f99-a4e5-198ac03d4618 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:34.635230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a9078252-dadf-4f99-a4e5-198ac03d4618 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:34.661910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1a157c2d-e41b-4715-bf5d-d73a1214c35a tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:34.676840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a9078252-dadf-4f99-a4e5-198ac03d4618 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:34.700992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a9078252-dadf-4f99-a4e5-198ac03d4618 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:34.714142 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a9078252-dadf-4f99-a4e5-198ac03d4618 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1361 microversion: 2.26 time: 0.484474 Aug 18 11:42:34.725596 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2043/3923] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:34 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1361 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:34.727424 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1a157c2d-e41b-4715-bf5d-d73a1214c35a tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1219 microversion: 2.1 time: 0.549026 Aug 18 11:42:34.734137 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1881/3924] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:34 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1219 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:42:34.891450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-51443744-f5bf-4ba3-9359-109af68dc74a req-00564dd1-d4f8-4529-bbba-5239a259265c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0493dbd2-0a0d-4628-95f0-300aa6bd5887", "tag": "1fb5b3a2-03cf-49b9-8d39-21c1f0c0cea1"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:34.977105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-51443744-f5bf-4ba3-9359-109af68dc74a req-00564dd1-d4f8-4529-bbba-5239a259265c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:34.987617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-51443744-f5bf-4ba3-9359-109af68dc74a req-00564dd1-d4f8-4529-bbba-5239a259265c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:34.990117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-51443744-f5bf-4ba3-9359-109af68dc74a req-00564dd1-d4f8-4529-bbba-5239a259265c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:35.036281 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-51443744-f5bf-4ba3-9359-109af68dc74a req-00564dd1-d4f8-4529-bbba-5239a259265c service nova] Creating event network-changed:1fb5b3a2-03cf-49b9-8d39-21c1f0c0cea1 for instance 0493dbd2-0a0d-4628-95f0-300aa6bd5887 on n-h2-853611-3 Aug 18 11:42:35.080776 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-51443744-f5bf-4ba3-9359-109af68dc74a req-00564dd1-d4f8-4529-bbba-5239a259265c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197944 Aug 18 11:42:35.082280 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1882/3925] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 18 11:42:35.104272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e4261a92-69f5-481f-8e4d-f3932fc46a65 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:35.115313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e4261a92-69f5-481f-8e4d-f3932fc46a65 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:35.160451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4261a92-69f5-481f-8e4d-f3932fc46a65 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:35.168145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4261a92-69f5-481f-8e4d-f3932fc46a65 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:35.169010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4261a92-69f5-481f-8e4d-f3932fc46a65 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:35.170564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4261a92-69f5-481f-8e4d-f3932fc46a65 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:35.171399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4261a92-69f5-481f-8e4d-f3932fc46a65 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:35.172144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4261a92-69f5-481f-8e4d-f3932fc46a65 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:35.559418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3d084aee-9d60-436a-81d6-ded1763aae8a tempest-AbsoluteLimitsTestJSON-671454848 tempest-AbsoluteLimitsTestJSON-671454848-project] Calling method '.version_select at 0x7f51b0d9ad30>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:35.586251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d084aee-9d60-436a-81d6-ded1763aae8a tempest-AbsoluteLimitsTestJSON-671454848 tempest-AbsoluteLimitsTestJSON-671454848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:35.587483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d084aee-9d60-436a-81d6-ded1763aae8a tempest-AbsoluteLimitsTestJSON-671454848 tempest-AbsoluteLimitsTestJSON-671454848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:35.589496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d084aee-9d60-436a-81d6-ded1763aae8a tempest-AbsoluteLimitsTestJSON-671454848 tempest-AbsoluteLimitsTestJSON-671454848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:35.592395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d084aee-9d60-436a-81d6-ded1763aae8a tempest-AbsoluteLimitsTestJSON-671454848 tempest-AbsoluteLimitsTestJSON-671454848-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:35.593503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d084aee-9d60-436a-81d6-ded1763aae8a tempest-AbsoluteLimitsTestJSON-671454848 tempest-AbsoluteLimitsTestJSON-671454848-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:35.594522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d084aee-9d60-436a-81d6-ded1763aae8a tempest-AbsoluteLimitsTestJSON-671454848 tempest-AbsoluteLimitsTestJSON-671454848-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:35.638449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:35.652268 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3d084aee-9d60-436a-81d6-ded1763aae8a tempest-AbsoluteLimitsTestJSON-671454848 tempest-AbsoluteLimitsTestJSON-671454848-project] 10.222.0.73 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.886633 Aug 18 11:42:35.654758 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2044/3926] 10.222.0.73 () {58 vars in 1122 bytes} [Thu Aug 18 11:42:34 2022] GET /compute/v2.1/limits => generated 511 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:35.669669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d1cd2233-27f6-4e31-9f7f-b4901a4f69c8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:35.671168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d1cd2233-27f6-4e31-9f7f-b4901a4f69c8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:35.703418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1cd2233-27f6-4e31-9f7f-b4901a4f69c8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:35.719659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1cd2233-27f6-4e31-9f7f-b4901a4f69c8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:35.720505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1cd2233-27f6-4e31-9f7f-b4901a4f69c8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:35.721814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1cd2233-27f6-4e31-9f7f-b4901a4f69c8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:35.722711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1cd2233-27f6-4e31-9f7f-b4901a4f69c8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:35.723510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1cd2233-27f6-4e31-9f7f-b4901a4f69c8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:35.739314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:36.155868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d1cd2233-27f6-4e31-9f7f-b4901a4f69c8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:36.180863 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d1cd2233-27f6-4e31-9f7f-b4901a4f69c8 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1494 microversion: 2.1 time: 0.522285 Aug 18 11:42:36.185151 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2045/3927] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:35 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1494 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:36.206766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7111ea6b-d33f-4467-829a-dd99ff538578 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:36.207019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7111ea6b-d33f-4467-829a-dd99ff538578 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:36.215974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7111ea6b-d33f-4467-829a-dd99ff538578 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:36.224744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7111ea6b-d33f-4467-829a-dd99ff538578 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:36.226060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7111ea6b-d33f-4467-829a-dd99ff538578 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:36.227413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7111ea6b-d33f-4467-829a-dd99ff538578 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:36.228795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7111ea6b-d33f-4467-829a-dd99ff538578 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:36.229736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7111ea6b-d33f-4467-829a-dd99ff538578 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:36.360504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e4261a92-69f5-481f-8e4d-f3932fc46a65 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:36.380693 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e4261a92-69f5-481f-8e4d-f3932fc46a65 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1320 microversion: 2.1 time: 1.296532 Aug 18 11:42:36.383009 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1883/3928] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:35 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1320 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:36.391556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-616c295e-de1e-4f3f-aed0-88dd9fb9cfcb tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:36.392730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-616c295e-de1e-4f3f-aed0-88dd9fb9cfcb tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:36.418471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-616c295e-de1e-4f3f-aed0-88dd9fb9cfcb tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:36.421787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-616c295e-de1e-4f3f-aed0-88dd9fb9cfcb tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:36.423456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-616c295e-de1e-4f3f-aed0-88dd9fb9cfcb tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:36.424573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-616c295e-de1e-4f3f-aed0-88dd9fb9cfcb tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:36.426187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-616c295e-de1e-4f3f-aed0-88dd9fb9cfcb tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:36.426914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-616c295e-de1e-4f3f-aed0-88dd9fb9cfcb tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:36.480035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7111ea6b-d33f-4467-829a-dd99ff538578 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:36.511748 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7111ea6b-d33f-4467-829a-dd99ff538578 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1223 microversion: 2.1 time: 0.323120 Aug 18 11:42:36.546952 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2046/3929] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:36 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1223 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:37.038801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=10 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:37.223414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3176187b-8245-48aa-b397-18d3125d3002 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:37.224069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3176187b-8245-48aa-b397-18d3125d3002 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:37.236043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3176187b-8245-48aa-b397-18d3125d3002 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:37.237132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3176187b-8245-48aa-b397-18d3125d3002 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:37.237782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3176187b-8245-48aa-b397-18d3125d3002 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:37.239650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3176187b-8245-48aa-b397-18d3125d3002 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:37.240468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3176187b-8245-48aa-b397-18d3125d3002 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:37.241257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3176187b-8245-48aa-b397-18d3125d3002 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:38.221110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-616c295e-de1e-4f3f-aed0-88dd9fb9cfcb tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:38.263862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-616c295e-de1e-4f3f-aed0-88dd9fb9cfcb tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:38.273807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-616c295e-de1e-4f3f-aed0-88dd9fb9cfcb tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:38.277645 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-616c295e-de1e-4f3f-aed0-88dd9fb9cfcb tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1361 microversion: 2.26 time: 1.892641 Aug 18 11:42:38.280339 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1884/3930] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:36 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1361 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:38.323863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-218deccb-9916-4bd0-90e8-be9a25260986 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:38.328822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-218deccb-9916-4bd0-90e8-be9a25260986 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:38.346536 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218deccb-9916-4bd0-90e8-be9a25260986 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:38.347194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218deccb-9916-4bd0-90e8-be9a25260986 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:38.347649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218deccb-9916-4bd0-90e8-be9a25260986 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:38.348405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218deccb-9916-4bd0-90e8-be9a25260986 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:38.348865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218deccb-9916-4bd0-90e8-be9a25260986 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:38.349294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218deccb-9916-4bd0-90e8-be9a25260986 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:38.699318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3176187b-8245-48aa-b397-18d3125d3002 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:38.728546 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3176187b-8245-48aa-b397-18d3125d3002 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1500 microversion: 2.1 time: 1.508895 Aug 18 11:42:38.733089 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2047/3931] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:37 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1500 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:38.763967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e90d142-f7a9-4733-a76e-dcd56960c876 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:38.769980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2e90d142-f7a9-4733-a76e-dcd56960c876 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:38.781910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e90d142-f7a9-4733-a76e-dcd56960c876 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:38.782774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e90d142-f7a9-4733-a76e-dcd56960c876 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:38.783291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e90d142-f7a9-4733-a76e-dcd56960c876 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:38.784656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e90d142-f7a9-4733-a76e-dcd56960c876 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:38.785615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e90d142-f7a9-4733-a76e-dcd56960c876 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:38.786526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e90d142-f7a9-4733-a76e-dcd56960c876 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:38.974606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2e90d142-f7a9-4733-a76e-dcd56960c876 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:38.992723 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2e90d142-f7a9-4733-a76e-dcd56960c876 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1277 microversion: 2.1 time: 0.258149 Aug 18 11:42:38.994154 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2048/3932] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:38 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1277 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:39.022644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7e3e300e-26b9-408a-8c6d-56dbe5eff575 req-7c081e82-3718-4a1b-b55e-a7989bbfa303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60edd382-8eec-45d5-a90b-eeb908026fc8", "tag": "46e932b5-9936-4551-8a1a-8af0f5286ff3"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:39.061571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7e3e300e-26b9-408a-8c6d-56dbe5eff575 req-7c081e82-3718-4a1b-b55e-a7989bbfa303 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:39.062779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7e3e300e-26b9-408a-8c6d-56dbe5eff575 req-7c081e82-3718-4a1b-b55e-a7989bbfa303 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:39.063557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7e3e300e-26b9-408a-8c6d-56dbe5eff575 req-7c081e82-3718-4a1b-b55e-a7989bbfa303 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:39.084172 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7e3e300e-26b9-408a-8c6d-56dbe5eff575 req-7c081e82-3718-4a1b-b55e-a7989bbfa303 service nova] Creating event network-changed:46e932b5-9936-4551-8a1a-8af0f5286ff3 for instance 60edd382-8eec-45d5-a90b-eeb908026fc8 on n-h2-853611-3 Aug 18 11:42:39.094399 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7e3e300e-26b9-408a-8c6d-56dbe5eff575 req-7c081e82-3718-4a1b-b55e-a7989bbfa303 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085200 Aug 18 11:42:39.096174 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2049/3933] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:39.104310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c8a8accd-351e-484a-ba20-27a60e30d749 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:39.105290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c8a8accd-351e-484a-ba20-27a60e30d749 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:39.115397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8a8accd-351e-484a-ba20-27a60e30d749 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:39.116115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8a8accd-351e-484a-ba20-27a60e30d749 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:39.116761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8a8accd-351e-484a-ba20-27a60e30d749 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:39.117890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8a8accd-351e-484a-ba20-27a60e30d749 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:39.118555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8a8accd-351e-484a-ba20-27a60e30d749 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:39.119242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8a8accd-351e-484a-ba20-27a60e30d749 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:39.162094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c8a8accd-351e-484a-ba20-27a60e30d749 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:42:39.327520 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c8a8accd-351e-484a-ba20-27a60e30d749 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 204 len: 0 microversion: 2.1 time: 0.226091 Aug 18 11:42:39.330218 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2050/3934] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:42:39 2022] DELETE /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:42:39.343447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-10c84288-b005-4995-ab58-837e3bcd01c8 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:39.344258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-10c84288-b005-4995-ab58-837e3bcd01c8 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:39.353772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10c84288-b005-4995-ab58-837e3bcd01c8 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:39.354768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10c84288-b005-4995-ab58-837e3bcd01c8 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:39.355650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10c84288-b005-4995-ab58-837e3bcd01c8 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:39.357749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10c84288-b005-4995-ab58-837e3bcd01c8 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:39.358737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10c84288-b005-4995-ab58-837e3bcd01c8 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:39.359495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10c84288-b005-4995-ab58-837e3bcd01c8 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:39.541558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-218deccb-9916-4bd0-90e8-be9a25260986 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:39.570848 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-218deccb-9916-4bd0-90e8-be9a25260986 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1320 microversion: 2.1 time: 1.266479 Aug 18 11:42:39.572339 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1885/3935] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:38 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1320 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:39.581555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-68dd9338-ef05-45f3-8f6a-b5624c2bdcfd tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:39.595173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-68dd9338-ef05-45f3-8f6a-b5624c2bdcfd tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:39.618975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-68dd9338-ef05-45f3-8f6a-b5624c2bdcfd tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:39.619888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-68dd9338-ef05-45f3-8f6a-b5624c2bdcfd tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:39.620680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-68dd9338-ef05-45f3-8f6a-b5624c2bdcfd tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:39.623473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-68dd9338-ef05-45f3-8f6a-b5624c2bdcfd tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:39.624300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-68dd9338-ef05-45f3-8f6a-b5624c2bdcfd tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:39.624854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-68dd9338-ef05-45f3-8f6a-b5624c2bdcfd tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:39.956378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-10c84288-b005-4995-ab58-837e3bcd01c8 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:39.975512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-10c84288-b005-4995-ab58-837e3bcd01c8 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:39.978006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-10c84288-b005-4995-ab58-837e3bcd01c8 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:39.988858 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-10c84288-b005-4995-ab58-837e3bcd01c8 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1361 microversion: 2.26 time: 0.654227 Aug 18 11:42:39.995212 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2051/3936] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:39 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1361 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:40.013306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-10a48cc3-12c5-47e5-bdb9-cb150c16184e req-05d04f6c-c535-450d-9064-696489a2bcab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3115980f-33d8-4f15-a6f3-a64c8d1b3016", "name": "network-vif-plugged", "status": "completed", "tag": "bbf23dea-fc53-4704-a016-8e0575a93aac"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:40.051049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-10a48cc3-12c5-47e5-bdb9-cb150c16184e req-05d04f6c-c535-450d-9064-696489a2bcab service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:40.051325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-10a48cc3-12c5-47e5-bdb9-cb150c16184e req-05d04f6c-c535-450d-9064-696489a2bcab service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:40.051620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-10a48cc3-12c5-47e5-bdb9-cb150c16184e req-05d04f6c-c535-450d-9064-696489a2bcab service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:40.087972 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-10a48cc3-12c5-47e5-bdb9-cb150c16184e req-05d04f6c-c535-450d-9064-696489a2bcab service nova] Creating event network-vif-plugged:bbf23dea-fc53-4704-a016-8e0575a93aac for instance 3115980f-33d8-4f15-a6f3-a64c8d1b3016 on n-h1-853611-3 Aug 18 11:42:40.114996 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-10a48cc3-12c5-47e5-bdb9-cb150c16184e req-05d04f6c-c535-450d-9064-696489a2bcab service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123779 Aug 18 11:42:40.117146 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2052/3937] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:40.126460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5c3eaaed-1cfe-4b9e-9e82-a85512640b62 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:40.127254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5c3eaaed-1cfe-4b9e-9e82-a85512640b62 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:40.135975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c3eaaed-1cfe-4b9e-9e82-a85512640b62 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:40.136484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c3eaaed-1cfe-4b9e-9e82-a85512640b62 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:40.136981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c3eaaed-1cfe-4b9e-9e82-a85512640b62 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:40.137819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c3eaaed-1cfe-4b9e-9e82-a85512640b62 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:40.138422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c3eaaed-1cfe-4b9e-9e82-a85512640b62 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:40.138938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c3eaaed-1cfe-4b9e-9e82-a85512640b62 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:40.284193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5c3eaaed-1cfe-4b9e-9e82-a85512640b62 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:40.297207 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5c3eaaed-1cfe-4b9e-9e82-a85512640b62 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1277 microversion: 2.1 time: 0.178585 Aug 18 11:42:40.299619 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2053/3938] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:40 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:40.549324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-68dd9338-ef05-45f3-8f6a-b5624c2bdcfd tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:40.565005 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-68dd9338-ef05-45f3-8f6a-b5624c2bdcfd tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.990251 Aug 18 11:42:40.566094 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1886/3939] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:39 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:40.613986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76a11bdf-2181-4574-92d8-9cc5421599d7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:40.614675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-76a11bdf-2181-4574-92d8-9cc5421599d7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:40.621356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76a11bdf-2181-4574-92d8-9cc5421599d7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:40.622951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76a11bdf-2181-4574-92d8-9cc5421599d7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:40.623654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76a11bdf-2181-4574-92d8-9cc5421599d7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:40.624407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76a11bdf-2181-4574-92d8-9cc5421599d7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:40.624877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76a11bdf-2181-4574-92d8-9cc5421599d7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:40.625315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76a11bdf-2181-4574-92d8-9cc5421599d7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:40.862662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-76a11bdf-2181-4574-92d8-9cc5421599d7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:40.879594 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76a11bdf-2181-4574-92d8-9cc5421599d7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1320 microversion: 2.1 time: 0.272320 Aug 18 11:42:40.881177 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2054/3940] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:40 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:41.019683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-91968732-bb83-4876-9496-2276d54e8b1e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:41.021680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-91968732-bb83-4876-9496-2276d54e8b1e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:41.037319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91968732-bb83-4876-9496-2276d54e8b1e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:41.038670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91968732-bb83-4876-9496-2276d54e8b1e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:41.039773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91968732-bb83-4876-9496-2276d54e8b1e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:41.041667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91968732-bb83-4876-9496-2276d54e8b1e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:41.042813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91968732-bb83-4876-9496-2276d54e8b1e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:41.045433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-91968732-bb83-4876-9496-2276d54e8b1e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:41.198166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9f494c57-fba2-444f-aa08-0d958a5e1447 req-9b2d678b-a065-4dd8-a6f4-f3ff0c302cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d414d73c-4cbb-4b18-a248-a2f90766ddfa", "tag": "7f859f5b-966f-48a6-a8ff-2fe9434494ba"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:41.209588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9f494c57-fba2-444f-aa08-0d958a5e1447 req-9b2d678b-a065-4dd8-a6f4-f3ff0c302cdc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:41.210694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9f494c57-fba2-444f-aa08-0d958a5e1447 req-9b2d678b-a065-4dd8-a6f4-f3ff0c302cdc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:41.211353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9f494c57-fba2-444f-aa08-0d958a5e1447 req-9b2d678b-a065-4dd8-a6f4-f3ff0c302cdc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:41.225307 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9f494c57-fba2-444f-aa08-0d958a5e1447 req-9b2d678b-a065-4dd8-a6f4-f3ff0c302cdc service nova] Creating event network-changed:7f859f5b-966f-48a6-a8ff-2fe9434494ba for instance d414d73c-4cbb-4b18-a248-a2f90766ddfa on n-h1-853611-3 Aug 18 11:42:41.232170 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9f494c57-fba2-444f-aa08-0d958a5e1447 req-9b2d678b-a065-4dd8-a6f4-f3ff0c302cdc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037842 Aug 18 11:42:41.233195 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2055/3941] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:41.342867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e0e09a88-1245-43da-b816-07c55b4c3d19 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:41.343919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e0e09a88-1245-43da-b816-07c55b4c3d19 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:41.354202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0e09a88-1245-43da-b816-07c55b4c3d19 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:41.355014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0e09a88-1245-43da-b816-07c55b4c3d19 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:41.355547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0e09a88-1245-43da-b816-07c55b4c3d19 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:41.357069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0e09a88-1245-43da-b816-07c55b4c3d19 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:41.357675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0e09a88-1245-43da-b816-07c55b4c3d19 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:41.358184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0e09a88-1245-43da-b816-07c55b4c3d19 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:41.444862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e0e09a88-1245-43da-b816-07c55b4c3d19 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:41.458525 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e0e09a88-1245-43da-b816-07c55b4c3d19 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1277 microversion: 2.1 time: 0.121145 Aug 18 11:42:41.459564 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2056/3942] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:41 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:42:41.594501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02005e9e-585e-4e25-a18d-aa3adbe574b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:41.596092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-02005e9e-585e-4e25-a18d-aa3adbe574b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:41.623915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02005e9e-585e-4e25-a18d-aa3adbe574b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:41.627924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02005e9e-585e-4e25-a18d-aa3adbe574b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:41.629085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02005e9e-585e-4e25-a18d-aa3adbe574b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:41.632513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02005e9e-585e-4e25-a18d-aa3adbe574b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:41.633833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02005e9e-585e-4e25-a18d-aa3adbe574b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:41.635869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02005e9e-585e-4e25-a18d-aa3adbe574b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:41.826230 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-91968732-bb83-4876-9496-2276d54e8b1e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:41.836939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-91968732-bb83-4876-9496-2276d54e8b1e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:41.838541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-91968732-bb83-4876-9496-2276d54e8b1e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:41.840331 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-91968732-bb83-4876-9496-2276d54e8b1e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1361 microversion: 2.26 time: 0.830224 Aug 18 11:42:41.841273 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1887/3943] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:41 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1361 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:41.915424 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-841f25b6-d605-45d0-af84-b2a563780ad6 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:41.919551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-841f25b6-d605-45d0-af84-b2a563780ad6 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:41.927795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-02005e9e-585e-4e25-a18d-aa3adbe574b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:41.935982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-841f25b6-d605-45d0-af84-b2a563780ad6 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:41.938921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-841f25b6-d605-45d0-af84-b2a563780ad6 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:41.940075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-841f25b6-d605-45d0-af84-b2a563780ad6 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:41.941752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-841f25b6-d605-45d0-af84-b2a563780ad6 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:41.943203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-841f25b6-d605-45d0-af84-b2a563780ad6 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:41.944404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-841f25b6-d605-45d0-af84-b2a563780ad6 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:41.944975 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-02005e9e-585e-4e25-a18d-aa3adbe574b9 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.356591 Aug 18 11:42:41.946273 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2057/3944] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:41 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:42:42.486233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2ad41771-d8bb-4f50-b062-5834b2476051 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:42.489828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2ad41771-d8bb-4f50-b062-5834b2476051 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:42.517554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ad41771-d8bb-4f50-b062-5834b2476051 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:42.519656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ad41771-d8bb-4f50-b062-5834b2476051 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:42.520824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ad41771-d8bb-4f50-b062-5834b2476051 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:42.523295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ad41771-d8bb-4f50-b062-5834b2476051 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:42.524970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ad41771-d8bb-4f50-b062-5834b2476051 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:42.526633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ad41771-d8bb-4f50-b062-5834b2476051 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:42.906926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2ad41771-d8bb-4f50-b062-5834b2476051 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:42.916738 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2ad41771-d8bb-4f50-b062-5834b2476051 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1319 microversion: 2.1 time: 0.438545 Aug 18 11:42:42.918905 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2058/3945] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:42 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:42:42.924435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-de38e77a-9abd-4002-953d-e625d5ea7643 req-35ddb2f8-5ab1-46c0-9378-78eada09aeac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f0209d-fc88-441f-aac1-d0dddf3a37a3", "tag": "1c7afcd2-a135-4a72-8fba-dca32a306d4b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:42.940477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-de38e77a-9abd-4002-953d-e625d5ea7643 req-35ddb2f8-5ab1-46c0-9378-78eada09aeac service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:42.942094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-de38e77a-9abd-4002-953d-e625d5ea7643 req-35ddb2f8-5ab1-46c0-9378-78eada09aeac service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:42.942648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-de38e77a-9abd-4002-953d-e625d5ea7643 req-35ddb2f8-5ab1-46c0-9378-78eada09aeac service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:42.959589 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-de38e77a-9abd-4002-953d-e625d5ea7643 req-35ddb2f8-5ab1-46c0-9378-78eada09aeac service nova] Creating event network-changed:1c7afcd2-a135-4a72-8fba-dca32a306d4b for instance 74f0209d-fc88-441f-aac1-d0dddf3a37a3 on n-h2-853611-3 Aug 18 11:42:42.973364 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-de38e77a-9abd-4002-953d-e625d5ea7643 req-35ddb2f8-5ab1-46c0-9378-78eada09aeac service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052581 Aug 18 11:42:42.975144 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2059/3946] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:42.982670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a6b1b77d-71cd-407e-a1c8-cbbfa17e2a27 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:42.983865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a6b1b77d-71cd-407e-a1c8-cbbfa17e2a27 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:42.993315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6b1b77d-71cd-407e-a1c8-cbbfa17e2a27 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:42.994501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6b1b77d-71cd-407e-a1c8-cbbfa17e2a27 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:42.995185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6b1b77d-71cd-407e-a1c8-cbbfa17e2a27 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:42.996197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6b1b77d-71cd-407e-a1c8-cbbfa17e2a27 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:42.998505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6b1b77d-71cd-407e-a1c8-cbbfa17e2a27 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:42.999234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6b1b77d-71cd-407e-a1c8-cbbfa17e2a27 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:43.166498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-841f25b6-d605-45d0-af84-b2a563780ad6 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:43.189227 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-841f25b6-d605-45d0-af84-b2a563780ad6 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1320 microversion: 2.1 time: 1.289055 Aug 18 11:42:43.205301 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1888/3947] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:41 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1320 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:43.217545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1399cb20-4317-42cb-92b2-bc1e466f2852 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:43.218708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1399cb20-4317-42cb-92b2-bc1e466f2852 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:43.225751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1399cb20-4317-42cb-92b2-bc1e466f2852 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:43.226872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1399cb20-4317-42cb-92b2-bc1e466f2852 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:43.227997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1399cb20-4317-42cb-92b2-bc1e466f2852 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:43.229062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1399cb20-4317-42cb-92b2-bc1e466f2852 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:43.229799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1399cb20-4317-42cb-92b2-bc1e466f2852 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:43.231188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1399cb20-4317-42cb-92b2-bc1e466f2852 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:43.306076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a6b1b77d-71cd-407e-a1c8-cbbfa17e2a27 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:43.319116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a6b1b77d-71cd-407e-a1c8-cbbfa17e2a27 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:43.322923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a6b1b77d-71cd-407e-a1c8-cbbfa17e2a27 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:43.327308 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a6b1b77d-71cd-407e-a1c8-cbbfa17e2a27 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1361 microversion: 2.26 time: 0.347451 Aug 18 11:42:43.327308 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2060/3948] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:42 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1361 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:43.342502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-3f59b17a-6c33-41b9-b91c-f587873815ee req-4839165c-1e5f-47f5-89fb-ca3fecc344d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0493dbd2-0a0d-4628-95f0-300aa6bd5887", "name": "network-vif-plugged", "status": "completed", "tag": "1fb5b3a2-03cf-49b9-8d39-21c1f0c0cea1"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:43.360029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3f59b17a-6c33-41b9-b91c-f587873815ee req-4839165c-1e5f-47f5-89fb-ca3fecc344d8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:43.367093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3f59b17a-6c33-41b9-b91c-f587873815ee req-4839165c-1e5f-47f5-89fb-ca3fecc344d8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:43.367093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3f59b17a-6c33-41b9-b91c-f587873815ee req-4839165c-1e5f-47f5-89fb-ca3fecc344d8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:43.397308 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-3f59b17a-6c33-41b9-b91c-f587873815ee req-4839165c-1e5f-47f5-89fb-ca3fecc344d8 service nova] Creating event network-vif-plugged:1fb5b3a2-03cf-49b9-8d39-21c1f0c0cea1 for instance 0493dbd2-0a0d-4628-95f0-300aa6bd5887 on n-h2-853611-3 Aug 18 11:42:43.407098 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-3f59b17a-6c33-41b9-b91c-f587873815ee req-4839165c-1e5f-47f5-89fb-ca3fecc344d8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079110 Aug 18 11:42:43.408801 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2061/3949] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:43.946363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d6b7dc11-a7fa-4e93-acc7-9a9f0d739082 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:43.947408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d6b7dc11-a7fa-4e93-acc7-9a9f0d739082 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:43.956235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6b7dc11-a7fa-4e93-acc7-9a9f0d739082 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:43.956937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6b7dc11-a7fa-4e93-acc7-9a9f0d739082 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:43.958140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6b7dc11-a7fa-4e93-acc7-9a9f0d739082 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:43.959054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6b7dc11-a7fa-4e93-acc7-9a9f0d739082 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:43.959633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6b7dc11-a7fa-4e93-acc7-9a9f0d739082 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:43.960243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6b7dc11-a7fa-4e93-acc7-9a9f0d739082 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:44.116442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d6b7dc11-a7fa-4e93-acc7-9a9f0d739082 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:44.134547 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d6b7dc11-a7fa-4e93-acc7-9a9f0d739082 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1319 microversion: 2.1 time: 0.193395 Aug 18 11:42:44.135448 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2062/3950] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:43 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:42:44.217456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fb65f361-348d-408b-b461-f96877d58700 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:44.218280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fb65f361-348d-408b-b461-f96877d58700 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:44.227699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb65f361-348d-408b-b461-f96877d58700 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:44.238987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb65f361-348d-408b-b461-f96877d58700 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:44.240180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb65f361-348d-408b-b461-f96877d58700 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:44.244509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb65f361-348d-408b-b461-f96877d58700 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:44.247481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb65f361-348d-408b-b461-f96877d58700 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:44.248237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb65f361-348d-408b-b461-f96877d58700 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:44.314506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:44.319346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1399cb20-4317-42cb-92b2-bc1e466f2852 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:44.328770 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1399cb20-4317-42cb-92b2-bc1e466f2852 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 1.121815 Aug 18 11:42:44.334685 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1889/3951] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:43 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:44.378661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5f3c009f-6460-4d0c-991f-ba4a7780da7c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:44.379601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5f3c009f-6460-4d0c-991f-ba4a7780da7c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:44.394401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f3c009f-6460-4d0c-991f-ba4a7780da7c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:44.397171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f3c009f-6460-4d0c-991f-ba4a7780da7c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:44.398845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f3c009f-6460-4d0c-991f-ba4a7780da7c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:44.399965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f3c009f-6460-4d0c-991f-ba4a7780da7c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:44.403074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f3c009f-6460-4d0c-991f-ba4a7780da7c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:44.404027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f3c009f-6460-4d0c-991f-ba4a7780da7c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:44.594211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fb65f361-348d-408b-b461-f96877d58700 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:44.602366 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fb65f361-348d-408b-b461-f96877d58700 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1320 microversion: 2.1 time: 0.390699 Aug 18 11:42:44.611541 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2063/3952] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:44 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1320 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:44.676719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=26 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:45.157723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-13c6cd95-7ee9-455d-9a6c-6de22ce19905 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:45.159077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-13c6cd95-7ee9-455d-9a6c-6de22ce19905 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:45.166704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13c6cd95-7ee9-455d-9a6c-6de22ce19905 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:45.167473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13c6cd95-7ee9-455d-9a6c-6de22ce19905 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:45.168239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13c6cd95-7ee9-455d-9a6c-6de22ce19905 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:45.168975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13c6cd95-7ee9-455d-9a6c-6de22ce19905 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:45.169837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13c6cd95-7ee9-455d-9a6c-6de22ce19905 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:45.170465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13c6cd95-7ee9-455d-9a6c-6de22ce19905 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:45.573592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-13c6cd95-7ee9-455d-9a6c-6de22ce19905 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:45.587396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=10 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:45.603571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5f3c009f-6460-4d0c-991f-ba4a7780da7c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:45.619367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:45.634933 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5f3c009f-6460-4d0c-991f-ba4a7780da7c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:45.636319 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-13c6cd95-7ee9-455d-9a6c-6de22ce19905 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1319 microversion: 2.1 time: 0.482223 Aug 18 11:42:45.641968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5f3c009f-6460-4d0c-991f-ba4a7780da7c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:45.642737 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2064/3953] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:45 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1319 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:45.649462 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5f3c009f-6460-4d0c-991f-ba4a7780da7c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1545 microversion: 2.26 time: 1.277705 Aug 18 11:42:45.656590 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1890/3954] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:44 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1545 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:45.665533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-65d95152-f37c-4f7e-a199-72b07fdef2f7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:45.670397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2122e2d5-54fd-45ee-a29f-ff403e2b1d93 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:45.671914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2122e2d5-54fd-45ee-a29f-ff403e2b1d93 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:45.676357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-65d95152-f37c-4f7e-a199-72b07fdef2f7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:45.700009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2122e2d5-54fd-45ee-a29f-ff403e2b1d93 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:45.705797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2122e2d5-54fd-45ee-a29f-ff403e2b1d93 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:45.707957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65d95152-f37c-4f7e-a199-72b07fdef2f7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:45.709850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2122e2d5-54fd-45ee-a29f-ff403e2b1d93 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:45.711904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65d95152-f37c-4f7e-a199-72b07fdef2f7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:45.713459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2122e2d5-54fd-45ee-a29f-ff403e2b1d93 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:45.714772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65d95152-f37c-4f7e-a199-72b07fdef2f7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:45.716141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2122e2d5-54fd-45ee-a29f-ff403e2b1d93 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:45.721518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65d95152-f37c-4f7e-a199-72b07fdef2f7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:45.723727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2122e2d5-54fd-45ee-a29f-ff403e2b1d93 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:45.727552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65d95152-f37c-4f7e-a199-72b07fdef2f7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:45.737256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65d95152-f37c-4f7e-a199-72b07fdef2f7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:45.852280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:46.403433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2122e2d5-54fd-45ee-a29f-ff403e2b1d93 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:46.416696 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2122e2d5-54fd-45ee-a29f-ff403e2b1d93 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1506 microversion: 2.1 time: 0.772039 Aug 18 11:42:46.419044 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2065/3955] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:45 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1506 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:46.437971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f51b0d9a1f0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:46.462771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:46.463278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:46.468789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:46.470088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:46.489861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:46.491560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:46.492527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:46.498343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:46.500292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:46.501698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:46.614608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:46.615756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:46.616732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:46.650989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:46.652217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:46.653832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:46.727017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lazy-loading 'flavor' on Instance uuid 3115980f-33d8-4f15-a6f3-a64c8d1b3016 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:46.764044 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4bc7c704-919b-4e4e-82e9-7d80b3f78b2e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "PUT /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-2024957423" status: 201 len: 0 microversion: 2.26 time: 0.343067 Aug 18 11:42:46.764971 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2066/3956] 10.222.0.73 () {62 vars in 1380 bytes} [Thu Aug 18 11:42:46 2022] PUT /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-2024957423 => generated 0 bytes in 345 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 18 11:42:46.771817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-31974198-c2ce-4ce1-834b-3d010b8d66f9 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:46.772644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-31974198-c2ce-4ce1-834b-3d010b8d66f9 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:46.781335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31974198-c2ce-4ce1-834b-3d010b8d66f9 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:46.781995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31974198-c2ce-4ce1-834b-3d010b8d66f9 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:46.782731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31974198-c2ce-4ce1-834b-3d010b8d66f9 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:46.783455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31974198-c2ce-4ce1-834b-3d010b8d66f9 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:46.783914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31974198-c2ce-4ce1-834b-3d010b8d66f9 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:46.784525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31974198-c2ce-4ce1-834b-3d010b8d66f9 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:47.300499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-65d95152-f37c-4f7e-a199-72b07fdef2f7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:47.327150 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-65d95152-f37c-4f7e-a199-72b07fdef2f7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1320 microversion: 2.1 time: 1.665440 Aug 18 11:42:47.328979 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1891/3957] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:45 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1320 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:47.358878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-57e7ecc7-7dd9-4413-b5b6-f471f2ab6540 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f519ec2a5e0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:47.402254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57e7ecc7-7dd9-4413-b5b6-f471f2ab6540 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:47.404789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57e7ecc7-7dd9-4413-b5b6-f471f2ab6540 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:47.406222 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57e7ecc7-7dd9-4413-b5b6-f471f2ab6540 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:47.517922 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-57e7ecc7-7dd9-4413-b5b6-f471f2ab6540 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-2024957423" status: 204 len: 0 microversion: 2.26 time: 0.184855 Aug 18 11:42:47.519813 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1892/3958] 10.222.0.73 () {60 vars in 1361 bytes} [Thu Aug 18 11:42:47 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-2024957423 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:42:47.565084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-82566aea-681c-48b7-b97a-e4b879a37f71 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:47.566831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-82566aea-681c-48b7-b97a-e4b879a37f71 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:47.601970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82566aea-681c-48b7-b97a-e4b879a37f71 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:47.602583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82566aea-681c-48b7-b97a-e4b879a37f71 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:47.603891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82566aea-681c-48b7-b97a-e4b879a37f71 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:47.604969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82566aea-681c-48b7-b97a-e4b879a37f71 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:47.607562 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82566aea-681c-48b7-b97a-e4b879a37f71 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:47.608474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82566aea-681c-48b7-b97a-e4b879a37f71 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:47.856326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-82566aea-681c-48b7-b97a-e4b879a37f71 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:47.866279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-31974198-c2ce-4ce1-834b-3d010b8d66f9 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:47.875280 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-31974198-c2ce-4ce1-834b-3d010b8d66f9 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1319 microversion: 2.1 time: 1.109191 Aug 18 11:42:47.875872 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2067/3959] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:46 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1319 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:47.887233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f519fc05310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:47.901111 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-82566aea-681c-48b7-b97a-e4b879a37f71 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1464 microversion: 2.1 time: 0.368507 Aug 18 11:42:47.904649 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1893/3960] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:47 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1464 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:47.924214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:47.924855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:47.925768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:47.926209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:47.932651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-fb61a34f-63db-4f4d-8c97-edb2c9be11c7 req-773673ff-f9e7-45a6-b562-55b3cee2e458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27", "tag": "91c51f5e-72e3-4dfd-a974-a08dd441bc3e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:47.944434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:47.945362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:47.945800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:47.946994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:47.947781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:47.948059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:47.993412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:47.994233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:47.994997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:47.997540 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-fb61a34f-63db-4f4d-8c97-edb2c9be11c7 req-773673ff-f9e7-45a6-b562-55b3cee2e458 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:47.998787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-fb61a34f-63db-4f4d-8c97-edb2c9be11c7 req-773673ff-f9e7-45a6-b562-55b3cee2e458 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.000974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-fb61a34f-63db-4f4d-8c97-edb2c9be11c7 req-773673ff-f9e7-45a6-b562-55b3cee2e458 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.017418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lazy-loading 'flavor' on Instance uuid 3115980f-33d8-4f15-a6f3-a64c8d1b3016 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:48.036600 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-fb61a34f-63db-4f4d-8c97-edb2c9be11c7 req-773673ff-f9e7-45a6-b562-55b3cee2e458 service nova] Creating event network-changed:91c51f5e-72e3-4dfd-a974-a08dd441bc3e for instance 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 on n-h1-853611-3 Aug 18 11:42:48.050909 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a34ecab3-5046-426c-a674-5a2acd5f9dc5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags" status: 204 len: 0 microversion: 2.26 time: 0.169471 Aug 18 11:42:48.051940 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2068/3961] 10.222.0.73 () {60 vars in 1295 bytes} [Thu Aug 18 11:42:47 2022] DELETE /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:42:48.056882 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-fb61a34f-63db-4f4d-8c97-edb2c9be11c7 req-773673ff-f9e7-45a6-b562-55b3cee2e458 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146715 Aug 18 11:42:48.058157 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1894/3962] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:48.069510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ada89c23-b547-451b-bfef-d5f8a10d5c9b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f51ac255ee0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:48.090871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ada89c23-b547-451b-bfef-d5f8a10d5c9b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.092056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ada89c23-b547-451b-bfef-d5f8a10d5c9b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.093512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ada89c23-b547-451b-bfef-d5f8a10d5c9b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.145319 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ada89c23-b547-451b-bfef-d5f8a10d5c9b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags" status: 200 len: 12 microversion: 2.26 time: 0.085005 Aug 18 11:42:48.147474 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2069/3963] 10.222.0.73 () {60 vars in 1292 bytes} [Thu Aug 18 11:42:48 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags => generated 12 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:48.186195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f519eb8faf0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:48.221717 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.222672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.223454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.224526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:48.229398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:48.267084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.268164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.268944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.270267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.272869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.273661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.379545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d7858808-92dc-4143-ad93-c0066aa871b5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:48.380968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d7858808-92dc-4143-ad93-c0066aa871b5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:48.383255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.384215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.385498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.426481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.427688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.428364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.431088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7858808-92dc-4143-ad93-c0066aa871b5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.432124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7858808-92dc-4143-ad93-c0066aa871b5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.433001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7858808-92dc-4143-ad93-c0066aa871b5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.434788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7858808-92dc-4143-ad93-c0066aa871b5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.439551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7858808-92dc-4143-ad93-c0066aa871b5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.440452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7858808-92dc-4143-ad93-c0066aa871b5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.484118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lazy-loading 'flavor' on Instance uuid 3115980f-33d8-4f15-a6f3-a64c8d1b3016 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:48.530217 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-876764d3-298f-4a2e-b7ea-b8025639ff85 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "PUT /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-678911135" status: 201 len: 0 microversion: 2.26 time: 0.374994 Aug 18 11:42:48.531722 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1895/3964] 10.222.0.73 () {62 vars in 1377 bytes} [Thu Aug 18 11:42:48 2022] PUT /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-678911135 => generated 0 bytes in 379 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 18 11:42:48.546140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-48c3e284-ec61-4dc5-9336-3fe085ca41b5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f519eb8f8b0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:48.568201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48c3e284-ec61-4dc5-9336-3fe085ca41b5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.572117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48c3e284-ec61-4dc5-9336-3fe085ca41b5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.574416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-48c3e284-ec61-4dc5-9336-3fe085ca41b5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.616423 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-48c3e284-ec61-4dc5-9336-3fe085ca41b5 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags" status: 200 len: 35 microversion: 2.26 time: 0.074664 Aug 18 11:42:48.618408 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1896/3965] 10.222.0.73 () {60 vars in 1292 bytes} [Thu Aug 18 11:42:48 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags => generated 35 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:48.630531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f519eb5c8b0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:48.652921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.656516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.657308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.659875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:48.691007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.691682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.692143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.695649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.698783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.700911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.771800 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.772372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.775522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.850552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lazy-loading 'flavor' on Instance uuid 3115980f-33d8-4f15-a6f3-a64c8d1b3016 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:48.890908 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-19cbb52d-1add-4f4f-8cdc-9b6e5d496285 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-678911135" status: 204 len: 0 microversion: 2.26 time: 0.265579 Aug 18 11:42:48.900969 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1897/3966] 10.222.0.73 () {60 vars in 1361 bytes} [Thu Aug 18 11:42:48 2022] DELETE /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-678911135 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:42:48.913821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-33df8a7d-ad18-444f-a61e-d2035b8ce8eb tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:48.916994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-33df8a7d-ad18-444f-a61e-d2035b8ce8eb tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:48.932621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33df8a7d-ad18-444f-a61e-d2035b8ce8eb tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.934033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33df8a7d-ad18-444f-a61e-d2035b8ce8eb tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.934872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33df8a7d-ad18-444f-a61e-d2035b8ce8eb tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.936064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33df8a7d-ad18-444f-a61e-d2035b8ce8eb tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:48.936806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33df8a7d-ad18-444f-a61e-d2035b8ce8eb tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:48.937730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33df8a7d-ad18-444f-a61e-d2035b8ce8eb tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:48.997572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d7858808-92dc-4143-ad93-c0066aa871b5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:49.021681 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d7858808-92dc-4143-ad93-c0066aa871b5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1320 microversion: 2.1 time: 0.652870 Aug 18 11:42:49.026911 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2070/3967] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:48 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1320 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:49.036487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a81d14ac-de16-4956-8db3-83568db24e5c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f51ac2558b0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:49.082350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a81d14ac-de16-4956-8db3-83568db24e5c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:49.082884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a81d14ac-de16-4956-8db3-83568db24e5c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:49.086958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a81d14ac-de16-4956-8db3-83568db24e5c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:49.107852 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a81d14ac-de16-4956-8db3-83568db24e5c tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags" status: 200 len: 12 microversion: 2.26 time: 0.079153 Aug 18 11:42:49.115974 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2071/3968] 10.222.0.73 () {60 vars in 1292 bytes} [Thu Aug 18 11:42:49 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags => generated 12 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:49.154057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a37cc6f8-a509-4655-b9db-10f20dbf0f32 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:49.155929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a37cc6f8-a509-4655-b9db-10f20dbf0f32 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:49.175640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37cc6f8-a509-4655-b9db-10f20dbf0f32 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:49.180179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37cc6f8-a509-4655-b9db-10f20dbf0f32 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:49.182778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37cc6f8-a509-4655-b9db-10f20dbf0f32 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:49.185554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37cc6f8-a509-4655-b9db-10f20dbf0f32 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:49.188834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37cc6f8-a509-4655-b9db-10f20dbf0f32 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:49.190283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37cc6f8-a509-4655-b9db-10f20dbf0f32 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:49.281933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37cc6f8-a509-4655-b9db-10f20dbf0f32 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:49.283950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37cc6f8-a509-4655-b9db-10f20dbf0f32 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:49.288298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37cc6f8-a509-4655-b9db-10f20dbf0f32 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:49.289905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-a37cc6f8-a509-4655-b9db-10f20dbf0f32 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lazy-loading 'fault' on Instance uuid ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:49.548711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a37cc6f8-a509-4655-b9db-10f20dbf0f32 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:49.581885 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a37cc6f8-a509-4655-b9db-10f20dbf0f32 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 200 len: 1304 microversion: 2.1 time: 0.458208 Aug 18 11:42:49.583677 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2072/3969] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:49 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 1304 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:49.607055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f519fcb9af0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:49.644405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:49.645923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:49.648148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:49.653956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:49.680337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:49.681813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:49.684973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:49.688150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:49.690993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:49.697112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:49.769682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:49.772201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:49.773697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:49.799815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lazy-loading 'flavor' on Instance uuid 3115980f-33d8-4f15-a6f3-a64c8d1b3016 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:49.846224 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c9acdb44-4923-4016-b262-8c34e26effbd tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags" status: 204 len: 0 microversion: 2.26 time: 0.254832 Aug 18 11:42:49.850285 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2073/3970] 10.222.0.73 () {60 vars in 1295 bytes} [Thu Aug 18 11:42:49 2022] DELETE /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:42:49.867286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f519fb115e0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:49.913162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:49.917347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:49.917347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:49.917347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:49.930749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:49.932480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:49.934667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:49.936876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:49.938100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:49.939377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:50.021325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:50.024908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:50.026899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:50.062280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:50.064504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:50.066046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:50.159701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lazy-loading 'flavor' on Instance uuid 3115980f-33d8-4f15-a6f3-a64c8d1b3016 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:50.204819 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a3db786e-3982-47a9-85b1-50e8cac37677 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "PUT /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-546210416" status: 201 len: 0 microversion: 2.26 time: 0.343580 Aug 18 11:42:50.211757 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2074/3971] 10.222.0.73 () {62 vars in 1377 bytes} [Thu Aug 18 11:42:49 2022] PUT /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-546210416 => generated 0 bytes in 354 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 18 11:42:50.227159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5fb092ef-20be-4400-8f0b-3c6c9d802e43 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:50.230214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5fb092ef-20be-4400-8f0b-3c6c9d802e43 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:50.244318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fb092ef-20be-4400-8f0b-3c6c9d802e43 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:50.245406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fb092ef-20be-4400-8f0b-3c6c9d802e43 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:50.247760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fb092ef-20be-4400-8f0b-3c6c9d802e43 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:50.250009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fb092ef-20be-4400-8f0b-3c6c9d802e43 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:50.251136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fb092ef-20be-4400-8f0b-3c6c9d802e43 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:50.253447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fb092ef-20be-4400-8f0b-3c6c9d802e43 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.277550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-33df8a7d-ad18-444f-a61e-d2035b8ce8eb tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:51.305715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5fb092ef-20be-4400-8f0b-3c6c9d802e43 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:51.309458 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-33df8a7d-ad18-444f-a61e-d2035b8ce8eb tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1319 microversion: 2.1 time: 2.403865 Aug 18 11:42:51.311967 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1898/3972] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:48 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1319 bytes in 2410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:51.323485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f519f5c3310>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:51.353791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.354516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.356967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.359751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:51.365706 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5fb092ef-20be-4400-8f0b-3c6c9d802e43 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1320 microversion: 2.1 time: 1.150853 Aug 18 11:42:51.377474 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2075/3973] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:50 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1320 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:51.392198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.392429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d38ca951-e63f-42ab-a9d6-b49692476da1 req-83cc88e5-93e7-461e-8f4d-68f172caf829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3", "name": "network-vif-deleted", "tag": "77b3ef64-9f58-4eb7-8e39-1baf558ebecc"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:51.393681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.394409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.395464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.396213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.396891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.414684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d38ca951-e63f-42ab-a9d6-b49692476da1 req-83cc88e5-93e7-461e-8f4d-68f172caf829 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.415187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d38ca951-e63f-42ab-a9d6-b49692476da1 req-83cc88e5-93e7-461e-8f4d-68f172caf829 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.415547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d38ca951-e63f-42ab-a9d6-b49692476da1 req-83cc88e5-93e7-461e-8f4d-68f172caf829 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.431908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:51.458926 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d38ca951-e63f-42ab-a9d6-b49692476da1 req-83cc88e5-93e7-461e-8f4d-68f172caf829 service nova] Creating event network-vif-deleted:77b3ef64-9f58-4eb7-8e39-1baf558ebecc for instance ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 on n-h1-853611-3 Aug 18 11:42:51.466185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.468112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.468872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.476509 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d38ca951-e63f-42ab-a9d6-b49692476da1 req-83cc88e5-93e7-461e-8f4d-68f172caf829 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097360 Aug 18 11:42:51.477604 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2076/3974] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:51.486333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f2e183b3-f5a4-4730-abd3-4b0abb22b723 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:51.487082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f2e183b3-f5a4-4730-abd3-4b0abb22b723 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:51.488767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.497892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.498785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.507786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2e183b3-f5a4-4730-abd3-4b0abb22b723 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.512323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2e183b3-f5a4-4730-abd3-4b0abb22b723 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.512855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2e183b3-f5a4-4730-abd3-4b0abb22b723 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.513626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2e183b3-f5a4-4730-abd3-4b0abb22b723 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.514104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2e183b3-f5a4-4730-abd3-4b0abb22b723 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.518384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2e183b3-f5a4-4730-abd3-4b0abb22b723 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.551013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lazy-loading 'flavor' on Instance uuid 3115980f-33d8-4f15-a6f3-a64c8d1b3016 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:51.562875 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-f2e183b3-f5a4-4730-abd3-4b0abb22b723 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] HTTP exception thrown: Instance ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 could not be found. Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f2e183b3-f5a4-4730-abd3-4b0abb22b723 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Request method failure captured: Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 HTTP/1.1 Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iU0ka0Sk8g1d78TdExGcs0mGuq9zO7rCRHbyVuYr9QaMT_TP-om5lNRTAwgreGzv5_t_NmaNCgAmDEP1YtkfrnuE_6Plja8CAHrozsWUpCXHCrgtsKrd5ywFWu2tVW5wGo0oid3O2OGhleoAvKMEoS-SHWptU_LXTQljkyyYKtGamc Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c2e348204c8d444fa46deb880043c565 Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerRescueTestJSON-302212366 Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c2e348204c8d444fa46deb880043c565"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c2e348204c8d444fa46deb880043c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c2e348204c8d444fa46deb880043c565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c2e348204c8d444fa46deb880043c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerRescueTestJSON-302212366 Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c2e348204c8d444fa46deb880043c565 Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerRescueTestJSON-302212366 Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerRescueTestJSON-302212366-project Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d7326372f966413d82aea488ca4a0742 Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerRescueTestJSON-302212366-project Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 could not be found. Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3'} Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 could not be found. Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 could not be found. Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:42:51.567702 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:51.576070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:51.576070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:42:51.576070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:42:51.576070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:42:51.576070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:42:51.576070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 could not be found. Aug 18 11:42:51.576070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:51.582206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f2e183b3-f5a4-4730-abd3-4b0abb22b723 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Returning 404 to user: Instance ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:42:51.583115 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d678c474-0507-4550-8f2c-a6c0fae2abdc tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "PUT /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-1684481709" status: 201 len: 0 microversion: 2.26 time: 0.269696 Aug 18 11:42:51.584265 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f2e183b3-f5a4-4730-abd3-4b0abb22b723 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3" status: 404 len: 111 microversion: 2.1 time: 0.102243 Aug 18 11:42:51.591037 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2077/3975] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:51 2022] GET /compute/v2.1/servers/ff7a5e67-b4ef-47d5-9dc8-2c5580912ea3 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:42:51.598590 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1899/3976] 10.222.0.73 () {62 vars in 1380 bytes} [Thu Aug 18 11:42:51 2022] PUT /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-1684481709 => generated 0 bytes in 282 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 18 11:42:51.605700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0e74852f-adcc-49ab-bebc-58ab5a0bd119 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:51.606286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0e74852f-adcc-49ab-bebc-58ab5a0bd119 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:51.609202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-60fd04c6-72c4-46ad-882c-00450629d364 req-6f2095f8-39a8-4a37-b833-bf29f1a3a509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60edd382-8eec-45d5-a90b-eeb908026fc8", "name": "network-vif-plugged", "status": "completed", "tag": "46e932b5-9936-4551-8a1a-8af0f5286ff3"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:51.619045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e74852f-adcc-49ab-bebc-58ab5a0bd119 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.619681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e74852f-adcc-49ab-bebc-58ab5a0bd119 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.620137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e74852f-adcc-49ab-bebc-58ab5a0bd119 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.623070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e74852f-adcc-49ab-bebc-58ab5a0bd119 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.624806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e74852f-adcc-49ab-bebc-58ab5a0bd119 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.625352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0e74852f-adcc-49ab-bebc-58ab5a0bd119 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.639696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-60fd04c6-72c4-46ad-882c-00450629d364 req-6f2095f8-39a8-4a37-b833-bf29f1a3a509 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.641029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-60fd04c6-72c4-46ad-882c-00450629d364 req-6f2095f8-39a8-4a37-b833-bf29f1a3a509 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.644174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-60fd04c6-72c4-46ad-882c-00450629d364 req-6f2095f8-39a8-4a37-b833-bf29f1a3a509 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.676190 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-60fd04c6-72c4-46ad-882c-00450629d364 req-6f2095f8-39a8-4a37-b833-bf29f1a3a509 service nova] Creating event network-vif-plugged:46e932b5-9936-4551-8a1a-8af0f5286ff3 for instance 60edd382-8eec-45d5-a90b-eeb908026fc8 on n-h2-853611-3 Aug 18 11:42:51.692103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0e74852f-adcc-49ab-bebc-58ab5a0bd119 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:42:51.700842 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-60fd04c6-72c4-46ad-882c-00450629d364 req-6f2095f8-39a8-4a37-b833-bf29f1a3a509 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108067 Aug 18 11:42:51.703375 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2078/3977] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:51.730000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f519faa7430>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:51.768083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.768676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.769238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.770078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:51.792672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.796552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.797154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.797925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.810738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.811219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.859594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.859999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.860582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.890474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lazy-loading 'flavor' on Instance uuid 3115980f-33d8-4f15-a6f3-a64c8d1b3016 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:51.917832 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0e74852f-adcc-49ab-bebc-58ab5a0bd119 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 204 len: 0 microversion: 2.1 time: 0.321706 Aug 18 11:42:51.918984 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1900/3978] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:42:51 2022] DELETE /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:42:51.934103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ac27a305-6b42-45b2-85cc-7c97f22b5d87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:51.934976 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-589a1053-1c45-45b5-a29c-fa247c30890b tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags" status: 204 len: 0 microversion: 2.26 time: 0.224852 Aug 18 11:42:51.936041 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2079/3979] 10.222.0.73 () {60 vars in 1295 bytes} [Thu Aug 18 11:42:51 2022] DELETE /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:42:51.937513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ac27a305-6b42-45b2-85cc-7c97f22b5d87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:51.946446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b0b2a392-c8b1-4f27-98f3-75e3de465b61 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f51b0d9a160>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:51.950487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ac27a305-6b42-45b2-85cc-7c97f22b5d87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.951583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ac27a305-6b42-45b2-85cc-7c97f22b5d87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.952565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ac27a305-6b42-45b2-85cc-7c97f22b5d87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.953947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ac27a305-6b42-45b2-85cc-7c97f22b5d87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.954968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ac27a305-6b42-45b2-85cc-7c97f22b5d87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.955898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ac27a305-6b42-45b2-85cc-7c97f22b5d87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.970123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0b2a392-c8b1-4f27-98f3-75e3de465b61 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:51.970690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0b2a392-c8b1-4f27-98f3-75e3de465b61 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:51.971142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0b2a392-c8b1-4f27-98f3-75e3de465b61 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:51.991715 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b0b2a392-c8b1-4f27-98f3-75e3de465b61 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags" status: 200 len: 12 microversion: 2.26 time: 0.049673 Aug 18 11:42:51.992361 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2080/3980] 10.222.0.73 () {60 vars in 1292 bytes} [Thu Aug 18 11:42:51 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags => generated 12 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:42:52.017613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f519f894820>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:52.048609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.053008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.053636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.054157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:52.072591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.074797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.080694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.081804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.082304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.083247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.119866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.120273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.121392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.133560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lazy-loading 'flavor' on Instance uuid 3115980f-33d8-4f15-a6f3-a64c8d1b3016 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:52.156805 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d8a8f039-d191-40db-95c8-e00a0f2460f1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags" status: 204 len: 0 microversion: 2.26 time: 0.153543 Aug 18 11:42:52.160338 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2081/3981] 10.222.0.73 () {60 vars in 1295 bytes} [Thu Aug 18 11:42:52 2022] DELETE /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:42:52.177922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f519ed94d30>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:52.195005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.196241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.196985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.197934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:52.208274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.209225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.210108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.211075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.211729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.213108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.258836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.260228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.260688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.282341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.282868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.283323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.344167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lazy-loading 'flavor' on Instance uuid 3115980f-33d8-4f15-a6f3-a64c8d1b3016 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:52.398942 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-02c56eb1-68bc-463e-9dcd-ad6ccc605d95 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "PUT /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-1521958813" status: 201 len: 0 microversion: 2.26 time: 0.227516 Aug 18 11:42:52.407123 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2082/3982] 10.222.0.73 () {62 vars in 1380 bytes} [Thu Aug 18 11:42:52 2022] PUT /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-1521958813 => generated 0 bytes in 232 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 18 11:42:52.408401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2791cfca-08ea-45a7-b638-7ec65f82f1dc tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:52.409025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2791cfca-08ea-45a7-b638-7ec65f82f1dc tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:52.418813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:52.425168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2791cfca-08ea-45a7-b638-7ec65f82f1dc tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.426031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2791cfca-08ea-45a7-b638-7ec65f82f1dc tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.426921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2791cfca-08ea-45a7-b638-7ec65f82f1dc tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.427924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2791cfca-08ea-45a7-b638-7ec65f82f1dc tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.428513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2791cfca-08ea-45a7-b638-7ec65f82f1dc tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.429148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2791cfca-08ea-45a7-b638-7ec65f82f1dc tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.756293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ac27a305-6b42-45b2-85cc-7c97f22b5d87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:52.783266 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ac27a305-6b42-45b2-85cc-7c97f22b5d87 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1491 microversion: 2.1 time: 0.856589 Aug 18 11:42:52.800164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2791cfca-08ea-45a7-b638-7ec65f82f1dc tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:52.810176 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2791cfca-08ea-45a7-b638-7ec65f82f1dc tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1319 microversion: 2.1 time: 0.408303 Aug 18 11:42:52.811627 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2083/3983] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:52 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:52.816227 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1901/3984] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:51 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1491 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:52.826467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5d6ddd0a-99a9-418f-9dac-fededf5bfa3d tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:52.826822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f519f5c3160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:52.830807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5d6ddd0a-99a9-418f-9dac-fededf5bfa3d tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:52.853759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.857267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d6ddd0a-99a9-418f-9dac-fededf5bfa3d tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.857902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d6ddd0a-99a9-418f-9dac-fededf5bfa3d tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.858748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d6ddd0a-99a9-418f-9dac-fededf5bfa3d tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.860137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d6ddd0a-99a9-418f-9dac-fededf5bfa3d tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.860910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d6ddd0a-99a9-418f-9dac-fededf5bfa3d tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.861641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d6ddd0a-99a9-418f-9dac-fededf5bfa3d tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.862847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.864015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.868799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:52.899929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.900737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.901450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:52.923301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:52.924227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:52.925480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.016844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.017050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.017701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.062376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=1,nova_cell1:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:53.065072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.079156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.080619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.173426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lazy-loading 'flavor' on Instance uuid 3115980f-33d8-4f15-a6f3-a64c8d1b3016 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:53.235631 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2936b749-6d1e-43e5-830c-046abbb85f88 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "PUT /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-2061021066" status: 201 len: 0 microversion: 2.26 time: 0.417148 Aug 18 11:42:53.237618 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1902/3985] 10.222.0.73 () {62 vars in 1380 bytes} [Thu Aug 18 11:42:52 2022] PUT /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags/tempest-tag-2061021066 => generated 0 bytes in 420 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 18 11:42:53.257988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Action: 'update_all', calling method: .version_select at 0x7f519f5c3ca0>, body: {"tags": ["tempest-tag-1368339414", "tempest-tag-480960310"]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:53.288220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.289508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.290557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.291669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:53.304311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.305542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.306660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.308734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.309972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.311086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.379721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.384746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.385924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.456550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lazy-loading 'flavor' on Instance uuid 3115980f-33d8-4f15-a6f3-a64c8d1b3016 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:53.475459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5d6ddd0a-99a9-418f-9dac-fededf5bfa3d tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:53.506294 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8b25745c-4708-4c8e-98cd-bdd988d31741 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "PUT /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags" status: 200 len: 61 microversion: 2.26 time: 0.256788 Aug 18 11:42:53.507628 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1903/3986] 10.222.0.73 () {62 vars in 1312 bytes} [Thu Aug 18 11:42:53 2022] PUT /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags => generated 61 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:42:53.508864 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5d6ddd0a-99a9-418f-9dac-fededf5bfa3d tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1320 microversion: 2.1 time: 0.695534 Aug 18 11:42:53.509957 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2084/3987] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:52 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1320 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:53.530309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fd08a040-5036-4a45-8147-fcb61bb91591 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f519f38a5e0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:53.558941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fd08a040-5036-4a45-8147-fcb61bb91591 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.559788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fd08a040-5036-4a45-8147-fcb61bb91591 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.560591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fd08a040-5036-4a45-8147-fcb61bb91591 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.587974 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fd08a040-5036-4a45-8147-fcb61bb91591 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags" status: 200 len: 61 microversion: 2.26 time: 0.066569 Aug 18 11:42:53.590106 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1904/3988] 10.222.0.73 () {60 vars in 1292 bytes} [Thu Aug 18 11:42:53 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags => generated 61 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:53.615185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '.version_select at 0x7f51b0d9a310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:53.641574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.643316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.644715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.645975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:53.671673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.673535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.675739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.677715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.679247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.680238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.751913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-a94c3e7b-f05b-49fc-8952-f0558d4e2c5b req-e805bb80-1378-4801-8e6e-5a4b46b569f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d414d73c-4cbb-4b18-a248-a2f90766ddfa", "name": "network-vif-plugged", "status": "completed", "tag": "7f859f5b-966f-48a6-a8ff-2fe9434494ba"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:53.765833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.778689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.780074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.789237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a94c3e7b-f05b-49fc-8952-f0558d4e2c5b req-e805bb80-1378-4801-8e6e-5a4b46b569f3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.790550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a94c3e7b-f05b-49fc-8952-f0558d4e2c5b req-e805bb80-1378-4801-8e6e-5a4b46b569f3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.791649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a94c3e7b-f05b-49fc-8952-f0558d4e2c5b req-e805bb80-1378-4801-8e6e-5a4b46b569f3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.826176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lazy-loading 'flavor' on Instance uuid 3115980f-33d8-4f15-a6f3-a64c8d1b3016 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:42:53.830767 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-a94c3e7b-f05b-49fc-8952-f0558d4e2c5b req-e805bb80-1378-4801-8e6e-5a4b46b569f3 service nova] Creating event network-vif-plugged:7f859f5b-966f-48a6-a8ff-2fe9434494ba for instance d414d73c-4cbb-4b18-a248-a2f90766ddfa on n-h1-853611-3 Aug 18 11:42:53.849982 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-32f9f310-957c-4a8b-b382-0501c8e9943f tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags" status: 204 len: 0 microversion: 2.26 time: 0.246129 Aug 18 11:42:53.850994 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-a94c3e7b-f05b-49fc-8952-f0558d4e2c5b req-e805bb80-1378-4801-8e6e-5a4b46b569f3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111962 Aug 18 11:42:53.856215 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1905/3990] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:53.858942 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2085/3990] 10.222.0.73 () {60 vars in 1295 bytes} [Thu Aug 18 11:42:53 2022] DELETE /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016/tags => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:42:53.864566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-01e97d91-8c74-4d0d-9f71-0512971dd203 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:53.865810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-01e97d91-8c74-4d0d-9f71-0512971dd203 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:53.873756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01e97d91-8c74-4d0d-9f71-0512971dd203 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.876161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01e97d91-8c74-4d0d-9f71-0512971dd203 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.876938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01e97d91-8c74-4d0d-9f71-0512971dd203 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.878578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01e97d91-8c74-4d0d-9f71-0512971dd203 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.880816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01e97d91-8c74-4d0d-9f71-0512971dd203 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.881541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01e97d91-8c74-4d0d-9f71-0512971dd203 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.885293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ccc50383-ca04-4c68-976c-aa79710e6b8c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:53.895050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ccc50383-ca04-4c68-976c-aa79710e6b8c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:53.914912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ccc50383-ca04-4c68-976c-aa79710e6b8c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.915321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ccc50383-ca04-4c68-976c-aa79710e6b8c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.929417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ccc50383-ca04-4c68-976c-aa79710e6b8c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:53.930468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ccc50383-ca04-4c68-976c-aa79710e6b8c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:53.931029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ccc50383-ca04-4c68-976c-aa79710e6b8c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:53.936183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ccc50383-ca04-4c68-976c-aa79710e6b8c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:54.214067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-01e97d91-8c74-4d0d-9f71-0512971dd203 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:54.224858 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-01e97d91-8c74-4d0d-9f71-0512971dd203 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1319 microversion: 2.1 time: 0.363940 Aug 18 11:42:54.225933 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2086/3991] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:53 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:54.236051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-50a28687-ccbe-4813-986d-fa5bc7e85df0 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:54.236876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-50a28687-ccbe-4813-986d-fa5bc7e85df0 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:54.247797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50a28687-ccbe-4813-986d-fa5bc7e85df0 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:54.248700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50a28687-ccbe-4813-986d-fa5bc7e85df0 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:54.249520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50a28687-ccbe-4813-986d-fa5bc7e85df0 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:54.250812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50a28687-ccbe-4813-986d-fa5bc7e85df0 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:54.251696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50a28687-ccbe-4813-986d-fa5bc7e85df0 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:54.252439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50a28687-ccbe-4813-986d-fa5bc7e85df0 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:54.307474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-50a28687-ccbe-4813-986d-fa5bc7e85df0 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:42:54.479675 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-50a28687-ccbe-4813-986d-fa5bc7e85df0 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 204 len: 0 microversion: 2.26 time: 0.251423 Aug 18 11:42:54.481704 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2087/3992] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:42:54 2022] DELETE /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:42:54.710579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ccc50383-ca04-4c68-976c-aa79710e6b8c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:54.719250 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ccc50383-ca04-4c68-976c-aa79710e6b8c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1491 microversion: 2.1 time: 0.857623 Aug 18 11:42:54.719739 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1906/3993] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:53 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1491 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:54.734812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2ffb5a70-3bf9-4aa1-b0b8-c660c08106aa tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:54.735760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2ffb5a70-3bf9-4aa1-b0b8-c660c08106aa tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:54.748689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ffb5a70-3bf9-4aa1-b0b8-c660c08106aa tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:54.753467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ffb5a70-3bf9-4aa1-b0b8-c660c08106aa tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:54.754184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ffb5a70-3bf9-4aa1-b0b8-c660c08106aa tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:54.755622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ffb5a70-3bf9-4aa1-b0b8-c660c08106aa tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:54.757163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ffb5a70-3bf9-4aa1-b0b8-c660c08106aa tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:54.759570 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ffb5a70-3bf9-4aa1-b0b8-c660c08106aa tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:54.874557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1aca400a-b674-4cb8-a2ee-91bfafddc307 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Action: 'create', calling method: .version_select at 0x7f51ac3be0d0>, body: {"keypair": {"name": "tempest-keypair-651818827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdnmatBMuuVJOWaJbL916pRyvvb3us3QWl9lwEeNAYIiXBzfzSZrGvkX04h7wdXOgUeOdUZMsSyPpKu70cC+trmaVH3B4kXn8D0D0B8GafeuUKkUvs3/prBu5PtPivJXQ=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:54.903701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-1aca400a-b674-4cb8-a2ee-91bfafddc307 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Getting quotas for project 7efdad3bc1194e1794de97e8d64efe88. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:42:54.924334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-1aca400a-b674-4cb8-a2ee-91bfafddc307 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Getting quotas for user 272a104b54e1450ea94761c135b7c0e4 and project 7efdad3bc1194e1794de97e8d64efe88. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:42:54.972322 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1aca400a-b674-4cb8-a2ee-91bfafddc307 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.487246 Aug 18 11:42:54.973321 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2088/3994] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:42:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:54.980794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-82524c0c-8f6d-41e3-95f7-b1b83fd831ae tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:54.982420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-82524c0c-8f6d-41e3-95f7-b1b83fd831ae tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:54.990585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82524c0c-8f6d-41e3-95f7-b1b83fd831ae tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:54.991837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82524c0c-8f6d-41e3-95f7-b1b83fd831ae tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:54.992660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82524c0c-8f6d-41e3-95f7-b1b83fd831ae tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:54.993689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82524c0c-8f6d-41e3-95f7-b1b83fd831ae tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:54.994363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82524c0c-8f6d-41e3-95f7-b1b83fd831ae tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:54.996000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82524c0c-8f6d-41e3-95f7-b1b83fd831ae tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:55.361753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-82524c0c-8f6d-41e3-95f7-b1b83fd831ae tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:55.381566 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-82524c0c-8f6d-41e3-95f7-b1b83fd831ae tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1320 microversion: 2.1 time: 0.405143 Aug 18 11:42:55.382228 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2089/3995] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:54 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1320 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:55.414819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-014c1a49-4d5d-4d1f-a93d-b70213f7f923 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:55.415974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-014c1a49-4d5d-4d1f-a93d-b70213f7f923 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:55.432976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-014c1a49-4d5d-4d1f-a93d-b70213f7f923 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:55.433510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-014c1a49-4d5d-4d1f-a93d-b70213f7f923 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:55.433961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-014c1a49-4d5d-4d1f-a93d-b70213f7f923 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:55.434733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-014c1a49-4d5d-4d1f-a93d-b70213f7f923 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:55.435207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-014c1a49-4d5d-4d1f-a93d-b70213f7f923 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:55.435641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-014c1a49-4d5d-4d1f-a93d-b70213f7f923 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:55.578282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2ffb5a70-3bf9-4aa1-b0b8-c660c08106aa tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:55.591704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2ffb5a70-3bf9-4aa1-b0b8-c660c08106aa tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:55.597572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2ffb5a70-3bf9-4aa1-b0b8-c660c08106aa tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:55.601588 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2ffb5a70-3bf9-4aa1-b0b8-c660c08106aa tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1551 microversion: 2.26 time: 0.880786 Aug 18 11:42:55.602550 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1907/3996] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:54 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1551 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:55.742768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ad1baa6e-260e-4ec2-a918-50929c77cde0 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:55.743428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ad1baa6e-260e-4ec2-a918-50929c77cde0 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:55.755627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad1baa6e-260e-4ec2-a918-50929c77cde0 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:55.756147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad1baa6e-260e-4ec2-a918-50929c77cde0 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:55.756604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad1baa6e-260e-4ec2-a918-50929c77cde0 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:55.770359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad1baa6e-260e-4ec2-a918-50929c77cde0 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:55.770961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad1baa6e-260e-4ec2-a918-50929c77cde0 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:55.771413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad1baa6e-260e-4ec2-a918-50929c77cde0 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:55.921718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-014c1a49-4d5d-4d1f-a93d-b70213f7f923 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:55.937220 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-014c1a49-4d5d-4d1f-a93d-b70213f7f923 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1319 microversion: 2.1 time: 0.535999 Aug 18 11:42:55.938164 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2090/3997] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:55 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1319 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:55.943240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d88b2e69-7d72-4882-a720-ae53c431293f req-de1095ea-6381-4968-ab72-aeb5907923ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f0209d-fc88-441f-aac1-d0dddf3a37a3", "name": "network-vif-plugged", "status": "completed", "tag": "1c7afcd2-a135-4a72-8fba-dca32a306d4b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:55.976896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d88b2e69-7d72-4882-a720-ae53c431293f req-de1095ea-6381-4968-ab72-aeb5907923ff service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:55.977725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d88b2e69-7d72-4882-a720-ae53c431293f req-de1095ea-6381-4968-ab72-aeb5907923ff service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:55.978377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d88b2e69-7d72-4882-a720-ae53c431293f req-de1095ea-6381-4968-ab72-aeb5907923ff service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:55.983719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:42:55.993108 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d88b2e69-7d72-4882-a720-ae53c431293f req-de1095ea-6381-4968-ab72-aeb5907923ff service nova] Creating event network-vif-plugged:1c7afcd2-a135-4a72-8fba-dca32a306d4b for instance 74f0209d-fc88-441f-aac1-d0dddf3a37a3 on n-h2-853611-3 Aug 18 11:42:56.025358 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d88b2e69-7d72-4882-a720-ae53c431293f req-de1095ea-6381-4968-ab72-aeb5907923ff service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085682 Aug 18 11:42:56.026395 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2091/3998] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:42:56.219442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ad1baa6e-260e-4ec2-a918-50929c77cde0 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:56.241051 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ad1baa6e-260e-4ec2-a918-50929c77cde0 tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1491 microversion: 2.1 time: 0.502666 Aug 18 11:42:56.246077 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1908/3999] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:55 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1491 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:42:56.409003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8ce4a338-3550-4936-a8dd-7006ddc60a15 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:56.409725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8ce4a338-3550-4936-a8dd-7006ddc60a15 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:56.426405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ce4a338-3550-4936-a8dd-7006ddc60a15 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:56.427180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ce4a338-3550-4936-a8dd-7006ddc60a15 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:56.427554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ce4a338-3550-4936-a8dd-7006ddc60a15 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:56.428673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ce4a338-3550-4936-a8dd-7006ddc60a15 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:56.429003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ce4a338-3550-4936-a8dd-7006ddc60a15 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:56.437855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ce4a338-3550-4936-a8dd-7006ddc60a15 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:56.477080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-1fa4e6ca-792b-48e8-8172-e4745e2b2f43 req-73760a81-5284-4a32-a126-8013f0d5ab52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a0c8a6-415b-4702-a260-13ff9be3fd57", "name": "network-vif-deleted", "tag": "77f6cdf6-27ca-4442-87a9-d496b7fb4ea5"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:42:56.500378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1fa4e6ca-792b-48e8-8172-e4745e2b2f43 req-73760a81-5284-4a32-a126-8013f0d5ab52 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:56.508917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1fa4e6ca-792b-48e8-8172-e4745e2b2f43 req-73760a81-5284-4a32-a126-8013f0d5ab52 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:56.509620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1fa4e6ca-792b-48e8-8172-e4745e2b2f43 req-73760a81-5284-4a32-a126-8013f0d5ab52 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:56.546238 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-1fa4e6ca-792b-48e8-8172-e4745e2b2f43 req-73760a81-5284-4a32-a126-8013f0d5ab52 service nova] Creating event network-vif-deleted:77f6cdf6-27ca-4442-87a9-d496b7fb4ea5 for instance c6a0c8a6-415b-4702-a260-13ff9be3fd57 on n-h1-853611-3 Aug 18 11:42:56.561546 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-1fa4e6ca-792b-48e8-8172-e4745e2b2f43 req-73760a81-5284-4a32-a126-8013f0d5ab52 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088179 Aug 18 11:42:56.562816 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1909/4000] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:42:56.630637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-85657fdf-56bb-44fd-a166-e805156b52c1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:56.632263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-85657fdf-56bb-44fd-a166-e805156b52c1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:56.649141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85657fdf-56bb-44fd-a166-e805156b52c1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:56.649650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85657fdf-56bb-44fd-a166-e805156b52c1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:56.654017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85657fdf-56bb-44fd-a166-e805156b52c1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:56.655981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85657fdf-56bb-44fd-a166-e805156b52c1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:56.656481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85657fdf-56bb-44fd-a166-e805156b52c1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:56.656930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-85657fdf-56bb-44fd-a166-e805156b52c1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:56.945728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8ce4a338-3550-4936-a8dd-7006ddc60a15 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:56.962697 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8ce4a338-3550-4936-a8dd-7006ddc60a15 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1320 microversion: 2.1 time: 0.557837 Aug 18 11:42:56.963520 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2092/4001] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:56 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1320 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:56.976199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-988f492b-5648-4f8a-acc5-c3559ad16c0d tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:56.977266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-988f492b-5648-4f8a-acc5-c3559ad16c0d tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:57.001795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-988f492b-5648-4f8a-acc5-c3559ad16c0d tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:57.002373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-988f492b-5648-4f8a-acc5-c3559ad16c0d tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:57.004160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-988f492b-5648-4f8a-acc5-c3559ad16c0d tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:57.008316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-988f492b-5648-4f8a-acc5-c3559ad16c0d tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:57.008961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-988f492b-5648-4f8a-acc5-c3559ad16c0d tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:57.009526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-988f492b-5648-4f8a-acc5-c3559ad16c0d tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:57.011824 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-85657fdf-56bb-44fd-a166-e805156b52c1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:57.043646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-85657fdf-56bb-44fd-a166-e805156b52c1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:57.054790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-85657fdf-56bb-44fd-a166-e805156b52c1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:57.058486 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-85657fdf-56bb-44fd-a166-e805156b52c1 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1551 microversion: 2.26 time: 0.431675 Aug 18 11:42:57.068831 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1910/4002] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:56 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1551 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:42:57.292108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2faa0173-4cdf-4085-af7b-ce95285b8c2f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:57.293325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2faa0173-4cdf-4085-af7b-ce95285b8c2f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:57.373949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2faa0173-4cdf-4085-af7b-ce95285b8c2f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:57.377167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2faa0173-4cdf-4085-af7b-ce95285b8c2f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:57.377668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2faa0173-4cdf-4085-af7b-ce95285b8c2f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:57.378635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2faa0173-4cdf-4085-af7b-ce95285b8c2f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:57.386403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2faa0173-4cdf-4085-af7b-ce95285b8c2f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:57.391211 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2faa0173-4cdf-4085-af7b-ce95285b8c2f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:57.783760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2faa0173-4cdf-4085-af7b-ce95285b8c2f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7326372f966413d82aea488ca4a0742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e348204c8d444fa46deb880043c565', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:57.821075 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2faa0173-4cdf-4085-af7b-ce95285b8c2f tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 200 len: 1285 microversion: 2.1 time: 0.558304 Aug 18 11:42:57.835772 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1911/4003] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:57 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 1285 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:57.868697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-988f492b-5648-4f8a-acc5-c3559ad16c0d tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:57.889561 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-988f492b-5648-4f8a-acc5-c3559ad16c0d tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1319 microversion: 2.1 time: 0.923995 Aug 18 11:42:57.913038 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2093/4004] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:56 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1319 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:58.006846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-05744bc4-634e-43d9-8976-651394926b04 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:58.007856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-05744bc4-634e-43d9-8976-651394926b04 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:58.020248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05744bc4-634e-43d9-8976-651394926b04 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:58.022607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05744bc4-634e-43d9-8976-651394926b04 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:58.023365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05744bc4-634e-43d9-8976-651394926b04 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:58.027178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05744bc4-634e-43d9-8976-651394926b04 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:58.031364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05744bc4-634e-43d9-8976-651394926b04 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:58.032201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-05744bc4-634e-43d9-8976-651394926b04 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:58.109440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-29b7dfff-ca9e-4cbb-81c9-2ca9b62f4613 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:58.115727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-29b7dfff-ca9e-4cbb-81c9-2ca9b62f4613 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:58.147262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29b7dfff-ca9e-4cbb-81c9-2ca9b62f4613 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:58.161466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29b7dfff-ca9e-4cbb-81c9-2ca9b62f4613 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:58.164342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29b7dfff-ca9e-4cbb-81c9-2ca9b62f4613 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:58.173242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29b7dfff-ca9e-4cbb-81c9-2ca9b62f4613 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:58.175779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29b7dfff-ca9e-4cbb-81c9-2ca9b62f4613 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:58.177189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29b7dfff-ca9e-4cbb-81c9-2ca9b62f4613 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:58.654700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-05744bc4-634e-43d9-8976-651394926b04 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:58.669467 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-05744bc4-634e-43d9-8976-651394926b04 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1512 microversion: 2.1 time: 0.663462 Aug 18 11:42:58.671246 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1912/4005] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:58 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1512 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:58.721040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6f659536-b7c2-46af-99af-7cb2892a37d3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:58.721675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6f659536-b7c2-46af-99af-7cb2892a37d3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:58.734994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f659536-b7c2-46af-99af-7cb2892a37d3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:58.735516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f659536-b7c2-46af-99af-7cb2892a37d3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:58.736080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f659536-b7c2-46af-99af-7cb2892a37d3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:58.736709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f659536-b7c2-46af-99af-7cb2892a37d3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:58.737182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f659536-b7c2-46af-99af-7cb2892a37d3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:58.737619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f659536-b7c2-46af-99af-7cb2892a37d3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:59.006506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-29b7dfff-ca9e-4cbb-81c9-2ca9b62f4613 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:59.077956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-29b7dfff-ca9e-4cbb-81c9-2ca9b62f4613 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:59.084801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-29b7dfff-ca9e-4cbb-81c9-2ca9b62f4613 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:59.098225 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-29b7dfff-ca9e-4cbb-81c9-2ca9b62f4613 tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1551 microversion: 2.26 time: 0.996995 Aug 18 11:42:59.103297 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2094/4006] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:42:58 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1551 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:42:59.130834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f5d5397-156a-4827-966d-c6e903a4317c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:59.133679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f5d5397-156a-4827-966d-c6e903a4317c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] [instance: c6a0c8a6-415b-4702-a260-13ff9be3fd57] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:59.148863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f5d5397-156a-4827-966d-c6e903a4317c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:59.150569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f5d5397-156a-4827-966d-c6e903a4317c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:59.156192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f5d5397-156a-4827-966d-c6e903a4317c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:59.160878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f5d5397-156a-4827-966d-c6e903a4317c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:59.162112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f5d5397-156a-4827-966d-c6e903a4317c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:59.163372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f5d5397-156a-4827-966d-c6e903a4317c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:59.226971 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-2f5d5397-156a-4827-966d-c6e903a4317c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] HTTP exception thrown: Instance c6a0c8a6-415b-4702-a260-13ff9be3fd57 could not be found. Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f5d5397-156a-4827-966d-c6e903a4317c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Request method failure captured: Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 HTTP/1.1 Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iU0ka0Sk8g1d78TdExGcs0mGuq9zO7rCRHbyVuYr9QaMT_TP-om5lNRTAwgreGzv5_t_NmaNCgAmDEP1YtkfrnuE_6Plja8CAHrozsWUpCXHCrgtsKrd5ywFWu2tVW5wGo0oid3O2OGhleoAvKMEoS-SHWptU_LXTQljkyyYKtGamc Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c2e348204c8d444fa46deb880043c565 Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerRescueTestJSON-302212366 Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c2e348204c8d444fa46deb880043c565"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c2e348204c8d444fa46deb880043c565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c2e348204c8d444fa46deb880043c565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c2e348204c8d444fa46deb880043c565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerRescueTestJSON-302212366 Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c2e348204c8d444fa46deb880043c565 Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerRescueTestJSON-302212366 Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerRescueTestJSON-302212366-project Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d7326372f966413d82aea488ca4a0742 Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerRescueTestJSON-302212366-project Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance c6a0c8a6-415b-4702-a260-13ff9be3fd57 could not be found. Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'c6a0c8a6-415b-4702-a260-13ff9be3fd57'} Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a0c8a6-415b-4702-a260-13ff9be3fd57 could not be found. Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a0c8a6-415b-4702-a260-13ff9be3fd57 could not be found. Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:42:59.236689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:59.248897 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:42:59.248897 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:42:59.248897 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:42:59.248897 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:42:59.248897 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:42:59.248897 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a0c8a6-415b-4702-a260-13ff9be3fd57 could not be found. Aug 18 11:42:59.248897 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:42:59.248897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f5d5397-156a-4827-966d-c6e903a4317c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] Returning 404 to user: Instance c6a0c8a6-415b-4702-a260-13ff9be3fd57 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:42:59.254795 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f5d5397-156a-4827-966d-c6e903a4317c tempest-ServerRescueTestJSON-302212366 tempest-ServerRescueTestJSON-302212366-project] 10.222.0.73 "GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57" status: 404 len: 111 microversion: 2.1 time: 0.143300 Aug 18 11:42:59.254795 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2095/4007] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:59 2022] GET /compute/v2.1/servers/c6a0c8a6-415b-4702-a260-13ff9be3fd57 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:42:59.261943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3d680d3e-4a0c-4fd8-bdff-4ddd7fd421e4 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:59.263370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3d680d3e-4a0c-4fd8-bdff-4ddd7fd421e4 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:59.270839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d680d3e-4a0c-4fd8-bdff-4ddd7fd421e4 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:59.272036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d680d3e-4a0c-4fd8-bdff-4ddd7fd421e4 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:59.272545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d680d3e-4a0c-4fd8-bdff-4ddd7fd421e4 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:59.274127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d680d3e-4a0c-4fd8-bdff-4ddd7fd421e4 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:59.275154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d680d3e-4a0c-4fd8-bdff-4ddd7fd421e4 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:59.277894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d680d3e-4a0c-4fd8-bdff-4ddd7fd421e4 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:59.687595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6f659536-b7c2-46af-99af-7cb2892a37d3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:59.731473 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6f659536-b7c2-46af-99af-7cb2892a37d3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1512 microversion: 2.1 time: 1.014050 Aug 18 11:42:59.732616 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1913/4008] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:58 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1512 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:42:59.775252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-02ef4962-d5bd-49a1-9fea-801bed733c9e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:42:59.777078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-02ef4962-d5bd-49a1-9fea-801bed733c9e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 60edd382-8eec-45d5-a90b-eeb908026fc8] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:42:59.788713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02ef4962-d5bd-49a1-9fea-801bed733c9e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:59.789617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02ef4962-d5bd-49a1-9fea-801bed733c9e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:59.790404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02ef4962-d5bd-49a1-9fea-801bed733c9e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:59.792502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02ef4962-d5bd-49a1-9fea-801bed733c9e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:42:59.793414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02ef4962-d5bd-49a1-9fea-801bed733c9e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:42:59.794236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02ef4962-d5bd-49a1-9fea-801bed733c9e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:42:59.801129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3d680d3e-4a0c-4fd8-bdff-4ddd7fd421e4 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:42:59.814703 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3d680d3e-4a0c-4fd8-bdff-4ddd7fd421e4 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1319 microversion: 2.1 time: 0.559063 Aug 18 11:42:59.855581 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2096/4009] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:59 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1319 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:00.175710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5cb36b6b-9243-4bf9-91b1-aff3e58229bf tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:00.176845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5cb36b6b-9243-4bf9-91b1-aff3e58229bf tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:00.207673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cb36b6b-9243-4bf9-91b1-aff3e58229bf tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:00.208587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cb36b6b-9243-4bf9-91b1-aff3e58229bf tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:00.209388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cb36b6b-9243-4bf9-91b1-aff3e58229bf tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:00.211867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cb36b6b-9243-4bf9-91b1-aff3e58229bf tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:00.212483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cb36b6b-9243-4bf9-91b1-aff3e58229bf tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:00.213584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cb36b6b-9243-4bf9-91b1-aff3e58229bf tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:00.655848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-02ef4962-d5bd-49a1-9fea-801bed733c9e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:00.671165 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-02ef4962-d5bd-49a1-9fea-801bed733c9e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8" status: 200 len: 1513 microversion: 2.1 time: 0.915589 Aug 18 11:43:00.672456 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1914/4010] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:42:59 2022] GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8 => generated 1513 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:00.687799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-5cedfc21-b1d0-4606-aa76-aff7c2e39b3f req-69bac557-5ca2-4029-b84a-827a6531da08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3115980f-33d8-4f15-a6f3-a64c8d1b3016", "name": "network-vif-deleted", "tag": "bbf23dea-fc53-4704-a016-8e0575a93aac"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:00.722214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5cedfc21-b1d0-4606-aa76-aff7c2e39b3f req-69bac557-5ca2-4029-b84a-827a6531da08 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:00.722894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5cedfc21-b1d0-4606-aa76-aff7c2e39b3f req-69bac557-5ca2-4029-b84a-827a6531da08 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:00.723643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-5cedfc21-b1d0-4606-aa76-aff7c2e39b3f req-69bac557-5ca2-4029-b84a-827a6531da08 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:00.725839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5cb36b6b-9243-4bf9-91b1-aff3e58229bf tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:00.742905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5cb36b6b-9243-4bf9-91b1-aff3e58229bf tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:00.753283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5cb36b6b-9243-4bf9-91b1-aff3e58229bf tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c0d507df31e4ac3929fc896a4cac68a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025ca122152a4dd1928436f60f3aef36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:00.754848 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5cb36b6b-9243-4bf9-91b1-aff3e58229bf tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 200 len: 1509 microversion: 2.26 time: 0.602337 Aug 18 11:43:00.758722 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2097/4011] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:00 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 1509 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:00.764454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:00.770927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:00.771170 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-5cedfc21-b1d0-4606-aa76-aff7c2e39b3f req-69bac557-5ca2-4029-b84a-827a6531da08 service nova] Creating event network-vif-deleted:bbf23dea-fc53-4704-a016-8e0575a93aac for instance 3115980f-33d8-4f15-a6f3-a64c8d1b3016 on n-h1-853611-3 Aug 18 11:43:00.772459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:00.786216 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-5cedfc21-b1d0-4606-aa76-aff7c2e39b3f req-69bac557-5ca2-4029-b84a-827a6531da08 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111688 Aug 18 11:43:00.791024 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1915/4012] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:00.796801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:00.797762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:00.798640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:00.800392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:00.811295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:00.827434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:00.852679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7bbe2fa1-616a-4402-b23b-cdf954c1d0cd tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:00.855357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7bbe2fa1-616a-4402-b23b-cdf954c1d0cd tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:00.880572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bbe2fa1-616a-4402-b23b-cdf954c1d0cd tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:00.882966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bbe2fa1-616a-4402-b23b-cdf954c1d0cd tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:00.883748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bbe2fa1-616a-4402-b23b-cdf954c1d0cd tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:00.891166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bbe2fa1-616a-4402-b23b-cdf954c1d0cd tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:00.892600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bbe2fa1-616a-4402-b23b-cdf954c1d0cd tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:00.893322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bbe2fa1-616a-4402-b23b-cdf954c1d0cd tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:01.124205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:01.396633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:01.412763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:01.414464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:01.415136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:01.697496 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-afa845a8-ba68-4851-8e29-48077f32cae2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.937204 Aug 18 11:43:01.700865 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2098/4013] 10.222.0.73 () {58 vars in 1167 bytes} [Thu Aug 18 11:43:00 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:01.717221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "b81171c9-ccee-4189-b139-fd0811f4384e"}], "security_groups": [{"name": "tempest-securitygroup--830100221"}], "key_name": "tempest-keypair-651818827", "user_data": "}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:01.965480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] validate_networks() for [('b81171c9-ccee-4189-b139-fd0811f4384e', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:43:02.185267 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7bbe2fa1-616a-4402-b23b-cdf954c1d0cd tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:02.203411 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7bbe2fa1-616a-4402-b23b-cdf954c1d0cd tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1319 microversion: 2.1 time: 1.365295 Aug 18 11:43:02.223465 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1916/4014] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:00 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1319 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:43:02.246793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:02.261007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:02.261939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1544117582', 'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:02.268179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:02.268669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:02.269109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:02.269856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:02.270371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:02.270826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:02.433895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:02.558632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:02.565883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:02.566516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:02.576215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:02.706035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:43:02.718668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:43:02.720296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:43:02.721213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:43:02.721842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:43:02.733740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:02.734414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:02.734967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:02.735815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:02.736380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:02.736912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:02.759588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Getting quotas for project 7efdad3bc1194e1794de97e8d64efe88. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:43:02.767451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Getting quotas for user 272a104b54e1450ea94761c135b7c0e4 and project 7efdad3bc1194e1794de97e8d64efe88. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:43:02.784347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:43:02.787020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:43:02.841859 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0ab9c13b-ec2b-4aa6-be9d-34b38ece0d66 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.139143 Aug 18 11:43:02.843096 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2099/4015] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:43:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:43:02.849181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-57983ce4-1fbf-4d67-ab53-e3d2cc09202e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:02.850702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-57983ce4-1fbf-4d67-ab53-e3d2cc09202e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] [instance: 3115980f-33d8-4f15-a6f3-a64c8d1b3016] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:02.863421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57983ce4-1fbf-4d67-ab53-e3d2cc09202e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:02.864238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57983ce4-1fbf-4d67-ab53-e3d2cc09202e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:02.865483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57983ce4-1fbf-4d67-ab53-e3d2cc09202e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:02.867268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57983ce4-1fbf-4d67-ab53-e3d2cc09202e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:02.868505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57983ce4-1fbf-4d67-ab53-e3d2cc09202e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:02.869126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57983ce4-1fbf-4d67-ab53-e3d2cc09202e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:02.907416 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-57983ce4-1fbf-4d67-ab53-e3d2cc09202e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] HTTP exception thrown: Instance 3115980f-33d8-4f15-a6f3-a64c8d1b3016 could not be found. Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-57983ce4-1fbf-4d67-ab53-e3d2cc09202e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Request method failure captured: Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 HTTP/1.1 Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iWVWnITOaMuxts77-DDvbDTl2HUY9f-z2tXSLNYcZ7upqzbxpcj5-Heirl5TiFHXqZblV8hbSpHkK6svTGOeUnP4Et_PXY9vfXCtcOvd18Lf564H31BygNFd85d1_pQyH_EH_OlDu8y0CjkjfK9oshhWNN7qRuPdK1ep0_t-Dx6pLY Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.26 Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 025ca122152a4dd1928436f60f3aef36 Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerTagsTestJSON-831028832 Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/025ca122152a4dd1928436f60f3aef36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/025ca122152a4dd1928436f60f3aef36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_025ca122152a4dd1928436f60f3aef36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/025ca122152a4dd1928436f60f3aef36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerTagsTestJSON-831028832 Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 025ca122152a4dd1928436f60f3aef36 Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerTagsTestJSON-831028832 Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerTagsTestJSON-831028832-project Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 1c0d507df31e4ac3929fc896a4cac68a Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerTagsTestJSON-831028832-project Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 3115980f-33d8-4f15-a6f3-a64c8d1b3016 could not be found. Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '3115980f-33d8-4f15-a6f3-a64c8d1b3016'} Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3115980f-33d8-4f15-a6f3-a64c8d1b3016 could not be found. Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3115980f-33d8-4f15-a6f3-a64c8d1b3016 could not be found. Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:43:02.910068 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:02.916094 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:02.916094 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:43:02.916094 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:43:02.916094 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:43:02.916094 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:43:02.916094 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3115980f-33d8-4f15-a6f3-a64c8d1b3016 could not be found. Aug 18 11:43:02.916094 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:02.919144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-57983ce4-1fbf-4d67-ab53-e3d2cc09202e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] Returning 404 to user: Instance 3115980f-33d8-4f15-a6f3-a64c8d1b3016 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:43:02.920239 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-57983ce4-1fbf-4d67-ab53-e3d2cc09202e tempest-ServerTagsTestJSON-831028832 tempest-ServerTagsTestJSON-831028832-project] 10.222.0.73 "GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016" status: 404 len: 111 microversion: 2.26 time: 0.076003 Aug 18 11:43:02.921345 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2100/4016] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:02 2022] GET /compute/v2.1/servers/3115980f-33d8-4f15-a6f3-a64c8d1b3016 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:43:03.038258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d9ca05b4-1e93-4fc6-8e58-59dd7e083249 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Action: 'create', calling method: .version_select at 0x7f519f9ddee0>, body: {"keypair": {"name": "tempest-keypair-577785836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpD4Y0SDwwnUr7Gjnv3md8nXD0zjzV0Sf5sgm8Z5yvuCRTl06LD1VZoWNhppk5hVZu1W+a38Q+SvE/DBhtsovhS/ZJqXDIkgHNGprpko7gQ8mlmfq4gsuA1zkDHEZV/lA=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:03.060491 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-33593355-d745-4118-ad4e-06232bd74a94 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1544117582" status: 200 len: 1515 microversion: 2.1 time: 0.834527 Aug 18 11:43:03.078602 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1917/4017] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:43:02 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1544117582 => generated 1515 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:03.102331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-f5cb816a-9a47-4916-850c-0f775d9b0b9c req-9f07a6e3-860d-46cb-8a01-e7735413ea24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27", "name": "network-vif-plugged", "status": "completed", "tag": "91c51f5e-72e3-4dfd-a974-a08dd441bc3e"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:03.146613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d9ca05b4-1e93-4fc6-8e58-59dd7e083249 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Getting quotas for project 104cfd007b1043239b1818d021f4b26c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:43:03.151792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f5cb816a-9a47-4916-850c-0f775d9b0b9c req-9f07a6e3-860d-46cb-8a01-e7735413ea24 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:03.152785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f5cb816a-9a47-4916-850c-0f775d9b0b9c req-9f07a6e3-860d-46cb-8a01-e7735413ea24 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:03.159387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f5cb816a-9a47-4916-850c-0f775d9b0b9c req-9f07a6e3-860d-46cb-8a01-e7735413ea24 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:03.182085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d9ca05b4-1e93-4fc6-8e58-59dd7e083249 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Getting quotas for user 7646f45e2e054269b3d00ec53c883728 and project 104cfd007b1043239b1818d021f4b26c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:43:03.190690 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-f5cb816a-9a47-4916-850c-0f775d9b0b9c req-9f07a6e3-860d-46cb-8a01-e7735413ea24 service nova] Creating event network-vif-plugged:91c51f5e-72e3-4dfd-a974-a08dd441bc3e for instance 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 on n-h1-853611-3 Aug 18 11:43:03.219798 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-f5cb816a-9a47-4916-850c-0f775d9b0b9c req-9f07a6e3-860d-46cb-8a01-e7735413ea24 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123692 Aug 18 11:43:03.221251 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1918/4018] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:03.247498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-20538d1f-2d12-4a43-9e2a-5fffd3eb87a2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:03.248242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-20538d1f-2d12-4a43-9e2a-5fffd3eb87a2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:03.303585 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d9ca05b4-1e93-4fc6-8e58-59dd7e083249 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.369954 Aug 18 11:43:03.314615 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2101/4019] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:43:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:03.327129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:03.341194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:03.351068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:03.371473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:03.380401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:03.381716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:03.383553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:03.387063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:03.388283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:03.685553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:03.725654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-20538d1f-2d12-4a43-9e2a-5fffd3eb87a2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:03.736469 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-20538d1f-2d12-4a43-9e2a-5fffd3eb87a2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1225 microversion: 2.1 time: 0.513281 Aug 18 11:43:03.737099 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1919/4020] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:03 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1225 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:03.744673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fbfc6260-4cc6-48e8-a7d1-b111e5af59d5 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:03.747832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fbfc6260-4cc6-48e8-a7d1-b111e5af59d5 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:03.769642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbfc6260-4cc6-48e8-a7d1-b111e5af59d5 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:03.771338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbfc6260-4cc6-48e8-a7d1-b111e5af59d5 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:03.771807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbfc6260-4cc6-48e8-a7d1-b111e5af59d5 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:03.772561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbfc6260-4cc6-48e8-a7d1-b111e5af59d5 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:03.775223 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbfc6260-4cc6-48e8-a7d1-b111e5af59d5 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:03.779958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fbfc6260-4cc6-48e8-a7d1-b111e5af59d5 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:03.822221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:03.880802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:03.899980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:03.902644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:03.903852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:04.309726 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-18e5e5da-99ee-41b4-9d18-2eb8c8eb843c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 1.000506 Aug 18 11:43:04.313599 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2102/4021] 10.222.0.73 () {58 vars in 1173 bytes} [Thu Aug 18 11:43:03 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:04.347262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:04.353169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:04.354238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.compute.servers [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Removing options 'limit' from query {{(pid=122210) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 18 11:43:04.355015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:04.360746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:04.361241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:04.361689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:04.362583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:04.363498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:04.363836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:04.441570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:04.445623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fbfc6260-4cc6-48e8-a7d1-b111e5af59d5 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:04.448749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:04.449247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:04.449690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:04.464693 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fbfc6260-4cc6-48e8-a7d1-b111e5af59d5 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1319 microversion: 2.1 time: 0.726392 Aug 18 11:43:04.472945 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1920/4022] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:03 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1319 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:04.761986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f185cab0-f37f-44d5-9a10-8c98f5aff03f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:04.763078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f185cab0-f37f-44d5-9a10-8c98f5aff03f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:04.778144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f185cab0-f37f-44d5-9a10-8c98f5aff03f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:04.781150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f185cab0-f37f-44d5-9a10-8c98f5aff03f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:04.782039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f185cab0-f37f-44d5-9a10-8c98f5aff03f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:04.786193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f185cab0-f37f-44d5-9a10-8c98f5aff03f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:04.786715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f185cab0-f37f-44d5-9a10-8c98f5aff03f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:04.787403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f185cab0-f37f-44d5-9a10-8c98f5aff03f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:05.026995 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-73ae50f9-2053-445d-aadb-089871e309f5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.683768 Aug 18 11:43:05.037604 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2103/4023] 10.222.0.73 () {58 vars in 1161 bytes} [Thu Aug 18 11:43:04 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:05.054589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a31b4ee4-8729-4d4c-87da-9d01eacc7948 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:05.060429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a31b4ee4-8729-4d4c-87da-9d01eacc7948 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:05.061643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a31b4ee4-8729-4d4c-87da-9d01eacc7948 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:05.067542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f185cab0-f37f-44d5-9a10-8c98f5aff03f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:05.069146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a31b4ee4-8729-4d4c-87da-9d01eacc7948 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:05.069901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a31b4ee4-8729-4d4c-87da-9d01eacc7948 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:05.070696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a31b4ee4-8729-4d4c-87da-9d01eacc7948 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:05.071728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a31b4ee4-8729-4d4c-87da-9d01eacc7948 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:05.073077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a31b4ee4-8729-4d4c-87da-9d01eacc7948 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:05.073769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a31b4ee4-8729-4d4c-87da-9d01eacc7948 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:05.095840 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f185cab0-f37f-44d5-9a10-8c98f5aff03f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1277 microversion: 2.1 time: 0.339726 Aug 18 11:43:05.106804 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1921/4024] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:04 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1277 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:05.219999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-a31b4ee4-8729-4d4c-87da-9d01eacc7948 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:05.356286 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a31b4ee4-8729-4d4c-87da-9d01eacc7948 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.305194 Aug 18 11:43:05.356286 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2104/4025] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 11:43:05 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:05.375542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3afe621-bf0d-4501-bea0-a5fd22ff1a93 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:05.402861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d3afe621-bf0d-4501-bea0-a5fd22ff1a93 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:05.403861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.compute.servers [None req-d3afe621-bf0d-4501-bea0-a5fd22ff1a93 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Removing options 'limit' from query {{(pid=122209) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 18 11:43:05.405831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d3afe621-bf0d-4501-bea0-a5fd22ff1a93 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:05.416801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3afe621-bf0d-4501-bea0-a5fd22ff1a93 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:05.418177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3afe621-bf0d-4501-bea0-a5fd22ff1a93 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:05.419459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3afe621-bf0d-4501-bea0-a5fd22ff1a93 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:05.421259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3afe621-bf0d-4501-bea0-a5fd22ff1a93 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:05.422597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3afe621-bf0d-4501-bea0-a5fd22ff1a93 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:05.423762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3afe621-bf0d-4501-bea0-a5fd22ff1a93 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:05.494882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c7d2917-7715-4122-8a8b-afeb868ef2ae tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:05.495752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c7d2917-7715-4122-8a8b-afeb868ef2ae tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:05.512964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7d2917-7715-4122-8a8b-afeb868ef2ae tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:05.516353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7d2917-7715-4122-8a8b-afeb868ef2ae tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:05.517240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7d2917-7715-4122-8a8b-afeb868ef2ae tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:05.519087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7d2917-7715-4122-8a8b-afeb868ef2ae tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:05.519588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7d2917-7715-4122-8a8b-afeb868ef2ae tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:05.520155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7d2917-7715-4122-8a8b-afeb868ef2ae tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:05.526218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-d3afe621-bf0d-4501-bea0-a5fd22ff1a93 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:05.593848 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d3afe621-bf0d-4501-bea0-a5fd22ff1a93 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.225743 Aug 18 11:43:05.595546 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1922/4026] 10.222.0.73 () {58 vars in 1150 bytes} [Thu Aug 18 11:43:05 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:05.612697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0dee1c60-3540-46d3-9d77-cf8673804fec tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:05.617708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0dee1c60-3540-46d3-9d77-cf8673804fec tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:05.618549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0dee1c60-3540-46d3-9d77-cf8673804fec tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:05.636379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0dee1c60-3540-46d3-9d77-cf8673804fec tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:05.636879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0dee1c60-3540-46d3-9d77-cf8673804fec tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:05.640539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0dee1c60-3540-46d3-9d77-cf8673804fec tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:05.641747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0dee1c60-3540-46d3-9d77-cf8673804fec tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:05.646003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0dee1c60-3540-46d3-9d77-cf8673804fec tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:05.647154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0dee1c60-3540-46d3-9d77-cf8673804fec tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:05.726255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-0dee1c60-3540-46d3-9d77-cf8673804fec tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:05.798896 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0dee1c60-3540-46d3-9d77-cf8673804fec tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.190670 Aug 18 11:43:05.801409 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1923/4027] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 18 11:43:05 2022] GET /compute/v2.1/servers => generated 1011 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:43:05.820288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cdbcf229-d497-42b3-9a5f-24f283050bda tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:05.846356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cdbcf229-d497-42b3-9a5f-24f283050bda tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:05.847485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cdbcf229-d497-42b3-9a5f-24f283050bda tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:05.865538 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cdbcf229-d497-42b3-9a5f-24f283050bda tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:05.866418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cdbcf229-d497-42b3-9a5f-24f283050bda tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:05.867139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cdbcf229-d497-42b3-9a5f-24f283050bda tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:05.868136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cdbcf229-d497-42b3-9a5f-24f283050bda tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:05.868972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cdbcf229-d497-42b3-9a5f-24f283050bda tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:05.869822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cdbcf229-d497-42b3-9a5f-24f283050bda tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:06.058474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-cdbcf229-d497-42b3-9a5f-24f283050bda tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:06.167809 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cdbcf229-d497-42b3-9a5f-24f283050bda tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.351860 Aug 18 11:43:06.169243 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1924/4028] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:43:05 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:43:06.192690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-65400867-8a5b-42fe-ba58-a26bc197e178 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:06.194827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-65400867-8a5b-42fe-ba58-a26bc197e178 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:06.218665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65400867-8a5b-42fe-ba58-a26bc197e178 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:06.219802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65400867-8a5b-42fe-ba58-a26bc197e178 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:06.220492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65400867-8a5b-42fe-ba58-a26bc197e178 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:06.221954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65400867-8a5b-42fe-ba58-a26bc197e178 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:06.222702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65400867-8a5b-42fe-ba58-a26bc197e178 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:06.223349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-65400867-8a5b-42fe-ba58-a26bc197e178 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:06.536756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9c7d2917-7715-4122-8a8b-afeb868ef2ae tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:06.552402 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c7d2917-7715-4122-8a8b-afeb868ef2ae tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1319 microversion: 2.1 time: 1.062542 Aug 18 11:43:06.556396 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2105/4029] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:05 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1319 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:06.566617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1bd31249-e404-46fb-b694-7e3ab1fbbe64 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:06.580684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1bd31249-e404-46fb-b694-7e3ab1fbbe64 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:06.582047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.compute.servers [None req-1bd31249-e404-46fb-b694-7e3ab1fbbe64 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Removing options 'limit' from query {{(pid=122210) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 18 11:43:06.583708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1bd31249-e404-46fb-b694-7e3ab1fbbe64 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:06.596555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bd31249-e404-46fb-b694-7e3ab1fbbe64 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:06.600937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bd31249-e404-46fb-b694-7e3ab1fbbe64 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:06.601637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bd31249-e404-46fb-b694-7e3ab1fbbe64 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:06.602499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bd31249-e404-46fb-b694-7e3ab1fbbe64 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:06.602967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bd31249-e404-46fb-b694-7e3ab1fbbe64 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:06.603437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bd31249-e404-46fb-b694-7e3ab1fbbe64 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:06.680454 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1bd31249-e404-46fb-b694-7e3ab1fbbe64 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.121685 Aug 18 11:43:06.690195 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2106/4030] 10.222.0.73 () {58 vars in 1140 bytes} [Thu Aug 18 11:43:06 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:06.696110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a0547c7-050f-4c08-814a-1b6da308ea06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:06.703211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a0547c7-050f-4c08-814a-1b6da308ea06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:06.704295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a0547c7-050f-4c08-814a-1b6da308ea06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1544117582', 'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:06.707908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:06.729345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a0547c7-050f-4c08-814a-1b6da308ea06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:06.730185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a0547c7-050f-4c08-814a-1b6da308ea06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:06.731422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a0547c7-050f-4c08-814a-1b6da308ea06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:06.732938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a0547c7-050f-4c08-814a-1b6da308ea06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:06.733695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a0547c7-050f-4c08-814a-1b6da308ea06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:06.734379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a0547c7-050f-4c08-814a-1b6da308ea06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:06.939302 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-65400867-8a5b-42fe-ba58-a26bc197e178 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:06.966713 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-65400867-8a5b-42fe-ba58-a26bc197e178 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1283 microversion: 2.1 time: 0.795614 Aug 18 11:43:06.971382 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1925/4031] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:06 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1283 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:06.995411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-1a0547c7-050f-4c08-814a-1b6da308ea06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:07.228018 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a0547c7-050f-4c08-814a-1b6da308ea06 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1544117582" status: 200 len: 346 microversion: 2.1 time: 0.535138 Aug 18 11:43:07.230944 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2107/4032] 10.222.0.73 () {58 vars in 1242 bytes} [Thu Aug 18 11:43:06 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1544117582 => generated 346 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:07.249327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f93f73b5-3024-442e-9e68-ae1f8e9408a8 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:07.262572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f93f73b5-3024-442e-9e68-ae1f8e9408a8 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:07.264224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f93f73b5-3024-442e-9e68-ae1f8e9408a8 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:07.267471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f93f73b5-3024-442e-9e68-ae1f8e9408a8 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:07.345841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f93f73b5-3024-442e-9e68-ae1f8e9408a8 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Going to try to stop instance {{(pid=122209) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 11:43:07.459386 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f93f73b5-3024-442e-9e68-ae1f8e9408a8 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "POST /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887/action" status: 202 len: 0 microversion: 2.1 time: 0.216049 Aug 18 11:43:07.461349 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1926/4033] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:43:07 2022] POST /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:43:07.476462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-53d80906-a83e-41a2-bb42-a4d81a75b020 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:07.489344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-53d80906-a83e-41a2-bb42-a4d81a75b020 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:07.511241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53d80906-a83e-41a2-bb42-a4d81a75b020 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:07.512355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53d80906-a83e-41a2-bb42-a4d81a75b020 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:07.513369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53d80906-a83e-41a2-bb42-a4d81a75b020 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:07.514810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53d80906-a83e-41a2-bb42-a4d81a75b020 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:07.515904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53d80906-a83e-41a2-bb42-a4d81a75b020 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:07.517241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53d80906-a83e-41a2-bb42-a4d81a75b020 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:07.586500 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-69e90d5b-b692-45d1-92bc-7b27d0afcffa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:07.594703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-69e90d5b-b692-45d1-92bc-7b27d0afcffa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:07.649642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e90d5b-b692-45d1-92bc-7b27d0afcffa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:07.651247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e90d5b-b692-45d1-92bc-7b27d0afcffa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:07.651996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e90d5b-b692-45d1-92bc-7b27d0afcffa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:07.653350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e90d5b-b692-45d1-92bc-7b27d0afcffa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:07.663333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e90d5b-b692-45d1-92bc-7b27d0afcffa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:07.664115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69e90d5b-b692-45d1-92bc-7b27d0afcffa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:08.088374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-53d80906-a83e-41a2-bb42-a4d81a75b020 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:08.113970 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-53d80906-a83e-41a2-bb42-a4d81a75b020 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1522 microversion: 2.1 time: 0.645042 Aug 18 11:43:08.114612 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2108/4034] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:07 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1522 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:08.126069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-46a9bd89-4a13-4b61-b2bb-6740123a19f7 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:08.134059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-46a9bd89-4a13-4b61-b2bb-6740123a19f7 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:08.158461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46a9bd89-4a13-4b61-b2bb-6740123a19f7 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:08.159325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46a9bd89-4a13-4b61-b2bb-6740123a19f7 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:08.160100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46a9bd89-4a13-4b61-b2bb-6740123a19f7 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:08.161348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46a9bd89-4a13-4b61-b2bb-6740123a19f7 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:08.162182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46a9bd89-4a13-4b61-b2bb-6740123a19f7 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:08.163009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46a9bd89-4a13-4b61-b2bb-6740123a19f7 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:08.313069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-69e90d5b-b692-45d1-92bc-7b27d0afcffa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:08.328881 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-69e90d5b-b692-45d1-92bc-7b27d0afcffa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 200 len: 1507 microversion: 2.1 time: 0.754593 Aug 18 11:43:08.329589 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1927/4035] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:07 2022] GET /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 1507 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:08.364719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-af4c7fd2-f072-48c6-8e17-5135efef1710 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:08.365783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-af4c7fd2-f072-48c6-8e17-5135efef1710 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 74f0209d-fc88-441f-aac1-d0dddf3a37a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:08.377236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af4c7fd2-f072-48c6-8e17-5135efef1710 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:08.379617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af4c7fd2-f072-48c6-8e17-5135efef1710 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:08.380190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af4c7fd2-f072-48c6-8e17-5135efef1710 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:08.382406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af4c7fd2-f072-48c6-8e17-5135efef1710 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:08.382967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af4c7fd2-f072-48c6-8e17-5135efef1710 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:08.383612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af4c7fd2-f072-48c6-8e17-5135efef1710 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:08.768376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-af4c7fd2-f072-48c6-8e17-5135efef1710 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:08.783754 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-af4c7fd2-f072-48c6-8e17-5135efef1710 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/74f0209d-fc88-441f-aac1-d0dddf3a37a3" status: 200 len: 1507 microversion: 2.1 time: 0.423126 Aug 18 11:43:08.788421 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1928/4036] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:08 2022] GET /compute/v2.1/servers/74f0209d-fc88-441f-aac1-d0dddf3a37a3 => generated 1507 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:08.831972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b3ad88b6-545a-4c9e-96cd-411f713dbe85 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:08.832782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b3ad88b6-545a-4c9e-96cd-411f713dbe85 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 74f0209d-fc88-441f-aac1-d0dddf3a37a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:08.844467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3ad88b6-545a-4c9e-96cd-411f713dbe85 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:08.845448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3ad88b6-545a-4c9e-96cd-411f713dbe85 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:08.845896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3ad88b6-545a-4c9e-96cd-411f713dbe85 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:08.846691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3ad88b6-545a-4c9e-96cd-411f713dbe85 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:08.847161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3ad88b6-545a-4c9e-96cd-411f713dbe85 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:08.847601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b3ad88b6-545a-4c9e-96cd-411f713dbe85 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:08.898052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-46a9bd89-4a13-4b61-b2bb-6740123a19f7 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:08.911842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b3ad88b6-545a-4c9e-96cd-411f713dbe85 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 74f0209d-fc88-441f-aac1-d0dddf3a37a3] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:43:08.918284 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-46a9bd89-4a13-4b61-b2bb-6740123a19f7 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1350 microversion: 2.1 time: 0.802339 Aug 18 11:43:08.930463 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2109/4037] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:08 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1350 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:09.077667 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b3ad88b6-545a-4c9e-96cd-411f713dbe85 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "DELETE /compute/v2.1/servers/74f0209d-fc88-441f-aac1-d0dddf3a37a3" status: 204 len: 0 microversion: 2.1 time: 0.249208 Aug 18 11:43:09.079254 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1929/4038] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:43:08 2022] DELETE /compute/v2.1/servers/74f0209d-fc88-441f-aac1-d0dddf3a37a3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:43:09.094298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e3a2962b-a05a-4847-b933-0ef446f831d7 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:09.095762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e3a2962b-a05a-4847-b933-0ef446f831d7 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:09.105880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3a2962b-a05a-4847-b933-0ef446f831d7 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:09.106828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3a2962b-a05a-4847-b933-0ef446f831d7 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:09.107533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3a2962b-a05a-4847-b933-0ef446f831d7 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:09.108477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3a2962b-a05a-4847-b933-0ef446f831d7 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:09.109450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3a2962b-a05a-4847-b933-0ef446f831d7 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:09.110410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3a2962b-a05a-4847-b933-0ef446f831d7 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:09.116392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:09.145420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e3a2962b-a05a-4847-b933-0ef446f831d7 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:43:09.161558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f215972c-1905-4590-9a1a-e1daaef7d435 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:09.162696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f215972c-1905-4590-9a1a-e1daaef7d435 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:09.172308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f215972c-1905-4590-9a1a-e1daaef7d435 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:09.173053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f215972c-1905-4590-9a1a-e1daaef7d435 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:09.173724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f215972c-1905-4590-9a1a-e1daaef7d435 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:09.174982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f215972c-1905-4590-9a1a-e1daaef7d435 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:09.175667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f215972c-1905-4590-9a1a-e1daaef7d435 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:09.176438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f215972c-1905-4590-9a1a-e1daaef7d435 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:09.317213 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e3a2962b-a05a-4847-b933-0ef446f831d7 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27" status: 204 len: 0 microversion: 2.1 time: 0.230963 Aug 18 11:43:09.319369 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2110/4039] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:43:09 2022] DELETE /compute/v2.1/servers/2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:43:09.567379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1720841874", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "53267c48-3217-41c6-a851-dd6e1521ee39"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:09.579826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f215972c-1905-4590-9a1a-e1daaef7d435 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:09.596512 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f215972c-1905-4590-9a1a-e1daaef7d435 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1522 microversion: 2.1 time: 0.438859 Aug 18 11:43:09.616349 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1930/4040] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:09 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:09.719190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] validate_networks() for [('53267c48-3217-41c6-a851-dd6e1521ee39', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:43:09.991513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c7efea7a-87f3-4754-bb26-adfd16fe051c tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:09.998157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c7efea7a-87f3-4754-bb26-adfd16fe051c tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:10.037227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c7efea7a-87f3-4754-bb26-adfd16fe051c tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:10.038367 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c7efea7a-87f3-4754-bb26-adfd16fe051c tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:10.039154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c7efea7a-87f3-4754-bb26-adfd16fe051c tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:10.039908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c7efea7a-87f3-4754-bb26-adfd16fe051c tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:10.051412 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c7efea7a-87f3-4754-bb26-adfd16fe051c tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:10.073767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c7efea7a-87f3-4754-bb26-adfd16fe051c tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:10.516912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c7efea7a-87f3-4754-bb26-adfd16fe051c tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:10.530489 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c7efea7a-87f3-4754-bb26-adfd16fe051c tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1350 microversion: 2.1 time: 0.571733 Aug 18 11:43:10.531495 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1931/4041] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:09 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1350 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:43:10.552158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-727461733", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35c2c144-0e1f-4df1-91ac-3817d3ad3bfe"}], "security_groups": [{"name": "tempest-securitygroup--233070706"}], "key_name": "tempest-keypair-577785836", "user_data": "}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:10.576150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:10.966707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] validate_networks() for [('35c2c144-0e1f-4df1-91ac-3817d3ad3bfe', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:43:10.987843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:43:10.988952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:43:10.989859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:43:10.990662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:43:10.991410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:43:11.048608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:11.050213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:11.051185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:11.052565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:11.053084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:11.053563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:11.107406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Getting quotas for project d83400501e4a4f84a984b01b02bee8a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:43:11.120393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Getting quotas for user 59d2180ae68a4190803f531121a58cea and project d83400501e4a4f84a984b01b02bee8a7. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:43:11.148189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Going to run 2 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:43:11.153517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 4bf0808e-967c-4d32-9d4e-0282a5ae3302] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:43:11.227774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=4bf0808e-967c-4d32-9d4e-0282a5ae3302,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:43:11.318664 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-44e3e794-ad2b-46b1-adf2-261babab0234 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.766398 Aug 18 11:43:11.319932 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2111/4042] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:43:09 2022] POST /compute/v2.1/servers => generated 32 bytes in 1769 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 18 11:43:11.326985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-97c77399-1b34-4f2b-914c-4db898df5829 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:11.327971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-97c77399-1b34-4f2b-914c-4db898df5829 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:11.343113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97c77399-1b34-4f2b-914c-4db898df5829 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:11.344605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97c77399-1b34-4f2b-914c-4db898df5829 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:11.345065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97c77399-1b34-4f2b-914c-4db898df5829 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:11.345828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97c77399-1b34-4f2b-914c-4db898df5829 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:11.349510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97c77399-1b34-4f2b-914c-4db898df5829 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:11.350205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97c77399-1b34-4f2b-914c-4db898df5829 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:11.847996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-97c77399-1b34-4f2b-914c-4db898df5829 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:11.867634 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-97c77399-1b34-4f2b-914c-4db898df5829 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1522 microversion: 2.1 time: 0.545561 Aug 18 11:43:11.884810 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2112/4043] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:11 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1522 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:11.899945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-34f3e72b-d895-471a-bfe7-25afef0ee6a4 req-f7e2bdca-bd76-467a-b069-c068c92f1280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cf62232-2b1e-47fa-8743-8ddcf11b891e", "tag": "11027fa7-e822-45c3-a79b-db78ee3a31d4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:11.924696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-34f3e72b-d895-471a-bfe7-25afef0ee6a4 req-f7e2bdca-bd76-467a-b069-c068c92f1280 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:11.925973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-34f3e72b-d895-471a-bfe7-25afef0ee6a4 req-f7e2bdca-bd76-467a-b069-c068c92f1280 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:11.926653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-34f3e72b-d895-471a-bfe7-25afef0ee6a4 req-f7e2bdca-bd76-467a-b069-c068c92f1280 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:11.942836 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-34f3e72b-d895-471a-bfe7-25afef0ee6a4 req-f7e2bdca-bd76-467a-b069-c068c92f1280 service nova] Creating event network-changed:11027fa7-e822-45c3-a79b-db78ee3a31d4 for instance 8cf62232-2b1e-47fa-8743-8ddcf11b891e on n-h1-853611-3 Aug 18 11:43:11.950348 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-34f3e72b-d895-471a-bfe7-25afef0ee6a4 req-f7e2bdca-bd76-467a-b069-c068c92f1280 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063208 Aug 18 11:43:11.951728 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2113/4044] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:11.958024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b9df3126-adf8-4fc2-91f5-180605a1db15 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:11.964689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b9df3126-adf8-4fc2-91f5-180605a1db15 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:11.965850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b9df3126-adf8-4fc2-91f5-180605a1db15 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Searching by: {'deleted': False, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:11.984151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9df3126-adf8-4fc2-91f5-180605a1db15 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:11.985126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9df3126-adf8-4fc2-91f5-180605a1db15 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:11.987202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9df3126-adf8-4fc2-91f5-180605a1db15 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:11.989663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9df3126-adf8-4fc2-91f5-180605a1db15 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:11.994846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9df3126-adf8-4fc2-91f5-180605a1db15 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:11.996589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9df3126-adf8-4fc2-91f5-180605a1db15 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:12.041238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-b9df3126-adf8-4fc2-91f5-180605a1db15 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:12.085489 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b9df3126-adf8-4fc2-91f5-180605a1db15 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.131898 Aug 18 11:43:12.087237 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2114/4045] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 18 11:43:11 2022] GET /compute/v2.1/servers => generated 1335 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:12.096631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0ec869c8-0fb6-462b-af80-54f92147c1ed tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:12.097904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0ec869c8-0fb6-462b-af80-54f92147c1ed tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:12.108493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ec869c8-0fb6-462b-af80-54f92147c1ed tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:12.109429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ec869c8-0fb6-462b-af80-54f92147c1ed tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:12.110139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ec869c8-0fb6-462b-af80-54f92147c1ed tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:12.111264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ec869c8-0fb6-462b-af80-54f92147c1ed tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:12.114390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ec869c8-0fb6-462b-af80-54f92147c1ed tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:12.115622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ec869c8-0fb6-462b-af80-54f92147c1ed tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:13.021796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0ec869c8-0fb6-462b-af80-54f92147c1ed tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:13.030820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0ec869c8-0fb6-462b-af80-54f92147c1ed tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1350 microversion: 2.1 time: 0.938614 Aug 18 11:43:13.031749 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2115/4046] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:12 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1350 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:13.036098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f640dba6-3110-4d41-aaad-3378b6b3bfb2 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:13.036715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f640dba6-3110-4d41-aaad-3378b6b3bfb2 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:13.054860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f640dba6-3110-4d41-aaad-3378b6b3bfb2 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:13.055540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f640dba6-3110-4d41-aaad-3378b6b3bfb2 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:13.056010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f640dba6-3110-4d41-aaad-3378b6b3bfb2 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:13.057612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f640dba6-3110-4d41-aaad-3378b6b3bfb2 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:13.058136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f640dba6-3110-4d41-aaad-3378b6b3bfb2 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:13.058620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f640dba6-3110-4d41-aaad-3378b6b3bfb2 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:13.294735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f640dba6-3110-4d41-aaad-3378b6b3bfb2 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:13.304105 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f640dba6-3110-4d41-aaad-3378b6b3bfb2 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 200 len: 1270 microversion: 2.1 time: 0.271598 Aug 18 11:43:13.305011 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2116/4047] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:13 2022] GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 1270 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:13.310532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-28d92265-6101-470b-83fb-c51997a0efc7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:13.311530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-28d92265-6101-470b-83fb-c51997a0efc7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:13.319499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28d92265-6101-470b-83fb-c51997a0efc7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:13.320197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28d92265-6101-470b-83fb-c51997a0efc7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:13.320738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28d92265-6101-470b-83fb-c51997a0efc7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:13.321834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28d92265-6101-470b-83fb-c51997a0efc7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:13.324295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28d92265-6101-470b-83fb-c51997a0efc7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:13.333112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28d92265-6101-470b-83fb-c51997a0efc7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:13.728919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:13.869609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-28d92265-6101-470b-83fb-c51997a0efc7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:13.882540 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-28d92265-6101-470b-83fb-c51997a0efc7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1522 microversion: 2.1 time: 0.575596 Aug 18 11:43:13.883899 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2117/4048] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:13 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1522 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:14.057923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e807ad38-2b95-427f-af47-2523d8758ada tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:14.059508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e807ad38-2b95-427f-af47-2523d8758ada tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:14.087994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e807ad38-2b95-427f-af47-2523d8758ada tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:14.090531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e807ad38-2b95-427f-af47-2523d8758ada tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:14.093509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e807ad38-2b95-427f-af47-2523d8758ada tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:14.098177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e807ad38-2b95-427f-af47-2523d8758ada tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:14.099906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e807ad38-2b95-427f-af47-2523d8758ada tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:14.102106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e807ad38-2b95-427f-af47-2523d8758ada tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:14.181757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:43:14.182561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:43:14.183278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:43:14.184190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:43:14.184807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:43:14.208771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:14.211245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:14.212986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:14.214278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:14.215236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:14.216386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:14.277752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Getting quotas for project 104cfd007b1043239b1818d021f4b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:43:14.305529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Getting quotas for user 7646f45e2e054269b3d00ec53c883728 and project 104cfd007b1043239b1818d021f4b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:43:14.347900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:43:14.350268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:43:14.500086 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5ba97ce3-9d71-4c70-9f9b-013d2ed57915 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.955802 Aug 18 11:43:14.507837 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1932/4049] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:43:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 3964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:43:14.514249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-4b4e710c-6a1b-42f0-8b43-5a9bf4d0361a req-b62e7216-c473-4181-aad2-45ce82f03abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27", "name": "network-vif-deleted", "tag": "91c51f5e-72e3-4dfd-a974-a08dd441bc3e"}, {"server_uuid": "74f0209d-fc88-441f-aac1-d0dddf3a37a3", "name": "network-vif-deleted", "tag": "1c7afcd2-a135-4a72-8fba-dca32a306d4b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:14.545672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4b4e710c-6a1b-42f0-8b43-5a9bf4d0361a req-b62e7216-c473-4181-aad2-45ce82f03abb service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:14.547727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4b4e710c-6a1b-42f0-8b43-5a9bf4d0361a req-b62e7216-c473-4181-aad2-45ce82f03abb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:14.549994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4b4e710c-6a1b-42f0-8b43-5a9bf4d0361a req-b62e7216-c473-4181-aad2-45ce82f03abb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:14.575571 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-4b4e710c-6a1b-42f0-8b43-5a9bf4d0361a req-b62e7216-c473-4181-aad2-45ce82f03abb service nova] Creating event network-vif-deleted:91c51f5e-72e3-4dfd-a974-a08dd441bc3e for instance 2446ba8e-e30d-4e99-8d4c-ab29e9f5dd27 on n-h1-853611-3 Aug 18 11:43:14.588760 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-4b4e710c-6a1b-42f0-8b43-5a9bf4d0361a req-b62e7216-c473-4181-aad2-45ce82f03abb service nova] Creating event network-vif-deleted:1c7afcd2-a135-4a72-8fba-dca32a306d4b for instance 74f0209d-fc88-441f-aac1-d0dddf3a37a3 on n-h2-853611-3 Aug 18 11:43:14.611197 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-4b4e710c-6a1b-42f0-8b43-5a9bf4d0361a req-b62e7216-c473-4181-aad2-45ce82f03abb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.101017 Aug 18 11:43:14.612534 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1933/4050] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:14.630578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1258a847-feb6-418e-90f8-412fc6e84c72 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:14.632261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1258a847-feb6-418e-90f8-412fc6e84c72 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:14.646119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1258a847-feb6-418e-90f8-412fc6e84c72 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:14.648000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1258a847-feb6-418e-90f8-412fc6e84c72 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:14.649154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1258a847-feb6-418e-90f8-412fc6e84c72 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:14.652297 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1258a847-feb6-418e-90f8-412fc6e84c72 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:14.653594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1258a847-feb6-418e-90f8-412fc6e84c72 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:14.656461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1258a847-feb6-418e-90f8-412fc6e84c72 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:14.688477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e807ad38-2b95-427f-af47-2523d8758ada tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:14.703326 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e807ad38-2b95-427f-af47-2523d8758ada tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1350 microversion: 2.1 time: 0.654629 Aug 18 11:43:14.727535 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2118/4051] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:14 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1350 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:14.734629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-190ba1e1-c31c-414f-9b4e-19d41803d8c9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:14.735276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-190ba1e1-c31c-414f-9b4e-19d41803d8c9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:14.844681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-190ba1e1-c31c-414f-9b4e-19d41803d8c9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:14.867398 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-190ba1e1-c31c-414f-9b4e-19d41803d8c9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1236 microversion: 2.1 time: 0.142189 Aug 18 11:43:14.868436 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2119/4052] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:14 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1236 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:14.905747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4ea7293c-94ea-4a87-af77-c653592fe2e4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:14.906602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4ea7293c-94ea-4a87-af77-c653592fe2e4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:14.927595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ea7293c-94ea-4a87-af77-c653592fe2e4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:14.928586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ea7293c-94ea-4a87-af77-c653592fe2e4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:14.932419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ea7293c-94ea-4a87-af77-c653592fe2e4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:14.934097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ea7293c-94ea-4a87-af77-c653592fe2e4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:14.935781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ea7293c-94ea-4a87-af77-c653592fe2e4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:14.941308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ea7293c-94ea-4a87-af77-c653592fe2e4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:14.943992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1258a847-feb6-418e-90f8-412fc6e84c72 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:14.952109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:14.954533 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1258a847-feb6-418e-90f8-412fc6e84c72 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 200 len: 1276 microversion: 2.1 time: 0.339983 Aug 18 11:43:14.955150 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1934/4053] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:14 2022] GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 1276 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:15.450294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4ea7293c-94ea-4a87-af77-c653592fe2e4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:15.491749 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4ea7293c-94ea-4a87-af77-c653592fe2e4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1522 microversion: 2.1 time: 0.590234 Aug 18 11:43:15.512008 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2120/4054] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:14 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1522 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:15.732934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dc2b4ed9-c3ac-4fa6-83b1-5ff8f5aaf490 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:15.735675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dc2b4ed9-c3ac-4fa6-83b1-5ff8f5aaf490 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:15.770106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc2b4ed9-c3ac-4fa6-83b1-5ff8f5aaf490 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:15.783119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc2b4ed9-c3ac-4fa6-83b1-5ff8f5aaf490 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:15.785753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc2b4ed9-c3ac-4fa6-83b1-5ff8f5aaf490 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:15.789204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc2b4ed9-c3ac-4fa6-83b1-5ff8f5aaf490 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:15.790349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc2b4ed9-c3ac-4fa6-83b1-5ff8f5aaf490 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:15.791163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc2b4ed9-c3ac-4fa6-83b1-5ff8f5aaf490 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:15.904111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec3d86db-0a2b-40ab-a4c6-1661e907cf2a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:15.904844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ec3d86db-0a2b-40ab-a4c6-1661e907cf2a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:15.920133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec3d86db-0a2b-40ab-a4c6-1661e907cf2a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:15.924785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec3d86db-0a2b-40ab-a4c6-1661e907cf2a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:15.926851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec3d86db-0a2b-40ab-a4c6-1661e907cf2a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:15.927762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec3d86db-0a2b-40ab-a4c6-1661e907cf2a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:15.928703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec3d86db-0a2b-40ab-a4c6-1661e907cf2a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:15.943758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec3d86db-0a2b-40ab-a4c6-1661e907cf2a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:16.096992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ec3d86db-0a2b-40ab-a4c6-1661e907cf2a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:16.130795 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ec3d86db-0a2b-40ab-a4c6-1661e907cf2a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1240 microversion: 2.1 time: 0.231046 Aug 18 11:43:16.136264 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2121/4055] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:15 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1240 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:16.141433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ca2e2591-49c9-4e00-b2df-ac5bccce9c75 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:16.145468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ca2e2591-49c9-4e00-b2df-ac5bccce9c75 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:16.162988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca2e2591-49c9-4e00-b2df-ac5bccce9c75 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:16.163807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca2e2591-49c9-4e00-b2df-ac5bccce9c75 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:16.164434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca2e2591-49c9-4e00-b2df-ac5bccce9c75 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:16.166017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca2e2591-49c9-4e00-b2df-ac5bccce9c75 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:16.166712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca2e2591-49c9-4e00-b2df-ac5bccce9c75 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:16.167410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca2e2591-49c9-4e00-b2df-ac5bccce9c75 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:16.558474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ca2e2591-49c9-4e00-b2df-ac5bccce9c75 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:16.578309 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ca2e2591-49c9-4e00-b2df-ac5bccce9c75 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 200 len: 1318 microversion: 2.1 time: 0.439644 Aug 18 11:43:16.604080 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2122/4056] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:16 2022] GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:16.777748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dc2b4ed9-c3ac-4fa6-83b1-5ff8f5aaf490 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:16.793142 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dc2b4ed9-c3ac-4fa6-83b1-5ff8f5aaf490 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1350 microversion: 2.1 time: 1.069904 Aug 18 11:43:16.812401 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1935/4057] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:15 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1350 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:16.834287 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-44948254-0d78-4796-95b6-28030e06f2dd tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:16.835972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-44948254-0d78-4796-95b6-28030e06f2dd tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:16.848835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44948254-0d78-4796-95b6-28030e06f2dd tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:16.850497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44948254-0d78-4796-95b6-28030e06f2dd tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:16.851555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44948254-0d78-4796-95b6-28030e06f2dd tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:16.853330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44948254-0d78-4796-95b6-28030e06f2dd tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:16.854576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44948254-0d78-4796-95b6-28030e06f2dd tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:16.855764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44948254-0d78-4796-95b6-28030e06f2dd tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:17.241313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f743c507-df70-4ed0-b226-9f928a250ac9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:17.242149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f743c507-df70-4ed0-b226-9f928a250ac9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:17.252523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f743c507-df70-4ed0-b226-9f928a250ac9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:17.253566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f743c507-df70-4ed0-b226-9f928a250ac9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:17.254991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f743c507-df70-4ed0-b226-9f928a250ac9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:17.256608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f743c507-df70-4ed0-b226-9f928a250ac9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:17.257563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f743c507-df70-4ed0-b226-9f928a250ac9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:17.261072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f743c507-df70-4ed0-b226-9f928a250ac9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:17.327888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f743c507-df70-4ed0-b226-9f928a250ac9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:43:17.638410 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f743c507-df70-4ed0-b226-9f928a250ac9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 204 len: 0 microversion: 2.42 time: 1.031600 Aug 18 11:43:17.642585 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2123/4058] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:43:16 2022] DELETE /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:43:17.710631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-44948254-0d78-4796-95b6-28030e06f2dd tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:17.732859 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-44948254-0d78-4796-95b6-28030e06f2dd tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1522 microversion: 2.1 time: 0.917698 Aug 18 11:43:17.736212 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1936/4059] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:16 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1522 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:17.778698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7a7f014e-6c9e-4a02-987e-5ef186d358eb tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:17.787067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7a7f014e-6c9e-4a02-987e-5ef186d358eb tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:17.830520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a7f014e-6c9e-4a02-987e-5ef186d358eb tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:17.831411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a7f014e-6c9e-4a02-987e-5ef186d358eb tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:17.837157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a7f014e-6c9e-4a02-987e-5ef186d358eb tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:17.841487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a7f014e-6c9e-4a02-987e-5ef186d358eb tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:17.843539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a7f014e-6c9e-4a02-987e-5ef186d358eb tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:17.844809 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a7f014e-6c9e-4a02-987e-5ef186d358eb tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:18.181077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-faefdf08-095f-4340-a3f1-8d22ddcc8c65 tempest-QuotasTestJSON-1762247130 tempest-QuotasTestJSON-1762247130-project] Calling method '.version_select at 0x7f519efc1b80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:18.442684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7a7f014e-6c9e-4a02-987e-5ef186d358eb tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:18.468089 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7a7f014e-6c9e-4a02-987e-5ef186d358eb tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1294 microversion: 2.1 time: 0.729692 Aug 18 11:43:18.472886 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1937/4060] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:17 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1294 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:18.480774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8ff39837-4c61-43af-80da-91263e9e7caa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:18.482863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8ff39837-4c61-43af-80da-91263e9e7caa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:18.503059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ff39837-4c61-43af-80da-91263e9e7caa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:18.504306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ff39837-4c61-43af-80da-91263e9e7caa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:18.505387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ff39837-4c61-43af-80da-91263e9e7caa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:18.507475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ff39837-4c61-43af-80da-91263e9e7caa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:18.508240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ff39837-4c61-43af-80da-91263e9e7caa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:18.510459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ff39837-4c61-43af-80da-91263e9e7caa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:18.658678 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-faefdf08-095f-4340-a3f1-8d22ddcc8c65 tempest-QuotasTestJSON-1762247130 tempest-QuotasTestJSON-1762247130-project] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/36893b480443418aa495c4aac7a6ed9f/defaults" status: 200 len: 371 microversion: 2.1 time: 1.013485 Aug 18 11:43:18.661642 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2124/4061] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:43:17 2022] GET /compute/v2.1/os-quota-sets/36893b480443418aa495c4aac7a6ed9f/defaults => generated 371 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:18.668365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-240adce5-d274-4f73-a814-8a7cfef68023 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:18.669486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-240adce5-d274-4f73-a814-8a7cfef68023 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:18.678716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-240adce5-d274-4f73-a814-8a7cfef68023 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:18.679228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-240adce5-d274-4f73-a814-8a7cfef68023 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:18.680284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-240adce5-d274-4f73-a814-8a7cfef68023 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:18.682722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-240adce5-d274-4f73-a814-8a7cfef68023 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:18.683736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-240adce5-d274-4f73-a814-8a7cfef68023 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:18.684370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-240adce5-d274-4f73-a814-8a7cfef68023 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:18.919015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8ff39837-4c61-43af-80da-91263e9e7caa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:18.928450 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8ff39837-4c61-43af-80da-91263e9e7caa tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 200 len: 1318 microversion: 2.1 time: 0.453552 Aug 18 11:43:18.929786 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1938/4062] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:18 2022] GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:18.936638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4e3890be-6d15-41a3-bd17-2b43d39db519 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:18.937498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4e3890be-6d15-41a3-bd17-2b43d39db519 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:18.945704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e3890be-6d15-41a3-bd17-2b43d39db519 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:18.947572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e3890be-6d15-41a3-bd17-2b43d39db519 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:18.948815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e3890be-6d15-41a3-bd17-2b43d39db519 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:18.949876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e3890be-6d15-41a3-bd17-2b43d39db519 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:18.950700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e3890be-6d15-41a3-bd17-2b43d39db519 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:18.951456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e3890be-6d15-41a3-bd17-2b43d39db519 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:19.029357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-240adce5-d274-4f73-a814-8a7cfef68023 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:19.049736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-240adce5-d274-4f73-a814-8a7cfef68023 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:19.053300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-240adce5-d274-4f73-a814-8a7cfef68023 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:19.057165 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-240adce5-d274-4f73-a814-8a7cfef68023 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 2960 microversion: 2.42 time: 0.392914 Aug 18 11:43:19.058271 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2125/4063] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:18 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 2960 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:19.068603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c4af9028-b16f-4ec9-bcaf-29afb41054c1 req-53aadb55-0367-4d60-92ab-cf538f758745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a4aef42-ba37-4d07-9cfb-798c9cab350e", "tag": "a50e0766-9746-4aff-b289-38c3ba8a396b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:19.088090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c4af9028-b16f-4ec9-bcaf-29afb41054c1 req-53aadb55-0367-4d60-92ab-cf538f758745 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:19.089638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c4af9028-b16f-4ec9-bcaf-29afb41054c1 req-53aadb55-0367-4d60-92ab-cf538f758745 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:19.090719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c4af9028-b16f-4ec9-bcaf-29afb41054c1 req-53aadb55-0367-4d60-92ab-cf538f758745 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:19.109255 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c4af9028-b16f-4ec9-bcaf-29afb41054c1 req-53aadb55-0367-4d60-92ab-cf538f758745 service nova] Creating event network-changed:a50e0766-9746-4aff-b289-38c3ba8a396b for instance 6a4aef42-ba37-4d07-9cfb-798c9cab350e on n-h2-853611-3 Aug 18 11:43:19.116660 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c4af9028-b16f-4ec9-bcaf-29afb41054c1 req-53aadb55-0367-4d60-92ab-cf538f758745 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056013 Aug 18 11:43:19.117555 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2126/4064] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:19.128705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d00282b-6fa4-46a9-80b4-6ebbe684e3bf tempest-QuotasTestJSON-1762247130 tempest-QuotasTestJSON-1762247130-project] Calling method '.version_select at 0x7f51b0c81d30>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:19.246321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4e3890be-6d15-41a3-bd17-2b43d39db519 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:19.264507 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4e3890be-6d15-41a3-bd17-2b43d39db519 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1350 microversion: 2.1 time: 0.332879 Aug 18 11:43:19.265220 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1939/4065] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:18 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1350 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:19.283178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-84d3fea0-87dd-40e6-bf69-bb0710a761b1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:19.284222 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-84d3fea0-87dd-40e6-bf69-bb0710a761b1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:19.291620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84d3fea0-87dd-40e6-bf69-bb0710a761b1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:19.292291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84d3fea0-87dd-40e6-bf69-bb0710a761b1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:19.292838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84d3fea0-87dd-40e6-bf69-bb0710a761b1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:19.293802 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84d3fea0-87dd-40e6-bf69-bb0710a761b1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:19.294373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84d3fea0-87dd-40e6-bf69-bb0710a761b1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:19.294950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84d3fea0-87dd-40e6-bf69-bb0710a761b1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:19.428542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=29 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:19.449225 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d00282b-6fa4-46a9-80b4-6ebbe684e3bf tempest-QuotasTestJSON-1762247130 tempest-QuotasTestJSON-1762247130-project] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/36893b480443418aa495c4aac7a6ed9f" status: 200 len: 371 microversion: 2.1 time: 0.329031 Aug 18 11:43:19.450460 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2127/4066] 10.222.0.73 () {58 vars in 1242 bytes} [Thu Aug 18 11:43:19 2022] GET /compute/v2.1/os-quota-sets/36893b480443418aa495c4aac7a6ed9f => generated 371 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:19.468328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-824399b3-9e01-4d20-8396-fc6962f2038d tempest-QuotasTestJSON-1762247130 tempest-QuotasTestJSON-1762247130-project] Calling method '.version_select at 0x7f519efc1310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:19.591736 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-824399b3-9e01-4d20-8396-fc6962f2038d tempest-QuotasTestJSON-1762247130 tempest-QuotasTestJSON-1762247130-project] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/36893b480443418aa495c4aac7a6ed9f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.127583 Aug 18 11:43:19.594313 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2128/4067] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:43:19 2022] GET /compute/v2.1/os-quota-sets/36893b480443418aa495c4aac7a6ed9f/defaults => generated 371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:43:19.605232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ac8ab1c-cb47-434d-9b80-d664b8ea8713 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:19.606691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9ac8ab1c-cb47-434d-9b80-d664b8ea8713 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:19.622752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ac8ab1c-cb47-434d-9b80-d664b8ea8713 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:19.623720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ac8ab1c-cb47-434d-9b80-d664b8ea8713 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:19.624436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-84d3fea0-87dd-40e6-bf69-bb0710a761b1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:19.625359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ac8ab1c-cb47-434d-9b80-d664b8ea8713 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:19.627183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ac8ab1c-cb47-434d-9b80-d664b8ea8713 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:19.628388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ac8ab1c-cb47-434d-9b80-d664b8ea8713 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:19.629188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ac8ab1c-cb47-434d-9b80-d664b8ea8713 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:19.639996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:19.646648 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-84d3fea0-87dd-40e6-bf69-bb0710a761b1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1522 microversion: 2.1 time: 0.379691 Aug 18 11:43:19.653183 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1940/4068] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:19 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:19.662179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dccb9402-74ad-41ce-90e9-de79062cebc0 tempest-QuotasTestJSON-1762247130 tempest-QuotasTestJSON-1762247130-project] Calling method '.version_select at 0x7f519f5c6c10>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:19.884033 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dccb9402-74ad-41ce-90e9-de79062cebc0 tempest-QuotasTestJSON-1762247130 tempest-QuotasTestJSON-1762247130-project] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/36893b480443418aa495c4aac7a6ed9f" status: 200 len: 371 microversion: 2.1 time: 0.227234 Aug 18 11:43:19.885597 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1941/4069] 10.222.0.73 () {58 vars in 1242 bytes} [Thu Aug 18 11:43:19 2022] GET /compute/v2.1/os-quota-sets/36893b480443418aa495c4aac7a6ed9f => generated 371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:19.896456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-a81c975c-8167-4e5b-8b1c-d68fba359044 req-ffefaed4-7f25-42bc-bd44-098e64dc89a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf62232-2b1e-47fa-8743-8ddcf11b891e", "name": "network-vif-plugged", "status": "completed", "tag": "11027fa7-e822-45c3-a79b-db78ee3a31d4"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:19.912999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a81c975c-8167-4e5b-8b1c-d68fba359044 req-ffefaed4-7f25-42bc-bd44-098e64dc89a3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:19.913590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a81c975c-8167-4e5b-8b1c-d68fba359044 req-ffefaed4-7f25-42bc-bd44-098e64dc89a3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:19.914042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a81c975c-8167-4e5b-8b1c-d68fba359044 req-ffefaed4-7f25-42bc-bd44-098e64dc89a3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:19.952638 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-a81c975c-8167-4e5b-8b1c-d68fba359044 req-ffefaed4-7f25-42bc-bd44-098e64dc89a3 service nova] Creating event network-vif-plugged:11027fa7-e822-45c3-a79b-db78ee3a31d4 for instance 8cf62232-2b1e-47fa-8743-8ddcf11b891e on n-h1-853611-3 Aug 18 11:43:19.962338 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-a81c975c-8167-4e5b-8b1c-d68fba359044 req-ffefaed4-7f25-42bc-bd44-098e64dc89a3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072676 Aug 18 11:43:19.963722 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1942/4070] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:19.970177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9ac8ab1c-cb47-434d-9b80-d664b8ea8713 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:19.975085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-044cd50e-e7e2-464a-aabb-cc5a5060dba1 tempest-QuotasTestJSON-1762247130 tempest-QuotasTestJSON-1762247130-project] Calling method '.version_select at 0x7f519f5cb040>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:19.998727 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9ac8ab1c-cb47-434d-9b80-d664b8ea8713 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1361 microversion: 2.1 time: 0.391980 Aug 18 11:43:20.001755 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2129/4071] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:19 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1361 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:20.010800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-50fe3628-61e2-432f-b3b9-843cc11ee534 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:20.011827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-50fe3628-61e2-432f-b3b9-843cc11ee534 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:20.035718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50fe3628-61e2-432f-b3b9-843cc11ee534 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:20.038715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50fe3628-61e2-432f-b3b9-843cc11ee534 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:20.041370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50fe3628-61e2-432f-b3b9-843cc11ee534 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:20.044581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50fe3628-61e2-432f-b3b9-843cc11ee534 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:20.045199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50fe3628-61e2-432f-b3b9-843cc11ee534 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:20.045800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50fe3628-61e2-432f-b3b9-843cc11ee534 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:20.182868 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-044cd50e-e7e2-464a-aabb-cc5a5060dba1 tempest-QuotasTestJSON-1762247130 tempest-QuotasTestJSON-1762247130-project] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/36893b480443418aa495c4aac7a6ed9f?user_id=d3a6e1a198204035979a923a96cc4c47" status: 200 len: 371 microversion: 2.1 time: 0.214863 Aug 18 11:43:20.208369 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1943/4072] 10.222.0.73 () {58 vars in 1323 bytes} [Thu Aug 18 11:43:19 2022] GET /compute/v2.1/os-quota-sets/36893b480443418aa495c4aac7a6ed9f?user_id=d3a6e1a198204035979a923a96cc4c47 => generated 371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:20.215870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-21141339-0b23-4cef-bfa9-2bda4573b5c9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:20.217070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-21141339-0b23-4cef-bfa9-2bda4573b5c9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:20.230860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21141339-0b23-4cef-bfa9-2bda4573b5c9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:20.232383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21141339-0b23-4cef-bfa9-2bda4573b5c9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:20.233331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21141339-0b23-4cef-bfa9-2bda4573b5c9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:20.235210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21141339-0b23-4cef-bfa9-2bda4573b5c9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:20.240054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21141339-0b23-4cef-bfa9-2bda4573b5c9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:20.241682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-21141339-0b23-4cef-bfa9-2bda4573b5c9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:20.767440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-21141339-0b23-4cef-bfa9-2bda4573b5c9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:20.778469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-21141339-0b23-4cef-bfa9-2bda4573b5c9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:20.780062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-21141339-0b23-4cef-bfa9-2bda4573b5c9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:20.781396 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-21141339-0b23-4cef-bfa9-2bda4573b5c9 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 2960 microversion: 2.42 time: 0.571596 Aug 18 11:43:20.781975 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1944/4073] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:20 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 2960 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:20.807057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2772ad44-7b3f-48a9-90bb-79101bc5d3de tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:20.808020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2772ad44-7b3f-48a9-90bb-79101bc5d3de tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:20.816329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2772ad44-7b3f-48a9-90bb-79101bc5d3de tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:20.817164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2772ad44-7b3f-48a9-90bb-79101bc5d3de tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:20.817790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2772ad44-7b3f-48a9-90bb-79101bc5d3de tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:20.818762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2772ad44-7b3f-48a9-90bb-79101bc5d3de tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:20.819414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2772ad44-7b3f-48a9-90bb-79101bc5d3de tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:20.820028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2772ad44-7b3f-48a9-90bb-79101bc5d3de tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:20.873876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-50fe3628-61e2-432f-b3b9-843cc11ee534 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:20.888689 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-50fe3628-61e2-432f-b3b9-843cc11ee534 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 200 len: 1318 microversion: 2.1 time: 0.884086 Aug 18 11:43:20.891265 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2130/4074] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:20 2022] GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 1318 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:20.898392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d90f6464-ab0e-4954-8fbb-32bc3ce4ed97 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:20.899570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d90f6464-ab0e-4954-8fbb-32bc3ce4ed97 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:20.909014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d90f6464-ab0e-4954-8fbb-32bc3ce4ed97 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:20.910316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d90f6464-ab0e-4954-8fbb-32bc3ce4ed97 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:20.912446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d90f6464-ab0e-4954-8fbb-32bc3ce4ed97 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:20.914531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d90f6464-ab0e-4954-8fbb-32bc3ce4ed97 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:20.916381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d90f6464-ab0e-4954-8fbb-32bc3ce4ed97 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:20.917095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d90f6464-ab0e-4954-8fbb-32bc3ce4ed97 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:21.342306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d90f6464-ab0e-4954-8fbb-32bc3ce4ed97 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:21.386389 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d90f6464-ab0e-4954-8fbb-32bc3ce4ed97 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1499 microversion: 2.1 time: 0.492566 Aug 18 11:43:21.387522 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2131/4075] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:20 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1499 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:21.396877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e97f2333-2bbd-4f07-8bc2-686add4f8387 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:21.404418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e97f2333-2bbd-4f07-8bc2-686add4f8387 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:21.417765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e97f2333-2bbd-4f07-8bc2-686add4f8387 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:21.418617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e97f2333-2bbd-4f07-8bc2-686add4f8387 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:21.419443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e97f2333-2bbd-4f07-8bc2-686add4f8387 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:21.420731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e97f2333-2bbd-4f07-8bc2-686add4f8387 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:21.421769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e97f2333-2bbd-4f07-8bc2-686add4f8387 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:21.422457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e97f2333-2bbd-4f07-8bc2-686add4f8387 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:21.492466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2772ad44-7b3f-48a9-90bb-79101bc5d3de tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:21.502118 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2772ad44-7b3f-48a9-90bb-79101bc5d3de tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1350 microversion: 2.1 time: 0.706362 Aug 18 11:43:21.502758 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1945/4076] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:20 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1350 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:21.508995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4941aa82-0a10-4b37-b530-59760aa22c96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:21.515186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4941aa82-0a10-4b37-b530-59760aa22c96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:21.516570 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4941aa82-0a10-4b37-b530-59760aa22c96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:21.523024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4941aa82-0a10-4b37-b530-59760aa22c96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:21.524414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4941aa82-0a10-4b37-b530-59760aa22c96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:21.525174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4941aa82-0a10-4b37-b530-59760aa22c96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:21.526345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4941aa82-0a10-4b37-b530-59760aa22c96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:21.527150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4941aa82-0a10-4b37-b530-59760aa22c96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:21.527879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4941aa82-0a10-4b37-b530-59760aa22c96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:21.574146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-4941aa82-0a10-4b37-b530-59760aa22c96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:21.620764 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4941aa82-0a10-4b37-b530-59760aa22c96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.116336 Aug 18 11:43:21.622108 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1946/4077] 10.222.0.73 () {58 vars in 1154 bytes} [Thu Aug 18 11:43:21 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:21.634777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-666d793d-2e27-4f95-8582-9a1372b65a3a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:21.642268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-666d793d-2e27-4f95-8582-9a1372b65a3a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:21.643645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-666d793d-2e27-4f95-8582-9a1372b65a3a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:21.644501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-666d793d-2e27-4f95-8582-9a1372b65a3a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:21.703829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-666d793d-2e27-4f95-8582-9a1372b65a3a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Going to try to start instance {{(pid=122209) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 18 11:43:21.798065 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-666d793d-2e27-4f95-8582-9a1372b65a3a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "POST /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887/action" status: 202 len: 0 microversion: 2.1 time: 0.167254 Aug 18 11:43:21.803738 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1947/4078] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:43:21 2022] POST /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:43:21.815835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7e8ddcd4-ae17-4223-989f-af26c1ed0956 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:21.819740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7e8ddcd4-ae17-4223-989f-af26c1ed0956 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:21.841502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7e8ddcd4-ae17-4223-989f-af26c1ed0956 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:21.842622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7e8ddcd4-ae17-4223-989f-af26c1ed0956 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:21.844059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7e8ddcd4-ae17-4223-989f-af26c1ed0956 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:21.846547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7e8ddcd4-ae17-4223-989f-af26c1ed0956 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:21.847856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7e8ddcd4-ae17-4223-989f-af26c1ed0956 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:21.850808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7e8ddcd4-ae17-4223-989f-af26c1ed0956 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:21.934384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e97f2333-2bbd-4f07-8bc2-686add4f8387 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:21.949769 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e97f2333-2bbd-4f07-8bc2-686add4f8387 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1361 microversion: 2.1 time: 0.560846 Aug 18 11:43:21.952448 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2132/4079] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:21 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1361 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:21.970629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3deba183-53ab-4025-8b15-7baf864f15cf tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:21.971576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3deba183-53ab-4025-8b15-7baf864f15cf tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:21.991950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3deba183-53ab-4025-8b15-7baf864f15cf tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:21.993350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3deba183-53ab-4025-8b15-7baf864f15cf tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:21.994052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3deba183-53ab-4025-8b15-7baf864f15cf tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:21.995057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3deba183-53ab-4025-8b15-7baf864f15cf tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:21.995793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3deba183-53ab-4025-8b15-7baf864f15cf tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:21.996466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3deba183-53ab-4025-8b15-7baf864f15cf tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:22.026123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=18 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:22.699092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7e8ddcd4-ae17-4223-989f-af26c1ed0956 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:22.717168 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7e8ddcd4-ae17-4223-989f-af26c1ed0956 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1508 microversion: 2.1 time: 0.911156 Aug 18 11:43:22.718285 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1948/4080] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:21 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1508 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:22.723196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8d4f09eb-bbd4-40c6-b6d6-0f4f2c60cee6 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:22.723844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8d4f09eb-bbd4-40c6-b6d6-0f4f2c60cee6 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:22.748564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d4f09eb-bbd4-40c6-b6d6-0f4f2c60cee6 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:22.749005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d4f09eb-bbd4-40c6-b6d6-0f4f2c60cee6 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:22.749593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d4f09eb-bbd4-40c6-b6d6-0f4f2c60cee6 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:22.751347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d4f09eb-bbd4-40c6-b6d6-0f4f2c60cee6 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:22.752303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d4f09eb-bbd4-40c6-b6d6-0f4f2c60cee6 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:22.755513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8d4f09eb-bbd4-40c6-b6d6-0f4f2c60cee6 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:23.072463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3deba183-53ab-4025-8b15-7baf864f15cf tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:23.098578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3deba183-53ab-4025-8b15-7baf864f15cf tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:23.101403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3deba183-53ab-4025-8b15-7baf864f15cf tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:23.104886 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3deba183-53ab-4025-8b15-7baf864f15cf tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 2960 microversion: 2.42 time: 1.151161 Aug 18 11:43:23.124880 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2133/4081] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:21 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 2960 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:23.131838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-872315fc-7d59-4c78-a02f-a7a44a34ccc5 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:23.135274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-872315fc-7d59-4c78-a02f-a7a44a34ccc5 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:23.143063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-872315fc-7d59-4c78-a02f-a7a44a34ccc5 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:23.144061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-872315fc-7d59-4c78-a02f-a7a44a34ccc5 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:23.144756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-872315fc-7d59-4c78-a02f-a7a44a34ccc5 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:23.145739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-872315fc-7d59-4c78-a02f-a7a44a34ccc5 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:23.146501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-872315fc-7d59-4c78-a02f-a7a44a34ccc5 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:23.147183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-872315fc-7d59-4c78-a02f-a7a44a34ccc5 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:23.881779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8d4f09eb-bbd4-40c6-b6d6-0f4f2c60cee6 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:23.900001 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8d4f09eb-bbd4-40c6-b6d6-0f4f2c60cee6 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 200 len: 1318 microversion: 2.1 time: 1.179005 Aug 18 11:43:23.901034 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1949/4082] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:22 2022] GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 1318 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:23.906037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-adc40a18-2b89-4d8e-97ad-f07bdaf2ba4d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:23.906714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-adc40a18-2b89-4d8e-97ad-f07bdaf2ba4d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:23.926368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-adc40a18-2b89-4d8e-97ad-f07bdaf2ba4d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:23.926924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-adc40a18-2b89-4d8e-97ad-f07bdaf2ba4d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:23.927385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-adc40a18-2b89-4d8e-97ad-f07bdaf2ba4d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:23.928174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-adc40a18-2b89-4d8e-97ad-f07bdaf2ba4d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:23.928662 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-adc40a18-2b89-4d8e-97ad-f07bdaf2ba4d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:23.929114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-adc40a18-2b89-4d8e-97ad-f07bdaf2ba4d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:24.040007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-872315fc-7d59-4c78-a02f-a7a44a34ccc5 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:24.064034 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-872315fc-7d59-4c78-a02f-a7a44a34ccc5 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1540 microversion: 2.1 time: 0.940852 Aug 18 11:43:24.065162 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2134/4083] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:23 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1540 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:24.072997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a8bdfc72-b09a-4924-9112-48b25ce24b59 req-7ccf0cd1-13cd-44dd-8b5b-dd5140ead3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-unplugged", "status": "completed", "tag": "cd3590e3-c7bc-46ed-9406-3be3fdd8f424"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:24.092658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a8bdfc72-b09a-4924-9112-48b25ce24b59 req-7ccf0cd1-13cd-44dd-8b5b-dd5140ead3b3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:24.093449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a8bdfc72-b09a-4924-9112-48b25ce24b59 req-7ccf0cd1-13cd-44dd-8b5b-dd5140ead3b3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:24.095171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a8bdfc72-b09a-4924-9112-48b25ce24b59 req-7ccf0cd1-13cd-44dd-8b5b-dd5140ead3b3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:24.109776 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a8bdfc72-b09a-4924-9112-48b25ce24b59 req-7ccf0cd1-13cd-44dd-8b5b-dd5140ead3b3 service nova] Creating event network-vif-unplugged:cd3590e3-c7bc-46ed-9406-3be3fdd8f424 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:43:24.118708 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a8bdfc72-b09a-4924-9112-48b25ce24b59 req-7ccf0cd1-13cd-44dd-8b5b-dd5140ead3b3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051341 Aug 18 11:43:24.121030 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2135/4084] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:24.151761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cdeb8fb1-0477-4c26-9224-408d6177d500 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:24.154326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cdeb8fb1-0477-4c26-9224-408d6177d500 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:24.175231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdeb8fb1-0477-4c26-9224-408d6177d500 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:24.176339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdeb8fb1-0477-4c26-9224-408d6177d500 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:24.184477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdeb8fb1-0477-4c26-9224-408d6177d500 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:24.187570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdeb8fb1-0477-4c26-9224-408d6177d500 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:24.188068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdeb8fb1-0477-4c26-9224-408d6177d500 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:24.188718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdeb8fb1-0477-4c26-9224-408d6177d500 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:24.545631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cdeb8fb1-0477-4c26-9224-408d6177d500 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:24.583935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-adc40a18-2b89-4d8e-97ad-f07bdaf2ba4d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:24.593519 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cdeb8fb1-0477-4c26-9224-408d6177d500 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1508 microversion: 2.1 time: 0.469753 Aug 18 11:43:24.594177 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2136/4085] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:24 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1508 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:24.608079 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-adc40a18-2b89-4d8e-97ad-f07bdaf2ba4d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1361 microversion: 2.1 time: 0.703983 Aug 18 11:43:24.611577 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1950/4086] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:23 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1361 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:24.612579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2020836c-9b6d-49f1-9853-a74ab9829d33 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:24.613096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2020836c-9b6d-49f1-9853-a74ab9829d33 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:24.628913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cedc0c47-8103-4239-936e-c037d2849ef0 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:24.632476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cedc0c47-8103-4239-936e-c037d2849ef0 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:24.636491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2020836c-9b6d-49f1-9853-a74ab9829d33 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:24.637006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2020836c-9b6d-49f1-9853-a74ab9829d33 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:24.637458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2020836c-9b6d-49f1-9853-a74ab9829d33 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:24.638189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2020836c-9b6d-49f1-9853-a74ab9829d33 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:24.638680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2020836c-9b6d-49f1-9853-a74ab9829d33 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:24.650798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2020836c-9b6d-49f1-9853-a74ab9829d33 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:24.654581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cedc0c47-8103-4239-936e-c037d2849ef0 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:24.658310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cedc0c47-8103-4239-936e-c037d2849ef0 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:24.664958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cedc0c47-8103-4239-936e-c037d2849ef0 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:24.667275 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cedc0c47-8103-4239-936e-c037d2849ef0 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:24.668553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cedc0c47-8103-4239-936e-c037d2849ef0 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:24.669578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cedc0c47-8103-4239-936e-c037d2849ef0 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:24.869610 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2020836c-9b6d-49f1-9853-a74ab9829d33 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.274267 Aug 18 11:43:24.870268 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2137/4087] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:43:24 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:24.882855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9fb645fa-2af3-4f72-9254-4e777c63aa87 req-997aa441-31a8-4e0c-8205-1b71f430a619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bf0808e-967c-4d32-9d4e-0282a5ae3302", "tag": "edfa1aee-f401-4b2f-b16f-78bcd45601a8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:24.909550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9fb645fa-2af3-4f72-9254-4e777c63aa87 req-997aa441-31a8-4e0c-8205-1b71f430a619 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:24.910054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9fb645fa-2af3-4f72-9254-4e777c63aa87 req-997aa441-31a8-4e0c-8205-1b71f430a619 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:24.910517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9fb645fa-2af3-4f72-9254-4e777c63aa87 req-997aa441-31a8-4e0c-8205-1b71f430a619 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:24.924634 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9fb645fa-2af3-4f72-9254-4e777c63aa87 req-997aa441-31a8-4e0c-8205-1b71f430a619 service nova] Creating event network-changed:edfa1aee-f401-4b2f-b16f-78bcd45601a8 for instance 4bf0808e-967c-4d32-9d4e-0282a5ae3302 on n-h2-853611-3 Aug 18 11:43:24.934297 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9fb645fa-2af3-4f72-9254-4e777c63aa87 req-997aa441-31a8-4e0c-8205-1b71f430a619 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054962 Aug 18 11:43:24.935018 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2138/4088] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:24.941570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-35730a7f-6cb2-439f-aaf1-19ef6173f266 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:24.942979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-35730a7f-6cb2-439f-aaf1-19ef6173f266 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:24.951237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35730a7f-6cb2-439f-aaf1-19ef6173f266 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:24.952720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35730a7f-6cb2-439f-aaf1-19ef6173f266 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:24.953447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35730a7f-6cb2-439f-aaf1-19ef6173f266 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:24.954371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35730a7f-6cb2-439f-aaf1-19ef6173f266 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:24.955031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35730a7f-6cb2-439f-aaf1-19ef6173f266 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:24.955683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35730a7f-6cb2-439f-aaf1-19ef6173f266 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:25.953329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-35730a7f-6cb2-439f-aaf1-19ef6173f266 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:25.969494 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-35730a7f-6cb2-439f-aaf1-19ef6173f266 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 200 len: 1318 microversion: 2.1 time: 1.032513 Aug 18 11:43:25.987908 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2139/4089] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:24 2022] GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 1318 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:26.036441 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cedc0c47-8103-4239-936e-c037d2849ef0 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:26.057377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cedc0c47-8103-4239-936e-c037d2849ef0 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:26.063116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cedc0c47-8103-4239-936e-c037d2849ef0 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:26.066245 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cedc0c47-8103-4239-936e-c037d2849ef0 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 2939 microversion: 2.42 time: 1.452575 Aug 18 11:43:26.095733 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1951/4090] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:24 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 2939 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:26.100995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-635173c1-5cd5-4749-8cd8-1878d511106e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:26.101648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-635173c1-5cd5-4749-8cd8-1878d511106e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:26.110067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-635173c1-5cd5-4749-8cd8-1878d511106e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:26.110594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-635173c1-5cd5-4749-8cd8-1878d511106e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:26.111040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-635173c1-5cd5-4749-8cd8-1878d511106e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:26.111765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-635173c1-5cd5-4749-8cd8-1878d511106e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:26.112226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-635173c1-5cd5-4749-8cd8-1878d511106e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:26.112656 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-635173c1-5cd5-4749-8cd8-1878d511106e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:26.389305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ee4324e5-d2e1-42bb-a542-cecfbdde1297 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] Action: 'create', calling method: .version_select at 0x7f519f012d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2093527118", "metadata": {"Type": "work"}}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:26.853995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-635173c1-5cd5-4749-8cd8-1878d511106e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:26.876936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:26.911395 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-635173c1-5cd5-4749-8cd8-1878d511106e tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1508 microversion: 2.1 time: 0.814012 Aug 18 11:43:26.912833 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1952/4091] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:26 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1508 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:26.951161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-138c0fec-2d0c-44b1-886d-68ad85657fbc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:26.952688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-138c0fec-2d0c-44b1-886d-68ad85657fbc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:26.966617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-138c0fec-2d0c-44b1-886d-68ad85657fbc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:26.967869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-138c0fec-2d0c-44b1-886d-68ad85657fbc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:26.968927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-138c0fec-2d0c-44b1-886d-68ad85657fbc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:26.970507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-138c0fec-2d0c-44b1-886d-68ad85657fbc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:26.971953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-138c0fec-2d0c-44b1-886d-68ad85657fbc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:26.973026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-138c0fec-2d0c-44b1-886d-68ad85657fbc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:27.223240 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ee4324e5-d2e1-42bb-a542-cecfbdde1297 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.232831 Aug 18 11:43:27.234478 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2140/4092] 10.222.0.73 () {60 vars in 1156 bytes} [Thu Aug 18 11:43:25 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1236 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 11:43:27.234478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-898c1fc3-6502-4b48-8170-54f3c8fa99f3 req-6e011b71-4a95-42e0-9639-318f1a08715b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-unplugged", "status": "completed", "tag": "b6b82b42-049e-4313-85b7-b7b6ccd6e554"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:27.255837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:27.264250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-898c1fc3-6502-4b48-8170-54f3c8fa99f3 req-6e011b71-4a95-42e0-9639-318f1a08715b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:27.264732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-898c1fc3-6502-4b48-8170-54f3c8fa99f3 req-6e011b71-4a95-42e0-9639-318f1a08715b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:27.268969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-898c1fc3-6502-4b48-8170-54f3c8fa99f3 req-6e011b71-4a95-42e0-9639-318f1a08715b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:27.338470 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-898c1fc3-6502-4b48-8170-54f3c8fa99f3 req-6e011b71-4a95-42e0-9639-318f1a08715b service nova] Creating event network-vif-unplugged:b6b82b42-049e-4313-85b7-b7b6ccd6e554 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:43:27.353232 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-898c1fc3-6502-4b48-8170-54f3c8fa99f3 req-6e011b71-4a95-42e0-9639-318f1a08715b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126248 Aug 18 11:43:27.355493 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2141/4093] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:27.369749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-318bda78-4c8c-49f7-9c92-82aad20e451b tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:27.371460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-318bda78-4c8c-49f7-9c92-82aad20e451b tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:27.387371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-318bda78-4c8c-49f7-9c92-82aad20e451b tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:27.389247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-318bda78-4c8c-49f7-9c92-82aad20e451b tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:27.390420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-318bda78-4c8c-49f7-9c92-82aad20e451b tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:27.392206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-318bda78-4c8c-49f7-9c92-82aad20e451b tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:27.393655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-318bda78-4c8c-49f7-9c92-82aad20e451b tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:27.395964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-318bda78-4c8c-49f7-9c92-82aad20e451b tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:27.788035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-138c0fec-2d0c-44b1-886d-68ad85657fbc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:27.797082 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-138c0fec-2d0c-44b1-886d-68ad85657fbc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1361 microversion: 2.1 time: 0.867760 Aug 18 11:43:27.798960 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1953/4094] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:26 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1361 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:27.803915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-28c0886a-b7f0-4d41-a3ff-0d2e55c8c8f5 req-94a513ad-2723-490f-b53a-1d9dbdf35afe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f554895-d3bd-4694-ad7a-1f23d21ed51a", "tag": "8fd6c4cd-227d-4d50-846f-b99223c530b6"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:27.814146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-28c0886a-b7f0-4d41-a3ff-0d2e55c8c8f5 req-94a513ad-2723-490f-b53a-1d9dbdf35afe service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:27.814972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-28c0886a-b7f0-4d41-a3ff-0d2e55c8c8f5 req-94a513ad-2723-490f-b53a-1d9dbdf35afe service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:27.815574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-28c0886a-b7f0-4d41-a3ff-0d2e55c8c8f5 req-94a513ad-2723-490f-b53a-1d9dbdf35afe service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:27.828605 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-28c0886a-b7f0-4d41-a3ff-0d2e55c8c8f5 req-94a513ad-2723-490f-b53a-1d9dbdf35afe service nova] Creating event network-changed:8fd6c4cd-227d-4d50-846f-b99223c530b6 for instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a on n-h1-853611-3 Aug 18 11:43:27.834370 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-28c0886a-b7f0-4d41-a3ff-0d2e55c8c8f5 req-94a513ad-2723-490f-b53a-1d9dbdf35afe service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033904 Aug 18 11:43:27.839835 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1954/4095] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:27.849048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-07ac6c52-c445-42ba-ac63-cc3859bf88a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:27.850064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-07ac6c52-c445-42ba-ac63-cc3859bf88a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:27.858694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ac6c52-c445-42ba-ac63-cc3859bf88a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:27.859484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ac6c52-c445-42ba-ac63-cc3859bf88a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:27.860108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ac6c52-c445-42ba-ac63-cc3859bf88a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:27.861005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ac6c52-c445-42ba-ac63-cc3859bf88a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:27.862691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ac6c52-c445-42ba-ac63-cc3859bf88a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:27.863447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07ac6c52-c445-42ba-ac63-cc3859bf88a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:27.975563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-318bda78-4c8c-49f7-9c92-82aad20e451b tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:27.992905 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-318bda78-4c8c-49f7-9c92-82aad20e451b tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 200 len: 1318 microversion: 2.1 time: 0.634165 Aug 18 11:43:28.003125 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2142/4096] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:27 2022] GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:28.003125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e79151ab-fabe-4198-8c1a-a8080b6aa855 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] Calling method '.version_select at 0x7f519f862ca0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:28.115246 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e79151ab-fabe-4198-8c1a-a8080b6aa855 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51" status: 200 len: 353 microversion: 2.1 time: 0.120124 Aug 18 11:43:28.116062 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2143/4097] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 11:43:27 2022] GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51 => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:28.123961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-07ac6c52-c445-42ba-ac63-cc3859bf88a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:28.127831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b67e1725-be20-48d3-a2e6-18e2d0af0262 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:28.128795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b67e1725-be20-48d3-a2e6-18e2d0af0262 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:28.139816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-07ac6c52-c445-42ba-ac63-cc3859bf88a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:28.142260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-07ac6c52-c445-42ba-ac63-cc3859bf88a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:28.144075 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-07ac6c52-c445-42ba-ac63-cc3859bf88a8 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 2918 microversion: 2.42 time: 0.302126 Aug 18 11:43:28.144258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b67e1725-be20-48d3-a2e6-18e2d0af0262 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:28.144745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b67e1725-be20-48d3-a2e6-18e2d0af0262 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:28.145196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b67e1725-be20-48d3-a2e6-18e2d0af0262 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:28.145767 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1955/4098] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:27 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 2918 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:28.159341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b67e1725-be20-48d3-a2e6-18e2d0af0262 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:28.159341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b67e1725-be20-48d3-a2e6-18e2d0af0262 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:28.159341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b67e1725-be20-48d3-a2e6-18e2d0af0262 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:28.834803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a5279701-ecb1-466d-8b4f-f61af8d698dc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:28.840196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a5279701-ecb1-466d-8b4f-f61af8d698dc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:28.858224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5279701-ecb1-466d-8b4f-f61af8d698dc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:28.859125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5279701-ecb1-466d-8b4f-f61af8d698dc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:28.859781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5279701-ecb1-466d-8b4f-f61af8d698dc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:28.861435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5279701-ecb1-466d-8b4f-f61af8d698dc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:28.863006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5279701-ecb1-466d-8b4f-f61af8d698dc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:28.864152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5279701-ecb1-466d-8b4f-f61af8d698dc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:29.016956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b67e1725-be20-48d3-a2e6-18e2d0af0262 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:29.035644 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b67e1725-be20-48d3-a2e6-18e2d0af0262 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1512 microversion: 2.1 time: 0.911757 Aug 18 11:43:29.036693 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2144/4099] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:28 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1512 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:29.042192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1558d9f4-fae0-4acc-99fc-aa6452e5a4ba tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:29.043285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1558d9f4-fae0-4acc-99fc-aa6452e5a4ba tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:29.052036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1558d9f4-fae0-4acc-99fc-aa6452e5a4ba tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:29.053017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1558d9f4-fae0-4acc-99fc-aa6452e5a4ba tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:29.055309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1558d9f4-fae0-4acc-99fc-aa6452e5a4ba tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:29.056528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1558d9f4-fae0-4acc-99fc-aa6452e5a4ba tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:29.057179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1558d9f4-fae0-4acc-99fc-aa6452e5a4ba tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:29.057946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1558d9f4-fae0-4acc-99fc-aa6452e5a4ba tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:29.360829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a5279701-ecb1-466d-8b4f-f61af8d698dc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:29.381969 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a5279701-ecb1-466d-8b4f-f61af8d698dc tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1361 microversion: 2.1 time: 0.562286 Aug 18 11:43:29.383776 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1956/4100] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:28 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1361 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:29.395363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-946aa963-8d91-46dc-8c6e-cb0f1d967c20 req-ec762a86-d810-43c2-93be-c37310581cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cf62232-2b1e-47fa-8743-8ddcf11b891e", "tag": "11027fa7-e822-45c3-a79b-db78ee3a31d4"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:29.430776 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-946aa963-8d91-46dc-8c6e-cb0f1d967c20 req-ec762a86-d810-43c2-93be-c37310581cd5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:29.432090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-946aa963-8d91-46dc-8c6e-cb0f1d967c20 req-ec762a86-d810-43c2-93be-c37310581cd5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:29.433580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-946aa963-8d91-46dc-8c6e-cb0f1d967c20 req-ec762a86-d810-43c2-93be-c37310581cd5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:29.448335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:29.465358 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-946aa963-8d91-46dc-8c6e-cb0f1d967c20 req-ec762a86-d810-43c2-93be-c37310581cd5 service nova] Creating event network-changed:11027fa7-e822-45c3-a79b-db78ee3a31d4 for instance 8cf62232-2b1e-47fa-8743-8ddcf11b891e on n-h1-853611-3 Aug 18 11:43:29.482096 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-946aa963-8d91-46dc-8c6e-cb0f1d967c20 req-ec762a86-d810-43c2-93be-c37310581cd5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089877 Aug 18 11:43:29.484804 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1957/4101] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:29.500085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-328c7637-261c-4578-a182-2f344fe3c827 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:29.518882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-328c7637-261c-4578-a182-2f344fe3c827 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:29.519997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.compute.servers [None req-328c7637-261c-4578-a182-2f344fe3c827 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Removing options 'limit' from query {{(pid=122209) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 18 11:43:29.524534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-328c7637-261c-4578-a182-2f344fe3c827 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:29.527210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-328c7637-261c-4578-a182-2f344fe3c827 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:29.528750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-328c7637-261c-4578-a182-2f344fe3c827 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:29.529836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-328c7637-261c-4578-a182-2f344fe3c827 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:29.531769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-328c7637-261c-4578-a182-2f344fe3c827 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:29.533317 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-328c7637-261c-4578-a182-2f344fe3c827 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:29.534961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-328c7637-261c-4578-a182-2f344fe3c827 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:29.539460 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-328c7637-261c-4578-a182-2f344fe3c827 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.050796 Aug 18 11:43:29.540976 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1958/4102] 10.222.0.73 () {58 vars in 1140 bytes} [Thu Aug 18 11:43:29 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:43:29.570184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2af24bf0-5279-4eb5-9901-8c9ad51e01fc tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] Calling method '.version_select at 0x7f519f3b0790>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:29.663463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1558d9f4-fae0-4acc-99fc-aa6452e5a4ba tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:29.694325 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1558d9f4-fae0-4acc-99fc-aa6452e5a4ba tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 200 len: 1318 microversion: 2.1 time: 0.655364 Aug 18 11:43:29.698037 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2145/4103] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:29 2022] GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 1318 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:29.720390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-09b85564-8f74-4838-992e-ebd41c672b7f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:29.720927 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2af24bf0-5279-4eb5-9901-8c9ad51e01fc tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51" status: 200 len: 354 microversion: 2.1 time: 0.160555 Aug 18 11:43:29.721994 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1959/4104] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 11:43:29 2022] GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51 => generated 354 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:29.724021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-09b85564-8f74-4838-992e-ebd41c672b7f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:29.749982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09b85564-8f74-4838-992e-ebd41c672b7f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:29.752457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-ee48c01b-869c-46a5-aedf-f80c17db0698 req-a8cfae97-0501-40f9-a60f-e7f4d00db220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-unplugged", "status": "completed", "tag": "87e91856-1edc-454b-ad68-ad91d5cc3042"}, {"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-unplugged", "status": "completed", "tag": "a8cc0ae7-4375-4ddf-bae4-66fb1bc368e4"}, {"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-unplugged", "status": "completed", "tag": "e2a4d3da-f8cb-4b7f-8b3f-325a41f5e8de"}, {"server_uuid": "6a4aef42-ba37-4d07-9cfb-798c9cab350e", "name": "network-vif-plugged", "status": "completed", "tag": "a50e0766-9746-4aff-b289-38c3ba8a396b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:29.760154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09b85564-8f74-4838-992e-ebd41c672b7f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:29.762652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09b85564-8f74-4838-992e-ebd41c672b7f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:29.768015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09b85564-8f74-4838-992e-ebd41c672b7f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:29.785945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09b85564-8f74-4838-992e-ebd41c672b7f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:29.787521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09b85564-8f74-4838-992e-ebd41c672b7f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:29.794857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ee48c01b-869c-46a5-aedf-f80c17db0698 req-a8cfae97-0501-40f9-a60f-e7f4d00db220 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:29.795720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ee48c01b-869c-46a5-aedf-f80c17db0698 req-a8cfae97-0501-40f9-a60f-e7f4d00db220 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:29.796431 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ee48c01b-869c-46a5-aedf-f80c17db0698 req-a8cfae97-0501-40f9-a60f-e7f4d00db220 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:29.841139 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ee48c01b-869c-46a5-aedf-f80c17db0698 req-a8cfae97-0501-40f9-a60f-e7f4d00db220 service nova] Creating event network-vif-unplugged:87e91856-1edc-454b-ad68-ad91d5cc3042 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:43:29.842724 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ee48c01b-869c-46a5-aedf-f80c17db0698 req-a8cfae97-0501-40f9-a60f-e7f4d00db220 service nova] Creating event network-vif-unplugged:a8cc0ae7-4375-4ddf-bae4-66fb1bc368e4 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:43:29.843457 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ee48c01b-869c-46a5-aedf-f80c17db0698 req-a8cfae97-0501-40f9-a60f-e7f4d00db220 service nova] Creating event network-vif-unplugged:e2a4d3da-f8cb-4b7f-8b3f-325a41f5e8de for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:43:29.844213 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ee48c01b-869c-46a5-aedf-f80c17db0698 req-a8cfae97-0501-40f9-a60f-e7f4d00db220 service nova] Creating event network-vif-plugged:a50e0766-9746-4aff-b289-38c3ba8a396b for instance 6a4aef42-ba37-4d07-9cfb-798c9cab350e on n-h2-853611-3 Aug 18 11:43:29.862354 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-ee48c01b-869c-46a5-aedf-f80c17db0698 req-a8cfae97-0501-40f9-a60f-e7f4d00db220 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 702 microversion: 2.1 time: 0.121920 Aug 18 11:43:29.863276 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1960/4105] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 702 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:29.877543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3d3b483c-3fa4-44cb-b542-c50b2e09c504 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:29.879474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3d3b483c-3fa4-44cb-b542-c50b2e09c504 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:29.891733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d3b483c-3fa4-44cb-b542-c50b2e09c504 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:29.893181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d3b483c-3fa4-44cb-b542-c50b2e09c504 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:29.893937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d3b483c-3fa4-44cb-b542-c50b2e09c504 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:29.896419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d3b483c-3fa4-44cb-b542-c50b2e09c504 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:29.897129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d3b483c-3fa4-44cb-b542-c50b2e09c504 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:29.900319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d3b483c-3fa4-44cb-b542-c50b2e09c504 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:30.140077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=12 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:30.667742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-09b85564-8f74-4838-992e-ebd41c672b7f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:30.696924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-09b85564-8f74-4838-992e-ebd41c672b7f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:30.707943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-09b85564-8f74-4838-992e-ebd41c672b7f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:30.717502 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-09b85564-8f74-4838-992e-ebd41c672b7f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 2918 microversion: 2.42 time: 1.014081 Aug 18 11:43:30.719383 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2146/4106] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:29 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 2918 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:30.745719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-36959fea-56a8-4036-ae64-3b76375eb86b tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] Calling method '.version_select at 0x7f51b0c81550>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:30.952543 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-36959fea-56a8-4036-ae64-3b76375eb86b tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51" status: 200 len: 354 microversion: 2.1 time: 0.230934 Aug 18 11:43:30.953583 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2147/4107] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 11:43:30 2022] GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51 => generated 354 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:30.970853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6c7543f0-ed25-493e-84a8-644177cb96c8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:30.977057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6c7543f0-ed25-493e-84a8-644177cb96c8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:30.998873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c7543f0-ed25-493e-84a8-644177cb96c8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:31.000040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c7543f0-ed25-493e-84a8-644177cb96c8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:31.012233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c7543f0-ed25-493e-84a8-644177cb96c8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:31.015494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c7543f0-ed25-493e-84a8-644177cb96c8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:31.027226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c7543f0-ed25-493e-84a8-644177cb96c8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:31.028424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c7543f0-ed25-493e-84a8-644177cb96c8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:31.049011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3d3b483c-3fa4-44cb-b542-c50b2e09c504 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:31.064891 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3d3b483c-3fa4-44cb-b542-c50b2e09c504 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1512 microversion: 2.1 time: 1.199780 Aug 18 11:43:31.065525 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1961/4108] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:29 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1512 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:31.076878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7d8c7a1b-1a17-43a2-9f30-ca8ff02242b0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:31.081078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7d8c7a1b-1a17-43a2-9f30-ca8ff02242b0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:31.097893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d8c7a1b-1a17-43a2-9f30-ca8ff02242b0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:31.103303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d8c7a1b-1a17-43a2-9f30-ca8ff02242b0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:31.104318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d8c7a1b-1a17-43a2-9f30-ca8ff02242b0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:31.105358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d8c7a1b-1a17-43a2-9f30-ca8ff02242b0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:31.106030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d8c7a1b-1a17-43a2-9f30-ca8ff02242b0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:31.107272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d8c7a1b-1a17-43a2-9f30-ca8ff02242b0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:31.447112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6c7543f0-ed25-493e-84a8-644177cb96c8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:31.462168 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6c7543f0-ed25-493e-84a8-644177cb96c8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1361 microversion: 2.1 time: 0.506747 Aug 18 11:43:31.474648 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2148/4109] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:30 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1361 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:31.487606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-93c098ad-c99b-4bb2-9a1a-38dd972d870f tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] Calling method '.version_select at 0x7f519f977280>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:31.534301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=12 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:31.637389 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-93c098ad-c99b-4bb2-9a1a-38dd972d870f tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51" status: 202 len: 0 microversion: 2.1 time: 0.159736 Aug 18 11:43:31.638543 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2149/4110] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:43:31 2022] DELETE /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:43:31.649041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f4c73ed8-8ef3-4eb1-89f9-a62c79722114 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:31.652274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f4c73ed8-8ef3-4eb1-89f9-a62c79722114 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 60edd382-8eec-45d5-a90b-eeb908026fc8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:31.663192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7d8c7a1b-1a17-43a2-9f30-ca8ff02242b0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:31.673924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4c73ed8-8ef3-4eb1-89f9-a62c79722114 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:31.677013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4c73ed8-8ef3-4eb1-89f9-a62c79722114 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:31.677751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4c73ed8-8ef3-4eb1-89f9-a62c79722114 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:31.678803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4c73ed8-8ef3-4eb1-89f9-a62c79722114 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:31.681875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4c73ed8-8ef3-4eb1-89f9-a62c79722114 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:31.684739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4c73ed8-8ef3-4eb1-89f9-a62c79722114 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:31.699903 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7d8c7a1b-1a17-43a2-9f30-ca8ff02242b0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 200 len: 1318 microversion: 2.1 time: 0.631978 Aug 18 11:43:31.705022 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1962/4111] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:31 2022] GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:31.737921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8ae7279e-c639-4c2b-b9b8-c2c74a018224 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] Calling method '.version_select at 0x7f519f5be430>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:31.916482 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8ae7279e-c639-4c2b-b9b8-c2c74a018224 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51" status: 200 len: 353 microversion: 2.1 time: 0.207078 Aug 18 11:43:31.917415 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1963/4112] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 11:43:31 2022] GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51 => generated 353 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:31.939628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8bb097f9-6fc6-4588-9aec-62209e9de71d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:31.948706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8bb097f9-6fc6-4588-9aec-62209e9de71d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:31.968543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bb097f9-6fc6-4588-9aec-62209e9de71d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:31.969327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bb097f9-6fc6-4588-9aec-62209e9de71d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:31.971577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bb097f9-6fc6-4588-9aec-62209e9de71d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:31.978904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bb097f9-6fc6-4588-9aec-62209e9de71d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:31.983908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bb097f9-6fc6-4588-9aec-62209e9de71d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:31.991354 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8bb097f9-6fc6-4588-9aec-62209e9de71d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:32.232602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f4c73ed8-8ef3-4eb1-89f9-a62c79722114 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:32.245989 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f4c73ed8-8ef3-4eb1-89f9-a62c79722114 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8" status: 200 len: 1513 microversion: 2.1 time: 0.602732 Aug 18 11:43:32.247405 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2150/4113] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:31 2022] GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8 => generated 1513 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:32.281023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a28afde4-7ba4-4010-b143-9575dc9874c0 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:32.282455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a28afde4-7ba4-4010-b143-9575dc9874c0 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:32.315031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a28afde4-7ba4-4010-b143-9575dc9874c0 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:32.315719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a28afde4-7ba4-4010-b143-9575dc9874c0 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:32.316529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a28afde4-7ba4-4010-b143-9575dc9874c0 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:32.321276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a28afde4-7ba4-4010-b143-9575dc9874c0 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:32.322093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a28afde4-7ba4-4010-b143-9575dc9874c0 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:32.336570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a28afde4-7ba4-4010-b143-9575dc9874c0 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:32.938711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a28afde4-7ba4-4010-b143-9575dc9874c0 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:32.954284 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a28afde4-7ba4-4010-b143-9575dc9874c0 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1512 microversion: 2.1 time: 0.686279 Aug 18 11:43:32.955087 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2151/4114] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:32 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1512 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:32.979893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0411ba29-493d-4f4f-bacf-eb3690f73e17 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:32.980756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0411ba29-493d-4f4f-bacf-eb3690f73e17 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:32.989472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0411ba29-493d-4f4f-bacf-eb3690f73e17 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:32.989974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0411ba29-493d-4f4f-bacf-eb3690f73e17 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:32.990506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0411ba29-493d-4f4f-bacf-eb3690f73e17 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:32.994120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0411ba29-493d-4f4f-bacf-eb3690f73e17 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:32.997035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0411ba29-493d-4f4f-bacf-eb3690f73e17 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:32.997495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0411ba29-493d-4f4f-bacf-eb3690f73e17 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:33.052736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:33.455968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0411ba29-493d-4f4f-bacf-eb3690f73e17 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:33.467285 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0411ba29-493d-4f4f-bacf-eb3690f73e17 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1361 microversion: 2.1 time: 0.494694 Aug 18 11:43:33.468545 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2152/4115] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:32 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1361 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:33.474054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1b434d8-a8a4-4f10-9184-866eb7589465 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:33.475014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1b434d8-a8a4-4f10-9184-866eb7589465 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:33.500369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1b434d8-a8a4-4f10-9184-866eb7589465 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:33.501533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1b434d8-a8a4-4f10-9184-866eb7589465 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:33.502160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1b434d8-a8a4-4f10-9184-866eb7589465 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:33.503161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1b434d8-a8a4-4f10-9184-866eb7589465 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:33.509334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1b434d8-a8a4-4f10-9184-866eb7589465 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:33.510075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1b434d8-a8a4-4f10-9184-866eb7589465 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:33.866763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a1b434d8-a8a4-4f10-9184-866eb7589465 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:33.873280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8bb097f9-6fc6-4588-9aec-62209e9de71d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:33.894050 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1b434d8-a8a4-4f10-9184-866eb7589465 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 200 len: 1506 microversion: 2.1 time: 0.423609 Aug 18 11:43:33.899461 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2153/4116] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:33 2022] GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:33.907709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8bb097f9-6fc6-4588-9aec-62209e9de71d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:33.909057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8bb097f9-6fc6-4588-9aec-62209e9de71d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:33.911666 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8bb097f9-6fc6-4588-9aec-62209e9de71d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 2871 microversion: 2.42 time: 1.991478 Aug 18 11:43:33.912326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-29afa0a8-2158-4f1b-96cf-3607dd4e1a64 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] Calling method '.version_select at 0x7f519fcd6ca0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:33.913276 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1964/4117] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:31 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 2871 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:33.930158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b499214-a730-4ff9-8c7a-b5a0a069ee2a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:33.995349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5b499214-a730-4ff9-8c7a-b5a0a069ee2a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:33.997529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5b499214-a730-4ff9-8c7a-b5a0a069ee2a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:34.066946 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-29afa0a8-2158-4f1b-96cf-3607dd4e1a64 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51" status: 200 len: 353 microversion: 2.1 time: 0.165506 Aug 18 11:43:34.068352 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2154/4118] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 11:43:33 2022] GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51 => generated 353 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:34.075920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-6d2816aa-c70c-4b23-96c3-bccd178d0723 req-175a797d-ea7a-4c64-b434-14f0e8654a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf0808e-967c-4d32-9d4e-0282a5ae3302", "name": "network-vif-plugged", "status": "completed", "tag": "edfa1aee-f401-4b2f-b16f-78bcd45601a8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:34.121938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6d2816aa-c70c-4b23-96c3-bccd178d0723 req-175a797d-ea7a-4c64-b434-14f0e8654a60 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:34.123241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6d2816aa-c70c-4b23-96c3-bccd178d0723 req-175a797d-ea7a-4c64-b434-14f0e8654a60 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:34.124280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6d2816aa-c70c-4b23-96c3-bccd178d0723 req-175a797d-ea7a-4c64-b434-14f0e8654a60 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:34.172367 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6d2816aa-c70c-4b23-96c3-bccd178d0723 req-175a797d-ea7a-4c64-b434-14f0e8654a60 service nova] Creating event network-vif-plugged:edfa1aee-f401-4b2f-b16f-78bcd45601a8 for instance 4bf0808e-967c-4d32-9d4e-0282a5ae3302 on n-h2-853611-3 Aug 18 11:43:34.192345 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-6d2816aa-c70c-4b23-96c3-bccd178d0723 req-175a797d-ea7a-4c64-b434-14f0e8654a60 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122080 Aug 18 11:43:34.193977 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2155/4119] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:34.236224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2410d197-547d-4661-9a27-be9de927496e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:34.241860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2410d197-547d-4661-9a27-be9de927496e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 4bf0808e-967c-4d32-9d4e-0282a5ae3302] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:34.314408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2410d197-547d-4661-9a27-be9de927496e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:34.315794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2410d197-547d-4661-9a27-be9de927496e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:34.319639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2410d197-547d-4661-9a27-be9de927496e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:34.321430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2410d197-547d-4661-9a27-be9de927496e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:34.324530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2410d197-547d-4661-9a27-be9de927496e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:34.327477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2410d197-547d-4661-9a27-be9de927496e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:34.713638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b499214-a730-4ff9-8c7a-b5a0a069ee2a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:34.722985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b499214-a730-4ff9-8c7a-b5a0a069ee2a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:34.725678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b499214-a730-4ff9-8c7a-b5a0a069ee2a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:34.729272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b499214-a730-4ff9-8c7a-b5a0a069ee2a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:34.730112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b499214-a730-4ff9-8c7a-b5a0a069ee2a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:34.735016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b499214-a730-4ff9-8c7a-b5a0a069ee2a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:34.774614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2410d197-547d-4661-9a27-be9de927496e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:34.803538 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2410d197-547d-4661-9a27-be9de927496e tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302" status: 200 len: 1318 microversion: 2.1 time: 0.606870 Aug 18 11:43:34.807434 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2156/4120] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:34 2022] GET /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302 => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:34.818411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-90a62d17-c920-4f34-b189-407ae2efd7ca req-f0400537-c208-4338-b418-2373cec7559b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-deleted", "tag": "87e91856-1edc-454b-ad68-ad91d5cc3042"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:34.849447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-90a62d17-c920-4f34-b189-407ae2efd7ca req-f0400537-c208-4338-b418-2373cec7559b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:34.856482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-90a62d17-c920-4f34-b189-407ae2efd7ca req-f0400537-c208-4338-b418-2373cec7559b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:34.857652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-90a62d17-c920-4f34-b189-407ae2efd7ca req-f0400537-c208-4338-b418-2373cec7559b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:34.884671 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-90a62d17-c920-4f34-b189-407ae2efd7ca req-f0400537-c208-4338-b418-2373cec7559b service nova] Creating event network-vif-deleted:87e91856-1edc-454b-ad68-ad91d5cc3042 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:43:34.902262 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-90a62d17-c920-4f34-b189-407ae2efd7ca req-f0400537-c208-4338-b418-2373cec7559b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092347 Aug 18 11:43:34.908669 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2157/4121] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:34.927575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c3a3d20e-826e-4a5a-a8e6-064ae077b6a2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:34.936102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c3a3d20e-826e-4a5a-a8e6-064ae077b6a2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:34.952642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3a3d20e-826e-4a5a-a8e6-064ae077b6a2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:34.957224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3a3d20e-826e-4a5a-a8e6-064ae077b6a2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:34.960028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3a3d20e-826e-4a5a-a8e6-064ae077b6a2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:34.968245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3a3d20e-826e-4a5a-a8e6-064ae077b6a2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:34.970597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3a3d20e-826e-4a5a-a8e6-064ae077b6a2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:34.973877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3a3d20e-826e-4a5a-a8e6-064ae077b6a2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:35.065165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-5b499214-a730-4ff9-8c7a-b5a0a069ee2a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:35.277132 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5b499214-a730-4ff9-8c7a-b5a0a069ee2a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 1.359526 Aug 18 11:43:35.278993 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1965/4122] 10.222.0.73 () {58 vars in 1154 bytes} [Thu Aug 18 11:43:33 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:35.289462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa337882-18ef-41ab-89a7-22d1c3faae3b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:35.291593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fa337882-18ef-41ab-89a7-22d1c3faae3b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:35.318179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa337882-18ef-41ab-89a7-22d1c3faae3b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:35.320237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa337882-18ef-41ab-89a7-22d1c3faae3b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:35.321434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa337882-18ef-41ab-89a7-22d1c3faae3b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:35.323139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa337882-18ef-41ab-89a7-22d1c3faae3b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:35.324577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa337882-18ef-41ab-89a7-22d1c3faae3b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:35.325754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa337882-18ef-41ab-89a7-22d1c3faae3b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:35.479696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c3a3d20e-826e-4a5a-a8e6-064ae077b6a2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:35.502489 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c3a3d20e-826e-4a5a-a8e6-064ae077b6a2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1361 microversion: 2.1 time: 0.591218 Aug 18 11:43:35.504348 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2158/4123] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:34 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1361 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:35.509663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2ec30f8d-82a2-43b4-9318-b0f4e8b50405 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] Calling method '.version_select at 0x7f519f012dc0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:35.668986 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2ec30f8d-82a2-43b4-9318-b0f4e8b50405 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51" status: 200 len: 353 microversion: 2.1 time: 0.163202 Aug 18 11:43:35.669957 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2159/4124] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 11:43:35 2022] GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51 => generated 353 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:35.676622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b25246d1-fab7-4989-bc15-c4696d4a7d52 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:35.684109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b25246d1-fab7-4989-bc15-c4696d4a7d52 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:35.712232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b25246d1-fab7-4989-bc15-c4696d4a7d52 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:35.712232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b25246d1-fab7-4989-bc15-c4696d4a7d52 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:35.712232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b25246d1-fab7-4989-bc15-c4696d4a7d52 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:35.720000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b25246d1-fab7-4989-bc15-c4696d4a7d52 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:35.721103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b25246d1-fab7-4989-bc15-c4696d4a7d52 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:35.722057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b25246d1-fab7-4989-bc15-c4696d4a7d52 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:35.998132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fa337882-18ef-41ab-89a7-22d1c3faae3b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:36.093359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fa337882-18ef-41ab-89a7-22d1c3faae3b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:36.110551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fa337882-18ef-41ab-89a7-22d1c3faae3b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:36.120556 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fa337882-18ef-41ab-89a7-22d1c3faae3b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 2532 microversion: 2.42 time: 0.836614 Aug 18 11:43:36.124338 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1966/4125] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:35 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 2532 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:36.149746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-218af3f8-3f6c-47fd-b318-a30588a61e6a tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:36.151340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-218af3f8-3f6c-47fd-b318-a30588a61e6a tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 4bf0808e-967c-4d32-9d4e-0282a5ae3302] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:36.187724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218af3f8-3f6c-47fd-b318-a30588a61e6a tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:36.193995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218af3f8-3f6c-47fd-b318-a30588a61e6a tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:36.195460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218af3f8-3f6c-47fd-b318-a30588a61e6a tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:36.196844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218af3f8-3f6c-47fd-b318-a30588a61e6a tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:36.197698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218af3f8-3f6c-47fd-b318-a30588a61e6a tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:36.198371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-218af3f8-3f6c-47fd-b318-a30588a61e6a tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:36.411795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b25246d1-fab7-4989-bc15-c4696d4a7d52 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:36.431416 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b25246d1-fab7-4989-bc15-c4696d4a7d52 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1512 microversion: 2.1 time: 0.757387 Aug 18 11:43:36.432924 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2160/4126] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:35 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1512 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:36.613250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-467596608", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:36.736200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-218af3f8-3f6c-47fd-b318-a30588a61e6a tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:36.763716 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-218af3f8-3f6c-47fd-b318-a30588a61e6a tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302" status: 200 len: 1506 microversion: 2.1 time: 0.627491 Aug 18 11:43:36.779593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] validate_networks() for [('c201add2-2905-4a42-a119-5f0f7b3c5bb7', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:43:36.786132 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1967/4127] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:36 2022] GET /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302 => generated 1506 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:36.792217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-583bfdfd-797b-4ad0-abf4-35c90e991460 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:36.792859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-583bfdfd-797b-4ad0-abf4-35c90e991460 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 60edd382-8eec-45d5-a90b-eeb908026fc8] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:36.809049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-583bfdfd-797b-4ad0-abf4-35c90e991460 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:36.809556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-583bfdfd-797b-4ad0-abf4-35c90e991460 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:36.810231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-583bfdfd-797b-4ad0-abf4-35c90e991460 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:36.810780 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-583bfdfd-797b-4ad0-abf4-35c90e991460 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:36.811250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-583bfdfd-797b-4ad0-abf4-35c90e991460 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:36.811682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-583bfdfd-797b-4ad0-abf4-35c90e991460 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:37.311687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-583bfdfd-797b-4ad0-abf4-35c90e991460 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:37.346885 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-583bfdfd-797b-4ad0-abf4-35c90e991460 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8" status: 200 len: 1513 microversion: 2.1 time: 0.538698 Aug 18 11:43:37.365568 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1968/4128] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:36 2022] GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8 => generated 1513 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:37.372189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7b40c97b-7f13-478e-b060-45f650a9433d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:37.372829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7b40c97b-7f13-478e-b060-45f650a9433d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:37.398066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b40c97b-7f13-478e-b060-45f650a9433d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:37.398694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b40c97b-7f13-478e-b060-45f650a9433d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:37.399154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b40c97b-7f13-478e-b060-45f650a9433d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:37.399909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b40c97b-7f13-478e-b060-45f650a9433d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:37.400371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b40c97b-7f13-478e-b060-45f650a9433d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:37.400803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b40c97b-7f13-478e-b060-45f650a9433d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:37.863350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7b40c97b-7f13-478e-b060-45f650a9433d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:37.877261 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7b40c97b-7f13-478e-b060-45f650a9433d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1361 microversion: 2.1 time: 0.509425 Aug 18 11:43:37.884211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:43:37.884989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:43:37.885793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:43:37.886845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:43:37.887876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:43:37.899170 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1969/4129] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:37 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1361 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:37.907947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-72afe1f5-5fb6-4dc6-b497-81e820f52542 req-58bbd5fd-8982-425c-b65b-77fb9782d8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f554895-d3bd-4694-ad7a-1f23d21ed51a", "name": "network-vif-plugged", "status": "completed", "tag": "8fd6c4cd-227d-4d50-846f-b99223c530b6"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:37.922993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:37.923422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-72afe1f5-5fb6-4dc6-b497-81e820f52542 req-58bbd5fd-8982-425c-b65b-77fb9782d8b6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:37.924045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-72afe1f5-5fb6-4dc6-b497-81e820f52542 req-58bbd5fd-8982-425c-b65b-77fb9782d8b6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:37.924770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-72afe1f5-5fb6-4dc6-b497-81e820f52542 req-58bbd5fd-8982-425c-b65b-77fb9782d8b6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:37.925213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:37.926963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:37.929802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:37.932732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:37.934002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:37.942816 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-72afe1f5-5fb6-4dc6-b497-81e820f52542 req-58bbd5fd-8982-425c-b65b-77fb9782d8b6 service nova] Creating event network-vif-plugged:8fd6c4cd-227d-4d50-846f-b99223c530b6 for instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a on n-h1-853611-3 Aug 18 11:43:37.967702 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-72afe1f5-5fb6-4dc6-b497-81e820f52542 req-58bbd5fd-8982-425c-b65b-77fb9782d8b6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062453 Aug 18 11:43:37.971156 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1970/4130] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:37.982777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Getting quotas for project ac6fa3a212e84a2a9ffe62c094f5d89b. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:43:37.986325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-015e8396-3246-4d2f-837e-b5db50815ce1 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] Calling method '.version_select at 0x7f519fa5b9d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:37.990472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Getting quotas for user 50b563ab6ffa4fa5a51b955ee1ccb3b9 and project ac6fa3a212e84a2a9ffe62c094f5d89b. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:43:38.029587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:43:38.037715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:43:38.056620 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-015e8396-3246-4d2f-837e-b5db50815ce1 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] HTTP exception thrown: Volume c470436e-bc23-4836-92dd-1d18f12a4b51 could not be found. Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-015e8396-3246-4d2f-837e-b5db50815ce1 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] Request method failure captured: Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51 HTTP/1.1 Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXdM7AgTgtqEDMxqOE0qTvtY37SfK6rN74sgPNw_tj75FZvyA5Vn-kjx4d4pYJxc2lfrMX_PVvZNNeQmzf3KE4QqSN3qalqiS7cVqnD7td4qJx80lZeigLoUBkp1UhgXA8DY9E62IqsXw6lU-v3HQYVahUm1DJakcwS-cZi6i-g1Cc Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b3861be69a4140229d316dba031c19e2 Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-VolumesGetTestJSON-2019481973 Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b3861be69a4140229d316dba031c19e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b3861be69a4140229d316dba031c19e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b3861be69a4140229d316dba031c19e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b3861be69a4140229d316dba031c19e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-VolumesGetTestJSON-2019481973 Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b3861be69a4140229d316dba031c19e2 Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-VolumesGetTestJSON-2019481973 Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-VolumesGetTestJSON-2019481973-project Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 60a4463222894ce58e07ac401f36542e Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-VolumesGetTestJSON-2019481973-project Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: exception: Volume c470436e-bc23-4836-92dd-1d18f12a4b51 could not be found. Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'c470436e-bc23-4836-92dd-1d18f12a4b51'} Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c470436e-bc23-4836-92dd-1d18f12a4b51 could not be found. (HTTP 404) (Request-ID: req-94089201-ba1b-484f-a41b-e8ee518663ad) Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 11:43:38.059217 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c470436e-bc23-4836-92dd-1d18f12a4b51 could not be found. Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c470436e-bc23-4836-92dd-1d18f12a4b51 could not be found. Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c470436e-bc23-4836-92dd-1d18f12a4b51 could not be found. Aug 18 11:43:38.064860 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:43:38.071828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-015e8396-3246-4d2f-837e-b5db50815ce1 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] Returning 404 to user: Volume c470436e-bc23-4836-92dd-1d18f12a4b51 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:43:38.072944 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-015e8396-3246-4d2f-837e-b5db50815ce1 tempest-VolumesGetTestJSON-2019481973 tempest-VolumesGetTestJSON-2019481973-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51" status: 404 len: 109 microversion: 2.1 time: 0.099948 Aug 18 11:43:38.074476 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1971/4131] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 11:43:37 2022] GET /compute/v2.1/os-volumes/c470436e-bc23-4836-92dd-1d18f12a4b51 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:43:38.094648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c238c309-3b4a-45ca-a0af-8faefe807374 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:38.100144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c238c309-3b4a-45ca-a0af-8faefe807374 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 4bf0808e-967c-4d32-9d4e-0282a5ae3302] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:38.126206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c238c309-3b4a-45ca-a0af-8faefe807374 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:38.140532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c238c309-3b4a-45ca-a0af-8faefe807374 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:38.143810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c238c309-3b4a-45ca-a0af-8faefe807374 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:38.152133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c238c309-3b4a-45ca-a0af-8faefe807374 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:38.154037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c238c309-3b4a-45ca-a0af-8faefe807374 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:38.155059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c238c309-3b4a-45ca-a0af-8faefe807374 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:38.166027 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-21372321-6d04-4ead-aff7-7466908a03e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.729507 Aug 18 11:43:38.170959 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2161/4132] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:43:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:43:38.208257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7349d561-a91b-4134-8a42-f24aa0562e0b req-4b89a0c9-5e01-44bc-8b7a-a6b3a7eebd2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-deleted", "tag": "cd3590e3-c7bc-46ed-9406-3be3fdd8f424"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:38.242885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7349d561-a91b-4134-8a42-f24aa0562e0b req-4b89a0c9-5e01-44bc-8b7a-a6b3a7eebd2e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:38.247510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7349d561-a91b-4134-8a42-f24aa0562e0b req-4b89a0c9-5e01-44bc-8b7a-a6b3a7eebd2e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:38.248662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7349d561-a91b-4134-8a42-f24aa0562e0b req-4b89a0c9-5e01-44bc-8b7a-a6b3a7eebd2e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:38.263131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c238c309-3b4a-45ca-a0af-8faefe807374 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 4bf0808e-967c-4d32-9d4e-0282a5ae3302] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:43:38.279167 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7349d561-a91b-4134-8a42-f24aa0562e0b req-4b89a0c9-5e01-44bc-8b7a-a6b3a7eebd2e service nova] Creating event network-vif-deleted:cd3590e3-c7bc-46ed-9406-3be3fdd8f424 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:43:38.293449 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7349d561-a91b-4134-8a42-f24aa0562e0b req-4b89a0c9-5e01-44bc-8b7a-a6b3a7eebd2e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120046 Aug 18 11:43:38.299074 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2162/4133] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:38.309477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-331957a2-9cd7-4f6a-93ef-4ba826b92b9f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:38.310516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-331957a2-9cd7-4f6a-93ef-4ba826b92b9f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:38.323720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-331957a2-9cd7-4f6a-93ef-4ba826b92b9f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:38.326841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-331957a2-9cd7-4f6a-93ef-4ba826b92b9f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:38.327633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-331957a2-9cd7-4f6a-93ef-4ba826b92b9f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:38.330574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-331957a2-9cd7-4f6a-93ef-4ba826b92b9f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:38.331495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-331957a2-9cd7-4f6a-93ef-4ba826b92b9f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:38.332670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-331957a2-9cd7-4f6a-93ef-4ba826b92b9f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:38.482186 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c238c309-3b4a-45ca-a0af-8faefe807374 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302" status: 204 len: 0 microversion: 2.1 time: 0.405692 Aug 18 11:43:38.483291 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1972/4134] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:43:38 2022] DELETE /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:43:38.489441 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-646bcca5-5ed8-4550-b0e0-759ac2f0ebb4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:38.495632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-646bcca5-5ed8-4550-b0e0-759ac2f0ebb4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:38.499248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:38.510904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-646bcca5-5ed8-4550-b0e0-759ac2f0ebb4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:38.519394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-646bcca5-5ed8-4550-b0e0-759ac2f0ebb4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:38.520207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-646bcca5-5ed8-4550-b0e0-759ac2f0ebb4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:38.523439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-646bcca5-5ed8-4550-b0e0-759ac2f0ebb4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:38.524522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-646bcca5-5ed8-4550-b0e0-759ac2f0ebb4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:38.530172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-646bcca5-5ed8-4550-b0e0-759ac2f0ebb4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:38.708486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-331957a2-9cd7-4f6a-93ef-4ba826b92b9f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:38.721339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-331957a2-9cd7-4f6a-93ef-4ba826b92b9f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:38.748304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-331957a2-9cd7-4f6a-93ef-4ba826b92b9f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:38.750776 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-331957a2-9cd7-4f6a-93ef-4ba826b92b9f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 2324 microversion: 2.42 time: 0.448630 Aug 18 11:43:38.759605 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2163/4135] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:38 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 2324 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:38.776363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6e46d2c6-101a-43cf-ac19-47d0a909edc6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:38.778092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6e46d2c6-101a-43cf-ac19-47d0a909edc6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:38.932553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6e46d2c6-101a-43cf-ac19-47d0a909edc6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:38.950776 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6e46d2c6-101a-43cf-ac19-47d0a909edc6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1216 microversion: 2.1 time: 0.189555 Aug 18 11:43:38.951749 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2164/4136] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:38 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1216 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:38.975517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3ec3eff6-8b1b-4f7e-b428-426aab326f45 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:38.976923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3ec3eff6-8b1b-4f7e-b428-426aab326f45 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:38.996361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ec3eff6-8b1b-4f7e-b428-426aab326f45 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:38.999560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ec3eff6-8b1b-4f7e-b428-426aab326f45 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:39.003911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ec3eff6-8b1b-4f7e-b428-426aab326f45 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:39.004906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ec3eff6-8b1b-4f7e-b428-426aab326f45 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:39.006349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ec3eff6-8b1b-4f7e-b428-426aab326f45 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:39.007663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ec3eff6-8b1b-4f7e-b428-426aab326f45 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:39.071969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3ec3eff6-8b1b-4f7e-b428-426aab326f45 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:43:39.189159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-646bcca5-5ed8-4550-b0e0-759ac2f0ebb4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:39.220101 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-646bcca5-5ed8-4550-b0e0-759ac2f0ebb4 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1512 microversion: 2.1 time: 0.725127 Aug 18 11:43:39.221964 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1973/4137] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:38 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1512 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:39.248501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8dcf3d53-ffb6-4229-a7b1-0bb794be5a24 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:39.249454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8dcf3d53-ffb6-4229-a7b1-0bb794be5a24 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:39.265854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8dcf3d53-ffb6-4229-a7b1-0bb794be5a24 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:39.267039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8dcf3d53-ffb6-4229-a7b1-0bb794be5a24 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:39.267862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8dcf3d53-ffb6-4229-a7b1-0bb794be5a24 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:39.269882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8dcf3d53-ffb6-4229-a7b1-0bb794be5a24 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:39.270640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8dcf3d53-ffb6-4229-a7b1-0bb794be5a24 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:39.271393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8dcf3d53-ffb6-4229-a7b1-0bb794be5a24 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:39.293864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:39.320268 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3ec3eff6-8b1b-4f7e-b428-426aab326f45 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 204 len: 0 microversion: 2.1 time: 0.365990 Aug 18 11:43:39.321029 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2165/4138] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:43:38 2022] DELETE /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:43:39.333953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:39.341064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:39.342459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:39.355126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:39.357355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:39.360830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:39.361918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:39.362811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:39.364422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:39.510074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:39.563248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8dcf3d53-ffb6-4229-a7b1-0bb794be5a24 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:39.575215 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8dcf3d53-ffb6-4229-a7b1-0bb794be5a24 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1361 microversion: 2.1 time: 0.331848 Aug 18 11:43:39.576217 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1974/4139] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:39 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1361 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:39.581544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4d53b6bd-852f-4a7b-a4f7-55f222dade5f tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:39.582461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4d53b6bd-852f-4a7b-a4f7-55f222dade5f tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 4bf0808e-967c-4d32-9d4e-0282a5ae3302] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:39.611276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d53b6bd-852f-4a7b-a4f7-55f222dade5f tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:39.612106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d53b6bd-852f-4a7b-a4f7-55f222dade5f tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:39.612734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d53b6bd-852f-4a7b-a4f7-55f222dade5f tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:39.613713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d53b6bd-852f-4a7b-a4f7-55f222dade5f tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:39.614923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:39.615699 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d53b6bd-852f-4a7b-a4f7-55f222dade5f tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:39.617659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d53b6bd-852f-4a7b-a4f7-55f222dade5f tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:39.644313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:39.645342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:39.645976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:39.951813 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-91e6a27f-272d-4742-8c03-b6225cea3f11 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.628279 Aug 18 11:43:39.952699 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2166/4140] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:43:39 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:39.957663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7cb19de3-89ac-4c73-a7ac-dce3c638601d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:39.959828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7cb19de3-89ac-4c73-a7ac-dce3c638601d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:39.969387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cb19de3-89ac-4c73-a7ac-dce3c638601d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:39.970295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cb19de3-89ac-4c73-a7ac-dce3c638601d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:39.971031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cb19de3-89ac-4c73-a7ac-dce3c638601d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:39.972147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cb19de3-89ac-4c73-a7ac-dce3c638601d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:39.972795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cb19de3-89ac-4c73-a7ac-dce3c638601d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:39.973424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cb19de3-89ac-4c73-a7ac-dce3c638601d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:39.974114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4d53b6bd-852f-4a7b-a4f7-55f222dade5f tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:39.985024 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4d53b6bd-852f-4a7b-a4f7-55f222dade5f tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302" status: 200 len: 1512 microversion: 2.1 time: 0.407543 Aug 18 11:43:40.000313 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1975/4141] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:39 2022] GET /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302 => generated 1512 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:40.005504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-16cfee47-d147-4451-a91b-cfc448e68012 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:40.006132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-16cfee47-d147-4451-a91b-cfc448e68012 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:40.013010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16cfee47-d147-4451-a91b-cfc448e68012 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:40.013590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16cfee47-d147-4451-a91b-cfc448e68012 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:40.014164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16cfee47-d147-4451-a91b-cfc448e68012 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:40.014959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16cfee47-d147-4451-a91b-cfc448e68012 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:40.015433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16cfee47-d147-4451-a91b-cfc448e68012 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:40.015938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16cfee47-d147-4451-a91b-cfc448e68012 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:40.161352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-16cfee47-d147-4451-a91b-cfc448e68012 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:40.177201 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-16cfee47-d147-4451-a91b-cfc448e68012 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1268 microversion: 2.1 time: 0.176218 Aug 18 11:43:40.177912 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1976/4142] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:39 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:40.192397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7cb19de3-89ac-4c73-a7ac-dce3c638601d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:40.201167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e9c1f46c-c48d-4ebb-bc02-3a2496e4cb09 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:40.203792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7cb19de3-89ac-4c73-a7ac-dce3c638601d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:40.207641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7cb19de3-89ac-4c73-a7ac-dce3c638601d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:40.210247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e9c1f46c-c48d-4ebb-bc02-3a2496e4cb09 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:40.210967 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7cb19de3-89ac-4c73-a7ac-dce3c638601d tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 2324 microversion: 2.42 time: 0.256398 Aug 18 11:43:40.211270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e9c1f46c-c48d-4ebb-bc02-3a2496e4cb09 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:40.213856 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2167/4143] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:39 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 2324 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:40.371244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9c1f46c-c48d-4ebb-bc02-3a2496e4cb09 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:40.373651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9c1f46c-c48d-4ebb-bc02-3a2496e4cb09 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:40.376434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-0fea1171-20d2-4965-ba9f-c90e96e58bab req-676603a8-c8b0-4cfc-88b9-ebceea2c38fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-deleted", "tag": "e2a4d3da-f8cb-4b7f-8b3f-325a41f5e8de"}, {"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-deleted", "tag": "a8cc0ae7-4375-4ddf-bae4-66fb1bc368e4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:40.377473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9c1f46c-c48d-4ebb-bc02-3a2496e4cb09 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:40.383080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9c1f46c-c48d-4ebb-bc02-3a2496e4cb09 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:40.407660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0fea1171-20d2-4965-ba9f-c90e96e58bab req-676603a8-c8b0-4cfc-88b9-ebceea2c38fc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:40.409179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0fea1171-20d2-4965-ba9f-c90e96e58bab req-676603a8-c8b0-4cfc-88b9-ebceea2c38fc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:40.410295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0fea1171-20d2-4965-ba9f-c90e96e58bab req-676603a8-c8b0-4cfc-88b9-ebceea2c38fc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:40.416414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9c1f46c-c48d-4ebb-bc02-3a2496e4cb09 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:40.418658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9c1f46c-c48d-4ebb-bc02-3a2496e4cb09 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:40.438344 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-0fea1171-20d2-4965-ba9f-c90e96e58bab req-676603a8-c8b0-4cfc-88b9-ebceea2c38fc service nova] Creating event network-vif-deleted:e2a4d3da-f8cb-4b7f-8b3f-325a41f5e8de for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:43:40.439801 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-0fea1171-20d2-4965-ba9f-c90e96e58bab req-676603a8-c8b0-4cfc-88b9-ebceea2c38fc service nova] Creating event network-vif-deleted:a8cc0ae7-4375-4ddf-bae4-66fb1bc368e4 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:43:40.452421 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-0fea1171-20d2-4965-ba9f-c90e96e58bab req-676603a8-c8b0-4cfc-88b9-ebceea2c38fc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095885 Aug 18 11:43:40.454161 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2168/4144] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:43:40.533817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-e9c1f46c-c48d-4ebb-bc02-3a2496e4cb09 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:40.612618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-870f1d84-9968-4909-b903-981b5e68cfa1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:40.613597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-870f1d84-9968-4909-b903-981b5e68cfa1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:40.626093 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e9c1f46c-c48d-4ebb-bc02-3a2496e4cb09 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.445982 Aug 18 11:43:40.629908 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1977/4145] 10.222.0.73 () {58 vars in 1150 bytes} [Thu Aug 18 11:43:40 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:40.631845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-870f1d84-9968-4909-b903-981b5e68cfa1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:40.633462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-870f1d84-9968-4909-b903-981b5e68cfa1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:40.633946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-870f1d84-9968-4909-b903-981b5e68cfa1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:40.637189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-870f1d84-9968-4909-b903-981b5e68cfa1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:40.637761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-870f1d84-9968-4909-b903-981b5e68cfa1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:40.638367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-870f1d84-9968-4909-b903-981b5e68cfa1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:40.658176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ad06e699-ecf2-4ec8-a032-909229405982 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:40.677037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ad06e699-ecf2-4ec8-a032-909229405982 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:40.679334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ad06e699-ecf2-4ec8-a032-909229405982 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:40.690838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad06e699-ecf2-4ec8-a032-909229405982 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:40.691841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad06e699-ecf2-4ec8-a032-909229405982 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:40.692733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad06e699-ecf2-4ec8-a032-909229405982 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:40.695720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad06e699-ecf2-4ec8-a032-909229405982 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:40.697240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad06e699-ecf2-4ec8-a032-909229405982 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:40.698180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ad06e699-ecf2-4ec8-a032-909229405982 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:41.112396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-ad06e699-ecf2-4ec8-a032-909229405982 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:41.167057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-870f1d84-9968-4909-b903-981b5e68cfa1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:41.206672 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-870f1d84-9968-4909-b903-981b5e68cfa1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1546 microversion: 2.1 time: 0.599033 Aug 18 11:43:41.208367 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2169/4146] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:40 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1546 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:43:41.219982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d9b71132-3ad5-432e-b184-6a5bae29eac0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:41.222890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d9b71132-3ad5-432e-b184-6a5bae29eac0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 4bf0808e-967c-4d32-9d4e-0282a5ae3302] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:41.257248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9b71132-3ad5-432e-b184-6a5bae29eac0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:41.258132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9b71132-3ad5-432e-b184-6a5bae29eac0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:41.258922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9b71132-3ad5-432e-b184-6a5bae29eac0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:41.265020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9b71132-3ad5-432e-b184-6a5bae29eac0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:41.266461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9b71132-3ad5-432e-b184-6a5bae29eac0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:41.271538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9b71132-3ad5-432e-b184-6a5bae29eac0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:41.347316 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ad06e699-ecf2-4ec8-a032-909229405982 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.696570 Aug 18 11:43:41.352803 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1978/4147] 10.222.0.73 () {58 vars in 1212 bytes} [Thu Aug 18 11:43:40 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:41.359665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d31c616b-f0dd-4045-9932-e1805441e676 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:41.361002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d31c616b-f0dd-4045-9932-e1805441e676 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:41.370101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d31c616b-f0dd-4045-9932-e1805441e676 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:41.370939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d31c616b-f0dd-4045-9932-e1805441e676 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:41.371636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d31c616b-f0dd-4045-9932-e1805441e676 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:41.373172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d31c616b-f0dd-4045-9932-e1805441e676 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:41.374339 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d31c616b-f0dd-4045-9932-e1805441e676 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:41.375180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d31c616b-f0dd-4045-9932-e1805441e676 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:41.683559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d9b71132-3ad5-432e-b184-6a5bae29eac0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:41.687377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d31c616b-f0dd-4045-9932-e1805441e676 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:41.702249 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d31c616b-f0dd-4045-9932-e1805441e676 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1274 microversion: 2.1 time: 0.348125 Aug 18 11:43:41.702892 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1979/4148] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:41 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1274 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:41.723239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-57365a5c-5a5b-45d4-b88b-b6b3c14a6e81 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:41.724464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-57365a5c-5a5b-45d4-b88b-b6b3c14a6e81 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:41.741591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57365a5c-5a5b-45d4-b88b-b6b3c14a6e81 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:41.742630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57365a5c-5a5b-45d4-b88b-b6b3c14a6e81 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:41.742792 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d9b71132-3ad5-432e-b184-6a5bae29eac0 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302" status: 200 len: 1512 microversion: 2.1 time: 0.523017 Aug 18 11:43:41.742994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57365a5c-5a5b-45d4-b88b-b6b3c14a6e81 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:41.743758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57365a5c-5a5b-45d4-b88b-b6b3c14a6e81 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:41.743891 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2170/4149] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:41 2022] GET /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302 => generated 1512 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:41.744224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57365a5c-5a5b-45d4-b88b-b6b3c14a6e81 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:41.744777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-57365a5c-5a5b-45d4-b88b-b6b3c14a6e81 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:41.775948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a9530ee-3444-45d8-945a-f499662c9f19 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:41.776736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4a9530ee-3444-45d8-945a-f499662c9f19 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:41.826364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a9530ee-3444-45d8-945a-f499662c9f19 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:41.827213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a9530ee-3444-45d8-945a-f499662c9f19 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:41.827991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a9530ee-3444-45d8-945a-f499662c9f19 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:41.829348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a9530ee-3444-45d8-945a-f499662c9f19 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:41.838032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a9530ee-3444-45d8-945a-f499662c9f19 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:41.838982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a9530ee-3444-45d8-945a-f499662c9f19 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:42.051332 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4a9530ee-3444-45d8-945a-f499662c9f19 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.305720 Aug 18 11:43:42.053299 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2171/4150] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:43:41 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/os-interface => generated 284 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:42.062319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-57365a5c-5a5b-45d4-b88b-b6b3c14a6e81 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:42.062948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b5291739-e012-4b21-865c-8cd7cb43000c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:42.076332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b5291739-e012-4b21-865c-8cd7cb43000c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:42.077857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-57365a5c-5a5b-45d4-b88b-b6b3c14a6e81 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:42.078749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b5291739-e012-4b21-865c-8cd7cb43000c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:42.082395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-57365a5c-5a5b-45d4-b88b-b6b3c14a6e81 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:42.091893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5291739-e012-4b21-865c-8cd7cb43000c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:42.093664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5291739-e012-4b21-865c-8cd7cb43000c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:42.094786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5291739-e012-4b21-865c-8cd7cb43000c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:42.097496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5291739-e012-4b21-865c-8cd7cb43000c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:42.097767 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-57365a5c-5a5b-45d4-b88b-b6b3c14a6e81 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.386756 Aug 18 11:43:42.098503 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1980/4151] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:41 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:42.099392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5291739-e012-4b21-865c-8cd7cb43000c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:42.101036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5291739-e012-4b21-865c-8cd7cb43000c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:42.366169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-b5291739-e012-4b21-865c-8cd7cb43000c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:42.441565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:42.473822 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b5291739-e012-4b21-865c-8cd7cb43000c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.418132 Aug 18 11:43:42.474447 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2172/4152] 10.222.0.73 () {58 vars in 1196 bytes} [Thu Aug 18 11:43:42 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:42.487965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-42eda211-3528-42ea-b272-550e1d9d24dc tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:42.496159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-42eda211-3528-42ea-b272-550e1d9d24dc tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:42.498909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-42eda211-3528-42ea-b272-550e1d9d24dc tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'name': '1544117582', 'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:42.512988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42eda211-3528-42ea-b272-550e1d9d24dc tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:42.514044 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42eda211-3528-42ea-b272-550e1d9d24dc tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:42.514877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42eda211-3528-42ea-b272-550e1d9d24dc tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:42.515991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42eda211-3528-42ea-b272-550e1d9d24dc tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:42.516738 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42eda211-3528-42ea-b272-550e1d9d24dc tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:42.517425 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42eda211-3528-42ea-b272-550e1d9d24dc tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:42.535050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9bce4149-123f-4a56-9ce5-3bc2b6a46f0c req-472d7a44-dea3-4cd1-87b9-0da9f5a22ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf6bf58-dceb-4e27-9d99-c8139ed38fce", "name": "network-vif-deleted", "tag": "b6b82b42-049e-4313-85b7-b7b6ccd6e554"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:42.555950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9bce4149-123f-4a56-9ce5-3bc2b6a46f0c req-472d7a44-dea3-4cd1-87b9-0da9f5a22ede service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:42.556443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9bce4149-123f-4a56-9ce5-3bc2b6a46f0c req-472d7a44-dea3-4cd1-87b9-0da9f5a22ede service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:42.556953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9bce4149-123f-4a56-9ce5-3bc2b6a46f0c req-472d7a44-dea3-4cd1-87b9-0da9f5a22ede service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:42.605501 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9bce4149-123f-4a56-9ce5-3bc2b6a46f0c req-472d7a44-dea3-4cd1-87b9-0da9f5a22ede service nova] Creating event network-vif-deleted:b6b82b42-049e-4313-85b7-b7b6ccd6e554 for instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce on n-h2-853611-3 Aug 18 11:43:42.618232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-42eda211-3528-42ea-b272-550e1d9d24dc tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:42.634581 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9bce4149-123f-4a56-9ce5-3bc2b6a46f0c req-472d7a44-dea3-4cd1-87b9-0da9f5a22ede service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100249 Aug 18 11:43:42.635277 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2173/4153] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:43:42.684266 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-42eda211-3528-42ea-b272-550e1d9d24dc tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers?name=1544117582" status: 200 len: 346 microversion: 2.1 time: 0.199998 Aug 18 11:43:42.696430 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1981/4154] 10.222.0.73 () {58 vars in 1156 bytes} [Thu Aug 18 11:43:42 2022] GET /compute/v2.1/servers?name=1544117582 => generated 346 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:42.704031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3179bf36-5d20-4ea3-84d1-af539fb2dc71 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:42.711177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3179bf36-5d20-4ea3-84d1-af539fb2dc71 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:42.712528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3179bf36-5d20-4ea3-84d1-af539fb2dc71 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:42.723614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3179bf36-5d20-4ea3-84d1-af539fb2dc71 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:42.725153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3179bf36-5d20-4ea3-84d1-af539fb2dc71 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:42.725773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3179bf36-5d20-4ea3-84d1-af539fb2dc71 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:42.726690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3179bf36-5d20-4ea3-84d1-af539fb2dc71 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:42.727244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3179bf36-5d20-4ea3-84d1-af539fb2dc71 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:42.728584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3179bf36-5d20-4ea3-84d1-af539fb2dc71 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:42.738178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-94708b4f-7a10-4101-a645-4ec429287767 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:42.739269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-94708b4f-7a10-4101-a645-4ec429287767 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:42.748733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94708b4f-7a10-4101-a645-4ec429287767 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:42.757945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94708b4f-7a10-4101-a645-4ec429287767 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:42.758842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94708b4f-7a10-4101-a645-4ec429287767 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:42.759880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94708b4f-7a10-4101-a645-4ec429287767 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:42.760670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94708b4f-7a10-4101-a645-4ec429287767 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:42.761360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94708b4f-7a10-4101-a645-4ec429287767 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:42.885317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-3179bf36-5d20-4ea3-84d1-af539fb2dc71 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:43.043688 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3179bf36-5d20-4ea3-84d1-af539fb2dc71 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.345229 Aug 18 11:43:43.045576 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2174/4155] 10.222.0.73 () {58 vars in 1154 bytes} [Thu Aug 18 11:43:42 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:43:43.056783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f82c5e6-ebe6-432b-855a-4cac6b14f414 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:43.058177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7f82c5e6-ebe6-432b-855a-4cac6b14f414 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 4bf0808e-967c-4d32-9d4e-0282a5ae3302] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:43.078608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f82c5e6-ebe6-432b-855a-4cac6b14f414 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:43.079757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f82c5e6-ebe6-432b-855a-4cac6b14f414 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:43.080500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f82c5e6-ebe6-432b-855a-4cac6b14f414 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:43.081830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f82c5e6-ebe6-432b-855a-4cac6b14f414 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:43.082770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f82c5e6-ebe6-432b-855a-4cac6b14f414 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:43.083813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f82c5e6-ebe6-432b-855a-4cac6b14f414 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:43.084358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-94708b4f-7a10-4101-a645-4ec429287767 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:43.097444 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-94708b4f-7a10-4101-a645-4ec429287767 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1274 microversion: 2.1 time: 0.363245 Aug 18 11:43:43.101988 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1982/4156] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:42 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1274 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:43:43.110538 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b91e5309-b8f1-43d6-bc64-a85a8ff6fe6c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:43.129083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b91e5309-b8f1-43d6-bc64-a85a8ff6fe6c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:43.131074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b91e5309-b8f1-43d6-bc64-a85a8ff6fe6c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-154411758', 'deleted': False, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:43:43.145871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b91e5309-b8f1-43d6-bc64-a85a8ff6fe6c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:43.146816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b91e5309-b8f1-43d6-bc64-a85a8ff6fe6c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:43.147885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b91e5309-b8f1-43d6-bc64-a85a8ff6fe6c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:43.148911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b91e5309-b8f1-43d6-bc64-a85a8ff6fe6c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:43.149575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b91e5309-b8f1-43d6-bc64-a85a8ff6fe6c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:43.152851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b91e5309-b8f1-43d6-bc64-a85a8ff6fe6c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:43.320324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-b91e5309-b8f1-43d6-bc64-a85a8ff6fe6c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:43:43.489861 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b91e5309-b8f1-43d6-bc64-a85a8ff6fe6c tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-154411758" status: 200 len: 346 microversion: 2.1 time: 0.385284 Aug 18 11:43:43.491602 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1983/4157] 10.222.0.73 () {58 vars in 1228 bytes} [Thu Aug 18 11:43:43 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-154411758 => generated 346 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:43.504650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-55dafd00-9f36-4140-9c1a-cb2772070982 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:43.505678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-55dafd00-9f36-4140-9c1a-cb2772070982 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:43.513125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55dafd00-9f36-4140-9c1a-cb2772070982 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:43.514233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55dafd00-9f36-4140-9c1a-cb2772070982 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:43.515045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55dafd00-9f36-4140-9c1a-cb2772070982 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:43.516227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55dafd00-9f36-4140-9c1a-cb2772070982 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:43.517014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55dafd00-9f36-4140-9c1a-cb2772070982 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:43.517750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55dafd00-9f36-4140-9c1a-cb2772070982 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:43.533235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7f82c5e6-ebe6-432b-855a-4cac6b14f414 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:43.544688 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7f82c5e6-ebe6-432b-855a-4cac6b14f414 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302" status: 200 len: 1470 microversion: 2.1 time: 0.497442 Aug 18 11:43:43.552619 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2175/4158] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:43 2022] GET /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302 => generated 1470 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:43.571325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bd2adc1e-7a6b-4294-804e-631963bfb3ad tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:43.571962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bd2adc1e-7a6b-4294-804e-631963bfb3ad tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:43.608737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd2adc1e-7a6b-4294-804e-631963bfb3ad tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:43.609631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd2adc1e-7a6b-4294-804e-631963bfb3ad tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:43.610476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd2adc1e-7a6b-4294-804e-631963bfb3ad tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:43.611798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd2adc1e-7a6b-4294-804e-631963bfb3ad tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:43.612669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd2adc1e-7a6b-4294-804e-631963bfb3ad tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:43.613470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd2adc1e-7a6b-4294-804e-631963bfb3ad tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:43.653055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-55dafd00-9f36-4140-9c1a-cb2772070982 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:43.672062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-55dafd00-9f36-4140-9c1a-cb2772070982 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:43.676069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-55dafd00-9f36-4140-9c1a-cb2772070982 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:43.681185 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-55dafd00-9f36-4140-9c1a-cb2772070982 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.187143 Aug 18 11:43:43.694896 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1984/4159] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:43 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:43.777170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bd2adc1e-7a6b-4294-804e-631963bfb3ad tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:43:43.958160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-319cdc6e-ce8e-477c-a133-18821fe4cab0 req-326424ca-6155-460b-9d87-79462f8ac82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4aef42-ba37-4d07-9cfb-798c9cab350e", "name": "network-vif-unplugged", "status": "completed", "tag": "a50e0766-9746-4aff-b289-38c3ba8a396b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:43.994065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-319cdc6e-ce8e-477c-a133-18821fe4cab0 req-326424ca-6155-460b-9d87-79462f8ac82f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:43.994614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-319cdc6e-ce8e-477c-a133-18821fe4cab0 req-326424ca-6155-460b-9d87-79462f8ac82f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:43.998504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-319cdc6e-ce8e-477c-a133-18821fe4cab0 req-326424ca-6155-460b-9d87-79462f8ac82f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:44.045222 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-319cdc6e-ce8e-477c-a133-18821fe4cab0 req-326424ca-6155-460b-9d87-79462f8ac82f service nova] Creating event network-vif-unplugged:a50e0766-9746-4aff-b289-38c3ba8a396b for instance 6a4aef42-ba37-4d07-9cfb-798c9cab350e on n-h2-853611-3 Aug 18 11:43:44.064005 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-319cdc6e-ce8e-477c-a133-18821fe4cab0 req-326424ca-6155-460b-9d87-79462f8ac82f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108538 Aug 18 11:43:44.066973 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1985/4160] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:43:44.075224 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bd2adc1e-7a6b-4294-804e-631963bfb3ad tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 204 len: 0 microversion: 2.1 time: 0.520274 Aug 18 11:43:44.076339 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2176/4161] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:43:43 2022] DELETE /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:43:44.091450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4694d3c0-0426-421c-a753-fbaed49a4c1f tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:44.092219 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4694d3c0-0426-421c-a753-fbaed49a4c1f tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:44.112296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4694d3c0-0426-421c-a753-fbaed49a4c1f tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:44.112608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4694d3c0-0426-421c-a753-fbaed49a4c1f tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:44.113305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4694d3c0-0426-421c-a753-fbaed49a4c1f tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:44.115079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4694d3c0-0426-421c-a753-fbaed49a4c1f tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:44.118160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4694d3c0-0426-421c-a753-fbaed49a4c1f tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:44.120040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4694d3c0-0426-421c-a753-fbaed49a4c1f tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:44.139808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-894a9200-c579-4ab1-9f2d-2d5561006ee8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:44.140823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-894a9200-c579-4ab1-9f2d-2d5561006ee8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:44.155828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-894a9200-c579-4ab1-9f2d-2d5561006ee8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:44.156222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-894a9200-c579-4ab1-9f2d-2d5561006ee8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:44.156861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-894a9200-c579-4ab1-9f2d-2d5561006ee8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:44.157828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-894a9200-c579-4ab1-9f2d-2d5561006ee8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:44.168275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-894a9200-c579-4ab1-9f2d-2d5561006ee8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:44.169027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-894a9200-c579-4ab1-9f2d-2d5561006ee8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:44.528501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-894a9200-c579-4ab1-9f2d-2d5561006ee8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:44.542891 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-894a9200-c579-4ab1-9f2d-2d5561006ee8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1274 microversion: 2.1 time: 0.408317 Aug 18 11:43:44.546514 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2177/4162] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:44 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1274 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:43:44.585539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6f8c346-cffa-411a-8426-d2b8fb3294fe tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:44.586874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c6f8c346-cffa-411a-8426-d2b8fb3294fe tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 4bf0808e-967c-4d32-9d4e-0282a5ae3302] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:44.602864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6f8c346-cffa-411a-8426-d2b8fb3294fe tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:44.604235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6f8c346-cffa-411a-8426-d2b8fb3294fe tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:44.604925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6f8c346-cffa-411a-8426-d2b8fb3294fe tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:44.605934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6f8c346-cffa-411a-8426-d2b8fb3294fe tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:44.607171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6f8c346-cffa-411a-8426-d2b8fb3294fe tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:44.608018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6f8c346-cffa-411a-8426-d2b8fb3294fe tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:44.625146 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-c6f8c346-cffa-411a-8426-d2b8fb3294fe tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] HTTP exception thrown: Instance 4bf0808e-967c-4d32-9d4e-0282a5ae3302 could not be found. Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6f8c346-cffa-411a-8426-d2b8fb3294fe tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Request method failure captured: Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302 HTTP/1.1 Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iWl9PPZtlnK4YvRGgO88SOmOVDbchvcoOnBqe89VcUisSFnDHFtM7x8aJnfZmCJmF-Bs_7-p6kYQ-TkJU-U-NlQZk_I9IQI8IhfnaCvhfg1Q5cm8bAhUD7XtfPcRu6UaWAyWJyG5aOhA_qjgxepZ0SrzdqmIlg7VkH80IbGFl8r86Y Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: d83400501e4a4f84a984b01b02bee8a7 Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-MultipleCreateTestJSON-184786698 Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d83400501e4a4f84a984b01b02bee8a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d83400501e4a4f84a984b01b02bee8a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d83400501e4a4f84a984b01b02bee8a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d83400501e4a4f84a984b01b02bee8a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-MultipleCreateTestJSON-184786698 Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: d83400501e4a4f84a984b01b02bee8a7 Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-MultipleCreateTestJSON-184786698 Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-MultipleCreateTestJSON-184786698-project Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 59d2180ae68a4190803f531121a58cea Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-MultipleCreateTestJSON-184786698-project Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 4bf0808e-967c-4d32-9d4e-0282a5ae3302 could not be found. Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '4bf0808e-967c-4d32-9d4e-0282a5ae3302'} Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bf0808e-967c-4d32-9d4e-0282a5ae3302 could not be found. Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bf0808e-967c-4d32-9d4e-0282a5ae3302 could not be found. Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:43:44.628248 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:44.633539 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:44.633539 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:43:44.633539 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:43:44.633539 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:43:44.633539 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:43:44.633539 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bf0808e-967c-4d32-9d4e-0282a5ae3302 could not be found. Aug 18 11:43:44.633539 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:44.637231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6f8c346-cffa-411a-8426-d2b8fb3294fe tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Returning 404 to user: Instance 4bf0808e-967c-4d32-9d4e-0282a5ae3302 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:43:44.639100 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c6f8c346-cffa-411a-8426-d2b8fb3294fe tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302" status: 404 len: 111 microversion: 2.1 time: 0.057853 Aug 18 11:43:44.640285 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2178/4163] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:44 2022] GET /compute/v2.1/servers/4bf0808e-967c-4d32-9d4e-0282a5ae3302 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:43:44.661143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1ff4487a-eef8-4584-ac71-bd06707f9991 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:44.662114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1ff4487a-eef8-4584-ac71-bd06707f9991 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:44.671014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ff4487a-eef8-4584-ac71-bd06707f9991 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:44.671857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ff4487a-eef8-4584-ac71-bd06707f9991 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:44.675407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ff4487a-eef8-4584-ac71-bd06707f9991 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:44.680970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ff4487a-eef8-4584-ac71-bd06707f9991 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:44.687932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ff4487a-eef8-4584-ac71-bd06707f9991 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:44.688706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ff4487a-eef8-4584-ac71-bd06707f9991 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:44.898272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1ff4487a-eef8-4584-ac71-bd06707f9991 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:44.909186 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1ff4487a-eef8-4584-ac71-bd06707f9991 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 200 len: 1470 microversion: 2.1 time: 0.264329 Aug 18 11:43:44.911478 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2179/4164] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:44 2022] GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:44.920168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-33e834bf-35e1-4e66-aedc-b6d5a4fa05fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:44.920798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-33e834bf-35e1-4e66-aedc-b6d5a4fa05fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:44.945124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e834bf-35e1-4e66-aedc-b6d5a4fa05fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:44.945718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e834bf-35e1-4e66-aedc-b6d5a4fa05fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:44.946414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e834bf-35e1-4e66-aedc-b6d5a4fa05fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:44.947198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e834bf-35e1-4e66-aedc-b6d5a4fa05fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:44.947660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e834bf-35e1-4e66-aedc-b6d5a4fa05fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:44.948086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33e834bf-35e1-4e66-aedc-b6d5a4fa05fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:45.123893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-33e834bf-35e1-4e66-aedc-b6d5a4fa05fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:45.141766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-33e834bf-35e1-4e66-aedc-b6d5a4fa05fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:45.144976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-33e834bf-35e1-4e66-aedc-b6d5a4fa05fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:45.149512 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-33e834bf-35e1-4e66-aedc-b6d5a4fa05fd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.235085 Aug 18 11:43:45.154470 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2180/4165] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:44 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:45.177583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7baf645a-e173-474a-b360-79c69e437031 req-6650eeec-24ae-4df9-a3fe-ae943eb0184a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bf0808e-967c-4d32-9d4e-0282a5ae3302", "name": "network-vif-deleted", "tag": "edfa1aee-f401-4b2f-b16f-78bcd45601a8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:45.195425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:45.208832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7baf645a-e173-474a-b360-79c69e437031 req-6650eeec-24ae-4df9-a3fe-ae943eb0184a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:45.211386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7baf645a-e173-474a-b360-79c69e437031 req-6650eeec-24ae-4df9-a3fe-ae943eb0184a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:45.212235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7baf645a-e173-474a-b360-79c69e437031 req-6650eeec-24ae-4df9-a3fe-ae943eb0184a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:45.243398 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7baf645a-e173-474a-b360-79c69e437031 req-6650eeec-24ae-4df9-a3fe-ae943eb0184a service nova] Creating event network-vif-deleted:edfa1aee-f401-4b2f-b16f-78bcd45601a8 for instance 4bf0808e-967c-4d32-9d4e-0282a5ae3302 on n-h2-853611-3 Aug 18 11:43:45.258759 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7baf645a-e173-474a-b360-79c69e437031 req-6650eeec-24ae-4df9-a3fe-ae943eb0184a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084887 Aug 18 11:43:45.264655 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2181/4166] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:45.567128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c54df7c6-de14-4af6-98ef-aed84e8b364f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:45.569665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c54df7c6-de14-4af6-98ef-aed84e8b364f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:45.598470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c54df7c6-de14-4af6-98ef-aed84e8b364f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:45.602073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c54df7c6-de14-4af6-98ef-aed84e8b364f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:45.605063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c54df7c6-de14-4af6-98ef-aed84e8b364f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:45.614005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c54df7c6-de14-4af6-98ef-aed84e8b364f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:45.620328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c54df7c6-de14-4af6-98ef-aed84e8b364f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:45.628472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c54df7c6-de14-4af6-98ef-aed84e8b364f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:45.989328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4694d3c0-0426-421c-a753-fbaed49a4c1f tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:46.009067 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4694d3c0-0426-421c-a753-fbaed49a4c1f tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1518 microversion: 2.1 time: 1.921858 Aug 18 11:43:46.010680 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1986/4167] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:44 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1518 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:46.026835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-25e606cf-ce76-4858-9dd7-38cb227a850b req-c1a1d3d6-719d-4bb4-b61f-5296a2c97aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f554895-d3bd-4694-ad7a-1f23d21ed51a", "tag": "8fd6c4cd-227d-4d50-846f-b99223c530b6"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:46.058203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c54df7c6-de14-4af6-98ef-aed84e8b364f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:46.070414 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c54df7c6-de14-4af6-98ef-aed84e8b364f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1316 microversion: 2.1 time: 0.507401 Aug 18 11:43:46.082907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-25e606cf-ce76-4858-9dd7-38cb227a850b req-c1a1d3d6-719d-4bb4-b61f-5296a2c97aab service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:46.083051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-25e606cf-ce76-4858-9dd7-38cb227a850b req-c1a1d3d6-719d-4bb4-b61f-5296a2c97aab service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:46.083471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-25e606cf-ce76-4858-9dd7-38cb227a850b req-c1a1d3d6-719d-4bb4-b61f-5296a2c97aab service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:46.084336 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2182/4168] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:45 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1316 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:46.094969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-088071f8-cd40-42b5-a366-98e143a19daf tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:46.095897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-088071f8-cd40-42b5-a366-98e143a19daf tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:46.104798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-088071f8-cd40-42b5-a366-98e143a19daf tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:46.105608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-088071f8-cd40-42b5-a366-98e143a19daf tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:46.106289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-088071f8-cd40-42b5-a366-98e143a19daf tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:46.107480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-088071f8-cd40-42b5-a366-98e143a19daf tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:46.108285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-088071f8-cd40-42b5-a366-98e143a19daf tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:46.108910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-088071f8-cd40-42b5-a366-98e143a19daf tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:46.136966 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-25e606cf-ce76-4858-9dd7-38cb227a850b req-c1a1d3d6-719d-4bb4-b61f-5296a2c97aab service nova] Creating event network-changed:8fd6c4cd-227d-4d50-846f-b99223c530b6 for instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a on n-h1-853611-3 Aug 18 11:43:46.152402 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-25e606cf-ce76-4858-9dd7-38cb227a850b req-c1a1d3d6-719d-4bb4-b61f-5296a2c97aab service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139394 Aug 18 11:43:46.156228 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1987/4169] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:46.180225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-088071f8-cd40-42b5-a366-98e143a19daf tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:46.181388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-088071f8-cd40-42b5-a366-98e143a19daf tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:46.182204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-088071f8-cd40-42b5-a366-98e143a19daf tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:46.183026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-088071f8-cd40-42b5-a366-98e143a19daf tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lazy-loading 'fault' on Instance uuid 6a4aef42-ba37-4d07-9cfb-798c9cab350e {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:43:46.183208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c019a3a9-d56c-4bd9-a532-2c5b96795244 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:46.183850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c019a3a9-d56c-4bd9-a532-2c5b96795244 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:46.201050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c019a3a9-d56c-4bd9-a532-2c5b96795244 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:46.209334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c019a3a9-d56c-4bd9-a532-2c5b96795244 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:46.210028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c019a3a9-d56c-4bd9-a532-2c5b96795244 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:46.211041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c019a3a9-d56c-4bd9-a532-2c5b96795244 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:46.211645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c019a3a9-d56c-4bd9-a532-2c5b96795244 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:46.213969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c019a3a9-d56c-4bd9-a532-2c5b96795244 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:46.250932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-088071f8-cd40-42b5-a366-98e143a19daf tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d2180ae68a4190803f531121a58cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83400501e4a4f84a984b01b02bee8a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:46.265516 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-088071f8-cd40-42b5-a366-98e143a19daf tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 200 len: 1308 microversion: 2.1 time: 0.179679 Aug 18 11:43:46.266740 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2183/4170] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:46 2022] GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 1308 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:46.611604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c019a3a9-d56c-4bd9-a532-2c5b96795244 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:46.639415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c019a3a9-d56c-4bd9-a532-2c5b96795244 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:46.641684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c019a3a9-d56c-4bd9-a532-2c5b96795244 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:46.659488 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c019a3a9-d56c-4bd9-a532-2c5b96795244 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.483199 Aug 18 11:43:46.659960 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1988/4171] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:46 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:43:47.063466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ddea8082-c63b-4eb9-ad29-d242dd88f1a7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:47.064930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ddea8082-c63b-4eb9-ad29-d242dd88f1a7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:47.098127 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-131a3491-7baa-462d-bac9-05ef3b8c1172 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:47.098928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddea8082-c63b-4eb9-ad29-d242dd88f1a7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:47.100991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-131a3491-7baa-462d-bac9-05ef3b8c1172 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:47.103178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddea8082-c63b-4eb9-ad29-d242dd88f1a7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:47.104004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddea8082-c63b-4eb9-ad29-d242dd88f1a7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:47.107804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddea8082-c63b-4eb9-ad29-d242dd88f1a7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:47.108679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddea8082-c63b-4eb9-ad29-d242dd88f1a7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:47.109464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddea8082-c63b-4eb9-ad29-d242dd88f1a7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:47.114633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131a3491-7baa-462d-bac9-05ef3b8c1172 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:47.123599 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131a3491-7baa-462d-bac9-05ef3b8c1172 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:47.125697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131a3491-7baa-462d-bac9-05ef3b8c1172 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:47.128858 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131a3491-7baa-462d-bac9-05ef3b8c1172 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:47.130734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131a3491-7baa-462d-bac9-05ef3b8c1172 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:47.131894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-131a3491-7baa-462d-bac9-05ef3b8c1172 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:47.597335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ddea8082-c63b-4eb9-ad29-d242dd88f1a7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:47.638651 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ddea8082-c63b-4eb9-ad29-d242dd88f1a7 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1518 microversion: 2.1 time: 0.586941 Aug 18 11:43:47.664440 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2184/4172] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:47 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1518 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:47.720812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8e1cc29-ccee-43c7-a9e6-44872cd8b545 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:47.722344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f8e1cc29-ccee-43c7-a9e6-44872cd8b545 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] [instance: 6a4aef42-ba37-4d07-9cfb-798c9cab350e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:47.738512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8e1cc29-ccee-43c7-a9e6-44872cd8b545 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:47.740259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8e1cc29-ccee-43c7-a9e6-44872cd8b545 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:47.741354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8e1cc29-ccee-43c7-a9e6-44872cd8b545 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:47.743029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8e1cc29-ccee-43c7-a9e6-44872cd8b545 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:47.744088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8e1cc29-ccee-43c7-a9e6-44872cd8b545 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:47.745227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8e1cc29-ccee-43c7-a9e6-44872cd8b545 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:47.824004 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-f8e1cc29-ccee-43c7-a9e6-44872cd8b545 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] HTTP exception thrown: Instance 6a4aef42-ba37-4d07-9cfb-798c9cab350e could not be found. Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8e1cc29-ccee-43c7-a9e6-44872cd8b545 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Request method failure captured: Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e HTTP/1.1 Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iWl9PPZtlnK4YvRGgO88SOmOVDbchvcoOnBqe89VcUisSFnDHFtM7x8aJnfZmCJmF-Bs_7-p6kYQ-TkJU-U-NlQZk_I9IQI8IhfnaCvhfg1Q5cm8bAhUD7XtfPcRu6UaWAyWJyG5aOhA_qjgxepZ0SrzdqmIlg7VkH80IbGFl8r86Y Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: d83400501e4a4f84a984b01b02bee8a7 Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-MultipleCreateTestJSON-184786698 Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d83400501e4a4f84a984b01b02bee8a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d83400501e4a4f84a984b01b02bee8a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d83400501e4a4f84a984b01b02bee8a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d83400501e4a4f84a984b01b02bee8a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-MultipleCreateTestJSON-184786698 Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: d83400501e4a4f84a984b01b02bee8a7 Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-MultipleCreateTestJSON-184786698 Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-MultipleCreateTestJSON-184786698-project Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 59d2180ae68a4190803f531121a58cea Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-MultipleCreateTestJSON-184786698-project Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 6a4aef42-ba37-4d07-9cfb-798c9cab350e could not be found. Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '6a4aef42-ba37-4d07-9cfb-798c9cab350e'} Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4aef42-ba37-4d07-9cfb-798c9cab350e could not be found. Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4aef42-ba37-4d07-9cfb-798c9cab350e could not be found. Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:43:47.835559 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:47.847632 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:47.847632 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:43:47.847632 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:43:47.847632 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:43:47.847632 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:43:47.847632 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4aef42-ba37-4d07-9cfb-798c9cab350e could not be found. Aug 18 11:43:47.847632 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:47.852334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8e1cc29-ccee-43c7-a9e6-44872cd8b545 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] Returning 404 to user: Instance 6a4aef42-ba37-4d07-9cfb-798c9cab350e could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:43:47.855241 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8e1cc29-ccee-43c7-a9e6-44872cd8b545 tempest-MultipleCreateTestJSON-184786698 tempest-MultipleCreateTestJSON-184786698-project] 10.222.0.73 "GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e" status: 404 len: 111 microversion: 2.1 time: 0.184844 Aug 18 11:43:47.863392 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2185/4173] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:47 2022] GET /compute/v2.1/servers/6a4aef42-ba37-4d07-9cfb-798c9cab350e => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:43:47.874410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ccec77ea-0de2-4806-be69-14566b4e7a35 req-5e7b2920-6fe8-4782-af76-83685a70c34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4aef42-ba37-4d07-9cfb-798c9cab350e", "name": "network-vif-deleted", "tag": "a50e0766-9746-4aff-b289-38c3ba8a396b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:47.925501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ccec77ea-0de2-4806-be69-14566b4e7a35 req-5e7b2920-6fe8-4782-af76-83685a70c34f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:47.927004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ccec77ea-0de2-4806-be69-14566b4e7a35 req-5e7b2920-6fe8-4782-af76-83685a70c34f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:47.930649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ccec77ea-0de2-4806-be69-14566b4e7a35 req-5e7b2920-6fe8-4782-af76-83685a70c34f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:47.936981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-131a3491-7baa-462d-bac9-05ef3b8c1172 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:47.976959 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-131a3491-7baa-462d-bac9-05ef3b8c1172 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1316 microversion: 2.1 time: 0.882388 Aug 18 11:43:47.980726 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ccec77ea-0de2-4806-be69-14566b4e7a35 req-5e7b2920-6fe8-4782-af76-83685a70c34f service nova] Creating event network-vif-deleted:a50e0766-9746-4aff-b289-38c3ba8a396b for instance 6a4aef42-ba37-4d07-9cfb-798c9cab350e on n-h2-853611-3 Aug 18 11:43:48.002465 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ccec77ea-0de2-4806-be69-14566b4e7a35 req-5e7b2920-6fe8-4782-af76-83685a70c34f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122629 Aug 18 11:43:48.002465 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2186/4174] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:48.014064 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1989/4175] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:47 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1316 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:48.023866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f2d1516e-508c-4319-b75d-f09bb7a63a2f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:48.025419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f2d1516e-508c-4319-b75d-f09bb7a63a2f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:48.044350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2d1516e-508c-4319-b75d-f09bb7a63a2f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:48.045350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2d1516e-508c-4319-b75d-f09bb7a63a2f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:48.046177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2d1516e-508c-4319-b75d-f09bb7a63a2f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:48.048128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2d1516e-508c-4319-b75d-f09bb7a63a2f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:48.049005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2d1516e-508c-4319-b75d-f09bb7a63a2f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:48.049863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2d1516e-508c-4319-b75d-f09bb7a63a2f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:48.262106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f2d1516e-508c-4319-b75d-f09bb7a63a2f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:48.276573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f2d1516e-508c-4319-b75d-f09bb7a63a2f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:48.282360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f2d1516e-508c-4319-b75d-f09bb7a63a2f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:48.284094 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f2d1516e-508c-4319-b75d-f09bb7a63a2f tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.288436 Aug 18 11:43:48.287134 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2187/4176] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:47 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:48.680416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6feac431-8e83-4afc-9a36-e406c442dd7a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:48.682517 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6feac431-8e83-4afc-9a36-e406c442dd7a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:48.696151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6feac431-8e83-4afc-9a36-e406c442dd7a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:48.696937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6feac431-8e83-4afc-9a36-e406c442dd7a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:48.698060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6feac431-8e83-4afc-9a36-e406c442dd7a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:48.699744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6feac431-8e83-4afc-9a36-e406c442dd7a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:48.700967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6feac431-8e83-4afc-9a36-e406c442dd7a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:48.701794 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6feac431-8e83-4afc-9a36-e406c442dd7a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:48.984456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6feac431-8e83-4afc-9a36-e406c442dd7a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:48.989080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:49.032218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1cac9225-9c9f-4238-98d3-d52341b04558 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:49.033369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1cac9225-9c9f-4238-98d3-d52341b04558 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:49.036114 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6feac431-8e83-4afc-9a36-e406c442dd7a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 200 len: 1476 microversion: 2.1 time: 0.360631 Aug 18 11:43:49.039432 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1990/4177] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:48 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 1476 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:49.055427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cac9225-9c9f-4238-98d3-d52341b04558 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:49.064400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cac9225-9c9f-4238-98d3-d52341b04558 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:49.065506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cac9225-9c9f-4238-98d3-d52341b04558 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:49.067176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cac9225-9c9f-4238-98d3-d52341b04558 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:49.068396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cac9225-9c9f-4238-98d3-d52341b04558 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:49.069849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cac9225-9c9f-4238-98d3-d52341b04558 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:49.313159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1728a13e-b75e-4d61-91b3-0a593b231c76 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:49.314278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1728a13e-b75e-4d61-91b3-0a593b231c76 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:49.338744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1728a13e-b75e-4d61-91b3-0a593b231c76 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:49.343246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1728a13e-b75e-4d61-91b3-0a593b231c76 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:49.344240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1728a13e-b75e-4d61-91b3-0a593b231c76 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:49.348945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1728a13e-b75e-4d61-91b3-0a593b231c76 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:49.355496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1728a13e-b75e-4d61-91b3-0a593b231c76 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:49.359755 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1728a13e-b75e-4d61-91b3-0a593b231c76 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:49.513327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1cac9225-9c9f-4238-98d3-d52341b04558 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:49.527943 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1cac9225-9c9f-4238-98d3-d52341b04558 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1316 microversion: 2.1 time: 0.502211 Aug 18 11:43:49.529210 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2188/4178] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:49 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:49.552712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1728a13e-b75e-4d61-91b3-0a593b231c76 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:49.576156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1728a13e-b75e-4d61-91b3-0a593b231c76 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:49.580308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1728a13e-b75e-4d61-91b3-0a593b231c76 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:49.582587 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1728a13e-b75e-4d61-91b3-0a593b231c76 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.274360 Aug 18 11:43:49.586915 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1991/4179] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:49 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:43:50.061134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e87e274b-a7fe-4ab7-9863-70752f5fdc96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:50.062124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e87e274b-a7fe-4ab7-9863-70752f5fdc96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: d414d73c-4cbb-4b18-a248-a2f90766ddfa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:50.072295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=10 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:50.075251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e87e274b-a7fe-4ab7-9863-70752f5fdc96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:50.075981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e87e274b-a7fe-4ab7-9863-70752f5fdc96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:50.076649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e87e274b-a7fe-4ab7-9863-70752f5fdc96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:50.077607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e87e274b-a7fe-4ab7-9863-70752f5fdc96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:50.078405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e87e274b-a7fe-4ab7-9863-70752f5fdc96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:50.079086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e87e274b-a7fe-4ab7-9863-70752f5fdc96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:50.096553 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-e87e274b-a7fe-4ab7-9863-70752f5fdc96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] HTTP exception thrown: Instance d414d73c-4cbb-4b18-a248-a2f90766ddfa could not be found. Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e87e274b-a7fe-4ab7-9863-70752f5fdc96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Request method failure captured: Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa HTTP/1.1 Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iWXhE7ktiFHUA6KHkq3wlqtnAzvNZR6iirRlYyNYLjgV_kk4O24NUYiF7UtVtMjs75t1KFx7VtztDWTiSjwpGH36-OAvbON98sW2FkJdDGdUhrQnstdbA7MerWnWStTuchMef-zPHDq7qIyZKuIsA_agazDMsTKR8ju7OuEHr5hV00 Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ca7031777c74405f90c3d5e0ac5cb208 Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ListServerFiltersTestJSON-1836651539 Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca7031777c74405f90c3d5e0ac5cb208"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ca7031777c74405f90c3d5e0ac5cb208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ca7031777c74405f90c3d5e0ac5cb208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca7031777c74405f90c3d5e0ac5cb208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ListServerFiltersTestJSON-1836651539 Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ca7031777c74405f90c3d5e0ac5cb208 Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1836651539 Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ListServerFiltersTestJSON-1836651539-project Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c1196b55b2754c2d8ea983837330d827 Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ListServerFiltersTestJSON-1836651539-project Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance d414d73c-4cbb-4b18-a248-a2f90766ddfa could not be found. Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'd414d73c-4cbb-4b18-a248-a2f90766ddfa'} Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d414d73c-4cbb-4b18-a248-a2f90766ddfa could not be found. Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d414d73c-4cbb-4b18-a248-a2f90766ddfa could not be found. Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:43:50.098765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:50.104028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:50.104028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:43:50.104028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:43:50.104028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:43:50.104028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:43:50.104028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d414d73c-4cbb-4b18-a248-a2f90766ddfa could not be found. Aug 18 11:43:50.104028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:43:50.106624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e87e274b-a7fe-4ab7-9863-70752f5fdc96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Returning 404 to user: Instance d414d73c-4cbb-4b18-a248-a2f90766ddfa could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:43:50.107922 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e87e274b-a7fe-4ab7-9863-70752f5fdc96 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa" status: 404 len: 111 microversion: 2.1 time: 0.050626 Aug 18 11:43:50.118276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0502c9c6-01d3-4232-8f51-bb686c2844ac tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:50.119532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0502c9c6-01d3-4232-8f51-bb686c2844ac tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 60edd382-8eec-45d5-a90b-eeb908026fc8] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:50.124746 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2189/4180] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:50 2022] GET /compute/v2.1/servers/d414d73c-4cbb-4b18-a248-a2f90766ddfa => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:43:50.128065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0502c9c6-01d3-4232-8f51-bb686c2844ac tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:50.128931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0502c9c6-01d3-4232-8f51-bb686c2844ac tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:50.129593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0502c9c6-01d3-4232-8f51-bb686c2844ac tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:50.131542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0502c9c6-01d3-4232-8f51-bb686c2844ac tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:50.132265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0502c9c6-01d3-4232-8f51-bb686c2844ac tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:50.132947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0502c9c6-01d3-4232-8f51-bb686c2844ac tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:50.163231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0502c9c6-01d3-4232-8f51-bb686c2844ac tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 60edd382-8eec-45d5-a90b-eeb908026fc8] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:43:50.259913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-55fcdf9f-d576-4919-89ab-a67ba8c1f1bf req-4fd33d67-c669-48a8-8851-642a0adda7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d414d73c-4cbb-4b18-a248-a2f90766ddfa", "name": "network-vif-deleted", "tag": "7f859f5b-966f-48a6-a8ff-2fe9434494ba"}, {"name": "network-changed", "server_uuid": "0eb953a8-e8bd-44d1-9264-75ae577c5940", "tag": "067f85bb-a79e-4035-966d-9dd9ced69382"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:50.293047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-55fcdf9f-d576-4919-89ab-a67ba8c1f1bf req-4fd33d67-c669-48a8-8851-642a0adda7b7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:50.294229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-55fcdf9f-d576-4919-89ab-a67ba8c1f1bf req-4fd33d67-c669-48a8-8851-642a0adda7b7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:50.294991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-55fcdf9f-d576-4919-89ab-a67ba8c1f1bf req-4fd33d67-c669-48a8-8851-642a0adda7b7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:50.303866 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0502c9c6-01d3-4232-8f51-bb686c2844ac tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "DELETE /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8" status: 204 len: 0 microversion: 2.1 time: 0.190093 Aug 18 11:43:50.305235 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1992/4181] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:43:50 2022] DELETE /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:43:50.323721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e3f715e6-12b0-4fac-8a2a-b4744d64bf0a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:50.324647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e3f715e6-12b0-4fac-8a2a-b4744d64bf0a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 60edd382-8eec-45d5-a90b-eeb908026fc8] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:50.343779 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-55fcdf9f-d576-4919-89ab-a67ba8c1f1bf req-4fd33d67-c669-48a8-8851-642a0adda7b7 service nova] Creating event network-vif-deleted:7f859f5b-966f-48a6-a8ff-2fe9434494ba for instance d414d73c-4cbb-4b18-a248-a2f90766ddfa on n-h1-853611-3 Aug 18 11:43:50.344076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3f715e6-12b0-4fac-8a2a-b4744d64bf0a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:50.344582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3f715e6-12b0-4fac-8a2a-b4744d64bf0a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:50.345021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3f715e6-12b0-4fac-8a2a-b4744d64bf0a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:50.345607 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-55fcdf9f-d576-4919-89ab-a67ba8c1f1bf req-4fd33d67-c669-48a8-8851-642a0adda7b7 service nova] Creating event network-changed:067f85bb-a79e-4035-966d-9dd9ced69382 for instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 on n-h1-853611-3 Aug 18 11:43:50.345755 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3f715e6-12b0-4fac-8a2a-b4744d64bf0a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:50.346171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3f715e6-12b0-4fac-8a2a-b4744d64bf0a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:50.346629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3f715e6-12b0-4fac-8a2a-b4744d64bf0a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:50.358294 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-55fcdf9f-d576-4919-89ab-a67ba8c1f1bf req-4fd33d67-c669-48a8-8851-642a0adda7b7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.103132 Aug 18 11:43:50.359807 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2190/4182] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:50.556055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94ae94ae-ca79-48c5-bd11-948a847fe462 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:50.558173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-94ae94ae-ca79-48c5-bd11-948a847fe462 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:50.573516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ae94ae-ca79-48c5-bd11-948a847fe462 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:50.574019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ae94ae-ca79-48c5-bd11-948a847fe462 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:50.577627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ae94ae-ca79-48c5-bd11-948a847fe462 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:50.578474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ae94ae-ca79-48c5-bd11-948a847fe462 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:50.578963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ae94ae-ca79-48c5-bd11-948a847fe462 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:50.579506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ae94ae-ca79-48c5-bd11-948a847fe462 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:50.766021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-94ae94ae-ca79-48c5-bd11-948a847fe462 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:50.770286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:50.779732 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-94ae94ae-ca79-48c5-bd11-948a847fe462 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1316 microversion: 2.1 time: 0.230882 Aug 18 11:43:50.780494 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2191/4183] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:50 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:43:50.785984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e553602-ee12-4460-a83e-edd118d256ec tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:50.786640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7e553602-ee12-4460-a83e-edd118d256ec tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:50.795058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e553602-ee12-4460-a83e-edd118d256ec tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:50.795637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e553602-ee12-4460-a83e-edd118d256ec tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:50.796301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e553602-ee12-4460-a83e-edd118d256ec tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:50.797246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e553602-ee12-4460-a83e-edd118d256ec tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:50.797708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e553602-ee12-4460-a83e-edd118d256ec tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:50.798139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e553602-ee12-4460-a83e-edd118d256ec tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:50.836815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e3f715e6-12b0-4fac-8a2a-b4744d64bf0a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:50.846245 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e3f715e6-12b0-4fac-8a2a-b4744d64bf0a tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8" status: 200 len: 1519 microversion: 2.1 time: 0.536129 Aug 18 11:43:50.861464 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1993/4184] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:50 2022] GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8 => generated 1519 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:50.909216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7e553602-ee12-4460-a83e-edd118d256ec tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:50.922235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7e553602-ee12-4460-a83e-edd118d256ec tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:50.923885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7e553602-ee12-4460-a83e-edd118d256ec tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:50.925131 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e553602-ee12-4460-a83e-edd118d256ec tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.143499 Aug 18 11:43:50.926031 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2192/4185] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:50 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:51.806690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d6f0716d-e627-4a8c-8e5e-19f92f6ddbd1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:51.811349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d6f0716d-e627-4a8c-8e5e-19f92f6ddbd1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:51.842662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6f0716d-e627-4a8c-8e5e-19f92f6ddbd1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:51.848330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6f0716d-e627-4a8c-8e5e-19f92f6ddbd1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:51.849789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6f0716d-e627-4a8c-8e5e-19f92f6ddbd1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:51.852012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6f0716d-e627-4a8c-8e5e-19f92f6ddbd1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:51.856627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6f0716d-e627-4a8c-8e5e-19f92f6ddbd1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:51.858063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6f0716d-e627-4a8c-8e5e-19f92f6ddbd1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:52.147287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d6f0716d-e627-4a8c-8e5e-19f92f6ddbd1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:52.163601 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d6f0716d-e627-4a8c-8e5e-19f92f6ddbd1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1316 microversion: 2.1 time: 0.365508 Aug 18 11:43:52.164198 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2193/4186] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:51 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:43:52.170197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eff93dee-9179-44b5-81ab-b3b131efdace tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:52.170855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eff93dee-9179-44b5-81ab-b3b131efdace tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 60edd382-8eec-45d5-a90b-eeb908026fc8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:52.182667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eff93dee-9179-44b5-81ab-b3b131efdace tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:52.195217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eff93dee-9179-44b5-81ab-b3b131efdace tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:52.195982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eff93dee-9179-44b5-81ab-b3b131efdace tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:52.196998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eff93dee-9179-44b5-81ab-b3b131efdace tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:52.197635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eff93dee-9179-44b5-81ab-b3b131efdace tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:52.198851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eff93dee-9179-44b5-81ab-b3b131efdace tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:52.318188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-580648a3-aa49-4c62-be75-be99bdb0163f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:52.319102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-580648a3-aa49-4c62-be75-be99bdb0163f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:52.340493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-580648a3-aa49-4c62-be75-be99bdb0163f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:52.341338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-580648a3-aa49-4c62-be75-be99bdb0163f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:52.342083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-580648a3-aa49-4c62-be75-be99bdb0163f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:52.347754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-580648a3-aa49-4c62-be75-be99bdb0163f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:52.348609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-580648a3-aa49-4c62-be75-be99bdb0163f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:52.349982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-580648a3-aa49-4c62-be75-be99bdb0163f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:52.399129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-eff93dee-9179-44b5-81ab-b3b131efdace tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:52.416123 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eff93dee-9179-44b5-81ab-b3b131efdace tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8" status: 200 len: 1519 microversion: 2.1 time: 0.250203 Aug 18 11:43:52.418518 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2194/4187] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:52 2022] GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8 => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:52.429260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2477609-a432-47a1-be7c-71e63489a7e4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:52.430234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b2477609-a432-47a1-be7c-71e63489a7e4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:52.440864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2477609-a432-47a1-be7c-71e63489a7e4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:52.441585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2477609-a432-47a1-be7c-71e63489a7e4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:52.442238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2477609-a432-47a1-be7c-71e63489a7e4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:52.443785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2477609-a432-47a1-be7c-71e63489a7e4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:52.444353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2477609-a432-47a1-be7c-71e63489a7e4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:52.444840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2477609-a432-47a1-be7c-71e63489a7e4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:52.470606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-580648a3-aa49-4c62-be75-be99bdb0163f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:43:52.706174 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-580648a3-aa49-4c62-be75-be99bdb0163f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "DELETE /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 204 len: 0 microversion: 2.32 time: 0.972951 Aug 18 11:43:52.714799 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1994/4188] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:43:51 2022] DELETE /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 0 bytes in 979 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:43:52.714975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b2477609-a432-47a1-be7c-71e63489a7e4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:52.740892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b2477609-a432-47a1-be7c-71e63489a7e4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:52.743866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a8a0d501-3720-4302-b4b0-fcb776af53d9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:52.745002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a8a0d501-3720-4302-b4b0-fcb776af53d9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:52.749169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b2477609-a432-47a1-be7c-71e63489a7e4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:52.755230 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b2477609-a432-47a1-be7c-71e63489a7e4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.334878 Aug 18 11:43:52.756714 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2195/4189] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:52 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:52.784478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8a0d501-3720-4302-b4b0-fcb776af53d9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:52.786086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8a0d501-3720-4302-b4b0-fcb776af53d9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:52.787619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8a0d501-3720-4302-b4b0-fcb776af53d9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:52.792947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8a0d501-3720-4302-b4b0-fcb776af53d9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:52.814275 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8a0d501-3720-4302-b4b0-fcb776af53d9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:52.818873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8a0d501-3720-4302-b4b0-fcb776af53d9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:53.188902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1368f57c-4ebb-4124-a46d-113a3bc7006d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:53.190027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1368f57c-4ebb-4124-a46d-113a3bc7006d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:53.205226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:53.216802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1368f57c-4ebb-4124-a46d-113a3bc7006d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:53.217643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1368f57c-4ebb-4124-a46d-113a3bc7006d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:53.218384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1368f57c-4ebb-4124-a46d-113a3bc7006d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:53.219717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1368f57c-4ebb-4124-a46d-113a3bc7006d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:53.220501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1368f57c-4ebb-4124-a46d-113a3bc7006d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:53.221256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1368f57c-4ebb-4124-a46d-113a3bc7006d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:53.247055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=10 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:53.524973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a8a0d501-3720-4302-b4b0-fcb776af53d9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:53.545750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a8a0d501-3720-4302-b4b0-fcb776af53d9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:53.549943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a8a0d501-3720-4302-b4b0-fcb776af53d9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:53.551727 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a8a0d501-3720-4302-b4b0-fcb776af53d9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 2960 microversion: 2.32 time: 0.829170 Aug 18 11:43:53.553224 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1995/4190] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:52 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 2960 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:53.554184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1368f57c-4ebb-4124-a46d-113a3bc7006d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:53.559293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5a6790bb-05fc-442f-80b4-a05c3e380fd5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:53.560196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5a6790bb-05fc-442f-80b4-a05c3e380fd5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 60edd382-8eec-45d5-a90b-eeb908026fc8] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:53.569797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a6790bb-05fc-442f-80b4-a05c3e380fd5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:53.570533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a6790bb-05fc-442f-80b4-a05c3e380fd5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:53.571151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a6790bb-05fc-442f-80b4-a05c3e380fd5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:53.572062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a6790bb-05fc-442f-80b4-a05c3e380fd5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:53.572686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a6790bb-05fc-442f-80b4-a05c3e380fd5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:53.573558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a6790bb-05fc-442f-80b4-a05c3e380fd5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:53.585122 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1368f57c-4ebb-4124-a46d-113a3bc7006d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1316 microversion: 2.1 time: 0.402968 Aug 18 11:43:53.598465 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2196/4191] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:53 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:53.789869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b478cbec-c329-4fbf-9157-ef7625c925f4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:53.795433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b478cbec-c329-4fbf-9157-ef7625c925f4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:53.807173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b478cbec-c329-4fbf-9157-ef7625c925f4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:53.808733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b478cbec-c329-4fbf-9157-ef7625c925f4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:53.809471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b478cbec-c329-4fbf-9157-ef7625c925f4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:53.810195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b478cbec-c329-4fbf-9157-ef7625c925f4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:53.810739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b478cbec-c329-4fbf-9157-ef7625c925f4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:53.811164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b478cbec-c329-4fbf-9157-ef7625c925f4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:53.944555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b478cbec-c329-4fbf-9157-ef7625c925f4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:53.977203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b478cbec-c329-4fbf-9157-ef7625c925f4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:53.997116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b478cbec-c329-4fbf-9157-ef7625c925f4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:54.015017 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b478cbec-c329-4fbf-9157-ef7625c925f4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.227965 Aug 18 11:43:54.018936 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2197/4192] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:53 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:43:54.592387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7c858a50-4070-4a40-b800-7f48521ffe54 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:54.597389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7c858a50-4070-4a40-b800-7f48521ffe54 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:54.635372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c858a50-4070-4a40-b800-7f48521ffe54 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:54.636731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c858a50-4070-4a40-b800-7f48521ffe54 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:54.637840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c858a50-4070-4a40-b800-7f48521ffe54 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:54.642680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c858a50-4070-4a40-b800-7f48521ffe54 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:54.644117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c858a50-4070-4a40-b800-7f48521ffe54 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:54.645495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c858a50-4070-4a40-b800-7f48521ffe54 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:55.285793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c858a50-4070-4a40-b800-7f48521ffe54 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:55.307202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c858a50-4070-4a40-b800-7f48521ffe54 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:55.310330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c858a50-4070-4a40-b800-7f48521ffe54 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:55.312248 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7c858a50-4070-4a40-b800-7f48521ffe54 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 2960 microversion: 2.32 time: 0.730230 Aug 18 11:43:55.315193 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2198/4193] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:54 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 2960 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:55.327675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b561cc73-10c9-4348-8c4e-9e43da4813c4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:55.332481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b561cc73-10c9-4348-8c4e-9e43da4813c4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:55.345212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b561cc73-10c9-4348-8c4e-9e43da4813c4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:55.350479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b561cc73-10c9-4348-8c4e-9e43da4813c4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:55.351253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b561cc73-10c9-4348-8c4e-9e43da4813c4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:55.352217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b561cc73-10c9-4348-8c4e-9e43da4813c4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:55.353439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b561cc73-10c9-4348-8c4e-9e43da4813c4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:55.355044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b561cc73-10c9-4348-8c4e-9e43da4813c4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:55.614099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5a6790bb-05fc-442f-80b4-a05c3e380fd5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:55.649581 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5a6790bb-05fc-442f-80b4-a05c3e380fd5 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8" status: 200 len: 1519 microversion: 2.1 time: 2.085001 Aug 18 11:43:55.662470 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1996/4194] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:53 2022] GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8 => generated 1519 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:55.667019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e9c1f0ef-2a09-4bdd-bcaf-ee14537f52aa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:55.668191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e9c1f0ef-2a09-4bdd-bcaf-ee14537f52aa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:55.685803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9c1f0ef-2a09-4bdd-bcaf-ee14537f52aa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:55.686660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9c1f0ef-2a09-4bdd-bcaf-ee14537f52aa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:55.687366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9c1f0ef-2a09-4bdd-bcaf-ee14537f52aa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:55.695395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9c1f0ef-2a09-4bdd-bcaf-ee14537f52aa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:55.696355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9c1f0ef-2a09-4bdd-bcaf-ee14537f52aa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:55.697011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e9c1f0ef-2a09-4bdd-bcaf-ee14537f52aa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:55.883661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e9c1f0ef-2a09-4bdd-bcaf-ee14537f52aa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:55.905063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e9c1f0ef-2a09-4bdd-bcaf-ee14537f52aa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:55.922950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b561cc73-10c9-4348-8c4e-9e43da4813c4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:55.923769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e9c1f0ef-2a09-4bdd-bcaf-ee14537f52aa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:55.931012 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e9c1f0ef-2a09-4bdd-bcaf-ee14537f52aa tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.278135 Aug 18 11:43:55.933710 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1997/4195] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:55 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:55.935218 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b561cc73-10c9-4348-8c4e-9e43da4813c4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1316 microversion: 2.1 time: 0.616747 Aug 18 11:43:55.946307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-48e5d648-8bd4-4432-b532-bec4b2ca98c7 req-4c18a2f5-88d9-4fa8-99ee-cce2eb317ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60edd382-8eec-45d5-a90b-eeb908026fc8", "name": "network-vif-deleted", "tag": "46e932b5-9936-4551-8a1a-8af0f5286ff3"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:55.950697 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2199/4196] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:55 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1316 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:55.985090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-48e5d648-8bd4-4432-b532-bec4b2ca98c7 req-4c18a2f5-88d9-4fa8-99ee-cce2eb317ca2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:55.987206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-48e5d648-8bd4-4432-b532-bec4b2ca98c7 req-4c18a2f5-88d9-4fa8-99ee-cce2eb317ca2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:55.989502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-48e5d648-8bd4-4432-b532-bec4b2ca98c7 req-4c18a2f5-88d9-4fa8-99ee-cce2eb317ca2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:56.044131 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-48e5d648-8bd4-4432-b532-bec4b2ca98c7 req-4c18a2f5-88d9-4fa8-99ee-cce2eb317ca2 service nova] Creating event network-vif-deleted:46e932b5-9936-4551-8a1a-8af0f5286ff3 for instance 60edd382-8eec-45d5-a90b-eeb908026fc8 on n-h2-853611-3 Aug 18 11:43:56.056185 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-48e5d648-8bd4-4432-b532-bec4b2ca98c7 req-4c18a2f5-88d9-4fa8-99ee-cce2eb317ca2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119671 Aug 18 11:43:56.058724 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1998/4197] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:43:56.352688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-98705307-4cff-4d24-b918-d0d791108aef tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:56.354906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-98705307-4cff-4d24-b918-d0d791108aef tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:56.376701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98705307-4cff-4d24-b918-d0d791108aef tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:56.377276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98705307-4cff-4d24-b918-d0d791108aef tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:56.377724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98705307-4cff-4d24-b918-d0d791108aef tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:56.383271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98705307-4cff-4d24-b918-d0d791108aef tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:56.383898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98705307-4cff-4d24-b918-d0d791108aef tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:56.384357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98705307-4cff-4d24-b918-d0d791108aef tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:56.522776 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-6bd65662-f7ae-4d91-ab2b-ee43571e37c9 req-bd15b520-4c86-4410-8fd5-8b0f5fd8e554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb953a8-e8bd-44d1-9264-75ae577c5940", "name": "network-vif-plugged", "status": "completed", "tag": "067f85bb-a79e-4035-966d-9dd9ced69382"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:56.547340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6bd65662-f7ae-4d91-ab2b-ee43571e37c9 req-bd15b520-4c86-4410-8fd5-8b0f5fd8e554 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:56.548038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6bd65662-f7ae-4d91-ab2b-ee43571e37c9 req-bd15b520-4c86-4410-8fd5-8b0f5fd8e554 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:56.549116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-6bd65662-f7ae-4d91-ab2b-ee43571e37c9 req-bd15b520-4c86-4410-8fd5-8b0f5fd8e554 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:56.588490 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-6bd65662-f7ae-4d91-ab2b-ee43571e37c9 req-bd15b520-4c86-4410-8fd5-8b0f5fd8e554 service nova] Creating event network-vif-plugged:067f85bb-a79e-4035-966d-9dd9ced69382 for instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 on n-h1-853611-3 Aug 18 11:43:56.596971 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-6bd65662-f7ae-4d91-ab2b-ee43571e37c9 req-bd15b520-4c86-4410-8fd5-8b0f5fd8e554 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077787 Aug 18 11:43:56.602467 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 1999/4198] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:43:56.675513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b6e9a2ff-17cc-49b0-8e1a-3c1ad0066a85 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:56.676403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b6e9a2ff-17cc-49b0-8e1a-3c1ad0066a85 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 60edd382-8eec-45d5-a90b-eeb908026fc8] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:56.704470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6e9a2ff-17cc-49b0-8e1a-3c1ad0066a85 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:56.705415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6e9a2ff-17cc-49b0-8e1a-3c1ad0066a85 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:56.706123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6e9a2ff-17cc-49b0-8e1a-3c1ad0066a85 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:56.714116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6e9a2ff-17cc-49b0-8e1a-3c1ad0066a85 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:56.715681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6e9a2ff-17cc-49b0-8e1a-3c1ad0066a85 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:56.716365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6e9a2ff-17cc-49b0-8e1a-3c1ad0066a85 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:56.752097 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-b6e9a2ff-17cc-49b0-8e1a-3c1ad0066a85 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] HTTP exception thrown: Instance 60edd382-8eec-45d5-a90b-eeb908026fc8 could not be found. Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b6e9a2ff-17cc-49b0-8e1a-3c1ad0066a85 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Request method failure captured: Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8 HTTP/1.1 Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iWXhE7ktiFHUA6KHkq3wlqtnAzvNZR6iirRlYyNYLjgV_kk4O24NUYiF7UtVtMjs75t1KFx7VtztDWTiSjwpGH36-OAvbON98sW2FkJdDGdUhrQnstdbA7MerWnWStTuchMef-zPHDq7qIyZKuIsA_agazDMsTKR8ju7OuEHr5hV00 Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ca7031777c74405f90c3d5e0ac5cb208 Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ListServerFiltersTestJSON-1836651539 Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca7031777c74405f90c3d5e0ac5cb208"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ca7031777c74405f90c3d5e0ac5cb208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ca7031777c74405f90c3d5e0ac5cb208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca7031777c74405f90c3d5e0ac5cb208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ListServerFiltersTestJSON-1836651539 Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ca7031777c74405f90c3d5e0ac5cb208 Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1836651539 Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ListServerFiltersTestJSON-1836651539-project Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: c1196b55b2754c2d8ea983837330d827 Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ListServerFiltersTestJSON-1836651539-project Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 60edd382-8eec-45d5-a90b-eeb908026fc8 could not be found. Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '60edd382-8eec-45d5-a90b-eeb908026fc8'} Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60edd382-8eec-45d5-a90b-eeb908026fc8 could not be found. Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60edd382-8eec-45d5-a90b-eeb908026fc8 could not be found. Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:43:56.759788 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:43:56.769463 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:43:56.769463 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:43:56.769463 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:43:56.769463 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:43:56.769463 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:43:56.769463 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60edd382-8eec-45d5-a90b-eeb908026fc8 could not be found. Aug 18 11:43:56.769463 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:43:56.769463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b6e9a2ff-17cc-49b0-8e1a-3c1ad0066a85 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Returning 404 to user: Instance 60edd382-8eec-45d5-a90b-eeb908026fc8 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:43:56.769463 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b6e9a2ff-17cc-49b0-8e1a-3c1ad0066a85 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8" status: 404 len: 111 microversion: 2.1 time: 0.091425 Aug 18 11:43:56.769463 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2000/4199] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:56 2022] GET /compute/v2.1/servers/60edd382-8eec-45d5-a90b-eeb908026fc8 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:43:56.776244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f36cf9b3-d216-4149-81cf-7c62bab39d9b tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:56.776244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f36cf9b3-d216-4149-81cf-7c62bab39d9b tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:56.792740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f36cf9b3-d216-4149-81cf-7c62bab39d9b tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:56.793242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f36cf9b3-d216-4149-81cf-7c62bab39d9b tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:56.797675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f36cf9b3-d216-4149-81cf-7c62bab39d9b tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:56.798871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f36cf9b3-d216-4149-81cf-7c62bab39d9b tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:56.799528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f36cf9b3-d216-4149-81cf-7c62bab39d9b tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:56.803896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f36cf9b3-d216-4149-81cf-7c62bab39d9b tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:56.870234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f36cf9b3-d216-4149-81cf-7c62bab39d9b tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:43:57.089099 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f36cf9b3-d216-4149-81cf-7c62bab39d9b tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 204 len: 0 microversion: 2.1 time: 0.317857 Aug 18 11:43:57.094772 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2001/4200] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:43:56 2022] DELETE /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:43:57.110027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2c6b958e-4890-440f-8f88-98150806caca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:57.118232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2c6b958e-4890-440f-8f88-98150806caca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:57.150949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c6b958e-4890-440f-8f88-98150806caca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:57.152342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c6b958e-4890-440f-8f88-98150806caca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:57.153034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c6b958e-4890-440f-8f88-98150806caca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:57.155731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c6b958e-4890-440f-8f88-98150806caca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:57.156312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c6b958e-4890-440f-8f88-98150806caca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:57.164015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c6b958e-4890-440f-8f88-98150806caca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:57.182075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-98705307-4cff-4d24-b918-d0d791108aef tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:57.193104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-98705307-4cff-4d24-b918-d0d791108aef tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:57.203389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-98705307-4cff-4d24-b918-d0d791108aef tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:57.208025 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-98705307-4cff-4d24-b918-d0d791108aef tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 2960 microversion: 2.32 time: 0.867393 Aug 18 11:43:57.229074 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2200/4201] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:56 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 2960 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:57.251737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-98a2f88d-6b9d-433f-8b41-157bc48ddd38 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:57.254566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-98a2f88d-6b9d-433f-8b41-157bc48ddd38 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:57.265544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98a2f88d-6b9d-433f-8b41-157bc48ddd38 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:57.266199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98a2f88d-6b9d-433f-8b41-157bc48ddd38 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:57.267676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98a2f88d-6b9d-433f-8b41-157bc48ddd38 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:57.268909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98a2f88d-6b9d-433f-8b41-157bc48ddd38 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:57.269682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98a2f88d-6b9d-433f-8b41-157bc48ddd38 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:57.271522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98a2f88d-6b9d-433f-8b41-157bc48ddd38 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:57.427184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-98a2f88d-6b9d-433f-8b41-157bc48ddd38 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:57.441441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-98a2f88d-6b9d-433f-8b41-157bc48ddd38 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:57.443965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-98a2f88d-6b9d-433f-8b41-157bc48ddd38 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:57.445699 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-98a2f88d-6b9d-433f-8b41-157bc48ddd38 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.215038 Aug 18 11:43:57.446787 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2201/4202] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:57 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:57.453664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c20fc09e-666e-4b0a-8404-f17c248b8fa2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:57.454895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c20fc09e-666e-4b0a-8404-f17c248b8fa2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:57.467980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c20fc09e-666e-4b0a-8404-f17c248b8fa2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:57.469567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c20fc09e-666e-4b0a-8404-f17c248b8fa2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:57.470949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c20fc09e-666e-4b0a-8404-f17c248b8fa2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:57.472203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c20fc09e-666e-4b0a-8404-f17c248b8fa2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:57.472965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c20fc09e-666e-4b0a-8404-f17c248b8fa2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:57.474805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c20fc09e-666e-4b0a-8404-f17c248b8fa2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:57.624234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2c6b958e-4890-440f-8f88-98150806caca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:57.652367 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2c6b958e-4890-440f-8f88-98150806caca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1316 microversion: 2.1 time: 0.558891 Aug 18 11:43:57.666929 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2002/4203] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:57 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1316 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:57.915168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c20fc09e-666e-4b0a-8404-f17c248b8fa2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:57.934106 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c20fc09e-666e-4b0a-8404-f17c248b8fa2 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1518 microversion: 2.1 time: 0.485488 Aug 18 11:43:57.971321 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2202/4204] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:57 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1518 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:58.247411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-410b187d-d107-4cca-b68d-11d30045d71e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:58.248572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-410b187d-d107-4cca-b68d-11d30045d71e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:58.270191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-410b187d-d107-4cca-b68d-11d30045d71e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:58.273214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-410b187d-d107-4cca-b68d-11d30045d71e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:58.274922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-410b187d-d107-4cca-b68d-11d30045d71e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:58.276552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-410b187d-d107-4cca-b68d-11d30045d71e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:58.277702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-410b187d-d107-4cca-b68d-11d30045d71e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:58.278732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-410b187d-d107-4cca-b68d-11d30045d71e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:58.492327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a124aef8-f3d1-4f23-83eb-e82e84691638 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:58.495442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a124aef8-f3d1-4f23-83eb-e82e84691638 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:58.511645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a124aef8-f3d1-4f23-83eb-e82e84691638 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:58.517666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a124aef8-f3d1-4f23-83eb-e82e84691638 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:58.518320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a124aef8-f3d1-4f23-83eb-e82e84691638 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:58.520100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a124aef8-f3d1-4f23-83eb-e82e84691638 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:58.521046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a124aef8-f3d1-4f23-83eb-e82e84691638 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:58.522775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a124aef8-f3d1-4f23-83eb-e82e84691638 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:58.751095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a124aef8-f3d1-4f23-83eb-e82e84691638 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:58.768212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a124aef8-f3d1-4f23-83eb-e82e84691638 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:58.774863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a124aef8-f3d1-4f23-83eb-e82e84691638 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:58.776388 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a124aef8-f3d1-4f23-83eb-e82e84691638 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.289755 Aug 18 11:43:58.794949 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2203/4205] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:58 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:58.807643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d0ed9160-9b79-4b65-9693-719011615bac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:58.808582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d0ed9160-9b79-4b65-9693-719011615bac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:58.816539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0ed9160-9b79-4b65-9693-719011615bac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:58.817460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0ed9160-9b79-4b65-9693-719011615bac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:58.818757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0ed9160-9b79-4b65-9693-719011615bac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:58.819708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0ed9160-9b79-4b65-9693-719011615bac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:58.820387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0ed9160-9b79-4b65-9693-719011615bac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:58.820997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0ed9160-9b79-4b65-9693-719011615bac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:59.091650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-410b187d-d107-4cca-b68d-11d30045d71e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:59.109144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-410b187d-d107-4cca-b68d-11d30045d71e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:59.111003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-410b187d-d107-4cca-b68d-11d30045d71e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:59.112347 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-410b187d-d107-4cca-b68d-11d30045d71e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 2939 microversion: 2.32 time: 0.874894 Aug 18 11:43:59.112942 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2003/4206] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:43:58 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 2939 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:43:59.126846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fcf203a7-d166-4e59-8795-80024ae7d1c1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:43:59.127477 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fcf203a7-d166-4e59-8795-80024ae7d1c1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:43:59.145581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fcf203a7-d166-4e59-8795-80024ae7d1c1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:59.146219 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fcf203a7-d166-4e59-8795-80024ae7d1c1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:59.146937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fcf203a7-d166-4e59-8795-80024ae7d1c1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:59.153411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fcf203a7-d166-4e59-8795-80024ae7d1c1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:43:59.154096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fcf203a7-d166-4e59-8795-80024ae7d1c1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:43:59.154596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fcf203a7-d166-4e59-8795-80024ae7d1c1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:43:59.187069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d0ed9160-9b79-4b65-9693-719011615bac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:43:59.196560 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d0ed9160-9b79-4b65-9693-719011615bac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.399927 Aug 18 11:43:59.198165 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2204/4207] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:58 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:43:59.214466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:43:59.410382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1685105247", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:43:59.517503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] validate_networks() for [('c201add2-2905-4a42-a119-5f0f7b3c5bb7', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:44:00.199247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fcf203a7-d166-4e59-8795-80024ae7d1c1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:00.219064 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fcf203a7-d166-4e59-8795-80024ae7d1c1 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1518 microversion: 2.1 time: 1.103808 Aug 18 11:44:00.239956 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2004/4208] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:43:59 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1518 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:00.263307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-96dc4217-0b93-486d-8b0c-d978dda71fc9 req-1494e50d-09ac-4b53-b8c3-50865d5b03c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-unplugged", "status": "completed", "tag": "7e3a32b5-0288-4b94-9154-5891994bd66b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:00.295035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-96dc4217-0b93-486d-8b0c-d978dda71fc9 req-1494e50d-09ac-4b53-b8c3-50865d5b03c1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:00.295840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-96dc4217-0b93-486d-8b0c-d978dda71fc9 req-1494e50d-09ac-4b53-b8c3-50865d5b03c1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:00.296136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-96dc4217-0b93-486d-8b0c-d978dda71fc9 req-1494e50d-09ac-4b53-b8c3-50865d5b03c1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:00.315793 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-96dc4217-0b93-486d-8b0c-d978dda71fc9 req-1494e50d-09ac-4b53-b8c3-50865d5b03c1 service nova] Creating event network-vif-unplugged:7e3a32b5-0288-4b94-9154-5891994bd66b for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:44:00.331604 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-96dc4217-0b93-486d-8b0c-d978dda71fc9 req-1494e50d-09ac-4b53-b8c3-50865d5b03c1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089746 Aug 18 11:44:00.332232 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2005/4209] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:44:00.342465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:44:00.343426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:44:00.343868 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-398963bf-755f-44e4-a212-15c38f431994 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:00.344782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-398963bf-755f-44e4-a212-15c38f431994 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:00.345176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:44:00.346069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:44:00.347412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:44:00.356861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-398963bf-755f-44e4-a212-15c38f431994 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:00.358043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-398963bf-755f-44e4-a212-15c38f431994 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:00.358714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-398963bf-755f-44e4-a212-15c38f431994 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:00.359762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-398963bf-755f-44e4-a212-15c38f431994 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:00.361334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-398963bf-755f-44e4-a212-15c38f431994 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:00.362390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-398963bf-755f-44e4-a212-15c38f431994 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:00.402775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:00.403901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:00.405421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:00.408701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:00.408701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:00.409997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:00.467541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Getting quotas for project ac6fa3a212e84a2a9ffe62c094f5d89b. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:44:00.481032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Getting quotas for user 50b563ab6ffa4fa5a51b955ee1ccb3b9 and project ac6fa3a212e84a2a9ffe62c094f5d89b. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:44:00.534699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:44:00.541788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:44:00.550555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-398963bf-755f-44e4-a212-15c38f431994 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:00.570944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-398963bf-755f-44e4-a212-15c38f431994 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:00.572897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-398963bf-755f-44e4-a212-15c38f431994 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:00.575769 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-398963bf-755f-44e4-a212-15c38f431994 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.241985 Aug 18 11:44:00.592513 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2006/4210] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:00 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:00.618836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-474cf17e-3103-43f3-8ae2-c7b452d1fd0b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:00.619502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-474cf17e-3103-43f3-8ae2-c7b452d1fd0b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:00.644954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-474cf17e-3103-43f3-8ae2-c7b452d1fd0b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:00.647486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-474cf17e-3103-43f3-8ae2-c7b452d1fd0b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:00.648347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-474cf17e-3103-43f3-8ae2-c7b452d1fd0b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:00.649313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-474cf17e-3103-43f3-8ae2-c7b452d1fd0b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:00.649956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-474cf17e-3103-43f3-8ae2-c7b452d1fd0b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:00.650686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-474cf17e-3103-43f3-8ae2-c7b452d1fd0b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:00.666483 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-35d3dc1d-a178-4abe-b852-7d1ba36c4da6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.260433 Aug 18 11:44:00.671973 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2205/4211] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:43:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:44:00.691524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e81bf88a-d8d6-4176-bf88-e31847bc4583 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:00.694789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e81bf88a-d8d6-4176-bf88-e31847bc4583 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:00.877356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e81bf88a-d8d6-4176-bf88-e31847bc4583 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:00.893034 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e81bf88a-d8d6-4176-bf88-e31847bc4583 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1217 microversion: 2.1 time: 0.212208 Aug 18 11:44:00.901042 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2206/4212] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:00 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1217 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:01.253745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c087080f-0e07-4998-9bec-db1e64395694 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:01.259881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c087080f-0e07-4998-9bec-db1e64395694 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:01.294712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c087080f-0e07-4998-9bec-db1e64395694 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:01.296394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c087080f-0e07-4998-9bec-db1e64395694 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:01.298361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c087080f-0e07-4998-9bec-db1e64395694 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:01.321903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c087080f-0e07-4998-9bec-db1e64395694 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:01.336202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c087080f-0e07-4998-9bec-db1e64395694 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:01.336202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c087080f-0e07-4998-9bec-db1e64395694 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:01.759582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c087080f-0e07-4998-9bec-db1e64395694 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:01.768197 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c087080f-0e07-4998-9bec-db1e64395694 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1518 microversion: 2.1 time: 0.525374 Aug 18 11:44:01.773225 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2207/4213] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:01 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1518 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:01.779113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df1667ee-9ccd-420d-918e-972b24cae4b4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:01.779720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df1667ee-9ccd-420d-918e-972b24cae4b4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:01.797775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df1667ee-9ccd-420d-918e-972b24cae4b4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:01.802518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df1667ee-9ccd-420d-918e-972b24cae4b4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:01.803776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df1667ee-9ccd-420d-918e-972b24cae4b4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:01.805873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df1667ee-9ccd-420d-918e-972b24cae4b4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:01.809629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df1667ee-9ccd-420d-918e-972b24cae4b4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:01.810370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df1667ee-9ccd-420d-918e-972b24cae4b4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:01.940009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df1667ee-9ccd-420d-918e-972b24cae4b4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:01.955652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df1667ee-9ccd-420d-918e-972b24cae4b4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:01.961705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df1667ee-9ccd-420d-918e-972b24cae4b4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:01.967034 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df1667ee-9ccd-420d-918e-972b24cae4b4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.188527 Aug 18 11:44:01.973247 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2208/4214] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:01 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:01.978770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f2ad042a-32db-4f6a-a50f-39361c301549 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:01.986668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f2ad042a-32db-4f6a-a50f-39361c301549 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:01.999534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2ad042a-32db-4f6a-a50f-39361c301549 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:02.000743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2ad042a-32db-4f6a-a50f-39361c301549 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:02.001454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2ad042a-32db-4f6a-a50f-39361c301549 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:02.003002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2ad042a-32db-4f6a-a50f-39361c301549 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:02.005650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2ad042a-32db-4f6a-a50f-39361c301549 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:02.006525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2ad042a-32db-4f6a-a50f-39361c301549 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:02.120448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f2ad042a-32db-4f6a-a50f-39361c301549 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:02.132379 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f2ad042a-32db-4f6a-a50f-39361c301549 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1221 microversion: 2.1 time: 0.157215 Aug 18 11:44:02.142138 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2209/4215] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:01 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1221 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:02.168989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bd3aa562-d232-40c3-9be0-1363e01fe9cc tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:02.169939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bd3aa562-d232-40c3-9be0-1363e01fe9cc tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:02.181747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd3aa562-d232-40c3-9be0-1363e01fe9cc tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:02.182518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd3aa562-d232-40c3-9be0-1363e01fe9cc tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:02.183132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd3aa562-d232-40c3-9be0-1363e01fe9cc tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:02.184956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd3aa562-d232-40c3-9be0-1363e01fe9cc tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:02.185628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd3aa562-d232-40c3-9be0-1363e01fe9cc tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:02.186233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd3aa562-d232-40c3-9be0-1363e01fe9cc tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:02.212061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:02.218418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bd3aa562-d232-40c3-9be0-1363e01fe9cc tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:44:02.284852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-474cf17e-3103-43f3-8ae2-c7b452d1fd0b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:02.321143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-474cf17e-3103-43f3-8ae2-c7b452d1fd0b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:02.322973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-474cf17e-3103-43f3-8ae2-c7b452d1fd0b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:02.330930 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-474cf17e-3103-43f3-8ae2-c7b452d1fd0b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 2918 microversion: 2.32 time: 1.737117 Aug 18 11:44:02.334898 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2007/4216] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:00 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 2918 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:02.379726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-b9ebf7c6-4054-4c21-a9d2-48f5cc50339f req-c30aca46-f92f-4052-af35-a336de1dbdcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-unplugged", "status": "completed", "tag": "24885c1e-8ab4-4480-b962-978b2d7e12d7"}, {"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-unplugged", "status": "completed", "tag": "b3b7c180-3e64-4262-a77c-687b117445ae"}, {"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-unplugged", "status": "completed", "tag": "d548862d-96b8-4389-b950-c025f882d608"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:02.416149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b9ebf7c6-4054-4c21-a9d2-48f5cc50339f req-c30aca46-f92f-4052-af35-a336de1dbdcf service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:02.416640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b9ebf7c6-4054-4c21-a9d2-48f5cc50339f req-c30aca46-f92f-4052-af35-a336de1dbdcf service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:02.418029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b9ebf7c6-4054-4c21-a9d2-48f5cc50339f req-c30aca46-f92f-4052-af35-a336de1dbdcf service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:02.445895 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bd3aa562-d232-40c3-9be0-1363e01fe9cc tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 204 len: 0 microversion: 2.1 time: 0.301325 Aug 18 11:44:02.447095 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2210/4217] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:44:02 2022] DELETE /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:44:02.462400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1d18704d-d125-4d42-890b-3244d8272eb4 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:02.468879 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-b9ebf7c6-4054-4c21-a9d2-48f5cc50339f req-c30aca46-f92f-4052-af35-a336de1dbdcf service nova] Creating event network-vif-unplugged:24885c1e-8ab4-4480-b962-978b2d7e12d7 for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:44:02.469554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1d18704d-d125-4d42-890b-3244d8272eb4 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:02.471690 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-b9ebf7c6-4054-4c21-a9d2-48f5cc50339f req-c30aca46-f92f-4052-af35-a336de1dbdcf service nova] Creating event network-vif-unplugged:b3b7c180-3e64-4262-a77c-687b117445ae for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:44:02.475273 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-b9ebf7c6-4054-4c21-a9d2-48f5cc50339f req-c30aca46-f92f-4052-af35-a336de1dbdcf service nova] Creating event network-vif-unplugged:d548862d-96b8-4389-b950-c025f882d608 for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:44:02.499916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d18704d-d125-4d42-890b-3244d8272eb4 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:02.500891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d18704d-d125-4d42-890b-3244d8272eb4 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:02.502221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d18704d-d125-4d42-890b-3244d8272eb4 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:02.504344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d18704d-d125-4d42-890b-3244d8272eb4 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:02.505125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d18704d-d125-4d42-890b-3244d8272eb4 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:02.505846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d18704d-d125-4d42-890b-3244d8272eb4 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:02.509526 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-b9ebf7c6-4054-4c21-a9d2-48f5cc50339f req-c30aca46-f92f-4052-af35-a336de1dbdcf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.114953 Aug 18 11:44:02.517200 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2008/4218] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:44:02.796495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3f3bc1a2-b98d-4653-ae85-32ccdad592a3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:02.797763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3f3bc1a2-b98d-4653-ae85-32ccdad592a3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:02.823346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f3bc1a2-b98d-4653-ae85-32ccdad592a3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:02.825277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f3bc1a2-b98d-4653-ae85-32ccdad592a3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:02.827024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f3bc1a2-b98d-4653-ae85-32ccdad592a3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:02.828033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f3bc1a2-b98d-4653-ae85-32ccdad592a3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:02.828906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f3bc1a2-b98d-4653-ae85-32ccdad592a3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:02.832258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f3bc1a2-b98d-4653-ae85-32ccdad592a3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:02.897464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1d18704d-d125-4d42-890b-3244d8272eb4 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:02.920492 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1d18704d-d125-4d42-890b-3244d8272eb4 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1665 microversion: 2.1 time: 0.467358 Aug 18 11:44:02.923544 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2211/4219] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:02 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1665 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:03.002169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4ce0b4fe-0fbc-4650-8800-68fdb452170b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:03.003889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4ce0b4fe-0fbc-4650-8800-68fdb452170b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:03.038509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ce0b4fe-0fbc-4650-8800-68fdb452170b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:03.040148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ce0b4fe-0fbc-4650-8800-68fdb452170b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:03.045435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ce0b4fe-0fbc-4650-8800-68fdb452170b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:03.046969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ce0b4fe-0fbc-4650-8800-68fdb452170b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:03.047806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ce0b4fe-0fbc-4650-8800-68fdb452170b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:03.048542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ce0b4fe-0fbc-4650-8800-68fdb452170b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:03.256078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4ce0b4fe-0fbc-4650-8800-68fdb452170b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:03.277473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4ce0b4fe-0fbc-4650-8800-68fdb452170b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:03.279256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4ce0b4fe-0fbc-4650-8800-68fdb452170b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:03.283941 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4ce0b4fe-0fbc-4650-8800-68fdb452170b tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.288291 Aug 18 11:44:03.289185 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2212/4220] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:02 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:44:03.310633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-158ca87b-1267-4e4c-aa3a-073a26ee83e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:03.311571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-158ca87b-1267-4e4c-aa3a-073a26ee83e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:03.327892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-158ca87b-1267-4e4c-aa3a-073a26ee83e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:03.328755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-158ca87b-1267-4e4c-aa3a-073a26ee83e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:03.331409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-158ca87b-1267-4e4c-aa3a-073a26ee83e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:03.332474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-158ca87b-1267-4e4c-aa3a-073a26ee83e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:03.333958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-158ca87b-1267-4e4c-aa3a-073a26ee83e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:03.335945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-158ca87b-1267-4e4c-aa3a-073a26ee83e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:03.492239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-158ca87b-1267-4e4c-aa3a-073a26ee83e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:03.506167 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-158ca87b-1267-4e4c-aa3a-073a26ee83e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1269 microversion: 2.1 time: 0.212165 Aug 18 11:44:03.521463 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2213/4221] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:03 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1269 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:03.543131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a87cc74-a977-4861-855e-9a195ead3e51 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:03.555390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4a87cc74-a977-4861-855e-9a195ead3e51 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:03.571227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a87cc74-a977-4861-855e-9a195ead3e51 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:03.574286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a87cc74-a977-4861-855e-9a195ead3e51 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:03.575721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a87cc74-a977-4861-855e-9a195ead3e51 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:03.577246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a87cc74-a977-4861-855e-9a195ead3e51 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:03.578213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a87cc74-a977-4861-855e-9a195ead3e51 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:03.579018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a87cc74-a977-4861-855e-9a195ead3e51 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:03.656729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3f3bc1a2-b98d-4653-ae85-32ccdad592a3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1196b55b2754c2d8ea983837330d827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca7031777c74405f90c3d5e0ac5cb208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:03.690486 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3f3bc1a2-b98d-4653-ae85-32ccdad592a3 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 200 len: 1476 microversion: 2.1 time: 0.889434 Aug 18 11:44:03.707854 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2009/4222] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:02 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 1476 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:03.713791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-389af384-8c50-4d49-aba5-70b7c6625f85 req-23be78e3-0e1d-4488-a951-2b28d0da6563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0493dbd2-0a0d-4628-95f0-300aa6bd5887", "name": "network-vif-deleted", "tag": "1fb5b3a2-03cf-49b9-8d39-21c1f0c0cea1"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:03.726645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-389af384-8c50-4d49-aba5-70b7c6625f85 req-23be78e3-0e1d-4488-a951-2b28d0da6563 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:03.727897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-389af384-8c50-4d49-aba5-70b7c6625f85 req-23be78e3-0e1d-4488-a951-2b28d0da6563 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:03.728653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-389af384-8c50-4d49-aba5-70b7c6625f85 req-23be78e3-0e1d-4488-a951-2b28d0da6563 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:03.755773 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-389af384-8c50-4d49-aba5-70b7c6625f85 req-23be78e3-0e1d-4488-a951-2b28d0da6563 service nova] Creating event network-vif-deleted:1fb5b3a2-03cf-49b9-8d39-21c1f0c0cea1 for instance 0493dbd2-0a0d-4628-95f0-300aa6bd5887 on n-h2-853611-3 Aug 18 11:44:03.769406 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-389af384-8c50-4d49-aba5-70b7c6625f85 req-23be78e3-0e1d-4488-a951-2b28d0da6563 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057303 Aug 18 11:44:03.775886 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2010/4223] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:44:03.967296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4a87cc74-a977-4861-855e-9a195ead3e51 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:03.973785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-80d2f664-b5f2-492d-8175-813ae6e3cd15 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:03.987771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4a87cc74-a977-4861-855e-9a195ead3e51 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:03.991413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-80d2f664-b5f2-492d-8175-813ae6e3cd15 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:03.992448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4a87cc74-a977-4861-855e-9a195ead3e51 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:03.995538 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4a87cc74-a977-4861-855e-9a195ead3e51 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 2918 microversion: 2.32 time: 0.472078 Aug 18 11:44:03.996277 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2214/4224] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:03 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 2918 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:04.037790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80d2f664-b5f2-492d-8175-813ae6e3cd15 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:04.039383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80d2f664-b5f2-492d-8175-813ae6e3cd15 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:04.040112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80d2f664-b5f2-492d-8175-813ae6e3cd15 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:04.041041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80d2f664-b5f2-492d-8175-813ae6e3cd15 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:04.042116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80d2f664-b5f2-492d-8175-813ae6e3cd15 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:04.045456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80d2f664-b5f2-492d-8175-813ae6e3cd15 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:04.826468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1808752266", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": "none"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:04.924134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:44:04.925004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:44:04.926888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:44:04.927624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:44:04.928333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:44:04.938195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-80d2f664-b5f2-492d-8175-813ae6e3cd15 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:04.963213 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-80d2f664-b5f2-492d-8175-813ae6e3cd15 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1665 microversion: 2.1 time: 1.002081 Aug 18 11:44:04.979480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:04.982465 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2011/4225] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:03 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1665 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:04.991757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:04.993134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:04.994880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:04.996520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:04.997776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:05.014365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-29605131-79f1-48ff-9fab-5c9bb4e9c1bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:05.016109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-29605131-79f1-48ff-9fab-5c9bb4e9c1bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:05.033925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29605131-79f1-48ff-9fab-5c9bb4e9c1bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:05.045315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29605131-79f1-48ff-9fab-5c9bb4e9c1bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:05.046871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29605131-79f1-48ff-9fab-5c9bb4e9c1bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:05.050055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29605131-79f1-48ff-9fab-5c9bb4e9c1bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:05.052431 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29605131-79f1-48ff-9fab-5c9bb4e9c1bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:05.054074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29605131-79f1-48ff-9fab-5c9bb4e9c1bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:05.072952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Getting quotas for project e13ad308c6814d7d82dd8c0afdfa7d02. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:44:05.085068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Getting quotas for user ac9115f76978444088f12ed55fbf43fb and project e13ad308c6814d7d82dd8c0afdfa7d02. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:44:05.094473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:05.132230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:44:05.143961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: ed4e597f-7b9e-49c9-b4e1-c10e051d5472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:44:05.282472 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-29605131-79f1-48ff-9fab-5c9bb4e9c1bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:05.284236 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0316c2c8-e3aa-453e-9d86-d8f7a987c48b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.965394 Aug 18 11:44:05.286134 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2215/4226] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:44:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 18 11:44:05.306750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-29605131-79f1-48ff-9fab-5c9bb4e9c1bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:05.311841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-29605131-79f1-48ff-9fab-5c9bb4e9c1bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:05.313187 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-29605131-79f1-48ff-9fab-5c9bb4e9c1bd tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.329158 Aug 18 11:44:05.313799 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2012/4227] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:04 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:05.318749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5e4d9fd2-03b3-4410-a89c-d430e7e76ef3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:05.320457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5e4d9fd2-03b3-4410-a89c-d430e7e76ef3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:05.338647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-1f94a173-860e-450e-b317-351b8cdbb713 req-d2b5bc02-c5f1-4ccb-82f9-f48d34a336a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-unplugged", "status": "completed", "tag": "d41345fd-e890-44f2-bb0d-38e0419cb39a"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:05.376140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1f94a173-860e-450e-b317-351b8cdbb713 req-d2b5bc02-c5f1-4ccb-82f9-f48d34a336a9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:05.379793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1f94a173-860e-450e-b317-351b8cdbb713 req-d2b5bc02-c5f1-4ccb-82f9-f48d34a336a9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:05.383187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1f94a173-860e-450e-b317-351b8cdbb713 req-d2b5bc02-c5f1-4ccb-82f9-f48d34a336a9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:05.393467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e4d9fd2-03b3-4410-a89c-d430e7e76ef3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:05.417655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e4d9fd2-03b3-4410-a89c-d430e7e76ef3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:05.418677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e4d9fd2-03b3-4410-a89c-d430e7e76ef3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:05.419713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e4d9fd2-03b3-4410-a89c-d430e7e76ef3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:05.421520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e4d9fd2-03b3-4410-a89c-d430e7e76ef3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:05.421808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e4d9fd2-03b3-4410-a89c-d430e7e76ef3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:05.455596 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-1f94a173-860e-450e-b317-351b8cdbb713 req-d2b5bc02-c5f1-4ccb-82f9-f48d34a336a9 service nova] Creating event network-vif-unplugged:d41345fd-e890-44f2-bb0d-38e0419cb39a for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:44:05.489759 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-1f94a173-860e-450e-b317-351b8cdbb713 req-d2b5bc02-c5f1-4ccb-82f9-f48d34a336a9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159961 Aug 18 11:44:05.491265 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2013/4228] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:44:05.509605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2a741675-4fc5-405a-96c1-acd0de8a3c31 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:05.511236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2a741675-4fc5-405a-96c1-acd0de8a3c31 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] [instance: 0493dbd2-0a0d-4628-95f0-300aa6bd5887] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:05.530152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a741675-4fc5-405a-96c1-acd0de8a3c31 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:05.535225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a741675-4fc5-405a-96c1-acd0de8a3c31 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:05.536934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a741675-4fc5-405a-96c1-acd0de8a3c31 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:05.538445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a741675-4fc5-405a-96c1-acd0de8a3c31 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:05.540584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a741675-4fc5-405a-96c1-acd0de8a3c31 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:05.541401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a741675-4fc5-405a-96c1-acd0de8a3c31 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:05.574607 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-2a741675-4fc5-405a-96c1-acd0de8a3c31 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] HTTP exception thrown: Instance 0493dbd2-0a0d-4628-95f0-300aa6bd5887 could not be found. Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2a741675-4fc5-405a-96c1-acd0de8a3c31 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Request method failure captured: Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 HTTP/1.1 Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iWXhE7ktiFHUA6KHkq3wlqtnAzvNZR6iirRlYyNYLjgV_kk4O24NUYiF7UtVtMjs75t1KFx7VtztDWTiSjwpGH36-OAvbON98sW2FkJdDGdUhrQnstdbA7MerWnWStTuchMef-zPHDq7qIyZKuIsA_agazDMsTKR8ju7OuEHr5hV00 Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ca7031777c74405f90c3d5e0ac5cb208 Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ListServerFiltersTestJSON-1836651539 Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca7031777c74405f90c3d5e0ac5cb208"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ca7031777c74405f90c3d5e0ac5cb208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ca7031777c74405f90c3d5e0ac5cb208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ca7031777c74405f90c3d5e0ac5cb208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ListServerFiltersTestJSON-1836651539 Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ca7031777c74405f90c3d5e0ac5cb208 Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1836651539 Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ListServerFiltersTestJSON-1836651539-project Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: c1196b55b2754c2d8ea983837330d827 Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ListServerFiltersTestJSON-1836651539-project Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 0493dbd2-0a0d-4628-95f0-300aa6bd5887 could not be found. Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '0493dbd2-0a0d-4628-95f0-300aa6bd5887'} Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0493dbd2-0a0d-4628-95f0-300aa6bd5887 could not be found. Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0493dbd2-0a0d-4628-95f0-300aa6bd5887 could not be found. Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:05.577645 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0493dbd2-0a0d-4628-95f0-300aa6bd5887 could not be found. Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2a741675-4fc5-405a-96c1-acd0de8a3c31 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] Returning 404 to user: Instance 0493dbd2-0a0d-4628-95f0-300aa6bd5887 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2a741675-4fc5-405a-96c1-acd0de8a3c31 tempest-ListServerFiltersTestJSON-1836651539 tempest-ListServerFiltersTestJSON-1836651539-project] 10.222.0.73 "GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887" status: 404 len: 111 microversion: 2.1 time: 0.087854 Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2014/4229] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:05 2022] GET /compute/v2.1/servers/0493dbd2-0a0d-4628-95f0-300aa6bd5887 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4c72260e-1816-4466-989e-7523ab7b94b3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4c72260e-1816-4466-989e-7523ab7b94b3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4c72260e-1816-4466-989e-7523ab7b94b3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4c72260e-1816-4466-989e-7523ab7b94b3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4c72260e-1816-4466-989e-7523ab7b94b3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4c72260e-1816-4466-989e-7523ab7b94b3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4c72260e-1816-4466-989e-7523ab7b94b3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:05.693577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4c72260e-1816-4466-989e-7523ab7b94b3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:05.701937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5e4d9fd2-03b3-4410-a89c-d430e7e76ef3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:05.701937 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5e4d9fd2-03b3-4410-a89c-d430e7e76ef3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1275 microversion: 2.1 time: 0.358283 Aug 18 11:44:05.701937 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2216/4230] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:05 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1275 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:05.701937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6b7c91b9-1085-4c3e-8ca5-0da77f52c208 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:05.701937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6b7c91b9-1085-4c3e-8ca5-0da77f52c208 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: ed4e597f-7b9e-49c9-b4e1-c10e051d5472] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:06.061148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6b7c91b9-1085-4c3e-8ca5-0da77f52c208 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:06.075031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6b7c91b9-1085-4c3e-8ca5-0da77f52c208 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:06.079841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6b7c91b9-1085-4c3e-8ca5-0da77f52c208 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:06.084654 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6b7c91b9-1085-4c3e-8ca5-0da77f52c208 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/ed4e597f-7b9e-49c9-b4e1-c10e051d5472" status: 200 len: 1278 microversion: 2.47 time: 0.430430 Aug 18 11:44:06.089015 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2217/4231] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:05 2022] GET /compute/v2.1/servers/ed4e597f-7b9e-49c9-b4e1-c10e051d5472 => generated 1278 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:06.100317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dfcd17af-6bd6-4fbe-93cd-a2e0272c06e8 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:06.103732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dfcd17af-6bd6-4fbe-93cd-a2e0272c06e8 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:06.123582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfcd17af-6bd6-4fbe-93cd-a2e0272c06e8 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:06.124872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfcd17af-6bd6-4fbe-93cd-a2e0272c06e8 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:06.126016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfcd17af-6bd6-4fbe-93cd-a2e0272c06e8 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:06.126972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfcd17af-6bd6-4fbe-93cd-a2e0272c06e8 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:06.134981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfcd17af-6bd6-4fbe-93cd-a2e0272c06e8 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:06.136104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfcd17af-6bd6-4fbe-93cd-a2e0272c06e8 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:07.023206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dfcd17af-6bd6-4fbe-93cd-a2e0272c06e8 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:07.033058 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dfcd17af-6bd6-4fbe-93cd-a2e0272c06e8 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1665 microversion: 2.1 time: 0.942472 Aug 18 11:44:07.037049 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2218/4232] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:06 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1665 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:07.042789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c69169aa-a201-43a5-9295-a6705478e159 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:07.044139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c69169aa-a201-43a5-9295-a6705478e159 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:07.052785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c69169aa-a201-43a5-9295-a6705478e159 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:07.053773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c69169aa-a201-43a5-9295-a6705478e159 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:07.055036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c69169aa-a201-43a5-9295-a6705478e159 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:07.056034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c69169aa-a201-43a5-9295-a6705478e159 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:07.056727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c69169aa-a201-43a5-9295-a6705478e159 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:07.057400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c69169aa-a201-43a5-9295-a6705478e159 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:07.828872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c69169aa-a201-43a5-9295-a6705478e159 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:07.845356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c69169aa-a201-43a5-9295-a6705478e159 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:07.850930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c69169aa-a201-43a5-9295-a6705478e159 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:07.857378 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c69169aa-a201-43a5-9295-a6705478e159 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1602 microversion: 2.42 time: 0.818849 Aug 18 11:44:07.858382 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2219/4233] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:07 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1602 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:07.874837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-485727688", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": "none"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:07.970126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:44:07.970792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:44:07.971414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:44:07.971951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:44:07.973411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:44:07.989345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:07.990131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:07.990754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:07.991691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:07.992297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:07.992863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:08.017478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Getting quotas for project e13ad308c6814d7d82dd8c0afdfa7d02. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:44:08.025289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Getting quotas for user ac9115f76978444088f12ed55fbf43fb and project e13ad308c6814d7d82dd8c0afdfa7d02. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:44:08.042137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:44:08.044618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:44:08.077221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4c72260e-1816-4466-989e-7523ab7b94b3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:08.100926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4c72260e-1816-4466-989e-7523ab7b94b3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:08.109462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4c72260e-1816-4466-989e-7523ab7b94b3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:08.114038 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4c72260e-1816-4466-989e-7523ab7b94b3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 2871 microversion: 2.32 time: 2.523976 Aug 18 11:44:08.117601 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2015/4234] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:05 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 2871 bytes in 2529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:08.127895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4cd6ec63-f0d3-403f-87f2-6fb430935204 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:08.128873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4cd6ec63-f0d3-403f-87f2-6fb430935204 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:08.147646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cd6ec63-f0d3-403f-87f2-6fb430935204 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:08.148551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cd6ec63-f0d3-403f-87f2-6fb430935204 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:08.150001 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cd6ec63-f0d3-403f-87f2-6fb430935204 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:08.152055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cd6ec63-f0d3-403f-87f2-6fb430935204 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:08.155119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cd6ec63-f0d3-403f-87f2-6fb430935204 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:08.155835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cd6ec63-f0d3-403f-87f2-6fb430935204 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:08.169674 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-19ce60dd-bc5d-46f8-8f25-2374194809d1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.309741 Aug 18 11:44:08.175235 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2220/4235] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:44:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 316 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 11:44:08.196875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-b890031c-8cd8-48aa-9fa6-96b55cb5e31a req-c20ec3b7-ec06-45e0-8198-9fde6c578b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-deleted", "tag": "24885c1e-8ab4-4480-b962-978b2d7e12d7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:08.224101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b890031c-8cd8-48aa-9fa6-96b55cb5e31a req-c20ec3b7-ec06-45e0-8198-9fde6c578b08 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:08.226404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b890031c-8cd8-48aa-9fa6-96b55cb5e31a req-c20ec3b7-ec06-45e0-8198-9fde6c578b08 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:08.227211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b890031c-8cd8-48aa-9fa6-96b55cb5e31a req-c20ec3b7-ec06-45e0-8198-9fde6c578b08 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:08.250724 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-b890031c-8cd8-48aa-9fa6-96b55cb5e31a req-c20ec3b7-ec06-45e0-8198-9fde6c578b08 service nova] Creating event network-vif-deleted:24885c1e-8ab4-4480-b962-978b2d7e12d7 for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:44:08.262868 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-b890031c-8cd8-48aa-9fa6-96b55cb5e31a req-c20ec3b7-ec06-45e0-8198-9fde6c578b08 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083407 Aug 18 11:44:08.264515 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2221/4236] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:44:08.274902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06109bff-7950-4e67-beea-b48b57be36d1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:08.277879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-06109bff-7950-4e67-beea-b48b57be36d1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:08.290132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06109bff-7950-4e67-beea-b48b57be36d1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:08.291038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06109bff-7950-4e67-beea-b48b57be36d1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:08.292710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06109bff-7950-4e67-beea-b48b57be36d1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:08.294288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06109bff-7950-4e67-beea-b48b57be36d1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:08.295153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06109bff-7950-4e67-beea-b48b57be36d1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:08.296181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06109bff-7950-4e67-beea-b48b57be36d1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:09.027969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-06109bff-7950-4e67-beea-b48b57be36d1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:09.043907 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-06109bff-7950-4e67-beea-b48b57be36d1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1665 microversion: 2.1 time: 0.777487 Aug 18 11:44:09.050374 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2222/4237] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:08 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1665 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:09.063596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b0a6f4ec-9b3c-4507-aea0-597da9e54c62 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:09.069694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b0a6f4ec-9b3c-4507-aea0-597da9e54c62 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:09.180511 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b0a6f4ec-9b3c-4507-aea0-597da9e54c62 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "PUT /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 991 microversion: 2.47 time: 0.117752 Aug 18 11:44:09.194778 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2223/4238] 10.222.0.73 () {62 vars in 1297 bytes} [Thu Aug 18 11:44:09 2022] PUT /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 991 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:44:09.213119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:09.216065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:09.241454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:09.243425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:09.245056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:09.253880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:09.254790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:09.255779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:09.317761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:09.318410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:09.319029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:09.319689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lazy-loading 'fault' on Instance uuid 3cf6bf58-dceb-4e27-9d99-c8139ed38fce {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:44:09.329723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4cd6ec63-f0d3-403f-87f2-6fb430935204 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:09.344550 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4cd6ec63-f0d3-403f-87f2-6fb430935204 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1275 microversion: 2.1 time: 1.225461 Aug 18 11:44:09.345146 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2016/4239] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:08 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1275 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:09.355359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-26ad9606-f593-4b4e-a312-99c4e2e09e4a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:09.358003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-26ad9606-f593-4b4e-a312-99c4e2e09e4a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:09.378715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26ad9606-f593-4b4e-a312-99c4e2e09e4a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:09.380197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26ad9606-f593-4b4e-a312-99c4e2e09e4a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:09.380789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26ad9606-f593-4b4e-a312-99c4e2e09e4a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:09.383746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26ad9606-f593-4b4e-a312-99c4e2e09e4a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:09.384308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26ad9606-f593-4b4e-a312-99c4e2e09e4a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:09.384754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-26ad9606-f593-4b4e-a312-99c4e2e09e4a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:09.399486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:09.420985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:09.428570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4d6302ebc22e490bbac83b5b218b3b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32aff83e4a644a59a1e1e8f0000864a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:09.439368 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-85f25359-d913-4512-8b2c-aee2d68ebc03 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 200 len: 1607 microversion: 2.42 time: 0.243149 Aug 18 11:44:09.440518 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2224/4240] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:09 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 1607 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:09.455148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e3073ab9-a7f3-463e-82d9-f90ffc47c31d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:09.455996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e3073ab9-a7f3-463e-82d9-f90ffc47c31d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:09.468415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3073ab9-a7f3-463e-82d9-f90ffc47c31d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:09.469442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3073ab9-a7f3-463e-82d9-f90ffc47c31d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:09.471777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3073ab9-a7f3-463e-82d9-f90ffc47c31d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:09.472901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3073ab9-a7f3-463e-82d9-f90ffc47c31d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:09.473532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3073ab9-a7f3-463e-82d9-f90ffc47c31d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:09.474295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3073ab9-a7f3-463e-82d9-f90ffc47c31d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:09.677263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e3073ab9-a7f3-463e-82d9-f90ffc47c31d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:09.703512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e3073ab9-a7f3-463e-82d9-f90ffc47c31d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:09.709976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e3073ab9-a7f3-463e-82d9-f90ffc47c31d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:09.713942 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e3073ab9-a7f3-463e-82d9-f90ffc47c31d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1281 microversion: 2.47 time: 0.269552 Aug 18 11:44:09.714637 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2225/4241] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:09 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1281 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:10.087482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d52dd46a-2db0-469f-a8cf-b8af768b9b09 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:10.089064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d52dd46a-2db0-469f-a8cf-b8af768b9b09 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:10.101923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d52dd46a-2db0-469f-a8cf-b8af768b9b09 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:10.104687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d52dd46a-2db0-469f-a8cf-b8af768b9b09 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:10.106849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d52dd46a-2db0-469f-a8cf-b8af768b9b09 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:10.108372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d52dd46a-2db0-469f-a8cf-b8af768b9b09 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:10.111061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d52dd46a-2db0-469f-a8cf-b8af768b9b09 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:10.111839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d52dd46a-2db0-469f-a8cf-b8af768b9b09 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:10.340846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d52dd46a-2db0-469f-a8cf-b8af768b9b09 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:10.355321 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d52dd46a-2db0-469f-a8cf-b8af768b9b09 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1598 microversion: 2.1 time: 0.271935 Aug 18 11:44:10.356397 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2226/4242] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:10 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1598 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:10.397280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f21c199-a91e-40c3-8666-6cc529a6a683 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:10.400855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7f21c199-a91e-40c3-8666-6cc529a6a683 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:10.415673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f21c199-a91e-40c3-8666-6cc529a6a683 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:10.416648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f21c199-a91e-40c3-8666-6cc529a6a683 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:10.417642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f21c199-a91e-40c3-8666-6cc529a6a683 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:10.419272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f21c199-a91e-40c3-8666-6cc529a6a683 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:10.420537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f21c199-a91e-40c3-8666-6cc529a6a683 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:10.422463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f21c199-a91e-40c3-8666-6cc529a6a683 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:10.645629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7f21c199-a91e-40c3-8666-6cc529a6a683 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:10.663351 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7f21c199-a91e-40c3-8666-6cc529a6a683 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1275 microversion: 2.1 time: 0.298862 Aug 18 11:44:10.665293 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2227/4243] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:10 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1275 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:10.674854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-901b358f-417d-4542-a5fd-1e8e19500cc3 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:10.684133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-901b358f-417d-4542-a5fd-1e8e19500cc3 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:10.724107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-901b358f-417d-4542-a5fd-1e8e19500cc3 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:10.724970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-901b358f-417d-4542-a5fd-1e8e19500cc3 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:10.726685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-26ad9606-f593-4b4e-a312-99c4e2e09e4a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:10.729544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-901b358f-417d-4542-a5fd-1e8e19500cc3 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:10.732185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-901b358f-417d-4542-a5fd-1e8e19500cc3 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:10.733028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-901b358f-417d-4542-a5fd-1e8e19500cc3 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:10.733797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-901b358f-417d-4542-a5fd-1e8e19500cc3 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:10.743146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-26ad9606-f593-4b4e-a312-99c4e2e09e4a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:10.748526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-26ad9606-f593-4b4e-a312-99c4e2e09e4a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:10.750187 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-26ad9606-f593-4b4e-a312-99c4e2e09e4a tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 2537 microversion: 2.32 time: 1.402484 Aug 18 11:44:10.752749 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2017/4244] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:09 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 2537 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:10.762692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-60d3166f-0fd2-4071-b345-7942096d260b req-dca440fc-624b-4c2a-b0b9-e6029aad5476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-deleted", "tag": "d548862d-96b8-4389-b950-c025f882d608"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:10.785117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-60d3166f-0fd2-4071-b345-7942096d260b req-dca440fc-624b-4c2a-b0b9-e6029aad5476 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:10.787862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-60d3166f-0fd2-4071-b345-7942096d260b req-dca440fc-624b-4c2a-b0b9-e6029aad5476 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:10.790052 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-901b358f-417d-4542-a5fd-1e8e19500cc3 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] HTTP exception thrown: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:10.790886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-60d3166f-0fd2-4071-b345-7942096d260b req-dca440fc-624b-4c2a-b0b9-e6029aad5476 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-901b358f-417d-4542-a5fd-1e8e19500cc3 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Request method failure captured: Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce HTTP/1.1 Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iRnH2QnEZcbVd_E_481iRNNM-IwbiL6o-tpXLM6m_CN2eKBD9XbQxUEvk76JlXdPc-MccGPvRGrbhUVfunMMoraSzZ-sHlmwm0ZNo_6KpwfOjBMo-Z5iKUJClxW2Et69hMqbb7dIGpmLB8LI2I5cOTBycO0Q5X2pdM31kHlGBA3R-8 Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.42 Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: d32aff83e4a644a59a1e1e8f0000864a Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1627059685 Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d32aff83e4a644a59a1e1e8f0000864a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d32aff83e4a644a59a1e1e8f0000864a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d32aff83e4a644a59a1e1e8f0000864a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d32aff83e4a644a59a1e1e8f0000864a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1627059685 Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: d32aff83e4a644a59a1e1e8f0000864a Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1627059685 Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TaggedBootDevicesTest_v242-1627059685-project Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 4d6302ebc22e490bbac83b5b218b3b84 Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1627059685-project Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '3cf6bf58-dceb-4e27-9d99-c8139ed38fce'} Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:10.796583 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:10.799794 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:10.799794 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:10.799794 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:10.799794 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:10.799794 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:44:10.799794 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:44:10.799794 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:10.799794 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:10.803475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-901b358f-417d-4542-a5fd-1e8e19500cc3 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Returning 404 to user: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:10.805046 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-901b358f-417d-4542-a5fd-1e8e19500cc3 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 404 len: 111 microversion: 2.42 time: 0.134955 Aug 18 11:44:10.812183 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2228/4245] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:10 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:44:10.836450 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-60d3166f-0fd2-4071-b345-7942096d260b req-dca440fc-624b-4c2a-b0b9-e6029aad5476 service nova] Creating event network-vif-deleted:d548862d-96b8-4389-b950-c025f882d608 for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:44:10.842016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f7790387-ed33-433f-adfd-5f8bf269fb3d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:10.850096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f7790387-ed33-433f-adfd-5f8bf269fb3d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:10.851429 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-60d3166f-0fd2-4071-b345-7942096d260b req-dca440fc-624b-4c2a-b0b9-e6029aad5476 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096379 Aug 18 11:44:10.852903 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2018/4246] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:44:10.864569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-805e7f85-2f32-4a33-b1a5-3132ea529157 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '.version_select at 0x7f519fabfd30>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:10.875950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7790387-ed33-433f-adfd-5f8bf269fb3d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:10.876528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7790387-ed33-433f-adfd-5f8bf269fb3d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:10.877073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7790387-ed33-433f-adfd-5f8bf269fb3d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:10.877822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7790387-ed33-433f-adfd-5f8bf269fb3d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:10.878288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7790387-ed33-433f-adfd-5f8bf269fb3d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:10.878829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7790387-ed33-433f-adfd-5f8bf269fb3d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:10.931441 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-805e7f85-2f32-4a33-b1a5-3132ea529157 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-40434335" status: 204 len: 0 microversion: 2.42 time: 0.076236 Aug 18 11:44:10.937066 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2019/4247] 10.222.0.73 () {60 vars in 1256 bytes} [Thu Aug 18 11:44:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-40434335 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:44:10.985829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:11.117609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f7790387-ed33-433f-adfd-5f8bf269fb3d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:11.134178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f7790387-ed33-433f-adfd-5f8bf269fb3d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:11.146104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f7790387-ed33-433f-adfd-5f8bf269fb3d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:11.147342 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f7790387-ed33-433f-adfd-5f8bf269fb3d tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1337 microversion: 2.47 time: 0.331311 Aug 18 11:44:11.154658 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2229/4248] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:10 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1337 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:11.401672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-345e1c28-1d6e-4d01-a73f-0b913b0c94a1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:11.406856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-345e1c28-1d6e-4d01-a73f-0b913b0c94a1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:11.433827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-345e1c28-1d6e-4d01-a73f-0b913b0c94a1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:11.437620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-345e1c28-1d6e-4d01-a73f-0b913b0c94a1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:11.442478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-345e1c28-1d6e-4d01-a73f-0b913b0c94a1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:11.448554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-345e1c28-1d6e-4d01-a73f-0b913b0c94a1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:11.449490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-345e1c28-1d6e-4d01-a73f-0b913b0c94a1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:11.451806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-345e1c28-1d6e-4d01-a73f-0b913b0c94a1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:11.590350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-887593602", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": "none"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:11.724116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-345e1c28-1d6e-4d01-a73f-0b913b0c94a1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:11.736301 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-345e1c28-1d6e-4d01-a73f-0b913b0c94a1 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1598 microversion: 2.1 time: 0.343521 Aug 18 11:44:11.751783 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2230/4249] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:11 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1598 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:11.764377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5d65ac36-b2e2-4faa-b791-7f62b461b65b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:11.765470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:44:11.766049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:44:11.766805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:44:11.767020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5d65ac36-b2e2-4faa-b791-7f62b461b65b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:11.767435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:44:11.767972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:44:11.782410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:11.783723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:11.784112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d65ac36-b2e2-4faa-b791-7f62b461b65b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:11.784606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d65ac36-b2e2-4faa-b791-7f62b461b65b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:11.784952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:11.785145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d65ac36-b2e2-4faa-b791-7f62b461b65b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:11.786049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d65ac36-b2e2-4faa-b791-7f62b461b65b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:11.786685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d65ac36-b2e2-4faa-b791-7f62b461b65b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:11.787005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:11.787893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:11.789861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d65ac36-b2e2-4faa-b791-7f62b461b65b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:11.796155 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:11.829959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Getting quotas for project 6ed53d121caa4ae9bff6da6e5e70c22a. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:44:11.839540 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Getting quotas for user 481410c21e374872bdf5694c2c47c62e and project 6ed53d121caa4ae9bff6da6e5e70c22a. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:44:11.858788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:44:11.862404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] [instance: dbb00326-eff9-4836-9d1b-c024a219717b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:44:11.929632 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-549ae49a-471d-445f-82ec-0c3eaf6ee7a2 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.673148 Aug 18 11:44:11.931237 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2020/4250] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:44:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 11:44:11.938959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5bda8697-5869-4652-86c8-55f91f49a719 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:11.939908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5bda8697-5869-4652-86c8-55f91f49a719 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:11.960414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bda8697-5869-4652-86c8-55f91f49a719 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:11.960920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bda8697-5869-4652-86c8-55f91f49a719 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:11.961474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bda8697-5869-4652-86c8-55f91f49a719 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:11.974636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bda8697-5869-4652-86c8-55f91f49a719 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:11.975244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bda8697-5869-4652-86c8-55f91f49a719 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:11.975690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bda8697-5869-4652-86c8-55f91f49a719 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:12.186668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5d65ac36-b2e2-4faa-b791-7f62b461b65b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:12.210032 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5d65ac36-b2e2-4faa-b791-7f62b461b65b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1317 microversion: 2.1 time: 0.457045 Aug 18 11:44:12.210957 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2231/4251] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:11 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:12.219337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4cc06454-f8fd-4f63-9100-3fc9b579ed46 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:12.219337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4cc06454-f8fd-4f63-9100-3fc9b579ed46 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] [instance: dbb00326-eff9-4836-9d1b-c024a219717b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:12.345228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4cc06454-f8fd-4f63-9100-3fc9b579ed46 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:12.358169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4cc06454-f8fd-4f63-9100-3fc9b579ed46 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:12.362910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4cc06454-f8fd-4f63-9100-3fc9b579ed46 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:12.370769 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4cc06454-f8fd-4f63-9100-3fc9b579ed46 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b" status: 200 len: 1280 microversion: 2.47 time: 0.152769 Aug 18 11:44:12.372072 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2232/4252] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:12 2022] GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b => generated 1280 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:12.378289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-752f3b3c-121e-40ee-ad6b-7231120c7092 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:12.381958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-752f3b3c-121e-40ee-ad6b-7231120c7092 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:12.392768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-752f3b3c-121e-40ee-ad6b-7231120c7092 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:12.393491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-752f3b3c-121e-40ee-ad6b-7231120c7092 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:12.394196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-752f3b3c-121e-40ee-ad6b-7231120c7092 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:12.395340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-752f3b3c-121e-40ee-ad6b-7231120c7092 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:12.395957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-752f3b3c-121e-40ee-ad6b-7231120c7092 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:12.396706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-752f3b3c-121e-40ee-ad6b-7231120c7092 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:12.913981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-752f3b3c-121e-40ee-ad6b-7231120c7092 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:12.922642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-752f3b3c-121e-40ee-ad6b-7231120c7092 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:12.924453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-752f3b3c-121e-40ee-ad6b-7231120c7092 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:12.926352 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-752f3b3c-121e-40ee-ad6b-7231120c7092 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1335 microversion: 2.47 time: 0.552535 Aug 18 11:44:12.939047 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2233/4253] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:12 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1335 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:12.950603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c52ce319-d534-4e5f-8c2f-747f84a4438f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:12.951508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c52ce319-d534-4e5f-8c2f-747f84a4438f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:12.958746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52ce319-d534-4e5f-8c2f-747f84a4438f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:12.959695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52ce319-d534-4e5f-8c2f-747f84a4438f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:12.960293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52ce319-d534-4e5f-8c2f-747f84a4438f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:12.961178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52ce319-d534-4e5f-8c2f-747f84a4438f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:12.961810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52ce319-d534-4e5f-8c2f-747f84a4438f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:12.962578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52ce319-d534-4e5f-8c2f-747f84a4438f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:13.261569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c52ce319-d534-4e5f-8c2f-747f84a4438f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272a104b54e1450ea94761c135b7c0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7efdad3bc1194e1794de97e8d64efe88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:13.298202 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c52ce319-d534-4e5f-8c2f-747f84a4438f tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 200 len: 1598 microversion: 2.1 time: 0.357315 Aug 18 11:44:13.299262 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2234/4254] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:12 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 1598 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:13.324156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2f246ce4-b964-4ee3-a81c-d1553dfa8eab req-3f12176c-4cb4-49b0-8ea9-e675191f3872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf62232-2b1e-47fa-8743-8ddcf11b891e", "name": "network-vif-deleted", "tag": "11027fa7-e822-45c3-a79b-db78ee3a31d4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:13.344975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5bda8697-5869-4652-86c8-55f91f49a719 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:13.365039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2f246ce4-b964-4ee3-a81c-d1553dfa8eab req-3f12176c-4cb4-49b0-8ea9-e675191f3872 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:13.365382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2f246ce4-b964-4ee3-a81c-d1553dfa8eab req-3f12176c-4cb4-49b0-8ea9-e675191f3872 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:13.370843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2f246ce4-b964-4ee3-a81c-d1553dfa8eab req-3f12176c-4cb4-49b0-8ea9-e675191f3872 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:13.385568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5bda8697-5869-4652-86c8-55f91f49a719 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:13.388572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5bda8697-5869-4652-86c8-55f91f49a719 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:13.401669 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5bda8697-5869-4652-86c8-55f91f49a719 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 2423 microversion: 2.32 time: 1.467607 Aug 18 11:44:13.406596 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2f246ce4-b964-4ee3-a81c-d1553dfa8eab req-3f12176c-4cb4-49b0-8ea9-e675191f3872 service nova] Creating event network-vif-deleted:11027fa7-e822-45c3-a79b-db78ee3a31d4 for instance 8cf62232-2b1e-47fa-8743-8ddcf11b891e on n-h1-853611-3 Aug 18 11:44:13.417212 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2f246ce4-b964-4ee3-a81c-d1553dfa8eab req-3f12176c-4cb4-49b0-8ea9-e675191f3872 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114630 Aug 18 11:44:13.419575 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2021/4255] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:11 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 2423 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:13.422422 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2235/4256] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:44:13.443269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24e6167e-2c2b-4fce-a7fd-3b41bdbcd29b tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:13.445020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-24e6167e-2c2b-4fce-a7fd-3b41bdbcd29b tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] [instance: dbb00326-eff9-4836-9d1b-c024a219717b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:13.446100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-713a28b6-7187-4e7c-9f8a-a75bd57aed0c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:13.447130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-713a28b6-7187-4e7c-9f8a-a75bd57aed0c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:13.464892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e6167e-2c2b-4fce-a7fd-3b41bdbcd29b tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:13.465619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e6167e-2c2b-4fce-a7fd-3b41bdbcd29b tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:13.467086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e6167e-2c2b-4fce-a7fd-3b41bdbcd29b tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:13.468683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e6167e-2c2b-4fce-a7fd-3b41bdbcd29b tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:13.471789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e6167e-2c2b-4fce-a7fd-3b41bdbcd29b tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:13.473183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e6167e-2c2b-4fce-a7fd-3b41bdbcd29b tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:13.473551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-713a28b6-7187-4e7c-9f8a-a75bd57aed0c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:13.478559 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-713a28b6-7187-4e7c-9f8a-a75bd57aed0c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:13.480072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-713a28b6-7187-4e7c-9f8a-a75bd57aed0c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:13.483653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-713a28b6-7187-4e7c-9f8a-a75bd57aed0c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:13.484714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-713a28b6-7187-4e7c-9f8a-a75bd57aed0c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:13.491621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-713a28b6-7187-4e7c-9f8a-a75bd57aed0c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:13.702555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-24e6167e-2c2b-4fce-a7fd-3b41bdbcd29b tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:13.721468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-24e6167e-2c2b-4fce-a7fd-3b41bdbcd29b tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:13.736440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-24e6167e-2c2b-4fce-a7fd-3b41bdbcd29b tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:13.737858 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-24e6167e-2c2b-4fce-a7fd-3b41bdbcd29b tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b" status: 200 len: 1332 microversion: 2.47 time: 0.313260 Aug 18 11:44:13.739197 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2236/4257] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:13 2022] GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b => generated 1332 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:13.956103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24b2575c-69d5-4769-9e1c-986f002fabd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:13.957432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-24b2575c-69d5-4769-9e1c-986f002fabd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:13.983292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24b2575c-69d5-4769-9e1c-986f002fabd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:13.984383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24b2575c-69d5-4769-9e1c-986f002fabd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:13.992427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24b2575c-69d5-4769-9e1c-986f002fabd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:13.993582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24b2575c-69d5-4769-9e1c-986f002fabd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:13.994515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24b2575c-69d5-4769-9e1c-986f002fabd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:13.995363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24b2575c-69d5-4769-9e1c-986f002fabd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:14.247300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-24b2575c-69d5-4769-9e1c-986f002fabd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:14.265223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-24b2575c-69d5-4769-9e1c-986f002fabd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:14.276627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-24b2575c-69d5-4769-9e1c-986f002fabd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:14.278269 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-24b2575c-69d5-4769-9e1c-986f002fabd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1356 microversion: 2.47 time: 0.326278 Aug 18 11:44:14.282172 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2237/4258] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:13 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1356 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:14.321152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-376ca878-3b9e-4729-bb97-bfeaca3490c2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:14.322171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-376ca878-3b9e-4729-bb97-bfeaca3490c2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] [instance: 8cf62232-2b1e-47fa-8743-8ddcf11b891e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:14.339557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-376ca878-3b9e-4729-bb97-bfeaca3490c2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:14.340709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-376ca878-3b9e-4729-bb97-bfeaca3490c2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:14.341395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-376ca878-3b9e-4729-bb97-bfeaca3490c2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:14.342553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-376ca878-3b9e-4729-bb97-bfeaca3490c2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:14.343610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-376ca878-3b9e-4729-bb97-bfeaca3490c2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:14.346116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-376ca878-3b9e-4729-bb97-bfeaca3490c2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:14.387586 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-376ca878-3b9e-4729-bb97-bfeaca3490c2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] HTTP exception thrown: Instance 8cf62232-2b1e-47fa-8743-8ddcf11b891e could not be found. Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-376ca878-3b9e-4729-bb97-bfeaca3490c2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Request method failure captured: Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e HTTP/1.1 Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iW9Wowwiymcj-xavTwPJjsZDV1gtDW3QH6lduNqEOhBIZp-vKnd8NwfRG5IHF0r284YPDlUz8unU-iiYkZ_7ECz_XrbzSw8F3UKqHpbPTaI0WaToZKyPjD4V5yL8vzHqUBVosQdLuZY4_tWJ390hI00QZzKfMsdk2gEO9mFNOLhOIE Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 7efdad3bc1194e1794de97e8d64efe88 Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestFqdnHostnames-936754704 Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7efdad3bc1194e1794de97e8d64efe88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7efdad3bc1194e1794de97e8d64efe88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7efdad3bc1194e1794de97e8d64efe88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7efdad3bc1194e1794de97e8d64efe88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestFqdnHostnames-936754704 Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 7efdad3bc1194e1794de97e8d64efe88 Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-936754704 Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestFqdnHostnames-936754704-project Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 272a104b54e1450ea94761c135b7c0e4 Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestFqdnHostnames-936754704-project Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 8cf62232-2b1e-47fa-8743-8ddcf11b891e could not be found. Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '8cf62232-2b1e-47fa-8743-8ddcf11b891e'} Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf62232-2b1e-47fa-8743-8ddcf11b891e could not be found. Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf62232-2b1e-47fa-8743-8ddcf11b891e could not be found. Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:14.390751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:14.395285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:14.395285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:14.395285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:14.395285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:44:14.395285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:44:14.395285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf62232-2b1e-47fa-8743-8ddcf11b891e could not be found. Aug 18 11:44:14.395285 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:14.403537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-376ca878-3b9e-4729-bb97-bfeaca3490c2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Returning 404 to user: Instance 8cf62232-2b1e-47fa-8743-8ddcf11b891e could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:14.404850 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-376ca878-3b9e-4729-bb97-bfeaca3490c2 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e" status: 404 len: 111 microversion: 2.1 time: 0.088664 Aug 18 11:44:14.406874 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2238/4259] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:14 2022] GET /compute/v2.1/servers/8cf62232-2b1e-47fa-8743-8ddcf11b891e => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:44:14.422672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:14.426143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:14.438538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:14.440066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:14.443867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:14.445593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:14.447013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:14.447777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:14.656441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:44:14.657530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:44:14.658692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:44:14.659464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:44:14.660790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:44:14.810731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:14.822327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:14.823574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:14.824489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:14.825849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:14.828692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:14.829713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:14.893047 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-706361f0-8a52-4667-aebf-66b0b15a0f40 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "POST /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2/action" status: 202 len: 1078 microversion: 2.47 time: 0.482345 Aug 18 11:44:14.894981 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2239/4260] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 18 11:44:14 2022] POST /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2/action => generated 1078 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 18 11:44:14.915450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-85541851-eb2b-4593-80e6-bf8506374278 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] Calling method '.version_select at 0x7f519fc1e5e0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:15.006778 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-85541851-eb2b-4593-80e6-bf8506374278 tempest-ServersTestFqdnHostnames-936754704 tempest-ServersTestFqdnHostnames-936754704-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-651818827" status: 202 len: 0 microversion: 2.1 time: 0.109639 Aug 18 11:44:15.008416 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2240/4261] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 18 11:44:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-651818827 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:44:15.021473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1bb2dc37-de59-4219-842d-1bf6f0461dfe tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:15.023234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1bb2dc37-de59-4219-842d-1bf6f0461dfe tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:15.054416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb2dc37-de59-4219-842d-1bf6f0461dfe tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:15.055331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb2dc37-de59-4219-842d-1bf6f0461dfe tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:15.060611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb2dc37-de59-4219-842d-1bf6f0461dfe tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:15.070875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb2dc37-de59-4219-842d-1bf6f0461dfe tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:15.076133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb2dc37-de59-4219-842d-1bf6f0461dfe tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:15.077060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb2dc37-de59-4219-842d-1bf6f0461dfe tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:15.534889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-713a28b6-7187-4e7c-9f8a-a75bd57aed0c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:15.553412 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-713a28b6-7187-4e7c-9f8a-a75bd57aed0c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1317 microversion: 2.1 time: 2.131341 Aug 18 11:44:15.569084 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2022/4262] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:13 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1317 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:15.580072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f70cc41b-e523-4b51-aeac-b26713e9374d tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:15.586467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f70cc41b-e523-4b51-aeac-b26713e9374d tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] [instance: dbb00326-eff9-4836-9d1b-c024a219717b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:15.594812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f70cc41b-e523-4b51-aeac-b26713e9374d tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:15.595581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f70cc41b-e523-4b51-aeac-b26713e9374d tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:15.596176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f70cc41b-e523-4b51-aeac-b26713e9374d tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:15.597468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f70cc41b-e523-4b51-aeac-b26713e9374d tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:15.598123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f70cc41b-e523-4b51-aeac-b26713e9374d tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:15.598747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f70cc41b-e523-4b51-aeac-b26713e9374d tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:15.818450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f70cc41b-e523-4b51-aeac-b26713e9374d tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:15.856619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f70cc41b-e523-4b51-aeac-b26713e9374d tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:15.864590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f70cc41b-e523-4b51-aeac-b26713e9374d tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:15.871252 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f70cc41b-e523-4b51-aeac-b26713e9374d tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b" status: 200 len: 1338 microversion: 2.47 time: 0.300357 Aug 18 11:44:15.876266 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2023/4263] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:15 2022] GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b => generated 1338 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:15.904600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bd84acf4-e26d-4a77-bbd1-e6906b73c43b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:15.907598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bd84acf4-e26d-4a77-bbd1-e6906b73c43b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:15.932137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd84acf4-e26d-4a77-bbd1-e6906b73c43b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:15.934493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd84acf4-e26d-4a77-bbd1-e6906b73c43b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:15.935524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd84acf4-e26d-4a77-bbd1-e6906b73c43b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:15.936922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd84acf4-e26d-4a77-bbd1-e6906b73c43b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:15.938026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd84acf4-e26d-4a77-bbd1-e6906b73c43b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:15.939901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd84acf4-e26d-4a77-bbd1-e6906b73c43b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:16.149220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bd84acf4-e26d-4a77-bbd1-e6906b73c43b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:16.166770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bd84acf4-e26d-4a77-bbd1-e6906b73c43b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:16.168312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bd84acf4-e26d-4a77-bbd1-e6906b73c43b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:16.169831 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bd84acf4-e26d-4a77-bbd1-e6906b73c43b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.289195 Aug 18 11:44:16.171254 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2024/4264] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:15 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:16.193696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1bb2dc37-de59-4219-842d-1bf6f0461dfe tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:16.195332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-e2016e39-ec77-4aac-8f20-46da78b50dd8 req-9853c272-a131-46c0-87e7-c18adf9c92b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-deleted", "tag": "7e3a32b5-0288-4b94-9154-5891994bd66b"}, {"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-deleted", "tag": "d41345fd-e890-44f2-bb0d-38e0419cb39a"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:16.218119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e2016e39-ec77-4aac-8f20-46da78b50dd8 req-9853c272-a131-46c0-87e7-c18adf9c92b4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:16.218878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e2016e39-ec77-4aac-8f20-46da78b50dd8 req-9853c272-a131-46c0-87e7-c18adf9c92b4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:16.219593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e2016e39-ec77-4aac-8f20-46da78b50dd8 req-9853c272-a131-46c0-87e7-c18adf9c92b4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:16.246339 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-e2016e39-ec77-4aac-8f20-46da78b50dd8 req-9853c272-a131-46c0-87e7-c18adf9c92b4 service nova] Creating event network-vif-deleted:7e3a32b5-0288-4b94-9154-5891994bd66b for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:44:16.250783 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-e2016e39-ec77-4aac-8f20-46da78b50dd8 req-9853c272-a131-46c0-87e7-c18adf9c92b4 service nova] Creating event network-vif-deleted:d41345fd-e890-44f2-bb0d-38e0419cb39a for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:44:16.251918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1bb2dc37-de59-4219-842d-1bf6f0461dfe tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:16.256071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1bb2dc37-de59-4219-842d-1bf6f0461dfe tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:16.259794 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1bb2dc37-de59-4219-842d-1bf6f0461dfe tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 2329 microversion: 2.32 time: 1.246472 Aug 18 11:44:16.261026 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2241/4265] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:15 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 2329 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:16.265836 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-e2016e39-ec77-4aac-8f20-46da78b50dd8 req-9853c272-a131-46c0-87e7-c18adf9c92b4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.092872 Aug 18 11:44:16.266701 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2025/4266] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:44:16.579342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b028f273-74db-4b41-a8c5-53c3a6073693 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:16.579986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b028f273-74db-4b41-a8c5-53c3a6073693 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:16.596306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b028f273-74db-4b41-a8c5-53c3a6073693 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:16.598828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b028f273-74db-4b41-a8c5-53c3a6073693 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:16.599472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b028f273-74db-4b41-a8c5-53c3a6073693 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:16.601951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b028f273-74db-4b41-a8c5-53c3a6073693 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:16.603028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b028f273-74db-4b41-a8c5-53c3a6073693 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:16.603634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b028f273-74db-4b41-a8c5-53c3a6073693 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:16.922613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-83752943-d02b-4045-b688-6120c705e284 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:16.923993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-83752943-d02b-4045-b688-6120c705e284 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] [instance: dbb00326-eff9-4836-9d1b-c024a219717b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:16.936025 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83752943-d02b-4045-b688-6120c705e284 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:16.936793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83752943-d02b-4045-b688-6120c705e284 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:16.937886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83752943-d02b-4045-b688-6120c705e284 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:16.938984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83752943-d02b-4045-b688-6120c705e284 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:16.939848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83752943-d02b-4045-b688-6120c705e284 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:16.940509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83752943-d02b-4045-b688-6120c705e284 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:17.235412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b028f273-74db-4b41-a8c5-53c3a6073693 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:17.297018 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b028f273-74db-4b41-a8c5-53c3a6073693 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1317 microversion: 2.1 time: 0.723547 Aug 18 11:44:17.299257 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2242/4267] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:16 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1317 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:44:17.308164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34eb6873-24c1-47a1-9161-837f49efd9eb tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:17.309461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-34eb6873-24c1-47a1-9161-837f49efd9eb tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:17.321965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34eb6873-24c1-47a1-9161-837f49efd9eb tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:17.329421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34eb6873-24c1-47a1-9161-837f49efd9eb tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:17.331429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34eb6873-24c1-47a1-9161-837f49efd9eb tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:17.332900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34eb6873-24c1-47a1-9161-837f49efd9eb tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:17.333795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34eb6873-24c1-47a1-9161-837f49efd9eb tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:17.334867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34eb6873-24c1-47a1-9161-837f49efd9eb tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:17.383725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-83752943-d02b-4045-b688-6120c705e284 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:17.419108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-83752943-d02b-4045-b688-6120c705e284 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:17.421118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-83752943-d02b-4045-b688-6120c705e284 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:17.422385 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-83752943-d02b-4045-b688-6120c705e284 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b" status: 200 len: 1338 microversion: 2.47 time: 0.505584 Aug 18 11:44:17.423001 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2026/4268] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:16 2022] GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b => generated 1338 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:44:17.427905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2e55bfdd-aea2-466b-abe2-32fc94659f34 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:17.428525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2e55bfdd-aea2-466b-abe2-32fc94659f34 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:17.448062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e55bfdd-aea2-466b-abe2-32fc94659f34 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:17.448565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e55bfdd-aea2-466b-abe2-32fc94659f34 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:17.449160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e55bfdd-aea2-466b-abe2-32fc94659f34 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:17.449888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e55bfdd-aea2-466b-abe2-32fc94659f34 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:17.450356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e55bfdd-aea2-466b-abe2-32fc94659f34 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:17.450853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2e55bfdd-aea2-466b-abe2-32fc94659f34 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:17.471349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:17.552506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-34eb6873-24c1-47a1-9161-837f49efd9eb tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:17.574144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-34eb6873-24c1-47a1-9161-837f49efd9eb tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:17.575972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-34eb6873-24c1-47a1-9161-837f49efd9eb tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:17.577882 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34eb6873-24c1-47a1-9161-837f49efd9eb tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.277141 Aug 18 11:44:17.578985 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2243/4269] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:17 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:18.022503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2e55bfdd-aea2-466b-abe2-32fc94659f34 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:18.041505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2e55bfdd-aea2-466b-abe2-32fc94659f34 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:18.043169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2e55bfdd-aea2-466b-abe2-32fc94659f34 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:18.044454 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2e55bfdd-aea2-466b-abe2-32fc94659f34 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 2101 microversion: 2.32 time: 0.620494 Aug 18 11:44:18.045052 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2027/4270] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:17 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 2101 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:18.321240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a5ca98c7-0a9c-43da-aebe-14629f14d59e req-da08d811-2552-4c30-bccc-c387bc5da5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0134fd66-53da-4cae-bfae-c3d813a96712", "tag": "fcb6250b-8698-4d0b-b229-0ae56b87cef4"}, {"server_uuid": "90132336-bd92-44e9-bc59-949f10e5ecab", "name": "network-vif-deleted", "tag": "b3b7c180-3e64-4262-a77c-687b117445ae"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:18.331864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:18.339327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5059ce43-425f-4b8c-995e-b7e824f2c728 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:18.339941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5059ce43-425f-4b8c-995e-b7e824f2c728 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:18.357218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5059ce43-425f-4b8c-995e-b7e824f2c728 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:18.357718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5059ce43-425f-4b8c-995e-b7e824f2c728 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:18.358153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5059ce43-425f-4b8c-995e-b7e824f2c728 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:18.358923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5059ce43-425f-4b8c-995e-b7e824f2c728 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:18.359387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5059ce43-425f-4b8c-995e-b7e824f2c728 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:18.359813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5059ce43-425f-4b8c-995e-b7e824f2c728 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:18.366756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a5ca98c7-0a9c-43da-aebe-14629f14d59e req-da08d811-2552-4c30-bccc-c387bc5da5b8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:18.371251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a5ca98c7-0a9c-43da-aebe-14629f14d59e req-da08d811-2552-4c30-bccc-c387bc5da5b8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:18.372088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a5ca98c7-0a9c-43da-aebe-14629f14d59e req-da08d811-2552-4c30-bccc-c387bc5da5b8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:18.409420 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a5ca98c7-0a9c-43da-aebe-14629f14d59e req-da08d811-2552-4c30-bccc-c387bc5da5b8 service nova] Creating event network-changed:fcb6250b-8698-4d0b-b229-0ae56b87cef4 for instance 0134fd66-53da-4cae-bfae-c3d813a96712 on n-h1-853611-3 Aug 18 11:44:18.412301 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a5ca98c7-0a9c-43da-aebe-14629f14d59e req-da08d811-2552-4c30-bccc-c387bc5da5b8 service nova] Creating event network-vif-deleted:b3b7c180-3e64-4262-a77c-687b117445ae for instance 90132336-bd92-44e9-bc59-949f10e5ecab on n-h2-853611-3 Aug 18 11:44:18.431206 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a5ca98c7-0a9c-43da-aebe-14629f14d59e req-da08d811-2552-4c30-bccc-c387bc5da5b8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.113570 Aug 18 11:44:18.438173 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2244/4271] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:44:18.457034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-503ffac8-6ec5-45e4-b642-4958958025a6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:18.459160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-503ffac8-6ec5-45e4-b642-4958958025a6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] [instance: dbb00326-eff9-4836-9d1b-c024a219717b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:18.469163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-503ffac8-6ec5-45e4-b642-4958958025a6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:18.469876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-503ffac8-6ec5-45e4-b642-4958958025a6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:18.471363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-503ffac8-6ec5-45e4-b642-4958958025a6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:18.473610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-503ffac8-6ec5-45e4-b642-4958958025a6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:18.474886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-503ffac8-6ec5-45e4-b642-4958958025a6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:18.476747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-503ffac8-6ec5-45e4-b642-4958958025a6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:18.782776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-503ffac8-6ec5-45e4-b642-4958958025a6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:18.797448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-503ffac8-6ec5-45e4-b642-4958958025a6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:18.805053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-503ffac8-6ec5-45e4-b642-4958958025a6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:18.809188 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-503ffac8-6ec5-45e4-b642-4958958025a6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b" status: 200 len: 1359 microversion: 2.47 time: 0.360801 Aug 18 11:44:18.812120 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2245/4272] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:18 2022] GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b => generated 1359 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:18.828621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d58b300c-b819-407f-abd4-c2cebca2c98f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:18.829182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d58b300c-b819-407f-abd4-c2cebca2c98f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:18.833236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:18.847533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d58b300c-b819-407f-abd4-c2cebca2c98f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:18.848449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d58b300c-b819-407f-abd4-c2cebca2c98f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:18.849238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d58b300c-b819-407f-abd4-c2cebca2c98f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:18.850505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d58b300c-b819-407f-abd4-c2cebca2c98f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:18.851360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d58b300c-b819-407f-abd4-c2cebca2c98f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:18.852159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d58b300c-b819-407f-abd4-c2cebca2c98f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:18.979684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5059ce43-425f-4b8c-995e-b7e824f2c728 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:18.996586 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5059ce43-425f-4b8c-995e-b7e824f2c728 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1317 microversion: 2.1 time: 0.660891 Aug 18 11:44:18.998898 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2028/4273] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:18 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:19.015693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8b18e7a0-10f5-47f6-863b-8a0cf4bff7a0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1809799208"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:19.031765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8b18e7a0-10f5-47f6-863b-8a0cf4bff7a0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] [instance: dbb00326-eff9-4836-9d1b-c024a219717b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:19.054396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b18e7a0-10f5-47f6-863b-8a0cf4bff7a0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:19.060588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b18e7a0-10f5-47f6-863b-8a0cf4bff7a0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:19.063120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b18e7a0-10f5-47f6-863b-8a0cf4bff7a0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:19.067328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b18e7a0-10f5-47f6-863b-8a0cf4bff7a0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:19.073924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b18e7a0-10f5-47f6-863b-8a0cf4bff7a0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:19.075011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b18e7a0-10f5-47f6-863b-8a0cf4bff7a0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:19.349802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d58b300c-b819-407f-abd4-c2cebca2c98f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:19.368191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d58b300c-b819-407f-abd4-c2cebca2c98f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:19.370944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d58b300c-b819-407f-abd4-c2cebca2c98f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:19.372819 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d58b300c-b819-407f-abd4-c2cebca2c98f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.559648 Aug 18 11:44:19.374755 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2246/4274] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:18 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:19.382493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cf6583ca-bcc7-49cc-b0c2-a3b7db2fe193 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:19.384648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cf6583ca-bcc7-49cc-b0c2-a3b7db2fe193 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:19.400571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf6583ca-bcc7-49cc-b0c2-a3b7db2fe193 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:19.401465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf6583ca-bcc7-49cc-b0c2-a3b7db2fe193 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:19.402123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf6583ca-bcc7-49cc-b0c2-a3b7db2fe193 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:19.403249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf6583ca-bcc7-49cc-b0c2-a3b7db2fe193 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:19.403991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf6583ca-bcc7-49cc-b0c2-a3b7db2fe193 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:19.405141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf6583ca-bcc7-49cc-b0c2-a3b7db2fe193 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:19.620478 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8b18e7a0-10f5-47f6-863b-8a0cf4bff7a0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] 10.222.0.73 "POST /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b/action" status: 202 len: 52 microversion: 2.47 time: 0.619205 Aug 18 11:44:19.624813 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2029/4275] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 18 11:44:18 2022] POST /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b/action => generated 52 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 18 11:44:19.648520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a17c3f71-21a7-4765-8182-a626ab09586c tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:19.649447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a17c3f71-21a7-4765-8182-a626ab09586c tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] [instance: dbb00326-eff9-4836-9d1b-c024a219717b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:19.664745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a17c3f71-21a7-4765-8182-a626ab09586c tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:19.665520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a17c3f71-21a7-4765-8182-a626ab09586c tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:19.666103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a17c3f71-21a7-4765-8182-a626ab09586c tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:19.667227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a17c3f71-21a7-4765-8182-a626ab09586c tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:19.667874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a17c3f71-21a7-4765-8182-a626ab09586c tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:19.668451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a17c3f71-21a7-4765-8182-a626ab09586c tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:19.706108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a17c3f71-21a7-4765-8182-a626ab09586c tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] [instance: dbb00326-eff9-4836-9d1b-c024a219717b] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:44:19.733826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cf6583ca-bcc7-49cc-b0c2-a3b7db2fe193 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:19.776319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cf6583ca-bcc7-49cc-b0c2-a3b7db2fe193 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:19.781084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cf6583ca-bcc7-49cc-b0c2-a3b7db2fe193 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:19.786933 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cf6583ca-bcc7-49cc-b0c2-a3b7db2fe193 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.409905 Aug 18 11:44:19.808750 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2247/4276] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:19 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:19.887523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e835dc62-2b62-4fbe-9b43-fe39ad9ad5ab tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:19.888453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e835dc62-2b62-4fbe-9b43-fe39ad9ad5ab tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:19.905498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e835dc62-2b62-4fbe-9b43-fe39ad9ad5ab tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:19.906855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e835dc62-2b62-4fbe-9b43-fe39ad9ad5ab tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:19.907851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e835dc62-2b62-4fbe-9b43-fe39ad9ad5ab tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:19.909582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e835dc62-2b62-4fbe-9b43-fe39ad9ad5ab tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:19.911647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e835dc62-2b62-4fbe-9b43-fe39ad9ad5ab tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:19.912631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e835dc62-2b62-4fbe-9b43-fe39ad9ad5ab tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:19.914358 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a17c3f71-21a7-4765-8182-a626ab09586c tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b" status: 204 len: 0 microversion: 2.47 time: 0.274818 Aug 18 11:44:19.917061 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2030/4277] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:44:19 2022] DELETE /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:44:19.918836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:19.935327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-11c445ec-7992-4829-9415-6710819dc6d6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:19.937468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-11c445ec-7992-4829-9415-6710819dc6d6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] [instance: dbb00326-eff9-4836-9d1b-c024a219717b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:19.951248 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e835dc62-2b62-4fbe-9b43-fe39ad9ad5ab tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/ips" status: 200 len: 144 microversion: 2.1 time: 0.072802 Aug 18 11:44:19.953316 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2248/4278] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:44:19 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/ips => generated 144 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:44:19.954119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11c445ec-7992-4829-9415-6710819dc6d6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:19.954702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11c445ec-7992-4829-9415-6710819dc6d6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:19.956793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11c445ec-7992-4829-9415-6710819dc6d6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:19.960454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11c445ec-7992-4829-9415-6710819dc6d6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:19.961732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11c445ec-7992-4829-9415-6710819dc6d6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:19.962334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11c445ec-7992-4829-9415-6710819dc6d6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:20.031173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b187cf9-3c39-47d3-b1e8-0500b01e8600 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:20.031986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b187cf9-3c39-47d3-b1e8-0500b01e8600 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:20.045657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b187cf9-3c39-47d3-b1e8-0500b01e8600 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:20.046180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b187cf9-3c39-47d3-b1e8-0500b01e8600 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:20.049594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b187cf9-3c39-47d3-b1e8-0500b01e8600 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:20.056585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b187cf9-3c39-47d3-b1e8-0500b01e8600 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:20.056585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b187cf9-3c39-47d3-b1e8-0500b01e8600 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:20.056965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b187cf9-3c39-47d3-b1e8-0500b01e8600 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:20.349549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5b187cf9-3c39-47d3-b1e8-0500b01e8600 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:20.352403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-11c445ec-7992-4829-9415-6710819dc6d6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:20.368292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-11c445ec-7992-4829-9415-6710819dc6d6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:20.370094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-11c445ec-7992-4829-9415-6710819dc6d6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:20.373509 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b187cf9-3c39-47d3-b1e8-0500b01e8600 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1317 microversion: 2.1 time: 0.347930 Aug 18 11:44:20.375567 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2249/4279] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:20 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:44:20.375756 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-11c445ec-7992-4829-9415-6710819dc6d6 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b" status: 200 len: 1365 microversion: 2.47 time: 0.451192 Aug 18 11:44:20.379491 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2031/4280] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:19 2022] GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b => generated 1365 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:20.408934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-547ae783-af11-4b4f-920f-6d552051015a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:20.408934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-547ae783-af11-4b4f-920f-6d552051015a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:20.416215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d0217c32-567e-4bb8-ad01-4aace7550bc3 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:20.417837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d0217c32-567e-4bb8-ad01-4aace7550bc3 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:20.434147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-547ae783-af11-4b4f-920f-6d552051015a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:20.434706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-547ae783-af11-4b4f-920f-6d552051015a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:20.434977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0217c32-567e-4bb8-ad01-4aace7550bc3 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:20.435180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-547ae783-af11-4b4f-920f-6d552051015a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:20.435433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0217c32-567e-4bb8-ad01-4aace7550bc3 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:20.435884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0217c32-567e-4bb8-ad01-4aace7550bc3 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:20.436504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-547ae783-af11-4b4f-920f-6d552051015a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:20.436982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-547ae783-af11-4b4f-920f-6d552051015a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:20.437423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-547ae783-af11-4b4f-920f-6d552051015a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:20.444903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0217c32-567e-4bb8-ad01-4aace7550bc3 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:20.445538 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0217c32-567e-4bb8-ad01-4aace7550bc3 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:20.446169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0217c32-567e-4bb8-ad01-4aace7550bc3 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:20.477935 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-547ae783-af11-4b4f-920f-6d552051015a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] HTTP exception thrown: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-547ae783-af11-4b4f-920f-6d552051015a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Request method failure captured: Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce HTTP/1.1 Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iRnH2QnEZcbVd_E_481iRNNM-IwbiL6o-tpXLM6m_CN2eKBD9XbQxUEvk76JlXdPc-MccGPvRGrbhUVfunMMoraSzZ-sHlmwm0ZNo_6KpwfOjBMo-Z5iKUJClxW2Et69hMqbb7dIGpmLB8LI2I5cOTBycO0Q5X2pdM31kHlGBA3R-8 Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.42 Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: d32aff83e4a644a59a1e1e8f0000864a Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1627059685 Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d32aff83e4a644a59a1e1e8f0000864a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d32aff83e4a644a59a1e1e8f0000864a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d32aff83e4a644a59a1e1e8f0000864a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d32aff83e4a644a59a1e1e8f0000864a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1627059685 Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: d32aff83e4a644a59a1e1e8f0000864a Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1627059685 Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TaggedBootDevicesTest_v242-1627059685-project Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 4d6302ebc22e490bbac83b5b218b3b84 Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1627059685-project Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '3cf6bf58-dceb-4e27-9d99-c8139ed38fce'} Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:44:20.486628 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:44:20.495332 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:20.495332 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:20.495332 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:20.495332 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:20.495332 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:20.495332 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:20.495332 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:20.495332 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:44:20.495332 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:44:20.495332 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:20.495332 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:20.495332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-547ae783-af11-4b4f-920f-6d552051015a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Returning 404 to user: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:20.495332 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-547ae783-af11-4b4f-920f-6d552051015a tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 404 len: 111 microversion: 2.42 time: 0.098311 Aug 18 11:44:20.495332 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2250/4281] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:44:20 2022] DELETE /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:44:20.512002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dea73c53-1834-4aec-8bea-5eb628a671d4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:20.512855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dea73c53-1834-4aec-8bea-5eb628a671d4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] [instance: 3cf6bf58-dceb-4e27-9d99-c8139ed38fce] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:20.533134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dea73c53-1834-4aec-8bea-5eb628a671d4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:20.534045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dea73c53-1834-4aec-8bea-5eb628a671d4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:20.536888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dea73c53-1834-4aec-8bea-5eb628a671d4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:20.537948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dea73c53-1834-4aec-8bea-5eb628a671d4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:20.542296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dea73c53-1834-4aec-8bea-5eb628a671d4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:20.544274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dea73c53-1834-4aec-8bea-5eb628a671d4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:20.586351 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-dea73c53-1834-4aec-8bea-5eb628a671d4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] HTTP exception thrown: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dea73c53-1834-4aec-8bea-5eb628a671d4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Request method failure captured: Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce HTTP/1.1 Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iRnH2QnEZcbVd_E_481iRNNM-IwbiL6o-tpXLM6m_CN2eKBD9XbQxUEvk76JlXdPc-MccGPvRGrbhUVfunMMoraSzZ-sHlmwm0ZNo_6KpwfOjBMo-Z5iKUJClxW2Et69hMqbb7dIGpmLB8LI2I5cOTBycO0Q5X2pdM31kHlGBA3R-8 Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.42 Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: d32aff83e4a644a59a1e1e8f0000864a Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1627059685 Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d32aff83e4a644a59a1e1e8f0000864a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d32aff83e4a644a59a1e1e8f0000864a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d32aff83e4a644a59a1e1e8f0000864a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d32aff83e4a644a59a1e1e8f0000864a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1627059685 Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: d32aff83e4a644a59a1e1e8f0000864a Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1627059685 Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TaggedBootDevicesTest_v242-1627059685-project Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 4d6302ebc22e490bbac83b5b218b3b84 Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1627059685-project Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '3cf6bf58-dceb-4e27-9d99-c8139ed38fce'} Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:20.589443 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:20.593313 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:20.593313 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:20.593313 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:20.593313 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:20.593313 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:44:20.593313 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:44:20.593313 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. Aug 18 11:44:20.593313 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:20.593919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d0217c32-567e-4bb8-ad01-4aace7550bc3 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:20.605000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d0217c32-567e-4bb8-ad01-4aace7550bc3 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:20.606725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d0217c32-567e-4bb8-ad01-4aace7550bc3 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:20.607986 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d0217c32-567e-4bb8-ad01-4aace7550bc3 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.196454 Aug 18 11:44:20.610836 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2032/4282] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:20 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:44:20.614773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dea73c53-1834-4aec-8bea-5eb628a671d4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] Returning 404 to user: Instance 3cf6bf58-dceb-4e27-9d99-c8139ed38fce could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:20.617902 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dea73c53-1834-4aec-8bea-5eb628a671d4 tempest-TaggedBootDevicesTest_v242-1627059685 tempest-TaggedBootDevicesTest_v242-1627059685-project] 10.222.0.73 "GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce" status: 404 len: 111 microversion: 2.42 time: 0.119964 Aug 18 11:44:20.622705 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2251/4283] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:20 2022] GET /compute/v2.1/servers/3cf6bf58-dceb-4e27-9d99-c8139ed38fce => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:44:20.828525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-580683e5-7776-4afb-a209-23d0e37940da tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:20.829515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-580683e5-7776-4afb-a209-23d0e37940da tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:20.844027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-580683e5-7776-4afb-a209-23d0e37940da tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:20.844557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-580683e5-7776-4afb-a209-23d0e37940da tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:20.845012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-580683e5-7776-4afb-a209-23d0e37940da tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:20.851724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-580683e5-7776-4afb-a209-23d0e37940da tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:20.852228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-580683e5-7776-4afb-a209-23d0e37940da tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:20.852700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-580683e5-7776-4afb-a209-23d0e37940da tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:21.129079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-580683e5-7776-4afb-a209-23d0e37940da tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:21.159825 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-580683e5-7776-4afb-a209-23d0e37940da tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:21.162278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-580683e5-7776-4afb-a209-23d0e37940da tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:21.176220 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-580683e5-7776-4afb-a209-23d0e37940da tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.351480 Aug 18 11:44:21.192191 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2033/4284] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:20 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:21.402113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fa4ec1bf-e3d4-4921-9c4a-0817750ff5ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:21.402772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fa4ec1bf-e3d4-4921-9c4a-0817750ff5ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:21.429170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4ec1bf-e3d4-4921-9c4a-0817750ff5ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:21.429957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4ec1bf-e3d4-4921-9c4a-0817750ff5ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:21.431107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4ec1bf-e3d4-4921-9c4a-0817750ff5ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:21.434002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-16779b2f-f158-4577-9efa-582dcb7024d0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:21.438171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4ec1bf-e3d4-4921-9c4a-0817750ff5ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:21.439317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4ec1bf-e3d4-4921-9c4a-0817750ff5ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:21.440258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4ec1bf-e3d4-4921-9c4a-0817750ff5ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:21.441158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-16779b2f-f158-4577-9efa-582dcb7024d0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] [instance: dbb00326-eff9-4836-9d1b-c024a219717b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:21.470833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16779b2f-f158-4577-9efa-582dcb7024d0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:21.476014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16779b2f-f158-4577-9efa-582dcb7024d0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:21.478020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16779b2f-f158-4577-9efa-582dcb7024d0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:21.482061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16779b2f-f158-4577-9efa-582dcb7024d0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:21.485911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16779b2f-f158-4577-9efa-582dcb7024d0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:21.486751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16779b2f-f158-4577-9efa-582dcb7024d0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:21.823642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:21.851865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:21.852169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fa4ec1bf-e3d4-4921-9c4a-0817750ff5ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:21.887170 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fa4ec1bf-e3d4-4921-9c4a-0817750ff5ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1317 microversion: 2.1 time: 0.491310 Aug 18 11:44:21.895987 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2252/4285] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:21 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:21.919142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b482610-a029-4568-8e4d-59e55feecff4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:21.920578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1b482610-a029-4568-8e4d-59e55feecff4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:21.946313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-16779b2f-f158-4577-9efa-582dcb7024d0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:21.950825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b482610-a029-4568-8e4d-59e55feecff4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:21.951595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b482610-a029-4568-8e4d-59e55feecff4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:21.952272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b482610-a029-4568-8e4d-59e55feecff4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:21.963728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b482610-a029-4568-8e4d-59e55feecff4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:21.965066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b482610-a029-4568-8e4d-59e55feecff4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:21.966267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b482610-a029-4568-8e4d-59e55feecff4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:21.978817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-16779b2f-f158-4577-9efa-582dcb7024d0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:21.989061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-16779b2f-f158-4577-9efa-582dcb7024d0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:21.994578 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-16779b2f-f158-4577-9efa-582dcb7024d0 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b" status: 200 len: 1365 microversion: 2.47 time: 0.582881 Aug 18 11:44:22.001260 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2034/4286] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:21 2022] GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b => generated 1365 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:44:22.161217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1b482610-a029-4568-8e4d-59e55feecff4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:22.180058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1b482610-a029-4568-8e4d-59e55feecff4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:22.182666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1b482610-a029-4568-8e4d-59e55feecff4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:22.184208 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1b482610-a029-4568-8e4d-59e55feecff4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.285487 Aug 18 11:44:22.185304 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2253/4287] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:21 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:22.227324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5481cece-ee73-4e5d-b158-175213b5a2f6 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:22.231865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5481cece-ee73-4e5d-b158-175213b5a2f6 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:22.250711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5481cece-ee73-4e5d-b158-175213b5a2f6 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:22.257243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5481cece-ee73-4e5d-b158-175213b5a2f6 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:22.258451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5481cece-ee73-4e5d-b158-175213b5a2f6 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:22.260481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5481cece-ee73-4e5d-b158-175213b5a2f6 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:22.261586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5481cece-ee73-4e5d-b158-175213b5a2f6 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:22.262699 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5481cece-ee73-4e5d-b158-175213b5a2f6 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:22.481728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5481cece-ee73-4e5d-b158-175213b5a2f6 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:22.518191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5481cece-ee73-4e5d-b158-175213b5a2f6 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:22.522272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5481cece-ee73-4e5d-b158-175213b5a2f6 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:22.524768 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5481cece-ee73-4e5d-b158-175213b5a2f6 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.322334 Aug 18 11:44:22.550469 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2035/4288] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:22 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:22.950412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f0cc919f-a298-40a5-b768-143cef0e3924 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:22.952762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f0cc919f-a298-40a5-b768-143cef0e3924 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:22.965725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=24 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:22.971488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0cc919f-a298-40a5-b768-143cef0e3924 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:22.974170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0cc919f-a298-40a5-b768-143cef0e3924 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:22.975435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0cc919f-a298-40a5-b768-143cef0e3924 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:22.976972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0cc919f-a298-40a5-b768-143cef0e3924 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:22.978017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0cc919f-a298-40a5-b768-143cef0e3924 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:22.979667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0cc919f-a298-40a5-b768-143cef0e3924 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:23.059678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3a17bdba-ab20-48d5-b769-3568b6229ca8 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:23.061091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3a17bdba-ab20-48d5-b769-3568b6229ca8 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] [instance: dbb00326-eff9-4836-9d1b-c024a219717b] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:23.093587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3a17bdba-ab20-48d5-b769-3568b6229ca8 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:23.095297 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3a17bdba-ab20-48d5-b769-3568b6229ca8 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:23.097029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3a17bdba-ab20-48d5-b769-3568b6229ca8 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:23.108327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3a17bdba-ab20-48d5-b769-3568b6229ca8 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:23.109609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3a17bdba-ab20-48d5-b769-3568b6229ca8 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:23.110994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3a17bdba-ab20-48d5-b769-3568b6229ca8 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:23.288602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f0cc919f-a298-40a5-b768-143cef0e3924 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:23.311450 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f0cc919f-a298-40a5-b768-143cef0e3924 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1317 microversion: 2.1 time: 0.371480 Aug 18 11:44:23.312355 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2254/4289] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:22 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:23.316877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-17ccec04-485c-4598-ad74-a405f174edc1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:23.317494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-17ccec04-485c-4598-ad74-a405f174edc1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:23.332217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17ccec04-485c-4598-ad74-a405f174edc1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:23.332719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17ccec04-485c-4598-ad74-a405f174edc1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:23.333159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17ccec04-485c-4598-ad74-a405f174edc1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:23.333998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17ccec04-485c-4598-ad74-a405f174edc1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:23.334491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17ccec04-485c-4598-ad74-a405f174edc1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:23.334926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17ccec04-485c-4598-ad74-a405f174edc1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:23.507552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3a17bdba-ab20-48d5-b769-3568b6229ca8 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:23.513327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-17ccec04-485c-4598-ad74-a405f174edc1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:23.530914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3a17bdba-ab20-48d5-b769-3568b6229ca8 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:23.547187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3a17bdba-ab20-48d5-b769-3568b6229ca8 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '481410c21e374872bdf5694c2c47c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed53d121caa4ae9bff6da6e5e70c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:23.549718 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3a17bdba-ab20-48d5-b769-3568b6229ca8 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b" status: 200 len: 1365 microversion: 2.47 time: 0.497405 Aug 18 11:44:23.551427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-17ccec04-485c-4598-ad74-a405f174edc1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:23.554679 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2036/4290] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:23 2022] GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b => generated 1365 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:23.572892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c954df61-400c-4bfa-80ea-fc60f1ffbc50 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:23.584106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c954df61-400c-4bfa-80ea-fc60f1ffbc50 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:23.587316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-17ccec04-485c-4598-ad74-a405f174edc1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:23.596802 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-17ccec04-485c-4598-ad74-a405f174edc1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.283162 Aug 18 11:44:23.603617 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2255/4291] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:23 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:23.642396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c954df61-400c-4bfa-80ea-fc60f1ffbc50 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:23.643107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c954df61-400c-4bfa-80ea-fc60f1ffbc50 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:23.643698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c954df61-400c-4bfa-80ea-fc60f1ffbc50 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:23.650949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c954df61-400c-4bfa-80ea-fc60f1ffbc50 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:23.651686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c954df61-400c-4bfa-80ea-fc60f1ffbc50 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:23.660414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c954df61-400c-4bfa-80ea-fc60f1ffbc50 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:23.897195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c954df61-400c-4bfa-80ea-fc60f1ffbc50 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:23.938139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c954df61-400c-4bfa-80ea-fc60f1ffbc50 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:23.944464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c954df61-400c-4bfa-80ea-fc60f1ffbc50 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:23.947222 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c954df61-400c-4bfa-80ea-fc60f1ffbc50 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.385422 Aug 18 11:44:23.948014 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2037/4292] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:23 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:24.182651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26e43553-1950-4ee6-acef-e8b9110f262b tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d46bfb6-8bdc-4333-9c69-23070c8d0d54"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:24.185286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26e43553-1950-4ee6-acef-e8b9110f262b tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:24.200006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e43553-1950-4ee6-acef-e8b9110f262b tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:24.201276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e43553-1950-4ee6-acef-e8b9110f262b tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:24.201999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e43553-1950-4ee6-acef-e8b9110f262b tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:24.208891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e43553-1950-4ee6-acef-e8b9110f262b tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:24.209652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e43553-1950-4ee6-acef-e8b9110f262b tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:24.210196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e43553-1950-4ee6-acef-e8b9110f262b tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:24.333185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-98597e4c-8053-40a5-8689-15f9b2ea0957 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:24.334323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-98597e4c-8053-40a5-8689-15f9b2ea0957 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:24.348887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98597e4c-8053-40a5-8689-15f9b2ea0957 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:24.351701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98597e4c-8053-40a5-8689-15f9b2ea0957 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:24.354826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98597e4c-8053-40a5-8689-15f9b2ea0957 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:24.357793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98597e4c-8053-40a5-8689-15f9b2ea0957 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:24.358557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98597e4c-8053-40a5-8689-15f9b2ea0957 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:24.360906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98597e4c-8053-40a5-8689-15f9b2ea0957 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:24.789290 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-26e43553-1950-4ee6-acef-e8b9110f262b tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "POST /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.610357 Aug 18 11:44:24.790275 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2256/4293] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:44:24 2022] POST /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/os-volume_attachments => generated 194 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:44:24.828412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d5f7f0e-135e-4343-a395-1f64f0c2f009 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:24.829145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7d5f7f0e-135e-4343-a395-1f64f0c2f009 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] [instance: dbb00326-eff9-4836-9d1b-c024a219717b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:24.856569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d5f7f0e-135e-4343-a395-1f64f0c2f009 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:24.857072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d5f7f0e-135e-4343-a395-1f64f0c2f009 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:24.865217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d5f7f0e-135e-4343-a395-1f64f0c2f009 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:24.881748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d5f7f0e-135e-4343-a395-1f64f0c2f009 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:24.882257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d5f7f0e-135e-4343-a395-1f64f0c2f009 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:24.891541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d5f7f0e-135e-4343-a395-1f64f0c2f009 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:24.940585 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-7d5f7f0e-135e-4343-a395-1f64f0c2f009 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] HTTP exception thrown: Instance dbb00326-eff9-4836-9d1b-c024a219717b could not be found. Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d5f7f0e-135e-4343-a395-1f64f0c2f009 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Request method failure captured: Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b HTTP/1.1 Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYLANjERnozdFM3g4TrpEf7lOEwqXI_Es1aDUA7JvRklPVXb_vucTRdOmFluZdb7l1t2VlNwe5xrblGqFn4dNQSROdTypkxNW1GpIHgidJDOdWordyxe78rqXTJVry6ANEaQQRMIMv-J4Mr15k9sqsN9h-aJTenOQTaAvRvqnarJF8 Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.47 Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6ed53d121caa4ae9bff6da6e5e70c22a Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersAaction247Test-1344364380 Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6ed53d121caa4ae9bff6da6e5e70c22a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6ed53d121caa4ae9bff6da6e5e70c22a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6ed53d121caa4ae9bff6da6e5e70c22a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6ed53d121caa4ae9bff6da6e5e70c22a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersAaction247Test-1344364380 Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6ed53d121caa4ae9bff6da6e5e70c22a Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersAaction247Test-1344364380 Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersAaction247Test-1344364380-project Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 481410c21e374872bdf5694c2c47c62e Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersAaction247Test-1344364380-project Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance dbb00326-eff9-4836-9d1b-c024a219717b could not be found. Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'dbb00326-eff9-4836-9d1b-c024a219717b'} Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb00326-eff9-4836-9d1b-c024a219717b could not be found. Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb00326-eff9-4836-9d1b-c024a219717b could not be found. Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:24.942901 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:24.946220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:24.946220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:24.946220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:24.946220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:24.946220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:44:24.946220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:44:24.946220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb00326-eff9-4836-9d1b-c024a219717b could not be found. Aug 18 11:44:24.946220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:24.953089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d5f7f0e-135e-4343-a395-1f64f0c2f009 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] Returning 404 to user: Instance dbb00326-eff9-4836-9d1b-c024a219717b could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:24.954251 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7d5f7f0e-135e-4343-a395-1f64f0c2f009 tempest-ServersAaction247Test-1344364380 tempest-ServersAaction247Test-1344364380-project] 10.222.0.73 "GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b" status: 404 len: 111 microversion: 2.47 time: 0.144194 Aug 18 11:44:24.955258 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2257/4294] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:24 2022] GET /compute/v2.1/servers/dbb00326-eff9-4836-9d1b-c024a219717b => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:44:24.993855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-97e776cd-c555-4834-b2b2-a65266072cc2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:25.005268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-97e776cd-c555-4834-b2b2-a65266072cc2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:25.031734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97e776cd-c555-4834-b2b2-a65266072cc2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:25.035274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97e776cd-c555-4834-b2b2-a65266072cc2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:25.040882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97e776cd-c555-4834-b2b2-a65266072cc2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:25.043867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97e776cd-c555-4834-b2b2-a65266072cc2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:25.048417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97e776cd-c555-4834-b2b2-a65266072cc2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:25.048976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97e776cd-c555-4834-b2b2-a65266072cc2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:25.275438 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-98597e4c-8053-40a5-8689-15f9b2ea0957 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:25.277707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-97e776cd-c555-4834-b2b2-a65266072cc2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:25.285552 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-98597e4c-8053-40a5-8689-15f9b2ea0957 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1317 microversion: 2.1 time: 0.956867 Aug 18 11:44:25.289907 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2038/4295] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:24 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1317 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:25.294082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-97e776cd-c555-4834-b2b2-a65266072cc2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:25.296081 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b830024-6afc-40d6-b4b3-d6ef46b6877f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:25.296375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5b830024-6afc-40d6-b4b3-d6ef46b6877f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:25.298366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-97e776cd-c555-4834-b2b2-a65266072cc2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:25.301242 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-97e776cd-c555-4834-b2b2-a65266072cc2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.311625 Aug 18 11:44:25.302137 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2258/4296] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:24 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:25.373055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b830024-6afc-40d6-b4b3-d6ef46b6877f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:25.375991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b830024-6afc-40d6-b4b3-d6ef46b6877f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:25.377047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b830024-6afc-40d6-b4b3-d6ef46b6877f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:25.382897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b830024-6afc-40d6-b4b3-d6ef46b6877f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:25.385000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b830024-6afc-40d6-b4b3-d6ef46b6877f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:25.387307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b830024-6afc-40d6-b4b3-d6ef46b6877f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:25.781241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5b830024-6afc-40d6-b4b3-d6ef46b6877f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:25.827988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5b830024-6afc-40d6-b4b3-d6ef46b6877f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:25.837565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5b830024-6afc-40d6-b4b3-d6ef46b6877f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:25.849350 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5b830024-6afc-40d6-b4b3-d6ef46b6877f tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.557897 Aug 18 11:44:25.883666 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2039/4297] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:25 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:26.327837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f5e8ae87-efcd-4811-a6f8-58c1fb7f6fd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:26.328457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f5e8ae87-efcd-4811-a6f8-58c1fb7f6fd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:26.330147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-61c09e59-77eb-4c9c-af8d-dda8955af3c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:26.332139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-61c09e59-77eb-4c9c-af8d-dda8955af3c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:26.339923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61c09e59-77eb-4c9c-af8d-dda8955af3c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:26.340771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61c09e59-77eb-4c9c-af8d-dda8955af3c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:26.341410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61c09e59-77eb-4c9c-af8d-dda8955af3c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:26.342555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61c09e59-77eb-4c9c-af8d-dda8955af3c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:26.344920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61c09e59-77eb-4c9c-af8d-dda8955af3c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:26.347468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61c09e59-77eb-4c9c-af8d-dda8955af3c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:26.351484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5e8ae87-efcd-4811-a6f8-58c1fb7f6fd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:26.351994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5e8ae87-efcd-4811-a6f8-58c1fb7f6fd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:26.352454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5e8ae87-efcd-4811-a6f8-58c1fb7f6fd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:26.353430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5e8ae87-efcd-4811-a6f8-58c1fb7f6fd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:26.354063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5e8ae87-efcd-4811-a6f8-58c1fb7f6fd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:26.354542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5e8ae87-efcd-4811-a6f8-58c1fb7f6fd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:26.604916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f5e8ae87-efcd-4811-a6f8-58c1fb7f6fd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:26.616374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f5e8ae87-efcd-4811-a6f8-58c1fb7f6fd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:26.624919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f5e8ae87-efcd-4811-a6f8-58c1fb7f6fd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:26.626389 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f5e8ae87-efcd-4811-a6f8-58c1fb7f6fd4 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.302445 Aug 18 11:44:26.630820 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2040/4298] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:26 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:26.897447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-80e73bef-754e-44f1-aa87-ded49a59803b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:26.899012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-80e73bef-754e-44f1-aa87-ded49a59803b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:26.904018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-61c09e59-77eb-4c9c-af8d-dda8955af3c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:26.945562 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-61c09e59-77eb-4c9c-af8d-dda8955af3c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1317 microversion: 2.1 time: 0.637201 Aug 18 11:44:26.950031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80e73bef-754e-44f1-aa87-ded49a59803b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:26.953688 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2259/4299] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:26 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:44:26.959638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80e73bef-754e-44f1-aa87-ded49a59803b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:26.960241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80e73bef-754e-44f1-aa87-ded49a59803b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:26.961452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80e73bef-754e-44f1-aa87-ded49a59803b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:26.963292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80e73bef-754e-44f1-aa87-ded49a59803b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:26.963895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80e73bef-754e-44f1-aa87-ded49a59803b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:27.003154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:27.026686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-84a384c3-80fd-4085-8e90-6369355c61fe req-6f9d4f78-d1b3-447a-afae-3b4a062e626c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0134fd66-53da-4cae-bfae-c3d813a96712", "name": "network-vif-plugged", "status": "completed", "tag": "fcb6250b-8698-4d0b-b229-0ae56b87cef4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:27.063464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-84a384c3-80fd-4085-8e90-6369355c61fe req-6f9d4f78-d1b3-447a-afae-3b4a062e626c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:27.063955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-84a384c3-80fd-4085-8e90-6369355c61fe req-6f9d4f78-d1b3-447a-afae-3b4a062e626c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:27.064394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-84a384c3-80fd-4085-8e90-6369355c61fe req-6f9d4f78-d1b3-447a-afae-3b4a062e626c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:27.116109 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-84a384c3-80fd-4085-8e90-6369355c61fe req-6f9d4f78-d1b3-447a-afae-3b4a062e626c service nova] Creating event network-vif-plugged:fcb6250b-8698-4d0b-b229-0ae56b87cef4 for instance 0134fd66-53da-4cae-bfae-c3d813a96712 on n-h1-853611-3 Aug 18 11:44:27.133866 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-84a384c3-80fd-4085-8e90-6369355c61fe req-6f9d4f78-d1b3-447a-afae-3b4a062e626c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109561 Aug 18 11:44:27.137302 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2260/4300] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:44:27.211451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-80e73bef-754e-44f1-aa87-ded49a59803b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:27.232546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-80e73bef-754e-44f1-aa87-ded49a59803b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:27.236676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-80e73bef-754e-44f1-aa87-ded49a59803b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:27.238876 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-80e73bef-754e-44f1-aa87-ded49a59803b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.352398 Aug 18 11:44:27.252473 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2041/4301] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:26 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:27.675525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e54e0e7-0c2e-4f19-9791-4614c6d56679 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:27.677957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9e54e0e7-0c2e-4f19-9791-4614c6d56679 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:27.694115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e54e0e7-0c2e-4f19-9791-4614c6d56679 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:27.695091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e54e0e7-0c2e-4f19-9791-4614c6d56679 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:27.696155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e54e0e7-0c2e-4f19-9791-4614c6d56679 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:27.697126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e54e0e7-0c2e-4f19-9791-4614c6d56679 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:27.697900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e54e0e7-0c2e-4f19-9791-4614c6d56679 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:27.698607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e54e0e7-0c2e-4f19-9791-4614c6d56679 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:27.839389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9e54e0e7-0c2e-4f19-9791-4614c6d56679 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:27.852800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9e54e0e7-0c2e-4f19-9791-4614c6d56679 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:27.855498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9e54e0e7-0c2e-4f19-9791-4614c6d56679 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:27.857022 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9e54e0e7-0c2e-4f19-9791-4614c6d56679 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.202338 Aug 18 11:44:27.858450 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2261/4302] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:27 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:27.987715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-19181617-2e2c-4353-b7b7-f90d181f6a06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:27.988945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-19181617-2e2c-4353-b7b7-f90d181f6a06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:28.007471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19181617-2e2c-4353-b7b7-f90d181f6a06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:28.008317 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19181617-2e2c-4353-b7b7-f90d181f6a06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:28.008918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19181617-2e2c-4353-b7b7-f90d181f6a06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:28.009891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19181617-2e2c-4353-b7b7-f90d181f6a06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:28.010752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19181617-2e2c-4353-b7b7-f90d181f6a06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:28.011720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-19181617-2e2c-4353-b7b7-f90d181f6a06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:28.270126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6e8dd1c9-63a6-4ac8-957a-20821856e399 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:28.271465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6e8dd1c9-63a6-4ac8-957a-20821856e399 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:28.287977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e8dd1c9-63a6-4ac8-957a-20821856e399 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:28.295895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e8dd1c9-63a6-4ac8-957a-20821856e399 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:28.295895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e8dd1c9-63a6-4ac8-957a-20821856e399 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:28.295895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e8dd1c9-63a6-4ac8-957a-20821856e399 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:28.295895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e8dd1c9-63a6-4ac8-957a-20821856e399 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:28.299728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e8dd1c9-63a6-4ac8-957a-20821856e399 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:28.331745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-19181617-2e2c-4353-b7b7-f90d181f6a06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:28.344937 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-19181617-2e2c-4353-b7b7-f90d181f6a06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1317 microversion: 2.1 time: 0.361050 Aug 18 11:44:28.345842 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2042/4303] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:27 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:44:28.461185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6e8dd1c9-63a6-4ac8-957a-20821856e399 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:28.481770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6e8dd1c9-63a6-4ac8-957a-20821856e399 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:28.489128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6e8dd1c9-63a6-4ac8-957a-20821856e399 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:28.493192 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6e8dd1c9-63a6-4ac8-957a-20821856e399 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.229837 Aug 18 11:44:28.495523 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2262/4304] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:28 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:28.898015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6a424994-bf6b-41c2-bb4f-2d9742debdea tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:28.901399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6a424994-bf6b-41c2-bb4f-2d9742debdea tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:28.953867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6a424994-bf6b-41c2-bb4f-2d9742debdea tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:28.958665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6a424994-bf6b-41c2-bb4f-2d9742debdea tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:28.960068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6a424994-bf6b-41c2-bb4f-2d9742debdea tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:28.961273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6a424994-bf6b-41c2-bb4f-2d9742debdea tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:28.961997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6a424994-bf6b-41c2-bb4f-2d9742debdea tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:28.962680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6a424994-bf6b-41c2-bb4f-2d9742debdea tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:29.173498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6a424994-bf6b-41c2-bb4f-2d9742debdea tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:29.186898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6a424994-bf6b-41c2-bb4f-2d9742debdea tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:29.189213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6a424994-bf6b-41c2-bb4f-2d9742debdea tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:29.191812 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6a424994-bf6b-41c2-bb4f-2d9742debdea tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.305729 Aug 18 11:44:29.193197 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2043/4305] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:28 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:44:29.375725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-40d26ed9-1016-4151-8ac6-b51bd690f609 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:29.376851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-40d26ed9-1016-4151-8ac6-b51bd690f609 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:29.416416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-40d26ed9-1016-4151-8ac6-b51bd690f609 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:29.417047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-40d26ed9-1016-4151-8ac6-b51bd690f609 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:29.417510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-40d26ed9-1016-4151-8ac6-b51bd690f609 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:29.418269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-40d26ed9-1016-4151-8ac6-b51bd690f609 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:29.418768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-40d26ed9-1016-4151-8ac6-b51bd690f609 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:29.425255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-40d26ed9-1016-4151-8ac6-b51bd690f609 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:29.522251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a1716744-dc6f-4286-9b45-00f26cd9a00d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:29.522935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a1716744-dc6f-4286-9b45-00f26cd9a00d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:29.538347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1716744-dc6f-4286-9b45-00f26cd9a00d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:29.539060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1716744-dc6f-4286-9b45-00f26cd9a00d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:29.539516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1716744-dc6f-4286-9b45-00f26cd9a00d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:29.540249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1716744-dc6f-4286-9b45-00f26cd9a00d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:29.540863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1716744-dc6f-4286-9b45-00f26cd9a00d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:29.541304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1716744-dc6f-4286-9b45-00f26cd9a00d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:29.709590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a1716744-dc6f-4286-9b45-00f26cd9a00d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:29.719792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-40d26ed9-1016-4151-8ac6-b51bd690f609 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:29.733797 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-40d26ed9-1016-4151-8ac6-b51bd690f609 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1506 microversion: 2.1 time: 0.365364 Aug 18 11:44:29.737573 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2263/4306] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:29 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:29.739665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a1716744-dc6f-4286-9b45-00f26cd9a00d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:29.741871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a1716744-dc6f-4286-9b45-00f26cd9a00d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:29.743663 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a1716744-dc6f-4286-9b45-00f26cd9a00d tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.226181 Aug 18 11:44:29.744721 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2044/4307] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:29 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:44:29.787557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e6a1f3e1-68e8-4f82-b4c1-868a94e9ff88 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:29.789700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e6a1f3e1-68e8-4f82-b4c1-868a94e9ff88 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:29.807221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6a1f3e1-68e8-4f82-b4c1-868a94e9ff88 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:29.808149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6a1f3e1-68e8-4f82-b4c1-868a94e9ff88 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:29.808861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6a1f3e1-68e8-4f82-b4c1-868a94e9ff88 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:29.809754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6a1f3e1-68e8-4f82-b4c1-868a94e9ff88 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:29.811496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6a1f3e1-68e8-4f82-b4c1-868a94e9ff88 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:29.813195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6a1f3e1-68e8-4f82-b4c1-868a94e9ff88 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:29.851444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e6a1f3e1-68e8-4f82-b4c1-868a94e9ff88 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:44:29.951062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:30.039382 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e6a1f3e1-68e8-4f82-b4c1-868a94e9ff88 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 204 len: 0 microversion: 2.1 time: 0.264111 Aug 18 11:44:30.041277 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2264/4308] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:44:29 2022] DELETE /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:44:30.051347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f14b789a-6366-4be4-a189-f150acd88a2d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:30.052286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f14b789a-6366-4be4-a189-f150acd88a2d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:30.071293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f14b789a-6366-4be4-a189-f150acd88a2d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:30.072131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f14b789a-6366-4be4-a189-f150acd88a2d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:30.072593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f14b789a-6366-4be4-a189-f150acd88a2d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:30.077564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f14b789a-6366-4be4-a189-f150acd88a2d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:30.079914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f14b789a-6366-4be4-a189-f150acd88a2d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:30.082714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f14b789a-6366-4be4-a189-f150acd88a2d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:30.219011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-072fab33-6b78-4e33-8418-6bf23cf2112f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:30.220066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-072fab33-6b78-4e33-8418-6bf23cf2112f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:30.239045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-072fab33-6b78-4e33-8418-6bf23cf2112f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:30.239846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-072fab33-6b78-4e33-8418-6bf23cf2112f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:30.240604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-072fab33-6b78-4e33-8418-6bf23cf2112f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:30.241522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-072fab33-6b78-4e33-8418-6bf23cf2112f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:30.242170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-072fab33-6b78-4e33-8418-6bf23cf2112f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:30.243311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-072fab33-6b78-4e33-8418-6bf23cf2112f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:30.476345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-072fab33-6b78-4e33-8418-6bf23cf2112f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:30.491478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-072fab33-6b78-4e33-8418-6bf23cf2112f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:30.495806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-072fab33-6b78-4e33-8418-6bf23cf2112f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:30.499083 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-072fab33-6b78-4e33-8418-6bf23cf2112f tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.284660 Aug 18 11:44:30.501152 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2265/4309] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:30 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:44:30.753471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f14b789a-6366-4be4-a189-f150acd88a2d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:30.770223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bf15e36c-d367-4475-a20b-66ce07c8c42e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:30.771052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bf15e36c-d367-4475-a20b-66ce07c8c42e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:30.788016 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f14b789a-6366-4be4-a189-f150acd88a2d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1512 microversion: 2.1 time: 0.741950 Aug 18 11:44:30.790819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf15e36c-d367-4475-a20b-66ce07c8c42e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:30.791333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf15e36c-d367-4475-a20b-66ce07c8c42e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:30.794327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf15e36c-d367-4475-a20b-66ce07c8c42e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:30.795429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf15e36c-d367-4475-a20b-66ce07c8c42e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:30.795908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf15e36c-d367-4475-a20b-66ce07c8c42e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:30.799777 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2045/4310] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:30 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1512 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:30.802255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf15e36c-d367-4475-a20b-66ce07c8c42e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:31.278851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bf15e36c-d367-4475-a20b-66ce07c8c42e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:31.296227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bf15e36c-d367-4475-a20b-66ce07c8c42e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:31.302790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bf15e36c-d367-4475-a20b-66ce07c8c42e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:31.304129 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bf15e36c-d367-4475-a20b-66ce07c8c42e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.538690 Aug 18 11:44:31.307690 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2266/4311] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:30 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:44:31.527443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-236d49ee-f3ef-4347-a103-ed4a47b09f36 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:31.528453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-236d49ee-f3ef-4347-a103-ed4a47b09f36 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:31.559213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-236d49ee-f3ef-4347-a103-ed4a47b09f36 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:31.560903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-236d49ee-f3ef-4347-a103-ed4a47b09f36 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:31.561431 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-236d49ee-f3ef-4347-a103-ed4a47b09f36 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:31.562199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-236d49ee-f3ef-4347-a103-ed4a47b09f36 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:31.562702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-236d49ee-f3ef-4347-a103-ed4a47b09f36 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:31.565878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-236d49ee-f3ef-4347-a103-ed4a47b09f36 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:31.805872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-236d49ee-f3ef-4347-a103-ed4a47b09f36 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:31.828926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-236d49ee-f3ef-4347-a103-ed4a47b09f36 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:31.830596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-236d49ee-f3ef-4347-a103-ed4a47b09f36 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:31.838601 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-236d49ee-f3ef-4347-a103-ed4a47b09f36 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.315040 Aug 18 11:44:31.839218 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2046/4312] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:31 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:31.839776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f7537510-d16b-4fb0-933f-22ead68e52c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:31.841028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f7537510-d16b-4fb0-933f-22ead68e52c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:31.855161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7537510-d16b-4fb0-933f-22ead68e52c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:31.856005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7537510-d16b-4fb0-933f-22ead68e52c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:31.856658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7537510-d16b-4fb0-933f-22ead68e52c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:31.857614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7537510-d16b-4fb0-933f-22ead68e52c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:31.858279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7537510-d16b-4fb0-933f-22ead68e52c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:31.858941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7537510-d16b-4fb0-933f-22ead68e52c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:32.329371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8cb842c1-7ed8-4b55-bcf6-79bcd560b868 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:32.330622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8cb842c1-7ed8-4b55-bcf6-79bcd560b868 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:32.341999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8cb842c1-7ed8-4b55-bcf6-79bcd560b868 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:32.342539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8cb842c1-7ed8-4b55-bcf6-79bcd560b868 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:32.342989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8cb842c1-7ed8-4b55-bcf6-79bcd560b868 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:32.347192 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8cb842c1-7ed8-4b55-bcf6-79bcd560b868 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:32.349032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8cb842c1-7ed8-4b55-bcf6-79bcd560b868 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:32.350907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8cb842c1-7ed8-4b55-bcf6-79bcd560b868 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:32.543574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8cb842c1-7ed8-4b55-bcf6-79bcd560b868 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:32.569650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8cb842c1-7ed8-4b55-bcf6-79bcd560b868 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:32.575074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8cb842c1-7ed8-4b55-bcf6-79bcd560b868 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:32.578584 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8cb842c1-7ed8-4b55-bcf6-79bcd560b868 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.254247 Aug 18 11:44:32.582270 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2047/4313] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:32 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:44:32.866975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-58514b59-dd0b-45f3-a75e-bb07b786cb68 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:32.867730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-58514b59-dd0b-45f3-a75e-bb07b786cb68 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:32.884495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58514b59-dd0b-45f3-a75e-bb07b786cb68 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:32.885296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58514b59-dd0b-45f3-a75e-bb07b786cb68 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:32.885798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58514b59-dd0b-45f3-a75e-bb07b786cb68 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:32.886595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58514b59-dd0b-45f3-a75e-bb07b786cb68 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:32.891133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58514b59-dd0b-45f3-a75e-bb07b786cb68 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:32.891607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58514b59-dd0b-45f3-a75e-bb07b786cb68 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:33.011365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-58514b59-dd0b-45f3-a75e-bb07b786cb68 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:33.025803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-58514b59-dd0b-45f3-a75e-bb07b786cb68 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:33.030872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-58514b59-dd0b-45f3-a75e-bb07b786cb68 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:33.032523 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-58514b59-dd0b-45f3-a75e-bb07b786cb68 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.170895 Aug 18 11:44:33.052594 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2048/4314] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:32 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:44:33.164852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f7537510-d16b-4fb0-933f-22ead68e52c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:33.178108 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f7537510-d16b-4fb0-933f-22ead68e52c6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 200 len: 1512 microversion: 2.1 time: 1.342861 Aug 18 11:44:33.195071 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2267/4315] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:31 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 1512 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:33.605759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6d9eea46-21cc-4491-af10-6df51756eadb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:33.606398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6d9eea46-21cc-4491-af10-6df51756eadb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:33.624103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-12b734a6-a842-4cf4-a250-fda2f4cc6a81 req-2dc4d8c9-d20a-4bd1-842b-e22972e0211c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0134fd66-53da-4cae-bfae-c3d813a96712", "name": "network-vif-deleted", "tag": "fcb6250b-8698-4d0b-b229-0ae56b87cef4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:33.624797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d9eea46-21cc-4491-af10-6df51756eadb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:33.625310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d9eea46-21cc-4491-af10-6df51756eadb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:33.625744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d9eea46-21cc-4491-af10-6df51756eadb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:33.626471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d9eea46-21cc-4491-af10-6df51756eadb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:33.636923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d9eea46-21cc-4491-af10-6df51756eadb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:33.637405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d9eea46-21cc-4491-af10-6df51756eadb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:33.651506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-12b734a6-a842-4cf4-a250-fda2f4cc6a81 req-2dc4d8c9-d20a-4bd1-842b-e22972e0211c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:33.653040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-12b734a6-a842-4cf4-a250-fda2f4cc6a81 req-2dc4d8c9-d20a-4bd1-842b-e22972e0211c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:33.655349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-12b734a6-a842-4cf4-a250-fda2f4cc6a81 req-2dc4d8c9-d20a-4bd1-842b-e22972e0211c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:33.697787 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-12b734a6-a842-4cf4-a250-fda2f4cc6a81 req-2dc4d8c9-d20a-4bd1-842b-e22972e0211c service nova] Creating event network-vif-deleted:fcb6250b-8698-4d0b-b229-0ae56b87cef4 for instance 0134fd66-53da-4cae-bfae-c3d813a96712 on n-h1-853611-3 Aug 18 11:44:33.708589 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-12b734a6-a842-4cf4-a250-fda2f4cc6a81 req-2dc4d8c9-d20a-4bd1-842b-e22972e0211c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088066 Aug 18 11:44:33.709784 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2268/4316] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:44:33.952457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6d9eea46-21cc-4491-af10-6df51756eadb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:33.977757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6d9eea46-21cc-4491-af10-6df51756eadb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:33.982204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6d9eea46-21cc-4491-af10-6df51756eadb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:33.983788 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6d9eea46-21cc-4491-af10-6df51756eadb tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.382273 Aug 18 11:44:34.003123 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2049/4317] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:33 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:34.062027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d91b71d-5816-4930-b888-a7814fabb338 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:34.066891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7d91b71d-5816-4930-b888-a7814fabb338 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:34.086367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d91b71d-5816-4930-b888-a7814fabb338 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:34.087207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d91b71d-5816-4930-b888-a7814fabb338 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:34.087849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d91b71d-5816-4930-b888-a7814fabb338 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:34.088775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d91b71d-5816-4930-b888-a7814fabb338 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:34.090579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d91b71d-5816-4930-b888-a7814fabb338 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:34.094332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d91b71d-5816-4930-b888-a7814fabb338 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:34.308825 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4d07b39a-0fcd-4614-85ec-629ab6e343ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:34.309646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4d07b39a-0fcd-4614-85ec-629ab6e343ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:34.323363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d07b39a-0fcd-4614-85ec-629ab6e343ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:34.325571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d07b39a-0fcd-4614-85ec-629ab6e343ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:34.329073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d07b39a-0fcd-4614-85ec-629ab6e343ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:34.332673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d07b39a-0fcd-4614-85ec-629ab6e343ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:34.333567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d07b39a-0fcd-4614-85ec-629ab6e343ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:34.335005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d07b39a-0fcd-4614-85ec-629ab6e343ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:34.377782 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-4d07b39a-0fcd-4614-85ec-629ab6e343ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4d07b39a-0fcd-4614-85ec-629ab6e343ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 HTTP/1.1 Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '0134fd66-53da-4cae-bfae-c3d813a96712'} Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:34.384826 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:34.388945 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:34.388945 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:34.388945 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:34.388945 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:44:34.388945 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:44:34.388945 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:44:34.388945 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:34.390607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4d07b39a-0fcd-4614-85ec-629ab6e343ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:34.394210 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4d07b39a-0fcd-4614-85ec-629ab6e343ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 404 len: 111 microversion: 2.1 time: 0.089574 Aug 18 11:44:34.398789 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2050/4318] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:34 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:44:34.410852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4cdcc9af-7474-4db2-be71-6ca91f9d5530 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:34.411893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4cdcc9af-7474-4db2-be71-6ca91f9d5530 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:34.427863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cdcc9af-7474-4db2-be71-6ca91f9d5530 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:34.431277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cdcc9af-7474-4db2-be71-6ca91f9d5530 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:34.431999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cdcc9af-7474-4db2-be71-6ca91f9d5530 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:34.432914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cdcc9af-7474-4db2-be71-6ca91f9d5530 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:34.435563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cdcc9af-7474-4db2-be71-6ca91f9d5530 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:34.436212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cdcc9af-7474-4db2-be71-6ca91f9d5530 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:34.537382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7d91b71d-5816-4930-b888-a7814fabb338 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:34.548619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7d91b71d-5816-4930-b888-a7814fabb338 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:34.559585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7d91b71d-5816-4930-b888-a7814fabb338 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:34.562646 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7d91b71d-5816-4930-b888-a7814fabb338 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.506670 Aug 18 11:44:34.574080 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2269/4319] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:34 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:35.018933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b3c5a408-b839-43a4-bddb-87d4753d3899 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:35.019727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b3c5a408-b839-43a4-bddb-87d4753d3899 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:35.038708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3c5a408-b839-43a4-bddb-87d4753d3899 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:35.044705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3c5a408-b839-43a4-bddb-87d4753d3899 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:35.045418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3c5a408-b839-43a4-bddb-87d4753d3899 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:35.046552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3c5a408-b839-43a4-bddb-87d4753d3899 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:35.047166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3c5a408-b839-43a4-bddb-87d4753d3899 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:35.047707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b3c5a408-b839-43a4-bddb-87d4753d3899 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:35.166111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4cdcc9af-7474-4db2-be71-6ca91f9d5530 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:35.179811 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4cdcc9af-7474-4db2-be71-6ca91f9d5530 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.778902 Aug 18 11:44:35.182606 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2051/4320] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:34 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:35.491830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2337443-fda4-4a0a-b66b-7ab024ed237b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2337443-fda4-4a0a-b66b-7ab024ed237b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 163 Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": 12345, "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'networks': [{'uuid': 'c201add2-2905-4a42-a119-5f0f7b3c5bb7'}]}}} Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 12345 Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:44:35.543665 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:44:35.547950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:44:35.547950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 18 11:44:35.547950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:35.547950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:35.547950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:35.547950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:35.547950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:35.547950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:35.547950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:44:35.547950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:44:35.547950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 18 11:44:35.547950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:35.550470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2337443-fda4-4a0a-b66b-7ab024ed237b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:35.560188 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a2337443-fda4-4a0a-b66b-7ab024ed237b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.076020 Aug 18 11:44:35.561010 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2052/4321] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:44:35 2022] POST /compute/v2.1/servers => generated 127 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 11:44:35.583011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1b07a55d-0ad2-46e3-9ea9-3e137ebc614a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:35.593042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1b07a55d-0ad2-46e3-9ea9-3e137ebc614a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:35.620421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b07a55d-0ad2-46e3-9ea9-3e137ebc614a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:35.621419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b07a55d-0ad2-46e3-9ea9-3e137ebc614a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:35.625459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b07a55d-0ad2-46e3-9ea9-3e137ebc614a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:35.632141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b07a55d-0ad2-46e3-9ea9-3e137ebc614a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:35.632983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b07a55d-0ad2-46e3-9ea9-3e137ebc614a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:35.634130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b07a55d-0ad2-46e3-9ea9-3e137ebc614a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:35.675870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b3c5a408-b839-43a4-bddb-87d4753d3899 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:35.689700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b3c5a408-b839-43a4-bddb-87d4753d3899 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:35.704063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b3c5a408-b839-43a4-bddb-87d4753d3899 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:35.713166 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b3c5a408-b839-43a4-bddb-87d4753d3899 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.701159 Aug 18 11:44:35.715181 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2270/4322] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:35 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:35.735875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11da5a3f-1e47-43a6-bb28-2f8a267d7e2e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:35.736542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-11da5a3f-1e47-43a6-bb28-2f8a267d7e2e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:35.750256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11da5a3f-1e47-43a6-bb28-2f8a267d7e2e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:35.751055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11da5a3f-1e47-43a6-bb28-2f8a267d7e2e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:35.764198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11da5a3f-1e47-43a6-bb28-2f8a267d7e2e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:35.765381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11da5a3f-1e47-43a6-bb28-2f8a267d7e2e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:35.768014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11da5a3f-1e47-43a6-bb28-2f8a267d7e2e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:35.768674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11da5a3f-1e47-43a6-bb28-2f8a267d7e2e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:36.058045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1b07a55d-0ad2-46e3-9ea9-3e137ebc614a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:36.064582 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1b07a55d-0ad2-46e3-9ea9-3e137ebc614a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.496100 Aug 18 11:44:36.082830 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2053/4323] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:35 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:36.097620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9a47fab2-bb4f-4c6a-aa3f-efe5facabaec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:36.098322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9a47fab2-bb4f-4c6a-aa3f-efe5facabaec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:36.108195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:36.135864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a47fab2-bb4f-4c6a-aa3f-efe5facabaec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:36.138336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a47fab2-bb4f-4c6a-aa3f-efe5facabaec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:36.139156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a47fab2-bb4f-4c6a-aa3f-efe5facabaec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:36.140236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a47fab2-bb4f-4c6a-aa3f-efe5facabaec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:36.141088 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a47fab2-bb4f-4c6a-aa3f-efe5facabaec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:36.141673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9a47fab2-bb4f-4c6a-aa3f-efe5facabaec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:36.245370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11da5a3f-1e47-43a6-bb28-2f8a267d7e2e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:36.260108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11da5a3f-1e47-43a6-bb28-2f8a267d7e2e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:36.260108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11da5a3f-1e47-43a6-bb28-2f8a267d7e2e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:36.261341 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-11da5a3f-1e47-43a6-bb28-2f8a267d7e2e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.545028 Aug 18 11:44:36.266781 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2271/4324] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:35 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:36.528661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9a47fab2-bb4f-4c6a-aa3f-efe5facabaec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:36.539786 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9a47fab2-bb4f-4c6a-aa3f-efe5facabaec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.455843 Aug 18 11:44:36.561761 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2054/4325] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:36 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:36.742882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11687107-b31c-4e0d-95ab-89958ed96b90 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:36.743689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-11687107-b31c-4e0d-95ab-89958ed96b90 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:36.751872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11687107-b31c-4e0d-95ab-89958ed96b90 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:36.753010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11687107-b31c-4e0d-95ab-89958ed96b90 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:36.754180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11687107-b31c-4e0d-95ab-89958ed96b90 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:36.755415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11687107-b31c-4e0d-95ab-89958ed96b90 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:36.756301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11687107-b31c-4e0d-95ab-89958ed96b90 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:36.756935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11687107-b31c-4e0d-95ab-89958ed96b90 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:36.916098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11687107-b31c-4e0d-95ab-89958ed96b90 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:36.945393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11687107-b31c-4e0d-95ab-89958ed96b90 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:36.948075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11687107-b31c-4e0d-95ab-89958ed96b90 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:36.955727 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-11687107-b31c-4e0d-95ab-89958ed96b90 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.217034 Aug 18 11:44:36.960860 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2272/4326] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:36 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:37.287053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a47dc7ec-c1be-40fd-a22a-3dfdaad44c76 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:37.287658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a47dc7ec-c1be-40fd-a22a-3dfdaad44c76 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:37.313381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a47dc7ec-c1be-40fd-a22a-3dfdaad44c76 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:37.313993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a47dc7ec-c1be-40fd-a22a-3dfdaad44c76 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:37.314648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a47dc7ec-c1be-40fd-a22a-3dfdaad44c76 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:37.321109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a47dc7ec-c1be-40fd-a22a-3dfdaad44c76 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:37.321628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a47dc7ec-c1be-40fd-a22a-3dfdaad44c76 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:37.327190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a47dc7ec-c1be-40fd-a22a-3dfdaad44c76 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:37.613564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a47dc7ec-c1be-40fd-a22a-3dfdaad44c76 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:37.625228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a47dc7ec-c1be-40fd-a22a-3dfdaad44c76 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:37.633553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a47dc7ec-c1be-40fd-a22a-3dfdaad44c76 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:37.637618 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a47dc7ec-c1be-40fd-a22a-3dfdaad44c76 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.356270 Aug 18 11:44:37.639301 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2055/4327] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:37 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:37.984112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a942422c-e7ec-4660-83ac-abbc2a260bdc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:37.984797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a942422c-e7ec-4660-83ac-abbc2a260bdc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:38.005217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a942422c-e7ec-4660-83ac-abbc2a260bdc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:38.006502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a942422c-e7ec-4660-83ac-abbc2a260bdc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:38.006502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a942422c-e7ec-4660-83ac-abbc2a260bdc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:38.021286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a942422c-e7ec-4660-83ac-abbc2a260bdc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:38.022187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a942422c-e7ec-4660-83ac-abbc2a260bdc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:38.022435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a942422c-e7ec-4660-83ac-abbc2a260bdc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:38.205040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a942422c-e7ec-4660-83ac-abbc2a260bdc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:38.217885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a942422c-e7ec-4660-83ac-abbc2a260bdc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:38.220629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a942422c-e7ec-4660-83ac-abbc2a260bdc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:38.222149 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a942422c-e7ec-4660-83ac-abbc2a260bdc tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.242266 Aug 18 11:44:38.226413 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2273/4328] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:37 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:38.661692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-52edc3f2-f1c5-42db-8a6c-52ccf04e21c1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:38.662322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-52edc3f2-f1c5-42db-8a6c-52ccf04e21c1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:38.673935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-52edc3f2-f1c5-42db-8a6c-52ccf04e21c1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:38.680233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-52edc3f2-f1c5-42db-8a6c-52ccf04e21c1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:38.680854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-52edc3f2-f1c5-42db-8a6c-52ccf04e21c1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:38.681710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-52edc3f2-f1c5-42db-8a6c-52ccf04e21c1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:38.682218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-52edc3f2-f1c5-42db-8a6c-52ccf04e21c1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:38.682821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-52edc3f2-f1c5-42db-8a6c-52ccf04e21c1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:38.952178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-52edc3f2-f1c5-42db-8a6c-52ccf04e21c1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:38.963840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-52edc3f2-f1c5-42db-8a6c-52ccf04e21c1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:38.966586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-52edc3f2-f1c5-42db-8a6c-52ccf04e21c1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:38.968170 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-52edc3f2-f1c5-42db-8a6c-52ccf04e21c1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.310958 Aug 18 11:44:38.991983 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2056/4329] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:38 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:39.247212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b8f0d927-adeb-40ab-b21e-3940168132a3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:39.248412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b8f0d927-adeb-40ab-b21e-3940168132a3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:39.257542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8f0d927-adeb-40ab-b21e-3940168132a3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:39.262488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8f0d927-adeb-40ab-b21e-3940168132a3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:39.263117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8f0d927-adeb-40ab-b21e-3940168132a3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:39.264044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8f0d927-adeb-40ab-b21e-3940168132a3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:39.265525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8f0d927-adeb-40ab-b21e-3940168132a3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:39.268159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8f0d927-adeb-40ab-b21e-3940168132a3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:39.435598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8f0d927-adeb-40ab-b21e-3940168132a3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:39.451837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8f0d927-adeb-40ab-b21e-3940168132a3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:39.456943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8f0d927-adeb-40ab-b21e-3940168132a3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:39.458950 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b8f0d927-adeb-40ab-b21e-3940168132a3 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.215682 Aug 18 11:44:39.460246 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2274/4330] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:39 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:40.005991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8f8b7279-17db-4217-8882-bd27f7c29af9 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:40.008772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8f8b7279-17db-4217-8882-bd27f7c29af9 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:40.037896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f8b7279-17db-4217-8882-bd27f7c29af9 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:40.039639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f8b7279-17db-4217-8882-bd27f7c29af9 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:40.040404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f8b7279-17db-4217-8882-bd27f7c29af9 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:40.041396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f8b7279-17db-4217-8882-bd27f7c29af9 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:40.042099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f8b7279-17db-4217-8882-bd27f7c29af9 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:40.042845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8f8b7279-17db-4217-8882-bd27f7c29af9 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:40.239082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8f8b7279-17db-4217-8882-bd27f7c29af9 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:40.274188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8f8b7279-17db-4217-8882-bd27f7c29af9 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:40.276400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8f8b7279-17db-4217-8882-bd27f7c29af9 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:40.279145 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8f8b7279-17db-4217-8882-bd27f7c29af9 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.282118 Aug 18 11:44:40.299308 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2057/4331] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:39 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:40.488694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6383e69d-dfd3-4d3c-8ac4-f669da909066 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:40.489551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6383e69d-dfd3-4d3c-8ac4-f669da909066 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:40.509938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6383e69d-dfd3-4d3c-8ac4-f669da909066 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:40.510756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6383e69d-dfd3-4d3c-8ac4-f669da909066 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:40.511499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6383e69d-dfd3-4d3c-8ac4-f669da909066 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:40.512686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6383e69d-dfd3-4d3c-8ac4-f669da909066 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:40.513443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6383e69d-dfd3-4d3c-8ac4-f669da909066 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:40.514146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6383e69d-dfd3-4d3c-8ac4-f669da909066 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:41.231843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6383e69d-dfd3-4d3c-8ac4-f669da909066 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:41.272867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6383e69d-dfd3-4d3c-8ac4-f669da909066 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:41.274443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6383e69d-dfd3-4d3c-8ac4-f669da909066 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:41.284015 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6383e69d-dfd3-4d3c-8ac4-f669da909066 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.799781 Aug 18 11:44:41.284658 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2275/4332] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:40 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:41.313295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1840dea-9ad6-4dc1-8eb1-5b9bc3e5c950 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:41.314535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1840dea-9ad6-4dc1-8eb1-5b9bc3e5c950 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:41.343379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1840dea-9ad6-4dc1-8eb1-5b9bc3e5c950 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:41.343927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1840dea-9ad6-4dc1-8eb1-5b9bc3e5c950 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:41.344400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1840dea-9ad6-4dc1-8eb1-5b9bc3e5c950 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:41.345339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1840dea-9ad6-4dc1-8eb1-5b9bc3e5c950 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:41.346083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1840dea-9ad6-4dc1-8eb1-5b9bc3e5c950 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:41.346572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1840dea-9ad6-4dc1-8eb1-5b9bc3e5c950 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:41.553770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-2081351831", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "748eeef0-4e88-4443-abac-e79de3b3bb2a"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:41.643025 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] validate_networks() for [('748eeef0-4e88-4443-abac-e79de3b3bb2a', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:44:41.693709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a1840dea-9ad6-4dc1-8eb1-5b9bc3e5c950 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:41.707023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a1840dea-9ad6-4dc1-8eb1-5b9bc3e5c950 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:41.709176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a1840dea-9ad6-4dc1-8eb1-5b9bc3e5c950 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:41.712811 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1840dea-9ad6-4dc1-8eb1-5b9bc3e5c950 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1365 microversion: 2.47 time: 0.409998 Aug 18 11:44:41.717287 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2276/4333] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:41 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1365 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:42.319688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cbd10fe6-9bb7-40ac-ae37-d567784dc3ca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:42.320328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cbd10fe6-9bb7-40ac-ae37-d567784dc3ca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:42.348538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbd10fe6-9bb7-40ac-ae37-d567784dc3ca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:42.349226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbd10fe6-9bb7-40ac-ae37-d567784dc3ca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:42.349687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbd10fe6-9bb7-40ac-ae37-d567784dc3ca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:42.350456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbd10fe6-9bb7-40ac-ae37-d567784dc3ca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:42.350939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbd10fe6-9bb7-40ac-ae37-d567784dc3ca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:42.351372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbd10fe6-9bb7-40ac-ae37-d567784dc3ca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:42.598872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cbd10fe6-9bb7-40ac-ae37-d567784dc3ca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:42.622865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cbd10fe6-9bb7-40ac-ae37-d567784dc3ca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:42.624414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cbd10fe6-9bb7-40ac-ae37-d567784dc3ca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:42.629590 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cbd10fe6-9bb7-40ac-ae37-d567784dc3ca tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.319416 Aug 18 11:44:42.634173 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2277/4334] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:42 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:42.752026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-026331fb-f394-41ef-bc8e-7ec1ec8fb3aa tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:42.752988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-026331fb-f394-41ef-bc8e-7ec1ec8fb3aa tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:42.771247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-026331fb-f394-41ef-bc8e-7ec1ec8fb3aa tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:42.772600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-026331fb-f394-41ef-bc8e-7ec1ec8fb3aa tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:42.773040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-026331fb-f394-41ef-bc8e-7ec1ec8fb3aa tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:42.773968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-026331fb-f394-41ef-bc8e-7ec1ec8fb3aa tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:42.774632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-026331fb-f394-41ef-bc8e-7ec1ec8fb3aa tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:42.781141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-026331fb-f394-41ef-bc8e-7ec1ec8fb3aa tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:42.944918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:44:42.948580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:44:42.949314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:44:42.950841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:44:42.951707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:44:42.965637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:42.967352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:42.969042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:42.975115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:42.976399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:42.977467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:43.047541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:44:43.051394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-026331fb-f394-41ef-bc8e-7ec1ec8fb3aa tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:43.067368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-026331fb-f394-41ef-bc8e-7ec1ec8fb3aa tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:43.068105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for user c850b0a836124d90b7e50fe8b9fdf011 and project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:44:43.072718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-026331fb-f394-41ef-bc8e-7ec1ec8fb3aa tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:43.076520 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-026331fb-f394-41ef-bc8e-7ec1ec8fb3aa tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1371 microversion: 2.47 time: 0.339270 Aug 18 11:44:43.081276 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2278/4335] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:42 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:43.107796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:44:43.113561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:44:43.256287 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-34491a35-4a79-479d-82be-9278b42efdcc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.072654 Aug 18 11:44:43.265680 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2058/4336] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:44:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:44:43.271101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a4c1a6c7-9e1f-4c6c-8147-bcfdc63002c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:43.271717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a4c1a6c7-9e1f-4c6c-8147-bcfdc63002c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:43.471349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a4c1a6c7-9e1f-4c6c-8147-bcfdc63002c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:43.479122 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a4c1a6c7-9e1f-4c6c-8147-bcfdc63002c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1193 microversion: 2.1 time: 0.212461 Aug 18 11:44:43.492630 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2279/4337] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:43 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1193 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:43.653108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5c779b62-c7ab-40fb-8515-20b5ebec51cd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:43.653876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5c779b62-c7ab-40fb-8515-20b5ebec51cd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:43.662325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c779b62-c7ab-40fb-8515-20b5ebec51cd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:43.679966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c779b62-c7ab-40fb-8515-20b5ebec51cd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:43.680757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c779b62-c7ab-40fb-8515-20b5ebec51cd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:43.683235 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c779b62-c7ab-40fb-8515-20b5ebec51cd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:43.686623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c779b62-c7ab-40fb-8515-20b5ebec51cd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:43.688852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c779b62-c7ab-40fb-8515-20b5ebec51cd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:43.945074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5c779b62-c7ab-40fb-8515-20b5ebec51cd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:43.966156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5c779b62-c7ab-40fb-8515-20b5ebec51cd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:43.968675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5c779b62-c7ab-40fb-8515-20b5ebec51cd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:43.970778 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5c779b62-c7ab-40fb-8515-20b5ebec51cd tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.321606 Aug 18 11:44:43.971989 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2059/4338] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:43 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:44.109293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9d7d7752-f042-428f-bea7-9ed5f2ab363a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:44.110176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9d7d7752-f042-428f-bea7-9ed5f2ab363a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:44.128722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d7d7752-f042-428f-bea7-9ed5f2ab363a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:44.130361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d7d7752-f042-428f-bea7-9ed5f2ab363a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:44.130861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d7d7752-f042-428f-bea7-9ed5f2ab363a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:44.134460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d7d7752-f042-428f-bea7-9ed5f2ab363a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:44.135031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d7d7752-f042-428f-bea7-9ed5f2ab363a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:44.135478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d7d7752-f042-428f-bea7-9ed5f2ab363a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:44.201677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:44.331632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9d7d7752-f042-428f-bea7-9ed5f2ab363a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:44.353370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9d7d7752-f042-428f-bea7-9ed5f2ab363a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:44.368741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9d7d7752-f042-428f-bea7-9ed5f2ab363a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:44.369962 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9d7d7752-f042-428f-bea7-9ed5f2ab363a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1371 microversion: 2.47 time: 0.268328 Aug 18 11:44:44.383623 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2060/4339] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:44 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:44.515147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f9dcfbef-9e98-4b4e-bd02-fdd73ba5bce2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:44.515926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f9dcfbef-9e98-4b4e-bd02-fdd73ba5bce2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:44.528766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9dcfbef-9e98-4b4e-bd02-fdd73ba5bce2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:44.529273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9dcfbef-9e98-4b4e-bd02-fdd73ba5bce2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:44.533816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9dcfbef-9e98-4b4e-bd02-fdd73ba5bce2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:44.540047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9dcfbef-9e98-4b4e-bd02-fdd73ba5bce2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:44.545499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9dcfbef-9e98-4b4e-bd02-fdd73ba5bce2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:44.546055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9dcfbef-9e98-4b4e-bd02-fdd73ba5bce2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:44.760130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f9dcfbef-9e98-4b4e-bd02-fdd73ba5bce2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:44.770467 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f9dcfbef-9e98-4b4e-bd02-fdd73ba5bce2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1197 microversion: 2.1 time: 0.259496 Aug 18 11:44:44.777898 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2061/4340] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:44 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1197 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:44.809530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1130604477", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "14ad8b67-fea6-4d7d-893b-f3d639b05ee9"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:44.957971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] validate_networks() for [('14ad8b67-fea6-4d7d-893b-f3d639b05ee9', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:44:45.000406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-567c8d25-3341-4df1-87d2-8ad742b6f5a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:45.002106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-567c8d25-3341-4df1-87d2-8ad742b6f5a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:45.017665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-567c8d25-3341-4df1-87d2-8ad742b6f5a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:45.018319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-567c8d25-3341-4df1-87d2-8ad742b6f5a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:45.020779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-567c8d25-3341-4df1-87d2-8ad742b6f5a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:45.021682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-567c8d25-3341-4df1-87d2-8ad742b6f5a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:45.027845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-567c8d25-3341-4df1-87d2-8ad742b6f5a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:45.028496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-567c8d25-3341-4df1-87d2-8ad742b6f5a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:45.163744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-567c8d25-3341-4df1-87d2-8ad742b6f5a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:45.182887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-567c8d25-3341-4df1-87d2-8ad742b6f5a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:45.188871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-567c8d25-3341-4df1-87d2-8ad742b6f5a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:45.193052 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-567c8d25-3341-4df1-87d2-8ad742b6f5a9 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.198204 Aug 18 11:44:45.196099 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2062/4341] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:44 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:45.397099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0d55818a-e17c-4902-bfaf-21e8928468a2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:45.397933 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0d55818a-e17c-4902-bfaf-21e8928468a2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:45.419221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d55818a-e17c-4902-bfaf-21e8928468a2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:45.420359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d55818a-e17c-4902-bfaf-21e8928468a2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:45.421613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d55818a-e17c-4902-bfaf-21e8928468a2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:45.440271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d55818a-e17c-4902-bfaf-21e8928468a2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:45.440915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d55818a-e17c-4902-bfaf-21e8928468a2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:45.441452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d55818a-e17c-4902-bfaf-21e8928468a2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:45.612150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0d55818a-e17c-4902-bfaf-21e8928468a2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:45.641516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0d55818a-e17c-4902-bfaf-21e8928468a2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:45.652378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0d55818a-e17c-4902-bfaf-21e8928468a2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:45.657432 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0d55818a-e17c-4902-bfaf-21e8928468a2 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1356 microversion: 2.47 time: 0.263658 Aug 18 11:44:45.663803 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2063/4342] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:45 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1356 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:44:45.689224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:45.696323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:45.697217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Searching by: {'deleted': False, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02'} {{(pid=122209) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 11:44:45.724448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:45.724946 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:45.725398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:45.726148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:45.726640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:45.727079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:45.838652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:44:45.840096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:44:45.843209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:44:45.843805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:44:45.845342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:44:45.866405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:45.867249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:45.868697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:45.870510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:45.871206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:45.873343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:45.921222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Getting quotas for project 96148bf9816d48769bbd0a4bff8db115. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:44:45.943949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Getting quotas for user ba7e608da6954bb382a16c7a0a8b815b and project 96148bf9816d48769bbd0a4bff8db115. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:44:45.980399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:44:45.988679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:44:46.042895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.multi_cell_list [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122209) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 11:44:46.104510 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.250241 Aug 18 11:44:46.107655 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2280/4343] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:44:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:44:46.122002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de6e69d0-65d1-4f60-a9f1-d8154d7e7eb4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:46.123160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-de6e69d0-65d1-4f60-a9f1-d8154d7e7eb4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:46.169994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de6e69d0-65d1-4f60-a9f1-d8154d7e7eb4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:46.170525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de6e69d0-65d1-4f60-a9f1-d8154d7e7eb4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:46.170976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de6e69d0-65d1-4f60-a9f1-d8154d7e7eb4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:46.181368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de6e69d0-65d1-4f60-a9f1-d8154d7e7eb4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:46.182058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de6e69d0-65d1-4f60-a9f1-d8154d7e7eb4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:46.182543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de6e69d0-65d1-4f60-a9f1-d8154d7e7eb4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:46.201810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:46.227620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:46.229001 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:46.229494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:46.264378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:46.269286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:46.394682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-de6e69d0-65d1-4f60-a9f1-d8154d7e7eb4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:46.443766 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de6e69d0-65d1-4f60-a9f1-d8154d7e7eb4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1251 microversion: 2.1 time: 0.334702 Aug 18 11:44:46.448978 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2281/4344] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:46 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1251 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:46.468835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-14650824-8924-4a87-9d08-612eb1cd16b6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:46.480915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-14650824-8924-4a87-9d08-612eb1cd16b6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:46.639416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-14650824-8924-4a87-9d08-612eb1cd16b6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:46.647828 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-14650824-8924-4a87-9d08-612eb1cd16b6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1217 microversion: 2.1 time: 0.191704 Aug 18 11:44:46.660301 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2282/4345] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:46 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1217 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:46.677967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d9505d80-17d9-42ee-b14b-866801dcff2b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:46.678654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d9505d80-17d9-42ee-b14b-866801dcff2b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:46.712281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9505d80-17d9-42ee-b14b-866801dcff2b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:46.712819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9505d80-17d9-42ee-b14b-866801dcff2b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:46.713259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9505d80-17d9-42ee-b14b-866801dcff2b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:46.714002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9505d80-17d9-42ee-b14b-866801dcff2b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:46.715590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9505d80-17d9-42ee-b14b-866801dcff2b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:46.716243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9505d80-17d9-42ee-b14b-866801dcff2b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:46.925069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d9505d80-17d9-42ee-b14b-866801dcff2b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:46.935305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d9505d80-17d9-42ee-b14b-866801dcff2b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:46.936874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d9505d80-17d9-42ee-b14b-866801dcff2b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:46.958345 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d9505d80-17d9-42ee-b14b-866801dcff2b tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.276736 Aug 18 11:44:46.959113 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2283/4346] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:46 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:47.065858 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4710cd94-5155-476e-975e-3b2511e52d0b tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 1.384224 Aug 18 11:44:47.083752 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2064/4347] 10.222.0.73 () {60 vars in 1187 bytes} [Thu Aug 18 11:44:45 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:44:47.112452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e065b552-7a56-4738-808b-82bc0166e4f1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:47.112967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e065b552-7a56-4738-808b-82bc0166e4f1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:47.117129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:47.139487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e065b552-7a56-4738-808b-82bc0166e4f1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:47.140224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e065b552-7a56-4738-808b-82bc0166e4f1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:47.143076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e065b552-7a56-4738-808b-82bc0166e4f1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:47.144634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e065b552-7a56-4738-808b-82bc0166e4f1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:47.148247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e065b552-7a56-4738-808b-82bc0166e4f1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:47.148703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e065b552-7a56-4738-808b-82bc0166e4f1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:47.249408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e065b552-7a56-4738-808b-82bc0166e4f1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:44:47.266947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:47.475254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3430c147-4091-4c89-95f7-377d2aabecf2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:47.476154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3430c147-4091-4c89-95f7-377d2aabecf2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:47.489536 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e065b552-7a56-4738-808b-82bc0166e4f1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "DELETE /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 204 len: 0 microversion: 2.47 time: 0.377708 Aug 18 11:44:47.501642 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2284/4348] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:44:47 2022] DELETE /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:44:47.521141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-213a9602-111b-4743-95df-c78485e444e1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:47.525554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-213a9602-111b-4743-95df-c78485e444e1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:47.552264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3430c147-4091-4c89-95f7-377d2aabecf2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:47.553883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3430c147-4091-4c89-95f7-377d2aabecf2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:47.554711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3430c147-4091-4c89-95f7-377d2aabecf2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:47.556266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3430c147-4091-4c89-95f7-377d2aabecf2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:47.564371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3430c147-4091-4c89-95f7-377d2aabecf2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:47.566655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3430c147-4091-4c89-95f7-377d2aabecf2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:47.571190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-213a9602-111b-4743-95df-c78485e444e1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:47.573607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-213a9602-111b-4743-95df-c78485e444e1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:47.574408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-213a9602-111b-4743-95df-c78485e444e1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:47.576604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-213a9602-111b-4743-95df-c78485e444e1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:47.591955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-213a9602-111b-4743-95df-c78485e444e1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:47.592991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-213a9602-111b-4743-95df-c78485e444e1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:47.926091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-213a9602-111b-4743-95df-c78485e444e1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:47.950730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-213a9602-111b-4743-95df-c78485e444e1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:47.956215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-213a9602-111b-4743-95df-c78485e444e1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:47.961825 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-213a9602-111b-4743-95df-c78485e444e1 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1362 microversion: 2.47 time: 0.451310 Aug 18 11:44:47.962804 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2285/4349] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:47 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1362 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:44:47.972007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-04a7e340-f810-42d3-a91b-afd86d01347c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-450966182", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f9874519-4fab-441b-adfa-18e40d761d7a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:48.032270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3430c147-4091-4c89-95f7-377d2aabecf2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:48.069533 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3430c147-4091-4c89-95f7-377d2aabecf2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1251 microversion: 2.1 time: 0.603901 Aug 18 11:44:48.086538 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2065/4350] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:47 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1251 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:48.104289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e1e84ce0-2895-447a-b30c-b4e7c92202c5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:48.105283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e1e84ce0-2895-447a-b30c-b4e7c92202c5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:48.116625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1e84ce0-2895-447a-b30c-b4e7c92202c5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:48.117651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1e84ce0-2895-447a-b30c-b4e7c92202c5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:48.118367 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1e84ce0-2895-447a-b30c-b4e7c92202c5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:48.120771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1e84ce0-2895-447a-b30c-b4e7c92202c5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:48.123432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1e84ce0-2895-447a-b30c-b4e7c92202c5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:48.124246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1e84ce0-2895-447a-b30c-b4e7c92202c5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:48.197059 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-04a7e340-f810-42d3-a91b-afd86d01347c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Block Device f9874519-4fab-441b-adfa-18e40d761d7a is not bootable. Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-04a7e340-f810-42d3-a91b-afd86d01347c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 357 Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-450966182", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f9874519-4fab-441b-adfa-18e40d761d7a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: exception: Block Device f9874519-4fab-441b-adfa-18e40d761d7a is not bootable. Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-450966182', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'f9874519-4fab-441b-adfa-18e40d761d7a'}], 'networks': [{'uuid': 'c201add2-2905-4a42-a119-5f0f7b3c5bb7'}]}}} Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device f9874519-4fab-441b-adfa-18e40d761d7a is not bootable. Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:44:48.218240 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device f9874519-4fab-441b-adfa-18e40d761d7a is not bootable. Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device f9874519-4fab-441b-adfa-18e40d761d7a is not bootable. Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-04a7e340-f810-42d3-a91b-afd86d01347c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Block Device f9874519-4fab-441b-adfa-18e40d761d7a is not bootable. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-04a7e340-f810-42d3-a91b-afd86d01347c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.257283 Aug 18 11:44:48.222969 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2286/4351] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:44:47 2022] POST /compute/v2.1/servers => generated 110 bytes in 258 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:44:48.231965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2394747-47ad-4623-af99-314230c0c665 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:48.233319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b2394747-47ad-4623-af99-314230c0c665 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:48.249021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2394747-47ad-4623-af99-314230c0c665 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:48.254212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2394747-47ad-4623-af99-314230c0c665 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:48.254893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2394747-47ad-4623-af99-314230c0c665 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:48.255664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2394747-47ad-4623-af99-314230c0c665 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:48.258105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2394747-47ad-4623-af99-314230c0c665 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:48.259826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2394747-47ad-4623-af99-314230c0c665 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:48.271277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e1e84ce0-2895-447a-b30c-b4e7c92202c5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:48.289007 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e1e84ce0-2895-447a-b30c-b4e7c92202c5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1269 microversion: 2.1 time: 0.193595 Aug 18 11:44:48.289825 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2066/4352] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:48 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1269 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:48.316452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-42bdedbd-4097-4e49-bfd0-6c767f644588 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:48.317152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-42bdedbd-4097-4e49-bfd0-6c767f644588 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:48.349955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42bdedbd-4097-4e49-bfd0-6c767f644588 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:48.350691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42bdedbd-4097-4e49-bfd0-6c767f644588 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:48.357064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42bdedbd-4097-4e49-bfd0-6c767f644588 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:48.362791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42bdedbd-4097-4e49-bfd0-6c767f644588 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:48.363513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42bdedbd-4097-4e49-bfd0-6c767f644588 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:48.364142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42bdedbd-4097-4e49-bfd0-6c767f644588 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:48.478332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b2394747-47ad-4623-af99-314230c0c665 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:48.494201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b2394747-47ad-4623-af99-314230c0c665 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:48.496055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b2394747-47ad-4623-af99-314230c0c665 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:48.501273 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b2394747-47ad-4623-af99-314230c0c665 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.277656 Aug 18 11:44:48.502066 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2287/4353] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:48 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:48.644301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-42bdedbd-4097-4e49-bfd0-6c767f644588 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:48.655708 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-42bdedbd-4097-4e49-bfd0-6c767f644588 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.345981 Aug 18 11:44:48.656308 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2067/4354] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:48 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:48.679830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8afd2f5c-5365-428b-bc8d-edd9cb973630 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:48.680465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8afd2f5c-5365-428b-bc8d-edd9cb973630 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:48.687445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8afd2f5c-5365-428b-bc8d-edd9cb973630 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:48.688567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8afd2f5c-5365-428b-bc8d-edd9cb973630 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:48.689306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8afd2f5c-5365-428b-bc8d-edd9cb973630 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:48.690021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8afd2f5c-5365-428b-bc8d-edd9cb973630 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:48.690512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8afd2f5c-5365-428b-bc8d-edd9cb973630 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:48.690952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8afd2f5c-5365-428b-bc8d-edd9cb973630 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:48.907766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8afd2f5c-5365-428b-bc8d-edd9cb973630 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:48.918102 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8afd2f5c-5365-428b-bc8d-edd9cb973630 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.242272 Aug 18 11:44:48.924186 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2288/4355] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:48 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:48.990325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a919a803-1e55-4404-b0e6-da561f80685e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:48.991140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a919a803-1e55-4404-b0e6-da561f80685e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:49.001737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a919a803-1e55-4404-b0e6-da561f80685e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:49.009029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a919a803-1e55-4404-b0e6-da561f80685e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:49.009801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a919a803-1e55-4404-b0e6-da561f80685e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:49.010773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a919a803-1e55-4404-b0e6-da561f80685e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:49.011432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a919a803-1e55-4404-b0e6-da561f80685e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:49.012072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a919a803-1e55-4404-b0e6-da561f80685e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:49.110233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b81a1017-7568-4552-8dfe-20cb039992ff tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:49.111096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b81a1017-7568-4552-8dfe-20cb039992ff tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:49.129598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b81a1017-7568-4552-8dfe-20cb039992ff tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:49.130106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b81a1017-7568-4552-8dfe-20cb039992ff tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:49.130592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b81a1017-7568-4552-8dfe-20cb039992ff tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:49.131310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b81a1017-7568-4552-8dfe-20cb039992ff tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:49.138978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b81a1017-7568-4552-8dfe-20cb039992ff tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:49.140029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b81a1017-7568-4552-8dfe-20cb039992ff tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:49.248188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a919a803-1e55-4404-b0e6-da561f80685e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:49.301818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a919a803-1e55-4404-b0e6-da561f80685e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:49.307826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a919a803-1e55-4404-b0e6-da561f80685e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:49.311344 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a919a803-1e55-4404-b0e6-da561f80685e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1362 microversion: 2.47 time: 0.325732 Aug 18 11:44:49.332301 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2068/4356] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:48 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:49.340177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b17c5496-a94b-45f3-8a95-b4412bb1a58c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:49.346183 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b17c5496-a94b-45f3-8a95-b4412bb1a58c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:49.416836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b17c5496-a94b-45f3-8a95-b4412bb1a58c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:49.417491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b17c5496-a94b-45f3-8a95-b4412bb1a58c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.049s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:49.418930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b17c5496-a94b-45f3-8a95-b4412bb1a58c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:49.423902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b17c5496-a94b-45f3-8a95-b4412bb1a58c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:49.425569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b17c5496-a94b-45f3-8a95-b4412bb1a58c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:49.427209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b17c5496-a94b-45f3-8a95-b4412bb1a58c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:49.564397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b81a1017-7568-4552-8dfe-20cb039992ff tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:49.577303 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b81a1017-7568-4552-8dfe-20cb039992ff tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1293 microversion: 2.1 time: 0.467306 Aug 18 11:44:49.579577 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2289/4357] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:49 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1293 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:49.584771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-584a526d-2ca1-447a-bbc6-be47cdfe5717 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:49.593106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-584a526d-2ca1-447a-bbc6-be47cdfe5717 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:49.609209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-584a526d-2ca1-447a-bbc6-be47cdfe5717 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:49.612319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-584a526d-2ca1-447a-bbc6-be47cdfe5717 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:49.613079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-584a526d-2ca1-447a-bbc6-be47cdfe5717 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:49.615563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-584a526d-2ca1-447a-bbc6-be47cdfe5717 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:49.616249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-584a526d-2ca1-447a-bbc6-be47cdfe5717 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:49.618558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-584a526d-2ca1-447a-bbc6-be47cdfe5717 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:49.811737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-584a526d-2ca1-447a-bbc6-be47cdfe5717 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:49.828193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-584a526d-2ca1-447a-bbc6-be47cdfe5717 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:49.835902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b17c5496-a94b-45f3-8a95-b4412bb1a58c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:49.836278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-584a526d-2ca1-447a-bbc6-be47cdfe5717 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:49.837842 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-584a526d-2ca1-447a-bbc6-be47cdfe5717 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.256983 Aug 18 11:44:49.840527 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2290/4358] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:49 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:49.870479 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b17c5496-a94b-45f3-8a95-b4412bb1a58c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1287 microversion: 2.1 time: 0.536626 Aug 18 11:44:49.887059 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2069/4359] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:49 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1287 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:50.345948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:50.347979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:50.382805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:50.384901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:50.387412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:50.389721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:50.390396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:50.391313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:50.508216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:50.511330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:50.512497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:50.513548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lazy-loading 'fault' on Instance uuid 27f7e9ca-0f78-4379-bd5a-85c836d152d2 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:44:50.600794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:50.605116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fe8060ff-5af7-4681-ac80-4d3546239e21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:50.606939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fe8060ff-5af7-4681-ac80-4d3546239e21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:50.611808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:50.621999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe8060ff-5af7-4681-ac80-4d3546239e21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:50.623934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe8060ff-5af7-4681-ac80-4d3546239e21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:50.626994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe8060ff-5af7-4681-ac80-4d3546239e21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:50.627400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:50.629736 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f6615ab5-c366-42a5-bcc4-bdc70ba72f42 tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 200 len: 1367 microversion: 2.47 time: 0.290448 Aug 18 11:44:50.630342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe8060ff-5af7-4681-ac80-4d3546239e21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:50.630891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe8060ff-5af7-4681-ac80-4d3546239e21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:50.630999 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2291/4360] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:50 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:50.631611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fe8060ff-5af7-4681-ac80-4d3546239e21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:50.866253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fe31ed14-4c9b-40a8-ae2d-9e9c2dac2d02 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:50.867829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fe31ed14-4c9b-40a8-ae2d-9e9c2dac2d02 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:50.879279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe31ed14-4c9b-40a8-ae2d-9e9c2dac2d02 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:50.880137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe31ed14-4c9b-40a8-ae2d-9e9c2dac2d02 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:50.883449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe31ed14-4c9b-40a8-ae2d-9e9c2dac2d02 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:50.884802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe31ed14-4c9b-40a8-ae2d-9e9c2dac2d02 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:50.885506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe31ed14-4c9b-40a8-ae2d-9e9c2dac2d02 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:50.888432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe31ed14-4c9b-40a8-ae2d-9e9c2dac2d02 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:51.050677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fe31ed14-4c9b-40a8-ae2d-9e9c2dac2d02 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:51.074042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fe31ed14-4c9b-40a8-ae2d-9e9c2dac2d02 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:51.078181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fe31ed14-4c9b-40a8-ae2d-9e9c2dac2d02 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:51.079930 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fe31ed14-4c9b-40a8-ae2d-9e9c2dac2d02 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.217809 Aug 18 11:44:51.082788 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2292/4361] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:50 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:51.089578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-560ec5bc-26dc-4524-8906-43effd097d76 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:51.090655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-560ec5bc-26dc-4524-8906-43effd097d76 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:51.113164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-560ec5bc-26dc-4524-8906-43effd097d76 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:51.114715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-560ec5bc-26dc-4524-8906-43effd097d76 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:51.115403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-560ec5bc-26dc-4524-8906-43effd097d76 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:51.116452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-560ec5bc-26dc-4524-8906-43effd097d76 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:51.117500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-560ec5bc-26dc-4524-8906-43effd097d76 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:51.118238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-560ec5bc-26dc-4524-8906-43effd097d76 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:51.195651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fe8060ff-5af7-4681-ac80-4d3546239e21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:51.220353 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fe8060ff-5af7-4681-ac80-4d3546239e21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1293 microversion: 2.1 time: 0.619187 Aug 18 11:44:51.226824 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2070/4362] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:50 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1293 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:51.321630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-560ec5bc-26dc-4524-8906-43effd097d76 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:51.331616 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-560ec5bc-26dc-4524-8906-43effd097d76 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1275 microversion: 2.1 time: 0.246980 Aug 18 11:44:51.332241 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2293/4363] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:51 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:51.649423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-dff91355-1179-45f7-8173-33d20216d72e req-17f31402-2666-410b-9107-4a893c54577d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2f4eea-48c1-4757-a5b3-64624def8f67", "tag": "a0233917-a53d-447a-82b0-5dcc439b518d"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:51.658682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-25d3dfbf-324a-497a-a20b-f2c0435b0a6a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:51.660250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-25d3dfbf-324a-497a-a20b-f2c0435b0a6a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: 27f7e9ca-0f78-4379-bd5a-85c836d152d2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:51.670894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25d3dfbf-324a-497a-a20b-f2c0435b0a6a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:51.672736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25d3dfbf-324a-497a-a20b-f2c0435b0a6a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:51.673679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25d3dfbf-324a-497a-a20b-f2c0435b0a6a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:51.674151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-dff91355-1179-45f7-8173-33d20216d72e req-17f31402-2666-410b-9107-4a893c54577d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:51.674983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25d3dfbf-324a-497a-a20b-f2c0435b0a6a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:51.675660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25d3dfbf-324a-497a-a20b-f2c0435b0a6a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:51.676289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25d3dfbf-324a-497a-a20b-f2c0435b0a6a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:51.678591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-dff91355-1179-45f7-8173-33d20216d72e req-17f31402-2666-410b-9107-4a893c54577d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:51.680273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-dff91355-1179-45f7-8173-33d20216d72e req-17f31402-2666-410b-9107-4a893c54577d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:51.700282 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-dff91355-1179-45f7-8173-33d20216d72e req-17f31402-2666-410b-9107-4a893c54577d service nova] Creating event network-changed:a0233917-a53d-447a-82b0-5dcc439b518d for instance ae2f4eea-48c1-4757-a5b3-64624def8f67 on n-h1-853611-3 Aug 18 11:44:51.710073 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-dff91355-1179-45f7-8173-33d20216d72e req-17f31402-2666-410b-9107-4a893c54577d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064247 Aug 18 11:44:51.711111 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-25d3dfbf-324a-497a-a20b-f2c0435b0a6a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] HTTP exception thrown: Instance 27f7e9ca-0f78-4379-bd5a-85c836d152d2 could not be found. Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-25d3dfbf-324a-497a-a20b-f2c0435b0a6a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Request method failure captured: Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 HTTP/1.1 Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYDX2L0chm3Pff85iNmOfmS2tq20TXJu2GOiswMvEKddUDYCZ38Xz92XCg8CBq16akojTlPIrYy_maypq8OwpLqbsL3jlpXiq2SFTCr2JWMMwU4KaWoPTTrrbilmxWki_j9HuSDBzncqD4rH9n4V3O8CDVP0boLdrE_T5Yi1L2MEAU Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.47 Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: e13ad308c6814d7d82dd8c0afdfa7d02 Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerShowV247Test-381466694 Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/e13ad308c6814d7d82dd8c0afdfa7d02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/e13ad308c6814d7d82dd8c0afdfa7d02"}]}, {"type": "tempest-type-782648630", "name": "tempest-service-2040032395", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_e13ad308c6814d7d82dd8c0afdfa7d02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/e13ad308c6814d7d82dd8c0afdfa7d02"}]}, {"type": "tempest-type-922229597", "name": "tempest-service-4321545", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerShowV247Test-381466694 Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: e13ad308c6814d7d82dd8c0afdfa7d02 Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerShowV247Test-381466694 Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerShowV247Test-381466694-project Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ac9115f76978444088f12ed55fbf43fb Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerShowV247Test-381466694-project Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 27f7e9ca-0f78-4379-bd5a-85c836d152d2 could not be found. Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '27f7e9ca-0f78-4379-bd5a-85c836d152d2'} Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27f7e9ca-0f78-4379-bd5a-85c836d152d2 could not be found. Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27f7e9ca-0f78-4379-bd5a-85c836d152d2 could not be found. Aug 18 11:44:51.713053 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:51.716275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:51.716275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:51.716275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:51.716275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:51.716275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:51.716275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:44:51.716275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:44:51.716275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27f7e9ca-0f78-4379-bd5a-85c836d152d2 could not be found. Aug 18 11:44:51.716275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:51.716275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-25d3dfbf-324a-497a-a20b-f2c0435b0a6a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Returning 404 to user: Instance 27f7e9ca-0f78-4379-bd5a-85c836d152d2 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:51.716275 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-25d3dfbf-324a-497a-a20b-f2c0435b0a6a tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2" status: 404 len: 111 microversion: 2.47 time: 0.061203 Aug 18 11:44:51.720493 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2294/4364] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:51 2022] GET /compute/v2.1/servers/27f7e9ca-0f78-4379-bd5a-85c836d152d2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 18 11:44:51.722567 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2071/4365] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:44:51.727244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0d1c76c3-f7d4-429b-89de-4d89f305cfab tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:51.727751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0d1c76c3-f7d4-429b-89de-4d89f305cfab tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: ed4e597f-7b9e-49c9-b4e1-c10e051d5472] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:51.741701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d1c76c3-f7d4-429b-89de-4d89f305cfab tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:51.742184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d1c76c3-f7d4-429b-89de-4d89f305cfab tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:51.742666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d1c76c3-f7d4-429b-89de-4d89f305cfab tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:51.743403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d1c76c3-f7d4-429b-89de-4d89f305cfab tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:51.743860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d1c76c3-f7d4-429b-89de-4d89f305cfab tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:51.744442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d1c76c3-f7d4-429b-89de-4d89f305cfab tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:51.817600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0d1c76c3-f7d4-429b-89de-4d89f305cfab tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: ed4e597f-7b9e-49c9-b4e1-c10e051d5472] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:44:52.099548 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0d1c76c3-f7d4-429b-89de-4d89f305cfab tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ed4e597f-7b9e-49c9-b4e1-c10e051d5472" status: 204 len: 0 microversion: 2.47 time: 0.377542 Aug 18 11:44:52.103650 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2295/4366] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:44:51 2022] DELETE /compute/v2.1/servers/ed4e597f-7b9e-49c9-b4e1-c10e051d5472 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:44:52.111144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d38772f9-2f38-47cc-aa3d-53334b4df7af tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:52.111874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d38772f9-2f38-47cc-aa3d-53334b4df7af tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: ed4e597f-7b9e-49c9-b4e1-c10e051d5472] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:52.125592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cfd8591a-bcd8-4dfb-bffb-f5d611979531 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:52.128767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d38772f9-2f38-47cc-aa3d-53334b4df7af tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:52.129261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d38772f9-2f38-47cc-aa3d-53334b4df7af tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:52.129701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d38772f9-2f38-47cc-aa3d-53334b4df7af tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:52.130415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d38772f9-2f38-47cc-aa3d-53334b4df7af tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:52.133942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cfd8591a-bcd8-4dfb-bffb-f5d611979531 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:52.140008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d38772f9-2f38-47cc-aa3d-53334b4df7af tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:52.140471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d38772f9-2f38-47cc-aa3d-53334b4df7af tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:52.146235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfd8591a-bcd8-4dfb-bffb-f5d611979531 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:52.146782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfd8591a-bcd8-4dfb-bffb-f5d611979531 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:52.147221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfd8591a-bcd8-4dfb-bffb-f5d611979531 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:52.155167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfd8591a-bcd8-4dfb-bffb-f5d611979531 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:52.155701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfd8591a-bcd8-4dfb-bffb-f5d611979531 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:52.156260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfd8591a-bcd8-4dfb-bffb-f5d611979531 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:52.334967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cfd8591a-bcd8-4dfb-bffb-f5d611979531 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:52.364242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cfd8591a-bcd8-4dfb-bffb-f5d611979531 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:52.371557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cfd8591a-bcd8-4dfb-bffb-f5d611979531 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:52.372848 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cfd8591a-bcd8-4dfb-bffb-f5d611979531 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.261537 Aug 18 11:44:52.379906 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2296/4367] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:52 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:52.390181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d2c334a6-5903-4ffc-b222-62297b25ca13 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:52.401598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d2c334a6-5903-4ffc-b222-62297b25ca13 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:52.418847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2c334a6-5903-4ffc-b222-62297b25ca13 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:52.419268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2c334a6-5903-4ffc-b222-62297b25ca13 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:52.419747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2c334a6-5903-4ffc-b222-62297b25ca13 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:52.423057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2c334a6-5903-4ffc-b222-62297b25ca13 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:52.423722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2c334a6-5903-4ffc-b222-62297b25ca13 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:52.424592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2c334a6-5903-4ffc-b222-62297b25ca13 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:52.459323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d38772f9-2f38-47cc-aa3d-53334b4df7af tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:52.483899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d38772f9-2f38-47cc-aa3d-53334b4df7af tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:52.494032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d38772f9-2f38-47cc-aa3d-53334b4df7af tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:52.501973 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d38772f9-2f38-47cc-aa3d-53334b4df7af tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/ed4e597f-7b9e-49c9-b4e1-c10e051d5472" status: 200 len: 1363 microversion: 2.47 time: 0.396932 Aug 18 11:44:52.506956 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2072/4368] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:52 2022] GET /compute/v2.1/servers/ed4e597f-7b9e-49c9-b4e1-c10e051d5472 => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:52.543023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-35032f10-6794-4896-b37d-c858afb7aadc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:52.546719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-35032f10-6794-4896-b37d-c858afb7aadc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:52.555352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35032f10-6794-4896-b37d-c858afb7aadc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:52.556254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35032f10-6794-4896-b37d-c858afb7aadc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:52.556948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35032f10-6794-4896-b37d-c858afb7aadc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:52.558511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35032f10-6794-4896-b37d-c858afb7aadc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:52.559289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35032f10-6794-4896-b37d-c858afb7aadc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:52.559933 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35032f10-6794-4896-b37d-c858afb7aadc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:52.715034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2c334a6-5903-4ffc-b222-62297b25ca13 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:52.740275 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d2c334a6-5903-4ffc-b222-62297b25ca13 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1293 microversion: 2.1 time: 0.352499 Aug 18 11:44:52.741357 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2297/4369] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:52 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1293 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:52.750029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-65ecea96-69ee-45e6-9cd8-eb4894bf6392 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1460734204", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "1073d795-16bf-4b88-a573-c9b71aeef18a", "destination_type": "local"}, {"source_type": "volume", "uuid": "0037aca7-f743-44e9-968a-84c26b424c19", "destination_type": "invalid"}], "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-65ecea96-69ee-45e6-9cd8-eb4894bf6392 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 495 Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1460734204", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "1073d795-16bf-4b88-a573-c9b71aeef18a", "destination_type": "local"}, {"source_type": "volume", "uuid": "0037aca7-f743-44e9-968a-84c26b424c19", "destination_type": "invalid"}], "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1460734204', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '0037aca7-f743-44e9-968a-84c26b424c19', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'c201add2-2905-4a42-a119-5f0f7b3c5bb7'}]}}} Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'invalid' Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:52.755510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 18 11:44:52.758949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:52.762209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-65ecea96-69ee-45e6-9cd8-eb4894bf6392 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:52.763463 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-65ecea96-69ee-45e6-9cd8-eb4894bf6392 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.019592 Aug 18 11:44:52.764440 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2298/4370] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:44:52 2022] POST /compute/v2.1/servers => generated 155 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:44:52.774735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a4a6c289-ffcc-40e3-b3d4-b93f956efd41 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:52.776009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a4a6c289-ffcc-40e3-b3d4-b93f956efd41 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:52.786223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4a6c289-ffcc-40e3-b3d4-b93f956efd41 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:52.787559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4a6c289-ffcc-40e3-b3d4-b93f956efd41 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:52.788229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4a6c289-ffcc-40e3-b3d4-b93f956efd41 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:52.789223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4a6c289-ffcc-40e3-b3d4-b93f956efd41 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:52.789921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4a6c289-ffcc-40e3-b3d4-b93f956efd41 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:52.790610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4a6c289-ffcc-40e3-b3d4-b93f956efd41 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:52.967569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-35032f10-6794-4896-b37d-c858afb7aadc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:52.976548 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-35032f10-6794-4896-b37d-c858afb7aadc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1317 microversion: 2.1 time: 0.449033 Aug 18 11:44:52.979211 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2073/4371] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:52 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:53.077773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a4a6c289-ffcc-40e3-b3d4-b93f956efd41 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:53.093333 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a4a6c289-ffcc-40e3-b3d4-b93f956efd41 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.323011 Aug 18 11:44:53.094533 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2299/4372] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:52 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:53.121573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4d108ddf-fe75-4bd5-8491-b327b60b0191 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:53.122398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4d108ddf-fe75-4bd5-8491-b327b60b0191 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:53.133785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d108ddf-fe75-4bd5-8491-b327b60b0191 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:53.134586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d108ddf-fe75-4bd5-8491-b327b60b0191 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:53.135207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d108ddf-fe75-4bd5-8491-b327b60b0191 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:53.136320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d108ddf-fe75-4bd5-8491-b327b60b0191 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:53.137068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d108ddf-fe75-4bd5-8491-b327b60b0191 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:53.137646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4d108ddf-fe75-4bd5-8491-b327b60b0191 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:53.221695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc30f137-5feb-4c31-8c42-14a7d30d4498 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:53.233476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc30f137-5feb-4c31-8c42-14a7d30d4498 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:53.234273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc30f137-5feb-4c31-8c42-14a7d30d4498 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:53.236957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc30f137-5feb-4c31-8c42-14a7d30d4498 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:53.303557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:53.315070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dc30f137-5feb-4c31-8c42-14a7d30d4498 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Going to try to stop instance {{(pid=122210) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 11:44:53.406396 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dc30f137-5feb-4c31-8c42-14a7d30d4498 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "POST /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/action" status: 202 len: 0 microversion: 2.1 time: 0.186732 Aug 18 11:44:53.407619 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2300/4373] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:44:53 2022] POST /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:44:53.417805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1d861ad5-bb35-4e52-a4eb-47b6c3a24259 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:53.418741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1d861ad5-bb35-4e52-a4eb-47b6c3a24259 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:53.437112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d861ad5-bb35-4e52-a4eb-47b6c3a24259 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:53.439331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d861ad5-bb35-4e52-a4eb-47b6c3a24259 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:53.439806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d861ad5-bb35-4e52-a4eb-47b6c3a24259 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:53.440546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d861ad5-bb35-4e52-a4eb-47b6c3a24259 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:53.441011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d861ad5-bb35-4e52-a4eb-47b6c3a24259 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:53.443716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d861ad5-bb35-4e52-a4eb-47b6c3a24259 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:53.563598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1d861ad5-bb35-4e52-a4eb-47b6c3a24259 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:53.577609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1d861ad5-bb35-4e52-a4eb-47b6c3a24259 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:53.581003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1d861ad5-bb35-4e52-a4eb-47b6c3a24259 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f79a445f2f764e6e9f6d9916ffca05de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185d17297d14e608e8b5f1040c2510b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:53.587234 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1d861ad5-bb35-4e52-a4eb-47b6c3a24259 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 200 len: 1605 microversion: 2.32 time: 0.175010 Aug 18 11:44:53.590184 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2301/4374] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:53 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 1605 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:53.604108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5cf862b7-4205-4203-9591-03275f35d092 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:53.605072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5cf862b7-4205-4203-9591-03275f35d092 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:53.627295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cf862b7-4205-4203-9591-03275f35d092 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:53.629578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cf862b7-4205-4203-9591-03275f35d092 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:53.631714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cf862b7-4205-4203-9591-03275f35d092 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:53.634614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cf862b7-4205-4203-9591-03275f35d092 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:53.637992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cf862b7-4205-4203-9591-03275f35d092 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:53.638677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cf862b7-4205-4203-9591-03275f35d092 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:53.793199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4d108ddf-fe75-4bd5-8491-b327b60b0191 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:53.803544 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4d108ddf-fe75-4bd5-8491-b327b60b0191 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.686532 Aug 18 11:44:53.805237 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2074/4375] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:53 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:53.823315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f5343f13-7b1a-4142-a041-33f01395a04e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:53.827202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f5343f13-7b1a-4142-a041-33f01395a04e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: ed4e597f-7b9e-49c9-b4e1-c10e051d5472] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:53.841668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5343f13-7b1a-4142-a041-33f01395a04e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:53.855759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5343f13-7b1a-4142-a041-33f01395a04e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:53.857327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5343f13-7b1a-4142-a041-33f01395a04e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:53.858699 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5343f13-7b1a-4142-a041-33f01395a04e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:53.859978 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5343f13-7b1a-4142-a041-33f01395a04e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:53.860598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f5343f13-7b1a-4142-a041-33f01395a04e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:54.024623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5cf862b7-4205-4203-9591-03275f35d092 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:54.033779 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5cf862b7-4205-4203-9591-03275f35d092 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1720 microversion: 2.1 time: 0.442204 Aug 18 11:44:54.048837 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2302/4376] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:53 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1720 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:54.054242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e2a285ee-47a2-4750-b6ee-b4d433fddf8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:54.055126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e2a285ee-47a2-4750-b6ee-b4d433fddf8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:54.062885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2a285ee-47a2-4750-b6ee-b4d433fddf8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:54.063641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2a285ee-47a2-4750-b6ee-b4d433fddf8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:54.064240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2a285ee-47a2-4750-b6ee-b4d433fddf8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:54.065166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2a285ee-47a2-4750-b6ee-b4d433fddf8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:54.065791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2a285ee-47a2-4750-b6ee-b4d433fddf8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:54.066398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2a285ee-47a2-4750-b6ee-b4d433fddf8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:54.425067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f5343f13-7b1a-4142-a041-33f01395a04e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:54.430471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e2a285ee-47a2-4750-b6ee-b4d433fddf8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:54.447162 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e2a285ee-47a2-4750-b6ee-b4d433fddf8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1293 microversion: 2.1 time: 0.396189 Aug 18 11:44:54.463887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f5343f13-7b1a-4142-a041-33f01395a04e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:54.473240 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2303/4377] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:54 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1293 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:54.483624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f5343f13-7b1a-4142-a041-33f01395a04e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac9115f76978444088f12ed55fbf43fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ad308c6814d7d82dd8c0afdfa7d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:54.499406 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f5343f13-7b1a-4142-a041-33f01395a04e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/ed4e597f-7b9e-49c9-b4e1-c10e051d5472" status: 200 len: 1363 microversion: 2.47 time: 0.690329 Aug 18 11:44:54.501309 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2075/4378] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:53 2022] GET /compute/v2.1/servers/ed4e597f-7b9e-49c9-b4e1-c10e051d5472 => generated 1363 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:44:54.514900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d3b1ed1-f0ff-489f-a951-c799ca7ddecd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-271904622", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d3b1ed1-f0ff-489f-a951-c799ca7ddecd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 491 Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-271904622", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-271904622', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'c201add2-2905-4a42-a119-5f0f7b3c5bb7'}]}}} Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:54.525144 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:54.527905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d3b1ed1-f0ff-489f-a951-c799ca7ddecd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:54.533396 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9d3b1ed1-f0ff-489f-a951-c799ca7ddecd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.049492 Aug 18 11:44:54.534089 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2304/4379] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:44:54 2022] POST /compute/v2.1/servers => generated 624 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:44:54.535619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2878c13d-e086-407d-abc8-dd365fffc941 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:54.539959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2878c13d-e086-407d-abc8-dd365fffc941 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:54.555657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8fc4f0e4-0fe5-427d-b70e-ecfb40adf2d8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:54.556626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8fc4f0e4-0fe5-427d-b70e-ecfb40adf2d8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:54.557760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2878c13d-e086-407d-abc8-dd365fffc941 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:54.559600 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2878c13d-e086-407d-abc8-dd365fffc941 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:54.560666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2878c13d-e086-407d-abc8-dd365fffc941 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:54.562558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2878c13d-e086-407d-abc8-dd365fffc941 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:54.563310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2878c13d-e086-407d-abc8-dd365fffc941 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:54.563974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2878c13d-e086-407d-abc8-dd365fffc941 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:54.589921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fc4f0e4-0fe5-427d-b70e-ecfb40adf2d8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:54.595071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fc4f0e4-0fe5-427d-b70e-ecfb40adf2d8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:54.595750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fc4f0e4-0fe5-427d-b70e-ecfb40adf2d8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:54.597214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fc4f0e4-0fe5-427d-b70e-ecfb40adf2d8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:54.604281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fc4f0e4-0fe5-427d-b70e-ecfb40adf2d8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:54.605172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8fc4f0e4-0fe5-427d-b70e-ecfb40adf2d8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:54.961773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2878c13d-e086-407d-abc8-dd365fffc941 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:54.964918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:54.975260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8fc4f0e4-0fe5-427d-b70e-ecfb40adf2d8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:54.991902 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8fc4f0e4-0fe5-427d-b70e-ecfb40adf2d8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.452495 Aug 18 11:44:54.993105 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2305/4380] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:54 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:44:54.996664 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2878c13d-e086-407d-abc8-dd365fffc941 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1317 microversion: 2.1 time: 0.491643 Aug 18 11:44:54.998596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-212db8b8-9c4b-4e88-8342-b13748c28bea tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:54.999190 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2076/4381] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:54 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1317 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:55.012185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-212db8b8-9c4b-4e88-8342-b13748c28bea tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:55.021547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212db8b8-9c4b-4e88-8342-b13748c28bea tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:55.022263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212db8b8-9c4b-4e88-8342-b13748c28bea tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:55.023005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212db8b8-9c4b-4e88-8342-b13748c28bea tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:55.023864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212db8b8-9c4b-4e88-8342-b13748c28bea tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:55.024495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212db8b8-9c4b-4e88-8342-b13748c28bea tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:55.025070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212db8b8-9c4b-4e88-8342-b13748c28bea tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:55.039803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-d171344e-8d16-4b61-a35e-8e5e1d11984b req-0e2fc9d2-c281-4bad-b59a-c4b0a90a0ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "369c24ec-e260-4e7a-b831-9f8b5ce7b0ac", "tag": "08ceaca9-08e2-4516-9407-f98fea48546d"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:55.043790 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-212db8b8-9c4b-4e88-8342-b13748c28bea tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] HTTP exception thrown: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-212db8b8-9c4b-4e88-8342-b13748c28bea tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Request method failure captured: Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab HTTP/1.1 Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iSP7erUKxCSon0QUcmhKCvXzYHXM-xvsBvTka4gqR-DMgMj5EbZD5M5E6boHEg-yQOMYJku61EJdcx9ZjfTd5i7QRH0lnhq-g29TQdILyxCLpY2A8jGshiwcRq878C92qcHz-qpeTkbgJUf5REHUbpxXSNJcSD0jLCGnAEv1h5DNKw Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.32 Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f185d17297d14e608e8b5f1040c2510b Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TaggedBootDevicesTest-478845745 Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f185d17297d14e608e8b5f1040c2510b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f185d17297d14e608e8b5f1040c2510b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f185d17297d14e608e8b5f1040c2510b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f185d17297d14e608e8b5f1040c2510b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TaggedBootDevicesTest-478845745 Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f185d17297d14e608e8b5f1040c2510b Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TaggedBootDevicesTest-478845745 Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TaggedBootDevicesTest-478845745-project Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: f79a445f2f764e6e9f6d9916ffca05de Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TaggedBootDevicesTest-478845745-project Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '90132336-bd92-44e9-bc59-949f10e5ecab'} Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:55.045582 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.049841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:55.049841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:55.049841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:55.049841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:44:55.049841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:44:55.049841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:44:55.049841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.052247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-212db8b8-9c4b-4e88-8342-b13748c28bea tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Returning 404 to user: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:55.053605 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-212db8b8-9c4b-4e88-8342-b13748c28bea tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 404 len: 111 microversion: 2.32 time: 0.059287 Aug 18 11:44:55.054758 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2306/4382] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:54 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:44:55.060028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-462d12a8-118b-419e-847a-8cd172947cf4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:55.063542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-462d12a8-118b-419e-847a-8cd172947cf4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:55.085553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d171344e-8d16-4b61-a35e-8e5e1d11984b req-0e2fc9d2-c281-4bad-b59a-c4b0a90a0ff9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:55.086302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-462d12a8-118b-419e-847a-8cd172947cf4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:55.087366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d171344e-8d16-4b61-a35e-8e5e1d11984b req-0e2fc9d2-c281-4bad-b59a-c4b0a90a0ff9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:55.088063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-d171344e-8d16-4b61-a35e-8e5e1d11984b req-0e2fc9d2-c281-4bad-b59a-c4b0a90a0ff9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:55.089139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-462d12a8-118b-419e-847a-8cd172947cf4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:55.090953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-462d12a8-118b-419e-847a-8cd172947cf4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:55.092280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-462d12a8-118b-419e-847a-8cd172947cf4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:55.094708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-462d12a8-118b-419e-847a-8cd172947cf4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:55.095606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-462d12a8-118b-419e-847a-8cd172947cf4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:55.132724 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-d171344e-8d16-4b61-a35e-8e5e1d11984b req-0e2fc9d2-c281-4bad-b59a-c4b0a90a0ff9 service nova] Creating event network-changed:08ceaca9-08e2-4516-9407-f98fea48546d for instance 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac on n-h2-853611-3 Aug 18 11:44:55.148603 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-d171344e-8d16-4b61-a35e-8e5e1d11984b req-0e2fc9d2-c281-4bad-b59a-c4b0a90a0ff9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132316 Aug 18 11:44:55.151470 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2077/4383] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:44:55.169635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2cafc968-4766-4bff-b2f7-1be14132fbd5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:55.172324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2cafc968-4766-4bff-b2f7-1be14132fbd5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:55.190162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cafc968-4766-4bff-b2f7-1be14132fbd5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:55.190735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cafc968-4766-4bff-b2f7-1be14132fbd5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:55.191250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cafc968-4766-4bff-b2f7-1be14132fbd5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:55.192207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cafc968-4766-4bff-b2f7-1be14132fbd5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:55.192771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cafc968-4766-4bff-b2f7-1be14132fbd5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:55.193236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2cafc968-4766-4bff-b2f7-1be14132fbd5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:55.442336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-462d12a8-118b-419e-847a-8cd172947cf4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:55.450409 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-462d12a8-118b-419e-847a-8cd172947cf4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.394405 Aug 18 11:44:55.454569 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2307/4384] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:55 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:55.461182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-32b2aa56-fdcd-4b1d-9b4a-586a3a9f1250 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '.version_select at 0x7f519fcd6dc0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:55.498168 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-32b2aa56-fdcd-4b1d-9b4a-586a3a9f1250 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913082647" status: 204 len: 0 microversion: 2.32 time: 0.041984 Aug 18 11:44:55.499334 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2308/4385] 10.222.0.73 () {60 vars in 1262 bytes} [Thu Aug 18 11:44:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913082647 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:44:55.507369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6c769db2-dde0-4a7d-8430-5becb6f338d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:55.508928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6c769db2-dde0-4a7d-8430-5becb6f338d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:55.518925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c769db2-dde0-4a7d-8430-5becb6f338d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:55.520333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c769db2-dde0-4a7d-8430-5becb6f338d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:55.520969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c769db2-dde0-4a7d-8430-5becb6f338d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:55.521896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c769db2-dde0-4a7d-8430-5becb6f338d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:55.523123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c769db2-dde0-4a7d-8430-5becb6f338d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:55.524278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c769db2-dde0-4a7d-8430-5becb6f338d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:55.590880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2cafc968-4766-4bff-b2f7-1be14132fbd5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:55.601819 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2cafc968-4766-4bff-b2f7-1be14132fbd5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1720 microversion: 2.1 time: 0.448862 Aug 18 11:44:55.602449 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2078/4386] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:55 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1720 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:55.621345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c0253853-eb24-4cd2-9ae2-ddf299497b28 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c0253853-eb24-4cd2-9ae2-ddf299497b28 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 416 Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'networks': [{'uuid': 'c201add2-2905-4a42-a119-5f0f7b3c5bb7'}]}}} Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.630181 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:44:55.633491 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.637622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c0253853-eb24-4cd2-9ae2-ddf299497b28 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:55.638700 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c0253853-eb24-4cd2-9ae2-ddf299497b28 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.021361 Aug 18 11:44:55.639778 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2079/4387] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:44:55 2022] POST /compute/v2.1/servers => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:44:55.648364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-92e62548-2461-40d0-b7c3-87f476f7464e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:55.649228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-92e62548-2461-40d0-b7c3-87f476f7464e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] [instance: ed4e597f-7b9e-49c9-b4e1-c10e051d5472] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:55.658766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92e62548-2461-40d0-b7c3-87f476f7464e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:55.659531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92e62548-2461-40d0-b7c3-87f476f7464e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:55.660322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92e62548-2461-40d0-b7c3-87f476f7464e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:55.661253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92e62548-2461-40d0-b7c3-87f476f7464e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:55.661870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92e62548-2461-40d0-b7c3-87f476f7464e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:55.662474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-92e62548-2461-40d0-b7c3-87f476f7464e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:55.691022 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-92e62548-2461-40d0-b7c3-87f476f7464e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] HTTP exception thrown: Instance ed4e597f-7b9e-49c9-b4e1-c10e051d5472 could not be found. Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-92e62548-2461-40d0-b7c3-87f476f7464e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Request method failure captured: Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/ed4e597f-7b9e-49c9-b4e1-c10e051d5472 HTTP/1.1 Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iYDX2L0chm3Pff85iNmOfmS2tq20TXJu2GOiswMvEKddUDYCZ38Xz92XCg8CBq16akojTlPIrYy_maypq8OwpLqbsL3jlpXiq2SFTCr2JWMMwU4KaWoPTTrrbilmxWki_j9HuSDBzncqD4rH9n4V3O8CDVP0boLdrE_T5Yi1L2MEAU Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Openstack-Nova-Api-Version: 2.47 Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: e13ad308c6814d7d82dd8c0afdfa7d02 Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerShowV247Test-381466694 Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/e13ad308c6814d7d82dd8c0afdfa7d02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/e13ad308c6814d7d82dd8c0afdfa7d02"}]}, {"type": "tempest-type-782648630", "name": "tempest-service-2040032395", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_e13ad308c6814d7d82dd8c0afdfa7d02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/e13ad308c6814d7d82dd8c0afdfa7d02"}]}, {"type": "tempest-type-922229597", "name": "tempest-service-4321545", "endpoints": []}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerShowV247Test-381466694 Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: e13ad308c6814d7d82dd8c0afdfa7d02 Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerShowV247Test-381466694 Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerShowV247Test-381466694-project Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: ac9115f76978444088f12ed55fbf43fb Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerShowV247Test-381466694-project Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance ed4e597f-7b9e-49c9-b4e1-c10e051d5472 could not be found. Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'ed4e597f-7b9e-49c9-b4e1-c10e051d5472'} Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4e597f-7b9e-49c9-b4e1-c10e051d5472 could not be found. Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4e597f-7b9e-49c9-b4e1-c10e051d5472 could not be found. Aug 18 11:44:55.692996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.697051 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:55.697051 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.697051 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:55.697051 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:55.697051 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:55.697051 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:44:55.697051 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:44:55.697051 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4e597f-7b9e-49c9-b4e1-c10e051d5472 could not be found. Aug 18 11:44:55.697051 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:55.699953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-92e62548-2461-40d0-b7c3-87f476f7464e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] Returning 404 to user: Instance ed4e597f-7b9e-49c9-b4e1-c10e051d5472 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:55.701343 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-92e62548-2461-40d0-b7c3-87f476f7464e tempest-ServerShowV247Test-381466694 tempest-ServerShowV247Test-381466694-project] 10.222.0.73 "GET /compute/v2.1/servers/ed4e597f-7b9e-49c9-b4e1-c10e051d5472" status: 404 len: 111 microversion: 2.47 time: 0.059380 Aug 18 11:44:55.702067 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2080/4388] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:44:55 2022] GET /compute/v2.1/servers/ed4e597f-7b9e-49c9-b4e1-c10e051d5472 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:44:55.710457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a8612ba5-d96e-4f89-9b2b-2a065c2c8974 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:55.711391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a8612ba5-d96e-4f89-9b2b-2a065c2c8974 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:55.719614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8612ba5-d96e-4f89-9b2b-2a065c2c8974 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:55.720347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8612ba5-d96e-4f89-9b2b-2a065c2c8974 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:55.720978 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8612ba5-d96e-4f89-9b2b-2a065c2c8974 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:55.721893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8612ba5-d96e-4f89-9b2b-2a065c2c8974 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:55.722534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8612ba5-d96e-4f89-9b2b-2a065c2c8974 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:55.723113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a8612ba5-d96e-4f89-9b2b-2a065c2c8974 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:55.821210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6c769db2-dde0-4a7d-8430-5becb6f338d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:55.838235 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6c769db2-dde0-4a7d-8430-5becb6f338d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1293 microversion: 2.1 time: 0.335776 Aug 18 11:44:55.839206 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2309/4389] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:55 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1293 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:55.896038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:56.027086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b77387e9-6f20-4e46-897f-0e120da8b32a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:56.028221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b77387e9-6f20-4e46-897f-0e120da8b32a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:56.034055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:56.053672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b77387e9-6f20-4e46-897f-0e120da8b32a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:56.059137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b77387e9-6f20-4e46-897f-0e120da8b32a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:56.059582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b77387e9-6f20-4e46-897f-0e120da8b32a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:56.060351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b77387e9-6f20-4e46-897f-0e120da8b32a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:56.060825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b77387e9-6f20-4e46-897f-0e120da8b32a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:56.061261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b77387e9-6f20-4e46-897f-0e120da8b32a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:56.186975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a8612ba5-d96e-4f89-9b2b-2a065c2c8974 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:56.199139 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a8612ba5-d96e-4f89-9b2b-2a065c2c8974 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.494976 Aug 18 11:44:56.200239 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2081/4390] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:55 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:56.222859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6b1ab289-4f95-4292-b6c8-96d090b4e3c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:56.224341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6b1ab289-4f95-4292-b6c8-96d090b4e3c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:56.238824 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=8 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:56.241086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b1ab289-4f95-4292-b6c8-96d090b4e3c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:56.241997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b1ab289-4f95-4292-b6c8-96d090b4e3c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:56.243004 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b1ab289-4f95-4292-b6c8-96d090b4e3c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:56.244666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b1ab289-4f95-4292-b6c8-96d090b4e3c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:56.245004 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b1ab289-4f95-4292-b6c8-96d090b4e3c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:56.245447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b1ab289-4f95-4292-b6c8-96d090b4e3c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:56.360989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b77387e9-6f20-4e46-897f-0e120da8b32a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:56.371768 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b77387e9-6f20-4e46-897f-0e120da8b32a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1317 microversion: 2.1 time: 0.351374 Aug 18 11:44:56.388755 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2310/4391] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:56 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:44:56.592287 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6b1ab289-4f95-4292-b6c8-96d090b4e3c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:56.605050 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6b1ab289-4f95-4292-b6c8-96d090b4e3c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.387339 Aug 18 11:44:56.606021 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2082/4392] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:56 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:44:56.632460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b18e3c9-0314-41e5-8f4f-3cc9b0df8e92 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:56.633358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b18e3c9-0314-41e5-8f4f-3cc9b0df8e92 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:56.643630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b18e3c9-0314-41e5-8f4f-3cc9b0df8e92 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:56.645090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b18e3c9-0314-41e5-8f4f-3cc9b0df8e92 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:56.646402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b18e3c9-0314-41e5-8f4f-3cc9b0df8e92 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:56.648012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b18e3c9-0314-41e5-8f4f-3cc9b0df8e92 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:56.657190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b18e3c9-0314-41e5-8f4f-3cc9b0df8e92 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:56.657914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b18e3c9-0314-41e5-8f4f-3cc9b0df8e92 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:56.659023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=10 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:44:56.807097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-409d6aa0-39a4-46bf-88d0-854994255ce2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1359067109", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": -1, "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:56.831188 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-409d6aa0-39a4-46bf-88d0-854994255ce2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Flavor -1 could not be found. Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-409d6aa0-39a4-46bf-88d0-854994255ce2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 206 Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1359067109", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": -1, "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: exception: Flavor -1 could not be found. Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1359067109', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': -1, 'networks': [{'uuid': 'c201add2-2905-4a42-a119-5f0f7b3c5bb7'}]}}} Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:44:56.832455 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-409d6aa0-39a4-46bf-88d0-854994255ce2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-409d6aa0-39a4-46bf-88d0-854994255ce2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.030755 Aug 18 11:44:56.841106 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2083/4393] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:44:56 2022] POST /compute/v2.1/servers => generated 73 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 18 11:44:56.850533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a35dde22-9ec8-42b8-ae86-24f9db763170 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:56.851190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a35dde22-9ec8-42b8-ae86-24f9db763170 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:56.873455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a35dde22-9ec8-42b8-ae86-24f9db763170 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:56.874315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a35dde22-9ec8-42b8-ae86-24f9db763170 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:56.874873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a35dde22-9ec8-42b8-ae86-24f9db763170 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:56.875717 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a35dde22-9ec8-42b8-ae86-24f9db763170 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:56.876189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a35dde22-9ec8-42b8-ae86-24f9db763170 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:56.876621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a35dde22-9ec8-42b8-ae86-24f9db763170 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:57.001966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5b18e3c9-0314-41e5-8f4f-3cc9b0df8e92 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:57.015783 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b18e3c9-0314-41e5-8f4f-3cc9b0df8e92 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1720 microversion: 2.1 time: 0.386952 Aug 18 11:44:57.016970 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2311/4394] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:56 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1720 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:57.022420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2df0ae14-18d6-4553-8e66-e256aab4b962 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:57.023441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2df0ae14-18d6-4553-8e66-e256aab4b962 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:57.038402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2df0ae14-18d6-4553-8e66-e256aab4b962 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:57.039171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2df0ae14-18d6-4553-8e66-e256aab4b962 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:57.044225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2df0ae14-18d6-4553-8e66-e256aab4b962 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:57.045567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2df0ae14-18d6-4553-8e66-e256aab4b962 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:57.047486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2df0ae14-18d6-4553-8e66-e256aab4b962 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:57.048380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2df0ae14-18d6-4553-8e66-e256aab4b962 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:57.279947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a35dde22-9ec8-42b8-ae86-24f9db763170 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:57.321404 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a35dde22-9ec8-42b8-ae86-24f9db763170 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.478345 Aug 18 11:44:57.322049 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2084/4395] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:56 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:57.351113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6f11b7d0-ff2d-4a44-a7f2-e46abd2ff06a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:57.351797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6f11b7d0-ff2d-4a44-a7f2-e46abd2ff06a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:57.368495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2df0ae14-18d6-4553-8e66-e256aab4b962 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:57.369413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f11b7d0-ff2d-4a44-a7f2-e46abd2ff06a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:57.369928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f11b7d0-ff2d-4a44-a7f2-e46abd2ff06a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:57.370376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f11b7d0-ff2d-4a44-a7f2-e46abd2ff06a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:57.378305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f11b7d0-ff2d-4a44-a7f2-e46abd2ff06a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:57.379659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f11b7d0-ff2d-4a44-a7f2-e46abd2ff06a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:57.380205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f11b7d0-ff2d-4a44-a7f2-e46abd2ff06a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:57.381646 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2df0ae14-18d6-4553-8e66-e256aab4b962 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1293 microversion: 2.1 time: 0.362958 Aug 18 11:44:57.382699 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2312/4396] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:57 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1293 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:57.394191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8bb3c182-5381-4f1f-b0c7-d1f07d2a1356 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:57.396184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8bb3c182-5381-4f1f-b0c7-d1f07d2a1356 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:57.414101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bb3c182-5381-4f1f-b0c7-d1f07d2a1356 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:57.414947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bb3c182-5381-4f1f-b0c7-d1f07d2a1356 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:57.415896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bb3c182-5381-4f1f-b0c7-d1f07d2a1356 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:57.416423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bb3c182-5381-4f1f-b0c7-d1f07d2a1356 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:57.417036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bb3c182-5381-4f1f-b0c7-d1f07d2a1356 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:57.417669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8bb3c182-5381-4f1f-b0c7-d1f07d2a1356 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:57.973658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6f11b7d0-ff2d-4a44-a7f2-e46abd2ff06a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:57.982705 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6f11b7d0-ff2d-4a44-a7f2-e46abd2ff06a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.637084 Aug 18 11:44:58.004244 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2085/4397] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:57 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:44:58.038256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-50bbcbec-db46-45d0-a239-cbc30441345a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:58.038910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-50bbcbec-db46-45d0-a239-cbc30441345a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:58.058334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50bbcbec-db46-45d0-a239-cbc30441345a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:58.058925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50bbcbec-db46-45d0-a239-cbc30441345a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:58.059356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50bbcbec-db46-45d0-a239-cbc30441345a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:58.060499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50bbcbec-db46-45d0-a239-cbc30441345a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:58.061123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50bbcbec-db46-45d0-a239-cbc30441345a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:58.061743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50bbcbec-db46-45d0-a239-cbc30441345a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:58.517038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-50bbcbec-db46-45d0-a239-cbc30441345a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:58.531739 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-50bbcbec-db46-45d0-a239-cbc30441345a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1720 microversion: 2.1 time: 0.496802 Aug 18 11:44:58.534808 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2086/4398] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:58 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1720 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:58.543384 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-54a66246-aa44-4456-86f5-3905bf0f0562 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1010156958", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-54a66246-aa44-4456-86f5-3905bf0f0562 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 173 Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1010156958", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1010156958', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'c201add2-2905-4a42-a119-5f0f7b3c5bb7'}]}}} Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi -1 Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:44:58.558691 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-54a66246-aa44-4456-86f5-3905bf0f0562 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-54a66246-aa44-4456-86f5-3905bf0f0562 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.024573 Aug 18 11:44:58.564356 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2087/4399] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:44:58 2022] POST /compute/v2.1/servers => generated 145 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:44:58.573633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e53c9ade-3340-480c-bfeb-30779f8f747f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:58.574246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e53c9ade-3340-480c-bfeb-30779f8f747f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:58.592286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e53c9ade-3340-480c-bfeb-30779f8f747f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:58.592781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e53c9ade-3340-480c-bfeb-30779f8f747f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:58.593753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e53c9ade-3340-480c-bfeb-30779f8f747f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:58.594490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e53c9ade-3340-480c-bfeb-30779f8f747f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:58.594953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e53c9ade-3340-480c-bfeb-30779f8f747f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:58.595447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e53c9ade-3340-480c-bfeb-30779f8f747f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:58.664346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8bb3c182-5381-4f1f-b0c7-d1f07d2a1356 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:58.693167 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8bb3c182-5381-4f1f-b0c7-d1f07d2a1356 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1317 microversion: 2.1 time: 1.303616 Aug 18 11:44:58.695140 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2313/4400] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:57 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1317 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:58.717956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d8b673fe-0498-4035-babe-d3d0dad3b1c9 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:58.723910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d8b673fe-0498-4035-babe-d3d0dad3b1c9 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:58.738579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8b673fe-0498-4035-babe-d3d0dad3b1c9 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:58.741050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8b673fe-0498-4035-babe-d3d0dad3b1c9 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:58.741686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8b673fe-0498-4035-babe-d3d0dad3b1c9 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:58.746315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8b673fe-0498-4035-babe-d3d0dad3b1c9 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:58.747034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8b673fe-0498-4035-babe-d3d0dad3b1c9 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:58.747885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8b673fe-0498-4035-babe-d3d0dad3b1c9 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:58.790843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e53c9ade-3340-480c-bfeb-30779f8f747f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:58.802611 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e53c9ade-3340-480c-bfeb-30779f8f747f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1293 microversion: 2.1 time: 0.236031 Aug 18 11:44:58.803997 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2088/4401] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:58 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1293 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:59.224993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d8b673fe-0498-4035-babe-d3d0dad3b1c9 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:59.240076 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d8b673fe-0498-4035-babe-d3d0dad3b1c9 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.539028 Aug 18 11:44:59.242936 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2314/4402] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:58 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:59.268851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6126547b-393f-4f56-8a0d-1cf703346232 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:59.269626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6126547b-393f-4f56-8a0d-1cf703346232 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:59.279707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6126547b-393f-4f56-8a0d-1cf703346232 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:59.287312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6126547b-393f-4f56-8a0d-1cf703346232 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:59.288149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6126547b-393f-4f56-8a0d-1cf703346232 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:59.289637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6126547b-393f-4f56-8a0d-1cf703346232 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:59.290306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6126547b-393f-4f56-8a0d-1cf703346232 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:59.291075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6126547b-393f-4f56-8a0d-1cf703346232 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:59.524987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6126547b-393f-4f56-8a0d-1cf703346232 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:44:59.546042 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6126547b-393f-4f56-8a0d-1cf703346232 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.281062 Aug 18 11:44:59.546989 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2089/4403] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:59 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:44:59.556446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8a1eab3b-6ffd-4d80-bbef-25bd430d2e81 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:59.558452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8a1eab3b-6ffd-4d80-bbef-25bd430d2e81 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:59.582176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a1eab3b-6ffd-4d80-bbef-25bd430d2e81 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:59.582792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a1eab3b-6ffd-4d80-bbef-25bd430d2e81 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:59.583253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a1eab3b-6ffd-4d80-bbef-25bd430d2e81 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:59.584141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a1eab3b-6ffd-4d80-bbef-25bd430d2e81 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:59.589957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a1eab3b-6ffd-4d80-bbef-25bd430d2e81 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:59.590491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a1eab3b-6ffd-4d80-bbef-25bd430d2e81 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:59.725407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c70c1cb9-9744-4207-b6f4-0dfd8fb0753c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:44:59.726368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c70c1cb9-9744-4207-b6f4-0dfd8fb0753c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:44:59.736839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c70c1cb9-9744-4207-b6f4-0dfd8fb0753c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:59.742516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c70c1cb9-9744-4207-b6f4-0dfd8fb0753c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:59.743281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c70c1cb9-9744-4207-b6f4-0dfd8fb0753c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:44:59.744167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c70c1cb9-9744-4207-b6f4-0dfd8fb0753c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:44:59.744790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c70c1cb9-9744-4207-b6f4-0dfd8fb0753c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:44:59.745429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c70c1cb9-9744-4207-b6f4-0dfd8fb0753c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:00.034059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8a1eab3b-6ffd-4d80-bbef-25bd430d2e81 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:00.053575 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8a1eab3b-6ffd-4d80-bbef-25bd430d2e81 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1720 microversion: 2.1 time: 0.503537 Aug 18 11:45:00.056987 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2315/4404] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:59 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1720 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:00.080887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b4282a8-11fc-44cf-8617-540e2d76cf10 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-966991213", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:00.092837 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-2b4282a8-11fc-44cf-8617-540e2d76cf10 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b4282a8-11fc-44cf-8617-540e2d76cf10 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 215 Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-966991213", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-966991213', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:00.107108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:00.111827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:00.111827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:00.111827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:00.111827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:00.111827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:00.111827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 18 11:45:00.111827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:00.116767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b4282a8-11fc-44cf-8617-540e2d76cf10 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:00.124955 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2b4282a8-11fc-44cf-8617-540e2d76cf10 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.063070 Aug 18 11:45:00.129527 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2316/4405] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:00 2022] POST /compute/v2.1/servers => generated 123 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:45:00.145165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7b7234cc-5c3e-4963-b0b6-84018c71c112 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:00.151536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7b7234cc-5c3e-4963-b0b6-84018c71c112 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:00.179525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b7234cc-5c3e-4963-b0b6-84018c71c112 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:00.180207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b7234cc-5c3e-4963-b0b6-84018c71c112 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:00.181491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b7234cc-5c3e-4963-b0b6-84018c71c112 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:00.183372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b7234cc-5c3e-4963-b0b6-84018c71c112 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:00.184030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b7234cc-5c3e-4963-b0b6-84018c71c112 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:00.186016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b7234cc-5c3e-4963-b0b6-84018c71c112 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:00.619517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7b7234cc-5c3e-4963-b0b6-84018c71c112 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:00.629453 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7b7234cc-5c3e-4963-b0b6-84018c71c112 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1293 microversion: 2.1 time: 0.498465 Aug 18 11:45:00.630392 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2317/4406] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:00 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1293 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:00.636786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2c84268e-e1a8-40ed-af88-45804d27e1cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:00.637431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2c84268e-e1a8-40ed-af88-45804d27e1cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:00.655570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c84268e-e1a8-40ed-af88-45804d27e1cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:00.656861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c84268e-e1a8-40ed-af88-45804d27e1cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:00.657501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c84268e-e1a8-40ed-af88-45804d27e1cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:00.660759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c84268e-e1a8-40ed-af88-45804d27e1cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:00.661259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c84268e-e1a8-40ed-af88-45804d27e1cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:00.661868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c84268e-e1a8-40ed-af88-45804d27e1cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:00.922723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c70c1cb9-9744-4207-b6f4-0dfd8fb0753c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:00.938232 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c70c1cb9-9744-4207-b6f4-0dfd8fb0753c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1317 microversion: 2.1 time: 1.216645 Aug 18 11:45:00.938875 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2090/4407] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:44:59 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1317 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:01.070309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2c84268e-e1a8-40ed-af88-45804d27e1cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:01.090058 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2c84268e-e1a8-40ed-af88-45804d27e1cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.452052 Aug 18 11:45:01.091911 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2318/4408] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:00 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:01.103348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f868a7e4-613c-4e6f-9887-e20112f4bce9 req-f8837c11-73f1-48ba-971b-b7eec4d6b0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2f4eea-48c1-4757-a5b3-64624def8f67", "name": "network-vif-plugged", "status": "completed", "tag": "a0233917-a53d-447a-82b0-5dcc439b518d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:01.151224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f868a7e4-613c-4e6f-9887-e20112f4bce9 req-f8837c11-73f1-48ba-971b-b7eec4d6b0c6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:01.152373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f868a7e4-613c-4e6f-9887-e20112f4bce9 req-f8837c11-73f1-48ba-971b-b7eec4d6b0c6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:01.153671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f868a7e4-613c-4e6f-9887-e20112f4bce9 req-f8837c11-73f1-48ba-971b-b7eec4d6b0c6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:01.193226 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f868a7e4-613c-4e6f-9887-e20112f4bce9 req-f8837c11-73f1-48ba-971b-b7eec4d6b0c6 service nova] Creating event network-vif-plugged:a0233917-a53d-447a-82b0-5dcc439b518d for instance ae2f4eea-48c1-4757-a5b3-64624def8f67 on n-h1-853611-3 Aug 18 11:45:01.212746 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f868a7e4-613c-4e6f-9887-e20112f4bce9 req-f8837c11-73f1-48ba-971b-b7eec4d6b0c6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119083 Aug 18 11:45:01.218863 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2319/4409] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:45:01.270239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8a59c0ff-664f-44b1-b225-86401a268f0a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:01.270622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3f8f8d0f-1de0-4cfb-9013-b25329a41792 tempest-ComputeTenantNetworksTest-541671245 tempest-ComputeTenantNetworksTest-541671245-project] Calling method '.version_select at 0x7f519ec439d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:01.272863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8a59c0ff-664f-44b1-b225-86401a268f0a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:01.295820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a59c0ff-664f-44b1-b225-86401a268f0a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:01.299536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a59c0ff-664f-44b1-b225-86401a268f0a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:01.299830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a59c0ff-664f-44b1-b225-86401a268f0a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:01.300586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a59c0ff-664f-44b1-b225-86401a268f0a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:01.311732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a59c0ff-664f-44b1-b225-86401a268f0a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:01.313009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a59c0ff-664f-44b1-b225-86401a268f0a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:01.372178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:01.767497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8a59c0ff-664f-44b1-b225-86401a268f0a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:01.777611 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8a59c0ff-664f-44b1-b225-86401a268f0a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1720 microversion: 2.1 time: 0.557408 Aug 18 11:45:01.781032 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2320/4410] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:01 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1720 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:01.790023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4120bbaa-9d49-4186-b418-ad139c2b1d1d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:01.794169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4120bbaa-9d49-4186-b418-ad139c2b1d1d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:01.796691 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3f8f8d0f-1de0-4cfb-9013-b25329a41792 tempest-ComputeTenantNetworksTest-541671245 tempest-ComputeTenantNetworksTest-541671245-project] 10.222.0.73 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.856005 Aug 18 11:45:01.797610 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2091/4411] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 11:45:00 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:45:01.803537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-771dffeb-341b-41fe-9a68-24983fd15aa9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:01.804375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-771dffeb-341b-41fe-9a68-24983fd15aa9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:01.810338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4120bbaa-9d49-4186-b418-ad139c2b1d1d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:01.811034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4120bbaa-9d49-4186-b418-ad139c2b1d1d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:01.812196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4120bbaa-9d49-4186-b418-ad139c2b1d1d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:01.817509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4120bbaa-9d49-4186-b418-ad139c2b1d1d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:01.817509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4120bbaa-9d49-4186-b418-ad139c2b1d1d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:01.817875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4120bbaa-9d49-4186-b418-ad139c2b1d1d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:01.822761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-771dffeb-341b-41fe-9a68-24983fd15aa9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:01.824593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-771dffeb-341b-41fe-9a68-24983fd15aa9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:01.826310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-771dffeb-341b-41fe-9a68-24983fd15aa9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:01.828642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-771dffeb-341b-41fe-9a68-24983fd15aa9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:01.829405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-771dffeb-341b-41fe-9a68-24983fd15aa9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:01.831303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-771dffeb-341b-41fe-9a68-24983fd15aa9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:02.237601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-771dffeb-341b-41fe-9a68-24983fd15aa9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:02.245806 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-771dffeb-341b-41fe-9a68-24983fd15aa9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1293 microversion: 2.1 time: 0.446830 Aug 18 11:45:02.253958 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2092/4412] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:01 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1293 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:02.265501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4120bbaa-9d49-4186-b418-ad139c2b1d1d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:02.272382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-56f10ce6-fbfc-4243-86b1-7cdd2452090d tempest-ComputeTenantNetworksTest-541671245 tempest-ComputeTenantNetworksTest-541671245-project] Calling method '.version_select at 0x7f519ec504c0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:02.276089 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4120bbaa-9d49-4186-b418-ad139c2b1d1d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.492519 Aug 18 11:45:02.278552 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2321/4413] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:01 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:02.289997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b7c73dff-d289-4c10-ad33-aa035e5c37c6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:02.293769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b7c73dff-d289-4c10-ad33-aa035e5c37c6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:02.304807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7c73dff-d289-4c10-ad33-aa035e5c37c6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:02.306999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7c73dff-d289-4c10-ad33-aa035e5c37c6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:02.308220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7c73dff-d289-4c10-ad33-aa035e5c37c6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:02.310416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7c73dff-d289-4c10-ad33-aa035e5c37c6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:02.311080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7c73dff-d289-4c10-ad33-aa035e5c37c6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:02.313466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7c73dff-d289-4c10-ad33-aa035e5c37c6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:02.491983 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-56f10ce6-fbfc-4243-86b1-7cdd2452090d tempest-ComputeTenantNetworksTest-541671245 tempest-ComputeTenantNetworksTest-541671245-project] 10.222.0.73 "GET /compute/v2.1/os-tenant-networks/139c444a-9c02-4b02-91c7-410822dae4da" status: 200 len: 140 microversion: 2.1 time: 0.235887 Aug 18 11:45:02.494045 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2093/4414] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 11:45:02 2022] GET /compute/v2.1/os-tenant-networks/139c444a-9c02-4b02-91c7-410822dae4da => generated 140 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:45:02.502118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-076f2063-359d-454c-9dfa-224b0771045c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1180531991", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "key_name": "tempest-key-455452953", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:02.596519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-076f2063-359d-454c-9dfa-224b0771045c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] validate_networks() for [('c201add2-2905-4a42-a119-5f0f7b3c5bb7', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:45:02.648186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b7c73dff-d289-4c10-ad33-aa035e5c37c6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:02.662257 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b7c73dff-d289-4c10-ad33-aa035e5c37c6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1317 microversion: 2.1 time: 0.380294 Aug 18 11:45:02.663676 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2322/4415] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:02 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:02.801576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-47521271-c550-42c8-96c8-9efb04e77f4f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:02.802194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-47521271-c550-42c8-96c8-9efb04e77f4f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:02.820935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47521271-c550-42c8-96c8-9efb04e77f4f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:02.821680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47521271-c550-42c8-96c8-9efb04e77f4f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:02.822131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47521271-c550-42c8-96c8-9efb04e77f4f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:02.822858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47521271-c550-42c8-96c8-9efb04e77f4f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:02.823321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47521271-c550-42c8-96c8-9efb04e77f4f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:02.823740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47521271-c550-42c8-96c8-9efb04e77f4f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:03.114758 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-076f2063-359d-454c-9dfa-224b0771045c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Invalid key_name provided. Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-076f2063-359d-454c-9dfa-224b0771045c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 246 Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1180531991", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "key_name": "tempest-key-455452953", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid key_name provided. Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1180531991', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'key_name': 'tempest-key-455452953', 'networks': [{'uuid': 'c201add2-2905-4a42-a119-5f0f7b3c5bb7'}]}}} Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-455452953 not found for user 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:03.116992 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 18 11:45:03.120916 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:03.125689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-076f2063-359d-454c-9dfa-224b0771045c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Invalid key_name provided. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:03.127041 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-076f2063-359d-454c-9dfa-224b0771045c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.631333 Aug 18 11:45:03.128045 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2094/4416] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:02 2022] POST /compute/v2.1/servers => generated 70 bytes in 633 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:03.138511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4784fc32-c8d0-4390-b9f4-dd69464beb01 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:03.139485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4784fc32-c8d0-4390-b9f4-dd69464beb01 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:03.150323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4784fc32-c8d0-4390-b9f4-dd69464beb01 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:03.151842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4784fc32-c8d0-4390-b9f4-dd69464beb01 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:03.152579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4784fc32-c8d0-4390-b9f4-dd69464beb01 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:03.153917 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4784fc32-c8d0-4390-b9f4-dd69464beb01 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:03.155316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4784fc32-c8d0-4390-b9f4-dd69464beb01 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:03.158233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4784fc32-c8d0-4390-b9f4-dd69464beb01 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:03.209377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-47521271-c550-42c8-96c8-9efb04e77f4f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:03.236998 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-47521271-c550-42c8-96c8-9efb04e77f4f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1720 microversion: 2.1 time: 0.439089 Aug 18 11:45:03.240033 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2323/4417] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:02 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1720 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:45:03.274093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-864ee434-1616-442d-ac2d-43fd54665409 req-dd21a671-3978-447d-8a85-56fc37994bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "369c24ec-e260-4e7a-b831-9f8b5ce7b0ac", "name": "network-vif-plugged", "status": "completed", "tag": "08ceaca9-08e2-4516-9407-f98fea48546d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:03.318483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-864ee434-1616-442d-ac2d-43fd54665409 req-dd21a671-3978-447d-8a85-56fc37994bca service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:03.319361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-864ee434-1616-442d-ac2d-43fd54665409 req-dd21a671-3978-447d-8a85-56fc37994bca service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:03.319960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-864ee434-1616-442d-ac2d-43fd54665409 req-dd21a671-3978-447d-8a85-56fc37994bca service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:03.353866 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-864ee434-1616-442d-ac2d-43fd54665409 req-dd21a671-3978-447d-8a85-56fc37994bca service nova] Creating event network-vif-plugged:08ceaca9-08e2-4516-9407-f98fea48546d for instance 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac on n-h2-853611-3 Aug 18 11:45:03.363407 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-864ee434-1616-442d-ac2d-43fd54665409 req-dd21a671-3978-447d-8a85-56fc37994bca service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096010 Aug 18 11:45:03.365041 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2324/4418] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:45:03.391984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9a83b19e-86cf-48d4-8dd6-21a12576c87d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:03.398079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9a83b19e-86cf-48d4-8dd6-21a12576c87d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:03.418796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a83b19e-86cf-48d4-8dd6-21a12576c87d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:03.420415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a83b19e-86cf-48d4-8dd6-21a12576c87d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:03.424063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a83b19e-86cf-48d4-8dd6-21a12576c87d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:03.425444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a83b19e-86cf-48d4-8dd6-21a12576c87d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:03.429430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a83b19e-86cf-48d4-8dd6-21a12576c87d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:03.430746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a83b19e-86cf-48d4-8dd6-21a12576c87d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:03.673308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4784fc32-c8d0-4390-b9f4-dd69464beb01 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:03.689251 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4784fc32-c8d0-4390-b9f4-dd69464beb01 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.555948 Aug 18 11:45:03.695087 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2095/4419] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:03 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:03.717271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5bbd45ce-be02-45e3-9a64-ec93ae4afc83 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:03.721579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5bbd45ce-be02-45e3-9a64-ec93ae4afc83 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:03.740457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bbd45ce-be02-45e3-9a64-ec93ae4afc83 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:03.741555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bbd45ce-be02-45e3-9a64-ec93ae4afc83 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:03.742411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bbd45ce-be02-45e3-9a64-ec93ae4afc83 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:03.743459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bbd45ce-be02-45e3-9a64-ec93ae4afc83 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:03.746458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bbd45ce-be02-45e3-9a64-ec93ae4afc83 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:03.747296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bbd45ce-be02-45e3-9a64-ec93ae4afc83 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:03.956929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9a83b19e-86cf-48d4-8dd6-21a12576c87d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:03.978818 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9a83b19e-86cf-48d4-8dd6-21a12576c87d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1474 microversion: 2.1 time: 0.611569 Aug 18 11:45:03.980650 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2325/4420] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:03 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1474 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:04.005521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fb280bef-2d18-4c5c-a06c-f4a512560589 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:04.012036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fb280bef-2d18-4c5c-a06c-f4a512560589 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:04.036686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb280bef-2d18-4c5c-a06c-f4a512560589 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:04.037203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb280bef-2d18-4c5c-a06c-f4a512560589 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:04.042470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb280bef-2d18-4c5c-a06c-f4a512560589 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:04.047220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb280bef-2d18-4c5c-a06c-f4a512560589 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:04.049087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb280bef-2d18-4c5c-a06c-f4a512560589 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:04.049573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb280bef-2d18-4c5c-a06c-f4a512560589 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:04.067557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5bbd45ce-be02-45e3-9a64-ec93ae4afc83 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:04.104913 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5bbd45ce-be02-45e3-9a64-ec93ae4afc83 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1317 microversion: 2.1 time: 0.405861 Aug 18 11:45:04.111829 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2096/4421] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:03 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:04.128518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a7ce2c1-13ea-424a-8334-833e675db177 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:04.130172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0a7ce2c1-13ea-424a-8334-833e675db177 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:04.137875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a7ce2c1-13ea-424a-8334-833e675db177 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:04.138816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a7ce2c1-13ea-424a-8334-833e675db177 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:04.140141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a7ce2c1-13ea-424a-8334-833e675db177 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:04.141321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a7ce2c1-13ea-424a-8334-833e675db177 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:04.142842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a7ce2c1-13ea-424a-8334-833e675db177 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:04.143546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a7ce2c1-13ea-424a-8334-833e675db177 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:04.163698 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-0a7ce2c1-13ea-424a-8334-833e675db177 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] HTTP exception thrown: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a7ce2c1-13ea-424a-8334-833e675db177 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Request method failure captured: Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab HTTP/1.1 Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iSP7erUKxCSon0QUcmhKCvXzYHXM-xvsBvTka4gqR-DMgMj5EbZD5M5E6boHEg-yQOMYJku61EJdcx9ZjfTd5i7QRH0lnhq-g29TQdILyxCLpY2A8jGshiwcRq878C92qcHz-qpeTkbgJUf5REHUbpxXSNJcSD0jLCGnAEv1h5DNKw Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Openstack-Nova-Api-Version: 2.32 Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: f185d17297d14e608e8b5f1040c2510b Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-TaggedBootDevicesTest-478845745 Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f185d17297d14e608e8b5f1040c2510b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f185d17297d14e608e8b5f1040c2510b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f185d17297d14e608e8b5f1040c2510b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f185d17297d14e608e8b5f1040c2510b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-TaggedBootDevicesTest-478845745 Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: f185d17297d14e608e8b5f1040c2510b Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-TaggedBootDevicesTest-478845745 Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-TaggedBootDevicesTest-478845745-project Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: f79a445f2f764e6e9f6d9916ffca05de Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-TaggedBootDevicesTest-478845745-project Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '90132336-bd92-44e9-bc59-949f10e5ecab'} Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:04.166570 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:04.171750 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:45:04.171750 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:04.171750 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:04.171750 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:04.171750 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:04.171750 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:04.171750 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:04.171750 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:04.171750 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:04.171750 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:45:04.171750 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:04.173511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a7ce2c1-13ea-424a-8334-833e675db177 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Returning 404 to user: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:04.174632 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0a7ce2c1-13ea-424a-8334-833e675db177 tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "DELETE /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 404 len: 111 microversion: 2.32 time: 0.060893 Aug 18 11:45:04.176204 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2097/4422] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:45:04 2022] DELETE /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:45:04.192327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4127711b-dcea-4a20-9b29-de7b40343f5e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:04.193444 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4127711b-dcea-4a20-9b29-de7b40343f5e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] [instance: 90132336-bd92-44e9-bc59-949f10e5ecab] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:04.212163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4127711b-dcea-4a20-9b29-de7b40343f5e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:04.213152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4127711b-dcea-4a20-9b29-de7b40343f5e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:04.214133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4127711b-dcea-4a20-9b29-de7b40343f5e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:04.220352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4127711b-dcea-4a20-9b29-de7b40343f5e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:04.221092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4127711b-dcea-4a20-9b29-de7b40343f5e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:04.221830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4127711b-dcea-4a20-9b29-de7b40343f5e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:04.242462 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-4127711b-dcea-4a20-9b29-de7b40343f5e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] HTTP exception thrown: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4127711b-dcea-4a20-9b29-de7b40343f5e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Request method failure captured: Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab HTTP/1.1 Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iSP7erUKxCSon0QUcmhKCvXzYHXM-xvsBvTka4gqR-DMgMj5EbZD5M5E6boHEg-yQOMYJku61EJdcx9ZjfTd5i7QRH0lnhq-g29TQdILyxCLpY2A8jGshiwcRq878C92qcHz-qpeTkbgJUf5REHUbpxXSNJcSD0jLCGnAEv1h5DNKw Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Openstack-Nova-Api-Version: 2.32 Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: f185d17297d14e608e8b5f1040c2510b Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-TaggedBootDevicesTest-478845745 Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f185d17297d14e608e8b5f1040c2510b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f185d17297d14e608e8b5f1040c2510b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f185d17297d14e608e8b5f1040c2510b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f185d17297d14e608e8b5f1040c2510b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-TaggedBootDevicesTest-478845745 Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: f185d17297d14e608e8b5f1040c2510b Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-TaggedBootDevicesTest-478845745 Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-TaggedBootDevicesTest-478845745-project Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: f79a445f2f764e6e9f6d9916ffca05de Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-TaggedBootDevicesTest-478845745-project Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '90132336-bd92-44e9-bc59-949f10e5ecab'} Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:04.244527 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:04.249077 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:04.249077 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:04.249077 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:04.249077 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:04.249077 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:04.249077 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. Aug 18 11:45:04.249077 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:04.249077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4127711b-dcea-4a20-9b29-de7b40343f5e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] Returning 404 to user: Instance 90132336-bd92-44e9-bc59-949f10e5ecab could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:04.249077 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4127711b-dcea-4a20-9b29-de7b40343f5e tempest-TaggedBootDevicesTest-478845745 tempest-TaggedBootDevicesTest-478845745-project] 10.222.0.73 "GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab" status: 404 len: 111 microversion: 2.32 time: 0.066283 Aug 18 11:45:04.249077 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2098/4423] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:45:04 2022] GET /compute/v2.1/servers/90132336-bd92-44e9-bc59-949f10e5ecab => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:45:04.256811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-858643690", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:04.271439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:04.340822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] validate_networks() for [('748eeef0-4e88-4443-abac-e79de3b3bb2a', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:45:04.379903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fb280bef-2d18-4c5c-a06c-f4a512560589 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:04.391425 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fb280bef-2d18-4c5c-a06c-f4a512560589 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.406148 Aug 18 11:45:04.410223 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2326/4424] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:03 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:04.424680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ad19bc70-82b8-474d-89ff-8b849ec2b07e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:04.425521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ad19bc70-82b8-474d-89ff-8b849ec2b07e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:04.433574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad19bc70-82b8-474d-89ff-8b849ec2b07e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:04.434320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad19bc70-82b8-474d-89ff-8b849ec2b07e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:04.434980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad19bc70-82b8-474d-89ff-8b849ec2b07e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:04.435887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad19bc70-82b8-474d-89ff-8b849ec2b07e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:04.437467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad19bc70-82b8-474d-89ff-8b849ec2b07e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:04.438171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad19bc70-82b8-474d-89ff-8b849ec2b07e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:04.863906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ad19bc70-82b8-474d-89ff-8b849ec2b07e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:04.886419 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ad19bc70-82b8-474d-89ff-8b849ec2b07e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1720 microversion: 2.1 time: 0.468349 Aug 18 11:45:04.902459 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2327/4425] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:04 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1720 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:04.909438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-717e574f-53a8-4761-a931-b4ad24b8e3ba tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-510630023", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:06.002177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.security_group_api [None req-717e574f-53a8-4761-a931-b4ad24b8e3ba tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Neutron security group does_not_exist not found {{(pid=122210) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 18 11:45:06.003536 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-717e574f-53a8-4761-a931-b4ad24b8e3ba tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-717e574f-53a8-4761-a931-b4ad24b8e3ba tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 257 Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-510630023", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-510630023', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'c201add2-2905-4a42-a119-5f0f7b3c5bb7'}]}}} Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 18 11:45:06.012277 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 18 11:45:06.016911 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:06.027622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-717e574f-53a8-4761-a931-b4ad24b8e3ba tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:06.028835 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-717e574f-53a8-4761-a931-b4ad24b8e3ba tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 1.140549 Aug 18 11:45:06.029657 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2328/4426] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:04 2022] POST /compute/v2.1/servers => generated 106 bytes in 1142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:45:06.035998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06aa9797-9682-48a3-86dc-f2e6e3a8e2e6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:06.050378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-06aa9797-9682-48a3-86dc-f2e6e3a8e2e6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:06.069690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:06.085642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06aa9797-9682-48a3-86dc-f2e6e3a8e2e6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:06.086606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06aa9797-9682-48a3-86dc-f2e6e3a8e2e6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:06.089330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06aa9797-9682-48a3-86dc-f2e6e3a8e2e6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:06.091438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06aa9797-9682-48a3-86dc-f2e6e3a8e2e6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:06.096775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06aa9797-9682-48a3-86dc-f2e6e3a8e2e6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:06.101483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06aa9797-9682-48a3-86dc-f2e6e3a8e2e6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:06.405768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:45:06.406491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:45:06.406685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:45:06.407104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:45:06.407518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:45:06.431876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:06.432607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:06.433204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:06.443194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:06.443982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:06.444437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-06aa9797-9682-48a3-86dc-f2e6e3a8e2e6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:06.444804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:06.453438 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-06aa9797-9682-48a3-86dc-f2e6e3a8e2e6 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1506 microversion: 2.1 time: 0.421683 Aug 18 11:45:06.460230 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2329/4427] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:06 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:06.465308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d4acb33b-e455-4ef2-9433-e04dbef5d727 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:06.471624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d4acb33b-e455-4ef2-9433-e04dbef5d727 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:06.485285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:45:06.492785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4acb33b-e455-4ef2-9433-e04dbef5d727 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:06.493542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4acb33b-e455-4ef2-9433-e04dbef5d727 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:06.494282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4acb33b-e455-4ef2-9433-e04dbef5d727 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:06.495219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4acb33b-e455-4ef2-9433-e04dbef5d727 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:06.495837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4acb33b-e455-4ef2-9433-e04dbef5d727 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:06.496512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4acb33b-e455-4ef2-9433-e04dbef5d727 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:06.504131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for user c850b0a836124d90b7e50fe8b9fdf011 and project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:45:06.539882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:45:06.547064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:45:06.634616 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-abeb2982-8e89-4853-9b3c-1e07bf292c17 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.385479 Aug 18 11:45:06.642145 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2099/4428] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:45:06.658543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-37d00ad6-d285-47d3-9996-0ae7e614f39f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:06.659187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-37d00ad6-d285-47d3-9996-0ae7e614f39f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:06.666292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37d00ad6-d285-47d3-9996-0ae7e614f39f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:06.666835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37d00ad6-d285-47d3-9996-0ae7e614f39f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:06.667283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37d00ad6-d285-47d3-9996-0ae7e614f39f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:06.675900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37d00ad6-d285-47d3-9996-0ae7e614f39f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:06.681318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37d00ad6-d285-47d3-9996-0ae7e614f39f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:06.681318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37d00ad6-d285-47d3-9996-0ae7e614f39f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:07.550090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d4acb33b-e455-4ef2-9433-e04dbef5d727 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:07.574200 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d4acb33b-e455-4ef2-9433-e04dbef5d727 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1720 microversion: 2.1 time: 1.109295 Aug 18 11:45:07.574892 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2330/4429] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:06 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1720 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:07.595938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8394c32f-f06a-421a-a59b-3502ae3b596a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:07.597022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8394c32f-f06a-421a-a59b-3502ae3b596a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:07.628704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8394c32f-f06a-421a-a59b-3502ae3b596a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:07.645438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8394c32f-f06a-421a-a59b-3502ae3b596a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:07.646353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8394c32f-f06a-421a-a59b-3502ae3b596a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:07.647969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8394c32f-f06a-421a-a59b-3502ae3b596a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:07.650539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8394c32f-f06a-421a-a59b-3502ae3b596a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:07.672812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8394c32f-f06a-421a-a59b-3502ae3b596a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:07.703371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-37d00ad6-d285-47d3-9996-0ae7e614f39f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:07.723754 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-37d00ad6-d285-47d3-9996-0ae7e614f39f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 1.080249 Aug 18 11:45:07.724905 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2100/4430] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:06 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:07.734828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:07.735788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:07.751453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:07.752149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:07.753293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:07.754202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:07.754861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:07.755441 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:07.795176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8394c32f-f06a-421a-a59b-3502ae3b596a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:07.802529 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8394c32f-f06a-421a-a59b-3502ae3b596a tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac/os-instance-actions/req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9" status: 200 len: 313 microversion: 2.1 time: 0.224236 Aug 18 11:45:07.808762 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2331/4431] 10.222.0.73 () {58 vars in 1419 bytes} [Thu Aug 18 11:45:07 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac/os-instance-actions/req-ed21a95c-3f6e-4e3d-9009-e34db3a8aef9 => generated 313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:45:07.828803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c857e03c-08ed-49d5-96a4-2d1cfaea59f2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:07.831081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c857e03c-08ed-49d5-96a4-2d1cfaea59f2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:07.860558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:45:07.890713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c857e03c-08ed-49d5-96a4-2d1cfaea59f2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:07.892841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c857e03c-08ed-49d5-96a4-2d1cfaea59f2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:07.894366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c857e03c-08ed-49d5-96a4-2d1cfaea59f2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:07.896260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c857e03c-08ed-49d5-96a4-2d1cfaea59f2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:07.898328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c857e03c-08ed-49d5-96a4-2d1cfaea59f2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:07.900811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c857e03c-08ed-49d5-96a4-2d1cfaea59f2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:07.918218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:07.921905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:07.923584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:08.049482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lazy-loading 'flavor' on Instance uuid 95a45926-b983-40e7-b9cf-16feec0fc37e {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:45:08.073406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lazy-loading 'system_metadata' on Instance uuid 95a45926-b983-40e7-b9cf-16feec0fc37e {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:45:08.192495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:08.209883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lazy-loading 'metadata' on Instance uuid 95a45926-b983-40e7-b9cf-16feec0fc37e {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:45:08.460701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:08.461221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:08.461679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:08.540991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c857e03c-08ed-49d5-96a4-2d1cfaea59f2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:08.553984 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c857e03c-08ed-49d5-96a4-2d1cfaea59f2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.742471 Aug 18 11:45:08.569846 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2332/4432] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:07 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:08.580021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0e9dcd5-9143-42ca-9df6-1dc189b87d40 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:08.583593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a0e9dcd5-9143-42ca-9df6-1dc189b87d40 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:08.603013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0e9dcd5-9143-42ca-9df6-1dc189b87d40 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:08.604855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0e9dcd5-9143-42ca-9df6-1dc189b87d40 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:08.607015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0e9dcd5-9143-42ca-9df6-1dc189b87d40 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:08.610701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0e9dcd5-9143-42ca-9df6-1dc189b87d40 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:08.611802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0e9dcd5-9143-42ca-9df6-1dc189b87d40 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:08.612407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0e9dcd5-9143-42ca-9df6-1dc189b87d40 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:08.770859 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9cd847a0-4e00-434b-97fa-0395f15a25db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 204 len: 0 microversion: 2.1 time: 1.044385 Aug 18 11:45:08.772572 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2101/4433] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:45:07 2022] DELETE /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 0 bytes in 1047 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:45:08.792729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7a68d6cf-1c8f-4619-befb-25a89f8747cd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:08.793448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7a68d6cf-1c8f-4619-befb-25a89f8747cd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: bf07bbda-384c-4fda-9446-6eae932d7c87] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:08.806577 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-7a68d6cf-1c8f-4619-befb-25a89f8747cd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance bf07bbda-384c-4fda-9446-6eae932d7c87 could not be found. Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7a68d6cf-1c8f-4619-befb-25a89f8747cd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/bf07bbda-384c-4fda-9446-6eae932d7c87 HTTP/1.1 Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance bf07bbda-384c-4fda-9446-6eae932d7c87 could not be found. Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'bf07bbda-384c-4fda-9446-6eae932d7c87'} Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf07bbda-384c-4fda-9446-6eae932d7c87 could not be found. Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf07bbda-384c-4fda-9446-6eae932d7c87 could not be found. Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:08.808734 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:08.814234 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:08.814234 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:08.814234 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:08.814234 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:08.814234 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:08.814234 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:08.814234 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf07bbda-384c-4fda-9446-6eae932d7c87 could not be found. Aug 18 11:45:08.814234 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:08.816012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7a68d6cf-1c8f-4619-befb-25a89f8747cd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance bf07bbda-384c-4fda-9446-6eae932d7c87 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:08.826546 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7a68d6cf-1c8f-4619-befb-25a89f8747cd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bf07bbda-384c-4fda-9446-6eae932d7c87" status: 404 len: 111 microversion: 2.1 time: 0.052425 Aug 18 11:45:08.827757 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2102/4434] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:45:08 2022] DELETE /compute/v2.1/servers/bf07bbda-384c-4fda-9446-6eae932d7c87 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:45:08.833634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d2bb0d60-1afa-4806-bbd9-8d94b95c7ebd tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:08.834603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d2bb0d60-1afa-4806-bbd9-8d94b95c7ebd tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:08.834723 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a0e9dcd5-9143-42ca-9df6-1dc189b87d40 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "POST /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac/action" status: 202 len: 0 microversion: 2.1 time: 0.263155 Aug 18 11:45:08.835684 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2333/4435] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:08 2022] POST /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:45:08.847487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ae9b5222-322d-4bb3-a410-d91a096029db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:08.848213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ae9b5222-322d-4bb3-a410-d91a096029db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:08.850008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2bb0d60-1afa-4806-bbd9-8d94b95c7ebd tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:08.850578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2bb0d60-1afa-4806-bbd9-8d94b95c7ebd tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:08.851022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2bb0d60-1afa-4806-bbd9-8d94b95c7ebd tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:08.852906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2bb0d60-1afa-4806-bbd9-8d94b95c7ebd tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:08.857207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2bb0d60-1afa-4806-bbd9-8d94b95c7ebd tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:08.858206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d2bb0d60-1afa-4806-bbd9-8d94b95c7ebd tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:08.881857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae9b5222-322d-4bb3-a410-d91a096029db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:08.882260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae9b5222-322d-4bb3-a410-d91a096029db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:08.882744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae9b5222-322d-4bb3-a410-d91a096029db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:08.883493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae9b5222-322d-4bb3-a410-d91a096029db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:08.883955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae9b5222-322d-4bb3-a410-d91a096029db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:08.884386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae9b5222-322d-4bb3-a410-d91a096029db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:09.099967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ae9b5222-322d-4bb3-a410-d91a096029db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:09.114804 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ae9b5222-322d-4bb3-a410-d91a096029db tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1266 microversion: 2.1 time: 0.277618 Aug 18 11:45:09.115620 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2334/4436] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:08 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:09.145657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34e46357-65a3-4835-b69b-6b794e7f0e22 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:09.146319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-34e46357-65a3-4835-b69b-6b794e7f0e22 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:09.153179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34e46357-65a3-4835-b69b-6b794e7f0e22 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:09.153682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34e46357-65a3-4835-b69b-6b794e7f0e22 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:09.154124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34e46357-65a3-4835-b69b-6b794e7f0e22 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:09.154916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34e46357-65a3-4835-b69b-6b794e7f0e22 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:09.155568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34e46357-65a3-4835-b69b-6b794e7f0e22 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:09.156003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34e46357-65a3-4835-b69b-6b794e7f0e22 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:09.463602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d2bb0d60-1afa-4806-bbd9-8d94b95c7ebd tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:09.474098 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d2bb0d60-1afa-4806-bbd9-8d94b95c7ebd tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1697 microversion: 2.1 time: 0.644958 Aug 18 11:45:09.474700 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2103/4437] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:08 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1697 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:09.487453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6afa52ef-6287-457e-bb8d-2650b1b5dc9f tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:09.491529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6afa52ef-6287-457e-bb8d-2650b1b5dc9f tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:09.502219 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6afa52ef-6287-457e-bb8d-2650b1b5dc9f tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:09.503754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6afa52ef-6287-457e-bb8d-2650b1b5dc9f tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:09.504993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6afa52ef-6287-457e-bb8d-2650b1b5dc9f tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:09.505741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6afa52ef-6287-457e-bb8d-2650b1b5dc9f tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:09.506210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6afa52ef-6287-457e-bb8d-2650b1b5dc9f tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:09.506683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6afa52ef-6287-457e-bb8d-2650b1b5dc9f tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:09.573495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-34e46357-65a3-4835-b69b-6b794e7f0e22 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:09.584861 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34e46357-65a3-4835-b69b-6b794e7f0e22 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.453025 Aug 18 11:45:09.599771 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2335/4438] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:09 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:09.612661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7affb10-51e0-4082-b6c3-5e5735837529 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:09.619914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7affb10-51e0-4082-b6c3-5e5735837529 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:09.621282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7affb10-51e0-4082-b6c3-5e5735837529 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:09.621930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7affb10-51e0-4082-b6c3-5e5735837529 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:09.647865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e7affb10-51e0-4082-b6c3-5e5735837529 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Going to try to start instance {{(pid=122210) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 18 11:45:09.707442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:09.724244 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e7affb10-51e0-4082-b6c3-5e5735837529 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "POST /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/action" status: 202 len: 0 microversion: 2.1 time: 0.122257 Aug 18 11:45:09.726109 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2336/4439] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:09 2022] POST /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:45:09.734952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8e8e37e1-4c0a-4a92-a10c-366a1d2e3143 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:09.736571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8e8e37e1-4c0a-4a92-a10c-366a1d2e3143 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:09.750351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e8e37e1-4c0a-4a92-a10c-366a1d2e3143 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:09.751792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e8e37e1-4c0a-4a92-a10c-366a1d2e3143 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:09.754875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e8e37e1-4c0a-4a92-a10c-366a1d2e3143 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:09.756954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e8e37e1-4c0a-4a92-a10c-366a1d2e3143 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:09.759354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e8e37e1-4c0a-4a92-a10c-366a1d2e3143 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:09.761938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e8e37e1-4c0a-4a92-a10c-366a1d2e3143 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:10.000021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6afa52ef-6287-457e-bb8d-2650b1b5dc9f tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:10.009772 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6afa52ef-6287-457e-bb8d-2650b1b5dc9f tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1508 microversion: 2.1 time: 0.531378 Aug 18 11:45:10.010578 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2104/4440] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:09 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1508 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:10.016780 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e4a4eda8-bc80-4096-99d9-c5cd689f8a30 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:10.017899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e4a4eda8-bc80-4096-99d9-c5cd689f8a30 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:10.028574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4a4eda8-bc80-4096-99d9-c5cd689f8a30 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:10.029076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4a4eda8-bc80-4096-99d9-c5cd689f8a30 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:10.029545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4a4eda8-bc80-4096-99d9-c5cd689f8a30 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:10.030268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4a4eda8-bc80-4096-99d9-c5cd689f8a30 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:10.030787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4a4eda8-bc80-4096-99d9-c5cd689f8a30 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:10.031216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4a4eda8-bc80-4096-99d9-c5cd689f8a30 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:10.198287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8e8e37e1-4c0a-4a92-a10c-366a1d2e3143 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:10.206903 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8e8e37e1-4c0a-4a92-a10c-366a1d2e3143 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.478358 Aug 18 11:45:10.207714 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2337/4441] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:09 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:10.229043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-46ad307b-4d80-477d-ae22-4ebd0a94874a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:10.229210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-46ad307b-4d80-477d-ae22-4ebd0a94874a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:10.238403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46ad307b-4d80-477d-ae22-4ebd0a94874a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:10.238642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46ad307b-4d80-477d-ae22-4ebd0a94874a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:10.239083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46ad307b-4d80-477d-ae22-4ebd0a94874a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:10.239788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46ad307b-4d80-477d-ae22-4ebd0a94874a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:10.240243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46ad307b-4d80-477d-ae22-4ebd0a94874a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:10.240669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46ad307b-4d80-477d-ae22-4ebd0a94874a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:10.465410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-46ad307b-4d80-477d-ae22-4ebd0a94874a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:10.482899 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-46ad307b-4d80-477d-ae22-4ebd0a94874a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1266 microversion: 2.1 time: 0.262169 Aug 18 11:45:10.483582 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2338/4442] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:10 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:10.499064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5eee0043-2a34-4632-a22d-8fe65baeee0a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:10.506685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5eee0043-2a34-4632-a22d-8fe65baeee0a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 18 11:45:10.508299 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-5eee0043-2a34-4632-a22d-8fe65baeee0a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5eee0043-2a34-4632-a22d-8fe65baeee0a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 9223372036854775808 could not be found. Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '9223372036854775808'} Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:10.510777 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:10.515250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:10.515250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:10.515250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:10.515250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 18 11:45:10.515250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:10.518042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5eee0043-2a34-4632-a22d-8fe65baeee0a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:10.519840 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5eee0043-2a34-4632-a22d-8fe65baeee0a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.032835 Aug 18 11:45:10.520617 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2339/4443] 10.222.0.73 () {58 vars in 1188 bytes} [Thu Aug 18 11:45:10 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:45:10.533859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d832b1d6-850f-4907-9e3b-dbfbe1f6c637 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:10.539031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d832b1d6-850f-4907-9e3b-dbfbe1f6c637 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:10.553494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d832b1d6-850f-4907-9e3b-dbfbe1f6c637 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:10.558340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d832b1d6-850f-4907-9e3b-dbfbe1f6c637 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:10.559266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d832b1d6-850f-4907-9e3b-dbfbe1f6c637 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:10.560176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d832b1d6-850f-4907-9e3b-dbfbe1f6c637 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:10.561422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d832b1d6-850f-4907-9e3b-dbfbe1f6c637 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:10.562037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d832b1d6-850f-4907-9e3b-dbfbe1f6c637 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:10.759005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e4a4eda8-bc80-4096-99d9-c5cd689f8a30 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:10.771275 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e4a4eda8-bc80-4096-99d9-c5cd689f8a30 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1706 microversion: 2.1 time: 0.759347 Aug 18 11:45:10.777822 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2105/4444] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:10 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1706 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:11.033720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-de0d233a-e2ff-497d-b268-ece45de13713 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:11.038646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-de0d233a-e2ff-497d-b268-ece45de13713 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:11.062675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de0d233a-e2ff-497d-b268-ece45de13713 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:11.063608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de0d233a-e2ff-497d-b268-ece45de13713 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:11.066513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de0d233a-e2ff-497d-b268-ece45de13713 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:11.070032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de0d233a-e2ff-497d-b268-ece45de13713 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:11.072280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de0d233a-e2ff-497d-b268-ece45de13713 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:11.074462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de0d233a-e2ff-497d-b268-ece45de13713 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:11.555318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d832b1d6-850f-4907-9e3b-dbfbe1f6c637 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:11.580607 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d832b1d6-850f-4907-9e3b-dbfbe1f6c637 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 1.055417 Aug 18 11:45:11.589518 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2340/4445] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:10 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:45:11.597801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-75883344-0f90-4164-97ae-2f65e0e2c6e6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:11.598867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-75883344-0f90-4164-97ae-2f65e0e2c6e6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:11.613861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75883344-0f90-4164-97ae-2f65e0e2c6e6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:11.620705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75883344-0f90-4164-97ae-2f65e0e2c6e6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:11.621481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75883344-0f90-4164-97ae-2f65e0e2c6e6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:11.622468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75883344-0f90-4164-97ae-2f65e0e2c6e6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:11.623259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75883344-0f90-4164-97ae-2f65e0e2c6e6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:11.624012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75883344-0f90-4164-97ae-2f65e0e2c6e6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:11.766446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-75883344-0f90-4164-97ae-2f65e0e2c6e6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:11.774967 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-75883344-0f90-4164-97ae-2f65e0e2c6e6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1266 microversion: 2.1 time: 0.183828 Aug 18 11:45:11.781411 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2341/4446] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:11 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:11.805961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-57d79bd7-8cdd-40d5-aba6-c8d5f78ba4cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:11.812201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-57d79bd7-8cdd-40d5-aba6-c8d5f78ba4cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:11.824236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57d79bd7-8cdd-40d5-aba6-c8d5f78ba4cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:11.826138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57d79bd7-8cdd-40d5-aba6-c8d5f78ba4cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:11.829508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57d79bd7-8cdd-40d5-aba6-c8d5f78ba4cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:11.830728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57d79bd7-8cdd-40d5-aba6-c8d5f78ba4cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:11.831416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57d79bd7-8cdd-40d5-aba6-c8d5f78ba4cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:11.835000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57d79bd7-8cdd-40d5-aba6-c8d5f78ba4cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:12.472360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-de0d233a-e2ff-497d-b268-ece45de13713 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:12.483080 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-de0d233a-e2ff-497d-b268-ece45de13713 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1508 microversion: 2.1 time: 1.452924 Aug 18 11:45:12.484461 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2106/4447] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:11 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1508 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:45:12.493110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4dbcb8ef-413e-412b-b2aa-822c03c30261 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:12.495330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4dbcb8ef-413e-412b-b2aa-822c03c30261 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:12.524292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dbcb8ef-413e-412b-b2aa-822c03c30261 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:12.525566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dbcb8ef-413e-412b-b2aa-822c03c30261 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:12.526685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dbcb8ef-413e-412b-b2aa-822c03c30261 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:12.527686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dbcb8ef-413e-412b-b2aa-822c03c30261 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:12.528396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dbcb8ef-413e-412b-b2aa-822c03c30261 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:12.529048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4dbcb8ef-413e-412b-b2aa-822c03c30261 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:12.962809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-57d79bd7-8cdd-40d5-aba6-c8d5f78ba4cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:12.976227 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-57d79bd7-8cdd-40d5-aba6-c8d5f78ba4cf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 1.179738 Aug 18 11:45:12.990343 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2342/4448] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:11 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:12.997358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a7fa6a5-0b54-4db1-866f-f4e2cf44bbcf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:13.019328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4a7fa6a5-0b54-4db1-866f-f4e2cf44bbcf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:13.044415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7fa6a5-0b54-4db1-866f-f4e2cf44bbcf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:13.046843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7fa6a5-0b54-4db1-866f-f4e2cf44bbcf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:13.047416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7fa6a5-0b54-4db1-866f-f4e2cf44bbcf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:13.048274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7fa6a5-0b54-4db1-866f-f4e2cf44bbcf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:13.048858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7fa6a5-0b54-4db1-866f-f4e2cf44bbcf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:13.049404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7fa6a5-0b54-4db1-866f-f4e2cf44bbcf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:13.937386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4a7fa6a5-0b54-4db1-866f-f4e2cf44bbcf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:13.980222 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4a7fa6a5-0b54-4db1-866f-f4e2cf44bbcf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1308 microversion: 2.1 time: 0.987689 Aug 18 11:45:13.989468 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2343/4449] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:12 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1308 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:14.033838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a0877e4-8065-498d-9fea-5b1e8897eea2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:14.038766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4a0877e4-8065-498d-9fea-5b1e8897eea2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Failed to fetch instance by id -1 {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 18 11:45:14.040499 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-4a0877e4-8065-498d-9fea-5b1e8897eea2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance -1 could not be found. Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a0877e4-8065-498d-9fea-5b1e8897eea2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance -1 could not be found. Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '-1'} Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:14.045242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:14.052167 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:14.052167 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:14.052167 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 18 11:45:14.052167 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:14.062952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a0877e4-8065-498d-9fea-5b1e8897eea2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:14.065145 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4a0877e4-8065-498d-9fea-5b1e8897eea2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.059828 Aug 18 11:45:14.072494 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2344/4450] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:45:14 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:45:14.082162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-98149b37-bb60-46bb-812d-d8fc2b6cb3b4 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:14.083519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-98149b37-bb60-46bb-812d-d8fc2b6cb3b4 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:14.100609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98149b37-bb60-46bb-812d-d8fc2b6cb3b4 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:14.107442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98149b37-bb60-46bb-812d-d8fc2b6cb3b4 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:14.109047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98149b37-bb60-46bb-812d-d8fc2b6cb3b4 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:14.110681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98149b37-bb60-46bb-812d-d8fc2b6cb3b4 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:14.111812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98149b37-bb60-46bb-812d-d8fc2b6cb3b4 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:14.112988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98149b37-bb60-46bb-812d-d8fc2b6cb3b4 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:14.575760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4dbcb8ef-413e-412b-b2aa-822c03c30261 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:14.592936 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4dbcb8ef-413e-412b-b2aa-822c03c30261 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1706 microversion: 2.1 time: 2.106966 Aug 18 11:45:14.610330 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2107/4451] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:12 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1706 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:14.621082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-656ea541-3b5b-4cbb-a0a5-e43a333b147f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:14.625072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-656ea541-3b5b-4cbb-a0a5-e43a333b147f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:14.671972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-656ea541-3b5b-4cbb-a0a5-e43a333b147f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:14.674247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-656ea541-3b5b-4cbb-a0a5-e43a333b147f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:14.674958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-656ea541-3b5b-4cbb-a0a5-e43a333b147f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:14.675902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-656ea541-3b5b-4cbb-a0a5-e43a333b147f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:14.676542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-656ea541-3b5b-4cbb-a0a5-e43a333b147f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:14.677413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-656ea541-3b5b-4cbb-a0a5-e43a333b147f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:15.193966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-656ea541-3b5b-4cbb-a0a5-e43a333b147f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:15.213851 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-656ea541-3b5b-4cbb-a0a5-e43a333b147f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.602022 Aug 18 11:45:15.218868 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2108/4452] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:14 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:15.236906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-34e82f8f-cc3d-482d-9866-e3124d0916e9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:15.237821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-34e82f8f-cc3d-482d-9866-e3124d0916e9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:15.254271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34e82f8f-cc3d-482d-9866-e3124d0916e9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:15.255902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34e82f8f-cc3d-482d-9866-e3124d0916e9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:15.257505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34e82f8f-cc3d-482d-9866-e3124d0916e9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:15.261969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34e82f8f-cc3d-482d-9866-e3124d0916e9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:15.263251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34e82f8f-cc3d-482d-9866-e3124d0916e9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:15.266092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34e82f8f-cc3d-482d-9866-e3124d0916e9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:15.429957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-98149b37-bb60-46bb-812d-d8fc2b6cb3b4 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:15.446220 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-98149b37-bb60-46bb-812d-d8fc2b6cb3b4 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1506 microversion: 2.1 time: 1.371320 Aug 18 11:45:15.447048 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2345/4453] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:14 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1506 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:15.458044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f4b68a2-b370-4196-8474-f1b0beb5f332 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:15.470476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f4b68a2-b370-4196-8474-f1b0beb5f332 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:15.490906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f4b68a2-b370-4196-8474-f1b0beb5f332 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:15.492265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f4b68a2-b370-4196-8474-f1b0beb5f332 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:15.492709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f4b68a2-b370-4196-8474-f1b0beb5f332 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:15.495975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f4b68a2-b370-4196-8474-f1b0beb5f332 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:15.496833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f4b68a2-b370-4196-8474-f1b0beb5f332 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:15.497286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f4b68a2-b370-4196-8474-f1b0beb5f332 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:15.718229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-34e82f8f-cc3d-482d-9866-e3124d0916e9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:15.732131 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-34e82f8f-cc3d-482d-9866-e3124d0916e9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1308 microversion: 2.1 time: 0.511027 Aug 18 11:45:15.738013 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2109/4454] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:15 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1308 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:15.769175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-04fff899-80fe-4d54-ad70-691df6515f57 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '.version_select at 0x7f519ec6b040>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:15.772629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-04fff899-80fe-4d54-ad70-691df6515f57 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:15.779789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04fff899-80fe-4d54-ad70-691df6515f57 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:15.780704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04fff899-80fe-4d54-ad70-691df6515f57 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:15.781565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04fff899-80fe-4d54-ad70-691df6515f57 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:15.782378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04fff899-80fe-4d54-ad70-691df6515f57 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:15.783379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04fff899-80fe-4d54-ad70-691df6515f57 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:15.784018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04fff899-80fe-4d54-ad70-691df6515f57 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:15.847923 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-04fff899-80fe-4d54-ad70-691df6515f57 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.108506 Aug 18 11:45:15.848777 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2110/4455] 10.222.0.73 () {58 vars in 1296 bytes} [Thu Aug 18 11:45:15 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac/os-instance-actions => generated 611 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:45:15.856684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-af7f2296-039c-4ad8-9404-f49e5d5e0790 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:15.858034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-af7f2296-039c-4ad8-9404-f49e5d5e0790 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:15.867379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af7f2296-039c-4ad8-9404-f49e5d5e0790 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:15.868312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af7f2296-039c-4ad8-9404-f49e5d5e0790 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:15.868945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af7f2296-039c-4ad8-9404-f49e5d5e0790 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:15.870525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af7f2296-039c-4ad8-9404-f49e5d5e0790 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:15.871169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af7f2296-039c-4ad8-9404-f49e5d5e0790 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:15.871764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-af7f2296-039c-4ad8-9404-f49e5d5e0790 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:16.037170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2f4b68a2-b370-4196-8474-f1b0beb5f332 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:16.050196 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f4b68a2-b370-4196-8474-f1b0beb5f332 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.601330 Aug 18 11:45:16.050846 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2346/4456] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:15 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:16.064822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8af0088f-e157-4f36-a3e0-3d66b73e9740 req-b1fcadfa-9e0b-42f3-8761-77e35852b55c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a45926-b983-40e7-b9cf-16feec0fc37e", "tag": "4cb7522f-53c7-48dd-acda-7c716a3b5f76"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:16.097202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8af0088f-e157-4f36-a3e0-3d66b73e9740 req-b1fcadfa-9e0b-42f3-8761-77e35852b55c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:16.098043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8af0088f-e157-4f36-a3e0-3d66b73e9740 req-b1fcadfa-9e0b-42f3-8761-77e35852b55c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:16.098904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8af0088f-e157-4f36-a3e0-3d66b73e9740 req-b1fcadfa-9e0b-42f3-8761-77e35852b55c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:16.115736 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8af0088f-e157-4f36-a3e0-3d66b73e9740 req-b1fcadfa-9e0b-42f3-8761-77e35852b55c service nova] Creating event network-changed:4cb7522f-53c7-48dd-acda-7c716a3b5f76 for instance 95a45926-b983-40e7-b9cf-16feec0fc37e on n-h2-853611-3 Aug 18 11:45:16.125161 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8af0088f-e157-4f36-a3e0-3d66b73e9740 req-b1fcadfa-9e0b-42f3-8761-77e35852b55c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067378 Aug 18 11:45:16.126276 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2347/4457] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:45:16.131808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-079ca1c3-686e-41b2-841c-a14ba7a448ef tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:16.132543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-079ca1c3-686e-41b2-841c-a14ba7a448ef tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:16.150181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-079ca1c3-686e-41b2-841c-a14ba7a448ef tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:16.151796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-079ca1c3-686e-41b2-841c-a14ba7a448ef tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:16.152153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-079ca1c3-686e-41b2-841c-a14ba7a448ef tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:16.152895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-079ca1c3-686e-41b2-841c-a14ba7a448ef tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:16.153358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-079ca1c3-686e-41b2-841c-a14ba7a448ef tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:16.153789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-079ca1c3-686e-41b2-841c-a14ba7a448ef tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:16.195486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-079ca1c3-686e-41b2-841c-a14ba7a448ef tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:45:16.367210 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-079ca1c3-686e-41b2-841c-a14ba7a448ef tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "DELETE /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 204 len: 0 microversion: 2.1 time: 0.238056 Aug 18 11:45:16.379336 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2348/4458] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:45:16 2022] DELETE /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:45:16.394395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7a36663e-0904-45f8-8cfb-d8f47717f499 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:16.395569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7a36663e-0904-45f8-8cfb-d8f47717f499 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 00643a24-6a0a-4cd6-b65d-170da2f072db] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:16.405247 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-7a36663e-0904-45f8-8cfb-d8f47717f499 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance 00643a24-6a0a-4cd6-b65d-170da2f072db could not be found. Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7a36663e-0904-45f8-8cfb-d8f47717f499 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/00643a24-6a0a-4cd6-b65d-170da2f072db/action HTTP/1.1 Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 19 Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: {"forceDelete": {}} Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 00643a24-6a0a-4cd6-b65d-170da2f072db could not be found. Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '00643a24-6a0a-4cd6-b65d-170da2f072db', 'body': {'forceDelete': {}}} Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00643a24-6a0a-4cd6-b65d-170da2f072db could not be found. Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00643a24-6a0a-4cd6-b65d-170da2f072db could not be found. Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:16.415079 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:16.430961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:16.430961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:16.430961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00643a24-6a0a-4cd6-b65d-170da2f072db could not be found. Aug 18 11:45:16.430961 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:16.434781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7a36663e-0904-45f8-8cfb-d8f47717f499 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance 00643a24-6a0a-4cd6-b65d-170da2f072db could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:16.436526 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7a36663e-0904-45f8-8cfb-d8f47717f499 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/00643a24-6a0a-4cd6-b65d-170da2f072db/action" status: 404 len: 111 microversion: 2.1 time: 0.048779 Aug 18 11:45:16.441494 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2349/4459] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:16 2022] POST /compute/v2.1/servers/00643a24-6a0a-4cd6-b65d-170da2f072db/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:45:16.447936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a2f6ffcf-f679-482e-9499-efe6cd69180c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:16.448970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a2f6ffcf-f679-482e-9499-efe6cd69180c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:16.459107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:16.468429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2f6ffcf-f679-482e-9499-efe6cd69180c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:16.469818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2f6ffcf-f679-482e-9499-efe6cd69180c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:16.471052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2f6ffcf-f679-482e-9499-efe6cd69180c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:16.473174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2f6ffcf-f679-482e-9499-efe6cd69180c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:16.474296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2f6ffcf-f679-482e-9499-efe6cd69180c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:16.475084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2f6ffcf-f679-482e-9499-efe6cd69180c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:16.491558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-af7f2296-039c-4ad8-9404-f49e5d5e0790 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:16.504953 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-af7f2296-039c-4ad8-9404-f49e5d5e0790 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1710 microversion: 2.1 time: 0.654939 Aug 18 11:45:16.516233 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2111/4460] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:15 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1710 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:16.537387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-66c5989d-791f-4ed1-a98e-dd3a3e5fac66 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:16.538015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-66c5989d-791f-4ed1-a98e-dd3a3e5fac66 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:16.539941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:16.559840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66c5989d-791f-4ed1-a98e-dd3a3e5fac66 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:16.560868 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66c5989d-791f-4ed1-a98e-dd3a3e5fac66 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:16.561319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66c5989d-791f-4ed1-a98e-dd3a3e5fac66 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:16.562026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66c5989d-791f-4ed1-a98e-dd3a3e5fac66 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:16.562679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66c5989d-791f-4ed1-a98e-dd3a3e5fac66 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:16.563280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-66c5989d-791f-4ed1-a98e-dd3a3e5fac66 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:16.829162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a2f6ffcf-f679-482e-9499-efe6cd69180c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:16.839553 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a2f6ffcf-f679-482e-9499-efe6cd69180c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1512 microversion: 2.1 time: 0.396234 Aug 18 11:45:16.842959 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2350/4461] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:16 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:16.849707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-30b2dc48-d475-434f-ab5f-c506d7aea63b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:16.850338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-30b2dc48-d475-434f-ab5f-c506d7aea63b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:16.869575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30b2dc48-d475-434f-ab5f-c506d7aea63b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:16.871575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30b2dc48-d475-434f-ab5f-c506d7aea63b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:16.874070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30b2dc48-d475-434f-ab5f-c506d7aea63b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:16.875664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30b2dc48-d475-434f-ab5f-c506d7aea63b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:16.878452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30b2dc48-d475-434f-ab5f-c506d7aea63b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:16.878918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30b2dc48-d475-434f-ab5f-c506d7aea63b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:16.971243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-66c5989d-791f-4ed1-a98e-dd3a3e5fac66 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:16.983693 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-66c5989d-791f-4ed1-a98e-dd3a3e5fac66 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.450382 Aug 18 11:45:16.984733 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2112/4462] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:16 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:17.011136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-38899ee8-ce79-4ec5-be5c-e2873a46c6ec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:17.012329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-38899ee8-ce79-4ec5-be5c-e2873a46c6ec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:17.039179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38899ee8-ce79-4ec5-be5c-e2873a46c6ec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:17.039712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38899ee8-ce79-4ec5-be5c-e2873a46c6ec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:17.040159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38899ee8-ce79-4ec5-be5c-e2873a46c6ec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:17.040877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38899ee8-ce79-4ec5-be5c-e2873a46c6ec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:17.043582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38899ee8-ce79-4ec5-be5c-e2873a46c6ec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:17.045193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38899ee8-ce79-4ec5-be5c-e2873a46c6ec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:17.341210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-30b2dc48-d475-434f-ab5f-c506d7aea63b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:17.391320 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-30b2dc48-d475-434f-ab5f-c506d7aea63b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1308 microversion: 2.1 time: 0.543815 Aug 18 11:45:17.394146 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2351/4463] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:16 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:17.528074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-38899ee8-ce79-4ec5-be5c-e2873a46c6ec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:17.543170 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-38899ee8-ce79-4ec5-be5c-e2873a46c6ec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.531604 Aug 18 11:45:17.545515 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2113/4464] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:17 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:45:17.571570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-088b9227-95d4-4fd9-a1d6-8599cd0378fa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:17.584882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-088b9227-95d4-4fd9-a1d6-8599cd0378fa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: f5e008ff-4e0c-4dc6-bf3f-1d0621604ded] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:17.617084 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-088b9227-95d4-4fd9-a1d6-8599cd0378fa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance f5e008ff-4e0c-4dc6-bf3f-1d0621604ded could not be found. Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-088b9227-95d4-4fd9-a1d6-8599cd0378fa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/f5e008ff-4e0c-4dc6-bf3f-1d0621604ded/action HTTP/1.1 Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 39 Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: {"os-getConsoleOutput": {"length": 10}} Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance f5e008ff-4e0c-4dc6-bf3f-1d0621604ded could not be found. Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'f5e008ff-4e0c-4dc6-bf3f-1d0621604ded', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e008ff-4e0c-4dc6-bf3f-1d0621604ded could not be found. Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e008ff-4e0c-4dc6-bf3f-1d0621604ded could not be found. Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:17.632298 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:17.635928 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:17.635928 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:17.635928 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:17.635928 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:17.635928 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e008ff-4e0c-4dc6-bf3f-1d0621604ded could not be found. Aug 18 11:45:17.635928 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:17.635928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-088b9227-95d4-4fd9-a1d6-8599cd0378fa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance f5e008ff-4e0c-4dc6-bf3f-1d0621604ded could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:17.635928 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-088b9227-95d4-4fd9-a1d6-8599cd0378fa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/f5e008ff-4e0c-4dc6-bf3f-1d0621604ded/action" status: 404 len: 111 microversion: 2.1 time: 0.072528 Aug 18 11:45:17.643253 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2352/4465] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:17 2022] POST /compute/v2.1/servers/f5e008ff-4e0c-4dc6-bf3f-1d0621604ded/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:45:17.651605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3d327fa6-776c-4557-ab4c-8136d1b01f09 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:17.652546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3d327fa6-776c-4557-ab4c-8136d1b01f09 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:17.663314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d327fa6-776c-4557-ab4c-8136d1b01f09 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:17.666282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d327fa6-776c-4557-ab4c-8136d1b01f09 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:17.667246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d327fa6-776c-4557-ab4c-8136d1b01f09 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:17.670364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d327fa6-776c-4557-ab4c-8136d1b01f09 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:17.671133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d327fa6-776c-4557-ab4c-8136d1b01f09 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:17.671783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3d327fa6-776c-4557-ab4c-8136d1b01f09 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:17.906730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b1504cf3-20b0-4bfb-8335-b088bb78a77c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:17.907905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b1504cf3-20b0-4bfb-8335-b088bb78a77c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:17.953209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1504cf3-20b0-4bfb-8335-b088bb78a77c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:17.953716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1504cf3-20b0-4bfb-8335-b088bb78a77c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:17.954168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1504cf3-20b0-4bfb-8335-b088bb78a77c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:17.954937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1504cf3-20b0-4bfb-8335-b088bb78a77c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:17.955522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1504cf3-20b0-4bfb-8335-b088bb78a77c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:17.956129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1504cf3-20b0-4bfb-8335-b088bb78a77c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:18.458704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b1504cf3-20b0-4bfb-8335-b088bb78a77c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:18.467923 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b1504cf3-20b0-4bfb-8335-b088bb78a77c tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1512 microversion: 2.1 time: 0.593019 Aug 18 11:45:18.471145 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2353/4466] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:17 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1512 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:18.485581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2c995859-fa7b-43e6-8a7d-d3464f96f0fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:18.489058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2c995859-fa7b-43e6-8a7d-d3464f96f0fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:18.508157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c995859-fa7b-43e6-8a7d-d3464f96f0fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:18.516504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c995859-fa7b-43e6-8a7d-d3464f96f0fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:18.517870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c995859-fa7b-43e6-8a7d-d3464f96f0fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:18.522279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c995859-fa7b-43e6-8a7d-d3464f96f0fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:18.523619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c995859-fa7b-43e6-8a7d-d3464f96f0fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:18.524366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c995859-fa7b-43e6-8a7d-d3464f96f0fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:18.681984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3d327fa6-776c-4557-ab4c-8136d1b01f09 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:18.697768 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3d327fa6-776c-4557-ab4c-8136d1b01f09 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 1.045102 Aug 18 11:45:18.699493 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2114/4467] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:17 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:18.726629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8e5a6da1-a1c9-45d7-b00d-5332eea3fc04 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:18.728459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8e5a6da1-a1c9-45d7-b00d-5332eea3fc04 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:18.737353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e5a6da1-a1c9-45d7-b00d-5332eea3fc04 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:18.737960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e5a6da1-a1c9-45d7-b00d-5332eea3fc04 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:18.738889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e5a6da1-a1c9-45d7-b00d-5332eea3fc04 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:18.739703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e5a6da1-a1c9-45d7-b00d-5332eea3fc04 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:18.740245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e5a6da1-a1c9-45d7-b00d-5332eea3fc04 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:18.741829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8e5a6da1-a1c9-45d7-b00d-5332eea3fc04 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:18.780862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:18.837690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2c995859-fa7b-43e6-8a7d-d3464f96f0fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:18.858829 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2c995859-fa7b-43e6-8a7d-d3464f96f0fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1308 microversion: 2.1 time: 0.386434 Aug 18 11:45:18.865011 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2354/4468] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:18 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1308 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:19.270861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8e5a6da1-a1c9-45d7-b00d-5332eea3fc04 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:19.280048 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8e5a6da1-a1c9-45d7-b00d-5332eea3fc04 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.559142 Aug 18 11:45:19.280872 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2115/4469] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:18 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:19.304251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a54eb95a-c157-41fa-ac36-02439a2e73be tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:19.304885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a54eb95a-c157-41fa-ac36-02439a2e73be tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: d180d034-1347-4423-a1f1-64a3e784cb20] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:19.316938 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-a54eb95a-c157-41fa-ac36-02439a2e73be tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance d180d034-1347-4423-a1f1-64a3e784cb20 could not be found. Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a54eb95a-c157-41fa-ac36-02439a2e73be tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/d180d034-1347-4423-a1f1-64a3e784cb20 HTTP/1.1 Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance d180d034-1347-4423-a1f1-64a3e784cb20 could not be found. Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'd180d034-1347-4423-a1f1-64a3e784cb20'} Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d180d034-1347-4423-a1f1-64a3e784cb20 could not be found. Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d180d034-1347-4423-a1f1-64a3e784cb20 could not be found. Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:19.318861 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:19.323048 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:19.323048 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:19.323048 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:19.323048 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d180d034-1347-4423-a1f1-64a3e784cb20 could not be found. Aug 18 11:45:19.323048 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:19.330041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a54eb95a-c157-41fa-ac36-02439a2e73be tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance d180d034-1347-4423-a1f1-64a3e784cb20 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:19.334099 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a54eb95a-c157-41fa-ac36-02439a2e73be tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/d180d034-1347-4423-a1f1-64a3e784cb20" status: 404 len: 111 microversion: 2.1 time: 0.033781 Aug 18 11:45:19.342639 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2355/4470] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:19 2022] GET /compute/v2.1/servers/d180d034-1347-4423-a1f1-64a3e784cb20 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:45:19.349983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0f5f7538-ed3a-43d9-8f2a-493e44fe5a52 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:19.356905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0f5f7538-ed3a-43d9-8f2a-493e44fe5a52 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:19.378180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f5f7538-ed3a-43d9-8f2a-493e44fe5a52 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:19.379016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f5f7538-ed3a-43d9-8f2a-493e44fe5a52 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:19.379736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f5f7538-ed3a-43d9-8f2a-493e44fe5a52 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:19.382774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f5f7538-ed3a-43d9-8f2a-493e44fe5a52 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:19.383510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f5f7538-ed3a-43d9-8f2a-493e44fe5a52 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:19.384159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0f5f7538-ed3a-43d9-8f2a-493e44fe5a52 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:19.503144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-992d9959-7301-433d-bfc1-670ff723e7cc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:19.504277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-992d9959-7301-433d-bfc1-670ff723e7cc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:19.515295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-992d9959-7301-433d-bfc1-670ff723e7cc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:19.516127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-992d9959-7301-433d-bfc1-670ff723e7cc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:19.518808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-992d9959-7301-433d-bfc1-670ff723e7cc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:19.525373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-992d9959-7301-433d-bfc1-670ff723e7cc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:19.526999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-992d9959-7301-433d-bfc1-670ff723e7cc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:19.527630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-992d9959-7301-433d-bfc1-670ff723e7cc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:19.801812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0f5f7538-ed3a-43d9-8f2a-493e44fe5a52 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:19.806325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-992d9959-7301-433d-bfc1-670ff723e7cc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:19.816394 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0f5f7538-ed3a-43d9-8f2a-493e44fe5a52 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.474002 Aug 18 11:45:19.817987 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2116/4471] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:19 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:19.820237 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-992d9959-7301-433d-bfc1-670ff723e7cc tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1512 microversion: 2.1 time: 0.330310 Aug 18 11:45:19.837807 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2356/4472] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:19 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1512 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:19.843771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e635d4bb-4c3b-476d-a463-b07b548190fc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:19.844401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e635d4bb-4c3b-476d-a463-b07b548190fc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:19.863225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e635d4bb-4c3b-476d-a463-b07b548190fc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:19.867743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e635d4bb-4c3b-476d-a463-b07b548190fc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:19.868541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e635d4bb-4c3b-476d-a463-b07b548190fc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:19.870077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e635d4bb-4c3b-476d-a463-b07b548190fc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:19.871578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e635d4bb-4c3b-476d-a463-b07b548190fc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:19.873501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e635d4bb-4c3b-476d-a463-b07b548190fc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:19.891591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-65952d1c-8e06-4321-bcc2-4b48459f4cef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:19.892492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-65952d1c-8e06-4321-bcc2-4b48459f4cef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:19.908160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65952d1c-8e06-4321-bcc2-4b48459f4cef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:19.908949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65952d1c-8e06-4321-bcc2-4b48459f4cef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:19.910055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65952d1c-8e06-4321-bcc2-4b48459f4cef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:19.912474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65952d1c-8e06-4321-bcc2-4b48459f4cef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:19.913131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65952d1c-8e06-4321-bcc2-4b48459f4cef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:19.914209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65952d1c-8e06-4321-bcc2-4b48459f4cef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:19.959689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:20.209194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-65952d1c-8e06-4321-bcc2-4b48459f4cef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:20.219584 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-65952d1c-8e06-4321-bcc2-4b48459f4cef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1308 microversion: 2.1 time: 0.333929 Aug 18 11:45:20.223087 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2357/4473] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:19 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:45:20.850594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-97f0bc94-7187-4fb3-abb9-fff41adc85e5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:20.851262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-97f0bc94-7187-4fb3-abb9-fff41adc85e5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:20.861588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97f0bc94-7187-4fb3-abb9-fff41adc85e5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:20.862097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97f0bc94-7187-4fb3-abb9-fff41adc85e5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:20.862589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97f0bc94-7187-4fb3-abb9-fff41adc85e5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:20.869859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97f0bc94-7187-4fb3-abb9-fff41adc85e5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:20.870791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97f0bc94-7187-4fb3-abb9-fff41adc85e5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:20.874079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97f0bc94-7187-4fb3-abb9-fff41adc85e5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:20.883417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e635d4bb-4c3b-476d-a463-b07b548190fc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:20.893417 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e635d4bb-4c3b-476d-a463-b07b548190fc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 1.054053 Aug 18 11:45:20.919146 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2117/4474] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:19 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:21.117200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-97f0bc94-7187-4fb3-abb9-fff41adc85e5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:21.142028 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-97f0bc94-7187-4fb3-abb9-fff41adc85e5 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1470 microversion: 2.1 time: 0.283991 Aug 18 11:45:21.154480 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2358/4475] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:20 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1470 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:21.246848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-34543d68-fb37-4e00-805c-a76a58eda737 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1102616173", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:21.256531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2c81ca88-3518-41f1-bbed-13bb48fa4ca2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:21.257511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2c81ca88-3518-41f1-bbed-13bb48fa4ca2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-34543d68-fb37-4e00-805c-a76a58eda737 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 238 Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1102616173", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1102616173', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'c201add2-2905-4a42-a119-5f0f7b3c5bb7'}]}}} Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:21.266347 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-34543d68-fb37-4e00-805c-a76a58eda737 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:21.270974 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-34543d68-fb37-4e00-805c-a76a58eda737 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.026052 Aug 18 11:45:21.274642 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2118/4476] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:21 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:45:21.274783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c81ca88-3518-41f1-bbed-13bb48fa4ca2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:21.274783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c81ca88-3518-41f1-bbed-13bb48fa4ca2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:21.276851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c81ca88-3518-41f1-bbed-13bb48fa4ca2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:21.276851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c81ca88-3518-41f1-bbed-13bb48fa4ca2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:21.276851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c81ca88-3518-41f1-bbed-13bb48fa4ca2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:21.276851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c81ca88-3518-41f1-bbed-13bb48fa4ca2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:21.279124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0b22eaab-b1f3-4271-b75c-f06d9f762cca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:21.279724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0b22eaab-b1f3-4271-b75c-f06d9f762cca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:21.310411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b22eaab-b1f3-4271-b75c-f06d9f762cca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:21.311053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b22eaab-b1f3-4271-b75c-f06d9f762cca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:21.311511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b22eaab-b1f3-4271-b75c-f06d9f762cca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:21.312440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b22eaab-b1f3-4271-b75c-f06d9f762cca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:21.312704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b22eaab-b1f3-4271-b75c-f06d9f762cca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:21.313133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b22eaab-b1f3-4271-b75c-f06d9f762cca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:21.899009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0b22eaab-b1f3-4271-b75c-f06d9f762cca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:21.938166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2c81ca88-3518-41f1-bbed-13bb48fa4ca2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:21.998277 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0b22eaab-b1f3-4271-b75c-f06d9f762cca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.723481 Aug 18 11:45:22.000882 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2c81ca88-3518-41f1-bbed-13bb48fa4ca2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1308 microversion: 2.1 time: 0.744749 Aug 18 11:45:22.016710 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2119/4477] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:21 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:22.039624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-77e4990b-e9d2-40fc-a07b-cb8d1eb2b9bf req-2bab8894-b54e-45d2-bed2-77f20daf44d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "369c24ec-e260-4e7a-b831-9f8b5ce7b0ac", "name": "network-vif-deleted", "tag": "08ceaca9-08e2-4516-9407-f98fea48546d"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:22.052861 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2359/4478] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:21 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1308 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:45:22.076057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-77e4990b-e9d2-40fc-a07b-cb8d1eb2b9bf req-2bab8894-b54e-45d2-bed2-77f20daf44d1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:22.078813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-77e4990b-e9d2-40fc-a07b-cb8d1eb2b9bf req-2bab8894-b54e-45d2-bed2-77f20daf44d1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:22.079455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-77e4990b-e9d2-40fc-a07b-cb8d1eb2b9bf req-2bab8894-b54e-45d2-bed2-77f20daf44d1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:22.089735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d9cd1cd2-d183-4bd4-9dc3-5ad4dbf043ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:22.092095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d9cd1cd2-d183-4bd4-9dc3-5ad4dbf043ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:22.103407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9cd1cd2-d183-4bd4-9dc3-5ad4dbf043ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:22.104451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9cd1cd2-d183-4bd4-9dc3-5ad4dbf043ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:22.105203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9cd1cd2-d183-4bd4-9dc3-5ad4dbf043ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:22.108184 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-77e4990b-e9d2-40fc-a07b-cb8d1eb2b9bf req-2bab8894-b54e-45d2-bed2-77f20daf44d1 service nova] Creating event network-vif-deleted:08ceaca9-08e2-4516-9407-f98fea48546d for instance 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac on n-h2-853611-3 Aug 18 11:45:22.122275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9cd1cd2-d183-4bd4-9dc3-5ad4dbf043ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:22.124127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9cd1cd2-d183-4bd4-9dc3-5ad4dbf043ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:22.124725 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-77e4990b-e9d2-40fc-a07b-cb8d1eb2b9bf req-2bab8894-b54e-45d2-bed2-77f20daf44d1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101750 Aug 18 11:45:22.125692 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2120/4479] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:45:22.126962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9cd1cd2-d183-4bd4-9dc3-5ad4dbf043ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:22.170525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5391e00b-8b6e-4ab5-befe-a9c2a81fd133 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:22.171383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5391e00b-8b6e-4ab5-befe-a9c2a81fd133 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:22.189865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5391e00b-8b6e-4ab5-befe-a9c2a81fd133 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:22.190361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5391e00b-8b6e-4ab5-befe-a9c2a81fd133 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:22.191082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5391e00b-8b6e-4ab5-befe-a9c2a81fd133 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:22.192732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5391e00b-8b6e-4ab5-befe-a9c2a81fd133 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:22.194537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5391e00b-8b6e-4ab5-befe-a9c2a81fd133 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:22.196759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5391e00b-8b6e-4ab5-befe-a9c2a81fd133 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:22.290852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5391e00b-8b6e-4ab5-befe-a9c2a81fd133 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:22.291100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5391e00b-8b6e-4ab5-befe-a9c2a81fd133 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:22.295476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5391e00b-8b6e-4ab5-befe-a9c2a81fd133 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:22.297242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-5391e00b-8b6e-4ab5-befe-a9c2a81fd133 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lazy-loading 'fault' on Instance uuid 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:45:22.398358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5391e00b-8b6e-4ab5-befe-a9c2a81fd133 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba7e608da6954bb382a16c7a0a8b815b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96148bf9816d48769bbd0a4bff8db115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:22.410234 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5391e00b-8b6e-4ab5-befe-a9c2a81fd133 tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 200 len: 1307 microversion: 2.1 time: 0.247066 Aug 18 11:45:22.413307 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2121/4480] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:22 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 1307 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:23.026136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d801395f-1c18-4f39-acfa-4a646df4b757 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:23.026789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d801395f-1c18-4f39-acfa-4a646df4b757 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:23.041139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d801395f-1c18-4f39-acfa-4a646df4b757 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:23.041895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d801395f-1c18-4f39-acfa-4a646df4b757 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:23.042374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d9cd1cd2-d183-4bd4-9dc3-5ad4dbf043ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:23.043143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d801395f-1c18-4f39-acfa-4a646df4b757 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:23.044829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d801395f-1c18-4f39-acfa-4a646df4b757 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:23.045795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d801395f-1c18-4f39-acfa-4a646df4b757 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:23.046754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d801395f-1c18-4f39-acfa-4a646df4b757 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:23.053267 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d9cd1cd2-d183-4bd4-9dc3-5ad4dbf043ca tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.998922 Aug 18 11:45:23.054413 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2360/4481] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:22 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:23.148041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c6a1a32-0638-4217-99f3-17faea637305 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1260120728", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c6a1a32-0638-4217-99f3-17faea637305 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 235 Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1260120728", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1260120728', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'c201add2-2905-4a42-a119-5f0f7b3c5bb7'}]}}} Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:23.156947 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 18 11:45:23.162781 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:23.167943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c6a1a32-0638-4217-99f3-17faea637305 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:23.169843 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c6a1a32-0638-4217-99f3-17faea637305 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.026005 Aug 18 11:45:23.171365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2361/4482] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:23 2022] POST /compute/v2.1/servers => generated 133 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:45:23.180512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9961ce18-a647-4946-80a3-1ba2bd5d1f6c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:23.182417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9961ce18-a647-4946-80a3-1ba2bd5d1f6c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:23.222119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9961ce18-a647-4946-80a3-1ba2bd5d1f6c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:23.223279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9961ce18-a647-4946-80a3-1ba2bd5d1f6c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:23.223984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9961ce18-a647-4946-80a3-1ba2bd5d1f6c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:23.231566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9961ce18-a647-4946-80a3-1ba2bd5d1f6c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:23.233224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9961ce18-a647-4946-80a3-1ba2bd5d1f6c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:23.234093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9961ce18-a647-4946-80a3-1ba2bd5d1f6c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:23.648482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9961ce18-a647-4946-80a3-1ba2bd5d1f6c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:23.668708 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9961ce18-a647-4946-80a3-1ba2bd5d1f6c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.488367 Aug 18 11:45:23.674888 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2362/4483] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:23 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:45:23.687785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a36a5d8a-66df-4a6d-ac54-ca6a1d96b2ce tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:23.690609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a36a5d8a-66df-4a6d-ac54-ca6a1d96b2ce tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] [instance: 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:23.728857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a36a5d8a-66df-4a6d-ac54-ca6a1d96b2ce tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:23.730061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a36a5d8a-66df-4a6d-ac54-ca6a1d96b2ce tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:23.732522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a36a5d8a-66df-4a6d-ac54-ca6a1d96b2ce tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:23.739583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a36a5d8a-66df-4a6d-ac54-ca6a1d96b2ce tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:23.741197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a36a5d8a-66df-4a6d-ac54-ca6a1d96b2ce tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:23.741903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a36a5d8a-66df-4a6d-ac54-ca6a1d96b2ce tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:23.800900 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-a36a5d8a-66df-4a6d-ac54-ca6a1d96b2ce tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] HTTP exception thrown: Instance 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac could not be found. Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a36a5d8a-66df-4a6d-ac54-ca6a1d96b2ce tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Request method failure captured: Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac HTTP/1.1 Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYr5UL23h2rCT0bzksW3Y6mOujVEvqgIMKBf-2lJ6WZJmtprYEcIRHbR3yBjd19ZCTDpAMeHy9x4GlCXZ7rOvb4LGN_gzZ0MX54TgqwV3FSXwX6V_1ki3kL4UEdIIeMmNbLPjXPRe-jls4Zm2oXCfNhk4rz6lWfXv5TulqfxYwyNyk Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 96148bf9816d48769bbd0a4bff8db115 Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-InstanceActionsTestJSON-2015997987 Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/96148bf9816d48769bbd0a4bff8db115"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/96148bf9816d48769bbd0a4bff8db115"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_96148bf9816d48769bbd0a4bff8db115"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/96148bf9816d48769bbd0a4bff8db115"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-InstanceActionsTestJSON-2015997987 Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 96148bf9816d48769bbd0a4bff8db115 Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2015997987 Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-InstanceActionsTestJSON-2015997987-project Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ba7e608da6954bb382a16c7a0a8b815b Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-InstanceActionsTestJSON-2015997987-project Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac could not be found. Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '369c24ec-e260-4e7a-b831-9f8b5ce7b0ac'} Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac could not be found. Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac could not be found. Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:23.803293 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:23.806971 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:23.806971 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:23.806971 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:23.806971 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:23.806971 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:23.806971 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac could not be found. Aug 18 11:45:23.806971 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:23.815631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a36a5d8a-66df-4a6d-ac54-ca6a1d96b2ce tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] Returning 404 to user: Instance 369c24ec-e260-4e7a-b831-9f8b5ce7b0ac could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:23.816816 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a36a5d8a-66df-4a6d-ac54-ca6a1d96b2ce tempest-InstanceActionsTestJSON-2015997987 tempest-InstanceActionsTestJSON-2015997987-project] 10.222.0.73 "GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac" status: 404 len: 111 microversion: 2.1 time: 0.140159 Aug 18 11:45:23.832880 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2363/4484] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:23 2022] GET /compute/v2.1/servers/369c24ec-e260-4e7a-b831-9f8b5ce7b0ac => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:45:23.838203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a11f7ae-0e24-476e-b38c-9b3c33298f26 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:23.846056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a11f7ae-0e24-476e-b38c-9b3c33298f26 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:23.858188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d801395f-1c18-4f39-acfa-4a646df4b757 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:23.866903 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d801395f-1c18-4f39-acfa-4a646df4b757 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1308 microversion: 2.1 time: 0.845180 Aug 18 11:45:23.867523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a11f7ae-0e24-476e-b38c-9b3c33298f26 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:23.871007 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2122/4485] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:23 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1308 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:23.872640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a11f7ae-0e24-476e-b38c-9b3c33298f26 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:23.874453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a11f7ae-0e24-476e-b38c-9b3c33298f26 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:23.875647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a11f7ae-0e24-476e-b38c-9b3c33298f26 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:23.879872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a11f7ae-0e24-476e-b38c-9b3c33298f26 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:23.880613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a11f7ae-0e24-476e-b38c-9b3c33298f26 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:24.449428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a11f7ae-0e24-476e-b38c-9b3c33298f26 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:24.475950 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a11f7ae-0e24-476e-b38c-9b3c33298f26 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.641371 Aug 18 11:45:24.476573 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2364/4486] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:23 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:24.496816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3af95e76-a955-445c-9cb5-6986470ea592 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:24.498018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3af95e76-a955-445c-9cb5-6986470ea592 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 8e548ff8-569c-4641-911a-cb6779c9e0a2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:24.504820 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-3af95e76-a955-445c-9cb5-6986470ea592 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance 8e548ff8-569c-4641-911a-cb6779c9e0a2 could not be found. Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3af95e76-a955-445c-9cb5-6986470ea592 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/8e548ff8-569c-4641-911a-cb6779c9e0a2/action HTTP/1.1 Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 13 Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: {"pause": {}} Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 8e548ff8-569c-4641-911a-cb6779c9e0a2 could not be found. Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '8e548ff8-569c-4641-911a-cb6779c9e0a2', 'body': {'pause': {}}} Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e548ff8-569c-4641-911a-cb6779c9e0a2 could not be found. Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e548ff8-569c-4641-911a-cb6779c9e0a2 could not be found. Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:24.514824 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:24.521298 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:24.521298 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:24.521298 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e548ff8-569c-4641-911a-cb6779c9e0a2 could not be found. Aug 18 11:45:24.521298 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:24.521298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3af95e76-a955-445c-9cb5-6986470ea592 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance 8e548ff8-569c-4641-911a-cb6779c9e0a2 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:24.521298 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3af95e76-a955-445c-9cb5-6986470ea592 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/8e548ff8-569c-4641-911a-cb6779c9e0a2/action" status: 404 len: 111 microversion: 2.1 time: 0.023710 Aug 18 11:45:24.521298 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2123/4487] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:24 2022] POST /compute/v2.1/servers/8e548ff8-569c-4641-911a-cb6779c9e0a2/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:45:24.531237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5400fac0-bbfd-4f64-aef3-7a85219314b0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:24.532228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5400fac0-bbfd-4f64-aef3-7a85219314b0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:24.542218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5400fac0-bbfd-4f64-aef3-7a85219314b0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:24.543561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5400fac0-bbfd-4f64-aef3-7a85219314b0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:24.544944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5400fac0-bbfd-4f64-aef3-7a85219314b0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:24.545692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5400fac0-bbfd-4f64-aef3-7a85219314b0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:24.546626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5400fac0-bbfd-4f64-aef3-7a85219314b0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:24.547222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5400fac0-bbfd-4f64-aef3-7a85219314b0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:24.880695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5400fac0-bbfd-4f64-aef3-7a85219314b0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:24.893006 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5400fac0-bbfd-4f64-aef3-7a85219314b0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.367750 Aug 18 11:45:24.900101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e3b43ee9-1156-4cc8-b77f-3a7c75739ec9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:24.901853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e3b43ee9-1156-4cc8-b77f-3a7c75739ec9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:24.910911 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2365/4488] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:24 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:24.921628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0dd72c30-b111-42c1-b6a1-0a9562b7d438 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:24.922624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0dd72c30-b111-42c1-b6a1-0a9562b7d438 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:24.929500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dd72c30-b111-42c1-b6a1-0a9562b7d438 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:24.930250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dd72c30-b111-42c1-b6a1-0a9562b7d438 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:24.931019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dd72c30-b111-42c1-b6a1-0a9562b7d438 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:24.932054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dd72c30-b111-42c1-b6a1-0a9562b7d438 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:24.932734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dd72c30-b111-42c1-b6a1-0a9562b7d438 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:24.933374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dd72c30-b111-42c1-b6a1-0a9562b7d438 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:24.948773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3b43ee9-1156-4cc8-b77f-3a7c75739ec9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:24.949358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3b43ee9-1156-4cc8-b77f-3a7c75739ec9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:24.949807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3b43ee9-1156-4cc8-b77f-3a7c75739ec9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:24.951428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3b43ee9-1156-4cc8-b77f-3a7c75739ec9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:24.951969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3b43ee9-1156-4cc8-b77f-3a7c75739ec9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:24.952410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e3b43ee9-1156-4cc8-b77f-3a7c75739ec9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:25.316170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0dd72c30-b111-42c1-b6a1-0a9562b7d438 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:25.330755 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0dd72c30-b111-42c1-b6a1-0a9562b7d438 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.407900 Aug 18 11:45:25.331600 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2366/4489] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:24 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:45:25.352316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-87e3362c-1f8f-4225-8a6b-d603b8b65cd3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:25.353224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-87e3362c-1f8f-4225-8a6b-d603b8b65cd3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:25.359964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87e3362c-1f8f-4225-8a6b-d603b8b65cd3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:25.362631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87e3362c-1f8f-4225-8a6b-d603b8b65cd3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:25.363267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87e3362c-1f8f-4225-8a6b-d603b8b65cd3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:25.364179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87e3362c-1f8f-4225-8a6b-d603b8b65cd3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:25.364785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87e3362c-1f8f-4225-8a6b-d603b8b65cd3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:25.365361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87e3362c-1f8f-4225-8a6b-d603b8b65cd3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:25.506379 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-87e3362c-1f8f-4225-8a6b-d603b8b65cd3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action" status: 202 len: 0 microversion: 2.1 time: 0.158162 Aug 18 11:45:25.516060 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2367/4490] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:25 2022] POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:45:25.529523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-65240555-c6d3-423e-87e8-fdbb855439de tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:25.533167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-65240555-c6d3-423e-87e8-fdbb855439de tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:25.550071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65240555-c6d3-423e-87e8-fdbb855439de tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:25.550919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65240555-c6d3-423e-87e8-fdbb855439de tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:25.551596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65240555-c6d3-423e-87e8-fdbb855439de tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:25.553096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65240555-c6d3-423e-87e8-fdbb855439de tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:25.556102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65240555-c6d3-423e-87e8-fdbb855439de tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:25.556815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65240555-c6d3-423e-87e8-fdbb855439de tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:25.675757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e3b43ee9-1156-4cc8-b77f-3a7c75739ec9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:25.705568 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e3b43ee9-1156-4cc8-b77f-3a7c75739ec9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1308 microversion: 2.1 time: 0.812266 Aug 18 11:45:25.706171 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2124/4491] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:24 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1308 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:25.995858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-65240555-c6d3-423e-87e8-fdbb855439de tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:26.008814 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-65240555-c6d3-423e-87e8-fdbb855439de tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1510 microversion: 2.1 time: 0.490771 Aug 18 11:45:26.023595 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2368/4492] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:25 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1510 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:26.462990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-561258d3-3386-4c15-9b71-9f77839a4417 req-616ccc9d-5999-4fc9-9dad-a22c963f04d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a45926-b983-40e7-b9cf-16feec0fc37e", "name": "network-vif-plugged", "status": "completed", "tag": "4cb7522f-53c7-48dd-acda-7c716a3b5f76"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:26.494395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-561258d3-3386-4c15-9b71-9f77839a4417 req-616ccc9d-5999-4fc9-9dad-a22c963f04d2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:26.494943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-561258d3-3386-4c15-9b71-9f77839a4417 req-616ccc9d-5999-4fc9-9dad-a22c963f04d2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:26.495404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-561258d3-3386-4c15-9b71-9f77839a4417 req-616ccc9d-5999-4fc9-9dad-a22c963f04d2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:26.540161 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-561258d3-3386-4c15-9b71-9f77839a4417 req-616ccc9d-5999-4fc9-9dad-a22c963f04d2 service nova] Creating event network-vif-plugged:4cb7522f-53c7-48dd-acda-7c716a3b5f76 for instance 95a45926-b983-40e7-b9cf-16feec0fc37e on n-h2-853611-3 Aug 18 11:45:26.551697 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-561258d3-3386-4c15-9b71-9f77839a4417 req-616ccc9d-5999-4fc9-9dad-a22c963f04d2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092252 Aug 18 11:45:26.556964 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2125/4493] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:45:26.729310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bc418594-2b80-44c0-b443-a3f57db41c3b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:26.730547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bc418594-2b80-44c0-b443-a3f57db41c3b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:26.748862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc418594-2b80-44c0-b443-a3f57db41c3b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:26.749364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc418594-2b80-44c0-b443-a3f57db41c3b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:26.749804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc418594-2b80-44c0-b443-a3f57db41c3b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:26.750547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc418594-2b80-44c0-b443-a3f57db41c3b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:26.751005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc418594-2b80-44c0-b443-a3f57db41c3b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:26.751429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc418594-2b80-44c0-b443-a3f57db41c3b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:27.036380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4a06116d-17cd-4d0f-92da-8b63c0810f69 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:27.039187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4a06116d-17cd-4d0f-92da-8b63c0810f69 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:27.061900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a06116d-17cd-4d0f-92da-8b63c0810f69 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:27.065226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a06116d-17cd-4d0f-92da-8b63c0810f69 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:27.067680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a06116d-17cd-4d0f-92da-8b63c0810f69 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:27.069657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a06116d-17cd-4d0f-92da-8b63c0810f69 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:27.070179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a06116d-17cd-4d0f-92da-8b63c0810f69 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:27.086473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a06116d-17cd-4d0f-92da-8b63c0810f69 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:27.292313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bc418594-2b80-44c0-b443-a3f57db41c3b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:27.310607 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bc418594-2b80-44c0-b443-a3f57db41c3b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1308 microversion: 2.1 time: 0.584620 Aug 18 11:45:27.322537 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2369/4494] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:26 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1308 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:27.639013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4a06116d-17cd-4d0f-92da-8b63c0810f69 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:27.650662 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4a06116d-17cd-4d0f-92da-8b63c0810f69 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1490 microversion: 2.1 time: 0.622827 Aug 18 11:45:27.651274 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2126/4495] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:27 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1490 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:27.676492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-342c4e76-ed14-4616-9962-81c6b4fd13a0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:27.677151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-342c4e76-ed14-4616-9962-81c6b4fd13a0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:27.690898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-342c4e76-ed14-4616-9962-81c6b4fd13a0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:27.696909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-342c4e76-ed14-4616-9962-81c6b4fd13a0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:27.697508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-342c4e76-ed14-4616-9962-81c6b4fd13a0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:27.705042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-342c4e76-ed14-4616-9962-81c6b4fd13a0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:27.705892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-342c4e76-ed14-4616-9962-81c6b4fd13a0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:27.711687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-342c4e76-ed14-4616-9962-81c6b4fd13a0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:27.783772 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-342c4e76-ed14-4616-9962-81c6b4fd13a0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Cannot 'pause' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state paused Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-342c4e76-ed14-4616-9962-81c6b4fd13a0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action HTTP/1.1 Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 13 Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: {"pause": {}} Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: exception: Cannot 'pause' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state paused Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '0eb953a8-e8bd-44d1-9264-75ae577c5940', 'body': {'pause': {}}} Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 in vm_state paused. Cannot pause while the instance is in this state. Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state paused Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:27.786726 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:27.790951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:27.790951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:27.790951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:27.790951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state paused Aug 18 11:45:27.790951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:27.790951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-342c4e76-ed14-4616-9962-81c6b4fd13a0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 409 to user: Cannot 'pause' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state paused {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:27.790951 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-342c4e76-ed14-4616-9962-81c6b4fd13a0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action" status: 409 len: 143 microversion: 2.1 time: 0.116743 Aug 18 11:45:27.790951 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2370/4496] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:27 2022] POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action => generated 143 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:45:27.800649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-faca6573-1263-4656-9979-fe26167c020a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:27.801387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-faca6573-1263-4656-9979-fe26167c020a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:27.811727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faca6573-1263-4656-9979-fe26167c020a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:27.812718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faca6573-1263-4656-9979-fe26167c020a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:27.814207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faca6573-1263-4656-9979-fe26167c020a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:27.818218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faca6573-1263-4656-9979-fe26167c020a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:27.820336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faca6573-1263-4656-9979-fe26167c020a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:27.821265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faca6573-1263-4656-9979-fe26167c020a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:27.984504 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-faca6573-1263-4656-9979-fe26167c020a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action" status: 202 len: 0 microversion: 2.1 time: 0.184757 Aug 18 11:45:27.985310 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2127/4497] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:27 2022] POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:45:28.017820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e23cbd15-f057-46cb-8b58-bd8d21cd1f46 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:28.023157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e23cbd15-f057-46cb-8b58-bd8d21cd1f46 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:28.061961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e23cbd15-f057-46cb-8b58-bd8d21cd1f46 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:28.066724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e23cbd15-f057-46cb-8b58-bd8d21cd1f46 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:28.067811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e23cbd15-f057-46cb-8b58-bd8d21cd1f46 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:28.073387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e23cbd15-f057-46cb-8b58-bd8d21cd1f46 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:28.078657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e23cbd15-f057-46cb-8b58-bd8d21cd1f46 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:28.079947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e23cbd15-f057-46cb-8b58-bd8d21cd1f46 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:28.339056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-60c81dbf-70a6-4935-b22c-5867623b318b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:28.339877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-60c81dbf-70a6-4935-b22c-5867623b318b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:28.371512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60c81dbf-70a6-4935-b22c-5867623b318b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:28.378490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60c81dbf-70a6-4935-b22c-5867623b318b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:28.379188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60c81dbf-70a6-4935-b22c-5867623b318b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:28.379962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60c81dbf-70a6-4935-b22c-5867623b318b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:28.386098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60c81dbf-70a6-4935-b22c-5867623b318b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:28.388050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-60c81dbf-70a6-4935-b22c-5867623b318b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:28.610260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e23cbd15-f057-46cb-8b58-bd8d21cd1f46 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:28.618978 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e23cbd15-f057-46cb-8b58-bd8d21cd1f46 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1497 microversion: 2.1 time: 0.628528 Aug 18 11:45:28.619803 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2371/4498] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:27 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1497 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:29.118962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-60c81dbf-70a6-4935-b22c-5867623b318b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:29.127534 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-60c81dbf-70a6-4935-b22c-5867623b318b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1489 microversion: 2.1 time: 0.795620 Aug 18 11:45:29.128416 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2128/4499] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:28 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1489 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:29.649806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3dce01bc-ad32-45c4-9ba0-1b62dda76586 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:29.651005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3dce01bc-ad32-45c4-9ba0-1b62dda76586 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:29.664250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3dce01bc-ad32-45c4-9ba0-1b62dda76586 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:29.665179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3dce01bc-ad32-45c4-9ba0-1b62dda76586 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:29.666897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3dce01bc-ad32-45c4-9ba0-1b62dda76586 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:29.667994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3dce01bc-ad32-45c4-9ba0-1b62dda76586 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:29.669690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3dce01bc-ad32-45c4-9ba0-1b62dda76586 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:29.671472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3dce01bc-ad32-45c4-9ba0-1b62dda76586 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:29.940039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3dce01bc-ad32-45c4-9ba0-1b62dda76586 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:29.958523 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3dce01bc-ad32-45c4-9ba0-1b62dda76586 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.320618 Aug 18 11:45:29.983144 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2372/4500] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:29 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:29.985476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7719cec6-9f35-41f9-a576-25ba75908774 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:29.986713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7719cec6-9f35-41f9-a576-25ba75908774 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:30.004126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7719cec6-9f35-41f9-a576-25ba75908774 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:30.004809 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7719cec6-9f35-41f9-a576-25ba75908774 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:30.011846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7719cec6-9f35-41f9-a576-25ba75908774 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:30.013298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7719cec6-9f35-41f9-a576-25ba75908774 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:30.013953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7719cec6-9f35-41f9-a576-25ba75908774 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:30.014563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7719cec6-9f35-41f9-a576-25ba75908774 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:30.151013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c58e5c5-dc1e-437b-b505-01e924dec21e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:30.158120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c58e5c5-dc1e-437b-b505-01e924dec21e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:30.176469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c58e5c5-dc1e-437b-b505-01e924dec21e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:30.177232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c58e5c5-dc1e-437b-b505-01e924dec21e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:30.177957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c58e5c5-dc1e-437b-b505-01e924dec21e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:30.183237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c58e5c5-dc1e-437b-b505-01e924dec21e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:30.185334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c58e5c5-dc1e-437b-b505-01e924dec21e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:30.188486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c58e5c5-dc1e-437b-b505-01e924dec21e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:30.503180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9c58e5c5-dc1e-437b-b505-01e924dec21e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:30.514936 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c58e5c5-dc1e-437b-b505-01e924dec21e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1489 microversion: 2.1 time: 0.368284 Aug 18 11:45:30.519051 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2373/4501] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:30 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1489 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:30.593240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7719cec6-9f35-41f9-a576-25ba75908774 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:30.628516 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7719cec6-9f35-41f9-a576-25ba75908774 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.645361 Aug 18 11:45:30.631970 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2129/4502] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:29 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:30.652285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-955119b3-3b73-43d8-8c9c-8bc0bb08cd6f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:30.654701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-955119b3-3b73-43d8-8c9c-8bc0bb08cd6f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:30.667492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-955119b3-3b73-43d8-8c9c-8bc0bb08cd6f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:30.670152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-955119b3-3b73-43d8-8c9c-8bc0bb08cd6f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:30.670891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-955119b3-3b73-43d8-8c9c-8bc0bb08cd6f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:30.676673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-955119b3-3b73-43d8-8c9c-8bc0bb08cd6f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:30.677439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-955119b3-3b73-43d8-8c9c-8bc0bb08cd6f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:30.678046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-955119b3-3b73-43d8-8c9c-8bc0bb08cd6f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:30.719977 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-955119b3-3b73-43d8-8c9c-8bc0bb08cd6f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-955119b3-3b73-43d8-8c9c-8bc0bb08cd6f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712/action HTTP/1.1 Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 28 Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: {"reboot": {"type": "SOFT"}} Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '0134fd66-53da-4cae-bfae-c3d813a96712', 'body': {'reboot': {'type': 'SOFT'}}} Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:30.735459 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:30.739747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:45:30.739747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:30.739747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:30.739747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:30.739747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:30.739747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:30.739747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:30.739747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:30.739747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:30.739747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:45:30.739747 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:30.742948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-955119b3-3b73-43d8-8c9c-8bc0bb08cd6f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:30.743933 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-955119b3-3b73-43d8-8c9c-8bc0bb08cd6f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712/action" status: 404 len: 111 microversion: 2.1 time: 0.096960 Aug 18 11:45:30.751662 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2374/4503] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:30 2022] POST /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712/action => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:45:30.762962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-82c36149-7d62-4efa-9806-5eb58aa2b27c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:30.763758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-82c36149-7d62-4efa-9806-5eb58aa2b27c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:30.784089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82c36149-7d62-4efa-9806-5eb58aa2b27c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:30.791531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82c36149-7d62-4efa-9806-5eb58aa2b27c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:30.793453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82c36149-7d62-4efa-9806-5eb58aa2b27c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:30.796046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82c36149-7d62-4efa-9806-5eb58aa2b27c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:30.808214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82c36149-7d62-4efa-9806-5eb58aa2b27c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:30.812501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82c36149-7d62-4efa-9806-5eb58aa2b27c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:31.305286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dfde3afc-be1b-42a6-815c-f2c50932f32d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Action: 'create', calling method: .version_select at 0x7f519f977af0>, body: {"keypair": {"name": "tempest-keypair-1158030029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmliF7OwzOZFEIqKCaftVZ0iLXIYtUTom+IgjdGVYdACRj17EfnxHM8Qtz01Y2YwwwYGxB9uqkv/uMiMVR/TIJPTciYz6j3il0I5GUIaJNe8dgses1v4e1JN3F5CXVdsg=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:31.349854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-dfde3afc-be1b-42a6-815c-f2c50932f32d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Getting quotas for project 9589b45c8fd0425b8f9c67201bece89c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:45:31.362052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-dfde3afc-be1b-42a6-815c-f2c50932f32d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Getting quotas for user e42e549b9e8c4740a2b33141bd4f7d14 and project 9589b45c8fd0425b8f9c67201bece89c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:45:31.408197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:31.459004 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dfde3afc-be1b-42a6-815c-f2c50932f32d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.508054 Aug 18 11:45:31.467721 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2375/4504] 10.222.0.73 () {62 vars in 1200 bytes} [Thu Aug 18 11:45:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 526 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 18 11:45:31.548125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-10059db5-64c0-4677-8e7c-63f47a213704 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:31.549706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-10059db5-64c0-4677-8e7c-63f47a213704 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:31.575906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10059db5-64c0-4677-8e7c-63f47a213704 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:31.579991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10059db5-64c0-4677-8e7c-63f47a213704 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:31.580678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10059db5-64c0-4677-8e7c-63f47a213704 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:31.587707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10059db5-64c0-4677-8e7c-63f47a213704 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:31.588458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10059db5-64c0-4677-8e7c-63f47a213704 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:31.589092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10059db5-64c0-4677-8e7c-63f47a213704 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:32.283887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-10059db5-64c0-4677-8e7c-63f47a213704 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:32.294182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:32.303580 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-10059db5-64c0-4677-8e7c-63f47a213704 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1489 microversion: 2.1 time: 0.765884 Aug 18 11:45:32.304570 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2376/4505] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:31 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1489 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:32.612234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-82c36149-7d62-4efa-9806-5eb58aa2b27c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:32.624833 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-82c36149-7d62-4efa-9806-5eb58aa2b27c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 1.868612 Aug 18 11:45:32.625446 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2130/4506] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:30 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:32.651639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f29456bb-da04-4dd6-8f33-16675a775056 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:32.652306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f29456bb-da04-4dd6-8f33-16675a775056 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:32.677293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f29456bb-da04-4dd6-8f33-16675a775056 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:32.677809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f29456bb-da04-4dd6-8f33-16675a775056 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:32.678264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f29456bb-da04-4dd6-8f33-16675a775056 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:32.679025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f29456bb-da04-4dd6-8f33-16675a775056 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:32.679492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f29456bb-da04-4dd6-8f33-16675a775056 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:32.679927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f29456bb-da04-4dd6-8f33-16675a775056 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:33.342862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-655230c6-4dcb-4daa-bbc0-de521a4aff3a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:33.343522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-655230c6-4dcb-4daa-bbc0-de521a4aff3a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:33.354900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-655230c6-4dcb-4daa-bbc0-de521a4aff3a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:33.355402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-655230c6-4dcb-4daa-bbc0-de521a4aff3a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:33.358642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-655230c6-4dcb-4daa-bbc0-de521a4aff3a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:33.360753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-655230c6-4dcb-4daa-bbc0-de521a4aff3a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:33.363361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-655230c6-4dcb-4daa-bbc0-de521a4aff3a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:33.365989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-655230c6-4dcb-4daa-bbc0-de521a4aff3a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:33.652500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f29456bb-da04-4dd6-8f33-16675a775056 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:33.668573 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f29456bb-da04-4dd6-8f33-16675a775056 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 1.022039 Aug 18 11:45:33.691211 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2377/4507] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:32 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:33.707249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9aa6c124-fcba-41ac-a885-7710e567d79c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:33.713976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9aa6c124-fcba-41ac-a885-7710e567d79c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 24f7abdf-2783-4ef7-a2d0-c1f6d48759e2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:33.728318 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-9aa6c124-fcba-41ac-a885-7710e567d79c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance 24f7abdf-2783-4ef7-a2d0-c1f6d48759e2 could not be found. Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9aa6c124-fcba-41ac-a885-7710e567d79c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/24f7abdf-2783-4ef7-a2d0-c1f6d48759e2/action HTTP/1.1 Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 28 Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: {"reboot": {"type": "SOFT"}} Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 24f7abdf-2783-4ef7-a2d0-c1f6d48759e2 could not be found. Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '24f7abdf-2783-4ef7-a2d0-c1f6d48759e2', 'body': {'reboot': {'type': 'SOFT'}}} Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f7abdf-2783-4ef7-a2d0-c1f6d48759e2 could not be found. Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f7abdf-2783-4ef7-a2d0-c1f6d48759e2 could not be found. Aug 18 11:45:33.734669 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:33.740351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:33.740351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:33.740351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:33.740351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:33.740351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:33.740351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:33.740351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:33.740351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f7abdf-2783-4ef7-a2d0-c1f6d48759e2 could not be found. Aug 18 11:45:33.740351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:33.740351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9aa6c124-fcba-41ac-a885-7710e567d79c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance 24f7abdf-2783-4ef7-a2d0-c1f6d48759e2 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:33.743351 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9aa6c124-fcba-41ac-a885-7710e567d79c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/24f7abdf-2783-4ef7-a2d0-c1f6d48759e2/action" status: 404 len: 111 microversion: 2.1 time: 0.043835 Aug 18 11:45:33.745850 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2378/4508] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:33 2022] POST /compute/v2.1/servers/24f7abdf-2783-4ef7-a2d0-c1f6d48759e2/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:45:33.759278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-90d2446c-2d95-4144-81f1-a75792c2ab42 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:33.760393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-90d2446c-2d95-4144-81f1-a75792c2ab42 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:33.820352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90d2446c-2d95-4144-81f1-a75792c2ab42 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:33.826937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90d2446c-2d95-4144-81f1-a75792c2ab42 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:33.828400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90d2446c-2d95-4144-81f1-a75792c2ab42 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:33.830481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90d2446c-2d95-4144-81f1-a75792c2ab42 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:33.834827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90d2446c-2d95-4144-81f1-a75792c2ab42 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:33.836380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90d2446c-2d95-4144-81f1-a75792c2ab42 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:34.323893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-655230c6-4dcb-4daa-bbc0-de521a4aff3a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:34.340491 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-655230c6-4dcb-4daa-bbc0-de521a4aff3a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1489 microversion: 2.1 time: 1.000915 Aug 18 11:45:34.342366 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2131/4509] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:33 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1489 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:45:34.564210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-90d2446c-2d95-4144-81f1-a75792c2ab42 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:34.587753 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-90d2446c-2d95-4144-81f1-a75792c2ab42 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.837490 Aug 18 11:45:34.603058 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2379/4510] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:33 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:34.623914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9cf35fb2-2dcd-4aa7-ad87-bb4a2de08ed8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:34.624795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9cf35fb2-2dcd-4aa7-ad87-bb4a2de08ed8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:34.639522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:34.642332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cf35fb2-2dcd-4aa7-ad87-bb4a2de08ed8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:34.645557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cf35fb2-2dcd-4aa7-ad87-bb4a2de08ed8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:34.658235 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cf35fb2-2dcd-4aa7-ad87-bb4a2de08ed8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:34.661136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cf35fb2-2dcd-4aa7-ad87-bb4a2de08ed8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:34.662646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cf35fb2-2dcd-4aa7-ad87-bb4a2de08ed8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:34.663229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9cf35fb2-2dcd-4aa7-ad87-bb4a2de08ed8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:35.369464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7b9b405-0962-4aba-8ad3-13df7c5e2d0e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:35.370097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e7b9b405-0962-4aba-8ad3-13df7c5e2d0e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:35.381324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9cf35fb2-2dcd-4aa7-ad87-bb4a2de08ed8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:35.384997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7b9b405-0962-4aba-8ad3-13df7c5e2d0e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:35.394028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7b9b405-0962-4aba-8ad3-13df7c5e2d0e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:35.394531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7b9b405-0962-4aba-8ad3-13df7c5e2d0e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:35.395321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7b9b405-0962-4aba-8ad3-13df7c5e2d0e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:35.395808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7b9b405-0962-4aba-8ad3-13df7c5e2d0e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:35.396253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7b9b405-0962-4aba-8ad3-13df7c5e2d0e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:35.398159 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9cf35fb2-2dcd-4aa7-ad87-bb4a2de08ed8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.787248 Aug 18 11:45:35.415168 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2132/4511] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:34 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:35.443164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d7500b39-184f-424b-9908-fc6109baa33f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:35.447376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d7500b39-184f-424b-9908-fc6109baa33f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:35.457614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7500b39-184f-424b-9908-fc6109baa33f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:35.458685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7500b39-184f-424b-9908-fc6109baa33f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:35.459479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7500b39-184f-424b-9908-fc6109baa33f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:35.460488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7500b39-184f-424b-9908-fc6109baa33f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:35.461251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7500b39-184f-424b-9908-fc6109baa33f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:35.461911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d7500b39-184f-424b-9908-fc6109baa33f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:35.489370 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-d7500b39-184f-424b-9908-fc6109baa33f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d7500b39-184f-424b-9908-fc6109baa33f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712/action HTTP/1.1 Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 65 Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: {"rebuild": {"imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a"}} Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '0134fd66-53da-4cae-bfae-c3d813a96712', 'body': {'rebuild': {'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a'}}} Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 18 11:45:35.491816 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:45:35.495303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:35.498187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d7500b39-184f-424b-9908-fc6109baa33f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:35.499108 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d7500b39-184f-424b-9908-fc6109baa33f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712/action" status: 404 len: 111 microversion: 2.1 time: 0.062444 Aug 18 11:45:35.503021 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2133/4512] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:35 2022] POST /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:45:35.519248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7917c88f-d44f-4c7e-adf7-afa1dfd1896a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:35.519811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7917c88f-d44f-4c7e-adf7-afa1dfd1896a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:35.563565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7917c88f-d44f-4c7e-adf7-afa1dfd1896a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:35.564078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7917c88f-d44f-4c7e-adf7-afa1dfd1896a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:35.564533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7917c88f-d44f-4c7e-adf7-afa1dfd1896a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:35.565282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7917c88f-d44f-4c7e-adf7-afa1dfd1896a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:35.565750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7917c88f-d44f-4c7e-adf7-afa1dfd1896a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:35.566188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7917c88f-d44f-4c7e-adf7-afa1dfd1896a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:36.134375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7917c88f-d44f-4c7e-adf7-afa1dfd1896a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:36.139735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:36.157104 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7917c88f-d44f-4c7e-adf7-afa1dfd1896a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.641913 Aug 18 11:45:36.158034 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2134/4513] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:35 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:36.165583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-ad5ba18b-cbd4-409d-8aad-aa4971e8c308 req-ac8b3b83-ce6b-44fe-9c90-1408dc284b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a45926-b983-40e7-b9cf-16feec0fc37e", "name": "network-vif-deleted", "tag": "4cb7522f-53c7-48dd-acda-7c716a3b5f76"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:36.210549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ad5ba18b-cbd4-409d-8aad-aa4971e8c308 req-ac8b3b83-ce6b-44fe-9c90-1408dc284b9d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:36.211886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ad5ba18b-cbd4-409d-8aad-aa4971e8c308 req-ac8b3b83-ce6b-44fe-9c90-1408dc284b9d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:36.212648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ad5ba18b-cbd4-409d-8aad-aa4971e8c308 req-ac8b3b83-ce6b-44fe-9c90-1408dc284b9d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:36.247747 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-ad5ba18b-cbd4-409d-8aad-aa4971e8c308 req-ac8b3b83-ce6b-44fe-9c90-1408dc284b9d service nova] Creating event network-vif-deleted:4cb7522f-53c7-48dd-acda-7c716a3b5f76 for instance 95a45926-b983-40e7-b9cf-16feec0fc37e on n-h2-853611-3 Aug 18 11:45:36.255935 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-ad5ba18b-cbd4-409d-8aad-aa4971e8c308 req-ac8b3b83-ce6b-44fe-9c90-1408dc284b9d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096009 Aug 18 11:45:36.258005 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2135/4514] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:45:36.267801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-52e811ed-93d9-47d9-a806-3aaaa7572394 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:36.268808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-52e811ed-93d9-47d9-a806-3aaaa7572394 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:36.294009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-52e811ed-93d9-47d9-a806-3aaaa7572394 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:36.295782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-52e811ed-93d9-47d9-a806-3aaaa7572394 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:36.297228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-52e811ed-93d9-47d9-a806-3aaaa7572394 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:36.299330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-52e811ed-93d9-47d9-a806-3aaaa7572394 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:36.300104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-52e811ed-93d9-47d9-a806-3aaaa7572394 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:36.300698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-52e811ed-93d9-47d9-a806-3aaaa7572394 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:36.603911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-52e811ed-93d9-47d9-a806-3aaaa7572394 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:36.624028 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-52e811ed-93d9-47d9-a806-3aaaa7572394 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.356669 Aug 18 11:45:36.624714 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2136/4515] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:36 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:36.648489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6304f5c9-806b-4d2b-923b-cdbb945637f8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:36.653554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6304f5c9-806b-4d2b-923b-cdbb945637f8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: a9c2b2b4-d377-4e9d-ba16-b9a703e7d0c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:36.662520 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-6304f5c9-806b-4d2b-923b-cdbb945637f8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance a9c2b2b4-d377-4e9d-ba16-b9a703e7d0c7 could not be found. Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6304f5c9-806b-4d2b-923b-cdbb945637f8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/a9c2b2b4-d377-4e9d-ba16-b9a703e7d0c7/action HTTP/1.1 Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 65 Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: {"rebuild": {"imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a"}} Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance a9c2b2b4-d377-4e9d-ba16-b9a703e7d0c7 could not be found. Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'a9c2b2b4-d377-4e9d-ba16-b9a703e7d0c7', 'body': {'rebuild': {'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a'}}} Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9c2b2b4-d377-4e9d-ba16-b9a703e7d0c7 could not be found. Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 18 11:45:36.666105 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:45:36.671525 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:45:36.671525 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:36.671525 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:36.671525 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9c2b2b4-d377-4e9d-ba16-b9a703e7d0c7 could not be found. Aug 18 11:45:36.671525 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:36.671525 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:36.671525 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:36.671525 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:36.671525 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:36.671525 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:36.671525 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:36.671525 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:36.671525 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9c2b2b4-d377-4e9d-ba16-b9a703e7d0c7 could not be found. Aug 18 11:45:36.671525 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:36.686216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6304f5c9-806b-4d2b-923b-cdbb945637f8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance a9c2b2b4-d377-4e9d-ba16-b9a703e7d0c7 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:36.687542 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6304f5c9-806b-4d2b-923b-cdbb945637f8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/a9c2b2b4-d377-4e9d-ba16-b9a703e7d0c7/action" status: 404 len: 111 microversion: 2.1 time: 0.043342 Aug 18 11:45:36.695677 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2137/4516] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:36 2022] POST /compute/v2.1/servers/a9c2b2b4-d377-4e9d-ba16-b9a703e7d0c7/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:45:36.705201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d0ed9b3d-84cb-41ad-ac61-39e82bc924a3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:36.707048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d0ed9b3d-84cb-41ad-ac61-39e82bc924a3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:36.724447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0ed9b3d-84cb-41ad-ac61-39e82bc924a3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:36.727475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0ed9b3d-84cb-41ad-ac61-39e82bc924a3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:36.735279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0ed9b3d-84cb-41ad-ac61-39e82bc924a3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:36.740206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0ed9b3d-84cb-41ad-ac61-39e82bc924a3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:36.740887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0ed9b3d-84cb-41ad-ac61-39e82bc924a3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:36.741483 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d0ed9b3d-84cb-41ad-ac61-39e82bc924a3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:37.088324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e7b9b405-0962-4aba-8ad3-13df7c5e2d0e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:37.124262 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e7b9b405-0962-4aba-8ad3-13df7c5e2d0e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 200 len: 1489 microversion: 2.1 time: 1.755379 Aug 18 11:45:37.126208 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2380/4517] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:35 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 1489 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:37.180909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d0ed9b3d-84cb-41ad-ac61-39e82bc924a3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:37.195209 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d0ed9b3d-84cb-41ad-ac61-39e82bc924a3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.493905 Aug 18 11:45:37.195921 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2138/4518] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:36 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:37.219605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b2e40ad-b32c-4f29-893f-4a27ae5e5a38 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:37.220525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2b2e40ad-b32c-4f29-893f-4a27ae5e5a38 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:37.233376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b2e40ad-b32c-4f29-893f-4a27ae5e5a38 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:37.233979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b2e40ad-b32c-4f29-893f-4a27ae5e5a38 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:37.234541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b2e40ad-b32c-4f29-893f-4a27ae5e5a38 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:37.244492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b2e40ad-b32c-4f29-893f-4a27ae5e5a38 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:37.245229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b2e40ad-b32c-4f29-893f-4a27ae5e5a38 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:37.245753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b2e40ad-b32c-4f29-893f-4a27ae5e5a38 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:38.001935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2b2e40ad-b32c-4f29-893f-4a27ae5e5a38 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:38.017790 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2b2e40ad-b32c-4f29-893f-4a27ae5e5a38 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.803332 Aug 18 11:45:38.020858 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2381/4519] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:37 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:38.040225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-35d26670-ad80-4ad5-9ef7-9ec4ac0860d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:38.041174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-35d26670-ad80-4ad5-9ef7-9ec4ac0860d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 27337679-48dd-4b50-bf9d-e28482564124] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:38.048797 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-35d26670-ad80-4ad5-9ef7-9ec4ac0860d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance 27337679-48dd-4b50-bf9d-e28482564124 could not be found. Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-35d26670-ad80-4ad5-9ef7-9ec4ac0860d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/27337679-48dd-4b50-bf9d-e28482564124/action HTTP/1.1 Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 15 Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: {"restore": {}} Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 27337679-48dd-4b50-bf9d-e28482564124 could not be found. Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '27337679-48dd-4b50-bf9d-e28482564124', 'body': {'restore': {}}} Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27337679-48dd-4b50-bf9d-e28482564124 could not be found. Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27337679-48dd-4b50-bf9d-e28482564124 could not be found. Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:38.051586 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:38.057350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:38.057350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:38.057350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27337679-48dd-4b50-bf9d-e28482564124 could not be found. Aug 18 11:45:38.057350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:38.059732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-35d26670-ad80-4ad5-9ef7-9ec4ac0860d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance 27337679-48dd-4b50-bf9d-e28482564124 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:38.060969 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-35d26670-ad80-4ad5-9ef7-9ec4ac0860d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/27337679-48dd-4b50-bf9d-e28482564124/action" status: 404 len: 111 microversion: 2.1 time: 0.026602 Aug 18 11:45:38.066115 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2139/4520] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:38 2022] POST /compute/v2.1/servers/27337679-48dd-4b50-bf9d-e28482564124/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:45:38.084049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ecbabccd-a642-45d6-bede-4c376b96cf80 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:38.095680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ecbabccd-a642-45d6-bede-4c376b96cf80 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:38.113059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecbabccd-a642-45d6-bede-4c376b96cf80 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:38.116331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecbabccd-a642-45d6-bede-4c376b96cf80 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:38.117441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecbabccd-a642-45d6-bede-4c376b96cf80 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:38.119198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecbabccd-a642-45d6-bede-4c376b96cf80 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:38.120097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecbabccd-a642-45d6-bede-4c376b96cf80 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:38.120880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecbabccd-a642-45d6-bede-4c376b96cf80 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:38.179160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5da6a2bc-2222-4073-864a-1c8293f198f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:38.181767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5da6a2bc-2222-4073-864a-1c8293f198f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:38.200458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5da6a2bc-2222-4073-864a-1c8293f198f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:38.202283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5da6a2bc-2222-4073-864a-1c8293f198f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:38.203131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5da6a2bc-2222-4073-864a-1c8293f198f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:38.205681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5da6a2bc-2222-4073-864a-1c8293f198f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:38.206653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5da6a2bc-2222-4073-864a-1c8293f198f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:38.207436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5da6a2bc-2222-4073-864a-1c8293f198f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:38.237862 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-5da6a2bc-2222-4073-864a-1c8293f198f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5da6a2bc-2222-4073-864a-1c8293f198f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e HTTP/1.1 Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '95a45926-b983-40e7-b9cf-16feec0fc37e'} Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:38.239761 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:38.249996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:38.249996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:38.249996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:38.249996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:38.249996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:45:38.249996 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:38.249996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5da6a2bc-2222-4073-864a-1c8293f198f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:38.249996 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5da6a2bc-2222-4073-864a-1c8293f198f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 404 len: 111 microversion: 2.1 time: 0.076640 Aug 18 11:45:38.249996 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2140/4521] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:38 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:45:38.395753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-665089707", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "748eeef0-4e88-4443-abac-e79de3b3bb2a"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:38.482090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ecbabccd-a642-45d6-bede-4c376b96cf80 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:38.496587 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ecbabccd-a642-45d6-bede-4c376b96cf80 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.429524 Aug 18 11:45:38.497461 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2382/4522] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:38 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:38.500083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] validate_networks() for [('748eeef0-4e88-4443-abac-e79de3b3bb2a', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:45:38.537385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-82fe4b41-438c-4333-9868-a3da5ec5e063 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:38.538583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-82fe4b41-438c-4333-9868-a3da5ec5e063 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:38.551826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82fe4b41-438c-4333-9868-a3da5ec5e063 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:38.556394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82fe4b41-438c-4333-9868-a3da5ec5e063 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:38.557241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82fe4b41-438c-4333-9868-a3da5ec5e063 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:38.559314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82fe4b41-438c-4333-9868-a3da5ec5e063 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:38.559314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82fe4b41-438c-4333-9868-a3da5ec5e063 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:38.561528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82fe4b41-438c-4333-9868-a3da5ec5e063 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:39.282995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-82fe4b41-438c-4333-9868-a3da5ec5e063 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:39.292925 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-82fe4b41-438c-4333-9868-a3da5ec5e063 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.762521 Aug 18 11:45:39.294039 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2383/4523] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:38 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:39.319111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c3fe7fb9-31f6-41f9-9e1b-63863b46b580 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:39.319953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c3fe7fb9-31f6-41f9-9e1b-63863b46b580 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:39.331307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3fe7fb9-31f6-41f9-9e1b-63863b46b580 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:39.332038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3fe7fb9-31f6-41f9-9e1b-63863b46b580 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:39.332682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3fe7fb9-31f6-41f9-9e1b-63863b46b580 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:39.333597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3fe7fb9-31f6-41f9-9e1b-63863b46b580 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:39.334255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3fe7fb9-31f6-41f9-9e1b-63863b46b580 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:39.334945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3fe7fb9-31f6-41f9-9e1b-63863b46b580 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:39.365140 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-c3fe7fb9-31f6-41f9-9e1b-63863b46b580 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Cannot 'restore' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c3fe7fb9-31f6-41f9-9e1b-63863b46b580 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action HTTP/1.1 Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 15 Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: {"restore": {}} Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: exception: Cannot 'restore' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '0eb953a8-e8bd-44d1-9264-75ae577c5940', 'body': {'restore': {}}} Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 in vm_state active. Cannot restore while the instance is in this state. Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:39.367274 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:39.372023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:39.372023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:39.372023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:39.372023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:45:39.372023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:39.374291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c3fe7fb9-31f6-41f9-9e1b-63863b46b580 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 409 to user: Cannot 'restore' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:39.375521 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c3fe7fb9-31f6-41f9-9e1b-63863b46b580 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action" status: 409 len: 145 microversion: 2.1 time: 0.062164 Aug 18 11:45:39.382154 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2384/4524] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:39 2022] POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action => generated 145 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:45:39.388645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2398dd35-6b1c-49ac-a769-a097e7bf7db8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:39.389574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2398dd35-6b1c-49ac-a769-a097e7bf7db8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:39.397156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2398dd35-6b1c-49ac-a769-a097e7bf7db8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:39.397956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2398dd35-6b1c-49ac-a769-a097e7bf7db8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:39.399322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2398dd35-6b1c-49ac-a769-a097e7bf7db8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:39.400437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2398dd35-6b1c-49ac-a769-a097e7bf7db8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:39.401511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2398dd35-6b1c-49ac-a769-a097e7bf7db8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:39.402622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2398dd35-6b1c-49ac-a769-a097e7bf7db8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:39.838267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2398dd35-6b1c-49ac-a769-a097e7bf7db8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:39.857055 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2398dd35-6b1c-49ac-a769-a097e7bf7db8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.473087 Aug 18 11:45:39.862081 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2385/4525] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:39 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:39.900894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cc87e594-440c-4d5f-a2f2-a7ba601732b2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:39.902469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cc87e594-440c-4d5f-a2f2-a7ba601732b2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:39.921923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc87e594-440c-4d5f-a2f2-a7ba601732b2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:39.922917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc87e594-440c-4d5f-a2f2-a7ba601732b2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:39.924252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc87e594-440c-4d5f-a2f2-a7ba601732b2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:39.930845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc87e594-440c-4d5f-a2f2-a7ba601732b2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:39.931635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc87e594-440c-4d5f-a2f2-a7ba601732b2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:39.932644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cc87e594-440c-4d5f-a2f2-a7ba601732b2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:40.127329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:45:40.127883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:45:40.128330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:45:40.128864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:45:40.129328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:45:40.152916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:40.153449 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:40.154070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:40.154877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:40.155466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:40.155780 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:40.202190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:45:40.220814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for user c850b0a836124d90b7e50fe8b9fdf011 and project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:45:40.254546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:45:40.259356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:45:40.373961 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a6cff2ee-acd2-47d2-ae39-1629c019e114 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.983059 Aug 18 11:45:40.377734 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2141/4526] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:45:40.393731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2100887607", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6a88b2c-bded-43ae-9568-27d654107f5e"}], "security_groups": [{"name": "tempest-securitygroup--1421721775"}], "key_name": "tempest-keypair-1158030029", "user_data": "}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:40.734216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cc87e594-440c-4d5f-a2f2-a7ba601732b2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:40.746815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] validate_networks() for [('a6a88b2c-bded-43ae-9568-27d654107f5e', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:45:40.756560 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cc87e594-440c-4d5f-a2f2-a7ba601732b2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.860098 Aug 18 11:45:40.760488 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2386/4527] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:39 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:45:40.776586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c1eba4e3-8b8a-4c3b-a2bb-075e259dcc9c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:40.779037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c1eba4e3-8b8a-4c3b-a2bb-075e259dcc9c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:41.383411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:41.493702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c1eba4e3-8b8a-4c3b-a2bb-075e259dcc9c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:41.504359 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c1eba4e3-8b8a-4c3b-a2bb-075e259dcc9c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1220 microversion: 2.1 time: 0.739109 Aug 18 11:45:41.506810 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2387/4528] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:40 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1220 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:41.516356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac7aa932-4c1b-45d0-90ee-5a1df42ddb3b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:41.517051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ac7aa932-4c1b-45d0-90ee-5a1df42ddb3b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: d4dc63bf-2b04-47be-8df6-22b20c450f7b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:41.529312 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-ac7aa932-4c1b-45d0-90ee-5a1df42ddb3b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance d4dc63bf-2b04-47be-8df6-22b20c450f7b could not be found. Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac7aa932-4c1b-45d0-90ee-5a1df42ddb3b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/d4dc63bf-2b04-47be-8df6-22b20c450f7b/action HTTP/1.1 Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 14 Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: {"resume": {}} Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance d4dc63bf-2b04-47be-8df6-22b20c450f7b could not be found. Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'd4dc63bf-2b04-47be-8df6-22b20c450f7b', 'body': {'resume': {}}} Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4dc63bf-2b04-47be-8df6-22b20c450f7b could not be found. Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4dc63bf-2b04-47be-8df6-22b20c450f7b could not be found. Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:41.541437 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:41.548556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:41.548556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:41.548556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4dc63bf-2b04-47be-8df6-22b20c450f7b could not be found. Aug 18 11:45:41.548556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:41.552286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac7aa932-4c1b-45d0-90ee-5a1df42ddb3b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance d4dc63bf-2b04-47be-8df6-22b20c450f7b could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:41.555828 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ac7aa932-4c1b-45d0-90ee-5a1df42ddb3b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/d4dc63bf-2b04-47be-8df6-22b20c450f7b/action" status: 404 len: 111 microversion: 2.1 time: 0.044276 Aug 18 11:45:41.556962 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2388/4529] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:41 2022] POST /compute/v2.1/servers/d4dc63bf-2b04-47be-8df6-22b20c450f7b/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:45:41.576806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-68a4dc2c-a310-4d17-a427-a2c6fe8a167d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:41.579085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-68a4dc2c-a310-4d17-a427-a2c6fe8a167d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:41.592586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68a4dc2c-a310-4d17-a427-a2c6fe8a167d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:41.595097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68a4dc2c-a310-4d17-a427-a2c6fe8a167d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:41.596428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68a4dc2c-a310-4d17-a427-a2c6fe8a167d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:41.596649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68a4dc2c-a310-4d17-a427-a2c6fe8a167d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:41.601563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68a4dc2c-a310-4d17-a427-a2c6fe8a167d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:41.602022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68a4dc2c-a310-4d17-a427-a2c6fe8a167d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:41.891014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:45:41.892087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:45:41.892808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:45:41.893390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:45:41.894936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:45:41.907004 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:41.907732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:41.908414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:41.909420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:41.910061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:41.910713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:41.935432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Getting quotas for project 9589b45c8fd0425b8f9c67201bece89c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:45:41.943280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Getting quotas for user e42e549b9e8c4740a2b33141bd4f7d14 and project 9589b45c8fd0425b8f9c67201bece89c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:45:41.960813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:45:41.963415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:45:42.081264 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0b652f02-a941-4a6f-b5d5-701facfc22cd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.701710 Aug 18 11:45:42.082226 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2142/4530] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:45:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 11:45:42.124376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-48a4d055-4aa9-487d-b266-b6727e07209c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:42.125186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-48a4d055-4aa9-487d-b266-b6727e07209c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:42.234725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-48a4d055-4aa9-487d-b266-b6727e07209c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:42.252631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-48a4d055-4aa9-487d-b266-b6727e07209c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:42.294813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-48a4d055-4aa9-487d-b266-b6727e07209c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:42.299589 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-48a4d055-4aa9-487d-b266-b6727e07209c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1282 microversion: 2.20 time: 0.191022 Aug 18 11:45:42.305450 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2143/4531] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:45:42 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1282 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:45:42.505564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-68a4dc2c-a310-4d17-a427-a2c6fe8a167d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:42.530138 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-68a4dc2c-a310-4d17-a427-a2c6fe8a167d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.961156 Aug 18 11:45:42.532340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6b44c25f-a679-4073-919c-44b821f0ff7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:42.532981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6b44c25f-a679-4073-919c-44b821f0ff7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:42.537362 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2389/4532] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:41 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:42.552430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b44c25f-a679-4073-919c-44b821f0ff7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:42.554061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b44c25f-a679-4073-919c-44b821f0ff7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:42.555968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b44c25f-a679-4073-919c-44b821f0ff7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:42.556788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b44c25f-a679-4073-919c-44b821f0ff7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:42.557489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b44c25f-a679-4073-919c-44b821f0ff7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:42.559344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6b44c25f-a679-4073-919c-44b821f0ff7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:42.564231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bf36bf61-b61c-4f54-bdd1-9c5f6ccd7a8a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:42.564855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bf36bf61-b61c-4f54-bdd1-9c5f6ccd7a8a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:42.583113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf36bf61-b61c-4f54-bdd1-9c5f6ccd7a8a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:42.583615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf36bf61-b61c-4f54-bdd1-9c5f6ccd7a8a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:42.584060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf36bf61-b61c-4f54-bdd1-9c5f6ccd7a8a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:42.584793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf36bf61-b61c-4f54-bdd1-9c5f6ccd7a8a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:42.585259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf36bf61-b61c-4f54-bdd1-9c5f6ccd7a8a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:42.585695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf36bf61-b61c-4f54-bdd1-9c5f6ccd7a8a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:43.039440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6b44c25f-a679-4073-919c-44b821f0ff7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:43.055962 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6b44c25f-a679-4073-919c-44b821f0ff7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1290 microversion: 2.1 time: 0.527261 Aug 18 11:45:43.062629 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2144/4533] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:42 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1290 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:43.085699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bf36bf61-b61c-4f54-bdd1-9c5f6ccd7a8a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:43.104053 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bf36bf61-b61c-4f54-bdd1-9c5f6ccd7a8a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.543613 Aug 18 11:45:43.118461 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2390/4534] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:42 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:45:43.137478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ca06d8ba-6ba6-4910-99a5-054601063a2c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:43.139826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ca06d8ba-6ba6-4910-99a5-054601063a2c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:43.157747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca06d8ba-6ba6-4910-99a5-054601063a2c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:43.158660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca06d8ba-6ba6-4910-99a5-054601063a2c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:43.159357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca06d8ba-6ba6-4910-99a5-054601063a2c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:43.163703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca06d8ba-6ba6-4910-99a5-054601063a2c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:43.164364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca06d8ba-6ba6-4910-99a5-054601063a2c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:43.165739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca06d8ba-6ba6-4910-99a5-054601063a2c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:43.228028 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-ca06d8ba-6ba6-4910-99a5-054601063a2c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Cannot 'resume' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ca06d8ba-6ba6-4910-99a5-054601063a2c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action HTTP/1.1 Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 14 Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: {"resume": {}} Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: exception: Cannot 'resume' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '0eb953a8-e8bd-44d1-9264-75ae577c5940', 'body': {'resume': {}}} Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 in vm_state active. Cannot resume while the instance is in this state. Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:43.232651 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:43.237575 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:43.237575 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:43.237575 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:43.237575 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:45:43.237575 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:43.239775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ca06d8ba-6ba6-4910-99a5-054601063a2c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 409 to user: Cannot 'resume' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:43.241625 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ca06d8ba-6ba6-4910-99a5-054601063a2c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action" status: 409 len: 144 microversion: 2.1 time: 0.110547 Aug 18 11:45:43.251650 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2145/4535] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:43 2022] POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action => generated 144 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:45:43.252799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-431bb94c-075b-4498-919f-4914790b0078 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:43.253576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-431bb94c-075b-4498-919f-4914790b0078 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:43.273024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-431bb94c-075b-4498-919f-4914790b0078 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:43.273315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-431bb94c-075b-4498-919f-4914790b0078 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:43.273770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-431bb94c-075b-4498-919f-4914790b0078 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:43.274545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-431bb94c-075b-4498-919f-4914790b0078 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:43.275362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-431bb94c-075b-4498-919f-4914790b0078 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:43.276374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-431bb94c-075b-4498-919f-4914790b0078 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:43.326815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2836f20d-823d-46aa-85ac-5903a0e615ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:43.327636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2836f20d-823d-46aa-85ac-5903a0e615ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:43.352514 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2836f20d-823d-46aa-85ac-5903a0e615ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:43.354177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2836f20d-823d-46aa-85ac-5903a0e615ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:43.358159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2836f20d-823d-46aa-85ac-5903a0e615ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:43.360031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2836f20d-823d-46aa-85ac-5903a0e615ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:43.363494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2836f20d-823d-46aa-85ac-5903a0e615ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:43.371037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2836f20d-823d-46aa-85ac-5903a0e615ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:43.731376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2836f20d-823d-46aa-85ac-5903a0e615ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:43.747190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2836f20d-823d-46aa-85ac-5903a0e615ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:43.749433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2836f20d-823d-46aa-85ac-5903a0e615ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:43.751346 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2836f20d-823d-46aa-85ac-5903a0e615ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1334 microversion: 2.20 time: 0.430802 Aug 18 11:45:43.752573 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2146/4536] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:45:43 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1334 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:45:43.890754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-431bb94c-075b-4498-919f-4914790b0078 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:43.907830 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-431bb94c-075b-4498-919f-4914790b0078 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.658853 Aug 18 11:45:43.911890 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2391/4537] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:43 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:43.940713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1b39f1b5-8b35-48ec-b6a3-e0480f7a2b1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:43.942677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1b39f1b5-8b35-48ec-b6a3-e0480f7a2b1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:43.957784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b39f1b5-8b35-48ec-b6a3-e0480f7a2b1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:43.958854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b39f1b5-8b35-48ec-b6a3-e0480f7a2b1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:43.959375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b39f1b5-8b35-48ec-b6a3-e0480f7a2b1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:43.960399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b39f1b5-8b35-48ec-b6a3-e0480f7a2b1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:43.961375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b39f1b5-8b35-48ec-b6a3-e0480f7a2b1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:43.961949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b39f1b5-8b35-48ec-b6a3-e0480f7a2b1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:44.098545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cf373916-de31-4d52-87a9-5d9f5c8bb6c7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:44.101616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cf373916-de31-4d52-87a9-5d9f5c8bb6c7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:44.119823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf373916-de31-4d52-87a9-5d9f5c8bb6c7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:44.121167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf373916-de31-4d52-87a9-5d9f5c8bb6c7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:44.122133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf373916-de31-4d52-87a9-5d9f5c8bb6c7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:44.125314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf373916-de31-4d52-87a9-5d9f5c8bb6c7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:44.126999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf373916-de31-4d52-87a9-5d9f5c8bb6c7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:44.138966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf373916-de31-4d52-87a9-5d9f5c8bb6c7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:44.299736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cf373916-de31-4d52-87a9-5d9f5c8bb6c7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:44.317045 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cf373916-de31-4d52-87a9-5d9f5c8bb6c7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1278 microversion: 2.1 time: 0.230763 Aug 18 11:45:44.317687 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2392/4538] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:44 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1278 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:45:44.636985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1b39f1b5-8b35-48ec-b6a3-e0480f7a2b1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:44.651063 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1b39f1b5-8b35-48ec-b6a3-e0480f7a2b1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.716421 Aug 18 11:45:44.657855 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2147/4539] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:43 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:44.776282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9971249-1154-45ab-b8a5-656d4da7ee08 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:44.776908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c9971249-1154-45ab-b8a5-656d4da7ee08 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:44.787150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9971249-1154-45ab-b8a5-656d4da7ee08 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:44.787650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9971249-1154-45ab-b8a5-656d4da7ee08 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:44.788089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9971249-1154-45ab-b8a5-656d4da7ee08 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:44.788812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9971249-1154-45ab-b8a5-656d4da7ee08 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:44.789273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9971249-1154-45ab-b8a5-656d4da7ee08 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:44.789702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9971249-1154-45ab-b8a5-656d4da7ee08 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:44.880581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ca721955-d844-4c46-b627-8dfaa98d13bc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ca721955-d844-4c46-b627-8dfaa98d13bc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 160 Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "c201add2-2905-4a42-a119-5f0f7b3c5bb7"}]}} Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': '', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'networks': [{'uuid': 'c201add2-2905-4a42-a119-5f0f7b3c5bb7'}]}}} Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi '' Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:45:44.885196 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:45:44.890542 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:45:44.890542 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 18 11:45:44.890542 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:44.890542 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:44.890542 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:44.890542 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:44.890542 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:44.890542 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:44.890542 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:45:44.890542 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:45:44.890542 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 18 11:45:44.890542 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:44.893165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ca721955-d844-4c46-b627-8dfaa98d13bc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:44.895523 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ca721955-d844-4c46-b627-8dfaa98d13bc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.018175 Aug 18 11:45:44.899287 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2148/4540] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:44 2022] POST /compute/v2.1/servers => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:45:44.908996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-90db6db7-cbb8-4e7e-ae62-b46cb4a980f4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:44.910221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-90db6db7-cbb8-4e7e-ae62-b46cb4a980f4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:44.921518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90db6db7-cbb8-4e7e-ae62-b46cb4a980f4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:44.922421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90db6db7-cbb8-4e7e-ae62-b46cb4a980f4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:44.923465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90db6db7-cbb8-4e7e-ae62-b46cb4a980f4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:44.924499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90db6db7-cbb8-4e7e-ae62-b46cb4a980f4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:44.925322 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90db6db7-cbb8-4e7e-ae62-b46cb4a980f4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:44.925980 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-90db6db7-cbb8-4e7e-ae62-b46cb4a980f4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:45.029242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c9971249-1154-45ab-b8a5-656d4da7ee08 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:45.049012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c9971249-1154-45ab-b8a5-656d4da7ee08 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:45.052163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c9971249-1154-45ab-b8a5-656d4da7ee08 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:45.054459 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c9971249-1154-45ab-b8a5-656d4da7ee08 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1340 microversion: 2.20 time: 0.281386 Aug 18 11:45:45.063921 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2393/4541] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:45:44 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1340 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:45:45.345853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-232b3f81-b035-4495-ad1d-9a2e6e0f74fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:45.346711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-232b3f81-b035-4495-ad1d-9a2e6e0f74fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:45.357547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-232b3f81-b035-4495-ad1d-9a2e6e0f74fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:45.358359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-232b3f81-b035-4495-ad1d-9a2e6e0f74fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:45.359063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-232b3f81-b035-4495-ad1d-9a2e6e0f74fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:45.360255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-232b3f81-b035-4495-ad1d-9a2e6e0f74fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:45.361029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-232b3f81-b035-4495-ad1d-9a2e6e0f74fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:45.361676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-232b3f81-b035-4495-ad1d-9a2e6e0f74fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:45.476276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-232b3f81-b035-4495-ad1d-9a2e6e0f74fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:45.499939 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-232b3f81-b035-4495-ad1d-9a2e6e0f74fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1278 microversion: 2.1 time: 0.148803 Aug 18 11:45:45.502111 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2394/4542] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:45 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:45.522065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-90db6db7-cbb8-4e7e-ae62-b46cb4a980f4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:45.536191 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-90db6db7-cbb8-4e7e-ae62-b46cb4a980f4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.632537 Aug 18 11:45:45.554990 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2149/4543] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:44 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:45.582210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-15263321-a25b-4bbc-ac5d-6a56ac59ab5d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:45.583233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-15263321-a25b-4bbc-ac5d-6a56ac59ab5d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:45.600046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15263321-a25b-4bbc-ac5d-6a56ac59ab5d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:45.600335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15263321-a25b-4bbc-ac5d-6a56ac59ab5d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:45.600945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15263321-a25b-4bbc-ac5d-6a56ac59ab5d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:45.602011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15263321-a25b-4bbc-ac5d-6a56ac59ab5d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:45.605123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15263321-a25b-4bbc-ac5d-6a56ac59ab5d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:45.605793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15263321-a25b-4bbc-ac5d-6a56ac59ab5d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:45.915666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-15263321-a25b-4bbc-ac5d-6a56ac59ab5d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:45.928653 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-15263321-a25b-4bbc-ac5d-6a56ac59ab5d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.350963 Aug 18 11:45:45.942788 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2395/4544] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:45 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:45.955344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a9bc329-d757-4e25-aee4-8f4c7802f82a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:45.957091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0a9bc329-d757-4e25-aee4-8f4c7802f82a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: f12aeb01-c176-47c0-b672-d0d266a04198] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:45.966521 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-0a9bc329-d757-4e25-aee4-8f4c7802f82a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance f12aeb01-c176-47c0-b672-d0d266a04198 could not be found. Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a9bc329-d757-4e25-aee4-8f4c7802f82a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/f12aeb01-c176-47c0-b672-d0d266a04198/action HTTP/1.1 Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 14 Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: {"shelve": {}} Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance f12aeb01-c176-47c0-b672-d0d266a04198 could not be found. Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'f12aeb01-c176-47c0-b672-d0d266a04198', 'body': {'shelve': {}}} Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f12aeb01-c176-47c0-b672-d0d266a04198 could not be found. Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12aeb01-c176-47c0-b672-d0d266a04198 could not be found. Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:45.969307 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:45.972950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:45.972950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:45.972950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12aeb01-c176-47c0-b672-d0d266a04198 could not be found. Aug 18 11:45:45.972950 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:45.975336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a9bc329-d757-4e25-aee4-8f4c7802f82a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance f12aeb01-c176-47c0-b672-d0d266a04198 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:45.976425 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0a9bc329-d757-4e25-aee4-8f4c7802f82a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/f12aeb01-c176-47c0-b672-d0d266a04198/action" status: 404 len: 111 microversion: 2.1 time: 0.026884 Aug 18 11:45:45.981941 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2150/4545] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:45 2022] POST /compute/v2.1/servers/f12aeb01-c176-47c0-b672-d0d266a04198/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:45:45.988433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a5b9a0b2-7b18-4f88-acb0-bc0bf85952dd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:45.989948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a5b9a0b2-7b18-4f88-acb0-bc0bf85952dd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:46.001378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5b9a0b2-7b18-4f88-acb0-bc0bf85952dd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:46.003110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5b9a0b2-7b18-4f88-acb0-bc0bf85952dd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:46.004017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5b9a0b2-7b18-4f88-acb0-bc0bf85952dd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:46.006028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5b9a0b2-7b18-4f88-acb0-bc0bf85952dd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:46.009296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5b9a0b2-7b18-4f88-acb0-bc0bf85952dd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:46.011790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5b9a0b2-7b18-4f88-acb0-bc0bf85952dd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:46.090921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d345f4cf-4b8b-4045-bc56-70489a2a1757 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:46.093394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d345f4cf-4b8b-4045-bc56-70489a2a1757 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:46.111142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d345f4cf-4b8b-4045-bc56-70489a2a1757 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:46.112279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d345f4cf-4b8b-4045-bc56-70489a2a1757 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:46.113220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d345f4cf-4b8b-4045-bc56-70489a2a1757 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:46.114248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d345f4cf-4b8b-4045-bc56-70489a2a1757 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:46.115452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d345f4cf-4b8b-4045-bc56-70489a2a1757 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:46.118126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d345f4cf-4b8b-4045-bc56-70489a2a1757 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:46.355362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d345f4cf-4b8b-4045-bc56-70489a2a1757 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:46.364498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d345f4cf-4b8b-4045-bc56-70489a2a1757 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:46.366020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d345f4cf-4b8b-4045-bc56-70489a2a1757 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:46.375537 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d345f4cf-4b8b-4045-bc56-70489a2a1757 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1340 microversion: 2.20 time: 0.292383 Aug 18 11:45:46.376154 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2151/4546] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:45:46 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1340 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:45:46.704671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a5b9a0b2-7b18-4f88-acb0-bc0bf85952dd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:46.724603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1203551617", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "d886c9e8-fe02-4a26-9d92-9059222774d5"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:46.725804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:46.732306 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a5b9a0b2-7b18-4f88-acb0-bc0bf85952dd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.748740 Aug 18 11:45:46.734922 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2396/4547] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:45 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:46.759472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6cf63ef4-c604-4fd7-9bad-4030ac3e91ac tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:46.765398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6cf63ef4-c604-4fd7-9bad-4030ac3e91ac tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:46.776929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cf63ef4-c604-4fd7-9bad-4030ac3e91ac tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:46.777760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cf63ef4-c604-4fd7-9bad-4030ac3e91ac tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:46.781906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cf63ef4-c604-4fd7-9bad-4030ac3e91ac tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:46.783035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cf63ef4-c604-4fd7-9bad-4030ac3e91ac tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:46.799110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cf63ef4-c604-4fd7-9bad-4030ac3e91ac tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:46.800052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cf63ef4-c604-4fd7-9bad-4030ac3e91ac tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:46.860414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] validate_networks() for [('d886c9e8-fe02-4a26-9d92-9059222774d5', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:45:47.418117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6cf63ef4-c604-4fd7-9bad-4030ac3e91ac tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:47.436294 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6cf63ef4-c604-4fd7-9bad-4030ac3e91ac tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1320 microversion: 2.1 time: 0.699873 Aug 18 11:45:47.437844 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2397/4548] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:46 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1320 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:47.445200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0fd96c36-09b4-4f88-aad4-61e836cc38c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:47.452302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0fd96c36-09b4-4f88-aad4-61e836cc38c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:47.463482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fd96c36-09b4-4f88-aad4-61e836cc38c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:47.464657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fd96c36-09b4-4f88-aad4-61e836cc38c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:47.464657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fd96c36-09b4-4f88-aad4-61e836cc38c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:47.465778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fd96c36-09b4-4f88-aad4-61e836cc38c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:47.466252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fd96c36-09b4-4f88-aad4-61e836cc38c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:47.466722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fd96c36-09b4-4f88-aad4-61e836cc38c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:47.892242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0fd96c36-09b4-4f88-aad4-61e836cc38c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:47.917561 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0fd96c36-09b4-4f88-aad4-61e836cc38c7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.473395 Aug 18 11:45:47.918969 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2398/4549] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:47 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:47.928429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b94a6a99-6044-43bb-950d-c38abcc4a1e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:47.929065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b94a6a99-6044-43bb-950d-c38abcc4a1e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:47.948651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b94a6a99-6044-43bb-950d-c38abcc4a1e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:47.952935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b94a6a99-6044-43bb-950d-c38abcc4a1e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:47.953823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b94a6a99-6044-43bb-950d-c38abcc4a1e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:47.955644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b94a6a99-6044-43bb-950d-c38abcc4a1e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:47.957227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b94a6a99-6044-43bb-950d-c38abcc4a1e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:47.959404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b94a6a99-6044-43bb-950d-c38abcc4a1e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:48.373119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b94a6a99-6044-43bb-950d-c38abcc4a1e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:48.390358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b94a6a99-6044-43bb-950d-c38abcc4a1e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:48.393279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b94a6a99-6044-43bb-950d-c38abcc4a1e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:48.395840 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b94a6a99-6044-43bb-950d-c38abcc4a1e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1408 microversion: 2.20 time: 0.476122 Aug 18 11:45:48.435496 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2399/4550] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:45:47 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1408 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:45:48.463601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f4d0d268-e121-4544-b92e-d10b33b2ceae tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:48.465572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f4d0d268-e121-4544-b92e-d10b33b2ceae tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:48.492350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4d0d268-e121-4544-b92e-d10b33b2ceae tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:48.494193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4d0d268-e121-4544-b92e-d10b33b2ceae tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:48.496554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4d0d268-e121-4544-b92e-d10b33b2ceae tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:48.498736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4d0d268-e121-4544-b92e-d10b33b2ceae tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:48.499412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4d0d268-e121-4544-b92e-d10b33b2ceae tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:48.500086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4d0d268-e121-4544-b92e-d10b33b2ceae tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:48.553773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-f4d0d268-e121-4544-b92e-d10b33b2ceae tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lazy-loading 'flavor' on Instance uuid 0eb953a8-e8bd-44d1-9264-75ae577c5940 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:45:48.981885 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f4d0d268-e121-4544-b92e-d10b33b2ceae tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action" status: 202 len: 0 microversion: 2.1 time: 0.544843 Aug 18 11:45:48.987535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:45:48.988881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:45:48.989613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:45:48.990017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:45:48.990793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:45:49.004460 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2400/4551] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:45:48 2022] POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:45:49.014917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dbf2a72b-f4a2-4c64-bc4a-5f5c51f4eba6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:49.015987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dbf2a72b-f4a2-4c64-bc4a-5f5c51f4eba6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:49.016862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:49.017571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:49.019668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:49.020741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:49.022339 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:49.029912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:49.043744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbf2a72b-f4a2-4c64-bc4a-5f5c51f4eba6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:49.044254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbf2a72b-f4a2-4c64-bc4a-5f5c51f4eba6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:49.044722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbf2a72b-f4a2-4c64-bc4a-5f5c51f4eba6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:49.050953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbf2a72b-f4a2-4c64-bc4a-5f5c51f4eba6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:49.051615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbf2a72b-f4a2-4c64-bc4a-5f5c51f4eba6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:49.052085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbf2a72b-f4a2-4c64-bc4a-5f5c51f4eba6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:49.071030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Getting quotas for project 69040d9d34cd4d608dfc842f78ca7532. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:45:49.084074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Getting quotas for user 265d100fde6346df81d44c014acd2529 and project 69040d9d34cd4d608dfc842f78ca7532. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:45:49.122663 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:45:49.125005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:45:49.219797 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bc45d024-6057-4978-a9f1-61d9d88aa27c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.828003 Aug 18 11:45:49.221615 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2152/4552] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:45:49.239204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2d161b0c-fcfc-47bc-8900-29a963583675 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:49.240492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2d161b0c-fcfc-47bc-8900-29a963583675 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:49.272044 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d161b0c-fcfc-47bc-8900-29a963583675 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:49.272697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d161b0c-fcfc-47bc-8900-29a963583675 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:49.275625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d161b0c-fcfc-47bc-8900-29a963583675 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:49.276970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d161b0c-fcfc-47bc-8900-29a963583675 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:49.278492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d161b0c-fcfc-47bc-8900-29a963583675 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:49.279884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2d161b0c-fcfc-47bc-8900-29a963583675 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:49.721772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2d161b0c-fcfc-47bc-8900-29a963583675 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:49.736126 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2d161b0c-fcfc-47bc-8900-29a963583675 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1511 microversion: 2.1 time: 0.511960 Aug 18 11:45:49.751469 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2153/4553] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:49 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1511 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:49.755919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-75cc31d2-5b03-42f5-82f6-715f9cea0f04 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:49.757829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-75cc31d2-5b03-42f5-82f6-715f9cea0f04 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:49.889250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-75cc31d2-5b03-42f5-82f6-715f9cea0f04 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:49.912309 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-75cc31d2-5b03-42f5-82f6-715f9cea0f04 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1225 microversion: 2.1 time: 0.169567 Aug 18 11:45:49.953220 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2154/4554] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:49 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1225 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:49.980504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9d988bc4-7836-47a0-974a-9facc1f5833b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:49.981537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9d988bc4-7836-47a0-974a-9facc1f5833b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:50.006840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d988bc4-7836-47a0-974a-9facc1f5833b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:50.011625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d988bc4-7836-47a0-974a-9facc1f5833b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:50.013786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d988bc4-7836-47a0-974a-9facc1f5833b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:50.014859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d988bc4-7836-47a0-974a-9facc1f5833b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:50.015154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d988bc4-7836-47a0-974a-9facc1f5833b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:50.018952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d988bc4-7836-47a0-974a-9facc1f5833b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:50.265525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dbf2a72b-f4a2-4c64-bc4a-5f5c51f4eba6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:50.289275 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dbf2a72b-f4a2-4c64-bc4a-5f5c51f4eba6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1320 microversion: 2.1 time: 1.284575 Aug 18 11:45:50.295960 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2401/4555] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:49 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1320 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:50.307892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2704c30-1e00-42a2-8157-75450445f89f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:50.310856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b2704c30-1e00-42a2-8157-75450445f89f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:50.327212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2704c30-1e00-42a2-8157-75450445f89f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:50.328077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2704c30-1e00-42a2-8157-75450445f89f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:50.328866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2704c30-1e00-42a2-8157-75450445f89f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:50.330391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2704c30-1e00-42a2-8157-75450445f89f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:50.331565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2704c30-1e00-42a2-8157-75450445f89f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:50.332006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2704c30-1e00-42a2-8157-75450445f89f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:50.543670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-b2704c30-1e00-42a2-8157-75450445f89f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lazy-loading 'services' on Instance uuid 0f554895-d3bd-4694-ad7a-1f23d21ed51a {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:45:50.698230 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b2704c30-1e00-42a2-8157-75450445f89f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/os-volume_attachments/1d46bfb6-8bdc-4333-9c69-23070c8d0d54" status: 202 len: 0 microversion: 2.1 time: 0.399952 Aug 18 11:45:50.700441 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2402/4556] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 11:45:50 2022] DELETE /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/os-volume_attachments/1d46bfb6-8bdc-4333-9c69-23070c8d0d54 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:45:50.759253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-bb87e245-13c8-4bc1-9f59-49d7ee126b79 req-9092eaa5-8f16-4ca9-9735-a6f108eaa3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43537e52-9c93-4713-93e8-e3db967345f9", "tag": "c787a259-c8af-4aa7-b345-05f25da2b652"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:50.803669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bb87e245-13c8-4bc1-9f59-49d7ee126b79 req-9092eaa5-8f16-4ca9-9735-a6f108eaa3a9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:50.806905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bb87e245-13c8-4bc1-9f59-49d7ee126b79 req-9092eaa5-8f16-4ca9-9735-a6f108eaa3a9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:50.813540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bb87e245-13c8-4bc1-9f59-49d7ee126b79 req-9092eaa5-8f16-4ca9-9735-a6f108eaa3a9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:50.876347 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-bb87e245-13c8-4bc1-9f59-49d7ee126b79 req-9092eaa5-8f16-4ca9-9735-a6f108eaa3a9 service nova] Creating event network-changed:c787a259-c8af-4aa7-b345-05f25da2b652 for instance 43537e52-9c93-4713-93e8-e3db967345f9 on n-h2-853611-3 Aug 18 11:45:50.904478 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-bb87e245-13c8-4bc1-9f59-49d7ee126b79 req-9092eaa5-8f16-4ca9-9735-a6f108eaa3a9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158948 Aug 18 11:45:50.905716 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2403/4557] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:45:50.924465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-182d5659-17a6-448b-9d49-5ca595462305 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:50.927075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-182d5659-17a6-448b-9d49-5ca595462305 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:50.941135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-182d5659-17a6-448b-9d49-5ca595462305 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:50.942014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-182d5659-17a6-448b-9d49-5ca595462305 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:50.942709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-182d5659-17a6-448b-9d49-5ca595462305 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:50.943691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-182d5659-17a6-448b-9d49-5ca595462305 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:50.945008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-182d5659-17a6-448b-9d49-5ca595462305 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:50.945971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-182d5659-17a6-448b-9d49-5ca595462305 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:51.243172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9d988bc4-7836-47a0-974a-9facc1f5833b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:51.261721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9d988bc4-7836-47a0-974a-9facc1f5833b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:51.263299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9d988bc4-7836-47a0-974a-9facc1f5833b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:51.269247 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9d988bc4-7836-47a0-974a-9facc1f5833b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1408 microversion: 2.20 time: 1.307710 Aug 18 11:45:51.271281 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2155/4558] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:45:49 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1408 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:45:51.278774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4ab2d2ee-721f-4b96-a76b-633cb92cc02b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:51.283162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4ab2d2ee-721f-4b96-a76b-633cb92cc02b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:51.298878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ab2d2ee-721f-4b96-a76b-633cb92cc02b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:51.303512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ab2d2ee-721f-4b96-a76b-633cb92cc02b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:51.304162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ab2d2ee-721f-4b96-a76b-633cb92cc02b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:51.305085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ab2d2ee-721f-4b96-a76b-633cb92cc02b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:51.305849 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ab2d2ee-721f-4b96-a76b-633cb92cc02b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:51.306462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ab2d2ee-721f-4b96-a76b-633cb92cc02b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:51.503562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:51.581513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-182d5659-17a6-448b-9d49-5ca595462305 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:51.596372 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-182d5659-17a6-448b-9d49-5ca595462305 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1511 microversion: 2.1 time: 0.687665 Aug 18 11:45:51.597026 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2404/4559] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:50 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1511 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:51.604686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-418724c7-1e0e-4d20-ae8a-0cccd50134dd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:51.613684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-418724c7-1e0e-4d20-ae8a-0cccd50134dd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:51.628520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-418724c7-1e0e-4d20-ae8a-0cccd50134dd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:51.630190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-418724c7-1e0e-4d20-ae8a-0cccd50134dd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:51.630687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-418724c7-1e0e-4d20-ae8a-0cccd50134dd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:51.636616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-418724c7-1e0e-4d20-ae8a-0cccd50134dd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:51.637274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-418724c7-1e0e-4d20-ae8a-0cccd50134dd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:51.637725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-418724c7-1e0e-4d20-ae8a-0cccd50134dd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:51.737976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4ab2d2ee-721f-4b96-a76b-633cb92cc02b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:51.753999 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4ab2d2ee-721f-4b96-a76b-633cb92cc02b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1285 microversion: 2.1 time: 0.481382 Aug 18 11:45:51.754697 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2156/4560] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:51 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1285 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:52.248874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-418724c7-1e0e-4d20-ae8a-0cccd50134dd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:52.264301 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-418724c7-1e0e-4d20-ae8a-0cccd50134dd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1320 microversion: 2.1 time: 0.663448 Aug 18 11:45:52.277512 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2405/4561] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:51 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1320 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:52.310149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-de63acd9-970f-43fd-bd4e-26f9bcfb36b8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:52.311633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-de63acd9-970f-43fd-bd4e-26f9bcfb36b8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:52.339485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de63acd9-970f-43fd-bd4e-26f9bcfb36b8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:52.340177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de63acd9-970f-43fd-bd4e-26f9bcfb36b8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:52.341048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de63acd9-970f-43fd-bd4e-26f9bcfb36b8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:52.342142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de63acd9-970f-43fd-bd4e-26f9bcfb36b8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:52.343697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de63acd9-970f-43fd-bd4e-26f9bcfb36b8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:52.355097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de63acd9-970f-43fd-bd4e-26f9bcfb36b8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:52.619893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-90abb4ec-35c2-4692-bd1e-457a1a5378cb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:52.620806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-90abb4ec-35c2-4692-bd1e-457a1a5378cb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:52.630236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90abb4ec-35c2-4692-bd1e-457a1a5378cb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:52.630775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90abb4ec-35c2-4692-bd1e-457a1a5378cb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:52.631226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90abb4ec-35c2-4692-bd1e-457a1a5378cb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:52.643522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90abb4ec-35c2-4692-bd1e-457a1a5378cb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:52.644052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90abb4ec-35c2-4692-bd1e-457a1a5378cb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:52.644478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90abb4ec-35c2-4692-bd1e-457a1a5378cb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:53.089937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-90abb4ec-35c2-4692-bd1e-457a1a5378cb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:53.105833 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-90abb4ec-35c2-4692-bd1e-457a1a5378cb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1511 microversion: 2.1 time: 0.490508 Aug 18 11:45:53.107105 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2406/4562] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:52 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1511 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:53.116029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ea16f85a-0a1b-4006-b264-da6f64ba12ec tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:53.118668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ea16f85a-0a1b-4006-b264-da6f64ba12ec tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:53.137302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea16f85a-0a1b-4006-b264-da6f64ba12ec tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:53.139019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea16f85a-0a1b-4006-b264-da6f64ba12ec tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:53.143545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea16f85a-0a1b-4006-b264-da6f64ba12ec tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:53.144547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea16f85a-0a1b-4006-b264-da6f64ba12ec tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:53.146809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea16f85a-0a1b-4006-b264-da6f64ba12ec tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:53.147421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea16f85a-0a1b-4006-b264-da6f64ba12ec tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:53.375574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ea16f85a-0a1b-4006-b264-da6f64ba12ec tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:53.387986 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ea16f85a-0a1b-4006-b264-da6f64ba12ec tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1283 microversion: 2.1 time: 0.279609 Aug 18 11:45:53.390902 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2407/4563] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:53 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1283 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:53.400217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d1b74659-f91d-45a0-8408-60dc0fef5363 req-319c661a-1152-48d8-a55b-47c680a9df3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1706f34c-3b86-4298-be5a-126d7bfeba56", "tag": "7d0067d8-be65-40dd-bc5c-64a302b5b9c1"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:53.430806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d1b74659-f91d-45a0-8408-60dc0fef5363 req-319c661a-1152-48d8-a55b-47c680a9df3d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:53.431253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d1b74659-f91d-45a0-8408-60dc0fef5363 req-319c661a-1152-48d8-a55b-47c680a9df3d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:53.432204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d1b74659-f91d-45a0-8408-60dc0fef5363 req-319c661a-1152-48d8-a55b-47c680a9df3d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:53.482464 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d1b74659-f91d-45a0-8408-60dc0fef5363 req-319c661a-1152-48d8-a55b-47c680a9df3d service nova] Creating event network-changed:7d0067d8-be65-40dd-bc5c-64a302b5b9c1 for instance 1706f34c-3b86-4298-be5a-126d7bfeba56 on n-h2-853611-3 Aug 18 11:45:53.495183 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d1b74659-f91d-45a0-8408-60dc0fef5363 req-319c661a-1152-48d8-a55b-47c680a9df3d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101472 Aug 18 11:45:53.496192 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2408/4564] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:45:53.509689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d18df52-8cd8-41c9-bcac-964b7b98595e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:53.511751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2d18df52-8cd8-41c9-bcac-964b7b98595e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:53.533222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d18df52-8cd8-41c9-bcac-964b7b98595e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:53.535986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d18df52-8cd8-41c9-bcac-964b7b98595e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:53.536667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d18df52-8cd8-41c9-bcac-964b7b98595e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:53.540268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d18df52-8cd8-41c9-bcac-964b7b98595e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:53.540984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d18df52-8cd8-41c9-bcac-964b7b98595e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:53.541915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d18df52-8cd8-41c9-bcac-964b7b98595e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:54.008386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2d18df52-8cd8-41c9-bcac-964b7b98595e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:54.020369 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d18df52-8cd8-41c9-bcac-964b7b98595e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1320 microversion: 2.1 time: 0.522871 Aug 18 11:45:54.023496 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2409/4565] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:53 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1320 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:54.132949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-de63acd9-970f-43fd-bd4e-26f9bcfb36b8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:54.148977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-de63acd9-970f-43fd-bd4e-26f9bcfb36b8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:54.154141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-de63acd9-970f-43fd-bd4e-26f9bcfb36b8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:54.157539 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-de63acd9-970f-43fd-bd4e-26f9bcfb36b8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1408 microversion: 2.20 time: 1.867171 Aug 18 11:45:54.158197 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2157/4566] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:45:52 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1408 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:45:54.164799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1b83f4ca-0cf3-4e5c-adf3-460b962bd16f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:54.165678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1b83f4ca-0cf3-4e5c-adf3-460b962bd16f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:54.187221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b83f4ca-0cf3-4e5c-adf3-460b962bd16f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:54.191348 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b83f4ca-0cf3-4e5c-adf3-460b962bd16f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:54.192876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b83f4ca-0cf3-4e5c-adf3-460b962bd16f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:54.194894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b83f4ca-0cf3-4e5c-adf3-460b962bd16f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:54.195692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b83f4ca-0cf3-4e5c-adf3-460b962bd16f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:54.197030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1b83f4ca-0cf3-4e5c-adf3-460b962bd16f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:54.517128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-290670506", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "4843c366-9249-442c-967c-92f98005fa89"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:54.633809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] validate_networks() for [('4843c366-9249-442c-967c-92f98005fa89', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:45:55.096310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1b83f4ca-0cf3-4e5c-adf3-460b962bd16f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:55.112435 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1b83f4ca-0cf3-4e5c-adf3-460b962bd16f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1511 microversion: 2.1 time: 0.949480 Aug 18 11:45:55.113350 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2158/4567] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:54 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1511 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:55.126100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-47b8a222-7b9b-477a-990c-4fa397106edf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:55.132002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-47b8a222-7b9b-477a-990c-4fa397106edf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:55.151866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:55.170505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47b8a222-7b9b-477a-990c-4fa397106edf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:55.171254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47b8a222-7b9b-477a-990c-4fa397106edf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:55.173721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47b8a222-7b9b-477a-990c-4fa397106edf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:55.174819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47b8a222-7b9b-477a-990c-4fa397106edf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:55.180401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47b8a222-7b9b-477a-990c-4fa397106edf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:55.180891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-47b8a222-7b9b-477a-990c-4fa397106edf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:55.887639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-47b8a222-7b9b-477a-990c-4fa397106edf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:55.896455 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-47b8a222-7b9b-477a-990c-4fa397106edf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1325 microversion: 2.1 time: 0.780777 Aug 18 11:45:55.897056 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2159/4568] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:55 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1325 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:55.918457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-938a3b0d-b04b-469f-8cee-253ff67c4eb1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:55.925908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-938a3b0d-b04b-469f-8cee-253ff67c4eb1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:55.948119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-938a3b0d-b04b-469f-8cee-253ff67c4eb1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:55.950143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-938a3b0d-b04b-469f-8cee-253ff67c4eb1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:55.950875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-938a3b0d-b04b-469f-8cee-253ff67c4eb1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:55.955252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-938a3b0d-b04b-469f-8cee-253ff67c4eb1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:55.955946 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-938a3b0d-b04b-469f-8cee-253ff67c4eb1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:55.957551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-938a3b0d-b04b-469f-8cee-253ff67c4eb1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:56.031369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:45:56.031855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:45:56.032268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:45:56.032851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:45:56.033270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:45:56.060699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:56.061466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:56.061915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:56.062691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:56.063161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:56.063595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:56.101343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Getting quotas for project 7436cf03ec16499b904dce330bb5f0dc. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:45:56.115179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Getting quotas for user 1f3abf383267459f998256c475d7e1db and project 7436cf03ec16499b904dce330bb5f0dc. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:45:56.162209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:45:56.179112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:45:56.320900 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-57d3758a-afb1-41f5-ab70-06da260f0d27 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.283305 Aug 18 11:45:56.325663 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2410/4569] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:45:56.338903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-998cba18-4a25-4d43-abc4-985c8ec22068 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:56.339549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-998cba18-4a25-4d43-abc4-985c8ec22068 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:56.359501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-998cba18-4a25-4d43-abc4-985c8ec22068 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:56.360421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-998cba18-4a25-4d43-abc4-985c8ec22068 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:56.361003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-998cba18-4a25-4d43-abc4-985c8ec22068 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:56.363533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-998cba18-4a25-4d43-abc4-985c8ec22068 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:56.364162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-998cba18-4a25-4d43-abc4-985c8ec22068 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:56.368515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-998cba18-4a25-4d43-abc4-985c8ec22068 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:56.661160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-998cba18-4a25-4d43-abc4-985c8ec22068 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:56.673818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-998cba18-4a25-4d43-abc4-985c8ec22068 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:56.675569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-998cba18-4a25-4d43-abc4-985c8ec22068 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:56.677242 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-998cba18-4a25-4d43-abc4-985c8ec22068 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1408 microversion: 2.20 time: 0.350013 Aug 18 11:45:56.677822 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2411/4570] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:45:56 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1408 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:45:56.708398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8298c9b3-501b-4795-92a6-c825481a0487 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:56.709342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8298c9b3-501b-4795-92a6-c825481a0487 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:56.733011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8298c9b3-501b-4795-92a6-c825481a0487 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:56.733886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8298c9b3-501b-4795-92a6-c825481a0487 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:56.734543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8298c9b3-501b-4795-92a6-c825481a0487 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:56.737811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8298c9b3-501b-4795-92a6-c825481a0487 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:56.749967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8298c9b3-501b-4795-92a6-c825481a0487 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:56.750932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8298c9b3-501b-4795-92a6-c825481a0487 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:57.057894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8298c9b3-501b-4795-92a6-c825481a0487 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:57.061987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:57.070368 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8298c9b3-501b-4795-92a6-c825481a0487 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1511 microversion: 2.1 time: 0.391160 Aug 18 11:45:57.071424 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2412/4571] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:56 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1511 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:57.410788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3ace7ae0-e19c-450d-8079-36d7def36ef3 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1051410957", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:57.414346 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-3ace7ae0-e19c-450d-8079-36d7def36ef3 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] HTTP exception thrown: min_count must be <= max_count Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3ace7ae0-e19c-450d-8079-36d7def36ef3 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Request method failure captured: Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 184 Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iZzNWNs6diphHoYKKFrnbYXw-4-t6YjNIfdg-oMBok5stX74bnblHwD26QDWQF0Llot7sK1b4KJ6xjq0_Wdxz-6g0nQKQtgdrCCL5wrVK9q20zfvDHnWGX7ncIuMFavOJJD3n1HzUCKM4M6oVamiGxuo-dRWI3OmMMsu-rEosZISrM Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 301919737c544f5db4039685a97d1d0a Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/301919737c544f5db4039685a97d1d0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/301919737c544f5db4039685a97d1d0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_301919737c544f5db4039685a97d1d0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/301919737c544f5db4039685a97d1d0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 301919737c544f5db4039685a97d1d0a Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-MultipleCreateNegativeTestJSON-111232221-project Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: a715b4ff70c44dac9c42aa7f58ea95dc Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-111232221-project Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1051410957", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: exception: min_count must be <= max_count Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1051410957', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 18 11:45:57.416966 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:57.421720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3ace7ae0-e19c-450d-8079-36d7def36ef3 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Returning 400 to user: min_count must be <= max_count {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:57.423575 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3ace7ae0-e19c-450d-8079-36d7def36ef3 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.350147 Aug 18 11:45:57.426249 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2413/4572] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:57 2022] POST /compute/v2.1/servers => generated 74 bytes in 354 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 18 11:45:57.466383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59b7580c-b399-42c3-b050-b1257bb64f0a tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:57.468290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59b7580c-b399-42c3-b050-b1257bb64f0a tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:57.598647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-59b7580c-b399-42c3-b050-b1257bb64f0a tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:57.607248 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59b7580c-b399-42c3-b050-b1257bb64f0a tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1223 microversion: 2.1 time: 0.178477 Aug 18 11:45:57.610662 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2414/4573] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:57 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1223 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:57.619918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5e4e4f93-1c36-46b8-850e-c2fdc65ffc1b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:57.622131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5e4e4f93-1c36-46b8-850e-c2fdc65ffc1b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:57.632548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e4e4f93-1c36-46b8-850e-c2fdc65ffc1b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:57.633065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e4e4f93-1c36-46b8-850e-c2fdc65ffc1b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:57.633483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e4e4f93-1c36-46b8-850e-c2fdc65ffc1b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:57.640894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e4e4f93-1c36-46b8-850e-c2fdc65ffc1b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:57.643510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e4e4f93-1c36-46b8-850e-c2fdc65ffc1b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:57.644167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e4e4f93-1c36-46b8-850e-c2fdc65ffc1b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:57.695833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-938a3b0d-b04b-469f-8cee-253ff67c4eb1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:57.717780 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-938a3b0d-b04b-469f-8cee-253ff67c4eb1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1320 microversion: 2.1 time: 1.808879 Aug 18 11:45:57.735674 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2160/4574] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:55 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1320 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:57.742259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dff08242-fed4-49a0-857d-2534ea110bb1 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1685920164", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "max_count": 0}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dff08242-fed4-49a0-857d-2534ea110bb1 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Request method failure captured: Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 168 Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iZzNWNs6diphHoYKKFrnbYXw-4-t6YjNIfdg-oMBok5stX74bnblHwD26QDWQF0Llot7sK1b4KJ6xjq0_Wdxz-6g0nQKQtgdrCCL5wrVK9q20zfvDHnWGX7ncIuMFavOJJD3n1HzUCKM4M6oVamiGxuo-dRWI3OmMMsu-rEosZISrM Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 301919737c544f5db4039685a97d1d0a Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/301919737c544f5db4039685a97d1d0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/301919737c544f5db4039685a97d1d0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_301919737c544f5db4039685a97d1d0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/301919737c544f5db4039685a97d1d0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 301919737c544f5db4039685a97d1d0a Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-MultipleCreateNegativeTestJSON-111232221-project Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: a715b4ff70c44dac9c42aa7f58ea95dc Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-111232221-project Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1685920164", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "max_count": 0}} Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1685920164', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'max_count': 0}}} Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 0 Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:45:57.757987 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 18 11:45:57.763319 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:45:57.770371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dff08242-fed4-49a0-857d-2534ea110bb1 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:57.776533 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dff08242-fed4-49a0-857d-2534ea110bb1 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.039178 Aug 18 11:45:57.798685 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2161/4575] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:57 2022] POST /compute/v2.1/servers => generated 130 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:45:57.805105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7d54f841-6583-48e4-bd1a-54a0d5bac65c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:57.813975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7d54f841-6583-48e4-bd1a-54a0d5bac65c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:57.829614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d54f841-6583-48e4-bd1a-54a0d5bac65c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:57.839116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d54f841-6583-48e4-bd1a-54a0d5bac65c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:57.839868 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d54f841-6583-48e4-bd1a-54a0d5bac65c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:57.841701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d54f841-6583-48e4-bd1a-54a0d5bac65c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:57.842405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d54f841-6583-48e4-bd1a-54a0d5bac65c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:57.843086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d54f841-6583-48e4-bd1a-54a0d5bac65c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:57.856045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:57.939108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5e4e4f93-1c36-46b8-850e-c2fdc65ffc1b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:57.949026 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5e4e4f93-1c36-46b8-850e-c2fdc65ffc1b tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1325 microversion: 2.1 time: 0.333602 Aug 18 11:45:57.950920 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2415/4576] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:57 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1325 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:57.972608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b543ea8-c8ef-4353-a170-b581e88a2481 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1102197855", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "max_count": 2.5}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b543ea8-c8ef-4353-a170-b581e88a2481 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Request method failure captured: Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 170 Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iZzNWNs6diphHoYKKFrnbYXw-4-t6YjNIfdg-oMBok5stX74bnblHwD26QDWQF0Llot7sK1b4KJ6xjq0_Wdxz-6g0nQKQtgdrCCL5wrVK9q20zfvDHnWGX7ncIuMFavOJJD3n1HzUCKM4M6oVamiGxuo-dRWI3OmMMsu-rEosZISrM Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 301919737c544f5db4039685a97d1d0a Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/301919737c544f5db4039685a97d1d0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/301919737c544f5db4039685a97d1d0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_301919737c544f5db4039685a97d1d0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/301919737c544f5db4039685a97d1d0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 301919737c544f5db4039685a97d1d0a Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-MultipleCreateNegativeTestJSON-111232221-project Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: a715b4ff70c44dac9c42aa7f58ea95dc Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-111232221-project Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1102197855", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "max_count": 2.5}} Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1102197855', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'max_count': 2.5}}} Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 2.5 Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:45:57.999663 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 18 11:45:58.004009 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.006609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b543ea8-c8ef-4353-a170-b581e88a2481 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:58.009012 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2b543ea8-c8ef-4353-a170-b581e88a2481 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.056093 Aug 18 11:45:58.009878 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2416/4577] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:57 2022] POST /compute/v2.1/servers => generated 139 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:45:58.095689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d190a7ba-2526-45ec-944b-ee4405a8f9d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:58.096315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d190a7ba-2526-45ec-944b-ee4405a8f9d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:58.108441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:58.119834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d190a7ba-2526-45ec-944b-ee4405a8f9d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:58.120588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d190a7ba-2526-45ec-944b-ee4405a8f9d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:58.122983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d190a7ba-2526-45ec-944b-ee4405a8f9d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:58.123952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d190a7ba-2526-45ec-944b-ee4405a8f9d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:58.124423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d190a7ba-2526-45ec-944b-ee4405a8f9d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:58.124855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d190a7ba-2526-45ec-944b-ee4405a8f9d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:58.435864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d190a7ba-2526-45ec-944b-ee4405a8f9d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:58.456328 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d190a7ba-2526-45ec-944b-ee4405a8f9d0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1511 microversion: 2.1 time: 0.354314 Aug 18 11:45:58.471824 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2417/4578] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:58 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1511 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:45:58.514174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-00da3c9f-cdee-42c2-ac64-28051e87b49d tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1389824336", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "min_count": 0}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-00da3c9f-cdee-42c2-ac64-28051e87b49d tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Request method failure captured: Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 168 Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iZzNWNs6diphHoYKKFrnbYXw-4-t6YjNIfdg-oMBok5stX74bnblHwD26QDWQF0Llot7sK1b4KJ6xjq0_Wdxz-6g0nQKQtgdrCCL5wrVK9q20zfvDHnWGX7ncIuMFavOJJD3n1HzUCKM4M6oVamiGxuo-dRWI3OmMMsu-rEosZISrM Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 301919737c544f5db4039685a97d1d0a Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/301919737c544f5db4039685a97d1d0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/301919737c544f5db4039685a97d1d0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_301919737c544f5db4039685a97d1d0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/301919737c544f5db4039685a97d1d0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 301919737c544f5db4039685a97d1d0a Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-MultipleCreateNegativeTestJSON-111232221-project Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: a715b4ff70c44dac9c42aa7f58ea95dc Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-111232221-project Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1389824336", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "min_count": 0}} Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1389824336', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'min_count': 0}}} Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 0 Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:45:58.531615 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-00da3c9f-cdee-42c2-ac64-28051e87b49d tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-00da3c9f-cdee-42c2-ac64-28051e87b49d tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.059625 Aug 18 11:45:58.535193 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2418/4579] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:58 2022] POST /compute/v2.1/servers => generated 130 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:45:58.621055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab9a28ec-0656-4781-a600-05cd179cba11 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-228038497", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "min_count": 2.5}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab9a28ec-0656-4781-a600-05cd179cba11 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Request method failure captured: Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 169 Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iZzNWNs6diphHoYKKFrnbYXw-4-t6YjNIfdg-oMBok5stX74bnblHwD26QDWQF0Llot7sK1b4KJ6xjq0_Wdxz-6g0nQKQtgdrCCL5wrVK9q20zfvDHnWGX7ncIuMFavOJJD3n1HzUCKM4M6oVamiGxuo-dRWI3OmMMsu-rEosZISrM Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 301919737c544f5db4039685a97d1d0a Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/301919737c544f5db4039685a97d1d0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/301919737c544f5db4039685a97d1d0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_301919737c544f5db4039685a97d1d0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/301919737c544f5db4039685a97d1d0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 301919737c544f5db4039685a97d1d0a Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-111232221 Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-MultipleCreateNegativeTestJSON-111232221-project Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: a715b4ff70c44dac9c42aa7f58ea95dc Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-111232221-project Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-228038497", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "min_count": 2.5}} Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-228038497', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'min_count': 2.5}}} Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 2.5 Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:45:58.630226 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab9a28ec-0656-4781-a600-05cd179cba11 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:45:58.634112 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab9a28ec-0656-4781-a600-05cd179cba11 tempest-MultipleCreateNegativeTestJSON-111232221 tempest-MultipleCreateNegativeTestJSON-111232221-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017015 Aug 18 11:45:58.636451 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2419/4580] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:45:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:45:58.663969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7aecbff-8f8e-4e73-ba54-b1801b346a1e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:58.668897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a7aecbff-8f8e-4e73-ba54-b1801b346a1e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:58.697481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7aecbff-8f8e-4e73-ba54-b1801b346a1e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:58.701349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7aecbff-8f8e-4e73-ba54-b1801b346a1e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:58.702262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7aecbff-8f8e-4e73-ba54-b1801b346a1e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:58.705258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7aecbff-8f8e-4e73-ba54-b1801b346a1e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:58.706368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7aecbff-8f8e-4e73-ba54-b1801b346a1e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:58.708388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7aecbff-8f8e-4e73-ba54-b1801b346a1e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:58.848710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a7aecbff-8f8e-4e73-ba54-b1801b346a1e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:58.863666 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a7aecbff-8f8e-4e73-ba54-b1801b346a1e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1275 microversion: 2.1 time: 0.224981 Aug 18 11:45:58.867728 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2420/4581] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:58 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1275 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:58.883489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-87d5c52c-5ff2-4eca-ae89-c0d635915288 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:58.884116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-87d5c52c-5ff2-4eca-ae89-c0d635915288 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:58.901709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87d5c52c-5ff2-4eca-ae89-c0d635915288 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:58.904046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87d5c52c-5ff2-4eca-ae89-c0d635915288 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:58.904789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87d5c52c-5ff2-4eca-ae89-c0d635915288 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:58.905742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87d5c52c-5ff2-4eca-ae89-c0d635915288 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:58.907146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87d5c52c-5ff2-4eca-ae89-c0d635915288 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:58.909506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87d5c52c-5ff2-4eca-ae89-c0d635915288 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:59.038880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:45:59.205382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-87d5c52c-5ff2-4eca-ae89-c0d635915288 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:59.215603 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-87d5c52c-5ff2-4eca-ae89-c0d635915288 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1320 microversion: 2.1 time: 0.346734 Aug 18 11:45:59.219645 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2421/4582] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:58 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1320 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:45:59.229091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-434a2014-750a-45c1-a72e-b03cbc4bb065 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:59.231355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-434a2014-750a-45c1-a72e-b03cbc4bb065 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:59.253116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-434a2014-750a-45c1-a72e-b03cbc4bb065 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:59.253616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-434a2014-750a-45c1-a72e-b03cbc4bb065 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:59.257952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-434a2014-750a-45c1-a72e-b03cbc4bb065 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:59.258729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-434a2014-750a-45c1-a72e-b03cbc4bb065 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:59.259218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-434a2014-750a-45c1-a72e-b03cbc4bb065 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:59.262920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-434a2014-750a-45c1-a72e-b03cbc4bb065 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:59.422565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7d54f841-6583-48e4-bd1a-54a0d5bac65c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:59.436391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7d54f841-6583-48e4-bd1a-54a0d5bac65c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:59.446147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7d54f841-6583-48e4-bd1a-54a0d5bac65c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:45:59.455593 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7d54f841-6583-48e4-bd1a-54a0d5bac65c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1408 microversion: 2.20 time: 1.653002 Aug 18 11:45:59.477751 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2162/4583] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:45:57 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1408 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:45:59.499081 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b5af1c2e-a4dd-48b9-89f5-ea2abd5ff19f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:45:59.506191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b5af1c2e-a4dd-48b9-89f5-ea2abd5ff19f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:45:59.536068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5af1c2e-a4dd-48b9-89f5-ea2abd5ff19f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:59.536897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5af1c2e-a4dd-48b9-89f5-ea2abd5ff19f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:59.538015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5af1c2e-a4dd-48b9-89f5-ea2abd5ff19f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:59.540501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5af1c2e-a4dd-48b9-89f5-ea2abd5ff19f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:45:59.550209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5af1c2e-a4dd-48b9-89f5-ea2abd5ff19f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:45:59.550883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5af1c2e-a4dd-48b9-89f5-ea2abd5ff19f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:45:59.895949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=22 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:00.019391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-434a2014-750a-45c1-a72e-b03cbc4bb065 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:00.035211 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-434a2014-750a-45c1-a72e-b03cbc4bb065 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1325 microversion: 2.1 time: 0.813599 Aug 18 11:46:00.036505 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2422/4584] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:59 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1325 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:00.043880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd28b554-2482-4947-abd9-d7156dc2639e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:00.044807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dd28b554-2482-4947-abd9-d7156dc2639e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:00.076293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd28b554-2482-4947-abd9-d7156dc2639e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:00.079839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd28b554-2482-4947-abd9-d7156dc2639e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:00.086309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd28b554-2482-4947-abd9-d7156dc2639e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:00.091669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd28b554-2482-4947-abd9-d7156dc2639e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:00.094909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd28b554-2482-4947-abd9-d7156dc2639e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:00.095869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd28b554-2482-4947-abd9-d7156dc2639e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:00.217096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd28b554-2482-4947-abd9-d7156dc2639e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:00.231534 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd28b554-2482-4947-abd9-d7156dc2639e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1281 microversion: 2.1 time: 0.190157 Aug 18 11:46:00.232213 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2423/4585] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:00 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1281 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:00.251356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-282d3864-c57e-48bc-a86e-2964c16da565 req-fbf09431-90af-4407-92b2-86daaa3e9444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43537e52-9c93-4713-93e8-e3db967345f9", "name": "network-vif-plugged", "status": "completed", "tag": "c787a259-c8af-4aa7-b345-05f25da2b652"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:00.263321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-282d3864-c57e-48bc-a86e-2964c16da565 req-fbf09431-90af-4407-92b2-86daaa3e9444 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:00.263808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-282d3864-c57e-48bc-a86e-2964c16da565 req-fbf09431-90af-4407-92b2-86daaa3e9444 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:00.264242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-282d3864-c57e-48bc-a86e-2964c16da565 req-fbf09431-90af-4407-92b2-86daaa3e9444 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:00.280716 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-282d3864-c57e-48bc-a86e-2964c16da565 req-fbf09431-90af-4407-92b2-86daaa3e9444 service nova] Creating event network-vif-plugged:c787a259-c8af-4aa7-b345-05f25da2b652 for instance 43537e52-9c93-4713-93e8-e3db967345f9 on n-h2-853611-3 Aug 18 11:46:00.287680 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-282d3864-c57e-48bc-a86e-2964c16da565 req-fbf09431-90af-4407-92b2-86daaa3e9444 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054065 Aug 18 11:46:00.288401 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2424/4586] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:00.306025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c0004679-ab74-4f7d-b3f3-7ac31853c123 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:00.313245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b5af1c2e-a4dd-48b9-89f5-ea2abd5ff19f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:00.317326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c0004679-ab74-4f7d-b3f3-7ac31853c123 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:00.328631 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b5af1c2e-a4dd-48b9-89f5-ea2abd5ff19f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1532 microversion: 2.1 time: 0.843983 Aug 18 11:46:00.329295 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2163/4587] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:45:59 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1532 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:00.342855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0004679-ab74-4f7d-b3f3-7ac31853c123 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:00.343365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0004679-ab74-4f7d-b3f3-7ac31853c123 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:00.343809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0004679-ab74-4f7d-b3f3-7ac31853c123 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:00.344561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0004679-ab74-4f7d-b3f3-7ac31853c123 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:00.345643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0004679-ab74-4f7d-b3f3-7ac31853c123 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:00.346159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0004679-ab74-4f7d-b3f3-7ac31853c123 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:00.489553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-963155e3-c81e-4749-8609-c5112900a972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:00.490201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-963155e3-c81e-4749-8609-c5112900a972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:00.510291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-963155e3-c81e-4749-8609-c5112900a972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:00.510819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-963155e3-c81e-4749-8609-c5112900a972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:00.512677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-963155e3-c81e-4749-8609-c5112900a972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:00.514958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-963155e3-c81e-4749-8609-c5112900a972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:00.518748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-963155e3-c81e-4749-8609-c5112900a972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:00.521404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-963155e3-c81e-4749-8609-c5112900a972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:00.613404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c0004679-ab74-4f7d-b3f3-7ac31853c123 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:00.624406 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c0004679-ab74-4f7d-b3f3-7ac31853c123 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1320 microversion: 2.1 time: 0.334531 Aug 18 11:46:00.641073 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2425/4588] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:00 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:01.062054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b644212-95cf-42ec-9914-f596385255b6 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:01.062054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b644212-95cf-42ec-9914-f596385255b6 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:01.082805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b644212-95cf-42ec-9914-f596385255b6 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:01.083453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b644212-95cf-42ec-9914-f596385255b6 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:01.084135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b644212-95cf-42ec-9914-f596385255b6 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:01.085103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b644212-95cf-42ec-9914-f596385255b6 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:01.085785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b644212-95cf-42ec-9914-f596385255b6 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:01.086287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b644212-95cf-42ec-9914-f596385255b6 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:01.114594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-963155e3-c81e-4749-8609-c5112900a972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:01.123337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-963155e3-c81e-4749-8609-c5112900a972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:01.125604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-963155e3-c81e-4749-8609-c5112900a972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:01.127081 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-963155e3-c81e-4749-8609-c5112900a972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1408 microversion: 2.20 time: 0.644277 Aug 18 11:46:01.127922 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2164/4589] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:46:00 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1408 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:46:01.202262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-262b2a74-91d5-453d-a846-0751214b7dda tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:01.208741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-262b2a74-91d5-453d-a846-0751214b7dda tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:01.209329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-262b2a74-91d5-453d-a846-0751214b7dda tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:01.209904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-262b2a74-91d5-453d-a846-0751214b7dda tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:01.239627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-262b2a74-91d5-453d-a846-0751214b7dda tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Going to try to stop instance {{(pid=122209) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 11:46:01.300242 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-262b2a74-91d5-453d-a846-0751214b7dda tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "POST /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/action" status: 202 len: 0 microversion: 2.1 time: 0.101679 Aug 18 11:46:01.303052 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2165/4590] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:46:01 2022] POST /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:46:01.313795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4db190f2-94a3-4298-a649-f533f1b5e3f6 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:01.314700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4db190f2-94a3-4298-a649-f533f1b5e3f6 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:01.336806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4db190f2-94a3-4298-a649-f533f1b5e3f6 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:01.338665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4db190f2-94a3-4298-a649-f533f1b5e3f6 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:01.339355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4db190f2-94a3-4298-a649-f533f1b5e3f6 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:01.340390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4db190f2-94a3-4298-a649-f533f1b5e3f6 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:01.340979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4db190f2-94a3-4298-a649-f533f1b5e3f6 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:01.341516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4db190f2-94a3-4298-a649-f533f1b5e3f6 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:01.475116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b644212-95cf-42ec-9914-f596385255b6 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:01.482464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4db190f2-94a3-4298-a649-f533f1b5e3f6 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:01.494299 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b644212-95cf-42ec-9914-f596385255b6 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1325 microversion: 2.1 time: 0.436447 Aug 18 11:46:01.497770 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4db190f2-94a3-4298-a649-f533f1b5e3f6 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1281 microversion: 2.1 time: 0.192897 Aug 18 11:46:01.503800 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2166/4591] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:01 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1281 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:01.506475 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2426/4592] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:01 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1325 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:01.517372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a950506f-b7e6-4e74-bd74-98d5b3c0e5df tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:01.518002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a950506f-b7e6-4e74-bd74-98d5b3c0e5df tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:01.533377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a950506f-b7e6-4e74-bd74-98d5b3c0e5df tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:01.534130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a950506f-b7e6-4e74-bd74-98d5b3c0e5df tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:01.534763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a950506f-b7e6-4e74-bd74-98d5b3c0e5df tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:01.535667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a950506f-b7e6-4e74-bd74-98d5b3c0e5df tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:01.536283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a950506f-b7e6-4e74-bd74-98d5b3c0e5df tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:01.536867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a950506f-b7e6-4e74-bd74-98d5b3c0e5df tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:01.768129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-b98b4f9b-de33-4513-85cd-766bbeacc4ae req-d1163f02-3055-4ef0-8c7b-5c8347155bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7182d507-c3fa-4453-bde3-90ba727aa886", "tag": "a483f82f-342c-4fcc-abf7-177f065ef4ec"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:01.803839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b98b4f9b-de33-4513-85cd-766bbeacc4ae req-d1163f02-3055-4ef0-8c7b-5c8347155bc8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:01.804339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b98b4f9b-de33-4513-85cd-766bbeacc4ae req-d1163f02-3055-4ef0-8c7b-5c8347155bc8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:01.804784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b98b4f9b-de33-4513-85cd-766bbeacc4ae req-d1163f02-3055-4ef0-8c7b-5c8347155bc8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:01.846955 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-b98b4f9b-de33-4513-85cd-766bbeacc4ae req-d1163f02-3055-4ef0-8c7b-5c8347155bc8 service nova] Creating event network-changed:a483f82f-342c-4fcc-abf7-177f065ef4ec for instance 7182d507-c3fa-4453-bde3-90ba727aa886 on n-h1-853611-3 Aug 18 11:46:01.866515 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-b98b4f9b-de33-4513-85cd-766bbeacc4ae req-d1163f02-3055-4ef0-8c7b-5c8347155bc8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.358371 Aug 18 11:46:01.867297 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2427/4593] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:01.879236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8a674aea-9145-4227-be2b-b0d9925531dc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:01.880202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8a674aea-9145-4227-be2b-b0d9925531dc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:01.899891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a674aea-9145-4227-be2b-b0d9925531dc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:01.905502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a674aea-9145-4227-be2b-b0d9925531dc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:01.909476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a674aea-9145-4227-be2b-b0d9925531dc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:01.910660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a674aea-9145-4227-be2b-b0d9925531dc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:01.912784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a674aea-9145-4227-be2b-b0d9925531dc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:01.913438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a674aea-9145-4227-be2b-b0d9925531dc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:02.134750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a950506f-b7e6-4e74-bd74-98d5b3c0e5df tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:02.146552 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a950506f-b7e6-4e74-bd74-98d5b3c0e5df tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1674 microversion: 2.1 time: 0.641315 Aug 18 11:46:02.167934 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2167/4594] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:01 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1674 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:02.182474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-513aeaaf-666b-4155-b066-53052e0ac589 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:02.183761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-513aeaaf-666b-4155-b066-53052e0ac589 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:02.201934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513aeaaf-666b-4155-b066-53052e0ac589 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:02.202645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513aeaaf-666b-4155-b066-53052e0ac589 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:02.203245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513aeaaf-666b-4155-b066-53052e0ac589 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:02.204345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513aeaaf-666b-4155-b066-53052e0ac589 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:02.207250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513aeaaf-666b-4155-b066-53052e0ac589 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:02.207947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-513aeaaf-666b-4155-b066-53052e0ac589 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:02.465196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8a674aea-9145-4227-be2b-b0d9925531dc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:02.482403 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8a674aea-9145-4227-be2b-b0d9925531dc tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1527 microversion: 2.1 time: 0.613441 Aug 18 11:46:02.484166 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2428/4595] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:01 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1527 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:02.534032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5a0b3cd8-252b-4e69-80d7-768aa17231f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:02.546721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5a0b3cd8-252b-4e69-80d7-768aa17231f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:02.565633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a0b3cd8-252b-4e69-80d7-768aa17231f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:02.566143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a0b3cd8-252b-4e69-80d7-768aa17231f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:02.569209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a0b3cd8-252b-4e69-80d7-768aa17231f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:02.573877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a0b3cd8-252b-4e69-80d7-768aa17231f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:02.577034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a0b3cd8-252b-4e69-80d7-768aa17231f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:02.577695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a0b3cd8-252b-4e69-80d7-768aa17231f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:02.901891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-513aeaaf-666b-4155-b066-53052e0ac589 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:02.918621 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-513aeaaf-666b-4155-b066-53052e0ac589 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1320 microversion: 2.1 time: 0.748891 Aug 18 11:46:02.919832 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2168/4596] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:02 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1320 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:02.925284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eae550c4-a1fa-4300-a8ea-640d85796589 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:02.929007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-eae550c4-a1fa-4300-a8ea-640d85796589 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:02.944157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eae550c4-a1fa-4300-a8ea-640d85796589 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:02.945948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eae550c4-a1fa-4300-a8ea-640d85796589 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:02.947391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eae550c4-a1fa-4300-a8ea-640d85796589 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:02.950270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eae550c4-a1fa-4300-a8ea-640d85796589 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:02.953265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eae550c4-a1fa-4300-a8ea-640d85796589 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:02.953913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eae550c4-a1fa-4300-a8ea-640d85796589 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:02.970907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5a0b3cd8-252b-4e69-80d7-768aa17231f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:02.988833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5a0b3cd8-252b-4e69-80d7-768aa17231f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:02.997653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5a0b3cd8-252b-4e69-80d7-768aa17231f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:03.001241 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5a0b3cd8-252b-4e69-80d7-768aa17231f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1408 microversion: 2.20 time: 0.482154 Aug 18 11:46:03.004628 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2429/4597] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:46:02 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1408 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:46:03.029386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d29b7b76-2d18-47c4-8926-2c37bf80208d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:03.031373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d29b7b76-2d18-47c4-8926-2c37bf80208d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:03.050794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d29b7b76-2d18-47c4-8926-2c37bf80208d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:03.053428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d29b7b76-2d18-47c4-8926-2c37bf80208d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:03.053957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d29b7b76-2d18-47c4-8926-2c37bf80208d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:03.054735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d29b7b76-2d18-47c4-8926-2c37bf80208d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:03.055197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d29b7b76-2d18-47c4-8926-2c37bf80208d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:03.058142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d29b7b76-2d18-47c4-8926-2c37bf80208d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:03.785330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eae550c4-a1fa-4300-a8ea-640d85796589 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:03.798846 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eae550c4-a1fa-4300-a8ea-640d85796589 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1325 microversion: 2.1 time: 0.874333 Aug 18 11:46:03.814626 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2169/4598] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:02 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1325 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:03.823158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-50a91e74-b2f9-4288-88e4-c67ac63a8f7e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:03.824086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-50a91e74-b2f9-4288-88e4-c67ac63a8f7e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:03.838741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50a91e74-b2f9-4288-88e4-c67ac63a8f7e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:03.839551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50a91e74-b2f9-4288-88e4-c67ac63a8f7e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:03.840225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50a91e74-b2f9-4288-88e4-c67ac63a8f7e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:03.841061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50a91e74-b2f9-4288-88e4-c67ac63a8f7e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:03.841739 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50a91e74-b2f9-4288-88e4-c67ac63a8f7e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:03.842396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-50a91e74-b2f9-4288-88e4-c67ac63a8f7e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:04.176364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d29b7b76-2d18-47c4-8926-2c37bf80208d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:04.188770 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d29b7b76-2d18-47c4-8926-2c37bf80208d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1323 microversion: 2.1 time: 1.181809 Aug 18 11:46:04.190774 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2430/4599] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:03 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1323 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:04.206732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aab18f26-481a-4b50-8653-6b2b82deb76a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:04.210740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aab18f26-481a-4b50-8653-6b2b82deb76a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:04.226301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aab18f26-481a-4b50-8653-6b2b82deb76a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:04.230381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aab18f26-481a-4b50-8653-6b2b82deb76a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:04.231238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aab18f26-481a-4b50-8653-6b2b82deb76a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:04.232240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aab18f26-481a-4b50-8653-6b2b82deb76a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:04.232954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aab18f26-481a-4b50-8653-6b2b82deb76a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:04.233627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aab18f26-481a-4b50-8653-6b2b82deb76a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:04.371188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-50a91e74-b2f9-4288-88e4-c67ac63a8f7e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:04.382481 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-50a91e74-b2f9-4288-88e4-c67ac63a8f7e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1674 microversion: 2.1 time: 0.563737 Aug 18 11:46:04.402347 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2170/4600] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:03 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1674 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:04.444985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d5222e46-62ef-4032-af02-663b6ac07aaf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:04.449842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d5222e46-62ef-4032-af02-663b6ac07aaf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:04.470023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5222e46-62ef-4032-af02-663b6ac07aaf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:04.470900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5222e46-62ef-4032-af02-663b6ac07aaf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:04.471582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5222e46-62ef-4032-af02-663b6ac07aaf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:04.472507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5222e46-62ef-4032-af02-663b6ac07aaf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:04.478691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5222e46-62ef-4032-af02-663b6ac07aaf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:04.479548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5222e46-62ef-4032-af02-663b6ac07aaf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:04.687741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aab18f26-481a-4b50-8653-6b2b82deb76a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:04.700394 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aab18f26-481a-4b50-8653-6b2b82deb76a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1527 microversion: 2.1 time: 0.506228 Aug 18 11:46:04.702948 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2431/4601] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:04 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1527 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:04.722574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b265e76-98b8-4a14-97ea-3938ca4e7036 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:04.723460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1b265e76-98b8-4a14-97ea-3938ca4e7036 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:04.736561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b265e76-98b8-4a14-97ea-3938ca4e7036 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:04.737100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b265e76-98b8-4a14-97ea-3938ca4e7036 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:04.737610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b265e76-98b8-4a14-97ea-3938ca4e7036 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:04.738844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b265e76-98b8-4a14-97ea-3938ca4e7036 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:04.739379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b265e76-98b8-4a14-97ea-3938ca4e7036 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:04.740972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b265e76-98b8-4a14-97ea-3938ca4e7036 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:05.101289 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d5222e46-62ef-4032-af02-663b6ac07aaf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:05.101886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1b265e76-98b8-4a14-97ea-3938ca4e7036 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:05.109981 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d5222e46-62ef-4032-af02-663b6ac07aaf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1501 microversion: 2.1 time: 0.719938 Aug 18 11:46:05.130502 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2171/4602] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:04 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1501 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:05.138198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1b265e76-98b8-4a14-97ea-3938ca4e7036 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:05.140240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-bb9d733d-c10e-46ca-8432-5830813f398d req-bd7c675b-b75b-4330-b3ce-a7bcdaf1694f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1706f34c-3b86-4298-be5a-126d7bfeba56", "name": "network-vif-plugged", "status": "completed", "tag": "7d0067d8-be65-40dd-bc5c-64a302b5b9c1"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:05.150340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1b265e76-98b8-4a14-97ea-3938ca4e7036 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:05.152454 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1b265e76-98b8-4a14-97ea-3938ca4e7036 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1408 microversion: 2.20 time: 0.447963 Aug 18 11:46:05.168334 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2432/4603] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:46:04 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1408 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:46:05.175493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9daed25-fc4c-4707-9784-3b9201fa8135 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:05.180299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bb9d733d-c10e-46ca-8432-5830813f398d req-bd7c675b-b75b-4330-b3ce-a7bcdaf1694f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:05.183607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bb9d733d-c10e-46ca-8432-5830813f398d req-bd7c675b-b75b-4330-b3ce-a7bcdaf1694f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:05.184303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bb9d733d-c10e-46ca-8432-5830813f398d req-bd7c675b-b75b-4330-b3ce-a7bcdaf1694f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:05.190678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c9daed25-fc4c-4707-9784-3b9201fa8135 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:05.212037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9daed25-fc4c-4707-9784-3b9201fa8135 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:05.212581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9daed25-fc4c-4707-9784-3b9201fa8135 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:05.214396 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-bb9d733d-c10e-46ca-8432-5830813f398d req-bd7c675b-b75b-4330-b3ce-a7bcdaf1694f service nova] Creating event network-vif-plugged:7d0067d8-be65-40dd-bc5c-64a302b5b9c1 for instance 1706f34c-3b86-4298-be5a-126d7bfeba56 on n-h2-853611-3 Aug 18 11:46:05.215111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9daed25-fc4c-4707-9784-3b9201fa8135 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:05.215998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9daed25-fc4c-4707-9784-3b9201fa8135 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:05.216558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9daed25-fc4c-4707-9784-3b9201fa8135 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:05.220998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9daed25-fc4c-4707-9784-3b9201fa8135 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:05.229951 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-bb9d733d-c10e-46ca-8432-5830813f398d req-bd7c675b-b75b-4330-b3ce-a7bcdaf1694f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097798 Aug 18 11:46:05.230795 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2172/4604] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:05.254152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-426c10b8-b17f-4627-b7a8-2784029be88c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:05.255162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-426c10b8-b17f-4627-b7a8-2784029be88c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:05.262970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-426c10b8-b17f-4627-b7a8-2784029be88c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:05.270650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-426c10b8-b17f-4627-b7a8-2784029be88c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:05.275700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-426c10b8-b17f-4627-b7a8-2784029be88c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:05.276484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-426c10b8-b17f-4627-b7a8-2784029be88c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:05.277586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-426c10b8-b17f-4627-b7a8-2784029be88c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:05.278058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-426c10b8-b17f-4627-b7a8-2784029be88c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:05.591328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c9daed25-fc4c-4707-9784-3b9201fa8135 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:05.600550 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c9daed25-fc4c-4707-9784-3b9201fa8135 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1325 microversion: 2.1 time: 0.435614 Aug 18 11:46:05.601494 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2433/4605] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:05 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1325 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:05.619712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-586ecbb8-dd94-426c-b23a-e988559e5028 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:05.623347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-586ecbb8-dd94-426c-b23a-e988559e5028 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:05.639189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-586ecbb8-dd94-426c-b23a-e988559e5028 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:05.639836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-586ecbb8-dd94-426c-b23a-e988559e5028 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:05.640297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-586ecbb8-dd94-426c-b23a-e988559e5028 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:05.641056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-586ecbb8-dd94-426c-b23a-e988559e5028 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:05.641520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-586ecbb8-dd94-426c-b23a-e988559e5028 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:05.641947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-586ecbb8-dd94-426c-b23a-e988559e5028 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:05.964729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-586ecbb8-dd94-426c-b23a-e988559e5028 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:05.981566 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-586ecbb8-dd94-426c-b23a-e988559e5028 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1323 microversion: 2.1 time: 0.378729 Aug 18 11:46:06.001419 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2434/4606] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:05 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1323 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:06.001419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2cb4da6-d5eb-42f6-81df-107057245ef0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:06.001419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b2cb4da6-d5eb-42f6-81df-107057245ef0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:06.016365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2cb4da6-d5eb-42f6-81df-107057245ef0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:06.020670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2cb4da6-d5eb-42f6-81df-107057245ef0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:06.021625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2cb4da6-d5eb-42f6-81df-107057245ef0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:06.023873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2cb4da6-d5eb-42f6-81df-107057245ef0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:06.029208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2cb4da6-d5eb-42f6-81df-107057245ef0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:06.029975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2cb4da6-d5eb-42f6-81df-107057245ef0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:06.092107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:06.341251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b2cb4da6-d5eb-42f6-81df-107057245ef0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:06.345578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:06.357565 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b2cb4da6-d5eb-42f6-81df-107057245ef0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1674 microversion: 2.1 time: 0.367460 Aug 18 11:46:06.359293 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2435/4607] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:05 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1674 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:06.372604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d9c36b47-57b3-48dc-9e77-b49816fae5f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:06.373720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d9c36b47-57b3-48dc-9e77-b49816fae5f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:06.397230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9c36b47-57b3-48dc-9e77-b49816fae5f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:06.399084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9c36b47-57b3-48dc-9e77-b49816fae5f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:06.400315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9c36b47-57b3-48dc-9e77-b49816fae5f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:06.402261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9c36b47-57b3-48dc-9e77-b49816fae5f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:06.403186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9c36b47-57b3-48dc-9e77-b49816fae5f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:06.403867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9c36b47-57b3-48dc-9e77-b49816fae5f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:06.418796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-426c10b8-b17f-4627-b7a8-2784029be88c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:06.435954 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-426c10b8-b17f-4627-b7a8-2784029be88c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1501 microversion: 2.1 time: 1.201361 Aug 18 11:46:06.452175 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2173/4608] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:05 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1501 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:06.462078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-87b63a40-f305-42b6-965d-8fd0be69a54a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:06.463357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-87b63a40-f305-42b6-965d-8fd0be69a54a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:06.471501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87b63a40-f305-42b6-965d-8fd0be69a54a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:06.472903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87b63a40-f305-42b6-965d-8fd0be69a54a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:06.473766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87b63a40-f305-42b6-965d-8fd0be69a54a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:06.474626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87b63a40-f305-42b6-965d-8fd0be69a54a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:06.475823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87b63a40-f305-42b6-965d-8fd0be69a54a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:06.476672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-87b63a40-f305-42b6-965d-8fd0be69a54a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:06.776223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d9c36b47-57b3-48dc-9e77-b49816fae5f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:06.786148 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d9c36b47-57b3-48dc-9e77-b49816fae5f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1527 microversion: 2.1 time: 0.425464 Aug 18 11:46:06.800594 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2436/4609] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:06 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1527 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:06.829335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ee8be761-83d3-460e-a830-9443a60d4284 req-02dddc1d-1749-4898-b394-ced411bcd93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe33958d-d95d-4038-8178-6ec455caf490", "tag": "7b5a58c5-9e96-4c1b-861c-0cc16aa74c7a"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:06.859352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ee8be761-83d3-460e-a830-9443a60d4284 req-02dddc1d-1749-4898-b394-ced411bcd93f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:06.862934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ee8be761-83d3-460e-a830-9443a60d4284 req-02dddc1d-1749-4898-b394-ced411bcd93f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:06.863793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ee8be761-83d3-460e-a830-9443a60d4284 req-02dddc1d-1749-4898-b394-ced411bcd93f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:06.898631 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ee8be761-83d3-460e-a830-9443a60d4284 req-02dddc1d-1749-4898-b394-ced411bcd93f service nova] Creating event network-changed:7b5a58c5-9e96-4c1b-861c-0cc16aa74c7a for instance fe33958d-d95d-4038-8178-6ec455caf490 on n-h2-853611-3 Aug 18 11:46:06.927989 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ee8be761-83d3-460e-a830-9443a60d4284 req-02dddc1d-1749-4898-b394-ced411bcd93f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125963 Aug 18 11:46:06.932035 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2437/4610] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:06.951427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-682ce96b-316e-4cc9-be07-ff32d006c2de tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:06.955110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-682ce96b-316e-4cc9-be07-ff32d006c2de tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:06.980285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-682ce96b-316e-4cc9-be07-ff32d006c2de tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:06.981689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-682ce96b-316e-4cc9-be07-ff32d006c2de tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:06.982496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-682ce96b-316e-4cc9-be07-ff32d006c2de tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:06.984094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-682ce96b-316e-4cc9-be07-ff32d006c2de tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:06.984789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-682ce96b-316e-4cc9-be07-ff32d006c2de tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:06.985473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-682ce96b-316e-4cc9-be07-ff32d006c2de tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:07.063947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-682ce96b-316e-4cc9-be07-ff32d006c2de tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:46:07.239074 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-682ce96b-316e-4cc9-be07-ff32d006c2de tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 204 len: 0 microversion: 2.1 time: 0.293922 Aug 18 11:46:07.242944 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2438/4611] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:46:06 2022] DELETE /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:46:07.259073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e75f1367-70e1-4ec1-95a6-b2ee0a9b461e tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:07.264374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e75f1367-70e1-4ec1-95a6-b2ee0a9b461e tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:07.292348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e75f1367-70e1-4ec1-95a6-b2ee0a9b461e tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:07.294842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e75f1367-70e1-4ec1-95a6-b2ee0a9b461e tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:07.295529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e75f1367-70e1-4ec1-95a6-b2ee0a9b461e tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:07.299442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e75f1367-70e1-4ec1-95a6-b2ee0a9b461e tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:07.299968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e75f1367-70e1-4ec1-95a6-b2ee0a9b461e tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:07.300423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e75f1367-70e1-4ec1-95a6-b2ee0a9b461e tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:07.579462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-87b63a40-f305-42b6-965d-8fd0be69a54a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:07.601804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-87b63a40-f305-42b6-965d-8fd0be69a54a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:07.604254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:07.612123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-87b63a40-f305-42b6-965d-8fd0be69a54a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:07.617620 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-87b63a40-f305-42b6-965d-8fd0be69a54a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1408 microversion: 2.20 time: 1.163708 Aug 18 11:46:07.622623 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2174/4612] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:46:06 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1408 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:46:07.629866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f8fc2427-5928-469a-a927-707d3b7d2098 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:07.640672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f8fc2427-5928-469a-a927-707d3b7d2098 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:07.659358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8fc2427-5928-469a-a927-707d3b7d2098 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:07.664462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8fc2427-5928-469a-a927-707d3b7d2098 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:07.665273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8fc2427-5928-469a-a927-707d3b7d2098 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:07.666261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8fc2427-5928-469a-a927-707d3b7d2098 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:07.671522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8fc2427-5928-469a-a927-707d3b7d2098 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:07.672538 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8fc2427-5928-469a-a927-707d3b7d2098 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:07.882168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e75f1367-70e1-4ec1-95a6-b2ee0a9b461e tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:07.891999 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e75f1367-70e1-4ec1-95a6-b2ee0a9b461e tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1325 microversion: 2.1 time: 0.650914 Aug 18 11:46:07.895478 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2439/4613] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:07 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1325 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:07.903171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd5c819a-f60e-40e8-8f37-f6feec3749a4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:07.909050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dd5c819a-f60e-40e8-8f37-f6feec3749a4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:07.929339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd5c819a-f60e-40e8-8f37-f6feec3749a4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:07.933434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd5c819a-f60e-40e8-8f37-f6feec3749a4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:07.936010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd5c819a-f60e-40e8-8f37-f6feec3749a4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:07.936974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd5c819a-f60e-40e8-8f37-f6feec3749a4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:07.943169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd5c819a-f60e-40e8-8f37-f6feec3749a4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:07.945637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd5c819a-f60e-40e8-8f37-f6feec3749a4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:08.270475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd5c819a-f60e-40e8-8f37-f6feec3749a4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:08.283244 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd5c819a-f60e-40e8-8f37-f6feec3749a4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1507 microversion: 2.1 time: 0.386441 Aug 18 11:46:08.301494 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2440/4614] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:07 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:08.312863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-b59cf347-9244-4bb2-8411-f5d032f0431f req-95719d55-bd19-4c20-aa0a-a470644da1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb953a8-e8bd-44d1-9264-75ae577c5940", "name": "network-vif-plugged", "status": "completed", "tag": "067f85bb-a79e-4035-966d-9dd9ced69382"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:08.344048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b59cf347-9244-4bb2-8411-f5d032f0431f req-95719d55-bd19-4c20-aa0a-a470644da1d1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:08.344921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b59cf347-9244-4bb2-8411-f5d032f0431f req-95719d55-bd19-4c20-aa0a-a470644da1d1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:08.348489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b59cf347-9244-4bb2-8411-f5d032f0431f req-95719d55-bd19-4c20-aa0a-a470644da1d1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:08.381548 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-b59cf347-9244-4bb2-8411-f5d032f0431f req-95719d55-bd19-4c20-aa0a-a470644da1d1 service nova] Creating event network-vif-plugged:067f85bb-a79e-4035-966d-9dd9ced69382 for instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 on n-h1-853611-3 Aug 18 11:46:08.389232 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-b59cf347-9244-4bb2-8411-f5d032f0431f req-95719d55-bd19-4c20-aa0a-a470644da1d1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086328 Aug 18 11:46:08.390488 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2441/4615] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:08.400156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d7a2ff87-9742-4b33-acaf-52996010589d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:08.401534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d7a2ff87-9742-4b33-acaf-52996010589d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:08.412802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7a2ff87-9742-4b33-acaf-52996010589d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:08.415549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7a2ff87-9742-4b33-acaf-52996010589d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:08.416467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7a2ff87-9742-4b33-acaf-52996010589d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:08.418971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7a2ff87-9742-4b33-acaf-52996010589d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:08.419637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7a2ff87-9742-4b33-acaf-52996010589d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:08.420331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7a2ff87-9742-4b33-acaf-52996010589d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:08.744838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d7a2ff87-9742-4b33-acaf-52996010589d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:08.759579 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d7a2ff87-9742-4b33-acaf-52996010589d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1674 microversion: 2.1 time: 0.365061 Aug 18 11:46:08.760277 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2442/4616] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:08 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1674 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:08.769908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0f3360eb-fe57-4dad-8f26-3d1fd0301731 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:08.770969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0f3360eb-fe57-4dad-8f26-3d1fd0301731 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:08.797398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f3360eb-fe57-4dad-8f26-3d1fd0301731 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:08.798254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f3360eb-fe57-4dad-8f26-3d1fd0301731 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:08.801410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f3360eb-fe57-4dad-8f26-3d1fd0301731 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:08.802671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f3360eb-fe57-4dad-8f26-3d1fd0301731 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:08.804185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f3360eb-fe57-4dad-8f26-3d1fd0301731 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:08.807200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f3360eb-fe57-4dad-8f26-3d1fd0301731 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:08.866710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f8fc2427-5928-469a-a927-707d3b7d2098 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:08.882410 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f8fc2427-5928-469a-a927-707d3b7d2098 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1323 microversion: 2.1 time: 1.258171 Aug 18 11:46:08.885452 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2175/4617] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:07 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1323 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:08.901266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-69146d42-ceb5-4ae7-841c-00e8c0b7acb6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:08.902256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-69146d42-ceb5-4ae7-841c-00e8c0b7acb6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:08.913338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69146d42-ceb5-4ae7-841c-00e8c0b7acb6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:08.919610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69146d42-ceb5-4ae7-841c-00e8c0b7acb6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:08.920096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69146d42-ceb5-4ae7-841c-00e8c0b7acb6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:08.920875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69146d42-ceb5-4ae7-841c-00e8c0b7acb6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:08.921352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69146d42-ceb5-4ae7-841c-00e8c0b7acb6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:08.921869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69146d42-ceb5-4ae7-841c-00e8c0b7acb6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:09.388984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0f3360eb-fe57-4dad-8f26-3d1fd0301731 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:09.402669 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0f3360eb-fe57-4dad-8f26-3d1fd0301731 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1527 microversion: 2.1 time: 0.640762 Aug 18 11:46:09.403721 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2443/4618] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:08 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1527 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:09.415755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-457c80a1-c316-4a62-a41c-0821306a8252 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:09.416692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-457c80a1-c316-4a62-a41c-0821306a8252 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:09.429899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-457c80a1-c316-4a62-a41c-0821306a8252 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:09.431184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-457c80a1-c316-4a62-a41c-0821306a8252 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:09.431695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-457c80a1-c316-4a62-a41c-0821306a8252 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:09.432737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-457c80a1-c316-4a62-a41c-0821306a8252 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:09.433216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-457c80a1-c316-4a62-a41c-0821306a8252 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:09.433658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-457c80a1-c316-4a62-a41c-0821306a8252 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:09.643677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-69146d42-ceb5-4ae7-841c-00e8c0b7acb6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:09.690838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-69146d42-ceb5-4ae7-841c-00e8c0b7acb6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:09.696667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-69146d42-ceb5-4ae7-841c-00e8c0b7acb6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:09.699910 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-69146d42-ceb5-4ae7-841c-00e8c0b7acb6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1600 microversion: 2.20 time: 0.812232 Aug 18 11:46:09.719306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-457c80a1-c316-4a62-a41c-0821306a8252 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:09.721898 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2176/4619] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:46:08 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1600 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:46:09.728473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3f9534d9-28c2-476a-9803-478a9ca39630 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:09.729358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3f9534d9-28c2-476a-9803-478a9ca39630 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:09.733268 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-457c80a1-c316-4a62-a41c-0821306a8252 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1325 microversion: 2.1 time: 0.328172 Aug 18 11:46:09.735534 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2444/4620] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:09 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1325 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:09.741766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f9534d9-28c2-476a-9803-478a9ca39630 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:09.742661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f9534d9-28c2-476a-9803-478a9ca39630 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:09.743995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f9534d9-28c2-476a-9803-478a9ca39630 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:09.744913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f9534d9-28c2-476a-9803-478a9ca39630 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:09.745558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f9534d9-28c2-476a-9803-478a9ca39630 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:09.746219 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f9534d9-28c2-476a-9803-478a9ca39630 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:09.751324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-996183ad-5c33-4ba5-9b61-6a2d93959925 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:09.751989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-996183ad-5c33-4ba5-9b61-6a2d93959925 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:09.783774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-996183ad-5c33-4ba5-9b61-6a2d93959925 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:09.784395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-996183ad-5c33-4ba5-9b61-6a2d93959925 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:09.784864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-996183ad-5c33-4ba5-9b61-6a2d93959925 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:09.785631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-996183ad-5c33-4ba5-9b61-6a2d93959925 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:09.786111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-996183ad-5c33-4ba5-9b61-6a2d93959925 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:09.790578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-996183ad-5c33-4ba5-9b61-6a2d93959925 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:09.964607 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-996183ad-5c33-4ba5-9b61-6a2d93959925 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.227673 Aug 18 11:46:09.965439 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2445/4621] 10.222.0.73 () {60 vars in 1316 bytes} [Thu Aug 18 11:46:09 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-interface => generated 284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:46:09.972509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2fb92b9a-da61-4e4d-821c-10857c4c0508 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:09.972509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2fb92b9a-da61-4e4d-821c-10857c4c0508 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:09.997045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fb92b9a-da61-4e4d-821c-10857c4c0508 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:09.997677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fb92b9a-da61-4e4d-821c-10857c4c0508 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:10.003840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fb92b9a-da61-4e4d-821c-10857c4c0508 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:10.004723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fb92b9a-da61-4e4d-821c-10857c4c0508 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:10.005309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fb92b9a-da61-4e4d-821c-10857c4c0508 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:10.005850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fb92b9a-da61-4e4d-821c-10857c4c0508 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:10.281630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3f9534d9-28c2-476a-9803-478a9ca39630 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:10.294732 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3f9534d9-28c2-476a-9803-478a9ca39630 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1507 microversion: 2.1 time: 0.571337 Aug 18 11:46:10.295572 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2177/4622] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:09 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1507 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:10.313859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f709a1cb-cf83-4260-a719-11310ea018fb tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:10.314743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f709a1cb-cf83-4260-a719-11310ea018fb tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:10.325015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f709a1cb-cf83-4260-a719-11310ea018fb tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:10.326943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f709a1cb-cf83-4260-a719-11310ea018fb tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:10.327612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f709a1cb-cf83-4260-a719-11310ea018fb tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:10.331775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f709a1cb-cf83-4260-a719-11310ea018fb tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:10.332489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f709a1cb-cf83-4260-a719-11310ea018fb tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:10.333103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f709a1cb-cf83-4260-a719-11310ea018fb tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:10.379805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:10.500918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2fb92b9a-da61-4e4d-821c-10857c4c0508 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:10.517916 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2fb92b9a-da61-4e4d-821c-10857c4c0508 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1674 microversion: 2.1 time: 0.549881 Aug 18 11:46:10.520997 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2446/4623] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:09 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1674 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:10.552663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5754b8e7-ba27-4d85-958c-4d20564eb77c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:10.553613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5754b8e7-ba27-4d85-958c-4d20564eb77c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:10.564525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5754b8e7-ba27-4d85-958c-4d20564eb77c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:10.567007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5754b8e7-ba27-4d85-958c-4d20564eb77c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:10.567533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5754b8e7-ba27-4d85-958c-4d20564eb77c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:10.569314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5754b8e7-ba27-4d85-958c-4d20564eb77c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:10.570862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5754b8e7-ba27-4d85-958c-4d20564eb77c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:10.571984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5754b8e7-ba27-4d85-958c-4d20564eb77c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:11.097095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f709a1cb-cf83-4260-a719-11310ea018fb tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:11.112231 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f709a1cb-cf83-4260-a719-11310ea018fb tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1323 microversion: 2.1 time: 0.808091 Aug 18 11:46:11.115193 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2178/4624] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:10 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1323 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:11.142861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-e4dcd09e-1754-46d7-84d7-669eb13e715f req-ea993b65-c022-44bd-83a5-7c3ad45ff475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7182d507-c3fa-4453-bde3-90ba727aa886", "name": "network-vif-plugged", "status": "completed", "tag": "a483f82f-342c-4fcc-abf7-177f065ef4ec"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:11.193286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e4dcd09e-1754-46d7-84d7-669eb13e715f req-ea993b65-c022-44bd-83a5-7c3ad45ff475 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:11.196589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e4dcd09e-1754-46d7-84d7-669eb13e715f req-ea993b65-c022-44bd-83a5-7c3ad45ff475 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:11.197244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e4dcd09e-1754-46d7-84d7-669eb13e715f req-ea993b65-c022-44bd-83a5-7c3ad45ff475 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:11.217276 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-e4dcd09e-1754-46d7-84d7-669eb13e715f req-ea993b65-c022-44bd-83a5-7c3ad45ff475 service nova] Creating event network-vif-plugged:a483f82f-342c-4fcc-abf7-177f065ef4ec for instance 7182d507-c3fa-4453-bde3-90ba727aa886 on n-h1-853611-3 Aug 18 11:46:11.224036 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-e4dcd09e-1754-46d7-84d7-669eb13e715f req-ea993b65-c022-44bd-83a5-7c3ad45ff475 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104151 Aug 18 11:46:11.225808 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2179/4625] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:11.235033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-04b2b730-8e46-4356-baac-c3c93607e381 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:11.236121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-04b2b730-8e46-4356-baac-c3c93607e381 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:11.247065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04b2b730-8e46-4356-baac-c3c93607e381 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:11.248429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04b2b730-8e46-4356-baac-c3c93607e381 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:11.250066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04b2b730-8e46-4356-baac-c3c93607e381 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:11.251092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04b2b730-8e46-4356-baac-c3c93607e381 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:11.251893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04b2b730-8e46-4356-baac-c3c93607e381 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:11.252566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04b2b730-8e46-4356-baac-c3c93607e381 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:11.858005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5754b8e7-ba27-4d85-958c-4d20564eb77c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:11.879054 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5754b8e7-ba27-4d85-958c-4d20564eb77c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1527 microversion: 2.1 time: 1.347336 Aug 18 11:46:11.908973 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2447/4626] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:10 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1527 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:11.925992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1c4c9940-bfe6-43e2-a3c1-8ac7be7bc31f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:11.926980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1c4c9940-bfe6-43e2-a3c1-8ac7be7bc31f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:11.949370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c4c9940-bfe6-43e2-a3c1-8ac7be7bc31f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:11.955702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c4c9940-bfe6-43e2-a3c1-8ac7be7bc31f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:11.956407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c4c9940-bfe6-43e2-a3c1-8ac7be7bc31f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:11.957356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c4c9940-bfe6-43e2-a3c1-8ac7be7bc31f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:11.957979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c4c9940-bfe6-43e2-a3c1-8ac7be7bc31f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:11.958605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c4c9940-bfe6-43e2-a3c1-8ac7be7bc31f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:12.575896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-04b2b730-8e46-4356-baac-c3c93607e381 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:12.598527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1c4c9940-bfe6-43e2-a3c1-8ac7be7bc31f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:12.602909 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-04b2b730-8e46-4356-baac-c3c93607e381 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1325 microversion: 2.1 time: 1.360311 Aug 18 11:46:12.603874 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2180/4627] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:11 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1325 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:12.622303 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1c4c9940-bfe6-43e2-a3c1-8ac7be7bc31f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 200 len: 1507 microversion: 2.1 time: 0.699528 Aug 18 11:46:12.622859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-863dc77d-b718-4468-bc44-08936490f0ef tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:12.634525 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2448/4628] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:11 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 1507 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:12.640009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-863dc77d-b718-4468-bc44-08936490f0ef tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:12.640214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de5055fe-6da5-4d88-a1e4-88d54b76f6b9 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:12.640214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-de5055fe-6da5-4d88-a1e4-88d54b76f6b9 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:12.647057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de5055fe-6da5-4d88-a1e4-88d54b76f6b9 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:12.647703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de5055fe-6da5-4d88-a1e4-88d54b76f6b9 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:12.648308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de5055fe-6da5-4d88-a1e4-88d54b76f6b9 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:12.649804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de5055fe-6da5-4d88-a1e4-88d54b76f6b9 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:12.650343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de5055fe-6da5-4d88-a1e4-88d54b76f6b9 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:12.651105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de5055fe-6da5-4d88-a1e4-88d54b76f6b9 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:12.660014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-863dc77d-b718-4468-bc44-08936490f0ef tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:12.660528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-863dc77d-b718-4468-bc44-08936490f0ef tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:12.660980 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-863dc77d-b718-4468-bc44-08936490f0ef tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:12.661707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-863dc77d-b718-4468-bc44-08936490f0ef tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:12.662173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-863dc77d-b718-4468-bc44-08936490f0ef tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:12.662984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-863dc77d-b718-4468-bc44-08936490f0ef tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:13.193763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-863dc77d-b718-4468-bc44-08936490f0ef tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:13.195966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-de5055fe-6da5-4d88-a1e4-88d54b76f6b9 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:13.204649 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-863dc77d-b718-4468-bc44-08936490f0ef tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1651 microversion: 2.1 time: 0.585587 Aug 18 11:46:13.207376 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de5055fe-6da5-4d88-a1e4-88d54b76f6b9 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1323 microversion: 2.1 time: 0.575569 Aug 18 11:46:13.212759 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2449/4629] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:12 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1323 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:13.224619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-062f89b0-ad93-4696-8579-d078fc7e0865 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:13.228817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-062f89b0-ad93-4696-8579-d078fc7e0865 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:13.238215 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2181/4630] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:12 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1651 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:13.248315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1bdc215e-a21c-44fd-bc16-8ce99755ce0d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:13.251606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-062f89b0-ad93-4696-8579-d078fc7e0865 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:13.252114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-062f89b0-ad93-4696-8579-d078fc7e0865 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:13.256781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-062f89b0-ad93-4696-8579-d078fc7e0865 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:13.257560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-062f89b0-ad93-4696-8579-d078fc7e0865 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:13.263752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-062f89b0-ad93-4696-8579-d078fc7e0865 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:13.264519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-062f89b0-ad93-4696-8579-d078fc7e0865 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:13.264934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1bdc215e-a21c-44fd-bc16-8ce99755ce0d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:13.271510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1bdc215e-a21c-44fd-bc16-8ce99755ce0d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:13.272499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1bdc215e-a21c-44fd-bc16-8ce99755ce0d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:13.317899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1bdc215e-a21c-44fd-bc16-8ce99755ce0d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Going to try to start instance {{(pid=122209) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 18 11:46:13.419272 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1bdc215e-a21c-44fd-bc16-8ce99755ce0d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "POST /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/action" status: 202 len: 0 microversion: 2.1 time: 0.179321 Aug 18 11:46:13.423599 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2182/4631] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:46:13 2022] POST /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:46:13.436765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6d2ec81c-c62c-43cd-a4ba-f62ae23bc5e5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:13.438088 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6d2ec81c-c62c-43cd-a4ba-f62ae23bc5e5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:13.456386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d2ec81c-c62c-43cd-a4ba-f62ae23bc5e5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:13.458572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d2ec81c-c62c-43cd-a4ba-f62ae23bc5e5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:13.459198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d2ec81c-c62c-43cd-a4ba-f62ae23bc5e5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:13.462577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d2ec81c-c62c-43cd-a4ba-f62ae23bc5e5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:13.463469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d2ec81c-c62c-43cd-a4ba-f62ae23bc5e5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:13.464158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6d2ec81c-c62c-43cd-a4ba-f62ae23bc5e5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:13.872806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-062f89b0-ad93-4696-8579-d078fc7e0865 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:13.887479 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-062f89b0-ad93-4696-8579-d078fc7e0865 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1527 microversion: 2.1 time: 0.673305 Aug 18 11:46:13.888606 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2450/4632] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:13 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1527 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:14.177676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f8b21d4d-a4c6-476d-9e94-76d1e84715c6 req-52e99602-579b-44fe-99a7-5cffb17057f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1706f34c-3b86-4298-be5a-126d7bfeba56", "tag": "7d0067d8-be65-40dd-bc5c-64a302b5b9c1"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:14.217492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f8b21d4d-a4c6-476d-9e94-76d1e84715c6 req-52e99602-579b-44fe-99a7-5cffb17057f8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:14.223395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f8b21d4d-a4c6-476d-9e94-76d1e84715c6 req-52e99602-579b-44fe-99a7-5cffb17057f8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:14.224304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f8b21d4d-a4c6-476d-9e94-76d1e84715c6 req-52e99602-579b-44fe-99a7-5cffb17057f8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:14.276780 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f8b21d4d-a4c6-476d-9e94-76d1e84715c6 req-52e99602-579b-44fe-99a7-5cffb17057f8 service nova] Creating event network-changed:7d0067d8-be65-40dd-bc5c-64a302b5b9c1 for instance 1706f34c-3b86-4298-be5a-126d7bfeba56 on n-h2-853611-3 Aug 18 11:46:14.300554 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f8b21d4d-a4c6-476d-9e94-76d1e84715c6 req-52e99602-579b-44fe-99a7-5cffb17057f8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.409262 Aug 18 11:46:14.309786 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2451/4633] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:14.326670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9190156c-e00b-44ad-ba42-2e61c20b671c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:14.334715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9190156c-e00b-44ad-ba42-2e61c20b671c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:14.365951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9190156c-e00b-44ad-ba42-2e61c20b671c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:14.377829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9190156c-e00b-44ad-ba42-2e61c20b671c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:14.379114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9190156c-e00b-44ad-ba42-2e61c20b671c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:14.384477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9190156c-e00b-44ad-ba42-2e61c20b671c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:14.385679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9190156c-e00b-44ad-ba42-2e61c20b671c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:14.390361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9190156c-e00b-44ad-ba42-2e61c20b671c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:15.075788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9190156c-e00b-44ad-ba42-2e61c20b671c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:15.093787 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9190156c-e00b-44ad-ba42-2e61c20b671c tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1522 microversion: 2.1 time: 0.781840 Aug 18 11:46:15.094723 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2452/4634] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:14 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1522 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:15.116210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c30fe64a-260e-47b6-b141-de7b3bed740e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:15.117941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c30fe64a-260e-47b6-b141-de7b3bed740e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:15.130032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c30fe64a-260e-47b6-b141-de7b3bed740e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:15.134289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c30fe64a-260e-47b6-b141-de7b3bed740e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:15.137428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c30fe64a-260e-47b6-b141-de7b3bed740e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:15.138533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c30fe64a-260e-47b6-b141-de7b3bed740e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:15.139246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c30fe64a-260e-47b6-b141-de7b3bed740e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:15.140858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c30fe64a-260e-47b6-b141-de7b3bed740e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:15.155295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:15.200422 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-c30fe64a-260e-47b6-b141-de7b3bed740e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c30fe64a-260e-47b6-b141-de7b3bed740e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 HTTP/1.1 Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '43537e52-9c93-4713-93e8-e3db967345f9'} Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:15.203479 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:15.208368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:15.208368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:15.208368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:46:15.208368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:46:15.208368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:46:15.208368 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:15.208368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c30fe64a-260e-47b6-b141-de7b3bed740e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:15.209209 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c30fe64a-260e-47b6-b141-de7b3bed740e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 404 len: 111 microversion: 2.1 time: 0.112734 Aug 18 11:46:15.212645 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2453/4635] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:15 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:46:15.230874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7716dfc9-d1ff-4012-86b8-0d4fb9963a57 req-973c97c4-4174-4b78-91ec-1d622f9207c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43537e52-9c93-4713-93e8-e3db967345f9", "name": "network-vif-deleted", "tag": "c787a259-c8af-4aa7-b345-05f25da2b652"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:15.264043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7716dfc9-d1ff-4012-86b8-0d4fb9963a57 req-973c97c4-4174-4b78-91ec-1d622f9207c4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:15.264671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7716dfc9-d1ff-4012-86b8-0d4fb9963a57 req-973c97c4-4174-4b78-91ec-1d622f9207c4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:15.265128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7716dfc9-d1ff-4012-86b8-0d4fb9963a57 req-973c97c4-4174-4b78-91ec-1d622f9207c4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:15.293654 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7716dfc9-d1ff-4012-86b8-0d4fb9963a57 req-973c97c4-4174-4b78-91ec-1d622f9207c4 service nova] Creating event network-vif-deleted:c787a259-c8af-4aa7-b345-05f25da2b652 for instance 43537e52-9c93-4713-93e8-e3db967345f9 on n-h2-853611-3 Aug 18 11:46:15.310328 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7716dfc9-d1ff-4012-86b8-0d4fb9963a57 req-973c97c4-4174-4b78-91ec-1d622f9207c4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093497 Aug 18 11:46:15.315682 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2454/4636] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:15.328111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ea66752c-0448-412c-9af9-39f75379b524 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:15.338986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ea66752c-0448-412c-9af9-39f75379b524 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:15.352372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea66752c-0448-412c-9af9-39f75379b524 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:15.357239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea66752c-0448-412c-9af9-39f75379b524 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:15.358013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea66752c-0448-412c-9af9-39f75379b524 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:15.370988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea66752c-0448-412c-9af9-39f75379b524 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:15.372180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea66752c-0448-412c-9af9-39f75379b524 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:15.372853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea66752c-0448-412c-9af9-39f75379b524 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:15.621344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6d2ec81c-c62c-43cd-a4ba-f62ae23bc5e5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:15.641302 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6d2ec81c-c62c-43cd-a4ba-f62ae23bc5e5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1660 microversion: 2.1 time: 2.213389 Aug 18 11:46:15.654462 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2183/4637] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:13 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1660 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:15.657695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5f0e722c-9b13-4d30-a2b9-1d32d19fec58 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:15.657935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5f0e722c-9b13-4d30-a2b9-1d32d19fec58 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:15.674736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f0e722c-9b13-4d30-a2b9-1d32d19fec58 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:15.677581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f0e722c-9b13-4d30-a2b9-1d32d19fec58 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:15.678199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f0e722c-9b13-4d30-a2b9-1d32d19fec58 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:15.683648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f0e722c-9b13-4d30-a2b9-1d32d19fec58 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:15.684336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f0e722c-9b13-4d30-a2b9-1d32d19fec58 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:15.684958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5f0e722c-9b13-4d30-a2b9-1d32d19fec58 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:15.864384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ea66752c-0448-412c-9af9-39f75379b524 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:15.875037 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ea66752c-0448-412c-9af9-39f75379b524 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1323 microversion: 2.1 time: 0.554865 Aug 18 11:46:15.894525 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2455/4638] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:15 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1323 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:15.901689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cd3b8753-7331-4bb2-abf4-b7f10bcecfcf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:15.902855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cd3b8753-7331-4bb2-abf4-b7f10bcecfcf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:15.914816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd3b8753-7331-4bb2-abf4-b7f10bcecfcf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:15.916353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd3b8753-7331-4bb2-abf4-b7f10bcecfcf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:15.920911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd3b8753-7331-4bb2-abf4-b7f10bcecfcf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:15.922008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd3b8753-7331-4bb2-abf4-b7f10bcecfcf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:15.922699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd3b8753-7331-4bb2-abf4-b7f10bcecfcf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:15.923329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd3b8753-7331-4bb2-abf4-b7f10bcecfcf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:15.967401 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-cd3b8753-7331-4bb2-abf4-b7f10bcecfcf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] HTTP exception thrown: Action 999 not found Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cd3b8753-7331-4bb2-abf4-b7f10bcecfcf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Request method failure captured: Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886/os-instance-actions/999 HTTP/1.1 Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iZqLLDjxmha4dX4oPtnmdEjI2KrF_Z9NA6mz-zMJDJkWYZTliH5kT70teRlDeeYJgwPp4sUxdfMPWE6k7ZM3sZuHL51V7HXQkoOEwWDbchlY9UcQzN_4ov2CVJelrrpbEYrhM1fiOCWwxg1D2J-0wjnuBHuP3EmVhucqNk-uuzQtTg Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 69040d9d34cd4d608dfc842f78ca7532 Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1877959385 Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/69040d9d34cd4d608dfc842f78ca7532"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/69040d9d34cd4d608dfc842f78ca7532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_69040d9d34cd4d608dfc842f78ca7532"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/69040d9d34cd4d608dfc842f78ca7532"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1877959385 Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 69040d9d34cd4d608dfc842f78ca7532 Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1877959385 Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-InstanceActionsNegativeTestJSON-1877959385-project Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 265d100fde6346df81d44c014acd2529 Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1877959385-project Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: exception: Action 999 not found Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': '7182d507-c3fa-4453-bde3-90ba727aa886', 'id': '999'} Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 18 11:46:15.976072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:15.989869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cd3b8753-7331-4bb2-abf4-b7f10bcecfcf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Returning 404 to user: Action 999 not found {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:15.991740 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cd3b8753-7331-4bb2-abf4-b7f10bcecfcf tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.095842 Aug 18 11:46:16.002957 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2456/4639] 10.222.0.73 () {58 vars in 1308 bytes} [Thu Aug 18 11:46:15 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886/os-instance-actions/999 => generated 66 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:46:16.019157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7147e8e5-0984-45ad-9ac8-cc93060d4585 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Action: 'create', calling method: .version_select at 0x7f519f0714c0>, body: {"keypair": {"name": "tempest-key-1273222430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjOUrNf+lsEy6iO5qNgnKhhCZbgHaYvYTziknX3+3td/0LpwZjGH+X367DZLAWLhmsszqeGAD2VXMt+CcOFkkDBTnxAaTqKPhoYa6Y7J1nuRv1/bWfwb3KNGP3tZwmvkw=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:16.070996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7147e8e5-0984-45ad-9ac8-cc93060d4585 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for project b8c07d0bce064140850194469cc81e9c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:46:16.090684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7147e8e5-0984-45ad-9ac8-cc93060d4585 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for user c850b0a836124d90b7e50fe8b9fdf011 and project b8c07d0bce064140850194469cc81e9c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:46:16.154673 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7147e8e5-0984-45ad-9ac8-cc93060d4585 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.149058 Aug 18 11:46:16.161417 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2457/4640] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:46:16 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:16.169274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e9424cbe-3fca-4d66-8607-2d4bcf737926 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '.version_select at 0x7f519ee1f790>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:16.175540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e9424cbe-3fca-4d66-8607-2d4bcf737926 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: ab94892a-31c1-4dd2-ad6d-1fa585280ad4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:16.187281 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-e9424cbe-3fca-4d66-8607-2d4bcf737926 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] HTTP exception thrown: Instance ab94892a-31c1-4dd2-ad6d-1fa585280ad4 could not be found. Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e9424cbe-3fca-4d66-8607-2d4bcf737926 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Request method failure captured: Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/ab94892a-31c1-4dd2-ad6d-1fa585280ad4/os-instance-actions HTTP/1.1 Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iZqLLDjxmha4dX4oPtnmdEjI2KrF_Z9NA6mz-zMJDJkWYZTliH5kT70teRlDeeYJgwPp4sUxdfMPWE6k7ZM3sZuHL51V7HXQkoOEwWDbchlY9UcQzN_4ov2CVJelrrpbEYrhM1fiOCWwxg1D2J-0wjnuBHuP3EmVhucqNk-uuzQtTg Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 69040d9d34cd4d608dfc842f78ca7532 Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1877959385 Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/69040d9d34cd4d608dfc842f78ca7532"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/69040d9d34cd4d608dfc842f78ca7532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_69040d9d34cd4d608dfc842f78ca7532"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/69040d9d34cd4d608dfc842f78ca7532"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1877959385 Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 69040d9d34cd4d608dfc842f78ca7532 Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1877959385 Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-InstanceActionsNegativeTestJSON-1877959385-project Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 265d100fde6346df81d44c014acd2529 Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1877959385-project Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance ab94892a-31c1-4dd2-ad6d-1fa585280ad4 could not be found. Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': 'ab94892a-31c1-4dd2-ad6d-1fa585280ad4'} Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab94892a-31c1-4dd2-ad6d-1fa585280ad4 could not be found. Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:46:16.191023 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:46:16.195827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab94892a-31c1-4dd2-ad6d-1fa585280ad4 could not be found. Aug 18 11:46:16.195827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:16.195827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:16.195827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:16.195827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:16.195827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:16.195827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:16.195827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:46:16.195827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:46:16.195827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab94892a-31c1-4dd2-ad6d-1fa585280ad4 could not be found. Aug 18 11:46:16.195827 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:16.206382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e9424cbe-3fca-4d66-8607-2d4bcf737926 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Returning 404 to user: Instance ab94892a-31c1-4dd2-ad6d-1fa585280ad4 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:16.207732 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e9424cbe-3fca-4d66-8607-2d4bcf737926 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/ab94892a-31c1-4dd2-ad6d-1fa585280ad4/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.045020 Aug 18 11:46:16.214864 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2458/4641] 10.222.0.73 () {58 vars in 1296 bytes} [Thu Aug 18 11:46:16 2022] GET /compute/v2.1/servers/ab94892a-31c1-4dd2-ad6d-1fa585280ad4/os-instance-actions => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:46:16.237694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-af84186f-b08f-418a-9228-dfe16ca2d60b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '.version_select at 0x7f519ede0a60>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:16.243280 n-d-853611-3 devstack@n-api.service[122210]: WARNING oslo_db.sqlalchemy.utils [None req-af84186f-b08f-418a-9228-dfe16ca2d60b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 18 11:46:16.257427 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-af84186f-b08f-418a-9228-dfe16ca2d60b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.041297 Aug 18 11:46:16.271129 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2459/4642] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:46:16 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:16.292127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6fd62f74-6b74-4610-82dc-41c2d4b20dc0 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:16.295175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6fd62f74-6b74-4610-82dc-41c2d4b20dc0 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:16.308951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fd62f74-6b74-4610-82dc-41c2d4b20dc0 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:16.309755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fd62f74-6b74-4610-82dc-41c2d4b20dc0 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:16.312506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fd62f74-6b74-4610-82dc-41c2d4b20dc0 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:16.315045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fd62f74-6b74-4610-82dc-41c2d4b20dc0 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:16.317703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fd62f74-6b74-4610-82dc-41c2d4b20dc0 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:16.318349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6fd62f74-6b74-4610-82dc-41c2d4b20dc0 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:16.413063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6fd62f74-6b74-4610-82dc-41c2d4b20dc0 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:46:16.618928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:16.652631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5f0e722c-9b13-4d30-a2b9-1d32d19fec58 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:16.663393 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5f0e722c-9b13-4d30-a2b9-1d32d19fec58 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1527 microversion: 2.1 time: 1.019869 Aug 18 11:46:16.675061 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6fd62f74-6b74-4610-82dc-41c2d4b20dc0 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 204 len: 0 microversion: 2.1 time: 0.401108 Aug 18 11:46:16.679006 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2460/4644] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:46:16 2022] DELETE /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:46:16.679236 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2184/4644] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:15 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1527 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:16.699662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9cfc1396-6366-4dc1-8ba7-3d5c5db075f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:16.702039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-842752079", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "key_name": "tempest-key-1273222430", "networks": [{"uuid": "748eeef0-4e88-4443-abac-e79de3b3bb2a"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:16.703629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9cfc1396-6366-4dc1-8ba7-3d5c5db075f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:16.717085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9cfc1396-6366-4dc1-8ba7-3d5c5db075f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:16.717587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9cfc1396-6366-4dc1-8ba7-3d5c5db075f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:16.718054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9cfc1396-6366-4dc1-8ba7-3d5c5db075f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:16.718842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9cfc1396-6366-4dc1-8ba7-3d5c5db075f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:16.719342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9cfc1396-6366-4dc1-8ba7-3d5c5db075f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:16.719818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9cfc1396-6366-4dc1-8ba7-3d5c5db075f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:16.828671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] validate_networks() for [('748eeef0-4e88-4443-abac-e79de3b3bb2a', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:46:17.011219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9cfc1396-6366-4dc1-8ba7-3d5c5db075f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:17.034013 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9cfc1396-6366-4dc1-8ba7-3d5c5db075f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1660 microversion: 2.1 time: 0.346280 Aug 18 11:46:17.035101 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2461/4645] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:16 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1660 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:17.051609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c38180e1-b309-4319-b719-a90332753081 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:17.052167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c38180e1-b309-4319-b719-a90332753081 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:17.072429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c38180e1-b309-4319-b719-a90332753081 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:17.072983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c38180e1-b309-4319-b719-a90332753081 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:17.073926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c38180e1-b309-4319-b719-a90332753081 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:17.075980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c38180e1-b309-4319-b719-a90332753081 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:17.075980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c38180e1-b309-4319-b719-a90332753081 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:17.076236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c38180e1-b309-4319-b719-a90332753081 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:17.551611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c38180e1-b309-4319-b719-a90332753081 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:17.576348 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c38180e1-b309-4319-b719-a90332753081 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1528 microversion: 2.1 time: 0.537596 Aug 18 11:46:17.587831 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2462/4646] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:17 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1528 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:17.599145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-46202b03-d28b-4df9-8d09-1d1a5e3e0508 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:17.599804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-46202b03-d28b-4df9-8d09-1d1a5e3e0508 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:17.607075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46202b03-d28b-4df9-8d09-1d1a5e3e0508 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:17.607975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46202b03-d28b-4df9-8d09-1d1a5e3e0508 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:17.608566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46202b03-d28b-4df9-8d09-1d1a5e3e0508 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:17.628796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46202b03-d28b-4df9-8d09-1d1a5e3e0508 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:17.628796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46202b03-d28b-4df9-8d09-1d1a5e3e0508 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:17.628796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46202b03-d28b-4df9-8d09-1d1a5e3e0508 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:18.146019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:46:18.146517 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:46:18.147379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:46:18.147875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:46:18.148881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:46:18.162188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:18.162981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:18.164602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:18.165532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:18.166321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:18.166943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:18.191086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:46:18.199666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for user c850b0a836124d90b7e50fe8b9fdf011 and project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:46:18.218744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:46:18.224757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:46:18.334514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-46202b03-d28b-4df9-8d09-1d1a5e3e0508 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:18.343239 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-68d3afad-252e-487d-81dc-f9748da02bfe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.657368 Aug 18 11:46:18.353950 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2185/4647] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:46:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:46:18.359342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c1bdc1ae-d55d-4d2d-9777-4b1023f68d68 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:18.363710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c1bdc1ae-d55d-4d2d-9777-4b1023f68d68 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:18.369964 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-46202b03-d28b-4df9-8d09-1d1a5e3e0508 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1323 microversion: 2.1 time: 0.779350 Aug 18 11:46:18.374183 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2463/4648] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:17 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1323 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:18.396061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1bdc1ae-d55d-4d2d-9777-4b1023f68d68 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:18.408201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1bdc1ae-d55d-4d2d-9777-4b1023f68d68 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:18.408948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1bdc1ae-d55d-4d2d-9777-4b1023f68d68 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:18.409872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1bdc1ae-d55d-4d2d-9777-4b1023f68d68 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:18.410730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1bdc1ae-d55d-4d2d-9777-4b1023f68d68 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:18.411397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1bdc1ae-d55d-4d2d-9777-4b1023f68d68 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:18.532626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9bbcac62-7c50-4a84-9816-725b94a6fed0 req-ff5cd647-5eba-459d-b74f-15081f8c3507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe33958d-d95d-4038-8178-6ec455caf490", "name": "network-vif-plugged", "status": "completed", "tag": "7b5a58c5-9e96-4c1b-861c-0cc16aa74c7a"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:18.580496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9bbcac62-7c50-4a84-9816-725b94a6fed0 req-ff5cd647-5eba-459d-b74f-15081f8c3507 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:18.581151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9bbcac62-7c50-4a84-9816-725b94a6fed0 req-ff5cd647-5eba-459d-b74f-15081f8c3507 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:18.587691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9bbcac62-7c50-4a84-9816-725b94a6fed0 req-ff5cd647-5eba-459d-b74f-15081f8c3507 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:18.613873 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9bbcac62-7c50-4a84-9816-725b94a6fed0 req-ff5cd647-5eba-459d-b74f-15081f8c3507 service nova] Creating event network-vif-plugged:7b5a58c5-9e96-4c1b-861c-0cc16aa74c7a for instance fe33958d-d95d-4038-8178-6ec455caf490 on n-h2-853611-3 Aug 18 11:46:18.622055 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9bbcac62-7c50-4a84-9816-725b94a6fed0 req-ff5cd647-5eba-459d-b74f-15081f8c3507 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244718 Aug 18 11:46:18.654315 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2464/4649] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:18.660624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b5ace69-d36c-42a7-8557-632f78bc7c2e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:18.679295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8b5ace69-d36c-42a7-8557-632f78bc7c2e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:18.697141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b5ace69-d36c-42a7-8557-632f78bc7c2e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:18.707674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b5ace69-d36c-42a7-8557-632f78bc7c2e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:18.716078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b5ace69-d36c-42a7-8557-632f78bc7c2e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:18.722234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b5ace69-d36c-42a7-8557-632f78bc7c2e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:18.723553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b5ace69-d36c-42a7-8557-632f78bc7c2e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:18.724470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b5ace69-d36c-42a7-8557-632f78bc7c2e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:19.185404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8b5ace69-d36c-42a7-8557-632f78bc7c2e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:19.205862 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8b5ace69-d36c-42a7-8557-632f78bc7c2e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1660 microversion: 2.1 time: 0.550126 Aug 18 11:46:19.222754 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2465/4650] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:18 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1660 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:19.240282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-78e3de36-886a-4147-ba42-3e351d3d488b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:19.249690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-78e3de36-886a-4147-ba42-3e351d3d488b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:19.446758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-78e3de36-886a-4147-ba42-3e351d3d488b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:19.454410 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-78e3de36-886a-4147-ba42-3e351d3d488b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1228 microversion: 2.1 time: 0.230592 Aug 18 11:46:19.462262 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2466/4651] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:19 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1228 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:19.476887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d73f15ec-706a-472c-a8ab-31e457b4a618 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:19.494350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d73f15ec-706a-472c-a8ab-31e457b4a618 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:19.526192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d73f15ec-706a-472c-a8ab-31e457b4a618 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:19.531165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d73f15ec-706a-472c-a8ab-31e457b4a618 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:19.538868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d73f15ec-706a-472c-a8ab-31e457b4a618 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:19.542097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d73f15ec-706a-472c-a8ab-31e457b4a618 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:19.544747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d73f15ec-706a-472c-a8ab-31e457b4a618 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:19.546262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d73f15ec-706a-472c-a8ab-31e457b4a618 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:20.116434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c1bdc1ae-d55d-4d2d-9777-4b1023f68d68 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:20.124614 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c1bdc1ae-d55d-4d2d-9777-4b1023f68d68 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1527 microversion: 2.1 time: 1.769077 Aug 18 11:46:20.125209 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2186/4652] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:18 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1527 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:20.139563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eab1d0ad-fcf0-4f3f-a96c-6f0604c3f956 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:20.143297 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-eab1d0ad-fcf0-4f3f-a96c-6f0604c3f956 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:20.156539 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eab1d0ad-fcf0-4f3f-a96c-6f0604c3f956 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:20.157319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eab1d0ad-fcf0-4f3f-a96c-6f0604c3f956 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:20.157987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eab1d0ad-fcf0-4f3f-a96c-6f0604c3f956 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:20.159084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eab1d0ad-fcf0-4f3f-a96c-6f0604c3f956 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:20.159715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eab1d0ad-fcf0-4f3f-a96c-6f0604c3f956 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:20.160431 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eab1d0ad-fcf0-4f3f-a96c-6f0604c3f956 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:20.473090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d73f15ec-706a-472c-a8ab-31e457b4a618 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:20.483874 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d73f15ec-706a-472c-a8ab-31e457b4a618 tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1528 microversion: 2.1 time: 1.016936 Aug 18 11:46:20.484499 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2467/4653] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:19 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1528 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:20.498878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c527293d-ff77-403b-9ebc-2abec3834ca7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:20.506744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c527293d-ff77-403b-9ebc-2abec3834ca7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:20.532415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c527293d-ff77-403b-9ebc-2abec3834ca7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:20.532659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c527293d-ff77-403b-9ebc-2abec3834ca7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:20.532963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c527293d-ff77-403b-9ebc-2abec3834ca7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:20.533724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c527293d-ff77-403b-9ebc-2abec3834ca7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:20.534193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c527293d-ff77-403b-9ebc-2abec3834ca7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:20.534674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c527293d-ff77-403b-9ebc-2abec3834ca7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:20.949623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c527293d-ff77-403b-9ebc-2abec3834ca7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:20.952345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eab1d0ad-fcf0-4f3f-a96c-6f0604c3f956 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:20.963818 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c527293d-ff77-403b-9ebc-2abec3834ca7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1664 microversion: 2.1 time: 0.474917 Aug 18 11:46:20.965347 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2468/4654] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:20 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1664 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:20.969651 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eab1d0ad-fcf0-4f3f-a96c-6f0604c3f956 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1323 microversion: 2.1 time: 0.840695 Aug 18 11:46:20.970622 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2187/4655] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:20 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1323 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:20.975015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bfc57582-8947-444c-b013-93d659d6aaea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:20.976881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bfc57582-8947-444c-b013-93d659d6aaea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:20.994648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfc57582-8947-444c-b013-93d659d6aaea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:20.997146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfc57582-8947-444c-b013-93d659d6aaea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:20.997925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfc57582-8947-444c-b013-93d659d6aaea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:20.999089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfc57582-8947-444c-b013-93d659d6aaea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:20.999818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfc57582-8947-444c-b013-93d659d6aaea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:21.000587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfc57582-8947-444c-b013-93d659d6aaea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:21.152181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8deaa455-0143-4041-90cb-f27ba55d44fd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:21.152808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8deaa455-0143-4041-90cb-f27ba55d44fd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:21.168124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8deaa455-0143-4041-90cb-f27ba55d44fd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:21.171111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8deaa455-0143-4041-90cb-f27ba55d44fd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:21.171760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8deaa455-0143-4041-90cb-f27ba55d44fd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:21.174759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8deaa455-0143-4041-90cb-f27ba55d44fd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:21.176778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8deaa455-0143-4041-90cb-f27ba55d44fd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:21.177414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8deaa455-0143-4041-90cb-f27ba55d44fd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:21.185051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bfc57582-8947-444c-b013-93d659d6aaea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:21.196323 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bfc57582-8947-444c-b013-93d659d6aaea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1286 microversion: 2.1 time: 0.229039 Aug 18 11:46:21.200750 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2469/4656] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:20 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1286 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:21.511969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2417bbc7-64fc-4cf0-b91f-935ec489979f tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:21.513436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2417bbc7-64fc-4cf0-b91f-935ec489979f tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:21.522646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2417bbc7-64fc-4cf0-b91f-935ec489979f tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:21.524484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2417bbc7-64fc-4cf0-b91f-935ec489979f tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:21.525084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2417bbc7-64fc-4cf0-b91f-935ec489979f tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:21.529935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2417bbc7-64fc-4cf0-b91f-935ec489979f tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:21.530559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2417bbc7-64fc-4cf0-b91f-935ec489979f tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:21.531200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2417bbc7-64fc-4cf0-b91f-935ec489979f tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:21.646230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2417bbc7-64fc-4cf0-b91f-935ec489979f tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '265d100fde6346df81d44c014acd2529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69040d9d34cd4d608dfc842f78ca7532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:21.659365 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2417bbc7-64fc-4cf0-b91f-935ec489979f tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 200 len: 1486 microversion: 2.1 time: 0.152079 Aug 18 11:46:21.663146 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2470/4657] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:21 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 1486 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:21.901321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8deaa455-0143-4041-90cb-f27ba55d44fd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:21.918130 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8deaa455-0143-4041-90cb-f27ba55d44fd tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1527 microversion: 2.1 time: 0.766478 Aug 18 11:46:21.923835 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2188/4658] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:21 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1527 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:21.978323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5ed99498-7b36-43ff-a23a-ba7da554c60c req-147d3426-dfc0-48f8-9aeb-e7cbc84e449d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7182d507-c3fa-4453-bde3-90ba727aa886", "name": "network-vif-deleted", "tag": "a483f82f-342c-4fcc-abf7-177f065ef4ec"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:21.995541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-be42e346-3d16-477e-93fd-045799f0a23e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:21.996157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-be42e346-3d16-477e-93fd-045799f0a23e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:21.999864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5ed99498-7b36-43ff-a23a-ba7da554c60c req-147d3426-dfc0-48f8-9aeb-e7cbc84e449d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:22.000592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5ed99498-7b36-43ff-a23a-ba7da554c60c req-147d3426-dfc0-48f8-9aeb-e7cbc84e449d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:22.002948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5ed99498-7b36-43ff-a23a-ba7da554c60c req-147d3426-dfc0-48f8-9aeb-e7cbc84e449d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:22.011072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be42e346-3d16-477e-93fd-045799f0a23e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:22.012979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be42e346-3d16-477e-93fd-045799f0a23e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:22.013563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be42e346-3d16-477e-93fd-045799f0a23e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:22.017152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be42e346-3d16-477e-93fd-045799f0a23e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:22.019812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be42e346-3d16-477e-93fd-045799f0a23e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:22.024057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-be42e346-3d16-477e-93fd-045799f0a23e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:22.041094 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5ed99498-7b36-43ff-a23a-ba7da554c60c req-147d3426-dfc0-48f8-9aeb-e7cbc84e449d service nova] Creating event network-vif-deleted:a483f82f-342c-4fcc-abf7-177f065ef4ec for instance 7182d507-c3fa-4453-bde3-90ba727aa886 on n-h1-853611-3 Aug 18 11:46:22.053761 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5ed99498-7b36-43ff-a23a-ba7da554c60c req-147d3426-dfc0-48f8-9aeb-e7cbc84e449d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084856 Aug 18 11:46:22.056261 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2471/4659] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:22.229394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8879b09c-6d5e-4531-8dcc-7a6f564bfa1f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:22.231199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8879b09c-6d5e-4531-8dcc-7a6f564bfa1f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:22.251399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8879b09c-6d5e-4531-8dcc-7a6f564bfa1f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:22.252268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8879b09c-6d5e-4531-8dcc-7a6f564bfa1f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:22.253176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8879b09c-6d5e-4531-8dcc-7a6f564bfa1f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:22.254274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8879b09c-6d5e-4531-8dcc-7a6f564bfa1f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:22.255147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8879b09c-6d5e-4531-8dcc-7a6f564bfa1f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:22.256527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8879b09c-6d5e-4531-8dcc-7a6f564bfa1f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:22.392579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8879b09c-6d5e-4531-8dcc-7a6f564bfa1f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:22.403008 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8879b09c-6d5e-4531-8dcc-7a6f564bfa1f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1286 microversion: 2.1 time: 0.183052 Aug 18 11:46:22.404710 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2472/4660] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:22 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1286 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:22.625034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-be42e346-3d16-477e-93fd-045799f0a23e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:22.646172 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-be42e346-3d16-477e-93fd-045799f0a23e tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1519 microversion: 2.1 time: 0.655821 Aug 18 11:46:22.646765 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2189/4661] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:21 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1519 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:22.691548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-561aa611-ce3b-46a4-8335-77ea67c105aa tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:22.693049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-561aa611-ce3b-46a4-8335-77ea67c105aa tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] [instance: 7182d507-c3fa-4453-bde3-90ba727aa886] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:22.701596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-561aa611-ce3b-46a4-8335-77ea67c105aa tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:22.702498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-561aa611-ce3b-46a4-8335-77ea67c105aa tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:22.703182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-561aa611-ce3b-46a4-8335-77ea67c105aa tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:22.704115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-561aa611-ce3b-46a4-8335-77ea67c105aa tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:22.704825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-561aa611-ce3b-46a4-8335-77ea67c105aa tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:22.705498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-561aa611-ce3b-46a4-8335-77ea67c105aa tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:22.746964 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-561aa611-ce3b-46a4-8335-77ea67c105aa tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] HTTP exception thrown: Instance 7182d507-c3fa-4453-bde3-90ba727aa886 could not be found. Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-561aa611-ce3b-46a4-8335-77ea67c105aa tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Request method failure captured: Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 HTTP/1.1 Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iZqLLDjxmha4dX4oPtnmdEjI2KrF_Z9NA6mz-zMJDJkWYZTliH5kT70teRlDeeYJgwPp4sUxdfMPWE6k7ZM3sZuHL51V7HXQkoOEwWDbchlY9UcQzN_4ov2CVJelrrpbEYrhM1fiOCWwxg1D2J-0wjnuBHuP3EmVhucqNk-uuzQtTg Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 69040d9d34cd4d608dfc842f78ca7532 Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1877959385 Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/69040d9d34cd4d608dfc842f78ca7532"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/69040d9d34cd4d608dfc842f78ca7532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_69040d9d34cd4d608dfc842f78ca7532"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/69040d9d34cd4d608dfc842f78ca7532"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1877959385 Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 69040d9d34cd4d608dfc842f78ca7532 Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1877959385 Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-InstanceActionsNegativeTestJSON-1877959385-project Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 265d100fde6346df81d44c014acd2529 Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1877959385-project Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 7182d507-c3fa-4453-bde3-90ba727aa886 could not be found. Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '7182d507-c3fa-4453-bde3-90ba727aa886'} Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7182d507-c3fa-4453-bde3-90ba727aa886 could not be found. Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7182d507-c3fa-4453-bde3-90ba727aa886 could not be found. Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:22.749689 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:22.753932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:22.753932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:22.753932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:22.753932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:22.753932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:46:22.753932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:46:22.753932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7182d507-c3fa-4453-bde3-90ba727aa886 could not be found. Aug 18 11:46:22.753932 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:22.758095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-561aa611-ce3b-46a4-8335-77ea67c105aa tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] Returning 404 to user: Instance 7182d507-c3fa-4453-bde3-90ba727aa886 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:22.759251 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-561aa611-ce3b-46a4-8335-77ea67c105aa tempest-InstanceActionsNegativeTestJSON-1877959385 tempest-InstanceActionsNegativeTestJSON-1877959385-project] 10.222.0.73 "GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886" status: 404 len: 111 microversion: 2.1 time: 0.081899 Aug 18 11:46:22.769310 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2473/4662] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:22 2022] GET /compute/v2.1/servers/7182d507-c3fa-4453-bde3-90ba727aa886 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:46:22.903038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e3e75369-b55e-451e-9dc4-72159fa9372c tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-613974724", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "4843c366-9249-442c-967c-92f98005fa89"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e3e75369-b55e-451e-9dc4-72159fa9372c tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Request method failure captured: Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 242 Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iZx7zirvHs48vS2s0WnnbLoAxYnv2_o3iEShRalPbsfcBW6h3fWCGLSjmUn5a1o_sKV2ZrFZjQagZb_cqgJUXGPrT3-qZXuxMgPnGz4AUU9N-_b1ugBdZRLSSTX9y9AtAdVhhq1XcOirMipnZh1_8XvhUBhpH3l5LkmHk2bytGr0vs Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1f3abf383267459f998256c475d7e1db Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-613974724", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "4843c366-9249-442c-967c-92f98005fa89"}]}} Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-613974724', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '4843c366-9249-442c-967c-92f98005fa89'}]}}} Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:22.918557 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:22.923963 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:22.941269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ece946ab-a49c-4e19-9e95-5cfc9ea7ff63 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:22.947032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ece946ab-a49c-4e19-9e95-5cfc9ea7ff63 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:22.958796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ece946ab-a49c-4e19-9e95-5cfc9ea7ff63 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:22.961672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e3e75369-b55e-451e-9dc4-72159fa9372c tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:22.971070 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e3e75369-b55e-451e-9dc4-72159fa9372c tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.073085 Aug 18 11:46:22.972732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ece946ab-a49c-4e19-9e95-5cfc9ea7ff63 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:22.973169 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2190/4663] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:46:22 2022] POST /compute/v2.1/servers => generated 175 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:46:22.983831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ece946ab-a49c-4e19-9e95-5cfc9ea7ff63 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:22.989992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ece946ab-a49c-4e19-9e95-5cfc9ea7ff63 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:22.990744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ece946ab-a49c-4e19-9e95-5cfc9ea7ff63 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:22.993114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ece946ab-a49c-4e19-9e95-5cfc9ea7ff63 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:23.002002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64cbd023-18b6-401b-b180-9bd96621874d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:23.004476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-64cbd023-18b6-401b-b180-9bd96621874d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: ffc20a35-a765-4085-92f7-e22bfc9cd684] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:23.035267 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-64cbd023-18b6-401b-b180-9bd96621874d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] HTTP exception thrown: Instance ffc20a35-a765-4085-92f7-e22bfc9cd684 could not be found. Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64cbd023-18b6-401b-b180-9bd96621874d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Request method failure captured: Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/ffc20a35-a765-4085-92f7-e22bfc9cd684/metadata HTTP/1.1 Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iZx7zirvHs48vS2s0WnnbLoAxYnv2_o3iEShRalPbsfcBW6h3fWCGLSjmUn5a1o_sKV2ZrFZjQagZb_cqgJUXGPrT3-qZXuxMgPnGz4AUU9N-_b1ugBdZRLSSTX9y9AtAdVhhq1XcOirMipnZh1_8XvhUBhpH3l5LkmHk2bytGr0vs Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1f3abf383267459f998256c475d7e1db Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance ffc20a35-a765-4085-92f7-e22bfc9cd684 could not be found. Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'server_id': 'ffc20a35-a765-4085-92f7-e22bfc9cd684'} Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc20a35-a765-4085-92f7-e22bfc9cd684 could not be found. Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc20a35-a765-4085-92f7-e22bfc9cd684 could not be found. Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:23.044445 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:23.050346 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:46:23.050346 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:46:23.050346 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc20a35-a765-4085-92f7-e22bfc9cd684 could not be found. Aug 18 11:46:23.050346 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.051748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64cbd023-18b6-401b-b180-9bd96621874d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Returning 404 to user: Instance ffc20a35-a765-4085-92f7-e22bfc9cd684 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:23.054982 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-64cbd023-18b6-401b-b180-9bd96621874d tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/ffc20a35-a765-4085-92f7-e22bfc9cd684/metadata" status: 404 len: 111 microversion: 2.1 time: 0.072667 Aug 18 11:46:23.056737 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2191/4664] 10.222.0.73 () {58 vars in 1263 bytes} [Thu Aug 18 11:46:22 2022] GET /compute/v2.1/servers/ffc20a35-a765-4085-92f7-e22bfc9cd684/metadata => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:46:23.144785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-30633565-2590-4287-b200-a4be70927e96 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1377615830", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4843c366-9249-442c-967c-92f98005fa89"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-30633565-2590-4287-b200-a4be70927e96 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Request method failure captured: Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 499 Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iZx7zirvHs48vS2s0WnnbLoAxYnv2_o3iEShRalPbsfcBW6h3fWCGLSjmUn5a1o_sKV2ZrFZjQagZb_cqgJUXGPrT3-qZXuxMgPnGz4AUU9N-_b1ugBdZRLSSTX9y9AtAdVhhq1XcOirMipnZh1_8XvhUBhpH3l5LkmHk2bytGr0vs Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1f3abf383267459f998256c475d7e1db Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1377615830", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4843c366-9249-442c-967c-92f98005fa89"}]}} Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1377615830', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4843c366-9249-442c-967c-92f98005fa89'}]}}} Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 18 11:46:23.150363 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.153205 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.157263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-30633565-2590-4287-b200-a4be70927e96 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:23.158371 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-30633565-2590-4287-b200-a4be70927e96 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.017539 Aug 18 11:46:23.169336 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2192/4665] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:46:23 2022] POST /compute/v2.1/servers => generated 687 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:46:23.219346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b7098fd9-7630-4138-9c9a-8a39ded25ae0 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-763490779", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4843c366-9249-442c-967c-92f98005fa89"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b7098fd9-7630-4138-9c9a-8a39ded25ae0 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Request method failure captured: Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 499 Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iZx7zirvHs48vS2s0WnnbLoAxYnv2_o3iEShRalPbsfcBW6h3fWCGLSjmUn5a1o_sKV2ZrFZjQagZb_cqgJUXGPrT3-qZXuxMgPnGz4AUU9N-_b1ugBdZRLSSTX9y9AtAdVhhq1XcOirMipnZh1_8XvhUBhpH3l5LkmHk2bytGr0vs Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1f3abf383267459f998256c475d7e1db Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-763490779", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4843c366-9249-442c-967c-92f98005fa89"}]}} Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-763490779', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4843c366-9249-442c-967c-92f98005fa89'}]}}} Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 18 11:46:23.223872 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b7098fd9-7630-4138-9c9a-8a39ded25ae0 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b7098fd9-7630-4138-9c9a-8a39ded25ae0 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.011292 Aug 18 11:46:23.235637 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2193/4666] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:46:23 2022] POST /compute/v2.1/servers => generated 689 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:46:23.313056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cf04ac15-bc93-44e4-9d63-e24b31924c5f tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-498525338", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4843c366-9249-442c-967c-92f98005fa89"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cf04ac15-bc93-44e4-9d63-e24b31924c5f tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Request method failure captured: Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 753 Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iZx7zirvHs48vS2s0WnnbLoAxYnv2_o3iEShRalPbsfcBW6h3fWCGLSjmUn5a1o_sKV2ZrFZjQagZb_cqgJUXGPrT3-qZXuxMgPnGz4AUU9N-_b1ugBdZRLSSTX9y9AtAdVhhq1XcOirMipnZh1_8XvhUBhpH3l5LkmHk2bytGr0vs Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1f3abf383267459f998256c475d7e1db Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-498525338", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4843c366-9249-442c-967c-92f98005fa89"}]}} Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-498525338', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4843c366-9249-442c-967c-92f98005fa89'}]}}} Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:46:23.317797 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:46:23.321326 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:46:23.323754 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.323754 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.327366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cf04ac15-bc93-44e4-9d63-e24b31924c5f tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:23.335625 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cf04ac15-bc93-44e4-9d63-e24b31924c5f tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.027364 Aug 18 11:46:23.336117 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2194/4667] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:46:23 2022] POST /compute/v2.1/servers => generated 1197 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 18 11:46:23.386998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ece946ab-a49c-4e19-9e95-5cfc9ea7ff63 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:23.395638 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ece946ab-a49c-4e19-9e95-5cfc9ea7ff63 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1527 microversion: 2.1 time: 0.458252 Aug 18 11:46:23.399093 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2474/4668] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:22 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1527 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:46:23.426744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c162a5c8-2451-4efa-9ebe-188017bc6993 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:23.427679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c162a5c8-2451-4efa-9ebe-188017bc6993 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:23.434093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e0f5b27-b5f7-42c1-b9ea-de0e9f366113 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-958154662", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4843c366-9249-442c-967c-92f98005fa89"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:23.444863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c162a5c8-2451-4efa-9ebe-188017bc6993 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:23.457752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c162a5c8-2451-4efa-9ebe-188017bc6993 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:23.458500 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c162a5c8-2451-4efa-9ebe-188017bc6993 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:23.461142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c162a5c8-2451-4efa-9ebe-188017bc6993 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e0f5b27-b5f7-42c1-b9ea-de0e9f366113 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Request method failure captured: Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 1265 Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iZx7zirvHs48vS2s0WnnbLoAxYnv2_o3iEShRalPbsfcBW6h3fWCGLSjmUn5a1o_sKV2ZrFZjQagZb_cqgJUXGPrT3-qZXuxMgPnGz4AUU9N-_b1ugBdZRLSSTX9y9AtAdVhhq1XcOirMipnZh1_8XvhUBhpH3l5LkmHk2bytGr0vs Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 1f3abf383267459f998256c475d7e1db Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-958154662", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4843c366-9249-442c-967c-92f98005fa89"}]}} Aug 18 11:46:23.466698 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-958154662', 'imageRef': '1073d795-16bf-4b88-a573-c9b71aeef18a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4843c366-9249-442c-967c-92f98005fa89'}]}}} Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.469166 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:46:23.470367 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:46:23.472313 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 18 11:46:23.472313 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.473410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c162a5c8-2451-4efa-9ebe-188017bc6993 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:23.473885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c162a5c8-2451-4efa-9ebe-188017bc6993 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:23.475285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e0f5b27-b5f7-42c1-b9ea-de0e9f366113 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:23.479369 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2e0f5b27-b5f7-42c1-b9ea-de0e9f366113 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.050213 Aug 18 11:46:23.480719 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2475/4669] 10.222.0.73 () {60 vars in 1148 bytes} [Thu Aug 18 11:46:23 2022] POST /compute/v2.1/servers => generated 2221 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 18 11:46:23.500711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-886774f4-8167-4915-a9a6-b75d67c99780 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:23.505919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-886774f4-8167-4915-a9a6-b75d67c99780 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: f260dbd4-2436-42e5-9dc8-630f9fc51fb4] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:23.523530 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-886774f4-8167-4915-a9a6-b75d67c99780 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] HTTP exception thrown: Instance f260dbd4-2436-42e5-9dc8-630f9fc51fb4 could not be found. Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-886774f4-8167-4915-a9a6-b75d67c99780 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Request method failure captured: Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/f260dbd4-2436-42e5-9dc8-630f9fc51fb4/metadata/test2 HTTP/1.1 Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iZx7zirvHs48vS2s0WnnbLoAxYnv2_o3iEShRalPbsfcBW6h3fWCGLSjmUn5a1o_sKV2ZrFZjQagZb_cqgJUXGPrT3-qZXuxMgPnGz4AUU9N-_b1ugBdZRLSSTX9y9AtAdVhhq1XcOirMipnZh1_8XvhUBhpH3l5LkmHk2bytGr0vs Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 1f3abf383267459f998256c475d7e1db Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance f260dbd4-2436-42e5-9dc8-630f9fc51fb4 could not be found. Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': 'f260dbd4-2436-42e5-9dc8-630f9fc51fb4', 'id': 'test2'} Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f260dbd4-2436-42e5-9dc8-630f9fc51fb4 could not be found. Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f260dbd4-2436-42e5-9dc8-630f9fc51fb4 could not be found. Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:23.525810 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:23.529557 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:46:23.529557 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:46:23.529557 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f260dbd4-2436-42e5-9dc8-630f9fc51fb4 could not be found. Aug 18 11:46:23.529557 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:23.533626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-886774f4-8167-4915-a9a6-b75d67c99780 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Returning 404 to user: Instance f260dbd4-2436-42e5-9dc8-630f9fc51fb4 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:23.534885 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-886774f4-8167-4915-a9a6-b75d67c99780 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/f260dbd4-2436-42e5-9dc8-630f9fc51fb4/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.043352 Aug 18 11:46:23.546114 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2476/4670] 10.222.0.73 () {58 vars in 1281 bytes} [Thu Aug 18 11:46:23 2022] GET /compute/v2.1/servers/f260dbd4-2436-42e5-9dc8-630f9fc51fb4/metadata/test2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:46:23.551459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1f7f0183-61af-4b4e-be2a-c1ec72a10590 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:23.552048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1f7f0183-61af-4b4e-be2a-c1ec72a10590 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:23.560890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f7f0183-61af-4b4e-be2a-c1ec72a10590 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:23.561479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f7f0183-61af-4b4e-be2a-c1ec72a10590 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:23.562152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f7f0183-61af-4b4e-be2a-c1ec72a10590 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:23.563352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f7f0183-61af-4b4e-be2a-c1ec72a10590 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:23.564091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f7f0183-61af-4b4e-be2a-c1ec72a10590 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:23.564687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f7f0183-61af-4b4e-be2a-c1ec72a10590 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:23.593456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:23.607693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1f7f0183-61af-4b4e-be2a-c1ec72a10590 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:46:23.774489 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1f7f0183-61af-4b4e-be2a-c1ec72a10590 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 204 len: 0 microversion: 2.1 time: 0.226552 Aug 18 11:46:23.782570 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2477/4671] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:46:23 2022] DELETE /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:46:23.838524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-25c3cf2c-dc27-46be-b104-16a5ee202caa tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:23.842569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-25c3cf2c-dc27-46be-b104-16a5ee202caa tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:23.863991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25c3cf2c-dc27-46be-b104-16a5ee202caa tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:23.864521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25c3cf2c-dc27-46be-b104-16a5ee202caa tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:23.867282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25c3cf2c-dc27-46be-b104-16a5ee202caa tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:23.868102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25c3cf2c-dc27-46be-b104-16a5ee202caa tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:23.868584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25c3cf2c-dc27-46be-b104-16a5ee202caa tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:23.869031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25c3cf2c-dc27-46be-b104-16a5ee202caa tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:24.284138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c162a5c8-2451-4efa-9ebe-188017bc6993 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:24.300244 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c162a5c8-2451-4efa-9ebe-188017bc6993 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1328 microversion: 2.1 time: 0.876348 Aug 18 11:46:24.301558 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2195/4672] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:23 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1328 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:24.428362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-03c89ae9-492a-427b-8778-d69593960aab tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:24.430755 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-03c89ae9-492a-427b-8778-d69593960aab tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:24.447853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03c89ae9-492a-427b-8778-d69593960aab tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:24.452611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03c89ae9-492a-427b-8778-d69593960aab tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:24.453631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03c89ae9-492a-427b-8778-d69593960aab tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:24.454796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03c89ae9-492a-427b-8778-d69593960aab tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:24.455549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03c89ae9-492a-427b-8778-d69593960aab tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:24.456255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03c89ae9-492a-427b-8778-d69593960aab tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:24.530793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-25c3cf2c-dc27-46be-b104-16a5ee202caa tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:24.543915 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-25c3cf2c-dc27-46be-b104-16a5ee202caa tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1525 microversion: 2.1 time: 0.742646 Aug 18 11:46:24.555952 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2478/4673] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:23 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1525 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:25.326861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-72792824-b7d1-44db-8a0a-53cde97ab90d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:25.349347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-72792824-b7d1-44db-8a0a-53cde97ab90d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:25.410691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72792824-b7d1-44db-8a0a-53cde97ab90d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:25.414333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72792824-b7d1-44db-8a0a-53cde97ab90d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:25.422696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72792824-b7d1-44db-8a0a-53cde97ab90d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:25.424228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72792824-b7d1-44db-8a0a-53cde97ab90d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:25.425989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72792824-b7d1-44db-8a0a-53cde97ab90d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:25.428722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72792824-b7d1-44db-8a0a-53cde97ab90d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:25.940938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-03c89ae9-492a-427b-8778-d69593960aab tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:25.955954 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-03c89ae9-492a-427b-8778-d69593960aab tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1527 microversion: 2.1 time: 1.535098 Aug 18 11:46:25.957320 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2196/4674] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:24 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1527 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:25.971684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9534e9a1-f3be-41b3-b27d-7f87a2105527 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:25.972711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9534e9a1-f3be-41b3-b27d-7f87a2105527 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:25.975266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:25.988162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9534e9a1-f3be-41b3-b27d-7f87a2105527 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:25.991098 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9534e9a1-f3be-41b3-b27d-7f87a2105527 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:25.992981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9534e9a1-f3be-41b3-b27d-7f87a2105527 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:25.994808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9534e9a1-f3be-41b3-b27d-7f87a2105527 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:25.996185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9534e9a1-f3be-41b3-b27d-7f87a2105527 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:25.999165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9534e9a1-f3be-41b3-b27d-7f87a2105527 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:26.239596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-72792824-b7d1-44db-8a0a-53cde97ab90d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:26.255646 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-72792824-b7d1-44db-8a0a-53cde97ab90d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1328 microversion: 2.1 time: 0.937728 Aug 18 11:46:26.256629 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2479/4675] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:25 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1328 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:26.978803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55feeb2a-88f2-4536-bb4f-8f824ee865f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:26.983203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-55feeb2a-88f2-4536-bb4f-8f824ee865f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:27.008945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55feeb2a-88f2-4536-bb4f-8f824ee865f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:27.009712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55feeb2a-88f2-4536-bb4f-8f824ee865f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:27.010349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55feeb2a-88f2-4536-bb4f-8f824ee865f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:27.018252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55feeb2a-88f2-4536-bb4f-8f824ee865f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:27.019030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55feeb2a-88f2-4536-bb4f-8f824ee865f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:27.019734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55feeb2a-88f2-4536-bb4f-8f824ee865f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:27.176794 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9534e9a1-f3be-41b3-b27d-7f87a2105527 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:27.192691 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9534e9a1-f3be-41b3-b27d-7f87a2105527 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1525 microversion: 2.1 time: 1.232479 Aug 18 11:46:27.208406 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2197/4676] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:25 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1525 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:27.282282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-16e63ce8-6b24-47ff-86bb-15d06dfb4ec4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:27.283637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-16e63ce8-6b24-47ff-86bb-15d06dfb4ec4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:27.307094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16e63ce8-6b24-47ff-86bb-15d06dfb4ec4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:27.315477 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16e63ce8-6b24-47ff-86bb-15d06dfb4ec4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:27.316294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16e63ce8-6b24-47ff-86bb-15d06dfb4ec4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:27.317552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16e63ce8-6b24-47ff-86bb-15d06dfb4ec4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:27.318366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16e63ce8-6b24-47ff-86bb-15d06dfb4ec4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:27.319146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-16e63ce8-6b24-47ff-86bb-15d06dfb4ec4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:27.553248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-55feeb2a-88f2-4536-bb4f-8f824ee865f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:27.565866 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-55feeb2a-88f2-4536-bb4f-8f824ee865f0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1527 microversion: 2.1 time: 0.592153 Aug 18 11:46:27.567467 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2480/4677] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:26 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1527 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:28.182325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:28.208843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:28.227108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-feedd2c9-2396-4ca6-bc85-ae9939491503 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:28.242287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-feedd2c9-2396-4ca6-bc85-ae9939491503 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:28.262677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-feedd2c9-2396-4ca6-bc85-ae9939491503 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:28.268201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-feedd2c9-2396-4ca6-bc85-ae9939491503 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:28.271250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-feedd2c9-2396-4ca6-bc85-ae9939491503 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:28.273756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-feedd2c9-2396-4ca6-bc85-ae9939491503 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:28.276172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-feedd2c9-2396-4ca6-bc85-ae9939491503 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:28.278358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-feedd2c9-2396-4ca6-bc85-ae9939491503 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:28.828104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-feedd2c9-2396-4ca6-bc85-ae9939491503 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:28.860427 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-feedd2c9-2396-4ca6-bc85-ae9939491503 tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1525 microversion: 2.1 time: 0.641636 Aug 18 11:46:28.863642 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2481/4678] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:28 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1525 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:28.895874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b1122072-9bed-4164-9638-5a5b743d1a32 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:28.900561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b1122072-9bed-4164-9638-5a5b743d1a32 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:28.917339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1122072-9bed-4164-9638-5a5b743d1a32 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:28.919753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1122072-9bed-4164-9638-5a5b743d1a32 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:28.921219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1122072-9bed-4164-9638-5a5b743d1a32 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:28.923426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1122072-9bed-4164-9638-5a5b743d1a32 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:28.927013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1122072-9bed-4164-9638-5a5b743d1a32 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:28.931517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1122072-9bed-4164-9638-5a5b743d1a32 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:28.960391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-16e63ce8-6b24-47ff-86bb-15d06dfb4ec4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:28.976937 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-16e63ce8-6b24-47ff-86bb-15d06dfb4ec4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1328 microversion: 2.1 time: 1.702429 Aug 18 11:46:28.977659 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2198/4679] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:27 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1328 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:29.325686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b1122072-9bed-4164-9638-5a5b743d1a32 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:29.339458 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b1122072-9bed-4164-9638-5a5b743d1a32 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1509 microversion: 2.1 time: 0.472774 Aug 18 11:46:29.340074 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2482/4680] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:28 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1509 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:29.669748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-72cb1197-2e87-45a6-bf99-217f05655f1b req-bf081460-d8a2-48f5-a192-f007aba45efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe33958d-d95d-4038-8178-6ec455caf490", "name": "network-vif-deleted", "tag": "7b5a58c5-9e96-4c1b-861c-0cc16aa74c7a"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:29.708396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-72cb1197-2e87-45a6-bf99-217f05655f1b req-bf081460-d8a2-48f5-a192-f007aba45efa service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:29.709478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-72cb1197-2e87-45a6-bf99-217f05655f1b req-bf081460-d8a2-48f5-a192-f007aba45efa service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:29.710153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-72cb1197-2e87-45a6-bf99-217f05655f1b req-bf081460-d8a2-48f5-a192-f007aba45efa service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:29.755307 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-72cb1197-2e87-45a6-bf99-217f05655f1b req-bf081460-d8a2-48f5-a192-f007aba45efa service nova] Creating event network-vif-deleted:7b5a58c5-9e96-4c1b-861c-0cc16aa74c7a for instance fe33958d-d95d-4038-8178-6ec455caf490 on n-h2-853611-3 Aug 18 11:46:29.782375 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-72cb1197-2e87-45a6-bf99-217f05655f1b req-bf081460-d8a2-48f5-a192-f007aba45efa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116043 Aug 18 11:46:29.795707 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2199/4681] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:29.899932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9400da9e-5adb-4881-8f51-0c71b02364ed tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:29.900627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9400da9e-5adb-4881-8f51-0c71b02364ed tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:29.906019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:29.938178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9400da9e-5adb-4881-8f51-0c71b02364ed tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:29.944739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9400da9e-5adb-4881-8f51-0c71b02364ed tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:29.953777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9400da9e-5adb-4881-8f51-0c71b02364ed tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:29.957202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9400da9e-5adb-4881-8f51-0c71b02364ed tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:29.957720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9400da9e-5adb-4881-8f51-0c71b02364ed tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:29.958177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9400da9e-5adb-4881-8f51-0c71b02364ed tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:30.078951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9400da9e-5adb-4881-8f51-0c71b02364ed tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:30.082403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9400da9e-5adb-4881-8f51-0c71b02364ed tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:30.085362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9400da9e-5adb-4881-8f51-0c71b02364ed tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:30.087298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-9400da9e-5adb-4881-8f51-0c71b02364ed tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lazy-loading 'fault' on Instance uuid fe33958d-d95d-4038-8178-6ec455caf490 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:46:30.131109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-186769776", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "0ed8dcea-ac40-4b37-b055-aad3d3b39887"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:30.216399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] validate_networks() for [('0ed8dcea-ac40-4b37-b055-aad3d3b39887', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:46:30.325915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9400da9e-5adb-4881-8f51-0c71b02364ed tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3abf383267459f998256c475d7e1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7436cf03ec16499b904dce330bb5f0dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:30.343641 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9400da9e-5adb-4881-8f51-0c71b02364ed tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 200 len: 1313 microversion: 2.1 time: 0.448995 Aug 18 11:46:30.351125 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2483/4682] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:29 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:46:30.384557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a6231f4-d962-42dc-bcdb-310ef7000d33 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:30.385802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4a6231f4-d962-42dc-bcdb-310ef7000d33 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:30.400806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a6231f4-d962-42dc-bcdb-310ef7000d33 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:30.402974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a6231f4-d962-42dc-bcdb-310ef7000d33 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:30.404782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a6231f4-d962-42dc-bcdb-310ef7000d33 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:30.407084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a6231f4-d962-42dc-bcdb-310ef7000d33 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:30.408489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a6231f4-d962-42dc-bcdb-310ef7000d33 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:30.410679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a6231f4-d962-42dc-bcdb-310ef7000d33 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:30.829667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4a6231f4-d962-42dc-bcdb-310ef7000d33 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:30.845832 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4a6231f4-d962-42dc-bcdb-310ef7000d33 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1328 microversion: 2.1 time: 0.488581 Aug 18 11:46:30.846555 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2484/4683] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:30 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1328 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:30.874115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b6f45bb5-5b54-4c35-b8bb-fba1a7c5e05f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:30.874908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b6f45bb5-5b54-4c35-b8bb-fba1a7c5e05f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:30.892329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6f45bb5-5b54-4c35-b8bb-fba1a7c5e05f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:30.892827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6f45bb5-5b54-4c35-b8bb-fba1a7c5e05f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:30.894490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6f45bb5-5b54-4c35-b8bb-fba1a7c5e05f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:30.896368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6f45bb5-5b54-4c35-b8bb-fba1a7c5e05f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:30.897695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6f45bb5-5b54-4c35-b8bb-fba1a7c5e05f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:30.898305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6f45bb5-5b54-4c35-b8bb-fba1a7c5e05f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:31.294364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b6f45bb5-5b54-4c35-b8bb-fba1a7c5e05f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:31.305105 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b6f45bb5-5b54-4c35-b8bb-fba1a7c5e05f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1509 microversion: 2.1 time: 0.457217 Aug 18 11:46:31.321353 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2485/4684] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:30 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1509 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:31.377255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1cbc72eb-a9a9-4eb3-8a8a-33d9177812ee tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:31.378907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1cbc72eb-a9a9-4eb3-8a8a-33d9177812ee tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] [instance: fe33958d-d95d-4038-8178-6ec455caf490] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:31.396461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cbc72eb-a9a9-4eb3-8a8a-33d9177812ee tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:31.398175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cbc72eb-a9a9-4eb3-8a8a-33d9177812ee tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:31.398870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cbc72eb-a9a9-4eb3-8a8a-33d9177812ee tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:31.399823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cbc72eb-a9a9-4eb3-8a8a-33d9177812ee tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:31.401316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cbc72eb-a9a9-4eb3-8a8a-33d9177812ee tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:31.402058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cbc72eb-a9a9-4eb3-8a8a-33d9177812ee tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:31.434067 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-1cbc72eb-a9a9-4eb3-8a8a-33d9177812ee tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] HTTP exception thrown: Instance fe33958d-d95d-4038-8178-6ec455caf490 could not be found. Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1cbc72eb-a9a9-4eb3-8a8a-33d9177812ee tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Request method failure captured: Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 HTTP/1.1 Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iZx7zirvHs48vS2s0WnnbLoAxYnv2_o3iEShRalPbsfcBW6h3fWCGLSjmUn5a1o_sKV2ZrFZjQagZb_cqgJUXGPrT3-qZXuxMgPnGz4AUU9N-_b1ugBdZRLSSTX9y9AtAdVhhq1XcOirMipnZh1_8XvhUBhpH3l5LkmHk2bytGr0vs Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7436cf03ec16499b904dce330bb5f0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 7436cf03ec16499b904dce330bb5f0dc Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2094938121 Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 1f3abf383267459f998256c475d7e1db Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2094938121-project Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance fe33958d-d95d-4038-8178-6ec455caf490 could not be found. Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'fe33958d-d95d-4038-8178-6ec455caf490'} Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe33958d-d95d-4038-8178-6ec455caf490 could not be found. Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe33958d-d95d-4038-8178-6ec455caf490 could not be found. Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:31.459238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:31.471918 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:31.471918 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:31.471918 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:31.471918 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:31.471918 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:46:31.471918 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:46:31.471918 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe33958d-d95d-4038-8178-6ec455caf490 could not be found. Aug 18 11:46:31.471918 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:31.476499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1cbc72eb-a9a9-4eb3-8a8a-33d9177812ee tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] Returning 404 to user: Instance fe33958d-d95d-4038-8178-6ec455caf490 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:31.478025 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1cbc72eb-a9a9-4eb3-8a8a-33d9177812ee tempest-ServerMetadataNegativeTestJSON-2094938121 tempest-ServerMetadataNegativeTestJSON-2094938121-project] 10.222.0.73 "GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490" status: 404 len: 111 microversion: 2.1 time: 0.106510 Aug 18 11:46:31.479667 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2486/4685] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:31 2022] GET /compute/v2.1/servers/fe33958d-d95d-4038-8178-6ec455caf490 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:46:31.835961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4d571225-1806-4a5d-9840-ec0ec754d56f req-18d8bc94-9809-4bac-91b5-47beb984f582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be93e56-058c-4369-95e5-d281ef5b9df1", "tag": "744ae921-4ee3-4764-b404-5f868c2045ac"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:31.875283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4d571225-1806-4a5d-9840-ec0ec754d56f req-18d8bc94-9809-4bac-91b5-47beb984f582 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:31.876263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4d571225-1806-4a5d-9840-ec0ec754d56f req-18d8bc94-9809-4bac-91b5-47beb984f582 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:31.877096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4d571225-1806-4a5d-9840-ec0ec754d56f req-18d8bc94-9809-4bac-91b5-47beb984f582 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:31.930061 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4d571225-1806-4a5d-9840-ec0ec754d56f req-18d8bc94-9809-4bac-91b5-47beb984f582 service nova] Creating event network-changed:744ae921-4ee3-4764-b404-5f868c2045ac for instance 7be93e56-058c-4369-95e5-d281ef5b9df1 on n-h1-853611-3 Aug 18 11:46:31.945369 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4d571225-1806-4a5d-9840-ec0ec754d56f req-18d8bc94-9809-4bac-91b5-47beb984f582 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114453 Aug 18 11:46:31.950075 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2487/4686] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:46:31.966991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b8ef9df-616d-41f2-9bcb-b797ef1449cc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:31.967667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b8ef9df-616d-41f2-9bcb-b797ef1449cc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:31.982778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ef9df-616d-41f2-9bcb-b797ef1449cc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:31.983284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ef9df-616d-41f2-9bcb-b797ef1449cc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:31.983845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ef9df-616d-41f2-9bcb-b797ef1449cc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:31.991762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ef9df-616d-41f2-9bcb-b797ef1449cc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:31.992136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ef9df-616d-41f2-9bcb-b797ef1449cc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:31.992636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ef9df-616d-41f2-9bcb-b797ef1449cc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:32.335226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:46:32.336509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:46:32.338225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:46:32.341237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:46:32.346127 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:46:32.399899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:32.400327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:32.401877 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:32.403092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:32.403591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:32.404037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:32.418480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b8ef9df-616d-41f2-9bcb-b797ef1449cc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:32.433335 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b8ef9df-616d-41f2-9bcb-b797ef1449cc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1328 microversion: 2.1 time: 0.479458 Aug 18 11:46:32.449130 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2488/4687] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:31 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1328 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:32.451997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Getting quotas for project b73b6d77ea914860ab3f8d1ee30700d0. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:46:32.462358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8deac549-0d96-4c73-8505-3fd320feec06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:32.464444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8deac549-0d96-4c73-8505-3fd320feec06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:32.473185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8deac549-0d96-4c73-8505-3fd320feec06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:32.474210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8deac549-0d96-4c73-8505-3fd320feec06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:32.475210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8deac549-0d96-4c73-8505-3fd320feec06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:32.476604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8deac549-0d96-4c73-8505-3fd320feec06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:32.477245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8deac549-0d96-4c73-8505-3fd320feec06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:32.477826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8deac549-0d96-4c73-8505-3fd320feec06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:32.479393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Getting quotas for user 0caa246d8fb3477aa623cb0ae229942c and project b73b6d77ea914860ab3f8d1ee30700d0. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:46:32.520064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:46:32.531634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:46:32.667364 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ee08724a-e406-4bdc-b772-dbf8f136ea6b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.723852 Aug 18 11:46:32.677121 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2200/4688] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:46:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:46:32.683174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e2e8058f-9490-43e6-9814-ec3892412925 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:32.685208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e2e8058f-9490-43e6-9814-ec3892412925 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:32.795921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e2e8058f-9490-43e6-9814-ec3892412925 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:32.812542 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e2e8058f-9490-43e6-9814-ec3892412925 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1224 microversion: 2.1 time: 0.131435 Aug 18 11:46:32.828456 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2201/4689] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:32 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1224 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:33.454569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-24fd80a9-4a62-49d0-877f-2f8962cac6b1 req-40f1a7da-d074-401e-9d87-cfdc57d39f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb953a8-e8bd-44d1-9264-75ae577c5940", "name": "network-vif-unplugged", "status": "completed", "tag": "067f85bb-a79e-4035-966d-9dd9ced69382"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:33.547099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-24fd80a9-4a62-49d0-877f-2f8962cac6b1 req-40f1a7da-d074-401e-9d87-cfdc57d39f00 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:33.547685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-24fd80a9-4a62-49d0-877f-2f8962cac6b1 req-40f1a7da-d074-401e-9d87-cfdc57d39f00 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:33.548174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-24fd80a9-4a62-49d0-877f-2f8962cac6b1 req-40f1a7da-d074-401e-9d87-cfdc57d39f00 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:33.557166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8deac549-0d96-4c73-8505-3fd320feec06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:33.593688 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-24fd80a9-4a62-49d0-877f-2f8962cac6b1 req-40f1a7da-d074-401e-9d87-cfdc57d39f00 service nova] Creating event network-vif-unplugged:067f85bb-a79e-4035-966d-9dd9ced69382 for instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 on n-h1-853611-3 Aug 18 11:46:33.610177 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-24fd80a9-4a62-49d0-877f-2f8962cac6b1 req-40f1a7da-d074-401e-9d87-cfdc57d39f00 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.198566 Aug 18 11:46:33.615281 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2202/4690] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:46:33.637206 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8deac549-0d96-4c73-8505-3fd320feec06 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1509 microversion: 2.1 time: 1.186574 Aug 18 11:46:33.640681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-45c21778-c18c-46e2-97fa-f4bdd5d4a0ec tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:33.641451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-45c21778-c18c-46e2-97fa-f4bdd5d4a0ec tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:33.654186 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2489/4691] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:32 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1509 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:33.656594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45c21778-c18c-46e2-97fa-f4bdd5d4a0ec tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:33.657115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45c21778-c18c-46e2-97fa-f4bdd5d4a0ec tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:33.660236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45c21778-c18c-46e2-97fa-f4bdd5d4a0ec tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:33.663532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45c21778-c18c-46e2-97fa-f4bdd5d4a0ec tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:33.666943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45c21778-c18c-46e2-97fa-f4bdd5d4a0ec tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:33.668801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45c21778-c18c-46e2-97fa-f4bdd5d4a0ec tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:33.715158 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:33.847476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b6a0a25a-63e7-42c6-99ba-71553301480b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:33.848555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b6a0a25a-63e7-42c6-99ba-71553301480b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:34.045614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b6a0a25a-63e7-42c6-99ba-71553301480b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:34.068040 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b6a0a25a-63e7-42c6-99ba-71553301480b tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1224 microversion: 2.1 time: 0.227695 Aug 18 11:46:34.087836 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2490/4692] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:33 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1224 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:34.427457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-45c21778-c18c-46e2-97fa-f4bdd5d4a0ec tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:34.453528 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-45c21778-c18c-46e2-97fa-f4bdd5d4a0ec tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1328 microversion: 2.1 time: 0.831540 Aug 18 11:46:34.456423 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2203/4693] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:33 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1328 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:34.690110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b8dc544-3940-486e-8a8d-4453e851bb29 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:34.690925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3b8dc544-3940-486e-8a8d-4453e851bb29 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:34.718751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b8dc544-3940-486e-8a8d-4453e851bb29 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:34.719814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b8dc544-3940-486e-8a8d-4453e851bb29 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:34.720452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b8dc544-3940-486e-8a8d-4453e851bb29 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:34.721423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b8dc544-3940-486e-8a8d-4453e851bb29 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:34.722087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b8dc544-3940-486e-8a8d-4453e851bb29 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:34.722894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b8dc544-3940-486e-8a8d-4453e851bb29 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:35.117850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-692918a2-d6ab-49c6-bd22-5ccf7cbb6c20 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:35.123164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-692918a2-d6ab-49c6-bd22-5ccf7cbb6c20 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:35.161568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-692918a2-d6ab-49c6-bd22-5ccf7cbb6c20 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:35.163899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-692918a2-d6ab-49c6-bd22-5ccf7cbb6c20 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:35.164719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-692918a2-d6ab-49c6-bd22-5ccf7cbb6c20 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:35.167959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-692918a2-d6ab-49c6-bd22-5ccf7cbb6c20 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:35.168963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-692918a2-d6ab-49c6-bd22-5ccf7cbb6c20 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:35.170633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-692918a2-d6ab-49c6-bd22-5ccf7cbb6c20 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:35.207227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3b8dc544-3940-486e-8a8d-4453e851bb29 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:35.231924 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3b8dc544-3940-486e-8a8d-4453e851bb29 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1452 microversion: 2.1 time: 0.544655 Aug 18 11:46:35.234465 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2491/4694] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:34 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1452 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:35.266280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e793efdb-a2bc-48df-9eba-2ecc02ce9666 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:35.267369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e793efdb-a2bc-48df-9eba-2ecc02ce9666 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:35.276613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e793efdb-a2bc-48df-9eba-2ecc02ce9666 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:35.277617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e793efdb-a2bc-48df-9eba-2ecc02ce9666 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:35.278365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e793efdb-a2bc-48df-9eba-2ecc02ce9666 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:35.279660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e793efdb-a2bc-48df-9eba-2ecc02ce9666 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:35.280842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e793efdb-a2bc-48df-9eba-2ecc02ce9666 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:35.282492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e793efdb-a2bc-48df-9eba-2ecc02ce9666 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:35.410758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-692918a2-d6ab-49c6-bd22-5ccf7cbb6c20 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:35.432010 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-692918a2-d6ab-49c6-bd22-5ccf7cbb6c20 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1294 microversion: 2.1 time: 0.329523 Aug 18 11:46:35.434063 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2204/4695] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:35 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1294 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:35.502870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-faff62de-26d8-4fcc-8318-0895e7ac2c92 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:35.504255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-faff62de-26d8-4fcc-8318-0895e7ac2c92 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:35.520350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faff62de-26d8-4fcc-8318-0895e7ac2c92 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:35.521336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faff62de-26d8-4fcc-8318-0895e7ac2c92 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:35.527201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faff62de-26d8-4fcc-8318-0895e7ac2c92 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:35.533792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faff62de-26d8-4fcc-8318-0895e7ac2c92 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:35.537938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faff62de-26d8-4fcc-8318-0895e7ac2c92 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:35.540846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faff62de-26d8-4fcc-8318-0895e7ac2c92 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:35.945814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-faff62de-26d8-4fcc-8318-0895e7ac2c92 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:35.955462 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-faff62de-26d8-4fcc-8318-0895e7ac2c92 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1328 microversion: 2.1 time: 0.468256 Aug 18 11:46:35.956256 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2205/4696] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:35 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1328 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:46:36.030765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e793efdb-a2bc-48df-9eba-2ecc02ce9666 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:36.065984 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e793efdb-a2bc-48df-9eba-2ecc02ce9666 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1452 microversion: 2.1 time: 0.809095 Aug 18 11:46:36.089828 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2492/4697] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:35 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1452 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:46:36.170944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c4877c26-d43f-4c29-86c5-420f78c5858f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:36.171491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c4877c26-d43f-4c29-86c5-420f78c5858f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:36.180798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4877c26-d43f-4c29-86c5-420f78c5858f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:36.181310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4877c26-d43f-4c29-86c5-420f78c5858f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:36.181762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4877c26-d43f-4c29-86c5-420f78c5858f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:36.182665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4877c26-d43f-4c29-86c5-420f78c5858f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:36.182980 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4877c26-d43f-4c29-86c5-420f78c5858f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:36.183414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4877c26-d43f-4c29-86c5-420f78c5858f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:36.215264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-c4877c26-d43f-4c29-86c5-420f78c5858f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lazy-loading 'flavor' on Instance uuid 0eb953a8-e8bd-44d1-9264-75ae577c5940 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:46:36.232384 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-c4877c26-d43f-4c29-86c5-420f78c5858f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Cannot 'shelve' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state shelved_offloaded Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c4877c26-d43f-4c29-86c5-420f78c5858f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action HTTP/1.1 Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 14 Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: {"shelve": {}} Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: exception: Cannot 'shelve' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state shelved_offloaded Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '0eb953a8-e8bd-44d1-9264-75ae577c5940', 'body': {'shelve': {}}} Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 18 11:46:36.234550 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:46:36.238740 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:46:36.238740 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:46:36.238740 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state shelved_offloaded Aug 18 11:46:36.238740 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:36.238740 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:36.238740 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:36.238740 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:36.238740 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:36.238740 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:36.238740 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:46:36.238740 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:46:36.238740 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state shelved_offloaded Aug 18 11:46:36.238740 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:36.245566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c4877c26-d43f-4c29-86c5-420f78c5858f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 409 to user: Cannot 'shelve' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state shelved_offloaded {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:36.247243 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c4877c26-d43f-4c29-86c5-420f78c5858f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action" status: 409 len: 155 microversion: 2.1 time: 0.080362 Aug 18 11:46:36.248463 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2206/4698] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:46:36 2022] POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action => generated 155 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 18 11:46:36.259922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ce31f4b3-4f59-449a-9709-75753ecc1092 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:36.261254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ce31f4b3-4f59-449a-9709-75753ecc1092 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:36.268774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce31f4b3-4f59-449a-9709-75753ecc1092 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:36.269672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce31f4b3-4f59-449a-9709-75753ecc1092 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:36.270330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce31f4b3-4f59-449a-9709-75753ecc1092 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:36.271725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce31f4b3-4f59-449a-9709-75753ecc1092 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:36.273123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce31f4b3-4f59-449a-9709-75753ecc1092 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:36.273955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce31f4b3-4f59-449a-9709-75753ecc1092 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:36.350303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ce31f4b3-4f59-449a-9709-75753ecc1092 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122210) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 18 11:46:36.423351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:36.461869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1c089b2c-8b8f-4ef6-b47a-e6295b788faa tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:36.462795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1c089b2c-8b8f-4ef6-b47a-e6295b788faa tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:36.463063 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ce31f4b3-4f59-449a-9709-75753ecc1092 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action" status: 202 len: 0 microversion: 2.1 time: 0.208308 Aug 18 11:46:36.467543 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2493/4699] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:46:36 2022] POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:46:36.473353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1c089b2c-8b8f-4ef6-b47a-e6295b788faa tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:36.473863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1c089b2c-8b8f-4ef6-b47a-e6295b788faa tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:36.475959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-838e044f-68b8-413b-be57-2433f2be6fec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:36.477028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-838e044f-68b8-413b-be57-2433f2be6fec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:36.478460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1c089b2c-8b8f-4ef6-b47a-e6295b788faa tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:36.484349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1c089b2c-8b8f-4ef6-b47a-e6295b788faa tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:36.484349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1c089b2c-8b8f-4ef6-b47a-e6295b788faa tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:36.484349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1c089b2c-8b8f-4ef6-b47a-e6295b788faa tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:36.486556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-838e044f-68b8-413b-be57-2433f2be6fec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:36.487316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-838e044f-68b8-413b-be57-2433f2be6fec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:36.487921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-838e044f-68b8-413b-be57-2433f2be6fec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:36.488821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-838e044f-68b8-413b-be57-2433f2be6fec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:36.489442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-838e044f-68b8-413b-be57-2433f2be6fec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:36.490035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-838e044f-68b8-413b-be57-2433f2be6fec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:36.663773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1c089b2c-8b8f-4ef6-b47a-e6295b788faa tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:36.675514 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1c089b2c-8b8f-4ef6-b47a-e6295b788faa tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1282 microversion: 2.1 time: 0.218227 Aug 18 11:46:36.682420 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2207/4700] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:36 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1282 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:37.003696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-09aac01d-99ce-4261-b25e-5b26482c293d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:37.004797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-09aac01d-99ce-4261-b25e-5b26482c293d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:37.027599 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09aac01d-99ce-4261-b25e-5b26482c293d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:37.029113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09aac01d-99ce-4261-b25e-5b26482c293d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:37.030707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09aac01d-99ce-4261-b25e-5b26482c293d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:37.032250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09aac01d-99ce-4261-b25e-5b26482c293d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:37.033564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09aac01d-99ce-4261-b25e-5b26482c293d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:37.034713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09aac01d-99ce-4261-b25e-5b26482c293d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:37.057715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-838e044f-68b8-413b-be57-2433f2be6fec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:37.076057 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-838e044f-68b8-413b-be57-2433f2be6fec tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1460 microversion: 2.1 time: 0.606374 Aug 18 11:46:37.077292 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2494/4701] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:36 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1460 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:37.715129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76d7b10e-4983-4e07-8e61-49ca51e601c8 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:37.721097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-76d7b10e-4983-4e07-8e61-49ca51e601c8 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:37.732922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76d7b10e-4983-4e07-8e61-49ca51e601c8 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:37.739172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76d7b10e-4983-4e07-8e61-49ca51e601c8 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:37.740286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76d7b10e-4983-4e07-8e61-49ca51e601c8 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:37.741282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76d7b10e-4983-4e07-8e61-49ca51e601c8 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:37.742138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76d7b10e-4983-4e07-8e61-49ca51e601c8 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:37.742954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76d7b10e-4983-4e07-8e61-49ca51e601c8 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:38.061515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-09aac01d-99ce-4261-b25e-5b26482c293d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:38.083934 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-09aac01d-99ce-4261-b25e-5b26482c293d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1328 microversion: 2.1 time: 1.091987 Aug 18 11:46:38.090360 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2208/4702] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:36 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1328 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:38.101718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f758d1a3-4947-41d1-97f8-ecef218a55fb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:38.107292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f758d1a3-4947-41d1-97f8-ecef218a55fb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:38.121769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f758d1a3-4947-41d1-97f8-ecef218a55fb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:38.122521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f758d1a3-4947-41d1-97f8-ecef218a55fb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:38.123016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f758d1a3-4947-41d1-97f8-ecef218a55fb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:38.123813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f758d1a3-4947-41d1-97f8-ecef218a55fb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:38.124286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f758d1a3-4947-41d1-97f8-ecef218a55fb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:38.124714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f758d1a3-4947-41d1-97f8-ecef218a55fb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:38.401520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-76d7b10e-4983-4e07-8e61-49ca51e601c8 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:38.413500 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76d7b10e-4983-4e07-8e61-49ca51e601c8 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1324 microversion: 2.1 time: 0.708243 Aug 18 11:46:38.416054 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2495/4703] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:37 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1324 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:38.559332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f758d1a3-4947-41d1-97f8-ecef218a55fb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:38.568051 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f758d1a3-4947-41d1-97f8-ecef218a55fb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1460 microversion: 2.1 time: 0.470360 Aug 18 11:46:38.569934 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2209/4704] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:38 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1460 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:39.113409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-045f1b9c-40d4-4c0c-8ecf-c742f24b9d42 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:39.114806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-045f1b9c-40d4-4c0c-8ecf-c742f24b9d42 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:39.142073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-045f1b9c-40d4-4c0c-8ecf-c742f24b9d42 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:39.142761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-045f1b9c-40d4-4c0c-8ecf-c742f24b9d42 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:39.143424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-045f1b9c-40d4-4c0c-8ecf-c742f24b9d42 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:39.144184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-045f1b9c-40d4-4c0c-8ecf-c742f24b9d42 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:39.144795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-045f1b9c-40d4-4c0c-8ecf-c742f24b9d42 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:39.145243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-045f1b9c-40d4-4c0c-8ecf-c742f24b9d42 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:39.445009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-31a66ed9-64ba-4665-8ea9-edc8ea259600 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:39.446531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-31a66ed9-64ba-4665-8ea9-edc8ea259600 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:39.476153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31a66ed9-64ba-4665-8ea9-edc8ea259600 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:39.477940 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31a66ed9-64ba-4665-8ea9-edc8ea259600 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:39.484198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31a66ed9-64ba-4665-8ea9-edc8ea259600 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:39.485394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31a66ed9-64ba-4665-8ea9-edc8ea259600 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:39.486122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31a66ed9-64ba-4665-8ea9-edc8ea259600 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:39.486793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31a66ed9-64ba-4665-8ea9-edc8ea259600 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:40.225202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-045f1b9c-40d4-4c0c-8ecf-c742f24b9d42 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:40.240965 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-045f1b9c-40d4-4c0c-8ecf-c742f24b9d42 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1328 microversion: 2.1 time: 1.132623 Aug 18 11:46:40.264011 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2496/4705] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:39 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1328 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:40.277770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e1b1db3e-817f-4d1e-a9d2-63e6b8353183 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:40.279098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e1b1db3e-817f-4d1e-a9d2-63e6b8353183 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:40.298155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1b1db3e-817f-4d1e-a9d2-63e6b8353183 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:40.299858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1b1db3e-817f-4d1e-a9d2-63e6b8353183 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:40.300751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1b1db3e-817f-4d1e-a9d2-63e6b8353183 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:40.304465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1b1db3e-817f-4d1e-a9d2-63e6b8353183 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:40.306626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1b1db3e-817f-4d1e-a9d2-63e6b8353183 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:40.307440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1b1db3e-817f-4d1e-a9d2-63e6b8353183 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:40.408884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-31a66ed9-64ba-4665-8ea9-edc8ea259600 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:40.423142 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-31a66ed9-64ba-4665-8ea9-edc8ea259600 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1324 microversion: 2.1 time: 0.982754 Aug 18 11:46:40.424540 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2210/4706] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:39 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1324 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:40.443189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-f597de63-c4d2-4d6b-8923-fa5f91bb8d21 req-962e997d-29c9-4165-9a6b-459cb727ce91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be93e56-058c-4369-95e5-d281ef5b9df1", "name": "network-vif-plugged", "status": "completed", "tag": "744ae921-4ee3-4764-b404-5f868c2045ac"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:40.466174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f597de63-c4d2-4d6b-8923-fa5f91bb8d21 req-962e997d-29c9-4165-9a6b-459cb727ce91 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:40.470283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f597de63-c4d2-4d6b-8923-fa5f91bb8d21 req-962e997d-29c9-4165-9a6b-459cb727ce91 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:40.471339 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f597de63-c4d2-4d6b-8923-fa5f91bb8d21 req-962e997d-29c9-4165-9a6b-459cb727ce91 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:40.508644 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-f597de63-c4d2-4d6b-8923-fa5f91bb8d21 req-962e997d-29c9-4165-9a6b-459cb727ce91 service nova] Creating event network-vif-plugged:744ae921-4ee3-4764-b404-5f868c2045ac for instance 7be93e56-058c-4369-95e5-d281ef5b9df1 on n-h1-853611-3 Aug 18 11:46:40.522133 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-f597de63-c4d2-4d6b-8923-fa5f91bb8d21 req-962e997d-29c9-4165-9a6b-459cb727ce91 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094843 Aug 18 11:46:40.523740 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2211/4707] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:40.671208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e1b1db3e-817f-4d1e-a9d2-63e6b8353183 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:40.683888 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e1b1db3e-817f-4d1e-a9d2-63e6b8353183 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 0.417804 Aug 18 11:46:40.684925 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2497/4708] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:40 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:40.962218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-7d335b81-3fdb-4c55-84f1-fa133f01e1a4 req-4acf955c-c273-45bd-9088-1cdadc84b3ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d31366f8-fd89-43d3-b036-6cf52c8e1844", "tag": "81112280-8adb-471c-a6e4-e0f927445f95"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:40.979186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7d335b81-3fdb-4c55-84f1-fa133f01e1a4 req-4acf955c-c273-45bd-9088-1cdadc84b3ab service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:40.980374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7d335b81-3fdb-4c55-84f1-fa133f01e1a4 req-4acf955c-c273-45bd-9088-1cdadc84b3ab service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:40.981126 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7d335b81-3fdb-4c55-84f1-fa133f01e1a4 req-4acf955c-c273-45bd-9088-1cdadc84b3ab service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:41.010953 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-7d335b81-3fdb-4c55-84f1-fa133f01e1a4 req-4acf955c-c273-45bd-9088-1cdadc84b3ab service nova] Creating event network-changed:81112280-8adb-471c-a6e4-e0f927445f95 for instance d31366f8-fd89-43d3-b036-6cf52c8e1844 on n-h2-853611-3 Aug 18 11:46:41.052625 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-7d335b81-3fdb-4c55-84f1-fa133f01e1a4 req-4acf955c-c273-45bd-9088-1cdadc84b3ab service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094936 Aug 18 11:46:41.054470 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2212/4709] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:41.275629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-be5805ec-bf31-422a-b566-46e5693bde1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:41.277014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-be5805ec-bf31-422a-b566-46e5693bde1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:41.286576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be5805ec-bf31-422a-b566-46e5693bde1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:41.287953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be5805ec-bf31-422a-b566-46e5693bde1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:41.288701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be5805ec-bf31-422a-b566-46e5693bde1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:41.290015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be5805ec-bf31-422a-b566-46e5693bde1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:41.290534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be5805ec-bf31-422a-b566-46e5693bde1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:41.290985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be5805ec-bf31-422a-b566-46e5693bde1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:41.448939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-75f7c354-8017-4547-a720-aa48c66aaf77 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:41.449455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-75f7c354-8017-4547-a720-aa48c66aaf77 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:41.466069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75f7c354-8017-4547-a720-aa48c66aaf77 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:41.466951 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75f7c354-8017-4547-a720-aa48c66aaf77 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:41.468102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75f7c354-8017-4547-a720-aa48c66aaf77 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:41.469085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75f7c354-8017-4547-a720-aa48c66aaf77 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:41.469754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75f7c354-8017-4547-a720-aa48c66aaf77 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:41.470368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-75f7c354-8017-4547-a720-aa48c66aaf77 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:41.664788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-be5805ec-bf31-422a-b566-46e5693bde1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:41.678406 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-be5805ec-bf31-422a-b566-46e5693bde1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1328 microversion: 2.1 time: 0.408400 Aug 18 11:46:41.683162 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2498/4710] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:41 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1328 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:41.713623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1c0f3c93-1ea5-4b59-8a01-d3e139c366f3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:41.714276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1c0f3c93-1ea5-4b59-8a01-d3e139c366f3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:41.725356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c0f3c93-1ea5-4b59-8a01-d3e139c366f3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:41.727001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c0f3c93-1ea5-4b59-8a01-d3e139c366f3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:41.728302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c0f3c93-1ea5-4b59-8a01-d3e139c366f3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:41.729545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c0f3c93-1ea5-4b59-8a01-d3e139c366f3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:41.730190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c0f3c93-1ea5-4b59-8a01-d3e139c366f3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:41.730804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c0f3c93-1ea5-4b59-8a01-d3e139c366f3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:42.139082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1c0f3c93-1ea5-4b59-8a01-d3e139c366f3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:42.151704 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1c0f3c93-1ea5-4b59-8a01-d3e139c366f3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 0.443300 Aug 18 11:46:42.192691 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2499/4711] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:41 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:42.415661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:42.486623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-75f7c354-8017-4547-a720-aa48c66aaf77 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:42.503170 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-75f7c354-8017-4547-a720-aa48c66aaf77 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1324 microversion: 2.1 time: 1.059129 Aug 18 11:46:42.504266 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2213/4712] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:41 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1324 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:42.705416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3277b0c-e4bc-4177-9336-fea99ec04eea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:42.706474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3277b0c-e4bc-4177-9336-fea99ec04eea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:42.729396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3277b0c-e4bc-4177-9336-fea99ec04eea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:42.733024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3277b0c-e4bc-4177-9336-fea99ec04eea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:42.736554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3277b0c-e4bc-4177-9336-fea99ec04eea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:42.739785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3277b0c-e4bc-4177-9336-fea99ec04eea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:42.742620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3277b0c-e4bc-4177-9336-fea99ec04eea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:42.745486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3277b0c-e4bc-4177-9336-fea99ec04eea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:43.128158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d3277b0c-e4bc-4177-9336-fea99ec04eea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:43.142777 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3277b0c-e4bc-4177-9336-fea99ec04eea tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1509 microversion: 2.1 time: 0.444219 Aug 18 11:46:43.144293 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2500/4713] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:42 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1509 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:43.165229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=8 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:43.168974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c04832e2-7dfc-4e42-a197-1760f8fffc21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:43.170229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c04832e2-7dfc-4e42-a197-1760f8fffc21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:43.181352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5caf8f8c-12ee-4551-bf99-113a3a4d7662 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:43.184442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c04832e2-7dfc-4e42-a197-1760f8fffc21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:43.185143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c04832e2-7dfc-4e42-a197-1760f8fffc21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:43.186065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5caf8f8c-12ee-4551-bf99-113a3a4d7662 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:43.186722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c04832e2-7dfc-4e42-a197-1760f8fffc21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:43.187605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c04832e2-7dfc-4e42-a197-1760f8fffc21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:43.189967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c04832e2-7dfc-4e42-a197-1760f8fffc21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:43.190629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c04832e2-7dfc-4e42-a197-1760f8fffc21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:43.201133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:43.203363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5caf8f8c-12ee-4551-bf99-113a3a4d7662 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:43.204575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5caf8f8c-12ee-4551-bf99-113a3a4d7662 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:43.205646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5caf8f8c-12ee-4551-bf99-113a3a4d7662 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:43.207243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5caf8f8c-12ee-4551-bf99-113a3a4d7662 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:43.208011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5caf8f8c-12ee-4551-bf99-113a3a4d7662 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:43.208860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5caf8f8c-12ee-4551-bf99-113a3a4d7662 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:43.457954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5caf8f8c-12ee-4551-bf99-113a3a4d7662 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:43.477066 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5caf8f8c-12ee-4551-bf99-113a3a4d7662 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 0.299830 Aug 18 11:46:43.478807 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2501/4714] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:43 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:43.526338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eb8d5d0d-b14b-48b7-8ce8-1e54f1d6b7ad tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:43.527325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eb8d5d0d-b14b-48b7-8ce8-1e54f1d6b7ad tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:43.550401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb8d5d0d-b14b-48b7-8ce8-1e54f1d6b7ad tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:43.552880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb8d5d0d-b14b-48b7-8ce8-1e54f1d6b7ad tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:43.556807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb8d5d0d-b14b-48b7-8ce8-1e54f1d6b7ad tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:43.559063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb8d5d0d-b14b-48b7-8ce8-1e54f1d6b7ad tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:43.560957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb8d5d0d-b14b-48b7-8ce8-1e54f1d6b7ad tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:43.561724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb8d5d0d-b14b-48b7-8ce8-1e54f1d6b7ad tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:43.764769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c04832e2-7dfc-4e42-a197-1760f8fffc21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:43.794352 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c04832e2-7dfc-4e42-a197-1760f8fffc21 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1509 microversion: 2.1 time: 0.631866 Aug 18 11:46:43.796089 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2214/4715] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:43 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1509 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:46:43.826153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7673d5e3-60a2-48f9-a8cf-f0ac06087a90 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:43.831105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7673d5e3-60a2-48f9-a8cf-f0ac06087a90 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:43.843976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7673d5e3-60a2-48f9-a8cf-f0ac06087a90 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:43.845020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7673d5e3-60a2-48f9-a8cf-f0ac06087a90 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:43.846518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7673d5e3-60a2-48f9-a8cf-f0ac06087a90 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:43.848516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7673d5e3-60a2-48f9-a8cf-f0ac06087a90 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:43.858153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7673d5e3-60a2-48f9-a8cf-f0ac06087a90 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:43.859390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7673d5e3-60a2-48f9-a8cf-f0ac06087a90 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:43.944337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7673d5e3-60a2-48f9-a8cf-f0ac06087a90 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:46:44.066713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:44.110544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-eb8d5d0d-b14b-48b7-8ce8-1e54f1d6b7ad tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:44.134820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eb8d5d0d-b14b-48b7-8ce8-1e54f1d6b7ad tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1324 microversion: 2.1 time: 0.613579 Aug 18 11:46:44.147073 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2502/4716] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:43 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1324 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:46:44.200139 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7673d5e3-60a2-48f9-a8cf-f0ac06087a90 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 204 len: 0 microversion: 2.1 time: 0.379908 Aug 18 11:46:44.203166 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2215/4717] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:46:43 2022] DELETE /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:46:44.213750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7c62bc2a-8dd1-41b5-9f84-413e28b52fa7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:44.214552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7c62bc2a-8dd1-41b5-9f84-413e28b52fa7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:44.233310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c62bc2a-8dd1-41b5-9f84-413e28b52fa7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:44.235530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c62bc2a-8dd1-41b5-9f84-413e28b52fa7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:44.236876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c62bc2a-8dd1-41b5-9f84-413e28b52fa7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:44.239743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c62bc2a-8dd1-41b5-9f84-413e28b52fa7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:44.241275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c62bc2a-8dd1-41b5-9f84-413e28b52fa7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:44.244645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c62bc2a-8dd1-41b5-9f84-413e28b52fa7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:44.514851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dcf77a0c-4fc9-496c-8937-2bb1426adbd6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:44.517545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dcf77a0c-4fc9-496c-8937-2bb1426adbd6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:44.542987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcf77a0c-4fc9-496c-8937-2bb1426adbd6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:44.544553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcf77a0c-4fc9-496c-8937-2bb1426adbd6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:44.550955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcf77a0c-4fc9-496c-8937-2bb1426adbd6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:44.552526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcf77a0c-4fc9-496c-8937-2bb1426adbd6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:44.554780 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcf77a0c-4fc9-496c-8937-2bb1426adbd6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:44.556967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dcf77a0c-4fc9-496c-8937-2bb1426adbd6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:44.784850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c62bc2a-8dd1-41b5-9f84-413e28b52fa7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:44.805015 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7c62bc2a-8dd1-41b5-9f84-413e28b52fa7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1515 microversion: 2.1 time: 0.597339 Aug 18 11:46:44.824263 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2503/4718] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:44 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1515 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:46:44.833563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e878515a-1a95-4f37-a1d1-030925533dbf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:44.833563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e878515a-1a95-4f37-a1d1-030925533dbf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:44.850118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e878515a-1a95-4f37-a1d1-030925533dbf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:44.851414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e878515a-1a95-4f37-a1d1-030925533dbf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:44.853465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e878515a-1a95-4f37-a1d1-030925533dbf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:44.855421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e878515a-1a95-4f37-a1d1-030925533dbf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:44.856902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e878515a-1a95-4f37-a1d1-030925533dbf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:44.858069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e878515a-1a95-4f37-a1d1-030925533dbf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:44.911313 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e878515a-1a95-4f37-a1d1-030925533dbf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/ips" status: 200 len: 150 microversion: 2.20 time: 0.085681 Aug 18 11:46:44.912520 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2504/4719] 10.222.0.73 () {60 vars in 1289 bytes} [Thu Aug 18 11:46:44 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/ips => generated 150 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:46:45.096041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dcf77a0c-4fc9-496c-8937-2bb1426adbd6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:45.104953 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dcf77a0c-4fc9-496c-8937-2bb1426adbd6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 0.601666 Aug 18 11:46:45.105569 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2216/4720] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:44 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:45.162824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d6638382-508e-41a2-a178-cfc5503a35a0 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:45.166738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d6638382-508e-41a2-a178-cfc5503a35a0 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:45.185566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6638382-508e-41a2-a178-cfc5503a35a0 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:45.186683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6638382-508e-41a2-a178-cfc5503a35a0 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:45.189357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6638382-508e-41a2-a178-cfc5503a35a0 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:45.191797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6638382-508e-41a2-a178-cfc5503a35a0 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:45.193625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6638382-508e-41a2-a178-cfc5503a35a0 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:45.196736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6638382-508e-41a2-a178-cfc5503a35a0 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:45.838921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-59172878-a9c0-46c5-8eb3-94f99ffe7954 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:45.839202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-59172878-a9c0-46c5-8eb3-94f99ffe7954 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:45.899082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59172878-a9c0-46c5-8eb3-94f99ffe7954 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:45.924329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59172878-a9c0-46c5-8eb3-94f99ffe7954 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:45.928276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59172878-a9c0-46c5-8eb3-94f99ffe7954 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:45.933200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59172878-a9c0-46c5-8eb3-94f99ffe7954 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:45.935023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d6638382-508e-41a2-a178-cfc5503a35a0 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:45.937007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59172878-a9c0-46c5-8eb3-94f99ffe7954 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:45.942614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59172878-a9c0-46c5-8eb3-94f99ffe7954 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:45.950030 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d6638382-508e-41a2-a178-cfc5503a35a0 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1324 microversion: 2.1 time: 0.795393 Aug 18 11:46:45.955241 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2505/4721] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:45 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1324 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:46.129497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-169409ee-6f22-4ce7-973e-bc73a7ea238e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:46.130907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-169409ee-6f22-4ce7-973e-bc73a7ea238e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:46.149228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-169409ee-6f22-4ce7-973e-bc73a7ea238e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:46.152976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-169409ee-6f22-4ce7-973e-bc73a7ea238e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:46.154127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-169409ee-6f22-4ce7-973e-bc73a7ea238e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:46.159854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-169409ee-6f22-4ce7-973e-bc73a7ea238e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:46.160836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-169409ee-6f22-4ce7-973e-bc73a7ea238e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:46.162290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-169409ee-6f22-4ce7-973e-bc73a7ea238e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:46.886411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-169409ee-6f22-4ce7-973e-bc73a7ea238e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:46.898611 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-169409ee-6f22-4ce7-973e-bc73a7ea238e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 0.774776 Aug 18 11:46:46.899217 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2506/4722] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:46 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:46.977367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e4b92204-feec-4e57-8b58-e86dec34e555 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:46.978281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e4b92204-feec-4e57-8b58-e86dec34e555 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:46.992262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4b92204-feec-4e57-8b58-e86dec34e555 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:46.993039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4b92204-feec-4e57-8b58-e86dec34e555 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:47.003398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4b92204-feec-4e57-8b58-e86dec34e555 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:47.007770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4b92204-feec-4e57-8b58-e86dec34e555 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:47.009034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4b92204-feec-4e57-8b58-e86dec34e555 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:47.015255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4b92204-feec-4e57-8b58-e86dec34e555 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:48.665327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-59172878-a9c0-46c5-8eb3-94f99ffe7954 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:48.687082 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-59172878-a9c0-46c5-8eb3-94f99ffe7954 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1515 microversion: 2.1 time: 2.849256 Aug 18 11:46:48.703581 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2217/4723] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:45 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1515 bytes in 2872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:48.708972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-790d7361-bf0a-4a07-905a-73a74e4b8c3e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:48.712957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-790d7361-bf0a-4a07-905a-73a74e4b8c3e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:48.759924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-790d7361-bf0a-4a07-905a-73a74e4b8c3e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:48.761925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-790d7361-bf0a-4a07-905a-73a74e4b8c3e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:48.765064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-790d7361-bf0a-4a07-905a-73a74e4b8c3e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:48.768020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-790d7361-bf0a-4a07-905a-73a74e4b8c3e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:48.770490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-790d7361-bf0a-4a07-905a-73a74e4b8c3e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:48.771549 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-790d7361-bf0a-4a07-905a-73a74e4b8c3e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:48.888620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e4b92204-feec-4e57-8b58-e86dec34e555 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:48.904693 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e4b92204-feec-4e57-8b58-e86dec34e555 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1324 microversion: 2.1 time: 1.925027 Aug 18 11:46:48.906251 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2507/4724] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:46 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1324 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:46:49.729839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1b0939f-b1a7-4d3d-85fe-451b89ebefad tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:49.736452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1b0939f-b1a7-4d3d-85fe-451b89ebefad tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:49.790696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1b0939f-b1a7-4d3d-85fe-451b89ebefad tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:49.799512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1b0939f-b1a7-4d3d-85fe-451b89ebefad tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:49.800668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1b0939f-b1a7-4d3d-85fe-451b89ebefad tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:49.802253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1b0939f-b1a7-4d3d-85fe-451b89ebefad tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:49.803342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1b0939f-b1a7-4d3d-85fe-451b89ebefad tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:49.809567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1b0939f-b1a7-4d3d-85fe-451b89ebefad tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:50.251862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a1b0939f-b1a7-4d3d-85fe-451b89ebefad tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:50.276234 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1b0939f-b1a7-4d3d-85fe-451b89ebefad tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1473 microversion: 2.1 time: 0.551817 Aug 18 11:46:50.277731 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2508/4725] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:49 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1473 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:50.300315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d92aba3c-7ca0-4079-8403-c188f7d69306 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:50.330416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d92aba3c-7ca0-4079-8403-c188f7d69306 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:50.380045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d92aba3c-7ca0-4079-8403-c188f7d69306 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:50.381355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d92aba3c-7ca0-4079-8403-c188f7d69306 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:50.382470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d92aba3c-7ca0-4079-8403-c188f7d69306 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:50.390823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d92aba3c-7ca0-4079-8403-c188f7d69306 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:50.404114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d92aba3c-7ca0-4079-8403-c188f7d69306 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:50.405332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d92aba3c-7ca0-4079-8403-c188f7d69306 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:50.441926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-790d7361-bf0a-4a07-905a-73a74e4b8c3e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:50.461566 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-790d7361-bf0a-4a07-905a-73a74e4b8c3e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 1.746933 Aug 18 11:46:50.481192 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2218/4726] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:48 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:50.493001 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2a3132ce-4c3b-4e29-a9be-30f74eb94958 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:50.494928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2a3132ce-4c3b-4e29-a9be-30f74eb94958 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:50.506507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3132ce-4c3b-4e29-a9be-30f74eb94958 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:50.508371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3132ce-4c3b-4e29-a9be-30f74eb94958 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:50.510564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3132ce-4c3b-4e29-a9be-30f74eb94958 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:50.511581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3132ce-4c3b-4e29-a9be-30f74eb94958 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:50.512254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3132ce-4c3b-4e29-a9be-30f74eb94958 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:50.512901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a3132ce-4c3b-4e29-a9be-30f74eb94958 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:50.514659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-d92aba3c-7ca0-4079-8403-c188f7d69306 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lazy-loading 'flavor' on Instance uuid 1706f34c-3b86-4298-be5a-126d7bfeba56 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:46:50.733725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:50.942811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2a3132ce-4c3b-4e29-a9be-30f74eb94958 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:50.966105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:50.984246 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2a3132ce-4c3b-4e29-a9be-30f74eb94958 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1324 microversion: 2.1 time: 0.501222 Aug 18 11:46:50.989208 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2219/4727] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:50 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1324 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:51.004084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-f4b11c6f-2dea-47ea-912d-ade98aa3f023 req-8d4ca46a-06ef-465c-ba49-0f1691cb6155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be93e56-058c-4369-95e5-d281ef5b9df1", "name": "network-vif-deleted", "tag": "744ae921-4ee3-4764-b404-5f868c2045ac"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:51.026141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f4b11c6f-2dea-47ea-912d-ade98aa3f023 req-8d4ca46a-06ef-465c-ba49-0f1691cb6155 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:51.033307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f4b11c6f-2dea-47ea-912d-ade98aa3f023 req-8d4ca46a-06ef-465c-ba49-0f1691cb6155 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:51.034166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f4b11c6f-2dea-47ea-912d-ade98aa3f023 req-8d4ca46a-06ef-465c-ba49-0f1691cb6155 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:51.061052 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d92aba3c-7ca0-4079-8403-c188f7d69306 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "POST /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/action" status: 202 len: 0 microversion: 2.20 time: 0.780375 Aug 18 11:46:51.061759 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2509/4728] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 18 11:46:50 2022] POST /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/action => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:46:51.085177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0c87df2c-abfc-449b-be34-428dbed30f17 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:51.099263 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-f4b11c6f-2dea-47ea-912d-ade98aa3f023 req-8d4ca46a-06ef-465c-ba49-0f1691cb6155 service nova] Creating event network-vif-deleted:744ae921-4ee3-4764-b404-5f868c2045ac for instance 7be93e56-058c-4369-95e5-d281ef5b9df1 on n-h1-853611-3 Aug 18 11:46:51.106253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0c87df2c-abfc-449b-be34-428dbed30f17 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:51.106253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c87df2c-abfc-449b-be34-428dbed30f17 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:51.110982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c87df2c-abfc-449b-be34-428dbed30f17 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:51.110982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c87df2c-abfc-449b-be34-428dbed30f17 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:51.110982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c87df2c-abfc-449b-be34-428dbed30f17 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:51.110982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c87df2c-abfc-449b-be34-428dbed30f17 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:51.110982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c87df2c-abfc-449b-be34-428dbed30f17 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:51.120211 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-f4b11c6f-2dea-47ea-912d-ade98aa3f023 req-8d4ca46a-06ef-465c-ba49-0f1691cb6155 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124193 Aug 18 11:46:51.120211 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2220/4729] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:51.309306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-89b6bff0-9b8c-4855-b60d-98e2275d6da7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:51.310031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-89b6bff0-9b8c-4855-b60d-98e2275d6da7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:51.359473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89b6bff0-9b8c-4855-b60d-98e2275d6da7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:51.361932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89b6bff0-9b8c-4855-b60d-98e2275d6da7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:51.363033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89b6bff0-9b8c-4855-b60d-98e2275d6da7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:51.364646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89b6bff0-9b8c-4855-b60d-98e2275d6da7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:51.365922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89b6bff0-9b8c-4855-b60d-98e2275d6da7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:51.367406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89b6bff0-9b8c-4855-b60d-98e2275d6da7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:51.483873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89b6bff0-9b8c-4855-b60d-98e2275d6da7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:51.487709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89b6bff0-9b8c-4855-b60d-98e2275d6da7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:51.490386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89b6bff0-9b8c-4855-b60d-98e2275d6da7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:51.491458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-89b6bff0-9b8c-4855-b60d-98e2275d6da7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lazy-loading 'fault' on Instance uuid 7be93e56-058c-4369-95e5-d281ef5b9df1 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:46:51.649956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-89b6bff0-9b8c-4855-b60d-98e2275d6da7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:51.702183 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-89b6bff0-9b8c-4855-b60d-98e2275d6da7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 200 len: 1318 microversion: 2.1 time: 0.390970 Aug 18 11:46:51.706332 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2221/4730] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:51 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:51.719276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c1c57533-b934-4f52-a4ce-b9e4f53e8ffa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:51.729633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c1c57533-b934-4f52-a4ce-b9e4f53e8ffa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:51.759702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1c57533-b934-4f52-a4ce-b9e4f53e8ffa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:51.760213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1c57533-b934-4f52-a4ce-b9e4f53e8ffa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:51.760666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1c57533-b934-4f52-a4ce-b9e4f53e8ffa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:51.761420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1c57533-b934-4f52-a4ce-b9e4f53e8ffa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:51.764286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1c57533-b934-4f52-a4ce-b9e4f53e8ffa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:51.767076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1c57533-b934-4f52-a4ce-b9e4f53e8ffa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:52.170637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c1c57533-b934-4f52-a4ce-b9e4f53e8ffa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:52.181585 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c1c57533-b934-4f52-a4ce-b9e4f53e8ffa tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 0.470274 Aug 18 11:46:52.194511 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2222/4731] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:51 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:52.197206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-387630d1-3080-44ec-a77f-db3c48eb3770 req-a5f3344e-40ba-484a-ba6b-8935034b8dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d31366f8-fd89-43d3-b036-6cf52c8e1844", "name": "network-vif-plugged", "status": "completed", "tag": "81112280-8adb-471c-a6e4-e0f927445f95"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:52.210374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-387630d1-3080-44ec-a77f-db3c48eb3770 req-a5f3344e-40ba-484a-ba6b-8935034b8dd3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:52.211050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-387630d1-3080-44ec-a77f-db3c48eb3770 req-a5f3344e-40ba-484a-ba6b-8935034b8dd3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:52.211562 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-387630d1-3080-44ec-a77f-db3c48eb3770 req-a5f3344e-40ba-484a-ba6b-8935034b8dd3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:52.230795 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-387630d1-3080-44ec-a77f-db3c48eb3770 req-a5f3344e-40ba-484a-ba6b-8935034b8dd3 service nova] Creating event network-vif-plugged:81112280-8adb-471c-a6e4-e0f927445f95 for instance d31366f8-fd89-43d3-b036-6cf52c8e1844 on n-h2-853611-3 Aug 18 11:46:52.250180 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-387630d1-3080-44ec-a77f-db3c48eb3770 req-a5f3344e-40ba-484a-ba6b-8935034b8dd3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057510 Aug 18 11:46:52.255159 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2223/4732] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:46:52.270634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0c87df2c-abfc-449b-be34-428dbed30f17 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:52.280595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2238bc79-36c5-4d9d-ae81-7217ec635137 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:52.281347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2238bc79-36c5-4d9d-ae81-7217ec635137 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:52.290857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0c87df2c-abfc-449b-be34-428dbed30f17 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:52.299644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0c87df2c-abfc-449b-be34-428dbed30f17 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:52.302859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2238bc79-36c5-4d9d-ae81-7217ec635137 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:52.303056 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0c87df2c-abfc-449b-be34-428dbed30f17 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1723 microversion: 2.20 time: 1.234005 Aug 18 11:46:52.303165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2238bc79-36c5-4d9d-ae81-7217ec635137 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:52.314475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2238bc79-36c5-4d9d-ae81-7217ec635137 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:52.314475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2238bc79-36c5-4d9d-ae81-7217ec635137 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:52.314475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2238bc79-36c5-4d9d-ae81-7217ec635137 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:52.315153 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2510/4733] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:46:51 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1723 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:46:52.323456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2238bc79-36c5-4d9d-ae81-7217ec635137 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:52.735086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-12c393a2-5e5e-4de6-a98a-45d2ffc0a431 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:52.737744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-12c393a2-5e5e-4de6-a98a-45d2ffc0a431 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:52.773374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12c393a2-5e5e-4de6-a98a-45d2ffc0a431 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:52.778707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12c393a2-5e5e-4de6-a98a-45d2ffc0a431 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:52.779523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12c393a2-5e5e-4de6-a98a-45d2ffc0a431 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:52.780947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12c393a2-5e5e-4de6-a98a-45d2ffc0a431 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:52.783246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12c393a2-5e5e-4de6-a98a-45d2ffc0a431 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:52.786931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12c393a2-5e5e-4de6-a98a-45d2ffc0a431 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:52.823427 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-12c393a2-5e5e-4de6-a98a-45d2ffc0a431 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-12c393a2-5e5e-4de6-a98a-45d2ffc0a431 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 HTTP/1.1 Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '7be93e56-058c-4369-95e5-d281ef5b9df1'} Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:52.833227 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:52.838412 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:52.838412 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:52.838412 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:46:52.838412 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:46:52.838412 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:46:52.838412 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:52.840197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-12c393a2-5e5e-4de6-a98a-45d2ffc0a431 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:52.842251 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-12c393a2-5e5e-4de6-a98a-45d2ffc0a431 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 404 len: 111 microversion: 2.1 time: 0.113240 Aug 18 11:46:52.847006 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2511/4734] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:52 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:46:52.856276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d5f3dc3-c067-44ab-b8c4-6b114139e234 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '.version_select at 0x7f519ee12700>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:52.930981 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d5f3dc3-c067-44ab-b8c4-6b114139e234 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-key-1273222430" status: 202 len: 0 microversion: 2.1 time: 0.078748 Aug 18 11:46:52.933054 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2512/4735] 10.222.0.73 () {58 vars in 1209 bytes} [Thu Aug 18 11:46:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1273222430 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:46:53.060624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2238bc79-36c5-4d9d-ae81-7217ec635137 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:53.083179 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2238bc79-36c5-4d9d-ae81-7217ec635137 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1324 microversion: 2.1 time: 0.826315 Aug 18 11:46:53.084193 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2224/4736] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:52 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1324 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:53.219389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e727f527-a2a4-451d-8f41-80430d196af8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:53.227455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e727f527-a2a4-451d-8f41-80430d196af8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:53.286884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e727f527-a2a4-451d-8f41-80430d196af8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:53.287610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e727f527-a2a4-451d-8f41-80430d196af8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:53.287868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e727f527-a2a4-451d-8f41-80430d196af8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:53.288721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e727f527-a2a4-451d-8f41-80430d196af8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:53.297172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e727f527-a2a4-451d-8f41-80430d196af8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:53.298697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e727f527-a2a4-451d-8f41-80430d196af8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:53.333535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-03ba273c-899c-46d1-a165-54ea6820450e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:53.334788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-03ba273c-899c-46d1-a165-54ea6820450e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:53.356749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03ba273c-899c-46d1-a165-54ea6820450e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:53.356749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03ba273c-899c-46d1-a165-54ea6820450e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:53.360036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03ba273c-899c-46d1-a165-54ea6820450e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:53.363821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03ba273c-899c-46d1-a165-54ea6820450e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:53.373652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03ba273c-899c-46d1-a165-54ea6820450e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:53.373652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-03ba273c-899c-46d1-a165-54ea6820450e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:53.812726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e727f527-a2a4-451d-8f41-80430d196af8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:53.827642 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e727f527-a2a4-451d-8f41-80430d196af8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 0.622761 Aug 18 11:46:53.856452 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2513/4737] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:53 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:53.875614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1487861972", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "748eeef0-4e88-4443-abac-e79de3b3bb2a"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:54.055636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] validate_networks() for [('748eeef0-4e88-4443-abac-e79de3b3bb2a', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:46:54.068952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-03ba273c-899c-46d1-a165-54ea6820450e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:54.101129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-03ba273c-899c-46d1-a165-54ea6820450e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:54.138248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-03ba273c-899c-46d1-a165-54ea6820450e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:54.140028 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-03ba273c-899c-46d1-a165-54ea6820450e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1723 microversion: 2.20 time: 0.812276 Aug 18 11:46:54.162921 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2225/4738] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:46:53 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1723 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:46:54.207487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-20a8a9ce-127a-486b-be35-1b9b1cbc483a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:54.251433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-20a8a9ce-127a-486b-be35-1b9b1cbc483a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:54.295577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a8a9ce-127a-486b-be35-1b9b1cbc483a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:54.299172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a8a9ce-127a-486b-be35-1b9b1cbc483a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:54.299817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a8a9ce-127a-486b-be35-1b9b1cbc483a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:54.300921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a8a9ce-127a-486b-be35-1b9b1cbc483a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:54.307672 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a8a9ce-127a-486b-be35-1b9b1cbc483a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:54.308513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20a8a9ce-127a-486b-be35-1b9b1cbc483a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:54.392799 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-20a8a9ce-127a-486b-be35-1b9b1cbc483a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.227728 Aug 18 11:46:54.395853 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2226/4739] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:46:54 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a/os-volume_attachments => generated 25 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:46:54.411207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5e0a5d7c-ed2f-4612-9bc5-638901c7c4fd tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:54.413663 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5e0a5d7c-ed2f-4612-9bc5-638901c7c4fd tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:54.439485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e0a5d7c-ed2f-4612-9bc5-638901c7c4fd tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:54.446888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e0a5d7c-ed2f-4612-9bc5-638901c7c4fd tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:54.447876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e0a5d7c-ed2f-4612-9bc5-638901c7c4fd tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:54.458848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e0a5d7c-ed2f-4612-9bc5-638901c7c4fd tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:54.459544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e0a5d7c-ed2f-4612-9bc5-638901c7c4fd tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:54.460266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5e0a5d7c-ed2f-4612-9bc5-638901c7c4fd tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:55.218513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5e0a5d7c-ed2f-4612-9bc5-638901c7c4fd tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:55.234832 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5e0a5d7c-ed2f-4612-9bc5-638901c7c4fd tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1520 microversion: 2.1 time: 0.837324 Aug 18 11:46:55.237764 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2227/4740] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:54 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1520 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:55.255503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a4a75d2a-194e-468e-8df8-92b193014045 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:55.258301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a4a75d2a-194e-468e-8df8-92b193014045 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:55.282239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4a75d2a-194e-468e-8df8-92b193014045 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:55.288259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4a75d2a-194e-468e-8df8-92b193014045 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:55.291531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4a75d2a-194e-468e-8df8-92b193014045 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:55.296364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4a75d2a-194e-468e-8df8-92b193014045 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:55.300837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4a75d2a-194e-468e-8df8-92b193014045 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:55.303719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a4a75d2a-194e-468e-8df8-92b193014045 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:55.403553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a4a75d2a-194e-468e-8df8-92b193014045 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:46:55.712490 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a4a75d2a-194e-468e-8df8-92b193014045 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 204 len: 0 microversion: 2.1 time: 0.470551 Aug 18 11:46:55.714577 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2228/4741] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:46:55 2022] DELETE /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:46:55.728130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e8181053-3080-41b2-9038-8f809a1e5a9f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:55.740676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e8181053-3080-41b2-9038-8f809a1e5a9f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:55.774219 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8181053-3080-41b2-9038-8f809a1e5a9f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:55.775154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8181053-3080-41b2-9038-8f809a1e5a9f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:55.776148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8181053-3080-41b2-9038-8f809a1e5a9f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:55.777174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8181053-3080-41b2-9038-8f809a1e5a9f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:55.778627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8181053-3080-41b2-9038-8f809a1e5a9f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:55.792486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8181053-3080-41b2-9038-8f809a1e5a9f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:56.032194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:46:56.034386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:46:56.036432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:46:56.037214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:46:56.037854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:46:56.064985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:56.066638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:56.070873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:56.073726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:56.090906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:56.093377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:56.185860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:46:56.225128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for user c850b0a836124d90b7e50fe8b9fdf011 and project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:46:56.259892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:46:56.262306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:46:56.351479 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8914fbf3-9407-4f00-8499-1f6f70aa4ac5 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.493580 Aug 18 11:46:56.352363 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2514/4742] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:46:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:46:56.360636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-00a048d3-9e04-43c7-ae8d-566e9d2d24da tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:56.363444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-00a048d3-9e04-43c7-ae8d-566e9d2d24da tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:56.381731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00a048d3-9e04-43c7-ae8d-566e9d2d24da tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:56.382243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00a048d3-9e04-43c7-ae8d-566e9d2d24da tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:56.382720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00a048d3-9e04-43c7-ae8d-566e9d2d24da tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:56.389115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00a048d3-9e04-43c7-ae8d-566e9d2d24da tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:56.389689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00a048d3-9e04-43c7-ae8d-566e9d2d24da tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:56.390153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00a048d3-9e04-43c7-ae8d-566e9d2d24da tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:56.420385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e8181053-3080-41b2-9038-8f809a1e5a9f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:56.442010 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e8181053-3080-41b2-9038-8f809a1e5a9f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 0.714917 Aug 18 11:46:56.443977 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2229/4743] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:55 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:56.456547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3ee66e21-bbac-451e-8f7e-42f5ef290b40 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:56.465670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3ee66e21-bbac-451e-8f7e-42f5ef290b40 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:56.468693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:46:56.497351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3ee66e21-bbac-451e-8f7e-42f5ef290b40 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:56.503068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3ee66e21-bbac-451e-8f7e-42f5ef290b40 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:56.503774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3ee66e21-bbac-451e-8f7e-42f5ef290b40 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:56.504813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3ee66e21-bbac-451e-8f7e-42f5ef290b40 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:56.505533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3ee66e21-bbac-451e-8f7e-42f5ef290b40 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:56.506250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3ee66e21-bbac-451e-8f7e-42f5ef290b40 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:56.596744 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-3ee66e21-bbac-451e-8f7e-42f5ef290b40 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] HTTP exception thrown: Instance is not a member of specified network Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3ee66e21-bbac-451e-8f7e-42f5ef290b40 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Request method failure captured: Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844/ips/invalid HTTP/1.1 Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iaVKqKQm4o3kRWQYq7jZpqVNYs60dYk73fbz7zJNRwnDL1Gusfy3qNaY5ZGZDBgPdv-sXbJ9Nr3FTmUcz1qg6M0XOXnLBW4T05M4r-2W6P5SrIBuM9GxvYSMFen16oqA_CW8uykePPsALgyje9ca-Uo6DEStNgthSw4MEL6lHnDyz0 Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b73b6d77ea914860ab3f8d1ee30700d0 Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1196330752 Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b73b6d77ea914860ab3f8d1ee30700d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b73b6d77ea914860ab3f8d1ee30700d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b73b6d77ea914860ab3f8d1ee30700d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b73b6d77ea914860ab3f8d1ee30700d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1196330752 Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b73b6d77ea914860ab3f8d1ee30700d0 Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1196330752 Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerAddressesNegativeTestJSON-1196330752-project Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 0caa246d8fb3477aa623cb0ae229942c Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1196330752-project Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance is not a member of specified network Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'server_id': 'd31366f8-fd89-43d3-b036-6cf52c8e1844', 'id': 'invalid'} Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 18 11:46:56.619066 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:46:56.624985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3ee66e21-bbac-451e-8f7e-42f5ef290b40 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:56.626101 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3ee66e21-bbac-451e-8f7e-42f5ef290b40 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.180841 Aug 18 11:46:56.626901 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2230/4744] 10.222.0.73 () {58 vars in 1272 bytes} [Thu Aug 18 11:46:56 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844/ips/invalid => generated 91 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:46:56.638063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-24539590-de87-4583-9662-09683b31d62c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:56.639765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-24539590-de87-4583-9662-09683b31d62c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:56.651057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-24539590-de87-4583-9662-09683b31d62c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:56.651887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-24539590-de87-4583-9662-09683b31d62c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:56.652605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-24539590-de87-4583-9662-09683b31d62c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:56.653602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-24539590-de87-4583-9662-09683b31d62c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:56.654327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-24539590-de87-4583-9662-09683b31d62c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:56.655134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-24539590-de87-4583-9662-09683b31d62c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:57.136798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-00a048d3-9e04-43c7-ae8d-566e9d2d24da tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:57.154732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-00a048d3-9e04-43c7-ae8d-566e9d2d24da tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:57.160660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-00a048d3-9e04-43c7-ae8d-566e9d2d24da tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:57.165932 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-00a048d3-9e04-43c7-ae8d-566e9d2d24da tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1723 microversion: 2.20 time: 0.810064 Aug 18 11:46:57.169052 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2515/4745] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:46:56 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1723 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:46:57.184984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-234610d4-3da1-4a6e-9aa5-89227513e42c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:57.187201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-234610d4-3da1-4a6e-9aa5-89227513e42c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:57.323656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-234610d4-3da1-4a6e-9aa5-89227513e42c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:57.344342 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-234610d4-3da1-4a6e-9aa5-89227513e42c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1209 microversion: 2.1 time: 0.173352 Aug 18 11:46:57.349812 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2516/4746] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:57 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1209 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:57.362599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6874fb7c-a922-4a0e-8e98-ed555c378ac2 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:57.365790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6874fb7c-a922-4a0e-8e98-ed555c378ac2 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Failed to fetch instance by id 999 {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 18 11:46:57.371229 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-6874fb7c-a922-4a0e-8e98-ed555c378ac2 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] HTTP exception thrown: Instance 999 could not be found. Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6874fb7c-a922-4a0e-8e98-ed555c378ac2 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Request method failure captured: Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iaVKqKQm4o3kRWQYq7jZpqVNYs60dYk73fbz7zJNRwnDL1Gusfy3qNaY5ZGZDBgPdv-sXbJ9Nr3FTmUcz1qg6M0XOXnLBW4T05M4r-2W6P5SrIBuM9GxvYSMFen16oqA_CW8uykePPsALgyje9ca-Uo6DEStNgthSw4MEL6lHnDyz0 Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b73b6d77ea914860ab3f8d1ee30700d0 Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1196330752 Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b73b6d77ea914860ab3f8d1ee30700d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b73b6d77ea914860ab3f8d1ee30700d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b73b6d77ea914860ab3f8d1ee30700d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b73b6d77ea914860ab3f8d1ee30700d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1196330752 Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b73b6d77ea914860ab3f8d1ee30700d0 Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1196330752 Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerAddressesNegativeTestJSON-1196330752-project Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 0caa246d8fb3477aa623cb0ae229942c Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1196330752-project Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 999 could not be found. Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': '999'} Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 18 11:46:57.379795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:46:57.390608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6874fb7c-a922-4a0e-8e98-ed555c378ac2 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:46:57.391946 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6874fb7c-a922-4a0e-8e98-ed555c378ac2 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.039475 Aug 18 11:46:57.393732 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2517/4747] 10.222.0.73 () {58 vars in 1149 bytes} [Thu Aug 18 11:46:57 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:46:57.416941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bfcba81e-47fd-4eac-a329-579826d501e7 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:57.418371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bfcba81e-47fd-4eac-a329-579826d501e7 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:57.465731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfcba81e-47fd-4eac-a329-579826d501e7 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:57.472966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfcba81e-47fd-4eac-a329-579826d501e7 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:57.473605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfcba81e-47fd-4eac-a329-579826d501e7 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:57.474495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfcba81e-47fd-4eac-a329-579826d501e7 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:57.475139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfcba81e-47fd-4eac-a329-579826d501e7 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:57.478837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfcba81e-47fd-4eac-a329-579826d501e7 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:57.590871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bfcba81e-47fd-4eac-a329-579826d501e7 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:46:57.871281 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bfcba81e-47fd-4eac-a329-579826d501e7 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "DELETE /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 204 len: 0 microversion: 2.1 time: 0.458985 Aug 18 11:46:57.872740 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2518/4748] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:46:57 2022] DELETE /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:46:57.894861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02870a13-24ab-4237-8774-c0ee7ccddd1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:57.896271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-02870a13-24ab-4237-8774-c0ee7ccddd1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:57.911485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02870a13-24ab-4237-8774-c0ee7ccddd1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:57.917097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02870a13-24ab-4237-8774-c0ee7ccddd1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:57.920987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02870a13-24ab-4237-8774-c0ee7ccddd1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:57.924611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02870a13-24ab-4237-8774-c0ee7ccddd1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:57.925495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02870a13-24ab-4237-8774-c0ee7ccddd1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:57.926156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02870a13-24ab-4237-8774-c0ee7ccddd1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:58.380306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-24539590-de87-4583-9662-09683b31d62c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:58.400322 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-24539590-de87-4583-9662-09683b31d62c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1670 microversion: 2.1 time: 1.768258 Aug 18 11:46:58.401642 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2231/4749] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:56 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1670 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:58.418231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e8ed2d55-a714-487f-81d9-ce3249e38241 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:46:58.419533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e8ed2d55-a714-487f-81d9-ce3249e38241 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:46:58.445017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8ed2d55-a714-487f-81d9-ce3249e38241 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:58.447096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8ed2d55-a714-487f-81d9-ce3249e38241 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:58.450555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8ed2d55-a714-487f-81d9-ce3249e38241 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:58.451713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8ed2d55-a714-487f-81d9-ce3249e38241 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:46:58.452423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8ed2d55-a714-487f-81d9-ce3249e38241 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:46:58.454129 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e8ed2d55-a714-487f-81d9-ce3249e38241 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:46:58.570787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-02870a13-24ab-4237-8774-c0ee7ccddd1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:46:58.604662 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-02870a13-24ab-4237-8774-c0ee7ccddd1e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 0.728804 Aug 18 11:46:58.608185 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2519/4750] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:57 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:46:59.447007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1531242865", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "455ab83e-ef52-429f-9b51-4dcc2fc99629"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:46:59.635952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] validate_networks() for [('455ab83e-ef52-429f-9b51-4dcc2fc99629', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:47:00.270585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e8ed2d55-a714-487f-81d9-ce3249e38241 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:00.344198 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e8ed2d55-a714-487f-81d9-ce3249e38241 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1526 microversion: 2.1 time: 1.938121 Aug 18 11:47:00.349128 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2232/4751] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:46:58 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1526 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:00.380333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2ae2bc51-63d4-4566-b4ce-cd4127f3b750 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:00.381927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2ae2bc51-63d4-4566-b4ce-cd4127f3b750 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:00.423890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ae2bc51-63d4-4566-b4ce-cd4127f3b750 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:00.432324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ae2bc51-63d4-4566-b4ce-cd4127f3b750 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:00.434165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ae2bc51-63d4-4566-b4ce-cd4127f3b750 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:00.435972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ae2bc51-63d4-4566-b4ce-cd4127f3b750 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:00.444422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ae2bc51-63d4-4566-b4ce-cd4127f3b750 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:00.450462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ae2bc51-63d4-4566-b4ce-cd4127f3b750 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:01.545247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2ae2bc51-63d4-4566-b4ce-cd4127f3b750 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:01.567097 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2ae2bc51-63d4-4566-b4ce-cd4127f3b750 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:01.568842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2ae2bc51-63d4-4566-b4ce-cd4127f3b750 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:01.570070 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2ae2bc51-63d4-4566-b4ce-cd4127f3b750 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1723 microversion: 2.20 time: 1.219089 Aug 18 11:47:01.573720 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2233/4752] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:00 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1723 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:01.591169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fb86fe23-744c-408e-b04f-9d342368e84d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:01.592284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fb86fe23-744c-408e-b04f-9d342368e84d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:01.600700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb86fe23-744c-408e-b04f-9d342368e84d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:01.606947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb86fe23-744c-408e-b04f-9d342368e84d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:01.608901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb86fe23-744c-408e-b04f-9d342368e84d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:01.610378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb86fe23-744c-408e-b04f-9d342368e84d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:01.614041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb86fe23-744c-408e-b04f-9d342368e84d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:01.614667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fb86fe23-744c-408e-b04f-9d342368e84d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:01.728604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:47:01.729159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:47:01.730511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:47:01.731487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:47:01.732270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:47:01.739039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fb86fe23-744c-408e-b04f-9d342368e84d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:01.749964 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fb86fe23-744c-408e-b04f-9d342368e84d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1267 microversion: 2.1 time: 0.173309 Aug 18 11:47:01.750589 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2234/4753] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:01 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:01.754524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:01.755259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:01.755916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:01.756927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:01.757721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:01.758450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:01.759658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-46a8c839-1d04-47dc-b4b2-110ff118a38e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:01.760279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-46a8c839-1d04-47dc-b4b2-110ff118a38e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:01.799451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46a8c839-1d04-47dc-b4b2-110ff118a38e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:01.800179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46a8c839-1d04-47dc-b4b2-110ff118a38e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:01.801400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46a8c839-1d04-47dc-b4b2-110ff118a38e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:01.805838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46a8c839-1d04-47dc-b4b2-110ff118a38e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:01.807234 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46a8c839-1d04-47dc-b4b2-110ff118a38e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:01.808487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46a8c839-1d04-47dc-b4b2-110ff118a38e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:01.835689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Getting quotas for project cc024c4689aa45fd93568184f7fd308e. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:47:01.849447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Getting quotas for user 6f6482e5465143c49fe7717b8699b220 and project cc024c4689aa45fd93568184f7fd308e. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:47:01.878606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:47:01.881476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:47:01.948829 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2791c17e-ecc0-4fb1-b878-045b19baf609 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.342228 Aug 18 11:47:01.950151 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2520/4754] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:46:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:47:01.955553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e4295437-b507-4304-82b3-55c64459a460 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:01.956594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e4295437-b507-4304-82b3-55c64459a460 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:01.963900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4295437-b507-4304-82b3-55c64459a460 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:01.965432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4295437-b507-4304-82b3-55c64459a460 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:01.966385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4295437-b507-4304-82b3-55c64459a460 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:01.967578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4295437-b507-4304-82b3-55c64459a460 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:01.968257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4295437-b507-4304-82b3-55c64459a460 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:01.968922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4295437-b507-4304-82b3-55c64459a460 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:02.269328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e4295437-b507-4304-82b3-55c64459a460 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:02.280814 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e4295437-b507-4304-82b3-55c64459a460 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 0.328380 Aug 18 11:47:02.282576 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2521/4755] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:01 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:02.296066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8ec55a23-ca3a-4feb-9753-338d0adddc51 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:02.310527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8ec55a23-ca3a-4feb-9753-338d0adddc51 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:02.342057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ec55a23-ca3a-4feb-9753-338d0adddc51 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:02.342687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ec55a23-ca3a-4feb-9753-338d0adddc51 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:02.343233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ec55a23-ca3a-4feb-9753-338d0adddc51 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:02.346070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ec55a23-ca3a-4feb-9753-338d0adddc51 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:02.347931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ec55a23-ca3a-4feb-9753-338d0adddc51 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:02.349307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ec55a23-ca3a-4feb-9753-338d0adddc51 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:02.525258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-46a8c839-1d04-47dc-b4b2-110ff118a38e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:02.554397 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-46a8c839-1d04-47dc-b4b2-110ff118a38e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1670 microversion: 2.1 time: 0.796074 Aug 18 11:47:02.569153 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2235/4756] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:01 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1670 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:02.586534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-50adda09-8a75-45ab-aa57-2be162784a7d tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:02.588627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-50adda09-8a75-45ab-aa57-2be162784a7d tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:02.806778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-50adda09-8a75-45ab-aa57-2be162784a7d tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:02.832097 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-50adda09-8a75-45ab-aa57-2be162784a7d tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1217 microversion: 2.1 time: 0.272102 Aug 18 11:47:02.834361 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2236/4757] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:02 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1217 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:02.843512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8168ecb4-4ecd-4e19-8fc2-1cf87289b59c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:02.850779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8168ecb4-4ecd-4e19-8fc2-1cf87289b59c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:02.873307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8168ecb4-4ecd-4e19-8fc2-1cf87289b59c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:02.874073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8168ecb4-4ecd-4e19-8fc2-1cf87289b59c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:02.874704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8168ecb4-4ecd-4e19-8fc2-1cf87289b59c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:02.875647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8168ecb4-4ecd-4e19-8fc2-1cf87289b59c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:02.876270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8168ecb4-4ecd-4e19-8fc2-1cf87289b59c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:02.876886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8168ecb4-4ecd-4e19-8fc2-1cf87289b59c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:02.885565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:02.954633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8ec55a23-ca3a-4feb-9753-338d0adddc51 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:02.975337 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8ec55a23-ca3a-4feb-9753-338d0adddc51 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1526 microversion: 2.1 time: 0.687424 Aug 18 11:47:02.977943 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2522/4758] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:02 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1526 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:02.995199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-080850de-29c3-4e2f-8a20-2a7c50e65ee6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:02.995821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-080850de-29c3-4e2f-8a20-2a7c50e65ee6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:03.029076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-080850de-29c3-4e2f-8a20-2a7c50e65ee6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:03.029589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-080850de-29c3-4e2f-8a20-2a7c50e65ee6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:03.030028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-080850de-29c3-4e2f-8a20-2a7c50e65ee6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:03.030781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-080850de-29c3-4e2f-8a20-2a7c50e65ee6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:03.031246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-080850de-29c3-4e2f-8a20-2a7c50e65ee6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:03.031674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-080850de-29c3-4e2f-8a20-2a7c50e65ee6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:03.476204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8168ecb4-4ecd-4e19-8fc2-1cf87289b59c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:03.506088 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8168ecb4-4ecd-4e19-8fc2-1cf87289b59c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:03.516328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8168ecb4-4ecd-4e19-8fc2-1cf87289b59c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:03.519327 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8168ecb4-4ecd-4e19-8fc2-1cf87289b59c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1744 microversion: 2.20 time: 0.682507 Aug 18 11:47:03.527618 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2237/4759] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:02 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1744 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:03.543239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-44726d4d-1ddc-45e9-9ee5-ae57793d5747 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:03.545038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-44726d4d-1ddc-45e9-9ee5-ae57793d5747 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:03.559336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44726d4d-1ddc-45e9-9ee5-ae57793d5747 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:03.564550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44726d4d-1ddc-45e9-9ee5-ae57793d5747 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:03.565252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44726d4d-1ddc-45e9-9ee5-ae57793d5747 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:03.573319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44726d4d-1ddc-45e9-9ee5-ae57793d5747 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:03.574024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44726d4d-1ddc-45e9-9ee5-ae57793d5747 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:03.574728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-44726d4d-1ddc-45e9-9ee5-ae57793d5747 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:03.826136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-080850de-29c3-4e2f-8a20-2a7c50e65ee6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:03.861147 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-080850de-29c3-4e2f-8a20-2a7c50e65ee6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1309 microversion: 2.1 time: 0.866475 Aug 18 11:47:03.868617 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2523/4760] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:02 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1309 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:03.893503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f0a1defc-e1bc-4972-8889-66015077bad4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:03.897709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f0a1defc-e1bc-4972-8889-66015077bad4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:03.933254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0a1defc-e1bc-4972-8889-66015077bad4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:03.933758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0a1defc-e1bc-4972-8889-66015077bad4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:03.934214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0a1defc-e1bc-4972-8889-66015077bad4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:03.934987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0a1defc-e1bc-4972-8889-66015077bad4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:03.949401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0a1defc-e1bc-4972-8889-66015077bad4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:03.952179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0a1defc-e1bc-4972-8889-66015077bad4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:04.452147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f0a1defc-e1bc-4972-8889-66015077bad4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:04.464105 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f0a1defc-e1bc-4972-8889-66015077bad4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1603 microversion: 2.1 time: 0.586315 Aug 18 11:47:04.471204 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2524/4761] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:03 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1603 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:04.508338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-3a79d692-a0ed-48f1-b677-0f3532bf4865 req-d7659f4f-63a5-4d9e-9d8b-003094342643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d31366f8-fd89-43d3-b036-6cf52c8e1844", "name": "network-vif-deleted", "tag": "81112280-8adb-471c-a6e4-e0f927445f95"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:04.547613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3a79d692-a0ed-48f1-b677-0f3532bf4865 req-d7659f4f-63a5-4d9e-9d8b-003094342643 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:04.548285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3a79d692-a0ed-48f1-b677-0f3532bf4865 req-d7659f4f-63a5-4d9e-9d8b-003094342643 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:04.548842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3a79d692-a0ed-48f1-b677-0f3532bf4865 req-d7659f4f-63a5-4d9e-9d8b-003094342643 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:04.580581 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-3a79d692-a0ed-48f1-b677-0f3532bf4865 req-d7659f4f-63a5-4d9e-9d8b-003094342643 service nova] Creating event network-vif-deleted:81112280-8adb-471c-a6e4-e0f927445f95 for instance d31366f8-fd89-43d3-b036-6cf52c8e1844 on n-h2-853611-3 Aug 18 11:47:04.601639 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-3a79d692-a0ed-48f1-b677-0f3532bf4865 req-d7659f4f-63a5-4d9e-9d8b-003094342643 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127666 Aug 18 11:47:04.603502 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2525/4762] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:04.610331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5a7bcb97-e8ae-4b61-bb56-99ac61ad5651 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:04.617861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5a7bcb97-e8ae-4b61-bb56-99ac61ad5651 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:04.634954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a7bcb97-e8ae-4b61-bb56-99ac61ad5651 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:04.635848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a7bcb97-e8ae-4b61-bb56-99ac61ad5651 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:04.636631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a7bcb97-e8ae-4b61-bb56-99ac61ad5651 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:04.638113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a7bcb97-e8ae-4b61-bb56-99ac61ad5651 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:04.645972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a7bcb97-e8ae-4b61-bb56-99ac61ad5651 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:04.646803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a7bcb97-e8ae-4b61-bb56-99ac61ad5651 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:04.907350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5a7bcb97-e8ae-4b61-bb56-99ac61ad5651 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:04.917052 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5a7bcb97-e8ae-4b61-bb56-99ac61ad5651 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1277 microversion: 2.1 time: 0.311981 Aug 18 11:47:04.923750 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2526/4763] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:04 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1277 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:04.942343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-be762b91-69b9-4286-9958-dc9406c8a15e tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:04.943308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-be762b91-69b9-4286-9958-dc9406c8a15e tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:04.956351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be762b91-69b9-4286-9958-dc9406c8a15e tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:04.957257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be762b91-69b9-4286-9958-dc9406c8a15e tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:04.958247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be762b91-69b9-4286-9958-dc9406c8a15e tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:04.965287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be762b91-69b9-4286-9958-dc9406c8a15e tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:04.966148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be762b91-69b9-4286-9958-dc9406c8a15e tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:04.966875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be762b91-69b9-4286-9958-dc9406c8a15e tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:05.046240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be762b91-69b9-4286-9958-dc9406c8a15e tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:05.047153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be762b91-69b9-4286-9958-dc9406c8a15e tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:05.047822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be762b91-69b9-4286-9958-dc9406c8a15e tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:05.048543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-be762b91-69b9-4286-9958-dc9406c8a15e tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lazy-loading 'fault' on Instance uuid d31366f8-fd89-43d3-b036-6cf52c8e1844 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:47:05.206080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-be762b91-69b9-4286-9958-dc9406c8a15e tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0caa246d8fb3477aa623cb0ae229942c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b73b6d77ea914860ab3f8d1ee30700d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:05.214325 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-be762b91-69b9-4286-9958-dc9406c8a15e tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 200 len: 1314 microversion: 2.1 time: 0.289058 Aug 18 11:47:05.222605 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2527/4764] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:04 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:05.228201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c4df9462-79b0-4290-999d-40eb8154e371 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:05.231770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c4df9462-79b0-4290-999d-40eb8154e371 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:05.246739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4df9462-79b0-4290-999d-40eb8154e371 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:05.249903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4df9462-79b0-4290-999d-40eb8154e371 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:05.252109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4df9462-79b0-4290-999d-40eb8154e371 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:05.253111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4df9462-79b0-4290-999d-40eb8154e371 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:05.255044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4df9462-79b0-4290-999d-40eb8154e371 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:05.255741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4df9462-79b0-4290-999d-40eb8154e371 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:05.391705 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-44726d4d-1ddc-45e9-9ee5-ae57793d5747 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:05.401006 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-44726d4d-1ddc-45e9-9ee5-ae57793d5747 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 1.871426 Aug 18 11:47:05.407617 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2238/4765] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:03 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:05.413200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ab6a8bff-d27c-4173-9a03-512687e70100 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:05.424006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ab6a8bff-d27c-4173-9a03-512687e70100 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:05.431159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab6a8bff-d27c-4173-9a03-512687e70100 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:05.435548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab6a8bff-d27c-4173-9a03-512687e70100 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:05.436500 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab6a8bff-d27c-4173-9a03-512687e70100 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:05.438420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab6a8bff-d27c-4173-9a03-512687e70100 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:05.439169 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab6a8bff-d27c-4173-9a03-512687e70100 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:05.443039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ab6a8bff-d27c-4173-9a03-512687e70100 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:06.074903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c4df9462-79b0-4290-999d-40eb8154e371 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:06.114697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:06.163763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c4df9462-79b0-4290-999d-40eb8154e371 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:06.173561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c4df9462-79b0-4290-999d-40eb8154e371 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:06.180196 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c4df9462-79b0-4290-999d-40eb8154e371 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1739 microversion: 2.20 time: 0.956098 Aug 18 11:47:06.185694 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2528/4766] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:05 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1739 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:06.198891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cf3652b1-027b-4512-b7d1-b9e7e9afe556 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:06.200883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cf3652b1-027b-4512-b7d1-b9e7e9afe556 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:06.256407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3652b1-027b-4512-b7d1-b9e7e9afe556 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:06.256925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3652b1-027b-4512-b7d1-b9e7e9afe556 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:06.257377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3652b1-027b-4512-b7d1-b9e7e9afe556 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:06.258106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3652b1-027b-4512-b7d1-b9e7e9afe556 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:06.258605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3652b1-027b-4512-b7d1-b9e7e9afe556 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:06.259046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3652b1-027b-4512-b7d1-b9e7e9afe556 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:06.471996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3652b1-027b-4512-b7d1-b9e7e9afe556 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:06.472794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3652b1-027b-4512-b7d1-b9e7e9afe556 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:06.473461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf3652b1-027b-4512-b7d1-b9e7e9afe556 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:06.474779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-cf3652b1-027b-4512-b7d1-b9e7e9afe556 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lazy-loading 'fault' on Instance uuid 0f554895-d3bd-4694-ad7a-1f23d21ed51a {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:47:06.681365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cf3652b1-027b-4512-b7d1-b9e7e9afe556 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:06.763645 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cf3652b1-027b-4512-b7d1-b9e7e9afe556 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 200 len: 1326 microversion: 2.1 time: 0.565010 Aug 18 11:47:06.775503 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2529/4767] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:06 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 1326 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:06.815642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-93204b21-c2c0-402f-aa40-69bd2631d0ce tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:06.828967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-93204b21-c2c0-402f-aa40-69bd2631d0ce tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:06.867076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93204b21-c2c0-402f-aa40-69bd2631d0ce tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:06.871652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93204b21-c2c0-402f-aa40-69bd2631d0ce tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:06.874910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93204b21-c2c0-402f-aa40-69bd2631d0ce tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:06.878587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93204b21-c2c0-402f-aa40-69bd2631d0ce tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:06.882214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93204b21-c2c0-402f-aa40-69bd2631d0ce tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:06.883647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93204b21-c2c0-402f-aa40-69bd2631d0ce tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:07.032900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ab6a8bff-d27c-4173-9a03-512687e70100 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:07.073125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-93204b21-c2c0-402f-aa40-69bd2631d0ce tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:07.084209 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ab6a8bff-d27c-4173-9a03-512687e70100 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1309 microversion: 2.1 time: 1.656729 Aug 18 11:47:07.087826 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2239/4768] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:05 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1309 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:07.090014 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-93204b21-c2c0-402f-aa40-69bd2631d0ce tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1275 microversion: 2.1 time: 0.311962 Aug 18 11:47:07.108071 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2530/4769] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:06 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1275 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:07.119182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b43dc4e0-5064-4c85-a78c-bd9fbe86d035 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:07.120507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b43dc4e0-5064-4c85-a78c-bd9fbe86d035 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] [instance: d31366f8-fd89-43d3-b036-6cf52c8e1844] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:07.127262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ce447578-87f9-41b3-987e-8619ddda80a8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:07.132406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ce447578-87f9-41b3-987e-8619ddda80a8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:07.147257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:07.149694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b43dc4e0-5064-4c85-a78c-bd9fbe86d035 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:07.152577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce447578-87f9-41b3-987e-8619ddda80a8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:07.154950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b43dc4e0-5064-4c85-a78c-bd9fbe86d035 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:07.155635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce447578-87f9-41b3-987e-8619ddda80a8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:07.156131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b43dc4e0-5064-4c85-a78c-bd9fbe86d035 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:07.156287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce447578-87f9-41b3-987e-8619ddda80a8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:07.158964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce447578-87f9-41b3-987e-8619ddda80a8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:07.159812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b43dc4e0-5064-4c85-a78c-bd9fbe86d035 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:07.160743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b43dc4e0-5064-4c85-a78c-bd9fbe86d035 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:07.163072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce447578-87f9-41b3-987e-8619ddda80a8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:07.163676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b43dc4e0-5064-4c85-a78c-bd9fbe86d035 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:07.165082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce447578-87f9-41b3-987e-8619ddda80a8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:07.212097 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-b43dc4e0-5064-4c85-a78c-bd9fbe86d035 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] HTTP exception thrown: Instance d31366f8-fd89-43d3-b036-6cf52c8e1844 could not be found. Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b43dc4e0-5064-4c85-a78c-bd9fbe86d035 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Request method failure captured: Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 HTTP/1.1 Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iaVKqKQm4o3kRWQYq7jZpqVNYs60dYk73fbz7zJNRwnDL1Gusfy3qNaY5ZGZDBgPdv-sXbJ9Nr3FTmUcz1qg6M0XOXnLBW4T05M4r-2W6P5SrIBuM9GxvYSMFen16oqA_CW8uykePPsALgyje9ca-Uo6DEStNgthSw4MEL6lHnDyz0 Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b73b6d77ea914860ab3f8d1ee30700d0 Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1196330752 Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b73b6d77ea914860ab3f8d1ee30700d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b73b6d77ea914860ab3f8d1ee30700d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b73b6d77ea914860ab3f8d1ee30700d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b73b6d77ea914860ab3f8d1ee30700d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1196330752 Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b73b6d77ea914860ab3f8d1ee30700d0 Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1196330752 Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerAddressesNegativeTestJSON-1196330752-project Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 0caa246d8fb3477aa623cb0ae229942c Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1196330752-project Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance d31366f8-fd89-43d3-b036-6cf52c8e1844 could not be found. Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'd31366f8-fd89-43d3-b036-6cf52c8e1844'} Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d31366f8-fd89-43d3-b036-6cf52c8e1844 could not be found. Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d31366f8-fd89-43d3-b036-6cf52c8e1844 could not be found. Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:07.215072 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:07.219576 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:07.219576 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:07.219576 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:07.219576 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:07.219576 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:07.219576 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:07.219576 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d31366f8-fd89-43d3-b036-6cf52c8e1844 could not be found. Aug 18 11:47:07.219576 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:07.225006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b43dc4e0-5064-4c85-a78c-bd9fbe86d035 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] Returning 404 to user: Instance d31366f8-fd89-43d3-b036-6cf52c8e1844 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:07.229257 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b43dc4e0-5064-4c85-a78c-bd9fbe86d035 tempest-ServerAddressesNegativeTestJSON-1196330752 tempest-ServerAddressesNegativeTestJSON-1196330752-project] 10.222.0.73 "GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844" status: 404 len: 111 microversion: 2.1 time: 0.137437 Aug 18 11:47:07.238035 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2240/4770] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:07 2022] GET /compute/v2.1/servers/d31366f8-fd89-43d3-b036-6cf52c8e1844 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:47:07.255037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c87b8317-98d4-4819-be08-eff16658a9d2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:07.259113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c87b8317-98d4-4819-be08-eff16658a9d2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:07.278306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c87b8317-98d4-4819-be08-eff16658a9d2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:07.280778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c87b8317-98d4-4819-be08-eff16658a9d2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:07.281352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c87b8317-98d4-4819-be08-eff16658a9d2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:07.283228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c87b8317-98d4-4819-be08-eff16658a9d2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:07.284018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c87b8317-98d4-4819-be08-eff16658a9d2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:07.286124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c87b8317-98d4-4819-be08-eff16658a9d2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:07.657477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ce447578-87f9-41b3-987e-8619ddda80a8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:07.671764 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ce447578-87f9-41b3-987e-8619ddda80a8 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 0.561546 Aug 18 11:47:07.676644 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2531/4771] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:07 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:07.697913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1b804a2c-ee15-4d19-88df-19e049ac1c77 req-d4c70cb9-c4c1-4fac-bf9d-4ddae63e0484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f554895-d3bd-4694-ad7a-1f23d21ed51a", "name": "network-vif-deleted", "tag": "8fd6c4cd-227d-4d50-846f-b99223c530b6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:07.721164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1b804a2c-ee15-4d19-88df-19e049ac1c77 req-d4c70cb9-c4c1-4fac-bf9d-4ddae63e0484 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:07.721987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1b804a2c-ee15-4d19-88df-19e049ac1c77 req-d4c70cb9-c4c1-4fac-bf9d-4ddae63e0484 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:07.723096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1b804a2c-ee15-4d19-88df-19e049ac1c77 req-d4c70cb9-c4c1-4fac-bf9d-4ddae63e0484 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:07.736306 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1b804a2c-ee15-4d19-88df-19e049ac1c77 req-d4c70cb9-c4c1-4fac-bf9d-4ddae63e0484 service nova] Creating event network-vif-deleted:8fd6c4cd-227d-4d50-846f-b99223c530b6 for instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a on n-h1-853611-3 Aug 18 11:47:07.743106 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1b804a2c-ee15-4d19-88df-19e049ac1c77 req-d4c70cb9-c4c1-4fac-bf9d-4ddae63e0484 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064471 Aug 18 11:47:07.744026 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2532/4772] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:07.803340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-595491e5-1c6d-40bc-8694-dceb885ded68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:07.803340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-595491e5-1c6d-40bc-8694-dceb885ded68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:07.812156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-595491e5-1c6d-40bc-8694-dceb885ded68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:07.812663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-595491e5-1c6d-40bc-8694-dceb885ded68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:07.813105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-595491e5-1c6d-40bc-8694-dceb885ded68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:07.814524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-595491e5-1c6d-40bc-8694-dceb885ded68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:07.815069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-595491e5-1c6d-40bc-8694-dceb885ded68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:07.816076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-595491e5-1c6d-40bc-8694-dceb885ded68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:07.840687 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-595491e5-1c6d-40bc-8694-dceb885ded68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] HTTP exception thrown: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-595491e5-1c6d-40bc-8694-dceb885ded68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Request method failure captured: Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a HTTP/1.1 Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXF7aVR-ODVyh8kOhh5_N4gR1o8moYoxFlGY5LbM6phVerU9qudotwG0fGIEowSEflR8prTOsliKCTKsHR5KtlrLpa8GM57d9zRQvvGwKRU_ttOzZRgZLDAR1zSzbqWQSocRQpZefZWX4STscwAvOnHjdMw7CgBM4DU_Qtt1yzStVY Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 104cfd007b1043239b1818d021f4b26c Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_104cfd007b1043239b1818d021f4b26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 104cfd007b1043239b1818d021f4b26c Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AttachVolumeTestJSON-1628800706-project Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7646f45e2e054269b3d00ec53c883728 Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AttachVolumeTestJSON-1628800706-project Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '0f554895-d3bd-4694-ad7a-1f23d21ed51a'} Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:07.842753 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:07.849223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:07.849223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:07.849223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:07.849223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:07.849223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:07.849223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:47:07.849223 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:07.849223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-595491e5-1c6d-40bc-8694-dceb885ded68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Returning 404 to user: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:07.849223 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-595491e5-1c6d-40bc-8694-dceb885ded68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 404 len: 111 microversion: 2.1 time: 0.052077 Aug 18 11:47:07.851928 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2533/4773] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:07 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:47:07.859252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-66c861ab-0c0e-4b6c-a992-2d29b9d123d3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '.version_select at 0x7f519ef35b80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:07.890089 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-66c861ab-0c0e-4b6c-a992-2d29b9d123d3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-577785836" status: 202 len: 0 microversion: 2.1 time: 0.036918 Aug 18 11:47:07.898514 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2534/4774] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 18 11:47:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-577785836 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:47:08.119121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-53cfdc60-b591-4983-8552-6bb5b4bba4dc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:08.126055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-53cfdc60-b591-4983-8552-6bb5b4bba4dc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:08.163004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53cfdc60-b591-4983-8552-6bb5b4bba4dc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:08.165217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53cfdc60-b591-4983-8552-6bb5b4bba4dc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:08.165965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53cfdc60-b591-4983-8552-6bb5b4bba4dc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:08.166920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53cfdc60-b591-4983-8552-6bb5b4bba4dc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:08.167679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53cfdc60-b591-4983-8552-6bb5b4bba4dc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:08.168497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53cfdc60-b591-4983-8552-6bb5b4bba4dc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:08.354071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c87b8317-98d4-4819-be08-eff16658a9d2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:08.364080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c87b8317-98d4-4819-be08-eff16658a9d2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:08.371900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c87b8317-98d4-4819-be08-eff16658a9d2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:08.373150 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c87b8317-98d4-4819-be08-eff16658a9d2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1739 microversion: 2.20 time: 1.133346 Aug 18 11:47:08.373721 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2241/4775] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:07 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1739 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:08.388231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e0603858-a9dc-4576-adce-ca8f1d4cfdcc tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:08.392495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e0603858-a9dc-4576-adce-ca8f1d4cfdcc tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:08.412062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0603858-a9dc-4576-adce-ca8f1d4cfdcc tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:08.412563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0603858-a9dc-4576-adce-ca8f1d4cfdcc tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:08.413004 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0603858-a9dc-4576-adce-ca8f1d4cfdcc tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:08.413733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0603858-a9dc-4576-adce-ca8f1d4cfdcc tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:08.414210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0603858-a9dc-4576-adce-ca8f1d4cfdcc tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:08.414668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0603858-a9dc-4576-adce-ca8f1d4cfdcc tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:08.654953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e0603858-a9dc-4576-adce-ca8f1d4cfdcc tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:08.675952 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e0603858-a9dc-4576-adce-ca8f1d4cfdcc tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1275 microversion: 2.1 time: 0.300850 Aug 18 11:47:08.678625 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2242/4776] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:08 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1275 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:08.693727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-87d92faa-3f86-477c-b64a-e3c4d235d915 req-7989f015-e73f-4bcd-af0e-420f3fd89601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb953a8-e8bd-44d1-9264-75ae577c5940", "name": "network-vif-plugged", "status": "completed", "tag": "067f85bb-a79e-4035-966d-9dd9ced69382"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:08.728056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-87d92faa-3f86-477c-b64a-e3c4d235d915 req-7989f015-e73f-4bcd-af0e-420f3fd89601 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:08.728750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-87d92faa-3f86-477c-b64a-e3c4d235d915 req-7989f015-e73f-4bcd-af0e-420f3fd89601 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:08.733913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-87d92faa-3f86-477c-b64a-e3c4d235d915 req-7989f015-e73f-4bcd-af0e-420f3fd89601 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:08.780199 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-87d92faa-3f86-477c-b64a-e3c4d235d915 req-7989f015-e73f-4bcd-af0e-420f3fd89601 service nova] Creating event network-vif-plugged:067f85bb-a79e-4035-966d-9dd9ced69382 for instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 on n-h1-853611-3 Aug 18 11:47:08.820712 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-87d92faa-3f86-477c-b64a-e3c4d235d915 req-7989f015-e73f-4bcd-af0e-420f3fd89601 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137445 Aug 18 11:47:08.825344 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2243/4777] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:08.864470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a555aa1c-29a9-485a-b6de-fdba86b1e718 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:08.865812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a555aa1c-29a9-485a-b6de-fdba86b1e718 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:08.889086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a555aa1c-29a9-485a-b6de-fdba86b1e718 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:08.889930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a555aa1c-29a9-485a-b6de-fdba86b1e718 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:08.890703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a555aa1c-29a9-485a-b6de-fdba86b1e718 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:08.892213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a555aa1c-29a9-485a-b6de-fdba86b1e718 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:08.894471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a555aa1c-29a9-485a-b6de-fdba86b1e718 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:08.897422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a555aa1c-29a9-485a-b6de-fdba86b1e718 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:09.669493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a555aa1c-29a9-485a-b6de-fdba86b1e718 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:09.672241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-53cfdc60-b591-4983-8552-6bb5b4bba4dc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:09.689294 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a555aa1c-29a9-485a-b6de-fdba86b1e718 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 0.858817 Aug 18 11:47:09.689914 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2244/4778] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:08 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:09.693967 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-53cfdc60-b591-4983-8552-6bb5b4bba4dc tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1309 microversion: 2.1 time: 1.588027 Aug 18 11:47:09.698310 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2535/4779] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:08 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1309 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:47:09.715688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-674a2c19-f2d4-4563-9b1f-82161ab5569f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:09.716654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-674a2c19-f2d4-4563-9b1f-82161ab5569f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:09.725734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-674a2c19-f2d4-4563-9b1f-82161ab5569f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:09.726482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-674a2c19-f2d4-4563-9b1f-82161ab5569f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:09.727162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-674a2c19-f2d4-4563-9b1f-82161ab5569f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:09.728188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-674a2c19-f2d4-4563-9b1f-82161ab5569f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:09.728880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-674a2c19-f2d4-4563-9b1f-82161ab5569f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:09.729534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-674a2c19-f2d4-4563-9b1f-82161ab5569f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:09.733103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-db8ca899-2af3-4c49-bbb8-591525e9cab4 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:09.733724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-db8ca899-2af3-4c49-bbb8-591525e9cab4 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:09.767496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db8ca899-2af3-4c49-bbb8-591525e9cab4 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:09.768228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db8ca899-2af3-4c49-bbb8-591525e9cab4 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:09.769386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db8ca899-2af3-4c49-bbb8-591525e9cab4 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:09.770462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db8ca899-2af3-4c49-bbb8-591525e9cab4 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:09.789011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db8ca899-2af3-4c49-bbb8-591525e9cab4 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:09.789886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db8ca899-2af3-4c49-bbb8-591525e9cab4 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:10.228756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-db8ca899-2af3-4c49-bbb8-591525e9cab4 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:10.248196 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-db8ca899-2af3-4c49-bbb8-591525e9cab4 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1317 microversion: 2.1 time: 0.519208 Aug 18 11:47:10.268638 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2536/4780] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:09 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:10.296065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-739e8a7d-5aa2-4f7d-80d8-0ff282d8d5d6 req-7ea3daf8-1771-43d4-9b19-f3d5ee786dfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd83b56e-8832-4e0a-93b2-dc11dfa067c5", "tag": "cc05ced5-140e-4931-9eb4-3d4f102578bc"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:10.328542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-739e8a7d-5aa2-4f7d-80d8-0ff282d8d5d6 req-7ea3daf8-1771-43d4-9b19-f3d5ee786dfc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:10.329483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-739e8a7d-5aa2-4f7d-80d8-0ff282d8d5d6 req-7ea3daf8-1771-43d4-9b19-f3d5ee786dfc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:10.331047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-739e8a7d-5aa2-4f7d-80d8-0ff282d8d5d6 req-7ea3daf8-1771-43d4-9b19-f3d5ee786dfc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:10.353074 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-739e8a7d-5aa2-4f7d-80d8-0ff282d8d5d6 req-7ea3daf8-1771-43d4-9b19-f3d5ee786dfc service nova] Creating event network-changed:cc05ced5-140e-4931-9eb4-3d4f102578bc for instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 on n-h1-853611-3 Aug 18 11:47:10.359116 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-739e8a7d-5aa2-4f7d-80d8-0ff282d8d5d6 req-7ea3daf8-1771-43d4-9b19-f3d5ee786dfc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088875 Aug 18 11:47:10.360535 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2537/4781] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:10.559830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-674a2c19-f2d4-4563-9b1f-82161ab5569f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:10.599243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-674a2c19-f2d4-4563-9b1f-82161ab5569f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:10.604989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-674a2c19-f2d4-4563-9b1f-82161ab5569f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:10.605792 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-674a2c19-f2d4-4563-9b1f-82161ab5569f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1739 microversion: 2.20 time: 0.895940 Aug 18 11:47:10.616406 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2245/4782] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:09 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1739 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:10.718059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-35f4479e-5585-42be-8c6a-c43700e8a008 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:10.719696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-35f4479e-5585-42be-8c6a-c43700e8a008 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:10.746205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e2c26d6e-2866-4998-ab10-5cf613bd57d1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:10.748269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35f4479e-5585-42be-8c6a-c43700e8a008 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:10.748821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35f4479e-5585-42be-8c6a-c43700e8a008 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:10.749756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e2c26d6e-2866-4998-ab10-5cf613bd57d1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:10.760342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35f4479e-5585-42be-8c6a-c43700e8a008 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:10.777012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35f4479e-5585-42be-8c6a-c43700e8a008 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:10.777706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35f4479e-5585-42be-8c6a-c43700e8a008 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:10.779140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35f4479e-5585-42be-8c6a-c43700e8a008 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:10.796392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2c26d6e-2866-4998-ab10-5cf613bd57d1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:10.797596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2c26d6e-2866-4998-ab10-5cf613bd57d1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:10.799043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2c26d6e-2866-4998-ab10-5cf613bd57d1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:10.799926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2c26d6e-2866-4998-ab10-5cf613bd57d1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:10.803347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2c26d6e-2866-4998-ab10-5cf613bd57d1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:10.803347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e2c26d6e-2866-4998-ab10-5cf613bd57d1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:11.351158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-35f4479e-5585-42be-8c6a-c43700e8a008 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:11.363603 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-35f4479e-5585-42be-8c6a-c43700e8a008 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1518 microversion: 2.1 time: 0.651334 Aug 18 11:47:11.374467 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2538/4783] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:10 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1518 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:11.378896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a487ddd7-d808-488e-86a1-50be5aadae08 req-3b35672a-eacf-4b8e-9aa8-ee7df3f6fadf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1706f34c-3b86-4298-be5a-126d7bfeba56", "name": "network-vif-plugged", "status": "completed", "tag": "7d0067d8-be65-40dd-bc5c-64a302b5b9c1"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:11.416708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a487ddd7-d808-488e-86a1-50be5aadae08 req-3b35672a-eacf-4b8e-9aa8-ee7df3f6fadf service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:11.419399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a487ddd7-d808-488e-86a1-50be5aadae08 req-3b35672a-eacf-4b8e-9aa8-ee7df3f6fadf service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:11.420923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a487ddd7-d808-488e-86a1-50be5aadae08 req-3b35672a-eacf-4b8e-9aa8-ee7df3f6fadf service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:11.477077 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a487ddd7-d808-488e-86a1-50be5aadae08 req-3b35672a-eacf-4b8e-9aa8-ee7df3f6fadf service nova] Creating event network-vif-plugged:7d0067d8-be65-40dd-bc5c-64a302b5b9c1 for instance 1706f34c-3b86-4298-be5a-126d7bfeba56 on n-h2-853611-3 Aug 18 11:47:11.497754 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a487ddd7-d808-488e-86a1-50be5aadae08 req-3b35672a-eacf-4b8e-9aa8-ee7df3f6fadf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121076 Aug 18 11:47:11.500361 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2539/4784] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:11.512966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d5d941b1-24c1-4ea0-95dd-201e07ec049d tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:11.516561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d5d941b1-24c1-4ea0-95dd-201e07ec049d tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:11.539875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5d941b1-24c1-4ea0-95dd-201e07ec049d tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:11.540979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5d941b1-24c1-4ea0-95dd-201e07ec049d tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:11.541609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5d941b1-24c1-4ea0-95dd-201e07ec049d tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:11.543149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5d941b1-24c1-4ea0-95dd-201e07ec049d tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:11.547754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5d941b1-24c1-4ea0-95dd-201e07ec049d tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:11.549633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5d941b1-24c1-4ea0-95dd-201e07ec049d tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:11.801148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:11.868966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=14 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:12.814696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:12.970104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d5d941b1-24c1-4ea0-95dd-201e07ec049d tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:13.012853 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d5d941b1-24c1-4ea0-95dd-201e07ec049d tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1317 microversion: 2.1 time: 1.508919 Aug 18 11:47:13.015324 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2540/4785] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:11 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1317 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:13.027735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f209a854-34f9-4b47-967e-64557a7807f8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:13.028366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f209a854-34f9-4b47-967e-64557a7807f8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:13.050584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f209a854-34f9-4b47-967e-64557a7807f8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:13.052862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f209a854-34f9-4b47-967e-64557a7807f8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:13.054528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f209a854-34f9-4b47-967e-64557a7807f8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:13.057556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f209a854-34f9-4b47-967e-64557a7807f8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:13.058065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f209a854-34f9-4b47-967e-64557a7807f8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:13.059455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f209a854-34f9-4b47-967e-64557a7807f8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:13.574879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e2c26d6e-2866-4998-ab10-5cf613bd57d1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:13.585800 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e2c26d6e-2866-4998-ab10-5cf613bd57d1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1309 microversion: 2.1 time: 2.856777 Aug 18 11:47:13.590691 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2246/4786] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:10 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1309 bytes in 2863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:13.609975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e38e55ba-fdcf-49cb-a501-76563d4bd4d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:13.610659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e38e55ba-fdcf-49cb-a501-76563d4bd4d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:13.620092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e38e55ba-fdcf-49cb-a501-76563d4bd4d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:13.620602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e38e55ba-fdcf-49cb-a501-76563d4bd4d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:13.621053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e38e55ba-fdcf-49cb-a501-76563d4bd4d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:13.621777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e38e55ba-fdcf-49cb-a501-76563d4bd4d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:13.624687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e38e55ba-fdcf-49cb-a501-76563d4bd4d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:13.625591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e38e55ba-fdcf-49cb-a501-76563d4bd4d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:13.692978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f209a854-34f9-4b47-967e-64557a7807f8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:13.706382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f209a854-34f9-4b47-967e-64557a7807f8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:13.719535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f209a854-34f9-4b47-967e-64557a7807f8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:13.729679 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f209a854-34f9-4b47-967e-64557a7807f8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1739 microversion: 2.20 time: 0.711912 Aug 18 11:47:13.734172 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2541/4787] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:13 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1739 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:13.829337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-129469b5-540b-4406-bd2e-74074f3e9584 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Action: 'create', calling method: .version_select at 0x7f51b0dad4c0>, body: {"keypair": {"name": "tempest-keypair-1737290786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOd620F/rzM2gOTkBi0kAFFFjZBxLGWQC0MNOvCkJ2G14lQSThmVcvWkpMmlEJFy54WNhajIasIXxVFw6MOd05He8kGdKDH8y6KF8UFGYZTfj3BrrS8J6D2WgSBWxMwQ6Q=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:13.868044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-129469b5-540b-4406-bd2e-74074f3e9584 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Getting quotas for project 104cfd007b1043239b1818d021f4b26c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:47:13.886130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-129469b5-540b-4406-bd2e-74074f3e9584 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Getting quotas for user 7646f45e2e054269b3d00ec53c883728 and project 104cfd007b1043239b1818d021f4b26c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:47:13.951093 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-129469b5-540b-4406-bd2e-74074f3e9584 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126535 Aug 18 11:47:13.952238 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2542/4788] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:47:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:47:14.036672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-73be2275-7e65-4342-8780-c05c84ace776 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:14.039140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-73be2275-7e65-4342-8780-c05c84ace776 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:14.049921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73be2275-7e65-4342-8780-c05c84ace776 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:14.052021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73be2275-7e65-4342-8780-c05c84ace776 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:14.052722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73be2275-7e65-4342-8780-c05c84ace776 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:14.055419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73be2275-7e65-4342-8780-c05c84ace776 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:14.059712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73be2275-7e65-4342-8780-c05c84ace776 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:14.060648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-73be2275-7e65-4342-8780-c05c84ace776 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:14.605086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e38e55ba-fdcf-49cb-a501-76563d4bd4d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:14.613568 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e38e55ba-fdcf-49cb-a501-76563d4bd4d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 1.021481 Aug 18 11:47:14.614172 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2247/4789] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:13 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:14.656606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-faa06a2f-ea2d-4fe4-be91-d387ede2584d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:14.657326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-faa06a2f-ea2d-4fe4-be91-d387ede2584d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:14.686417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faa06a2f-ea2d-4fe4-be91-d387ede2584d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:14.687014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faa06a2f-ea2d-4fe4-be91-d387ede2584d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:14.687462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faa06a2f-ea2d-4fe4-be91-d387ede2584d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:14.688323 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faa06a2f-ea2d-4fe4-be91-d387ede2584d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:14.688734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faa06a2f-ea2d-4fe4-be91-d387ede2584d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:14.689166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-faa06a2f-ea2d-4fe4-be91-d387ede2584d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:14.764402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-73be2275-7e65-4342-8780-c05c84ace776 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:14.780834 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-73be2275-7e65-4342-8780-c05c84ace776 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1317 microversion: 2.1 time: 0.748400 Aug 18 11:47:14.782018 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2543/4790] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:14 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1317 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:47:14.787118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4e1f53be-a654-4e5c-9877-f7b4daae84d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:14.787930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4e1f53be-a654-4e5c-9877-f7b4daae84d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:14.800805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e1f53be-a654-4e5c-9877-f7b4daae84d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:14.801544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e1f53be-a654-4e5c-9877-f7b4daae84d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:14.802165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e1f53be-a654-4e5c-9877-f7b4daae84d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:14.805791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e1f53be-a654-4e5c-9877-f7b4daae84d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:14.812784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e1f53be-a654-4e5c-9877-f7b4daae84d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:14.813671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e1f53be-a654-4e5c-9877-f7b4daae84d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:15.266968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-faa06a2f-ea2d-4fe4-be91-d387ede2584d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:15.282787 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-faa06a2f-ea2d-4fe4-be91-d387ede2584d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1309 microversion: 2.1 time: 0.644407 Aug 18 11:47:15.293396 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2248/4791] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:14 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1309 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:15.329377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-df19da08-616b-4a56-8be4-016bc6242b5f req-03c9ccd6-6c6b-4d3f-99c7-aa3d99700d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcf89573-5c6f-49b3-8216-f377532a9832", "tag": "448d1648-dc8b-4e13-b524-1093cfc83321"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:15.370855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-df19da08-616b-4a56-8be4-016bc6242b5f req-03c9ccd6-6c6b-4d3f-99c7-aa3d99700d95 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:15.371341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-df19da08-616b-4a56-8be4-016bc6242b5f req-03c9ccd6-6c6b-4d3f-99c7-aa3d99700d95 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:15.371790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-df19da08-616b-4a56-8be4-016bc6242b5f req-03c9ccd6-6c6b-4d3f-99c7-aa3d99700d95 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:15.422792 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-df19da08-616b-4a56-8be4-016bc6242b5f req-03c9ccd6-6c6b-4d3f-99c7-aa3d99700d95 service nova] Creating event network-changed:448d1648-dc8b-4e13-b524-1093cfc83321 for instance dcf89573-5c6f-49b3-8216-f377532a9832 on n-h1-853611-3 Aug 18 11:47:15.436355 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-df19da08-616b-4a56-8be4-016bc6242b5f req-03c9ccd6-6c6b-4d3f-99c7-aa3d99700d95 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136178 Aug 18 11:47:15.437722 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2249/4792] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:15.448501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cbad62bc-564f-46a7-af1c-1e0c17eabc5c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:15.449203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cbad62bc-564f-46a7-af1c-1e0c17eabc5c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:15.475486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cbad62bc-564f-46a7-af1c-1e0c17eabc5c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:15.475997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cbad62bc-564f-46a7-af1c-1e0c17eabc5c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:15.476436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cbad62bc-564f-46a7-af1c-1e0c17eabc5c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:15.485812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cbad62bc-564f-46a7-af1c-1e0c17eabc5c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:15.486305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cbad62bc-564f-46a7-af1c-1e0c17eabc5c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:15.486784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cbad62bc-564f-46a7-af1c-1e0c17eabc5c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:15.548581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4e1f53be-a654-4e5c-9877-f7b4daae84d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:15.570753 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4e1f53be-a654-4e5c-9877-f7b4daae84d7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.787204 Aug 18 11:47:15.574771 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2544/4793] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:14 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:15.620335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a43875c3-dff8-45e4-95fb-52a1fe506b6b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:15.621659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a43875c3-dff8-45e4-95fb-52a1fe506b6b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:15.643169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a43875c3-dff8-45e4-95fb-52a1fe506b6b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:15.645854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a43875c3-dff8-45e4-95fb-52a1fe506b6b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:15.647873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a43875c3-dff8-45e4-95fb-52a1fe506b6b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:15.652415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a43875c3-dff8-45e4-95fb-52a1fe506b6b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:15.653222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a43875c3-dff8-45e4-95fb-52a1fe506b6b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:15.653862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a43875c3-dff8-45e4-95fb-52a1fe506b6b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:16.095421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a43875c3-dff8-45e4-95fb-52a1fe506b6b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:16.114356 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a43875c3-dff8-45e4-95fb-52a1fe506b6b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.509264 Aug 18 11:47:16.130655 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2545/4794] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:15 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:16.145399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-42d30deb-94ef-424d-9cef-d2a6f18707ec tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:16.152206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-42d30deb-94ef-424d-9cef-d2a6f18707ec tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:16.204487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42d30deb-94ef-424d-9cef-d2a6f18707ec tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:16.209007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42d30deb-94ef-424d-9cef-d2a6f18707ec tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:16.213131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42d30deb-94ef-424d-9cef-d2a6f18707ec tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:16.215790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42d30deb-94ef-424d-9cef-d2a6f18707ec tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:16.218662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42d30deb-94ef-424d-9cef-d2a6f18707ec tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:16.220342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42d30deb-94ef-424d-9cef-d2a6f18707ec tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:16.655596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-42d30deb-94ef-424d-9cef-d2a6f18707ec tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:16.666825 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-42d30deb-94ef-424d-9cef-d2a6f18707ec tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1317 microversion: 2.1 time: 0.541126 Aug 18 11:47:16.670419 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2546/4795] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:16 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1317 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:16.677737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c7acc34-d042-47bb-831f-91098e7f9bad tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:16.706269 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-4c7acc34-d042-47bb-831f-91098e7f9bad tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance b8208f50-853a-4091-a332-29c9ff4587a3 has no mapping to a cell. Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c7acc34-d042-47bb-831f-91098e7f9bad tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/b8208f50-853a-4091-a332-29c9ff4587a3/action HTTP/1.1 Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 15 Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: {"os-stop": {}} Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance b8208f50-853a-4091-a332-29c9ff4587a3 has no mapping to a cell. Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'b8208f50-853a-4091-a332-29c9ff4587a3', 'body': {'os-stop': {}}} Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance b8208f50-853a-4091-a332-29c9ff4587a3 has no mapping to a cell. Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:47:16.732722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8208f50-853a-4091-a332-29c9ff4587a3 has no mapping to a cell. Aug 18 11:47:16.738386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:16.738386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:16.738386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:16.738386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:16.738386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:16.738386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:16.738386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:16.738386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:16.738386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8208f50-853a-4091-a332-29c9ff4587a3 has no mapping to a cell. Aug 18 11:47:16.738386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:16.740366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c7acc34-d042-47bb-831f-91098e7f9bad tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance b8208f50-853a-4091-a332-29c9ff4587a3 has no mapping to a cell. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:16.741447 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4c7acc34-d042-47bb-831f-91098e7f9bad tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/b8208f50-853a-4091-a332-29c9ff4587a3/action" status: 404 len: 117 microversion: 2.1 time: 0.069801 Aug 18 11:47:16.742690 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2547/4796] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:47:16 2022] POST /compute/v2.1/servers/b8208f50-853a-4091-a332-29c9ff4587a3/action => generated 117 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:47:16.756334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c60aa835-f306-48e4-a11a-0365e0816c34 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:16.767203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c60aa835-f306-48e4-a11a-0365e0816c34 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:16.779116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c60aa835-f306-48e4-a11a-0365e0816c34 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:16.779617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c60aa835-f306-48e4-a11a-0365e0816c34 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:16.780081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c60aa835-f306-48e4-a11a-0365e0816c34 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:16.780790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c60aa835-f306-48e4-a11a-0365e0816c34 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:16.781455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c60aa835-f306-48e4-a11a-0365e0816c34 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:16.785534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c60aa835-f306-48e4-a11a-0365e0816c34 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:16.968104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cbad62bc-564f-46a7-af1c-1e0c17eabc5c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:16.992566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cbad62bc-564f-46a7-af1c-1e0c17eabc5c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:17.005281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cbad62bc-564f-46a7-af1c-1e0c17eabc5c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:17.013338 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cbad62bc-564f-46a7-af1c-1e0c17eabc5c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1739 microversion: 2.20 time: 1.573939 Aug 18 11:47:17.027259 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2250/4797] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:15 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1739 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:17.048012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ffe491e6-c3a4-481e-a868-5e74e2328405 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:17.055622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ffe491e6-c3a4-481e-a868-5e74e2328405 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:17.093389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ffe491e6-c3a4-481e-a868-5e74e2328405 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:17.093892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ffe491e6-c3a4-481e-a868-5e74e2328405 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:17.094364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ffe491e6-c3a4-481e-a868-5e74e2328405 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:17.095156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ffe491e6-c3a4-481e-a868-5e74e2328405 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:17.095611 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ffe491e6-c3a4-481e-a868-5e74e2328405 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:17.096071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ffe491e6-c3a4-481e-a868-5e74e2328405 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:17.225245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c60aa835-f306-48e4-a11a-0365e0816c34 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:17.243881 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c60aa835-f306-48e4-a11a-0365e0816c34 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1309 microversion: 2.1 time: 0.489416 Aug 18 11:47:17.246490 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2548/4798] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:16 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1309 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:17.691750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d2e2b0b-ca8f-4917-802c-f1e539c0d96c tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:17.692586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2d2e2b0b-ca8f-4917-802c-f1e539c0d96c tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:17.705923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d2e2b0b-ca8f-4917-802c-f1e539c0d96c tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:17.717436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d2e2b0b-ca8f-4917-802c-f1e539c0d96c tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:17.719681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d2e2b0b-ca8f-4917-802c-f1e539c0d96c tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:17.722790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d2e2b0b-ca8f-4917-802c-f1e539c0d96c tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:17.723489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d2e2b0b-ca8f-4917-802c-f1e539c0d96c tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:17.724623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d2e2b0b-ca8f-4917-802c-f1e539c0d96c tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:18.255155 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ffe491e6-c3a4-481e-a868-5e74e2328405 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:18.269040 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ffe491e6-c3a4-481e-a868-5e74e2328405 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 1.240151 Aug 18 11:47:18.270691 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2251/4799] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:17 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:18.281028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-42b418a5-183d-4b79-979d-08f41fe6376d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:18.281667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-42b418a5-183d-4b79-979d-08f41fe6376d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:18.299944 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42b418a5-183d-4b79-979d-08f41fe6376d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:18.300722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42b418a5-183d-4b79-979d-08f41fe6376d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:18.301329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42b418a5-183d-4b79-979d-08f41fe6376d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:18.302228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42b418a5-183d-4b79-979d-08f41fe6376d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:18.302918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42b418a5-183d-4b79-979d-08f41fe6376d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:18.308931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42b418a5-183d-4b79-979d-08f41fe6376d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:18.383823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2d2e2b0b-ca8f-4917-802c-f1e539c0d96c tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:18.397717 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d2e2b0b-ca8f-4917-802c-f1e539c0d96c tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1317 microversion: 2.1 time: 0.710638 Aug 18 11:47:18.403421 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2549/4800] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:17 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1317 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:18.416587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e1fd2b89-89eb-4e01-929b-4de4c018cf80 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:18.417397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e1fd2b89-89eb-4e01-929b-4de4c018cf80 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:18.423926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1fd2b89-89eb-4e01-929b-4de4c018cf80 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:18.429840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1fd2b89-89eb-4e01-929b-4de4c018cf80 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:18.430712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1fd2b89-89eb-4e01-929b-4de4c018cf80 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:18.431731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1fd2b89-89eb-4e01-929b-4de4c018cf80 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:18.432541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1fd2b89-89eb-4e01-929b-4de4c018cf80 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:18.433204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1fd2b89-89eb-4e01-929b-4de4c018cf80 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:18.766808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e1fd2b89-89eb-4e01-929b-4de4c018cf80 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:18.772081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:18.780951 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e1fd2b89-89eb-4e01-929b-4de4c018cf80 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1309 microversion: 2.1 time: 0.376277 Aug 18 11:47:18.787076 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2550/4801] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:18 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1309 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:18.801044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f28b7a48-8d56-4273-a9ee-afe0fa607dcf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:18.802053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f28b7a48-8d56-4273-a9ee-afe0fa607dcf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:18.821695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-42b418a5-183d-4b79-979d-08f41fe6376d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:18.827903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f28b7a48-8d56-4273-a9ee-afe0fa607dcf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:18.839245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f28b7a48-8d56-4273-a9ee-afe0fa607dcf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:18.842242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f28b7a48-8d56-4273-a9ee-afe0fa607dcf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:18.843321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f28b7a48-8d56-4273-a9ee-afe0fa607dcf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:18.847282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f28b7a48-8d56-4273-a9ee-afe0fa607dcf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:18.848215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f28b7a48-8d56-4273-a9ee-afe0fa607dcf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:18.850891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-42b418a5-183d-4b79-979d-08f41fe6376d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:18.852969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-42b418a5-183d-4b79-979d-08f41fe6376d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:18.857575 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-42b418a5-183d-4b79-979d-08f41fe6376d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1739 microversion: 2.20 time: 0.585823 Aug 18 11:47:18.860027 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2252/4802] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:18 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1739 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:19.375466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f28b7a48-8d56-4273-a9ee-afe0fa607dcf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:19.389825 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f28b7a48-8d56-4273-a9ee-afe0fa607dcf tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.601071 Aug 18 11:47:19.392379 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2551/4803] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:18 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:19.413783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-45f8f8e6-c1c5-45b5-861f-151773c0d781 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:19.415481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-45f8f8e6-c1c5-45b5-861f-151773c0d781 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 97a4dcde-9e8b-4197-9316-5e060bcfa39c] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:19.428178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7453b1e8-886a-4023-aea2-0d1dd1125743 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:19.429284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7453b1e8-886a-4023-aea2-0d1dd1125743 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:19.448975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7453b1e8-886a-4023-aea2-0d1dd1125743 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:19.450590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7453b1e8-886a-4023-aea2-0d1dd1125743 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:19.452681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7453b1e8-886a-4023-aea2-0d1dd1125743 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:19.452869 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-45f8f8e6-c1c5-45b5-861f-151773c0d781 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance 97a4dcde-9e8b-4197-9316-5e060bcfa39c could not be found. Aug 18 11:47:19.454184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7453b1e8-886a-4023-aea2-0d1dd1125743 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:19.457864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7453b1e8-886a-4023-aea2-0d1dd1125743 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:19.458750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7453b1e8-886a-4023-aea2-0d1dd1125743 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-45f8f8e6-c1c5-45b5-861f-151773c0d781 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/97a4dcde-9e8b-4197-9316-5e060bcfa39c/action HTTP/1.1 Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 15 Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: {"suspend": {}} Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 97a4dcde-9e8b-4197-9316-5e060bcfa39c could not be found. Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '97a4dcde-9e8b-4197-9316-5e060bcfa39c', 'body': {'suspend': {}}} Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97a4dcde-9e8b-4197-9316-5e060bcfa39c could not be found. Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97a4dcde-9e8b-4197-9316-5e060bcfa39c could not be found. Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:19.462021 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:19.466619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:19.466619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:19.466619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97a4dcde-9e8b-4197-9316-5e060bcfa39c could not be found. Aug 18 11:47:19.466619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:19.469795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-45f8f8e6-c1c5-45b5-861f-151773c0d781 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance 97a4dcde-9e8b-4197-9316-5e060bcfa39c could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:19.471592 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-45f8f8e6-c1c5-45b5-861f-151773c0d781 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/97a4dcde-9e8b-4197-9316-5e060bcfa39c/action" status: 404 len: 111 microversion: 2.1 time: 0.062469 Aug 18 11:47:19.473421 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2253/4804] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:47:19 2022] POST /compute/v2.1/servers/97a4dcde-9e8b-4197-9316-5e060bcfa39c/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:47:19.486318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-71ab92ec-dd63-4fc5-9452-ccd84724d62c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:19.489179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-71ab92ec-dd63-4fc5-9452-ccd84724d62c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:19.516206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71ab92ec-dd63-4fc5-9452-ccd84724d62c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:19.521045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71ab92ec-dd63-4fc5-9452-ccd84724d62c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:19.527864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71ab92ec-dd63-4fc5-9452-ccd84724d62c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:19.529440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71ab92ec-dd63-4fc5-9452-ccd84724d62c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:19.530101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71ab92ec-dd63-4fc5-9452-ccd84724d62c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:19.530752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-71ab92ec-dd63-4fc5-9452-ccd84724d62c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:19.996382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7453b1e8-886a-4023-aea2-0d1dd1125743 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:20.012990 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7453b1e8-886a-4023-aea2-0d1dd1125743 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1317 microversion: 2.1 time: 0.586648 Aug 18 11:47:20.018808 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2552/4805] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:19 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:20.040565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b2dbb3c-dc29-4f01-93fa-6ee1d591a13d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:20.041926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9b2dbb3c-dc29-4f01-93fa-6ee1d591a13d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:20.070654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b2dbb3c-dc29-4f01-93fa-6ee1d591a13d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:20.072929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b2dbb3c-dc29-4f01-93fa-6ee1d591a13d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:20.073404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b2dbb3c-dc29-4f01-93fa-6ee1d591a13d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:20.074171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b2dbb3c-dc29-4f01-93fa-6ee1d591a13d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:20.076480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b2dbb3c-dc29-4f01-93fa-6ee1d591a13d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:20.079534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b2dbb3c-dc29-4f01-93fa-6ee1d591a13d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:20.412778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-71ab92ec-dd63-4fc5-9452-ccd84724d62c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:20.423250 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-71ab92ec-dd63-4fc5-9452-ccd84724d62c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.943952 Aug 18 11:47:20.431797 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2254/4806] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:19 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:20.465718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aeca0ac7-4e8a-4c69-863f-4fd13bc845e4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:20.466801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-aeca0ac7-4e8a-4c69-863f-4fd13bc845e4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:20.490683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeca0ac7-4e8a-4c69-863f-4fd13bc845e4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:20.491282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeca0ac7-4e8a-4c69-863f-4fd13bc845e4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:20.491753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeca0ac7-4e8a-4c69-863f-4fd13bc845e4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:20.492530 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeca0ac7-4e8a-4c69-863f-4fd13bc845e4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:20.493008 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeca0ac7-4e8a-4c69-863f-4fd13bc845e4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:20.493461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeca0ac7-4e8a-4c69-863f-4fd13bc845e4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:20.619310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9b2dbb3c-dc29-4f01-93fa-6ee1d591a13d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:20.634163 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b2dbb3c-dc29-4f01-93fa-6ee1d591a13d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1309 microversion: 2.1 time: 0.611901 Aug 18 11:47:20.639132 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2553/4807] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:20 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1309 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:20.645816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-15a75b5c-d641-4e9f-bd14-89b2c4769a4b req-d31c93ff-1e13-451c-9836-35da51ca3f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd83b56e-8832-4e0a-93b2-dc11dfa067c5", "name": "network-vif-plugged", "status": "completed", "tag": "cc05ced5-140e-4931-9eb4-3d4f102578bc"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:20.679675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-15a75b5c-d641-4e9f-bd14-89b2c4769a4b req-d31c93ff-1e13-451c-9836-35da51ca3f05 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:20.690697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-15a75b5c-d641-4e9f-bd14-89b2c4769a4b req-d31c93ff-1e13-451c-9836-35da51ca3f05 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:20.695146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-15a75b5c-d641-4e9f-bd14-89b2c4769a4b req-d31c93ff-1e13-451c-9836-35da51ca3f05 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:20.737326 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-15a75b5c-d641-4e9f-bd14-89b2c4769a4b req-d31c93ff-1e13-451c-9836-35da51ca3f05 service nova] Creating event network-vif-plugged:cc05ced5-140e-4931-9eb4-3d4f102578bc for instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 on n-h1-853611-3 Aug 18 11:47:20.744207 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-15a75b5c-d641-4e9f-bd14-89b2c4769a4b req-d31c93ff-1e13-451c-9836-35da51ca3f05 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103290 Aug 18 11:47:20.745197 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2554/4808] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:20.752683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-51cefaf6-b729-496f-b519-5baa72bd79d5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:20.756275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-51cefaf6-b729-496f-b519-5baa72bd79d5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:20.764334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51cefaf6-b729-496f-b519-5baa72bd79d5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:20.765144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51cefaf6-b729-496f-b519-5baa72bd79d5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:20.765775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51cefaf6-b729-496f-b519-5baa72bd79d5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:20.766709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51cefaf6-b729-496f-b519-5baa72bd79d5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:20.767353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51cefaf6-b729-496f-b519-5baa72bd79d5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:20.768113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51cefaf6-b729-496f-b519-5baa72bd79d5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:21.249876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aeca0ac7-4e8a-4c69-863f-4fd13bc845e4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:21.258893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aeca0ac7-4e8a-4c69-863f-4fd13bc845e4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:21.269518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aeca0ac7-4e8a-4c69-863f-4fd13bc845e4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:21.274534 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aeca0ac7-4e8a-4c69-863f-4fd13bc845e4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1739 microversion: 2.20 time: 0.840382 Aug 18 11:47:21.286830 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2255/4809] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:20 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1739 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:21.315750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-83e1d9a9-001f-4782-9fca-a6ab01626382 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:21.317220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-83e1d9a9-001f-4782-9fca-a6ab01626382 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:21.337992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83e1d9a9-001f-4782-9fca-a6ab01626382 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:21.343620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83e1d9a9-001f-4782-9fca-a6ab01626382 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:21.344461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83e1d9a9-001f-4782-9fca-a6ab01626382 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:21.345588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83e1d9a9-001f-4782-9fca-a6ab01626382 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:21.346321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83e1d9a9-001f-4782-9fca-a6ab01626382 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:21.350266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-83e1d9a9-001f-4782-9fca-a6ab01626382 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:21.449233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-51cefaf6-b729-496f-b519-5baa72bd79d5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:21.466396 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-51cefaf6-b729-496f-b519-5baa72bd79d5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.719963 Aug 18 11:47:21.468946 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2555/4810] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:20 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:21.499325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-be8866a0-4e89-4d63-9ca0-2714d3b8508e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:21.500563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-be8866a0-4e89-4d63-9ca0-2714d3b8508e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:21.510901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be8866a0-4e89-4d63-9ca0-2714d3b8508e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:21.511887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be8866a0-4e89-4d63-9ca0-2714d3b8508e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:21.512480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be8866a0-4e89-4d63-9ca0-2714d3b8508e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:21.514143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be8866a0-4e89-4d63-9ca0-2714d3b8508e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:21.514802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be8866a0-4e89-4d63-9ca0-2714d3b8508e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:21.515385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be8866a0-4e89-4d63-9ca0-2714d3b8508e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:21.554017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-be8866a0-4e89-4d63-9ca0-2714d3b8508e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lazy-loading 'flavor' on Instance uuid 0eb953a8-e8bd-44d1-9264-75ae577c5940 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:47:21.672534 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-be8866a0-4e89-4d63-9ca0-2714d3b8508e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action" status: 202 len: 0 microversion: 2.1 time: 0.180100 Aug 18 11:47:21.689674 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2556/4811] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:47:21 2022] POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:47:21.704415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b4fe7b5f-6f6e-4c5e-9dad-47a6bf37788e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:21.705503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b4fe7b5f-6f6e-4c5e-9dad-47a6bf37788e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:21.741074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4fe7b5f-6f6e-4c5e-9dad-47a6bf37788e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:21.741801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4fe7b5f-6f6e-4c5e-9dad-47a6bf37788e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:21.742012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4fe7b5f-6f6e-4c5e-9dad-47a6bf37788e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:21.745575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4fe7b5f-6f6e-4c5e-9dad-47a6bf37788e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:21.746072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4fe7b5f-6f6e-4c5e-9dad-47a6bf37788e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:21.750776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4fe7b5f-6f6e-4c5e-9dad-47a6bf37788e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:22.031535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b4fe7b5f-6f6e-4c5e-9dad-47a6bf37788e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:22.042411 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b4fe7b5f-6f6e-4c5e-9dad-47a6bf37788e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1309 microversion: 2.1 time: 0.350650 Aug 18 11:47:22.043136 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2557/4812] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:21 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1309 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:22.050854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a9a656c4-d4b7-4bb8-a74b-10c4ceb7d85b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:22.054038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a9a656c4-d4b7-4bb8-a74b-10c4ceb7d85b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:22.063920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9a656c4-d4b7-4bb8-a74b-10c4ceb7d85b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:22.064418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9a656c4-d4b7-4bb8-a74b-10c4ceb7d85b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:22.065055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9a656c4-d4b7-4bb8-a74b-10c4ceb7d85b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:22.065783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9a656c4-d4b7-4bb8-a74b-10c4ceb7d85b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:22.067124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9a656c4-d4b7-4bb8-a74b-10c4ceb7d85b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:22.067580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9a656c4-d4b7-4bb8-a74b-10c4ceb7d85b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:22.346455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-83e1d9a9-001f-4782-9fca-a6ab01626382 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:22.352884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:22.382968 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-83e1d9a9-001f-4782-9fca-a6ab01626382 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1317 microversion: 2.1 time: 1.068044 Aug 18 11:47:22.397593 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2256/4813] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:21 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1317 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:22.408000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-141177253", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35c2c144-0e1f-4df1-91ac-3817d3ad3bfe"}], "security_groups": [{"name": "tempest-securitygroup--238197814"}], "key_name": "tempest-keypair-1737290786", "user_data": "}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:22.544909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a9a656c4-d4b7-4bb8-a74b-10c4ceb7d85b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:22.574454 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a9a656c4-d4b7-4bb8-a74b-10c4ceb7d85b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1513 microversion: 2.1 time: 0.530340 Aug 18 11:47:22.579472 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2558/4814] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:22 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1513 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:22.597912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-21bb5420-ae02-4c1e-b513-dc50c62cfb16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:22.603594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-21bb5420-ae02-4c1e-b513-dc50c62cfb16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:22.646651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21bb5420-ae02-4c1e-b513-dc50c62cfb16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:22.648244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21bb5420-ae02-4c1e-b513-dc50c62cfb16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:22.649698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21bb5420-ae02-4c1e-b513-dc50c62cfb16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:22.651886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21bb5420-ae02-4c1e-b513-dc50c62cfb16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:22.654998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21bb5420-ae02-4c1e-b513-dc50c62cfb16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:22.656758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21bb5420-ae02-4c1e-b513-dc50c62cfb16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:22.912601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] validate_networks() for [('35c2c144-0e1f-4df1-91ac-3817d3ad3bfe', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:47:23.373480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-21bb5420-ae02-4c1e-b513-dc50c62cfb16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:23.410548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-21bb5420-ae02-4c1e-b513-dc50c62cfb16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:23.415185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-21bb5420-ae02-4c1e-b513-dc50c62cfb16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:23.419724 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-21bb5420-ae02-4c1e-b513-dc50c62cfb16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1739 microversion: 2.20 time: 0.838994 Aug 18 11:47:23.443072 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2559/4815] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:22 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1739 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:23.454284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-79274ce7-cd4d-4003-9d65-9fc399cbc754 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:23.455706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-79274ce7-cd4d-4003-9d65-9fc399cbc754 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:23.467735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79274ce7-cd4d-4003-9d65-9fc399cbc754 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:23.469578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79274ce7-cd4d-4003-9d65-9fc399cbc754 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:23.471279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79274ce7-cd4d-4003-9d65-9fc399cbc754 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:23.472651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79274ce7-cd4d-4003-9d65-9fc399cbc754 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:23.474186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79274ce7-cd4d-4003-9d65-9fc399cbc754 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:23.475339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79274ce7-cd4d-4003-9d65-9fc399cbc754 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:23.906939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-79274ce7-cd4d-4003-9d65-9fc399cbc754 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:23.909570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:23.920077 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-79274ce7-cd4d-4003-9d65-9fc399cbc754 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1489 microversion: 2.1 time: 0.475327 Aug 18 11:47:23.920874 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2560/4816] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:23 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1489 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:23.959269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bbc109df-7aa4-4a47-a453-2a987dcd0dd5 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:23.962641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bbc109df-7aa4-4a47-a453-2a987dcd0dd5 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:23.978932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbc109df-7aa4-4a47-a453-2a987dcd0dd5 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:23.983694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbc109df-7aa4-4a47-a453-2a987dcd0dd5 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:23.984239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbc109df-7aa4-4a47-a453-2a987dcd0dd5 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:23.985069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbc109df-7aa4-4a47-a453-2a987dcd0dd5 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:23.985544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbc109df-7aa4-4a47-a453-2a987dcd0dd5 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:23.985979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbc109df-7aa4-4a47-a453-2a987dcd0dd5 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:24.767203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:47:24.768433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:47:24.769080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:47:24.769652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:47:24.770990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:47:24.788557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:24.790653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:24.793649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:24.796286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:24.797231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:24.799095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:24.857897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Getting quotas for project 104cfd007b1043239b1818d021f4b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:47:24.872347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Getting quotas for user 7646f45e2e054269b3d00ec53c883728 and project 104cfd007b1043239b1818d021f4b26c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:47:24.912883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:47:24.923602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:47:25.053024 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1f9d2bb2-7f6f-4c90-a640-91b09d8d6406 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.660531 Aug 18 11:47:25.062264 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2257/4817] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:47:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 2673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:47:25.076265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1a3c948a-14b3-458b-8efe-b36f99ac68eb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:25.076893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1a3c948a-14b3-458b-8efe-b36f99ac68eb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:25.091968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1a3c948a-14b3-458b-8efe-b36f99ac68eb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:25.092465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1a3c948a-14b3-458b-8efe-b36f99ac68eb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:25.092903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1a3c948a-14b3-458b-8efe-b36f99ac68eb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:25.105915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1a3c948a-14b3-458b-8efe-b36f99ac68eb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:25.106451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1a3c948a-14b3-458b-8efe-b36f99ac68eb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:25.109628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1a3c948a-14b3-458b-8efe-b36f99ac68eb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:25.204983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bbc109df-7aa4-4a47-a453-2a987dcd0dd5 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:25.222064 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bbc109df-7aa4-4a47-a453-2a987dcd0dd5 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1317 microversion: 2.1 time: 1.272500 Aug 18 11:47:25.225477 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2561/4818] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:23 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1317 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:25.237481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1487861972", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "748eeef0-4e88-4443-abac-e79de3b3bb2a"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:25.388685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] validate_networks() for [('748eeef0-4e88-4443-abac-e79de3b3bb2a', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:47:25.846604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1a3c948a-14b3-458b-8efe-b36f99ac68eb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:25.865401 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1a3c948a-14b3-458b-8efe-b36f99ac68eb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1496 microversion: 2.1 time: 0.801498 Aug 18 11:47:25.881918 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2258/4819] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:25 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1496 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:25.913693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-413382a0-b246-4af7-b40d-fd0d29b353c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:25.915691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-413382a0-b246-4af7-b40d-fd0d29b353c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:25.932987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-413382a0-b246-4af7-b40d-fd0d29b353c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:25.934217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-413382a0-b246-4af7-b40d-fd0d29b353c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:25.935595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-413382a0-b246-4af7-b40d-fd0d29b353c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:25.937443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-413382a0-b246-4af7-b40d-fd0d29b353c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:25.938746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-413382a0-b246-4af7-b40d-fd0d29b353c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:25.943789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-413382a0-b246-4af7-b40d-fd0d29b353c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:26.445218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-413382a0-b246-4af7-b40d-fd0d29b353c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:26.457187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-413382a0-b246-4af7-b40d-fd0d29b353c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:26.476474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-413382a0-b246-4af7-b40d-fd0d29b353c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:26.478954 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-413382a0-b246-4af7-b40d-fd0d29b353c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1739 microversion: 2.20 time: 0.597049 Aug 18 11:47:26.480775 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2259/4820] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:25 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1739 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:26.500321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bc710af8-64f4-4418-9713-9f41e506ec8a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:26.501313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bc710af8-64f4-4418-9713-9f41e506ec8a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:26.504225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:26.517620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc710af8-64f4-4418-9713-9f41e506ec8a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:26.519335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc710af8-64f4-4418-9713-9f41e506ec8a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:26.519933 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc710af8-64f4-4418-9713-9f41e506ec8a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:26.520688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc710af8-64f4-4418-9713-9f41e506ec8a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:26.521172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc710af8-64f4-4418-9713-9f41e506ec8a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:26.521614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bc710af8-64f4-4418-9713-9f41e506ec8a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:27.073692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:47:27.074205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:47:27.074338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:47:27.075049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:47:27.075791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:47:27.100134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:27.100862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:27.102409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:27.103462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:27.105475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:27.106955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:27.179294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:47:27.192665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for user c850b0a836124d90b7e50fe8b9fdf011 and project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:47:27.218759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:47:27.221518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:47:27.318133 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1bbfa78-bfd4-4724-aad7-00f01965fc6e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.087470 Aug 18 11:47:27.320365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2562/4821] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:47:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:47:27.332540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-84d29953-b293-40cd-9168-85772e545150 req-722bfaea-a351-48cf-a198-0c6c6a686e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf89573-5c6f-49b3-8216-f377532a9832", "name": "network-vif-plugged", "status": "completed", "tag": "448d1648-dc8b-4e13-b524-1093cfc83321"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:27.356374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-84d29953-b293-40cd-9168-85772e545150 req-722bfaea-a351-48cf-a198-0c6c6a686e95 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:27.359196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-84d29953-b293-40cd-9168-85772e545150 req-722bfaea-a351-48cf-a198-0c6c6a686e95 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:27.361259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-84d29953-b293-40cd-9168-85772e545150 req-722bfaea-a351-48cf-a198-0c6c6a686e95 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:27.388974 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-84d29953-b293-40cd-9168-85772e545150 req-722bfaea-a351-48cf-a198-0c6c6a686e95 service nova] Creating event network-vif-plugged:448d1648-dc8b-4e13-b524-1093cfc83321 for instance dcf89573-5c6f-49b3-8216-f377532a9832 on n-h1-853611-3 Aug 18 11:47:27.402229 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-84d29953-b293-40cd-9168-85772e545150 req-722bfaea-a351-48cf-a198-0c6c6a686e95 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080251 Aug 18 11:47:27.412336 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2563/4822] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:27.426243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-501fe559-cfcd-4912-be90-c7c57e5940ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:27.428129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-501fe559-cfcd-4912-be90-c7c57e5940ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:27.461107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501fe559-cfcd-4912-be90-c7c57e5940ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:27.463961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501fe559-cfcd-4912-be90-c7c57e5940ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:27.467054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501fe559-cfcd-4912-be90-c7c57e5940ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:27.473293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501fe559-cfcd-4912-be90-c7c57e5940ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:27.474096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501fe559-cfcd-4912-be90-c7c57e5940ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:27.474604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501fe559-cfcd-4912-be90-c7c57e5940ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:27.559978 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bc710af8-64f4-4418-9713-9f41e506ec8a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:27.571860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-501fe559-cfcd-4912-be90-c7c57e5940ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lazy-loading 'flavor' on Instance uuid 0eb953a8-e8bd-44d1-9264-75ae577c5940 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:47:27.575610 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bc710af8-64f4-4418-9713-9f41e506ec8a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1289 microversion: 2.1 time: 1.090506 Aug 18 11:47:27.578971 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2260/4823] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:26 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1289 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:27.590085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cae53a9c-3cf4-408a-bde1-0e18125a1e90 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:27.592077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cae53a9c-3cf4-408a-bde1-0e18125a1e90 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:27.604572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cae53a9c-3cf4-408a-bde1-0e18125a1e90 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:27.605328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cae53a9c-3cf4-408a-bde1-0e18125a1e90 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:27.606185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cae53a9c-3cf4-408a-bde1-0e18125a1e90 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:27.611381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cae53a9c-3cf4-408a-bde1-0e18125a1e90 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:27.619876 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-501fe559-cfcd-4912-be90-c7c57e5940ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Cannot 'suspend' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state suspended Aug 18 11:47:27.625268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cae53a9c-3cf4-408a-bde1-0e18125a1e90 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:27.631965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cae53a9c-3cf4-408a-bde1-0e18125a1e90 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-501fe559-cfcd-4912-be90-c7c57e5940ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action HTTP/1.1 Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 15 Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: {"suspend": {}} Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: exception: Cannot 'suspend' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state suspended Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '0eb953a8-e8bd-44d1-9264-75ae577c5940', 'body': {'suspend': {}}} Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 18 11:47:27.646225 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state suspended Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state suspended Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-501fe559-cfcd-4912-be90-c7c57e5940ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 409 to user: Cannot 'suspend' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state suspended {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-501fe559-cfcd-4912-be90-c7c57e5940ac tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action" status: 409 len: 148 microversion: 2.1 time: 0.233722 Aug 18 11:47:27.650171 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2564/4824] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:47:27 2022] POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action => generated 148 bytes in 235 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:47:27.663712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-52ca29ad-47e4-4133-a35f-c98fd4c662f7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:27.675141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-52ca29ad-47e4-4133-a35f-c98fd4c662f7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:27.803012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-52ca29ad-47e4-4133-a35f-c98fd4c662f7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:27.816402 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-52ca29ad-47e4-4133-a35f-c98fd4c662f7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1209 microversion: 2.1 time: 0.166399 Aug 18 11:47:27.817739 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2565/4825] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:27 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1209 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:27.836960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-316b9d5b-bcea-4e4b-ae55-abc5fe44c9b5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:27.836960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-316b9d5b-bcea-4e4b-ae55-abc5fe44c9b5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:27.855876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-316b9d5b-bcea-4e4b-ae55-abc5fe44c9b5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:27.857781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-316b9d5b-bcea-4e4b-ae55-abc5fe44c9b5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:27.860306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-316b9d5b-bcea-4e4b-ae55-abc5fe44c9b5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:27.861489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-316b9d5b-bcea-4e4b-ae55-abc5fe44c9b5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:27.861972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-316b9d5b-bcea-4e4b-ae55-abc5fe44c9b5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:27.864379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-316b9d5b-bcea-4e4b-ae55-abc5fe44c9b5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:28.295964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-316b9d5b-bcea-4e4b-ae55-abc5fe44c9b5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:28.307934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-316b9d5b-bcea-4e4b-ae55-abc5fe44c9b5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:28.309716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-316b9d5b-bcea-4e4b-ae55-abc5fe44c9b5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:28.311281 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-316b9d5b-bcea-4e4b-ae55-abc5fe44c9b5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1739 microversion: 2.20 time: 0.492301 Aug 18 11:47:28.312515 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2566/4826] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:27 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1739 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:28.319108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5853ab8f-395e-43f4-b6a3-1a36d6ff3bf7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:28.320208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5853ab8f-395e-43f4-b6a3-1a36d6ff3bf7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:28.324201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:28.328892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5853ab8f-395e-43f4-b6a3-1a36d6ff3bf7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:28.329711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5853ab8f-395e-43f4-b6a3-1a36d6ff3bf7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:28.330556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5853ab8f-395e-43f4-b6a3-1a36d6ff3bf7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:28.331655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5853ab8f-395e-43f4-b6a3-1a36d6ff3bf7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:28.332911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5853ab8f-395e-43f4-b6a3-1a36d6ff3bf7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:28.333770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5853ab8f-395e-43f4-b6a3-1a36d6ff3bf7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:28.448622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:28.476002 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5853ab8f-395e-43f4-b6a3-1a36d6ff3bf7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action" status: 202 len: 0 microversion: 2.1 time: 0.161847 Aug 18 11:47:28.480080 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2567/4827] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:47:28 2022] POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:47:28.500538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08e2ab1c-f254-446b-853b-7a0e9af62b0f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:28.503371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-08e2ab1c-f254-446b-853b-7a0e9af62b0f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:28.531749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e2ab1c-f254-446b-853b-7a0e9af62b0f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:28.532813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e2ab1c-f254-446b-853b-7a0e9af62b0f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:28.533432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e2ab1c-f254-446b-853b-7a0e9af62b0f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:28.534745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e2ab1c-f254-446b-853b-7a0e9af62b0f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:28.539757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e2ab1c-f254-446b-853b-7a0e9af62b0f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:28.542292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e2ab1c-f254-446b-853b-7a0e9af62b0f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:28.934187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cae53a9c-3cf4-408a-bde1-0e18125a1e90 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:28.954202 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cae53a9c-3cf4-408a-bde1-0e18125a1e90 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1317 microversion: 2.1 time: 1.371975 Aug 18 11:47:28.963567 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2261/4828] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:27 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1317 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:28.983684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bd878f43-5064-47d3-a5c9-e7e6e67b430c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:28.986332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bd878f43-5064-47d3-a5c9-e7e6e67b430c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:29.009746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd878f43-5064-47d3-a5c9-e7e6e67b430c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:29.011450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd878f43-5064-47d3-a5c9-e7e6e67b430c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:29.012350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd878f43-5064-47d3-a5c9-e7e6e67b430c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:29.014639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd878f43-5064-47d3-a5c9-e7e6e67b430c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:29.016878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd878f43-5064-47d3-a5c9-e7e6e67b430c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:29.019711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd878f43-5064-47d3-a5c9-e7e6e67b430c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:29.037718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-08e2ab1c-f254-446b-853b-7a0e9af62b0f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:29.052445 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-08e2ab1c-f254-446b-853b-7a0e9af62b0f tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1502 microversion: 2.1 time: 0.568085 Aug 18 11:47:29.054837 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2568/4829] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:28 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1502 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:29.065952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-363fd850-dfd3-4dd2-a24b-bce6eb9a1613 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:29.066540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-363fd850-dfd3-4dd2-a24b-bce6eb9a1613 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:29.084231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-363fd850-dfd3-4dd2-a24b-bce6eb9a1613 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:29.084744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-363fd850-dfd3-4dd2-a24b-bce6eb9a1613 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:29.086994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-363fd850-dfd3-4dd2-a24b-bce6eb9a1613 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:29.089304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-363fd850-dfd3-4dd2-a24b-bce6eb9a1613 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:29.091820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-363fd850-dfd3-4dd2-a24b-bce6eb9a1613 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:29.092077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-363fd850-dfd3-4dd2-a24b-bce6eb9a1613 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:29.236564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-363fd850-dfd3-4dd2-a24b-bce6eb9a1613 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:29.250761 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-363fd850-dfd3-4dd2-a24b-bce6eb9a1613 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1261 microversion: 2.1 time: 0.194155 Aug 18 11:47:29.252436 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2569/4830] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:29 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1261 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:29.338256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-97a797ab-6f1e-4f4b-80bd-a67dff2664f3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:29.339826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-97a797ab-6f1e-4f4b-80bd-a67dff2664f3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:29.351765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97a797ab-6f1e-4f4b-80bd-a67dff2664f3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:29.355138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97a797ab-6f1e-4f4b-80bd-a67dff2664f3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:29.355829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97a797ab-6f1e-4f4b-80bd-a67dff2664f3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:29.358713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97a797ab-6f1e-4f4b-80bd-a67dff2664f3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:29.360806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97a797ab-6f1e-4f4b-80bd-a67dff2664f3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:29.361449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97a797ab-6f1e-4f4b-80bd-a67dff2664f3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:29.422713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bd878f43-5064-47d3-a5c9-e7e6e67b430c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:29.456217 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bd878f43-5064-47d3-a5c9-e7e6e67b430c tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1295 microversion: 2.1 time: 0.487663 Aug 18 11:47:29.458874 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2262/4831] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:28 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1295 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:29.832823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-97a797ab-6f1e-4f4b-80bd-a67dff2664f3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:29.847421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-97a797ab-6f1e-4f4b-80bd-a67dff2664f3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:29.857187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-97a797ab-6f1e-4f4b-80bd-a67dff2664f3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:29.857187 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-97a797ab-6f1e-4f4b-80bd-a67dff2664f3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1739 microversion: 2.20 time: 0.522260 Aug 18 11:47:29.871602 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2570/4832] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:29 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1739 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:29.985672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f519b63b-67ce-4096-9df6-cf612edb0cc1 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:29.986153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f519b63b-67ce-4096-9df6-cf612edb0cc1 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:30.034156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f519b63b-67ce-4096-9df6-cf612edb0cc1 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:30.034817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f519b63b-67ce-4096-9df6-cf612edb0cc1 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:30.035796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f519b63b-67ce-4096-9df6-cf612edb0cc1 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:30.036096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f519b63b-67ce-4096-9df6-cf612edb0cc1 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:30.037159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f519b63b-67ce-4096-9df6-cf612edb0cc1 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:30.037917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f519b63b-67ce-4096-9df6-cf612edb0cc1 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:30.372211 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3fe12e3-ae8d-43ec-a983-da6b0eec26da tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Action: 'create', calling method: .version_select at 0x7f519f43eaf0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1758211723", "metadata": {"Type": "work"}}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3fe12e3-ae8d-43ec-a983-da6b0eec26da tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Request method failure captured: Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 122 Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_ibRqQbPazZXY7cYdejG_2GySLpHb-gMnmp_zkFkD2sQ0rqKk_2jZNqESxJ6FenopP112pS1IDHG3DpbY_k-lg7loAIobRjh7eAXMrmeIR2Xu2yXhC8Tyzr-MhrhUm62We8JQgt_XIW5K5J3LR0mOMQTpiWv60kSXYVHqw0V-AbvGJc Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a0415b43438f4a059dea2dd4cd73bbcf Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a0415b43438f4a059dea2dd4cd73bbcf Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-VolumesNegativeTest-265617733-project Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4f167dde380541c3890c5921fd61f7ee Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-VolumesNegativeTest-265617733-project Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1758211723", "metadata": {"Type": "work"}}} Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1758211723', 'metadata': {'Type': 'work'}}}} Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi '#$%' Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:47:30.391186 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:47:30.397768 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 11:47:30.397768 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:30.397768 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:30.397768 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:30.397768 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:30.397768 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:30.397768 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:30.397768 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:47:30.397768 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:47:30.397768 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 11:47:30.397768 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:30.403495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3fe12e3-ae8d-43ec-a983-da6b0eec26da tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:30.407671 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d3fe12e3-ae8d-43ec-a983-da6b0eec26da tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.545019 Aug 18 11:47:30.419489 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2263/4833] 10.222.0.73 () {60 vars in 1156 bytes} [Thu Aug 18 11:47:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 559 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:47:30.432335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-992c0e9d-62fd-47b7-a813-479289e8b801 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:30.444870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-992c0e9d-62fd-47b7-a813-479289e8b801 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:30.481357 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-992c0e9d-62fd-47b7-a813-479289e8b801 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:30.495958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-992c0e9d-62fd-47b7-a813-479289e8b801 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:30.496742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-992c0e9d-62fd-47b7-a813-479289e8b801 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:30.498119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-992c0e9d-62fd-47b7-a813-479289e8b801 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:30.498791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-992c0e9d-62fd-47b7-a813-479289e8b801 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:30.500138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-992c0e9d-62fd-47b7-a813-479289e8b801 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:30.791278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f519b63b-67ce-4096-9df6-cf612edb0cc1 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:30.821257 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f519b63b-67ce-4096-9df6-cf612edb0cc1 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1317 microversion: 2.1 time: 0.840179 Aug 18 11:47:30.823418 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2571/4834] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:29 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1317 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:47:30.829518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-84187291-2b24-43a4-9bd4-322624ae2d75 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:30.831700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-84187291-2b24-43a4-9bd4-322624ae2d75 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:30.863025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84187291-2b24-43a4-9bd4-322624ae2d75 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:30.867177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84187291-2b24-43a4-9bd4-322624ae2d75 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:30.868043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84187291-2b24-43a4-9bd4-322624ae2d75 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:30.870526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84187291-2b24-43a4-9bd4-322624ae2d75 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:30.875905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84187291-2b24-43a4-9bd4-322624ae2d75 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:30.877177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84187291-2b24-43a4-9bd4-322624ae2d75 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:31.088152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-84187291-2b24-43a4-9bd4-322624ae2d75 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:31.111400 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-84187291-2b24-43a4-9bd4-322624ae2d75 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1267 microversion: 2.1 time: 0.283791 Aug 18 11:47:31.130902 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2572/4835] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:30 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:31.141831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a5ad42bc-eb59-4b45-b0ad-0b4ce331c6ff tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Action: 'create', calling method: .version_select at 0x7f519e80bd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-411472255", "metadata": {"Type": "work"}}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a5ad42bc-eb59-4b45-b0ad-0b4ce331c6ff tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Request method failure captured: Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 119 Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ibRqQbPazZXY7cYdejG_2GySLpHb-gMnmp_zkFkD2sQ0rqKk_2jZNqESxJ6FenopP112pS1IDHG3DpbY_k-lg7loAIobRjh7eAXMrmeIR2Xu2yXhC8Tyzr-MhrhUm62We8JQgt_XIW5K5J3LR0mOMQTpiWv60kSXYVHqw0V-AbvGJc Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a0415b43438f4a059dea2dd4cd73bbcf Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a0415b43438f4a059dea2dd4cd73bbcf Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-VolumesNegativeTest-265617733-project Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 4f167dde380541c3890c5921fd61f7ee Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-VolumesNegativeTest-265617733-project Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-411472255", "metadata": {"Type": "work"}}} Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-411472255', 'metadata': {'Type': 'work'}}}} Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi '0' Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:47:31.153238 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:47:31.158951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 11:47:31.158951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:31.158951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:31.158951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:31.158951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:31.158951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:31.158951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:31.158951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:47:31.158951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:47:31.158951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 11:47:31.158951 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:31.163232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a5ad42bc-eb59-4b45-b0ad-0b4ce331c6ff tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:31.164823 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a5ad42bc-eb59-4b45-b0ad-0b4ce331c6ff tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.031300 Aug 18 11:47:31.165585 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2573/4836] 10.222.0.73 () {60 vars in 1156 bytes} [Thu Aug 18 11:47:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:47:31.180094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4cce3556-f335-484b-ad7d-c6d9c993a939 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:31.181089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4cce3556-f335-484b-ad7d-c6d9c993a939 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:31.218417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cce3556-f335-484b-ad7d-c6d9c993a939 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:31.219441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cce3556-f335-484b-ad7d-c6d9c993a939 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:31.222550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cce3556-f335-484b-ad7d-c6d9c993a939 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:31.226698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cce3556-f335-484b-ad7d-c6d9c993a939 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:31.227695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cce3556-f335-484b-ad7d-c6d9c993a939 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:31.228668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cce3556-f335-484b-ad7d-c6d9c993a939 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:31.422909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4cce3556-f335-484b-ad7d-c6d9c993a939 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:31.430938 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4cce3556-f335-484b-ad7d-c6d9c993a939 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1295 microversion: 2.1 time: 0.258235 Aug 18 11:47:31.431526 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2574/4837] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:31 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1295 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:31.447086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-18e4d5c0-19ef-4b98-8f5c-b2b9805ee60e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:31.449577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-18e4d5c0-19ef-4b98-8f5c-b2b9805ee60e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:31.471097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e4d5c0-19ef-4b98-8f5c-b2b9805ee60e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:31.471846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e4d5c0-19ef-4b98-8f5c-b2b9805ee60e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:31.472406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e4d5c0-19ef-4b98-8f5c-b2b9805ee60e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:31.473673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e4d5c0-19ef-4b98-8f5c-b2b9805ee60e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:31.474729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e4d5c0-19ef-4b98-8f5c-b2b9805ee60e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:31.475689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18e4d5c0-19ef-4b98-8f5c-b2b9805ee60e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:31.855110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-18e4d5c0-19ef-4b98-8f5c-b2b9805ee60e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:31.868913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-18e4d5c0-19ef-4b98-8f5c-b2b9805ee60e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:31.882819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-18e4d5c0-19ef-4b98-8f5c-b2b9805ee60e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:31.890954 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-18e4d5c0-19ef-4b98-8f5c-b2b9805ee60e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1739 microversion: 2.20 time: 0.458104 Aug 18 11:47:31.907353 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2575/4838] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:31 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1739 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:31.930082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a58f98e5-000f-4728-9aa0-7f0cdfb3dce2 tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Action: 'create', calling method: .version_select at 0x7f519e862ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1294135203", "metadata": {"Type": "work"}}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a58f98e5-000f-4728-9aa0-7f0cdfb3dce2 tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Request method failure captured: Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 119 Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ibRqQbPazZXY7cYdejG_2GySLpHb-gMnmp_zkFkD2sQ0rqKk_2jZNqESxJ6FenopP112pS1IDHG3DpbY_k-lg7loAIobRjh7eAXMrmeIR2Xu2yXhC8Tyzr-MhrhUm62We8JQgt_XIW5K5J3LR0mOMQTpiWv60kSXYVHqw0V-AbvGJc Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a0415b43438f4a059dea2dd4cd73bbcf Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a0415b43438f4a059dea2dd4cd73bbcf Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-VolumesNegativeTest-265617733-project Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 4f167dde380541c3890c5921fd61f7ee Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-VolumesNegativeTest-265617733-project Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1294135203", "metadata": {"Type": "work"}}} Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1294135203', 'metadata': {'Type': 'work'}}}} Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi '' Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:47:31.938973 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:47:31.944745 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 11:47:31.944745 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:31.944745 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:31.944745 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:31.944745 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:31.944745 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:31.944745 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:31.944745 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:47:31.944745 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:47:31.944745 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 11:47:31.944745 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:31.949129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a58f98e5-000f-4728-9aa0-7f0cdfb3dce2 tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:31.950904 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a58f98e5-000f-4728-9aa0-7f0cdfb3dce2 tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.040884 Aug 18 11:47:31.952365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2576/4839] 10.222.0.73 () {60 vars in 1156 bytes} [Thu Aug 18 11:47:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:47:31.969107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b185c47-5a60-4661-a938-dbd3c2ea4a03 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:31.970192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8b185c47-5a60-4661-a938-dbd3c2ea4a03 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:31.993869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b185c47-5a60-4661-a938-dbd3c2ea4a03 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:31.997643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b185c47-5a60-4661-a938-dbd3c2ea4a03 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:32.000045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b185c47-5a60-4661-a938-dbd3c2ea4a03 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:32.001116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b185c47-5a60-4661-a938-dbd3c2ea4a03 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:32.006742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b185c47-5a60-4661-a938-dbd3c2ea4a03 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:32.008652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b185c47-5a60-4661-a938-dbd3c2ea4a03 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:32.018638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-992c0e9d-62fd-47b7-a813-479289e8b801 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:32.029523 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-992c0e9d-62fd-47b7-a813-479289e8b801 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1502 microversion: 2.1 time: 1.608528 Aug 18 11:47:32.055235 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2264/4840] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:30 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1502 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:32.066305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c2bca5d2-7276-4765-8580-52873c30a223 tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Calling method '.version_select at 0x7f519f882ca0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:32.149781 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-c2bca5d2-7276-4765-8580-52873c30a223 tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] HTTP exception thrown: Volume tempest-invalid-462839522 could not be found. Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c2bca5d2-7276-4765-8580-52873c30a223 tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Request method failure captured: Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-462839522 HTTP/1.1 Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_ibRqQbPazZXY7cYdejG_2GySLpHb-gMnmp_zkFkD2sQ0rqKk_2jZNqESxJ6FenopP112pS1IDHG3DpbY_k-lg7loAIobRjh7eAXMrmeIR2Xu2yXhC8Tyzr-MhrhUm62We8JQgt_XIW5K5J3LR0mOMQTpiWv60kSXYVHqw0V-AbvGJc Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a0415b43438f4a059dea2dd4cd73bbcf Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a0415b43438f4a059dea2dd4cd73bbcf Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-VolumesNegativeTest-265617733-project Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4f167dde380541c3890c5921fd61f7ee Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-VolumesNegativeTest-265617733-project Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: exception: Volume tempest-invalid-462839522 could not be found. Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'tempest-invalid-462839522'} Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-462839522 could not be found. (HTTP 404) (Request-ID: req-a015385e-d0a0-4a7d-b4f3-92af74787d7f) Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:47:32.152047 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-462839522 could not be found. Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-462839522 could not be found. Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-462839522 could not be found. Aug 18 11:47:32.159561 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:32.164691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c2bca5d2-7276-4765-8580-52873c30a223 tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Returning 404 to user: Volume tempest-invalid-462839522 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:32.166261 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c2bca5d2-7276-4765-8580-52873c30a223 tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/tempest-invalid-462839522" status: 404 len: 98 microversion: 2.1 time: 0.105570 Aug 18 11:47:32.167099 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2265/4841] 10.222.0.73 () {58 vars in 1215 bytes} [Thu Aug 18 11:47:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-462839522 => generated 98 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:47:32.186565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2ef74d68-0564-4bd1-8911-af2348819c0d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:32.187661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2ef74d68-0564-4bd1-8911-af2348819c0d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:32.204767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ef74d68-0564-4bd1-8911-af2348819c0d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:32.205245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ef74d68-0564-4bd1-8911-af2348819c0d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:32.205879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ef74d68-0564-4bd1-8911-af2348819c0d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:32.207351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ef74d68-0564-4bd1-8911-af2348819c0d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:32.209306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ef74d68-0564-4bd1-8911-af2348819c0d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:32.214058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ef74d68-0564-4bd1-8911-af2348819c0d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:32.775353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2ef74d68-0564-4bd1-8911-af2348819c0d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:32.798353 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2ef74d68-0564-4bd1-8911-af2348819c0d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1267 microversion: 2.1 time: 0.629543 Aug 18 11:47:32.799364 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2266/4842] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:32 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1267 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:32.822000 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fc843bca-43b0-477c-a007-6102eeb979f3 tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.021317 Aug 18 11:47:32.823088 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2267/4843] 10.222.0.73 () {58 vars in 1140 bytes} [Thu Aug 18 11:47:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 11:47:32.849896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-226fa283-d8c8-487a-9070-cc1d4827108a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:32.865487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-226fa283-d8c8-487a-9070-cc1d4827108a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:32.891221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-226fa283-d8c8-487a-9070-cc1d4827108a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:32.892997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-226fa283-d8c8-487a-9070-cc1d4827108a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:32.906617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-226fa283-d8c8-487a-9070-cc1d4827108a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:32.911671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-226fa283-d8c8-487a-9070-cc1d4827108a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:32.912434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-226fa283-d8c8-487a-9070-cc1d4827108a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:32.913119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-226fa283-d8c8-487a-9070-cc1d4827108a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:33.099992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8b185c47-5a60-4661-a938-dbd3c2ea4a03 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:33.125525 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8b185c47-5a60-4661-a938-dbd3c2ea4a03 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1507 microversion: 2.1 time: 1.168426 Aug 18 11:47:33.130230 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2577/4844] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:31 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1507 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:33.149701 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cc28cec9-79ef-4d75-9fcd-e3242fcdf419 tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017517 Aug 18 11:47:33.151474 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2578/4845] 10.222.0.73 () {58 vars in 1137 bytes} [Thu Aug 18 11:47:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 11:47:33.162830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-30ddb692-0872-4fa3-84e4-c1b8e773582e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:33.163493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-30ddb692-0872-4fa3-84e4-c1b8e773582e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:33.178000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30ddb692-0872-4fa3-84e4-c1b8e773582e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:33.178941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30ddb692-0872-4fa3-84e4-c1b8e773582e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:33.180168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30ddb692-0872-4fa3-84e4-c1b8e773582e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:33.181195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30ddb692-0872-4fa3-84e4-c1b8e773582e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:33.181836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30ddb692-0872-4fa3-84e4-c1b8e773582e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:33.182456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30ddb692-0872-4fa3-84e4-c1b8e773582e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:33.624667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-30ddb692-0872-4fa3-84e4-c1b8e773582e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:33.640584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-30ddb692-0872-4fa3-84e4-c1b8e773582e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:33.652068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-30ddb692-0872-4fa3-84e4-c1b8e773582e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:33.653754 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-30ddb692-0872-4fa3-84e4-c1b8e773582e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1721 microversion: 2.20 time: 0.498927 Aug 18 11:47:33.663847 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2579/4846] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:33 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1721 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:33.699149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1bfb1041-ff26-4e5a-ae7d-0110b4c3ff7b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:33.699741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1bfb1041-ff26-4e5a-ae7d-0110b4c3ff7b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:33.715586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bfb1041-ff26-4e5a-ae7d-0110b4c3ff7b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:33.716142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bfb1041-ff26-4e5a-ae7d-0110b4c3ff7b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:33.716593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bfb1041-ff26-4e5a-ae7d-0110b4c3ff7b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:33.721569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bfb1041-ff26-4e5a-ae7d-0110b4c3ff7b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:33.722689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bfb1041-ff26-4e5a-ae7d-0110b4c3ff7b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:33.723508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bfb1041-ff26-4e5a-ae7d-0110b4c3ff7b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:33.786109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-226fa283-d8c8-487a-9070-cc1d4827108a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:33.807293 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-226fa283-d8c8-487a-9070-cc1d4827108a tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1362 microversion: 2.1 time: 0.978311 Aug 18 11:47:33.818604 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2268/4847] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:32 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1362 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:33.818604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1317e67d-ce34-44cd-874f-79f9379321e3 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:33.818968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1317e67d-ce34-44cd-874f-79f9379321e3 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:33.848669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1317e67d-ce34-44cd-874f-79f9379321e3 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:33.855420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1317e67d-ce34-44cd-874f-79f9379321e3 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:33.856489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1317e67d-ce34-44cd-874f-79f9379321e3 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:33.861324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1317e67d-ce34-44cd-874f-79f9379321e3 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:33.862332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1317e67d-ce34-44cd-874f-79f9379321e3 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:33.864186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1317e67d-ce34-44cd-874f-79f9379321e3 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:33.940110 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1317e67d-ce34-44cd-874f-79f9379321e3 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832/ips" status: 200 len: 110 microversion: 2.1 time: 0.125942 Aug 18 11:47:33.959035 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2269/4848] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:47:33 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832/ips => generated 110 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:33.965144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-85ffd910-7c47-4348-b857-367e6d9dd71b tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Calling method '.version_select at 0x7f51ac2e29d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:34.032471 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-85ffd910-7c47-4348-b857-367e6d9dd71b tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] HTTP exception thrown: Volume 06ded1f4-e268-4657-afd7-a3d81aede797 could not be found. Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-85ffd910-7c47-4348-b857-367e6d9dd71b tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Request method failure captured: Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-volumes/06ded1f4-e268-4657-afd7-a3d81aede797 HTTP/1.1 Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_ibRqQbPazZXY7cYdejG_2GySLpHb-gMnmp_zkFkD2sQ0rqKk_2jZNqESxJ6FenopP112pS1IDHG3DpbY_k-lg7loAIobRjh7eAXMrmeIR2Xu2yXhC8Tyzr-MhrhUm62We8JQgt_XIW5K5J3LR0mOMQTpiWv60kSXYVHqw0V-AbvGJc Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: a0415b43438f4a059dea2dd4cd73bbcf Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: a0415b43438f4a059dea2dd4cd73bbcf Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-VolumesNegativeTest-265617733-project Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 4f167dde380541c3890c5921fd61f7ee Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-VolumesNegativeTest-265617733-project Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: exception: Volume 06ded1f4-e268-4657-afd7-a3d81aede797 could not be found. Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '06ded1f4-e268-4657-afd7-a3d81aede797'} Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06ded1f4-e268-4657-afd7-a3d81aede797 could not be found. (HTTP 404) (Request-ID: req-642b8011-7447-4161-953b-be41c1f408f4) Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 11:47:34.034635 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06ded1f4-e268-4657-afd7-a3d81aede797 could not be found. Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06ded1f4-e268-4657-afd7-a3d81aede797 could not be found. Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06ded1f4-e268-4657-afd7-a3d81aede797 could not be found. Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-85ffd910-7c47-4348-b857-367e6d9dd71b tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Returning 404 to user: Volume 06ded1f4-e268-4657-afd7-a3d81aede797 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:34.041367 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-85ffd910-7c47-4348-b857-367e6d9dd71b tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/06ded1f4-e268-4657-afd7-a3d81aede797" status: 404 len: 109 microversion: 2.1 time: 0.076047 Aug 18 11:47:34.049954 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2270/4849] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:47:33 2022] DELETE /compute/v2.1/os-volumes/06ded1f4-e268-4657-afd7-a3d81aede797 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:47:34.049954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7a1175e4-3efe-4c3f-a2b7-c3147d9d1b54 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:34.053407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7a1175e4-3efe-4c3f-a2b7-c3147d9d1b54 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:34.088418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a1175e4-3efe-4c3f-a2b7-c3147d9d1b54 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:34.089902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a1175e4-3efe-4c3f-a2b7-c3147d9d1b54 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:34.095699 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a1175e4-3efe-4c3f-a2b7-c3147d9d1b54 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:34.100196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a1175e4-3efe-4c3f-a2b7-c3147d9d1b54 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:34.101190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a1175e4-3efe-4c3f-a2b7-c3147d9d1b54 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:34.101755 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a1175e4-3efe-4c3f-a2b7-c3147d9d1b54 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:34.293756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1bfb1041-ff26-4e5a-ae7d-0110b4c3ff7b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:34.308831 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1bfb1041-ff26-4e5a-ae7d-0110b4c3ff7b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.635904 Aug 18 11:47:34.309858 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2580/4850] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:33 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:34.335037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34a1399a-d861-4f14-b41e-64849507455a tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:34.335986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-34a1399a-d861-4f14-b41e-64849507455a tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:34.343844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34a1399a-d861-4f14-b41e-64849507455a tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:34.344348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34a1399a-d861-4f14-b41e-64849507455a tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:34.344789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34a1399a-d861-4f14-b41e-64849507455a tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:34.345518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34a1399a-d861-4f14-b41e-64849507455a tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:34.346740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34a1399a-d861-4f14-b41e-64849507455a tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:34.347185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34a1399a-d861-4f14-b41e-64849507455a tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:34.376606 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34a1399a-d861-4f14-b41e-64849507455a tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832/ips" status: 200 len: 110 microversion: 2.1 time: 0.046251 Aug 18 11:47:34.378060 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2581/4851] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:47:34 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832/ips => generated 110 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:34.382680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-15ea4112-d088-4d4d-9a73-3f0bd8a8949c tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Calling method '.version_select at 0x7f519e84c700>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:34.458196 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-15ea4112-d088-4d4d-9a73-3f0bd8a8949c tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] HTTP exception thrown: Volume 13404107-e401-4dc2-ad02-5fc423f6eb3a could not be found. Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-15ea4112-d088-4d4d-9a73-3f0bd8a8949c tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Request method failure captured: Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-volumes/13404107-e401-4dc2-ad02-5fc423f6eb3a HTTP/1.1 Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ibRqQbPazZXY7cYdejG_2GySLpHb-gMnmp_zkFkD2sQ0rqKk_2jZNqESxJ6FenopP112pS1IDHG3DpbY_k-lg7loAIobRjh7eAXMrmeIR2Xu2yXhC8Tyzr-MhrhUm62We8JQgt_XIW5K5J3LR0mOMQTpiWv60kSXYVHqw0V-AbvGJc Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a0415b43438f4a059dea2dd4cd73bbcf Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a0415b43438f4a059dea2dd4cd73bbcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a0415b43438f4a059dea2dd4cd73bbcf Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-VolumesNegativeTest-265617733 Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-VolumesNegativeTest-265617733-project Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 4f167dde380541c3890c5921fd61f7ee Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-VolumesNegativeTest-265617733-project Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: exception: Volume 13404107-e401-4dc2-ad02-5fc423f6eb3a could not be found. Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '13404107-e401-4dc2-ad02-5fc423f6eb3a'} Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 13404107-e401-4dc2-ad02-5fc423f6eb3a could not be found. (HTTP 404) (Request-ID: req-ced5df2c-601e-4edb-8ae9-8c906cf992ad) Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 11:47:34.460372 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 13404107-e401-4dc2-ad02-5fc423f6eb3a could not be found. Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 13404107-e401-4dc2-ad02-5fc423f6eb3a could not be found. Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 13404107-e401-4dc2-ad02-5fc423f6eb3a could not be found. Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-15ea4112-d088-4d4d-9a73-3f0bd8a8949c tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] Returning 404 to user: Volume 13404107-e401-4dc2-ad02-5fc423f6eb3a could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:34.466843 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-15ea4112-d088-4d4d-9a73-3f0bd8a8949c tempest-VolumesNegativeTest-265617733 tempest-VolumesNegativeTest-265617733-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/13404107-e401-4dc2-ad02-5fc423f6eb3a" status: 404 len: 109 microversion: 2.1 time: 0.086426 Aug 18 11:47:34.474658 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2582/4852] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 11:47:34 2022] GET /compute/v2.1/os-volumes/13404107-e401-4dc2-ad02-5fc423f6eb3a => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:47:34.475048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-31062991-ff3c-43f1-8a09-f9a9e5a5932d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:34.475470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-31062991-ff3c-43f1-8a09-f9a9e5a5932d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:34.486334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31062991-ff3c-43f1-8a09-f9a9e5a5932d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:34.486875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31062991-ff3c-43f1-8a09-f9a9e5a5932d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:34.487377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31062991-ff3c-43f1-8a09-f9a9e5a5932d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:34.488327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31062991-ff3c-43f1-8a09-f9a9e5a5932d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:34.489183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31062991-ff3c-43f1-8a09-f9a9e5a5932d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:34.490016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31062991-ff3c-43f1-8a09-f9a9e5a5932d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:34.826280 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:34.902160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:34.929531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7a1175e4-3efe-4c3f-a2b7-c3147d9d1b54 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:34.957005 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7a1175e4-3efe-4c3f-a2b7-c3147d9d1b54 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1309 microversion: 2.1 time: 0.913517 Aug 18 11:47:34.977853 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2271/4853] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:34 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1309 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:34.983990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bd7b0333-2e33-4049-a104-0dd4293cec8b tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:34.984758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bd7b0333-2e33-4049-a104-0dd4293cec8b tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:34.991821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd7b0333-2e33-4049-a104-0dd4293cec8b tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:34.992651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd7b0333-2e33-4049-a104-0dd4293cec8b tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:34.993828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd7b0333-2e33-4049-a104-0dd4293cec8b tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:34.995084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd7b0333-2e33-4049-a104-0dd4293cec8b tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:34.996016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd7b0333-2e33-4049-a104-0dd4293cec8b tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:34.996605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bd7b0333-2e33-4049-a104-0dd4293cec8b tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:35.062388 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bd7b0333-2e33-4049-a104-0dd4293cec8b tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832/ips/tempest-ServerAddressesTestJSON-1851006429-network" status: 200 len: 95 microversion: 2.1 time: 0.083020 Aug 18 11:47:35.070676 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2272/4854] 10.222.0.73 () {58 vars in 1401 bytes} [Thu Aug 18 11:47:34 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832/ips/tempest-ServerAddressesTestJSON-1851006429-network => generated 95 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:47:35.076661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d53109e3-f28d-42c6-98e6-6c57ec728e16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:35.077643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d53109e3-f28d-42c6-98e6-6c57ec728e16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:35.084786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d53109e3-f28d-42c6-98e6-6c57ec728e16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:35.085661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d53109e3-f28d-42c6-98e6-6c57ec728e16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:35.086754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d53109e3-f28d-42c6-98e6-6c57ec728e16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:35.088281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d53109e3-f28d-42c6-98e6-6c57ec728e16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:35.089006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d53109e3-f28d-42c6-98e6-6c57ec728e16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:35.090228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d53109e3-f28d-42c6-98e6-6c57ec728e16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:35.545689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-31062991-ff3c-43f1-8a09-f9a9e5a5932d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:35.565204 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-31062991-ff3c-43f1-8a09-f9a9e5a5932d tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 1.094312 Aug 18 11:47:35.567180 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2583/4855] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:34 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:35.588848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34143959-71f3-451d-bba2-30ea8dfdc9da tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:35.589825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-34143959-71f3-451d-bba2-30ea8dfdc9da tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:35.599595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34143959-71f3-451d-bba2-30ea8dfdc9da tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:35.600360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34143959-71f3-451d-bba2-30ea8dfdc9da tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:35.600951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34143959-71f3-451d-bba2-30ea8dfdc9da tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:35.602622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34143959-71f3-451d-bba2-30ea8dfdc9da tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:35.603485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34143959-71f3-451d-bba2-30ea8dfdc9da tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:35.604285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34143959-71f3-451d-bba2-30ea8dfdc9da tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:36.059054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-34143959-71f3-451d-bba2-30ea8dfdc9da tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:36.071446 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34143959-71f3-451d-bba2-30ea8dfdc9da tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1362 microversion: 2.1 time: 0.498348 Aug 18 11:47:36.072091 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2584/4856] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:35 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1362 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:36.086783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f40b6fa3-2bd3-4454-b9f1-8a0d17ace832 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:36.091891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f40b6fa3-2bd3-4454-b9f1-8a0d17ace832 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:36.109576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f40b6fa3-2bd3-4454-b9f1-8a0d17ace832 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:36.111278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f40b6fa3-2bd3-4454-b9f1-8a0d17ace832 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:36.111737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f40b6fa3-2bd3-4454-b9f1-8a0d17ace832 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:36.112592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f40b6fa3-2bd3-4454-b9f1-8a0d17ace832 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:36.115887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f40b6fa3-2bd3-4454-b9f1-8a0d17ace832 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:36.116716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f40b6fa3-2bd3-4454-b9f1-8a0d17ace832 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:36.179530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f40b6fa3-2bd3-4454-b9f1-8a0d17ace832 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:47:36.292960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d53109e3-f28d-42c6-98e6-6c57ec728e16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:36.314326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d53109e3-f28d-42c6-98e6-6c57ec728e16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:36.316646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d53109e3-f28d-42c6-98e6-6c57ec728e16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:36.325800 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d53109e3-f28d-42c6-98e6-6c57ec728e16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1721 microversion: 2.20 time: 1.252160 Aug 18 11:47:36.333374 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2273/4857] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:35 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1721 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:36.345314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fbd5fa60-67ca-4157-a5c4-c925d4e28542 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:36.349760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fbd5fa60-67ca-4157-a5c4-c925d4e28542 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 6f693485-75a2-43f0-a6ab-a7d0397ad47f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:36.365820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f40b6fa3-2bd3-4454-b9f1-8a0d17ace832 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 204 len: 0 microversion: 2.1 time: 0.291110 Aug 18 11:47:36.368268 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-fbd5fa60-67ca-4157-a5c4-c925d4e28542 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance 6f693485-75a2-43f0-a6ab-a7d0397ad47f could not be found. Aug 18 11:47:36.372249 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2585/4858] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:47:36 2022] DELETE /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:47:36.378923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ecfa1e3c-3bda-42d6-978a-bc49e7cb2e2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:36.379937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ecfa1e3c-3bda-42d6-978a-bc49e7cb2e2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fbd5fa60-67ca-4157-a5c4-c925d4e28542 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/6f693485-75a2-43f0-a6ab-a7d0397ad47f/action HTTP/1.1 Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 15 Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: {"unpause": {}} Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 6f693485-75a2-43f0-a6ab-a7d0397ad47f could not be found. Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '6f693485-75a2-43f0-a6ab-a7d0397ad47f', 'body': {'unpause': {}}} Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f693485-75a2-43f0-a6ab-a7d0397ad47f could not be found. Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f693485-75a2-43f0-a6ab-a7d0397ad47f could not be found. Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:36.383509 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:36.387519 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:36.387519 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:36.387519 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f693485-75a2-43f0-a6ab-a7d0397ad47f could not be found. Aug 18 11:47:36.387519 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:36.387519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fbd5fa60-67ca-4157-a5c4-c925d4e28542 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance 6f693485-75a2-43f0-a6ab-a7d0397ad47f could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:36.387519 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fbd5fa60-67ca-4157-a5c4-c925d4e28542 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/6f693485-75a2-43f0-a6ab-a7d0397ad47f/action" status: 404 len: 111 microversion: 2.1 time: 0.050623 Aug 18 11:47:36.387519 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2274/4859] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:47:36 2022] POST /compute/v2.1/servers/6f693485-75a2-43f0-a6ab-a7d0397ad47f/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:47:36.391914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecfa1e3c-3bda-42d6-978a-bc49e7cb2e2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:36.392632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecfa1e3c-3bda-42d6-978a-bc49e7cb2e2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:36.393357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecfa1e3c-3bda-42d6-978a-bc49e7cb2e2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:36.394243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecfa1e3c-3bda-42d6-978a-bc49e7cb2e2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:36.394899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecfa1e3c-3bda-42d6-978a-bc49e7cb2e2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:36.395486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecfa1e3c-3bda-42d6-978a-bc49e7cb2e2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:36.410779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-07773481-073f-447a-8be8-a33c279a5962 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:36.411740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-07773481-073f-447a-8be8-a33c279a5962 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:36.438929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07773481-073f-447a-8be8-a33c279a5962 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:36.439565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07773481-073f-447a-8be8-a33c279a5962 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:36.440259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07773481-073f-447a-8be8-a33c279a5962 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:36.441512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07773481-073f-447a-8be8-a33c279a5962 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:36.442328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07773481-073f-447a-8be8-a33c279a5962 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:36.443108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-07773481-073f-447a-8be8-a33c279a5962 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:36.712222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ecfa1e3c-3bda-42d6-978a-bc49e7cb2e2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:36.727380 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ecfa1e3c-3bda-42d6-978a-bc49e7cb2e2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1309 microversion: 2.1 time: 0.353466 Aug 18 11:47:36.728029 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2586/4860] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:36 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1309 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:36.749853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26dee6e2-27ed-487c-9b4a-6d61859ad3c0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:36.750496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26dee6e2-27ed-487c-9b4a-6d61859ad3c0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:36.758474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26dee6e2-27ed-487c-9b4a-6d61859ad3c0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:36.759107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26dee6e2-27ed-487c-9b4a-6d61859ad3c0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:36.759653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26dee6e2-27ed-487c-9b4a-6d61859ad3c0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:36.761557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26dee6e2-27ed-487c-9b4a-6d61859ad3c0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:36.762513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26dee6e2-27ed-487c-9b4a-6d61859ad3c0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:36.763317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26dee6e2-27ed-487c-9b4a-6d61859ad3c0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:36.772826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:37.046631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-07773481-073f-447a-8be8-a33c279a5962 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:37.055055 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-07773481-073f-447a-8be8-a33c279a5962 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1513 microversion: 2.1 time: 0.651473 Aug 18 11:47:37.056385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-26dee6e2-27ed-487c-9b4a-6d61859ad3c0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:37.067320 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2275/4861] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:36 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1513 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:37.079047 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-26dee6e2-27ed-487c-9b4a-6d61859ad3c0 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.333456 Aug 18 11:47:37.080085 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2587/4862] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:36 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:37.114283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-da95127b-e9d0-436b-9430-03350d54b195 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:37.114837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-da95127b-e9d0-436b-9430-03350d54b195 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:37.117668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34df253f-f76e-4041-9060-568adf6d795d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:37.118661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-34df253f-f76e-4041-9060-568adf6d795d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:37.123254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da95127b-e9d0-436b-9430-03350d54b195 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:37.124768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da95127b-e9d0-436b-9430-03350d54b195 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:37.125441 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da95127b-e9d0-436b-9430-03350d54b195 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:37.126760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da95127b-e9d0-436b-9430-03350d54b195 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:37.127463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da95127b-e9d0-436b-9430-03350d54b195 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:37.128145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da95127b-e9d0-436b-9430-03350d54b195 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:37.134960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34df253f-f76e-4041-9060-568adf6d795d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:37.135798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34df253f-f76e-4041-9060-568adf6d795d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:37.136246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34df253f-f76e-4041-9060-568adf6d795d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:37.136977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34df253f-f76e-4041-9060-568adf6d795d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:37.147578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34df253f-f76e-4041-9060-568adf6d795d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:37.148040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34df253f-f76e-4041-9060-568adf6d795d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:37.148539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:37.354278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-34df253f-f76e-4041-9060-568adf6d795d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:37.367521 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34df253f-f76e-4041-9060-568adf6d795d tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1362 microversion: 2.1 time: 0.257639 Aug 18 11:47:37.374607 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2588/4863] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:37 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:37.390114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a724cc99-227a-4f44-85a0-1fce96c8ab2c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:37.391576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a724cc99-227a-4f44-85a0-1fce96c8ab2c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:37.403844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a724cc99-227a-4f44-85a0-1fce96c8ab2c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:37.404733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a724cc99-227a-4f44-85a0-1fce96c8ab2c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:37.405911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a724cc99-227a-4f44-85a0-1fce96c8ab2c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:37.407359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a724cc99-227a-4f44-85a0-1fce96c8ab2c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:37.408134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a724cc99-227a-4f44-85a0-1fce96c8ab2c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:37.408626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a724cc99-227a-4f44-85a0-1fce96c8ab2c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:37.643097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a724cc99-227a-4f44-85a0-1fce96c8ab2c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:37.655587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a724cc99-227a-4f44-85a0-1fce96c8ab2c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:37.659046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a724cc99-227a-4f44-85a0-1fce96c8ab2c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:37.661233 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a724cc99-227a-4f44-85a0-1fce96c8ab2c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1721 microversion: 2.20 time: 0.281472 Aug 18 11:47:37.686691 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2589/4864] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:37 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:37.694403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4c239415-f91c-451b-84bc-34e877da6df2 req-17cfcc0b-2da6-473b-86ca-f68a779698f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89651755-2a7f-4ccd-870e-3b2c6b29c497", "tag": "437fe7bd-ec5e-4005-8194-f8e7f2b93b32"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:37.707670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4c239415-f91c-451b-84bc-34e877da6df2 req-17cfcc0b-2da6-473b-86ca-f68a779698f7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:37.708743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4c239415-f91c-451b-84bc-34e877da6df2 req-17cfcc0b-2da6-473b-86ca-f68a779698f7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:37.709347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4c239415-f91c-451b-84bc-34e877da6df2 req-17cfcc0b-2da6-473b-86ca-f68a779698f7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:37.725245 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4c239415-f91c-451b-84bc-34e877da6df2 req-17cfcc0b-2da6-473b-86ca-f68a779698f7 service nova] Creating event network-changed:437fe7bd-ec5e-4005-8194-f8e7f2b93b32 for instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 on n-h2-853611-3 Aug 18 11:47:37.734526 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4c239415-f91c-451b-84bc-34e877da6df2 req-17cfcc0b-2da6-473b-86ca-f68a779698f7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045195 Aug 18 11:47:37.735884 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2590/4865] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:37.759416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7c55f7bb-fd32-40ed-beb9-579a1d1718c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:37.760261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7c55f7bb-fd32-40ed-beb9-579a1d1718c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:37.781502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c55f7bb-fd32-40ed-beb9-579a1d1718c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:37.781923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c55f7bb-fd32-40ed-beb9-579a1d1718c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:37.782124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c55f7bb-fd32-40ed-beb9-579a1d1718c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:37.782967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c55f7bb-fd32-40ed-beb9-579a1d1718c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:37.783427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c55f7bb-fd32-40ed-beb9-579a1d1718c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:37.783954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c55f7bb-fd32-40ed-beb9-579a1d1718c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:37.791840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-da95127b-e9d0-436b-9430-03350d54b195 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:37.817553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:37.819948 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-da95127b-e9d0-436b-9430-03350d54b195 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.709163 Aug 18 11:47:37.825712 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2276/4866] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:37 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:47:37.850796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-34028a86-b8db-43e1-afd2-361a0bb4e4b5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:37.850796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-34028a86-b8db-43e1-afd2-361a0bb4e4b5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:37.861321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34028a86-b8db-43e1-afd2-361a0bb4e4b5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:37.862035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34028a86-b8db-43e1-afd2-361a0bb4e4b5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:37.866395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34028a86-b8db-43e1-afd2-361a0bb4e4b5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:37.869430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34028a86-b8db-43e1-afd2-361a0bb4e4b5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:37.870418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34028a86-b8db-43e1-afd2-361a0bb4e4b5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:37.872143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-34028a86-b8db-43e1-afd2-361a0bb4e4b5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:37.902627 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-34028a86-b8db-43e1-afd2-361a0bb4e4b5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Cannot 'unpause' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-34028a86-b8db-43e1-afd2-361a0bb4e4b5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action HTTP/1.1 Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 15 Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: {"unpause": {}} Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: exception: Cannot 'unpause' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '0eb953a8-e8bd-44d1-9264-75ae577c5940', 'body': {'unpause': {}}} Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 in vm_state active. Cannot unpause while the instance is in this state. Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:37.904335 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:37.908402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:37.908402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:37.908402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:37.908402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:47:37.908402 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:37.910614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-34028a86-b8db-43e1-afd2-361a0bb4e4b5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 409 to user: Cannot 'unpause' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:37.911747 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-34028a86-b8db-43e1-afd2-361a0bb4e4b5 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action" status: 409 len: 145 microversion: 2.1 time: 0.067533 Aug 18 11:47:37.916111 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2277/4867] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:47:37 2022] POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action => generated 145 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:47:37.922673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4e04a841-f80b-442f-9aa5-9c07c01b040b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:37.923766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4e04a841-f80b-442f-9aa5-9c07c01b040b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:37.931637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e04a841-f80b-442f-9aa5-9c07c01b040b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:37.932589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e04a841-f80b-442f-9aa5-9c07c01b040b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:37.933961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e04a841-f80b-442f-9aa5-9c07c01b040b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:37.935069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e04a841-f80b-442f-9aa5-9c07c01b040b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:37.935744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e04a841-f80b-442f-9aa5-9c07c01b040b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:37.936363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4e04a841-f80b-442f-9aa5-9c07c01b040b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:38.579626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4e04a841-f80b-442f-9aa5-9c07c01b040b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:38.609058 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4e04a841-f80b-442f-9aa5-9c07c01b040b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.690542 Aug 18 11:47:38.612653 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2278/4868] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:37 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:38.620588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1dd444df-7264-45bf-ab96-5ffd160b6892 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:38.622822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1dd444df-7264-45bf-ab96-5ffd160b6892 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:38.642148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dd444df-7264-45bf-ab96-5ffd160b6892 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:38.643184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dd444df-7264-45bf-ab96-5ffd160b6892 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:38.645120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dd444df-7264-45bf-ab96-5ffd160b6892 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:38.647788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dd444df-7264-45bf-ab96-5ffd160b6892 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:38.648878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dd444df-7264-45bf-ab96-5ffd160b6892 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:38.649687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dd444df-7264-45bf-ab96-5ffd160b6892 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:38.663678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c55f7bb-fd32-40ed-beb9-579a1d1718c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:38.678291 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7c55f7bb-fd32-40ed-beb9-579a1d1718c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1309 microversion: 2.1 time: 0.930557 Aug 18 11:47:38.684081 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2591/4869] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:37 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1309 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:47:38.698913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d556df3c-50dc-4422-9cc1-fc9ecee4ad6d req-8a2249b3-4025-419d-9240-70ce5cdc42d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1706f34c-3b86-4298-be5a-126d7bfeba56", "name": "network-vif-unplugged", "status": "completed", "tag": "7d0067d8-be65-40dd-bc5c-64a302b5b9c1"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:38.724440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d556df3c-50dc-4422-9cc1-fc9ecee4ad6d req-8a2249b3-4025-419d-9240-70ce5cdc42d9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:38.725742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d556df3c-50dc-4422-9cc1-fc9ecee4ad6d req-8a2249b3-4025-419d-9240-70ce5cdc42d9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:38.727279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d556df3c-50dc-4422-9cc1-fc9ecee4ad6d req-8a2249b3-4025-419d-9240-70ce5cdc42d9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:38.749304 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d556df3c-50dc-4422-9cc1-fc9ecee4ad6d req-8a2249b3-4025-419d-9240-70ce5cdc42d9 service nova] Creating event network-vif-unplugged:7d0067d8-be65-40dd-bc5c-64a302b5b9c1 for instance 1706f34c-3b86-4298-be5a-126d7bfeba56 on n-h2-853611-3 Aug 18 11:47:38.756022 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d556df3c-50dc-4422-9cc1-fc9ecee4ad6d req-8a2249b3-4025-419d-9240-70ce5cdc42d9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069471 Aug 18 11:47:38.757999 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2592/4870] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:38.764697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-89358edb-1ddb-43b6-b5d3-adab72a3110e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:38.765620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-89358edb-1ddb-43b6-b5d3-adab72a3110e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:38.776747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89358edb-1ddb-43b6-b5d3-adab72a3110e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:38.778469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89358edb-1ddb-43b6-b5d3-adab72a3110e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:38.779229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89358edb-1ddb-43b6-b5d3-adab72a3110e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:38.780450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89358edb-1ddb-43b6-b5d3-adab72a3110e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:38.781267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89358edb-1ddb-43b6-b5d3-adab72a3110e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:38.782017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89358edb-1ddb-43b6-b5d3-adab72a3110e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:39.165634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-89358edb-1ddb-43b6-b5d3-adab72a3110e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:39.196419 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-89358edb-1ddb-43b6-b5d3-adab72a3110e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1362 microversion: 2.1 time: 0.427194 Aug 18 11:47:39.202784 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2593/4871] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:38 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1362 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:39.217995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6cc82a0f-5478-4f63-899f-47bf9a8b08fe tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:39.220245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6cc82a0f-5478-4f63-899f-47bf9a8b08fe tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:39.247993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cc82a0f-5478-4f63-899f-47bf9a8b08fe tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:39.252940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cc82a0f-5478-4f63-899f-47bf9a8b08fe tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:39.253916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cc82a0f-5478-4f63-899f-47bf9a8b08fe tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:39.258305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cc82a0f-5478-4f63-899f-47bf9a8b08fe tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:39.259157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cc82a0f-5478-4f63-899f-47bf9a8b08fe tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:39.259856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cc82a0f-5478-4f63-899f-47bf9a8b08fe tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:39.719733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1dd444df-7264-45bf-ab96-5ffd160b6892 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6482e5465143c49fe7717b8699b220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc024c4689aa45fd93568184f7fd308e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:39.743325 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1dd444df-7264-45bf-ab96-5ffd160b6892 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 200 len: 1513 microversion: 2.1 time: 1.131603 Aug 18 11:47:39.750364 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2279/4872] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:38 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 1513 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:39.770649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1bb02f3f-5ef0-4824-9835-a95627e16b80 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:39.772507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1bb02f3f-5ef0-4824-9835-a95627e16b80 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:39.795094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1bb02f3f-5ef0-4824-9835-a95627e16b80 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:39.802680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1bb02f3f-5ef0-4824-9835-a95627e16b80 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:39.803398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1bb02f3f-5ef0-4824-9835-a95627e16b80 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:39.804299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1bb02f3f-5ef0-4824-9835-a95627e16b80 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:39.806057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1bb02f3f-5ef0-4824-9835-a95627e16b80 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:39.807277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1bb02f3f-5ef0-4824-9835-a95627e16b80 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:39.869358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:40.118567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6cc82a0f-5478-4f63-899f-47bf9a8b08fe tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:40.136163 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6cc82a0f-5478-4f63-899f-47bf9a8b08fe tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.930158 Aug 18 11:47:40.139493 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2594/4873] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:39 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:40.145254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-93f09462-f7b8-4f1d-8571-d6f87cea9efb tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:40.146656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-93f09462-f7b8-4f1d-8571-d6f87cea9efb tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:40.177284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f09462-f7b8-4f1d-8571-d6f87cea9efb tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:40.178165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f09462-f7b8-4f1d-8571-d6f87cea9efb tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:40.178868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f09462-f7b8-4f1d-8571-d6f87cea9efb tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:40.179857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f09462-f7b8-4f1d-8571-d6f87cea9efb tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:40.180795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f09462-f7b8-4f1d-8571-d6f87cea9efb tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:40.181771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93f09462-f7b8-4f1d-8571-d6f87cea9efb tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:40.605401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1bb02f3f-5ef0-4824-9835-a95627e16b80 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:40.626116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1bb02f3f-5ef0-4824-9835-a95627e16b80 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:40.631609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1bb02f3f-5ef0-4824-9835-a95627e16b80 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:40.634635 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1bb02f3f-5ef0-4824-9835-a95627e16b80 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1664 microversion: 2.20 time: 0.881222 Aug 18 11:47:40.656392 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2280/4874] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:39 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1664 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:40.668227 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-3634e43f-aabb-4295-9e38-2947b18d5ef2 req-380794fa-37b5-48ac-a5d9-9934dce2c568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9f9674-f5b0-42e7-b843-15f50cfc751a", "tag": "7f362877-7820-47c2-bb2c-97b187c82a2b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:40.682809 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-3634e43f-aabb-4295-9e38-2947b18d5ef2 req-380794fa-37b5-48ac-a5d9-9934dce2c568 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:40.683587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-3634e43f-aabb-4295-9e38-2947b18d5ef2 req-380794fa-37b5-48ac-a5d9-9934dce2c568 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:40.684687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-3634e43f-aabb-4295-9e38-2947b18d5ef2 req-380794fa-37b5-48ac-a5d9-9934dce2c568 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:40.712511 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-3634e43f-aabb-4295-9e38-2947b18d5ef2 req-380794fa-37b5-48ac-a5d9-9934dce2c568 service nova] Creating event network-changed:7f362877-7820-47c2-bb2c-97b187c82a2b for instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a on n-h2-853611-3 Aug 18 11:47:40.719825 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-3634e43f-aabb-4295-9e38-2947b18d5ef2 req-380794fa-37b5-48ac-a5d9-9934dce2c568 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060603 Aug 18 11:47:40.721548 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2281/4875] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:40.729593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-334cc11a-76c4-4ba5-9b98-026682fa85e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:40.731294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-334cc11a-76c4-4ba5-9b98-026682fa85e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: c6fbdbd6-d66a-4743-98fd-b3f86a472b49] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:40.739589 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-334cc11a-76c4-4ba5-9b98-026682fa85e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance c6fbdbd6-d66a-4743-98fd-b3f86a472b49 could not be found. Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-334cc11a-76c4-4ba5-9b98-026682fa85e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/c6fbdbd6-d66a-4743-98fd-b3f86a472b49/action HTTP/1.1 Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 18 Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: {"unshelve": null} Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance c6fbdbd6-d66a-4743-98fd-b3f86a472b49 could not be found. Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'c6fbdbd6-d66a-4743-98fd-b3f86a472b49', 'body': {'unshelve': None}} Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6fbdbd6-d66a-4743-98fd-b3f86a472b49 could not be found. Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6fbdbd6-d66a-4743-98fd-b3f86a472b49 could not be found. Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:40.741731 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:40.746571 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:40.746571 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:40.746571 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:40.746571 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:40.746571 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:40.746571 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:40.746571 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6fbdbd6-d66a-4743-98fd-b3f86a472b49 could not be found. Aug 18 11:47:40.746571 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:40.750476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-334cc11a-76c4-4ba5-9b98-026682fa85e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance c6fbdbd6-d66a-4743-98fd-b3f86a472b49 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:40.751577 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-334cc11a-76c4-4ba5-9b98-026682fa85e3 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/c6fbdbd6-d66a-4743-98fd-b3f86a472b49/action" status: 404 len: 111 microversion: 2.1 time: 0.028670 Aug 18 11:47:40.752770 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2282/4876] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:47:40 2022] POST /compute/v2.1/servers/c6fbdbd6-d66a-4743-98fd-b3f86a472b49/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:47:40.758784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c8d4554b-fa65-4c71-95dc-9be1fd6b1964 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:40.760012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c8d4554b-fa65-4c71-95dc-9be1fd6b1964 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:40.768591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c8d4554b-fa65-4c71-95dc-9be1fd6b1964 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:40.769405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c8d4554b-fa65-4c71-95dc-9be1fd6b1964 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:40.770405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c8d4554b-fa65-4c71-95dc-9be1fd6b1964 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:40.771489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c8d4554b-fa65-4c71-95dc-9be1fd6b1964 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:40.772130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c8d4554b-fa65-4c71-95dc-9be1fd6b1964 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:40.772731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c8d4554b-fa65-4c71-95dc-9be1fd6b1964 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:40.820089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-93f09462-f7b8-4f1d-8571-d6f87cea9efb tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:40.844299 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-93f09462-f7b8-4f1d-8571-d6f87cea9efb tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1309 microversion: 2.1 time: 0.701949 Aug 18 11:47:40.847163 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2595/4877] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:40 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1309 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:40.859785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3a150ed2-c594-48ac-b2fd-b68f9152ad7b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f88940be-12e1-4a23-a04e-582a458bbabd"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:40.888790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3a150ed2-c594-48ac-b2fd-b68f9152ad7b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:40.899439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a150ed2-c594-48ac-b2fd-b68f9152ad7b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:40.900319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a150ed2-c594-48ac-b2fd-b68f9152ad7b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:40.901152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a150ed2-c594-48ac-b2fd-b68f9152ad7b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:40.902133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a150ed2-c594-48ac-b2fd-b68f9152ad7b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:40.902931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a150ed2-c594-48ac-b2fd-b68f9152ad7b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:40.903597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a150ed2-c594-48ac-b2fd-b68f9152ad7b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:41.479151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c8d4554b-fa65-4c71-95dc-9be1fd6b1964 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:41.502148 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c8d4554b-fa65-4c71-95dc-9be1fd6b1964 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1362 microversion: 2.1 time: 0.747966 Aug 18 11:47:41.502996 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2283/4878] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:40 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1362 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:41.511978 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d06a5999-4a54-4512-9e03-ab073b82aacb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:41.512942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d06a5999-4a54-4512-9e03-ab073b82aacb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:41.522187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d06a5999-4a54-4512-9e03-ab073b82aacb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:41.522930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d06a5999-4a54-4512-9e03-ab073b82aacb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:41.523666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d06a5999-4a54-4512-9e03-ab073b82aacb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:41.526511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d06a5999-4a54-4512-9e03-ab073b82aacb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:41.527252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d06a5999-4a54-4512-9e03-ab073b82aacb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:41.528154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d06a5999-4a54-4512-9e03-ab073b82aacb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:41.532519 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3a150ed2-c594-48ac-b2fd-b68f9152ad7b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "POST /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.680284 Aug 18 11:47:41.540245 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2596/4879] 10.222.0.73 () {62 vars in 1364 bytes} [Thu Aug 18 11:47:40 2022] POST /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments => generated 188 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:47:41.553164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8debe4d-aee5-45f4-94bb-83ae9fc0d214 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:41.569145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f8debe4d-aee5-45f4-94bb-83ae9fc0d214 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] [instance: dcf89573-5c6f-49b3-8216-f377532a9832] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:41.582747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8debe4d-aee5-45f4-94bb-83ae9fc0d214 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:41.586470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8debe4d-aee5-45f4-94bb-83ae9fc0d214 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:41.591834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8debe4d-aee5-45f4-94bb-83ae9fc0d214 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:41.593654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8debe4d-aee5-45f4-94bb-83ae9fc0d214 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:41.594450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8debe4d-aee5-45f4-94bb-83ae9fc0d214 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:41.595558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8debe4d-aee5-45f4-94bb-83ae9fc0d214 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:41.627494 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-f8debe4d-aee5-45f4-94bb-83ae9fc0d214 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] HTTP exception thrown: Instance dcf89573-5c6f-49b3-8216-f377532a9832 could not be found. Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8debe4d-aee5-45f4-94bb-83ae9fc0d214 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Request method failure captured: Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 HTTP/1.1 Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iaxiCUgSGtkkD_yMRKNJ5TxobZGEC8j0MQiBIU-J9j9Jcpig6OmBwEWR4uEc4Cgw_WC9kW6FcK3lO1ry5U6IfOByFGBVesrCL-1RJ5FLsP0xNYLgKn8Pibse5y0xeBKUZHqcl4CEAWMLrDcoES9HGws3Wrf09eu3g1NYEJzYNHmnUk Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: cc024c4689aa45fd93568184f7fd308e Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerAddressesTestJSON-2035791125 Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cc024c4689aa45fd93568184f7fd308e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cc024c4689aa45fd93568184f7fd308e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cc024c4689aa45fd93568184f7fd308e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cc024c4689aa45fd93568184f7fd308e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerAddressesTestJSON-2035791125 Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: cc024c4689aa45fd93568184f7fd308e Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2035791125 Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerAddressesTestJSON-2035791125-project Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6f6482e5465143c49fe7717b8699b220 Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerAddressesTestJSON-2035791125-project Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance dcf89573-5c6f-49b3-8216-f377532a9832 could not be found. Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'dcf89573-5c6f-49b3-8216-f377532a9832'} Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcf89573-5c6f-49b3-8216-f377532a9832 could not be found. Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcf89573-5c6f-49b3-8216-f377532a9832 could not be found. Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:41.637811 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:41.642636 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:41.642636 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:41.642636 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:41.642636 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:41.642636 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:41.642636 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcf89573-5c6f-49b3-8216-f377532a9832 could not be found. Aug 18 11:47:41.642636 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:41.644481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8debe4d-aee5-45f4-94bb-83ae9fc0d214 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] Returning 404 to user: Instance dcf89573-5c6f-49b3-8216-f377532a9832 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:41.646936 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8debe4d-aee5-45f4-94bb-83ae9fc0d214 tempest-ServerAddressesTestJSON-2035791125 tempest-ServerAddressesTestJSON-2035791125-project] 10.222.0.73 "GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832" status: 404 len: 111 microversion: 2.1 time: 0.104586 Aug 18 11:47:41.647990 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2597/4880] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:41 2022] GET /compute/v2.1/servers/dcf89573-5c6f-49b3-8216-f377532a9832 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:47:41.844190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0a9326e5-3bcd-46dc-a934-443d93e985cb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:41.845040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0a9326e5-3bcd-46dc-a934-443d93e985cb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:41.864418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a9326e5-3bcd-46dc-a934-443d93e985cb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:41.865314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a9326e5-3bcd-46dc-a934-443d93e985cb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:41.865988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a9326e5-3bcd-46dc-a934-443d93e985cb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:41.866992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a9326e5-3bcd-46dc-a934-443d93e985cb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:41.867681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a9326e5-3bcd-46dc-a934-443d93e985cb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:41.869792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a9326e5-3bcd-46dc-a934-443d93e985cb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:41.918080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0a9326e5-3bcd-46dc-a934-443d93e985cb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122210) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 18 11:47:42.064312 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0a9326e5-3bcd-46dc-a934-443d93e985cb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "POST /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/action" status: 202 len: 0 microversion: 2.20 time: 0.221907 Aug 18 11:47:42.065058 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2598/4881] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 18 11:47:41 2022] POST /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:47:42.110085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0620a362-6f56-427a-b977-ce125c2e36c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:42.111701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0620a362-6f56-427a-b977-ce125c2e36c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:42.131882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0620a362-6f56-427a-b977-ce125c2e36c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:42.133451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0620a362-6f56-427a-b977-ce125c2e36c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:42.136273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0620a362-6f56-427a-b977-ce125c2e36c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:42.140415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0620a362-6f56-427a-b977-ce125c2e36c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:42.141426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0620a362-6f56-427a-b977-ce125c2e36c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:42.146942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0620a362-6f56-427a-b977-ce125c2e36c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:42.796841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d06a5999-4a54-4512-9e03-ab073b82aacb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:42.808237 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d06a5999-4a54-4512-9e03-ab073b82aacb tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 1.303939 Aug 18 11:47:42.815838 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2284/4882] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:41 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:42.832729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0620a362-6f56-427a-b977-ce125c2e36c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:42.844743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f92b7f2a-fe92-409c-979f-51d4fc384639 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:42.845741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f92b7f2a-fe92-409c-979f-51d4fc384639 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:42.849054 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0620a362-6f56-427a-b977-ce125c2e36c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1309 microversion: 2.1 time: 0.782331 Aug 18 11:47:42.862898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f92b7f2a-fe92-409c-979f-51d4fc384639 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:42.864074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f92b7f2a-fe92-409c-979f-51d4fc384639 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:42.864790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f92b7f2a-fe92-409c-979f-51d4fc384639 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:42.866581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f92b7f2a-fe92-409c-979f-51d4fc384639 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:42.867342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f92b7f2a-fe92-409c-979f-51d4fc384639 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:42.868036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f92b7f2a-fe92-409c-979f-51d4fc384639 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:42.872155 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2599/4883] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:42 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1309 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:42.884305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-37816d62-a7a9-4292-a5b5-46c59c5d5e65 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:42.884930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-37816d62-a7a9-4292-a5b5-46c59c5d5e65 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:42.920695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37816d62-a7a9-4292-a5b5-46c59c5d5e65 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:42.921290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37816d62-a7a9-4292-a5b5-46c59c5d5e65 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:42.921846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37816d62-a7a9-4292-a5b5-46c59c5d5e65 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:42.922608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37816d62-a7a9-4292-a5b5-46c59c5d5e65 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:42.923077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37816d62-a7a9-4292-a5b5-46c59c5d5e65 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:42.923513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37816d62-a7a9-4292-a5b5-46c59c5d5e65 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:43.349741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f92b7f2a-fe92-409c-979f-51d4fc384639 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:43.357916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-37816d62-a7a9-4292-a5b5-46c59c5d5e65 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:43.359732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f92b7f2a-fe92-409c-979f-51d4fc384639 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:43.361625 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f92b7f2a-fe92-409c-979f-51d4fc384639 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:43.372672 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f92b7f2a-fe92-409c-979f-51d4fc384639 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1750 microversion: 2.20 time: 0.528341 Aug 18 11:47:43.376654 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-37816d62-a7a9-4292-a5b5-46c59c5d5e65 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1362 microversion: 2.1 time: 0.503133 Aug 18 11:47:43.383348 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2285/4884] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:42 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1750 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:43.387305 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2600/4885] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:42 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1362 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:43.404873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-f0211ec3-12e9-4a73-b35f-1697f31fdf4c req-37d6c3e3-4ad3-4b31-b6c4-14bd68dd3f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf89573-5c6f-49b3-8216-f377532a9832", "name": "network-vif-deleted", "tag": "448d1648-dc8b-4e13-b524-1093cfc83321"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:43.420418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f0211ec3-12e9-4a73-b35f-1697f31fdf4c req-37d6c3e3-4ad3-4b31-b6c4-14bd68dd3f4f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:43.421205 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f0211ec3-12e9-4a73-b35f-1697f31fdf4c req-37d6c3e3-4ad3-4b31-b6c4-14bd68dd3f4f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:43.422336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f0211ec3-12e9-4a73-b35f-1697f31fdf4c req-37d6c3e3-4ad3-4b31-b6c4-14bd68dd3f4f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:43.423482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-519cb862-fb3e-4a06-b917-0763fddff125 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:43.424112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-519cb862-fb3e-4a06-b917-0763fddff125 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:43.443963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-519cb862-fb3e-4a06-b917-0763fddff125 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:43.446578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-519cb862-fb3e-4a06-b917-0763fddff125 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:43.447492 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-f0211ec3-12e9-4a73-b35f-1697f31fdf4c req-37d6c3e3-4ad3-4b31-b6c4-14bd68dd3f4f service nova] Creating event network-vif-deleted:448d1648-dc8b-4e13-b524-1093cfc83321 for instance dcf89573-5c6f-49b3-8216-f377532a9832 on n-h1-853611-3 Aug 18 11:47:43.448409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-519cb862-fb3e-4a06-b917-0763fddff125 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:43.453986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-519cb862-fb3e-4a06-b917-0763fddff125 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:43.454937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-519cb862-fb3e-4a06-b917-0763fddff125 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:43.455688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-519cb862-fb3e-4a06-b917-0763fddff125 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:43.462740 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-f0211ec3-12e9-4a73-b35f-1697f31fdf4c req-37d6c3e3-4ad3-4b31-b6c4-14bd68dd3f4f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077685 Aug 18 11:47:43.463742 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2286/4886] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:43.761599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-519cb862-fb3e-4a06-b917-0763fddff125 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:43.770980 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-519cb862-fb3e-4a06-b917-0763fddff125 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.382302 Aug 18 11:47:43.772173 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2601/4887] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:43 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:43.798638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b20ff2e-3410-4fd0-9079-940cb9a29ac1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:43.799340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5b20ff2e-3410-4fd0-9079-940cb9a29ac1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:43.814569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b20ff2e-3410-4fd0-9079-940cb9a29ac1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:43.815363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b20ff2e-3410-4fd0-9079-940cb9a29ac1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:43.816501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b20ff2e-3410-4fd0-9079-940cb9a29ac1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:43.817236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b20ff2e-3410-4fd0-9079-940cb9a29ac1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:43.817740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b20ff2e-3410-4fd0-9079-940cb9a29ac1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:43.819345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b20ff2e-3410-4fd0-9079-940cb9a29ac1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:43.883185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ccdd6bfd-c696-48b3-ac1f-90d830b8f174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:43.883825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ccdd6bfd-c696-48b3-ac1f-90d830b8f174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:43.896498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccdd6bfd-c696-48b3-ac1f-90d830b8f174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:43.897157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccdd6bfd-c696-48b3-ac1f-90d830b8f174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:43.897606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccdd6bfd-c696-48b3-ac1f-90d830b8f174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:43.898591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccdd6bfd-c696-48b3-ac1f-90d830b8f174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:43.899312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccdd6bfd-c696-48b3-ac1f-90d830b8f174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:43.900027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccdd6bfd-c696-48b3-ac1f-90d830b8f174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:43.905091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:43.917748 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-5b20ff2e-3410-4fd0-9079-940cb9a29ac1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Cannot 'unshelve' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b20ff2e-3410-4fd0-9079-940cb9a29ac1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: request: POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action HTTP/1.1 Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 18 Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: {"unshelve": null} Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: exception: Cannot 'unshelve' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '0eb953a8-e8bd-44d1-9264-75ae577c5940', 'body': {'unshelve': None}} Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 in vm_state active. Cannot unshelve while the instance is in this state. Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 11:47:43.924397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 11:47:43.928380 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:47:43.928380 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:43.928380 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:43.928380 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:43.928380 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:43.928380 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:43.928380 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:43.928380 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:43.928380 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:43.928380 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active Aug 18 11:47:43.928380 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:43.928380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b20ff2e-3410-4fd0-9079-940cb9a29ac1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 409 to user: Cannot 'unshelve' instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 while it is in vm_state active {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:43.928380 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5b20ff2e-3410-4fd0-9079-940cb9a29ac1 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action" status: 409 len: 146 microversion: 2.1 time: 0.133536 Aug 18 11:47:43.928380 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2287/4888] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:47:43 2022] POST /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940/action => generated 146 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 11:47:43.942826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7278f266-d8eb-4631-88d8-c0cee6268d19 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:43.943404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7278f266-d8eb-4631-88d8-c0cee6268d19 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:43.965807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7278f266-d8eb-4631-88d8-c0cee6268d19 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:43.968178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7278f266-d8eb-4631-88d8-c0cee6268d19 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:43.968646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7278f266-d8eb-4631-88d8-c0cee6268d19 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:43.974638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7278f266-d8eb-4631-88d8-c0cee6268d19 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:43.977434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7278f266-d8eb-4631-88d8-c0cee6268d19 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:43.977904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7278f266-d8eb-4631-88d8-c0cee6268d19 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:44.110784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ccdd6bfd-c696-48b3-ac1f-90d830b8f174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:44.122406 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ccdd6bfd-c696-48b3-ac1f-90d830b8f174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1309 microversion: 2.1 time: 0.249370 Aug 18 11:47:44.123043 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2602/4889] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:43 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1309 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:47:44.396499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7278f266-d8eb-4631-88d8-c0cee6268d19 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:44.401046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f5f5e070-4b26-4499-b1b6-d6321d8e478d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:44.401665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f5f5e070-4b26-4499-b1b6-d6321d8e478d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:44.413764 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7278f266-d8eb-4631-88d8-c0cee6268d19 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.478168 Aug 18 11:47:44.414369 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2288/4890] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:43 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:44.416284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5f5e070-4b26-4499-b1b6-d6321d8e478d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:44.420139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5f5e070-4b26-4499-b1b6-d6321d8e478d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:44.420654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5f5e070-4b26-4499-b1b6-d6321d8e478d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:44.421412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5f5e070-4b26-4499-b1b6-d6321d8e478d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:44.424624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5f5e070-4b26-4499-b1b6-d6321d8e478d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:44.426800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5f5e070-4b26-4499-b1b6-d6321d8e478d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:44.435651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dce8611c-2326-424b-8b3f-a81ea86e7ca2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:44.436248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dce8611c-2326-424b-8b3f-a81ea86e7ca2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:44.452426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dce8611c-2326-424b-8b3f-a81ea86e7ca2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:44.453186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dce8611c-2326-424b-8b3f-a81ea86e7ca2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:44.454315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dce8611c-2326-424b-8b3f-a81ea86e7ca2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:44.455252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dce8611c-2326-424b-8b3f-a81ea86e7ca2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:44.455912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dce8611c-2326-424b-8b3f-a81ea86e7ca2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:44.456527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dce8611c-2326-424b-8b3f-a81ea86e7ca2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:44.700837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dce8611c-2326-424b-8b3f-a81ea86e7ca2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:44.711397 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dce8611c-2326-424b-8b3f-a81ea86e7ca2 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1362 microversion: 2.1 time: 0.280167 Aug 18 11:47:44.712006 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2289/4891] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:44 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:44.721652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-806cd1e9-997a-4564-a33f-e17c582b1b8b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:44.722093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-806cd1e9-997a-4564-a33f-e17c582b1b8b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:44.753336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-806cd1e9-997a-4564-a33f-e17c582b1b8b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:44.757273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-806cd1e9-997a-4564-a33f-e17c582b1b8b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:44.757965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-806cd1e9-997a-4564-a33f-e17c582b1b8b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:44.759545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-806cd1e9-997a-4564-a33f-e17c582b1b8b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:44.760060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-806cd1e9-997a-4564-a33f-e17c582b1b8b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:44.760503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-806cd1e9-997a-4564-a33f-e17c582b1b8b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:44.845923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f5f5e070-4b26-4499-b1b6-d6321d8e478d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:44.873237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f5f5e070-4b26-4499-b1b6-d6321d8e478d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:44.875432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f5f5e070-4b26-4499-b1b6-d6321d8e478d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:44.877283 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f5f5e070-4b26-4499-b1b6-d6321d8e478d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1750 microversion: 2.20 time: 0.480670 Aug 18 11:47:44.879196 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2603/4892] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:44 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1750 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:45.092575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-806cd1e9-997a-4564-a33f-e17c582b1b8b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:45.103440 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-806cd1e9-997a-4564-a33f-e17c582b1b8b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.390014 Aug 18 11:47:45.107930 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2290/4893] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:44 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:45.134166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6968846c-f981-40ac-b61c-a0690709478e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1303460370_updated"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:45.138642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6968846c-f981-40ac-b61c-a0690709478e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 23889520-f276-4ba1-82b7-b8bade3c61bf] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:45.149340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f76681ad-2aa3-42df-8aae-63969f378e0b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:45.149787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f76681ad-2aa3-42df-8aae-63969f378e0b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:45.157144 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-6968846c-f981-40ac-b61c-a0690709478e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance 23889520-f276-4ba1-82b7-b8bade3c61bf could not be found. Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6968846c-f981-40ac-b61c-a0690709478e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: request: PUT /compute/v2.1/servers/23889520-f276-4ba1-82b7-b8bade3c61bf HTTP/1.1 Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 81 Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1303460370_updated"}} Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 23889520-f276-4ba1-82b7-b8bade3c61bf could not be found. Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '23889520-f276-4ba1-82b7-b8bade3c61bf', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1303460370_updated'}}} Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23889520-f276-4ba1-82b7-b8bade3c61bf could not be found. Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 18 11:47:45.161127 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:47:45.166495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:47:45.166495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:47:45.166495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:47:45.166495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23889520-f276-4ba1-82b7-b8bade3c61bf could not be found. Aug 18 11:47:45.166495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:45.166495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:45.166495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:45.166495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:45.166495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:45.166495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:45.166495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:45.166495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:45.166495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23889520-f276-4ba1-82b7-b8bade3c61bf could not be found. Aug 18 11:47:45.166495 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:45.171758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6968846c-f981-40ac-b61c-a0690709478e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance 23889520-f276-4ba1-82b7-b8bade3c61bf could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:45.175064 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6968846c-f981-40ac-b61c-a0690709478e tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "PUT /compute/v2.1/servers/23889520-f276-4ba1-82b7-b8bade3c61bf" status: 404 len: 111 microversion: 2.1 time: 0.050191 Aug 18 11:47:45.176457 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2604/4894] 10.222.0.73 () {60 vars in 1256 bytes} [Thu Aug 18 11:47:45 2022] PUT /compute/v2.1/servers/23889520-f276-4ba1-82b7-b8bade3c61bf => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:47:45.179486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f76681ad-2aa3-42df-8aae-63969f378e0b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:45.180631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f76681ad-2aa3-42df-8aae-63969f378e0b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:45.181285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f76681ad-2aa3-42df-8aae-63969f378e0b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:45.182067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f76681ad-2aa3-42df-8aae-63969f378e0b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:45.182702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f76681ad-2aa3-42df-8aae-63969f378e0b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:45.183191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f76681ad-2aa3-42df-8aae-63969f378e0b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:45.189489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d468b514-562a-4a8b-a5b4-82eba6482d6a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:45.190684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d468b514-562a-4a8b-a5b4-82eba6482d6a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:45.217736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d468b514-562a-4a8b-a5b4-82eba6482d6a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:45.228469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d468b514-562a-4a8b-a5b4-82eba6482d6a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:45.230586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d468b514-562a-4a8b-a5b4-82eba6482d6a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:45.235267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d468b514-562a-4a8b-a5b4-82eba6482d6a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:45.238050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d468b514-562a-4a8b-a5b4-82eba6482d6a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:45.241239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d468b514-562a-4a8b-a5b4-82eba6482d6a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:45.609686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f76681ad-2aa3-42df-8aae-63969f378e0b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:45.633589 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f76681ad-2aa3-42df-8aae-63969f378e0b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1309 microversion: 2.1 time: 0.491376 Aug 18 11:47:45.647181 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2291/4895] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:45 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1309 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:45.729173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d468b514-562a-4a8b-a5b4-82eba6482d6a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:45.732740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-17062ab8-899e-46f4-84e6-d321845642f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:45.733376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-17062ab8-899e-46f4-84e6-d321845642f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:45.739451 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d468b514-562a-4a8b-a5b4-82eba6482d6a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.555322 Aug 18 11:47:45.742459 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2605/4896] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:45 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:45.747005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-17062ab8-899e-46f4-84e6-d321845642f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:45.749296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-17062ab8-899e-46f4-84e6-d321845642f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:45.750929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-17062ab8-899e-46f4-84e6-d321845642f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:45.753908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-17062ab8-899e-46f4-84e6-d321845642f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:45.754484 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-17062ab8-899e-46f4-84e6-d321845642f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:45.756547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-17062ab8-899e-46f4-84e6-d321845642f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:45.765945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e491e802-6e25-4f9c-b7d5-9084ce784121 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:45.772442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e491e802-6e25-4f9c-b7d5-9084ce784121 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:45.787199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e491e802-6e25-4f9c-b7d5-9084ce784121 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:45.787780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e491e802-6e25-4f9c-b7d5-9084ce784121 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:45.788388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e491e802-6e25-4f9c-b7d5-9084ce784121 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:45.789210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e491e802-6e25-4f9c-b7d5-9084ce784121 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:45.789748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e491e802-6e25-4f9c-b7d5-9084ce784121 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:45.790279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e491e802-6e25-4f9c-b7d5-9084ce784121 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:46.092254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e491e802-6e25-4f9c-b7d5-9084ce784121 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:46.102362 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e491e802-6e25-4f9c-b7d5-9084ce784121 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.340267 Aug 18 11:47:46.103579 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2606/4897] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:45 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:46.111637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0917a5e0-b635-407d-980d-5acafdb502a4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:46.113622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0917a5e0-b635-407d-980d-5acafdb502a4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:46.129105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0917a5e0-b635-407d-980d-5acafdb502a4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:46.130089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0917a5e0-b635-407d-980d-5acafdb502a4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:46.133029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0917a5e0-b635-407d-980d-5acafdb502a4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:46.135062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0917a5e0-b635-407d-980d-5acafdb502a4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:46.136474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0917a5e0-b635-407d-980d-5acafdb502a4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:46.137735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0917a5e0-b635-407d-980d-5acafdb502a4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:46.170916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-17062ab8-899e-46f4-84e6-d321845642f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:46.189101 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-17062ab8-899e-46f4-84e6-d321845642f3 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1362 microversion: 2.1 time: 0.459661 Aug 18 11:47:46.190718 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2292/4898] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:45 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1362 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:47:46.201644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e284b934-a44d-4ce2-aeee-9514dc37933b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e284b934-a44d-4ce2-aeee-9514dc37933b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: request: PUT /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 HTTP/1.1 Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 280 Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '0eb953a8-e8bd-44d1-9264-75ae577c5940', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:46.233804 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 18 11:47:46.240322 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:46.246021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e284b934-a44d-4ce2-aeee-9514dc37933b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:46.248633 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e284b934-a44d-4ce2-aeee-9514dc37933b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "PUT /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 400 len: 619 microversion: 2.1 time: 0.056818 Aug 18 11:47:46.250845 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2293/4899] 10.222.0.73 () {60 vars in 1257 bytes} [Thu Aug 18 11:47:46 2022] PUT /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 619 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:47:46.264217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9234f5c1-bb63-4b0c-81b4-2933fc5a6524 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:46.265232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9234f5c1-bb63-4b0c-81b4-2933fc5a6524 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:46.282828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9234f5c1-bb63-4b0c-81b4-2933fc5a6524 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:46.285772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9234f5c1-bb63-4b0c-81b4-2933fc5a6524 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:46.286459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9234f5c1-bb63-4b0c-81b4-2933fc5a6524 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:46.289182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9234f5c1-bb63-4b0c-81b4-2933fc5a6524 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:46.291043 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9234f5c1-bb63-4b0c-81b4-2933fc5a6524 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:46.291757 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9234f5c1-bb63-4b0c-81b4-2933fc5a6524 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:46.545349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0917a5e0-b635-407d-980d-5acafdb502a4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:46.559795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0917a5e0-b635-407d-980d-5acafdb502a4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:46.562305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0917a5e0-b635-407d-980d-5acafdb502a4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:46.564266 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0917a5e0-b635-407d-980d-5acafdb502a4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1752 microversion: 2.20 time: 0.459358 Aug 18 11:47:46.579756 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2607/4900] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:46 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1752 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:46.660497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2654ed9c-4f00-40cb-852d-2dcc40ad261a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:46.661247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2654ed9c-4f00-40cb-852d-2dcc40ad261a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:46.674977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2654ed9c-4f00-40cb-852d-2dcc40ad261a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:46.684736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2654ed9c-4f00-40cb-852d-2dcc40ad261a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:46.685350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2654ed9c-4f00-40cb-852d-2dcc40ad261a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:46.686178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2654ed9c-4f00-40cb-852d-2dcc40ad261a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:46.688823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2654ed9c-4f00-40cb-852d-2dcc40ad261a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:46.689523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2654ed9c-4f00-40cb-852d-2dcc40ad261a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:47.000876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2654ed9c-4f00-40cb-852d-2dcc40ad261a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:47.013257 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2654ed9c-4f00-40cb-852d-2dcc40ad261a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1309 microversion: 2.1 time: 0.357766 Aug 18 11:47:47.018024 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2608/4901] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:46 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1309 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:47.030256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9234f5c1-bb63-4b0c-81b4-2933fc5a6524 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:47.041129 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9234f5c1-bb63-4b0c-81b4-2933fc5a6524 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.784894 Aug 18 11:47:47.045668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-cf45dc0a-60cb-4cf0-a003-0560babae84b req-f55d3d1b-3691-47e8-bb55-0845be0920ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9f9674-f5b0-42e7-b843-15f50cfc751a", "name": "network-vif-plugged", "status": "completed", "tag": "7f362877-7820-47c2-bb2c-97b187c82a2b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:47.049864 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2294/4902] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:46 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:47.066653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cf45dc0a-60cb-4cf0-a003-0560babae84b req-f55d3d1b-3691-47e8-bb55-0845be0920ca service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:47.069721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cf45dc0a-60cb-4cf0-a003-0560babae84b req-f55d3d1b-3691-47e8-bb55-0845be0920ca service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:47.072307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cf45dc0a-60cb-4cf0-a003-0560babae84b req-f55d3d1b-3691-47e8-bb55-0845be0920ca service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:47.079887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-311f14d6-3f68-4770-be4d-e792543d214b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:47.081163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-311f14d6-3f68-4770-be4d-e792543d214b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:47.093913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-311f14d6-3f68-4770-be4d-e792543d214b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:47.094550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-311f14d6-3f68-4770-be4d-e792543d214b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:47.095093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-311f14d6-3f68-4770-be4d-e792543d214b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:47.095895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-311f14d6-3f68-4770-be4d-e792543d214b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:47.097069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-311f14d6-3f68-4770-be4d-e792543d214b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:47.099648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-311f14d6-3f68-4770-be4d-e792543d214b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:47.116246 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-cf45dc0a-60cb-4cf0-a003-0560babae84b req-f55d3d1b-3691-47e8-bb55-0845be0920ca service nova] Creating event network-vif-plugged:7f362877-7820-47c2-bb2c-97b187c82a2b for instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a on n-h2-853611-3 Aug 18 11:47:47.129078 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-cf45dc0a-60cb-4cf0-a003-0560babae84b req-f55d3d1b-3691-47e8-bb55-0845be0920ca service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108969 Aug 18 11:47:47.133589 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2609/4903] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:47.223278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ed3c68c-0249-4e02-b049-37a24b7f9fa6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:47.224535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9ed3c68c-0249-4e02-b049-37a24b7f9fa6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:47.261668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ed3c68c-0249-4e02-b049-37a24b7f9fa6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:47.262258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ed3c68c-0249-4e02-b049-37a24b7f9fa6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:47.262849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ed3c68c-0249-4e02-b049-37a24b7f9fa6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:47.267164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ed3c68c-0249-4e02-b049-37a24b7f9fa6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:47.267650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ed3c68c-0249-4e02-b049-37a24b7f9fa6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:47.272582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ed3c68c-0249-4e02-b049-37a24b7f9fa6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:47.610291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-311f14d6-3f68-4770-be4d-e792543d214b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:47.620023 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-311f14d6-3f68-4770-be4d-e792543d214b tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.545347 Aug 18 11:47:47.625242 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2295/4904] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:47 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:47.653418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fce339fb-e949-4039-ac2f-a6b7dfb0905a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:47.655276 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fce339fb-e949-4039-ac2f-a6b7dfb0905a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:47.673111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fce339fb-e949-4039-ac2f-a6b7dfb0905a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:47.673705 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fce339fb-e949-4039-ac2f-a6b7dfb0905a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:47.674047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fce339fb-e949-4039-ac2f-a6b7dfb0905a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:47.675426 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fce339fb-e949-4039-ac2f-a6b7dfb0905a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:47.675889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fce339fb-e949-4039-ac2f-a6b7dfb0905a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:47.676400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fce339fb-e949-4039-ac2f-a6b7dfb0905a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:47.677086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9ed3c68c-0249-4e02-b049-37a24b7f9fa6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:47.686220 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9ed3c68c-0249-4e02-b049-37a24b7f9fa6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1362 microversion: 2.1 time: 0.472210 Aug 18 11:47:47.692501 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2610/4905] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:47 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1362 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:47.703962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8fe8ae79-740a-48bc-a6eb-31793abb5bb9 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8fe8ae79-740a-48bc-a6eb-31793abb5bb9 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: request: PUT /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 HTTP/1.1 Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 24 Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": ""}} Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '0eb953a8-e8bd-44d1-9264-75ae577c5940', 'body': {'server': {'name': ''}}} Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi '' Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 11:47:47.710457 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 18 11:47:47.715516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:47.715516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:47.715516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:47.715516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:47.715516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:47.715516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:47.715516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 11:47:47.715516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 11:47:47.715516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 18 11:47:47.715516 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:47.727377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8fe8ae79-740a-48bc-a6eb-31793abb5bb9 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:47.728581 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8fe8ae79-740a-48bc-a6eb-31793abb5bb9 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "PUT /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 400 len: 108 microversion: 2.1 time: 0.034901 Aug 18 11:47:47.731779 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2611/4906] 10.222.0.73 () {60 vars in 1256 bytes} [Thu Aug 18 11:47:47 2022] PUT /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:47:47.742299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a5c87950-2cd8-451d-947d-b90f2c55d2df tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:47.743589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a5c87950-2cd8-451d-947d-b90f2c55d2df tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:47.763719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5c87950-2cd8-451d-947d-b90f2c55d2df tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:47.765373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5c87950-2cd8-451d-947d-b90f2c55d2df tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:47.766012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5c87950-2cd8-451d-947d-b90f2c55d2df tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:47.767010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5c87950-2cd8-451d-947d-b90f2c55d2df tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:47.767925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5c87950-2cd8-451d-947d-b90f2c55d2df tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:47.770781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5c87950-2cd8-451d-947d-b90f2c55d2df tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:48.009080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a5c87950-2cd8-451d-947d-b90f2c55d2df tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:48.023448 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a5c87950-2cd8-451d-947d-b90f2c55d2df tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1505 microversion: 2.1 time: 0.288862 Aug 18 11:47:48.028972 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2612/4907] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:47 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:48.041836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1fbfbd58-d506-4594-8f98-4d3af4df39c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:48.042814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1fbfbd58-d506-4594-8f98-4d3af4df39c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:48.055603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fbfbd58-d506-4594-8f98-4d3af4df39c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:48.056370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fbfbd58-d506-4594-8f98-4d3af4df39c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:48.057112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fbfbd58-d506-4594-8f98-4d3af4df39c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:48.058106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fbfbd58-d506-4594-8f98-4d3af4df39c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:48.059284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fbfbd58-d506-4594-8f98-4d3af4df39c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:48.059930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fbfbd58-d506-4594-8f98-4d3af4df39c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:48.270389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fce339fb-e949-4039-ac2f-a6b7dfb0905a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:48.297713 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fce339fb-e949-4039-ac2f-a6b7dfb0905a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:48.318565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-fce339fb-e949-4039-ac2f-a6b7dfb0905a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:48.320527 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fce339fb-e949-4039-ac2f-a6b7dfb0905a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1752 microversion: 2.20 time: 0.679985 Aug 18 11:47:48.321597 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2296/4908] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:47 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1752 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:48.516209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1fbfbd58-d506-4594-8f98-4d3af4df39c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:48.531147 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1fbfbd58-d506-4594-8f98-4d3af4df39c6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1309 microversion: 2.1 time: 0.490760 Aug 18 11:47:48.532268 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2613/4909] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:48 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1309 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:48.723105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e1fea6b1-827a-45d8-8153-8e7226609801 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:48.724305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e1fea6b1-827a-45d8-8153-8e7226609801 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:48.733435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1fea6b1-827a-45d8-8153-8e7226609801 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:48.735907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1fea6b1-827a-45d8-8153-8e7226609801 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:48.736836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1fea6b1-827a-45d8-8153-8e7226609801 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:48.740616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1fea6b1-827a-45d8-8153-8e7226609801 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:48.741431 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1fea6b1-827a-45d8-8153-8e7226609801 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:48.742967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1fea6b1-827a-45d8-8153-8e7226609801 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:49.225297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-27287a41-9fe4-46cd-bb3a-17d81d459a73 req-4bf76935-563d-4d99-93c4-bbfe835bfc23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89651755-2a7f-4ccd-870e-3b2c6b29c497", "name": "network-vif-plugged", "status": "completed", "tag": "437fe7bd-ec5e-4005-8194-f8e7f2b93b32"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:49.261822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-27287a41-9fe4-46cd-bb3a-17d81d459a73 req-4bf76935-563d-4d99-93c4-bbfe835bfc23 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:49.270320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-27287a41-9fe4-46cd-bb3a-17d81d459a73 req-4bf76935-563d-4d99-93c4-bbfe835bfc23 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:49.272714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-27287a41-9fe4-46cd-bb3a-17d81d459a73 req-4bf76935-563d-4d99-93c4-bbfe835bfc23 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:49.302188 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-27287a41-9fe4-46cd-bb3a-17d81d459a73 req-4bf76935-563d-4d99-93c4-bbfe835bfc23 service nova] Creating event network-vif-plugged:437fe7bd-ec5e-4005-8194-f8e7f2b93b32 for instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 on n-h2-853611-3 Aug 18 11:47:49.315895 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-27287a41-9fe4-46cd-bb3a-17d81d459a73 req-4bf76935-563d-4d99-93c4-bbfe835bfc23 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094837 Aug 18 11:47:49.320702 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2614/4910] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:49.350224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fa0230a2-9dd9-4e84-88fd-a9fc60f1bf6e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:49.351593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fa0230a2-9dd9-4e84-88fd-a9fc60f1bf6e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:49.365560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa0230a2-9dd9-4e84-88fd-a9fc60f1bf6e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:49.366474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa0230a2-9dd9-4e84-88fd-a9fc60f1bf6e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:49.369271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa0230a2-9dd9-4e84-88fd-a9fc60f1bf6e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:49.374207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa0230a2-9dd9-4e84-88fd-a9fc60f1bf6e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:49.375837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa0230a2-9dd9-4e84-88fd-a9fc60f1bf6e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:49.376650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa0230a2-9dd9-4e84-88fd-a9fc60f1bf6e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:49.667896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fa0230a2-9dd9-4e84-88fd-a9fc60f1bf6e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:49.685423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fa0230a2-9dd9-4e84-88fd-a9fc60f1bf6e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:49.688426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fa0230a2-9dd9-4e84-88fd-a9fc60f1bf6e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:49.695912 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fa0230a2-9dd9-4e84-88fd-a9fc60f1bf6e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1752 microversion: 2.20 time: 0.350764 Aug 18 11:47:49.696785 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2615/4911] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:49 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1752 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:47:49.708695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-88865018-f0da-4343-98ff-242d520f83a6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:49.709552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88865018-f0da-4343-98ff-242d520f83a6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:49.726889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:49.729080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88865018-f0da-4343-98ff-242d520f83a6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:49.734195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88865018-f0da-4343-98ff-242d520f83a6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:49.734881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88865018-f0da-4343-98ff-242d520f83a6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:49.735859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88865018-f0da-4343-98ff-242d520f83a6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:49.736498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88865018-f0da-4343-98ff-242d520f83a6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:49.737386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88865018-f0da-4343-98ff-242d520f83a6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:50.073929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-88865018-f0da-4343-98ff-242d520f83a6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:50.084990 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-88865018-f0da-4343-98ff-242d520f83a6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1489 microversion: 2.1 time: 0.385310 Aug 18 11:47:50.086820 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2616/4912] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:49 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1489 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:50.110563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4cc8219c-505e-45b4-ab9a-0c15a50ccb4a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:50.111949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4cc8219c-505e-45b4-ab9a-0c15a50ccb4a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:50.122192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc8219c-505e-45b4-ab9a-0c15a50ccb4a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:50.124106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc8219c-505e-45b4-ab9a-0c15a50ccb4a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:50.133033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc8219c-505e-45b4-ab9a-0c15a50ccb4a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:50.138106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc8219c-505e-45b4-ab9a-0c15a50ccb4a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:50.138653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc8219c-505e-45b4-ab9a-0c15a50ccb4a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:50.139299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc8219c-505e-45b4-ab9a-0c15a50ccb4a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:50.532902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e1fea6b1-827a-45d8-8153-8e7226609801 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:50.555221 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e1fea6b1-827a-45d8-8153-8e7226609801 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1362 microversion: 2.1 time: 1.835017 Aug 18 11:47:50.556613 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2297/4913] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:48 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1362 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:50.731408 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a731071-7f54-4497-8408-52b62640cb36 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:50.734364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0a731071-7f54-4497-8408-52b62640cb36 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:50.748620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a731071-7f54-4497-8408-52b62640cb36 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:50.749132 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a731071-7f54-4497-8408-52b62640cb36 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:50.749585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a731071-7f54-4497-8408-52b62640cb36 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:50.751139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a731071-7f54-4497-8408-52b62640cb36 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:50.751659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a731071-7f54-4497-8408-52b62640cb36 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:50.752112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0a731071-7f54-4497-8408-52b62640cb36 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:50.814751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4cc8219c-505e-45b4-ab9a-0c15a50ccb4a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:50.825375 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4cc8219c-505e-45b4-ab9a-0c15a50ccb4a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1489 microversion: 2.1 time: 0.718506 Aug 18 11:47:50.829509 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2617/4914] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:50 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1489 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:47:50.868937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ad419f5-2cfb-48e8-93ca-5513fb9def1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:50.869910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6ad419f5-2cfb-48e8-93ca-5513fb9def1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:50.880552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ad419f5-2cfb-48e8-93ca-5513fb9def1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:50.881777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ad419f5-2cfb-48e8-93ca-5513fb9def1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:50.883279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ad419f5-2cfb-48e8-93ca-5513fb9def1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:50.884268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ad419f5-2cfb-48e8-93ca-5513fb9def1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:50.885027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ad419f5-2cfb-48e8-93ca-5513fb9def1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:50.885758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ad419f5-2cfb-48e8-93ca-5513fb9def1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:51.563696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6ad419f5-2cfb-48e8-93ca-5513fb9def1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:51.584508 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6ad419f5-2cfb-48e8-93ca-5513fb9def1e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1489 microversion: 2.1 time: 0.717956 Aug 18 11:47:51.588304 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2618/4915] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:50 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1489 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:51.604852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-780e2d9e-a016-451e-9b35-14d50c107a5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:51.605959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-780e2d9e-a016-451e-9b35-14d50c107a5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:51.613745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-780e2d9e-a016-451e-9b35-14d50c107a5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:51.616494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-780e2d9e-a016-451e-9b35-14d50c107a5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:51.617872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-780e2d9e-a016-451e-9b35-14d50c107a5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:51.620341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-780e2d9e-a016-451e-9b35-14d50c107a5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:51.621106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-780e2d9e-a016-451e-9b35-14d50c107a5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:51.623685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-780e2d9e-a016-451e-9b35-14d50c107a5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:51.631932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0a731071-7f54-4497-8408-52b62640cb36 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:51.647325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0a731071-7f54-4497-8408-52b62640cb36 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:51.653281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0a731071-7f54-4497-8408-52b62640cb36 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:51.655101 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0a731071-7f54-4497-8408-52b62640cb36 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1752 microversion: 2.20 time: 0.934766 Aug 18 11:47:51.665678 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2298/4916] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:50 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1752 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:47:51.674404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-498a196d-c92b-43f0-8960-17764fee256f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:51.675269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-498a196d-c92b-43f0-8960-17764fee256f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:51.703756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-498a196d-c92b-43f0-8960-17764fee256f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:51.705377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-498a196d-c92b-43f0-8960-17764fee256f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:51.706194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-498a196d-c92b-43f0-8960-17764fee256f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:51.719364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-498a196d-c92b-43f0-8960-17764fee256f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:51.719908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-498a196d-c92b-43f0-8960-17764fee256f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:51.720498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-498a196d-c92b-43f0-8960-17764fee256f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:51.780259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-498a196d-c92b-43f0-8960-17764fee256f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:47:51.887594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=100 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:51.988591 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-498a196d-c92b-43f0-8960-17764fee256f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 204 len: 0 microversion: 2.1 time: 0.320354 Aug 18 11:47:51.989984 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2299/4917] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:47:51 2022] DELETE /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:47:52.005781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-010b5fa6-df0b-4084-bc76-9a8879764d40 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:52.008528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-010b5fa6-df0b-4084-bc76-9a8879764d40 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:52.028829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-010b5fa6-df0b-4084-bc76-9a8879764d40 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:52.029828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-010b5fa6-df0b-4084-bc76-9a8879764d40 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:52.030567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-010b5fa6-df0b-4084-bc76-9a8879764d40 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:52.031547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-010b5fa6-df0b-4084-bc76-9a8879764d40 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:52.032263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-010b5fa6-df0b-4084-bc76-9a8879764d40 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:52.033156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-010b5fa6-df0b-4084-bc76-9a8879764d40 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:52.328680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-780e2d9e-a016-451e-9b35-14d50c107a5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:52.387213 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-780e2d9e-a016-451e-9b35-14d50c107a5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1547 microversion: 2.1 time: 0.790293 Aug 18 11:47:52.388015 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2619/4918] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:51 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1547 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:52.432228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6b4d3360-aae7-4605-9b31-b0a6b58c010e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:52.433020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6b4d3360-aae7-4605-9b31-b0a6b58c010e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:52.475488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b4d3360-aae7-4605-9b31-b0a6b58c010e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:52.476399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b4d3360-aae7-4605-9b31-b0a6b58c010e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:52.476873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b4d3360-aae7-4605-9b31-b0a6b58c010e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:52.477646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b4d3360-aae7-4605-9b31-b0a6b58c010e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:52.478361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b4d3360-aae7-4605-9b31-b0a6b58c010e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:52.478841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b4d3360-aae7-4605-9b31-b0a6b58c010e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:52.734507 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6b4d3360-aae7-4605-9b31-b0a6b58c010e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.325917 Aug 18 11:47:52.735088 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2620/4919] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:47:52 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-interface => generated 284 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:52.759224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b42d843b-9db6-47ac-9cb1-3e242cebb39b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:52.763158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b42d843b-9db6-47ac-9cb1-3e242cebb39b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:52.764720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-010b5fa6-df0b-4084-bc76-9a8879764d40 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:52.779426 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-010b5fa6-df0b-4084-bc76-9a8879764d40 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1495 microversion: 2.1 time: 0.783417 Aug 18 11:47:52.790096 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2300/4920] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:51 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1495 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:52.805983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b42d843b-9db6-47ac-9cb1-3e242cebb39b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:52.808914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b42d843b-9db6-47ac-9cb1-3e242cebb39b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:52.812756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b42d843b-9db6-47ac-9cb1-3e242cebb39b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:52.819322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b42d843b-9db6-47ac-9cb1-3e242cebb39b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:52.821368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b42d843b-9db6-47ac-9cb1-3e242cebb39b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:52.825364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b42d843b-9db6-47ac-9cb1-3e242cebb39b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:53.239603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b42d843b-9db6-47ac-9cb1-3e242cebb39b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:53.253863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b42d843b-9db6-47ac-9cb1-3e242cebb39b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:53.255968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b42d843b-9db6-47ac-9cb1-3e242cebb39b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:53.258318 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b42d843b-9db6-47ac-9cb1-3e242cebb39b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1752 microversion: 2.20 time: 0.513717 Aug 18 11:47:53.271704 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2621/4921] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:52 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1752 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:53.814835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4f0f39e9-ab0d-4650-828e-e59ab39a667c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:53.815459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4f0f39e9-ab0d-4650-828e-e59ab39a667c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:53.833239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f0f39e9-ab0d-4650-828e-e59ab39a667c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:53.833742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f0f39e9-ab0d-4650-828e-e59ab39a667c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:53.834188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f0f39e9-ab0d-4650-828e-e59ab39a667c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:53.834943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f0f39e9-ab0d-4650-828e-e59ab39a667c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:53.835961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f0f39e9-ab0d-4650-828e-e59ab39a667c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:53.836395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f0f39e9-ab0d-4650-828e-e59ab39a667c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:54.288493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f647a247-d974-4362-a06b-c45a0c9ec81d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:54.290761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f647a247-d974-4362-a06b-c45a0c9ec81d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:54.301166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f647a247-d974-4362-a06b-c45a0c9ec81d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:54.301715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f647a247-d974-4362-a06b-c45a0c9ec81d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:54.302642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f647a247-d974-4362-a06b-c45a0c9ec81d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:54.306316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f647a247-d974-4362-a06b-c45a0c9ec81d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:54.307752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f647a247-d974-4362-a06b-c45a0c9ec81d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:54.308406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f647a247-d974-4362-a06b-c45a0c9ec81d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:54.358851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:54.769952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f647a247-d974-4362-a06b-c45a0c9ec81d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:54.808866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f647a247-d974-4362-a06b-c45a0c9ec81d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:54.817213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f647a247-d974-4362-a06b-c45a0c9ec81d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:54.841215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4f0f39e9-ab0d-4650-828e-e59ab39a667c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:54.844750 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f647a247-d974-4362-a06b-c45a0c9ec81d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1752 microversion: 2.20 time: 0.542732 Aug 18 11:47:54.845928 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2622/4922] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:54 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1752 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:54.856321 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4f0f39e9-ab0d-4650-828e-e59ab39a667c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1495 microversion: 2.1 time: 1.045236 Aug 18 11:47:54.876295 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2301/4923] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:53 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1495 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:55.887179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f6ce49d-fbe4-4b5e-beb3-cc501b77d7c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:55.888510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6f6ce49d-fbe4-4b5e-beb3-cc501b77d7c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:55.888860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-770de9f9-9852-4710-8328-36d7fe94ae64 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:55.889478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-770de9f9-9852-4710-8328-36d7fe94ae64 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:55.908705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f6ce49d-fbe4-4b5e-beb3-cc501b77d7c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:55.909592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f6ce49d-fbe4-4b5e-beb3-cc501b77d7c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:55.911099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f6ce49d-fbe4-4b5e-beb3-cc501b77d7c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:55.911335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-770de9f9-9852-4710-8328-36d7fe94ae64 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:55.913260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f6ce49d-fbe4-4b5e-beb3-cc501b77d7c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:55.914114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-770de9f9-9852-4710-8328-36d7fe94ae64 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:55.918096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-770de9f9-9852-4710-8328-36d7fe94ae64 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:55.922166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-770de9f9-9852-4710-8328-36d7fe94ae64 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:55.924003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f6ce49d-fbe4-4b5e-beb3-cc501b77d7c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:55.926134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f6ce49d-fbe4-4b5e-beb3-cc501b77d7c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:55.927294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-770de9f9-9852-4710-8328-36d7fe94ae64 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:55.929722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-770de9f9-9852-4710-8328-36d7fe94ae64 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:56.314758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-770de9f9-9852-4710-8328-36d7fe94ae64 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:56.341644 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-770de9f9-9852-4710-8328-36d7fe94ae64 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 200 len: 1453 microversion: 2.1 time: 0.456509 Aug 18 11:47:56.362813 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2302/4924] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:55 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 1453 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:56.374253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-86d70e80-1620-4ffe-a8d0-59268ae642f3 req-ab1904d8-4749-4cf6-8530-13d1459ca57b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9f9674-f5b0-42e7-b843-15f50cfc751a", "name": "network-vif-deleted", "tag": "7f362877-7820-47c2-bb2c-97b187c82a2b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:56.433566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-86d70e80-1620-4ffe-a8d0-59268ae642f3 req-ab1904d8-4749-4cf6-8530-13d1459ca57b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:56.436475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-86d70e80-1620-4ffe-a8d0-59268ae642f3 req-ab1904d8-4749-4cf6-8530-13d1459ca57b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:56.438538 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-86d70e80-1620-4ffe-a8d0-59268ae642f3 req-ab1904d8-4749-4cf6-8530-13d1459ca57b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:56.502526 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-86d70e80-1620-4ffe-a8d0-59268ae642f3 req-ab1904d8-4749-4cf6-8530-13d1459ca57b service nova] Creating event network-vif-deleted:7f362877-7820-47c2-bb2c-97b187c82a2b for instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a on n-h2-853611-3 Aug 18 11:47:56.519139 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-86d70e80-1620-4ffe-a8d0-59268ae642f3 req-ab1904d8-4749-4cf6-8530-13d1459ca57b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162612 Aug 18 11:47:56.527459 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2303/4925] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:56.692047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6f6ce49d-fbe4-4b5e-beb3-cc501b77d7c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:56.711982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6f6ce49d-fbe4-4b5e-beb3-cc501b77d7c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:56.719134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6f6ce49d-fbe4-4b5e-beb3-cc501b77d7c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:56.720678 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6f6ce49d-fbe4-4b5e-beb3-cc501b77d7c2 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1752 microversion: 2.20 time: 0.838719 Aug 18 11:47:56.729311 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2623/4926] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:55 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1752 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:57.389367 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c1d518dc-8847-4222-8bdb-82381dc7a98a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:57.390326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c1d518dc-8847-4222-8bdb-82381dc7a98a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:57.392657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:47:57.423247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1d518dc-8847-4222-8bdb-82381dc7a98a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:57.423799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1d518dc-8847-4222-8bdb-82381dc7a98a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:57.430101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1d518dc-8847-4222-8bdb-82381dc7a98a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:57.432146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1d518dc-8847-4222-8bdb-82381dc7a98a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:57.432657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1d518dc-8847-4222-8bdb-82381dc7a98a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:57.433290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c1d518dc-8847-4222-8bdb-82381dc7a98a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:57.493399 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-c1d518dc-8847-4222-8bdb-82381dc7a98a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c1d518dc-8847-4222-8bdb-82381dc7a98a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a HTTP/1.1 Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '0b9f9674-f5b0-42e7-b843-15f50cfc751a'} Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:57.503407 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:57.508163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:57.508163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:57.508163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:57.508163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:57.508163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:47:57.508163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:57.509397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c1d518dc-8847-4222-8bdb-82381dc7a98a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:57.511680 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c1d518dc-8847-4222-8bdb-82381dc7a98a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 404 len: 111 microversion: 2.1 time: 0.129440 Aug 18 11:47:57.517024 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2304/4927] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:57 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:47:57.527543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8dcfe532-3f3a-4116-af25-cfe0eae89488 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:57.528118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8dcfe532-3f3a-4116-af25-cfe0eae89488 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:57.544251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcfe532-3f3a-4116-af25-cfe0eae89488 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:57.545247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcfe532-3f3a-4116-af25-cfe0eae89488 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:57.546752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcfe532-3f3a-4116-af25-cfe0eae89488 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:57.550509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcfe532-3f3a-4116-af25-cfe0eae89488 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:57.551525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcfe532-3f3a-4116-af25-cfe0eae89488 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:57.553807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcfe532-3f3a-4116-af25-cfe0eae89488 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:57.678511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8dcfe532-3f3a-4116-af25-cfe0eae89488 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:47:57.693561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5fe95986-73cc-42e0-97a9-231e8c697f48 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:57.694060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5fe95986-73cc-42e0-97a9-231e8c697f48 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:57.705629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fe95986-73cc-42e0-97a9-231e8c697f48 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:57.706128 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fe95986-73cc-42e0-97a9-231e8c697f48 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:57.712878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fe95986-73cc-42e0-97a9-231e8c697f48 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:57.713787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fe95986-73cc-42e0-97a9-231e8c697f48 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:57.714292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fe95986-73cc-42e0-97a9-231e8c697f48 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:57.718582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fe95986-73cc-42e0-97a9-231e8c697f48 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:57.761142 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-5fe95986-73cc-42e0-97a9-231e8c697f48 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5fe95986-73cc-42e0-97a9-231e8c697f48 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 HTTP/1.1 Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '0134fd66-53da-4cae-bfae-c3d813a96712'} Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:47:57.763664 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:47:57.767333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:47:57.767333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:57.767333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:57.767333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:57.767333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:57.767333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:57.767333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:57.767333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:57.767333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:57.767333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:47:57.767333 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:47:57.768792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5fe95986-73cc-42e0-97a9-231e8c697f48 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:57.769823 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5fe95986-73cc-42e0-97a9-231e8c697f48 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 404 len: 111 microversion: 2.1 time: 0.080223 Aug 18 11:47:57.771124 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2305/4928] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:47:57 2022] DELETE /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:47:57.779687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-76f3f107-f77a-43dc-861b-c7f031d76f2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:57.780584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-76f3f107-f77a-43dc-861b-c7f031d76f2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:57.787778 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76f3f107-f77a-43dc-861b-c7f031d76f2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:57.788897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76f3f107-f77a-43dc-861b-c7f031d76f2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:57.790418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76f3f107-f77a-43dc-861b-c7f031d76f2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:57.792467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76f3f107-f77a-43dc-861b-c7f031d76f2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:57.794125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76f3f107-f77a-43dc-861b-c7f031d76f2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:57.794986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-76f3f107-f77a-43dc-861b-c7f031d76f2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:58.029093 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8dcfe532-3f3a-4116-af25-cfe0eae89488 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 204 len: 0 microversion: 2.1 time: 0.491953 Aug 18 11:47:58.038801 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2624/4929] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:47:57 2022] DELETE /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:47:58.045387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-76f3f107-f77a-43dc-861b-c7f031d76f2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:58.057518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-76f3f107-f77a-43dc-861b-c7f031d76f2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:58.060031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-76f3f107-f77a-43dc-861b-c7f031d76f2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:58.062206 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-76f3f107-f77a-43dc-861b-c7f031d76f2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.289026 Aug 18 11:47:58.063059 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2306/4930] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:57 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:58.074764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b070810-7071-496b-8826-4d5017e0def4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:58.074764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2b070810-7071-496b-8826-4d5017e0def4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0134fd66-53da-4cae-bfae-c3d813a96712] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:58.083057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b070810-7071-496b-8826-4d5017e0def4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:58.086908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eb36c098-9505-4ca3-a00b-82f4963eff76 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:58.087912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-eb36c098-9505-4ca3-a00b-82f4963eff76 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:58.090802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b070810-7071-496b-8826-4d5017e0def4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:58.091506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b070810-7071-496b-8826-4d5017e0def4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:58.092519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b070810-7071-496b-8826-4d5017e0def4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:58.093012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b070810-7071-496b-8826-4d5017e0def4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:58.094904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b070810-7071-496b-8826-4d5017e0def4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:58.103468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb36c098-9505-4ca3-a00b-82f4963eff76 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:58.105489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb36c098-9505-4ca3-a00b-82f4963eff76 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:58.107684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb36c098-9505-4ca3-a00b-82f4963eff76 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:58.109286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb36c098-9505-4ca3-a00b-82f4963eff76 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:58.111154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb36c098-9505-4ca3-a00b-82f4963eff76 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:58.112736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb36c098-9505-4ca3-a00b-82f4963eff76 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:58.133489 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-2b070810-7071-496b-8826-4d5017e0def4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b070810-7071-496b-8826-4d5017e0def4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 HTTP/1.1 Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '0134fd66-53da-4cae-bfae-c3d813a96712'} Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:47:58.140817 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:58.144775 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:47:58.144775 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:47:58.144775 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:47:58.144775 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:47:58.144775 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:47:58.144775 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. Aug 18 11:47:58.144775 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:47:58.148871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b070810-7071-496b-8826-4d5017e0def4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance 0134fd66-53da-4cae-bfae-c3d813a96712 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:47:58.150013 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2b070810-7071-496b-8826-4d5017e0def4 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712" status: 404 len: 111 microversion: 2.1 time: 0.108542 Aug 18 11:47:58.151938 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2625/4931] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:58 2022] GET /compute/v2.1/servers/0134fd66-53da-4cae-bfae-c3d813a96712 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:47:58.166015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e0638b37-d677-4094-a28f-eda994cba17c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:58.167995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e0638b37-d677-4094-a28f-eda994cba17c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:58.180590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0638b37-d677-4094-a28f-eda994cba17c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:58.188091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0638b37-d677-4094-a28f-eda994cba17c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:58.190017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0638b37-d677-4094-a28f-eda994cba17c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:58.195932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0638b37-d677-4094-a28f-eda994cba17c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:58.197114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0638b37-d677-4094-a28f-eda994cba17c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:58.200098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0638b37-d677-4094-a28f-eda994cba17c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:58.262584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e0638b37-d677-4094-a28f-eda994cba17c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:47:58.443990 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e0638b37-d677-4094-a28f-eda994cba17c tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 204 len: 0 microversion: 2.1 time: 0.285130 Aug 18 11:47:58.445353 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2626/4932] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:47:58 2022] DELETE /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:47:58.464498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-943656af-0239-4529-b8ae-bae1cfc56dd7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:58.465636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-943656af-0239-4529-b8ae-bae1cfc56dd7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:58.479912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-943656af-0239-4529-b8ae-bae1cfc56dd7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:58.483895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-943656af-0239-4529-b8ae-bae1cfc56dd7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:58.484698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-943656af-0239-4529-b8ae-bae1cfc56dd7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:58.491521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-943656af-0239-4529-b8ae-bae1cfc56dd7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:58.492512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-943656af-0239-4529-b8ae-bae1cfc56dd7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:58.493199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-943656af-0239-4529-b8ae-bae1cfc56dd7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:58.535145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eb36c098-9505-4ca3-a00b-82f4963eff76 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:58.551516 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eb36c098-9505-4ca3-a00b-82f4963eff76 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1495 microversion: 2.1 time: 0.473431 Aug 18 11:47:58.552513 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2307/4933] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:58 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1495 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:58.571901 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-a175b59d-401f-4101-98d5-e5e30ddd34c8 req-97d4ad20-ae45-464b-bdb4-c9a499755dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89651755-2a7f-4ccd-870e-3b2c6b29c497", "tag": "437fe7bd-ec5e-4005-8194-f8e7f2b93b32"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:47:58.592784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a175b59d-401f-4101-98d5-e5e30ddd34c8 req-97d4ad20-ae45-464b-bdb4-c9a499755dff service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:58.593182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a175b59d-401f-4101-98d5-e5e30ddd34c8 req-97d4ad20-ae45-464b-bdb4-c9a499755dff service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:58.593624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a175b59d-401f-4101-98d5-e5e30ddd34c8 req-97d4ad20-ae45-464b-bdb4-c9a499755dff service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:58.639156 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-a175b59d-401f-4101-98d5-e5e30ddd34c8 req-97d4ad20-ae45-464b-bdb4-c9a499755dff service nova] Creating event network-changed:437fe7bd-ec5e-4005-8194-f8e7f2b93b32 for instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 on n-h2-853611-3 Aug 18 11:47:58.657376 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-a175b59d-401f-4101-98d5-e5e30ddd34c8 req-97d4ad20-ae45-464b-bdb4-c9a499755dff service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089431 Aug 18 11:47:58.658244 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2308/4934] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:47:58.817064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-943656af-0239-4529-b8ae-bae1cfc56dd7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:58.828258 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-943656af-0239-4529-b8ae-bae1cfc56dd7 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1511 microversion: 2.1 time: 0.376661 Aug 18 11:47:58.831401 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2627/4935] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:58 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1511 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:47:59.091545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3744e5ee-7283-4878-94e4-aca8f3f6e531 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:59.092502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3744e5ee-7283-4878-94e4-aca8f3f6e531 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:59.107283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3744e5ee-7283-4878-94e4-aca8f3f6e531 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:59.109887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3744e5ee-7283-4878-94e4-aca8f3f6e531 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:59.110584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3744e5ee-7283-4878-94e4-aca8f3f6e531 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:59.112031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3744e5ee-7283-4878-94e4-aca8f3f6e531 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:59.115528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3744e5ee-7283-4878-94e4-aca8f3f6e531 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:59.116254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3744e5ee-7283-4878-94e4-aca8f3f6e531 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:59.582044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59bb6ca6-b787-4298-ae60-fad2d3d93fbf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:59.583425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59bb6ca6-b787-4298-ae60-fad2d3d93fbf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:59.603076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59bb6ca6-b787-4298-ae60-fad2d3d93fbf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:59.611543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59bb6ca6-b787-4298-ae60-fad2d3d93fbf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:59.612531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59bb6ca6-b787-4298-ae60-fad2d3d93fbf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:59.619014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59bb6ca6-b787-4298-ae60-fad2d3d93fbf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:59.620035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59bb6ca6-b787-4298-ae60-fad2d3d93fbf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:59.621627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59bb6ca6-b787-4298-ae60-fad2d3d93fbf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:59.755359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3744e5ee-7283-4878-94e4-aca8f3f6e531 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:59.772824 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3744e5ee-7283-4878-94e4-aca8f3f6e531 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:59.775110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3744e5ee-7283-4878-94e4-aca8f3f6e531 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:47:59.776755 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3744e5ee-7283-4878-94e4-aca8f3f6e531 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.689869 Aug 18 11:47:59.778187 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2309/4936] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:47:59 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:47:59.855359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0db680cc-3c29-492d-936f-b582552a78a2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:47:59.856974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0db680cc-3c29-492d-936f-b582552a78a2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:47:59.868143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0db680cc-3c29-492d-936f-b582552a78a2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:59.868927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0db680cc-3c29-492d-936f-b582552a78a2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:59.869556 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0db680cc-3c29-492d-936f-b582552a78a2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:47:59.872253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0db680cc-3c29-492d-936f-b582552a78a2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:47:59.872951 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0db680cc-3c29-492d-936f-b582552a78a2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:47:59.873621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0db680cc-3c29-492d-936f-b582552a78a2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:00.084137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-59bb6ca6-b787-4298-ae60-fad2d3d93fbf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:00.097368 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59bb6ca6-b787-4298-ae60-fad2d3d93fbf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1495 microversion: 2.1 time: 0.521412 Aug 18 11:48:00.106315 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2628/4937] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:59 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1495 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:00.238285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0db680cc-3c29-492d-936f-b582552a78a2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:00.265354 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0db680cc-3c29-492d-936f-b582552a78a2 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1511 microversion: 2.1 time: 0.416501 Aug 18 11:48:00.270239 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2310/4938] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:47:59 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1511 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:48:00.805531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-60a544a8-61d3-4c07-93e9-d27543a322c6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:00.807659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-60a544a8-61d3-4c07-93e9-d27543a322c6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:00.821943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60a544a8-61d3-4c07-93e9-d27543a322c6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:00.822482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60a544a8-61d3-4c07-93e9-d27543a322c6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:00.822927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60a544a8-61d3-4c07-93e9-d27543a322c6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:00.823653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60a544a8-61d3-4c07-93e9-d27543a322c6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:00.824110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60a544a8-61d3-4c07-93e9-d27543a322c6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:00.838308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60a544a8-61d3-4c07-93e9-d27543a322c6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:01.138408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-60a544a8-61d3-4c07-93e9-d27543a322c6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:01.149241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-145e4cb5-1942-4e58-aa31-161924047076 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:01.158260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-145e4cb5-1942-4e58-aa31-161924047076 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:01.186585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-60a544a8-61d3-4c07-93e9-d27543a322c6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:01.188891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-60a544a8-61d3-4c07-93e9-d27543a322c6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:01.192934 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-60a544a8-61d3-4c07-93e9-d27543a322c6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.391895 Aug 18 11:48:01.197801 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2629/4939] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:00 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:01.216850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-145e4cb5-1942-4e58-aa31-161924047076 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:01.217720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-145e4cb5-1942-4e58-aa31-161924047076 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:01.229336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-145e4cb5-1942-4e58-aa31-161924047076 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:01.231482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-145e4cb5-1942-4e58-aa31-161924047076 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:01.232719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-145e4cb5-1942-4e58-aa31-161924047076 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:01.233830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-145e4cb5-1942-4e58-aa31-161924047076 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:01.292747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4955a125-a885-4c24-a29c-61438619e9e6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:01.295472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4955a125-a885-4c24-a29c-61438619e9e6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:01.305983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4955a125-a885-4c24-a29c-61438619e9e6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:01.307060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4955a125-a885-4c24-a29c-61438619e9e6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:01.308152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4955a125-a885-4c24-a29c-61438619e9e6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:01.311756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4955a125-a885-4c24-a29c-61438619e9e6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:01.312876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4955a125-a885-4c24-a29c-61438619e9e6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:01.313608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4955a125-a885-4c24-a29c-61438619e9e6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:01.807284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4955a125-a885-4c24-a29c-61438619e9e6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b563ab6ffa4fa5a51b955ee1ccb3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6fa3a212e84a2a9ffe62c094f5d89b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:01.822557 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4955a125-a885-4c24-a29c-61438619e9e6 tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 200 len: 1511 microversion: 2.1 time: 0.535260 Aug 18 11:48:01.825467 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2630/4940] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:01 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 1511 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:48:02.054912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-515f6ffa-5fce-4cb5-b8fd-7888c2574246 req-6d0581f2-ee4e-4aaa-85fd-cee1a8611fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb953a8-e8bd-44d1-9264-75ae577c5940", "name": "network-vif-deleted", "tag": "067f85bb-a79e-4035-966d-9dd9ced69382"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:02.058466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-145e4cb5-1942-4e58-aa31-161924047076 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:02.076948 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-145e4cb5-1942-4e58-aa31-161924047076 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1495 microversion: 2.1 time: 0.950064 Aug 18 11:48:02.077576 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2311/4941] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:01 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1495 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:02.083217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-515f6ffa-5fce-4cb5-b8fd-7888c2574246 req-6d0581f2-ee4e-4aaa-85fd-cee1a8611fb5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:02.084064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-515f6ffa-5fce-4cb5-b8fd-7888c2574246 req-6d0581f2-ee4e-4aaa-85fd-cee1a8611fb5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:02.085287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-515f6ffa-5fce-4cb5-b8fd-7888c2574246 req-6d0581f2-ee4e-4aaa-85fd-cee1a8611fb5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:02.125390 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-515f6ffa-5fce-4cb5-b8fd-7888c2574246 req-6d0581f2-ee4e-4aaa-85fd-cee1a8611fb5 service nova] Creating event network-vif-deleted:067f85bb-a79e-4035-966d-9dd9ced69382 for instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 on n-h1-853611-3 Aug 18 11:48:02.132634 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-515f6ffa-5fce-4cb5-b8fd-7888c2574246 req-6d0581f2-ee4e-4aaa-85fd-cee1a8611fb5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091128 Aug 18 11:48:02.138603 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2631/4942] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:48:02.239497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6fb4c5a7-a244-45f2-bee0-64da01a7a8ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:02.239497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6fb4c5a7-a244-45f2-bee0-64da01a7a8ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:02.256995 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6fb4c5a7-a244-45f2-bee0-64da01a7a8ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:02.257749 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6fb4c5a7-a244-45f2-bee0-64da01a7a8ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:02.258375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6fb4c5a7-a244-45f2-bee0-64da01a7a8ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:02.259366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6fb4c5a7-a244-45f2-bee0-64da01a7a8ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:02.260040 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6fb4c5a7-a244-45f2-bee0-64da01a7a8ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:02.260702 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6fb4c5a7-a244-45f2-bee0-64da01a7a8ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:02.862044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e2aa37f2-eabe-46be-95d5-2c34762b977a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:02.862773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e2aa37f2-eabe-46be-95d5-2c34762b977a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] [instance: 0eb953a8-e8bd-44d1-9264-75ae577c5940] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:02.882198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2aa37f2-eabe-46be-95d5-2c34762b977a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:02.882722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2aa37f2-eabe-46be-95d5-2c34762b977a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:02.883159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2aa37f2-eabe-46be-95d5-2c34762b977a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:02.883879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2aa37f2-eabe-46be-95d5-2c34762b977a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:02.884358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2aa37f2-eabe-46be-95d5-2c34762b977a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:02.884944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2aa37f2-eabe-46be-95d5-2c34762b977a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:02.900389 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-e2aa37f2-eabe-46be-95d5-2c34762b977a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] HTTP exception thrown: Instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 could not be found. Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e2aa37f2-eabe-46be-95d5-2c34762b977a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Request method failure captured: Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 HTTP/1.1 Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXn9ic5lQU3E9cS37eExIae0mbZfTGLq0ttAlrmJIzQCrkBJX6UuBas6p8C_ywH-zkTMpJegr5wiYqRYVclKTgo6xnAL2vFtajIJ84MSvseX9pq1OqnJyvO21aYmg3Yy1TDbAkfFIDkqkt0vMAXkD7LRLEQbRU2UjY_TDcQiKQtAj0 Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/ac6fa3a212e84a2a9ffe62c094f5d89b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: ac6fa3a212e84a2a9ffe62c094f5d89b Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796783127 Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 50b563ab6ffa4fa5a51b955ee1ccb3b9 Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-796783127-project Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 could not be found. Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '0eb953a8-e8bd-44d1-9264-75ae577c5940'} Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 could not be found. Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 could not be found. Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:48:02.902965 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:48:02.908260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:48:02.908260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:48:02.908260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:48:02.908260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:48:02.908260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:48:02.908260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 could not be found. Aug 18 11:48:02.908260 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:48:02.909557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e2aa37f2-eabe-46be-95d5-2c34762b977a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] Returning 404 to user: Instance 0eb953a8-e8bd-44d1-9264-75ae577c5940 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:48:02.910690 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e2aa37f2-eabe-46be-95d5-2c34762b977a tempest-ServersNegativeTestJSON-796783127 tempest-ServersNegativeTestJSON-796783127-project] 10.222.0.73 "GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940" status: 404 len: 111 microversion: 2.1 time: 0.053895 Aug 18 11:48:02.911751 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2632/4943] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:02 2022] GET /compute/v2.1/servers/0eb953a8-e8bd-44d1-9264-75ae577c5940 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:48:03.126565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f74f1b4d-9624-4f70-aa92-3df66e69c9f6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:03.127553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f74f1b4d-9624-4f70-aa92-3df66e69c9f6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:03.143996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f74f1b4d-9624-4f70-aa92-3df66e69c9f6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:03.144912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f74f1b4d-9624-4f70-aa92-3df66e69c9f6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:03.145742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f74f1b4d-9624-4f70-aa92-3df66e69c9f6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:03.146848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f74f1b4d-9624-4f70-aa92-3df66e69c9f6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:03.147620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f74f1b4d-9624-4f70-aa92-3df66e69c9f6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:03.148337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f74f1b4d-9624-4f70-aa92-3df66e69c9f6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:03.519226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6fb4c5a7-a244-45f2-bee0-64da01a7a8ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:03.543916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6fb4c5a7-a244-45f2-bee0-64da01a7a8ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:03.561459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f74f1b4d-9624-4f70-aa92-3df66e69c9f6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:03.571609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6fb4c5a7-a244-45f2-bee0-64da01a7a8ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:03.574265 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6fb4c5a7-a244-45f2-bee0-64da01a7a8ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 1.340114 Aug 18 11:48:03.575274 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f74f1b4d-9624-4f70-aa92-3df66e69c9f6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 200 len: 1495 microversion: 2.1 time: 0.459825 Aug 18 11:48:03.589830 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2633/4944] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:03 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 1495 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:03.590155 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2312/4945] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:02 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:03.931591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1729058f-8240-496d-abde-4d7c0afadf76 req-9d050300-20f7-49c7-8e3f-1302944c44ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd83b56e-8832-4e0a-93b2-dc11dfa067c5", "name": "network-vif-deleted", "tag": "cc05ced5-140e-4931-9eb4-3d4f102578bc"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:03.980737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1729058f-8240-496d-abde-4d7c0afadf76 req-9d050300-20f7-49c7-8e3f-1302944c44ee service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:03.981168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1729058f-8240-496d-abde-4d7c0afadf76 req-9d050300-20f7-49c7-8e3f-1302944c44ee service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:03.981624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1729058f-8240-496d-abde-4d7c0afadf76 req-9d050300-20f7-49c7-8e3f-1302944c44ee service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:03.994670 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1729058f-8240-496d-abde-4d7c0afadf76 req-9d050300-20f7-49c7-8e3f-1302944c44ee service nova] Creating event network-vif-deleted:cc05ced5-140e-4931-9eb4-3d4f102578bc for instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 on n-h1-853611-3 Aug 18 11:48:04.001042 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1729058f-8240-496d-abde-4d7c0afadf76 req-9d050300-20f7-49c7-8e3f-1302944c44ee service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080656 Aug 18 11:48:04.002254 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2634/4946] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:48:04.606582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a9bff64e-8bbf-4666-837e-50f51e178c53 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:04.607750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a9bff64e-8bbf-4666-837e-50f51e178c53 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:04.610112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a751cee-e68f-453e-b435-f735b8a71ff6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:04.612869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a751cee-e68f-453e-b435-f735b8a71ff6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:04.636441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a751cee-e68f-453e-b435-f735b8a71ff6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:04.637647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9bff64e-8bbf-4666-837e-50f51e178c53 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:04.638777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a751cee-e68f-453e-b435-f735b8a71ff6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:04.640933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a751cee-e68f-453e-b435-f735b8a71ff6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:04.643890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a751cee-e68f-453e-b435-f735b8a71ff6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:04.644467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9bff64e-8bbf-4666-837e-50f51e178c53 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:04.645259 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9bff64e-8bbf-4666-837e-50f51e178c53 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:04.647570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a751cee-e68f-453e-b435-f735b8a71ff6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:04.650002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a751cee-e68f-453e-b435-f735b8a71ff6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:04.650842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9bff64e-8bbf-4666-837e-50f51e178c53 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:04.654468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9bff64e-8bbf-4666-837e-50f51e178c53 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:04.658048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9bff64e-8bbf-4666-837e-50f51e178c53 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:04.717107 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-a9bff64e-8bbf-4666-837e-50f51e178c53 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a9bff64e-8bbf-4666-837e-50f51e178c53 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 HTTP/1.1 Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'cd83b56e-8832-4e0a-93b2-dc11dfa067c5'} Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:04.731350 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:48:04.737849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:48:04.737849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:48:04.737849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:48:04.737849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:48:04.737849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:48:04.737849 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:04.739497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a9bff64e-8bbf-4666-837e-50f51e178c53 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:48:04.740551 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a9bff64e-8bbf-4666-837e-50f51e178c53 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 404 len: 111 microversion: 2.1 time: 0.146583 Aug 18 11:48:04.742511 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2313/4947] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:04 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:48:04.906291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-941924626", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "748eeef0-4e88-4443-abac-e79de3b3bb2a"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:04.977807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] validate_networks() for [('748eeef0-4e88-4443-abac-e79de3b3bb2a', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:48:05.139007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a751cee-e68f-453e-b435-f735b8a71ff6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:05.179980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a751cee-e68f-453e-b435-f735b8a71ff6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:05.184843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a751cee-e68f-453e-b435-f735b8a71ff6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:05.187396 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a751cee-e68f-453e-b435-f735b8a71ff6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.587851 Aug 18 11:48:05.190090 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2635/4948] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:04 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:48:06.067054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7aa69dee-29f3-4a5b-959f-cc11eec5ce40 req-c754cf07-50ad-45ce-b4ba-fa97be25ea09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1706f34c-3b86-4298-be5a-126d7bfeba56", "tag": "7d0067d8-be65-40dd-bc5c-64a302b5b9c1"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:06.100643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7aa69dee-29f3-4a5b-959f-cc11eec5ce40 req-c754cf07-50ad-45ce-b4ba-fa97be25ea09 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:06.101938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7aa69dee-29f3-4a5b-959f-cc11eec5ce40 req-c754cf07-50ad-45ce-b4ba-fa97be25ea09 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:06.103418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7aa69dee-29f3-4a5b-959f-cc11eec5ce40 req-c754cf07-50ad-45ce-b4ba-fa97be25ea09 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:06.128546 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7aa69dee-29f3-4a5b-959f-cc11eec5ce40 req-c754cf07-50ad-45ce-b4ba-fa97be25ea09 service nova] Creating event network-changed:7d0067d8-be65-40dd-bc5c-64a302b5b9c1 for instance 1706f34c-3b86-4298-be5a-126d7bfeba56 on n-h1-853611-3 Aug 18 11:48:06.135245 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7aa69dee-29f3-4a5b-959f-cc11eec5ce40 req-c754cf07-50ad-45ce-b4ba-fa97be25ea09 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074665 Aug 18 11:48:06.137487 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2636/4949] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:48:06.220326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-778a18ff-044f-4553-953c-eb5a3f83f94d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:06.221680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-778a18ff-044f-4553-953c-eb5a3f83f94d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:06.232253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-778a18ff-044f-4553-953c-eb5a3f83f94d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:06.233241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-778a18ff-044f-4553-953c-eb5a3f83f94d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:06.235000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-778a18ff-044f-4553-953c-eb5a3f83f94d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:06.238143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-778a18ff-044f-4553-953c-eb5a3f83f94d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:06.239208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-778a18ff-044f-4553-953c-eb5a3f83f94d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:06.239945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-778a18ff-044f-4553-953c-eb5a3f83f94d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:06.292598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:48:06.293238 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:48:06.293502 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:48:06.293916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:48:06.294335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:48:06.315216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:06.315793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:06.316246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:06.317444 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:06.318046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:06.318508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:06.407970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:48:06.424256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for user c850b0a836124d90b7e50fe8b9fdf011 and project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:48:06.483202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:48:06.486783 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:48:06.570176 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f915f77a-c266-4a90-bc25-889ef14638d6 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.667998 Aug 18 11:48:06.572108 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2314/4950] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:48:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:48:06.586545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3f45796c-dadb-4f75-812a-d44a95a58548 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:06.598168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3f45796c-dadb-4f75-812a-d44a95a58548 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:06.882173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3f45796c-dadb-4f75-812a-d44a95a58548 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:06.892354 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3f45796c-dadb-4f75-812a-d44a95a58548 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1208 microversion: 2.1 time: 0.312421 Aug 18 11:48:06.906632 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2315/4951] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:06 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1208 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:07.470303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-778a18ff-044f-4553-953c-eb5a3f83f94d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:07.482271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-778a18ff-044f-4553-953c-eb5a3f83f94d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:07.488409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-778a18ff-044f-4553-953c-eb5a3f83f94d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:07.490276 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-778a18ff-044f-4553-953c-eb5a3f83f94d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 1.280833 Aug 18 11:48:07.496402 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2637/4952] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:06 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:07.921254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-08c36ae2-c4e2-46c2-8701-511d2c8e2a8d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:07.921964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-08c36ae2-c4e2-46c2-8701-511d2c8e2a8d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:07.953118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08c36ae2-c4e2-46c2-8701-511d2c8e2a8d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:07.954252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08c36ae2-c4e2-46c2-8701-511d2c8e2a8d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:07.954754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08c36ae2-c4e2-46c2-8701-511d2c8e2a8d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:07.960970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08c36ae2-c4e2-46c2-8701-511d2c8e2a8d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:07.974897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08c36ae2-c4e2-46c2-8701-511d2c8e2a8d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:07.976497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-08c36ae2-c4e2-46c2-8701-511d2c8e2a8d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:08.521476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-745b63ba-de87-4ed3-9415-6dc7dc696b7e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:08.522104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-745b63ba-de87-4ed3-9415-6dc7dc696b7e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:08.559904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-745b63ba-de87-4ed3-9415-6dc7dc696b7e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:08.564610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-745b63ba-de87-4ed3-9415-6dc7dc696b7e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:08.568598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-745b63ba-de87-4ed3-9415-6dc7dc696b7e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:08.575866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-745b63ba-de87-4ed3-9415-6dc7dc696b7e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:08.577798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-745b63ba-de87-4ed3-9415-6dc7dc696b7e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:08.585071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-745b63ba-de87-4ed3-9415-6dc7dc696b7e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:09.222375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-745b63ba-de87-4ed3-9415-6dc7dc696b7e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:09.253055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-745b63ba-de87-4ed3-9415-6dc7dc696b7e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:09.271599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-745b63ba-de87-4ed3-9415-6dc7dc696b7e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:09.276744 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-745b63ba-de87-4ed3-9415-6dc7dc696b7e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.759025 Aug 18 11:48:09.279899 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2638/4953] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:08 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:09.329283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-08c36ae2-c4e2-46c2-8701-511d2c8e2a8d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:09.348429 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-08c36ae2-c4e2-46c2-8701-511d2c8e2a8d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1204 microversion: 2.1 time: 1.430388 Aug 18 11:48:09.350783 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2316/4954] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:07 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1204 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:10.303926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-424064fd-0423-485d-8416-53c8d9867666 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:10.304653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-424064fd-0423-485d-8416-53c8d9867666 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:10.313101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-424064fd-0423-485d-8416-53c8d9867666 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:10.313912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-424064fd-0423-485d-8416-53c8d9867666 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:10.314847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-424064fd-0423-485d-8416-53c8d9867666 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:10.316119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-424064fd-0423-485d-8416-53c8d9867666 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:10.316919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-424064fd-0423-485d-8416-53c8d9867666 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:10.317689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-424064fd-0423-485d-8416-53c8d9867666 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:10.360054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:10.380190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e07caf00-ce20-46c1-9c37-56b93455dc41 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:10.380835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e07caf00-ce20-46c1-9c37-56b93455dc41 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:10.397513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e07caf00-ce20-46c1-9c37-56b93455dc41 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:10.398151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e07caf00-ce20-46c1-9c37-56b93455dc41 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:10.398734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e07caf00-ce20-46c1-9c37-56b93455dc41 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:10.399409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e07caf00-ce20-46c1-9c37-56b93455dc41 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:10.399879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e07caf00-ce20-46c1-9c37-56b93455dc41 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:10.405038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e07caf00-ce20-46c1-9c37-56b93455dc41 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:10.850282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e07caf00-ce20-46c1-9c37-56b93455dc41 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:10.884741 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e07caf00-ce20-46c1-9c37-56b93455dc41 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1266 microversion: 2.1 time: 0.515783 Aug 18 11:48:10.885450 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2317/4955] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:10 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1266 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:48:11.074549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-424064fd-0423-485d-8416-53c8d9867666 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:11.102750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-424064fd-0423-485d-8416-53c8d9867666 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:11.108397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-424064fd-0423-485d-8416-53c8d9867666 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:11.112916 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-424064fd-0423-485d-8416-53c8d9867666 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.811519 Aug 18 11:48:11.116355 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2639/4956] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:10 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:11.915162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9606de70-e13f-40f8-901c-35a2f2b9894d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:11.916019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9606de70-e13f-40f8-901c-35a2f2b9894d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:11.929102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9606de70-e13f-40f8-901c-35a2f2b9894d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:11.931752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9606de70-e13f-40f8-901c-35a2f2b9894d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:11.933742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9606de70-e13f-40f8-901c-35a2f2b9894d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:11.936167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9606de70-e13f-40f8-901c-35a2f2b9894d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:11.937083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9606de70-e13f-40f8-901c-35a2f2b9894d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:11.939415 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9606de70-e13f-40f8-901c-35a2f2b9894d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:12.144350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-66c74736-4069-4d4a-86e5-5ab3399fe92a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:12.147800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-66c74736-4069-4d4a-86e5-5ab3399fe92a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:12.170103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9606de70-e13f-40f8-901c-35a2f2b9894d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:12.177841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66c74736-4069-4d4a-86e5-5ab3399fe92a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:12.179464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66c74736-4069-4d4a-86e5-5ab3399fe92a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:12.183210 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9606de70-e13f-40f8-901c-35a2f2b9894d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1266 microversion: 2.1 time: 0.274239 Aug 18 11:48:12.184292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66c74736-4069-4d4a-86e5-5ab3399fe92a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:12.186225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66c74736-4069-4d4a-86e5-5ab3399fe92a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:12.187423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66c74736-4069-4d4a-86e5-5ab3399fe92a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:12.192552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66c74736-4069-4d4a-86e5-5ab3399fe92a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:12.193327 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2318/4957] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:11 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:12.874510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-66c74736-4069-4d4a-86e5-5ab3399fe92a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:12.927446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-66c74736-4069-4d4a-86e5-5ab3399fe92a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:12.947369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-66c74736-4069-4d4a-86e5-5ab3399fe92a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:12.952016 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-66c74736-4069-4d4a-86e5-5ab3399fe92a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.815455 Aug 18 11:48:12.970977 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2640/4958] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:12 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:13.224490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2f0f2017-7cb1-44df-b683-5e5e828f59d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:13.241063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2f0f2017-7cb1-44df-b683-5e5e828f59d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:13.284667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f0f2017-7cb1-44df-b683-5e5e828f59d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:13.286883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f0f2017-7cb1-44df-b683-5e5e828f59d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:13.287450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f0f2017-7cb1-44df-b683-5e5e828f59d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:13.288457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f0f2017-7cb1-44df-b683-5e5e828f59d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:13.291067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f0f2017-7cb1-44df-b683-5e5e828f59d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:13.291823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2f0f2017-7cb1-44df-b683-5e5e828f59d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:13.980852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-566367f6-a0a2-4036-8ded-a53499ef53e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:13.982296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-566367f6-a0a2-4036-8ded-a53499ef53e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:13.997377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-566367f6-a0a2-4036-8ded-a53499ef53e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:14.001717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-566367f6-a0a2-4036-8ded-a53499ef53e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:14.005470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-566367f6-a0a2-4036-8ded-a53499ef53e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:14.008917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-566367f6-a0a2-4036-8ded-a53499ef53e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:14.010711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-566367f6-a0a2-4036-8ded-a53499ef53e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:14.013816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-566367f6-a0a2-4036-8ded-a53499ef53e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:14.758864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-566367f6-a0a2-4036-8ded-a53499ef53e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:14.781164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-566367f6-a0a2-4036-8ded-a53499ef53e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:14.788360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-566367f6-a0a2-4036-8ded-a53499ef53e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:14.791260 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-566367f6-a0a2-4036-8ded-a53499ef53e9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.814647 Aug 18 11:48:14.796031 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2641/4959] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:13 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:48:15.817338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4ff098b1-8121-47fc-b78c-c99326423a18 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:15.819544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4ff098b1-8121-47fc-b78c-c99326423a18 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:15.831595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ff098b1-8121-47fc-b78c-c99326423a18 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:15.834646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ff098b1-8121-47fc-b78c-c99326423a18 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:15.843120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ff098b1-8121-47fc-b78c-c99326423a18 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:15.844632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ff098b1-8121-47fc-b78c-c99326423a18 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:15.845942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ff098b1-8121-47fc-b78c-c99326423a18 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:15.847362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ff098b1-8121-47fc-b78c-c99326423a18 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:15.926163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2f0f2017-7cb1-44df-b683-5e5e828f59d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:15.947614 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2f0f2017-7cb1-44df-b683-5e5e828f59d9 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1308 microversion: 2.1 time: 2.733996 Aug 18 11:48:15.948770 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2319/4960] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:13 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1308 bytes in 2737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:16.931344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4ff098b1-8121-47fc-b78c-c99326423a18 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:16.954392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4ff098b1-8121-47fc-b78c-c99326423a18 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:16.961598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4ff098b1-8121-47fc-b78c-c99326423a18 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:16.971543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d17655d6-21be-494f-9f6d-98f120b9d3b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:16.972208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d17655d6-21be-494f-9f6d-98f120b9d3b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:16.978028 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4ff098b1-8121-47fc-b78c-c99326423a18 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 1.149971 Aug 18 11:48:16.979797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:16.982797 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2642/4961] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:15 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:48:16.985260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=8 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:17.006305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d17655d6-21be-494f-9f6d-98f120b9d3b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:17.012434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d17655d6-21be-494f-9f6d-98f120b9d3b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:17.012897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d17655d6-21be-494f-9f6d-98f120b9d3b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:17.019200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d17655d6-21be-494f-9f6d-98f120b9d3b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:17.020075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d17655d6-21be-494f-9f6d-98f120b9d3b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:17.027072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d17655d6-21be-494f-9f6d-98f120b9d3b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:17.096393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:17.690160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d17655d6-21be-494f-9f6d-98f120b9d3b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:17.720183 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d17655d6-21be-494f-9f6d-98f120b9d3b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1308 microversion: 2.1 time: 0.754905 Aug 18 11:48:17.725103 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2320/4962] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:16 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1308 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:18.002159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4ed67806-61ad-4733-a0cb-49c5473a173e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:18.003503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4ed67806-61ad-4733-a0cb-49c5473a173e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:18.021138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ed67806-61ad-4733-a0cb-49c5473a173e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:18.024957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ed67806-61ad-4733-a0cb-49c5473a173e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:18.025710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ed67806-61ad-4733-a0cb-49c5473a173e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:18.030458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ed67806-61ad-4733-a0cb-49c5473a173e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:18.031283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ed67806-61ad-4733-a0cb-49c5473a173e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:18.031901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ed67806-61ad-4733-a0cb-49c5473a173e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:18.636474 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:48:18.636929 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 11:48:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:48:18.706409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4ed67806-61ad-4733-a0cb-49c5473a173e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:18.727162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4ed67806-61ad-4733-a0cb-49c5473a173e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:18.728792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4ed67806-61ad-4733-a0cb-49c5473a173e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:18.729979 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4ed67806-61ad-4733-a0cb-49c5473a173e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.732279 Aug 18 11:48:18.741168 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2643/4963] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:17 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:18.754015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-89679358-35c5-4cb9-b497-93f0cd7c6174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:18.756301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-89679358-35c5-4cb9-b497-93f0cd7c6174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:18.782290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89679358-35c5-4cb9-b497-93f0cd7c6174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:18.789184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89679358-35c5-4cb9-b497-93f0cd7c6174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:18.790144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89679358-35c5-4cb9-b497-93f0cd7c6174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:18.794737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89679358-35c5-4cb9-b497-93f0cd7c6174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:18.796963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89679358-35c5-4cb9-b497-93f0cd7c6174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:18.828919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-89679358-35c5-4cb9-b497-93f0cd7c6174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:19.478141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1cf25ae3-4a92-48da-89d0-cf71bbef631e req-f092da0f-3f62-42e7-b700-efdb81a75472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9c9732-0341-44a6-a88c-ad6904ec6912", "tag": "2465be05-dd5e-41f7-99a4-45cf0f4237ca"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:19.514187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1cf25ae3-4a92-48da-89d0-cf71bbef631e req-f092da0f-3f62-42e7-b700-efdb81a75472 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:19.524289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1cf25ae3-4a92-48da-89d0-cf71bbef631e req-f092da0f-3f62-42e7-b700-efdb81a75472 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:19.527966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1cf25ae3-4a92-48da-89d0-cf71bbef631e req-f092da0f-3f62-42e7-b700-efdb81a75472 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:19.571944 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1cf25ae3-4a92-48da-89d0-cf71bbef631e req-f092da0f-3f62-42e7-b700-efdb81a75472 service nova] Creating event network-changed:2465be05-dd5e-41f7-99a4-45cf0f4237ca for instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 on n-h2-853611-3 Aug 18 11:48:19.578807 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1cf25ae3-4a92-48da-89d0-cf71bbef631e req-f092da0f-3f62-42e7-b700-efdb81a75472 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105039 Aug 18 11:48:19.580842 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2644/4964] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:48:19.786221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8121b870-3fc1-4516-b591-8c111346163b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:19.786221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8121b870-3fc1-4516-b591-8c111346163b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:19.787811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8121b870-3fc1-4516-b591-8c111346163b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:19.788379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8121b870-3fc1-4516-b591-8c111346163b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:19.789552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8121b870-3fc1-4516-b591-8c111346163b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:19.790844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8121b870-3fc1-4516-b591-8c111346163b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:19.791489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8121b870-3fc1-4516-b591-8c111346163b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:19.792091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8121b870-3fc1-4516-b591-8c111346163b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:20.385464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-89679358-35c5-4cb9-b497-93f0cd7c6174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:20.407244 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-89679358-35c5-4cb9-b497-93f0cd7c6174 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1308 microversion: 2.1 time: 1.660168 Aug 18 11:48:20.408810 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2321/4965] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:18 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1308 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:20.432229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8121b870-3fc1-4516-b591-8c111346163b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:20.454706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8121b870-3fc1-4516-b591-8c111346163b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:20.463024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8121b870-3fc1-4516-b591-8c111346163b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:20.467607 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8121b870-3fc1-4516-b591-8c111346163b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.704023 Aug 18 11:48:20.469954 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2645/4966] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:19 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:21.430178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ef361c4f-7e91-413f-82cb-43736d66b970 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:21.432248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef361c4f-7e91-413f-82cb-43736d66b970 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:21.448308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:21.457539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef361c4f-7e91-413f-82cb-43736d66b970 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:21.462636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef361c4f-7e91-413f-82cb-43736d66b970 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:21.463239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef361c4f-7e91-413f-82cb-43736d66b970 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:21.464970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef361c4f-7e91-413f-82cb-43736d66b970 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:21.466915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef361c4f-7e91-413f-82cb-43736d66b970 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:21.480605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef361c4f-7e91-413f-82cb-43736d66b970 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:21.958170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6fab69a4-d961-491d-9cad-13f5977e5a45 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] Action: 'create', calling method: .version_select at 0x7f519eb85160>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:22.032329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-6fab69a4-d961-491d-9cad-13f5977e5a45 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] Getting quotas for project eb6e5e8855b54d6f9507c9dfc8e33180. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:48:22.042035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ef361c4f-7e91-413f-82cb-43736d66b970 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:22.053131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-6fab69a4-d961-491d-9cad-13f5977e5a45 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] Getting quotas for user aabdafdf45014958a8a9dd76aaa507ea and project eb6e5e8855b54d6f9507c9dfc8e33180. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:48:22.053396 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ef361c4f-7e91-413f-82cb-43736d66b970 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1308 microversion: 2.1 time: 0.625174 Aug 18 11:48:22.054225 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2646/4967] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:21 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1308 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:22.064615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3bd31894-7b55-45de-9710-fd55f4ccbf16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:22.086128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3bd31894-7b55-45de-9710-fd55f4ccbf16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:22.106117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bd31894-7b55-45de-9710-fd55f4ccbf16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:22.107530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bd31894-7b55-45de-9710-fd55f4ccbf16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:22.110723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bd31894-7b55-45de-9710-fd55f4ccbf16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:22.113181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bd31894-7b55-45de-9710-fd55f4ccbf16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:22.115045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bd31894-7b55-45de-9710-fd55f4ccbf16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:22.116417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bd31894-7b55-45de-9710-fd55f4ccbf16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:22.190873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-6fab69a4-d961-491d-9cad-13f5977e5a45 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] Getting quotas for project eb6e5e8855b54d6f9507c9dfc8e33180. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:48:22.208033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-6fab69a4-d961-491d-9cad-13f5977e5a45 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] Getting quotas for user aabdafdf45014958a8a9dd76aaa507ea and project eb6e5e8855b54d6f9507c9dfc8e33180. Resources: {'server_groups'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:48:22.234365 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6fab69a4-d961-491d-9cad-13f5977e5a45 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] 10.222.0.73 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 1.043704 Aug 18 11:48:22.244073 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2322/4968] 10.222.0.73 () {62 vars in 1214 bytes} [Thu Aug 18 11:48:21 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:48:22.251696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0a3d2fd0-98b1-427c-ac81-e5a651d92d40 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:22.265415 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0a3d2fd0-98b1-427c-ac81-e5a651d92d40 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] 10.222.0.73 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.018853 Aug 18 11:48:22.273141 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2323/4969] 10.222.0.73 () {60 vars in 1193 bytes} [Thu Aug 18 11:48:22 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 11:48:22.281229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-64206e7a-8e74-4758-b34d-7e23f1b683e4 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:22.293960 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-64206e7a-8e74-4758-b34d-7e23f1b683e4 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] 10.222.0.73 "GET /compute/v2.1/os-server-groups/304d3cd2-20f3-4f1e-ae8b-35315574a69f" status: 200 len: 235 microversion: 2.64 time: 0.017999 Aug 18 11:48:22.302078 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2324/4970] 10.222.0.73 () {60 vars in 1304 bytes} [Thu Aug 18 11:48:22 2022] GET /compute/v2.1/os-server-groups/304d3cd2-20f3-4f1e-ae8b-35315574a69f => generated 235 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:48:22.309714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8bee3c88-97b4-4a69-9506-cada843d5ee9 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:22.355383 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8bee3c88-97b4-4a69-9506-cada843d5ee9 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] 10.222.0.73 "DELETE /compute/v2.1/os-server-groups/304d3cd2-20f3-4f1e-ae8b-35315574a69f" status: 204 len: 0 microversion: 2.64 time: 0.051715 Aug 18 11:48:22.363686 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2325/4971] 10.222.0.73 () {60 vars in 1307 bytes} [Thu Aug 18 11:48:22 2022] DELETE /compute/v2.1/os-server-groups/304d3cd2-20f3-4f1e-ae8b-35315574a69f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:48:22.370319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-40fc01be-3035-432d-a027-dc656cda02e8 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:22.379444 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-40fc01be-3035-432d-a027-dc656cda02e8 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] HTTP exception thrown: Instance group 304d3cd2-20f3-4f1e-ae8b-35315574a69f could not be found. Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-40fc01be-3035-432d-a027-dc656cda02e8 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] Request method failure captured: Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-server-groups/304d3cd2-20f3-4f1e-ae8b-35315574a69f HTTP/1.1 Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_icExWw2GTTfjNiHCIfLlgQ-o8cUSxNxtIunU9c5XNjLqNdpPwy4sYGDabLK0T_vsQV6nIaaN_Tkvf0tZ8Jd7oRk4cdXJXVv6YvuMxc8Rsw7YufS3UGH6i8g50auDTJbQy-Z1_bhP1sRaDnEcFND2JVv0kaETmMaZTQk2mRnAnNcxRE Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Openstack-Nova-Api-Version: 2.64 Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: eb6e5e8855b54d6f9507c9dfc8e33180 Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerGroup264TestJSON-1345470435 Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/eb6e5e8855b54d6f9507c9dfc8e33180"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/eb6e5e8855b54d6f9507c9dfc8e33180"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_eb6e5e8855b54d6f9507c9dfc8e33180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/eb6e5e8855b54d6f9507c9dfc8e33180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerGroup264TestJSON-1345470435 Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: eb6e5e8855b54d6f9507c9dfc8e33180 Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1345470435 Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerGroup264TestJSON-1345470435-project Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: aabdafdf45014958a8a9dd76aaa507ea Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerGroup264TestJSON-1345470435-project Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance group 304d3cd2-20f3-4f1e-ae8b-35315574a69f could not be found. Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '304d3cd2-20f3-4f1e-ae8b-35315574a69f'} Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 304d3cd2-20f3-4f1e-ae8b-35315574a69f could not be found. Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 304d3cd2-20f3-4f1e-ae8b-35315574a69f could not be found. Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:22.381545 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:48:22.386616 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:48:22.386616 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:48:22.386616 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:48:22.386616 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:48:22.386616 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 304d3cd2-20f3-4f1e-ae8b-35315574a69f could not be found. Aug 18 11:48:22.386616 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:22.389560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-40fc01be-3035-432d-a027-dc656cda02e8 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] Returning 404 to user: Instance group 304d3cd2-20f3-4f1e-ae8b-35315574a69f could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:48:22.391197 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-40fc01be-3035-432d-a027-dc656cda02e8 tempest-ServerGroup264TestJSON-1345470435 tempest-ServerGroup264TestJSON-1345470435-project] 10.222.0.73 "DELETE /compute/v2.1/os-server-groups/304d3cd2-20f3-4f1e-ae8b-35315574a69f" status: 404 len: 117 microversion: 2.64 time: 0.026122 Aug 18 11:48:22.391956 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2326/4972] 10.222.0.73 () {60 vars in 1307 bytes} [Thu Aug 18 11:48:22 2022] DELETE /compute/v2.1/os-server-groups/304d3cd2-20f3-4f1e-ae8b-35315574a69f => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:48:22.880860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3bd31894-7b55-45de-9710-fd55f4ccbf16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:22.904812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3bd31894-7b55-45de-9710-fd55f4ccbf16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:22.913608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3bd31894-7b55-45de-9710-fd55f4ccbf16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:22.921217 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3bd31894-7b55-45de-9710-fd55f4ccbf16 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.858261 Aug 18 11:48:22.924739 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2647/4973] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:22 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:23.080092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-09adac8f-4a66-4aa4-8748-459fa94923e4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:23.080698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-09adac8f-4a66-4aa4-8748-459fa94923e4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:23.094905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09adac8f-4a66-4aa4-8748-459fa94923e4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:23.100902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09adac8f-4a66-4aa4-8748-459fa94923e4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:23.105670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09adac8f-4a66-4aa4-8748-459fa94923e4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:23.109492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09adac8f-4a66-4aa4-8748-459fa94923e4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:23.113130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09adac8f-4a66-4aa4-8748-459fa94923e4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:23.115135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-09adac8f-4a66-4aa4-8748-459fa94923e4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:23.891120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-09adac8f-4a66-4aa4-8748-459fa94923e4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:23.912892 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-09adac8f-4a66-4aa4-8748-459fa94923e4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1308 microversion: 2.1 time: 0.833116 Aug 18 11:48:23.915953 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2327/4974] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:23 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1308 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:23.950209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2a1efbef-d221-4685-a6dd-6da31627f265 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:23.950968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2a1efbef-d221-4685-a6dd-6da31627f265 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:23.962215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a1efbef-d221-4685-a6dd-6da31627f265 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:23.967188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a1efbef-d221-4685-a6dd-6da31627f265 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:23.967648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a1efbef-d221-4685-a6dd-6da31627f265 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:23.968671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a1efbef-d221-4685-a6dd-6da31627f265 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:23.969137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a1efbef-d221-4685-a6dd-6da31627f265 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:23.969560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a1efbef-d221-4685-a6dd-6da31627f265 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:24.350025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2a1efbef-d221-4685-a6dd-6da31627f265 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:24.364908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2a1efbef-d221-4685-a6dd-6da31627f265 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:24.370136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2a1efbef-d221-4685-a6dd-6da31627f265 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:24.373693 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2a1efbef-d221-4685-a6dd-6da31627f265 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.428266 Aug 18 11:48:24.379199 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2648/4975] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:23 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:24.939805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a5bc813a-2f2f-40c0-8d48-e5f52d586d69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:24.940937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a5bc813a-2f2f-40c0-8d48-e5f52d586d69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:24.977036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5bc813a-2f2f-40c0-8d48-e5f52d586d69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:24.977899 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5bc813a-2f2f-40c0-8d48-e5f52d586d69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:24.980946 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5bc813a-2f2f-40c0-8d48-e5f52d586d69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:24.983254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5bc813a-2f2f-40c0-8d48-e5f52d586d69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:24.984810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5bc813a-2f2f-40c0-8d48-e5f52d586d69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:24.986168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a5bc813a-2f2f-40c0-8d48-e5f52d586d69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:25.406711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-25dc0418-b5be-4d97-a4d4-00e3d6868ea9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:25.408202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-25dc0418-b5be-4d97-a4d4-00e3d6868ea9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:25.432723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25dc0418-b5be-4d97-a4d4-00e3d6868ea9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:25.434120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25dc0418-b5be-4d97-a4d4-00e3d6868ea9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:25.435506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25dc0418-b5be-4d97-a4d4-00e3d6868ea9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:25.437628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25dc0418-b5be-4d97-a4d4-00e3d6868ea9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:25.438310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25dc0418-b5be-4d97-a4d4-00e3d6868ea9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:25.444693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25dc0418-b5be-4d97-a4d4-00e3d6868ea9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:25.871594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a5bc813a-2f2f-40c0-8d48-e5f52d586d69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:25.884820 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a5bc813a-2f2f-40c0-8d48-e5f52d586d69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1308 microversion: 2.1 time: 0.954055 Aug 18 11:48:25.900207 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2328/4976] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:24 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1308 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:26.148770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-25dc0418-b5be-4d97-a4d4-00e3d6868ea9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:26.173166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-25dc0418-b5be-4d97-a4d4-00e3d6868ea9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:26.177917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-25dc0418-b5be-4d97-a4d4-00e3d6868ea9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:26.181770 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-25dc0418-b5be-4d97-a4d4-00e3d6868ea9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.779258 Aug 18 11:48:26.197634 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2649/4977] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:25 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:48:26.879692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-659a1058-7489-4e7a-8cd8-7f1ca7dc09b2 req-3cbc6bfa-06f2-4b3a-81bd-7895e6fc98b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9c9732-0341-44a6-a88c-ad6904ec6912", "name": "network-vif-plugged", "status": "completed", "tag": "2465be05-dd5e-41f7-99a4-45cf0f4237ca"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:26.909094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-659a1058-7489-4e7a-8cd8-7f1ca7dc09b2 req-3cbc6bfa-06f2-4b3a-81bd-7895e6fc98b7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:26.910165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-659a1058-7489-4e7a-8cd8-7f1ca7dc09b2 req-3cbc6bfa-06f2-4b3a-81bd-7895e6fc98b7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:26.910867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-659a1058-7489-4e7a-8cd8-7f1ca7dc09b2 req-3cbc6bfa-06f2-4b3a-81bd-7895e6fc98b7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:26.917135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4b1ac5fa-25ee-434a-bc26-a886ec399805 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:26.920787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4b1ac5fa-25ee-434a-bc26-a886ec399805 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:26.936070 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-659a1058-7489-4e7a-8cd8-7f1ca7dc09b2 req-3cbc6bfa-06f2-4b3a-81bd-7895e6fc98b7 service nova] Creating event network-vif-plugged:2465be05-dd5e-41f7-99a4-45cf0f4237ca for instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 on n-h2-853611-3 Aug 18 11:48:26.946033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b1ac5fa-25ee-434a-bc26-a886ec399805 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:26.946750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b1ac5fa-25ee-434a-bc26-a886ec399805 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:26.947211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b1ac5fa-25ee-434a-bc26-a886ec399805 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:26.948089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b1ac5fa-25ee-434a-bc26-a886ec399805 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:26.952180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b1ac5fa-25ee-434a-bc26-a886ec399805 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:26.952423 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-659a1058-7489-4e7a-8cd8-7f1ca7dc09b2 req-3cbc6bfa-06f2-4b3a-81bd-7895e6fc98b7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073773 Aug 18 11:48:26.953884 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2329/4978] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:48:26.964113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b1ac5fa-25ee-434a-bc26-a886ec399805 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:27.207257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b5dc1bbc-2bd6-47e3-a065-7e4decffdbec tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:27.208822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b5dc1bbc-2bd6-47e3-a065-7e4decffdbec tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:27.219915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:27.222762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5dc1bbc-2bd6-47e3-a065-7e4decffdbec tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:27.227926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5dc1bbc-2bd6-47e3-a065-7e4decffdbec tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:27.229493 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5dc1bbc-2bd6-47e3-a065-7e4decffdbec tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:27.231769 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5dc1bbc-2bd6-47e3-a065-7e4decffdbec tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:27.232454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5dc1bbc-2bd6-47e3-a065-7e4decffdbec tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:27.233124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b5dc1bbc-2bd6-47e3-a065-7e4decffdbec tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:27.388724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4b1ac5fa-25ee-434a-bc26-a886ec399805 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:27.408899 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4b1ac5fa-25ee-434a-bc26-a886ec399805 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1308 microversion: 2.1 time: 0.502907 Aug 18 11:48:27.410154 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2650/4979] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:26 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1308 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:27.621056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b5dc1bbc-2bd6-47e3-a065-7e4decffdbec tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:27.645644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b5dc1bbc-2bd6-47e3-a065-7e4decffdbec tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:27.648075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b5dc1bbc-2bd6-47e3-a065-7e4decffdbec tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:27.651222 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b5dc1bbc-2bd6-47e3-a065-7e4decffdbec tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.449001 Aug 18 11:48:27.657768 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2330/4980] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:27 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:28.433833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b69d8e3-f280-4a59-ac64-afa2c4e6c888 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:28.439400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b69d8e3-f280-4a59-ac64-afa2c4e6c888 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:28.469294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b69d8e3-f280-4a59-ac64-afa2c4e6c888 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:28.470175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b69d8e3-f280-4a59-ac64-afa2c4e6c888 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:28.470844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b69d8e3-f280-4a59-ac64-afa2c4e6c888 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:28.473127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b69d8e3-f280-4a59-ac64-afa2c4e6c888 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:28.475367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b69d8e3-f280-4a59-ac64-afa2c4e6c888 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:28.477964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b69d8e3-f280-4a59-ac64-afa2c4e6c888 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:28.687020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-72bda29b-75bf-4c7b-990e-bcef38b4d54d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:28.694142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-72bda29b-75bf-4c7b-990e-bcef38b4d54d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:28.717580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72bda29b-75bf-4c7b-990e-bcef38b4d54d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:28.718470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72bda29b-75bf-4c7b-990e-bcef38b4d54d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:28.719136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72bda29b-75bf-4c7b-990e-bcef38b4d54d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:28.721760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72bda29b-75bf-4c7b-990e-bcef38b4d54d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:28.723083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72bda29b-75bf-4c7b-990e-bcef38b4d54d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:28.724981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-72bda29b-75bf-4c7b-990e-bcef38b4d54d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:29.192220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-72bda29b-75bf-4c7b-990e-bcef38b4d54d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:29.206777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-72bda29b-75bf-4c7b-990e-bcef38b4d54d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:29.208473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-72bda29b-75bf-4c7b-990e-bcef38b4d54d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:29.209729 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-72bda29b-75bf-4c7b-990e-bcef38b4d54d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.527258 Aug 18 11:48:29.210317 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2331/4981] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:28 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:29.249147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5b69d8e3-f280-4a59-ac64-afa2c4e6c888 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:29.261853 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b69d8e3-f280-4a59-ac64-afa2c4e6c888 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1488 microversion: 2.1 time: 0.830285 Aug 18 11:48:29.274372 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2651/4982] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:28 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1488 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:29.289383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6af63e83-8565-4c77-92f7-f1e5de4133a3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:29.293910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6af63e83-8565-4c77-92f7-f1e5de4133a3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:29.302245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6af63e83-8565-4c77-92f7-f1e5de4133a3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:29.303398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6af63e83-8565-4c77-92f7-f1e5de4133a3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:29.308775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6af63e83-8565-4c77-92f7-f1e5de4133a3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:29.310514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6af63e83-8565-4c77-92f7-f1e5de4133a3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:29.311201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6af63e83-8565-4c77-92f7-f1e5de4133a3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:29.311858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6af63e83-8565-4c77-92f7-f1e5de4133a3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:29.422562 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6af63e83-8565-4c77-92f7-f1e5de4133a3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "PUT /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1083 microversion: 2.1 time: 0.137574 Aug 18 11:48:29.424463 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2652/4983] 10.222.0.73 () {60 vars in 1256 bytes} [Thu Aug 18 11:48:29 2022] PUT /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1083 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:29.447661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1c8a292d-716e-4fda-92b0-79cf184678b1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:29.449178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1c8a292d-716e-4fda-92b0-79cf184678b1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:29.467069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c8a292d-716e-4fda-92b0-79cf184678b1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:29.467869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c8a292d-716e-4fda-92b0-79cf184678b1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:29.468531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c8a292d-716e-4fda-92b0-79cf184678b1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:29.469419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c8a292d-716e-4fda-92b0-79cf184678b1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:29.471670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c8a292d-716e-4fda-92b0-79cf184678b1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:29.472327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c8a292d-716e-4fda-92b0-79cf184678b1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:29.769811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-728aecdf-5828-457d-9a55-323d9bd46660 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:29.771195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-728aecdf-5828-457d-9a55-323d9bd46660 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:29.786932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-728aecdf-5828-457d-9a55-323d9bd46660 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:29.787791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-728aecdf-5828-457d-9a55-323d9bd46660 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:29.789442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-728aecdf-5828-457d-9a55-323d9bd46660 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:29.790927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-728aecdf-5828-457d-9a55-323d9bd46660 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:29.793902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-728aecdf-5828-457d-9a55-323d9bd46660 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:29.798920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-728aecdf-5828-457d-9a55-323d9bd46660 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:29.878664 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-728aecdf-5828-457d-9a55-323d9bd46660 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/ips" status: 200 len: 144 microversion: 2.1 time: 0.643996 Aug 18 11:48:29.879477 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2332/4984] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:48:29 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/ips => generated 144 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:48:30.241113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f1428960-f23e-45de-bab0-226ae1df9bf3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:30.241912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f1428960-f23e-45de-bab0-226ae1df9bf3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:30.251403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1428960-f23e-45de-bab0-226ae1df9bf3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:30.259150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1428960-f23e-45de-bab0-226ae1df9bf3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:30.260693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1428960-f23e-45de-bab0-226ae1df9bf3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:30.275086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1428960-f23e-45de-bab0-226ae1df9bf3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:30.276079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1428960-f23e-45de-bab0-226ae1df9bf3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:30.277284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1428960-f23e-45de-bab0-226ae1df9bf3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:30.829152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1c8a292d-716e-4fda-92b0-79cf184678b1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:30.841308 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1c8a292d-716e-4fda-92b0-79cf184678b1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1509 microversion: 2.1 time: 1.399354 Aug 18 11:48:30.847440 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2653/4985] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:29 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1509 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:30.869393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3db105c6-a97d-4b52-9a07-bc33b761f13a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:30.870228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3db105c6-a97d-4b52-9a07-bc33b761f13a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:30.891582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3db105c6-a97d-4b52-9a07-bc33b761f13a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:30.892894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3db105c6-a97d-4b52-9a07-bc33b761f13a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:30.894613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3db105c6-a97d-4b52-9a07-bc33b761f13a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:30.896722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3db105c6-a97d-4b52-9a07-bc33b761f13a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:30.897237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3db105c6-a97d-4b52-9a07-bc33b761f13a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:30.899678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3db105c6-a97d-4b52-9a07-bc33b761f13a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:31.355964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f1428960-f23e-45de-bab0-226ae1df9bf3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:31.375454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f1428960-f23e-45de-bab0-226ae1df9bf3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:31.379931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f1428960-f23e-45de-bab0-226ae1df9bf3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:31.382847 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f1428960-f23e-45de-bab0-226ae1df9bf3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 1.146023 Aug 18 11:48:31.402853 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2333/4986] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:30 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:31.752242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3db105c6-a97d-4b52-9a07-bc33b761f13a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:31.782881 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3db105c6-a97d-4b52-9a07-bc33b761f13a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1509 microversion: 2.1 time: 0.915942 Aug 18 11:48:31.784541 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2654/4987] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:30 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1509 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:31.825731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-82b250ad-5245-48f6-b509-39d6d2c0eb89 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:31.827984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-82b250ad-5245-48f6-b509-39d6d2c0eb89 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:31.856561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82b250ad-5245-48f6-b509-39d6d2c0eb89 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:31.862720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82b250ad-5245-48f6-b509-39d6d2c0eb89 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:31.863864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82b250ad-5245-48f6-b509-39d6d2c0eb89 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:31.866589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82b250ad-5245-48f6-b509-39d6d2c0eb89 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:31.868416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82b250ad-5245-48f6-b509-39d6d2c0eb89 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:31.870781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-82b250ad-5245-48f6-b509-39d6d2c0eb89 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:31.997603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-82b250ad-5245-48f6-b509-39d6d2c0eb89 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:48:32.237674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=8 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:32.364108 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-82b250ad-5245-48f6-b509-39d6d2c0eb89 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 204 len: 0 microversion: 2.1 time: 0.550043 Aug 18 11:48:32.371913 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2334/4988] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:48:31 2022] DELETE /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:48:32.384711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8345d61-b15a-4021-afc8-cd03dfb48c73 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:32.386238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e8345d61-b15a-4021-afc8-cd03dfb48c73 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:32.401984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8345d61-b15a-4021-afc8-cd03dfb48c73 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:32.411806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-37c0e3ac-2e15-4445-a1ac-81019d9b37a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:32.412683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-37c0e3ac-2e15-4445-a1ac-81019d9b37a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:32.413277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8345d61-b15a-4021-afc8-cd03dfb48c73 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:32.414673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8345d61-b15a-4021-afc8-cd03dfb48c73 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:32.417514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8345d61-b15a-4021-afc8-cd03dfb48c73 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:32.424066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8345d61-b15a-4021-afc8-cd03dfb48c73 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:32.424884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8345d61-b15a-4021-afc8-cd03dfb48c73 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:32.442673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37c0e3ac-2e15-4445-a1ac-81019d9b37a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:32.443476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37c0e3ac-2e15-4445-a1ac-81019d9b37a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:32.446735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37c0e3ac-2e15-4445-a1ac-81019d9b37a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:32.448074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37c0e3ac-2e15-4445-a1ac-81019d9b37a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:32.449889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37c0e3ac-2e15-4445-a1ac-81019d9b37a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:32.454619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37c0e3ac-2e15-4445-a1ac-81019d9b37a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:33.418481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-37c0e3ac-2e15-4445-a1ac-81019d9b37a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:33.452149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-37c0e3ac-2e15-4445-a1ac-81019d9b37a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:33.468092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-37c0e3ac-2e15-4445-a1ac-81019d9b37a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:33.472258 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-37c0e3ac-2e15-4445-a1ac-81019d9b37a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 1.066458 Aug 18 11:48:33.492707 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2335/4989] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:32 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:34.094148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0b0c1feb-759d-4674-ba19-ba3d498ede68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50005913-250a-4660-9401-3c219a28c551"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:34.097073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0b0c1feb-759d-4674-ba19-ba3d498ede68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:34.104795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b0c1feb-759d-4674-ba19-ba3d498ede68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:34.105648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b0c1feb-759d-4674-ba19-ba3d498ede68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:34.106254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b0c1feb-759d-4674-ba19-ba3d498ede68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:34.107208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b0c1feb-759d-4674-ba19-ba3d498ede68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:34.107836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b0c1feb-759d-4674-ba19-ba3d498ede68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:34.108428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0b0c1feb-759d-4674-ba19-ba3d498ede68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:34.319046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e8345d61-b15a-4021-afc8-cd03dfb48c73 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:34.327692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:34.336788 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e8345d61-b15a-4021-afc8-cd03dfb48c73 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1515 microversion: 2.1 time: 1.961476 Aug 18 11:48:34.340654 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2655/4990] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:32 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1515 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:34.502514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f4eb9f6b-5ba8-48e9-8886-c5fcc3759ddc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:34.503473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f4eb9f6b-5ba8-48e9-8886-c5fcc3759ddc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:34.533224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4eb9f6b-5ba8-48e9-8886-c5fcc3759ddc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:34.535555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4eb9f6b-5ba8-48e9-8886-c5fcc3759ddc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:34.541629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4eb9f6b-5ba8-48e9-8886-c5fcc3759ddc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:34.544647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4eb9f6b-5ba8-48e9-8886-c5fcc3759ddc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:34.545321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4eb9f6b-5ba8-48e9-8886-c5fcc3759ddc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:34.547532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4eb9f6b-5ba8-48e9-8886-c5fcc3759ddc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:34.623189 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0b0c1feb-759d-4674-ba19-ba3d498ede68 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "POST /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.532693 Aug 18 11:48:34.633660 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2336/4991] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:48:34 2022] POST /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments => generated 194 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:48:35.339859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f4eb9f6b-5ba8-48e9-8886-c5fcc3759ddc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:35.366003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f4eb9f6b-5ba8-48e9-8886-c5fcc3759ddc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:35.368254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f4eb9f6b-5ba8-48e9-8886-c5fcc3759ddc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:35.375143 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5c7abaaa-7c7d-46da-945e-f686e8d49779 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:35.377028 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f4eb9f6b-5ba8-48e9-8886-c5fcc3759ddc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.882160 Aug 18 11:48:35.377264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5c7abaaa-7c7d-46da-945e-f686e8d49779 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:35.381342 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2656/4992] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:34 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:48:35.400380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c7abaaa-7c7d-46da-945e-f686e8d49779 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:35.400986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c7abaaa-7c7d-46da-945e-f686e8d49779 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:35.401452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c7abaaa-7c7d-46da-945e-f686e8d49779 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:35.414092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c7abaaa-7c7d-46da-945e-f686e8d49779 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:35.414869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c7abaaa-7c7d-46da-945e-f686e8d49779 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:35.415352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5c7abaaa-7c7d-46da-945e-f686e8d49779 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:35.583395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-be3d72a5-3e58-4f4d-9ca0-b3bd4c200863 req-f2dfd365-5b95-4422-ad3e-b7f3116ecf9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9c9732-0341-44a6-a88c-ad6904ec6912", "name": "network-vif-deleted", "tag": "2465be05-dd5e-41f7-99a4-45cf0f4237ca"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:35.616097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-be3d72a5-3e58-4f4d-9ca0-b3bd4c200863 req-f2dfd365-5b95-4422-ad3e-b7f3116ecf9f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:35.617385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-be3d72a5-3e58-4f4d-9ca0-b3bd4c200863 req-f2dfd365-5b95-4422-ad3e-b7f3116ecf9f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:35.619288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-be3d72a5-3e58-4f4d-9ca0-b3bd4c200863 req-f2dfd365-5b95-4422-ad3e-b7f3116ecf9f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:35.662797 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-be3d72a5-3e58-4f4d-9ca0-b3bd4c200863 req-f2dfd365-5b95-4422-ad3e-b7f3116ecf9f service nova] Creating event network-vif-deleted:2465be05-dd5e-41f7-99a4-45cf0f4237ca for instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 on n-h2-853611-3 Aug 18 11:48:35.676371 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-be3d72a5-3e58-4f4d-9ca0-b3bd4c200863 req-f2dfd365-5b95-4422-ad3e-b7f3116ecf9f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097523 Aug 18 11:48:35.677730 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2657/4993] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:48:35.689791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5c7abaaa-7c7d-46da-945e-f686e8d49779 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:35.732242 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5c7abaaa-7c7d-46da-945e-f686e8d49779 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 200 len: 1473 microversion: 2.1 time: 0.363494 Aug 18 11:48:35.733839 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2337/4994] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:35 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 1473 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:48:36.433210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-78e5a3cf-82c7-4239-9d7c-7dac8e881b0b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:36.434064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-78e5a3cf-82c7-4239-9d7c-7dac8e881b0b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:36.463729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78e5a3cf-82c7-4239-9d7c-7dac8e881b0b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:36.464342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78e5a3cf-82c7-4239-9d7c-7dac8e881b0b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:36.471356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78e5a3cf-82c7-4239-9d7c-7dac8e881b0b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:36.472550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78e5a3cf-82c7-4239-9d7c-7dac8e881b0b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:36.473055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78e5a3cf-82c7-4239-9d7c-7dac8e881b0b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:36.478662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78e5a3cf-82c7-4239-9d7c-7dac8e881b0b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:36.771053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b09ae9bf-85d0-4fc4-b705-ce002c9f3e3e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:36.771665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b09ae9bf-85d0-4fc4-b705-ce002c9f3e3e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:36.801550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b09ae9bf-85d0-4fc4-b705-ce002c9f3e3e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:36.803614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b09ae9bf-85d0-4fc4-b705-ce002c9f3e3e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:36.804818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b09ae9bf-85d0-4fc4-b705-ce002c9f3e3e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:36.807737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b09ae9bf-85d0-4fc4-b705-ce002c9f3e3e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:36.810408 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b09ae9bf-85d0-4fc4-b705-ce002c9f3e3e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:36.811643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b09ae9bf-85d0-4fc4-b705-ce002c9f3e3e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:36.864109 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-b09ae9bf-85d0-4fc4-b705-ce002c9f3e3e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b09ae9bf-85d0-4fc4-b705-ce002c9f3e3e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 HTTP/1.1 Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '8d9c9732-0341-44a6-a88c-ad6904ec6912'} Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:36.868655 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:48:36.881182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:48:36.881182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:48:36.881182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:48:36.881182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:48:36.881182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:48:36.881182 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:48:36.884000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b09ae9bf-85d0-4fc4-b705-ce002c9f3e3e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:48:36.887237 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b09ae9bf-85d0-4fc4-b705-ce002c9f3e3e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 404 len: 111 microversion: 2.1 time: 0.121149 Aug 18 11:48:36.887237 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2338/4995] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:36 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:48:37.481475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-217602288", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "748eeef0-4e88-4443-abac-e79de3b3bb2a"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:37.707398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] validate_networks() for [('748eeef0-4e88-4443-abac-e79de3b3bb2a', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:48:38.246158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-78e5a3cf-82c7-4239-9d7c-7dac8e881b0b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:38.270387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-78e5a3cf-82c7-4239-9d7c-7dac8e881b0b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:38.288313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-78e5a3cf-82c7-4239-9d7c-7dac8e881b0b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:38.294613 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-78e5a3cf-82c7-4239-9d7c-7dac8e881b0b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 1.861930 Aug 18 11:48:38.295396 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2658/4996] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:36 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:48:39.436139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1760771116", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": "none"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:39.644049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:48:39.645374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:48:39.649518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:48:39.656534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:48:39.670687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:48:39.718687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:39.719179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:39.719648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:39.720490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:39.720975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:39.722214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:39.823966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Getting quotas for project 9f0668e316c042ae8dc6e619bf91e146. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:48:39.832774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Getting quotas for user 2effd9b78906421eb0849500cb7095ee and project 9f0668e316c042ae8dc6e619bf91e146. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:48:39.854760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:48:39.859139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:48:39.860492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:48:39.861789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:48:39.863434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:48:39.943728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:48:39.944400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:39.945710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:39.957553 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:39.962420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:39.965853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:39.967174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:48:39.968750 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:40.097046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:48:40.149916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Getting quotas for user c850b0a836124d90b7e50fe8b9fdf011 and project b8c07d0bce064140850194469cc81e9c. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:48:40.212147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:48:40.224983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:48:40.276204 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-773086c6-6eb6-4580-b85b-31cbc38caca7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.557841 Aug 18 11:48:40.294899 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2659/4997] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:48:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 18 11:48:40.328107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de103a4d-f3e0-4186-b889-58fb1db50cac tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:40.335672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-de103a4d-f3e0-4186-b889-58fb1db50cac tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:40.380487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de103a4d-f3e0-4186-b889-58fb1db50cac tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:40.381430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de103a4d-f3e0-4186-b889-58fb1db50cac tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:40.382208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de103a4d-f3e0-4186-b889-58fb1db50cac tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:40.388111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de103a4d-f3e0-4186-b889-58fb1db50cac tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:40.389694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de103a4d-f3e0-4186-b889-58fb1db50cac tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:40.392795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de103a4d-f3e0-4186-b889-58fb1db50cac tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:40.488104 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-726617e8-ad95-4667-8f9e-8733471bee77 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.009588 Aug 18 11:48:40.521268 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2339/4998] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:48:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:48:40.571688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-bb328b69-f78b-4aeb-8c6b-7e3888a24dd3 req-912f9b47-e20a-4337-9aac-6f1e74f334b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1706f34c-3b86-4298-be5a-126d7bfeba56", "name": "network-vif-plugged", "status": "completed", "tag": "7d0067d8-be65-40dd-bc5c-64a302b5b9c1"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:40.645982 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bb328b69-f78b-4aeb-8c6b-7e3888a24dd3 req-912f9b47-e20a-4337-9aac-6f1e74f334b9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:40.646893 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bb328b69-f78b-4aeb-8c6b-7e3888a24dd3 req-912f9b47-e20a-4337-9aac-6f1e74f334b9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:40.649874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-bb328b69-f78b-4aeb-8c6b-7e3888a24dd3 req-912f9b47-e20a-4337-9aac-6f1e74f334b9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:40.741866 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-bb328b69-f78b-4aeb-8c6b-7e3888a24dd3 req-912f9b47-e20a-4337-9aac-6f1e74f334b9 service nova] Creating event network-vif-plugged:7d0067d8-be65-40dd-bc5c-64a302b5b9c1 for instance 1706f34c-3b86-4298-be5a-126d7bfeba56 on n-h1-853611-3 Aug 18 11:48:40.771097 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-bb328b69-f78b-4aeb-8c6b-7e3888a24dd3 req-912f9b47-e20a-4337-9aac-6f1e74f334b9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237506 Aug 18 11:48:40.785571 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2340/4999] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:48:40.811149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-67c9a44a-c097-4ea9-ba60-a3d278983421 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:40.816248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-67c9a44a-c097-4ea9-ba60-a3d278983421 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:41.401371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-de103a4d-f3e0-4186-b889-58fb1db50cac tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:41.431359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-de103a4d-f3e0-4186-b889-58fb1db50cac tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:41.445830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-de103a4d-f3e0-4186-b889-58fb1db50cac tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:41.448134 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de103a4d-f3e0-4186-b889-58fb1db50cac tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 1.151234 Aug 18 11:48:41.453160 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2660/5000] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:40 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:41.482630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-337d914b-85bd-49a3-bc17-36a7c3c91c65 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:41.492319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-337d914b-85bd-49a3-bc17-36a7c3c91c65 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:41.728667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-67c9a44a-c097-4ea9-ba60-a3d278983421 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:41.765221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-67c9a44a-c097-4ea9-ba60-a3d278983421 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:41.771343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-67c9a44a-c097-4ea9-ba60-a3d278983421 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:41.777229 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-67c9a44a-c097-4ea9-ba60-a3d278983421 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1278 microversion: 2.54 time: 0.984222 Aug 18 11:48:41.778856 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2341/5001] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:40 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1278 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:41.853043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-337d914b-85bd-49a3-bc17-36a7c3c91c65 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:41.891500 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-337d914b-85bd-49a3-bc17-36a7c3c91c65 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1208 microversion: 2.1 time: 0.423136 Aug 18 11:48:41.899905 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2661/5002] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:41 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1208 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:42.493659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3f11e9ab-420d-4b8f-9148-035e543b13a9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:42.498703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3f11e9ab-420d-4b8f-9148-035e543b13a9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:42.538383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f11e9ab-420d-4b8f-9148-035e543b13a9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:42.547986 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f11e9ab-420d-4b8f-9148-035e543b13a9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:42.549970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f11e9ab-420d-4b8f-9148-035e543b13a9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:42.554732 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f11e9ab-420d-4b8f-9148-035e543b13a9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:42.558822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f11e9ab-420d-4b8f-9148-035e543b13a9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:42.561632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f11e9ab-420d-4b8f-9148-035e543b13a9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:42.813871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cec3ce16-e079-4c08-b9bf-8e1f4b561ec6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:42.818870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cec3ce16-e079-4c08-b9bf-8e1f4b561ec6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:42.845935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cec3ce16-e079-4c08-b9bf-8e1f4b561ec6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:42.849610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cec3ce16-e079-4c08-b9bf-8e1f4b561ec6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:42.852634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cec3ce16-e079-4c08-b9bf-8e1f4b561ec6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:42.855499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cec3ce16-e079-4c08-b9bf-8e1f4b561ec6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:42.861752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cec3ce16-e079-4c08-b9bf-8e1f4b561ec6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:42.863021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cec3ce16-e079-4c08-b9bf-8e1f4b561ec6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:43.108195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3f11e9ab-420d-4b8f-9148-035e543b13a9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:43.153210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3f11e9ab-420d-4b8f-9148-035e543b13a9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:43.161924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3f11e9ab-420d-4b8f-9148-035e543b13a9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:43.170216 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3f11e9ab-420d-4b8f-9148-035e543b13a9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.682549 Aug 18 11:48:43.179133 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2342/5003] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:42 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:43.208873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5427835b-e270-44a8-aac7-902cd0be371b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:43.219499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5427835b-e270-44a8-aac7-902cd0be371b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:43.235814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5427835b-e270-44a8-aac7-902cd0be371b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:43.236606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5427835b-e270-44a8-aac7-902cd0be371b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:43.237386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5427835b-e270-44a8-aac7-902cd0be371b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:43.260197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5427835b-e270-44a8-aac7-902cd0be371b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:43.261300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5427835b-e270-44a8-aac7-902cd0be371b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:43.262102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5427835b-e270-44a8-aac7-902cd0be371b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:43.298543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:43.463499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cec3ce16-e079-4c08-b9bf-8e1f4b561ec6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:43.486831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cec3ce16-e079-4c08-b9bf-8e1f4b561ec6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:43.509380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cec3ce16-e079-4c08-b9bf-8e1f4b561ec6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:43.519271 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cec3ce16-e079-4c08-b9bf-8e1f4b561ec6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1330 microversion: 2.54 time: 0.710413 Aug 18 11:48:43.519943 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2662/5004] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:42 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1330 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:43.813996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5427835b-e270-44a8-aac7-902cd0be371b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:43.834764 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5427835b-e270-44a8-aac7-902cd0be371b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1204 microversion: 2.1 time: 0.652266 Aug 18 11:48:43.847766 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2343/5005] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:43 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1204 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:44.195019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-262f6b1c-96d8-44f8-886e-43640fb14964 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:44.195645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-262f6b1c-96d8-44f8-886e-43640fb14964 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:44.223046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-262f6b1c-96d8-44f8-886e-43640fb14964 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:44.224381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-262f6b1c-96d8-44f8-886e-43640fb14964 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:44.227496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-262f6b1c-96d8-44f8-886e-43640fb14964 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:44.231363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-262f6b1c-96d8-44f8-886e-43640fb14964 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:44.236191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-262f6b1c-96d8-44f8-886e-43640fb14964 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:44.237870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-262f6b1c-96d8-44f8-886e-43640fb14964 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:44.547566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-103dba34-2dd9-42b0-b14d-b9b09fda3f08 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:44.548230 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-103dba34-2dd9-42b0-b14d-b9b09fda3f08 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:44.562375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-103dba34-2dd9-42b0-b14d-b9b09fda3f08 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:44.563037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-103dba34-2dd9-42b0-b14d-b9b09fda3f08 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:44.565078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-103dba34-2dd9-42b0-b14d-b9b09fda3f08 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:44.566913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-103dba34-2dd9-42b0-b14d-b9b09fda3f08 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:44.569153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-103dba34-2dd9-42b0-b14d-b9b09fda3f08 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:44.571688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-103dba34-2dd9-42b0-b14d-b9b09fda3f08 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:44.760898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-262f6b1c-96d8-44f8-886e-43640fb14964 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:44.775073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-262f6b1c-96d8-44f8-886e-43640fb14964 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:44.786280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-262f6b1c-96d8-44f8-886e-43640fb14964 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:44.794019 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-262f6b1c-96d8-44f8-886e-43640fb14964 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1808 microversion: 2.20 time: 0.603512 Aug 18 11:48:44.799545 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2663/5006] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:44 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1808 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:44.883497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d7f905c1-f723-4680-947f-748a90fa6454 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:44.891986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d7f905c1-f723-4680-947f-748a90fa6454 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:44.926178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7f905c1-f723-4680-947f-748a90fa6454 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:44.929851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7f905c1-f723-4680-947f-748a90fa6454 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:44.930925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7f905c1-f723-4680-947f-748a90fa6454 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:44.936673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7f905c1-f723-4680-947f-748a90fa6454 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:44.937605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7f905c1-f723-4680-947f-748a90fa6454 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:44.938306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7f905c1-f723-4680-947f-748a90fa6454 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:45.015093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-103dba34-2dd9-42b0-b14d-b9b09fda3f08 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:45.041558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-103dba34-2dd9-42b0-b14d-b9b09fda3f08 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:45.044871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-103dba34-2dd9-42b0-b14d-b9b09fda3f08 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:45.049777 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-103dba34-2dd9-42b0-b14d-b9b09fda3f08 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1336 microversion: 2.54 time: 0.506654 Aug 18 11:48:45.050388 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2344/5007] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:44 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1336 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:48:45.187323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d7f905c1-f723-4680-947f-748a90fa6454 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:45.200845 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d7f905c1-f723-4680-947f-748a90fa6454 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1268 microversion: 2.1 time: 0.332424 Aug 18 11:48:45.219054 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2664/5008] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:44 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1268 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:45.825297 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-835ffc48-e81a-46cc-ac8a-ef10ef2cd2f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:45.826003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-835ffc48-e81a-46cc-ac8a-ef10ef2cd2f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:45.847319 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-835ffc48-e81a-46cc-ac8a-ef10ef2cd2f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:45.848106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-835ffc48-e81a-46cc-ac8a-ef10ef2cd2f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:45.851335 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-835ffc48-e81a-46cc-ac8a-ef10ef2cd2f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:45.853650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-835ffc48-e81a-46cc-ac8a-ef10ef2cd2f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:45.859685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-835ffc48-e81a-46cc-ac8a-ef10ef2cd2f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:45.860483 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-835ffc48-e81a-46cc-ac8a-ef10ef2cd2f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:46.078223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-36ea493c-dd9b-481a-843f-7fbfcc530a80 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:46.078893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-36ea493c-dd9b-481a-843f-7fbfcc530a80 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:46.100890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36ea493c-dd9b-481a-843f-7fbfcc530a80 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:46.101422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36ea493c-dd9b-481a-843f-7fbfcc530a80 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:46.101886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36ea493c-dd9b-481a-843f-7fbfcc530a80 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:46.103410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36ea493c-dd9b-481a-843f-7fbfcc530a80 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:46.104497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36ea493c-dd9b-481a-843f-7fbfcc530a80 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:46.106171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36ea493c-dd9b-481a-843f-7fbfcc530a80 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:46.308980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-36ea493c-dd9b-481a-843f-7fbfcc530a80 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:46.323851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-36ea493c-dd9b-481a-843f-7fbfcc530a80 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:46.326678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-36ea493c-dd9b-481a-843f-7fbfcc530a80 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:46.328269 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-36ea493c-dd9b-481a-843f-7fbfcc530a80 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1336 microversion: 2.54 time: 0.255283 Aug 18 11:48:46.329065 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2665/5009] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:46 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1336 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:46.336745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a9f75ff-8e90-44b4-b7ed-0ea9700a1273 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:46.337626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a9f75ff-8e90-44b4-b7ed-0ea9700a1273 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:46.344834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a9f75ff-8e90-44b4-b7ed-0ea9700a1273 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:46.346569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a9f75ff-8e90-44b4-b7ed-0ea9700a1273 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:46.348064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a9f75ff-8e90-44b4-b7ed-0ea9700a1273 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:46.351109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a9f75ff-8e90-44b4-b7ed-0ea9700a1273 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:46.352411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a9f75ff-8e90-44b4-b7ed-0ea9700a1273 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:46.353171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a9f75ff-8e90-44b4-b7ed-0ea9700a1273 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:46.375785 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-835ffc48-e81a-46cc-ac8a-ef10ef2cd2f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:46.427394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-835ffc48-e81a-46cc-ac8a-ef10ef2cd2f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:46.429801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-835ffc48-e81a-46cc-ac8a-ef10ef2cd2f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:46.436601 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-835ffc48-e81a-46cc-ac8a-ef10ef2cd2f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1795 microversion: 2.20 time: 0.616372 Aug 18 11:48:46.437290 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2345/5010] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:45 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1795 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:46.438499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-835ffc48-e81a-46cc-ac8a-ef10ef2cd2f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:46.439803 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-835ffc48-e81a-46cc-ac8a-ef10ef2cd2f9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001509 Aug 18 11:48:46.451169 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2346/5011] 10.222.0.73 () {56 vars in 886 bytes} [Thu Aug 18 11:48:46 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 18 11:48:46.794836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a9f75ff-8e90-44b4-b7ed-0ea9700a1273 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:46.827257 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a9f75ff-8e90-44b4-b7ed-0ea9700a1273 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1266 microversion: 2.1 time: 0.495249 Aug 18 11:48:46.833608 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2666/5012] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:46 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1266 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:47.356331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-10b31e33-d63c-414c-93fd-6340a079b2d7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:47.357696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-10b31e33-d63c-414c-93fd-6340a079b2d7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:47.379522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10b31e33-d63c-414c-93fd-6340a079b2d7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:47.384434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10b31e33-d63c-414c-93fd-6340a079b2d7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:47.385728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10b31e33-d63c-414c-93fd-6340a079b2d7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:47.388722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10b31e33-d63c-414c-93fd-6340a079b2d7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:47.389488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10b31e33-d63c-414c-93fd-6340a079b2d7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:47.396117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10b31e33-d63c-414c-93fd-6340a079b2d7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:47.862150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d3d3702-d8c4-4362-bbe4-9610b57aeab4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:47.863501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7d3d3702-d8c4-4362-bbe4-9610b57aeab4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:47.873775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d3d3702-d8c4-4362-bbe4-9610b57aeab4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:47.875437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d3d3702-d8c4-4362-bbe4-9610b57aeab4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:47.876251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d3d3702-d8c4-4362-bbe4-9610b57aeab4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:47.877323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d3d3702-d8c4-4362-bbe4-9610b57aeab4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:47.878091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d3d3702-d8c4-4362-bbe4-9610b57aeab4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:47.878943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d3d3702-d8c4-4362-bbe4-9610b57aeab4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:48.041432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-10b31e33-d63c-414c-93fd-6340a079b2d7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:48.064988 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-10b31e33-d63c-414c-93fd-6340a079b2d7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:48.077273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-10b31e33-d63c-414c-93fd-6340a079b2d7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:48.096703 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-10b31e33-d63c-414c-93fd-6340a079b2d7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1357 microversion: 2.54 time: 0.744773 Aug 18 11:48:48.097792 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2347/5013] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:47 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1357 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:48.131404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b450a070-cdb8-4423-a65d-c3a9ff9203b3 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Action: 'create', calling method: .version_select at 0x7f519ec43f70>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1889124716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyM1AYMddMsJ7PXSU/owrUEbEFAB4oZWmGyZfCM3Vyn3DWvRXaaI+/6oXH6azWxn5cn4b6mg67Iky0ZbGTKjsJgekZE+rkr6LjyRYljwnh5sKd61YKJI8XnYRWb3w/8JA=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:48.168212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-b450a070-cdb8-4423-a65d-c3a9ff9203b3 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Getting quotas for project 9f0668e316c042ae8dc6e619bf91e146. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:48:48.181331 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-b450a070-cdb8-4423-a65d-c3a9ff9203b3 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Getting quotas for user 2effd9b78906421eb0849500cb7095ee and project 9f0668e316c042ae8dc6e619bf91e146. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:48:48.242894 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b450a070-cdb8-4423-a65d-c3a9ff9203b3 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.115325 Aug 18 11:48:48.244102 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2348/5014] 10.222.0.73 () {62 vars in 1200 bytes} [Thu Aug 18 11:48:48 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 11:48:48.256676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1889124716", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:48.263035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:48.287587 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:48.289447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:48.290880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:48.292011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:48.292779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:48.293762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:48.447270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:48:48.447947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:48:48.454318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:48:48.454973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:48:48.455690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:48:48.650229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7d3d3702-d8c4-4362-bbe4-9610b57aeab4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:48.657719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:48.662343 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7d3d3702-d8c4-4362-bbe4-9610b57aeab4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1308 microversion: 2.1 time: 0.805330 Aug 18 11:48:48.679584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:48.680889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:48.681665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:48.682656 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:48.683644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:48.684300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:48.692129 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2667/5015] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:47 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1308 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:48.767798 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7b02f4b0-644f-4a7b-9391-a198543212ec tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "POST /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3/action" status: 202 len: 1140 microversion: 2.54 time: 0.515021 Aug 18 11:48:48.797727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-204ed828-5e41-4b06-82b7-df6a5a0ce329 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:48.798554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-204ed828-5e41-4b06-82b7-df6a5a0ce329 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:48.805813 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2349/5016] 10.222.0.73 () {62 vars in 1320 bytes} [Thu Aug 18 11:48:48 2022] POST /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3/action => generated 1140 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 18 11:48:48.813161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-204ed828-5e41-4b06-82b7-df6a5a0ce329 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:48.817011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-204ed828-5e41-4b06-82b7-df6a5a0ce329 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:48.817757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-204ed828-5e41-4b06-82b7-df6a5a0ce329 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:48.818740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-204ed828-5e41-4b06-82b7-df6a5a0ce329 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:48.819623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-204ed828-5e41-4b06-82b7-df6a5a0ce329 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:48.820638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-204ed828-5e41-4b06-82b7-df6a5a0ce329 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:48.978251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-204ed828-5e41-4b06-82b7-df6a5a0ce329 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:49.017521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-204ed828-5e41-4b06-82b7-df6a5a0ce329 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:49.023483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-204ed828-5e41-4b06-82b7-df6a5a0ce329 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:49.024672 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-204ed828-5e41-4b06-82b7-df6a5a0ce329 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.233931 Aug 18 11:48:49.046624 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2668/5017] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:48 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:49.696836 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6ca434ec-d29d-4276-b732-ac80e223ee7f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:49.697460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6ca434ec-d29d-4276-b732-ac80e223ee7f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:49.713171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ca434ec-d29d-4276-b732-ac80e223ee7f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:49.714010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ca434ec-d29d-4276-b732-ac80e223ee7f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:49.714826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ca434ec-d29d-4276-b732-ac80e223ee7f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:49.715971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ca434ec-d29d-4276-b732-ac80e223ee7f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:49.716635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ca434ec-d29d-4276-b732-ac80e223ee7f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:49.717069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ca434ec-d29d-4276-b732-ac80e223ee7f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:50.027660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:50.053266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3be9ad00-5e7f-4432-87d3-dccc680e1780 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:50.053894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3be9ad00-5e7f-4432-87d3-dccc680e1780 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:50.061771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:50.085163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3be9ad00-5e7f-4432-87d3-dccc680e1780 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:50.086545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3be9ad00-5e7f-4432-87d3-dccc680e1780 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:50.087164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3be9ad00-5e7f-4432-87d3-dccc680e1780 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:50.088085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3be9ad00-5e7f-4432-87d3-dccc680e1780 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:50.088815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3be9ad00-5e7f-4432-87d3-dccc680e1780 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:50.092783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3be9ad00-5e7f-4432-87d3-dccc680e1780 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:50.130471 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6ca434ec-d29d-4276-b732-ac80e223ee7f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:50.165811 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6ca434ec-d29d-4276-b732-ac80e223ee7f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1308 microversion: 2.1 time: 0.472487 Aug 18 11:48:50.168099 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2350/5018] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:49 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:50.266639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3be9ad00-5e7f-4432-87d3-dccc680e1780 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:50.297526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3be9ad00-5e7f-4432-87d3-dccc680e1780 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:50.304078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3be9ad00-5e7f-4432-87d3-dccc680e1780 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:50.311617 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3be9ad00-5e7f-4432-87d3-dccc680e1780 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.262187 Aug 18 11:48:50.324357 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2669/5019] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:50 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:48:51.193715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-98105fb7-6c33-4bea-8475-fb0532b0ab4e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:51.196025 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-98105fb7-6c33-4bea-8475-fb0532b0ab4e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:51.221292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98105fb7-6c33-4bea-8475-fb0532b0ab4e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:51.224774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98105fb7-6c33-4bea-8475-fb0532b0ab4e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:51.225428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98105fb7-6c33-4bea-8475-fb0532b0ab4e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:51.228157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98105fb7-6c33-4bea-8475-fb0532b0ab4e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:51.228461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98105fb7-6c33-4bea-8475-fb0532b0ab4e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:51.230019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98105fb7-6c33-4bea-8475-fb0532b0ab4e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:51.312129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-48fb0345-04b2-4615-bd75-e4da8fdb0ec2 req-2ff0c6ea-4cce-4a7a-9f0b-6b7beb919b19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "047c1683-c0b2-4cef-999a-d178bd10a52e", "tag": "a818cc91-5d20-46cf-908e-7b73c19feeae"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:51.349434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-48fb0345-04b2-4615-bd75-e4da8fdb0ec2 req-2ff0c6ea-4cce-4a7a-9f0b-6b7beb919b19 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:51.350117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-48fb0345-04b2-4615-bd75-e4da8fdb0ec2 req-2ff0c6ea-4cce-4a7a-9f0b-6b7beb919b19 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:51.350691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-48fb0345-04b2-4615-bd75-e4da8fdb0ec2 req-2ff0c6ea-4cce-4a7a-9f0b-6b7beb919b19 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:51.374324 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-48fb0345-04b2-4615-bd75-e4da8fdb0ec2 req-2ff0c6ea-4cce-4a7a-9f0b-6b7beb919b19 service nova] Creating event network-changed:a818cc91-5d20-46cf-908e-7b73c19feeae for instance 047c1683-c0b2-4cef-999a-d178bd10a52e on n-h2-853611-3 Aug 18 11:48:51.398376 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-48fb0345-04b2-4615-bd75-e4da8fdb0ec2 req-2ff0c6ea-4cce-4a7a-9f0b-6b7beb919b19 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093689 Aug 18 11:48:51.401834 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2670/5020] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:48:51.409843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-796c3e22-78c0-4514-b1ec-8a13e9079c93 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:51.412626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-796c3e22-78c0-4514-b1ec-8a13e9079c93 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:51.422846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-796c3e22-78c0-4514-b1ec-8a13e9079c93 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:51.424023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-796c3e22-78c0-4514-b1ec-8a13e9079c93 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:51.424727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-796c3e22-78c0-4514-b1ec-8a13e9079c93 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:51.426995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-796c3e22-78c0-4514-b1ec-8a13e9079c93 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:51.427768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-796c3e22-78c0-4514-b1ec-8a13e9079c93 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:51.428460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-796c3e22-78c0-4514-b1ec-8a13e9079c93 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:51.657075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-796c3e22-78c0-4514-b1ec-8a13e9079c93 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:51.696939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-796c3e22-78c0-4514-b1ec-8a13e9079c93 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:51.699095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-796c3e22-78c0-4514-b1ec-8a13e9079c93 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:51.701420 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-796c3e22-78c0-4514-b1ec-8a13e9079c93 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.297483 Aug 18 11:48:51.717605 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2671/5021] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:51 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:51.887051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-98105fb7-6c33-4bea-8475-fb0532b0ab4e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:51.907753 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-98105fb7-6c33-4bea-8475-fb0532b0ab4e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1308 microversion: 2.1 time: 0.716052 Aug 18 11:48:51.908955 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2351/5022] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:51 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1308 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:52.731019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2fad023a-d374-403f-8c88-e2e42c50ab62 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:52.733299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2fad023a-d374-403f-8c88-e2e42c50ab62 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:52.746010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:52.748826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:52.750891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fad023a-d374-403f-8c88-e2e42c50ab62 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:52.751700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fad023a-d374-403f-8c88-e2e42c50ab62 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:52.752532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fad023a-d374-403f-8c88-e2e42c50ab62 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:52.753535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fad023a-d374-403f-8c88-e2e42c50ab62 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:52.755381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fad023a-d374-403f-8c88-e2e42c50ab62 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:52.756316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2fad023a-d374-403f-8c88-e2e42c50ab62 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:52.930216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2fad023a-d374-403f-8c88-e2e42c50ab62 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:52.941692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-84f640df-6d13-411f-a8cc-74ae33361493 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:52.942264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2fad023a-d374-403f-8c88-e2e42c50ab62 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:52.942414 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-84f640df-6d13-411f-a8cc-74ae33361493 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:52.948856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2fad023a-d374-403f-8c88-e2e42c50ab62 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:52.951424 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2fad023a-d374-403f-8c88-e2e42c50ab62 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.229241 Aug 18 11:48:52.954126 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2672/5023] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:52 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:52.974262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84f640df-6d13-411f-a8cc-74ae33361493 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:52.974262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84f640df-6d13-411f-a8cc-74ae33361493 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:52.974262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84f640df-6d13-411f-a8cc-74ae33361493 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:52.974262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84f640df-6d13-411f-a8cc-74ae33361493 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:52.974262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84f640df-6d13-411f-a8cc-74ae33361493 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:52.974262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-84f640df-6d13-411f-a8cc-74ae33361493 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:53.297551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-84f640df-6d13-411f-a8cc-74ae33361493 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:53.315918 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-84f640df-6d13-411f-a8cc-74ae33361493 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1308 microversion: 2.1 time: 0.386163 Aug 18 11:48:53.316679 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2352/5024] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:52 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1308 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:53.977220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-41727ebd-83bf-46cb-9ca2-1e860ab31d1e tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:53.977773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-41727ebd-83bf-46cb-9ca2-1e860ab31d1e tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:53.986722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41727ebd-83bf-46cb-9ca2-1e860ab31d1e tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:53.987227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41727ebd-83bf-46cb-9ca2-1e860ab31d1e tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:53.987665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41727ebd-83bf-46cb-9ca2-1e860ab31d1e tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:53.988557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41727ebd-83bf-46cb-9ca2-1e860ab31d1e tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:53.989176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41727ebd-83bf-46cb-9ca2-1e860ab31d1e tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:53.989625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41727ebd-83bf-46cb-9ca2-1e860ab31d1e tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:54.123283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-41727ebd-83bf-46cb-9ca2-1e860ab31d1e tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:54.132681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-41727ebd-83bf-46cb-9ca2-1e860ab31d1e tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:54.134371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-41727ebd-83bf-46cb-9ca2-1e860ab31d1e tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:54.135994 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-41727ebd-83bf-46cb-9ca2-1e860ab31d1e tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.163052 Aug 18 11:48:54.136657 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2673/5025] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:53 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:54.346172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-730305c4-f650-48c2-8f77-320c9357e8b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:54.348124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-730305c4-f650-48c2-8f77-320c9357e8b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:54.357959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-730305c4-f650-48c2-8f77-320c9357e8b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:54.358710 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-730305c4-f650-48c2-8f77-320c9357e8b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:54.359513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-730305c4-f650-48c2-8f77-320c9357e8b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:54.360733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-730305c4-f650-48c2-8f77-320c9357e8b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:54.361521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-730305c4-f650-48c2-8f77-320c9357e8b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:54.362125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-730305c4-f650-48c2-8f77-320c9357e8b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:54.751648 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-730305c4-f650-48c2-8f77-320c9357e8b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:54.761814 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-730305c4-f650-48c2-8f77-320c9357e8b7 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1308 microversion: 2.1 time: 0.421077 Aug 18 11:48:54.762625 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2353/5026] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:54 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:55.163859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0367f3ac-101f-42b2-9cd3-108fc2a9e312 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:55.166872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0367f3ac-101f-42b2-9cd3-108fc2a9e312 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:55.192272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0367f3ac-101f-42b2-9cd3-108fc2a9e312 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:55.196591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0367f3ac-101f-42b2-9cd3-108fc2a9e312 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:55.206577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0367f3ac-101f-42b2-9cd3-108fc2a9e312 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:55.213547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0367f3ac-101f-42b2-9cd3-108fc2a9e312 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:55.214367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0367f3ac-101f-42b2-9cd3-108fc2a9e312 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:55.214993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0367f3ac-101f-42b2-9cd3-108fc2a9e312 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:55.396021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0367f3ac-101f-42b2-9cd3-108fc2a9e312 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:55.407167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0367f3ac-101f-42b2-9cd3-108fc2a9e312 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:55.409823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0367f3ac-101f-42b2-9cd3-108fc2a9e312 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:55.411476 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0367f3ac-101f-42b2-9cd3-108fc2a9e312 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.254026 Aug 18 11:48:55.412554 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2674/5027] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:55 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:48:55.687542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3f4b501d-4f9b-49d1-a37d-38ceae5d2da1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:55.691608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3f4b501d-4f9b-49d1-a37d-38ceae5d2da1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:55.701667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f4b501d-4f9b-49d1-a37d-38ceae5d2da1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:55.702422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f4b501d-4f9b-49d1-a37d-38ceae5d2da1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:55.703077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f4b501d-4f9b-49d1-a37d-38ceae5d2da1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:55.704099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f4b501d-4f9b-49d1-a37d-38ceae5d2da1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:55.704842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f4b501d-4f9b-49d1-a37d-38ceae5d2da1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:55.705422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3f4b501d-4f9b-49d1-a37d-38ceae5d2da1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:55.782860 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3f4b501d-4f9b-49d1-a37d-38ceae5d2da1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099855 Aug 18 11:48:55.789910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8db6d8ac-6d71-41dd-8511-adb3ab60a502 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:55.790751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8db6d8ac-6d71-41dd-8511-adb3ab60a502 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:55.805450 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2354/5028] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:48:55 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:48:55.814806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db6d8ac-6d71-41dd-8511-adb3ab60a502 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:55.816292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db6d8ac-6d71-41dd-8511-adb3ab60a502 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:55.816750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db6d8ac-6d71-41dd-8511-adb3ab60a502 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:55.817479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db6d8ac-6d71-41dd-8511-adb3ab60a502 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:55.823941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db6d8ac-6d71-41dd-8511-adb3ab60a502 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:55.825921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db6d8ac-6d71-41dd-8511-adb3ab60a502 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:55.827754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-39c128ef-7ad8-4c13-bf2a-24d500cd93f4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:55.828427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-39c128ef-7ad8-4c13-bf2a-24d500cd93f4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:55.849843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-39c128ef-7ad8-4c13-bf2a-24d500cd93f4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:55.850336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-39c128ef-7ad8-4c13-bf2a-24d500cd93f4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:55.850873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-39c128ef-7ad8-4c13-bf2a-24d500cd93f4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:55.851605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-39c128ef-7ad8-4c13-bf2a-24d500cd93f4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:55.852060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-39c128ef-7ad8-4c13-bf2a-24d500cd93f4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:55.860462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-39c128ef-7ad8-4c13-bf2a-24d500cd93f4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:55.889935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:55.925964 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-39c128ef-7ad8-4c13-bf2a-24d500cd93f4 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments/50005913-250a-4660-9401-3c219a28c551" status: 200 len: 194 microversion: 2.1 time: 0.119114 Aug 18 11:48:55.933941 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2355/5029] 10.222.0.73 () {58 vars in 1413 bytes} [Thu Aug 18 11:48:55 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments/50005913-250a-4660-9401-3c219a28c551 => generated 194 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:48:56.196168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8db6d8ac-6d71-41dd-8511-adb3ab60a502 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:56.217039 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8db6d8ac-6d71-41dd-8511-adb3ab60a502 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1308 microversion: 2.1 time: 0.431620 Aug 18 11:48:56.217959 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2675/5030] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:55 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:48:56.458610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-10e05008-aad6-437a-a6a7-e6701f1f78b4 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:56.459857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-10e05008-aad6-437a-a6a7-e6701f1f78b4 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:56.516400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10e05008-aad6-437a-a6a7-e6701f1f78b4 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:56.516919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10e05008-aad6-437a-a6a7-e6701f1f78b4 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:56.517372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10e05008-aad6-437a-a6a7-e6701f1f78b4 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:56.518404 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10e05008-aad6-437a-a6a7-e6701f1f78b4 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:56.518912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10e05008-aad6-437a-a6a7-e6701f1f78b4 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:56.526695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-10e05008-aad6-437a-a6a7-e6701f1f78b4 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:56.707173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-10e05008-aad6-437a-a6a7-e6701f1f78b4 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:56.719954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-10e05008-aad6-437a-a6a7-e6701f1f78b4 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:56.722827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-10e05008-aad6-437a-a6a7-e6701f1f78b4 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:56.726067 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-10e05008-aad6-437a-a6a7-e6701f1f78b4 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.290209 Aug 18 11:48:56.733141 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2356/5031] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:56 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:57.254989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab56c3f9-8b04-47b1-bcac-5ef264390103 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:57.255534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ab56c3f9-8b04-47b1-bcac-5ef264390103 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:57.275665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab56c3f9-8b04-47b1-bcac-5ef264390103 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:57.276901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab56c3f9-8b04-47b1-bcac-5ef264390103 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:57.277868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab56c3f9-8b04-47b1-bcac-5ef264390103 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:57.278925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab56c3f9-8b04-47b1-bcac-5ef264390103 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:57.279473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab56c3f9-8b04-47b1-bcac-5ef264390103 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:57.280043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab56c3f9-8b04-47b1-bcac-5ef264390103 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:57.704892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ab56c3f9-8b04-47b1-bcac-5ef264390103 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:57.717695 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab56c3f9-8b04-47b1-bcac-5ef264390103 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1308 microversion: 2.1 time: 0.466263 Aug 18 11:48:57.719964 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2676/5032] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:57 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1308 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:57.767579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f86c1beb-68c2-4673-9c03-5769aa15194b tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:57.768400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f86c1beb-68c2-4673-9c03-5769aa15194b tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:57.783106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:57.784621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f86c1beb-68c2-4673-9c03-5769aa15194b tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:57.785152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f86c1beb-68c2-4673-9c03-5769aa15194b tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:57.785621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f86c1beb-68c2-4673-9c03-5769aa15194b tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:57.786353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f86c1beb-68c2-4673-9c03-5769aa15194b tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:57.786920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f86c1beb-68c2-4673-9c03-5769aa15194b tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:57.787355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f86c1beb-68c2-4673-9c03-5769aa15194b tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:58.005303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f86c1beb-68c2-4673-9c03-5769aa15194b tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:58.018838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f86c1beb-68c2-4673-9c03-5769aa15194b tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:58.020863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f86c1beb-68c2-4673-9c03-5769aa15194b tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:58.022456 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f86c1beb-68c2-4673-9c03-5769aa15194b tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.265034 Aug 18 11:48:58.023267 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2357/5033] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:57 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:48:58.741791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f89ac78-b3ed-4e68-b52a-636993d0c541 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:58.742499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7f89ac78-b3ed-4e68-b52a-636993d0c541 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:58.754669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f89ac78-b3ed-4e68-b52a-636993d0c541 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:58.755314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f89ac78-b3ed-4e68-b52a-636993d0c541 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:58.756113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f89ac78-b3ed-4e68-b52a-636993d0c541 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:58.756722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f89ac78-b3ed-4e68-b52a-636993d0c541 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:58.757105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f89ac78-b3ed-4e68-b52a-636993d0c541 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:58.757540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f89ac78-b3ed-4e68-b52a-636993d0c541 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:58.967337 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-58eec6c1-e7a8-45d3-8487-eb2da7919c5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb129c7a-a5ae-40ed-81d9-e91d3131f4ac"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:58.970469 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-58eec6c1-e7a8-45d3-8487-eb2da7919c5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:58.976823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=12 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:58.981765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58eec6c1-e7a8-45d3-8487-eb2da7919c5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:58.982962 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58eec6c1-e7a8-45d3-8487-eb2da7919c5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:58.983963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58eec6c1-e7a8-45d3-8487-eb2da7919c5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:58.985388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58eec6c1-e7a8-45d3-8487-eb2da7919c5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:58.986421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58eec6c1-e7a8-45d3-8487-eb2da7919c5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:58.988870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-58eec6c1-e7a8-45d3-8487-eb2da7919c5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:59.320867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7f89ac78-b3ed-4e68-b52a-636993d0c541 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:59.344739 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7f89ac78-b3ed-4e68-b52a-636993d0c541 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1308 microversion: 2.1 time: 0.606757 Aug 18 11:48:59.352761 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2677/5034] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:48:58 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1308 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:48:59.367116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7c1efb90-0a19-4c82-a573-513d1606e503 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:48:59.377566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7c1efb90-0a19-4c82-a573-513d1606e503 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:48:59.406264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c1efb90-0a19-4c82-a573-513d1606e503 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:59.407669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c1efb90-0a19-4c82-a573-513d1606e503 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:59.413093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c1efb90-0a19-4c82-a573-513d1606e503 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:59.414927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c1efb90-0a19-4c82-a573-513d1606e503 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:59.418787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c1efb90-0a19-4c82-a573-513d1606e503 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:59.421569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c1efb90-0a19-4c82-a573-513d1606e503 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:59.428269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:48:59.489372 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-58eec6c1-e7a8-45d3-8487-eb2da7919c5e tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "POST /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526787 Aug 18 11:48:59.512314 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2358/5035] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:48:58 2022] POST /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments => generated 194 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:48:59.531154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-e1c1b838-0aef-4e35-8be5-7f4f6b3e01c6 req-e7aa9cd4-658b-43ab-b3a6-a77d120ddd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "047c1683-c0b2-4cef-999a-d178bd10a52e", "name": "network-vif-plugged", "status": "completed", "tag": "a818cc91-5d20-46cf-908e-7b73c19feeae"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:48:59.581497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e1c1b838-0aef-4e35-8be5-7f4f6b3e01c6 req-e7aa9cd4-658b-43ab-b3a6-a77d120ddd27 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:48:59.585974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e1c1b838-0aef-4e35-8be5-7f4f6b3e01c6 req-e7aa9cd4-658b-43ab-b3a6-a77d120ddd27 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:48:59.587131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-e1c1b838-0aef-4e35-8be5-7f4f6b3e01c6 req-e7aa9cd4-658b-43ab-b3a6-a77d120ddd27 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:48:59.629154 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-e1c1b838-0aef-4e35-8be5-7f4f6b3e01c6 req-e7aa9cd4-658b-43ab-b3a6-a77d120ddd27 service nova] Creating event network-vif-plugged:a818cc91-5d20-46cf-908e-7b73c19feeae for instance 047c1683-c0b2-4cef-999a-d178bd10a52e on n-h2-853611-3 Aug 18 11:48:59.640198 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-e1c1b838-0aef-4e35-8be5-7f4f6b3e01c6 req-e7aa9cd4-658b-43ab-b3a6-a77d120ddd27 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129380 Aug 18 11:48:59.644578 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2359/5036] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:48:59.732577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c1efb90-0a19-4c82-a573-513d1606e503 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:59.748096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c1efb90-0a19-4c82-a573-513d1606e503 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:59.750478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c1efb90-0a19-4c82-a573-513d1606e503 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:48:59.755289 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7c1efb90-0a19-4c82-a573-513d1606e503 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.400894 Aug 18 11:48:59.758129 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2678/5037] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:48:59 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:00.390028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e6690a7f-8782-4157-8149-6ba053530eb2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:00.390798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e6690a7f-8782-4157-8149-6ba053530eb2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:00.410034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6690a7f-8782-4157-8149-6ba053530eb2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:00.412604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6690a7f-8782-4157-8149-6ba053530eb2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:00.413263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6690a7f-8782-4157-8149-6ba053530eb2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:00.414768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6690a7f-8782-4157-8149-6ba053530eb2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:00.422543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6690a7f-8782-4157-8149-6ba053530eb2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:00.423999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6690a7f-8782-4157-8149-6ba053530eb2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:00.759683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e6690a7f-8782-4157-8149-6ba053530eb2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:00.782079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-30d38e0d-99ab-45ed-8e22-21a5319c1e2a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:00.782839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-30d38e0d-99ab-45ed-8e22-21a5319c1e2a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:00.784615 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e6690a7f-8782-4157-8149-6ba053530eb2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1308 microversion: 2.1 time: 0.396903 Aug 18 11:49:00.788265 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2360/5038] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:00 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1308 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:00.795835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d38e0d-99ab-45ed-8e22-21a5319c1e2a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:00.800707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d38e0d-99ab-45ed-8e22-21a5319c1e2a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:00.801654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d38e0d-99ab-45ed-8e22-21a5319c1e2a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:00.802696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d38e0d-99ab-45ed-8e22-21a5319c1e2a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:00.803463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d38e0d-99ab-45ed-8e22-21a5319c1e2a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:00.804147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d38e0d-99ab-45ed-8e22-21a5319c1e2a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:01.016872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-30d38e0d-99ab-45ed-8e22-21a5319c1e2a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:01.035362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-30d38e0d-99ab-45ed-8e22-21a5319c1e2a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:01.036696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-30d38e0d-99ab-45ed-8e22-21a5319c1e2a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:01.041649 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-30d38e0d-99ab-45ed-8e22-21a5319c1e2a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.263904 Aug 18 11:49:01.042915 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2679/5039] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:00 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:49:01.814798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-70e7df51-4618-49be-ab42-8fa3b4042aa4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:01.815519 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-70e7df51-4618-49be-ab42-8fa3b4042aa4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:01.836512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-70e7df51-4618-49be-ab42-8fa3b4042aa4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:01.837023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-70e7df51-4618-49be-ab42-8fa3b4042aa4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:01.845866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-70e7df51-4618-49be-ab42-8fa3b4042aa4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:01.850753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-70e7df51-4618-49be-ab42-8fa3b4042aa4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:01.851265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-70e7df51-4618-49be-ab42-8fa3b4042aa4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:01.851719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-70e7df51-4618-49be-ab42-8fa3b4042aa4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:02.071127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f330ef04-7a14-43cd-9f3c-65adb8b2ab15 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:02.076740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f330ef04-7a14-43cd-9f3c-65adb8b2ab15 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:02.101350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f330ef04-7a14-43cd-9f3c-65adb8b2ab15 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:02.101885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f330ef04-7a14-43cd-9f3c-65adb8b2ab15 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:02.102291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f330ef04-7a14-43cd-9f3c-65adb8b2ab15 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:02.107493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f330ef04-7a14-43cd-9f3c-65adb8b2ab15 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:02.107978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f330ef04-7a14-43cd-9f3c-65adb8b2ab15 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:02.113223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f330ef04-7a14-43cd-9f3c-65adb8b2ab15 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:02.288621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f330ef04-7a14-43cd-9f3c-65adb8b2ab15 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:02.314471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f330ef04-7a14-43cd-9f3c-65adb8b2ab15 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:02.325366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f330ef04-7a14-43cd-9f3c-65adb8b2ab15 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:02.331392 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f330ef04-7a14-43cd-9f3c-65adb8b2ab15 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.264105 Aug 18 11:49:02.336143 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2680/5040] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:02 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:02.462626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-70e7df51-4618-49be-ab42-8fa3b4042aa4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:02.477226 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-70e7df51-4618-49be-ab42-8fa3b4042aa4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1488 microversion: 2.1 time: 0.668987 Aug 18 11:49:02.479258 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2361/5041] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:01 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1488 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:02.507430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-86e57e12-74c8-4cca-822b-6a0228c21652 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-483781486"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:49:02.510793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-86e57e12-74c8-4cca-822b-6a0228c21652 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:02.537256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86e57e12-74c8-4cca-822b-6a0228c21652 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:02.538112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86e57e12-74c8-4cca-822b-6a0228c21652 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:02.540541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86e57e12-74c8-4cca-822b-6a0228c21652 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:02.542450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86e57e12-74c8-4cca-822b-6a0228c21652 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:02.546420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86e57e12-74c8-4cca-822b-6a0228c21652 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:02.548622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86e57e12-74c8-4cca-822b-6a0228c21652 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:02.815729 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-86e57e12-74c8-4cca-822b-6a0228c21652 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "PUT /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1073 microversion: 2.1 time: 0.314468 Aug 18 11:49:02.817646 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2681/5042] 10.222.0.73 () {60 vars in 1256 bytes} [Thu Aug 18 11:49:02 2022] PUT /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1073 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:49:02.836748 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a0ae4a07-d00c-4305-b36f-8d1863d02cdd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:02.837419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a0ae4a07-d00c-4305-b36f-8d1863d02cdd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:02.865137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0ae4a07-d00c-4305-b36f-8d1863d02cdd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:02.867511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0ae4a07-d00c-4305-b36f-8d1863d02cdd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:02.869764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0ae4a07-d00c-4305-b36f-8d1863d02cdd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:02.874724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0ae4a07-d00c-4305-b36f-8d1863d02cdd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:02.875979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0ae4a07-d00c-4305-b36f-8d1863d02cdd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:02.876685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a0ae4a07-d00c-4305-b36f-8d1863d02cdd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:03.359376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab7f60a1-261a-4464-9343-2f2fcdc28eb7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:03.360767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ab7f60a1-261a-4464-9343-2f2fcdc28eb7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:03.377996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab7f60a1-261a-4464-9343-2f2fcdc28eb7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:03.378748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab7f60a1-261a-4464-9343-2f2fcdc28eb7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:03.379735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab7f60a1-261a-4464-9343-2f2fcdc28eb7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:03.384665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab7f60a1-261a-4464-9343-2f2fcdc28eb7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:03.385664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab7f60a1-261a-4464-9343-2f2fcdc28eb7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:03.386404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab7f60a1-261a-4464-9343-2f2fcdc28eb7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:03.684883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ab7f60a1-261a-4464-9343-2f2fcdc28eb7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:03.710091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ab7f60a1-261a-4464-9343-2f2fcdc28eb7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:03.714842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ab7f60a1-261a-4464-9343-2f2fcdc28eb7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:03.720192 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab7f60a1-261a-4464-9343-2f2fcdc28eb7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.364351 Aug 18 11:49:03.734362 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2682/5043] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:03 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:03.754729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a0ae4a07-d00c-4305-b36f-8d1863d02cdd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:03.767569 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a0ae4a07-d00c-4305-b36f-8d1863d02cdd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1499 microversion: 2.1 time: 0.937464 Aug 18 11:49:03.768167 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2362/5044] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:02 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1499 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:03.792776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03646441-6f6e-4212-ab1c-5efeb1eb987e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:03.793657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-03646441-6f6e-4212-ab1c-5efeb1eb987e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:03.810868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03646441-6f6e-4212-ab1c-5efeb1eb987e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:03.812569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03646441-6f6e-4212-ab1c-5efeb1eb987e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:03.816431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03646441-6f6e-4212-ab1c-5efeb1eb987e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:03.817579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03646441-6f6e-4212-ab1c-5efeb1eb987e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:03.818212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03646441-6f6e-4212-ab1c-5efeb1eb987e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:03.818897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03646441-6f6e-4212-ab1c-5efeb1eb987e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:04.083978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-03646441-6f6e-4212-ab1c-5efeb1eb987e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:04.096028 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-03646441-6f6e-4212-ab1c-5efeb1eb987e tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1499 microversion: 2.1 time: 0.308717 Aug 18 11:49:04.120363 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2683/5045] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:03 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1499 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:04.124152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c9d8cf2f-b5c3-4c5e-9612-80418ecbcdd0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:49:04.146353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c9d8cf2f-b5c3-4c5e-9612-80418ecbcdd0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:04.147215 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c9d8cf2f-b5c3-4c5e-9612-80418ecbcdd0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:04.148563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c9d8cf2f-b5c3-4c5e-9612-80418ecbcdd0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:04.210572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c9d8cf2f-b5c3-4c5e-9612-80418ecbcdd0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Going to try to stop instance {{(pid=122209) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 11:49:04.323340 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c9d8cf2f-b5c3-4c5e-9612-80418ecbcdd0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "POST /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e/action" status: 202 len: 0 microversion: 2.1 time: 0.201267 Aug 18 11:49:04.332706 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2363/5046] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 11:49:04 2022] POST /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:49:04.333358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e46b55b2-27dd-4d78-ad79-c84ab5447f67 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:04.334310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e46b55b2-27dd-4d78-ad79-c84ab5447f67 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:04.349010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e46b55b2-27dd-4d78-ad79-c84ab5447f67 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:04.351132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e46b55b2-27dd-4d78-ad79-c84ab5447f67 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:04.354168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e46b55b2-27dd-4d78-ad79-c84ab5447f67 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:04.355191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e46b55b2-27dd-4d78-ad79-c84ab5447f67 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:04.355871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e46b55b2-27dd-4d78-ad79-c84ab5447f67 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:04.359434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e46b55b2-27dd-4d78-ad79-c84ab5447f67 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:04.715507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e46b55b2-27dd-4d78-ad79-c84ab5447f67 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:04.726452 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e46b55b2-27dd-4d78-ad79-c84ab5447f67 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.397127 Aug 18 11:49:04.730722 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2684/5047] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:04 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:04.752400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-de998598-a56e-451c-81f7-032d7abaa0c6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:04.753388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-de998598-a56e-451c-81f7-032d7abaa0c6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:04.768839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de998598-a56e-451c-81f7-032d7abaa0c6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:04.776880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de998598-a56e-451c-81f7-032d7abaa0c6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:04.777559 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de998598-a56e-451c-81f7-032d7abaa0c6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:04.782157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de998598-a56e-451c-81f7-032d7abaa0c6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:04.783578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de998598-a56e-451c-81f7-032d7abaa0c6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:04.784196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de998598-a56e-451c-81f7-032d7abaa0c6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:05.002839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-de998598-a56e-451c-81f7-032d7abaa0c6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:05.017462 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-de998598-a56e-451c-81f7-032d7abaa0c6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:05.021455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-de998598-a56e-451c-81f7-032d7abaa0c6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:05.023323 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-de998598-a56e-451c-81f7-032d7abaa0c6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.276281 Aug 18 11:49:05.034462 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2364/5048] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:04 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:05.772546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03e419ee-da42-4bef-9aee-c122894c7a38 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:05.773358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-03e419ee-da42-4bef-9aee-c122894c7a38 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:05.792087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03e419ee-da42-4bef-9aee-c122894c7a38 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:05.792598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03e419ee-da42-4bef-9aee-c122894c7a38 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:05.793048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03e419ee-da42-4bef-9aee-c122894c7a38 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:05.793778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03e419ee-da42-4bef-9aee-c122894c7a38 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:05.794239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03e419ee-da42-4bef-9aee-c122894c7a38 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:05.794696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03e419ee-da42-4bef-9aee-c122894c7a38 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:06.049351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-150e4ca8-2c0d-4fd6-a6b0-bd1e930b70ce tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:06.050882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-150e4ca8-2c0d-4fd6-a6b0-bd1e930b70ce tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:06.069445 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-150e4ca8-2c0d-4fd6-a6b0-bd1e930b70ce tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:06.070358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-150e4ca8-2c0d-4fd6-a6b0-bd1e930b70ce tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:06.071179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-150e4ca8-2c0d-4fd6-a6b0-bd1e930b70ce tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:06.071961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-150e4ca8-2c0d-4fd6-a6b0-bd1e930b70ce tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:06.072446 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-150e4ca8-2c0d-4fd6-a6b0-bd1e930b70ce tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:06.073014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-150e4ca8-2c0d-4fd6-a6b0-bd1e930b70ce tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:06.092046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-03e419ee-da42-4bef-9aee-c122894c7a38 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:06.107342 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-03e419ee-da42-4bef-9aee-c122894c7a38 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.339240 Aug 18 11:49:06.110701 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2685/5049] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:05 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:06.253533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-150e4ca8-2c0d-4fd6-a6b0-bd1e930b70ce tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:06.264282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-150e4ca8-2c0d-4fd6-a6b0-bd1e930b70ce tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:06.266795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-150e4ca8-2c0d-4fd6-a6b0-bd1e930b70ce tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:06.272285 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-150e4ca8-2c0d-4fd6-a6b0-bd1e930b70ce tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.229440 Aug 18 11:49:06.298381 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2365/5050] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:06 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:49:07.151955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7caafe42-e10b-4a9d-ad96-ff72bddf40f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:07.152579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7caafe42-e10b-4a9d-ad96-ff72bddf40f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:07.170193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7caafe42-e10b-4a9d-ad96-ff72bddf40f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:07.170834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7caafe42-e10b-4a9d-ad96-ff72bddf40f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:07.171865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7caafe42-e10b-4a9d-ad96-ff72bddf40f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:07.174213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7caafe42-e10b-4a9d-ad96-ff72bddf40f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:07.176831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7caafe42-e10b-4a9d-ad96-ff72bddf40f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:07.177451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7caafe42-e10b-4a9d-ad96-ff72bddf40f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:07.318781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a1bee5db-2b0c-48c9-a49e-ba6289e0738c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:07.325115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a1bee5db-2b0c-48c9-a49e-ba6289e0738c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:07.387576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1bee5db-2b0c-48c9-a49e-ba6289e0738c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:07.391160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1bee5db-2b0c-48c9-a49e-ba6289e0738c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:07.392091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1bee5db-2b0c-48c9-a49e-ba6289e0738c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:07.393053 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1bee5db-2b0c-48c9-a49e-ba6289e0738c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:07.393692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1bee5db-2b0c-48c9-a49e-ba6289e0738c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:07.394603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a1bee5db-2b0c-48c9-a49e-ba6289e0738c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:07.536994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7caafe42-e10b-4a9d-ad96-ff72bddf40f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:07.554689 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7caafe42-e10b-4a9d-ad96-ff72bddf40f4 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.406650 Aug 18 11:49:07.564672 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2686/5051] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:07 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:07.636954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a1bee5db-2b0c-48c9-a49e-ba6289e0738c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:07.649743 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a1bee5db-2b0c-48c9-a49e-ba6289e0738c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:07.654381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a1bee5db-2b0c-48c9-a49e-ba6289e0738c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:07.660943 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a1bee5db-2b0c-48c9-a49e-ba6289e0738c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.350782 Aug 18 11:49:07.661748 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2366/5052] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:07 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:08.578836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d4b0c63a-5da9-4335-a8b0-432b0fdbda27 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:08.580260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d4b0c63a-5da9-4335-a8b0-432b0fdbda27 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:08.607857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4b0c63a-5da9-4335-a8b0-432b0fdbda27 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:08.615804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4b0c63a-5da9-4335-a8b0-432b0fdbda27 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:08.616801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4b0c63a-5da9-4335-a8b0-432b0fdbda27 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:08.617885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4b0c63a-5da9-4335-a8b0-432b0fdbda27 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:08.618725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4b0c63a-5da9-4335-a8b0-432b0fdbda27 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:08.619449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4b0c63a-5da9-4335-a8b0-432b0fdbda27 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:08.688263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e579e536-dbf2-4fcc-b548-74f28365226c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:08.689633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e579e536-dbf2-4fcc-b548-74f28365226c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:08.721789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e579e536-dbf2-4fcc-b548-74f28365226c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:08.724178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e579e536-dbf2-4fcc-b548-74f28365226c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:08.726405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e579e536-dbf2-4fcc-b548-74f28365226c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:08.727446 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e579e536-dbf2-4fcc-b548-74f28365226c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:08.730547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e579e536-dbf2-4fcc-b548-74f28365226c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:08.731408 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e579e536-dbf2-4fcc-b548-74f28365226c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:08.895004 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e579e536-dbf2-4fcc-b548-74f28365226c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:08.908359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e579e536-dbf2-4fcc-b548-74f28365226c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:08.911496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e579e536-dbf2-4fcc-b548-74f28365226c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:08.913607 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e579e536-dbf2-4fcc-b548-74f28365226c tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.230998 Aug 18 11:49:08.914356 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2367/5053] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:08 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:09.137670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d4b0c63a-5da9-4335-a8b0-432b0fdbda27 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:09.147551 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d4b0c63a-5da9-4335-a8b0-432b0fdbda27 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.573023 Aug 18 11:49:09.161467 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2687/5054] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:08 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:09.939154 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1e868cb8-05f1-4545-8286-dde9a3262fe6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:09.940004 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1e868cb8-05f1-4545-8286-dde9a3262fe6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:09.955854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e868cb8-05f1-4545-8286-dde9a3262fe6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:09.972720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e868cb8-05f1-4545-8286-dde9a3262fe6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:09.973396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e868cb8-05f1-4545-8286-dde9a3262fe6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:09.978105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e868cb8-05f1-4545-8286-dde9a3262fe6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:09.979021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e868cb8-05f1-4545-8286-dde9a3262fe6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:09.979842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1e868cb8-05f1-4545-8286-dde9a3262fe6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:10.145590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1e868cb8-05f1-4545-8286-dde9a3262fe6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:10.170703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e144f9cf-8fc3-4e6c-a5c6-befdc056422b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:10.173715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e144f9cf-8fc3-4e6c-a5c6-befdc056422b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:10.181886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1e868cb8-05f1-4545-8286-dde9a3262fe6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:10.186519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e144f9cf-8fc3-4e6c-a5c6-befdc056422b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:10.186905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1e868cb8-05f1-4545-8286-dde9a3262fe6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:10.189493 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1e868cb8-05f1-4545-8286-dde9a3262fe6 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.254276 Aug 18 11:49:10.191277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e144f9cf-8fc3-4e6c-a5c6-befdc056422b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:10.192835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e144f9cf-8fc3-4e6c-a5c6-befdc056422b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:10.195163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e144f9cf-8fc3-4e6c-a5c6-befdc056422b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:10.195982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e144f9cf-8fc3-4e6c-a5c6-befdc056422b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:10.196684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e144f9cf-8fc3-4e6c-a5c6-befdc056422b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:10.203014 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2368/5055] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:09 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:10.702542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e144f9cf-8fc3-4e6c-a5c6-befdc056422b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:10.714705 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e144f9cf-8fc3-4e6c-a5c6-befdc056422b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.549140 Aug 18 11:49:10.715297 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2688/5056] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:10 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:11.226299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4a9dfcac-66b7-496d-a135-e7989f071108 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:11.227609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4a9dfcac-66b7-496d-a135-e7989f071108 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:11.246194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a9dfcac-66b7-496d-a135-e7989f071108 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:11.247049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a9dfcac-66b7-496d-a135-e7989f071108 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:11.247488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a9dfcac-66b7-496d-a135-e7989f071108 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:11.249545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a9dfcac-66b7-496d-a135-e7989f071108 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:11.250034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a9dfcac-66b7-496d-a135-e7989f071108 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:11.250486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4a9dfcac-66b7-496d-a135-e7989f071108 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:11.568419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4a9dfcac-66b7-496d-a135-e7989f071108 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:11.583443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4a9dfcac-66b7-496d-a135-e7989f071108 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:11.586554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4a9dfcac-66b7-496d-a135-e7989f071108 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:11.587999 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4a9dfcac-66b7-496d-a135-e7989f071108 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.365681 Aug 18 11:49:11.589619 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2369/5057] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:11 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:11.741374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4726af26-b656-453b-95f9-e1c3c33de004 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:11.742147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4726af26-b656-453b-95f9-e1c3c33de004 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:11.752463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4726af26-b656-453b-95f9-e1c3c33de004 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:11.753772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4726af26-b656-453b-95f9-e1c3c33de004 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:11.754313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4726af26-b656-453b-95f9-e1c3c33de004 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:11.755683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4726af26-b656-453b-95f9-e1c3c33de004 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:11.756570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4726af26-b656-453b-95f9-e1c3c33de004 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:11.757269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4726af26-b656-453b-95f9-e1c3c33de004 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:12.018570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4726af26-b656-453b-95f9-e1c3c33de004 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:12.039047 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4726af26-b656-453b-95f9-e1c3c33de004 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.305809 Aug 18 11:49:12.041902 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2689/5058] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:11 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:12.614846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1ffadf14-bee9-4248-864a-d38949ea2595 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:12.615479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1ffadf14-bee9-4248-864a-d38949ea2595 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:12.630220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ffadf14-bee9-4248-864a-d38949ea2595 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:12.630811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ffadf14-bee9-4248-864a-d38949ea2595 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:12.631268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ffadf14-bee9-4248-864a-d38949ea2595 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:12.637109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ffadf14-bee9-4248-864a-d38949ea2595 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:12.639188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ffadf14-bee9-4248-864a-d38949ea2595 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:12.639655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1ffadf14-bee9-4248-864a-d38949ea2595 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:12.807697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1ffadf14-bee9-4248-864a-d38949ea2595 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:12.810359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1ffadf14-bee9-4248-864a-d38949ea2595 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:12.812141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1ffadf14-bee9-4248-864a-d38949ea2595 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:12.813342 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1ffadf14-bee9-4248-864a-d38949ea2595 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.203376 Aug 18 11:49:12.813936 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2370/5059] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:12 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:13.088964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5d1e17cd-c3b0-4974-921f-4b4e4ba3179d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:13.101832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5d1e17cd-c3b0-4974-921f-4b4e4ba3179d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:13.114609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d1e17cd-c3b0-4974-921f-4b4e4ba3179d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:13.115348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d1e17cd-c3b0-4974-921f-4b4e4ba3179d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:13.115943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d1e17cd-c3b0-4974-921f-4b4e4ba3179d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:13.116943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d1e17cd-c3b0-4974-921f-4b4e4ba3179d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:13.118223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d1e17cd-c3b0-4974-921f-4b4e4ba3179d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:13.118688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d1e17cd-c3b0-4974-921f-4b4e4ba3179d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:13.297420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5d1e17cd-c3b0-4974-921f-4b4e4ba3179d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:13.309563 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5d1e17cd-c3b0-4974-921f-4b4e4ba3179d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.241338 Aug 18 11:49:13.323437 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2690/5060] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:13 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:13.837428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e27bb645-84b0-42a7-b326-f0b1802ef35a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:13.838628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e27bb645-84b0-42a7-b326-f0b1802ef35a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:13.848413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e27bb645-84b0-42a7-b326-f0b1802ef35a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:13.849147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e27bb645-84b0-42a7-b326-f0b1802ef35a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:13.850027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e27bb645-84b0-42a7-b326-f0b1802ef35a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:13.850931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e27bb645-84b0-42a7-b326-f0b1802ef35a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:13.851535 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e27bb645-84b0-42a7-b326-f0b1802ef35a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:13.852114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e27bb645-84b0-42a7-b326-f0b1802ef35a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:13.977035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e27bb645-84b0-42a7-b326-f0b1802ef35a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:13.987137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e27bb645-84b0-42a7-b326-f0b1802ef35a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:13.988989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e27bb645-84b0-42a7-b326-f0b1802ef35a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:13.990405 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e27bb645-84b0-42a7-b326-f0b1802ef35a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.157657 Aug 18 11:49:13.991022 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2371/5061] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:13 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:14.331862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5598b6b8-eabe-43c0-8a56-ea0d7dd05485 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:14.332450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5598b6b8-eabe-43c0-8a56-ea0d7dd05485 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:14.339627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5598b6b8-eabe-43c0-8a56-ea0d7dd05485 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:14.340503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5598b6b8-eabe-43c0-8a56-ea0d7dd05485 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:14.341168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5598b6b8-eabe-43c0-8a56-ea0d7dd05485 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:14.342109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5598b6b8-eabe-43c0-8a56-ea0d7dd05485 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:14.342812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5598b6b8-eabe-43c0-8a56-ea0d7dd05485 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:14.343479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5598b6b8-eabe-43c0-8a56-ea0d7dd05485 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:14.374242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:49:14.522037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5598b6b8-eabe-43c0-8a56-ea0d7dd05485 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:14.531663 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5598b6b8-eabe-43c0-8a56-ea0d7dd05485 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.203581 Aug 18 11:49:14.532349 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2691/5062] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:14 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:49:15.013194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eed674d4-ec69-4e24-a6ef-2cb1f8fc2eca tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:15.013823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-eed674d4-ec69-4e24-a6ef-2cb1f8fc2eca tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:15.023808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eed674d4-ec69-4e24-a6ef-2cb1f8fc2eca tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:15.024983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eed674d4-ec69-4e24-a6ef-2cb1f8fc2eca tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:15.025658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eed674d4-ec69-4e24-a6ef-2cb1f8fc2eca tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:15.026639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eed674d4-ec69-4e24-a6ef-2cb1f8fc2eca tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:15.027324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eed674d4-ec69-4e24-a6ef-2cb1f8fc2eca tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:15.028002 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eed674d4-ec69-4e24-a6ef-2cb1f8fc2eca tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:15.141224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eed674d4-ec69-4e24-a6ef-2cb1f8fc2eca tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:15.158250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eed674d4-ec69-4e24-a6ef-2cb1f8fc2eca tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:15.162575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-eed674d4-ec69-4e24-a6ef-2cb1f8fc2eca tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:15.164667 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eed674d4-ec69-4e24-a6ef-2cb1f8fc2eca tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.155136 Aug 18 11:49:15.165948 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2372/5063] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:15 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:15.557306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3d56c320-4579-42b9-b116-8d6c97b0c4c1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:15.559079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3d56c320-4579-42b9-b116-8d6c97b0c4c1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:15.570241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d56c320-4579-42b9-b116-8d6c97b0c4c1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:15.571166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d56c320-4579-42b9-b116-8d6c97b0c4c1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:15.572000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d56c320-4579-42b9-b116-8d6c97b0c4c1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:15.573068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d56c320-4579-42b9-b116-8d6c97b0c4c1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:15.573842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d56c320-4579-42b9-b116-8d6c97b0c4c1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:15.574527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d56c320-4579-42b9-b116-8d6c97b0c4c1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:15.807581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3d56c320-4579-42b9-b116-8d6c97b0c4c1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:15.825136 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3d56c320-4579-42b9-b116-8d6c97b0c4c1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.274044 Aug 18 11:49:15.826278 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2692/5064] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:15 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:16.198336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c710ed89-e09d-406b-86a4-f3039b6ee5f7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:16.201345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c710ed89-e09d-406b-86a4-f3039b6ee5f7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:16.220728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c710ed89-e09d-406b-86a4-f3039b6ee5f7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:16.221198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c710ed89-e09d-406b-86a4-f3039b6ee5f7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:16.222489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c710ed89-e09d-406b-86a4-f3039b6ee5f7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:16.223576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c710ed89-e09d-406b-86a4-f3039b6ee5f7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:16.224179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c710ed89-e09d-406b-86a4-f3039b6ee5f7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:16.224949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c710ed89-e09d-406b-86a4-f3039b6ee5f7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:16.379876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c710ed89-e09d-406b-86a4-f3039b6ee5f7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:16.398518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c710ed89-e09d-406b-86a4-f3039b6ee5f7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:16.402763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c710ed89-e09d-406b-86a4-f3039b6ee5f7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:16.404442 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c710ed89-e09d-406b-86a4-f3039b6ee5f7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.214175 Aug 18 11:49:16.419438 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2373/5065] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:16 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:16.551599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3f03b539-ce3f-44fb-85e6-5c69ff69f242 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:16.554141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3f03b539-ce3f-44fb-85e6-5c69ff69f242 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:16.561660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f03b539-ce3f-44fb-85e6-5c69ff69f242 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:16.563084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f03b539-ce3f-44fb-85e6-5c69ff69f242 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:16.563707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f03b539-ce3f-44fb-85e6-5c69ff69f242 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:16.564953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f03b539-ce3f-44fb-85e6-5c69ff69f242 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:16.566116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f03b539-ce3f-44fb-85e6-5c69ff69f242 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:16.566607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f03b539-ce3f-44fb-85e6-5c69ff69f242 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:16.603951 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3f03b539-ce3f-44fb-85e6-5c69ff69f242 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.056470 Aug 18 11:49:16.605181 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2693/5066] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:49:16 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:49:16.746704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-da8433aa-4faa-437e-b51c-b3423de640e9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:16.747303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-da8433aa-4faa-437e-b51c-b3423de640e9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:16.754595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da8433aa-4faa-437e-b51c-b3423de640e9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:16.755843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da8433aa-4faa-437e-b51c-b3423de640e9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:16.756374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da8433aa-4faa-437e-b51c-b3423de640e9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:16.757191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da8433aa-4faa-437e-b51c-b3423de640e9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:16.757890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da8433aa-4faa-437e-b51c-b3423de640e9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:16.758388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da8433aa-4faa-437e-b51c-b3423de640e9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:16.778245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:49:16.796328 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-da8433aa-4faa-437e-b51c-b3423de640e9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments/50005913-250a-4660-9401-3c219a28c551" status: 200 len: 194 microversion: 2.1 time: 0.053735 Aug 18 11:49:16.797640 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2374/5067] 10.222.0.73 () {58 vars in 1413 bytes} [Thu Aug 18 11:49:16 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments/50005913-250a-4660-9401-3c219a28c551 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:49:16.810562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cf5658dd-2f12-4dcc-8237-041f587cc3c9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:16.812417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cf5658dd-2f12-4dcc-8237-041f587cc3c9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:16.820816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf5658dd-2f12-4dcc-8237-041f587cc3c9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:16.821565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf5658dd-2f12-4dcc-8237-041f587cc3c9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:16.822264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf5658dd-2f12-4dcc-8237-041f587cc3c9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:16.823025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf5658dd-2f12-4dcc-8237-041f587cc3c9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:16.823796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf5658dd-2f12-4dcc-8237-041f587cc3c9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:16.824241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf5658dd-2f12-4dcc-8237-041f587cc3c9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:16.852609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bfe95b3f-177a-4f7e-9bb1-3bdd47e3f99a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:16.853475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bfe95b3f-177a-4f7e-9bb1-3bdd47e3f99a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:16.868987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bfe95b3f-177a-4f7e-9bb1-3bdd47e3f99a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:16.869430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bfe95b3f-177a-4f7e-9bb1-3bdd47e3f99a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:16.869876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bfe95b3f-177a-4f7e-9bb1-3bdd47e3f99a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:16.870708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bfe95b3f-177a-4f7e-9bb1-3bdd47e3f99a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:16.875754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bfe95b3f-177a-4f7e-9bb1-3bdd47e3f99a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:16.876235 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bfe95b3f-177a-4f7e-9bb1-3bdd47e3f99a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:16.946399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-cf5658dd-2f12-4dcc-8237-041f587cc3c9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lazy-loading 'services' on Instance uuid 89651755-2a7f-4ccd-870e-3b2c6b29c497 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:49:17.043978 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cf5658dd-2f12-4dcc-8237-041f587cc3c9 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "DELETE /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments/50005913-250a-4660-9401-3c219a28c551" status: 202 len: 0 microversion: 2.1 time: 0.238719 Aug 18 11:49:17.044607 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2694/5068] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 11:49:16 2022] DELETE /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments/50005913-250a-4660-9401-3c219a28c551 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:49:17.073075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5200b4fc-dd7d-4b61-9afe-30122a13eeb9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:17.073689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5200b4fc-dd7d-4b61-9afe-30122a13eeb9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:17.094483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5200b4fc-dd7d-4b61-9afe-30122a13eeb9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:17.095276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5200b4fc-dd7d-4b61-9afe-30122a13eeb9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:17.095921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5200b4fc-dd7d-4b61-9afe-30122a13eeb9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:17.099141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5200b4fc-dd7d-4b61-9afe-30122a13eeb9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:17.099834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5200b4fc-dd7d-4b61-9afe-30122a13eeb9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:17.100431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5200b4fc-dd7d-4b61-9afe-30122a13eeb9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:17.209980 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5200b4fc-dd7d-4b61-9afe-30122a13eeb9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments/f88940be-12e1-4a23-a04e-582a458bbabd" status: 200 len: 194 microversion: 2.20 time: 0.138838 Aug 18 11:49:17.214096 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2695/5069] 10.222.0.73 () {60 vars in 1454 bytes} [Thu Aug 18 11:49:17 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments/f88940be-12e1-4a23-a04e-582a458bbabd => generated 194 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 11:49:17.254576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bfe95b3f-177a-4f7e-9bb1-3bdd47e3f99a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:17.274780 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bfe95b3f-177a-4f7e-9bb1-3bdd47e3f99a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.426129 Aug 18 11:49:17.276324 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2375/5070] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:16 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:17.414132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b0ff5f6-b379-4830-9280-df9547c2cce8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:17.415206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1b0ff5f6-b379-4830-9280-df9547c2cce8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:17.436332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-13d84b6d-b36a-44e8-868e-a8cdf72e9d30 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:17.438202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-13d84b6d-b36a-44e8-868e-a8cdf72e9d30 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:17.442341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b0ff5f6-b379-4830-9280-df9547c2cce8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:17.442810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b0ff5f6-b379-4830-9280-df9547c2cce8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:17.449033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b0ff5f6-b379-4830-9280-df9547c2cce8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:17.452325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b0ff5f6-b379-4830-9280-df9547c2cce8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:17.453443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b0ff5f6-b379-4830-9280-df9547c2cce8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:17.456253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b0ff5f6-b379-4830-9280-df9547c2cce8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:17.464669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13d84b6d-b36a-44e8-868e-a8cdf72e9d30 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:17.465905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13d84b6d-b36a-44e8-868e-a8cdf72e9d30 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:17.468279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13d84b6d-b36a-44e8-868e-a8cdf72e9d30 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:17.470660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13d84b6d-b36a-44e8-868e-a8cdf72e9d30 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:17.473828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13d84b6d-b36a-44e8-868e-a8cdf72e9d30 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:17.474610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-13d84b6d-b36a-44e8-868e-a8cdf72e9d30 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:17.621518 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-13d84b6d-b36a-44e8-868e-a8cdf72e9d30 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:17.641726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-13d84b6d-b36a-44e8-868e-a8cdf72e9d30 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:17.655787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-1b0ff5f6-b379-4830-9280-df9547c2cce8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lazy-loading 'services' on Instance uuid 1706f34c-3b86-4298-be5a-126d7bfeba56 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:49:17.665359 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-13d84b6d-b36a-44e8-868e-a8cdf72e9d30 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:17.670014 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-13d84b6d-b36a-44e8-868e-a8cdf72e9d30 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.237910 Aug 18 11:49:17.670696 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2376/5071] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:17 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:17.805608 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1b0ff5f6-b379-4830-9280-df9547c2cce8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments/f88940be-12e1-4a23-a04e-582a458bbabd" status: 202 len: 0 microversion: 2.20 time: 0.401791 Aug 18 11:49:17.816543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7bc6ad9f-3713-4d71-9f09-e45fe84f8ddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:17.819717 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7bc6ad9f-3713-4d71-9f09-e45fe84f8ddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:17.821504 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2696/5072] 10.222.0.73 () {60 vars in 1457 bytes} [Thu Aug 18 11:49:17 2022] DELETE /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments/f88940be-12e1-4a23-a04e-582a458bbabd => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:49:17.836684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bc6ad9f-3713-4d71-9f09-e45fe84f8ddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:17.839922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bc6ad9f-3713-4d71-9f09-e45fe84f8ddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:17.841883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bc6ad9f-3713-4d71-9f09-e45fe84f8ddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:17.842946 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bc6ad9f-3713-4d71-9f09-e45fe84f8ddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:17.845005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bc6ad9f-3713-4d71-9f09-e45fe84f8ddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:17.845833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7bc6ad9f-3713-4d71-9f09-e45fe84f8ddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:17.947311 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7bc6ad9f-3713-4d71-9f09-e45fe84f8ddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.135496 Aug 18 11:49:17.951602 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2377/5073] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:49:17 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 11:49:18.318491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-50e8911a-9165-4dbd-8903-a5a4b93af0d0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:18.319396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-50e8911a-9165-4dbd-8903-a5a4b93af0d0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:18.326310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50e8911a-9165-4dbd-8903-a5a4b93af0d0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:18.326847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50e8911a-9165-4dbd-8903-a5a4b93af0d0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:18.327297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50e8911a-9165-4dbd-8903-a5a4b93af0d0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:18.328030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50e8911a-9165-4dbd-8903-a5a4b93af0d0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:18.329877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50e8911a-9165-4dbd-8903-a5a4b93af0d0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:18.330351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50e8911a-9165-4dbd-8903-a5a4b93af0d0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:18.697340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-135516f7-0ec0-4975-8bd3-96a43cba6fd7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:18.705294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-135516f7-0ec0-4975-8bd3-96a43cba6fd7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:18.724589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-135516f7-0ec0-4975-8bd3-96a43cba6fd7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:18.725439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-135516f7-0ec0-4975-8bd3-96a43cba6fd7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:18.726185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-135516f7-0ec0-4975-8bd3-96a43cba6fd7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:18.727427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-135516f7-0ec0-4975-8bd3-96a43cba6fd7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:18.728241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-135516f7-0ec0-4975-8bd3-96a43cba6fd7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:18.738907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-135516f7-0ec0-4975-8bd3-96a43cba6fd7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:18.869526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-50e8911a-9165-4dbd-8903-a5a4b93af0d0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:18.881754 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-50e8911a-9165-4dbd-8903-a5a4b93af0d0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.586271 Aug 18 11:49:18.883113 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2697/5074] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:18 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:49:18.964938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-52b82cf1-98c3-44b5-93bc-2f82fdd006c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:18.967389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-52b82cf1-98c3-44b5-93bc-2f82fdd006c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:18.974543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52b82cf1-98c3-44b5-93bc-2f82fdd006c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:18.975377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52b82cf1-98c3-44b5-93bc-2f82fdd006c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:18.976065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52b82cf1-98c3-44b5-93bc-2f82fdd006c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:18.976996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52b82cf1-98c3-44b5-93bc-2f82fdd006c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:18.977792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52b82cf1-98c3-44b5-93bc-2f82fdd006c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:18.978578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52b82cf1-98c3-44b5-93bc-2f82fdd006c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:19.017558 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-52b82cf1-98c3-44b5-93bc-2f82fdd006c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056757 Aug 18 11:49:19.018541 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2698/5075] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:49:18 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 11:49:19.329810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-135516f7-0ec0-4975-8bd3-96a43cba6fd7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:19.340210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-135516f7-0ec0-4975-8bd3-96a43cba6fd7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:19.342131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-135516f7-0ec0-4975-8bd3-96a43cba6fd7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:19.343559 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-135516f7-0ec0-4975-8bd3-96a43cba6fd7 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.653937 Aug 18 11:49:19.344684 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2378/5076] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:18 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:19.916769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-898f02d6-dde8-4074-8e35-3fd3cf8e0f2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:19.918206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-898f02d6-dde8-4074-8e35-3fd3cf8e0f2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:19.931216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-898f02d6-dde8-4074-8e35-3fd3cf8e0f2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:19.934286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-898f02d6-dde8-4074-8e35-3fd3cf8e0f2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:19.935461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-898f02d6-dde8-4074-8e35-3fd3cf8e0f2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:19.937666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-898f02d6-dde8-4074-8e35-3fd3cf8e0f2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:19.939237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-898f02d6-dde8-4074-8e35-3fd3cf8e0f2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:19.940072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-898f02d6-dde8-4074-8e35-3fd3cf8e0f2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:20.032032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f37cf037-251c-4e7d-b6ed-a4294a01dc43 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:20.034457 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f37cf037-251c-4e7d-b6ed-a4294a01dc43 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:20.049552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f37cf037-251c-4e7d-b6ed-a4294a01dc43 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:20.050058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f37cf037-251c-4e7d-b6ed-a4294a01dc43 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:20.054731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f37cf037-251c-4e7d-b6ed-a4294a01dc43 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:20.055621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f37cf037-251c-4e7d-b6ed-a4294a01dc43 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:20.056296 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f37cf037-251c-4e7d-b6ed-a4294a01dc43 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:20.056754 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f37cf037-251c-4e7d-b6ed-a4294a01dc43 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:20.140387 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f37cf037-251c-4e7d-b6ed-a4294a01dc43 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.112917 Aug 18 11:49:20.142189 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2379/5077] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:49:20 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 11:49:20.325707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-898f02d6-dde8-4074-8e35-3fd3cf8e0f2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:20.338850 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-898f02d6-dde8-4074-8e35-3fd3cf8e0f2d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.426541 Aug 18 11:49:20.355149 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2699/5078] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:19 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:20.369894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d4d45a30-7c68-40fb-ab3a-d0b83430a673 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:20.370616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d4d45a30-7c68-40fb-ab3a-d0b83430a673 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:20.377569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d4d45a30-7c68-40fb-ab3a-d0b83430a673 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:20.378074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d4d45a30-7c68-40fb-ab3a-d0b83430a673 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:20.378557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d4d45a30-7c68-40fb-ab3a-d0b83430a673 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:20.381370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d4d45a30-7c68-40fb-ab3a-d0b83430a673 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:20.382191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d4d45a30-7c68-40fb-ab3a-d0b83430a673 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:20.382707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d4d45a30-7c68-40fb-ab3a-d0b83430a673 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:20.530213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d4d45a30-7c68-40fb-ab3a-d0b83430a673 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:20.543138 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d4d45a30-7c68-40fb-ab3a-d0b83430a673 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:20.547094 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d4d45a30-7c68-40fb-ab3a-d0b83430a673 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:20.552696 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d4d45a30-7c68-40fb-ab3a-d0b83430a673 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1409 microversion: 2.54 time: 0.186279 Aug 18 11:49:20.554107 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2380/5079] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:20 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1409 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:49:21.164704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8f821e6b-ba66-4183-a60e-7b464334824f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:21.173403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8f821e6b-ba66-4183-a60e-7b464334824f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:21.215305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f821e6b-ba66-4183-a60e-7b464334824f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:21.219489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f821e6b-ba66-4183-a60e-7b464334824f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:21.222671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f821e6b-ba66-4183-a60e-7b464334824f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:21.231855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f821e6b-ba66-4183-a60e-7b464334824f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:21.231855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f821e6b-ba66-4183-a60e-7b464334824f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:21.232591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f821e6b-ba66-4183-a60e-7b464334824f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:21.310958 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8f821e6b-ba66-4183-a60e-7b464334824f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.157375 Aug 18 11:49:21.312394 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2700/5080] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:49:21 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:49:21.366740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4492942b-a489-4432-be8d-8541b8b3f7cf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:21.366740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4492942b-a489-4432-be8d-8541b8b3f7cf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:21.377795 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4492942b-a489-4432-be8d-8541b8b3f7cf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:21.379124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4492942b-a489-4432-be8d-8541b8b3f7cf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:21.380794 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4492942b-a489-4432-be8d-8541b8b3f7cf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:21.382843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4492942b-a489-4432-be8d-8541b8b3f7cf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:21.384014 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4492942b-a489-4432-be8d-8541b8b3f7cf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:21.385291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4492942b-a489-4432-be8d-8541b8b3f7cf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:21.579740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1ec95ea5-68cf-40d7-993e-43441301c154 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:21.580942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1ec95ea5-68cf-40d7-993e-43441301c154 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:21.593097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ec95ea5-68cf-40d7-993e-43441301c154 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:21.593867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ec95ea5-68cf-40d7-993e-43441301c154 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:21.597059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ec95ea5-68cf-40d7-993e-43441301c154 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:21.599323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ec95ea5-68cf-40d7-993e-43441301c154 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:21.603570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ec95ea5-68cf-40d7-993e-43441301c154 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:21.604050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ec95ea5-68cf-40d7-993e-43441301c154 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:21.749033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1ec95ea5-68cf-40d7-993e-43441301c154 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:21.768208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1ec95ea5-68cf-40d7-993e-43441301c154 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:21.775580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1ec95ea5-68cf-40d7-993e-43441301c154 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:21.782999 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1ec95ea5-68cf-40d7-993e-43441301c154 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1415 microversion: 2.54 time: 0.206445 Aug 18 11:49:21.787763 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2701/5081] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:21 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1415 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:21.898654 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4492942b-a489-4432-be8d-8541b8b3f7cf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:21.917380 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4492942b-a489-4432-be8d-8541b8b3f7cf tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.559603 Aug 18 11:49:21.919460 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2381/5082] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:21 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:22.324975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d00691c2-66e4-4691-b39d-602f4259049e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:22.327551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d00691c2-66e4-4691-b39d-602f4259049e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:22.345592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d00691c2-66e4-4691-b39d-602f4259049e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:22.351084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d00691c2-66e4-4691-b39d-602f4259049e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:22.352588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d00691c2-66e4-4691-b39d-602f4259049e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:22.354095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d00691c2-66e4-4691-b39d-602f4259049e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:22.355949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d00691c2-66e4-4691-b39d-602f4259049e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:22.356700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d00691c2-66e4-4691-b39d-602f4259049e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:22.460630 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d00691c2-66e4-4691-b39d-602f4259049e tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.139307 Aug 18 11:49:22.461483 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2702/5083] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:49:22 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:49:22.841028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-49148984-6ff0-4f56-bad3-48ee6b8a0785 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:22.842077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-49148984-6ff0-4f56-bad3-48ee6b8a0785 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:22.880236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49148984-6ff0-4f56-bad3-48ee6b8a0785 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:22.884975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49148984-6ff0-4f56-bad3-48ee6b8a0785 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:22.885634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49148984-6ff0-4f56-bad3-48ee6b8a0785 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:22.886597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49148984-6ff0-4f56-bad3-48ee6b8a0785 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:22.888807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49148984-6ff0-4f56-bad3-48ee6b8a0785 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:22.891142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-49148984-6ff0-4f56-bad3-48ee6b8a0785 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:22.951550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b2a67fd-33ae-4e44-9f3c-b453fd2f45fe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:22.952554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b2a67fd-33ae-4e44-9f3c-b453fd2f45fe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:22.957288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=62 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:49:22.978738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b2a67fd-33ae-4e44-9f3c-b453fd2f45fe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:22.982233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b2a67fd-33ae-4e44-9f3c-b453fd2f45fe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:22.982931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b2a67fd-33ae-4e44-9f3c-b453fd2f45fe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:22.984473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b2a67fd-33ae-4e44-9f3c-b453fd2f45fe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:22.985731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b2a67fd-33ae-4e44-9f3c-b453fd2f45fe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:22.987490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b2a67fd-33ae-4e44-9f3c-b453fd2f45fe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:23.085681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-49148984-6ff0-4f56-bad3-48ee6b8a0785 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:23.103135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-49148984-6ff0-4f56-bad3-48ee6b8a0785 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:23.104652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-49148984-6ff0-4f56-bad3-48ee6b8a0785 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:23.106164 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-49148984-6ff0-4f56-bad3-48ee6b8a0785 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1415 microversion: 2.54 time: 0.272735 Aug 18 11:49:23.108242 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2382/5084] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:22 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1415 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:23.387779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b2a67fd-33ae-4e44-9f3c-b453fd2f45fe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:23.405937 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b2a67fd-33ae-4e44-9f3c-b453fd2f45fe tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.458260 Aug 18 11:49:23.407016 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2703/5085] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:22 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:23.478820 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-31304347-f520-4d3a-ba68-b7d966ff772c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:23.485382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-31304347-f520-4d3a-ba68-b7d966ff772c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:23.500844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31304347-f520-4d3a-ba68-b7d966ff772c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:23.503041 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31304347-f520-4d3a-ba68-b7d966ff772c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:23.504157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31304347-f520-4d3a-ba68-b7d966ff772c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:23.506208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31304347-f520-4d3a-ba68-b7d966ff772c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:23.507265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31304347-f520-4d3a-ba68-b7d966ff772c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:23.508601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31304347-f520-4d3a-ba68-b7d966ff772c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:23.572425 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-31304347-f520-4d3a-ba68-b7d966ff772c tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099523 Aug 18 11:49:23.578540 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2383/5086] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:49:23 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:49:24.135482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dca4bd98-8797-4a14-a25e-cbc5bfba5076 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:24.136203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dca4bd98-8797-4a14-a25e-cbc5bfba5076 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:24.152397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dca4bd98-8797-4a14-a25e-cbc5bfba5076 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:24.154951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dca4bd98-8797-4a14-a25e-cbc5bfba5076 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:24.155423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dca4bd98-8797-4a14-a25e-cbc5bfba5076 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:24.158318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dca4bd98-8797-4a14-a25e-cbc5bfba5076 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:24.160676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dca4bd98-8797-4a14-a25e-cbc5bfba5076 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:24.161355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dca4bd98-8797-4a14-a25e-cbc5bfba5076 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:24.312077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-391f8b5a-ee6f-49e3-a7b5-7204041cdc6f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:24.313264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-391f8b5a-ee6f-49e3-a7b5-7204041cdc6f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:24.321507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dca4bd98-8797-4a14-a25e-cbc5bfba5076 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:24.324691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391f8b5a-ee6f-49e3-a7b5-7204041cdc6f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:24.325294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391f8b5a-ee6f-49e3-a7b5-7204041cdc6f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:24.325633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391f8b5a-ee6f-49e3-a7b5-7204041cdc6f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:24.338927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391f8b5a-ee6f-49e3-a7b5-7204041cdc6f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:24.339527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391f8b5a-ee6f-49e3-a7b5-7204041cdc6f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:24.339987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391f8b5a-ee6f-49e3-a7b5-7204041cdc6f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:24.340837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dca4bd98-8797-4a14-a25e-cbc5bfba5076 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:24.345620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dca4bd98-8797-4a14-a25e-cbc5bfba5076 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:24.350737 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dca4bd98-8797-4a14-a25e-cbc5bfba5076 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1400 microversion: 2.54 time: 0.219937 Aug 18 11:49:24.353560 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2704/5087] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:24 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1400 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:24.391068 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-391f8b5a-ee6f-49e3-a7b5-7204041cdc6f tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments/fb129c7a-a5ae-40ed-81d9-e91d3131f4ac" status: 200 len: 194 microversion: 2.1 time: 0.070941 Aug 18 11:49:24.398291 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2384/5088] 10.222.0.73 () {58 vars in 1413 bytes} [Thu Aug 18 11:49:24 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments/fb129c7a-a5ae-40ed-81d9-e91d3131f4ac => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:49:24.402104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f125de0f-8c74-454c-aa87-d94bf3008df5 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '.version_select at 0x7f519e7f8e50>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:24.411010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-802453d1-ea61-47fd-a472-21a39b331b76 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:24.412932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-802453d1-ea61-47fd-a472-21a39b331b76 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:24.427506 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-802453d1-ea61-47fd-a472-21a39b331b76 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:24.429343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-802453d1-ea61-47fd-a472-21a39b331b76 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:24.430779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-802453d1-ea61-47fd-a472-21a39b331b76 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:24.432811 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-802453d1-ea61-47fd-a472-21a39b331b76 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:24.434459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-802453d1-ea61-47fd-a472-21a39b331b76 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:24.435179 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f125de0f-8c74-454c-aa87-d94bf3008df5 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [8d540245-869d-4e40-b2b7-9f5f5e8f8484] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 11:49:24.436246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-802453d1-ea61-47fd-a472-21a39b331b76 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:24.665120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-802453d1-ea61-47fd-a472-21a39b331b76 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lazy-loading 'services' on Instance uuid 89651755-2a7f-4ccd-870e-3b2c6b29c497 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:49:24.820055 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-802453d1-ea61-47fd-a472-21a39b331b76 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "DELETE /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments/fb129c7a-a5ae-40ed-81d9-e91d3131f4ac" status: 202 len: 0 microversion: 2.1 time: 0.413068 Aug 18 11:49:24.832323 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2385/5089] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 11:49:24 2022] DELETE /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments/fb129c7a-a5ae-40ed-81d9-e91d3131f4ac => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:49:24.858567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b679340b-c1ce-41a4-a65d-db6ea4dd3013 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:24.859569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b679340b-c1ce-41a4-a65d-db6ea4dd3013 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:24.875572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b679340b-c1ce-41a4-a65d-db6ea4dd3013 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:24.878387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b679340b-c1ce-41a4-a65d-db6ea4dd3013 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:24.880418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b679340b-c1ce-41a4-a65d-db6ea4dd3013 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:24.881764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b679340b-c1ce-41a4-a65d-db6ea4dd3013 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:24.886386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b679340b-c1ce-41a4-a65d-db6ea4dd3013 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:24.887147 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b679340b-c1ce-41a4-a65d-db6ea4dd3013 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:25.218970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b679340b-c1ce-41a4-a65d-db6ea4dd3013 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:25.233871 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b679340b-c1ce-41a4-a65d-db6ea4dd3013 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.394237 Aug 18 11:49:25.235553 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2386/5090] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:24 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:25.242947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0d2b85f2-6fb2-4b6c-a0a6-d040217214ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:25.246083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0d2b85f2-6fb2-4b6c-a0a6-d040217214ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:25.258116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d2b85f2-6fb2-4b6c-a0a6-d040217214ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:25.259511 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d2b85f2-6fb2-4b6c-a0a6-d040217214ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:25.260208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d2b85f2-6fb2-4b6c-a0a6-d040217214ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:25.261806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d2b85f2-6fb2-4b6c-a0a6-d040217214ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:25.263171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d2b85f2-6fb2-4b6c-a0a6-d040217214ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:25.264112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0d2b85f2-6fb2-4b6c-a0a6-d040217214ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:25.325246 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0d2b85f2-6fb2-4b6c-a0a6-d040217214ae tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086719 Aug 18 11:49:25.333460 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2387/5091] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:49:25 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:49:25.445239 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [None req-f125de0f-8c74-454c-aa87-d94bf3008df5 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [8d540245-869d-4e40-b2b7-9f5f5e8f8484] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 42362. Aug 18 11:49:25.484978 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f125de0f-8c74-454c-aa87-d94bf3008df5 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1889124716" status: 204 len: 0 microversion: 2.54 time: 1.098675 Aug 18 11:49:25.485933 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2705/5092] 10.222.0.73 () {60 vars in 1319 bytes} [Thu Aug 18 11:49:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1889124716 => generated 0 bytes in 1103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:49:25.506101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4f6da602-ae4d-4598-9573-a9c8f7e8ed39 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:25.507606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4f6da602-ae4d-4598-9573-a9c8f7e8ed39 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:25.521292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f6da602-ae4d-4598-9573-a9c8f7e8ed39 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:25.522250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f6da602-ae4d-4598-9573-a9c8f7e8ed39 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:25.524273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f6da602-ae4d-4598-9573-a9c8f7e8ed39 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:25.526580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f6da602-ae4d-4598-9573-a9c8f7e8ed39 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:25.528513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f6da602-ae4d-4598-9573-a9c8f7e8ed39 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:25.530503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4f6da602-ae4d-4598-9573-a9c8f7e8ed39 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:25.570867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4f6da602-ae4d-4598-9573-a9c8f7e8ed39 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:49:25.655497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:49:25.708831 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4f6da602-ae4d-4598-9573-a9c8f7e8ed39 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 204 len: 0 microversion: 2.54 time: 0.206208 Aug 18 11:49:25.711179 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2388/5093] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:49:25 2022] DELETE /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:49:25.724447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3708845-d1f7-451e-9855-19f9b53b115a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:25.727698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3708845-d1f7-451e-9855-19f9b53b115a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:25.745001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3708845-d1f7-451e-9855-19f9b53b115a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:25.750007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3708845-d1f7-451e-9855-19f9b53b115a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:25.753436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3708845-d1f7-451e-9855-19f9b53b115a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:25.755255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3708845-d1f7-451e-9855-19f9b53b115a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:25.758600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3708845-d1f7-451e-9855-19f9b53b115a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:25.759066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3708845-d1f7-451e-9855-19f9b53b115a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:25.962133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d3708845-d1f7-451e-9855-19f9b53b115a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:25.999542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d3708845-d1f7-451e-9855-19f9b53b115a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:26.008365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d3708845-d1f7-451e-9855-19f9b53b115a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:26.017248 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3708845-d1f7-451e-9855-19f9b53b115a tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1406 microversion: 2.54 time: 0.299477 Aug 18 11:49:26.021338 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2706/5094] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:25 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:26.260032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-472c2aa6-7be0-443d-9a1c-0ef01b157c8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:26.261134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-472c2aa6-7be0-443d-9a1c-0ef01b157c8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:26.273630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-472c2aa6-7be0-443d-9a1c-0ef01b157c8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:26.274668 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-472c2aa6-7be0-443d-9a1c-0ef01b157c8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:26.275347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-472c2aa6-7be0-443d-9a1c-0ef01b157c8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:26.280996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-472c2aa6-7be0-443d-9a1c-0ef01b157c8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:26.281965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-472c2aa6-7be0-443d-9a1c-0ef01b157c8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:26.282658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-472c2aa6-7be0-443d-9a1c-0ef01b157c8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:26.342045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-81c82dd1-9377-473d-a2b1-668c4479f67b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:26.346761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-81c82dd1-9377-473d-a2b1-668c4479f67b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:26.365372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81c82dd1-9377-473d-a2b1-668c4479f67b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:26.373305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81c82dd1-9377-473d-a2b1-668c4479f67b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:26.373879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81c82dd1-9377-473d-a2b1-668c4479f67b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:26.378988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81c82dd1-9377-473d-a2b1-668c4479f67b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:26.380267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81c82dd1-9377-473d-a2b1-668c4479f67b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:26.380734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81c82dd1-9377-473d-a2b1-668c4479f67b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:26.494692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:49:26.507792 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-81c82dd1-9377-473d-a2b1-668c4479f67b tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.170520 Aug 18 11:49:26.508537 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2707/5095] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:49:26 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:49:26.886112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-472c2aa6-7be0-443d-9a1c-0ef01b157c8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:26.899779 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-472c2aa6-7be0-443d-9a1c-0ef01b157c8a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.643843 Aug 18 11:49:26.900774 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2389/5096] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:26 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:27.047435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-394da328-80a5-4c39-84b6-f2c3c15f4322 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:27.048063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-394da328-80a5-4c39-84b6-f2c3c15f4322 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:27.060555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-394da328-80a5-4c39-84b6-f2c3c15f4322 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:27.061062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-394da328-80a5-4c39-84b6-f2c3c15f4322 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:27.061510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-394da328-80a5-4c39-84b6-f2c3c15f4322 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:27.062236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-394da328-80a5-4c39-84b6-f2c3c15f4322 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:27.070308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-394da328-80a5-4c39-84b6-f2c3c15f4322 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:27.070834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-394da328-80a5-4c39-84b6-f2c3c15f4322 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:27.335475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-394da328-80a5-4c39-84b6-f2c3c15f4322 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:27.355398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-394da328-80a5-4c39-84b6-f2c3c15f4322 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:27.358551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-394da328-80a5-4c39-84b6-f2c3c15f4322 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2effd9b78906421eb0849500cb7095ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0668e316c042ae8dc6e619bf91e146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:27.362815 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-394da328-80a5-4c39-84b6-f2c3c15f4322 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 200 len: 1406 microversion: 2.54 time: 0.319564 Aug 18 11:49:27.368855 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2708/5097] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:27 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:49:27.523453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-25b35f89-8c9e-461a-bcf5-d67e374b0cdd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:27.526653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-25b35f89-8c9e-461a-bcf5-d67e374b0cdd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:27.546572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25b35f89-8c9e-461a-bcf5-d67e374b0cdd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:27.547474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25b35f89-8c9e-461a-bcf5-d67e374b0cdd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:27.548168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25b35f89-8c9e-461a-bcf5-d67e374b0cdd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:27.549914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25b35f89-8c9e-461a-bcf5-d67e374b0cdd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:27.551913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25b35f89-8c9e-461a-bcf5-d67e374b0cdd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:27.555272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25b35f89-8c9e-461a-bcf5-d67e374b0cdd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:27.665685 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-25b35f89-8c9e-461a-bcf5-d67e374b0cdd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147002 Aug 18 11:49:27.667897 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2390/5098] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:49:27 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:49:27.927230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f749284f-b6ff-41ac-9968-b7ec2de03931 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:27.928066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f749284f-b6ff-41ac-9968-b7ec2de03931 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:27.941848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f749284f-b6ff-41ac-9968-b7ec2de03931 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:27.942531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f749284f-b6ff-41ac-9968-b7ec2de03931 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:27.943099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f749284f-b6ff-41ac-9968-b7ec2de03931 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:27.943923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f749284f-b6ff-41ac-9968-b7ec2de03931 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:27.944486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f749284f-b6ff-41ac-9968-b7ec2de03931 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:27.949955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f749284f-b6ff-41ac-9968-b7ec2de03931 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:28.404629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-42a8b0cd-56d4-4f3c-9121-a922ccffdfe9 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:28.408540 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-42a8b0cd-56d4-4f3c-9121-a922ccffdfe9 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] [instance: c08b5c6a-d59b-48d4-b14b-a27a255bf9a3] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:28.423848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:49:28.423848 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42a8b0cd-56d4-4f3c-9121-a922ccffdfe9 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:28.425401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42a8b0cd-56d4-4f3c-9121-a922ccffdfe9 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:28.426879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42a8b0cd-56d4-4f3c-9121-a922ccffdfe9 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:28.431679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42a8b0cd-56d4-4f3c-9121-a922ccffdfe9 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:28.432251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42a8b0cd-56d4-4f3c-9121-a922ccffdfe9 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:28.432704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42a8b0cd-56d4-4f3c-9121-a922ccffdfe9 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:28.459031 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-42a8b0cd-56d4-4f3c-9121-a922ccffdfe9 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] HTTP exception thrown: Instance c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 could not be found. Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-42a8b0cd-56d4-4f3c-9121-a922ccffdfe9 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Request method failure captured: Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 HTTP/1.1 Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_icWWW8_vBhugJOW6J_oz1jV3gGqove6XuQgyQLFaKXYqL4JAlEDUuXeVdcwrqiUrjxCcja2SevfCiCJIbOpWd019vQUaXtvzuMatXMODWL5mPpcYEEGX17-z1wsiQH-tKC5rxbjePeJqXGJYCipIa_45lUJ2QKSDYt9BGh11A0kyME Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Openstack-Nova-Api-Version: 2.54 Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 9f0668e316c042ae8dc6e619bf91e146 Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServerShowV254Test-2013812027 Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9f0668e316c042ae8dc6e619bf91e146"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9f0668e316c042ae8dc6e619bf91e146"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9f0668e316c042ae8dc6e619bf91e146"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9f0668e316c042ae8dc6e619bf91e146"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServerShowV254Test-2013812027 Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 9f0668e316c042ae8dc6e619bf91e146 Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServerShowV254Test-2013812027 Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServerShowV254Test-2013812027-project Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 2effd9b78906421eb0849500cb7095ee Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServerShowV254Test-2013812027-project Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 could not be found. Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'c08b5c6a-d59b-48d4-b14b-a27a255bf9a3'} Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 could not be found. Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 could not be found. Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:28.461240 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:28.467121 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:28.467121 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:28.467121 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:28.467121 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:28.467121 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:28.467121 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 could not be found. Aug 18 11:49:28.467121 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:28.470019 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-42a8b0cd-56d4-4f3c-9121-a922ccffdfe9 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] Returning 404 to user: Instance c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:28.471747 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-42a8b0cd-56d4-4f3c-9121-a922ccffdfe9 tempest-ServerShowV254Test-2013812027 tempest-ServerShowV254Test-2013812027-project] 10.222.0.73 "GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3" status: 404 len: 111 microversion: 2.54 time: 0.081843 Aug 18 11:49:28.473438 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2391/5099] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:28 2022] GET /compute/v2.1/servers/c08b5c6a-d59b-48d4-b14b-a27a255bf9a3 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 18 11:49:28.701845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-727e81a2-e5e6-4f1c-a9d6-2e40af1d3f01 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:28.704451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-727e81a2-e5e6-4f1c-a9d6-2e40af1d3f01 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:28.739421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-727e81a2-e5e6-4f1c-a9d6-2e40af1d3f01 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:28.739923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-727e81a2-e5e6-4f1c-a9d6-2e40af1d3f01 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:28.748316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-727e81a2-e5e6-4f1c-a9d6-2e40af1d3f01 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:28.749352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-727e81a2-e5e6-4f1c-a9d6-2e40af1d3f01 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:28.750167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-727e81a2-e5e6-4f1c-a9d6-2e40af1d3f01 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:28.751109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-727e81a2-e5e6-4f1c-a9d6-2e40af1d3f01 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:28.868743 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-727e81a2-e5e6-4f1c-a9d6-2e40af1d3f01 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.191106 Aug 18 11:49:28.878849 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2392/5100] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:49:28 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:49:28.879794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f749284f-b6ff-41ac-9968-b7ec2de03931 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:28.893962 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f749284f-b6ff-41ac-9968-b7ec2de03931 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1509 microversion: 2.1 time: 0.969623 Aug 18 11:49:28.895645 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2709/5101] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:27 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1509 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:49:29.910708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a9d1ec57-2f30-49d3-b99d-1fe0cf339ad9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:29.918061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a9d1ec57-2f30-49d3-b99d-1fe0cf339ad9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:29.933866 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9d1ec57-2f30-49d3-b99d-1fe0cf339ad9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:29.936468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9d1ec57-2f30-49d3-b99d-1fe0cf339ad9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:29.939361 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9d1ec57-2f30-49d3-b99d-1fe0cf339ad9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:29.940327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9d1ec57-2f30-49d3-b99d-1fe0cf339ad9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:29.940786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8f7ba5b3-e085-4091-9e58-fd052907ab36 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:29.941538 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9d1ec57-2f30-49d3-b99d-1fe0cf339ad9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:29.941661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8f7ba5b3-e085-4091-9e58-fd052907ab36 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:29.946603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9d1ec57-2f30-49d3-b99d-1fe0cf339ad9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:30.004709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f7ba5b3-e085-4091-9e58-fd052907ab36 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:30.007277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f7ba5b3-e085-4091-9e58-fd052907ab36 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:30.010778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f7ba5b3-e085-4091-9e58-fd052907ab36 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:30.019476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f7ba5b3-e085-4091-9e58-fd052907ab36 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:30.022414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f7ba5b3-e085-4091-9e58-fd052907ab36 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:30.022936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f7ba5b3-e085-4091-9e58-fd052907ab36 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:30.029613 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a9d1ec57-2f30-49d3-b99d-1fe0cf339ad9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.146201 Aug 18 11:49:30.033469 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2393/5102] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:49:29 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:49:30.499206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8f7ba5b3-e085-4091-9e58-fd052907ab36 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:30.509177 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8f7ba5b3-e085-4091-9e58-fd052907ab36 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1486 microversion: 2.1 time: 0.582915 Aug 18 11:49:30.509793 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2710/5103] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:29 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1486 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:49:30.535181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e6674349-c868-4375-b9b2-45415cce1527 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1142475104"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:49:30.537708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e6674349-c868-4375-b9b2-45415cce1527 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:30.549410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6674349-c868-4375-b9b2-45415cce1527 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:30.552666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6674349-c868-4375-b9b2-45415cce1527 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:30.553466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6674349-c868-4375-b9b2-45415cce1527 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:30.554475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6674349-c868-4375-b9b2-45415cce1527 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:30.555756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6674349-c868-4375-b9b2-45415cce1527 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:30.556581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e6674349-c868-4375-b9b2-45415cce1527 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:31.021946 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e6674349-c868-4375-b9b2-45415cce1527 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "PUT /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1060 microversion: 2.1 time: 0.490925 Aug 18 11:49:31.027470 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2394/5104] 10.222.0.73 () {60 vars in 1256 bytes} [Thu Aug 18 11:49:30 2022] PUT /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1060 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:31.045150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-728750a6-a247-49c2-b8c1-5a22e57cccca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:31.047594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-728750a6-a247-49c2-b8c1-5a22e57cccca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:31.050250 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-38bf3f9b-30b0-4fa4-b125-58d93e5878c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:31.056422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-38bf3f9b-30b0-4fa4-b125-58d93e5878c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:31.072198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-728750a6-a247-49c2-b8c1-5a22e57cccca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:31.072704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-728750a6-a247-49c2-b8c1-5a22e57cccca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:31.073142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-728750a6-a247-49c2-b8c1-5a22e57cccca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:31.075182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38bf3f9b-30b0-4fa4-b125-58d93e5878c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:31.077685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-728750a6-a247-49c2-b8c1-5a22e57cccca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:31.078191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-728750a6-a247-49c2-b8c1-5a22e57cccca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:31.078719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38bf3f9b-30b0-4fa4-b125-58d93e5878c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:31.081165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38bf3f9b-30b0-4fa4-b125-58d93e5878c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:31.082790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-728750a6-a247-49c2-b8c1-5a22e57cccca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:31.083390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38bf3f9b-30b0-4fa4-b125-58d93e5878c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:31.083895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38bf3f9b-30b0-4fa4-b125-58d93e5878c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:31.084326 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-38bf3f9b-30b0-4fa4-b125-58d93e5878c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:31.214875 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-728750a6-a247-49c2-b8c1-5a22e57cccca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.173456 Aug 18 11:49:31.223684 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2711/5105] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:49:31 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56/os-volume_attachments => generated 25 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:31.356534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02dbf220-0828-4806-bdbd-34dd9e52dde7 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:31.357553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-02dbf220-0828-4806-bdbd-34dd9e52dde7 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:31.397548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02dbf220-0828-4806-bdbd-34dd9e52dde7 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:31.398092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02dbf220-0828-4806-bdbd-34dd9e52dde7 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:31.404872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02dbf220-0828-4806-bdbd-34dd9e52dde7 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:31.406666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02dbf220-0828-4806-bdbd-34dd9e52dde7 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:31.407172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02dbf220-0828-4806-bdbd-34dd9e52dde7 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:31.407627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02dbf220-0828-4806-bdbd-34dd9e52dde7 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:31.506869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-38bf3f9b-30b0-4fa4-b125-58d93e5878c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:31.519154 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-38bf3f9b-30b0-4fa4-b125-58d93e5878c0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1487 microversion: 2.1 time: 0.472664 Aug 18 11:49:31.538502 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2395/5106] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:31 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1487 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:31.548315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-767ad10b-0535-436b-b547-5eada29d3681 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:31.555100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-767ad10b-0535-436b-b547-5eada29d3681 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:31.562804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-767ad10b-0535-436b-b547-5eada29d3681 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:31.566410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-767ad10b-0535-436b-b547-5eada29d3681 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:31.567544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-767ad10b-0535-436b-b547-5eada29d3681 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:31.568623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-767ad10b-0535-436b-b547-5eada29d3681 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:31.574058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-767ad10b-0535-436b-b547-5eada29d3681 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:31.574928 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-767ad10b-0535-436b-b547-5eada29d3681 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:31.597411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-02dbf220-0828-4806-bdbd-34dd9e52dde7 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:49:31.863971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-767ad10b-0535-436b-b547-5eada29d3681 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:31.873996 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-767ad10b-0535-436b-b547-5eada29d3681 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1487 microversion: 2.1 time: 0.329703 Aug 18 11:49:31.890809 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2396/5107] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:31 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1487 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:49:31.929204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9d5c34eb-f806-4d69-9077-f8a2893b994d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:31.930222 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9d5c34eb-f806-4d69-9077-f8a2893b994d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:31.986246 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d5c34eb-f806-4d69-9077-f8a2893b994d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:31.994226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d5c34eb-f806-4d69-9077-f8a2893b994d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:31.999212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d5c34eb-f806-4d69-9077-f8a2893b994d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:32.007738 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d5c34eb-f806-4d69-9077-f8a2893b994d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:32.018379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d5c34eb-f806-4d69-9077-f8a2893b994d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:32.022418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d5c34eb-f806-4d69-9077-f8a2893b994d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:32.135321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9d5c34eb-f806-4d69-9077-f8a2893b994d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:49:32.271489 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-02dbf220-0828-4806-bdbd-34dd9e52dde7 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 204 len: 0 microversion: 2.20 time: 0.916358 Aug 18 11:49:32.274100 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2712/5108] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:49:31 2022] DELETE /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 18 11:49:32.296794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-572982e8-b7fb-4bf8-9309-6d01c365c3ea tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:32.307418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-572982e8-b7fb-4bf8-9309-6d01c365c3ea tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:32.335503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-572982e8-b7fb-4bf8-9309-6d01c365c3ea tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:32.340593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-572982e8-b7fb-4bf8-9309-6d01c365c3ea tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:32.346901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-572982e8-b7fb-4bf8-9309-6d01c365c3ea tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:32.365374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-572982e8-b7fb-4bf8-9309-6d01c365c3ea tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:32.366221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-572982e8-b7fb-4bf8-9309-6d01c365c3ea tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:32.373110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-572982e8-b7fb-4bf8-9309-6d01c365c3ea tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:32.464551 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9d5c34eb-f806-4d69-9077-f8a2893b994d tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 204 len: 0 microversion: 2.1 time: 0.567471 Aug 18 11:49:32.466163 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2397/5109] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:49:31 2022] DELETE /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:49:32.487839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-00ba4f67-a9d2-4aa4-b623-d3257da2b204 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:32.494249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-00ba4f67-a9d2-4aa4-b623-d3257da2b204 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:32.525984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00ba4f67-a9d2-4aa4-b623-d3257da2b204 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:32.527350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00ba4f67-a9d2-4aa4-b623-d3257da2b204 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:32.544013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00ba4f67-a9d2-4aa4-b623-d3257da2b204 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:32.547161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00ba4f67-a9d2-4aa4-b623-d3257da2b204 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:32.547669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00ba4f67-a9d2-4aa4-b623-d3257da2b204 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:32.548181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-00ba4f67-a9d2-4aa4-b623-d3257da2b204 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:32.933617 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-00ba4f67-a9d2-4aa4-b623-d3257da2b204 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:32.951810 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-00ba4f67-a9d2-4aa4-b623-d3257da2b204 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1493 microversion: 2.1 time: 0.478544 Aug 18 11:49:32.952814 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2398/5110] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:32 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1493 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:33.395676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-572982e8-b7fb-4bf8-9309-6d01c365c3ea tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:33.406969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-572982e8-b7fb-4bf8-9309-6d01c365c3ea tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:33.418517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-572982e8-b7fb-4bf8-9309-6d01c365c3ea tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:33.421436 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-572982e8-b7fb-4bf8-9309-6d01c365c3ea tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1723 microversion: 2.20 time: 1.138274 Aug 18 11:49:33.422235 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2713/5111] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:32 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1723 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:49:33.988203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3e2a77b1-48c2-4ccc-8f6a-87993054f7fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:33.991714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3e2a77b1-48c2-4ccc-8f6a-87993054f7fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:34.020741 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e2a77b1-48c2-4ccc-8f6a-87993054f7fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:34.023031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e2a77b1-48c2-4ccc-8f6a-87993054f7fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:34.023807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e2a77b1-48c2-4ccc-8f6a-87993054f7fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:34.025649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e2a77b1-48c2-4ccc-8f6a-87993054f7fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:34.026637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e2a77b1-48c2-4ccc-8f6a-87993054f7fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:34.037304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e2a77b1-48c2-4ccc-8f6a-87993054f7fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:34.453213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9cbb3be0-c3ec-4f27-af69-d8c2cba54955 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:34.453826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9cbb3be0-c3ec-4f27-af69-d8c2cba54955 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:34.465824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9cbb3be0-c3ec-4f27-af69-d8c2cba54955 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:34.472496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9cbb3be0-c3ec-4f27-af69-d8c2cba54955 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:34.474582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9cbb3be0-c3ec-4f27-af69-d8c2cba54955 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:34.480579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9cbb3be0-c3ec-4f27-af69-d8c2cba54955 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:34.481522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9cbb3be0-c3ec-4f27-af69-d8c2cba54955 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:34.482342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9cbb3be0-c3ec-4f27-af69-d8c2cba54955 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:34.951759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3e2a77b1-48c2-4ccc-8f6a-87993054f7fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:34.960173 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3e2a77b1-48c2-4ccc-8f6a-87993054f7fd tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1493 microversion: 2.1 time: 0.985425 Aug 18 11:49:34.964463 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2399/5112] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:33 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1493 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:35.157157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9cbb3be0-c3ec-4f27-af69-d8c2cba54955 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:35.184335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9cbb3be0-c3ec-4f27-af69-d8c2cba54955 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:35.187168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9cbb3be0-c3ec-4f27-af69-d8c2cba54955 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:35.188680 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9cbb3be0-c3ec-4f27-af69-d8c2cba54955 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1723 microversion: 2.20 time: 0.740528 Aug 18 11:49:35.191098 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2714/5113] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:34 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1723 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:35.983374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5a2401cd-6b0f-4576-bba3-810bf29b3ff0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:35.984119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5a2401cd-6b0f-4576-bba3-810bf29b3ff0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:35.996061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a2401cd-6b0f-4576-bba3-810bf29b3ff0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:35.996621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a2401cd-6b0f-4576-bba3-810bf29b3ff0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:36.003155 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a2401cd-6b0f-4576-bba3-810bf29b3ff0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:36.003970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a2401cd-6b0f-4576-bba3-810bf29b3ff0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:36.004722 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a2401cd-6b0f-4576-bba3-810bf29b3ff0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:36.005173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a2401cd-6b0f-4576-bba3-810bf29b3ff0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:36.217998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b3027e8-08fa-4bbb-9c89-58bd287e12fa tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:36.219072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1b3027e8-08fa-4bbb-9c89-58bd287e12fa tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:36.241898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b3027e8-08fa-4bbb-9c89-58bd287e12fa tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:36.242401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b3027e8-08fa-4bbb-9c89-58bd287e12fa tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:36.242869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b3027e8-08fa-4bbb-9c89-58bd287e12fa tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:36.245970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b3027e8-08fa-4bbb-9c89-58bd287e12fa tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:36.247441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b3027e8-08fa-4bbb-9c89-58bd287e12fa tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:36.248079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b3027e8-08fa-4bbb-9c89-58bd287e12fa tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:37.429003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1b3027e8-08fa-4bbb-9c89-58bd287e12fa tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:37.443990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1b3027e8-08fa-4bbb-9c89-58bd287e12fa tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:37.447629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1b3027e8-08fa-4bbb-9c89-58bd287e12fa tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:37.450159 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1b3027e8-08fa-4bbb-9c89-58bd287e12fa tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1723 microversion: 2.20 time: 1.238276 Aug 18 11:49:37.453648 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2715/5114] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:36 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1723 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:49:37.546891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5a2401cd-6b0f-4576-bba3-810bf29b3ff0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:37.599067 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5a2401cd-6b0f-4576-bba3-810bf29b3ff0 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1493 microversion: 2.1 time: 1.617914 Aug 18 11:49:37.599750 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2400/5115] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:35 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1493 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:37.891659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-65c0b6c3-7feb-40f6-b854-0cdd406aed88 req-25f7f442-d980-41f8-9324-d8d68693a50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "047c1683-c0b2-4cef-999a-d178bd10a52e", "name": "network-vif-deleted", "tag": "a818cc91-5d20-46cf-908e-7b73c19feeae"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:49:37.936455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-65c0b6c3-7feb-40f6-b854-0cdd406aed88 req-25f7f442-d980-41f8-9324-d8d68693a50d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:37.940251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-65c0b6c3-7feb-40f6-b854-0cdd406aed88 req-25f7f442-d980-41f8-9324-d8d68693a50d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:37.942086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-65c0b6c3-7feb-40f6-b854-0cdd406aed88 req-25f7f442-d980-41f8-9324-d8d68693a50d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:38.478937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-159f1f4e-629e-4255-83d4-fd3cfce7b8dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:38.480452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-159f1f4e-629e-4255-83d4-fd3cfce7b8dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:38.505342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-159f1f4e-629e-4255-83d4-fd3cfce7b8dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:38.506847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-159f1f4e-629e-4255-83d4-fd3cfce7b8dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:38.510063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-159f1f4e-629e-4255-83d4-fd3cfce7b8dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:38.517678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-159f1f4e-629e-4255-83d4-fd3cfce7b8dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:38.524939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-159f1f4e-629e-4255-83d4-fd3cfce7b8dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:38.525695 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-159f1f4e-629e-4255-83d4-fd3cfce7b8dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:38.525940 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-65c0b6c3-7feb-40f6-b854-0cdd406aed88 req-25f7f442-d980-41f8-9324-d8d68693a50d service nova] Creating event network-vif-deleted:a818cc91-5d20-46cf-908e-7b73c19feeae for instance 047c1683-c0b2-4cef-999a-d178bd10a52e on n-h2-853611-3 Aug 18 11:49:38.538749 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-65c0b6c3-7feb-40f6-b854-0cdd406aed88 req-25f7f442-d980-41f8-9324-d8d68693a50d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.652789 Aug 18 11:49:38.539992 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2716/5116] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:49:38.625565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6381a4d-f7fe-4099-a3bb-9ee0661d37e2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:38.627160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c6381a4d-f7fe-4099-a3bb-9ee0661d37e2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:38.640687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6381a4d-f7fe-4099-a3bb-9ee0661d37e2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:38.643542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6381a4d-f7fe-4099-a3bb-9ee0661d37e2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:38.647126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6381a4d-f7fe-4099-a3bb-9ee0661d37e2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:38.648459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6381a4d-f7fe-4099-a3bb-9ee0661d37e2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:38.649237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6381a4d-f7fe-4099-a3bb-9ee0661d37e2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:38.649936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6381a4d-f7fe-4099-a3bb-9ee0661d37e2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:38.799933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6381a4d-f7fe-4099-a3bb-9ee0661d37e2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:38.800281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6381a4d-f7fe-4099-a3bb-9ee0661d37e2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:38.811667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6381a4d-f7fe-4099-a3bb-9ee0661d37e2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:38.813418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-c6381a4d-f7fe-4099-a3bb-9ee0661d37e2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lazy-loading 'fault' on Instance uuid 047c1683-c0b2-4cef-999a-d178bd10a52e {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:49:39.069083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c6381a4d-f7fe-4099-a3bb-9ee0661d37e2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:39.083634 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c6381a4d-f7fe-4099-a3bb-9ee0661d37e2 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 200 len: 1310 microversion: 2.1 time: 0.462867 Aug 18 11:49:39.096562 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2717/5117] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:38 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 1310 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:39.209963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-159f1f4e-629e-4255-83d4-fd3cfce7b8dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:39.225753 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-159f1f4e-629e-4255-83d4-fd3cfce7b8dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:39.249793 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-159f1f4e-629e-4255-83d4-fd3cfce7b8dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:39.256036 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-159f1f4e-629e-4255-83d4-fd3cfce7b8dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1655 microversion: 2.20 time: 0.780613 Aug 18 11:49:39.258815 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2401/5118] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:38 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1655 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:49:40.113171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c0340d6-7c9c-47d9-a403-54b14cf0d406 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:40.114058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4c0340d6-7c9c-47d9-a403-54b14cf0d406 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:40.148754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c0340d6-7c9c-47d9-a403-54b14cf0d406 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.152892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c0340d6-7c9c-47d9-a403-54b14cf0d406 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.163714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c0340d6-7c9c-47d9-a403-54b14cf0d406 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.166657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c0340d6-7c9c-47d9-a403-54b14cf0d406 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.172936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c0340d6-7c9c-47d9-a403-54b14cf0d406 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.174960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c0340d6-7c9c-47d9-a403-54b14cf0d406 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.224280 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-4c0340d6-7c9c-47d9-a403-54b14cf0d406 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c0340d6-7c9c-47d9-a403-54b14cf0d406 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e HTTP/1.1 Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '047c1683-c0b2-4cef-999a-d178bd10a52e'} Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.227461 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.234822 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:40.234822 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:40.234822 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:40.234822 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:40.234822 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.234822 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.239248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c0340d6-7c9c-47d9-a403-54b14cf0d406 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:40.241633 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4c0340d6-7c9c-47d9-a403-54b14cf0d406 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 404 len: 111 microversion: 2.1 time: 0.135425 Aug 18 11:49:40.265320 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2718/5119] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:40 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:40.281875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c9518c40-4d15-429e-9668-cc01a299f8b7 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] Calling method '.version_select at 0x7f519ec5f3a0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:40.308553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a37fe414-65ff-4ef9-900b-7e6603fa40ef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:40.309814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a37fe414-65ff-4ef9-900b-7e6603fa40ef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:40.325013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37fe414-65ff-4ef9-900b-7e6603fa40ef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.326373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37fe414-65ff-4ef9-900b-7e6603fa40ef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.327538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37fe414-65ff-4ef9-900b-7e6603fa40ef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.332253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37fe414-65ff-4ef9-900b-7e6603fa40ef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.334557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37fe414-65ff-4ef9-900b-7e6603fa40ef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.336220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a37fe414-65ff-4ef9-900b-7e6603fa40ef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.370189 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-a37fe414-65ff-4ef9-900b-7e6603fa40ef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a37fe414-65ff-4ef9-900b-7e6603fa40ef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e HTTP/1.1 Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '047c1683-c0b2-4cef-999a-d178bd10a52e'} Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:40.381969 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.391711 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.391711 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:40.391711 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.391711 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.391711 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:40.391711 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:40.391711 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:40.391711 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:40.391711 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.391711 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.395927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a37fe414-65ff-4ef9-900b-7e6603fa40ef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:40.398105 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a37fe414-65ff-4ef9-900b-7e6603fa40ef tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 404 len: 111 microversion: 2.1 time: 0.109537 Aug 18 11:49:40.408105 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2719/5120] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:49:40 2022] DELETE /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:40.422578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:40.424167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:40.451281 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c9518c40-4d15-429e-9668-cc01a299f8b7 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/f0dfdbbc-c8af-4fb8-a050-50ef562e16b7" status: 200 len: 351 microversion: 2.1 time: 0.167600 Aug 18 11:49:40.451281 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2402/5121] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 11:49:40 2022] GET /compute/v2.1/os-volumes/f0dfdbbc-c8af-4fb8-a050-50ef562e16b7 => generated 351 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:49:40.459534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.464052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.467297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.469126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.469947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dc7d6c5e-7509-4c27-af41-86dc89b3024f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:40.472402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dc7d6c5e-7509-4c27-af41-86dc89b3024f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 047c1683-c0b2-4cef-999a-d178bd10a52e] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:40.484987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.488100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.494997 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc7d6c5e-7509-4c27-af41-86dc89b3024f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.496981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc7d6c5e-7509-4c27-af41-86dc89b3024f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.497978 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc7d6c5e-7509-4c27-af41-86dc89b3024f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.500142 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc7d6c5e-7509-4c27-af41-86dc89b3024f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.501433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc7d6c5e-7509-4c27-af41-86dc89b3024f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.502463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc7d6c5e-7509-4c27-af41-86dc89b3024f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.564272 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-dc7d6c5e-7509-4c27-af41-86dc89b3024f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.568644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dc7d6c5e-7509-4c27-af41-86dc89b3024f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e HTTP/1.1 Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '047c1683-c0b2-4cef-999a-d178bd10a52e'} Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.569018 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.573303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:40.573303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:40.573303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:40.573303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:40.573303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. Aug 18 11:49:40.573303 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.574049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dc7d6c5e-7509-4c27-af41-86dc89b3024f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 047c1683-c0b2-4cef-999a-d178bd10a52e could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:40.576338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.577368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.578123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lazy-loading 'fault' on Instance uuid 1706f34c-3b86-4298-be5a-126d7bfeba56 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:49:40.578841 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dc7d6c5e-7509-4c27-af41-86dc89b3024f tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e" status: 404 len: 111 microversion: 2.1 time: 0.115611 Aug 18 11:49:40.581973 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2403/5122] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:40 2022] GET /compute/v2.1/servers/047c1683-c0b2-4cef-999a-d178bd10a52e => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:40.604904 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4b5ba929-de26-4e82-8036-f0be5835a340 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:40.609136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4b5ba929-de26-4e82-8036-f0be5835a340 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:40.656036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b5ba929-de26-4e82-8036-f0be5835a340 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.661109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b5ba929-de26-4e82-8036-f0be5835a340 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.665626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b5ba929-de26-4e82-8036-f0be5835a340 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.670060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b5ba929-de26-4e82-8036-f0be5835a340 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.675804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b5ba929-de26-4e82-8036-f0be5835a340 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.677822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b5ba929-de26-4e82-8036-f0be5835a340 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.696082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:40.717091 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-4b5ba929-de26-4e82-8036-f0be5835a340 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4b5ba929-de26-4e82-8036-f0be5835a340 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 HTTP/1.1 Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '8d9c9732-0341-44a6-a88c-ad6904ec6912'} Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:40.721203 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:49:40.731029 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.731029 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:40.731029 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.731029 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.731029 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:40.731029 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:40.731029 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:40.731029 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:40.731029 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:49:40.731029 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.733927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:40.734170 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4b5ba929-de26-4e82-8036-f0be5835a340 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:40.734170 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4b5ba929-de26-4e82-8036-f0be5835a340 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 404 len: 111 microversion: 2.1 time: 0.140096 Aug 18 11:49:40.734170 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2404/5123] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:49:40 2022] DELETE /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:40.734642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:40.734642 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ecb18ad9-e5f4-45c2-b416-97d4d23757e3 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 200 len: 1372 microversion: 2.20 time: 0.323771 Aug 18 11:49:40.738620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-8f86d3af-9565-4f63-8296-519c771f6c95 req-dcaed326-0e7e-4f10-9cb0-5bdcd14d77fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1706f34c-3b86-4298-be5a-126d7bfeba56", "name": "network-vif-deleted", "tag": "7d0067d8-be65-40dd-bc5c-64a302b5b9c1"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:49:40.751533 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2720/5124] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:40 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 1372 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:40.760846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8f86d3af-9565-4f63-8296-519c771f6c95 req-dcaed326-0e7e-4f10-9cb0-5bdcd14d77fc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.762343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8f86d3af-9565-4f63-8296-519c771f6c95 req-dcaed326-0e7e-4f10-9cb0-5bdcd14d77fc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.763380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8f86d3af-9565-4f63-8296-519c771f6c95 req-dcaed326-0e7e-4f10-9cb0-5bdcd14d77fc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.772980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55723452-824d-4564-9793-598c1a691821 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:40.773621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-55723452-824d-4564-9793-598c1a691821 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 8d9c9732-0341-44a6-a88c-ad6904ec6912] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:40.794854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55723452-824d-4564-9793-598c1a691821 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.795403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55723452-824d-4564-9793-598c1a691821 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.795861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55723452-824d-4564-9793-598c1a691821 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.796609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55723452-824d-4564-9793-598c1a691821 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.797077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55723452-824d-4564-9793-598c1a691821 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.797343 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-8f86d3af-9565-4f63-8296-519c771f6c95 req-dcaed326-0e7e-4f10-9cb0-5bdcd14d77fc service nova] Creating event network-vif-deleted:7d0067d8-be65-40dd-bc5c-64a302b5b9c1 for instance 1706f34c-3b86-4298-be5a-126d7bfeba56 on n-h1-853611-3 Aug 18 11:49:40.797542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55723452-824d-4564-9793-598c1a691821 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.807903 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-8f86d3af-9565-4f63-8296-519c771f6c95 req-dcaed326-0e7e-4f10-9cb0-5bdcd14d77fc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077052 Aug 18 11:49:40.811805 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2405/5125] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:49:40.831389 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-55723452-824d-4564-9793-598c1a691821 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55723452-824d-4564-9793-598c1a691821 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 HTTP/1.1 Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '8d9c9732-0341-44a6-a88c-ad6904ec6912'} Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.835419 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.844923 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:40.844923 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:40.844923 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:40.844923 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:40.844923 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. Aug 18 11:49:40.844923 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.848131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55723452-824d-4564-9793-598c1a691821 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 8d9c9732-0341-44a6-a88c-ad6904ec6912 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:40.849885 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-55723452-824d-4564-9793-598c1a691821 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912" status: 404 len: 111 microversion: 2.1 time: 0.096971 Aug 18 11:49:40.852531 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2721/5126] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:40 2022] GET /compute/v2.1/servers/8d9c9732-0341-44a6-a88c-ad6904ec6912 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:40.873104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-55b53d17-ab4d-45af-860f-8e5e4f2291e8 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:40.875825 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-55b53d17-ab4d-45af-860f-8e5e4f2291e8 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:40.891382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55b53d17-ab4d-45af-860f-8e5e4f2291e8 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.894763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55b53d17-ab4d-45af-860f-8e5e4f2291e8 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.896425 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55b53d17-ab4d-45af-860f-8e5e4f2291e8 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.901171 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55b53d17-ab4d-45af-860f-8e5e4f2291e8 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:40.903728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55b53d17-ab4d-45af-860f-8e5e4f2291e8 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:40.906573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55b53d17-ab4d-45af-860f-8e5e4f2291e8 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:40.959072 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-55b53d17-ab4d-45af-860f-8e5e4f2291e8 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-55b53d17-ab4d-45af-860f-8e5e4f2291e8 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a HTTP/1.1 Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '0b9f9674-f5b0-42e7-b843-15f50cfc751a'} Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:40.977459 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:49:40.983775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.983775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:40.983775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.983775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:40.983775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:40.983775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:40.983775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:40.983775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:40.983775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:49:40.983775 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:40.983775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-55b53d17-ab4d-45af-860f-8e5e4f2291e8 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:40.985259 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-55b53d17-ab4d-45af-860f-8e5e4f2291e8 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 404 len: 111 microversion: 2.1 time: 0.121915 Aug 18 11:49:40.986474 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2406/5127] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:49:40 2022] DELETE /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:41.001111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ba76c93c-c845-48e7-8a7c-6a221b30589b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:41.001755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ba76c93c-c845-48e7-8a7c-6a221b30589b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 0b9f9674-f5b0-42e7-b843-15f50cfc751a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:41.015986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba76c93c-c845-48e7-8a7c-6a221b30589b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:41.017046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba76c93c-c845-48e7-8a7c-6a221b30589b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:41.020584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba76c93c-c845-48e7-8a7c-6a221b30589b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:41.023370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba76c93c-c845-48e7-8a7c-6a221b30589b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:41.024447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba76c93c-c845-48e7-8a7c-6a221b30589b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:41.028934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba76c93c-c845-48e7-8a7c-6a221b30589b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:41.060152 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-ba76c93c-c845-48e7-8a7c-6a221b30589b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ba76c93c-c845-48e7-8a7c-6a221b30589b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a HTTP/1.1 Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '0b9f9674-f5b0-42e7-b843-15f50cfc751a'} Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.062318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.066651 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:41.066651 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:41.066651 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:41.066651 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:41.066651 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. Aug 18 11:49:41.066651 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.073632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ba76c93c-c845-48e7-8a7c-6a221b30589b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 0b9f9674-f5b0-42e7-b843-15f50cfc751a could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:41.075705 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ba76c93c-c845-48e7-8a7c-6a221b30589b tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a" status: 404 len: 111 microversion: 2.1 time: 0.079966 Aug 18 11:49:41.081827 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2722/5128] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:40 2022] GET /compute/v2.1/servers/0b9f9674-f5b0-42e7-b843-15f50cfc751a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:41.098095 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-27000793-9507-4978-962f-b77c1f84fc59 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:41.105085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-27000793-9507-4978-962f-b77c1f84fc59 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:41.140431 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27000793-9507-4978-962f-b77c1f84fc59 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:41.143639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27000793-9507-4978-962f-b77c1f84fc59 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:41.144390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27000793-9507-4978-962f-b77c1f84fc59 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:41.148497 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27000793-9507-4978-962f-b77c1f84fc59 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:41.150467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27000793-9507-4978-962f-b77c1f84fc59 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:41.156157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27000793-9507-4978-962f-b77c1f84fc59 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:41.223559 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-27000793-9507-4978-962f-b77c1f84fc59 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-27000793-9507-4978-962f-b77c1f84fc59 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 HTTP/1.1 Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'cd83b56e-8832-4e0a-93b2-dc11dfa067c5'} Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:41.231507 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:49:41.251076 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.251076 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:41.251076 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.251076 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.251076 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:41.251076 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:41.251076 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:41.251076 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:41.251076 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:49:41.251076 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.251076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-27000793-9507-4978-962f-b77c1f84fc59 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:41.251076 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-27000793-9507-4978-962f-b77c1f84fc59 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 404 len: 111 microversion: 2.1 time: 0.155980 Aug 18 11:49:41.251076 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2407/5129] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:49:41 2022] DELETE /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:41.255916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-efd27d91-0ce7-4006-a185-4b1e9c4b7655 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:41.262725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-efd27d91-0ce7-4006-a185-4b1e9c4b7655 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: cd83b56e-8832-4e0a-93b2-dc11dfa067c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:41.294078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efd27d91-0ce7-4006-a185-4b1e9c4b7655 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:41.295109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efd27d91-0ce7-4006-a185-4b1e9c4b7655 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:41.295958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efd27d91-0ce7-4006-a185-4b1e9c4b7655 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:41.298534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efd27d91-0ce7-4006-a185-4b1e9c4b7655 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:41.302161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efd27d91-0ce7-4006-a185-4b1e9c4b7655 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:41.304281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efd27d91-0ce7-4006-a185-4b1e9c4b7655 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:41.438706 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-efd27d91-0ce7-4006-a185-4b1e9c4b7655 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-efd27d91-0ce7-4006-a185-4b1e9c4b7655 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 HTTP/1.1 Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'cd83b56e-8832-4e0a-93b2-dc11dfa067c5'} Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.462945 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.478746 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:41.478746 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:41.478746 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:41.478746 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:41.478746 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. Aug 18 11:49:41.478746 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.478746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-efd27d91-0ce7-4006-a185-4b1e9c4b7655 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance cd83b56e-8832-4e0a-93b2-dc11dfa067c5 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:41.481827 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-efd27d91-0ce7-4006-a185-4b1e9c4b7655 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5" status: 404 len: 111 microversion: 2.1 time: 0.230841 Aug 18 11:49:41.483754 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2723/5130] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:41 2022] GET /compute/v2.1/servers/cd83b56e-8832-4e0a-93b2-dc11dfa067c5 => generated 111 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:41.499650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a28e122d-6230-4975-bf21-e1468910bb69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:41.517844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a28e122d-6230-4975-bf21-e1468910bb69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:41.565716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a28e122d-6230-4975-bf21-e1468910bb69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:41.568181 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a28e122d-6230-4975-bf21-e1468910bb69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:41.572069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a28e122d-6230-4975-bf21-e1468910bb69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:41.576998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a28e122d-6230-4975-bf21-e1468910bb69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:41.581064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a28e122d-6230-4975-bf21-e1468910bb69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:41.582773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a28e122d-6230-4975-bf21-e1468910bb69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:41.615124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:49:41.720231 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-a28e122d-6230-4975-bf21-e1468910bb69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a28e122d-6230-4975-bf21-e1468910bb69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 HTTP/1.1 Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '7be93e56-058c-4369-95e5-d281ef5b9df1'} Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:41.729876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:49:41.741528 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.741528 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:41.741528 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.741528 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.741528 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:41.741528 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:41.741528 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:41.741528 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:41.741528 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:49:41.741528 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.741528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a28e122d-6230-4975-bf21-e1468910bb69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:41.741528 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a28e122d-6230-4975-bf21-e1468910bb69 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 404 len: 111 microversion: 2.1 time: 0.244888 Aug 18 11:49:41.741528 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2408/5131] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:49:41 2022] DELETE /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 111 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:49:41.806992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-63e60b43-8bd6-42e2-91ae-fab03b9ce6a8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:41.813297 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-63e60b43-8bd6-42e2-91ae-fab03b9ce6a8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:41.851841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-63e60b43-8bd6-42e2-91ae-fab03b9ce6a8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:41.868294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-63e60b43-8bd6-42e2-91ae-fab03b9ce6a8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:41.874590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-63e60b43-8bd6-42e2-91ae-fab03b9ce6a8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:41.879972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-63e60b43-8bd6-42e2-91ae-fab03b9ce6a8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:41.881381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-63e60b43-8bd6-42e2-91ae-fab03b9ce6a8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:41.884969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-63e60b43-8bd6-42e2-91ae-fab03b9ce6a8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:41.940047 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-63e60b43-8bd6-42e2-91ae-fab03b9ce6a8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] HTTP exception thrown: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-63e60b43-8bd6-42e2-91ae-fab03b9ce6a8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Request method failure captured: Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 HTTP/1.1 Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iZa7VxM4p_Ex-E6naGIuyRvcDHAvwfBHmXQGhAfHLAh_LzgDa1FYvEwvBordnUxLES5G2CCLkjYuBXHuFc3poMPHBIpcWHLmBcG7NImLiPB552HmCcpO5xbbZWr8MtZ5JPO79kgNJ7e6DEgca-DGka31QdGuMeleuUlzAE_wjZ_fYY Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 9589b45c8fd0425b8f9c67201bece89c Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 9589b45c8fd0425b8f9c67201bece89c Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeShelveTestJSON-808802786-project Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e42e549b9e8c4740a2b33141bd4f7d14 Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeShelveTestJSON-808802786-project Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '1706f34c-3b86-4298-be5a-126d7bfeba56'} Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.944932 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:41.954397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.954397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:41.954397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:41.954397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:41.954397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:41.954397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:41.954397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:49:41.954397 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:49:41.963925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-63e60b43-8bd6-42e2-91ae-fab03b9ce6a8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Returning 404 to user: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:41.973680 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-63e60b43-8bd6-42e2-91ae-fab03b9ce6a8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 404 len: 111 microversion: 2.20 time: 0.204608 Aug 18 11:49:41.978052 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2409/5132] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:41 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:49:41.994885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-55832fcc-d23e-4b0c-85f4-4b1f259543af tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:42.013249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-55832fcc-d23e-4b0c-85f4-4b1f259543af tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:42.041943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55832fcc-d23e-4b0c-85f4-4b1f259543af tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:42.043545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55832fcc-d23e-4b0c-85f4-4b1f259543af tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:42.047921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55832fcc-d23e-4b0c-85f4-4b1f259543af tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:42.049844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55832fcc-d23e-4b0c-85f4-4b1f259543af tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:42.053198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55832fcc-d23e-4b0c-85f4-4b1f259543af tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:42.056117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-55832fcc-d23e-4b0c-85f4-4b1f259543af tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:42.196142 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-55832fcc-d23e-4b0c-85f4-4b1f259543af tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.214799 Aug 18 11:49:42.199185 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2410/5133] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:49:41 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments => generated 25 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:49:42.220428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-83ca9aac-b1a3-4f1a-987e-b3d914f5b58a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '.version_select at 0x7f519e4d7790>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:42.312777 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-83ca9aac-b1a3-4f1a-987e-b3d914f5b58a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158030029" status: 204 len: 0 microversion: 2.20 time: 0.110345 Aug 18 11:49:42.314781 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2411/5134] 10.222.0.73 () {60 vars in 1262 bytes} [Thu Aug 18 11:49:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158030029 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:49:42.631656 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7ebc2c25-cec8-4275-a136-6ae60cce92f7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:42.638636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7ebc2c25-cec8-4275-a136-6ae60cce92f7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:42.657190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ebc2c25-cec8-4275-a136-6ae60cce92f7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:42.658700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ebc2c25-cec8-4275-a136-6ae60cce92f7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:42.659940 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ebc2c25-cec8-4275-a136-6ae60cce92f7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:42.662313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ebc2c25-cec8-4275-a136-6ae60cce92f7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:42.663636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ebc2c25-cec8-4275-a136-6ae60cce92f7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:42.665116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ebc2c25-cec8-4275-a136-6ae60cce92f7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:42.789640 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7ebc2c25-cec8-4275-a136-6ae60cce92f7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.165206 Aug 18 11:49:42.791461 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2412/5135] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:49:42 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497/os-volume_attachments => generated 25 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:49:42.884722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f4b7719-dd64-44cb-998b-10abddca4d28 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:42.891510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7f4b7719-dd64-44cb-998b-10abddca4d28 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 7be93e56-058c-4369-95e5-d281ef5b9df1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:42.970089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f4b7719-dd64-44cb-998b-10abddca4d28 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:42.973521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f4b7719-dd64-44cb-998b-10abddca4d28 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:42.978970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f4b7719-dd64-44cb-998b-10abddca4d28 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:42.983979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f4b7719-dd64-44cb-998b-10abddca4d28 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:42.985037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f4b7719-dd64-44cb-998b-10abddca4d28 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:42.992371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f4b7719-dd64-44cb-998b-10abddca4d28 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.036579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7582040c-2bdf-435a-aede-cc02f5f8f7c5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:43.037959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7582040c-2bdf-435a-aede-cc02f5f8f7c5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:43.061790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7582040c-2bdf-435a-aede-cc02f5f8f7c5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:43.062315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7582040c-2bdf-435a-aede-cc02f5f8f7c5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:43.062798 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7582040c-2bdf-435a-aede-cc02f5f8f7c5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.069396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7582040c-2bdf-435a-aede-cc02f5f8f7c5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:43.071926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7582040c-2bdf-435a-aede-cc02f5f8f7c5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:43.072413 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-7f4b7719-dd64-44cb-998b-10abddca4d28 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:49:43.072621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7582040c-2bdf-435a-aede-cc02f5f8f7c5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f4b7719-dd64-44cb-998b-10abddca4d28 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 HTTP/1.1 Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '7be93e56-058c-4369-95e5-d281ef5b9df1'} Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.080625 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.102302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:43.102302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:43.102302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:43.102302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:43.102302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. Aug 18 11:49:43.102302 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.139973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f4b7719-dd64-44cb-998b-10abddca4d28 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 7be93e56-058c-4369-95e5-d281ef5b9df1 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:43.144210 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7f4b7719-dd64-44cb-998b-10abddca4d28 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1" status: 404 len: 111 microversion: 2.1 time: 1.401453 Aug 18 11:49:43.145964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7582040c-2bdf-435a-aede-cc02f5f8f7c5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:49:43.150275 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2724/5136] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:41 2022] GET /compute/v2.1/servers/7be93e56-058c-4369-95e5-d281ef5b9df1 => generated 111 bytes in 1410 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:43.176362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e014772-1039-4b24-b7b0-c884db87bce1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:43.178785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9e014772-1039-4b24-b7b0-c884db87bce1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:43.211401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e014772-1039-4b24-b7b0-c884db87bce1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:43.212024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e014772-1039-4b24-b7b0-c884db87bce1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:43.213646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e014772-1039-4b24-b7b0-c884db87bce1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.217961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e014772-1039-4b24-b7b0-c884db87bce1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:43.218967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e014772-1039-4b24-b7b0-c884db87bce1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:43.219660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e014772-1039-4b24-b7b0-c884db87bce1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.268641 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-9e014772-1039-4b24-b7b0-c884db87bce1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e014772-1039-4b24-b7b0-c884db87bce1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 HTTP/1.1 Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '43537e52-9c93-4713-93e8-e3db967345f9'} Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:43.270343 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:49:43.275315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.275315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:43.275315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.275315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.275315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:43.275315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:43.275315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:43.275315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:43.275315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:49:43.275315 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.286487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e014772-1039-4b24-b7b0-c884db87bce1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:43.291284 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9e014772-1039-4b24-b7b0-c884db87bce1 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 404 len: 111 microversion: 2.1 time: 0.129069 Aug 18 11:49:43.296156 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2725/5137] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:49:43 2022] DELETE /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:43.310610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4da28436-0be1-4399-aee4-a391c75b45ca tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:43.311792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4da28436-0be1-4399-aee4-a391c75b45ca tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 43537e52-9c93-4713-93e8-e3db967345f9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:43.333053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4da28436-0be1-4399-aee4-a391c75b45ca tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:43.334089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4da28436-0be1-4399-aee4-a391c75b45ca tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:43.334789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4da28436-0be1-4399-aee4-a391c75b45ca tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.335955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4da28436-0be1-4399-aee4-a391c75b45ca tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:43.336651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4da28436-0be1-4399-aee4-a391c75b45ca tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:43.337295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4da28436-0be1-4399-aee4-a391c75b45ca tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.392502 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-4da28436-0be1-4399-aee4-a391c75b45ca tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4da28436-0be1-4399-aee4-a391c75b45ca tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 HTTP/1.1 Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '43537e52-9c93-4713-93e8-e3db967345f9'} Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.396798 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.401640 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:43.401640 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:43.401640 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:43.401640 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:43.401640 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. Aug 18 11:49:43.401640 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.406702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4da28436-0be1-4399-aee4-a391c75b45ca tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 43537e52-9c93-4713-93e8-e3db967345f9 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:43.408158 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4da28436-0be1-4399-aee4-a391c75b45ca tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9" status: 404 len: 111 microversion: 2.1 time: 0.107267 Aug 18 11:49:43.409258 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2726/5138] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:43 2022] GET /compute/v2.1/servers/43537e52-9c93-4713-93e8-e3db967345f9 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:43.415643 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7582040c-2bdf-435a-aede-cc02f5f8f7c5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "DELETE /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 204 len: 0 microversion: 2.1 time: 0.383145 Aug 18 11:49:43.416601 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2413/5139] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:49:43 2022] DELETE /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:49:43.439609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ed8bcc1e-e57c-4a60-85b4-ec24191275d6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:43.440504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ed8bcc1e-e57c-4a60-85b4-ec24191275d6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:43.441151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-96adec94-67d1-4444-9dda-9e00aa0a7c07 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:43.453540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-96adec94-67d1-4444-9dda-9e00aa0a7c07 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:43.467707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed8bcc1e-e57c-4a60-85b4-ec24191275d6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:43.468218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed8bcc1e-e57c-4a60-85b4-ec24191275d6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:43.468712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed8bcc1e-e57c-4a60-85b4-ec24191275d6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.469467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed8bcc1e-e57c-4a60-85b4-ec24191275d6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:43.470061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed8bcc1e-e57c-4a60-85b4-ec24191275d6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:43.477061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ed8bcc1e-e57c-4a60-85b4-ec24191275d6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.494072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96adec94-67d1-4444-9dda-9e00aa0a7c07 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:43.498663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96adec94-67d1-4444-9dda-9e00aa0a7c07 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:43.505867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96adec94-67d1-4444-9dda-9e00aa0a7c07 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.510133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96adec94-67d1-4444-9dda-9e00aa0a7c07 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:43.511492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96adec94-67d1-4444-9dda-9e00aa0a7c07 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:43.514790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96adec94-67d1-4444-9dda-9e00aa0a7c07 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.553210 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-96adec94-67d1-4444-9dda-9e00aa0a7c07 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-96adec94-67d1-4444-9dda-9e00aa0a7c07 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e HTTP/1.1 Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '95a45926-b983-40e7-b9cf-16feec0fc37e'} Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:43.557988 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:49:43.563741 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.563741 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:43.563741 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.563741 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.563741 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:43.563741 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:43.563741 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:43.563741 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:43.563741 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:49:43.563741 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.567251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-96adec94-67d1-4444-9dda-9e00aa0a7c07 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:43.568812 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-96adec94-67d1-4444-9dda-9e00aa0a7c07 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 404 len: 111 microversion: 2.1 time: 0.150432 Aug 18 11:49:43.569980 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2727/5140] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:49:43 2022] DELETE /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:43.585039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0d3377c-d44f-4980-b53b-044431d1b416 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:43.587117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a0d3377c-d44f-4980-b53b-044431d1b416 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: 95a45926-b983-40e7-b9cf-16feec0fc37e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:43.599784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0d3377c-d44f-4980-b53b-044431d1b416 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:43.600750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0d3377c-d44f-4980-b53b-044431d1b416 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:43.601553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0d3377c-d44f-4980-b53b-044431d1b416 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.602558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0d3377c-d44f-4980-b53b-044431d1b416 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:43.603264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0d3377c-d44f-4980-b53b-044431d1b416 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:43.603855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0d3377c-d44f-4980-b53b-044431d1b416 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.632809 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-a0d3377c-d44f-4980-b53b-044431d1b416 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0d3377c-d44f-4980-b53b-044431d1b416 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e HTTP/1.1 Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '95a45926-b983-40e7-b9cf-16feec0fc37e'} Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.635016 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:43.642301 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:43.642301 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:43.642301 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:43.642301 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:43.642301 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. Aug 18 11:49:43.642301 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:43.644330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0d3377c-d44f-4980-b53b-044431d1b416 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance 95a45926-b983-40e7-b9cf-16feec0fc37e could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:43.646122 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a0d3377c-d44f-4980-b53b-044431d1b416 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e" status: 404 len: 111 microversion: 2.1 time: 0.068006 Aug 18 11:49:43.647497 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2728/5141] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:43 2022] GET /compute/v2.1/servers/95a45926-b983-40e7-b9cf-16feec0fc37e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:43.662289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f4a1f0a3-790a-4463-abac-b0cc4e574e7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:43.663092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f4a1f0a3-790a-4463-abac-b0cc4e574e7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:43.673511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4a1f0a3-790a-4463-abac-b0cc4e574e7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:43.674375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4a1f0a3-790a-4463-abac-b0cc4e574e7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:43.675196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4a1f0a3-790a-4463-abac-b0cc4e574e7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.677368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4a1f0a3-790a-4463-abac-b0cc4e574e7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:43.678074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4a1f0a3-790a-4463-abac-b0cc4e574e7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:43.678782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4a1f0a3-790a-4463-abac-b0cc4e574e7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:43.716886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:49:43.748517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f4a1f0a3-790a-4463-abac-b0cc4e574e7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:49:44.003248 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f4a1f0a3-790a-4463-abac-b0cc4e574e7c tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "DELETE /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 204 len: 0 microversion: 2.1 time: 0.348535 Aug 18 11:49:44.005502 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2729/5142] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:49:43 2022] DELETE /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:49:44.051651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3733fe42-989f-4b0f-87fb-570262b96134 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:44.053357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3733fe42-989f-4b0f-87fb-570262b96134 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:44.082335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3733fe42-989f-4b0f-87fb-570262b96134 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:44.083844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3733fe42-989f-4b0f-87fb-570262b96134 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:44.085400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3733fe42-989f-4b0f-87fb-570262b96134 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:44.086795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3733fe42-989f-4b0f-87fb-570262b96134 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:44.088059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3733fe42-989f-4b0f-87fb-570262b96134 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:44.088931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3733fe42-989f-4b0f-87fb-570262b96134 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:44.132777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ed8bcc1e-e57c-4a60-85b4-ec24191275d6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:44.142332 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ed8bcc1e-e57c-4a60-85b4-ec24191275d6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1671 microversion: 2.1 time: 0.718702 Aug 18 11:49:44.152060 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2414/5143] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:43 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1671 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:44.795835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3733fe42-989f-4b0f-87fb-570262b96134 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:44.824510 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3733fe42-989f-4b0f-87fb-570262b96134 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1480 microversion: 2.1 time: 0.812305 Aug 18 11:49:44.824510 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2730/5144] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:44 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1480 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:45.164291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-89ea5deb-ad17-43da-b0f9-09ffa9198fc5 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] Calling method '.version_select at 0x7f519f2d45e0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:45.186394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6f6a959-41eb-4461-a804-0c503d26e1d8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:45.188190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c6f6a959-41eb-4461-a804-0c503d26e1d8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:45.196576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6f6a959-41eb-4461-a804-0c503d26e1d8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:45.197492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6f6a959-41eb-4461-a804-0c503d26e1d8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:45.198130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6f6a959-41eb-4461-a804-0c503d26e1d8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:45.199222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6f6a959-41eb-4461-a804-0c503d26e1d8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:45.199878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6f6a959-41eb-4461-a804-0c503d26e1d8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:45.200627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6f6a959-41eb-4461-a804-0c503d26e1d8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:45.303317 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-89ea5deb-ad17-43da-b0f9-09ffa9198fc5 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/c1fddfa2-8314-4e2f-840c-18776e13a721" status: 200 len: 350 microversion: 2.1 time: 0.143035 Aug 18 11:49:45.304146 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2415/5145] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 11:49:45 2022] GET /compute/v2.1/os-volumes/c1fddfa2-8314-4e2f-840c-18776e13a721 => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:49:45.766127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c6f6a959-41eb-4461-a804-0c503d26e1d8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:45.783174 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c6f6a959-41eb-4461-a804-0c503d26e1d8 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1671 microversion: 2.1 time: 0.593099 Aug 18 11:49:45.784093 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2731/5146] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:45 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1671 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:45.858615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dadbd405-2d75-40f5-8292-18d9d417c791 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:45.859321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dadbd405-2d75-40f5-8292-18d9d417c791 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:45.875677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dadbd405-2d75-40f5-8292-18d9d417c791 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:45.875677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dadbd405-2d75-40f5-8292-18d9d417c791 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:45.875677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dadbd405-2d75-40f5-8292-18d9d417c791 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:45.875677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dadbd405-2d75-40f5-8292-18d9d417c791 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:45.879677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dadbd405-2d75-40f5-8292-18d9d417c791 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:45.880211 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dadbd405-2d75-40f5-8292-18d9d417c791 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:45.916317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ae606592-073c-402f-961d-fa1906ab30dc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Action: 'create', calling method: .version_select at 0x7f519e7858b0>, body: {"keypair": {"name": "tempest-keypair-1592795002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcGwTNBWZ82LhViActdvDeEAjX0nPaME/1JQncUm9j16ZFejYxrlAquIuUm9L0C884fHSX9d+4Gv1JaVLtx1T5f+uZq3oxhgQpSkiS+k6Ko9g5e/87E/cQgUc9pkul+iQ=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:49:45.959225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-ae606592-073c-402f-961d-fa1906ab30dc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Getting quotas for project 9589b45c8fd0425b8f9c67201bece89c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:49:45.977710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-ae606592-073c-402f-961d-fa1906ab30dc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Getting quotas for user e42e549b9e8c4740a2b33141bd4f7d14 and project 9589b45c8fd0425b8f9c67201bece89c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:49:46.058734 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ae606592-073c-402f-961d-fa1906ab30dc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.148922 Aug 18 11:49:46.060783 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2732/5147] 10.222.0.73 () {62 vars in 1200 bytes} [Thu Aug 18 11:49:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 18 11:49:46.807235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-43bd7d01-eb7d-45e5-aeb1-7a74fed4b5a6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:46.808636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-43bd7d01-eb7d-45e5-aeb1-7a74fed4b5a6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:46.818084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43bd7d01-eb7d-45e5-aeb1-7a74fed4b5a6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:46.819166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43bd7d01-eb7d-45e5-aeb1-7a74fed4b5a6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:46.819819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43bd7d01-eb7d-45e5-aeb1-7a74fed4b5a6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:46.821021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43bd7d01-eb7d-45e5-aeb1-7a74fed4b5a6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:46.822249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43bd7d01-eb7d-45e5-aeb1-7a74fed4b5a6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:46.822940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43bd7d01-eb7d-45e5-aeb1-7a74fed4b5a6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:47.115195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dadbd405-2d75-40f5-8292-18d9d417c791 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:47.135493 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dadbd405-2d75-40f5-8292-18d9d417c791 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1480 microversion: 2.1 time: 1.280825 Aug 18 11:49:47.141784 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2416/5148] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:45 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1480 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:47.178281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-43bd7d01-eb7d-45e5-aeb1-7a74fed4b5a6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:47.191130 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-43bd7d01-eb7d-45e5-aeb1-7a74fed4b5a6 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1671 microversion: 2.1 time: 0.386224 Aug 18 11:49:47.194388 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2733/5149] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:46 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1671 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:48.105894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-681f7cf9-0f22-4e59-9ecf-4e3241f8ef7d req-94c584fd-57ba-4be2-b022-02bf371d09ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2f4eea-48c1-4757-a5b3-64624def8f67", "name": "network-vif-deleted", "tag": "a0233917-a53d-447a-82b0-5dcc439b518d"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:49:48.161651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-681f7cf9-0f22-4e59-9ecf-4e3241f8ef7d req-94c584fd-57ba-4be2-b022-02bf371d09ad service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:48.169498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ef4b455e-7ba9-4c13-97c4-a569d5a08ed3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:48.172079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef4b455e-7ba9-4c13-97c4-a569d5a08ed3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:48.183839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-681f7cf9-0f22-4e59-9ecf-4e3241f8ef7d req-94c584fd-57ba-4be2-b022-02bf371d09ad service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:48.189137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-681f7cf9-0f22-4e59-9ecf-4e3241f8ef7d req-94c584fd-57ba-4be2-b022-02bf371d09ad service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:48.205113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef4b455e-7ba9-4c13-97c4-a569d5a08ed3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:48.210944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef4b455e-7ba9-4c13-97c4-a569d5a08ed3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:48.211958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef4b455e-7ba9-4c13-97c4-a569d5a08ed3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:48.213632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef4b455e-7ba9-4c13-97c4-a569d5a08ed3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:48.214722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef4b455e-7ba9-4c13-97c4-a569d5a08ed3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:48.215694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef4b455e-7ba9-4c13-97c4-a569d5a08ed3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:48.238907 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-681f7cf9-0f22-4e59-9ecf-4e3241f8ef7d req-94c584fd-57ba-4be2-b022-02bf371d09ad service nova] Creating event network-vif-deleted:a0233917-a53d-447a-82b0-5dcc439b518d for instance ae2f4eea-48c1-4757-a5b3-64624def8f67 on n-h1-853611-3 Aug 18 11:49:48.253490 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-681f7cf9-0f22-4e59-9ecf-4e3241f8ef7d req-94c584fd-57ba-4be2-b022-02bf371d09ad service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156726 Aug 18 11:49:48.254811 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2417/5150] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:49:48.271123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-391191d6-cf2d-432c-8468-34b781babeed tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:48.271856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-391191d6-cf2d-432c-8468-34b781babeed tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:48.290924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391191d6-cf2d-432c-8468-34b781babeed tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:48.291052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391191d6-cf2d-432c-8468-34b781babeed tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:48.291506 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391191d6-cf2d-432c-8468-34b781babeed tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:48.292278 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391191d6-cf2d-432c-8468-34b781babeed tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:48.292751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391191d6-cf2d-432c-8468-34b781babeed tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:48.295537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391191d6-cf2d-432c-8468-34b781babeed tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:48.416314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ef4b455e-7ba9-4c13-97c4-a569d5a08ed3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c850b0a836124d90b7e50fe8b9fdf011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c07d0bce064140850194469cc81e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:48.468413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-391191d6-cf2d-432c-8468-34b781babeed tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:48.487047 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ef4b455e-7ba9-4c13-97c4-a569d5a08ed3 tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 200 len: 1278 microversion: 2.1 time: 0.322048 Aug 18 11:49:48.487615 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-391191d6-cf2d-432c-8468-34b781babeed tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1604 microversion: 2.1 time: 0.229995 Aug 18 11:49:48.489507 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2418/5151] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:48 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:48.490591 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2734/5152] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:48 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 1278 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:48.495957 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0e4042bb-4298-4d31-88d4-83ddfc291bd6 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] Calling method '.version_select at 0x7f519e577af0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:48.612788 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0e4042bb-4298-4d31-88d4-83ddfc291bd6 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/142c4781-b940-498f-a35a-3c3f8f9a26c6" status: 200 len: 351 microversion: 2.1 time: 0.120701 Aug 18 11:49:48.613149 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2419/5153] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 11:49:48 2022] GET /compute/v2.1/os-volumes/142c4781-b940-498f-a35a-3c3f8f9a26c6 => generated 351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:49:48.633969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-57d630f5-d062-4e9d-b619-6232fc39ac92 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] Calling method '.version_select at 0x7f519ee96dc0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:48.837629 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-57d630f5-d062-4e9d-b619-6232fc39ac92 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.207062 Aug 18 11:49:48.840235 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2735/5154] 10.222.0.73 () {58 vars in 1134 bytes} [Thu Aug 18 11:49:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:48.856551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-79455ff8-8fd9-4f95-97ed-1aba762c11a0 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] Calling method '.version_select at 0x7f519e4bfee0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:49.049889 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-79455ff8-8fd9-4f95-97ed-1aba762c11a0 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.197205 Aug 18 11:49:49.050510 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2420/5155] 10.222.0.73 () {58 vars in 1149 bytes} [Thu Aug 18 11:49:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:49:49.066004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-649aa566-33d2-4bd1-90e0-6f69c7dc3eca tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] Calling method '.version_select at 0x7f519e7c2ee0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:49.234642 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-649aa566-33d2-4bd1-90e0-6f69c7dc3eca tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.173815 Aug 18 11:49:49.243405 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2736/5156] 10.222.0.73 () {58 vars in 1134 bytes} [Thu Aug 18 11:49:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:49.250417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ef07ca9d-3920-405b-af1e-46013377b978 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] Calling method '.version_select at 0x7f519f325670>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:49.428298 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ef07ca9d-3920-405b-af1e-46013377b978 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.182917 Aug 18 11:49:49.443560 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2421/5157] 10.222.0.73 () {58 vars in 1167 bytes} [Thu Aug 18 11:49:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:49:49.444273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-deb7ed9a-4486-4fbb-b1f2-5a59cb8fc080 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] Calling method '.version_select at 0x7f519e862c10>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:49.518881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f78d87e3-154e-4289-9fc6-39700a149f35 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:49.520292 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f78d87e3-154e-4289-9fc6-39700a149f35 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:49.542875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f78d87e3-154e-4289-9fc6-39700a149f35 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:49.546233 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f78d87e3-154e-4289-9fc6-39700a149f35 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:49.547636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f78d87e3-154e-4289-9fc6-39700a149f35 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:49.550865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f78d87e3-154e-4289-9fc6-39700a149f35 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:49.551667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f78d87e3-154e-4289-9fc6-39700a149f35 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:49.553593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f78d87e3-154e-4289-9fc6-39700a149f35 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:49.636434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f78d87e3-154e-4289-9fc6-39700a149f35 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:49.637207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f78d87e3-154e-4289-9fc6-39700a149f35 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:49.638681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f78d87e3-154e-4289-9fc6-39700a149f35 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:49.639507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-f78d87e3-154e-4289-9fc6-39700a149f35 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lazy-loading 'fault' on Instance uuid 89651755-2a7f-4ccd-870e-3b2c6b29c497 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:49:49.658948 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-deb7ed9a-4486-4fbb-b1f2-5a59cb8fc080 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.219349 Aug 18 11:49:49.659539 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2737/5158] 10.222.0.73 () {58 vars in 1170 bytes} [Thu Aug 18 11:49:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:49:49.676137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-549c4c79-e3dd-4f96-9506-b70b33d91c0a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:49.676767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-549c4c79-e3dd-4f96-9506-b70b33d91c0a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] [instance: ae2f4eea-48c1-4757-a5b3-64624def8f67] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:49.711708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-549c4c79-e3dd-4f96-9506-b70b33d91c0a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:49.715183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-549c4c79-e3dd-4f96-9506-b70b33d91c0a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:49.716042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-549c4c79-e3dd-4f96-9506-b70b33d91c0a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:49.719625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-549c4c79-e3dd-4f96-9506-b70b33d91c0a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:49.723291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-549c4c79-e3dd-4f96-9506-b70b33d91c0a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:49.724674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-549c4c79-e3dd-4f96-9506-b70b33d91c0a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:49.773055 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-549c4c79-e3dd-4f96-9506-b70b33d91c0a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] HTTP exception thrown: Instance ae2f4eea-48c1-4757-a5b3-64624def8f67 could not be found. Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-549c4c79-e3dd-4f96-9506-b70b33d91c0a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Request method failure captured: Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 HTTP/1.1 Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iYo24TzKVdM--CEyfTHS1MHRHf4wwyIjFVbazpGqn-ycgtjsZOLoY4CEWr76Y-0TwousGjKficIrJqVeqAnOVchsbRlRQuz9fw4R3nD8KwY0h-VxGm5yZR1lHqeZT6hlMQIL2wcazS52MnfaDrqNI5A5s3zSTkM-n6JXG2iqezmAgM Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b8c07d0bce064140850194469cc81e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b8c07d0bce064140850194469cc81e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersTestJSON-808099425 Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b8c07d0bce064140850194469cc81e9c Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersTestJSON-808099425 Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersTestJSON-808099425-project Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c850b0a836124d90b7e50fe8b9fdf011 Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersTestJSON-808099425-project Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance ae2f4eea-48c1-4757-a5b3-64624def8f67 could not be found. Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'ae2f4eea-48c1-4757-a5b3-64624def8f67'} Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae2f4eea-48c1-4757-a5b3-64624def8f67 could not be found. Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae2f4eea-48c1-4757-a5b3-64624def8f67 could not be found. Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:49.775570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:49.781001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:49.781001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:49.781001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:49.781001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:49.781001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae2f4eea-48c1-4757-a5b3-64624def8f67 could not be found. Aug 18 11:49:49.781001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:49.786108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-549c4c79-e3dd-4f96-9506-b70b33d91c0a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] Returning 404 to user: Instance ae2f4eea-48c1-4757-a5b3-64624def8f67 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:49.787329 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-549c4c79-e3dd-4f96-9506-b70b33d91c0a tempest-ServersTestJSON-808099425 tempest-ServersTestJSON-808099425-project] 10.222.0.73 "GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67" status: 404 len: 111 microversion: 2.1 time: 0.123301 Aug 18 11:49:49.793174 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2738/5159] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:49 2022] GET /compute/v2.1/servers/ae2f4eea-48c1-4757-a5b3-64624def8f67 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:49.803081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-075c85c2-e878-4a47-a35b-9a9ba07cd9b4 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] Calling method '.version_select at 0x7f519ee96940>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:49.896226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f78d87e3-154e-4289-9fc6-39700a149f35 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7646f45e2e054269b3d00ec53c883728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104cfd007b1043239b1818d021f4b26c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:49.953438 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f78d87e3-154e-4289-9fc6-39700a149f35 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 200 len: 1327 microversion: 2.1 time: 0.442563 Aug 18 11:49:49.979980 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2422/5160] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:49 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 1327 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:50.017160 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-075c85c2-e878-4a47-a35b-9a9ba07cd9b4 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.221792 Aug 18 11:49:50.017908 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2739/5161] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:49:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:50.032036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4aa42173-a45c-466a-8b58-0ea6ab7df4d3 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] Calling method '.version_select at 0x7f519e577820>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:50.165433 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4aa42173-a45c-466a-8b58-0ea6ab7df4d3 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.137811 Aug 18 11:49:50.180225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-22843b45-5260-4fc6-99a4-ecd4af555432 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] Calling method '.version_select at 0x7f519e8628b0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:50.182920 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2423/5162] 10.222.0.73 () {58 vars in 1188 bytes} [Thu Aug 18 11:49:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:49:50.391673 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-22843b45-5260-4fc6-99a4-ecd4af555432 tempest-VolumesTestJSON-1290030032 tempest-VolumesTestJSON-1290030032-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.215359 Aug 18 11:49:50.401055 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2740/5163] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 11:49:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:49:50.437733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-13c7d1b3-83cd-44c1-8cb1-7bbec67136dc req-1b9b0d07-0195-451c-9081-b9de4cd6246b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89651755-2a7f-4ccd-870e-3b2c6b29c497", "name": "network-vif-deleted", "tag": "437fe7bd-ec5e-4005-8194-f8e7f2b93b32"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:49:50.486464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-13c7d1b3-83cd-44c1-8cb1-7bbec67136dc req-1b9b0d07-0195-451c-9081-b9de4cd6246b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:50.490842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-13c7d1b3-83cd-44c1-8cb1-7bbec67136dc req-1b9b0d07-0195-451c-9081-b9de4cd6246b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:50.492271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-13c7d1b3-83cd-44c1-8cb1-7bbec67136dc req-1b9b0d07-0195-451c-9081-b9de4cd6246b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:50.522141 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-13c7d1b3-83cd-44c1-8cb1-7bbec67136dc req-1b9b0d07-0195-451c-9081-b9de4cd6246b service nova] Creating event network-vif-deleted:437fe7bd-ec5e-4005-8194-f8e7f2b93b32 for instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 on n-h2-853611-3 Aug 18 11:49:50.554361 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-13c7d1b3-83cd-44c1-8cb1-7bbec67136dc req-1b9b0d07-0195-451c-9081-b9de4cd6246b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122315 Aug 18 11:49:50.557588 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2424/5164] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:49:50.998774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1498c990-9001-47b0-afd3-7a320bd9e1d1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:51.003541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1498c990-9001-47b0-afd3-7a320bd9e1d1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:51.041504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1498c990-9001-47b0-afd3-7a320bd9e1d1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:51.042018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1498c990-9001-47b0-afd3-7a320bd9e1d1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:51.042488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1498c990-9001-47b0-afd3-7a320bd9e1d1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:51.043236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1498c990-9001-47b0-afd3-7a320bd9e1d1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:51.048207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1498c990-9001-47b0-afd3-7a320bd9e1d1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:51.048694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1498c990-9001-47b0-afd3-7a320bd9e1d1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:51.105018 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-1498c990-9001-47b0-afd3-7a320bd9e1d1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] HTTP exception thrown: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1498c990-9001-47b0-afd3-7a320bd9e1d1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Request method failure captured: Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 HTTP/1.1 Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXF7aVR-ODVyh8kOhh5_N4gR1o8moYoxFlGY5LbM6phVerU9qudotwG0fGIEowSEflR8prTOsliKCTKsHR5KtlrLpa8GM57d9zRQvvGwKRU_ttOzZRgZLDAR1zSzbqWQSocRQpZefZWX4STscwAvOnHjdMw7CgBM4DU_Qtt1yzStVY Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 104cfd007b1043239b1818d021f4b26c Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_104cfd007b1043239b1818d021f4b26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 104cfd007b1043239b1818d021f4b26c Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AttachVolumeTestJSON-1628800706-project Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7646f45e2e054269b3d00ec53c883728 Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AttachVolumeTestJSON-1628800706-project Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '89651755-2a7f-4ccd-870e-3b2c6b29c497'} Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:49:51.113278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:51.117940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:49:51.117940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:49:51.117940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:49:51.117940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:49:51.117940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:49:51.117940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:49:51.117940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:49:51.122116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1498c990-9001-47b0-afd3-7a320bd9e1d1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Returning 404 to user: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:49:51.129162 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1498c990-9001-47b0-afd3-7a320bd9e1d1 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 404 len: 111 microversion: 2.1 time: 0.143928 Aug 18 11:49:51.130919 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2741/5165] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:49:50 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:49:51.144494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e4387c10-62ec-48c3-8a63-5d86755fc9f5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '.version_select at 0x7f519e577790>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:51.283311 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e4387c10-62ec-48c3-8a63-5d86755fc9f5 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1737290786" status: 202 len: 0 microversion: 2.1 time: 0.147130 Aug 18 11:49:51.286192 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2425/5166] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 11:49:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1737290786 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:49:52.574469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1136519609", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6a88b2c-bded-43ae-9568-27d654107f5e"}], "security_groups": [{"name": "tempest-securitygroup--1196176135"}], "key_name": "tempest-keypair-1592795002", "user_data": "}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:49:53.165342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] validate_networks() for [('a6a88b2c-bded-43ae-9568-27d654107f5e', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:49:53.596168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:49:54.924006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:49:54.924587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:49:54.924915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:49:54.925329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:49:54.925739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:49:54.947432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:54.947947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:54.948392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:54.949165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:54.949626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:54.950059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:54.994827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Getting quotas for project 9589b45c8fd0425b8f9c67201bece89c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:49:55.016839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Getting quotas for user e42e549b9e8c4740a2b33141bd4f7d14 and project 9589b45c8fd0425b8f9c67201bece89c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:49:55.037797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:49:55.040459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:49:55.154169 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-db9bde19-3833-4af5-8b0e-4eb13c1ebd74 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.586008 Aug 18 11:49:55.155522 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2742/5167] 10.222.0.73 () {62 vars in 1188 bytes} [Thu Aug 18 11:49:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 2588 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 11:49:55.167806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a44ab54e-23c5-421d-a873-29774ed63612 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:55.169230 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a44ab54e-23c5-421d-a873-29774ed63612 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:55.342461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a44ab54e-23c5-421d-a873-29774ed63612 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:55.358257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a44ab54e-23c5-421d-a873-29774ed63612 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:55.360681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a44ab54e-23c5-421d-a873-29774ed63612 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:55.369024 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a44ab54e-23c5-421d-a873-29774ed63612 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1282 microversion: 2.20 time: 0.205395 Aug 18 11:49:55.370123 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2426/5168] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:55 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1282 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:56.396830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e588b9c3-3a47-4b73-8af2-ddf46a148273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:56.397565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e588b9c3-3a47-4b73-8af2-ddf46a148273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:57.832533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e588b9c3-3a47-4b73-8af2-ddf46a148273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:57.851330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e588b9c3-3a47-4b73-8af2-ddf46a148273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:57.861455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e588b9c3-3a47-4b73-8af2-ddf46a148273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:57.865525 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e588b9c3-3a47-4b73-8af2-ddf46a148273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1282 microversion: 2.20 time: 1.472984 Aug 18 11:49:57.871934 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2743/5169] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:56 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1282 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:49:58.896533 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-973d77b3-0658-47f4-83c2-7895713cd5e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:49:58.897198 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-973d77b3-0658-47f4-83c2-7895713cd5e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:49:58.911356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:49:58.922770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-973d77b3-0658-47f4-83c2-7895713cd5e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:58.923861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-973d77b3-0658-47f4-83c2-7895713cd5e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:58.924382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-973d77b3-0658-47f4-83c2-7895713cd5e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:58.935595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-973d77b3-0658-47f4-83c2-7895713cd5e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:49:58.936150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-973d77b3-0658-47f4-83c2-7895713cd5e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:49:58.937386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-973d77b3-0658-47f4-83c2-7895713cd5e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:49:59.184596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-973d77b3-0658-47f4-83c2-7895713cd5e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:59.215022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-973d77b3-0658-47f4-83c2-7895713cd5e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:59.233055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-973d77b3-0658-47f4-83c2-7895713cd5e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:49:59.241860 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-973d77b3-0658-47f4-83c2-7895713cd5e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1340 microversion: 2.20 time: 0.349926 Aug 18 11:49:59.246829 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2427/5170] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:49:58 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1340 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:50:00.269423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26e1a239-a915-4adb-896e-d234370d8dcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:00.270268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26e1a239-a915-4adb-896e-d234370d8dcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:00.307918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e1a239-a915-4adb-896e-d234370d8dcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:00.310354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e1a239-a915-4adb-896e-d234370d8dcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:00.310989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e1a239-a915-4adb-896e-d234370d8dcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:00.313480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e1a239-a915-4adb-896e-d234370d8dcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:00.314215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e1a239-a915-4adb-896e-d234370d8dcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:00.316280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e1a239-a915-4adb-896e-d234370d8dcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:02.931562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-26e1a239-a915-4adb-896e-d234370d8dcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:02.951447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-26e1a239-a915-4adb-896e-d234370d8dcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:02.970838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-26e1a239-a915-4adb-896e-d234370d8dcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:02.980425 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-26e1a239-a915-4adb-896e-d234370d8dcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1408 microversion: 2.20 time: 2.710731 Aug 18 11:50:02.985664 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2744/5171] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:50:00 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1408 bytes in 2722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:50:04.007477 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6745b457-1918-47b3-ba60-4a92d55bcddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:04.009076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6745b457-1918-47b3-ba60-4a92d55bcddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:04.026505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6745b457-1918-47b3-ba60-4a92d55bcddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:04.027720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6745b457-1918-47b3-ba60-4a92d55bcddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:04.028440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6745b457-1918-47b3-ba60-4a92d55bcddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:04.029555 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6745b457-1918-47b3-ba60-4a92d55bcddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:04.030338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6745b457-1918-47b3-ba60-4a92d55bcddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:04.031131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6745b457-1918-47b3-ba60-4a92d55bcddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:05.356120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:50:05.902229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6745b457-1918-47b3-ba60-4a92d55bcddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:05.959888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6745b457-1918-47b3-ba60-4a92d55bcddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:05.976896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6745b457-1918-47b3-ba60-4a92d55bcddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:05.982229 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6745b457-1918-47b3-ba60-4a92d55bcddf tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1408 microversion: 2.20 time: 1.978143 Aug 18 11:50:05.986480 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2428/5172] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:50:04 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1408 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:50:07.010512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02c3f00e-eab9-4649-b925-9d31cd7aaa38 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:07.011326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-02c3f00e-eab9-4649-b925-9d31cd7aaa38 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:07.027258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:50:07.032069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c3f00e-eab9-4649-b925-9d31cd7aaa38 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:07.036338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c3f00e-eab9-4649-b925-9d31cd7aaa38 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:07.036927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c3f00e-eab9-4649-b925-9d31cd7aaa38 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:07.038062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c3f00e-eab9-4649-b925-9d31cd7aaa38 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:07.041829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c3f00e-eab9-4649-b925-9d31cd7aaa38 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:07.042788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02c3f00e-eab9-4649-b925-9d31cd7aaa38 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:07.069970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-a2246473-e535-43a3-ba33-a8d7a802067a req-4de566e6-e7c7-48ce-a381-ba4d978d67bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373c0727-3fa4-4945-9b0f-3012eea4e5c7", "tag": "df51f019-ee16-4596-81ff-d9bb027f990b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:50:07.143864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a2246473-e535-43a3-ba33-a8d7a802067a req-4de566e6-e7c7-48ce-a381-ba4d978d67bc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:07.150563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a2246473-e535-43a3-ba33-a8d7a802067a req-4de566e6-e7c7-48ce-a381-ba4d978d67bc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:07.155217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-a2246473-e535-43a3-ba33-a8d7a802067a req-4de566e6-e7c7-48ce-a381-ba4d978d67bc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:07.260097 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-a2246473-e535-43a3-ba33-a8d7a802067a req-4de566e6-e7c7-48ce-a381-ba4d978d67bc service nova] Creating event network-changed:df51f019-ee16-4596-81ff-d9bb027f990b for instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 on n-h2-853611-3 Aug 18 11:50:07.309000 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-a2246473-e535-43a3-ba33-a8d7a802067a req-4de566e6-e7c7-48ce-a381-ba4d978d67bc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251680 Aug 18 11:50:07.311321 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2429/5173] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:50:07.836927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:50:08.820024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-02c3f00e-eab9-4649-b925-9d31cd7aaa38 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:08.848028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-02c3f00e-eab9-4649-b925-9d31cd7aaa38 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:08.857635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-02c3f00e-eab9-4649-b925-9d31cd7aaa38 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:08.875785 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-02c3f00e-eab9-4649-b925-9d31cd7aaa38 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1408 microversion: 2.20 time: 1.867739 Aug 18 11:50:08.880229 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2745/5174] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:50:07 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1408 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:50:09.920856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-31481a3b-b336-4969-8a56-31e2d84b1cdc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:09.928103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-31481a3b-b336-4969-8a56-31e2d84b1cdc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:09.949391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31481a3b-b336-4969-8a56-31e2d84b1cdc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:09.958657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31481a3b-b336-4969-8a56-31e2d84b1cdc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:09.959521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31481a3b-b336-4969-8a56-31e2d84b1cdc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:09.960918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31481a3b-b336-4969-8a56-31e2d84b1cdc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:09.961818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31481a3b-b336-4969-8a56-31e2d84b1cdc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:09.963108 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-31481a3b-b336-4969-8a56-31e2d84b1cdc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:12.478954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-31481a3b-b336-4969-8a56-31e2d84b1cdc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:12.481935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:50:12.498151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-31481a3b-b336-4969-8a56-31e2d84b1cdc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:12.506010 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-31481a3b-b336-4969-8a56-31e2d84b1cdc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:12.515809 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-31481a3b-b336-4969-8a56-31e2d84b1cdc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1408 microversion: 2.20 time: 2.604651 Aug 18 11:50:12.542091 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2430/5175] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:50:09 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1408 bytes in 2637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:50:12.558671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c8dfa11a-9ce6-4220-a841-40ffa0f04cc0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:12.559271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c8dfa11a-9ce6-4220-a841-40ffa0f04cc0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:12.571468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8dfa11a-9ce6-4220-a841-40ffa0f04cc0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:12.573846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8dfa11a-9ce6-4220-a841-40ffa0f04cc0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:12.574362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8dfa11a-9ce6-4220-a841-40ffa0f04cc0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:12.577177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8dfa11a-9ce6-4220-a841-40ffa0f04cc0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:12.578886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8dfa11a-9ce6-4220-a841-40ffa0f04cc0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:12.580132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8dfa11a-9ce6-4220-a841-40ffa0f04cc0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:12.613694 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-c8dfa11a-9ce6-4220-a841-40ffa0f04cc0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] HTTP exception thrown: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c8dfa11a-9ce6-4220-a841-40ffa0f04cc0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Request method failure captured: Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 HTTP/1.1 Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXF7aVR-ODVyh8kOhh5_N4gR1o8moYoxFlGY5LbM6phVerU9qudotwG0fGIEowSEflR8prTOsliKCTKsHR5KtlrLpa8GM57d9zRQvvGwKRU_ttOzZRgZLDAR1zSzbqWQSocRQpZefZWX4STscwAvOnHjdMw7CgBM4DU_Qtt1yzStVY Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 104cfd007b1043239b1818d021f4b26c Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_104cfd007b1043239b1818d021f4b26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 104cfd007b1043239b1818d021f4b26c Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AttachVolumeTestJSON-1628800706-project Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7646f45e2e054269b3d00ec53c883728 Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AttachVolumeTestJSON-1628800706-project Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '89651755-2a7f-4ccd-870e-3b2c6b29c497'} Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:50:12.616018 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:50:12.620329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:50:12.620329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:50:12.620329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:50:12.620329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:50:12.620329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:50:12.620329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:50:12.620329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:50:12.620329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:50:12.620329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:50:12.620329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:50:12.620329 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:50:12.625343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c8dfa11a-9ce6-4220-a841-40ffa0f04cc0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Returning 404 to user: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:50:12.628202 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c8dfa11a-9ce6-4220-a841-40ffa0f04cc0 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "DELETE /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 404 len: 111 microversion: 2.1 time: 0.074494 Aug 18 11:50:12.633357 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2746/5176] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:50:12 2022] DELETE /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:50:12.641906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6c732dd9-d6d7-4ea2-9f5c-dd59266eb989 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:12.643028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6c732dd9-d6d7-4ea2-9f5c-dd59266eb989 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 89651755-2a7f-4ccd-870e-3b2c6b29c497] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:12.667964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c732dd9-d6d7-4ea2-9f5c-dd59266eb989 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:12.669282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c732dd9-d6d7-4ea2-9f5c-dd59266eb989 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:12.670807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c732dd9-d6d7-4ea2-9f5c-dd59266eb989 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:12.674281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c732dd9-d6d7-4ea2-9f5c-dd59266eb989 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:12.677149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c732dd9-d6d7-4ea2-9f5c-dd59266eb989 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:12.680314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6c732dd9-d6d7-4ea2-9f5c-dd59266eb989 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:12.737284 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-6c732dd9-d6d7-4ea2-9f5c-dd59266eb989 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] HTTP exception thrown: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6c732dd9-d6d7-4ea2-9f5c-dd59266eb989 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Request method failure captured: Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 HTTP/1.1 Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXF7aVR-ODVyh8kOhh5_N4gR1o8moYoxFlGY5LbM6phVerU9qudotwG0fGIEowSEflR8prTOsliKCTKsHR5KtlrLpa8GM57d9zRQvvGwKRU_ttOzZRgZLDAR1zSzbqWQSocRQpZefZWX4STscwAvOnHjdMw7CgBM4DU_Qtt1yzStVY Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 104cfd007b1043239b1818d021f4b26c Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_104cfd007b1043239b1818d021f4b26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 104cfd007b1043239b1818d021f4b26c Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeTestJSON-1628800706-project Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7646f45e2e054269b3d00ec53c883728 Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeTestJSON-1628800706-project Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '89651755-2a7f-4ccd-870e-3b2c6b29c497'} Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:50:12.739080 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:50:12.744618 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:50:12.744618 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:50:12.744618 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:50:12.744618 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:50:12.744618 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:50:12.744618 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. Aug 18 11:50:12.744618 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:50:12.747498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6c732dd9-d6d7-4ea2-9f5c-dd59266eb989 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Returning 404 to user: Instance 89651755-2a7f-4ccd-870e-3b2c6b29c497 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:50:12.748523 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6c732dd9-d6d7-4ea2-9f5c-dd59266eb989 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497" status: 404 len: 111 microversion: 2.1 time: 0.113620 Aug 18 11:50:12.749132 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2431/5177] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:50:12 2022] GET /compute/v2.1/servers/89651755-2a7f-4ccd-870e-3b2c6b29c497 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:50:13.551399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a63a9b07-f6f1-41ff-a3b1-696b50f304f5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:13.552534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a63a9b07-f6f1-41ff-a3b1-696b50f304f5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:13.567955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a63a9b07-f6f1-41ff-a3b1-696b50f304f5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:13.571428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a63a9b07-f6f1-41ff-a3b1-696b50f304f5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:13.572251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a63a9b07-f6f1-41ff-a3b1-696b50f304f5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:13.573612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a63a9b07-f6f1-41ff-a3b1-696b50f304f5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:13.577748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a63a9b07-f6f1-41ff-a3b1-696b50f304f5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:13.578576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a63a9b07-f6f1-41ff-a3b1-696b50f304f5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:14.467666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a63a9b07-f6f1-41ff-a3b1-696b50f304f5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:14.478811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:50:14.487471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a63a9b07-f6f1-41ff-a3b1-696b50f304f5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:14.497653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a63a9b07-f6f1-41ff-a3b1-696b50f304f5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:14.499117 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a63a9b07-f6f1-41ff-a3b1-696b50f304f5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1408 microversion: 2.20 time: 0.953357 Aug 18 11:50:14.503055 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2747/5178] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:50:13 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1408 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:50:15.543931 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-11b3b5a8-6fb6-4898-9485-c8db8f1b24a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:15.544804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-11b3b5a8-6fb6-4898-9485-c8db8f1b24a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:15.610638 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11b3b5a8-6fb6-4898-9485-c8db8f1b24a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:15.617362 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11b3b5a8-6fb6-4898-9485-c8db8f1b24a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:15.619071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11b3b5a8-6fb6-4898-9485-c8db8f1b24a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:15.620133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11b3b5a8-6fb6-4898-9485-c8db8f1b24a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:15.622489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11b3b5a8-6fb6-4898-9485-c8db8f1b24a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:15.624791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11b3b5a8-6fb6-4898-9485-c8db8f1b24a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:15.989821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-57672669-7598-4456-89b9-465c01a008de req-bf4dd5bd-bedc-4b2e-a0f7-9ffcacbb4e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373c0727-3fa4-4945-9b0f-3012eea4e5c7", "name": "network-vif-plugged", "status": "completed", "tag": "df51f019-ee16-4596-81ff-d9bb027f990b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:50:16.052740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-57672669-7598-4456-89b9-465c01a008de req-bf4dd5bd-bedc-4b2e-a0f7-9ffcacbb4e5d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:16.056343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-57672669-7598-4456-89b9-465c01a008de req-bf4dd5bd-bedc-4b2e-a0f7-9ffcacbb4e5d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:16.057614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-57672669-7598-4456-89b9-465c01a008de req-bf4dd5bd-bedc-4b2e-a0f7-9ffcacbb4e5d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:16.104335 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-57672669-7598-4456-89b9-465c01a008de req-bf4dd5bd-bedc-4b2e-a0f7-9ffcacbb4e5d service nova] Creating event network-vif-plugged:df51f019-ee16-4596-81ff-d9bb027f990b for instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 on n-h2-853611-3 Aug 18 11:50:16.125110 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-57672669-7598-4456-89b9-465c01a008de req-bf4dd5bd-bedc-4b2e-a0f7-9ffcacbb4e5d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138689 Aug 18 11:50:16.126404 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2748/5179] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:50:16.753001 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-11b3b5a8-6fb6-4898-9485-c8db8f1b24a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:16.775594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-11b3b5a8-6fb6-4898-9485-c8db8f1b24a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:16.777932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-11b3b5a8-6fb6-4898-9485-c8db8f1b24a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:16.779427 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-11b3b5a8-6fb6-4898-9485-c8db8f1b24a6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1408 microversion: 2.20 time: 1.250077 Aug 18 11:50:16.797547 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2432/5180] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:50:15 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1408 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:50:17.808131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c084a8fc-fea1-43cb-9041-119f4d381cc9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:17.810213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c084a8fc-fea1-43cb-9041-119f4d381cc9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:17.825136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c084a8fc-fea1-43cb-9041-119f4d381cc9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:17.830867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c084a8fc-fea1-43cb-9041-119f4d381cc9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:17.831677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c084a8fc-fea1-43cb-9041-119f4d381cc9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:17.833876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c084a8fc-fea1-43cb-9041-119f4d381cc9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:17.833876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c084a8fc-fea1-43cb-9041-119f4d381cc9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:17.833876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c084a8fc-fea1-43cb-9041-119f4d381cc9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:18.623932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c084a8fc-fea1-43cb-9041-119f4d381cc9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:18.638522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c084a8fc-fea1-43cb-9041-119f4d381cc9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:18.645914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c084a8fc-fea1-43cb-9041-119f4d381cc9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:18.647445 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c084a8fc-fea1-43cb-9041-119f4d381cc9 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1408 microversion: 2.20 time: 0.846209 Aug 18 11:50:18.651757 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2749/5181] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:50:17 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1408 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:50:19.676166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f01d7a4d-77c3-4cb1-a1e0-2185017cf282 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:19.677439 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f01d7a4d-77c3-4cb1-a1e0-2185017cf282 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:19.699489 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f01d7a4d-77c3-4cb1-a1e0-2185017cf282 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:19.702260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f01d7a4d-77c3-4cb1-a1e0-2185017cf282 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:19.703071 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f01d7a4d-77c3-4cb1-a1e0-2185017cf282 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:19.706784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f01d7a4d-77c3-4cb1-a1e0-2185017cf282 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:19.707709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f01d7a4d-77c3-4cb1-a1e0-2185017cf282 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:19.709499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f01d7a4d-77c3-4cb1-a1e0-2185017cf282 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:20.174012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f01d7a4d-77c3-4cb1-a1e0-2185017cf282 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:20.217954 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f01d7a4d-77c3-4cb1-a1e0-2185017cf282 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:20.229163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f01d7a4d-77c3-4cb1-a1e0-2185017cf282 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:20.232725 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f01d7a4d-77c3-4cb1-a1e0-2185017cf282 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1600 microversion: 2.20 time: 0.562154 Aug 18 11:50:20.238249 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2433/5182] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:50:19 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1600 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:50:20.265077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ecf954f3-a259-4c9c-ba56-dc71080bfa34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:20.266018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ecf954f3-a259-4c9c-ba56-dc71080bfa34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:20.279814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecf954f3-a259-4c9c-ba56-dc71080bfa34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:20.280370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecf954f3-a259-4c9c-ba56-dc71080bfa34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:20.284195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecf954f3-a259-4c9c-ba56-dc71080bfa34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:20.286923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecf954f3-a259-4c9c-ba56-dc71080bfa34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:20.287509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecf954f3-a259-4c9c-ba56-dc71080bfa34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:20.288045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecf954f3-a259-4c9c-ba56-dc71080bfa34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:20.614314 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ecf954f3-a259-4c9c-ba56-dc71080bfa34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.353464 Aug 18 11:50:20.614971 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2750/5183] 10.222.0.73 () {60 vars in 1316 bytes} [Thu Aug 18 11:50:20 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7/os-interface => generated 284 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:50:20.981581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c113e189-d834-4ca3-a3bd-e97a0cd1aea7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:20.986545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c113e189-d834-4ca3-a3bd-e97a0cd1aea7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:21.021747 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c113e189-d834-4ca3-a3bd-e97a0cd1aea7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:21.029835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c113e189-d834-4ca3-a3bd-e97a0cd1aea7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:21.031592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c113e189-d834-4ca3-a3bd-e97a0cd1aea7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:21.033578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c113e189-d834-4ca3-a3bd-e97a0cd1aea7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:21.034731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c113e189-d834-4ca3-a3bd-e97a0cd1aea7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:21.035761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c113e189-d834-4ca3-a3bd-e97a0cd1aea7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:21.106414 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-c113e189-d834-4ca3-a3bd-e97a0cd1aea7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] HTTP exception thrown: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c113e189-d834-4ca3-a3bd-e97a0cd1aea7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Request method failure captured: Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a HTTP/1.1 Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iXF7aVR-ODVyh8kOhh5_N4gR1o8moYoxFlGY5LbM6phVerU9qudotwG0fGIEowSEflR8prTOsliKCTKsHR5KtlrLpa8GM57d9zRQvvGwKRU_ttOzZRgZLDAR1zSzbqWQSocRQpZefZWX4STscwAvOnHjdMw7CgBM4DU_Qtt1yzStVY Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 104cfd007b1043239b1818d021f4b26c Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_104cfd007b1043239b1818d021f4b26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 104cfd007b1043239b1818d021f4b26c Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeTestJSON-1628800706-project Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 7646f45e2e054269b3d00ec53c883728 Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeTestJSON-1628800706-project Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '0f554895-d3bd-4694-ad7a-1f23d21ed51a'} Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:50:21.108317 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:50:21.112876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:50:21.112876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:50:21.112876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:50:21.112876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:50:21.112876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:50:21.112876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:50:21.112876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:50:21.112876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:50:21.112876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:50:21.112876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:50:21.112876 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:50:21.118912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c113e189-d834-4ca3-a3bd-e97a0cd1aea7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Returning 404 to user: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:50:21.120337 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c113e189-d834-4ca3-a3bd-e97a0cd1aea7 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 404 len: 111 microversion: 2.1 time: 0.148102 Aug 18 11:50:21.122026 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2434/5184] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:50:20 2022] DELETE /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:50:21.129891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-462f0fe4-0606-476c-be56-0278c30d9b00 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:21.131028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-462f0fe4-0606-476c-be56-0278c30d9b00 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] [instance: 0f554895-d3bd-4694-ad7a-1f23d21ed51a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:21.143952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-462f0fe4-0606-476c-be56-0278c30d9b00 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:21.145063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-462f0fe4-0606-476c-be56-0278c30d9b00 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:21.146772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-462f0fe4-0606-476c-be56-0278c30d9b00 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:21.148402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-462f0fe4-0606-476c-be56-0278c30d9b00 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:21.150722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-462f0fe4-0606-476c-be56-0278c30d9b00 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:21.152222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-462f0fe4-0606-476c-be56-0278c30d9b00 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:21.184890 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-462f0fe4-0606-476c-be56-0278c30d9b00 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] HTTP exception thrown: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-462f0fe4-0606-476c-be56-0278c30d9b00 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Request method failure captured: Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a HTTP/1.1 Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iXF7aVR-ODVyh8kOhh5_N4gR1o8moYoxFlGY5LbM6phVerU9qudotwG0fGIEowSEflR8prTOsliKCTKsHR5KtlrLpa8GM57d9zRQvvGwKRU_ttOzZRgZLDAR1zSzbqWQSocRQpZefZWX4STscwAvOnHjdMw7CgBM4DU_Qtt1yzStVY Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 104cfd007b1043239b1818d021f4b26c Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_104cfd007b1043239b1818d021f4b26c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/104cfd007b1043239b1818d021f4b26c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 104cfd007b1043239b1818d021f4b26c Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1628800706 Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AttachVolumeTestJSON-1628800706-project Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 7646f45e2e054269b3d00ec53c883728 Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AttachVolumeTestJSON-1628800706-project Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '0f554895-d3bd-4694-ad7a-1f23d21ed51a'} Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:50:21.189488 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:50:21.194518 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:50:21.194518 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:50:21.194518 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:50:21.194518 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:50:21.194518 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:50:21.194518 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. Aug 18 11:50:21.194518 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:50:21.201557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-462f0fe4-0606-476c-be56-0278c30d9b00 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] Returning 404 to user: Instance 0f554895-d3bd-4694-ad7a-1f23d21ed51a could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:50:21.202681 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-462f0fe4-0606-476c-be56-0278c30d9b00 tempest-AttachVolumeTestJSON-1628800706 tempest-AttachVolumeTestJSON-1628800706-project] 10.222.0.73 "GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a" status: 404 len: 111 microversion: 2.1 time: 0.077090 Aug 18 11:50:21.204028 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2751/5185] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:50:21 2022] GET /compute/v2.1/servers/0f554895-d3bd-4694-ad7a-1f23d21ed51a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:50:27.771193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-38aa81dc-2325-4da9-b7ba-550121e6a937 req-fa5fded7-996f-42e9-bf3c-056125e381cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373c0727-3fa4-4945-9b0f-3012eea4e5c7", "tag": "df51f019-ee16-4596-81ff-d9bb027f990b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:50:27.856265 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-38aa81dc-2325-4da9-b7ba-550121e6a937 req-fa5fded7-996f-42e9-bf3c-056125e381cf service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:27.859968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-38aa81dc-2325-4da9-b7ba-550121e6a937 req-fa5fded7-996f-42e9-bf3c-056125e381cf service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:27.861730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-38aa81dc-2325-4da9-b7ba-550121e6a937 req-fa5fded7-996f-42e9-bf3c-056125e381cf service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:27.928851 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-38aa81dc-2325-4da9-b7ba-550121e6a937 req-fa5fded7-996f-42e9-bf3c-056125e381cf service nova] Creating event network-changed:df51f019-ee16-4596-81ff-d9bb027f990b for instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 on n-h2-853611-3 Aug 18 11:50:27.944375 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-38aa81dc-2325-4da9-b7ba-550121e6a937 req-fa5fded7-996f-42e9-bf3c-056125e381cf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181031 Aug 18 11:50:27.948593 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2435/5186] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:50:52.485726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:50:52.492771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=15 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:50:53.393757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-31e26205-9e2e-4410-a12c-ae22b2d3f130 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:53.394537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-31e26205-9e2e-4410-a12c-ae22b2d3f130 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:53.422739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e26205-9e2e-4410-a12c-ae22b2d3f130 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:53.424576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e26205-9e2e-4410-a12c-ae22b2d3f130 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:53.426375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e26205-9e2e-4410-a12c-ae22b2d3f130 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:53.427940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e26205-9e2e-4410-a12c-ae22b2d3f130 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:53.430600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e26205-9e2e-4410-a12c-ae22b2d3f130 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:53.433281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31e26205-9e2e-4410-a12c-ae22b2d3f130 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:53.592027 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-31e26205-9e2e-4410-a12c-ae22b2d3f130 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7/ips" status: 200 len: 151 microversion: 2.20 time: 1.104787 Aug 18 11:50:53.594967 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2752/5187] 10.222.0.73 () {60 vars in 1289 bytes} [Thu Aug 18 11:50:52 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7/ips => generated 151 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:50:54.366876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=17 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:50:54.371529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=19 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:50:55.383926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1659502676", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "d9d39231-e645-4bcc-8f56-2ad604955770"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:50:55.543406 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] validate_networks() for [('d9d39231-e645-4bcc-8f56-2ad604955770', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:50:56.711499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:50:56.713336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:50:56.720318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:50:56.721032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:50:56.721683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:50:56.753742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:56.755254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:56.756578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:56.763474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:56.780297 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:56.780919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:56.854546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Getting quotas for project 3c8e1c483ee0497aa6d0e623320850a1. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:50:56.874176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Getting quotas for user befc2c7efc744acf88e0642cc2efdb6a and project 3c8e1c483ee0497aa6d0e623320850a1. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:50:56.926721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:50:56.929191 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:50:57.107739 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c93eac01-ac1c-416a-831c-46b067b0478d tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.773908 Aug 18 11:50:57.114954 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2436/5188] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:50:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:50:57.124136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6e185d78-3789-4e99-ab17-7d4653f784dd tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:57.124942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6e185d78-3789-4e99-ab17-7d4653f784dd tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:57.137987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4877b659-324b-4e43-8f62-99b1f6ffd044 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:50:57.167401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4877b659-324b-4e43-8f62-99b1f6ffd044 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:57.194831 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4877b659-324b-4e43-8f62-99b1f6ffd044 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:57.195686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4877b659-324b-4e43-8f62-99b1f6ffd044 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:57.198286 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4877b659-324b-4e43-8f62-99b1f6ffd044 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:57.199398 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4877b659-324b-4e43-8f62-99b1f6ffd044 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:57.201327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4877b659-324b-4e43-8f62-99b1f6ffd044 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:57.202392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4877b659-324b-4e43-8f62-99b1f6ffd044 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:57.243815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-4877b659-324b-4e43-8f62-99b1f6ffd044 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lazy-loading 'flavor' on Instance uuid 373c0727-3fa4-4945-9b0f-3012eea4e5c7 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:50:57.319654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6e185d78-3789-4e99-ab17-7d4653f784dd tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:57.337423 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6e185d78-3789-4e99-ab17-7d4653f784dd tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1228 microversion: 2.1 time: 0.220766 Aug 18 11:50:57.341467 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2753/5189] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:50:57 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1228 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:50:57.756001 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4877b659-324b-4e43-8f62-99b1f6ffd044 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "POST /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7/action" status: 202 len: 0 microversion: 2.20 time: 0.617646 Aug 18 11:50:57.767720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f644a478-9296-4141-8763-21c3f83286dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:57.768342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f644a478-9296-4141-8763-21c3f83286dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:57.775899 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2437/5190] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 18 11:50:57 2022] POST /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 18 11:50:57.796394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f644a478-9296-4141-8763-21c3f83286dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:57.796913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f644a478-9296-4141-8763-21c3f83286dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:57.798101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f644a478-9296-4141-8763-21c3f83286dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:57.798912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f644a478-9296-4141-8763-21c3f83286dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:57.822935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f644a478-9296-4141-8763-21c3f83286dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:57.823489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f644a478-9296-4141-8763-21c3f83286dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:58.367855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-192911fd-694f-4d07-8b9c-8ee8959c4a88 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:58.368878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-192911fd-694f-4d07-8b9c-8ee8959c4a88 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:58.889482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f644a478-9296-4141-8763-21c3f83286dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:58.910893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f644a478-9296-4141-8763-21c3f83286dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:58.915167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f644a478-9296-4141-8763-21c3f83286dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:58.919609 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f644a478-9296-4141-8763-21c3f83286dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1724 microversion: 2.20 time: 1.155971 Aug 18 11:50:58.923872 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2754/5191] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:50:57 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1724 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:50:58.929851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-192911fd-694f-4d07-8b9c-8ee8959c4a88 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:50:58.939697 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-192911fd-694f-4d07-8b9c-8ee8959c4a88 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1228 microversion: 2.1 time: 0.576608 Aug 18 11:50:58.941879 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2438/5192] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:50:58 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1228 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:50:59.950711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fd05ac3f-ff7e-43db-b631-d443961d8f48 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:59.951450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fd05ac3f-ff7e-43db-b631-d443961d8f48 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:59.968342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dc728bbb-d415-4237-b030-55d5c6aa5d38 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:50:59.970243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dc728bbb-d415-4237-b030-55d5c6aa5d38 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:50:59.973388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd05ac3f-ff7e-43db-b631-d443961d8f48 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:59.980006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd05ac3f-ff7e-43db-b631-d443961d8f48 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:59.981934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd05ac3f-ff7e-43db-b631-d443961d8f48 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:59.983335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd05ac3f-ff7e-43db-b631-d443961d8f48 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:50:59.988087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd05ac3f-ff7e-43db-b631-d443961d8f48 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:50:59.989627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd05ac3f-ff7e-43db-b631-d443961d8f48 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:50:59.996552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc728bbb-d415-4237-b030-55d5c6aa5d38 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:00.002364 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc728bbb-d415-4237-b030-55d5c6aa5d38 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:00.005568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc728bbb-d415-4237-b030-55d5c6aa5d38 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:00.008146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc728bbb-d415-4237-b030-55d5c6aa5d38 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:00.016193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc728bbb-d415-4237-b030-55d5c6aa5d38 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:00.019078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dc728bbb-d415-4237-b030-55d5c6aa5d38 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:00.569102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dc728bbb-d415-4237-b030-55d5c6aa5d38 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:00.584550 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dc728bbb-d415-4237-b030-55d5c6aa5d38 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1280 microversion: 2.1 time: 0.621150 Aug 18 11:51:00.590285 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2439/5193] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:50:59 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1280 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:51:00.665905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fd05ac3f-ff7e-43db-b631-d443961d8f48 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:00.675453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fd05ac3f-ff7e-43db-b631-d443961d8f48 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:00.682001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fd05ac3f-ff7e-43db-b631-d443961d8f48 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:00.689598 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fd05ac3f-ff7e-43db-b631-d443961d8f48 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1724 microversion: 2.20 time: 0.743654 Aug 18 11:51:00.699306 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2755/5194] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:50:59 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1724 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:01.612853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-23affca7-5bf8-446d-ab4d-746209fe4271 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:01.614574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-23affca7-5bf8-446d-ab4d-746209fe4271 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:01.636847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23affca7-5bf8-446d-ab4d-746209fe4271 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:01.637639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23affca7-5bf8-446d-ab4d-746209fe4271 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:01.641517 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23affca7-5bf8-446d-ab4d-746209fe4271 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:01.647736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23affca7-5bf8-446d-ab4d-746209fe4271 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:01.657018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23affca7-5bf8-446d-ab4d-746209fe4271 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:01.658679 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23affca7-5bf8-446d-ab4d-746209fe4271 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:01.731258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a75feb1a-d38b-4c2b-9ec8-dbaa79a62079 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:01.732041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a75feb1a-d38b-4c2b-9ec8-dbaa79a62079 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:01.748199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a75feb1a-d38b-4c2b-9ec8-dbaa79a62079 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:01.757036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a75feb1a-d38b-4c2b-9ec8-dbaa79a62079 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:01.757602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a75feb1a-d38b-4c2b-9ec8-dbaa79a62079 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:01.759282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a75feb1a-d38b-4c2b-9ec8-dbaa79a62079 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:01.762808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a75feb1a-d38b-4c2b-9ec8-dbaa79a62079 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:01.764357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a75feb1a-d38b-4c2b-9ec8-dbaa79a62079 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:02.053852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-23affca7-5bf8-446d-ab4d-746209fe4271 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:02.065075 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-23affca7-5bf8-446d-ab4d-746209fe4271 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1286 microversion: 2.1 time: 0.457467 Aug 18 11:51:02.070725 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2440/5195] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:01 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1286 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:51:02.602783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a75feb1a-d38b-4c2b-9ec8-dbaa79a62079 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:02.612732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a75feb1a-d38b-4c2b-9ec8-dbaa79a62079 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:02.614244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a75feb1a-d38b-4c2b-9ec8-dbaa79a62079 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:02.622255 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a75feb1a-d38b-4c2b-9ec8-dbaa79a62079 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1724 microversion: 2.20 time: 0.895077 Aug 18 11:51:02.623193 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2756/5196] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:01 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1724 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:51:03.087651 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-962200f9-e08b-476d-947c-c834174281f3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:03.088288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-962200f9-e08b-476d-947c-c834174281f3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:03.100505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-962200f9-e08b-476d-947c-c834174281f3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:03.106174 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-962200f9-e08b-476d-947c-c834174281f3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:03.106897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-962200f9-e08b-476d-947c-c834174281f3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:03.107892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-962200f9-e08b-476d-947c-c834174281f3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:03.108529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-962200f9-e08b-476d-947c-c834174281f3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:03.109120 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-962200f9-e08b-476d-947c-c834174281f3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:03.671330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ee07a901-c83c-495c-aa5a-bf730edde972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:03.681531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ee07a901-c83c-495c-aa5a-bf730edde972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:03.756924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee07a901-c83c-495c-aa5a-bf730edde972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:03.761830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee07a901-c83c-495c-aa5a-bf730edde972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:03.766072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee07a901-c83c-495c-aa5a-bf730edde972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:03.799748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee07a901-c83c-495c-aa5a-bf730edde972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:03.805982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee07a901-c83c-495c-aa5a-bf730edde972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:03.811094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee07a901-c83c-495c-aa5a-bf730edde972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:04.262405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-962200f9-e08b-476d-947c-c834174281f3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:04.278080 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-962200f9-e08b-476d-947c-c834174281f3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1328 microversion: 2.1 time: 1.194844 Aug 18 11:51:04.294800 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2441/5197] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:03 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1328 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:51:04.459778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ee07a901-c83c-495c-aa5a-bf730edde972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:04.479671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ee07a901-c83c-495c-aa5a-bf730edde972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:04.489839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ee07a901-c83c-495c-aa5a-bf730edde972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:04.495453 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ee07a901-c83c-495c-aa5a-bf730edde972 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1724 microversion: 2.20 time: 0.850166 Aug 18 11:51:04.507602 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2757/5198] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:03 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1724 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:05.303093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f9f8c1ab-e3d0-4886-805d-45b3fd7edbd0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:05.303842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f9f8c1ab-e3d0-4886-805d-45b3fd7edbd0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:05.317512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9f8c1ab-e3d0-4886-805d-45b3fd7edbd0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:05.318012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9f8c1ab-e3d0-4886-805d-45b3fd7edbd0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:05.318505 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9f8c1ab-e3d0-4886-805d-45b3fd7edbd0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:05.319238 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9f8c1ab-e3d0-4886-805d-45b3fd7edbd0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:05.329857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9f8c1ab-e3d0-4886-805d-45b3fd7edbd0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:05.336020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f9f8c1ab-e3d0-4886-805d-45b3fd7edbd0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:05.534191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd64e02e-03d0-427c-aabf-92a6cd7053ff tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:05.535141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dd64e02e-03d0-427c-aabf-92a6cd7053ff tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:05.577522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd64e02e-03d0-427c-aabf-92a6cd7053ff tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:05.580302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd64e02e-03d0-427c-aabf-92a6cd7053ff tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:05.582410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd64e02e-03d0-427c-aabf-92a6cd7053ff tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:05.583808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd64e02e-03d0-427c-aabf-92a6cd7053ff tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:05.586421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd64e02e-03d0-427c-aabf-92a6cd7053ff tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:05.587164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd64e02e-03d0-427c-aabf-92a6cd7053ff tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:06.023042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd64e02e-03d0-427c-aabf-92a6cd7053ff tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:06.033131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd64e02e-03d0-427c-aabf-92a6cd7053ff tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:06.046147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd64e02e-03d0-427c-aabf-92a6cd7053ff tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:06.048273 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd64e02e-03d0-427c-aabf-92a6cd7053ff tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1724 microversion: 2.20 time: 0.524029 Aug 18 11:51:06.053316 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2758/5199] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:05 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1724 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:06.277678 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f9f8c1ab-e3d0-4886-805d-45b3fd7edbd0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:06.287698 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f9f8c1ab-e3d0-4886-805d-45b3fd7edbd0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1328 microversion: 2.1 time: 0.991412 Aug 18 11:51:06.313175 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2442/5200] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:05 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1328 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:51:07.079634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-461b102a-d67d-4294-98da-63e53b70c46f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:07.081290 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-461b102a-d67d-4294-98da-63e53b70c46f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:07.094789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:51:07.097455 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-461b102a-d67d-4294-98da-63e53b70c46f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:07.101185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-461b102a-d67d-4294-98da-63e53b70c46f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:07.127035 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-461b102a-d67d-4294-98da-63e53b70c46f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:07.137427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-461b102a-d67d-4294-98da-63e53b70c46f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:07.145303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-461b102a-d67d-4294-98da-63e53b70c46f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:07.146016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-461b102a-d67d-4294-98da-63e53b70c46f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:07.330219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:51:07.681197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-b36599fa-881c-4b6b-8488-76713fb46e27 req-c9cee59d-fb9a-40a5-8f80-e36d2d165864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44490807-25cd-4550-95b8-9d990ef72937", "tag": "850645aa-0cf7-4e66-8a96-279509fff0e7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:51:07.742173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b36599fa-881c-4b6b-8488-76713fb46e27 req-c9cee59d-fb9a-40a5-8f80-e36d2d165864 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:07.742936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b36599fa-881c-4b6b-8488-76713fb46e27 req-c9cee59d-fb9a-40a5-8f80-e36d2d165864 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:07.745909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b36599fa-881c-4b6b-8488-76713fb46e27 req-c9cee59d-fb9a-40a5-8f80-e36d2d165864 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:07.802542 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-b36599fa-881c-4b6b-8488-76713fb46e27 req-c9cee59d-fb9a-40a5-8f80-e36d2d165864 service nova] Creating event network-changed:850645aa-0cf7-4e66-8a96-279509fff0e7 for instance 44490807-25cd-4550-95b8-9d990ef72937 on n-h1-853611-3 Aug 18 11:51:07.823609 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-b36599fa-881c-4b6b-8488-76713fb46e27 req-c9cee59d-fb9a-40a5-8f80-e36d2d165864 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.828894 Aug 18 11:51:07.825832 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2759/5201] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:51:07.846013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-932670c2-ccff-49ff-a376-f289764d26d4 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:07.848342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-932670c2-ccff-49ff-a376-f289764d26d4 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:07.858645 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-461b102a-d67d-4294-98da-63e53b70c46f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:07.876851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-461b102a-d67d-4294-98da-63e53b70c46f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:07.883170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-932670c2-ccff-49ff-a376-f289764d26d4 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:07.883687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-932670c2-ccff-49ff-a376-f289764d26d4 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:07.884171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-932670c2-ccff-49ff-a376-f289764d26d4 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:07.884904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-932670c2-ccff-49ff-a376-f289764d26d4 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:07.885377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-932670c2-ccff-49ff-a376-f289764d26d4 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:07.885815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-932670c2-ccff-49ff-a376-f289764d26d4 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:07.890201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-461b102a-d67d-4294-98da-63e53b70c46f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:07.897993 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-461b102a-d67d-4294-98da-63e53b70c46f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1724 microversion: 2.20 time: 0.822309 Aug 18 11:51:07.901946 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2443/5202] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:07 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1724 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:08.548999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-932670c2-ccff-49ff-a376-f289764d26d4 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:08.563776 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-932670c2-ccff-49ff-a376-f289764d26d4 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1328 microversion: 2.1 time: 0.731441 Aug 18 11:51:08.566991 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2760/5203] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:07 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1328 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:51:08.929069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ccbafca9-10fb-46d7-8af1-09e980c30b75 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:08.929923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ccbafca9-10fb-46d7-8af1-09e980c30b75 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:08.979046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=8 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:51:08.985028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ccbafca9-10fb-46d7-8af1-09e980c30b75 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:08.993761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ccbafca9-10fb-46d7-8af1-09e980c30b75 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:08.999210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ccbafca9-10fb-46d7-8af1-09e980c30b75 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:09.000913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ccbafca9-10fb-46d7-8af1-09e980c30b75 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:09.001517 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ccbafca9-10fb-46d7-8af1-09e980c30b75 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:09.006688 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ccbafca9-10fb-46d7-8af1-09e980c30b75 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:09.588335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d48b644-24f0-4cb0-89bf-51c8c6bfbec8 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:09.591003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9d48b644-24f0-4cb0-89bf-51c8c6bfbec8 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:09.623583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d48b644-24f0-4cb0-89bf-51c8c6bfbec8 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:09.629654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d48b644-24f0-4cb0-89bf-51c8c6bfbec8 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:09.637865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d48b644-24f0-4cb0-89bf-51c8c6bfbec8 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:09.646309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d48b644-24f0-4cb0-89bf-51c8c6bfbec8 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:09.648509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d48b644-24f0-4cb0-89bf-51c8c6bfbec8 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:09.649372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d48b644-24f0-4cb0-89bf-51c8c6bfbec8 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:09.805558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ccbafca9-10fb-46d7-8af1-09e980c30b75 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:09.824059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ccbafca9-10fb-46d7-8af1-09e980c30b75 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:09.838860 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ccbafca9-10fb-46d7-8af1-09e980c30b75 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:09.841866 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ccbafca9-10fb-46d7-8af1-09e980c30b75 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1724 microversion: 2.20 time: 0.918243 Aug 18 11:51:09.845418 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2444/5204] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:08 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1724 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:10.227234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9d48b644-24f0-4cb0-89bf-51c8c6bfbec8 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:10.239751 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9d48b644-24f0-4cb0-89bf-51c8c6bfbec8 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1328 microversion: 2.1 time: 0.657750 Aug 18 11:51:10.244063 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2761/5205] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:09 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1328 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:51:10.869224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-29fd26bc-c53e-4892-b16d-b0595e147322 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:10.869852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-29fd26bc-c53e-4892-b16d-b0595e147322 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:10.878916 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29fd26bc-c53e-4892-b16d-b0595e147322 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:10.880708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29fd26bc-c53e-4892-b16d-b0595e147322 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:10.883970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29fd26bc-c53e-4892-b16d-b0595e147322 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:10.885151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29fd26bc-c53e-4892-b16d-b0595e147322 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:10.887017 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29fd26bc-c53e-4892-b16d-b0595e147322 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:10.887661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-29fd26bc-c53e-4892-b16d-b0595e147322 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:11.120865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-29fd26bc-c53e-4892-b16d-b0595e147322 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:11.129558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-29fd26bc-c53e-4892-b16d-b0595e147322 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:11.140483 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-29fd26bc-c53e-4892-b16d-b0595e147322 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:11.141725 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-29fd26bc-c53e-4892-b16d-b0595e147322 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1724 microversion: 2.20 time: 0.276927 Aug 18 11:51:11.142306 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2445/5206] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:10 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:11.266414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c8eca55f-8e83-4c3a-a2f1-fd5b693e3595 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:11.267069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c8eca55f-8e83-4c3a-a2f1-fd5b693e3595 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:11.298975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8eca55f-8e83-4c3a-a2f1-fd5b693e3595 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:11.302479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8eca55f-8e83-4c3a-a2f1-fd5b693e3595 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:11.303064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8eca55f-8e83-4c3a-a2f1-fd5b693e3595 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:11.304005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8eca55f-8e83-4c3a-a2f1-fd5b693e3595 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:11.304644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8eca55f-8e83-4c3a-a2f1-fd5b693e3595 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:11.305487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8eca55f-8e83-4c3a-a2f1-fd5b693e3595 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:11.768237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c8eca55f-8e83-4c3a-a2f1-fd5b693e3595 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:11.785234 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c8eca55f-8e83-4c3a-a2f1-fd5b693e3595 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1328 microversion: 2.1 time: 0.523429 Aug 18 11:51:11.789462 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2762/5207] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:11 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1328 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:51:12.172070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-523d260f-f01e-4342-bc9a-7edcac6b6039 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:12.172684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-523d260f-f01e-4342-bc9a-7edcac6b6039 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:12.184583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-523d260f-f01e-4342-bc9a-7edcac6b6039 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:12.185365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-523d260f-f01e-4342-bc9a-7edcac6b6039 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:12.186258 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-523d260f-f01e-4342-bc9a-7edcac6b6039 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:12.187294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-523d260f-f01e-4342-bc9a-7edcac6b6039 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:12.187935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-523d260f-f01e-4342-bc9a-7edcac6b6039 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:12.188542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-523d260f-f01e-4342-bc9a-7edcac6b6039 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:12.474568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-523d260f-f01e-4342-bc9a-7edcac6b6039 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:12.487318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-523d260f-f01e-4342-bc9a-7edcac6b6039 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:12.499334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-523d260f-f01e-4342-bc9a-7edcac6b6039 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:12.500978 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-523d260f-f01e-4342-bc9a-7edcac6b6039 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1724 microversion: 2.20 time: 0.333889 Aug 18 11:51:12.517435 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2446/5208] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:12 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1724 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:12.815180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-20e112df-c8c5-46eb-95db-af7fd4a6c8e0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:12.816517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-20e112df-c8c5-46eb-95db-af7fd4a6c8e0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:12.837877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20e112df-c8c5-46eb-95db-af7fd4a6c8e0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:12.838390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20e112df-c8c5-46eb-95db-af7fd4a6c8e0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:12.838897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20e112df-c8c5-46eb-95db-af7fd4a6c8e0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:12.841692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20e112df-c8c5-46eb-95db-af7fd4a6c8e0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:12.842228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20e112df-c8c5-46eb-95db-af7fd4a6c8e0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:12.842708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20e112df-c8c5-46eb-95db-af7fd4a6c8e0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:13.211839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-9374b5c1-a9e2-41bc-a3dc-c65d417dd8f6 req-12370348-de1d-4742-bf9a-277007854703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44490807-25cd-4550-95b8-9d990ef72937", "name": "network-vif-plugged", "status": "completed", "tag": "850645aa-0cf7-4e66-8a96-279509fff0e7"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:51:13.235752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9374b5c1-a9e2-41bc-a3dc-c65d417dd8f6 req-12370348-de1d-4742-bf9a-277007854703 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:13.238577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9374b5c1-a9e2-41bc-a3dc-c65d417dd8f6 req-12370348-de1d-4742-bf9a-277007854703 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:13.240804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9374b5c1-a9e2-41bc-a3dc-c65d417dd8f6 req-12370348-de1d-4742-bf9a-277007854703 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:13.267327 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-9374b5c1-a9e2-41bc-a3dc-c65d417dd8f6 req-12370348-de1d-4742-bf9a-277007854703 service nova] Creating event network-vif-plugged:850645aa-0cf7-4e66-8a96-279509fff0e7 for instance 44490807-25cd-4550-95b8-9d990ef72937 on n-h1-853611-3 Aug 18 11:51:13.281114 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-9374b5c1-a9e2-41bc-a3dc-c65d417dd8f6 req-12370348-de1d-4742-bf9a-277007854703 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077331 Aug 18 11:51:13.283631 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2447/5209] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:51:13.309125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-20e112df-c8c5-46eb-95db-af7fd4a6c8e0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:13.327852 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-20e112df-c8c5-46eb-95db-af7fd4a6c8e0 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1328 microversion: 2.1 time: 0.518345 Aug 18 11:51:13.329549 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2763/5210] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:12 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1328 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:51:13.525410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-116c2c4c-9101-4a5f-8d09-e81b63af8cd0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:13.526691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-116c2c4c-9101-4a5f-8d09-e81b63af8cd0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:13.544038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-116c2c4c-9101-4a5f-8d09-e81b63af8cd0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:13.544596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-116c2c4c-9101-4a5f-8d09-e81b63af8cd0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:13.546092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-116c2c4c-9101-4a5f-8d09-e81b63af8cd0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:13.547520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-116c2c4c-9101-4a5f-8d09-e81b63af8cd0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:13.551929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-116c2c4c-9101-4a5f-8d09-e81b63af8cd0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:13.555177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-116c2c4c-9101-4a5f-8d09-e81b63af8cd0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:13.812450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-116c2c4c-9101-4a5f-8d09-e81b63af8cd0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:13.825007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-116c2c4c-9101-4a5f-8d09-e81b63af8cd0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:13.828872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-116c2c4c-9101-4a5f-8d09-e81b63af8cd0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:13.829812 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-116c2c4c-9101-4a5f-8d09-e81b63af8cd0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1745 microversion: 2.20 time: 0.308755 Aug 18 11:51:13.833821 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2448/5211] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:13 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1745 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:14.350574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-501deae3-05f6-4a72-81af-afe34fc59cac tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:14.351195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-501deae3-05f6-4a72-81af-afe34fc59cac tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:14.365623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501deae3-05f6-4a72-81af-afe34fc59cac tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:14.366122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501deae3-05f6-4a72-81af-afe34fc59cac tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:14.366599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501deae3-05f6-4a72-81af-afe34fc59cac tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:14.367328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501deae3-05f6-4a72-81af-afe34fc59cac tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:14.375066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501deae3-05f6-4a72-81af-afe34fc59cac tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:14.375809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-501deae3-05f6-4a72-81af-afe34fc59cac tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:14.706118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-501deae3-05f6-4a72-81af-afe34fc59cac tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:14.735749 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-501deae3-05f6-4a72-81af-afe34fc59cac tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1328 microversion: 2.1 time: 0.388271 Aug 18 11:51:14.752430 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2764/5212] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:14 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1328 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:51:14.869096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-59c9b845-6f05-41a0-92b2-33e5c18f69c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:14.871534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-59c9b845-6f05-41a0-92b2-33e5c18f69c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:14.890420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59c9b845-6f05-41a0-92b2-33e5c18f69c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:14.891217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59c9b845-6f05-41a0-92b2-33e5c18f69c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:14.891965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59c9b845-6f05-41a0-92b2-33e5c18f69c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:14.893156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59c9b845-6f05-41a0-92b2-33e5c18f69c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:14.894209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59c9b845-6f05-41a0-92b2-33e5c18f69c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:14.897013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-59c9b845-6f05-41a0-92b2-33e5c18f69c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:15.147580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-59c9b845-6f05-41a0-92b2-33e5c18f69c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:15.157207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-59c9b845-6f05-41a0-92b2-33e5c18f69c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:15.159067 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-59c9b845-6f05-41a0-92b2-33e5c18f69c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:15.161344 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-59c9b845-6f05-41a0-92b2-33e5c18f69c0 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1745 microversion: 2.20 time: 0.303081 Aug 18 11:51:15.162785 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2449/5213] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:14 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1745 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:15.765732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-96efc606-fd9a-4789-a125-4e76e8dec9b3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:15.767399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-96efc606-fd9a-4789-a125-4e76e8dec9b3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:15.787254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96efc606-fd9a-4789-a125-4e76e8dec9b3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:15.789884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96efc606-fd9a-4789-a125-4e76e8dec9b3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:15.792413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96efc606-fd9a-4789-a125-4e76e8dec9b3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:15.793548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96efc606-fd9a-4789-a125-4e76e8dec9b3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:15.798289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96efc606-fd9a-4789-a125-4e76e8dec9b3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:15.799109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96efc606-fd9a-4789-a125-4e76e8dec9b3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:16.189991 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-942639c5-ab86-4157-89d4-bbee5d2e0514 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:16.191235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-96efc606-fd9a-4789-a125-4e76e8dec9b3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:16.192891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-942639c5-ab86-4157-89d4-bbee5d2e0514 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:16.213845 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-96efc606-fd9a-4789-a125-4e76e8dec9b3 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1526 microversion: 2.1 time: 0.454579 Aug 18 11:51:16.214466 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2765/5214] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:15 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1526 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:51:16.216926 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-942639c5-ab86-4157-89d4-bbee5d2e0514 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:16.217630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-942639c5-ab86-4157-89d4-bbee5d2e0514 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:16.218601 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-942639c5-ab86-4157-89d4-bbee5d2e0514 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:16.219504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-942639c5-ab86-4157-89d4-bbee5d2e0514 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:16.220175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-942639c5-ab86-4157-89d4-bbee5d2e0514 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:16.242151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-942639c5-ab86-4157-89d4-bbee5d2e0514 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:16.251008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fb5b5365-11ff-4802-b17c-48d5ba6000cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:16.251652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fb5b5365-11ff-4802-b17c-48d5ba6000cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:16.279781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb5b5365-11ff-4802-b17c-48d5ba6000cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:16.280875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb5b5365-11ff-4802-b17c-48d5ba6000cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:16.281507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb5b5365-11ff-4802-b17c-48d5ba6000cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:16.286874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb5b5365-11ff-4802-b17c-48d5ba6000cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:16.287363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb5b5365-11ff-4802-b17c-48d5ba6000cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:16.287802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb5b5365-11ff-4802-b17c-48d5ba6000cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:16.586995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fb5b5365-11ff-4802-b17c-48d5ba6000cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:16.594185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-942639c5-ab86-4157-89d4-bbee5d2e0514 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:16.614889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-942639c5-ab86-4157-89d4-bbee5d2e0514 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:16.615416 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fb5b5365-11ff-4802-b17c-48d5ba6000cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1526 microversion: 2.1 time: 0.379947 Aug 18 11:51:16.618132 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2766/5215] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:16 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1526 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:51:16.619547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-942639c5-ab86-4157-89d4-bbee5d2e0514 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:16.621772 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-942639c5-ab86-4157-89d4-bbee5d2e0514 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 0.437645 Aug 18 11:51:16.631494 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2450/5216] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:16 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:17.552669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b7171e6-97f1-4df1-8711-8f7f6315124b tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:17.553536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8b7171e6-97f1-4df1-8711-8f7f6315124b tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:17.566527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b7171e6-97f1-4df1-8711-8f7f6315124b tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:17.568081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b7171e6-97f1-4df1-8711-8f7f6315124b tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:17.568777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b7171e6-97f1-4df1-8711-8f7f6315124b tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:17.571434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b7171e6-97f1-4df1-8711-8f7f6315124b tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:17.572241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b7171e6-97f1-4df1-8711-8f7f6315124b tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:17.572935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b7171e6-97f1-4df1-8711-8f7f6315124b tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:17.593288 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-8b7171e6-97f1-4df1-8711-8f7f6315124b tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] HTTP exception thrown: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b7171e6-97f1-4df1-8711-8f7f6315124b tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Request method failure captured: Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 HTTP/1.1 Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iedtFOdWr2eJORuKDMyyibjuA-a3Ee9PdOSyfxQ61ajq5axw-C_WLVEgJwLnKVRHFrmTTZDIOpNVFD7AB52d8JDnrf5q6gVoUSvX8C169-l8bnBqTypVr8s9z5DNV7vM0tL0aknavFcRhKlp3nQWjxdYyq-2JA7mml-3P52nVh0fOE Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 1351e1b970e74e04ba3dd73ab83dd88a Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-660581491 Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1351e1b970e74e04ba3dd73ab83dd88a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1351e1b970e74e04ba3dd73ab83dd88a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1351e1b970e74e04ba3dd73ab83dd88a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1351e1b970e74e04ba3dd73ab83dd88a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-660581491 Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 1351e1b970e74e04ba3dd73ab83dd88a Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-660581491 Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestMultiTenantJSON-660581491-project Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6d43388e08ef4f30a08171c35d8dbb1d Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-660581491-project Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '44490807-25cd-4550-95b8-9d990ef72937'} Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:51:17.597087 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:51:17.607655 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:17.607655 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:17.607655 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:51:17.607655 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:17.607655 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:51:17.607655 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:51:17.607655 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:51:17.607655 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:51:17.607655 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:51:17.607655 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:17.607655 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:17.651674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b7171e6-97f1-4df1-8711-8f7f6315124b tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Returning 404 to user: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:51:17.651674 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8b7171e6-97f1-4df1-8711-8f7f6315124b tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] 10.222.0.73 "DELETE /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 404 len: 111 microversion: 2.1 time: 0.971510 Aug 18 11:51:17.651674 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2767/5217] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:51:16 2022] DELETE /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 111 bytes in 973 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:51:17.651981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c384c728-c940-4f67-89dd-9cf0c8c04e75 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:17.651981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c384c728-c940-4f67-89dd-9cf0c8c04e75 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:17.657687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fb25bc71-25f0-43db-9f75-0b0541886c34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:17.658820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fb25bc71-25f0-43db-9f75-0b0541886c34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:17.664586 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c384c728-c940-4f67-89dd-9cf0c8c04e75 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:17.666771 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c384c728-c940-4f67-89dd-9cf0c8c04e75 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:17.667559 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c384c728-c940-4f67-89dd-9cf0c8c04e75 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:17.670130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c384c728-c940-4f67-89dd-9cf0c8c04e75 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:17.672456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c384c728-c940-4f67-89dd-9cf0c8c04e75 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:17.673588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb25bc71-25f0-43db-9f75-0b0541886c34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:17.674299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c384c728-c940-4f67-89dd-9cf0c8c04e75 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:17.676041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb25bc71-25f0-43db-9f75-0b0541886c34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:17.677636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb25bc71-25f0-43db-9f75-0b0541886c34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:17.680455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb25bc71-25f0-43db-9f75-0b0541886c34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:17.681229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb25bc71-25f0-43db-9f75-0b0541886c34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:17.686132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb25bc71-25f0-43db-9f75-0b0541886c34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:18.027454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fb25bc71-25f0-43db-9f75-0b0541886c34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:18.042778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fb25bc71-25f0-43db-9f75-0b0541886c34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:18.044653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fb25bc71-25f0-43db-9f75-0b0541886c34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:18.050920 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fb25bc71-25f0-43db-9f75-0b0541886c34 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 0.399123 Aug 18 11:51:18.071945 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2768/5218] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:17 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:51:18.209890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c384c728-c940-4f67-89dd-9cf0c8c04e75 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:18.225332 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c384c728-c940-4f67-89dd-9cf0c8c04e75 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1526 microversion: 2.1 time: 0.603787 Aug 18 11:51:18.230023 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2451/5219] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:17 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1526 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:51:18.255693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b80e7a18-7c6d-48b1-8d89-b6d06dba9639 tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Action: 'update', calling method: >, body: {"server": {"name": "44490807-25cd-4550-95b8-9d990ef72937_new"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:51:18.261050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b80e7a18-7c6d-48b1-8d89-b6d06dba9639 tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:18.280377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-4e617afe-ced8-4212-9530-b02a91ee4470 req-6c697035-dd17-42fd-a972-f7e4c99b96d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373c0727-3fa4-4945-9b0f-3012eea4e5c7", "name": "network-vif-plugged", "status": "completed", "tag": "df51f019-ee16-4596-81ff-d9bb027f990b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:51:18.321220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b80e7a18-7c6d-48b1-8d89-b6d06dba9639 tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:18.325781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b80e7a18-7c6d-48b1-8d89-b6d06dba9639 tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:18.326865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4e617afe-ced8-4212-9530-b02a91ee4470 req-6c697035-dd17-42fd-a972-f7e4c99b96d9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:18.334178 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4e617afe-ced8-4212-9530-b02a91ee4470 req-6c697035-dd17-42fd-a972-f7e4c99b96d9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:18.334549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b80e7a18-7c6d-48b1-8d89-b6d06dba9639 tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:18.337672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b80e7a18-7c6d-48b1-8d89-b6d06dba9639 tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:18.340458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b80e7a18-7c6d-48b1-8d89-b6d06dba9639 tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:18.343400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b80e7a18-7c6d-48b1-8d89-b6d06dba9639 tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:18.348395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4e617afe-ced8-4212-9530-b02a91ee4470 req-6c697035-dd17-42fd-a972-f7e4c99b96d9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:18.383777 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-4e617afe-ced8-4212-9530-b02a91ee4470 req-6c697035-dd17-42fd-a972-f7e4c99b96d9 service nova] Creating event network-vif-plugged:df51f019-ee16-4596-81ff-d9bb027f990b for instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 on n-h2-853611-3 Aug 18 11:51:18.392349 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-4e617afe-ced8-4212-9530-b02a91ee4470 req-6c697035-dd17-42fd-a972-f7e4c99b96d9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116531 Aug 18 11:51:18.392630 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-b80e7a18-7c6d-48b1-8d89-b6d06dba9639 tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] HTTP exception thrown: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:18.394228 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2452/5220] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b80e7a18-7c6d-48b1-8d89-b6d06dba9639 tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Request method failure captured: Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: request: PUT /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 HTTP/1.1 Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 64 Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iedtFOdWr2eJORuKDMyyibjuA-a3Ee9PdOSyfxQ61ajq5axw-C_WLVEgJwLnKVRHFrmTTZDIOpNVFD7AB52d8JDnrf5q6gVoUSvX8C169-l8bnBqTypVr8s9z5DNV7vM0tL0aknavFcRhKlp3nQWjxdYyq-2JA7mml-3P52nVh0fOE Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 1351e1b970e74e04ba3dd73ab83dd88a Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-660581491 Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1351e1b970e74e04ba3dd73ab83dd88a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1351e1b970e74e04ba3dd73ab83dd88a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1351e1b970e74e04ba3dd73ab83dd88a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1351e1b970e74e04ba3dd73ab83dd88a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-660581491 Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 1351e1b970e74e04ba3dd73ab83dd88a Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-660581491 Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestMultiTenantJSON-660581491-project Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6d43388e08ef4f30a08171c35d8dbb1d Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-660581491-project Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: {"server": {"name": "44490807-25cd-4550-95b8-9d990ef72937_new"}} Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '44490807-25cd-4550-95b8-9d990ef72937', 'body': {'server': {'name': '44490807-25cd-4550-95b8-9d990ef72937_new'}}} Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:51:18.396138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b80e7a18-7c6d-48b1-8d89-b6d06dba9639 tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] Returning 404 to user: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:51:18.402681 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b80e7a18-7c6d-48b1-8d89-b6d06dba9639 tempest-ServersNegativeTestMultiTenantJSON-660581491 tempest-ServersNegativeTestMultiTenantJSON-660581491-project] 10.222.0.73 "PUT /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 404 len: 111 microversion: 2.1 time: 0.147259 Aug 18 11:51:18.406309 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2769/5221] 10.222.0.73 () {60 vars in 1256 bytes} [Thu Aug 18 11:51:18 2022] PUT /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:51:18.413184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-88926884-e280-4121-b157-0a1e9b0c7f48 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:18.414101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-88926884-e280-4121-b157-0a1e9b0c7f48 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:18.423413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88926884-e280-4121-b157-0a1e9b0c7f48 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:18.424202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88926884-e280-4121-b157-0a1e9b0c7f48 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:18.424833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88926884-e280-4121-b157-0a1e9b0c7f48 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:18.426968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88926884-e280-4121-b157-0a1e9b0c7f48 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:18.427723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88926884-e280-4121-b157-0a1e9b0c7f48 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:18.428352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88926884-e280-4121-b157-0a1e9b0c7f48 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:18.463947 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:51:18.472187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-88926884-e280-4121-b157-0a1e9b0c7f48 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:51:18.632073 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-88926884-e280-4121-b157-0a1e9b0c7f48 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "DELETE /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 204 len: 0 microversion: 2.1 time: 0.223536 Aug 18 11:51:18.635870 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2453/5222] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:51:18 2022] DELETE /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:51:18.641423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0261159-413d-48fe-8260-400fa5fff543 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:18.642695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a0261159-413d-48fe-8260-400fa5fff543 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:18.652841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0261159-413d-48fe-8260-400fa5fff543 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:18.654647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0261159-413d-48fe-8260-400fa5fff543 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:18.655532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0261159-413d-48fe-8260-400fa5fff543 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:18.658138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0261159-413d-48fe-8260-400fa5fff543 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:18.660036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0261159-413d-48fe-8260-400fa5fff543 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:18.661812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0261159-413d-48fe-8260-400fa5fff543 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:18.911736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a0261159-413d-48fe-8260-400fa5fff543 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:18.923194 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a0261159-413d-48fe-8260-400fa5fff543 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1532 microversion: 2.1 time: 0.285939 Aug 18 11:51:18.925056 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2770/5223] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:18 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1532 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:51:19.079554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2460dc88-d3a0-4f16-858f-e163780f84af tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:19.080378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2460dc88-d3a0-4f16-858f-e163780f84af tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:19.110892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2460dc88-d3a0-4f16-858f-e163780f84af tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:19.112172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2460dc88-d3a0-4f16-858f-e163780f84af tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:19.114932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2460dc88-d3a0-4f16-858f-e163780f84af tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:19.115765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2460dc88-d3a0-4f16-858f-e163780f84af tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:19.119093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2460dc88-d3a0-4f16-858f-e163780f84af tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:19.121079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2460dc88-d3a0-4f16-858f-e163780f84af tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:19.581687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2460dc88-d3a0-4f16-858f-e163780f84af tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:19.595820 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2460dc88-d3a0-4f16-858f-e163780f84af tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:19.599344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2460dc88-d3a0-4f16-858f-e163780f84af tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:19.602800 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2460dc88-d3a0-4f16-858f-e163780f84af tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 0.527927 Aug 18 11:51:19.604442 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2454/5224] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:19 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:19.950934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11afc045-2ca3-48f3-89f7-7ff5ad457076 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:19.952139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-11afc045-2ca3-48f3-89f7-7ff5ad457076 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:19.963671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11afc045-2ca3-48f3-89f7-7ff5ad457076 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:19.964182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11afc045-2ca3-48f3-89f7-7ff5ad457076 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:19.981431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11afc045-2ca3-48f3-89f7-7ff5ad457076 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:19.982273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11afc045-2ca3-48f3-89f7-7ff5ad457076 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:19.982801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11afc045-2ca3-48f3-89f7-7ff5ad457076 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:19.983248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11afc045-2ca3-48f3-89f7-7ff5ad457076 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:20.636149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cdda1f1a-916d-48d2-a601-f6778f418702 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:20.637546 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cdda1f1a-916d-48d2-a601-f6778f418702 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:20.659955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cdda1f1a-916d-48d2-a601-f6778f418702 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:20.666950 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cdda1f1a-916d-48d2-a601-f6778f418702 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:20.667930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cdda1f1a-916d-48d2-a601-f6778f418702 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:20.671624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cdda1f1a-916d-48d2-a601-f6778f418702 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:20.674930 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cdda1f1a-916d-48d2-a601-f6778f418702 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:20.679116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cdda1f1a-916d-48d2-a601-f6778f418702 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:21.117116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11afc045-2ca3-48f3-89f7-7ff5ad457076 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:21.120843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:51:21.129333 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-11afc045-2ca3-48f3-89f7-7ff5ad457076 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1532 microversion: 2.1 time: 1.183716 Aug 18 11:51:21.138464 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2771/5225] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:19 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1532 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:51:22.163198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1bb3fb14-5e45-413d-b28b-25b62a0771cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:22.164625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1bb3fb14-5e45-413d-b28b-25b62a0771cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:22.182127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb3fb14-5e45-413d-b28b-25b62a0771cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:22.183099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb3fb14-5e45-413d-b28b-25b62a0771cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:22.186537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb3fb14-5e45-413d-b28b-25b62a0771cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:22.187727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb3fb14-5e45-413d-b28b-25b62a0771cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:22.189867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb3fb14-5e45-413d-b28b-25b62a0771cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:22.191027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb3fb14-5e45-413d-b28b-25b62a0771cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:22.221144 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cdda1f1a-916d-48d2-a601-f6778f418702 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:22.244940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb3fb14-5e45-413d-b28b-25b62a0771cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:22.245871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb3fb14-5e45-413d-b28b-25b62a0771cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:22.246794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb3fb14-5e45-413d-b28b-25b62a0771cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:22.247544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-1bb3fb14-5e45-413d-b28b-25b62a0771cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lazy-loading 'fault' on Instance uuid 44490807-25cd-4550-95b8-9d990ef72937 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:51:22.250504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cdda1f1a-916d-48d2-a601-f6778f418702 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:22.260166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cdda1f1a-916d-48d2-a601-f6778f418702 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:22.272856 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cdda1f1a-916d-48d2-a601-f6778f418702 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 1.648551 Aug 18 11:51:22.275976 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2455/5226] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:20 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:51:22.321116 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-eaf8cdaa-55ca-4e9e-b0e9-987c4abc16a1 req-4e64dace-85bb-4b4b-b7d7-16136d974c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44490807-25cd-4550-95b8-9d990ef72937", "name": "network-vif-deleted", "tag": "850645aa-0cf7-4e66-8a96-279509fff0e7"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:51:22.351730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-eaf8cdaa-55ca-4e9e-b0e9-987c4abc16a1 req-4e64dace-85bb-4b4b-b7d7-16136d974c1b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:22.352266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-eaf8cdaa-55ca-4e9e-b0e9-987c4abc16a1 req-4e64dace-85bb-4b4b-b7d7-16136d974c1b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:22.352718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-eaf8cdaa-55ca-4e9e-b0e9-987c4abc16a1 req-4e64dace-85bb-4b4b-b7d7-16136d974c1b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:22.393811 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-eaf8cdaa-55ca-4e9e-b0e9-987c4abc16a1 req-4e64dace-85bb-4b4b-b7d7-16136d974c1b service nova] Creating event network-vif-deleted:850645aa-0cf7-4e66-8a96-279509fff0e7 for instance 44490807-25cd-4550-95b8-9d990ef72937 on n-h1-853611-3 Aug 18 11:51:22.412986 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-eaf8cdaa-55ca-4e9e-b0e9-987c4abc16a1 req-4e64dace-85bb-4b4b-b7d7-16136d974c1b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121486 Aug 18 11:51:22.415069 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2456/5227] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:51:22.481872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1bb3fb14-5e45-413d-b28b-25b62a0771cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc2c7efc744acf88e0642cc2efdb6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8e1c483ee0497aa6d0e623320850a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:22.494241 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1bb3fb14-5e45-413d-b28b-25b62a0771cc tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 200 len: 1318 microversion: 2.1 time: 0.335113 Aug 18 11:51:22.496257 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2772/5228] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:22 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:51:23.304153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-db007989-93f7-41a5-b0d4-56dca17c523f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:23.304853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-db007989-93f7-41a5-b0d4-56dca17c523f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:23.321226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db007989-93f7-41a5-b0d4-56dca17c523f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:23.324838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db007989-93f7-41a5-b0d4-56dca17c523f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:23.326350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db007989-93f7-41a5-b0d4-56dca17c523f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:23.327393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db007989-93f7-41a5-b0d4-56dca17c523f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:23.330239 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db007989-93f7-41a5-b0d4-56dca17c523f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:23.330734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db007989-93f7-41a5-b0d4-56dca17c523f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:23.517370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d7eeb0f-53cb-42d7-bea6-36c762dd1416 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:23.517998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9d7eeb0f-53cb-42d7-bea6-36c762dd1416 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] [instance: 44490807-25cd-4550-95b8-9d990ef72937] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:23.519985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=47 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:51:23.542965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d7eeb0f-53cb-42d7-bea6-36c762dd1416 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:23.543481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d7eeb0f-53cb-42d7-bea6-36c762dd1416 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:23.543931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d7eeb0f-53cb-42d7-bea6-36c762dd1416 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:23.544670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d7eeb0f-53cb-42d7-bea6-36c762dd1416 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:23.545283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d7eeb0f-53cb-42d7-bea6-36c762dd1416 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:23.545972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d7eeb0f-53cb-42d7-bea6-36c762dd1416 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:23.607055 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-9d7eeb0f-53cb-42d7-bea6-36c762dd1416 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] HTTP exception thrown: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d7eeb0f-53cb-42d7-bea6-36c762dd1416 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Request method failure captured: Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 HTTP/1.1 Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ieLpvyMJiI2I6IMjnXQpJPE4x3ICI7WQ442aJhF6ie9JhxYMNej06sGqoQ7BrCWo5uWoLdwLltJrr4TPBGhoMrEFrNmWNnqpcixZdDuMMO26a3WN5Qb5iqgx2WruM7bUl5fVB_5ntja4EbeLqCpICTkvd9JagxBZZDPMI9CWIk69kE Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 3c8e1c483ee0497aa6d0e623320850a1 Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1041297138 Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3c8e1c483ee0497aa6d0e623320850a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3c8e1c483ee0497aa6d0e623320850a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3c8e1c483ee0497aa6d0e623320850a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3c8e1c483ee0497aa6d0e623320850a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1041297138 Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 3c8e1c483ee0497aa6d0e623320850a1 Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1041297138 Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1041297138-project Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: befc2c7efc744acf88e0642cc2efdb6a Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1041297138-project Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '44490807-25cd-4550-95b8-9d990ef72937'} Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:23.608342 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:23.613156 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:51:23.613156 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:23.613156 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:51:23.613156 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:51:23.613156 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:51:23.613156 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:51:23.613156 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:51:23.613156 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. Aug 18 11:51:23.613156 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:51:23.613156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d7eeb0f-53cb-42d7-bea6-36c762dd1416 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] Returning 404 to user: Instance 44490807-25cd-4550-95b8-9d990ef72937 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:51:23.613156 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9d7eeb0f-53cb-42d7-bea6-36c762dd1416 tempest-ServersNegativeTestMultiTenantJSON-1041297138 tempest-ServersNegativeTestMultiTenantJSON-1041297138-project] 10.222.0.73 "GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937" status: 404 len: 111 microversion: 2.1 time: 0.097346 Aug 18 11:51:23.626537 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2773/5229] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:51:23 2022] GET /compute/v2.1/servers/44490807-25cd-4550-95b8-9d990ef72937 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:51:24.369332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-db007989-93f7-41a5-b0d4-56dca17c523f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:24.383929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-db007989-93f7-41a5-b0d4-56dca17c523f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:24.385628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-db007989-93f7-41a5-b0d4-56dca17c523f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:24.386887 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-db007989-93f7-41a5-b0d4-56dca17c523f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 1.087739 Aug 18 11:51:24.398097 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2457/5230] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:23 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:25.425830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b0f533c4-58c1-43e4-b63f-865836674264 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:25.426663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b0f533c4-58c1-43e4-b63f-865836674264 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:25.456129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0f533c4-58c1-43e4-b63f-865836674264 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:25.460939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0f533c4-58c1-43e4-b63f-865836674264 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:25.463154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0f533c4-58c1-43e4-b63f-865836674264 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:25.469568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0f533c4-58c1-43e4-b63f-865836674264 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:25.472251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0f533c4-58c1-43e4-b63f-865836674264 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:25.479506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0f533c4-58c1-43e4-b63f-865836674264 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:26.778267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b0f533c4-58c1-43e4-b63f-865836674264 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:26.793156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b0f533c4-58c1-43e4-b63f-865836674264 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:26.832264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b0f533c4-58c1-43e4-b63f-865836674264 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:26.833660 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b0f533c4-58c1-43e4-b63f-865836674264 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 1.412780 Aug 18 11:51:26.853384 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2774/5231] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:25 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:27.862087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-25c260b8-7f85-44d7-a1f2-309fa75901d4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:27.862889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-25c260b8-7f85-44d7-a1f2-309fa75901d4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:27.882293 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:51:27.893405 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25c260b8-7f85-44d7-a1f2-309fa75901d4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:27.893925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25c260b8-7f85-44d7-a1f2-309fa75901d4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:27.894383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25c260b8-7f85-44d7-a1f2-309fa75901d4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:27.895152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25c260b8-7f85-44d7-a1f2-309fa75901d4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:27.895619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25c260b8-7f85-44d7-a1f2-309fa75901d4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:27.896056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-25c260b8-7f85-44d7-a1f2-309fa75901d4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:28.536671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-25c260b8-7f85-44d7-a1f2-309fa75901d4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:28.621644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-25c260b8-7f85-44d7-a1f2-309fa75901d4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:28.629736 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-25c260b8-7f85-44d7-a1f2-309fa75901d4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:28.645096 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-25c260b8-7f85-44d7-a1f2-309fa75901d4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 0.789687 Aug 18 11:51:28.665182 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2458/5232] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:27 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:29.672820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b22733f8-cfb7-4e5d-988b-af3b73116542 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:29.673448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b22733f8-cfb7-4e5d-988b-af3b73116542 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:29.704802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b22733f8-cfb7-4e5d-988b-af3b73116542 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:29.708584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b22733f8-cfb7-4e5d-988b-af3b73116542 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:29.712414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b22733f8-cfb7-4e5d-988b-af3b73116542 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:29.716980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b22733f8-cfb7-4e5d-988b-af3b73116542 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:29.718289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b22733f8-cfb7-4e5d-988b-af3b73116542 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:29.721686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b22733f8-cfb7-4e5d-988b-af3b73116542 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:32.003064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b22733f8-cfb7-4e5d-988b-af3b73116542 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:32.037219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b22733f8-cfb7-4e5d-988b-af3b73116542 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:32.045997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b22733f8-cfb7-4e5d-988b-af3b73116542 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:32.056080 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b22733f8-cfb7-4e5d-988b-af3b73116542 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 2.387283 Aug 18 11:51:32.060099 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2775/5233] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:29 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 2392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:33.085641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-78789bfb-fae2-468d-98b7-aba310c59062 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:33.086998 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-78789bfb-fae2-468d-98b7-aba310c59062 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:33.111199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78789bfb-fae2-468d-98b7-aba310c59062 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:33.114162 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78789bfb-fae2-468d-98b7-aba310c59062 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:33.116182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78789bfb-fae2-468d-98b7-aba310c59062 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:33.119704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78789bfb-fae2-468d-98b7-aba310c59062 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:33.120955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78789bfb-fae2-468d-98b7-aba310c59062 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:33.126009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78789bfb-fae2-468d-98b7-aba310c59062 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:35.698151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-78789bfb-fae2-468d-98b7-aba310c59062 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:35.716846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-78789bfb-fae2-468d-98b7-aba310c59062 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:35.719211 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-78789bfb-fae2-468d-98b7-aba310c59062 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:35.721247 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-78789bfb-fae2-468d-98b7-aba310c59062 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 2.639922 Aug 18 11:51:35.748814 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2459/5234] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:33 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 2666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:36.752324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-65fbae1f-258b-4fdd-837b-1fc5ac9348d8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:36.754303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-65fbae1f-258b-4fdd-837b-1fc5ac9348d8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:36.785957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65fbae1f-258b-4fdd-837b-1fc5ac9348d8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:36.787596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65fbae1f-258b-4fdd-837b-1fc5ac9348d8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:36.790564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65fbae1f-258b-4fdd-837b-1fc5ac9348d8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:36.791412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65fbae1f-258b-4fdd-837b-1fc5ac9348d8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:36.791979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65fbae1f-258b-4fdd-837b-1fc5ac9348d8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:36.796054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65fbae1f-258b-4fdd-837b-1fc5ac9348d8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:37.734858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-65fbae1f-258b-4fdd-837b-1fc5ac9348d8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:37.749473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-65fbae1f-258b-4fdd-837b-1fc5ac9348d8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:37.759476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-65fbae1f-258b-4fdd-837b-1fc5ac9348d8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:37.768717 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-65fbae1f-258b-4fdd-837b-1fc5ac9348d8 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 1.023133 Aug 18 11:51:37.776305 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2776/5235] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:36 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:38.802213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-087e8452-fa1f-4da5-b891-8219f11418dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:38.803244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-087e8452-fa1f-4da5-b891-8219f11418dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:38.832618 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-087e8452-fa1f-4da5-b891-8219f11418dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:38.832618 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-087e8452-fa1f-4da5-b891-8219f11418dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:38.832618 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-087e8452-fa1f-4da5-b891-8219f11418dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:38.832618 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-087e8452-fa1f-4da5-b891-8219f11418dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:38.837890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-087e8452-fa1f-4da5-b891-8219f11418dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:38.838990 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-087e8452-fa1f-4da5-b891-8219f11418dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:39.727397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-087e8452-fa1f-4da5-b891-8219f11418dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:39.803009 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-087e8452-fa1f-4da5-b891-8219f11418dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:39.804657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-087e8452-fa1f-4da5-b891-8219f11418dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:39.814466 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-087e8452-fa1f-4da5-b891-8219f11418dd tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 1.007910 Aug 18 11:51:39.831705 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2460/5236] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:38 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:40.847865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5bccad39-34e0-4ede-a6e4-51d5e60dfbd4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:40.850302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5bccad39-34e0-4ede-a6e4-51d5e60dfbd4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:40.869958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bccad39-34e0-4ede-a6e4-51d5e60dfbd4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:40.870721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bccad39-34e0-4ede-a6e4-51d5e60dfbd4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:40.874313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bccad39-34e0-4ede-a6e4-51d5e60dfbd4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:40.875414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bccad39-34e0-4ede-a6e4-51d5e60dfbd4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:40.876152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bccad39-34e0-4ede-a6e4-51d5e60dfbd4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:40.876787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bccad39-34e0-4ede-a6e4-51d5e60dfbd4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:41.554233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5bccad39-34e0-4ede-a6e4-51d5e60dfbd4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:41.574388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5bccad39-34e0-4ede-a6e4-51d5e60dfbd4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:41.581158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5bccad39-34e0-4ede-a6e4-51d5e60dfbd4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:41.591387 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5bccad39-34e0-4ede-a6e4-51d5e60dfbd4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 0.750471 Aug 18 11:51:41.603530 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2777/5237] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:40 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:42.632892 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6ed82519-7e11-449b-8cce-a055d4920567 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:42.634902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6ed82519-7e11-449b-8cce-a055d4920567 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:42.650086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ed82519-7e11-449b-8cce-a055d4920567 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:42.655977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ed82519-7e11-449b-8cce-a055d4920567 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:42.656685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ed82519-7e11-449b-8cce-a055d4920567 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:42.657620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ed82519-7e11-449b-8cce-a055d4920567 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:42.658248 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ed82519-7e11-449b-8cce-a055d4920567 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:42.658886 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6ed82519-7e11-449b-8cce-a055d4920567 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:44.006203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6ed82519-7e11-449b-8cce-a055d4920567 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:44.026977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6ed82519-7e11-449b-8cce-a055d4920567 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:44.037424 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6ed82519-7e11-449b-8cce-a055d4920567 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:44.039180 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6ed82519-7e11-449b-8cce-a055d4920567 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 1.412578 Aug 18 11:51:44.040280 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2461/5238] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:42 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:45.069214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a851c32a-42f3-41ac-9100-358b16d955c1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:45.069892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a851c32a-42f3-41ac-9100-358b16d955c1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:45.091103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a851c32a-42f3-41ac-9100-358b16d955c1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:45.094751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a851c32a-42f3-41ac-9100-358b16d955c1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:45.095345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a851c32a-42f3-41ac-9100-358b16d955c1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:45.096326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a851c32a-42f3-41ac-9100-358b16d955c1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:45.096981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a851c32a-42f3-41ac-9100-358b16d955c1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:45.100036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a851c32a-42f3-41ac-9100-358b16d955c1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:46.459722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a851c32a-42f3-41ac-9100-358b16d955c1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:46.486612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a851c32a-42f3-41ac-9100-358b16d955c1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:46.495667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a851c32a-42f3-41ac-9100-358b16d955c1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:46.507981 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a851c32a-42f3-41ac-9100-358b16d955c1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 1.437832 Aug 18 11:51:46.510756 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2778/5239] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:45 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:47.537834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-280421e5-ec79-4305-a920-4670345f90d5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:47.538485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-280421e5-ec79-4305-a920-4670345f90d5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:47.569157 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-280421e5-ec79-4305-a920-4670345f90d5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:47.569718 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-280421e5-ec79-4305-a920-4670345f90d5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:47.574391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-280421e5-ec79-4305-a920-4670345f90d5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:47.582273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-280421e5-ec79-4305-a920-4670345f90d5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:47.586607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-280421e5-ec79-4305-a920-4670345f90d5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:47.589891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-280421e5-ec79-4305-a920-4670345f90d5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:48.039096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-280421e5-ec79-4305-a920-4670345f90d5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:48.057046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-280421e5-ec79-4305-a920-4670345f90d5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:48.060499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-280421e5-ec79-4305-a920-4670345f90d5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:48.064610 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-280421e5-ec79-4305-a920-4670345f90d5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 0.532857 Aug 18 11:51:48.083139 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2462/5240] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:47 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:49.067018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c46c1be9-54b8-4818-92b5-ff0d88abba44 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979-project-admin] Calling method '.version_select at 0x7f519e855310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:49.069028 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:51:49.069028 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 11:51:49.070765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c46c1be9-54b8-4818-92b5-ff0d88abba44 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:49.071548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c46c1be9-54b8-4818-92b5-ff0d88abba44 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:49.074229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c46c1be9-54b8-4818-92b5-ff0d88abba44 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:49.104024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f1ba9d87-a758-4955-9906-9ea9c13f71e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:49.107058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f1ba9d87-a758-4955-9906-9ea9c13f71e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:49.125720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1ba9d87-a758-4955-9906-9ea9c13f71e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:49.127050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1ba9d87-a758-4955-9906-9ea9c13f71e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:49.127751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1ba9d87-a758-4955-9906-9ea9c13f71e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:49.133117 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1ba9d87-a758-4955-9906-9ea9c13f71e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:49.133966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1ba9d87-a758-4955-9906-9ea9c13f71e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:49.135243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f1ba9d87-a758-4955-9906-9ea9c13f71e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:49.161673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c46c1be9-54b8-4818-92b5-ff0d88abba44 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:49.162840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c46c1be9-54b8-4818-92b5-ff0d88abba44 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:49.163676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c46c1be9-54b8-4818-92b5-ff0d88abba44 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:49.211449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c46c1be9-54b8-4818-92b5-ff0d88abba44 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:49.213568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c46c1be9-54b8-4818-92b5-ff0d88abba44 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:49.215114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c46c1be9-54b8-4818-92b5-ff0d88abba44 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:49.237244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:51:49.241998 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c46c1be9-54b8-4818-92b5-ff0d88abba44 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1876560979-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.531065 Aug 18 11:51:49.263941 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2779/5241] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:51:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:51:49.748999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f1ba9d87-a758-4955-9906-9ea9c13f71e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:49.765204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f1ba9d87-a758-4955-9906-9ea9c13f71e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:49.781463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f1ba9d87-a758-4955-9906-9ea9c13f71e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:49.798100 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f1ba9d87-a758-4955-9906-9ea9c13f71e5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 0.700051 Aug 18 11:51:49.806056 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2463/5242] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:49 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:50.826023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2855bf4a-a95d-48f6-a034-ad1f27701e37 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:50.826824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2855bf4a-a95d-48f6-a034-ad1f27701e37 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:50.848327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2855bf4a-a95d-48f6-a034-ad1f27701e37 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:50.848815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2855bf4a-a95d-48f6-a034-ad1f27701e37 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:50.849271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2855bf4a-a95d-48f6-a034-ad1f27701e37 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:50.850078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2855bf4a-a95d-48f6-a034-ad1f27701e37 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:50.858071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2855bf4a-a95d-48f6-a034-ad1f27701e37 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:50.858673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2855bf4a-a95d-48f6-a034-ad1f27701e37 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:51.525850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2855bf4a-a95d-48f6-a034-ad1f27701e37 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:51.563739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2855bf4a-a95d-48f6-a034-ad1f27701e37 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:51.584413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2855bf4a-a95d-48f6-a034-ad1f27701e37 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:51.586611 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2855bf4a-a95d-48f6-a034-ad1f27701e37 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 0.764789 Aug 18 11:51:51.614772 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2780/5243] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:50 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:52.626830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cd7129b0-0813-43f3-bc9e-0691b72d29c4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:52.629529 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-cd7129b0-0813-43f3-bc9e-0691b72d29c4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:52.662605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd7129b0-0813-43f3-bc9e-0691b72d29c4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:52.663105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd7129b0-0813-43f3-bc9e-0691b72d29c4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:52.665228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd7129b0-0813-43f3-bc9e-0691b72d29c4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:52.667841 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd7129b0-0813-43f3-bc9e-0691b72d29c4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:52.673808 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd7129b0-0813-43f3-bc9e-0691b72d29c4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:52.674397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-cd7129b0-0813-43f3-bc9e-0691b72d29c4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:53.422953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cd7129b0-0813-43f3-bc9e-0691b72d29c4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:53.442115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cd7129b0-0813-43f3-bc9e-0691b72d29c4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:53.453127 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-cd7129b0-0813-43f3-bc9e-0691b72d29c4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:53.455189 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cd7129b0-0813-43f3-bc9e-0691b72d29c4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1740 microversion: 2.20 time: 0.832528 Aug 18 11:51:53.456121 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2464/5244] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:52 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1740 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:54.505251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b07943ef-4cda-43e2-ba34-ba1d3448f00d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:54.507965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b07943ef-4cda-43e2-ba34-ba1d3448f00d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:54.526035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=18 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:51:54.529872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b07943ef-4cda-43e2-ba34-ba1d3448f00d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:54.531107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b07943ef-4cda-43e2-ba34-ba1d3448f00d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:54.531863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b07943ef-4cda-43e2-ba34-ba1d3448f00d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:54.537085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b07943ef-4cda-43e2-ba34-ba1d3448f00d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:54.539394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b07943ef-4cda-43e2-ba34-ba1d3448f00d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:54.540024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b07943ef-4cda-43e2-ba34-ba1d3448f00d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:54.551507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=53 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:51:54.878036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b07943ef-4cda-43e2-ba34-ba1d3448f00d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:54.890967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b07943ef-4cda-43e2-ba34-ba1d3448f00d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:54.892525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b07943ef-4cda-43e2-ba34-ba1d3448f00d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:54.901309 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b07943ef-4cda-43e2-ba34-ba1d3448f00d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1722 microversion: 2.20 time: 0.394030 Aug 18 11:51:54.902890 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2781/5245] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:54 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1722 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:55.734024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-cd7129b0-0813-43f3-bc9e-0691b72d29c4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:55.741818 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-cd7129b0-0813-43f3-bc9e-0691b72d29c4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute//" status: 200 len: 377 microversion: - time: 0.008555 Aug 18 11:51:55.743465 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2465/5246] 10.222.0.73 () {56 vars in 886 bytes} [Thu Aug 18 11:51:55 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 18 11:51:55.930128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd794772-4fea-4459-97f1-0be6d72f4dca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:55.935613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dd794772-4fea-4459-97f1-0be6d72f4dca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:55.989226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd794772-4fea-4459-97f1-0be6d72f4dca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:55.991811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd794772-4fea-4459-97f1-0be6d72f4dca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:55.995930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd794772-4fea-4459-97f1-0be6d72f4dca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:55.997877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd794772-4fea-4459-97f1-0be6d72f4dca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:56.000691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd794772-4fea-4459-97f1-0be6d72f4dca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:56.004899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd794772-4fea-4459-97f1-0be6d72f4dca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:56.642164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-ad45b87c-d189-4406-a401-968a87835a7a req-9e7f7965-3619-4baf-bf96-542256e686be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373c0727-3fa4-4945-9b0f-3012eea4e5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "df51f019-ee16-4596-81ff-d9bb027f990b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:51:56.676937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ad45b87c-d189-4406-a401-968a87835a7a req-9e7f7965-3619-4baf-bf96-542256e686be service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:56.677832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ad45b87c-d189-4406-a401-968a87835a7a req-9e7f7965-3619-4baf-bf96-542256e686be service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:56.681416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-ad45b87c-d189-4406-a401-968a87835a7a req-9e7f7965-3619-4baf-bf96-542256e686be service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:56.714869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.compute.server_external_events [req-ad45b87c-d189-4406-a401-968a87835a7a req-9e7f7965-3619-4baf-bf96-542256e686be service nova] Unable to find a host for instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7. Dropping event network-vif-unplugged {{(pid=122209) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 11:51:56.716109 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-ad45b87c-d189-4406-a401-968a87835a7a req-9e7f7965-3619-4baf-bf96-542256e686be service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.759021 Aug 18 11:51:56.724091 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2466/5247] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 767 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 18 11:51:56.857222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd794772-4fea-4459-97f1-0be6d72f4dca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:56.873398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd794772-4fea-4459-97f1-0be6d72f4dca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:56.875434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd794772-4fea-4459-97f1-0be6d72f4dca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:56.884506 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd794772-4fea-4459-97f1-0be6d72f4dca tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1722 microversion: 2.20 time: 0.961754 Aug 18 11:51:56.885961 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2782/5248] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:55 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1722 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:57.912971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-94c2e2a2-d6ae-48b0-8524-525ec14a0845 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:57.913791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-94c2e2a2-d6ae-48b0-8524-525ec14a0845 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:57.925488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94c2e2a2-d6ae-48b0-8524-525ec14a0845 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:57.933499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94c2e2a2-d6ae-48b0-8524-525ec14a0845 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:57.936194 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94c2e2a2-d6ae-48b0-8524-525ec14a0845 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:57.938330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94c2e2a2-d6ae-48b0-8524-525ec14a0845 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:57.939058 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94c2e2a2-d6ae-48b0-8524-525ec14a0845 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:57.940832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-94c2e2a2-d6ae-48b0-8524-525ec14a0845 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:58.315320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-94c2e2a2-d6ae-48b0-8524-525ec14a0845 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:58.335663 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-94c2e2a2-d6ae-48b0-8524-525ec14a0845 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:58.337821 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-94c2e2a2-d6ae-48b0-8524-525ec14a0845 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:51:58.340187 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-94c2e2a2-d6ae-48b0-8524-525ec14a0845 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1665 microversion: 2.20 time: 0.430891 Aug 18 11:51:58.354641 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2467/5249] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:51:57 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1665 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:51:58.369713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b1b0d10a-2355-4028-8c5a-7f07c281f684 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e923406-f482-43b8-9fa1-87352bf25d89"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:51:58.377725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b1b0d10a-2355-4028-8c5a-7f07c281f684 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:58.392064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1b0d10a-2355-4028-8c5a-7f07c281f684 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:58.392960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1b0d10a-2355-4028-8c5a-7f07c281f684 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:58.394382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1b0d10a-2355-4028-8c5a-7f07c281f684 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:58.396512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1b0d10a-2355-4028-8c5a-7f07c281f684 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:58.397279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1b0d10a-2355-4028-8c5a-7f07c281f684 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:58.397947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1b0d10a-2355-4028-8c5a-7f07c281f684 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:59.014927 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b1b0d10a-2355-4028-8c5a-7f07c281f684 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "POST /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.653141 Aug 18 11:51:59.015995 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2783/5250] 10.222.0.73 () {62 vars in 1364 bytes} [Thu Aug 18 11:51:58 2022] POST /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7/os-volume_attachments => generated 188 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 11:51:59.294725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-04c139f0-bc6f-4b24-bdd7-dd4135f6c273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:51:59.295173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-04c139f0-bc6f-4b24-bdd7-dd4135f6c273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:51:59.302938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=18 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:51:59.304716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04c139f0-bc6f-4b24-bdd7-dd4135f6c273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:59.305728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04c139f0-bc6f-4b24-bdd7-dd4135f6c273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:59.306417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04c139f0-bc6f-4b24-bdd7-dd4135f6c273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:59.307411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04c139f0-bc6f-4b24-bdd7-dd4135f6c273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:51:59.310606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04c139f0-bc6f-4b24-bdd7-dd4135f6c273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:51:59.311620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-04c139f0-bc6f-4b24-bdd7-dd4135f6c273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:51:59.957219 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-04c139f0-bc6f-4b24-bdd7-dd4135f6c273 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "DELETE /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7/os-volume_attachments/8e923406-f482-43b8-9fa1-87352bf25d89" status: 202 len: 0 microversion: 2.20 time: 0.666906 Aug 18 11:51:59.962779 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2468/5251] 10.222.0.73 () {60 vars in 1457 bytes} [Thu Aug 18 11:51:59 2022] DELETE /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7/os-volume_attachments/8e923406-f482-43b8-9fa1-87352bf25d89 => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:52:00.057904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7318c22e-b214-47fb-86e1-00a1d11d9b6f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:52:00.060241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7318c22e-b214-47fb-86e1-00a1d11d9b6f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:00.085549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7318c22e-b214-47fb-86e1-00a1d11d9b6f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:00.085981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7318c22e-b214-47fb-86e1-00a1d11d9b6f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:00.086473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7318c22e-b214-47fb-86e1-00a1d11d9b6f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:00.090632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7318c22e-b214-47fb-86e1-00a1d11d9b6f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:00.091457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7318c22e-b214-47fb-86e1-00a1d11d9b6f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:00.094295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7318c22e-b214-47fb-86e1-00a1d11d9b6f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:00.157924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7318c22e-b214-47fb-86e1-00a1d11d9b6f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122210) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 18 11:52:00.379071 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7318c22e-b214-47fb-86e1-00a1d11d9b6f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "POST /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7/action" status: 202 len: 0 microversion: 2.20 time: 0.325339 Aug 18 11:52:00.388482 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2784/5252] 10.222.0.73 () {62 vars in 1319 bytes} [Thu Aug 18 11:52:00 2022] POST /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:52:00.396583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a9e70016-2047-4e1c-81f6-939e4c9ef550 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:00.398629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a9e70016-2047-4e1c-81f6-939e4c9ef550 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:00.421346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9e70016-2047-4e1c-81f6-939e4c9ef550 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:00.423004 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9e70016-2047-4e1c-81f6-939e4c9ef550 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:00.426392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9e70016-2047-4e1c-81f6-939e4c9ef550 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:00.427524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9e70016-2047-4e1c-81f6-939e4c9ef550 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:00.428352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9e70016-2047-4e1c-81f6-939e4c9ef550 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:00.428856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9e70016-2047-4e1c-81f6-939e4c9ef550 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:00.953898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a9e70016-2047-4e1c-81f6-939e4c9ef550 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:00.967563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a9e70016-2047-4e1c-81f6-939e4c9ef550 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:00.974021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a9e70016-2047-4e1c-81f6-939e4c9ef550 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:00.976565 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a9e70016-2047-4e1c-81f6-939e4c9ef550 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1673 microversion: 2.20 time: 0.586842 Aug 18 11:52:00.980794 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2469/5253] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:00 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1673 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:52:02.023499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6982d786-fb17-4787-af5c-7d3036d13b41 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:02.025000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6982d786-fb17-4787-af5c-7d3036d13b41 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:02.039925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6982d786-fb17-4787-af5c-7d3036d13b41 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:02.040781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6982d786-fb17-4787-af5c-7d3036d13b41 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:02.041937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6982d786-fb17-4787-af5c-7d3036d13b41 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:02.046852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6982d786-fb17-4787-af5c-7d3036d13b41 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:02.047555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6982d786-fb17-4787-af5c-7d3036d13b41 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:02.048022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6982d786-fb17-4787-af5c-7d3036d13b41 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:02.857489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6982d786-fb17-4787-af5c-7d3036d13b41 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:02.907235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6982d786-fb17-4787-af5c-7d3036d13b41 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:02.926199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6982d786-fb17-4787-af5c-7d3036d13b41 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:02.929813 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6982d786-fb17-4787-af5c-7d3036d13b41 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1673 microversion: 2.20 time: 0.911293 Aug 18 11:52:02.950525 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2785/5254] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:02 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1673 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:52:03.987279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0427ab03-7185-435d-882e-84828a2ba2f4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:03.988106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0427ab03-7185-435d-882e-84828a2ba2f4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:04.002160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0427ab03-7185-435d-882e-84828a2ba2f4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:04.002709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0427ab03-7185-435d-882e-84828a2ba2f4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:04.003160 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0427ab03-7185-435d-882e-84828a2ba2f4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:04.003908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0427ab03-7185-435d-882e-84828a2ba2f4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:04.004371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0427ab03-7185-435d-882e-84828a2ba2f4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:04.004805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0427ab03-7185-435d-882e-84828a2ba2f4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:04.495042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0427ab03-7185-435d-882e-84828a2ba2f4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:04.514377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0427ab03-7185-435d-882e-84828a2ba2f4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:04.518958 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0427ab03-7185-435d-882e-84828a2ba2f4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:04.520514 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0427ab03-7185-435d-882e-84828a2ba2f4 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 0.538707 Aug 18 11:52:04.551126 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2470/5255] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:03 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:52:05.562708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc985320-a9f0-46c6-abda-0557f29b5fee tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:05.564146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dc985320-a9f0-46c6-abda-0557f29b5fee tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:05.576255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc985320-a9f0-46c6-abda-0557f29b5fee tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:05.577130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc985320-a9f0-46c6-abda-0557f29b5fee tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:05.579261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc985320-a9f0-46c6-abda-0557f29b5fee tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:05.583454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc985320-a9f0-46c6-abda-0557f29b5fee tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:05.584951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc985320-a9f0-46c6-abda-0557f29b5fee tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:05.585825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc985320-a9f0-46c6-abda-0557f29b5fee tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:07.476047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dc985320-a9f0-46c6-abda-0557f29b5fee tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:07.491296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dc985320-a9f0-46c6-abda-0557f29b5fee tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:07.497738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dc985320-a9f0-46c6-abda-0557f29b5fee tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:07.500653 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dc985320-a9f0-46c6-abda-0557f29b5fee tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 1.951374 Aug 18 11:52:07.508358 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2786/5256] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:05 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:52:08.532298 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-78fb84e5-49fb-4151-8d65-8a1844fcafcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:08.533528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-78fb84e5-49fb-4151-8d65-8a1844fcafcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:08.553745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78fb84e5-49fb-4151-8d65-8a1844fcafcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:08.574353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78fb84e5-49fb-4151-8d65-8a1844fcafcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:08.574881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78fb84e5-49fb-4151-8d65-8a1844fcafcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:08.583314 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78fb84e5-49fb-4151-8d65-8a1844fcafcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:08.589224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78fb84e5-49fb-4151-8d65-8a1844fcafcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:08.589834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-78fb84e5-49fb-4151-8d65-8a1844fcafcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:09.256923 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-78fb84e5-49fb-4151-8d65-8a1844fcafcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:09.274626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-78fb84e5-49fb-4151-8d65-8a1844fcafcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:09.280309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-78fb84e5-49fb-4151-8d65-8a1844fcafcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:09.282853 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-78fb84e5-49fb-4151-8d65-8a1844fcafcb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 0.756206 Aug 18 11:52:09.286591 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2471/5257] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:08 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:52:10.311558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-702d5679-106d-498b-bd91-334514ee6113 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:10.312178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-702d5679-106d-498b-bd91-334514ee6113 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:10.327998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-702d5679-106d-498b-bd91-334514ee6113 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:10.328502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-702d5679-106d-498b-bd91-334514ee6113 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:10.328942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-702d5679-106d-498b-bd91-334514ee6113 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:10.329667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-702d5679-106d-498b-bd91-334514ee6113 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:10.330134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-702d5679-106d-498b-bd91-334514ee6113 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:10.355152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-702d5679-106d-498b-bd91-334514ee6113 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:10.791583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-702d5679-106d-498b-bd91-334514ee6113 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:10.811878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-702d5679-106d-498b-bd91-334514ee6113 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:10.820619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-702d5679-106d-498b-bd91-334514ee6113 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:10.826459 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-702d5679-106d-498b-bd91-334514ee6113 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 0.518219 Aug 18 11:52:10.829764 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2787/5258] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:10 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:52:11.856388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b106df12-3ce2-4a68-b3f8-8f3d850c22bc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:11.857284 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b106df12-3ce2-4a68-b3f8-8f3d850c22bc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:11.875622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b106df12-3ce2-4a68-b3f8-8f3d850c22bc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:11.876430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b106df12-3ce2-4a68-b3f8-8f3d850c22bc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:11.879501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b106df12-3ce2-4a68-b3f8-8f3d850c22bc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:11.880524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b106df12-3ce2-4a68-b3f8-8f3d850c22bc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:11.881177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b106df12-3ce2-4a68-b3f8-8f3d850c22bc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:11.884122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b106df12-3ce2-4a68-b3f8-8f3d850c22bc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:13.321432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b106df12-3ce2-4a68-b3f8-8f3d850c22bc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:13.337592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b106df12-3ce2-4a68-b3f8-8f3d850c22bc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:13.342125 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b106df12-3ce2-4a68-b3f8-8f3d850c22bc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:13.345695 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b106df12-3ce2-4a68-b3f8-8f3d850c22bc tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 1.493244 Aug 18 11:52:13.349655 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2472/5259] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:11 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:52:14.388914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-86f422c1-fc9b-49fc-a5ec-719535baa2fb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:14.391142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-86f422c1-fc9b-49fc-a5ec-719535baa2fb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:14.420384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f422c1-fc9b-49fc-a5ec-719535baa2fb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:14.421800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f422c1-fc9b-49fc-a5ec-719535baa2fb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:14.432030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f422c1-fc9b-49fc-a5ec-719535baa2fb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:14.434193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f422c1-fc9b-49fc-a5ec-719535baa2fb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:14.438128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f422c1-fc9b-49fc-a5ec-719535baa2fb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:14.441264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f422c1-fc9b-49fc-a5ec-719535baa2fb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:15.470822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-86f422c1-fc9b-49fc-a5ec-719535baa2fb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:15.486779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-86f422c1-fc9b-49fc-a5ec-719535baa2fb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:15.495109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-86f422c1-fc9b-49fc-a5ec-719535baa2fb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:15.497730 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-86f422c1-fc9b-49fc-a5ec-719535baa2fb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 1.128947 Aug 18 11:52:15.502048 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2788/5260] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:14 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:52:16.526665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f9bb03fb-c7b1-460c-90c1-2fd3064c961d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:16.528047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f9bb03fb-c7b1-460c-90c1-2fd3064c961d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:16.541088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9bb03fb-c7b1-460c-90c1-2fd3064c961d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:16.557558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-02b96ad8-a3c8-4df8-a3e6-0a467fbcabff tempest-PortsAdminExtendedAttrsTestJSON-2002518955 tempest-PortsAdminExtendedAttrsTestJSON-2002518955-project-admin] Calling method '.version_select at 0x7f519e4e0790>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:16.559220 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 11:52:16.559220 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 11:52:16.561799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b96ad8-a3c8-4df8-a3e6-0a467fbcabff tempest-PortsAdminExtendedAttrsTestJSON-2002518955 tempest-PortsAdminExtendedAttrsTestJSON-2002518955-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:16.564909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b96ad8-a3c8-4df8-a3e6-0a467fbcabff tempest-PortsAdminExtendedAttrsTestJSON-2002518955 tempest-PortsAdminExtendedAttrsTestJSON-2002518955-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:16.566933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9bb03fb-c7b1-460c-90c1-2fd3064c961d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:16.568614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9bb03fb-c7b1-460c-90c1-2fd3064c961d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:16.569604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b96ad8-a3c8-4df8-a3e6-0a467fbcabff tempest-PortsAdminExtendedAttrsTestJSON-2002518955 tempest-PortsAdminExtendedAttrsTestJSON-2002518955-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:16.572526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9bb03fb-c7b1-460c-90c1-2fd3064c961d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:16.578902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9bb03fb-c7b1-460c-90c1-2fd3064c961d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:16.587305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9bb03fb-c7b1-460c-90c1-2fd3064c961d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:16.656765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b96ad8-a3c8-4df8-a3e6-0a467fbcabff tempest-PortsAdminExtendedAttrsTestJSON-2002518955 tempest-PortsAdminExtendedAttrsTestJSON-2002518955-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:16.662872 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b96ad8-a3c8-4df8-a3e6-0a467fbcabff tempest-PortsAdminExtendedAttrsTestJSON-2002518955 tempest-PortsAdminExtendedAttrsTestJSON-2002518955-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:16.663454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b96ad8-a3c8-4df8-a3e6-0a467fbcabff tempest-PortsAdminExtendedAttrsTestJSON-2002518955 tempest-PortsAdminExtendedAttrsTestJSON-2002518955-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:16.726853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b96ad8-a3c8-4df8-a3e6-0a467fbcabff tempest-PortsAdminExtendedAttrsTestJSON-2002518955 tempest-PortsAdminExtendedAttrsTestJSON-2002518955-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:16.737113 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b96ad8-a3c8-4df8-a3e6-0a467fbcabff tempest-PortsAdminExtendedAttrsTestJSON-2002518955 tempest-PortsAdminExtendedAttrsTestJSON-2002518955-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:16.742983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-02b96ad8-a3c8-4df8-a3e6-0a467fbcabff tempest-PortsAdminExtendedAttrsTestJSON-2002518955 tempest-PortsAdminExtendedAttrsTestJSON-2002518955-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:16.761045 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-02b96ad8-a3c8-4df8-a3e6-0a467fbcabff tempest-PortsAdminExtendedAttrsTestJSON-2002518955 tempest-PortsAdminExtendedAttrsTestJSON-2002518955-project-admin] 10.222.0.73 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.804835 Aug 18 11:52:16.768042 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2473/5261] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 11:52:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:52:17.031799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f9bb03fb-c7b1-460c-90c1-2fd3064c961d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:17.049629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f9bb03fb-c7b1-460c-90c1-2fd3064c961d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:17.052512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f9bb03fb-c7b1-460c-90c1-2fd3064c961d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:17.054248 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f9bb03fb-c7b1-460c-90c1-2fd3064c961d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 0.531761 Aug 18 11:52:17.067933 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2789/5262] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:16 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:52:18.084797 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2a5d7591-a039-4bfd-ac43-c908489e9e4f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:18.091060 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2a5d7591-a039-4bfd-ac43-c908489e9e4f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:18.108680 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a5d7591-a039-4bfd-ac43-c908489e9e4f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:18.111417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a5d7591-a039-4bfd-ac43-c908489e9e4f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:18.115063 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a5d7591-a039-4bfd-ac43-c908489e9e4f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:18.115814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a5d7591-a039-4bfd-ac43-c908489e9e4f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:18.116332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a5d7591-a039-4bfd-ac43-c908489e9e4f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:18.126602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2a5d7591-a039-4bfd-ac43-c908489e9e4f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:19.535029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2a5d7591-a039-4bfd-ac43-c908489e9e4f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:19.554186 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:52:19.580072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2a5d7591-a039-4bfd-ac43-c908489e9e4f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:19.588092 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2a5d7591-a039-4bfd-ac43-c908489e9e4f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:19.589440 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2a5d7591-a039-4bfd-ac43-c908489e9e4f tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 1.509015 Aug 18 11:52:19.597964 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2474/5263] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:18 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:52:20.625091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dfe4a5ba-6ab8-4457-87be-4a172ed50081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:20.627088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dfe4a5ba-6ab8-4457-87be-4a172ed50081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:20.673070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfe4a5ba-6ab8-4457-87be-4a172ed50081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:20.679383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfe4a5ba-6ab8-4457-87be-4a172ed50081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:20.693463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfe4a5ba-6ab8-4457-87be-4a172ed50081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:20.698528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfe4a5ba-6ab8-4457-87be-4a172ed50081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:20.700444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfe4a5ba-6ab8-4457-87be-4a172ed50081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:20.701805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfe4a5ba-6ab8-4457-87be-4a172ed50081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:21.911561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a2a6f373-6c52-4587-9024-f2a88a7affbe tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Action: 'create', calling method: .version_select at 0x7f519e53ce50>, body: {"keypair": {"name": "tempest-keypair-703950820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnRnSRRx40VRzjuX8qCBnrdUY8E/uAAXrHbWNXswqsjfD6MTkC5LLxCLaUxgT0OTlNtnY4sGcypflrugfJyuVT9by2x3F7dfau7vEKxhuVPzJvAMY1dy/RkvPTD7rVF3g=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:52:21.961397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a2a6f373-6c52-4587-9024-f2a88a7affbe tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:52:21.984442 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-a2a6f373-6c52-4587-9024-f2a88a7affbe tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for user 1e4b3c7d38a540f19d88bf28c83cf9a6 and project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:52:22.041719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dfe4a5ba-6ab8-4457-87be-4a172ed50081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:22.048900 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a2a6f373-6c52-4587-9024-f2a88a7affbe tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.526467 Aug 18 11:52:22.050636 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2475/5264] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:52:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:52:22.070877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dfe4a5ba-6ab8-4457-87be-4a172ed50081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:22.083071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dfe4a5ba-6ab8-4457-87be-4a172ed50081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:22.087103 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dfe4a5ba-6ab8-4457-87be-4a172ed50081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 1.468248 Aug 18 11:52:22.087707 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2790/5265] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:20 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:52:23.120037 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1fca9f6d-6ef1-449a-a413-ac50b16cf034 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:23.121389 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1fca9f6d-6ef1-449a-a413-ac50b16cf034 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:23.142751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fca9f6d-6ef1-449a-a413-ac50b16cf034 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:23.149203 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fca9f6d-6ef1-449a-a413-ac50b16cf034 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:23.152385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fca9f6d-6ef1-449a-a413-ac50b16cf034 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:23.158972 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fca9f6d-6ef1-449a-a413-ac50b16cf034 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:23.163390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fca9f6d-6ef1-449a-a413-ac50b16cf034 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:23.164850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1fca9f6d-6ef1-449a-a413-ac50b16cf034 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:23.845407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1fca9f6d-6ef1-449a-a413-ac50b16cf034 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:23.867320 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1fca9f6d-6ef1-449a-a413-ac50b16cf034 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:23.877281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1fca9f6d-6ef1-449a-a413-ac50b16cf034 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:23.887999 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1fca9f6d-6ef1-449a-a413-ac50b16cf034 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 0.774806 Aug 18 11:52:23.893583 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2476/5266] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:23 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:52:24.920071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5cc3ef0a-4eab-4757-a953-ad22a976cb2a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:24.922794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5cc3ef0a-4eab-4757-a953-ad22a976cb2a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:24.932583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:52:24.938931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cc3ef0a-4eab-4757-a953-ad22a976cb2a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:24.939562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cc3ef0a-4eab-4757-a953-ad22a976cb2a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:24.940155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cc3ef0a-4eab-4757-a953-ad22a976cb2a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:24.941025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cc3ef0a-4eab-4757-a953-ad22a976cb2a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:24.941589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cc3ef0a-4eab-4757-a953-ad22a976cb2a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:24.942129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cc3ef0a-4eab-4757-a953-ad22a976cb2a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:24.990923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:52:25.698938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5cc3ef0a-4eab-4757-a953-ad22a976cb2a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:25.731729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5cc3ef0a-4eab-4757-a953-ad22a976cb2a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:25.735955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5cc3ef0a-4eab-4757-a953-ad22a976cb2a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:25.737231 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5cc3ef0a-4eab-4757-a953-ad22a976cb2a tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 0.824776 Aug 18 11:52:25.738477 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2791/5267] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:24 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:52:26.761334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7b1602a1-204a-45c9-a3c5-e5751d609e2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:26.762709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7b1602a1-204a-45c9-a3c5-e5751d609e2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:26.776463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b1602a1-204a-45c9-a3c5-e5751d609e2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:26.785812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b1602a1-204a-45c9-a3c5-e5751d609e2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:26.786285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b1602a1-204a-45c9-a3c5-e5751d609e2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:26.787324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b1602a1-204a-45c9-a3c5-e5751d609e2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:26.787993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b1602a1-204a-45c9-a3c5-e5751d609e2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:26.788633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b1602a1-204a-45c9-a3c5-e5751d609e2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:27.181548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7b1602a1-204a-45c9-a3c5-e5751d609e2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:27.191307 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7b1602a1-204a-45c9-a3c5-e5751d609e2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:27.193989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7b1602a1-204a-45c9-a3c5-e5751d609e2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:27.195494 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7b1602a1-204a-45c9-a3c5-e5751d609e2d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 0.438245 Aug 18 11:52:27.196594 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2477/5268] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:26 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:52:27.303119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1119642223", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43cde373-6762-4357-b5ca-4bc083d39b6f"}], "security_groups": [{"name": "tempest-securitygroup--320799778"}], "key_name": "tempest-keypair-703950820", "user_data": "}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:52:27.626788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] validate_networks() for [('43cde373-6762-4357-b5ca-4bc083d39b6f', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:52:28.223671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7a16f4e6-9497-4f68-82ed-6776e6378de1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:28.224254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7a16f4e6-9497-4f68-82ed-6776e6378de1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:28.264013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a16f4e6-9497-4f68-82ed-6776e6378de1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:28.266485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a16f4e6-9497-4f68-82ed-6776e6378de1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:28.266959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a16f4e6-9497-4f68-82ed-6776e6378de1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:28.267786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a16f4e6-9497-4f68-82ed-6776e6378de1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:28.268242 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a16f4e6-9497-4f68-82ed-6776e6378de1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:28.277244 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a16f4e6-9497-4f68-82ed-6776e6378de1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:28.693152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7a16f4e6-9497-4f68-82ed-6776e6378de1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:28.703152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7a16f4e6-9497-4f68-82ed-6776e6378de1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:28.708619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7a16f4e6-9497-4f68-82ed-6776e6378de1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:28.716329 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7a16f4e6-9497-4f68-82ed-6776e6378de1 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 0.500540 Aug 18 11:52:28.719167 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2478/5269] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:28 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:52:28.724104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-4a7a7701-24d0-49b4-a387-d89b910232ad req-66763186-4937-46f2-aabc-ff7374d2b44f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373c0727-3fa4-4945-9b0f-3012eea4e5c7", "name": "network-vif-plugged", "status": "completed", "tag": "df51f019-ee16-4596-81ff-d9bb027f990b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:52:28.753819 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4a7a7701-24d0-49b4-a387-d89b910232ad req-66763186-4937-46f2-aabc-ff7374d2b44f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:28.755960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4a7a7701-24d0-49b4-a387-d89b910232ad req-66763186-4937-46f2-aabc-ff7374d2b44f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:28.756578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4a7a7701-24d0-49b4-a387-d89b910232ad req-66763186-4937-46f2-aabc-ff7374d2b44f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:28.789621 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-4a7a7701-24d0-49b4-a387-d89b910232ad req-66763186-4937-46f2-aabc-ff7374d2b44f service nova] Creating event network-vif-plugged:df51f019-ee16-4596-81ff-d9bb027f990b for instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 on n-h2-853611-3 Aug 18 11:52:28.806277 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-4a7a7701-24d0-49b4-a387-d89b910232ad req-66763186-4937-46f2-aabc-ff7374d2b44f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085575 Aug 18 11:52:28.809360 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2479/5270] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:52:29.744606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-69698fe3-313c-4adb-8d30-6d7e978fc8bb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:29.745501 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-69698fe3-313c-4adb-8d30-6d7e978fc8bb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:29.749461 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:52:29.769114 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69698fe3-313c-4adb-8d30-6d7e978fc8bb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:29.771963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69698fe3-313c-4adb-8d30-6d7e978fc8bb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:29.772742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69698fe3-313c-4adb-8d30-6d7e978fc8bb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:29.774691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69698fe3-313c-4adb-8d30-6d7e978fc8bb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:29.776685 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69698fe3-313c-4adb-8d30-6d7e978fc8bb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:29.777363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-69698fe3-313c-4adb-8d30-6d7e978fc8bb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:29.873634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:52:29.874240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:52:29.874556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:52:29.875700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:52:29.876301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:52:29.901509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:29.902338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:29.902979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:29.903774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:29.904258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:29.904683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:29.965031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:52:29.980382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for user 1e4b3c7d38a540f19d88bf28c83cf9a6 and project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:52:30.010177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:52:30.016657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:52:30.096960 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-60449c75-4e7b-4ae4-9508-61f6327389d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.802212 Aug 18 11:52:30.097632 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2792/5271] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:52:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 2804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:52:30.109141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b250f0b-6735-4402-9580-a46499bfe443 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:30.110593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b250f0b-6735-4402-9580-a46499bfe443 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:30.270914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-69698fe3-313c-4adb-8d30-6d7e978fc8bb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:30.287405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5b250f0b-6735-4402-9580-a46499bfe443 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:30.287644 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-69698fe3-313c-4adb-8d30-6d7e978fc8bb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:30.292856 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-69698fe3-313c-4adb-8d30-6d7e978fc8bb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:30.294129 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-69698fe3-313c-4adb-8d30-6d7e978fc8bb tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 0.554856 Aug 18 11:52:30.298896 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2480/5272] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:29 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:52:30.308007 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b250f0b-6735-4402-9580-a46499bfe443 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1241 microversion: 2.1 time: 0.203232 Aug 18 11:52:30.314404 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2793/5273] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:52:30 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1241 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:52:31.340635 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5b49702b-9e7e-4f64-8099-15df512cde5f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:31.341448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5b49702b-9e7e-4f64-8099-15df512cde5f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:31.341612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-57bee8c2-b411-49f2-a925-3462f98cf685 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:31.342302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-57bee8c2-b411-49f2-a925-3462f98cf685 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:31.352277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57bee8c2-b411-49f2-a925-3462f98cf685 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:31.352780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57bee8c2-b411-49f2-a925-3462f98cf685 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:31.353230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57bee8c2-b411-49f2-a925-3462f98cf685 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:31.353966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57bee8c2-b411-49f2-a925-3462f98cf685 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:31.354790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57bee8c2-b411-49f2-a925-3462f98cf685 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:31.354902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57bee8c2-b411-49f2-a925-3462f98cf685 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:31.367118 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b49702b-9e7e-4f64-8099-15df512cde5f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:31.370758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b49702b-9e7e-4f64-8099-15df512cde5f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:31.371446 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b49702b-9e7e-4f64-8099-15df512cde5f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:31.372433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b49702b-9e7e-4f64-8099-15df512cde5f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:31.375837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b49702b-9e7e-4f64-8099-15df512cde5f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:31.378023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5b49702b-9e7e-4f64-8099-15df512cde5f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:31.975583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-57bee8c2-b411-49f2-a925-3462f98cf685 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:31.989386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-57bee8c2-b411-49f2-a925-3462f98cf685 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:31.995784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-57bee8c2-b411-49f2-a925-3462f98cf685 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:31.999600 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-57bee8c2-b411-49f2-a925-3462f98cf685 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1731 microversion: 2.20 time: 0.662353 Aug 18 11:52:32.002089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:52:32.017271 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2794/5274] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:31 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1731 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:52:32.937379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5b49702b-9e7e-4f64-8099-15df512cde5f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:32.973536 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5b49702b-9e7e-4f64-8099-15df512cde5f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1237 microversion: 2.1 time: 1.637630 Aug 18 11:52:32.979731 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2481/5275] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:52:31 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1237 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:52:33.030709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f9c48b0-8203-4448-a873-dd91202e7330 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:33.032085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f9c48b0-8203-4448-a873-dd91202e7330 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:33.052153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f9c48b0-8203-4448-a873-dd91202e7330 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:33.063967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f9c48b0-8203-4448-a873-dd91202e7330 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:33.065319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f9c48b0-8203-4448-a873-dd91202e7330 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:33.067392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f9c48b0-8203-4448-a873-dd91202e7330 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:33.069777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f9c48b0-8203-4448-a873-dd91202e7330 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:33.070235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f9c48b0-8203-4448-a873-dd91202e7330 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:33.578583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2f9c48b0-8203-4448-a873-dd91202e7330 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:33.587767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2f9c48b0-8203-4448-a873-dd91202e7330 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:33.596903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2f9c48b0-8203-4448-a873-dd91202e7330 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:33.598621 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f9c48b0-8203-4448-a873-dd91202e7330 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1718 microversion: 2.20 time: 0.575439 Aug 18 11:52:33.599582 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2795/5276] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:52:33 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1718 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:52:34.011064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-37d03b79-93f0-43b3-a2ea-37cc471896bb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:34.013538 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-37d03b79-93f0-43b3-a2ea-37cc471896bb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:34.025172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37d03b79-93f0-43b3-a2ea-37cc471896bb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:34.027952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37d03b79-93f0-43b3-a2ea-37cc471896bb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:34.030495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37d03b79-93f0-43b3-a2ea-37cc471896bb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:34.032210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37d03b79-93f0-43b3-a2ea-37cc471896bb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:34.035582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37d03b79-93f0-43b3-a2ea-37cc471896bb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:34.036966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37d03b79-93f0-43b3-a2ea-37cc471896bb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:34.293133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-37d03b79-93f0-43b3-a2ea-37cc471896bb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:34.311380 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-37d03b79-93f0-43b3-a2ea-37cc471896bb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1299 microversion: 2.1 time: 0.301831 Aug 18 11:52:34.312431 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2482/5277] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:52:34 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1299 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:52:35.336788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c31dd9ea-a88a-4dda-accf-0fede9bf51ed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:35.337839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c31dd9ea-a88a-4dda-accf-0fede9bf51ed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:35.362001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c31dd9ea-a88a-4dda-accf-0fede9bf51ed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:35.364198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c31dd9ea-a88a-4dda-accf-0fede9bf51ed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:35.368627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c31dd9ea-a88a-4dda-accf-0fede9bf51ed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:35.369584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c31dd9ea-a88a-4dda-accf-0fede9bf51ed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:35.373181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c31dd9ea-a88a-4dda-accf-0fede9bf51ed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:35.374815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c31dd9ea-a88a-4dda-accf-0fede9bf51ed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:35.528366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c31dd9ea-a88a-4dda-accf-0fede9bf51ed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:35.539191 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c31dd9ea-a88a-4dda-accf-0fede9bf51ed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1299 microversion: 2.1 time: 0.206455 Aug 18 11:52:35.554897 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2796/5278] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:52:35 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1299 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:52:36.565581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-80005214-53d3-45ca-9929-3c7f497af276 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:36.566204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-80005214-53d3-45ca-9929-3c7f497af276 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:36.579490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80005214-53d3-45ca-9929-3c7f497af276 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:36.584984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80005214-53d3-45ca-9929-3c7f497af276 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:36.585719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80005214-53d3-45ca-9929-3c7f497af276 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:36.588491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80005214-53d3-45ca-9929-3c7f497af276 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:36.589253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80005214-53d3-45ca-9929-3c7f497af276 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:36.589887 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80005214-53d3-45ca-9929-3c7f497af276 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:37.233416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-80005214-53d3-45ca-9929-3c7f497af276 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:37.249152 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-80005214-53d3-45ca-9929-3c7f497af276 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1366 microversion: 2.1 time: 0.689004 Aug 18 11:52:37.252790 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2483/5279] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:52:36 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1366 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:52:37.637049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-db63b95a-4134-471e-9872-046cb67c2e82 req-2788d0b9-0152-4e5c-91c9-40a747b8ca66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d41ef54-abb5-4b95-943d-219504a92c05", "tag": "d6275a81-2cc8-4a38-9cff-a199e768dbff"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:52:37.660797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-db63b95a-4134-471e-9872-046cb67c2e82 req-2788d0b9-0152-4e5c-91c9-40a747b8ca66 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:37.662803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-db63b95a-4134-471e-9872-046cb67c2e82 req-2788d0b9-0152-4e5c-91c9-40a747b8ca66 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:37.663354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-db63b95a-4134-471e-9872-046cb67c2e82 req-2788d0b9-0152-4e5c-91c9-40a747b8ca66 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:37.694799 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-db63b95a-4134-471e-9872-046cb67c2e82 req-2788d0b9-0152-4e5c-91c9-40a747b8ca66 service nova] Creating event network-changed:d6275a81-2cc8-4a38-9cff-a199e768dbff for instance 8d41ef54-abb5-4b95-943d-219504a92c05 on n-h2-853611-3 Aug 18 11:52:37.709575 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-db63b95a-4134-471e-9872-046cb67c2e82 req-2788d0b9-0152-4e5c-91c9-40a747b8ca66 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077310 Aug 18 11:52:37.710708 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2797/5280] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:52:38.283805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5a20a433-0023-4c8a-b220-4dd119ca9952 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:38.284460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5a20a433-0023-4c8a-b220-4dd119ca9952 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:38.304550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a20a433-0023-4c8a-b220-4dd119ca9952 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:38.305080 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a20a433-0023-4c8a-b220-4dd119ca9952 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:38.305490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a20a433-0023-4c8a-b220-4dd119ca9952 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:38.306225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a20a433-0023-4c8a-b220-4dd119ca9952 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:38.306921 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a20a433-0023-4c8a-b220-4dd119ca9952 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:38.311006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5a20a433-0023-4c8a-b220-4dd119ca9952 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:38.677719 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5a20a433-0023-4c8a-b220-4dd119ca9952 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:38.689745 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5a20a433-0023-4c8a-b220-4dd119ca9952 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1366 microversion: 2.1 time: 0.420360 Aug 18 11:52:38.692464 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2484/5281] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:52:38 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:52:39.731628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c8c23e90-6385-4524-9181-b65a7e048b92 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:39.733463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c8c23e90-6385-4524-9181-b65a7e048b92 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:39.748139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8c23e90-6385-4524-9181-b65a7e048b92 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:39.749291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8c23e90-6385-4524-9181-b65a7e048b92 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:39.749989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8c23e90-6385-4524-9181-b65a7e048b92 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:39.751809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8c23e90-6385-4524-9181-b65a7e048b92 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:39.752764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8c23e90-6385-4524-9181-b65a7e048b92 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:39.753466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8c23e90-6385-4524-9181-b65a7e048b92 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:39.932717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:52:40.199195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c8c23e90-6385-4524-9181-b65a7e048b92 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:40.211856 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c8c23e90-6385-4524-9181-b65a7e048b92 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1366 microversion: 2.1 time: 0.490229 Aug 18 11:52:40.214779 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2798/5282] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:52:39 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1366 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:52:41.234779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b0979fe4-c9d3-4bb3-acbd-13c8d806e777 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:41.235334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b0979fe4-c9d3-4bb3-acbd-13c8d806e777 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:41.250733 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0979fe4-c9d3-4bb3-acbd-13c8d806e777 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:41.251772 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0979fe4-c9d3-4bb3-acbd-13c8d806e777 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:41.252327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0979fe4-c9d3-4bb3-acbd-13c8d806e777 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:41.256884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0979fe4-c9d3-4bb3-acbd-13c8d806e777 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:41.260596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0979fe4-c9d3-4bb3-acbd-13c8d806e777 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:41.261324 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0979fe4-c9d3-4bb3-acbd-13c8d806e777 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:41.686955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b0979fe4-c9d3-4bb3-acbd-13c8d806e777 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:41.696415 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b0979fe4-c9d3-4bb3-acbd-13c8d806e777 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1366 microversion: 2.1 time: 0.465005 Aug 18 11:52:41.697381 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2485/5283] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:52:41 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1366 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:52:42.718657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d2de2d36-b331-4a38-9b3b-1896adf30c30 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:42.719878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d2de2d36-b331-4a38-9b3b-1896adf30c30 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:42.722975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:52:42.739311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2de2d36-b331-4a38-9b3b-1896adf30c30 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:42.741124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2de2d36-b331-4a38-9b3b-1896adf30c30 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:42.741973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2de2d36-b331-4a38-9b3b-1896adf30c30 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:42.745030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2de2d36-b331-4a38-9b3b-1896adf30c30 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:42.747115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2de2d36-b331-4a38-9b3b-1896adf30c30 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:42.747799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2de2d36-b331-4a38-9b3b-1896adf30c30 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:43.689869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2de2d36-b331-4a38-9b3b-1896adf30c30 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:43.718319 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d2de2d36-b331-4a38-9b3b-1896adf30c30 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1366 microversion: 2.1 time: 0.992036 Aug 18 11:52:43.731832 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2799/5284] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:52:42 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1366 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:52:44.322857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-594e9616-098a-417e-adca-e035c817b00b req-873f225f-9205-4da7-a782-96b8ca2d66e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d41ef54-abb5-4b95-943d-219504a92c05", "name": "network-vif-plugged", "status": "completed", "tag": "d6275a81-2cc8-4a38-9cff-a199e768dbff"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:52:44.352607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-594e9616-098a-417e-adca-e035c817b00b req-873f225f-9205-4da7-a782-96b8ca2d66e5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:44.355371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-594e9616-098a-417e-adca-e035c817b00b req-873f225f-9205-4da7-a782-96b8ca2d66e5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:44.355806 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-594e9616-098a-417e-adca-e035c817b00b req-873f225f-9205-4da7-a782-96b8ca2d66e5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:44.393315 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-594e9616-098a-417e-adca-e035c817b00b req-873f225f-9205-4da7-a782-96b8ca2d66e5 service nova] Creating event network-vif-plugged:d6275a81-2cc8-4a38-9cff-a199e768dbff for instance 8d41ef54-abb5-4b95-943d-219504a92c05 on n-h2-853611-3 Aug 18 11:52:44.399295 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-594e9616-098a-417e-adca-e035c817b00b req-873f225f-9205-4da7-a782-96b8ca2d66e5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080164 Aug 18 11:52:44.400423 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2486/5285] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:52:44.745198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-767d932e-34a6-443b-8dcd-e832759c293f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:44.745849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-767d932e-34a6-443b-8dcd-e832759c293f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:44.760557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767d932e-34a6-443b-8dcd-e832759c293f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:44.761861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767d932e-34a6-443b-8dcd-e832759c293f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:44.762456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767d932e-34a6-443b-8dcd-e832759c293f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:44.766126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767d932e-34a6-443b-8dcd-e832759c293f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:44.766654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767d932e-34a6-443b-8dcd-e832759c293f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:44.767104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-767d932e-34a6-443b-8dcd-e832759c293f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:45.334340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-767d932e-34a6-443b-8dcd-e832759c293f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:45.343771 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-767d932e-34a6-443b-8dcd-e832759c293f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1366 microversion: 2.1 time: 0.603716 Aug 18 11:52:45.344386 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2800/5286] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:52:44 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1366 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:52:46.372391 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9810e65d-49fc-48e0-98bc-7b3dc2a4256d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:46.373115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9810e65d-49fc-48e0-98bc-7b3dc2a4256d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:46.388690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9810e65d-49fc-48e0-98bc-7b3dc2a4256d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:46.389356 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9810e65d-49fc-48e0-98bc-7b3dc2a4256d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:46.404270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9810e65d-49fc-48e0-98bc-7b3dc2a4256d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:46.405705 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9810e65d-49fc-48e0-98bc-7b3dc2a4256d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:46.421130 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9810e65d-49fc-48e0-98bc-7b3dc2a4256d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:46.422005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9810e65d-49fc-48e0-98bc-7b3dc2a4256d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:46.973684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9810e65d-49fc-48e0-98bc-7b3dc2a4256d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:52:46.986851 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9810e65d-49fc-48e0-98bc-7b3dc2a4256d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1555 microversion: 2.1 time: 0.621341 Aug 18 11:52:46.988286 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2487/5287] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:52:46 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1555 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:52:47.023314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fe06fee4-42e4-4118-bc17-86720419e5c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:52:47.025446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fe06fee4-42e4-4118-bc17-86720419e5c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:52:47.035916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe06fee4-42e4-4118-bc17-86720419e5c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:47.036796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe06fee4-42e4-4118-bc17-86720419e5c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:47.037535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe06fee4-42e4-4118-bc17-86720419e5c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:47.038562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe06fee4-42e4-4118-bc17-86720419e5c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:47.039282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe06fee4-42e4-4118-bc17-86720419e5c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:47.039957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe06fee4-42e4-4118-bc17-86720419e5c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:47.227888 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fe06fee4-42e4-4118-bc17-86720419e5c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.210339 Aug 18 11:52:47.239782 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2801/5288] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:52:47 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-interface => generated 284 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:52:49.802016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-75066408-a498-4a32-a4a1-0c760bf45af0 req-33181cc5-6a9e-4431-894a-21495d8a7117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d41ef54-abb5-4b95-943d-219504a92c05", "tag": "d6275a81-2cc8-4a38-9cff-a199e768dbff"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:52:49.812738 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-75066408-a498-4a32-a4a1-0c760bf45af0 req-33181cc5-6a9e-4431-894a-21495d8a7117 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:52:49.820810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-75066408-a498-4a32-a4a1-0c760bf45af0 req-33181cc5-6a9e-4431-894a-21495d8a7117 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:52:49.821524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-75066408-a498-4a32-a4a1-0c760bf45af0 req-33181cc5-6a9e-4431-894a-21495d8a7117 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:52:49.842572 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-75066408-a498-4a32-a4a1-0c760bf45af0 req-33181cc5-6a9e-4431-894a-21495d8a7117 service nova] Creating event network-changed:d6275a81-2cc8-4a38-9cff-a199e768dbff for instance 8d41ef54-abb5-4b95-943d-219504a92c05 on n-h2-853611-3 Aug 18 11:52:49.860250 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-75066408-a498-4a32-a4a1-0c760bf45af0 req-33181cc5-6a9e-4431-894a-21495d8a7117 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.337220 Aug 18 11:52:49.861606 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2488/5289] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:53:04.665276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-19d1655a-c54b-4dd6-ab80-36b014abc993 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:04.667856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-19d1655a-c54b-4dd6-ab80-36b014abc993 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:04.682814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:04.685187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=49 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:04.692182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19d1655a-c54b-4dd6-ab80-36b014abc993 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:04.693259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19d1655a-c54b-4dd6-ab80-36b014abc993 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:04.694071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19d1655a-c54b-4dd6-ab80-36b014abc993 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:04.695133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19d1655a-c54b-4dd6-ab80-36b014abc993 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:04.696094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19d1655a-c54b-4dd6-ab80-36b014abc993 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:04.699163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19d1655a-c54b-4dd6-ab80-36b014abc993 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:04.784713 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-19d1655a-c54b-4dd6-ab80-36b014abc993 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.124216 Aug 18 11:53:04.787268 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2802/5290] 10.222.0.73 () {60 vars in 1343 bytes} [Thu Aug 18 11:53:04 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:04.911660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=17 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:04.913083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=67 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:04.917964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7ad9bb89-fa96-4240-8575-b28042bc5ace tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:04.920078 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7ad9bb89-fa96-4240-8575-b28042bc5ace tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:04.937752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ad9bb89-fa96-4240-8575-b28042bc5ace tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:04.944521 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ad9bb89-fa96-4240-8575-b28042bc5ace tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:04.945164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ad9bb89-fa96-4240-8575-b28042bc5ace tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:04.946047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ad9bb89-fa96-4240-8575-b28042bc5ace tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:04.946846 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ad9bb89-fa96-4240-8575-b28042bc5ace tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:04.950577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7ad9bb89-fa96-4240-8575-b28042bc5ace tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:05.009034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7ad9bb89-fa96-4240-8575-b28042bc5ace tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:53:05.199991 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7ad9bb89-fa96-4240-8575-b28042bc5ace tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "DELETE /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 204 len: 0 microversion: 2.20 time: 0.292894 Aug 18 11:53:05.201220 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2489/5291] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:53:04 2022] DELETE /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:53:05.210236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-936b58e0-2c36-467f-be82-f9f45825dc04 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:05.211268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-936b58e0-2c36-467f-be82-f9f45825dc04 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:05.223949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-936b58e0-2c36-467f-be82-f9f45825dc04 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:05.224540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-936b58e0-2c36-467f-be82-f9f45825dc04 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:05.225002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-936b58e0-2c36-467f-be82-f9f45825dc04 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:05.226810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-936b58e0-2c36-467f-be82-f9f45825dc04 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:05.227814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-936b58e0-2c36-467f-be82-f9f45825dc04 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:05.227814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-936b58e0-2c36-467f-be82-f9f45825dc04 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:06.055946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-936b58e0-2c36-467f-be82-f9f45825dc04 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:06.084921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-936b58e0-2c36-467f-be82-f9f45825dc04 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:06.089276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-936b58e0-2c36-467f-be82-f9f45825dc04 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:06.092884 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-936b58e0-2c36-467f-be82-f9f45825dc04 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1724 microversion: 2.20 time: 0.887446 Aug 18 11:53:06.095080 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2803/5292] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:53:05 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1724 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:53:07.125101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7eff4ea8-ae05-4a1f-827e-17d5e238fed5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:07.126631 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7eff4ea8-ae05-4a1f-827e-17d5e238fed5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:07.144492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7eff4ea8-ae05-4a1f-827e-17d5e238fed5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:07.147963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7eff4ea8-ae05-4a1f-827e-17d5e238fed5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:07.149545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7eff4ea8-ae05-4a1f-827e-17d5e238fed5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:07.155956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7eff4ea8-ae05-4a1f-827e-17d5e238fed5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:07.156729 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7eff4ea8-ae05-4a1f-827e-17d5e238fed5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:07.157541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7eff4ea8-ae05-4a1f-827e-17d5e238fed5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:08.814825 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7eff4ea8-ae05-4a1f-827e-17d5e238fed5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:08.835475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7eff4ea8-ae05-4a1f-827e-17d5e238fed5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:08.838285 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7eff4ea8-ae05-4a1f-827e-17d5e238fed5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:08.854404 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7eff4ea8-ae05-4a1f-827e-17d5e238fed5 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1724 microversion: 2.20 time: 1.737678 Aug 18 11:53:08.855731 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2490/5293] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:53:07 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1724 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:53:09.878170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2776d986-110a-4bd8-8dfe-63c3a02c0a42 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:09.879554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2776d986-110a-4bd8-8dfe-63c3a02c0a42 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:09.898262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2776d986-110a-4bd8-8dfe-63c3a02c0a42 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:09.905074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2776d986-110a-4bd8-8dfe-63c3a02c0a42 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:09.905887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2776d986-110a-4bd8-8dfe-63c3a02c0a42 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:09.907429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2776d986-110a-4bd8-8dfe-63c3a02c0a42 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:09.907782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2776d986-110a-4bd8-8dfe-63c3a02c0a42 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:09.911697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2776d986-110a-4bd8-8dfe-63c3a02c0a42 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:10.578299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2776d986-110a-4bd8-8dfe-63c3a02c0a42 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:10.600731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2776d986-110a-4bd8-8dfe-63c3a02c0a42 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:10.606997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2776d986-110a-4bd8-8dfe-63c3a02c0a42 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:10.609783 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2776d986-110a-4bd8-8dfe-63c3a02c0a42 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1724 microversion: 2.20 time: 0.735519 Aug 18 11:53:10.611721 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2804/5294] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:53:09 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1724 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 11:53:11.648387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-df18999b-6812-4e27-9f96-4770177e6c35 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:11.649028 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-df18999b-6812-4e27-9f96-4770177e6c35 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:11.668905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df18999b-6812-4e27-9f96-4770177e6c35 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:11.671666 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df18999b-6812-4e27-9f96-4770177e6c35 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:11.673020 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df18999b-6812-4e27-9f96-4770177e6c35 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:11.673745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df18999b-6812-4e27-9f96-4770177e6c35 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:11.675052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df18999b-6812-4e27-9f96-4770177e6c35 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:11.687568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-df18999b-6812-4e27-9f96-4770177e6c35 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:11.873407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-df18999b-6812-4e27-9f96-4770177e6c35 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:11.938979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-df18999b-6812-4e27-9f96-4770177e6c35 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:11.945208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-df18999b-6812-4e27-9f96-4770177e6c35 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:11.947945 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-df18999b-6812-4e27-9f96-4770177e6c35 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1656 microversion: 2.20 time: 0.308559 Aug 18 11:53:11.949769 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2491/5295] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:53:11 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1656 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:53:12.103474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-49fb814e-ab4d-4c00-b339-023ac09cd036 req-8258efc4-8f90-4f65-89b5-5352b94cebeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373c0727-3fa4-4945-9b0f-3012eea4e5c7", "name": "network-vif-deleted", "tag": "df51f019-ee16-4596-81ff-d9bb027f990b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:53:12.136744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-49fb814e-ab4d-4c00-b339-023ac09cd036 req-8258efc4-8f90-4f65-89b5-5352b94cebeb service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:12.137261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-49fb814e-ab4d-4c00-b339-023ac09cd036 req-8258efc4-8f90-4f65-89b5-5352b94cebeb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:12.137707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-49fb814e-ab4d-4c00-b339-023ac09cd036 req-8258efc4-8f90-4f65-89b5-5352b94cebeb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:12.185364 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-49fb814e-ab4d-4c00-b339-023ac09cd036 req-8258efc4-8f90-4f65-89b5-5352b94cebeb service nova] Creating event network-vif-deleted:df51f019-ee16-4596-81ff-d9bb027f990b for instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 on n-h2-853611-3 Aug 18 11:53:12.199629 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-49fb814e-ab4d-4c00-b339-023ac09cd036 req-8258efc4-8f90-4f65-89b5-5352b94cebeb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104193 Aug 18 11:53:12.203797 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2805/5296] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:53:12.984327 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:12.986744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:13.004936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:13.006312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:13.007047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:13.020316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:13.022253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:13.023869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:13.070660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:13.071441 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:13.072099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:13.072735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lazy-loading 'fault' on Instance uuid 373c0727-3fa4-4945-9b0f-3012eea4e5c7 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:53:13.190217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:13.220486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:13.236865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e42e549b9e8c4740a2b33141bd4f7d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9589b45c8fd0425b8f9c67201bece89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:13.243154 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2c9c81ca-4199-4d69-b43f-2e93050f37ba tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 200 len: 1372 microversion: 2.20 time: 0.269087 Aug 18 11:53:13.246761 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2492/5297] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:53:12 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 1372 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 11:53:13.754126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-118396085", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:53:13.841404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:53:14.269942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-35cf0a9c-0dc2-457e-94cb-1383683ab081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:14.271268 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-35cf0a9c-0dc2-457e-94cb-1383683ab081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:14.285388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35cf0a9c-0dc2-457e-94cb-1383683ab081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:14.290889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35cf0a9c-0dc2-457e-94cb-1383683ab081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:14.291692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35cf0a9c-0dc2-457e-94cb-1383683ab081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:14.292669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35cf0a9c-0dc2-457e-94cb-1383683ab081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:14.293358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35cf0a9c-0dc2-457e-94cb-1383683ab081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:14.294065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-35cf0a9c-0dc2-457e-94cb-1383683ab081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:14.333918 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-35cf0a9c-0dc2-457e-94cb-1383683ab081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] HTTP exception thrown: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-35cf0a9c-0dc2-457e-94cb-1383683ab081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Request method failure captured: Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 HTTP/1.1 Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iZa7VxM4p_Ex-E6naGIuyRvcDHAvwfBHmXQGhAfHLAh_LzgDa1FYvEwvBordnUxLES5G2CCLkjYuBXHuFc3poMPHBIpcWHLmBcG7NImLiPB552HmCcpO5xbbZWr8MtZ5JPO79kgNJ7e6DEgca-DGka31QdGuMeleuUlzAE_wjZ_fYY Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 9589b45c8fd0425b8f9c67201bece89c Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "tempest-type-1071722843", "name": "tempest-service-2066272042", "endpoints": [{"region": "tempest-region-95327236", "publicURL": "https://url-843292534.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 9589b45c8fd0425b8f9c67201bece89c Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeShelveTestJSON-808802786-project Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e42e549b9e8c4740a2b33141bd4f7d14 Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeShelveTestJSON-808802786-project Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '373c0727-3fa4-4945-9b0f-3012eea4e5c7'} Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:53:14.340228 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:53:14.344738 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:14.344738 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:14.344738 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:53:14.344738 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:14.344738 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:14.344738 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:53:14.344738 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:53:14.344738 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:53:14.344738 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:53:14.344738 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:14.344738 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:14.348042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-35cf0a9c-0dc2-457e-94cb-1383683ab081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Returning 404 to user: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:53:14.358737 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-35cf0a9c-0dc2-457e-94cb-1383683ab081 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 404 len: 111 microversion: 2.20 time: 0.083740 Aug 18 11:53:14.365889 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2493/5298] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:53:14 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 18 11:53:14.372225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1350e524-391f-4775-80dc-0972ef0be2aa tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '.version_select at 0x7f519e4a50d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:14.399798 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1350e524-391f-4775-80dc-0972ef0be2aa tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1592795002" status: 204 len: 0 microversion: 2.20 time: 0.032001 Aug 18 11:53:14.400556 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2494/5299] 10.222.0.73 () {60 vars in 1262 bytes} [Thu Aug 18 11:53:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1592795002 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 11:53:14.761039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:53:14.762724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:53:14.763489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:53:14.765982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:53:14.766885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:53:14.789943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:14.791061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:14.791780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:14.793629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:14.794409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:14.796294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:14.830002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Getting quotas for project e557ebc2a18c42578cb3377efdb54edf. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:53:14.838152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Getting quotas for user 00a0023446c4422ab3b9db8cb680d556 and project e557ebc2a18c42578cb3377efdb54edf. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:53:14.858102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:53:14.861997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:53:14.942831 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6649d597-9b5c-4549-be4b-e3d339c9c4c1 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.189168 Aug 18 11:53:14.949764 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2806/5300] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:53:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:53:14.954993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-993794df-a50f-4703-820e-0e62f39795fa tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:14.955708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-993794df-a50f-4703-820e-0e62f39795fa tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:15.128640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-993794df-a50f-4703-820e-0e62f39795fa tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:15.143858 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-993794df-a50f-4703-820e-0e62f39795fa tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1213 microversion: 2.1 time: 0.192550 Aug 18 11:53:15.145255 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2495/5301] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:14 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1213 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:16.167797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6db81f97-432f-41e2-9178-2b81db67741a tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:16.168442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6db81f97-432f-41e2-9178-2b81db67741a tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:16.181968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6db81f97-432f-41e2-9178-2b81db67741a tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:16.182897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6db81f97-432f-41e2-9178-2b81db67741a tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:16.183641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6db81f97-432f-41e2-9178-2b81db67741a tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:16.185062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6db81f97-432f-41e2-9178-2b81db67741a tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:16.186705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6db81f97-432f-41e2-9178-2b81db67741a tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:16.188354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6db81f97-432f-41e2-9178-2b81db67741a tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:16.362840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6db81f97-432f-41e2-9178-2b81db67741a tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:16.374836 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6db81f97-432f-41e2-9178-2b81db67741a tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1265 microversion: 2.1 time: 0.212984 Aug 18 11:53:16.375862 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2807/5302] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:16 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:17.416479 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-723f249f-ae88-4238-bc1e-931472ec8d55 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:17.417696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-723f249f-ae88-4238-bc1e-931472ec8d55 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:17.445762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-723f249f-ae88-4238-bc1e-931472ec8d55 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:17.446871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-723f249f-ae88-4238-bc1e-931472ec8d55 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:17.449134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-723f249f-ae88-4238-bc1e-931472ec8d55 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:17.451340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-723f249f-ae88-4238-bc1e-931472ec8d55 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:17.452452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-723f249f-ae88-4238-bc1e-931472ec8d55 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:17.454179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-723f249f-ae88-4238-bc1e-931472ec8d55 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:17.823202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-723f249f-ae88-4238-bc1e-931472ec8d55 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:17.847291 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-723f249f-ae88-4238-bc1e-931472ec8d55 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1271 microversion: 2.1 time: 0.445328 Aug 18 11:53:17.851058 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2496/5303] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:17 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1271 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:18.876580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6c8a3ee-e4e3-46e2-ba48-52271485ecfc tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:18.877852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c6c8a3ee-e4e3-46e2-ba48-52271485ecfc tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:18.904138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6c8a3ee-e4e3-46e2-ba48-52271485ecfc tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:18.905027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6c8a3ee-e4e3-46e2-ba48-52271485ecfc tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:18.905501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6c8a3ee-e4e3-46e2-ba48-52271485ecfc tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:18.906254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6c8a3ee-e4e3-46e2-ba48-52271485ecfc tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:18.908923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6c8a3ee-e4e3-46e2-ba48-52271485ecfc tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:18.909952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6c8a3ee-e4e3-46e2-ba48-52271485ecfc tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:19.077167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c6c8a3ee-e4e3-46e2-ba48-52271485ecfc tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:19.088958 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c6c8a3ee-e4e3-46e2-ba48-52271485ecfc tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1271 microversion: 2.1 time: 0.218158 Aug 18 11:53:19.098818 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2808/5304] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:18 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1271 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:19.965089 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:53:19.965960 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 11:53:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:53:20.112061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-137f960e-bf91-4229-bff8-9f7ea8b4b01d tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:20.112697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-137f960e-bf91-4229-bff8-9f7ea8b4b01d tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:20.121273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-137f960e-bf91-4229-bff8-9f7ea8b4b01d tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:20.121677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-137f960e-bf91-4229-bff8-9f7ea8b4b01d tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:20.135254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-137f960e-bf91-4229-bff8-9f7ea8b4b01d tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:20.136042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-137f960e-bf91-4229-bff8-9f7ea8b4b01d tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:20.136616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-137f960e-bf91-4229-bff8-9f7ea8b4b01d tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:20.137101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-137f960e-bf91-4229-bff8-9f7ea8b4b01d tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:20.659139 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-137f960e-bf91-4229-bff8-9f7ea8b4b01d tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:20.670389 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-137f960e-bf91-4229-bff8-9f7ea8b4b01d tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1313 microversion: 2.1 time: 0.560184 Aug 18 11:53:20.672158 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2497/5305] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:20 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1313 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:20.906105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-abceba44-7312-4f2c-ba77-af40111b89f6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:20.907415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-abceba44-7312-4f2c-ba77-af40111b89f6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:20.923055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abceba44-7312-4f2c-ba77-af40111b89f6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:20.925723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abceba44-7312-4f2c-ba77-af40111b89f6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:20.927440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abceba44-7312-4f2c-ba77-af40111b89f6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:20.931396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abceba44-7312-4f2c-ba77-af40111b89f6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:20.932276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abceba44-7312-4f2c-ba77-af40111b89f6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:20.932958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abceba44-7312-4f2c-ba77-af40111b89f6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:20.990193 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-abceba44-7312-4f2c-ba77-af40111b89f6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] HTTP exception thrown: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-abceba44-7312-4f2c-ba77-af40111b89f6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Request method failure captured: Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 HTTP/1.1 Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iZa7VxM4p_Ex-E6naGIuyRvcDHAvwfBHmXQGhAfHLAh_LzgDa1FYvEwvBordnUxLES5G2CCLkjYuBXHuFc3poMPHBIpcWHLmBcG7NImLiPB552HmCcpO5xbbZWr8MtZ5JPO79kgNJ7e6DEgca-DGka31QdGuMeleuUlzAE_wjZ_fYY Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 9589b45c8fd0425b8f9c67201bece89c Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "tempest-type-1071722843", "name": "tempest-service-2066272042", "endpoints": [{"region": "tempest-region-95327236", "publicURL": "https://url-843292534.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 9589b45c8fd0425b8f9c67201bece89c Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AttachVolumeShelveTestJSON-808802786-project Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e42e549b9e8c4740a2b33141bd4f7d14 Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AttachVolumeShelveTestJSON-808802786-project Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '373c0727-3fa4-4945-9b0f-3012eea4e5c7'} Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:53:20.993997 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:53:21.000465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:53:21.000465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:53:21.000465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:21.000465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:53:21.000465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:53:21.000465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:53:21.000465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:21.000465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:53:21.000465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:53:21.000465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:53:21.000465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:53:21.000465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:21.000465 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:53:21.004333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-abceba44-7312-4f2c-ba77-af40111b89f6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Returning 404 to user: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:53:21.005587 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-abceba44-7312-4f2c-ba77-af40111b89f6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "DELETE /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 404 len: 111 microversion: 2.20 time: 0.103885 Aug 18 11:53:21.008325 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2809/5306] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:53:20 2022] DELETE /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:53:21.016978 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-20499824-73cf-4b58-b39d-aeae591af818 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:21.018032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-20499824-73cf-4b58-b39d-aeae591af818 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 373c0727-3fa4-4945-9b0f-3012eea4e5c7] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:21.032508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20499824-73cf-4b58-b39d-aeae591af818 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:21.033033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20499824-73cf-4b58-b39d-aeae591af818 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:21.034632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20499824-73cf-4b58-b39d-aeae591af818 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:21.036740 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20499824-73cf-4b58-b39d-aeae591af818 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:21.039755 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20499824-73cf-4b58-b39d-aeae591af818 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:21.040334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-20499824-73cf-4b58-b39d-aeae591af818 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:21.072298 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-20499824-73cf-4b58-b39d-aeae591af818 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] HTTP exception thrown: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-20499824-73cf-4b58-b39d-aeae591af818 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Request method failure captured: Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 HTTP/1.1 Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iZa7VxM4p_Ex-E6naGIuyRvcDHAvwfBHmXQGhAfHLAh_LzgDa1FYvEwvBordnUxLES5G2CCLkjYuBXHuFc3poMPHBIpcWHLmBcG7NImLiPB552HmCcpO5xbbZWr8MtZ5JPO79kgNJ7e6DEgca-DGka31QdGuMeleuUlzAE_wjZ_fYY Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 9589b45c8fd0425b8f9c67201bece89c Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "tempest-type-1071722843", "name": "tempest-service-2066272042", "endpoints": [{"region": "tempest-region-95327236", "publicURL": "https://url-843292534.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 9589b45c8fd0425b8f9c67201bece89c Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeShelveTestJSON-808802786-project Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e42e549b9e8c4740a2b33141bd4f7d14 Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeShelveTestJSON-808802786-project Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '373c0727-3fa4-4945-9b0f-3012eea4e5c7'} Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:53:21.073967 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:53:21.078127 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:21.078127 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:21.078127 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:53:21.078127 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:21.078127 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:21.078127 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:53:21.078127 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:53:21.078127 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:53:21.078127 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:53:21.078127 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. Aug 18 11:53:21.078127 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:21.082759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-20499824-73cf-4b58-b39d-aeae591af818 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Returning 404 to user: Instance 373c0727-3fa4-4945-9b0f-3012eea4e5c7 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:53:21.083792 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-20499824-73cf-4b58-b39d-aeae591af818 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7" status: 404 len: 111 microversion: 2.20 time: 0.070994 Aug 18 11:53:21.085201 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2498/5307] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:53:21 2022] GET /compute/v2.1/servers/373c0727-3fa4-4945-9b0f-3012eea4e5c7 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:53:21.716381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-32124cb2-a573-427a-95f2-d02be96de481 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:21.717484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-32124cb2-a573-427a-95f2-d02be96de481 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:21.731331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32124cb2-a573-427a-95f2-d02be96de481 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:21.732715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32124cb2-a573-427a-95f2-d02be96de481 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:21.735144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32124cb2-a573-427a-95f2-d02be96de481 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:21.736717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32124cb2-a573-427a-95f2-d02be96de481 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:21.747575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32124cb2-a573-427a-95f2-d02be96de481 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:21.748258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32124cb2-a573-427a-95f2-d02be96de481 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:22.630392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-32124cb2-a573-427a-95f2-d02be96de481 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:22.648473 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-32124cb2-a573-427a-95f2-d02be96de481 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1313 microversion: 2.1 time: 0.935546 Aug 18 11:53:22.650088 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2810/5308] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:21 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1313 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:23.683450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b8032c54-dc81-44ce-b965-cc1c1b6b6555 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:23.684084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b8032c54-dc81-44ce-b965-cc1c1b6b6555 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:23.696542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8032c54-dc81-44ce-b965-cc1c1b6b6555 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:23.697048 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8032c54-dc81-44ce-b965-cc1c1b6b6555 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:23.703804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8032c54-dc81-44ce-b965-cc1c1b6b6555 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:23.708559 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8032c54-dc81-44ce-b965-cc1c1b6b6555 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:23.709687 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8032c54-dc81-44ce-b965-cc1c1b6b6555 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:23.712064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8032c54-dc81-44ce-b965-cc1c1b6b6555 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:23.728118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ee2b0c45-2bca-4975-84fa-1236c0a9a512 req-edf0f43f-817b-4155-8ae9-29bc20d5c143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf26a4b8-1dc7-4eae-915f-96edb3669e6f", "tag": "6421071f-4269-40e0-b3c6-3e988d872dea"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:53:23.760267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ee2b0c45-2bca-4975-84fa-1236c0a9a512 req-edf0f43f-817b-4155-8ae9-29bc20d5c143 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:23.760953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ee2b0c45-2bca-4975-84fa-1236c0a9a512 req-edf0f43f-817b-4155-8ae9-29bc20d5c143 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:23.761558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ee2b0c45-2bca-4975-84fa-1236c0a9a512 req-edf0f43f-817b-4155-8ae9-29bc20d5c143 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:23.793153 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ee2b0c45-2bca-4975-84fa-1236c0a9a512 req-edf0f43f-817b-4155-8ae9-29bc20d5c143 service nova] Creating event network-changed:6421071f-4269-40e0-b3c6-3e988d872dea for instance bf26a4b8-1dc7-4eae-915f-96edb3669e6f on n-h1-853611-3 Aug 18 11:53:23.812547 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ee2b0c45-2bca-4975-84fa-1236c0a9a512 req-edf0f43f-817b-4155-8ae9-29bc20d5c143 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088782 Aug 18 11:53:23.825761 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2811/5309] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:53:25.139781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:25.243209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-221316bf-820b-4a10-920e-68ad15ca2c0b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:25.246287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-221316bf-820b-4a10-920e-68ad15ca2c0b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:25.256072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:25.257896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:25.279824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-221316bf-820b-4a10-920e-68ad15ca2c0b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:25.280667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-221316bf-820b-4a10-920e-68ad15ca2c0b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:25.281324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-221316bf-820b-4a10-920e-68ad15ca2c0b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:25.285956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-221316bf-820b-4a10-920e-68ad15ca2c0b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:25.286678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-221316bf-820b-4a10-920e-68ad15ca2c0b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:25.287336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-221316bf-820b-4a10-920e-68ad15ca2c0b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:25.337090 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-221316bf-820b-4a10-920e-68ad15ca2c0b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/ips" status: 200 len: 149 microversion: 2.1 time: 0.100190 Aug 18 11:53:25.338236 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2812/5310] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:53:25 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/ips => generated 149 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:53:25.889394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b8032c54-dc81-44ce-b965-cc1c1b6b6555 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:25.898023 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b8032c54-dc81-44ce-b965-cc1c1b6b6555 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1313 microversion: 2.1 time: 2.220881 Aug 18 11:53:25.898764 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2499/5311] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:23 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1313 bytes in 2222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:26.784509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08f9605a-8428-47fb-adee-ff8165af413d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:26.785631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-08f9605a-8428-47fb-adee-ff8165af413d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:26.799116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08f9605a-8428-47fb-adee-ff8165af413d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:26.799922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08f9605a-8428-47fb-adee-ff8165af413d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:26.800562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08f9605a-8428-47fb-adee-ff8165af413d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:26.802743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08f9605a-8428-47fb-adee-ff8165af413d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:26.805090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08f9605a-8428-47fb-adee-ff8165af413d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:26.805789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08f9605a-8428-47fb-adee-ff8165af413d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:26.840846 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-08f9605a-8428-47fb-adee-ff8165af413d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] HTTP exception thrown: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08f9605a-8428-47fb-adee-ff8165af413d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Request method failure captured: Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 HTTP/1.1 Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iZa7VxM4p_Ex-E6naGIuyRvcDHAvwfBHmXQGhAfHLAh_LzgDa1FYvEwvBordnUxLES5G2CCLkjYuBXHuFc3poMPHBIpcWHLmBcG7NImLiPB552HmCcpO5xbbZWr8MtZ5JPO79kgNJ7e6DEgca-DGka31QdGuMeleuUlzAE_wjZ_fYY Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 9589b45c8fd0425b8f9c67201bece89c Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "tempest-type-1071722843", "name": "tempest-service-2066272042", "endpoints": [{"region": "tempest-region-95327236", "publicURL": "https://url-843292534.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 9589b45c8fd0425b8f9c67201bece89c Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AttachVolumeShelveTestJSON-808802786-project Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e42e549b9e8c4740a2b33141bd4f7d14 Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AttachVolumeShelveTestJSON-808802786-project Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '1706f34c-3b86-4298-be5a-126d7bfeba56'} Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:53:26.845232 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:53:26.851074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:53:26.851074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:53:26.851074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:53:26.851074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:53:26.851074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:53:26.851074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:53:26.851074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:26.851074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:53:26.851074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:53:26.851074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:53:26.851074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:53:26.851074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:53:26.851074 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:53:26.855372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08f9605a-8428-47fb-adee-ff8165af413d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Returning 404 to user: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:53:26.860024 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-08f9605a-8428-47fb-adee-ff8165af413d tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 404 len: 111 microversion: 2.20 time: 0.080181 Aug 18 11:53:26.860968 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2813/5312] 10.222.0.73 () {60 vars in 1280 bytes} [Thu Aug 18 11:53:26 2022] DELETE /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:53:26.870011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dee9ee2c-12f1-4b89-a1b0-8c42781650e6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:26.870720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dee9ee2c-12f1-4b89-a1b0-8c42781650e6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] [instance: 1706f34c-3b86-4298-be5a-126d7bfeba56] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:26.883345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dee9ee2c-12f1-4b89-a1b0-8c42781650e6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:26.888822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dee9ee2c-12f1-4b89-a1b0-8c42781650e6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:26.889350 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dee9ee2c-12f1-4b89-a1b0-8c42781650e6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:26.890123 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dee9ee2c-12f1-4b89-a1b0-8c42781650e6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:26.894421 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dee9ee2c-12f1-4b89-a1b0-8c42781650e6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:26.895172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dee9ee2c-12f1-4b89-a1b0-8c42781650e6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:26.924196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6eb2adbc-fa77-460c-a362-64c7897b0de4 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:26.924998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6eb2adbc-fa77-460c-a362-64c7897b0de4 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:26.947379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eb2adbc-fa77-460c-a362-64c7897b0de4 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:26.947894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eb2adbc-fa77-460c-a362-64c7897b0de4 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:26.948335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eb2adbc-fa77-460c-a362-64c7897b0de4 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:26.955535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eb2adbc-fa77-460c-a362-64c7897b0de4 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:26.956046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eb2adbc-fa77-460c-a362-64c7897b0de4 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:26.960952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eb2adbc-fa77-460c-a362-64c7897b0de4 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:26.962790 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-dee9ee2c-12f1-4b89-a1b0-8c42781650e6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] HTTP exception thrown: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dee9ee2c-12f1-4b89-a1b0-8c42781650e6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Request method failure captured: Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 HTTP/1.1 Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_iZa7VxM4p_Ex-E6naGIuyRvcDHAvwfBHmXQGhAfHLAh_LzgDa1FYvEwvBordnUxLES5G2CCLkjYuBXHuFc3poMPHBIpcWHLmBcG7NImLiPB552HmCcpO5xbbZWr8MtZ5JPO79kgNJ7e6DEgca-DGka31QdGuMeleuUlzAE_wjZ_fYY Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 9589b45c8fd0425b8f9c67201bece89c Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "tempest-type-1071722843", "name": "tempest-service-2066272042", "endpoints": [{"region": "tempest-region-95327236", "publicURL": "https://url-843292534.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9589b45c8fd0425b8f9c67201bece89c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 9589b45c8fd0425b8f9c67201bece89c Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-808802786 Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeShelveTestJSON-808802786-project Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: e42e549b9e8c4740a2b33141bd4f7d14 Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeShelveTestJSON-808802786-project Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '1706f34c-3b86-4298-be5a-126d7bfeba56'} Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:53:26.968629 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:53:26.974163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:53:26.974163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:26.974163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:53:26.974163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:26.974163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:53:26.974163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:53:26.974163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:53:26.974163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:53:26.974163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:53:26.974163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. Aug 18 11:53:26.974163 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:53:26.975089 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dee9ee2c-12f1-4b89-a1b0-8c42781650e6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] Returning 404 to user: Instance 1706f34c-3b86-4298-be5a-126d7bfeba56 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:53:26.980211 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dee9ee2c-12f1-4b89-a1b0-8c42781650e6 tempest-AttachVolumeShelveTestJSON-808802786 tempest-AttachVolumeShelveTestJSON-808802786-project] 10.222.0.73 "GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56" status: 404 len: 111 microversion: 2.20 time: 0.113564 Aug 18 11:53:26.982534 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2500/5313] 10.222.0.73 () {60 vars in 1277 bytes} [Thu Aug 18 11:53:26 2022] GET /compute/v2.1/servers/1706f34c-3b86-4298-be5a-126d7bfeba56 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:53:27.524377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6eb2adbc-fa77-460c-a362-64c7897b0de4 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:27.544616 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6eb2adbc-fa77-460c-a362-64c7897b0de4 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1313 microversion: 2.1 time: 0.626472 Aug 18 11:53:27.545664 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2814/5314] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:26 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1313 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:53:28.363082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-952eb83d-1458-447c-8f85-c594157dd9b6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4483ebe7-f29b-4882-81e1-3166a386088e"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:53:28.365399 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-952eb83d-1458-447c-8f85-c594157dd9b6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:28.375980 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952eb83d-1458-447c-8f85-c594157dd9b6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:28.380161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952eb83d-1458-447c-8f85-c594157dd9b6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:28.380640 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952eb83d-1458-447c-8f85-c594157dd9b6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:28.381392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952eb83d-1458-447c-8f85-c594157dd9b6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:28.382024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952eb83d-1458-447c-8f85-c594157dd9b6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:28.382411 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-952eb83d-1458-447c-8f85-c594157dd9b6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:28.575630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e6396f6-19c6-40ba-a0ff-c49a7dd32e28 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:28.577484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1e6396f6-19c6-40ba-a0ff-c49a7dd32e28 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:28.592740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e6396f6-19c6-40ba-a0ff-c49a7dd32e28 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:28.593592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e6396f6-19c6-40ba-a0ff-c49a7dd32e28 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:28.595877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e6396f6-19c6-40ba-a0ff-c49a7dd32e28 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:28.597012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e6396f6-19c6-40ba-a0ff-c49a7dd32e28 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:28.599623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e6396f6-19c6-40ba-a0ff-c49a7dd32e28 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:28.602577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e6396f6-19c6-40ba-a0ff-c49a7dd32e28 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:28.776242 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-952eb83d-1458-447c-8f85-c594157dd9b6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "POST /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.415120 Aug 18 11:53:28.776842 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2501/5315] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:53:28 2022] POST /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:53:29.355276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1e6396f6-19c6-40ba-a0ff-c49a7dd32e28 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:29.368905 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1e6396f6-19c6-40ba-a0ff-c49a7dd32e28 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1313 microversion: 2.1 time: 0.803347 Aug 18 11:53:29.370258 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2815/5316] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:28 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1313 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:30.391547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7caddc8e-4c08-4299-a14a-2a8d6552fb84 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:30.393159 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7caddc8e-4c08-4299-a14a-2a8d6552fb84 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:30.409145 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7caddc8e-4c08-4299-a14a-2a8d6552fb84 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:30.415371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7caddc8e-4c08-4299-a14a-2a8d6552fb84 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:30.416711 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7caddc8e-4c08-4299-a14a-2a8d6552fb84 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:30.420473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7caddc8e-4c08-4299-a14a-2a8d6552fb84 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:30.421345 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7caddc8e-4c08-4299-a14a-2a8d6552fb84 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:30.422029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7caddc8e-4c08-4299-a14a-2a8d6552fb84 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:31.694161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7caddc8e-4c08-4299-a14a-2a8d6552fb84 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:31.705878 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7caddc8e-4c08-4299-a14a-2a8d6552fb84 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1313 microversion: 2.1 time: 1.319797 Aug 18 11:53:31.732289 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2502/5317] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:30 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1313 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:32.739357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a89ee87c-ca84-4a14-9c50-bb849f86397c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:32.740174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a89ee87c-ca84-4a14-9c50-bb849f86397c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:32.792080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a89ee87c-ca84-4a14-9c50-bb849f86397c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:32.792599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a89ee87c-ca84-4a14-9c50-bb849f86397c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:32.793058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a89ee87c-ca84-4a14-9c50-bb849f86397c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:32.800567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a89ee87c-ca84-4a14-9c50-bb849f86397c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:32.801216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a89ee87c-ca84-4a14-9c50-bb849f86397c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:32.801845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a89ee87c-ca84-4a14-9c50-bb849f86397c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:33.655038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a89ee87c-ca84-4a14-9c50-bb849f86397c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:33.667263 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a89ee87c-ca84-4a14-9c50-bb849f86397c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1313 microversion: 2.1 time: 0.931157 Aug 18 11:53:33.670228 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2816/5318] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:32 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1313 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:34.030799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-15273127-c008-450c-a920-10133c0d3312 req-73d75f8f-4e88-4f11-964d-6b2cbe49e8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf26a4b8-1dc7-4eae-915f-96edb3669e6f", "name": "network-vif-plugged", "status": "completed", "tag": "6421071f-4269-40e0-b3c6-3e988d872dea"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:53:34.056146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-15273127-c008-450c-a920-10133c0d3312 req-73d75f8f-4e88-4f11-964d-6b2cbe49e8c4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:34.057989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-15273127-c008-450c-a920-10133c0d3312 req-73d75f8f-4e88-4f11-964d-6b2cbe49e8c4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:34.058475 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-15273127-c008-450c-a920-10133c0d3312 req-73d75f8f-4e88-4f11-964d-6b2cbe49e8c4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:34.090336 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-15273127-c008-450c-a920-10133c0d3312 req-73d75f8f-4e88-4f11-964d-6b2cbe49e8c4 service nova] Creating event network-vif-plugged:6421071f-4269-40e0-b3c6-3e988d872dea for instance bf26a4b8-1dc7-4eae-915f-96edb3669e6f on n-h1-853611-3 Aug 18 11:53:34.099937 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-15273127-c008-450c-a920-10133c0d3312 req-73d75f8f-4e88-4f11-964d-6b2cbe49e8c4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073624 Aug 18 11:53:34.100556 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2503/5319] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:53:34.697977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4d985d7f-a59e-4c84-92dd-ef6d09e97c2b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:34.701105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4d985d7f-a59e-4c84-92dd-ef6d09e97c2b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:34.728179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d985d7f-a59e-4c84-92dd-ef6d09e97c2b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:34.729073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d985d7f-a59e-4c84-92dd-ef6d09e97c2b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:34.729789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d985d7f-a59e-4c84-92dd-ef6d09e97c2b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:34.730809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d985d7f-a59e-4c84-92dd-ef6d09e97c2b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:34.731530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d985d7f-a59e-4c84-92dd-ef6d09e97c2b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:34.732727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d985d7f-a59e-4c84-92dd-ef6d09e97c2b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:34.831976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=69 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:35.499993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4d985d7f-a59e-4c84-92dd-ef6d09e97c2b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:35.513858 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4d985d7f-a59e-4c84-92dd-ef6d09e97c2b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1313 microversion: 2.1 time: 0.821194 Aug 18 11:53:35.516815 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2817/5320] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:34 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1313 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:36.537862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-dee37ac1-108f-488f-9cf7-940cefc93635 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:36.539996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-dee37ac1-108f-488f-9cf7-940cefc93635 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:36.563483 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:36.612758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dee37ac1-108f-488f-9cf7-940cefc93635 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:36.612758 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dee37ac1-108f-488f-9cf7-940cefc93635 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:36.622458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dee37ac1-108f-488f-9cf7-940cefc93635 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:36.622458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dee37ac1-108f-488f-9cf7-940cefc93635 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:36.622458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dee37ac1-108f-488f-9cf7-940cefc93635 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:36.622458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-dee37ac1-108f-488f-9cf7-940cefc93635 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:36.709196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:37.596937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-dee37ac1-108f-488f-9cf7-940cefc93635 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:37.610569 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-dee37ac1-108f-488f-9cf7-940cefc93635 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1463 microversion: 2.1 time: 1.077814 Aug 18 11:53:37.611937 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2504/5321] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:36 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1463 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:37.632329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a522d6d-63c5-4d90-9d2d-fd08df954aa9 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73d6cbdf-9dff-4dab-a57f-e1900be3cd24", "device": "/dev/sdb"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:53:37.635739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6a522d6d-63c5-4d90-9d2d-fd08df954aa9 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:37.640776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:37.647650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a522d6d-63c5-4d90-9d2d-fd08df954aa9 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:37.649005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a522d6d-63c5-4d90-9d2d-fd08df954aa9 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:37.649604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a522d6d-63c5-4d90-9d2d-fd08df954aa9 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:37.650502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a522d6d-63c5-4d90-9d2d-fd08df954aa9 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:37.651136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a522d6d-63c5-4d90-9d2d-fd08df954aa9 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:37.651695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a522d6d-63c5-4d90-9d2d-fd08df954aa9 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:38.182088 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6a522d6d-63c5-4d90-9d2d-fd08df954aa9 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "POST /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.553744 Aug 18 11:53:38.183355 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2818/5322] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:53:37 2022] POST /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f/os-volume_attachments => generated 194 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:53:45.126422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9690c9bf-4e4e-42b8-bf36-e621c8703643 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Action: 'create', calling method: .version_select at 0x7f519e457c10>, body: {"keypair": {"name": "tempest-keypair-1625376471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXlsjT6HQAark8SCn83tYqqhlo5hyv8MI/i7eI2H1KdNKd4qXcuq9TzEpSmM5MVy3HDg9oA0BxEZDaiuPhNIhHFlpeymID8XncedG7kj7N/ioRaE2jjmLCCUjNzBg+mrA=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:53:45.168310 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-9690c9bf-4e4e-42b8-bf36-e621c8703643 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:53:45.189137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-9690c9bf-4e4e-42b8-bf36-e621c8703643 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for user 1e4b3c7d38a540f19d88bf28c83cf9a6 and project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:53:45.269684 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9690c9bf-4e4e-42b8-bf36-e621c8703643 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.147094 Aug 18 11:53:45.278660 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2505/5323] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:53:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:53:51.795066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1139172840", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43cde373-6762-4357-b5ca-4bc083d39b6f"}], "security_groups": [{"name": "tempest-securitygroup--1640675420"}], "key_name": "tempest-keypair-1625376471", "user_data": "}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:53:51.841190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:51.845876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:52.210739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] validate_networks() for [('43cde373-6762-4357-b5ca-4bc083d39b6f', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:53:53.506879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:53:53.507469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:53:53.508583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:53:53.509101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:53:53.510695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:53:53.529434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:53.530015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:53.530592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:53.534784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:53.535375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:53.536011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:53.586490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:53:53.603548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for user 1e4b3c7d38a540f19d88bf28c83cf9a6 and project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:53:53.633977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:53:53.644160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:53:53.748683 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dc66139b-a435-4fb1-871a-8baa4a31050e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.962663 Aug 18 11:53:53.750202 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2819/5324] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:53:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:53:53.759898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=5 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:53:53.766468 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1553f72c-1dca-4a5d-b915-5fb231ebc38d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:53.769914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1553f72c-1dca-4a5d-b915-5fb231ebc38d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:54.020173 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-1553f72c-1dca-4a5d-b915-5fb231ebc38d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:54.029388 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1553f72c-1dca-4a5d-b915-5fb231ebc38d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1242 microversion: 2.1 time: 0.271804 Aug 18 11:53:54.052871 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2506/5325] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:53 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1242 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:55.062009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f6a87058-87da-4441-ba2d-93ee6bc46c47 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:55.063327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f6a87058-87da-4441-ba2d-93ee6bc46c47 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:55.082806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a87058-87da-4441-ba2d-93ee6bc46c47 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:55.083899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a87058-87da-4441-ba2d-93ee6bc46c47 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:55.084558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a87058-87da-4441-ba2d-93ee6bc46c47 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:55.085513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a87058-87da-4441-ba2d-93ee6bc46c47 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:55.087410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a87058-87da-4441-ba2d-93ee6bc46c47 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:55.092732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a87058-87da-4441-ba2d-93ee6bc46c47 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:55.725262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f6a87058-87da-4441-ba2d-93ee6bc46c47 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:55.769146 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f6a87058-87da-4441-ba2d-93ee6bc46c47 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1238 microversion: 2.1 time: 0.712486 Aug 18 11:53:55.775980 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2820/5326] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:55 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1238 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:56.818225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c04a8242-c972-438c-9618-e5dea47f0c61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:56.819400 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c04a8242-c972-438c-9618-e5dea47f0c61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:56.856677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c04a8242-c972-438c-9618-e5dea47f0c61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:56.858394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c04a8242-c972-438c-9618-e5dea47f0c61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:56.859341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c04a8242-c972-438c-9618-e5dea47f0c61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:56.860560 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c04a8242-c972-438c-9618-e5dea47f0c61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:56.861329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c04a8242-c972-438c-9618-e5dea47f0c61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:56.868540 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c04a8242-c972-438c-9618-e5dea47f0c61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:57.402728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c04a8242-c972-438c-9618-e5dea47f0c61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:57.410822 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c04a8242-c972-438c-9618-e5dea47f0c61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1300 microversion: 2.1 time: 0.599920 Aug 18 11:53:57.423334 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2507/5327] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:56 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1300 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:53:58.445823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e1653839-e0f0-4203-8d17-82733ee4dfcf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:58.446456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e1653839-e0f0-4203-8d17-82733ee4dfcf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:58.458898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1653839-e0f0-4203-8d17-82733ee4dfcf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:58.462469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1653839-e0f0-4203-8d17-82733ee4dfcf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:58.468795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1653839-e0f0-4203-8d17-82733ee4dfcf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:58.469778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1653839-e0f0-4203-8d17-82733ee4dfcf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:58.471665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1653839-e0f0-4203-8d17-82733ee4dfcf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:58.472291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1653839-e0f0-4203-8d17-82733ee4dfcf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:58.713583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e1653839-e0f0-4203-8d17-82733ee4dfcf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:53:58.727158 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e1653839-e0f0-4203-8d17-82733ee4dfcf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1300 microversion: 2.1 time: 0.286003 Aug 18 11:53:58.728019 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2821/5328] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:58 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1300 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:53:59.762709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-40858d64-e3f1-411b-af4e-e869a7cea90c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:53:59.763395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-40858d64-e3f1-411b-af4e-e869a7cea90c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:53:59.787378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40858d64-e3f1-411b-af4e-e869a7cea90c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:59.802151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40858d64-e3f1-411b-af4e-e869a7cea90c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:59.802744 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40858d64-e3f1-411b-af4e-e869a7cea90c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:53:59.803510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40858d64-e3f1-411b-af4e-e869a7cea90c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:53:59.807862 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40858d64-e3f1-411b-af4e-e869a7cea90c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:53:59.812804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-40858d64-e3f1-411b-af4e-e869a7cea90c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:00.172428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-40858d64-e3f1-411b-af4e-e869a7cea90c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:54:00.224307 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-40858d64-e3f1-411b-af4e-e869a7cea90c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1300 microversion: 2.1 time: 0.464876 Aug 18 11:54:00.227070 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2508/5329] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:53:59 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1300 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:54:01.257536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-323da27e-0283-426f-aec1-412bdb5fec85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:01.259427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-323da27e-0283-426f-aec1-412bdb5fec85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:01.281579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-323da27e-0283-426f-aec1-412bdb5fec85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:01.286885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-323da27e-0283-426f-aec1-412bdb5fec85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:01.294081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-323da27e-0283-426f-aec1-412bdb5fec85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:01.295340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-323da27e-0283-426f-aec1-412bdb5fec85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:01.297199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-323da27e-0283-426f-aec1-412bdb5fec85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:01.299779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-323da27e-0283-426f-aec1-412bdb5fec85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:01.801751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-323da27e-0283-426f-aec1-412bdb5fec85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:54:01.815169 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-323da27e-0283-426f-aec1-412bdb5fec85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1368 microversion: 2.1 time: 0.563797 Aug 18 11:54:01.815980 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2822/5330] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:54:01 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1368 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:54:02.857257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6446487f-0620-4f05-85ab-02e6eb09e710 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:02.857953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6446487f-0620-4f05-85ab-02e6eb09e710 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:02.893791 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6446487f-0620-4f05-85ab-02e6eb09e710 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:02.894341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6446487f-0620-4f05-85ab-02e6eb09e710 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:02.896709 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6446487f-0620-4f05-85ab-02e6eb09e710 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:02.902027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6446487f-0620-4f05-85ab-02e6eb09e710 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:02.905216 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6446487f-0620-4f05-85ab-02e6eb09e710 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:02.908609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6446487f-0620-4f05-85ab-02e6eb09e710 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:04.029137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:54:04.081429 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6446487f-0620-4f05-85ab-02e6eb09e710 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:54:04.111989 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6446487f-0620-4f05-85ab-02e6eb09e710 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1368 microversion: 2.1 time: 1.274325 Aug 18 11:54:04.112778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-e6895ebc-b91c-430e-8dc4-f67f6d7a0d1e req-324e7a7f-a339-4f28-8362-db21745c6413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c9809a8-4788-41b8-bc8a-584344c37102", "tag": "56caf80e-641b-47ad-8fc0-7d18b957c7ce"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:54:04.131194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:54:04.131911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:54:04.132668 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2509/5331] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:54:02 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1368 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:54:04.134132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e6895ebc-b91c-430e-8dc4-f67f6d7a0d1e req-324e7a7f-a339-4f28-8362-db21745c6413 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:04.140622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e6895ebc-b91c-430e-8dc4-f67f6d7a0d1e req-324e7a7f-a339-4f28-8362-db21745c6413 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:04.143913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e6895ebc-b91c-430e-8dc4-f67f6d7a0d1e req-324e7a7f-a339-4f28-8362-db21745c6413 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:04.193622 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e6895ebc-b91c-430e-8dc4-f67f6d7a0d1e req-324e7a7f-a339-4f28-8362-db21745c6413 service nova] Creating event network-changed:56caf80e-641b-47ad-8fc0-7d18b957c7ce for instance 6c9809a8-4788-41b8-bc8a-584344c37102 on n-h2-853611-3 Aug 18 11:54:04.215274 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-e6895ebc-b91c-430e-8dc4-f67f6d7a0d1e req-324e7a7f-a339-4f28-8362-db21745c6413 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105529 Aug 18 11:54:04.231148 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2823/5332] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:54:05.145745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e7b55383-092b-4a37-97b9-8e60ccda77ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:05.146373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e7b55383-092b-4a37-97b9-8e60ccda77ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:05.155777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7b55383-092b-4a37-97b9-8e60ccda77ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:05.156589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7b55383-092b-4a37-97b9-8e60ccda77ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:05.157413 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7b55383-092b-4a37-97b9-8e60ccda77ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:05.158351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7b55383-092b-4a37-97b9-8e60ccda77ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:05.159047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7b55383-092b-4a37-97b9-8e60ccda77ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:05.159818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e7b55383-092b-4a37-97b9-8e60ccda77ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:05.761966 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e7b55383-092b-4a37-97b9-8e60ccda77ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:54:05.782409 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e7b55383-092b-4a37-97b9-8e60ccda77ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1368 microversion: 2.1 time: 0.644593 Aug 18 11:54:05.796954 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2510/5333] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:54:05 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1368 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:54:06.815778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-abe8ad78-c60d-4db4-b3cd-fd32db6825bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:06.817257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-abe8ad78-c60d-4db4-b3cd-fd32db6825bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:06.835110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abe8ad78-c60d-4db4-b3cd-fd32db6825bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:06.836651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abe8ad78-c60d-4db4-b3cd-fd32db6825bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:06.840889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abe8ad78-c60d-4db4-b3cd-fd32db6825bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:06.841867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abe8ad78-c60d-4db4-b3cd-fd32db6825bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:06.842642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abe8ad78-c60d-4db4-b3cd-fd32db6825bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:06.846713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abe8ad78-c60d-4db4-b3cd-fd32db6825bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:07.420825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-abe8ad78-c60d-4db4-b3cd-fd32db6825bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:54:07.442545 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-abe8ad78-c60d-4db4-b3cd-fd32db6825bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1368 microversion: 2.1 time: 0.633108 Aug 18 11:54:07.450173 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2824/5334] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:54:06 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1368 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:54:08.481204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2016e53e-5877-4bf6-9308-ed64aa7233b7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:08.483212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2016e53e-5877-4bf6-9308-ed64aa7233b7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:08.497433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:54:08.504378 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2016e53e-5877-4bf6-9308-ed64aa7233b7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:08.505959 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2016e53e-5877-4bf6-9308-ed64aa7233b7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:08.508375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2016e53e-5877-4bf6-9308-ed64aa7233b7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:08.510440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2016e53e-5877-4bf6-9308-ed64aa7233b7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:08.511716 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2016e53e-5877-4bf6-9308-ed64aa7233b7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:08.514691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2016e53e-5877-4bf6-9308-ed64aa7233b7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:09.490204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2016e53e-5877-4bf6-9308-ed64aa7233b7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:54:09.506300 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2016e53e-5877-4bf6-9308-ed64aa7233b7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1368 microversion: 2.1 time: 1.025651 Aug 18 11:54:09.507543 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2511/5335] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:54:08 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1368 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:54:10.532619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eba12fe8-eac6-4293-a2c4-9a1503bbe97f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:10.533656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eba12fe8-eac6-4293-a2c4-9a1503bbe97f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:10.545759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eba12fe8-eac6-4293-a2c4-9a1503bbe97f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:10.547302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eba12fe8-eac6-4293-a2c4-9a1503bbe97f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:10.547777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eba12fe8-eac6-4293-a2c4-9a1503bbe97f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:10.556609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eba12fe8-eac6-4293-a2c4-9a1503bbe97f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:10.557219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eba12fe8-eac6-4293-a2c4-9a1503bbe97f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:10.558180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eba12fe8-eac6-4293-a2c4-9a1503bbe97f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:10.988102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-7387afae-da50-427d-b9a2-cb9019283a64 req-2a3e1d2b-4cdc-46a7-aa55-48fbb4335367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9809a8-4788-41b8-bc8a-584344c37102", "name": "network-vif-plugged", "status": "completed", "tag": "56caf80e-641b-47ad-8fc0-7d18b957c7ce"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:54:11.021226 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7387afae-da50-427d-b9a2-cb9019283a64 req-2a3e1d2b-4cdc-46a7-aa55-48fbb4335367 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:11.023243 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7387afae-da50-427d-b9a2-cb9019283a64 req-2a3e1d2b-4cdc-46a7-aa55-48fbb4335367 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:11.023726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-7387afae-da50-427d-b9a2-cb9019283a64 req-2a3e1d2b-4cdc-46a7-aa55-48fbb4335367 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:11.059769 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-7387afae-da50-427d-b9a2-cb9019283a64 req-2a3e1d2b-4cdc-46a7-aa55-48fbb4335367 service nova] Creating event network-vif-plugged:56caf80e-641b-47ad-8fc0-7d18b957c7ce for instance 6c9809a8-4788-41b8-bc8a-584344c37102 on n-h2-853611-3 Aug 18 11:54:11.075692 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-7387afae-da50-427d-b9a2-cb9019283a64 req-2a3e1d2b-4cdc-46a7-aa55-48fbb4335367 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101728 Aug 18 11:54:11.100162 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2512/5336] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:54:11.105923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-eba12fe8-eac6-4293-a2c4-9a1503bbe97f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:54:11.134287 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eba12fe8-eac6-4293-a2c4-9a1503bbe97f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1368 microversion: 2.1 time: 0.604097 Aug 18 11:54:11.138155 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2825/5337] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:54:10 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1368 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:54:12.157623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b0049ccc-8c3a-4cc6-96b3-86c60d45d0bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:12.160425 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b0049ccc-8c3a-4cc6-96b3-86c60d45d0bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:12.178911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0049ccc-8c3a-4cc6-96b3-86c60d45d0bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:12.179571 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0049ccc-8c3a-4cc6-96b3-86c60d45d0bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:12.180140 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0049ccc-8c3a-4cc6-96b3-86c60d45d0bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:12.181007 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0049ccc-8c3a-4cc6-96b3-86c60d45d0bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:12.181576 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0049ccc-8c3a-4cc6-96b3-86c60d45d0bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:12.184875 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b0049ccc-8c3a-4cc6-96b3-86c60d45d0bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:13.084689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b0049ccc-8c3a-4cc6-96b3-86c60d45d0bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:54:13.099347 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b0049ccc-8c3a-4cc6-96b3-86c60d45d0bf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1368 microversion: 2.1 time: 0.946060 Aug 18 11:54:13.117266 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2513/5338] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:54:12 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1368 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:54:14.122835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-52410e8f-5107-402e-925c-b2ba24ea6991 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:14.124373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-52410e8f-5107-402e-925c-b2ba24ea6991 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:14.139801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52410e8f-5107-402e-925c-b2ba24ea6991 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:14.140493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52410e8f-5107-402e-925c-b2ba24ea6991 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:14.141087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52410e8f-5107-402e-925c-b2ba24ea6991 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:14.142032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52410e8f-5107-402e-925c-b2ba24ea6991 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:14.142671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52410e8f-5107-402e-925c-b2ba24ea6991 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:14.143264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52410e8f-5107-402e-925c-b2ba24ea6991 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:14.692275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-52410e8f-5107-402e-925c-b2ba24ea6991 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:54:14.703010 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-52410e8f-5107-402e-925c-b2ba24ea6991 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1558 microversion: 2.1 time: 0.585806 Aug 18 11:54:14.713228 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2826/5339] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:54:14 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1558 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:54:14.735873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8c763f05-f2ff-4a22-9f10-3fd1cc45418b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:14.735873 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8c763f05-f2ff-4a22-9f10-3fd1cc45418b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:14.764919 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c763f05-f2ff-4a22-9f10-3fd1cc45418b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:14.767214 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c763f05-f2ff-4a22-9f10-3fd1cc45418b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:14.768642 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c763f05-f2ff-4a22-9f10-3fd1cc45418b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:14.770163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c763f05-f2ff-4a22-9f10-3fd1cc45418b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:14.771652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c763f05-f2ff-4a22-9f10-3fd1cc45418b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:14.773989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8c763f05-f2ff-4a22-9f10-3fd1cc45418b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:15.045394 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8c763f05-f2ff-4a22-9f10-3fd1cc45418b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.313939 Aug 18 11:54:15.047708 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2514/5340] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:54:14 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102/os-interface => generated 285 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:54:20.500044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-97d9bb61-cd52-41ca-af50-f1fb7616c6be req-4a63cd98-72c9-4df9-9871-dfa3527860eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c9809a8-4788-41b8-bc8a-584344c37102", "tag": "56caf80e-641b-47ad-8fc0-7d18b957c7ce"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:54:20.526611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-97d9bb61-cd52-41ca-af50-f1fb7616c6be req-4a63cd98-72c9-4df9-9871-dfa3527860eb service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:20.527083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-97d9bb61-cd52-41ca-af50-f1fb7616c6be req-4a63cd98-72c9-4df9-9871-dfa3527860eb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:20.529818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-97d9bb61-cd52-41ca-af50-f1fb7616c6be req-4a63cd98-72c9-4df9-9871-dfa3527860eb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:20.558676 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-97d9bb61-cd52-41ca-af50-f1fb7616c6be req-4a63cd98-72c9-4df9-9871-dfa3527860eb service nova] Creating event network-changed:56caf80e-641b-47ad-8fc0-7d18b957c7ce for instance 6c9809a8-4788-41b8-bc8a-584344c37102 on n-h2-853611-3 Aug 18 11:54:20.568872 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-97d9bb61-cd52-41ca-af50-f1fb7616c6be req-4a63cd98-72c9-4df9-9871-dfa3527860eb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077974 Aug 18 11:54:20.573449 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2827/5341] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:54:46.647347 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7a757af2-218b-44b5-ab8f-18b08cf03857 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:46.648564 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7a757af2-218b-44b5-ab8f-18b08cf03857 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:46.665342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=7 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:54:46.666422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=42 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:54:46.668309 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a757af2-218b-44b5-ab8f-18b08cf03857 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:46.671281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a757af2-218b-44b5-ab8f-18b08cf03857 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:46.672013 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a757af2-218b-44b5-ab8f-18b08cf03857 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:46.679663 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a757af2-218b-44b5-ab8f-18b08cf03857 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:46.680437 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a757af2-218b-44b5-ab8f-18b08cf03857 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:46.681066 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7a757af2-218b-44b5-ab8f-18b08cf03857 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:46.734779 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7a757af2-218b-44b5-ab8f-18b08cf03857 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102/ips" status: 200 len: 150 microversion: 2.1 time: 0.091148 Aug 18 11:54:46.742083 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2515/5342] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:54:46 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102/ips => generated 150 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:54:46.753806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:54:46.755306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=42 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:54:46.760685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-69339ced-8323-47c7-b778-4fc63d1eb55d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4483ebe7-f29b-4882-81e1-3166a386088e"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:54:46.774046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-69339ced-8323-47c7-b778-4fc63d1eb55d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:46.790705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69339ced-8323-47c7-b778-4fc63d1eb55d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:46.791406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69339ced-8323-47c7-b778-4fc63d1eb55d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:46.792001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69339ced-8323-47c7-b778-4fc63d1eb55d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:46.793084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69339ced-8323-47c7-b778-4fc63d1eb55d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:46.799383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69339ced-8323-47c7-b778-4fc63d1eb55d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:46.800294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69339ced-8323-47c7-b778-4fc63d1eb55d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:47.065145 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-69339ced-8323-47c7-b778-4fc63d1eb55d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] HTTP exception thrown: Invalid volume: volume 4483ebe7-f29b-4882-81e1-3166a386088e is already attached to instances: 8d41ef54-abb5-4b95-943d-219504a92c05 Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-69339ced-8323-47c7-b778-4fc63d1eb55d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Request method failure captured: Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102/os-volume_attachments HTTP/1.1 Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 74 Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_if1x16WBMpc3s4OH8sjm3tHJjaZqQcRpU1oiMS-p1WI1YrRSC2t7-vlFi9T8Z71n1HUxo4fP6nRLR16BbxlLWyXqp2clERspIcMb_jAedcCu_hp9tsk0cAtcafVC7hlv2fQVmuiFfoXUzkmUNLY6LwwQl_4XOvH_miTFCjGf1SoX08 Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 1e4b3c7d38a540f19d88bf28c83cf9a6 Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: {"volumeAttachment": {"volumeId": "4483ebe7-f29b-4882-81e1-3166a386088e"}} Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid volume: volume 4483ebe7-f29b-4882-81e1-3166a386088e is already attached to instances: 8d41ef54-abb5-4b95-943d-219504a92c05 Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': '6c9809a8-4788-41b8-bc8a-584344c37102', 'body': {'volumeAttachment': {'volumeId': '4483ebe7-f29b-4882-81e1-3166a386088e'}}} Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4483ebe7-f29b-4882-81e1-3166a386088e is already attached to instances: 8d41ef54-abb5-4b95-943d-219504a92c05 Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:54:47.070936 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4483ebe7-f29b-4882-81e1-3166a386088e is already attached to instances: 8d41ef54-abb5-4b95-943d-219504a92c05 Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4483ebe7-f29b-4882-81e1-3166a386088e is already attached to instances: 8d41ef54-abb5-4b95-943d-219504a92c05 Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:54:47.074895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-69339ced-8323-47c7-b778-4fc63d1eb55d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Returning 400 to user: Invalid volume: volume 4483ebe7-f29b-4882-81e1-3166a386088e is already attached to instances: 8d41ef54-abb5-4b95-943d-219504a92c05 {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:54:47.078205 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-69339ced-8323-47c7-b778-4fc63d1eb55d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "POST /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.326337 Aug 18 11:54:47.095063 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2828/5343] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:54:46 2022] POST /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102/os-volume_attachments => generated 174 bytes in 343 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:54:47.109032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-11453a82-82c7-43a3-9b9a-0d6a159af262 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:47.112073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-11453a82-82c7-43a3-9b9a-0d6a159af262 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:47.138106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11453a82-82c7-43a3-9b9a-0d6a159af262 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:47.140578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11453a82-82c7-43a3-9b9a-0d6a159af262 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:47.141241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11453a82-82c7-43a3-9b9a-0d6a159af262 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:47.144606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11453a82-82c7-43a3-9b9a-0d6a159af262 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:47.145188 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11453a82-82c7-43a3-9b9a-0d6a159af262 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:47.148925 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-11453a82-82c7-43a3-9b9a-0d6a159af262 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:47.223938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-11453a82-82c7-43a3-9b9a-0d6a159af262 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:54:47.453997 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-11453a82-82c7-43a3-9b9a-0d6a159af262 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 204 len: 0 microversion: 2.1 time: 0.349139 Aug 18 11:54:47.454706 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2516/5344] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:54:47 2022] DELETE /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:54:47.463707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cdb89b11-e82a-4ab7-9d0f-4cd42c5ef62e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:47.464767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cdb89b11-e82a-4ab7-9d0f-4cd42c5ef62e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:47.490180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdb89b11-e82a-4ab7-9d0f-4cd42c5ef62e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:47.490977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdb89b11-e82a-4ab7-9d0f-4cd42c5ef62e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:47.491635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdb89b11-e82a-4ab7-9d0f-4cd42c5ef62e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:47.492716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdb89b11-e82a-4ab7-9d0f-4cd42c5ef62e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:47.493482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdb89b11-e82a-4ab7-9d0f-4cd42c5ef62e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:47.494090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdb89b11-e82a-4ab7-9d0f-4cd42c5ef62e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:49.199740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cdb89b11-e82a-4ab7-9d0f-4cd42c5ef62e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:54:49.242640 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cdb89b11-e82a-4ab7-9d0f-4cd42c5ef62e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1683 microversion: 2.1 time: 1.779351 Aug 18 11:54:49.261168 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2829/5345] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:54:47 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1683 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:54:50.286111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f207a1ee-ec93-43ff-a3cf-01a48c73edf5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:50.287075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f207a1ee-ec93-43ff-a3cf-01a48c73edf5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:50.304963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f207a1ee-ec93-43ff-a3cf-01a48c73edf5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:50.305495 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f207a1ee-ec93-43ff-a3cf-01a48c73edf5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:50.308372 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f207a1ee-ec93-43ff-a3cf-01a48c73edf5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:50.309491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f207a1ee-ec93-43ff-a3cf-01a48c73edf5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:50.316482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f207a1ee-ec93-43ff-a3cf-01a48c73edf5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:50.316939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f207a1ee-ec93-43ff-a3cf-01a48c73edf5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:51.601660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f207a1ee-ec93-43ff-a3cf-01a48c73edf5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:54:51.622030 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f207a1ee-ec93-43ff-a3cf-01a48c73edf5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1683 microversion: 2.1 time: 1.340204 Aug 18 11:54:51.636383 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2517/5346] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:54:50 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1683 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:54:52.660564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1fbdb1df-e10c-4dfc-a033-1bf285647631 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:52.661268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1fbdb1df-e10c-4dfc-a033-1bf285647631 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:52.682222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fbdb1df-e10c-4dfc-a033-1bf285647631 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:52.685360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fbdb1df-e10c-4dfc-a033-1bf285647631 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:52.688172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fbdb1df-e10c-4dfc-a033-1bf285647631 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:52.689914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fbdb1df-e10c-4dfc-a033-1bf285647631 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:52.691502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fbdb1df-e10c-4dfc-a033-1bf285647631 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:52.691954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fbdb1df-e10c-4dfc-a033-1bf285647631 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:52.991241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1fbdb1df-e10c-4dfc-a033-1bf285647631 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:54:53.001222 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1fbdb1df-e10c-4dfc-a033-1bf285647631 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1615 microversion: 2.1 time: 0.344778 Aug 18 11:54:53.005540 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2830/5347] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:54:52 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1615 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:54:53.779448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-0f69026c-1678-4e87-8ff2-bd055cf78a5a req-e8a7c95f-af5d-4ffa-9931-53bde6c92e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9809a8-4788-41b8-bc8a-584344c37102", "name": "network-vif-deleted", "tag": "56caf80e-641b-47ad-8fc0-7d18b957c7ce"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:54:53.794000 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0f69026c-1678-4e87-8ff2-bd055cf78a5a req-e8a7c95f-af5d-4ffa-9931-53bde6c92e86 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:53.794779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0f69026c-1678-4e87-8ff2-bd055cf78a5a req-e8a7c95f-af5d-4ffa-9931-53bde6c92e86 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:53.795595 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-0f69026c-1678-4e87-8ff2-bd055cf78a5a req-e8a7c95f-af5d-4ffa-9931-53bde6c92e86 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:53.836375 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-0f69026c-1678-4e87-8ff2-bd055cf78a5a req-e8a7c95f-af5d-4ffa-9931-53bde6c92e86 service nova] Creating event network-vif-deleted:56caf80e-641b-47ad-8fc0-7d18b957c7ce for instance 6c9809a8-4788-41b8-bc8a-584344c37102 on n-h2-853611-3 Aug 18 11:54:53.854108 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-0f69026c-1678-4e87-8ff2-bd055cf78a5a req-e8a7c95f-af5d-4ffa-9931-53bde6c92e86 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075040 Aug 18 11:54:53.855483 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2518/5348] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:54:54.036197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a6de4df-219f-436e-babb-9b5087b0c8fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:54.036820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6a6de4df-219f-436e-babb-9b5087b0c8fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:54.057147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a6de4df-219f-436e-babb-9b5087b0c8fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:54.065441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a6de4df-219f-436e-babb-9b5087b0c8fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:54.066164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a6de4df-219f-436e-babb-9b5087b0c8fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:54.068530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a6de4df-219f-436e-babb-9b5087b0c8fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:54.069244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a6de4df-219f-436e-babb-9b5087b0c8fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:54.069862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a6de4df-219f-436e-babb-9b5087b0c8fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:54.133762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a6de4df-219f-436e-babb-9b5087b0c8fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:54.134694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a6de4df-219f-436e-babb-9b5087b0c8fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:54.135504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a6de4df-219f-436e-babb-9b5087b0c8fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:54.136231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-6a6de4df-219f-436e-babb-9b5087b0c8fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lazy-loading 'fault' on Instance uuid 6c9809a8-4788-41b8-bc8a-584344c37102 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:54:54.363678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6a6de4df-219f-436e-babb-9b5087b0c8fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:54:54.404412 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6a6de4df-219f-436e-babb-9b5087b0c8fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 200 len: 1332 microversion: 2.1 time: 0.381358 Aug 18 11:54:54.409046 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2831/5349] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:54:54 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 1332 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:54:55.430184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa90f8b2-1cfc-4881-8674-07982cb1619b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:55.430994 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fa90f8b2-1cfc-4881-8674-07982cb1619b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:55.456547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa90f8b2-1cfc-4881-8674-07982cb1619b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:55.457834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa90f8b2-1cfc-4881-8674-07982cb1619b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:55.458485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa90f8b2-1cfc-4881-8674-07982cb1619b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:55.460924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa90f8b2-1cfc-4881-8674-07982cb1619b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:55.462251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa90f8b2-1cfc-4881-8674-07982cb1619b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:55.462731 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fa90f8b2-1cfc-4881-8674-07982cb1619b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:55.484276 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-fa90f8b2-1cfc-4881-8674-07982cb1619b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] HTTP exception thrown: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa90f8b2-1cfc-4881-8674-07982cb1619b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Request method failure captured: Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 HTTP/1.1 Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_if1x16WBMpc3s4OH8sjm3tHJjaZqQcRpU1oiMS-p1WI1YrRSC2t7-vlFi9T8Z71n1HUxo4fP6nRLR16BbxlLWyXqp2clERspIcMb_jAedcCu_hp9tsk0cAtcafVC7hlv2fQVmuiFfoXUzkmUNLY6LwwQl_4XOvH_miTFCjGf1SoX08 Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1e4b3c7d38a540f19d88bf28c83cf9a6 Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '6c9809a8-4788-41b8-bc8a-584344c37102'} Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:54:55.486422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:54:55.490202 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:54:55.490202 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:54:55.490202 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:54:55.490202 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:54:55.490202 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:54:55.490202 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:54:55.490202 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:54:55.490202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fa90f8b2-1cfc-4881-8674-07982cb1619b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Returning 404 to user: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:54:55.490670 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fa90f8b2-1cfc-4881-8674-07982cb1619b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 404 len: 111 microversion: 2.1 time: 0.065226 Aug 18 11:54:55.491200 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2519/5350] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:54:55 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:54:55.501077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d0a47458-2853-4f53-895e-ebddaa8205da tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '.version_select at 0x7f519e8a51f0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:55.506262 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d0a47458-2853-4f53-895e-ebddaa8205da tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [8d540245-869d-4e40-b2b7-9f5f5e8f8484] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 11:54:56.514201 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [None req-d0a47458-2853-4f53-895e-ebddaa8205da tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [8d540245-869d-4e40-b2b7-9f5f5e8f8484] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 50350. Aug 18 11:54:56.555260 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d0a47458-2853-4f53-895e-ebddaa8205da tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625376471" status: 202 len: 0 microversion: 2.1 time: 1.057105 Aug 18 11:54:56.559563 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2832/5351] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 11:54:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625376471 => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:54:59.797542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eb8077aa-7030-4316-b29f-ec6a30730492 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:54:59.800252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-eb8077aa-7030-4316-b29f-ec6a30730492 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:54:59.819500 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb8077aa-7030-4316-b29f-ec6a30730492 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:59.820676 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb8077aa-7030-4316-b29f-ec6a30730492 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:59.821423 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb8077aa-7030-4316-b29f-ec6a30730492 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:54:59.822977 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb8077aa-7030-4316-b29f-ec6a30730492 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:54:59.823723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb8077aa-7030-4316-b29f-ec6a30730492 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:54:59.824370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb8077aa-7030-4316-b29f-ec6a30730492 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:00.002759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-eb8077aa-7030-4316-b29f-ec6a30730492 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lazy-loading 'services' on Instance uuid 8d41ef54-abb5-4b95-943d-219504a92c05 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:55:00.191605 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eb8077aa-7030-4316-b29f-ec6a30730492 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments/4483ebe7-f29b-4882-81e1-3166a386088e" status: 202 len: 0 microversion: 2.1 time: 0.406752 Aug 18 11:55:00.193135 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2520/5352] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 11:54:59 2022] DELETE /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments/4483ebe7-f29b-4882-81e1-3166a386088e => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:55:00.203681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1ed4a0e3-8bf8-46ec-a563-fec8a02d04c1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:00.207059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1ed4a0e3-8bf8-46ec-a563-fec8a02d04c1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:00.227493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed4a0e3-8bf8-46ec-a563-fec8a02d04c1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:00.228466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed4a0e3-8bf8-46ec-a563-fec8a02d04c1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:00.229078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed4a0e3-8bf8-46ec-a563-fec8a02d04c1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:00.230009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed4a0e3-8bf8-46ec-a563-fec8a02d04c1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:00.232095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed4a0e3-8bf8-46ec-a563-fec8a02d04c1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:00.232721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ed4a0e3-8bf8-46ec-a563-fec8a02d04c1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:00.359014 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1ed4a0e3-8bf8-46ec-a563-fec8a02d04c1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161479 Aug 18 11:55:00.373076 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2833/5353] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:55:00 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:01.397065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b83d8e15-0855-4a1f-9e86-e0f61c8ea92c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:01.403550 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b83d8e15-0855-4a1f-9e86-e0f61c8ea92c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:01.438201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b83d8e15-0855-4a1f-9e86-e0f61c8ea92c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:01.438822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b83d8e15-0855-4a1f-9e86-e0f61c8ea92c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:01.439283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b83d8e15-0855-4a1f-9e86-e0f61c8ea92c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:01.448222 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b83d8e15-0855-4a1f-9e86-e0f61c8ea92c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:01.449093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b83d8e15-0855-4a1f-9e86-e0f61c8ea92c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:01.449706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b83d8e15-0855-4a1f-9e86-e0f61c8ea92c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:01.545531 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b83d8e15-0855-4a1f-9e86-e0f61c8ea92c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155492 Aug 18 11:55:01.556422 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2521/5354] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:55:01 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:02.559081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e74974fe-e9b4-4e76-a82d-63bd24cb5851 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:02.562323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e74974fe-e9b4-4e76-a82d-63bd24cb5851 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:02.587172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e74974fe-e9b4-4e76-a82d-63bd24cb5851 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:02.587172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e74974fe-e9b4-4e76-a82d-63bd24cb5851 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:02.587172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e74974fe-e9b4-4e76-a82d-63bd24cb5851 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:02.601636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e74974fe-e9b4-4e76-a82d-63bd24cb5851 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:02.605313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e74974fe-e9b4-4e76-a82d-63bd24cb5851 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:02.606017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e74974fe-e9b4-4e76-a82d-63bd24cb5851 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:02.737487 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e74974fe-e9b4-4e76-a82d-63bd24cb5851 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183643 Aug 18 11:55:02.738829 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2834/5355] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:55:02 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:03.751417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-db31c650-7d9e-4332-ac3d-8d10a563885a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:03.755189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-db31c650-7d9e-4332-ac3d-8d10a563885a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:03.778871 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db31c650-7d9e-4332-ac3d-8d10a563885a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:03.779613 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db31c650-7d9e-4332-ac3d-8d10a563885a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:03.780260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db31c650-7d9e-4332-ac3d-8d10a563885a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:03.782090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db31c650-7d9e-4332-ac3d-8d10a563885a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:03.782937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db31c650-7d9e-4332-ac3d-8d10a563885a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:03.783536 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db31c650-7d9e-4332-ac3d-8d10a563885a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:03.881430 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-db31c650-7d9e-4332-ac3d-8d10a563885a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135410 Aug 18 11:55:03.888129 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2522/5356] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:55:03 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:04.896871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1684013b-b5b6-49c5-a493-d00853787e56 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:04.900092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1684013b-b5b6-49c5-a493-d00853787e56 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:04.917142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1684013b-b5b6-49c5-a493-d00853787e56 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:04.918159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1684013b-b5b6-49c5-a493-d00853787e56 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:04.918800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1684013b-b5b6-49c5-a493-d00853787e56 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:04.919737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1684013b-b5b6-49c5-a493-d00853787e56 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:04.923295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1684013b-b5b6-49c5-a493-d00853787e56 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:04.923973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1684013b-b5b6-49c5-a493-d00853787e56 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:05.005586 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1684013b-b5b6-49c5-a493-d00853787e56 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112869 Aug 18 11:55:05.014896 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2835/5357] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:55:04 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:06.023999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1d31f29a-5675-43e8-9e74-6686793fda85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:06.028937 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1d31f29a-5675-43e8-9e74-6686793fda85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:06.042952 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d31f29a-5675-43e8-9e74-6686793fda85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:06.043568 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d31f29a-5675-43e8-9e74-6686793fda85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:06.044022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d31f29a-5675-43e8-9e74-6686793fda85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:06.044910 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d31f29a-5675-43e8-9e74-6686793fda85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:06.045728 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d31f29a-5675-43e8-9e74-6686793fda85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:06.046547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1d31f29a-5675-43e8-9e74-6686793fda85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:06.167268 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1d31f29a-5675-43e8-9e74-6686793fda85 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147297 Aug 18 11:55:06.173980 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2523/5358] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:55:06 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:07.181178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-83d82744-e349-4e4b-aa90-4a05348c55a9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:07.183714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-83d82744-e349-4e4b-aa90-4a05348c55a9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:07.207335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83d82744-e349-4e4b-aa90-4a05348c55a9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:07.214627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83d82744-e349-4e4b-aa90-4a05348c55a9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:07.215443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83d82744-e349-4e4b-aa90-4a05348c55a9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:07.219095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83d82744-e349-4e4b-aa90-4a05348c55a9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:07.220943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83d82744-e349-4e4b-aa90-4a05348c55a9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:07.221969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83d82744-e349-4e4b-aa90-4a05348c55a9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:07.346183 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-83d82744-e349-4e4b-aa90-4a05348c55a9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167976 Aug 18 11:55:07.354119 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2836/5359] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:55:07 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:08.366810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b6e17ce8-02d1-44e6-b3aa-cebf84e4370e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:08.369305 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b6e17ce8-02d1-44e6-b3aa-cebf84e4370e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:08.402745 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6e17ce8-02d1-44e6-b3aa-cebf84e4370e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:08.403781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6e17ce8-02d1-44e6-b3aa-cebf84e4370e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:08.405623 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6e17ce8-02d1-44e6-b3aa-cebf84e4370e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:08.412416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6e17ce8-02d1-44e6-b3aa-cebf84e4370e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:08.413152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6e17ce8-02d1-44e6-b3aa-cebf84e4370e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:08.414100 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b6e17ce8-02d1-44e6-b3aa-cebf84e4370e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:08.536518 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b6e17ce8-02d1-44e6-b3aa-cebf84e4370e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177073 Aug 18 11:55:08.539834 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2524/5360] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:55:08 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:09.552024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-356f77dd-35b7-4114-93c9-4e2585be173f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:09.558165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-356f77dd-35b7-4114-93c9-4e2585be173f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:09.585628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-356f77dd-35b7-4114-93c9-4e2585be173f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:09.586124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-356f77dd-35b7-4114-93c9-4e2585be173f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:09.594493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-356f77dd-35b7-4114-93c9-4e2585be173f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:09.597845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-356f77dd-35b7-4114-93c9-4e2585be173f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:09.600326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-356f77dd-35b7-4114-93c9-4e2585be173f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:09.602273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-356f77dd-35b7-4114-93c9-4e2585be173f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:09.707470 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-356f77dd-35b7-4114-93c9-4e2585be173f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161177 Aug 18 11:55:09.717459 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2837/5361] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:55:09 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:10.724531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-db95a218-77b5-4625-9038-eb2431bcd0c5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:10.726888 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-db95a218-77b5-4625-9038-eb2431bcd0c5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:10.772592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db95a218-77b5-4625-9038-eb2431bcd0c5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:10.773102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db95a218-77b5-4625-9038-eb2431bcd0c5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:10.773547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db95a218-77b5-4625-9038-eb2431bcd0c5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:10.774272 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db95a218-77b5-4625-9038-eb2431bcd0c5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:10.774765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db95a218-77b5-4625-9038-eb2431bcd0c5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:10.775197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-db95a218-77b5-4625-9038-eb2431bcd0c5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:10.916610 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-db95a218-77b5-4625-9038-eb2431bcd0c5 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200491 Aug 18 11:55:10.927888 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2525/5362] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:55:10 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:11.941086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-71a4e628-970d-48f1-b5e0-0316fdd6ca82 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:11.944382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-71a4e628-970d-48f1-b5e0-0316fdd6ca82 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:11.981428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71a4e628-970d-48f1-b5e0-0316fdd6ca82 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:11.981952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71a4e628-970d-48f1-b5e0-0316fdd6ca82 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:11.982403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71a4e628-970d-48f1-b5e0-0316fdd6ca82 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:11.995259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71a4e628-970d-48f1-b5e0-0316fdd6ca82 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:11.995824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71a4e628-970d-48f1-b5e0-0316fdd6ca82 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:12.002014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71a4e628-970d-48f1-b5e0-0316fdd6ca82 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:12.109631 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-71a4e628-970d-48f1-b5e0-0316fdd6ca82 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173672 Aug 18 11:55:12.119013 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2838/5363] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:55:11 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:13.127935 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a685fe50-520d-46ee-8109-c1a255f8da6b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:13.132498 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a685fe50-520d-46ee-8109-c1a255f8da6b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:13.159657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a685fe50-520d-46ee-8109-c1a255f8da6b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:13.163861 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a685fe50-520d-46ee-8109-c1a255f8da6b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:13.164934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a685fe50-520d-46ee-8109-c1a255f8da6b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:13.166906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a685fe50-520d-46ee-8109-c1a255f8da6b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:13.168837 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a685fe50-520d-46ee-8109-c1a255f8da6b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:13.174934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a685fe50-520d-46ee-8109-c1a255f8da6b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:13.288288 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a685fe50-520d-46ee-8109-c1a255f8da6b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.158805 Aug 18 11:55:13.291086 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2526/5364] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:55:13 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05/os-volume_attachments => generated 25 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:55:13.418462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ca60a545-f794-4c79-9ced-dcd178e7cc9a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:13.418462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ca60a545-f794-4c79-9ced-dcd178e7cc9a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:13.429183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca60a545-f794-4c79-9ced-dcd178e7cc9a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:13.429658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca60a545-f794-4c79-9ced-dcd178e7cc9a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:13.430098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca60a545-f794-4c79-9ced-dcd178e7cc9a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:13.432433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca60a545-f794-4c79-9ced-dcd178e7cc9a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:13.432905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca60a545-f794-4c79-9ced-dcd178e7cc9a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:13.433340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca60a545-f794-4c79-9ced-dcd178e7cc9a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:13.549395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ca60a545-f794-4c79-9ced-dcd178e7cc9a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:55:13.711085 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ca60a545-f794-4c79-9ced-dcd178e7cc9a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 204 len: 0 microversion: 2.1 time: 0.305427 Aug 18 11:55:13.714251 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2839/5365] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:55:13 2022] DELETE /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:55:13.736131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d5b53a1d-4c64-4009-9856-7a5703703087 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:13.736752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d5b53a1d-4c64-4009-9856-7a5703703087 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:13.755607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5b53a1d-4c64-4009-9856-7a5703703087 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:13.756182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5b53a1d-4c64-4009-9856-7a5703703087 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:13.756585 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5b53a1d-4c64-4009-9856-7a5703703087 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:13.757315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5b53a1d-4c64-4009-9856-7a5703703087 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:13.769435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5b53a1d-4c64-4009-9856-7a5703703087 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:13.772213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d5b53a1d-4c64-4009-9856-7a5703703087 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:14.781189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d5b53a1d-4c64-4009-9856-7a5703703087 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:14.793202 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d5b53a1d-4c64-4009-9856-7a5703703087 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1680 microversion: 2.1 time: 1.074509 Aug 18 11:55:14.795514 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2527/5366] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:13 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1680 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:15.822649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7cc87e62-4f28-4739-aafd-d8a401a45a7f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:15.825032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7cc87e62-4f28-4739-aafd-d8a401a45a7f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:15.842321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cc87e62-4f28-4739-aafd-d8a401a45a7f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:15.844853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cc87e62-4f28-4739-aafd-d8a401a45a7f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:15.846385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cc87e62-4f28-4739-aafd-d8a401a45a7f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:15.850398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cc87e62-4f28-4739-aafd-d8a401a45a7f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:15.851515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cc87e62-4f28-4739-aafd-d8a401a45a7f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:15.853199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cc87e62-4f28-4739-aafd-d8a401a45a7f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:17.824530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7cc87e62-4f28-4739-aafd-d8a401a45a7f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:17.827608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:55:17.865484 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7cc87e62-4f28-4739-aafd-d8a401a45a7f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1680 microversion: 2.1 time: 2.047140 Aug 18 11:55:17.882857 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2840/5367] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:15 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1680 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:18.902608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3eb5b4eb-d8c8-4b1f-819c-99cb796d77c9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:18.903299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3eb5b4eb-d8c8-4b1f-819c-99cb796d77c9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:18.905254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:55:18.928333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3eb5b4eb-d8c8-4b1f-819c-99cb796d77c9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:18.928859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3eb5b4eb-d8c8-4b1f-819c-99cb796d77c9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:18.929311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3eb5b4eb-d8c8-4b1f-819c-99cb796d77c9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:18.930046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3eb5b4eb-d8c8-4b1f-819c-99cb796d77c9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:18.930547 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3eb5b4eb-d8c8-4b1f-819c-99cb796d77c9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:18.930985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3eb5b4eb-d8c8-4b1f-819c-99cb796d77c9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:18.957578 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:55:19.210582 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3eb5b4eb-d8c8-4b1f-819c-99cb796d77c9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:19.221584 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3eb5b4eb-d8c8-4b1f-819c-99cb796d77c9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1613 microversion: 2.1 time: 0.324912 Aug 18 11:55:19.223041 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2528/5368] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:18 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1613 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:19.939755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-b6e5fae1-91d3-4d0c-9d94-83d02efd4873 req-702b79be-e566-481d-807b-26bb76f0b9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d41ef54-abb5-4b95-943d-219504a92c05", "name": "network-vif-deleted", "tag": "d6275a81-2cc8-4a38-9cff-a199e768dbff"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:55:19.978381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:55:20.002627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b6e5fae1-91d3-4d0c-9d94-83d02efd4873 req-702b79be-e566-481d-807b-26bb76f0b9c1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:20.003268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b6e5fae1-91d3-4d0c-9d94-83d02efd4873 req-702b79be-e566-481d-807b-26bb76f0b9c1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:20.003732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b6e5fae1-91d3-4d0c-9d94-83d02efd4873 req-702b79be-e566-481d-807b-26bb76f0b9c1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:20.044767 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-b6e5fae1-91d3-4d0c-9d94-83d02efd4873 req-702b79be-e566-481d-807b-26bb76f0b9c1 service nova] Creating event network-vif-deleted:d6275a81-2cc8-4a38-9cff-a199e768dbff for instance 8d41ef54-abb5-4b95-943d-219504a92c05 on n-h2-853611-3 Aug 18 11:55:20.077252 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-b6e5fae1-91d3-4d0c-9d94-83d02efd4873 req-702b79be-e566-481d-807b-26bb76f0b9c1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145689 Aug 18 11:55:20.079918 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2841/5369] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:20.247639 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5fad150c-2c5f-4201-887c-cc33f712c3ff tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:20.249271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5fad150c-2c5f-4201-887c-cc33f712c3ff tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:20.271297 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fad150c-2c5f-4201-887c-cc33f712c3ff tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:20.277626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fad150c-2c5f-4201-887c-cc33f712c3ff tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:20.278213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fad150c-2c5f-4201-887c-cc33f712c3ff tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:20.280207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fad150c-2c5f-4201-887c-cc33f712c3ff tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:20.296725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fad150c-2c5f-4201-887c-cc33f712c3ff tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:20.300417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fad150c-2c5f-4201-887c-cc33f712c3ff tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:20.399782 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fad150c-2c5f-4201-887c-cc33f712c3ff tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:20.401531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fad150c-2c5f-4201-887c-cc33f712c3ff tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:20.405279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5fad150c-2c5f-4201-887c-cc33f712c3ff tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:20.407915 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-5fad150c-2c5f-4201-887c-cc33f712c3ff tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lazy-loading 'fault' on Instance uuid 8d41ef54-abb5-4b95-943d-219504a92c05 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:55:20.613605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5fad150c-2c5f-4201-887c-cc33f712c3ff tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:20.649956 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5fad150c-2c5f-4201-887c-cc33f712c3ff tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 200 len: 1331 microversion: 2.1 time: 0.405640 Aug 18 11:55:20.656942 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2529/5370] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:20 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 1331 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:21.686096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bee0d2e6-8c4c-40e5-a107-ececfbe40860 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:21.688884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bee0d2e6-8c4c-40e5-a107-ececfbe40860 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:21.716256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bee0d2e6-8c4c-40e5-a107-ececfbe40860 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:21.717951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bee0d2e6-8c4c-40e5-a107-ececfbe40860 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:21.719038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bee0d2e6-8c4c-40e5-a107-ececfbe40860 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:21.722830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bee0d2e6-8c4c-40e5-a107-ececfbe40860 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:21.731147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bee0d2e6-8c4c-40e5-a107-ececfbe40860 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:21.743223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bee0d2e6-8c4c-40e5-a107-ececfbe40860 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:21.806468 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-bee0d2e6-8c4c-40e5-a107-ececfbe40860 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] HTTP exception thrown: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bee0d2e6-8c4c-40e5-a107-ececfbe40860 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Request method failure captured: Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 HTTP/1.1 Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_if1x16WBMpc3s4OH8sjm3tHJjaZqQcRpU1oiMS-p1WI1YrRSC2t7-vlFi9T8Z71n1HUxo4fP6nRLR16BbxlLWyXqp2clERspIcMb_jAedcCu_hp9tsk0cAtcafVC7hlv2fQVmuiFfoXUzkmUNLY6LwwQl_4XOvH_miTFCjGf1SoX08 Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 1e4b3c7d38a540f19d88bf28c83cf9a6 Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '8d41ef54-abb5-4b95-943d-219504a92c05'} Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:55:21.814759 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:55:21.819796 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:55:21.819796 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:55:21.819796 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:55:21.819796 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:55:21.819796 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:55:21.819796 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 11:55:21.819796 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:55:21.819796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bee0d2e6-8c4c-40e5-a107-ececfbe40860 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Returning 404 to user: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:55:21.819796 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bee0d2e6-8c4c-40e5-a107-ececfbe40860 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 404 len: 111 microversion: 2.1 time: 0.140995 Aug 18 11:55:21.824341 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2842/5371] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:21 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:55:21.829366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-afb72c09-ca88-4aed-a327-5908e7da0f69 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '.version_select at 0x7f519e489ca0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:21.881253 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-afb72c09-ca88-4aed-a327-5908e7da0f69 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-703950820" status: 202 len: 0 microversion: 2.1 time: 0.058815 Aug 18 11:55:21.881925 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2530/5372] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 18 11:55:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-703950820 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:55:26.226494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-00e89fa7-2637-487d-bb22-38af69f049d6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Action: 'create', calling method: .version_select at 0x7f519edbba60>, body: {"keypair": {"name": "tempest-keypair-1799209101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBhLRQse+fFEiZsHw7+yODVWbHa/uLyBLgTmcJUgaO7b6tKqOlyIxQZqRzs+7GEBTnDTJrPZmVcmCO2oKKSSroiP9uM6QmNOSBFQNgIoHmOFhypiwFanTMZUlCzOKhkbw=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:55:26.261569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-00e89fa7-2637-487d-bb22-38af69f049d6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:55:26.282355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-00e89fa7-2637-487d-bb22-38af69f049d6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for user 1e4b3c7d38a540f19d88bf28c83cf9a6 and project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:55:26.360222 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-00e89fa7-2637-487d-bb22-38af69f049d6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140734 Aug 18 11:55:26.364000 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2843/5373] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:55:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:37.908593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-188065001", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43cde373-6762-4357-b5ca-4bc083d39b6f"}], "security_groups": [{"name": "tempest-securitygroup--859402203"}], "key_name": "tempest-keypair-1799209101", "user_data": "}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:55:37.935368 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=13 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:55:37.937224 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:55:38.459561 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] validate_networks() for [('43cde373-6762-4357-b5ca-4bc083d39b6f', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:55:39.217283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=5 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:55:39.219387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:55:39.220318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:55:39.225202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-61a8f516-4b99-4625-8f1a-8de375172159 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:39.225803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-61a8f516-4b99-4625-8f1a-8de375172159 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:39.245347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61a8f516-4b99-4625-8f1a-8de375172159 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:39.259240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61a8f516-4b99-4625-8f1a-8de375172159 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:39.259728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61a8f516-4b99-4625-8f1a-8de375172159 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:39.260570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61a8f516-4b99-4625-8f1a-8de375172159 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:39.261284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61a8f516-4b99-4625-8f1a-8de375172159 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:39.261871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61a8f516-4b99-4625-8f1a-8de375172159 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:39.418254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-61a8f516-4b99-4625-8f1a-8de375172159 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lazy-loading 'services' on Instance uuid bf26a4b8-1dc7-4eae-915f-96edb3669e6f {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:55:39.637592 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-61a8f516-4b99-4625-8f1a-8de375172159 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f/os-volume_attachments/73d6cbdf-9dff-4dab-a57f-e1900be3cd24" status: 202 len: 0 microversion: 2.1 time: 0.421925 Aug 18 11:55:39.638210 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2844/5374] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 11:55:39 2022] DELETE /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f/os-volume_attachments/73d6cbdf-9dff-4dab-a57f-e1900be3cd24 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:55:40.433885 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:55:40.434366 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:55:40.434829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:55:40.435240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:55:40.435655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:55:40.452574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:40.453069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:40.453510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:40.461151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:40.464271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:40.465476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:40.534104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:55:40.562941 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for user 1e4b3c7d38a540f19d88bf28c83cf9a6 and project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:55:40.593767 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:55:40.602520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:55:40.733530 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-de747659-fb02-404e-a929-58d1673d4245 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.832389 Aug 18 11:55:40.735142 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2531/5375] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:55:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 2835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 11:55:40.751556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0f7ac60-bb74-41b6-ab2a-8f2c3258c957 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:40.752270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a0f7ac60-bb74-41b6-ab2a-8f2c3258c957 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:41.001244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a0f7ac60-bb74-41b6-ab2a-8f2c3258c957 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:41.028669 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a0f7ac60-bb74-41b6-ab2a-8f2c3258c957 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1241 microversion: 2.1 time: 0.286069 Aug 18 11:55:41.040422 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2845/5376] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:40 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1241 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:42.052784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7f27ce7e-3db4-496f-934a-edc508fadd15 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:42.053516 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7f27ce7e-3db4-496f-934a-edc508fadd15 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:42.072927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f27ce7e-3db4-496f-934a-edc508fadd15 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:42.072927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f27ce7e-3db4-496f-934a-edc508fadd15 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:42.072927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f27ce7e-3db4-496f-934a-edc508fadd15 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:42.081487 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f27ce7e-3db4-496f-934a-edc508fadd15 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:42.082133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f27ce7e-3db4-496f-934a-edc508fadd15 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:42.082626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7f27ce7e-3db4-496f-934a-edc508fadd15 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:42.294459 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7f27ce7e-3db4-496f-934a-edc508fadd15 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:42.308874 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7f27ce7e-3db4-496f-934a-edc508fadd15 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1237 microversion: 2.1 time: 0.261400 Aug 18 11:55:42.309871 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2532/5377] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:42 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1237 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:43.333272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cf2bbe74-f139-48ab-9bc2-6c17771dda7c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:43.334975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cf2bbe74-f139-48ab-9bc2-6c17771dda7c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:43.352583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf2bbe74-f139-48ab-9bc2-6c17771dda7c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:43.353282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf2bbe74-f139-48ab-9bc2-6c17771dda7c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:43.353735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf2bbe74-f139-48ab-9bc2-6c17771dda7c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:43.354685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf2bbe74-f139-48ab-9bc2-6c17771dda7c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:43.355253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf2bbe74-f139-48ab-9bc2-6c17771dda7c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:43.355840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf2bbe74-f139-48ab-9bc2-6c17771dda7c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:43.523386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cf2bbe74-f139-48ab-9bc2-6c17771dda7c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:43.531128 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cf2bbe74-f139-48ab-9bc2-6c17771dda7c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1299 microversion: 2.1 time: 0.202596 Aug 18 11:55:43.548977 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2846/5378] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:43 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1299 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:44.555474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b1f9078f-4747-48c8-ae7e-0593839696b2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:44.557074 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b1f9078f-4747-48c8-ae7e-0593839696b2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:44.569311 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b1f9078f-4747-48c8-ae7e-0593839696b2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:44.572932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b1f9078f-4747-48c8-ae7e-0593839696b2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:44.573590 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b1f9078f-4747-48c8-ae7e-0593839696b2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:44.575288 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b1f9078f-4747-48c8-ae7e-0593839696b2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:44.578166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b1f9078f-4747-48c8-ae7e-0593839696b2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:44.578832 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b1f9078f-4747-48c8-ae7e-0593839696b2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:44.976532 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b1f9078f-4747-48c8-ae7e-0593839696b2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:44.988937 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b1f9078f-4747-48c8-ae7e-0593839696b2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1299 microversion: 2.1 time: 0.437171 Aug 18 11:55:44.989450 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2533/5379] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:44 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1299 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:46.010657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-81b34c48-2cba-403f-ba8e-05006185f32b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:46.011180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-81b34c48-2cba-403f-ba8e-05006185f32b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:46.025093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81b34c48-2cba-403f-ba8e-05006185f32b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:46.032605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81b34c48-2cba-403f-ba8e-05006185f32b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:46.033165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81b34c48-2cba-403f-ba8e-05006185f32b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:46.035646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81b34c48-2cba-403f-ba8e-05006185f32b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:46.036141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81b34c48-2cba-403f-ba8e-05006185f32b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:46.036591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81b34c48-2cba-403f-ba8e-05006185f32b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:46.451886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-81b34c48-2cba-403f-ba8e-05006185f32b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:46.472475 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-81b34c48-2cba-403f-ba8e-05006185f32b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1366 microversion: 2.1 time: 0.465659 Aug 18 11:55:46.490687 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2847/5380] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:46 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1366 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:47.507427 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-98ab8046-6d4e-44e2-847b-ed6a77431e0f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:47.508304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-98ab8046-6d4e-44e2-847b-ed6a77431e0f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:47.527575 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98ab8046-6d4e-44e2-847b-ed6a77431e0f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:47.532146 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98ab8046-6d4e-44e2-847b-ed6a77431e0f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:47.532790 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98ab8046-6d4e-44e2-847b-ed6a77431e0f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:47.533572 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98ab8046-6d4e-44e2-847b-ed6a77431e0f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:47.535621 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98ab8046-6d4e-44e2-847b-ed6a77431e0f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:47.536301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-98ab8046-6d4e-44e2-847b-ed6a77431e0f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:48.252133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-98ab8046-6d4e-44e2-847b-ed6a77431e0f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:48.280293 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-98ab8046-6d4e-44e2-847b-ed6a77431e0f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1366 microversion: 2.1 time: 0.779154 Aug 18 11:55:48.280902 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2534/5381] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:47 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1366 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:48.891213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-83982cb4-271a-47b8-bc49-ff4b4a6ebbc3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:48.892316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-83982cb4-271a-47b8-bc49-ff4b4a6ebbc3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:48.906452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83982cb4-271a-47b8-bc49-ff4b4a6ebbc3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:48.907267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83982cb4-271a-47b8-bc49-ff4b4a6ebbc3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:48.908035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83982cb4-271a-47b8-bc49-ff4b4a6ebbc3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:48.910367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83982cb4-271a-47b8-bc49-ff4b4a6ebbc3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:48.911057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83982cb4-271a-47b8-bc49-ff4b4a6ebbc3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:48.912815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83982cb4-271a-47b8-bc49-ff4b4a6ebbc3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:48.973800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-83982cb4-271a-47b8-bc49-ff4b4a6ebbc3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:55:49.084701 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-83982cb4-271a-47b8-bc49-ff4b4a6ebbc3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "DELETE /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 204 len: 0 microversion: 2.1 time: 0.198274 Aug 18 11:55:49.087041 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2848/5382] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:55:48 2022] DELETE /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:55:49.096255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2c3b83a8-b4e2-423a-8fe4-fb84360f888b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:49.097970 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2c3b83a8-b4e2-423a-8fe4-fb84360f888b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:49.107443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c3b83a8-b4e2-423a-8fe4-fb84360f888b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:49.110047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c3b83a8-b4e2-423a-8fe4-fb84360f888b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:49.110760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c3b83a8-b4e2-423a-8fe4-fb84360f888b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:49.111708 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c3b83a8-b4e2-423a-8fe4-fb84360f888b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:49.112583 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c3b83a8-b4e2-423a-8fe4-fb84360f888b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:49.113317 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2c3b83a8-b4e2-423a-8fe4-fb84360f888b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:49.304263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1ffe1618-388f-40ef-b339-747b7f5f89be tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:49.305379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1ffe1618-388f-40ef-b339-747b7f5f89be tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:49.312668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ffe1618-388f-40ef-b339-747b7f5f89be tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:49.313527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ffe1618-388f-40ef-b339-747b7f5f89be tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:49.314247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ffe1618-388f-40ef-b339-747b7f5f89be tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:49.315223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ffe1618-388f-40ef-b339-747b7f5f89be tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:49.315908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ffe1618-388f-40ef-b339-747b7f5f89be tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:49.316571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ffe1618-388f-40ef-b339-747b7f5f89be tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:49.595761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1ffe1618-388f-40ef-b339-747b7f5f89be tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:49.608752 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1ffe1618-388f-40ef-b339-747b7f5f89be tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1366 microversion: 2.1 time: 0.308707 Aug 18 11:55:49.610466 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2849/5383] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:49 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:50.041725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2c3b83a8-b4e2-423a-8fe4-fb84360f888b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:50.054088 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2c3b83a8-b4e2-423a-8fe4-fb84360f888b tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1469 microversion: 2.1 time: 0.961056 Aug 18 11:55:50.055535 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2535/5384] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:49 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1469 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:55:50.430719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-24cfcedd-2f53-4f0a-ad34-71e469e2a9ea req-ef333cfc-ebcf-4a25-8e3d-32b9fc586d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee32c00-b94f-4934-8b57-31d670dd8ea2", "tag": "ca7571bf-b53b-486d-872d-87c9ec2f17a3"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:55:50.491476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-24cfcedd-2f53-4f0a-ad34-71e469e2a9ea req-ef333cfc-ebcf-4a25-8e3d-32b9fc586d89 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:50.492973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-24cfcedd-2f53-4f0a-ad34-71e469e2a9ea req-ef333cfc-ebcf-4a25-8e3d-32b9fc586d89 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:50.494391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-24cfcedd-2f53-4f0a-ad34-71e469e2a9ea req-ef333cfc-ebcf-4a25-8e3d-32b9fc586d89 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:50.517177 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-24cfcedd-2f53-4f0a-ad34-71e469e2a9ea req-ef333cfc-ebcf-4a25-8e3d-32b9fc586d89 service nova] Creating event network-changed:ca7571bf-b53b-486d-872d-87c9ec2f17a3 for instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 on n-h2-853611-3 Aug 18 11:55:50.549523 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-24cfcedd-2f53-4f0a-ad34-71e469e2a9ea req-ef333cfc-ebcf-4a25-8e3d-32b9fc586d89 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112016 Aug 18 11:55:50.550478 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2850/5385] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:50.633255 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-650019ee-10c5-459f-92b0-85e54b86bdb2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:50.633889 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-650019ee-10c5-459f-92b0-85e54b86bdb2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:50.644724 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:55:50.648859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:55:50.652662 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-650019ee-10c5-459f-92b0-85e54b86bdb2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:50.653176 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-650019ee-10c5-459f-92b0-85e54b86bdb2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:50.653628 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-650019ee-10c5-459f-92b0-85e54b86bdb2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:50.655164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-650019ee-10c5-459f-92b0-85e54b86bdb2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:50.655440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-650019ee-10c5-459f-92b0-85e54b86bdb2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:50.655882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-650019ee-10c5-459f-92b0-85e54b86bdb2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:51.077448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a34b56b3-5262-4f5d-a534-e1bbf5f397a3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:51.078680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a34b56b3-5262-4f5d-a534-e1bbf5f397a3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:51.085302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:55:51.088633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34b56b3-5262-4f5d-a534-e1bbf5f397a3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:51.089716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34b56b3-5262-4f5d-a534-e1bbf5f397a3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:51.090397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34b56b3-5262-4f5d-a534-e1bbf5f397a3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:51.091401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34b56b3-5262-4f5d-a534-e1bbf5f397a3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:51.093361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34b56b3-5262-4f5d-a534-e1bbf5f397a3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:51.094056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34b56b3-5262-4f5d-a534-e1bbf5f397a3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:51.269588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-650019ee-10c5-459f-92b0-85e54b86bdb2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:51.279872 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-650019ee-10c5-459f-92b0-85e54b86bdb2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1366 microversion: 2.1 time: 0.653301 Aug 18 11:55:51.281611 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2536/5386] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:50 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1366 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:51.392598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a34b56b3-5262-4f5d-a534-e1bbf5f397a3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:51.401044 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a34b56b3-5262-4f5d-a534-e1bbf5f397a3 tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1469 microversion: 2.1 time: 0.329091 Aug 18 11:55:51.402198 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2851/5387] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:51 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1469 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:55:52.302477 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8dceaf53-d0a4-46d6-89ec-0b93dca54cdc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:52.303106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8dceaf53-d0a4-46d6-89ec-0b93dca54cdc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:52.320945 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8dceaf53-d0a4-46d6-89ec-0b93dca54cdc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:52.321380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8dceaf53-d0a4-46d6-89ec-0b93dca54cdc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:52.321829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8dceaf53-d0a4-46d6-89ec-0b93dca54cdc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:52.322965 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8dceaf53-d0a4-46d6-89ec-0b93dca54cdc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:52.323592 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8dceaf53-d0a4-46d6-89ec-0b93dca54cdc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:52.324030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8dceaf53-d0a4-46d6-89ec-0b93dca54cdc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:52.426384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e08e99c-019a-43cf-b44d-c10e1f61334c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:52.429633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1e08e99c-019a-43cf-b44d-c10e1f61334c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:52.436959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e08e99c-019a-43cf-b44d-c10e1f61334c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:52.437460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e08e99c-019a-43cf-b44d-c10e1f61334c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:52.437907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e08e99c-019a-43cf-b44d-c10e1f61334c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:52.438659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e08e99c-019a-43cf-b44d-c10e1f61334c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:52.445680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e08e99c-019a-43cf-b44d-c10e1f61334c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:52.446512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e08e99c-019a-43cf-b44d-c10e1f61334c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:52.516055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e08e99c-019a-43cf-b44d-c10e1f61334c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:52.516896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e08e99c-019a-43cf-b44d-c10e1f61334c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:52.517555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e08e99c-019a-43cf-b44d-c10e1f61334c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:52.526943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-1e08e99c-019a-43cf-b44d-c10e1f61334c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lazy-loading 'fault' on Instance uuid bf26a4b8-1dc7-4eae-915f-96edb3669e6f {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:55:52.678506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1e08e99c-019a-43cf-b44d-c10e1f61334c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00a0023446c4422ab3b9db8cb680d556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e557ebc2a18c42578cb3377efdb54edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:52.710843 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1e08e99c-019a-43cf-b44d-c10e1f61334c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 200 len: 1303 microversion: 2.1 time: 0.288159 Aug 18 11:55:52.716291 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2852/5388] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:52 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 1303 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:52.743071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f9eb81a9-e403-4c61-8ade-ca3fdec9157f req-33cd4704-20b4-47e2-92c7-553de641e859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf26a4b8-1dc7-4eae-915f-96edb3669e6f", "name": "network-vif-deleted", "tag": "6421071f-4269-40e0-b3c6-3e988d872dea"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:55:52.762514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f9eb81a9-e403-4c61-8ade-ca3fdec9157f req-33cd4704-20b4-47e2-92c7-553de641e859 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:52.763016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f9eb81a9-e403-4c61-8ade-ca3fdec9157f req-33cd4704-20b4-47e2-92c7-553de641e859 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:52.763496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f9eb81a9-e403-4c61-8ade-ca3fdec9157f req-33cd4704-20b4-47e2-92c7-553de641e859 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:52.791225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8dceaf53-d0a4-46d6-89ec-0b93dca54cdc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:52.799796 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8dceaf53-d0a4-46d6-89ec-0b93dca54cdc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1366 microversion: 2.1 time: 0.501129 Aug 18 11:55:52.803746 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2537/5389] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:52 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1366 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:52.833869 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f9eb81a9-e403-4c61-8ade-ca3fdec9157f req-33cd4704-20b4-47e2-92c7-553de641e859 service nova] Creating event network-vif-deleted:6421071f-4269-40e0-b3c6-3e988d872dea for instance bf26a4b8-1dc7-4eae-915f-96edb3669e6f on n-h1-853611-3 Aug 18 11:55:52.844344 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f9eb81a9-e403-4c61-8ade-ca3fdec9157f req-33cd4704-20b4-47e2-92c7-553de641e859 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125244 Aug 18 11:55:52.851975 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2853/5390] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:55:53.743913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-391ec42f-f985-481a-b15f-1d978e18402c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:53.745180 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-391ec42f-f985-481a-b15f-1d978e18402c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] [instance: bf26a4b8-1dc7-4eae-915f-96edb3669e6f] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:53.763111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391ec42f-f985-481a-b15f-1d978e18402c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:53.763996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391ec42f-f985-481a-b15f-1d978e18402c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:53.764608 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391ec42f-f985-481a-b15f-1d978e18402c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:53.765483 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391ec42f-f985-481a-b15f-1d978e18402c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:53.781715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391ec42f-f985-481a-b15f-1d978e18402c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:53.782177 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-391ec42f-f985-481a-b15f-1d978e18402c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:53.812997 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-391ec42f-f985-481a-b15f-1d978e18402c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] HTTP exception thrown: Instance bf26a4b8-1dc7-4eae-915f-96edb3669e6f could not be found. Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-391ec42f-f985-481a-b15f-1d978e18402c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Request method failure captured: Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f HTTP/1.1 Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_igm727f4x3i0Z6Zl3hU4IdpG8yaW0Gil5U5vL5p8Mm0RIhfjGHMmd4Z9y7NTaCeysZUqvP0H3AJ6DeHCrlUTj9m9dtdtTOqpNzdJq-hGUeepZ8vrzLtx117xNJHI8KsVo3D3R73odtkWyRhDtUnCcWK3w-eAC7-axMLsFFlzyPlTQQ Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: e557ebc2a18c42578cb3377efdb54edf Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-VolumesBackupsTest-542239376 Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/e557ebc2a18c42578cb3377efdb54edf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/e557ebc2a18c42578cb3377efdb54edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_e557ebc2a18c42578cb3377efdb54edf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/e557ebc2a18c42578cb3377efdb54edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-VolumesBackupsTest-542239376 Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: e557ebc2a18c42578cb3377efdb54edf Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-VolumesBackupsTest-542239376 Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-VolumesBackupsTest-542239376-project Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 00a0023446c4422ab3b9db8cb680d556 Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-VolumesBackupsTest-542239376-project Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance bf26a4b8-1dc7-4eae-915f-96edb3669e6f could not be found. Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': 'bf26a4b8-1dc7-4eae-915f-96edb3669e6f'} Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf26a4b8-1dc7-4eae-915f-96edb3669e6f could not be found. Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf26a4b8-1dc7-4eae-915f-96edb3669e6f could not be found. Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:55:53.817544 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:55:53.821742 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:55:53.821742 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:55:53.821742 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:55:53.821742 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:55:53.821742 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:55:53.821742 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf26a4b8-1dc7-4eae-915f-96edb3669e6f could not be found. Aug 18 11:55:53.821742 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:55:53.822938 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-391ec42f-f985-481a-b15f-1d978e18402c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] Returning 404 to user: Instance bf26a4b8-1dc7-4eae-915f-96edb3669e6f could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:55:53.823966 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-391ec42f-f985-481a-b15f-1d978e18402c tempest-VolumesBackupsTest-542239376 tempest-VolumesBackupsTest-542239376-project] 10.222.0.73 "GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f" status: 404 len: 111 microversion: 2.1 time: 0.088110 Aug 18 11:55:53.838789 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2538/5391] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:53 2022] GET /compute/v2.1/servers/bf26a4b8-1dc7-4eae-915f-96edb3669e6f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:55:53.943420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-797ee1f1-3b92-4ff9-bb28-80ceee5de253 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:53.945306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-797ee1f1-3b92-4ff9-bb28-80ceee5de253 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:53.960265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-797ee1f1-3b92-4ff9-bb28-80ceee5de253 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:53.961059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-797ee1f1-3b92-4ff9-bb28-80ceee5de253 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:53.961683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-797ee1f1-3b92-4ff9-bb28-80ceee5de253 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:53.963389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-797ee1f1-3b92-4ff9-bb28-80ceee5de253 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:53.964176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-797ee1f1-3b92-4ff9-bb28-80ceee5de253 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:53.964762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-797ee1f1-3b92-4ff9-bb28-80ceee5de253 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:56.240468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-797ee1f1-3b92-4ff9-bb28-80ceee5de253 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:56.262734 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-797ee1f1-3b92-4ff9-bb28-80ceee5de253 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1366 microversion: 2.1 time: 2.329928 Aug 18 11:55:56.266414 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2854/5392] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:53 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1366 bytes in 2335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:57.290784 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aadec12a-47f1-4050-9e0b-1b17d0c6c80a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:57.295329 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-aadec12a-47f1-4050-9e0b-1b17d0c6c80a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:57.334264 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aadec12a-47f1-4050-9e0b-1b17d0c6c80a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:57.355624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aadec12a-47f1-4050-9e0b-1b17d0c6c80a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:57.356046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aadec12a-47f1-4050-9e0b-1b17d0c6c80a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:57.369634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aadec12a-47f1-4050-9e0b-1b17d0c6c80a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:57.370664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aadec12a-47f1-4050-9e0b-1b17d0c6c80a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:57.371612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aadec12a-47f1-4050-9e0b-1b17d0c6c80a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:57.831024 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-aadec12a-47f1-4050-9e0b-1b17d0c6c80a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:57.845853 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aadec12a-47f1-4050-9e0b-1b17d0c6c80a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1366 microversion: 2.1 time: 0.562540 Aug 18 11:55:57.847267 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2539/5393] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:57 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1366 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:55:58.885267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0170d746-175a-4bb7-a977-701ff12b38ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:55:58.886603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0170d746-175a-4bb7-a977-701ff12b38ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:55:58.895947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0170d746-175a-4bb7-a977-701ff12b38ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:58.896786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0170d746-175a-4bb7-a977-701ff12b38ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:58.897459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0170d746-175a-4bb7-a977-701ff12b38ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:58.898598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0170d746-175a-4bb7-a977-701ff12b38ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:55:58.902142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0170d746-175a-4bb7-a977-701ff12b38ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:55:58.903035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0170d746-175a-4bb7-a977-701ff12b38ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:55:59.618339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0170d746-175a-4bb7-a977-701ff12b38ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:55:59.629273 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0170d746-175a-4bb7-a977-701ff12b38ad tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1366 microversion: 2.1 time: 0.748148 Aug 18 11:55:59.642298 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2855/5394] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:55:58 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1366 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:56:00.049646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-60057096-5e01-45cf-b33d-df8bb786b77c req-25d64eb1-056f-43ea-8e88-14c37322c049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee32c00-b94f-4934-8b57-31d670dd8ea2", "name": "network-vif-plugged", "status": "completed", "tag": "ca7571bf-b53b-486d-872d-87c9ec2f17a3"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:56:00.071023 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-60057096-5e01-45cf-b33d-df8bb786b77c req-25d64eb1-056f-43ea-8e88-14c37322c049 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:56:00.071657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-60057096-5e01-45cf-b33d-df8bb786b77c req-25d64eb1-056f-43ea-8e88-14c37322c049 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:56:00.072199 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-60057096-5e01-45cf-b33d-df8bb786b77c req-25d64eb1-056f-43ea-8e88-14c37322c049 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:56:00.099227 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-60057096-5e01-45cf-b33d-df8bb786b77c req-25d64eb1-056f-43ea-8e88-14c37322c049 service nova] Creating event network-vif-plugged:ca7571bf-b53b-486d-872d-87c9ec2f17a3 for instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 on n-h2-853611-3 Aug 18 11:56:00.109879 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-60057096-5e01-45cf-b33d-df8bb786b77c req-25d64eb1-056f-43ea-8e88-14c37322c049 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063783 Aug 18 11:56:00.113428 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2540/5395] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:56:00.663444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9715be7e-9b61-4fef-ba6f-9e939462a6cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:56:00.664306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9715be7e-9b61-4fef-ba6f-9e939462a6cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:56:00.677676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9715be7e-9b61-4fef-ba6f-9e939462a6cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:56:00.678173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9715be7e-9b61-4fef-ba6f-9e939462a6cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:56:00.678839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9715be7e-9b61-4fef-ba6f-9e939462a6cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:56:00.679555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9715be7e-9b61-4fef-ba6f-9e939462a6cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:56:00.686873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9715be7e-9b61-4fef-ba6f-9e939462a6cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:56:00.697585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9715be7e-9b61-4fef-ba6f-9e939462a6cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:56:01.806025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9715be7e-9b61-4fef-ba6f-9e939462a6cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:56:01.815958 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9715be7e-9b61-4fef-ba6f-9e939462a6cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1366 microversion: 2.1 time: 1.157959 Aug 18 11:56:01.819888 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2856/5396] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:56:00 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1366 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:56:02.844172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c4bfaba7-eb55-4147-9f24-eade0f513bb6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:56:02.844898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c4bfaba7-eb55-4147-9f24-eade0f513bb6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:56:02.868661 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4bfaba7-eb55-4147-9f24-eade0f513bb6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:56:02.869254 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4bfaba7-eb55-4147-9f24-eade0f513bb6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:56:02.869721 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4bfaba7-eb55-4147-9f24-eade0f513bb6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:56:02.871064 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4bfaba7-eb55-4147-9f24-eade0f513bb6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:56:02.873647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4bfaba7-eb55-4147-9f24-eade0f513bb6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:56:02.875149 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c4bfaba7-eb55-4147-9f24-eade0f513bb6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:56:03.353900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c4bfaba7-eb55-4147-9f24-eade0f513bb6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:56:03.370589 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c4bfaba7-eb55-4147-9f24-eade0f513bb6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1555 microversion: 2.1 time: 0.528329 Aug 18 11:56:03.376096 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2541/5397] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:56:02 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1555 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:56:03.409001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1bd42b1c-d870-4d59-aa3f-45a7d6caad13 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:56:03.409516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1bd42b1c-d870-4d59-aa3f-45a7d6caad13 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:56:03.432334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bd42b1c-d870-4d59-aa3f-45a7d6caad13 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:56:03.433634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bd42b1c-d870-4d59-aa3f-45a7d6caad13 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:56:03.436371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bd42b1c-d870-4d59-aa3f-45a7d6caad13 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:56:03.438288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bd42b1c-d870-4d59-aa3f-45a7d6caad13 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:56:03.439947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bd42b1c-d870-4d59-aa3f-45a7d6caad13 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:56:03.441644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bd42b1c-d870-4d59-aa3f-45a7d6caad13 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:56:04.176657 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1bd42b1c-d870-4d59-aa3f-45a7d6caad13 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.775811 Aug 18 11:56:04.186807 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2857/5398] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:56:03 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-interface => generated 284 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:56:07.796328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-f993f3a1-41b7-4b9e-89d1-03da22ce38c5 req-9dec805c-3161-4619-b98f-d0eaa664aef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee32c00-b94f-4934-8b57-31d670dd8ea2", "tag": "ca7571bf-b53b-486d-872d-87c9ec2f17a3"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:56:07.855756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f993f3a1-41b7-4b9e-89d1-03da22ce38c5 req-9dec805c-3161-4619-b98f-d0eaa664aef4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:56:07.858385 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f993f3a1-41b7-4b9e-89d1-03da22ce38c5 req-9dec805c-3161-4619-b98f-d0eaa664aef4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:56:07.861121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-f993f3a1-41b7-4b9e-89d1-03da22ce38c5 req-9dec805c-3161-4619-b98f-d0eaa664aef4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:56:07.891333 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-f993f3a1-41b7-4b9e-89d1-03da22ce38c5 req-9dec805c-3161-4619-b98f-d0eaa664aef4 service nova] Creating event network-changed:ca7571bf-b53b-486d-872d-87c9ec2f17a3 for instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 on n-h2-853611-3 Aug 18 11:56:07.909181 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-f993f3a1-41b7-4b9e-89d1-03da22ce38c5 req-9dec805c-3161-4619-b98f-d0eaa664aef4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.423314 Aug 18 11:56:07.909830 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2542/5399] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:56:36.690883 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:56:36.691468 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 11:56:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:56:39.383405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-18243fad-b565-44a2-980d-455985406e7b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:56:39.385118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-18243fad-b565-44a2-980d-455985406e7b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:56:39.467471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:56:39.473242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:56:39.480709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18243fad-b565-44a2-980d-455985406e7b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:56:39.481231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18243fad-b565-44a2-980d-455985406e7b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:56:39.484537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18243fad-b565-44a2-980d-455985406e7b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:56:39.485307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18243fad-b565-44a2-980d-455985406e7b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:56:39.485772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18243fad-b565-44a2-980d-455985406e7b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:56:39.486211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18243fad-b565-44a2-980d-455985406e7b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:56:39.559414 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-18243fad-b565-44a2-980d-455985406e7b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/ips" status: 200 len: 148 microversion: 2.1 time: 0.192470 Aug 18 11:56:39.564409 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2858/5400] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:56:39 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/ips => generated 148 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:56:43.613765 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bf37ddd2-6e10-45e1-bb4d-beeddac0d6c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b063843-f6f1-4232-9265-27a26d0cfccd"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:56:43.624980 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bf37ddd2-6e10-45e1-bb4d-beeddac0d6c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:56:43.661325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:56:43.662134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=56 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:56:43.668392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf37ddd2-6e10-45e1-bb4d-beeddac0d6c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:56:43.673054 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf37ddd2-6e10-45e1-bb4d-beeddac0d6c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:56:43.673589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf37ddd2-6e10-45e1-bb4d-beeddac0d6c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:56:43.674358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf37ddd2-6e10-45e1-bb4d-beeddac0d6c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:56:43.677344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf37ddd2-6e10-45e1-bb4d-beeddac0d6c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:56:43.677981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf37ddd2-6e10-45e1-bb4d-beeddac0d6c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:56:44.286073 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bf37ddd2-6e10-45e1-bb4d-beeddac0d6c7 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "POST /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.684456 Aug 18 11:56:44.294946 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2543/5401] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:56:43 2022] POST /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments => generated 194 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:57:04.756638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-21d0eadb-f261-4c4d-85c8-35b011b54d4b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b063843-f6f1-4232-9265-27a26d0cfccd"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:57:04.759177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-21d0eadb-f261-4c4d-85c8-35b011b54d4b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:04.769806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:57:04.786456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21d0eadb-f261-4c4d-85c8-35b011b54d4b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:04.787500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21d0eadb-f261-4c4d-85c8-35b011b54d4b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:04.788107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21d0eadb-f261-4c4d-85c8-35b011b54d4b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:04.788989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21d0eadb-f261-4c4d-85c8-35b011b54d4b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:04.791593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21d0eadb-f261-4c4d-85c8-35b011b54d4b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:04.792275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-21d0eadb-f261-4c4d-85c8-35b011b54d4b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:05.028801 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-21d0eadb-f261-4c4d-85c8-35b011b54d4b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] HTTP exception thrown: Invalid volume: volume 1b063843-f6f1-4232-9265-27a26d0cfccd is already attached to instances: 2ee32c00-b94f-4934-8b57-31d670dd8ea2 Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-21d0eadb-f261-4c4d-85c8-35b011b54d4b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Request method failure captured: Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments HTTP/1.1 Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 74 Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_if1x16WBMpc3s4OH8sjm3tHJjaZqQcRpU1oiMS-p1WI1YrRSC2t7-vlFi9T8Z71n1HUxo4fP6nRLR16BbxlLWyXqp2clERspIcMb_jAedcCu_hp9tsk0cAtcafVC7hlv2fQVmuiFfoXUzkmUNLY6LwwQl_4XOvH_miTFCjGf1SoX08 Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 1e4b3c7d38a540f19d88bf28c83cf9a6 Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: {"volumeAttachment": {"volumeId": "1b063843-f6f1-4232-9265-27a26d0cfccd"}} Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid volume: volume 1b063843-f6f1-4232-9265-27a26d0cfccd is already attached to instances: 2ee32c00-b94f-4934-8b57-31d670dd8ea2 Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': '2ee32c00-b94f-4934-8b57-31d670dd8ea2', 'body': {'volumeAttachment': {'volumeId': '1b063843-f6f1-4232-9265-27a26d0cfccd'}}} Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1b063843-f6f1-4232-9265-27a26d0cfccd is already attached to instances: 2ee32c00-b94f-4934-8b57-31d670dd8ea2 Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:57:05.042880 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1b063843-f6f1-4232-9265-27a26d0cfccd is already attached to instances: 2ee32c00-b94f-4934-8b57-31d670dd8ea2 Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1b063843-f6f1-4232-9265-27a26d0cfccd is already attached to instances: 2ee32c00-b94f-4934-8b57-31d670dd8ea2 Aug 18 11:57:05.048035 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 11:57:05.053673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-21d0eadb-f261-4c4d-85c8-35b011b54d4b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Returning 400 to user: Invalid volume: volume 1b063843-f6f1-4232-9265-27a26d0cfccd is already attached to instances: 2ee32c00-b94f-4934-8b57-31d670dd8ea2 {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:57:05.054772 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-21d0eadb-f261-4c4d-85c8-35b011b54d4b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "POST /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.304093 Aug 18 11:57:05.055354 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2859/5402] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:57:04 2022] POST /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments => generated 174 bytes in 305 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 11:57:05.248584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:57:05.250016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:57:05.255308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b9836e75-c027-489e-b186-0006503b91b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:05.255900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b9836e75-c027-489e-b186-0006503b91b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:05.283853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9836e75-c027-489e-b186-0006503b91b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:05.289760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9836e75-c027-489e-b186-0006503b91b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:05.293390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9836e75-c027-489e-b186-0006503b91b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:05.294528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9836e75-c027-489e-b186-0006503b91b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:05.299712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9836e75-c027-489e-b186-0006503b91b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:05.301835 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b9836e75-c027-489e-b186-0006503b91b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:05.575249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-b9836e75-c027-489e-b186-0006503b91b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lazy-loading 'services' on Instance uuid 2ee32c00-b94f-4934-8b57-31d670dd8ea2 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:57:05.755594 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b9836e75-c027-489e-b186-0006503b91b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments/1b063843-f6f1-4232-9265-27a26d0cfccd" status: 202 len: 0 microversion: 2.1 time: 0.509118 Aug 18 11:57:05.756348 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2544/5403] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 11:57:05 2022] DELETE /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments/1b063843-f6f1-4232-9265-27a26d0cfccd => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:57:05.766418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-543e52bd-217d-44a8-8390-80ade8de89fa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:05.769445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-543e52bd-217d-44a8-8390-80ade8de89fa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:05.797165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-543e52bd-217d-44a8-8390-80ade8de89fa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:05.808139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-543e52bd-217d-44a8-8390-80ade8de89fa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:05.810846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-543e52bd-217d-44a8-8390-80ade8de89fa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:05.812338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-543e52bd-217d-44a8-8390-80ade8de89fa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:05.815102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-543e52bd-217d-44a8-8390-80ade8de89fa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:05.817160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-543e52bd-217d-44a8-8390-80ade8de89fa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:05.925071 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-543e52bd-217d-44a8-8390-80ade8de89fa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161977 Aug 18 11:57:05.925722 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2860/5404] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:57:05 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:57:06.939349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2ef6b380-5497-4c35-abdd-d67567489a1c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:06.950340 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2ef6b380-5497-4c35-abdd-d67567489a1c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:06.969478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ef6b380-5497-4c35-abdd-d67567489a1c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:06.977682 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ef6b380-5497-4c35-abdd-d67567489a1c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:06.978563 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ef6b380-5497-4c35-abdd-d67567489a1c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:06.979751 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ef6b380-5497-4c35-abdd-d67567489a1c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:06.980513 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ef6b380-5497-4c35-abdd-d67567489a1c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:06.981153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ef6b380-5497-4c35-abdd-d67567489a1c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:07.045824 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2ef6b380-5497-4c35-abdd-d67567489a1c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111902 Aug 18 11:57:07.047126 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2545/5405] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:57:06 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:57:08.058979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-795cdc6b-38c8-48b6-8d1f-04f19df007e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:08.061211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-795cdc6b-38c8-48b6-8d1f-04f19df007e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:08.075742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-795cdc6b-38c8-48b6-8d1f-04f19df007e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:08.076244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-795cdc6b-38c8-48b6-8d1f-04f19df007e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:08.076687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-795cdc6b-38c8-48b6-8d1f-04f19df007e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:08.077410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-795cdc6b-38c8-48b6-8d1f-04f19df007e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:08.077869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-795cdc6b-38c8-48b6-8d1f-04f19df007e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:08.078303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-795cdc6b-38c8-48b6-8d1f-04f19df007e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:08.171700 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-795cdc6b-38c8-48b6-8d1f-04f19df007e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116633 Aug 18 11:57:08.172617 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2861/5406] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:57:08 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:57:09.185328 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-88ce3a05-85aa-439a-a548-b08e26e542e2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:09.188304 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-88ce3a05-85aa-439a-a548-b08e26e542e2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:09.207598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88ce3a05-85aa-439a-a548-b08e26e542e2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:09.211155 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88ce3a05-85aa-439a-a548-b08e26e542e2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:09.211883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88ce3a05-85aa-439a-a548-b08e26e542e2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:09.213874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88ce3a05-85aa-439a-a548-b08e26e542e2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:09.215853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88ce3a05-85aa-439a-a548-b08e26e542e2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:09.216527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-88ce3a05-85aa-439a-a548-b08e26e542e2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:09.316298 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-88ce3a05-85aa-439a-a548-b08e26e542e2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136238 Aug 18 11:57:09.317269 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2546/5407] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:57:09 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:57:10.330405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8c40ec9e-b4a9-4524-a31d-c7e9f22486e6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:10.333254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8c40ec9e-b4a9-4524-a31d-c7e9f22486e6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:10.351085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c40ec9e-b4a9-4524-a31d-c7e9f22486e6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:10.351831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c40ec9e-b4a9-4524-a31d-c7e9f22486e6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:10.355024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c40ec9e-b4a9-4524-a31d-c7e9f22486e6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:10.355974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c40ec9e-b4a9-4524-a31d-c7e9f22486e6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:10.356602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c40ec9e-b4a9-4524-a31d-c7e9f22486e6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:10.357189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c40ec9e-b4a9-4524-a31d-c7e9f22486e6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:10.435685 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8c40ec9e-b4a9-4524-a31d-c7e9f22486e6 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110134 Aug 18 11:57:10.447652 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2862/5408] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:57:10 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:57:11.460490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-934bc554-6f9e-4aad-abbb-d4dc40b57069 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:11.463788 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-934bc554-6f9e-4aad-abbb-d4dc40b57069 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:11.489301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-934bc554-6f9e-4aad-abbb-d4dc40b57069 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:11.491410 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-934bc554-6f9e-4aad-abbb-d4dc40b57069 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:11.492065 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-934bc554-6f9e-4aad-abbb-d4dc40b57069 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:11.497696 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-934bc554-6f9e-4aad-abbb-d4dc40b57069 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:11.498358 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-934bc554-6f9e-4aad-abbb-d4dc40b57069 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:11.498981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-934bc554-6f9e-4aad-abbb-d4dc40b57069 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:11.577571 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-934bc554-6f9e-4aad-abbb-d4dc40b57069 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121987 Aug 18 11:57:11.580749 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2547/5409] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:57:11 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:57:12.593639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-90876f6a-53fc-49bd-b21e-c37f62246f69 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:12.596369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-90876f6a-53fc-49bd-b21e-c37f62246f69 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:12.613689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90876f6a-53fc-49bd-b21e-c37f62246f69 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:12.614469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90876f6a-53fc-49bd-b21e-c37f62246f69 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:12.617898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90876f6a-53fc-49bd-b21e-c37f62246f69 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:12.620759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90876f6a-53fc-49bd-b21e-c37f62246f69 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:12.623124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90876f6a-53fc-49bd-b21e-c37f62246f69 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:12.623769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90876f6a-53fc-49bd-b21e-c37f62246f69 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:12.715967 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-90876f6a-53fc-49bd-b21e-c37f62246f69 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126940 Aug 18 11:57:12.717117 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2863/5410] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:57:12 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:57:13.733566 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-329e55df-1a93-49b9-8f73-8e17ce92d96a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:13.736360 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-329e55df-1a93-49b9-8f73-8e17ce92d96a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:13.760111 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-329e55df-1a93-49b9-8f73-8e17ce92d96a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:13.760984 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-329e55df-1a93-49b9-8f73-8e17ce92d96a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:13.761151 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-329e55df-1a93-49b9-8f73-8e17ce92d96a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:13.763452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-329e55df-1a93-49b9-8f73-8e17ce92d96a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:13.763927 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-329e55df-1a93-49b9-8f73-8e17ce92d96a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:13.764370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-329e55df-1a93-49b9-8f73-8e17ce92d96a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:13.877624 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-329e55df-1a93-49b9-8f73-8e17ce92d96a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147150 Aug 18 11:57:13.880083 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2548/5411] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:57:13 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:57:14.893281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ddacf3f6-f26b-49af-9fcc-26f38d4be54a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:14.895580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ddacf3f6-f26b-49af-9fcc-26f38d4be54a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:14.912590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddacf3f6-f26b-49af-9fcc-26f38d4be54a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:14.913090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddacf3f6-f26b-49af-9fcc-26f38d4be54a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:14.913535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddacf3f6-f26b-49af-9fcc-26f38d4be54a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:14.914260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddacf3f6-f26b-49af-9fcc-26f38d4be54a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:14.914756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddacf3f6-f26b-49af-9fcc-26f38d4be54a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:14.915189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddacf3f6-f26b-49af-9fcc-26f38d4be54a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:15.032737 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ddacf3f6-f26b-49af-9fcc-26f38d4be54a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143822 Aug 18 11:57:15.034786 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2864/5412] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:57:14 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:57:16.047370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-475b2de6-814b-466b-858c-97be6dafb9a0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:16.050496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-475b2de6-814b-466b-858c-97be6dafb9a0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:16.083643 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-475b2de6-814b-466b-858c-97be6dafb9a0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:16.084161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-475b2de6-814b-466b-858c-97be6dafb9a0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:16.084615 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-475b2de6-814b-466b-858c-97be6dafb9a0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:16.085363 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-475b2de6-814b-466b-858c-97be6dafb9a0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:16.085840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-475b2de6-814b-466b-858c-97be6dafb9a0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:16.086277 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-475b2de6-814b-466b-858c-97be6dafb9a0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:16.201085 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-475b2de6-814b-466b-858c-97be6dafb9a0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157750 Aug 18 11:57:16.201990 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2549/5413] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:57:16 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:57:17.218187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-809a6a87-7745-4198-bb49-7603eee66e81 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:17.221442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-809a6a87-7745-4198-bb49-7603eee66e81 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:17.241143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-809a6a87-7745-4198-bb49-7603eee66e81 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:17.249099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-809a6a87-7745-4198-bb49-7603eee66e81 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:17.249812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-809a6a87-7745-4198-bb49-7603eee66e81 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:17.251649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-809a6a87-7745-4198-bb49-7603eee66e81 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:17.252493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-809a6a87-7745-4198-bb49-7603eee66e81 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:17.272103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-809a6a87-7745-4198-bb49-7603eee66e81 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:17.354643 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-809a6a87-7745-4198-bb49-7603eee66e81 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.144935 Aug 18 11:57:17.355838 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2865/5414] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:57:17 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2/os-volume_attachments => generated 25 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:57:17.456119 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-802b8a35-6949-4aca-9081-91f0a6397214 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:17.456854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-802b8a35-6949-4aca-9081-91f0a6397214 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:17.465604 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-802b8a35-6949-4aca-9081-91f0a6397214 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:17.466137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-802b8a35-6949-4aca-9081-91f0a6397214 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:17.466727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-802b8a35-6949-4aca-9081-91f0a6397214 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:17.467649 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-802b8a35-6949-4aca-9081-91f0a6397214 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:17.468273 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-802b8a35-6949-4aca-9081-91f0a6397214 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:17.468715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-802b8a35-6949-4aca-9081-91f0a6397214 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:17.523675 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-802b8a35-6949-4aca-9081-91f0a6397214 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:57:17.761354 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-802b8a35-6949-4aca-9081-91f0a6397214 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 204 len: 0 microversion: 2.1 time: 0.309056 Aug 18 11:57:17.762574 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2550/5415] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:57:17 2022] DELETE /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:57:17.771881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e248927-993c-4106-a724-1fb75d740515 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:17.773520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1e248927-993c-4106-a724-1fb75d740515 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:17.794309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e248927-993c-4106-a724-1fb75d740515 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:17.795207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e248927-993c-4106-a724-1fb75d740515 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:17.797415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e248927-993c-4106-a724-1fb75d740515 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:17.799358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e248927-993c-4106-a724-1fb75d740515 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:17.800839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e248927-993c-4106-a724-1fb75d740515 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:17.801628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e248927-993c-4106-a724-1fb75d740515 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:18.212179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1e248927-993c-4106-a724-1fb75d740515 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:18.221278 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1e248927-993c-4106-a724-1fb75d740515 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1679 microversion: 2.1 time: 0.453948 Aug 18 11:57:18.240648 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2866/5416] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:17 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1679 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:19.251686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-0712d867-4aef-495a-a3b0-0254b1254060 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:19.252597 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-0712d867-4aef-495a-a3b0-0254b1254060 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:19.266694 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0712d867-4aef-495a-a3b0-0254b1254060 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:19.267565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0712d867-4aef-495a-a3b0-0254b1254060 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:19.268202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0712d867-4aef-495a-a3b0-0254b1254060 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:19.269197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0712d867-4aef-495a-a3b0-0254b1254060 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:19.269939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0712d867-4aef-495a-a3b0-0254b1254060 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:19.270691 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-0712d867-4aef-495a-a3b0-0254b1254060 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:19.668202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-0712d867-4aef-495a-a3b0-0254b1254060 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:19.676258 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-0712d867-4aef-495a-a3b0-0254b1254060 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1679 microversion: 2.1 time: 0.430504 Aug 18 11:57:19.679348 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2551/5417] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:19 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1679 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:20.702462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06217570-d0ea-430d-b2a8-bcf31992fc67 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:20.706805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-06217570-d0ea-430d-b2a8-bcf31992fc67 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:20.722930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06217570-d0ea-430d-b2a8-bcf31992fc67 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:20.723629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06217570-d0ea-430d-b2a8-bcf31992fc67 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:20.724241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06217570-d0ea-430d-b2a8-bcf31992fc67 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:20.725111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06217570-d0ea-430d-b2a8-bcf31992fc67 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:20.725738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06217570-d0ea-430d-b2a8-bcf31992fc67 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:20.738018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06217570-d0ea-430d-b2a8-bcf31992fc67 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:21.553104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-06217570-d0ea-430d-b2a8-bcf31992fc67 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:21.563701 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-06217570-d0ea-430d-b2a8-bcf31992fc67 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1679 microversion: 2.1 time: 0.867083 Aug 18 11:57:21.583752 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2867/5418] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:20 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1679 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:23.201822 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-718c6b6b-76fe-4961-a76e-fcae49ec87cd tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:23.203096 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-718c6b6b-76fe-4961-a76e-fcae49ec87cd tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:23.223882 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-718c6b6b-76fe-4961-a76e-fcae49ec87cd tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:23.224419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-718c6b6b-76fe-4961-a76e-fcae49ec87cd tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:23.224864 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-718c6b6b-76fe-4961-a76e-fcae49ec87cd tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:23.225781 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-718c6b6b-76fe-4961-a76e-fcae49ec87cd tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:23.226247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-718c6b6b-76fe-4961-a76e-fcae49ec87cd tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:23.226763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-718c6b6b-76fe-4961-a76e-fcae49ec87cd tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:23.519543 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-718c6b6b-76fe-4961-a76e-fcae49ec87cd tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:23.530760 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-718c6b6b-76fe-4961-a76e-fcae49ec87cd tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1612 microversion: 2.1 time: 0.949252 Aug 18 11:57:23.539855 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2552/5419] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:22 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1612 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:24.558490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-185239ed-fd8c-45fd-97ba-f35f23e80dfc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:24.561083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-55ef3807-928f-46aa-b955-4549ad158b82 req-b60261f2-7c87-4a5a-bd85-ca18517b1541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee32c00-b94f-4934-8b57-31d670dd8ea2", "name": "network-vif-deleted", "tag": "ca7571bf-b53b-486d-872d-87c9ec2f17a3"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:57:24.564137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-185239ed-fd8c-45fd-97ba-f35f23e80dfc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:24.586106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-185239ed-fd8c-45fd-97ba-f35f23e80dfc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:24.589219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-185239ed-fd8c-45fd-97ba-f35f23e80dfc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:24.591765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-185239ed-fd8c-45fd-97ba-f35f23e80dfc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:24.593450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-55ef3807-928f-46aa-b955-4549ad158b82 req-b60261f2-7c87-4a5a-bd85-ca18517b1541 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:24.593939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-185239ed-fd8c-45fd-97ba-f35f23e80dfc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:24.597562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-185239ed-fd8c-45fd-97ba-f35f23e80dfc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:24.598755 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-55ef3807-928f-46aa-b955-4549ad158b82 req-b60261f2-7c87-4a5a-bd85-ca18517b1541 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:24.599358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-185239ed-fd8c-45fd-97ba-f35f23e80dfc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:24.611504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-55ef3807-928f-46aa-b955-4549ad158b82 req-b60261f2-7c87-4a5a-bd85-ca18517b1541 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:24.663976 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-55ef3807-928f-46aa-b955-4549ad158b82 req-b60261f2-7c87-4a5a-bd85-ca18517b1541 service nova] Creating event network-vif-deleted:ca7571bf-b53b-486d-872d-87c9ec2f17a3 for instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 on n-h2-853611-3 Aug 18 11:57:24.685808 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-55ef3807-928f-46aa-b955-4549ad158b82 req-b60261f2-7c87-4a5a-bd85-ca18517b1541 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131018 Aug 18 11:57:24.692529 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2553/5420] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:57:25.486198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-185239ed-fd8c-45fd-97ba-f35f23e80dfc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:25.517243 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-185239ed-fd8c-45fd-97ba-f35f23e80dfc tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 200 len: 1326 microversion: 2.1 time: 0.967104 Aug 18 11:57:25.531579 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2868/5421] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:24 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 1326 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:26.544287 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f8a0d4bf-69b8-4a96-8b9b-844242c9984b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:26.544992 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f8a0d4bf-69b8-4a96-8b9b-844242c9984b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:26.559252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8a0d4bf-69b8-4a96-8b9b-844242c9984b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:26.559746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8a0d4bf-69b8-4a96-8b9b-844242c9984b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:26.560184 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8a0d4bf-69b8-4a96-8b9b-844242c9984b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:26.560890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8a0d4bf-69b8-4a96-8b9b-844242c9984b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:26.561342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8a0d4bf-69b8-4a96-8b9b-844242c9984b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:26.561768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8a0d4bf-69b8-4a96-8b9b-844242c9984b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:26.613685 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-f8a0d4bf-69b8-4a96-8b9b-844242c9984b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] HTTP exception thrown: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f8a0d4bf-69b8-4a96-8b9b-844242c9984b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Request method failure captured: Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 HTTP/1.1 Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_if1x16WBMpc3s4OH8sjm3tHJjaZqQcRpU1oiMS-p1WI1YrRSC2t7-vlFi9T8Z71n1HUxo4fP6nRLR16BbxlLWyXqp2clERspIcMb_jAedcCu_hp9tsk0cAtcafVC7hlv2fQVmuiFfoXUzkmUNLY6LwwQl_4XOvH_miTFCjGf1SoX08 Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1e4b3c7d38a540f19d88bf28c83cf9a6 Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '2ee32c00-b94f-4934-8b57-31d670dd8ea2'} Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:57:26.626890 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:57:26.631433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:57:26.631433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:57:26.631433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:57:26.631433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:57:26.631433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:57:26.631433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:57:26.631433 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:57:26.631433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f8a0d4bf-69b8-4a96-8b9b-844242c9984b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Returning 404 to user: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:57:26.631433 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f8a0d4bf-69b8-4a96-8b9b-844242c9984b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 404 len: 111 microversion: 2.1 time: 0.089321 Aug 18 11:57:26.637893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-164f82ad-ac65-40e9-8343-07a971cfe00f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '.version_select at 0x7f519f071040>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:26.646584 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2554/5422] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:26 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:57:26.686407 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-164f82ad-ac65-40e9-8343-07a971cfe00f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799209101" status: 202 len: 0 microversion: 2.1 time: 0.052769 Aug 18 11:57:26.692993 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2869/5423] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 11:57:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799209101 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 11:57:28.187527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9f9b49a8-f1d5-4933-8946-6f9c6a62b5bb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Action: 'create', calling method: .version_select at 0x7f519e46e160>, body: {"keypair": {"name": "tempest-keypair-364564421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh00Le0ilGJKLYItTSd0K9fHgsgcc0baQsPGKrw72Rgl2SrUMiZQcLy0KYsGSUmF2OPjWH63fgnVK0uvtRpekbyt1aadq2Nc7hER2NWJVtDiBZPH1HtDHCoMXF5WCMkDw=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:57:28.228417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-9f9b49a8-f1d5-4933-8946-6f9c6a62b5bb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:57:28.238266 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-9f9b49a8-f1d5-4933-8946-6f9c6a62b5bb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for user 1e4b3c7d38a540f19d88bf28c83cf9a6 and project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:57:28.312067 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9f9b49a8-f1d5-4933-8946-6f9c6a62b5bb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128275 Aug 18 11:57:28.312671 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2555/5424] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:57:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:57:34.979792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-208184804", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43cde373-6762-4357-b5ca-4bc083d39b6f"}], "security_groups": [{"name": "tempest-securitygroup--873425223"}], "key_name": "tempest-keypair-364564421", "user_data": "}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:57:35.020762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:57:35.317239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] validate_networks() for [('43cde373-6762-4357-b5ca-4bc083d39b6f', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:57:35.508508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=64 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:57:37.597896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:57:37.598689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:57:37.599077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:57:37.599215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:57:37.599638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:57:37.638921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:37.639426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:37.639872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:37.640621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:37.641084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:37.641515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:37.736701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:57:37.748447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Getting quotas for user 1e4b3c7d38a540f19d88bf28c83cf9a6 and project 15c4a3296e2a40fe96cb7994b2e3720b. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:57:37.770774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:57:37.782643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:57:37.876114 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ccdd2d42-70ed-4ea8-8337-a0c75517334c tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.913133 Aug 18 11:57:37.882875 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2870/5425] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:57:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 2916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:57:37.889756 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-521f89b3-5182-415a-b23e-10aedafc6daf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:37.891536 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-521f89b3-5182-415a-b23e-10aedafc6daf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:37.900122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:57:37.901655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:57:38.118626 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-521f89b3-5182-415a-b23e-10aedafc6daf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:38.126027 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-521f89b3-5182-415a-b23e-10aedafc6daf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1240 microversion: 2.1 time: 0.240456 Aug 18 11:57:38.138746 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2556/5426] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:37 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1240 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:39.157890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e74f084-6394-4cc4-a271-edd96e98402d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:39.159115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7e74f084-6394-4cc4-a271-edd96e98402d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:39.353425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7e74f084-6394-4cc4-a271-edd96e98402d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:39.375632 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e74f084-6394-4cc4-a271-edd96e98402d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1240 microversion: 2.1 time: 0.227216 Aug 18 11:57:39.383055 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2871/5427] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:39 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1240 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:40.398761 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6bcd9e22-39c3-4667-93d9-bf37752245eb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:40.400090 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6bcd9e22-39c3-4667-93d9-bf37752245eb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:40.434141 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bcd9e22-39c3-4667-93d9-bf37752245eb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:40.435025 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bcd9e22-39c3-4667-93d9-bf37752245eb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:40.435908 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bcd9e22-39c3-4667-93d9-bf37752245eb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:40.440659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bcd9e22-39c3-4667-93d9-bf37752245eb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:40.442894 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bcd9e22-39c3-4667-93d9-bf37752245eb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:40.443528 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6bcd9e22-39c3-4667-93d9-bf37752245eb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:41.439195 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6bcd9e22-39c3-4667-93d9-bf37752245eb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:41.462346 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6bcd9e22-39c3-4667-93d9-bf37752245eb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1300 microversion: 2.1 time: 1.065032 Aug 18 11:57:41.463447 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2557/5428] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:40 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1300 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:42.486495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a8328e59-c97c-435d-af39-c8d46b6539de tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:42.491692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a8328e59-c97c-435d-af39-c8d46b6539de tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:42.522846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8328e59-c97c-435d-af39-c8d46b6539de tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:42.523712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8328e59-c97c-435d-af39-c8d46b6539de tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:42.527068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8328e59-c97c-435d-af39-c8d46b6539de tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:42.533281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8328e59-c97c-435d-af39-c8d46b6539de tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:42.534061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8328e59-c97c-435d-af39-c8d46b6539de tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:42.534792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8328e59-c97c-435d-af39-c8d46b6539de tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:43.046863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a8328e59-c97c-435d-af39-c8d46b6539de tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:43.063624 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a8328e59-c97c-435d-af39-c8d46b6539de tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1298 microversion: 2.1 time: 0.580152 Aug 18 11:57:43.065747 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2872/5429] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:42 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1298 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:57:44.097099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5222daf1-9a36-4ffd-aa93-7cbf793ec1e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:44.097723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5222daf1-9a36-4ffd-aa93-7cbf793ec1e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:44.132775 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5222daf1-9a36-4ffd-aa93-7cbf793ec1e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:44.133859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5222daf1-9a36-4ffd-aa93-7cbf793ec1e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:44.142052 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5222daf1-9a36-4ffd-aa93-7cbf793ec1e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:44.147269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5222daf1-9a36-4ffd-aa93-7cbf793ec1e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:44.151768 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5222daf1-9a36-4ffd-aa93-7cbf793ec1e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:44.152033 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5222daf1-9a36-4ffd-aa93-7cbf793ec1e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:44.754652 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-5222daf1-9a36-4ffd-aa93-7cbf793ec1e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:44.763821 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5222daf1-9a36-4ffd-aa93-7cbf793ec1e1 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1365 microversion: 2.1 time: 0.673042 Aug 18 11:57:44.782983 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2558/5430] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:44 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1365 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:45.801972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7bb1a606-ad85-4f66-b111-10069d5991b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:45.803683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7bb1a606-ad85-4f66-b111-10069d5991b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:45.824142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bb1a606-ad85-4f66-b111-10069d5991b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:45.824652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bb1a606-ad85-4f66-b111-10069d5991b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:45.825100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bb1a606-ad85-4f66-b111-10069d5991b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:45.827626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bb1a606-ad85-4f66-b111-10069d5991b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:45.828106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bb1a606-ad85-4f66-b111-10069d5991b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:45.830556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bb1a606-ad85-4f66-b111-10069d5991b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:46.206380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7bb1a606-ad85-4f66-b111-10069d5991b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:46.230881 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7bb1a606-ad85-4f66-b111-10069d5991b3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1365 microversion: 2.1 time: 0.434823 Aug 18 11:57:46.231859 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2873/5431] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:45 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1365 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:46.294624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-040f129e-f6ca-4ebc-ac6e-48e1a42b7267 req-02c31a36-6b53-45e0-bf75-59268592b194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d858006-1223-472d-bf15-891c83ce6d4a", "tag": "c27eddb0-4d1e-4d0d-bc11-b70105bff1f7"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:57:46.330934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-040f129e-f6ca-4ebc-ac6e-48e1a42b7267 req-02c31a36-6b53-45e0-bf75-59268592b194 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:46.331456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-040f129e-f6ca-4ebc-ac6e-48e1a42b7267 req-02c31a36-6b53-45e0-bf75-59268592b194 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:46.332308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-040f129e-f6ca-4ebc-ac6e-48e1a42b7267 req-02c31a36-6b53-45e0-bf75-59268592b194 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:46.372740 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-040f129e-f6ca-4ebc-ac6e-48e1a42b7267 req-02c31a36-6b53-45e0-bf75-59268592b194 service nova] Creating event network-changed:c27eddb0-4d1e-4d0d-bc11-b70105bff1f7 for instance 3d858006-1223-472d-bf15-891c83ce6d4a on n-h2-853611-3 Aug 18 11:57:46.396396 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-040f129e-f6ca-4ebc-ac6e-48e1a42b7267 req-02c31a36-6b53-45e0-bf75-59268592b194 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105488 Aug 18 11:57:46.404547 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2559/5432] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:57:47.253816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d11e7dbc-e5e0-4570-a375-d1747496b125 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:47.255171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d11e7dbc-e5e0-4570-a375-d1747496b125 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:47.274799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11e7dbc-e5e0-4570-a375-d1747496b125 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:47.276069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11e7dbc-e5e0-4570-a375-d1747496b125 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:47.276693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11e7dbc-e5e0-4570-a375-d1747496b125 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:47.279567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11e7dbc-e5e0-4570-a375-d1747496b125 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:47.280930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11e7dbc-e5e0-4570-a375-d1747496b125 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:47.284390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11e7dbc-e5e0-4570-a375-d1747496b125 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:47.691113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:57:47.956289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d11e7dbc-e5e0-4570-a375-d1747496b125 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:47.971077 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d11e7dbc-e5e0-4570-a375-d1747496b125 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1365 microversion: 2.1 time: 0.722395 Aug 18 11:57:47.984794 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2874/5433] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:47 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1365 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:48.997845 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d6786194-15c5-4430-b4e0-270690972dc8 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:48.999942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d6786194-15c5-4430-b4e0-270690972dc8 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:49.032474 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:57:49.038589 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d6786194-15c5-4430-b4e0-270690972dc8 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:49.039109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d6786194-15c5-4430-b4e0-270690972dc8 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:49.039616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d6786194-15c5-4430-b4e0-270690972dc8 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:49.040895 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d6786194-15c5-4430-b4e0-270690972dc8 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:49.041374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d6786194-15c5-4430-b4e0-270690972dc8 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:49.042318 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d6786194-15c5-4430-b4e0-270690972dc8 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:49.734759 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d6786194-15c5-4430-b4e0-270690972dc8 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:49.744524 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d6786194-15c5-4430-b4e0-270690972dc8 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1365 microversion: 2.1 time: 0.755479 Aug 18 11:57:49.747657 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2560/5434] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:48 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1365 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:57:50.769149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e87b0436-f2ca-4ec6-a45e-4c24673b4e54 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:50.769619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e87b0436-f2ca-4ec6-a45e-4c24673b4e54 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:50.777301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:57:50.808770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e87b0436-f2ca-4ec6-a45e-4c24673b4e54 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:50.809278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e87b0436-f2ca-4ec6-a45e-4c24673b4e54 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:50.809891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e87b0436-f2ca-4ec6-a45e-4c24673b4e54 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:50.810678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e87b0436-f2ca-4ec6-a45e-4c24673b4e54 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:50.811146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e87b0436-f2ca-4ec6-a45e-4c24673b4e54 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:50.811580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e87b0436-f2ca-4ec6-a45e-4c24673b4e54 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:51.306741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e87b0436-f2ca-4ec6-a45e-4c24673b4e54 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:51.316459 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e87b0436-f2ca-4ec6-a45e-4c24673b4e54 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1365 microversion: 2.1 time: 0.552201 Aug 18 11:57:51.320309 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2875/5435] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:50 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1365 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:52.343334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e821f389-ac25-4602-9681-1b0e2c6fa489 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:52.344537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e821f389-ac25-4602-9681-1b0e2c6fa489 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:52.365813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e821f389-ac25-4602-9681-1b0e2c6fa489 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:52.366660 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e821f389-ac25-4602-9681-1b0e2c6fa489 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:52.367115 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e821f389-ac25-4602-9681-1b0e2c6fa489 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:52.378659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e821f389-ac25-4602-9681-1b0e2c6fa489 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:52.379636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e821f389-ac25-4602-9681-1b0e2c6fa489 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:52.380417 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e821f389-ac25-4602-9681-1b0e2c6fa489 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:52.621018 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e821f389-ac25-4602-9681-1b0e2c6fa489 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:52.644258 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e821f389-ac25-4602-9681-1b0e2c6fa489 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1365 microversion: 2.1 time: 0.298146 Aug 18 11:57:52.652026 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2561/5436] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:52 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:53.670037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-10a91ecd-61e1-493a-913a-b501c5b40248 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:53.670695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-10a91ecd-61e1-493a-913a-b501c5b40248 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:53.684226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10a91ecd-61e1-493a-913a-b501c5b40248 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:53.690698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10a91ecd-61e1-493a-913a-b501c5b40248 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:53.691616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10a91ecd-61e1-493a-913a-b501c5b40248 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:53.692530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10a91ecd-61e1-493a-913a-b501c5b40248 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:53.707954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10a91ecd-61e1-493a-913a-b501c5b40248 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:53.714632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10a91ecd-61e1-493a-913a-b501c5b40248 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:54.131057 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-8dad4dc9-eacd-48eb-a61d-4fbf4467bb58 req-1bbb0cba-c230-45e6-abfe-743372ba1ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d858006-1223-472d-bf15-891c83ce6d4a", "name": "network-vif-plugged", "status": "completed", "tag": "c27eddb0-4d1e-4d0d-bc11-b70105bff1f7"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:57:54.182478 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8dad4dc9-eacd-48eb-a61d-4fbf4467bb58 req-1bbb0cba-c230-45e6-abfe-743372ba1ffd service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:54.183225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8dad4dc9-eacd-48eb-a61d-4fbf4467bb58 req-1bbb0cba-c230-45e6-abfe-743372ba1ffd service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:54.184512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-8dad4dc9-eacd-48eb-a61d-4fbf4467bb58 req-1bbb0cba-c230-45e6-abfe-743372ba1ffd service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:54.235658 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-8dad4dc9-eacd-48eb-a61d-4fbf4467bb58 req-1bbb0cba-c230-45e6-abfe-743372ba1ffd service nova] Creating event network-vif-plugged:c27eddb0-4d1e-4d0d-bc11-b70105bff1f7 for instance 3d858006-1223-472d-bf15-891c83ce6d4a on n-h2-853611-3 Aug 18 11:57:54.243586 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-8dad4dc9-eacd-48eb-a61d-4fbf4467bb58 req-1bbb0cba-c230-45e6-abfe-743372ba1ffd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.553642 Aug 18 11:57:54.244982 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2562/5437] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:57:54.346128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-10a91ecd-61e1-493a-913a-b501c5b40248 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:54.358240 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-10a91ecd-61e1-493a-913a-b501c5b40248 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1365 microversion: 2.1 time: 0.695341 Aug 18 11:57:54.371258 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2876/5438] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:53 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1365 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:55.381166 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-bf60f668-07ca-4fc7-ba93-2a467e0776ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:55.382890 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-bf60f668-07ca-4fc7-ba93-2a467e0776ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:55.396646 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf60f668-07ca-4fc7-ba93-2a467e0776ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:55.401510 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf60f668-07ca-4fc7-ba93-2a467e0776ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:55.402015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf60f668-07ca-4fc7-ba93-2a467e0776ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:55.402799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf60f668-07ca-4fc7-ba93-2a467e0776ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:55.404434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf60f668-07ca-4fc7-ba93-2a467e0776ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:55.404878 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-bf60f668-07ca-4fc7-ba93-2a467e0776ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:55.854664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-bf60f668-07ca-4fc7-ba93-2a467e0776ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:55.868358 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-bf60f668-07ca-4fc7-ba93-2a467e0776ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1365 microversion: 2.1 time: 0.492132 Aug 18 11:57:55.869685 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2563/5439] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:55 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1365 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:56.891097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fddf33f1-9cbf-467c-b18c-f7856428810b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:56.892341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fddf33f1-9cbf-467c-b18c-f7856428810b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:56.899413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fddf33f1-9cbf-467c-b18c-f7856428810b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:56.900161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fddf33f1-9cbf-467c-b18c-f7856428810b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:56.900771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fddf33f1-9cbf-467c-b18c-f7856428810b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:56.901660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fddf33f1-9cbf-467c-b18c-f7856428810b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:56.902308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fddf33f1-9cbf-467c-b18c-f7856428810b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:56.902914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fddf33f1-9cbf-467c-b18c-f7856428810b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:57.504825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fddf33f1-9cbf-467c-b18c-f7856428810b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:57:57.524270 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fddf33f1-9cbf-467c-b18c-f7856428810b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1554 microversion: 2.1 time: 0.635310 Aug 18 11:57:57.539072 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2877/5440] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:57:56 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1554 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:57:57.549161 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f8737658-fb6a-4483-a47b-16ff199ef550 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:57:57.549874 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f8737658-fb6a-4483-a47b-16ff199ef550 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:57:57.561796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8737658-fb6a-4483-a47b-16ff199ef550 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:57.567076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8737658-fb6a-4483-a47b-16ff199ef550 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:57.567868 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8737658-fb6a-4483-a47b-16ff199ef550 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:57.568870 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8737658-fb6a-4483-a47b-16ff199ef550 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:57:57.569552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8737658-fb6a-4483-a47b-16ff199ef550 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:57:57.571967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f8737658-fb6a-4483-a47b-16ff199ef550 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:57:57.878033 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f8737658-fb6a-4483-a47b-16ff199ef550 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.333013 Aug 18 11:57:57.881592 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2564/5441] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 11:57:57 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-interface => generated 284 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:58:01.724065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-3134505d-b1ef-49c3-abd5-a1496801830e req-91d36015-bc81-4a65-a331-56c4a6bcc2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d858006-1223-472d-bf15-891c83ce6d4a", "tag": "c27eddb0-4d1e-4d0d-bc11-b70105bff1f7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:58:01.747758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3134505d-b1ef-49c3-abd5-a1496801830e req-91d36015-bc81-4a65-a331-56c4a6bcc2b0 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:58:01.748425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3134505d-b1ef-49c3-abd5-a1496801830e req-91d36015-bc81-4a65-a331-56c4a6bcc2b0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:58:01.750686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3134505d-b1ef-49c3-abd5-a1496801830e req-91d36015-bc81-4a65-a331-56c4a6bcc2b0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:58:01.778523 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-3134505d-b1ef-49c3-abd5-a1496801830e req-91d36015-bc81-4a65-a331-56c4a6bcc2b0 service nova] Creating event network-changed:c27eddb0-4d1e-4d0d-bc11-b70105bff1f7 for instance 3d858006-1223-472d-bf15-891c83ce6d4a on n-h2-853611-3 Aug 18 11:58:01.788159 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-3134505d-b1ef-49c3-abd5-a1496801830e req-91d36015-bc81-4a65-a331-56c4a6bcc2b0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188929 Aug 18 11:58:01.792188 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2878/5442] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:58:19.985703 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:58:19.986329 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 11:58:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:58:28.684349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=19 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:58:28.686401 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=38 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:58:28.702336 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-fabc527c-c9d0-4012-be90-889d69a685fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:58:28.703185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-fabc527c-c9d0-4012-be90-889d69a685fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:58:28.722632 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fabc527c-c9d0-4012-be90-889d69a685fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:58:28.728480 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fabc527c-c9d0-4012-be90-889d69a685fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:58:28.730332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fabc527c-c9d0-4012-be90-889d69a685fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:58:28.732614 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fabc527c-c9d0-4012-be90-889d69a685fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:58:28.733102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fabc527c-c9d0-4012-be90-889d69a685fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:58:28.735481 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-fabc527c-c9d0-4012-be90-889d69a685fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:58:28.829304 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-fabc527c-c9d0-4012-be90-889d69a685fb tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/ips" status: 200 len: 149 microversion: 2.1 time: 0.146989 Aug 18 11:58:28.839373 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2565/5443] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 11:58:28 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/ips => generated 149 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:58:33.443748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-808fd1a4-6723-413e-a5d0-f6d6444a98d3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f3afb37-c109-462c-8bd7-fb29e3fe0032"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:58:33.468993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-808fd1a4-6723-413e-a5d0-f6d6444a98d3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:58:33.474387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:58:33.488178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=40 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:58:33.523743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808fd1a4-6723-413e-a5d0-f6d6444a98d3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:58:33.524261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808fd1a4-6723-413e-a5d0-f6d6444a98d3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:58:33.524712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808fd1a4-6723-413e-a5d0-f6d6444a98d3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:58:33.525459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808fd1a4-6723-413e-a5d0-f6d6444a98d3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:58:33.525925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808fd1a4-6723-413e-a5d0-f6d6444a98d3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:58:33.526365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808fd1a4-6723-413e-a5d0-f6d6444a98d3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:58:34.334881 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-808fd1a4-6723-413e-a5d0-f6d6444a98d3 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "POST /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.911340 Aug 18 11:58:34.348345 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2879/5444] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 11:58:33 2022] POST /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments => generated 194 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:59:07.930396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2c4623cb-d960-4652-923a-1860fe259450 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Action: 'create', calling method: .version_select at 0x7f519e43aaf0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-935484746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMopMVU50IdMZMi3b4lHnrgALR0QzFd+bOhdJdanGyXgq06QgTfTLpMEt1VZ0A2EP9E4DPS9KtBhAYKWSen7MSiu5vXgR3r+TGyydkB9zi+9gdycM7Uiswwc0By7TnfA3w=="}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:59:07.948099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:59:07.952896 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:59:07.978197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-2c4623cb-d960-4652-923a-1860fe259450 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Getting quotas for project c65e9924e8554a53a3842fd38b685410. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:59:07.990106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-2c4623cb-d960-4652-923a-1860fe259450 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Getting quotas for user c11231212bdc4f10a30a5ccd6fd117a0 and project c65e9924e8554a53a3842fd38b685410. Resources: {'key_pairs'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:59:08.083538 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2c4623cb-d960-4652-923a-1860fe259450 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.157928 Aug 18 11:59:08.084641 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2566/5445] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 11:59:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:59:08.604324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:59:08.605218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:59:08.610238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a373e403-1df2-4745-92f5-27f1c6ba9be4 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:08.613638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a373e403-1df2-4745-92f5-27f1c6ba9be4 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:08.668836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a373e403-1df2-4745-92f5-27f1c6ba9be4 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:08.669394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a373e403-1df2-4745-92f5-27f1c6ba9be4 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:08.669925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a373e403-1df2-4745-92f5-27f1c6ba9be4 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:08.670695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a373e403-1df2-4745-92f5-27f1c6ba9be4 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:08.671250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a373e403-1df2-4745-92f5-27f1c6ba9be4 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:08.671696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a373e403-1df2-4745-92f5-27f1c6ba9be4 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:09.023222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-a373e403-1df2-4745-92f5-27f1c6ba9be4 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lazy-loading 'services' on Instance uuid 3d858006-1223-472d-bf15-891c83ce6d4a {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:59:09.221645 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a373e403-1df2-4745-92f5-27f1c6ba9be4 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments/2f3afb37-c109-462c-8bd7-fb29e3fe0032" status: 202 len: 0 microversion: 2.1 time: 0.620605 Aug 18 11:59:09.223235 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2880/5446] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 11:59:08 2022] DELETE /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments/2f3afb37-c109-462c-8bd7-fb29e3fe0032 => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:59:09.234934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-297b70cd-4148-4b55-a8a5-a861f7fba28d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:09.238229 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-297b70cd-4148-4b55-a8a5-a861f7fba28d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:09.262833 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-297b70cd-4148-4b55-a8a5-a861f7fba28d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:09.263779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-297b70cd-4148-4b55-a8a5-a861f7fba28d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:09.264612 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-297b70cd-4148-4b55-a8a5-a861f7fba28d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:09.266225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-297b70cd-4148-4b55-a8a5-a861f7fba28d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:09.273450 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-297b70cd-4148-4b55-a8a5-a861f7fba28d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:09.274374 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-297b70cd-4148-4b55-a8a5-a861f7fba28d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:09.364329 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-297b70cd-4148-4b55-a8a5-a861f7fba28d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136189 Aug 18 11:59:09.370851 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2567/5447] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:59:09 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:59:10.387628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-842ef59b-caee-4680-aaca-070360a03aed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:10.390647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-842ef59b-caee-4680-aaca-070360a03aed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:10.415798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-842ef59b-caee-4680-aaca-070360a03aed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:10.423346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-842ef59b-caee-4680-aaca-070360a03aed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:10.423915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-842ef59b-caee-4680-aaca-070360a03aed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:10.424765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-842ef59b-caee-4680-aaca-070360a03aed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:10.425326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-842ef59b-caee-4680-aaca-070360a03aed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:10.425848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-842ef59b-caee-4680-aaca-070360a03aed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:10.505332 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-842ef59b-caee-4680-aaca-070360a03aed tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124539 Aug 18 11:59:10.506666 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2881/5448] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:59:10 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:59:11.247026 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1175025513", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8def14ee-88fa-413a-9361-07a018750a74", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-935484746", "security_groups": [{"name": "tempest-secgroup-smoke-867528634"}], "networks": [{"uuid": "a3276408-a193-494a-ad64-4d0ced01fce6"}]}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:59:11.519554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b535afd-9480-4641-8522-3a978941dd61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:11.525261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b535afd-9480-4641-8522-3a978941dd61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:11.552330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b535afd-9480-4641-8522-3a978941dd61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:11.561658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b535afd-9480-4641-8522-3a978941dd61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:11.562674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b535afd-9480-4641-8522-3a978941dd61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:11.563633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b535afd-9480-4641-8522-3a978941dd61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:11.566029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b535afd-9480-4641-8522-3a978941dd61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:11.569242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b535afd-9480-4641-8522-3a978941dd61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:11.665068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] validate_networks() for [('a3276408-a193-494a-ad64-4d0ced01fce6', None, None, None, None, None)] {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 11:59:11.695796 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b535afd-9480-4641-8522-3a978941dd61 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178148 Aug 18 11:59:11.701884 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2882/5449] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:59:11 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:59:12.713279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-23fde884-ba87-4d04-8426-7b1662029b17 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:12.718840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-23fde884-ba87-4d04-8426-7b1662029b17 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:12.752266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23fde884-ba87-4d04-8426-7b1662029b17 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:12.753311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23fde884-ba87-4d04-8426-7b1662029b17 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:12.754064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23fde884-ba87-4d04-8426-7b1662029b17 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:12.759160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23fde884-ba87-4d04-8426-7b1662029b17 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:12.760003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23fde884-ba87-4d04-8426-7b1662029b17 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:12.762793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23fde884-ba87-4d04-8426-7b1662029b17 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:12.876813 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-23fde884-ba87-4d04-8426-7b1662029b17 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164538 Aug 18 11:59:12.876813 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2883/5450] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:59:12 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:59:13.201218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 11:59:13.203403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 11:59:13.204373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 11:59:13.205046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 11:59:13.205663 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 11:59:13.232684 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:13.238256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:13.238974 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:13.240393 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:13.241102 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:13.250333 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:13.320476 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Getting quotas for project c65e9924e8554a53a3842fd38b685410. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 11:59:13.340236 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Getting quotas for user c11231212bdc4f10a30a5ccd6fd117a0 and project c65e9924e8554a53a3842fd38b685410. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 11:59:13.459979 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 11:59:13.463467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8def14ee-88fa-413a-9361-07a018750a74',volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 11:59:13.842219 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2115057e-9076-4dbc-b44e-2f566b7cdf59 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.599063 Aug 18 11:59:13.844905 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2568/5451] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 11:59:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 2603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 11:59:13.856997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eb6fc7a5-3728-4a22-b733-e65fc78d8b34 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:13.858471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eb6fc7a5-3728-4a22-b733-e65fc78d8b34 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:13.893725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ec5f698e-20eb-4be3-b07a-99a0e33ae6d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:13.897072 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ec5f698e-20eb-4be3-b07a-99a0e33ae6d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:13.918179 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec5f698e-20eb-4be3-b07a-99a0e33ae6d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:13.918703 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec5f698e-20eb-4be3-b07a-99a0e33ae6d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:13.919801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec5f698e-20eb-4be3-b07a-99a0e33ae6d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:13.920538 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec5f698e-20eb-4be3-b07a-99a0e33ae6d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:13.921005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec5f698e-20eb-4be3-b07a-99a0e33ae6d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:13.925789 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ec5f698e-20eb-4be3-b07a-99a0e33ae6d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:14.056480 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ec5f698e-20eb-4be3-b07a-99a0e33ae6d9 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165247 Aug 18 11:59:14.058314 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2569/5452] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:59:13 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:59:14.181569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-eb6fc7a5-3728-4a22-b733-e65fc78d8b34 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:14.197860 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eb6fc7a5-3728-4a22-b733-e65fc78d8b34 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1098 microversion: 2.1 time: 0.346911 Aug 18 11:59:14.200716 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2884/5453] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:13 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1098 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:15.078245 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3cc49755-4278-4025-982c-1bf44808fb8b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:15.088433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3cc49755-4278-4025-982c-1bf44808fb8b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:15.097636 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3cc49755-4278-4025-982c-1bf44808fb8b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:15.098607 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3cc49755-4278-4025-982c-1bf44808fb8b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:15.102912 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3cc49755-4278-4025-982c-1bf44808fb8b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:15.103844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3cc49755-4278-4025-982c-1bf44808fb8b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:15.104451 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3cc49755-4278-4025-982c-1bf44808fb8b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:15.104907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3cc49755-4278-4025-982c-1bf44808fb8b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:15.175618 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3cc49755-4278-4025-982c-1bf44808fb8b tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107529 Aug 18 11:59:15.181057 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2570/5454] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:59:15 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:59:15.243841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-deb64f40-eedb-48f5-8b40-1376a6e826d4 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:15.244512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-deb64f40-eedb-48f5-8b40-1376a6e826d4 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:15.278367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-deb64f40-eedb-48f5-8b40-1376a6e826d4 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:15.279282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-deb64f40-eedb-48f5-8b40-1376a6e826d4 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:15.279898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-deb64f40-eedb-48f5-8b40-1376a6e826d4 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:15.285367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-deb64f40-eedb-48f5-8b40-1376a6e826d4 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:15.286002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-deb64f40-eedb-48f5-8b40-1376a6e826d4 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:15.287992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-deb64f40-eedb-48f5-8b40-1376a6e826d4 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:16.037535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-deb64f40-eedb-48f5-8b40-1376a6e826d4 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:16.046528 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-deb64f40-eedb-48f5-8b40-1376a6e826d4 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1140 microversion: 2.1 time: 0.829931 Aug 18 11:59:16.047391 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2885/5455] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:15 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1140 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:16.193536 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f57e3c61-958a-4795-9f68-85d658966178 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:16.196735 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f57e3c61-958a-4795-9f68-85d658966178 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:16.217047 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f57e3c61-958a-4795-9f68-85d658966178 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:16.217554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f57e3c61-958a-4795-9f68-85d658966178 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:16.218006 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f57e3c61-958a-4795-9f68-85d658966178 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:16.218777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f57e3c61-958a-4795-9f68-85d658966178 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:16.219380 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f57e3c61-958a-4795-9f68-85d658966178 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:16.219824 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f57e3c61-958a-4795-9f68-85d658966178 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:16.291372 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f57e3c61-958a-4795-9f68-85d658966178 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102173 Aug 18 11:59:16.300755 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2571/5456] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:59:16 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:59:17.079291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-72bbb17d-d47b-4699-87e5-756929696cef tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:17.079938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-72bbb17d-d47b-4699-87e5-756929696cef tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:17.094440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72bbb17d-d47b-4699-87e5-756929696cef tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:17.094957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72bbb17d-d47b-4699-87e5-756929696cef tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:17.095409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72bbb17d-d47b-4699-87e5-756929696cef tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:17.096137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72bbb17d-d47b-4699-87e5-756929696cef tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:17.096606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72bbb17d-d47b-4699-87e5-756929696cef tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:17.097047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72bbb17d-d47b-4699-87e5-756929696cef tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:17.247601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-72bbb17d-d47b-4699-87e5-756929696cef tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:17.274809 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-72bbb17d-d47b-4699-87e5-756929696cef tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1214 microversion: 2.1 time: 0.205938 Aug 18 11:59:17.275755 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2886/5457] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:17 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1214 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:17.305015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9f6b4883-02a8-4fb6-8c5d-7cc8843a7a6a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:17.308187 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9f6b4883-02a8-4fb6-8c5d-7cc8843a7a6a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:17.325596 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f6b4883-02a8-4fb6-8c5d-7cc8843a7a6a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:17.326274 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f6b4883-02a8-4fb6-8c5d-7cc8843a7a6a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:17.326922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f6b4883-02a8-4fb6-8c5d-7cc8843a7a6a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:17.327834 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f6b4883-02a8-4fb6-8c5d-7cc8843a7a6a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:17.328552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f6b4883-02a8-4fb6-8c5d-7cc8843a7a6a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:17.329148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9f6b4883-02a8-4fb6-8c5d-7cc8843a7a6a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:17.404728 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9f6b4883-02a8-4fb6-8c5d-7cc8843a7a6a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105160 Aug 18 11:59:17.406119 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2572/5458] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:59:17 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:59:18.303106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dcb53039-21a9-49ee-b769-42417daf0e10 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:18.303749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dcb53039-21a9-49ee-b769-42417daf0e10 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:18.324485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcb53039-21a9-49ee-b769-42417daf0e10 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:18.326999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcb53039-21a9-49ee-b769-42417daf0e10 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:18.329632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcb53039-21a9-49ee-b769-42417daf0e10 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:18.331844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcb53039-21a9-49ee-b769-42417daf0e10 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:18.333245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcb53039-21a9-49ee-b769-42417daf0e10 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:18.336408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcb53039-21a9-49ee-b769-42417daf0e10 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:18.418387 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3e7c71c1-8d09-4df3-a5d2-81aead8469ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:18.420670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3e7c71c1-8d09-4df3-a5d2-81aead8469ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:18.452069 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e7c71c1-8d09-4df3-a5d2-81aead8469ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:18.452580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e7c71c1-8d09-4df3-a5d2-81aead8469ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:18.453029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e7c71c1-8d09-4df3-a5d2-81aead8469ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:18.454003 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e7c71c1-8d09-4df3-a5d2-81aead8469ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:18.454730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e7c71c1-8d09-4df3-a5d2-81aead8469ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:18.455349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3e7c71c1-8d09-4df3-a5d2-81aead8469ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:18.523628 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3e7c71c1-8d09-4df3-a5d2-81aead8469ae tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110070 Aug 18 11:59:18.524583 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2573/5459] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:59:18 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:59:18.781718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dcb53039-21a9-49ee-b769-42417daf0e10 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:18.794108 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dcb53039-21a9-49ee-b769-42417daf0e10 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1214 microversion: 2.1 time: 0.495644 Aug 18 11:59:18.795322 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2887/5460] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:18 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1214 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:19.551371 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-aeace333-7290-411e-b77c-028005b736cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:19.573526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-aeace333-7290-411e-b77c-028005b736cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:19.643999 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeace333-7290-411e-b77c-028005b736cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:19.648964 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeace333-7290-411e-b77c-028005b736cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:19.650634 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeace333-7290-411e-b77c-028005b736cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:19.654251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeace333-7290-411e-b77c-028005b736cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:19.655463 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeace333-7290-411e-b77c-028005b736cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:19.658164 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-aeace333-7290-411e-b77c-028005b736cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:19.824482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0095b774-1181-4ce2-9e39-57a98ed63aa6 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:19.825866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0095b774-1181-4ce2-9e39-57a98ed63aa6 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:19.827144 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-aeace333-7290-411e-b77c-028005b736cf tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.294109 Aug 18 11:59:19.840070 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2574/5461] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:59:19 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments => generated 197 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:59:19.846665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0095b774-1181-4ce2-9e39-57a98ed63aa6 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:19.847187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0095b774-1181-4ce2-9e39-57a98ed63aa6 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:19.847640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0095b774-1181-4ce2-9e39-57a98ed63aa6 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:19.848654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0095b774-1181-4ce2-9e39-57a98ed63aa6 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:19.849125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0095b774-1181-4ce2-9e39-57a98ed63aa6 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:19.864075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0095b774-1181-4ce2-9e39-57a98ed63aa6 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:20.312549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0095b774-1181-4ce2-9e39-57a98ed63aa6 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:20.327678 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0095b774-1181-4ce2-9e39-57a98ed63aa6 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1281 microversion: 2.1 time: 0.511532 Aug 18 11:59:20.328278 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2888/5462] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:19 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1281 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:20.853105 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7b6889c0-c86d-4925-9001-0f90cab67b09 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:20.855855 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7b6889c0-c86d-4925-9001-0f90cab67b09 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:20.885032 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b6889c0-c86d-4925-9001-0f90cab67b09 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:20.887042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b6889c0-c86d-4925-9001-0f90cab67b09 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:20.889070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b6889c0-c86d-4925-9001-0f90cab67b09 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:20.893465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b6889c0-c86d-4925-9001-0f90cab67b09 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:20.896106 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b6889c0-c86d-4925-9001-0f90cab67b09 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:20.896774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7b6889c0-c86d-4925-9001-0f90cab67b09 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:20.979820 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7b6889c0-c86d-4925-9001-0f90cab67b09 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132643 Aug 18 11:59:20.981210 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2575/5463] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:59:20 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:59:21.348955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d5a8a216-ae9e-4511-956b-42f5cafb487a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:21.350109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d5a8a216-ae9e-4511-956b-42f5cafb487a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:21.367377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a8a216-ae9e-4511-956b-42f5cafb487a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:21.367829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a8a216-ae9e-4511-956b-42f5cafb487a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:21.368289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a8a216-ae9e-4511-956b-42f5cafb487a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:21.369046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a8a216-ae9e-4511-956b-42f5cafb487a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:21.369513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a8a216-ae9e-4511-956b-42f5cafb487a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:21.377552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a8a216-ae9e-4511-956b-42f5cafb487a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:21.917981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-508e4755-1c63-4802-a92d-f86bb027dd2f req-ff6d9612-d5bd-47ce-947e-6d936769c6ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77328cb-e6b5-40dd-b8ed-788cc97b88c5", "tag": "020695c4-3b6d-4b22-a562-e51f623cef2b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:59:21.949376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-508e4755-1c63-4802-a92d-f86bb027dd2f req-ff6d9612-d5bd-47ce-947e-6d936769c6ca service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:21.950150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-508e4755-1c63-4802-a92d-f86bb027dd2f req-ff6d9612-d5bd-47ce-947e-6d936769c6ca service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:21.954909 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-508e4755-1c63-4802-a92d-f86bb027dd2f req-ff6d9612-d5bd-47ce-947e-6d936769c6ca service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:21.987654 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-508e4755-1c63-4802-a92d-f86bb027dd2f req-ff6d9612-d5bd-47ce-947e-6d936769c6ca service nova] Creating event network-changed:020695c4-3b6d-4b22-a562-e51f623cef2b for instance e77328cb-e6b5-40dd-b8ed-788cc97b88c5 on n-h1-853611-3 Aug 18 11:59:22.000859 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-508e4755-1c63-4802-a92d-f86bb027dd2f req-ff6d9612-d5bd-47ce-947e-6d936769c6ca service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088829 Aug 18 11:59:22.004553 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2576/5464] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:59:22.024707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-53b09a9f-7a99-4c27-90f0-121d381d16aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:22.024707 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-53b09a9f-7a99-4c27-90f0-121d381d16aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:22.031135 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53b09a9f-7a99-4c27-90f0-121d381d16aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:22.031302 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53b09a9f-7a99-4c27-90f0-121d381d16aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:22.032175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53b09a9f-7a99-4c27-90f0-121d381d16aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:22.033353 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53b09a9f-7a99-4c27-90f0-121d381d16aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:22.034016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53b09a9f-7a99-4c27-90f0-121d381d16aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:22.034667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-53b09a9f-7a99-4c27-90f0-121d381d16aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:22.095488 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-53b09a9f-7a99-4c27-90f0-121d381d16aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089570 Aug 18 11:59:22.096592 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2577/5465] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 11:59:22 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 11:59:22.149636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d5a8a216-ae9e-4511-956b-42f5cafb487a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:22.172338 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d5a8a216-ae9e-4511-956b-42f5cafb487a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1281 microversion: 2.1 time: 0.824593 Aug 18 11:59:22.175509 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2889/5466] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:21 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1281 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:22.474706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-664083a1-a439-4a3d-8d32-cd18e0afdaea tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:22.475213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-664083a1-a439-4a3d-8d32-cd18e0afdaea tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:22.494084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-664083a1-a439-4a3d-8d32-cd18e0afdaea tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:22.497382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-664083a1-a439-4a3d-8d32-cd18e0afdaea tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:22.497955 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-664083a1-a439-4a3d-8d32-cd18e0afdaea tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:22.498760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-664083a1-a439-4a3d-8d32-cd18e0afdaea tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:22.499235 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-664083a1-a439-4a3d-8d32-cd18e0afdaea tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:22.499667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-664083a1-a439-4a3d-8d32-cd18e0afdaea tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:22.573557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-664083a1-a439-4a3d-8d32-cd18e0afdaea tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 11:59:22.792233 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-664083a1-a439-4a3d-8d32-cd18e0afdaea tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 204 len: 0 microversion: 2.1 time: 0.321187 Aug 18 11:59:22.793891 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2578/5467] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:59:22 2022] DELETE /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 11:59:22.802375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3c6cbf52-0162-4861-adf7-4b4436c68f4a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:22.805032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3c6cbf52-0162-4861-adf7-4b4436c68f4a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:22.830090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c6cbf52-0162-4861-adf7-4b4436c68f4a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:22.830619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c6cbf52-0162-4861-adf7-4b4436c68f4a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:22.831064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c6cbf52-0162-4861-adf7-4b4436c68f4a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:22.831835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c6cbf52-0162-4861-adf7-4b4436c68f4a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:22.842577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c6cbf52-0162-4861-adf7-4b4436c68f4a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:22.843298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c6cbf52-0162-4861-adf7-4b4436c68f4a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:23.201349 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9d478271-034f-4f94-a188-479be4f7e1fb tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:23.204112 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-9d478271-034f-4f94-a188-479be4f7e1fb tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:23.228881 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d478271-034f-4f94-a188-479be4f7e1fb tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:23.229397 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d478271-034f-4f94-a188-479be4f7e1fb tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:23.229852 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d478271-034f-4f94-a188-479be4f7e1fb tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:23.232898 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d478271-034f-4f94-a188-479be4f7e1fb tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:23.233456 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d478271-034f-4f94-a188-479be4f7e1fb tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:23.236565 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-9d478271-034f-4f94-a188-479be4f7e1fb tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:23.308670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:59:23.346759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3c6cbf52-0162-4861-adf7-4b4436c68f4a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:23.359382 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3c6cbf52-0162-4861-adf7-4b4436c68f4a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1679 microversion: 2.1 time: 0.561048 Aug 18 11:59:23.359990 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2890/5468] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:22 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1679 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:23.376453 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=10 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:59:24.001720 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-9d478271-034f-4f94-a188-479be4f7e1fb tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:24.019078 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9d478271-034f-4f94-a188-479be4f7e1fb tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1281 microversion: 2.1 time: 0.824452 Aug 18 11:59:24.019682 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2579/5469] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:23 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1281 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:24.380649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-752adbdd-f60c-44b6-adb2-b7472db43476 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:24.381897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-752adbdd-f60c-44b6-adb2-b7472db43476 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:24.398409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:59:24.403449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-752adbdd-f60c-44b6-adb2-b7472db43476 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:24.403958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-752adbdd-f60c-44b6-adb2-b7472db43476 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:24.404411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-752adbdd-f60c-44b6-adb2-b7472db43476 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:24.405154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-752adbdd-f60c-44b6-adb2-b7472db43476 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:24.405635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-752adbdd-f60c-44b6-adb2-b7472db43476 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:24.406064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-752adbdd-f60c-44b6-adb2-b7472db43476 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:24.894940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-752adbdd-f60c-44b6-adb2-b7472db43476 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:24.910120 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-752adbdd-f60c-44b6-adb2-b7472db43476 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1679 microversion: 2.1 time: 0.533294 Aug 18 11:59:24.931915 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2891/5470] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:24 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1679 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:25.040664 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6f5f2ba7-0885-4b87-8b70-719eca7e76ca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:25.041843 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6f5f2ba7-0885-4b87-8b70-719eca7e76ca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:25.056512 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f5f2ba7-0885-4b87-8b70-719eca7e76ca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:25.057897 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f5f2ba7-0885-4b87-8b70-719eca7e76ca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:25.059545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f5f2ba7-0885-4b87-8b70-719eca7e76ca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:25.064698 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f5f2ba7-0885-4b87-8b70-719eca7e76ca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:25.065300 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f5f2ba7-0885-4b87-8b70-719eca7e76ca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:25.066723 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6f5f2ba7-0885-4b87-8b70-719eca7e76ca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:25.944325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-84d4e1df-ac2b-4466-9cf7-2307c778bd04 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:25.956237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-84d4e1df-ac2b-4466-9cf7-2307c778bd04 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:25.978976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6f5f2ba7-0885-4b87-8b70-719eca7e76ca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:25.997102 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6f5f2ba7-0885-4b87-8b70-719eca7e76ca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1281 microversion: 2.1 time: 0.960669 Aug 18 11:59:25.997709 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2580/5471] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:25 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1281 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:26.032721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84d4e1df-ac2b-4466-9cf7-2307c778bd04 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:26.034882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84d4e1df-ac2b-4466-9cf7-2307c778bd04 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:26.035547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84d4e1df-ac2b-4466-9cf7-2307c778bd04 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:26.039560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84d4e1df-ac2b-4466-9cf7-2307c778bd04 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:26.040361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84d4e1df-ac2b-4466-9cf7-2307c778bd04 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:26.041510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84d4e1df-ac2b-4466-9cf7-2307c778bd04 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:26.466922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-84d4e1df-ac2b-4466-9cf7-2307c778bd04 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:26.483799 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-84d4e1df-ac2b-4466-9cf7-2307c778bd04 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1679 microversion: 2.1 time: 0.548833 Aug 18 11:59:26.486164 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2892/5472] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:25 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1679 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:59:27.041681 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c799f25f-9212-4871-8a7c-0dcdf9b24e79 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:27.042382 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c799f25f-9212-4871-8a7c-0dcdf9b24e79 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:27.059558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c799f25f-9212-4871-8a7c-0dcdf9b24e79 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:27.060070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c799f25f-9212-4871-8a7c-0dcdf9b24e79 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:27.066610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c799f25f-9212-4871-8a7c-0dcdf9b24e79 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:27.067420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c799f25f-9212-4871-8a7c-0dcdf9b24e79 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:27.067906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c799f25f-9212-4871-8a7c-0dcdf9b24e79 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:27.072542 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c799f25f-9212-4871-8a7c-0dcdf9b24e79 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:27.496973 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-c799f25f-9212-4871-8a7c-0dcdf9b24e79 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:27.505326 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c799f25f-9212-4871-8a7c-0dcdf9b24e79 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1281 microversion: 2.1 time: 0.468259 Aug 18 11:59:27.512011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1bb24898-d3b1-4af6-95af-7544665598f0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:27.512630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1bb24898-d3b1-4af6-95af-7544665598f0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:27.512832 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2581/5473] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:27 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1281 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:27.532238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb24898-d3b1-4af6-95af-7544665598f0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:27.533218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb24898-d3b1-4af6-95af-7544665598f0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:27.533867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb24898-d3b1-4af6-95af-7544665598f0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:27.534986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb24898-d3b1-4af6-95af-7544665598f0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:27.536221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb24898-d3b1-4af6-95af-7544665598f0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:27.536834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bb24898-d3b1-4af6-95af-7544665598f0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:27.982878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1bb24898-d3b1-4af6-95af-7544665598f0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:27.994987 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1bb24898-d3b1-4af6-95af-7544665598f0 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1679 microversion: 2.1 time: 0.487351 Aug 18 11:59:27.996240 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2893/5474] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:27 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1679 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:28.530804 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3acc9c1e-6d1e-474d-8626-98429f510dc9 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:28.531431 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3acc9c1e-6d1e-474d-8626-98429f510dc9 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:28.559231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3acc9c1e-6d1e-474d-8626-98429f510dc9 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:28.559847 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3acc9c1e-6d1e-474d-8626-98429f510dc9 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:28.566810 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3acc9c1e-6d1e-474d-8626-98429f510dc9 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:28.567686 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3acc9c1e-6d1e-474d-8626-98429f510dc9 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:28.568168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3acc9c1e-6d1e-474d-8626-98429f510dc9 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:28.568609 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3acc9c1e-6d1e-474d-8626-98429f510dc9 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:29.019222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1f4a860c-235e-4a06-bfab-8947da37fd41 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:29.019789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1f4a860c-235e-4a06-bfab-8947da37fd41 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:29.031744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f4a860c-235e-4a06-bfab-8947da37fd41 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:29.038576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f4a860c-235e-4a06-bfab-8947da37fd41 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:29.039496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f4a860c-235e-4a06-bfab-8947da37fd41 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:29.040422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f4a860c-235e-4a06-bfab-8947da37fd41 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:29.041060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f4a860c-235e-4a06-bfab-8947da37fd41 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:29.041655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f4a860c-235e-4a06-bfab-8947da37fd41 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:29.197295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1f4a860c-235e-4a06-bfab-8947da37fd41 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:29.209586 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1f4a860c-235e-4a06-bfab-8947da37fd41 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1612 microversion: 2.1 time: 0.195784 Aug 18 11:59:29.212914 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2894/5475] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:29 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1612 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 11:59:29.687627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3acc9c1e-6d1e-474d-8626-98429f510dc9 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:29.735267 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3acc9c1e-6d1e-474d-8626-98429f510dc9 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1281 microversion: 2.1 time: 1.191971 Aug 18 11:59:29.735980 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2582/5476] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:28 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1281 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:29.986219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-36191f75-8d31-4e84-9ed1-d024eb60395d req-be297c67-04c5-451d-8fe9-dd0b2ba98c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d858006-1223-472d-bf15-891c83ce6d4a", "name": "network-vif-deleted", "tag": "c27eddb0-4d1e-4d0d-bc11-b70105bff1f7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:59:30.036019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-36191f75-8d31-4e84-9ed1-d024eb60395d req-be297c67-04c5-451d-8fe9-dd0b2ba98c27 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:30.048018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-36191f75-8d31-4e84-9ed1-d024eb60395d req-be297c67-04c5-451d-8fe9-dd0b2ba98c27 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:30.048707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-36191f75-8d31-4e84-9ed1-d024eb60395d req-be297c67-04c5-451d-8fe9-dd0b2ba98c27 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:30.102349 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-36191f75-8d31-4e84-9ed1-d024eb60395d req-be297c67-04c5-451d-8fe9-dd0b2ba98c27 service nova] Creating event network-vif-deleted:c27eddb0-4d1e-4d0d-bc11-b70105bff1f7 for instance 3d858006-1223-472d-bf15-891c83ce6d4a on n-h2-853611-3 Aug 18 11:59:30.128263 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-36191f75-8d31-4e84-9ed1-d024eb60395d req-be297c67-04c5-451d-8fe9-dd0b2ba98c27 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146885 Aug 18 11:59:30.134873 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2895/5477] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 11:59:30.241454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-27e89af3-d78a-44d4-af12-63d36a875724 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:30.242093 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-27e89af3-d78a-44d4-af12-63d36a875724 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:30.253523 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e89af3-d78a-44d4-af12-63d36a875724 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:30.256044 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e89af3-d78a-44d4-af12-63d36a875724 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:30.256509 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e89af3-d78a-44d4-af12-63d36a875724 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:30.257814 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e89af3-d78a-44d4-af12-63d36a875724 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:30.258522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e89af3-d78a-44d4-af12-63d36a875724 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:30.258752 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e89af3-d78a-44d4-af12-63d36a875724 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:30.269541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:59:30.358763 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e89af3-d78a-44d4-af12-63d36a875724 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:30.359496 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e89af3-d78a-44d4-af12-63d36a875724 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:30.359963 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-27e89af3-d78a-44d4-af12-63d36a875724 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:30.360436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-27e89af3-d78a-44d4-af12-63d36a875724 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lazy-loading 'fault' on Instance uuid 3d858006-1223-472d-bf15-891c83ce6d4a {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 11:59:30.494677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-27e89af3-d78a-44d4-af12-63d36a875724 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4b3c7d38a540f19d88bf28c83cf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4a3296e2a40fe96cb7994b2e3720b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:30.515091 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-27e89af3-d78a-44d4-af12-63d36a875724 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 200 len: 1330 microversion: 2.1 time: 0.266989 Aug 18 11:59:30.520107 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2583/5478] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:30 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 1330 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:30.759756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1555fc6f-51aa-4438-8783-4b26c465510e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:30.760909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1555fc6f-51aa-4438-8783-4b26c465510e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:30.773775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1555fc6f-51aa-4438-8783-4b26c465510e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:30.774295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1555fc6f-51aa-4438-8783-4b26c465510e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:30.774787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1555fc6f-51aa-4438-8783-4b26c465510e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:30.775517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1555fc6f-51aa-4438-8783-4b26c465510e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:30.775974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1555fc6f-51aa-4438-8783-4b26c465510e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:30.776401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1555fc6f-51aa-4438-8783-4b26c465510e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:31.545030 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8966e8f1-a90e-4e5b-848b-46816be4fece tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:31.546086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8966e8f1-a90e-4e5b-848b-46816be4fece tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:31.584202 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8966e8f1-a90e-4e5b-848b-46816be4fece tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:31.584760 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8966e8f1-a90e-4e5b-848b-46816be4fece tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:31.585900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8966e8f1-a90e-4e5b-848b-46816be4fece tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:31.587869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8966e8f1-a90e-4e5b-848b-46816be4fece tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:31.588370 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8966e8f1-a90e-4e5b-848b-46816be4fece tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:31.588796 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8966e8f1-a90e-4e5b-848b-46816be4fece tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:31.641868 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-8966e8f1-a90e-4e5b-848b-46816be4fece tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] HTTP exception thrown: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8966e8f1-a90e-4e5b-848b-46816be4fece tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Request method failure captured: Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a HTTP/1.1 Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_if1x16WBMpc3s4OH8sjm3tHJjaZqQcRpU1oiMS-p1WI1YrRSC2t7-vlFi9T8Z71n1HUxo4fP6nRLR16BbxlLWyXqp2clERspIcMb_jAedcCu_hp9tsk0cAtcafVC7hlv2fQVmuiFfoXUzkmUNLY6LwwQl_4XOvH_miTFCjGf1SoX08 Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1e4b3c7d38a540f19d88bf28c83cf9a6 Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3d858006-1223-472d-bf15-891c83ce6d4a'} Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:59:31.650061 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:31.654850 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:31.654850 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:59:31.654850 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:59:31.654850 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:59:31.654850 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:59:31.654850 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:31.654850 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:31.654850 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8966e8f1-a90e-4e5b-848b-46816be4fece tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Returning 404 to user: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:59:31.654850 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8966e8f1-a90e-4e5b-848b-46816be4fece tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 404 len: 111 microversion: 2.1 time: 0.115387 Aug 18 11:59:31.654850 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2584/5479] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:31 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:59:31.675271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1a27c3f6-78cb-4927-825c-030abbbdd53f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '.version_select at 0x7f519e403160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:31.724766 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1a27c3f6-78cb-4927-825c-030abbbdd53f tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-364564421" status: 202 len: 0 microversion: 2.1 time: 0.067675 Aug 18 11:59:31.727823 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2585/5480] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 18 11:59:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-364564421 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 11:59:32.359193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1555fc6f-51aa-4438-8783-4b26c465510e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:32.368372 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1555fc6f-51aa-4438-8783-4b26c465510e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1281 microversion: 2.1 time: 1.614430 Aug 18 11:59:32.378965 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2896/5481] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:30 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1281 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:33.390085 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-3bab2ff2-99c5-4518-bd4f-4ea673210dbf tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:33.390900 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-3bab2ff2-99c5-4518-bd4f-4ea673210dbf tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:33.406766 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bab2ff2-99c5-4518-bd4f-4ea673210dbf tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:33.411150 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bab2ff2-99c5-4518-bd4f-4ea673210dbf tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:33.412876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bab2ff2-99c5-4518-bd4f-4ea673210dbf tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:33.416045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bab2ff2-99c5-4518-bd4f-4ea673210dbf tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:33.416762 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bab2ff2-99c5-4518-bd4f-4ea673210dbf tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:33.418975 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-3bab2ff2-99c5-4518-bd4f-4ea673210dbf tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:33.978196 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-3bab2ff2-99c5-4518-bd4f-4ea673210dbf tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:33.990458 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-3bab2ff2-99c5-4518-bd4f-4ea673210dbf tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1281 microversion: 2.1 time: 0.604319 Aug 18 11:59:33.992003 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2586/5482] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:33 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1281 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:35.025567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cf1ea2e3-2cee-4b0a-9677-0efa6965d578 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:35.026397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cf1ea2e3-2cee-4b0a-9677-0efa6965d578 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:35.101734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf1ea2e3-2cee-4b0a-9677-0efa6965d578 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:35.102690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf1ea2e3-2cee-4b0a-9677-0efa6965d578 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:35.103516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf1ea2e3-2cee-4b0a-9677-0efa6965d578 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:35.104460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf1ea2e3-2cee-4b0a-9677-0efa6965d578 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:35.105782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf1ea2e3-2cee-4b0a-9677-0efa6965d578 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:35.107494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf1ea2e3-2cee-4b0a-9677-0efa6965d578 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:35.143135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:59:35.440030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cf1ea2e3-2cee-4b0a-9677-0efa6965d578 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:35.451504 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cf1ea2e3-2cee-4b0a-9677-0efa6965d578 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1269 microversion: 2.1 time: 0.442119 Aug 18 11:59:35.472131 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2897/5483] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:35 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1269 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:36.475402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-d3c879e0-cede-41f3-88e2-318165ef0a9e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:36.478005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-d3c879e0-cede-41f3-88e2-318165ef0a9e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:36.489107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3c879e0-cede-41f3-88e2-318165ef0a9e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:36.490906 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3c879e0-cede-41f3-88e2-318165ef0a9e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:36.492247 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3c879e0-cede-41f3-88e2-318165ef0a9e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:36.494377 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3c879e0-cede-41f3-88e2-318165ef0a9e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:36.495217 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3c879e0-cede-41f3-88e2-318165ef0a9e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:36.496291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-d3c879e0-cede-41f3-88e2-318165ef0a9e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:36.827650 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-d3c879e0-cede-41f3-88e2-318165ef0a9e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:36.836385 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-d3c879e0-cede-41f3-88e2-318165ef0a9e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1269 microversion: 2.1 time: 0.365407 Aug 18 11:59:36.839258 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2587/5484] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:36 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1269 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:37.874607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1534e7f-a553-456c-a68d-70972e6c0412 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:37.875482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1534e7f-a553-456c-a68d-70972e6c0412 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:37.890338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1534e7f-a553-456c-a68d-70972e6c0412 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:37.890886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1534e7f-a553-456c-a68d-70972e6c0412 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:37.891414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1534e7f-a553-456c-a68d-70972e6c0412 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:37.892151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1534e7f-a553-456c-a68d-70972e6c0412 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:37.892677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1534e7f-a553-456c-a68d-70972e6c0412 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:37.893110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1534e7f-a553-456c-a68d-70972e6c0412 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:38.301711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a1534e7f-a553-456c-a68d-70972e6c0412 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:38.321887 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1534e7f-a553-456c-a68d-70972e6c0412 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1269 microversion: 2.1 time: 0.460499 Aug 18 11:59:38.323011 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2898/5485] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:37 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1269 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:39.346504 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-111d2c74-991e-4f3c-ba1e-7e5baa1bd429 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:39.347137 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-111d2c74-991e-4f3c-ba1e-7e5baa1bd429 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:39.350580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:59:39.383201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-111d2c74-991e-4f3c-ba1e-7e5baa1bd429 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:39.385131 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-111d2c74-991e-4f3c-ba1e-7e5baa1bd429 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:39.388294 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-111d2c74-991e-4f3c-ba1e-7e5baa1bd429 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:39.391491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-111d2c74-991e-4f3c-ba1e-7e5baa1bd429 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:39.393658 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-111d2c74-991e-4f3c-ba1e-7e5baa1bd429 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:39.396409 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-111d2c74-991e-4f3c-ba1e-7e5baa1bd429 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:40.120876 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-111d2c74-991e-4f3c-ba1e-7e5baa1bd429 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:40.136688 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-111d2c74-991e-4f3c-ba1e-7e5baa1bd429 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1269 microversion: 2.1 time: 0.792650 Aug 18 11:59:40.138740 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2588/5486] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:39 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1269 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:41.166061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f0ea5a5b-5d87-469c-8765-c95aa5580afe tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:41.170515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f0ea5a5b-5d87-469c-8765-c95aa5580afe tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:41.181694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=41 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 11:59:41.193400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0ea5a5b-5d87-469c-8765-c95aa5580afe tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:41.198473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0ea5a5b-5d87-469c-8765-c95aa5580afe tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:41.200201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0ea5a5b-5d87-469c-8765-c95aa5580afe tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:41.202498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0ea5a5b-5d87-469c-8765-c95aa5580afe tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:41.205730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0ea5a5b-5d87-469c-8765-c95aa5580afe tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:41.206813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0ea5a5b-5d87-469c-8765-c95aa5580afe tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:41.576104 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-80a7effa-5475-46bf-8880-619c13d1d5aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:41.576552 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-80a7effa-5475-46bf-8880-619c13d1d5aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:41.596346 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80a7effa-5475-46bf-8880-619c13d1d5aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:41.596851 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80a7effa-5475-46bf-8880-619c13d1d5aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:41.599330 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80a7effa-5475-46bf-8880-619c13d1d5aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:41.600103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80a7effa-5475-46bf-8880-619c13d1d5aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:41.602531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80a7effa-5475-46bf-8880-619c13d1d5aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:41.603381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-80a7effa-5475-46bf-8880-619c13d1d5aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:41.604923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f0ea5a5b-5d87-469c-8765-c95aa5580afe tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:41.625123 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-80a7effa-5475-46bf-8880-619c13d1d5aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] HTTP exception thrown: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-80a7effa-5475-46bf-8880-619c13d1d5aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Request method failure captured: Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a HTTP/1.1 Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_if1x16WBMpc3s4OH8sjm3tHJjaZqQcRpU1oiMS-p1WI1YrRSC2t7-vlFi9T8Z71n1HUxo4fP6nRLR16BbxlLWyXqp2clERspIcMb_jAedcCu_hp9tsk0cAtcafVC7hlv2fQVmuiFfoXUzkmUNLY6LwwQl_4XOvH_miTFCjGf1SoX08 Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1e4b3c7d38a540f19d88bf28c83cf9a6 Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3d858006-1223-472d-bf15-891c83ce6d4a'} Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:59:41.627460 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:59:41.632619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:41.632619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:41.632619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:59:41.632619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:41.632619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:41.632619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:59:41.632619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:59:41.632619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:59:41.632619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:59:41.632619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:41.632619 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:41.634332 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-80a7effa-5475-46bf-8880-619c13d1d5aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Returning 404 to user: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:59:41.635595 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-80a7effa-5475-46bf-8880-619c13d1d5aa tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 404 len: 111 microversion: 2.1 time: 0.063565 Aug 18 11:59:41.636514 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2589/5487] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:59:41 2022] DELETE /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:59:41.651420 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a9a5f1a4-a279-4314-9df2-29bcd0d219d2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:41.654044 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f0ea5a5b-5d87-469c-8765-c95aa5580afe tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1269 microversion: 2.1 time: 0.491241 Aug 18 11:59:41.655969 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a9a5f1a4-a279-4314-9df2-29bcd0d219d2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 3d858006-1223-472d-bf15-891c83ce6d4a] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:41.668860 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2899/5488] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:41 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1269 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:41.682207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9a5f1a4-a279-4314-9df2-29bcd0d219d2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:41.683492 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9a5f1a4-a279-4314-9df2-29bcd0d219d2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:41.685844 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9a5f1a4-a279-4314-9df2-29bcd0d219d2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:41.688544 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9a5f1a4-a279-4314-9df2-29bcd0d219d2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:41.692857 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9a5f1a4-a279-4314-9df2-29bcd0d219d2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:41.697662 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a9a5f1a4-a279-4314-9df2-29bcd0d219d2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:41.765389 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-a9a5f1a4-a279-4314-9df2-29bcd0d219d2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] HTTP exception thrown: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a9a5f1a4-a279-4314-9df2-29bcd0d219d2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Request method failure captured: Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a HTTP/1.1 Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_if1x16WBMpc3s4OH8sjm3tHJjaZqQcRpU1oiMS-p1WI1YrRSC2t7-vlFi9T8Z71n1HUxo4fP6nRLR16BbxlLWyXqp2clERspIcMb_jAedcCu_hp9tsk0cAtcafVC7hlv2fQVmuiFfoXUzkmUNLY6LwwQl_4XOvH_miTFCjGf1SoX08 Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1e4b3c7d38a540f19d88bf28c83cf9a6 Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '3d858006-1223-472d-bf15-891c83ce6d4a'} Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:59:41.776526 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:41.785541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:41.785541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:59:41.785541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:59:41.785541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:59:41.785541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:59:41.785541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. Aug 18 11:59:41.785541 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:41.791295 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a9a5f1a4-a279-4314-9df2-29bcd0d219d2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Returning 404 to user: Instance 3d858006-1223-472d-bf15-891c83ce6d4a could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:59:41.801903 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a9a5f1a4-a279-4314-9df2-29bcd0d219d2 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a" status: 404 len: 111 microversion: 2.1 time: 0.153607 Aug 18 11:59:41.803281 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2590/5489] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:41 2022] GET /compute/v2.1/servers/3d858006-1223-472d-bf15-891c83ce6d4a => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:59:42.686584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9a0b07ba-70ec-499e-89fd-fc6d6583d105 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:42.687794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9a0b07ba-70ec-499e-89fd-fc6d6583d105 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:42.703819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a0b07ba-70ec-499e-89fd-fc6d6583d105 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:42.707657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a0b07ba-70ec-499e-89fd-fc6d6583d105 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:42.711492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a0b07ba-70ec-499e-89fd-fc6d6583d105 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:42.712593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a0b07ba-70ec-499e-89fd-fc6d6583d105 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:42.713514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a0b07ba-70ec-499e-89fd-fc6d6583d105 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:42.714122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a0b07ba-70ec-499e-89fd-fc6d6583d105 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:43.378136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9a0b07ba-70ec-499e-89fd-fc6d6583d105 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:43.394164 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9a0b07ba-70ec-499e-89fd-fc6d6583d105 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1269 microversion: 2.1 time: 0.713007 Aug 18 11:59:43.410651 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2900/5490] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:42 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1269 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:44.417803 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4171d5fc-a504-4655-a281-c06886851175 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:44.418464 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4171d5fc-a504-4655-a281-c06886851175 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:44.438005 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4171d5fc-a504-4655-a281-c06886851175 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:44.443011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4171d5fc-a504-4655-a281-c06886851175 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:44.443551 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4171d5fc-a504-4655-a281-c06886851175 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:44.444428 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4171d5fc-a504-4655-a281-c06886851175 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:44.445045 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4171d5fc-a504-4655-a281-c06886851175 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:44.445641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4171d5fc-a504-4655-a281-c06886851175 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:44.834281 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4171d5fc-a504-4655-a281-c06886851175 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:44.851873 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4171d5fc-a504-4655-a281-c06886851175 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1269 microversion: 2.1 time: 0.438509 Aug 18 11:59:44.858222 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2591/5491] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:44 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1269 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:45.893090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ea7df62-a31d-4064-a44c-9f97d8dbb7ec tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:45.899056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6ea7df62-a31d-4064-a44c-9f97d8dbb7ec tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:45.937404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ea7df62-a31d-4064-a44c-9f97d8dbb7ec tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:45.938699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ea7df62-a31d-4064-a44c-9f97d8dbb7ec tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:45.939743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ea7df62-a31d-4064-a44c-9f97d8dbb7ec tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:45.941991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ea7df62-a31d-4064-a44c-9f97d8dbb7ec tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:45.944259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ea7df62-a31d-4064-a44c-9f97d8dbb7ec tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:45.946331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ea7df62-a31d-4064-a44c-9f97d8dbb7ec tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:46.528172 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-4d8f1e01-8037-4f56-9e9b-347b1a6afc15 req-9eb259ba-27eb-49a4-afd3-cfbcb7b8e469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77328cb-e6b5-40dd-b8ed-788cc97b88c5", "name": "network-vif-plugged", "status": "completed", "tag": "020695c4-3b6d-4b22-a562-e51f623cef2b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:59:46.559299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4d8f1e01-8037-4f56-9e9b-347b1a6afc15 req-9eb259ba-27eb-49a4-afd3-cfbcb7b8e469 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:46.565206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4d8f1e01-8037-4f56-9e9b-347b1a6afc15 req-9eb259ba-27eb-49a4-afd3-cfbcb7b8e469 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:46.566956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-4d8f1e01-8037-4f56-9e9b-347b1a6afc15 req-9eb259ba-27eb-49a4-afd3-cfbcb7b8e469 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:46.604464 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-4d8f1e01-8037-4f56-9e9b-347b1a6afc15 req-9eb259ba-27eb-49a4-afd3-cfbcb7b8e469 service nova] Creating event network-vif-plugged:020695c4-3b6d-4b22-a562-e51f623cef2b for instance e77328cb-e6b5-40dd-b8ed-788cc97b88c5 on n-h1-853611-3 Aug 18 11:59:46.631623 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-4d8f1e01-8037-4f56-9e9b-347b1a6afc15 req-9eb259ba-27eb-49a4-afd3-cfbcb7b8e469 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107794 Aug 18 11:59:46.634016 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2592/5492] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 11:59:46.943890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6ea7df62-a31d-4064-a44c-9f97d8dbb7ec tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:46.962181 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6ea7df62-a31d-4064-a44c-9f97d8dbb7ec tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1269 microversion: 2.1 time: 1.081303 Aug 18 11:59:46.968176 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2901/5493] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:45 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1269 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:48.009942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f48a3509-a7f5-4c27-9a94-5ecd146847e7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:48.010764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f48a3509-a7f5-4c27-9a94-5ecd146847e7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:48.042201 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f48a3509-a7f5-4c27-9a94-5ecd146847e7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:48.050121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f48a3509-a7f5-4c27-9a94-5ecd146847e7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:48.050842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f48a3509-a7f5-4c27-9a94-5ecd146847e7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:48.051730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f48a3509-a7f5-4c27-9a94-5ecd146847e7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:48.052220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f48a3509-a7f5-4c27-9a94-5ecd146847e7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:48.052665 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f48a3509-a7f5-4c27-9a94-5ecd146847e7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:48.615630 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f48a3509-a7f5-4c27-9a94-5ecd146847e7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:48.651020 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f48a3509-a7f5-4c27-9a94-5ecd146847e7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1269 microversion: 2.1 time: 0.646604 Aug 18 11:59:48.654710 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2593/5494] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:48 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1269 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:49.716557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-33a7bd74-f864-46c6-aea3-e2719c27763e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:49.717409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-33a7bd74-f864-46c6-aea3-e2719c27763e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:49.738089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33a7bd74-f864-46c6-aea3-e2719c27763e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:49.754556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33a7bd74-f864-46c6-aea3-e2719c27763e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:49.759518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33a7bd74-f864-46c6-aea3-e2719c27763e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:49.762561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33a7bd74-f864-46c6-aea3-e2719c27763e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:49.769573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33a7bd74-f864-46c6-aea3-e2719c27763e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:49.773778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33a7bd74-f864-46c6-aea3-e2719c27763e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:50.498027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8b85a5df-124c-4cfe-8c7b-6c934a0e60ec tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:50.499482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8b85a5df-124c-4cfe-8c7b-6c934a0e60ec tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:50.516905 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b85a5df-124c-4cfe-8c7b-6c934a0e60ec tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:50.517416 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b85a5df-124c-4cfe-8c7b-6c934a0e60ec tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:50.517863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b85a5df-124c-4cfe-8c7b-6c934a0e60ec tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:50.518807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b85a5df-124c-4cfe-8c7b-6c934a0e60ec tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:50.519271 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b85a5df-124c-4cfe-8c7b-6c934a0e60ec tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:50.523342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8b85a5df-124c-4cfe-8c7b-6c934a0e60ec tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:50.572319 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-8b85a5df-124c-4cfe-8c7b-6c934a0e60ec tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] HTTP exception thrown: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8b85a5df-124c-4cfe-8c7b-6c934a0e60ec tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Request method failure captured: Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 HTTP/1.1 Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_if1x16WBMpc3s4OH8sjm3tHJjaZqQcRpU1oiMS-p1WI1YrRSC2t7-vlFi9T8Z71n1HUxo4fP6nRLR16BbxlLWyXqp2clERspIcMb_jAedcCu_hp9tsk0cAtcafVC7hlv2fQVmuiFfoXUzkmUNLY6LwwQl_4XOvH_miTFCjGf1SoX08 Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1e4b3c7d38a540f19d88bf28c83cf9a6 Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '2ee32c00-b94f-4934-8b57-31d670dd8ea2'} Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:59:50.574422 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:59:50.578827 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:59:50.578827 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.578827 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:59:50.578827 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.578827 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:50.578827 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:59:50.578827 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:59:50.578827 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:59:50.578827 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:59:50.578827 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:59:50.578827 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.581049 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8b85a5df-124c-4cfe-8c7b-6c934a0e60ec tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Returning 404 to user: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:59:50.590834 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8b85a5df-124c-4cfe-8c7b-6c934a0e60ec tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 404 len: 111 microversion: 2.1 time: 0.096586 Aug 18 11:59:50.592088 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2594/5495] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:59:50 2022] DELETE /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:59:50.601593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5bdf4cbd-d24f-480b-90ec-611a2509145d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:50.602527 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5bdf4cbd-d24f-480b-90ec-611a2509145d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 2ee32c00-b94f-4934-8b57-31d670dd8ea2] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:50.618976 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bdf4cbd-d24f-480b-90ec-611a2509145d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:50.619949 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bdf4cbd-d24f-480b-90ec-611a2509145d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:50.620598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bdf4cbd-d24f-480b-90ec-611a2509145d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:50.623659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bdf4cbd-d24f-480b-90ec-611a2509145d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:50.627051 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bdf4cbd-d24f-480b-90ec-611a2509145d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:50.627815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5bdf4cbd-d24f-480b-90ec-611a2509145d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:50.660701 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-5bdf4cbd-d24f-480b-90ec-611a2509145d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] HTTP exception thrown: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5bdf4cbd-d24f-480b-90ec-611a2509145d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Request method failure captured: Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 HTTP/1.1 Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_if1x16WBMpc3s4OH8sjm3tHJjaZqQcRpU1oiMS-p1WI1YrRSC2t7-vlFi9T8Z71n1HUxo4fP6nRLR16BbxlLWyXqp2clERspIcMb_jAedcCu_hp9tsk0cAtcafVC7hlv2fQVmuiFfoXUzkmUNLY6LwwQl_4XOvH_miTFCjGf1SoX08 Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1e4b3c7d38a540f19d88bf28c83cf9a6 Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '2ee32c00-b94f-4934-8b57-31d670dd8ea2'} Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:59:50.662683 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.666947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:50.666947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:59:50.666947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:59:50.666947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:59:50.666947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:59:50.666947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. Aug 18 11:59:50.666947 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.679742 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5bdf4cbd-d24f-480b-90ec-611a2509145d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Returning 404 to user: Instance 2ee32c00-b94f-4934-8b57-31d670dd8ea2 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:59:50.681447 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5bdf4cbd-d24f-480b-90ec-611a2509145d tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2" status: 404 len: 111 microversion: 2.1 time: 0.085232 Aug 18 11:59:50.682892 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2595/5496] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:50 2022] GET /compute/v2.1/servers/2ee32c00-b94f-4934-8b57-31d670dd8ea2 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:59:50.701633 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c51f8520-5cd8-4c1e-9d9f-3ce2cac3ab5e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:50.702588 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c51f8520-5cd8-4c1e-9d9f-3ce2cac3ab5e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:50.711914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c51f8520-5cd8-4c1e-9d9f-3ce2cac3ab5e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:50.714674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c51f8520-5cd8-4c1e-9d9f-3ce2cac3ab5e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:50.716422 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c51f8520-5cd8-4c1e-9d9f-3ce2cac3ab5e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:50.719392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c51f8520-5cd8-4c1e-9d9f-3ce2cac3ab5e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:50.720210 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c51f8520-5cd8-4c1e-9d9f-3ce2cac3ab5e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:50.721524 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-c51f8520-5cd8-4c1e-9d9f-3ce2cac3ab5e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:50.763673 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-c51f8520-5cd8-4c1e-9d9f-3ce2cac3ab5e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] HTTP exception thrown: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c51f8520-5cd8-4c1e-9d9f-3ce2cac3ab5e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Request method failure captured: Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 HTTP/1.1 Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_if1x16WBMpc3s4OH8sjm3tHJjaZqQcRpU1oiMS-p1WI1YrRSC2t7-vlFi9T8Z71n1HUxo4fP6nRLR16BbxlLWyXqp2clERspIcMb_jAedcCu_hp9tsk0cAtcafVC7hlv2fQVmuiFfoXUzkmUNLY6LwwQl_4XOvH_miTFCjGf1SoX08 Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1e4b3c7d38a540f19d88bf28c83cf9a6 Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '6c9809a8-4788-41b8-bc8a-584344c37102'} Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:59:50.767989 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:59:50.772011 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:59:50.772011 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.772011 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:59:50.772011 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.772011 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:50.772011 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:59:50.772011 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:59:50.772011 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:59:50.772011 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:59:50.772011 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:59:50.772011 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.772011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c51f8520-5cd8-4c1e-9d9f-3ce2cac3ab5e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Returning 404 to user: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:59:50.774117 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c51f8520-5cd8-4c1e-9d9f-3ce2cac3ab5e tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 404 len: 111 microversion: 2.1 time: 0.083382 Aug 18 11:59:50.774893 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2596/5497] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 11:59:50 2022] DELETE /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 11:59:50.783325 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1dc3db8f-cac8-476c-80a1-4df4dd644340 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:50.789240 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-1dc3db8f-cac8-476c-80a1-4df4dd644340 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 6c9809a8-4788-41b8-bc8a-584344c37102] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:50.808616 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dc3db8f-cac8-476c-80a1-4df4dd644340 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:50.809262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dc3db8f-cac8-476c-80a1-4df4dd644340 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:50.809725 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dc3db8f-cac8-476c-80a1-4df4dd644340 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:50.810573 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dc3db8f-cac8-476c-80a1-4df4dd644340 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:50.811136 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dc3db8f-cac8-476c-80a1-4df4dd644340 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:50.811641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-1dc3db8f-cac8-476c-80a1-4df4dd644340 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:50.852338 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-1dc3db8f-cac8-476c-80a1-4df4dd644340 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] HTTP exception thrown: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1dc3db8f-cac8-476c-80a1-4df4dd644340 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Request method failure captured: Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 HTTP/1.1 Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_if1x16WBMpc3s4OH8sjm3tHJjaZqQcRpU1oiMS-p1WI1YrRSC2t7-vlFi9T8Z71n1HUxo4fP6nRLR16BbxlLWyXqp2clERspIcMb_jAedcCu_hp9tsk0cAtcafVC7hlv2fQVmuiFfoXUzkmUNLY6LwwQl_4XOvH_miTFCjGf1SoX08 Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1e4b3c7d38a540f19d88bf28c83cf9a6 Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '6c9809a8-4788-41b8-bc8a-584344c37102'} Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 11:59:50.854165 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.862388 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 11:59:50.862388 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 11:59:50.862388 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 11:59:50.862388 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 11:59:50.862388 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 11:59:50.862388 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. Aug 18 11:59:50.862388 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 11:59:50.862388 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1dc3db8f-cac8-476c-80a1-4df4dd644340 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Returning 404 to user: Instance 6c9809a8-4788-41b8-bc8a-584344c37102 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 11:59:50.862388 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1dc3db8f-cac8-476c-80a1-4df4dd644340 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102" status: 404 len: 111 microversion: 2.1 time: 0.076304 Aug 18 11:59:50.862388 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2597/5498] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:50 2022] GET /compute/v2.1/servers/6c9809a8-4788-41b8-bc8a-584344c37102 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 11:59:50.961838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-33a7bd74-f864-46c6-aea3-e2719c27763e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:50.986901 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-33a7bd74-f864-46c6-aea3-e2719c27763e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1457 microversion: 2.1 time: 1.273530 Aug 18 11:59:50.990795 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2902/5499] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:49 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1457 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:51.013838 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a3464fca-2d0b-40ac-9f2d-0bb424b2cbca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 11:59:51.014677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a3464fca-2d0b-40ac-9f2d-0bb424b2cbca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 11:59:51.025815 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3464fca-2d0b-40ac-9f2d-0bb424b2cbca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:51.031015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3464fca-2d0b-40ac-9f2d-0bb424b2cbca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:51.035390 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3464fca-2d0b-40ac-9f2d-0bb424b2cbca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:51.036316 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3464fca-2d0b-40ac-9f2d-0bb424b2cbca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:51.039627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3464fca-2d0b-40ac-9f2d-0bb424b2cbca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:51.040218 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3464fca-2d0b-40ac-9f2d-0bb424b2cbca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:51.551315 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a3464fca-2d0b-40ac-9f2d-0bb424b2cbca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 11:59:51.563451 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a3464fca-2d0b-40ac-9f2d-0bb424b2cbca tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1457 microversion: 2.1 time: 0.553812 Aug 18 11:59:51.578463 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2598/5500] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 11:59:51 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1457 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 11:59:56.609572 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 11:59:56.610037 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 11:59:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 11:59:56.965473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8d7355a1-9fb0-49a8-9486-b22eef800118 req-6dc80a8a-a33c-471d-8168-f35d1894024a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77328cb-e6b5-40dd-b8ed-788cc97b88c5", "tag": "020695c4-3b6d-4b22-a562-e51f623cef2b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 11:59:56.982375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8d7355a1-9fb0-49a8-9486-b22eef800118 req-6dc80a8a-a33c-471d-8168-f35d1894024a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 11:59:57.002608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8d7355a1-9fb0-49a8-9486-b22eef800118 req-6dc80a8a-a33c-471d-8168-f35d1894024a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 11:59:57.003311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8d7355a1-9fb0-49a8-9486-b22eef800118 req-6dc80a8a-a33c-471d-8168-f35d1894024a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 11:59:57.073660 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8d7355a1-9fb0-49a8-9486-b22eef800118 req-6dc80a8a-a33c-471d-8168-f35d1894024a service nova] Creating event network-changed:020695c4-3b6d-4b22-a562-e51f623cef2b for instance e77328cb-e6b5-40dd-b8ed-788cc97b88c5 on n-h1-853611-3 Aug 18 11:59:57.099240 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8d7355a1-9fb0-49a8-9486-b22eef800118 req-6dc80a8a-a33c-471d-8168-f35d1894024a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137437 Aug 18 11:59:57.120727 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2903/5501] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 11:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:00:02.785692 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-808ffdc3-4923-4f1c-874f-5defc885e175 req-ddebfa68-d861-4d55-9e8a-aecd57bdf9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77328cb-e6b5-40dd-b8ed-788cc97b88c5", "tag": "020695c4-3b6d-4b22-a562-e51f623cef2b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:00:02.804530 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=21 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:00:02.813830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=58 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:00:02.833829 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-808ffdc3-4923-4f1c-874f-5defc885e175 req-ddebfa68-d861-4d55-9e8a-aecd57bdf9f5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:02.843447 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-808ffdc3-4923-4f1c-874f-5defc885e175 req-ddebfa68-d861-4d55-9e8a-aecd57bdf9f5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:02.844200 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-808ffdc3-4923-4f1c-874f-5defc885e175 req-ddebfa68-d861-4d55-9e8a-aecd57bdf9f5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:02.879656 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-808ffdc3-4923-4f1c-874f-5defc885e175 req-ddebfa68-d861-4d55-9e8a-aecd57bdf9f5 service nova] Creating event network-changed:020695c4-3b6d-4b22-a562-e51f623cef2b for instance e77328cb-e6b5-40dd-b8ed-788cc97b88c5 on n-h1-853611-3 Aug 18 12:00:02.892550 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-808ffdc3-4923-4f1c-874f-5defc885e175 req-ddebfa68-d861-4d55-9e8a-aecd57bdf9f5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111533 Aug 18 12:00:02.893606 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2599/5502] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:00:03.792422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b75fa117-4cb5-4f85-b7f9-c549d748be1a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:03.793193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b75fa117-4cb5-4f85-b7f9-c549d748be1a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:03.817832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b75fa117-4cb5-4f85-b7f9-c549d748be1a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:03.836041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b75fa117-4cb5-4f85-b7f9-c549d748be1a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:03.836968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b75fa117-4cb5-4f85-b7f9-c549d748be1a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:03.838219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b75fa117-4cb5-4f85-b7f9-c549d748be1a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:03.839181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b75fa117-4cb5-4f85-b7f9-c549d748be1a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:03.839900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b75fa117-4cb5-4f85-b7f9-c549d748be1a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:03.890001 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-b75fa117-4cb5-4f85-b7f9-c549d748be1a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] HTTP exception thrown: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b75fa117-4cb5-4f85-b7f9-c549d748be1a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Request method failure captured: Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 HTTP/1.1 Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_if1x16WBMpc3s4OH8sjm3tHJjaZqQcRpU1oiMS-p1WI1YrRSC2t7-vlFi9T8Z71n1HUxo4fP6nRLR16BbxlLWyXqp2clERspIcMb_jAedcCu_hp9tsk0cAtcafVC7hlv2fQVmuiFfoXUzkmUNLY6LwwQl_4XOvH_miTFCjGf1SoX08 Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 1e4b3c7d38a540f19d88bf28c83cf9a6 Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '8d41ef54-abb5-4b95-943d-219504a92c05'} Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:00:03.892526 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:00:03.896803 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 12:00:03.896803 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:03.896803 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:03.896803 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:03.896803 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:03.896803 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:00:03.896803 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:00:03.896803 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:00:03.896803 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:00:03.896803 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 12:00:03.896803 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:03.913168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b75fa117-4cb5-4f85-b7f9-c549d748be1a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Returning 404 to user: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:00:03.914865 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b75fa117-4cb5-4f85-b7f9-c549d748be1a tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 404 len: 111 microversion: 2.1 time: 0.129004 Aug 18 12:00:03.920618 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2904/5503] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:00:03 2022] DELETE /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:00:03.933865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7c6226cb-4f32-4355-ac8b-44b74a22ed99 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:03.938807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7c6226cb-4f32-4355-ac8b-44b74a22ed99 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] [instance: 8d41ef54-abb5-4b95-943d-219504a92c05] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:03.993779 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c6226cb-4f32-4355-ac8b-44b74a22ed99 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:03.995220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c6226cb-4f32-4355-ac8b-44b74a22ed99 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:03.999392 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c6226cb-4f32-4355-ac8b-44b74a22ed99 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:04.009312 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c6226cb-4f32-4355-ac8b-44b74a22ed99 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:04.013440 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c6226cb-4f32-4355-ac8b-44b74a22ed99 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:04.019208 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7c6226cb-4f32-4355-ac8b-44b74a22ed99 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:04.090768 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-7c6226cb-4f32-4355-ac8b-44b74a22ed99 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] HTTP exception thrown: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7c6226cb-4f32-4355-ac8b-44b74a22ed99 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Request method failure captured: Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: request: GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 HTTP/1.1 Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_if1x16WBMpc3s4OH8sjm3tHJjaZqQcRpU1oiMS-p1WI1YrRSC2t7-vlFi9T8Z71n1HUxo4fP6nRLR16BbxlLWyXqp2clERspIcMb_jAedcCu_hp9tsk0cAtcafVC7hlv2fQVmuiFfoXUzkmUNLY6LwwQl_4XOvH_miTFCjGf1SoX08 Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/15c4a3296e2a40fe96cb7994b2e3720b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: 15c4a3296e2a40fe96cb7994b2e3720b Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1384056244 Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 1e4b3c7d38a540f19d88bf28c83cf9a6 Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-AttachVolumeNegativeTest-1384056244-project Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: method: > Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: exception: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '8d41ef54-abb5-4b95-943d-219504a92c05'} Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:04.105454 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 12:00:04.113622 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:04.113622 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:00:04.113622 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:00:04.113622 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:00:04.113622 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:00:04.113622 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. Aug 18 12:00:04.113622 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 12:00:04.113622 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7c6226cb-4f32-4355-ac8b-44b74a22ed99 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] Returning 404 to user: Instance 8d41ef54-abb5-4b95-943d-219504a92c05 could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:00:04.113622 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7c6226cb-4f32-4355-ac8b-44b74a22ed99 tempest-AttachVolumeNegativeTest-1384056244 tempest-AttachVolumeNegativeTest-1384056244-project] 10.222.0.73 "GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05" status: 404 len: 111 microversion: 2.1 time: 0.184412 Aug 18 12:00:04.113622 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2600/5504] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:03 2022] GET /compute/v2.1/servers/8d41ef54-abb5-4b95-943d-219504a92c05 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:00:05.089639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-74797d9a-5d07-4e2f-ad60-e3017c224c04 req-ca67ac21-e9ef-45c0-90d3-a7201bead71f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77328cb-e6b5-40dd-b8ed-788cc97b88c5", "tag": "020695c4-3b6d-4b22-a562-e51f623cef2b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:00:05.134598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-74797d9a-5d07-4e2f-ad60-e3017c224c04 req-ca67ac21-e9ef-45c0-90d3-a7201bead71f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:05.142563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-74797d9a-5d07-4e2f-ad60-e3017c224c04 req-ca67ac21-e9ef-45c0-90d3-a7201bead71f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:05.150471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-74797d9a-5d07-4e2f-ad60-e3017c224c04 req-ca67ac21-e9ef-45c0-90d3-a7201bead71f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:05.175965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=37 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:00:05.233108 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-74797d9a-5d07-4e2f-ad60-e3017c224c04 req-ca67ac21-e9ef-45c0-90d3-a7201bead71f service nova] Creating event network-changed:020695c4-3b6d-4b22-a562-e51f623cef2b for instance e77328cb-e6b5-40dd-b8ed-788cc97b88c5 on n-h1-853611-3 Aug 18 12:00:05.254705 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-74797d9a-5d07-4e2f-ad60-e3017c224c04 req-ca67ac21-e9ef-45c0-90d3-a7201bead71f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173630 Aug 18 12:00:05.263710 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2905/5505] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:21.771792 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:00:21.786262 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=4 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:00:22.074554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e35f9826-c308-47dc-8a81-3844770fc8a2 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Action: 'create', calling method: .version_select at 0x7f519e3d1a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2061216982"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:00:22.973075 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e35f9826-c308-47dc-8a81-3844770fc8a2 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.216367 Aug 18 12:00:22.982895 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2601/5506] 10.222.0.73 () {60 vars in 1155 bytes} [Thu Aug 18 12:00:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1227 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 12:00:22.989406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-724b5588-e931-4c41-b75b-9665ab62434a tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f51ac255f70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:23.001253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=13 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:00:23.002758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:00:23.328563 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-724b5588-e931-4c41-b75b-9665ab62434a tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a" status: 200 len: 345 microversion: 2.1 time: 0.344335 Aug 18 12:00:23.329694 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2906/5507] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 12:00:22 2022] GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a => generated 345 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:24.346297 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-9d403786-72f9-4f82-b3b1-ffcbb2fdc91c tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519e3d1160>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:24.545919 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-9d403786-72f9-4f82-b3b1-ffcbb2fdc91c tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a" status: 200 len: 345 microversion: 2.1 time: 0.205723 Aug 18 12:00:24.546235 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2602/5508] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 12:00:24 2022] GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a => generated 345 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:25.572349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1888f28-772d-4b6d-ae9d-c205589ceedf tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519f894310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:25.700067 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1888f28-772d-4b6d-ae9d-c205589ceedf tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a" status: 200 len: 346 microversion: 2.1 time: 0.141750 Aug 18 12:00:25.701175 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2907/5509] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 12:00:25 2022] GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a => generated 346 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:25.714569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-681b6245-7206-49dd-ba5f-68560f4b9ea5 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Action: 'create', calling method: .version_select at 0x7f519e428430>, body: {"snapshot": {"volume_id": "22aa1463-4b2d-4626-b2e8-428bf57b7b7a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1443934212"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:00:26.089397 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-681b6245-7206-49dd-ba5f-68560f4b9ea5 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.379012 Aug 18 12:00:26.091040 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2603/5510] 10.222.0.73 () {60 vars in 1162 bytes} [Thu Aug 18 12:00:25 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:26.103044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8cb8d4e5-84d4-4370-877e-da5497cf0405 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519f894dc0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:26.153751 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8cb8d4e5-84d4-4370-877e-da5497cf0405 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc" status: 200 len: 287 microversion: 2.1 time: 0.055224 Aug 18 12:00:26.155079 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2908/5511] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 12:00:26 2022] GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:26.192365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4985e88a-7cad-4880-8707-ff861320c627 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519e428280>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:26.333399 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4985e88a-7cad-4880-8707-ff861320c627 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.169660 Aug 18 12:00:26.341958 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2604/5512] 10.222.0.73 () {58 vars in 1140 bytes} [Thu Aug 18 12:00:26 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:26.346515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0824e9c2-c053-42dc-b695-1b1aca2a9034 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519e842700>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:26.439781 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0824e9c2-c053-42dc-b695-1b1aca2a9034 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc" status: 200 len: 287 microversion: 2.1 time: 0.097511 Aug 18 12:00:26.444726 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2909/5513] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 12:00:26 2022] GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:27.458321 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ac2ed05c-14c5-4442-884b-a200b6be742e tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519e3fdca0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:27.573161 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ac2ed05c-14c5-4442-884b-a200b6be742e tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc" status: 200 len: 287 microversion: 2.1 time: 0.123887 Aug 18 12:00:27.574850 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2605/5514] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 12:00:27 2022] GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:28.591324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f353def1-acd5-42d3-918e-bee44d4ffa78 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519efa1670>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:28.687497 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f353def1-acd5-42d3-918e-bee44d4ffa78 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc" status: 200 len: 287 microversion: 2.1 time: 0.104309 Aug 18 12:00:28.688407 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2910/5515] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 12:00:28 2022] GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:29.719050 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-252f6e5e-2118-4b82-aca5-bc73b5305121 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519e428040>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:29.824862 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-252f6e5e-2118-4b82-aca5-bc73b5305121 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc" status: 200 len: 287 microversion: 2.1 time: 0.127050 Aug 18 12:00:29.836126 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2606/5516] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 12:00:29 2022] GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc => generated 287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:30.848083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-22bbedac-0fe3-4d3a-bd7d-c96848d38795 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519e8429d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:30.934033 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-22bbedac-0fe3-4d3a-bd7d-c96848d38795 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc" status: 200 len: 288 microversion: 2.1 time: 0.090114 Aug 18 12:00:30.935681 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2911/5517] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 12:00:30 2022] GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc => generated 288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:00:30.967526 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-be20b8c2-256e-4323-980a-38adf6f68c25 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519e3e59d0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:31.265728 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-be20b8c2-256e-4323-980a-38adf6f68c25 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "DELETE /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc" status: 202 len: 0 microversion: 2.1 time: 0.321276 Aug 18 12:00:31.269470 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2607/5518] 10.222.0.73 () {58 vars in 1254 bytes} [Thu Aug 18 12:00:30 2022] DELETE /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:00:31.282067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0460b6d8-1540-4859-9db0-cbf225766265 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519eda1670>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:31.389385 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0460b6d8-1540-4859-9db0-cbf225766265 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc" status: 200 len: 287 microversion: 2.1 time: 0.114315 Aug 18 12:00:31.391467 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2912/5519] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 12:00:31 2022] GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:32.412283 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5e8d9c3d-09ff-4a71-8ef5-e40f4c7dc118 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519e4284c0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:32.499798 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5e8d9c3d-09ff-4a71-8ef5-e40f4c7dc118 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc" status: 200 len: 287 microversion: 2.1 time: 0.101849 Aug 18 12:00:32.500519 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2608/5520] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 12:00:32 2022] GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:00:33.110729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-88f15013-1857-4a86-926c-79bee2d05b03 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:33.112103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88f15013-1857-4a86-926c-79bee2d05b03 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:33.136746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-b3271be3-58c1-4521-9d4f-4bf6f5fd8f08 req-fb11591e-85b2-45fc-bdc7-1e15665da009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77328cb-e6b5-40dd-b8ed-788cc97b88c5", "tag": "020695c4-3b6d-4b22-a562-e51f623cef2b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:00:33.144351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88f15013-1857-4a86-926c-79bee2d05b03 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:33.147552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88f15013-1857-4a86-926c-79bee2d05b03 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:33.149990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88f15013-1857-4a86-926c-79bee2d05b03 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:33.156662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88f15013-1857-4a86-926c-79bee2d05b03 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:33.157196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88f15013-1857-4a86-926c-79bee2d05b03 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:33.164780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88f15013-1857-4a86-926c-79bee2d05b03 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:33.171021 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b3271be3-58c1-4521-9d4f-4bf6f5fd8f08 req-fb11591e-85b2-45fc-bdc7-1e15665da009 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:33.171508 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b3271be3-58c1-4521-9d4f-4bf6f5fd8f08 req-fb11591e-85b2-45fc-bdc7-1e15665da009 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:33.183044 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b3271be3-58c1-4521-9d4f-4bf6f5fd8f08 req-fb11591e-85b2-45fc-bdc7-1e15665da009 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:33.230197 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-b3271be3-58c1-4521-9d4f-4bf6f5fd8f08 req-fb11591e-85b2-45fc-bdc7-1e15665da009 service nova] Creating event network-changed:020695c4-3b6d-4b22-a562-e51f623cef2b for instance e77328cb-e6b5-40dd-b8ed-788cc97b88c5 on n-h1-853611-3 Aug 18 12:00:33.251130 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-b3271be3-58c1-4521-9d4f-4bf6f5fd8f08 req-fb11591e-85b2-45fc-bdc7-1e15665da009 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112570 Aug 18 12:00:33.253394 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2609/5521] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:00:33.274130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88f15013-1857-4a86-926c-79bee2d05b03 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:00:33.525046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-96bb3e53-4626-4750-9011-bd076e5a1899 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519e4284c0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:33.618932 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-96bb3e53-4626-4750-9011-bd076e5a1899 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc" status: 200 len: 287 microversion: 2.1 time: 0.107648 Aug 18 12:00:33.620086 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2610/5522] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 12:00:33 2022] GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:33.693812 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-88f15013-1857-4a86-926c-79bee2d05b03 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 204 len: 0 microversion: 2.1 time: 0.589931 Aug 18 12:00:33.696284 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2913/5523] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:00:33 2022] DELETE /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:00:33.711443 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6edc523f-b162-428d-8406-e8998967dfda tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:33.712946 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6edc523f-b162-428d-8406-e8998967dfda tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:33.724801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6edc523f-b162-428d-8406-e8998967dfda tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:33.725334 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6edc523f-b162-428d-8406-e8998967dfda tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:33.725953 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6edc523f-b162-428d-8406-e8998967dfda tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:33.732773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6edc523f-b162-428d-8406-e8998967dfda tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:33.733558 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6edc523f-b162-428d-8406-e8998967dfda tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:33.734039 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-6edc523f-b162-428d-8406-e8998967dfda tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:34.638642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4e5e2bee-58d7-4033-bac5-8024270af18c tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519f816280>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:34.794721 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4e5e2bee-58d7-4033-bac5-8024270af18c tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc" status: 200 len: 287 microversion: 2.1 time: 0.165448 Aug 18 12:00:34.796599 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2914/5524] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 12:00:34 2022] GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc => generated 287 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:34.919637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6edc523f-b162-428d-8406-e8998967dfda tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:00:34.953053 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6edc523f-b162-428d-8406-e8998967dfda tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1580 microversion: 2.1 time: 1.240971 Aug 18 12:00:34.955606 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2611/5525] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:33 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1580 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:00:35.830081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a6f74ac7-8936-4a03-b4c1-3834c3d4f888 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519fdecc10>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:35.963281 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-a6f74ac7-8936-4a03-b4c1-3834c3d4f888 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] HTTP exception thrown: Snapshot 4c4995c9-ec3e-43a7-89ff-61de683c4fcc could not be found. Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a6f74ac7-8936-4a03-b4c1-3834c3d4f888 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Request method failure captured: Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc HTTP/1.1 Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_inVkL9lpDCfmpBfaSp-mfPGVH6kCU0UeFuzXl0UaOChWGhuzVeU7BcxMGZEQn52L5Eg0QR35ZH9jr0PrEh3Lu9KsFNGmMcgQa8hYCiBK-r4Yllj9H-xxHxpQ-b738JIowqRjCcrT_icEgrM7EPVZGIv9G4JzsnAVcGAipN5gHpYOBw Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f2381630b8f84140ae4accb42f692a43 Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1575787155 Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f2381630b8f84140ae4accb42f692a43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f2381630b8f84140ae4accb42f692a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f2381630b8f84140ae4accb42f692a43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f2381630b8f84140ae4accb42f692a43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1575787155 Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f2381630b8f84140ae4accb42f692a43 Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1575787155 Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-VolumesSnapshotsTestJSON-1575787155-project Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 2b442951935e4a1ab1ffb2a850ee6baf Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1575787155-project Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: exception: Snapshot 4c4995c9-ec3e-43a7-89ff-61de683c4fcc could not be found. Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '4c4995c9-ec3e-43a7-89ff-61de683c4fcc'} Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4c4995c9-ec3e-43a7-89ff-61de683c4fcc could not be found. (HTTP 404) (Request-ID: req-bf46df8f-2acf-4025-9fb3-a8f01e1a373b) Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 12:00:35.980409 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4c4995c9-ec3e-43a7-89ff-61de683c4fcc could not be found. Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4c4995c9-ec3e-43a7-89ff-61de683c4fcc could not be found. Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4c4995c9-ec3e-43a7-89ff-61de683c4fcc could not be found. Aug 18 12:00:36.004667 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:36.016369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b8631cf3-cb32-4cbd-bf81-bc394fdaf05e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:36.016369 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b8631cf3-cb32-4cbd-bf81-bc394fdaf05e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:36.017365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a6f74ac7-8936-4a03-b4c1-3834c3d4f888 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Returning 404 to user: Snapshot 4c4995c9-ec3e-43a7-89ff-61de683c4fcc could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:00:36.017365 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a6f74ac7-8936-4a03-b4c1-3834c3d4f888 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc" status: 404 len: 111 microversion: 2.1 time: 0.199436 Aug 18 12:00:36.017365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2915/5526] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 12:00:35 2022] GET /compute/v2.1/os-snapshots/4c4995c9-ec3e-43a7-89ff-61de683c4fcc => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:00:36.018059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8631cf3-cb32-4cbd-bf81-bc394fdaf05e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:36.018059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8631cf3-cb32-4cbd-bf81-bc394fdaf05e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:36.018059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8631cf3-cb32-4cbd-bf81-bc394fdaf05e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:36.018059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8631cf3-cb32-4cbd-bf81-bc394fdaf05e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:36.018059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8631cf3-cb32-4cbd-bf81-bc394fdaf05e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:36.018059 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b8631cf3-cb32-4cbd-bf81-bc394fdaf05e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:36.049427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-295af878-ecef-489d-8781-78388f395976 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519faf6040>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:36.260412 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-295af878-ecef-489d-8781-78388f395976 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a" status: 202 len: 0 microversion: 2.1 time: 0.241211 Aug 18 12:00:36.261174 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2916/5527] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 12:00:36 2022] DELETE /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:00:36.276491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df71fac2-b3a5-4f80-8916-31ad2c418265 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519efc69d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:36.443824 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df71fac2-b3a5-4f80-8916-31ad2c418265 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a" status: 200 len: 345 microversion: 2.1 time: 0.176231 Aug 18 12:00:36.445929 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2917/5528] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 12:00:36 2022] GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a => generated 345 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:00:37.468593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f9f1bdb7-d82e-4860-b2ef-ad9e5177e70a tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519efc6a60>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:37.543884 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b8631cf3-cb32-4cbd-bf81-bc394fdaf05e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:00:37.560182 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b8631cf3-cb32-4cbd-bf81-bc394fdaf05e tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1580 microversion: 2.1 time: 1.569397 Aug 18 12:00:37.562597 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2612/5529] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:35 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1580 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:00:37.837499 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f9f1bdb7-d82e-4860-b2ef-ad9e5177e70a tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a" status: 200 len: 345 microversion: 2.1 time: 0.380872 Aug 18 12:00:37.840031 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2918/5530] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 12:00:37 2022] GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a => generated 345 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:38.391942 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-1ee51f29-278b-427b-a82e-cf6694f7c729 req-f3710d6c-0197-4011-96d4-132e8a00f571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77328cb-e6b5-40dd-b8ed-788cc97b88c5", "name": "network-vif-unplugged", "status": "completed", "tag": "020695c4-3b6d-4b22-a562-e51f623cef2b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:00:38.438121 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1ee51f29-278b-427b-a82e-cf6694f7c729 req-f3710d6c-0197-4011-96d4-132e8a00f571 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:38.480569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1ee51f29-278b-427b-a82e-cf6694f7c729 req-f3710d6c-0197-4011-96d4-132e8a00f571 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:38.497580 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-1ee51f29-278b-427b-a82e-cf6694f7c729 req-f3710d6c-0197-4011-96d4-132e8a00f571 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:38.535221 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-1ee51f29-278b-427b-a82e-cf6694f7c729 req-f3710d6c-0197-4011-96d4-132e8a00f571 service nova] Creating event network-vif-unplugged:020695c4-3b6d-4b22-a562-e51f623cef2b for instance e77328cb-e6b5-40dd-b8ed-788cc97b88c5 on n-h1-853611-3 Aug 18 12:00:38.553813 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-1ee51f29-278b-427b-a82e-cf6694f7c729 req-f3710d6c-0197-4011-96d4-132e8a00f571 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161504 Aug 18 12:00:38.555854 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2613/5531] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:38.630111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5ba3d694-5387-4ae4-99fd-06733bd1ed6a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:38.640508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5ba3d694-5387-4ae4-99fd-06733bd1ed6a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:38.680470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ba3d694-5387-4ae4-99fd-06733bd1ed6a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:38.687724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ba3d694-5387-4ae4-99fd-06733bd1ed6a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:38.693963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ba3d694-5387-4ae4-99fd-06733bd1ed6a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:38.696698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ba3d694-5387-4ae4-99fd-06733bd1ed6a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:38.703680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ba3d694-5387-4ae4-99fd-06733bd1ed6a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:38.706406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ba3d694-5387-4ae4-99fd-06733bd1ed6a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:38.861770 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2b1d2c71-4664-4b99-b8cc-c7bffa53c7b9 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519e384040>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:39.044462 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2b1d2c71-4664-4b99-b8cc-c7bffa53c7b9 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a" status: 200 len: 345 microversion: 2.1 time: 0.188245 Aug 18 12:00:39.062198 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2614/5532] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 12:00:38 2022] GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a => generated 345 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:39.176603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5ba3d694-5387-4ae4-99fd-06733bd1ed6a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:00:39.227244 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5ba3d694-5387-4ae4-99fd-06733bd1ed6a tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1396 microversion: 2.1 time: 0.594907 Aug 18 12:00:39.229396 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2919/5533] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:38 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1396 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:00:39.321940 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-b924ce80-f27f-43bb-aaa9-99d1cef9c053 req-7922c395-d5e6-4bc9-94ff-1dd05850f73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77328cb-e6b5-40dd-b8ed-788cc97b88c5", "name": "network-vif-deleted", "tag": "020695c4-3b6d-4b22-a562-e51f623cef2b"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:00:39.415715 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b924ce80-f27f-43bb-aaa9-99d1cef9c053 req-7922c395-d5e6-4bc9-94ff-1dd05850f73a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:39.423016 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b924ce80-f27f-43bb-aaa9-99d1cef9c053 req-7922c395-d5e6-4bc9-94ff-1dd05850f73a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:39.423730 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-b924ce80-f27f-43bb-aaa9-99d1cef9c053 req-7922c395-d5e6-4bc9-94ff-1dd05850f73a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:39.450294 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-b924ce80-f27f-43bb-aaa9-99d1cef9c053 req-7922c395-d5e6-4bc9-94ff-1dd05850f73a service nova] Creating event network-vif-deleted:020695c4-3b6d-4b22-a562-e51f623cef2b for instance e77328cb-e6b5-40dd-b8ed-788cc97b88c5 on n-h1-853611-3 Aug 18 12:00:39.479681 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-b924ce80-f27f-43bb-aaa9-99d1cef9c053 req-7922c395-d5e6-4bc9-94ff-1dd05850f73a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180838 Aug 18 12:00:39.490905 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2615/5534] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:40.069526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a2ac433-53c9-42c9-92d6-01319fcc2a63 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519e87ba60>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:40.276603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-edf79ace-10b4-4c0b-8486-91a25c0715c7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:40.278383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-edf79ace-10b4-4c0b-8486-91a25c0715c7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:40.293375 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edf79ace-10b4-4c0b-8486-91a25c0715c7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:40.298279 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edf79ace-10b4-4c0b-8486-91a25c0715c7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:40.299046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edf79ace-10b4-4c0b-8486-91a25c0715c7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:40.304801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edf79ace-10b4-4c0b-8486-91a25c0715c7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:40.305773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edf79ace-10b4-4c0b-8486-91a25c0715c7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:40.306485 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-edf79ace-10b4-4c0b-8486-91a25c0715c7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:40.815890 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6a2ac433-53c9-42c9-92d6-01319fcc2a63 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a" status: 200 len: 345 microversion: 2.1 time: 0.759660 Aug 18 12:00:40.816877 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2920/5535] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 12:00:40 2022] GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a => generated 345 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:40.990697 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-edf79ace-10b4-4c0b-8486-91a25c0715c7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:00:41.027951 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-edf79ace-10b4-4c0b-8486-91a25c0715c7 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1229 microversion: 2.1 time: 0.757070 Aug 18 12:00:41.035285 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2616/5536] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:40 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1229 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:00:41.834135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55356d64-0a17-4fed-bf70-244999bb8866 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519f961d30>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:42.022266 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-55356d64-0a17-4fed-bf70-244999bb8866 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a" status: 200 len: 345 microversion: 2.1 time: 0.193621 Aug 18 12:00:42.023764 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2921/5537] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 12:00:41 2022] GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a => generated 345 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:42.078712 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-37054ef6-55f8-411a-9aa7-46e520f466f1 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:42.081936 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-37054ef6-55f8-411a-9aa7-46e520f466f1 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:42.122903 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37054ef6-55f8-411a-9aa7-46e520f466f1 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:42.124674 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37054ef6-55f8-411a-9aa7-46e520f466f1 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:42.130465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37054ef6-55f8-411a-9aa7-46e520f466f1 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:42.139525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37054ef6-55f8-411a-9aa7-46e520f466f1 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:42.140548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37054ef6-55f8-411a-9aa7-46e520f466f1 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:42.156967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-37054ef6-55f8-411a-9aa7-46e520f466f1 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:42.579602 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-37054ef6-55f8-411a-9aa7-46e520f466f1 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:00:42.620070 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-37054ef6-55f8-411a-9aa7-46e520f466f1 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1229 microversion: 2.1 time: 0.542376 Aug 18 12:00:42.624190 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2617/5538] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:42 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1229 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:00:43.057165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2debd386-7e85-4333-8ca1-060c87735cfe tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519fdec040>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:43.334509 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2debd386-7e85-4333-8ca1-060c87735cfe tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a" status: 200 len: 345 microversion: 2.1 time: 0.296046 Aug 18 12:00:43.336280 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2922/5539] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 12:00:43 2022] GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a => generated 345 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:00:43.673826 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b81dc666-4822-438b-8336-37937fbdddd0 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:43.676084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-b81dc666-4822-438b-8336-37937fbdddd0 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:43.732499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b81dc666-4822-438b-8336-37937fbdddd0 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:43.739598 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b81dc666-4822-438b-8336-37937fbdddd0 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:43.741220 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b81dc666-4822-438b-8336-37937fbdddd0 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:43.743029 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b81dc666-4822-438b-8336-37937fbdddd0 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:43.744231 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b81dc666-4822-438b-8336-37937fbdddd0 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:43.751012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-b81dc666-4822-438b-8336-37937fbdddd0 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:44.077593 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-b81dc666-4822-438b-8336-37937fbdddd0 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:00:44.096668 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b81dc666-4822-438b-8336-37937fbdddd0 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1229 microversion: 2.1 time: 0.431939 Aug 18 12:00:44.097934 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2618/5540] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:43 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1229 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:00:44.362393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-86ae0add-70e6-4318-8b10-58fe7921a759 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519f9544c0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:44.505402 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-86ae0add-70e6-4318-8b10-58fe7921a759 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] HTTP exception thrown: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-86ae0add-70e6-4318-8b10-58fe7921a759 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Request method failure captured: Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a HTTP/1.1 Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_inVkL9lpDCfmpBfaSp-mfPGVH6kCU0UeFuzXl0UaOChWGhuzVeU7BcxMGZEQn52L5Eg0QR35ZH9jr0PrEh3Lu9KsFNGmMcgQa8hYCiBK-r4Yllj9H-xxHxpQ-b738JIowqRjCcrT_icEgrM7EPVZGIv9G4JzsnAVcGAipN5gHpYOBw Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f2381630b8f84140ae4accb42f692a43 Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1575787155 Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f2381630b8f84140ae4accb42f692a43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f2381630b8f84140ae4accb42f692a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f2381630b8f84140ae4accb42f692a43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f2381630b8f84140ae4accb42f692a43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1575787155 Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f2381630b8f84140ae4accb42f692a43 Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1575787155 Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-VolumesSnapshotsTestJSON-1575787155-project Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 2b442951935e4a1ab1ffb2a850ee6baf Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1575787155-project Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: exception: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '22aa1463-4b2d-4626-b2e8-428bf57b7b7a'} Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. (HTTP 404) (Request-ID: req-565fd531-fb13-406f-8dff-ca0b0c324a92) Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 12:00:44.508666 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-86ae0add-70e6-4318-8b10-58fe7921a759 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Returning 404 to user: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-86ae0add-70e6-4318-8b10-58fe7921a759 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a" status: 404 len: 109 microversion: 2.1 time: 0.157536 Aug 18 12:00:44.525765 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2923/5541] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 12:00:44 2022] GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a => generated 109 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:00:44.539842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1fdcdcee-0a0e-4ad0-ae71-46bccc3e8642 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519e45e4c0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:44.755429 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.wsgi [None req-1fdcdcee-0a0e-4ad0-ae71-46bccc3e8642 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] HTTP exception thrown: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1fdcdcee-0a0e-4ad0-ae71-46bccc3e8642 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Request method failure captured: Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: request: DELETE /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a HTTP/1.1 Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: Accept: application/json Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: Accept-Encoding: identity Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: Connection: close Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: Content-Length: 0 Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: Content-Type: application/json Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: Host: 10.222.0.73 Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: Openstack-System-Scope: None Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: User-Agent: python-urllib3/1.26.11 Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Auth-Token: gAAAAABi_inVkL9lpDCfmpBfaSp-mfPGVH6kCU0UeFuzXl0UaOChWGhuzVeU7BcxMGZEQn52L5Eg0QR35ZH9jr0PrEh3Lu9KsFNGmMcgQa8hYCiBK-r4Yllj9H-xxHxpQ-b738JIowqRjCcrT_icEgrM7EPVZGIv9G4JzsnAVcGAipN5gHpYOBw Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Id: None Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Domain-Name: None Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Identity-Status: Confirmed Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Is-Admin-Project: True Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Id: default Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Domain-Name: Default Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Id: f2381630b8f84140ae4accb42f692a43 Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1575787155 Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Role: member,reader Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Roles: member,reader Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f2381630b8f84140ae4accb42f692a43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f2381630b8f84140ae4accb42f692a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f2381630b8f84140ae4accb42f692a43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f2381630b8f84140ae4accb42f692a43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1575787155 Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Id: f2381630b8f84140ae4accb42f692a43 Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1575787155 Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-User: tempest-VolumesSnapshotsTestJSON-1575787155-project Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Id: default Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-User-Domain-Name: Default Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-User-Id: 2b442951935e4a1ab1ffb2a850ee6baf Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1575787155-project Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: method: Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: exception: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: action_args: {'id': '22aa1463-4b2d-4626-b2e8-428bf57b7b7a'} Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. (HTTP 404) (Request-ID: req-fecbede5-06af-402e-8f69-3df9353dd9ac) Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 12:00:44.760537 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:44.765481 n-d-853611-3 devstack@n-api.service[122209]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.771306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-1fdcdcee-0a0e-4ad0-ae71-46bccc3e8642 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Returning 404 to user: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. {{(pid=122209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:00:44.771306 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-1fdcdcee-0a0e-4ad0-ae71-46bccc3e8642 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a" status: 404 len: 109 microversion: 2.1 time: 0.245997 Aug 18 12:00:44.785046 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2619/5542] 10.222.0.73 () {58 vars in 1248 bytes} [Thu Aug 18 12:00:44 2022] DELETE /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a => generated 109 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:00:44.805085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e684024b-307c-4c89-9c7e-b30efa4dc403 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Calling method '.version_select at 0x7f519f9630d0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:44.985126 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-e684024b-307c-4c89-9c7e-b30efa4dc403 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] HTTP exception thrown: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e684024b-307c-4c89-9c7e-b30efa4dc403 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Request method failure captured: Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a HTTP/1.1 Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_inVkL9lpDCfmpBfaSp-mfPGVH6kCU0UeFuzXl0UaOChWGhuzVeU7BcxMGZEQn52L5Eg0QR35ZH9jr0PrEh3Lu9KsFNGmMcgQa8hYCiBK-r4Yllj9H-xxHxpQ-b738JIowqRjCcrT_icEgrM7EPVZGIv9G4JzsnAVcGAipN5gHpYOBw Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f2381630b8f84140ae4accb42f692a43 Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1575787155 Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f2381630b8f84140ae4accb42f692a43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f2381630b8f84140ae4accb42f692a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f2381630b8f84140ae4accb42f692a43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f2381630b8f84140ae4accb42f692a43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1575787155 Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f2381630b8f84140ae4accb42f692a43 Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1575787155 Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-VolumesSnapshotsTestJSON-1575787155-project Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 2b442951935e4a1ab1ffb2a850ee6baf Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1575787155-project Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: method: Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: exception: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '22aa1463-4b2d-4626-b2e8-428bf57b7b7a'} Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. (HTTP 404) (Request-ID: req-fa75c90c-e79a-45bb-b266-35dbb746ef90) Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 12:00:44.988264 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e684024b-307c-4c89-9c7e-b30efa4dc403 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] Returning 404 to user: Volume 22aa1463-4b2d-4626-b2e8-428bf57b7b7a could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e684024b-307c-4c89-9c7e-b30efa4dc403 tempest-VolumesSnapshotsTestJSON-1575787155 tempest-VolumesSnapshotsTestJSON-1575787155-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a" status: 404 len: 109 microversion: 2.1 time: 0.198288 Aug 18 12:00:45.001839 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2924/5543] 10.222.0.73 () {58 vars in 1245 bytes} [Thu Aug 18 12:00:44 2022] GET /compute/v2.1/os-volumes/22aa1463-4b2d-4626-b2e8-428bf57b7b7a => generated 109 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:00:45.129261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4cd21373-101d-45d5-bba0-2b08b086aaf2 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:45.135122 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4cd21373-101d-45d5-bba0-2b08b086aaf2 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:45.169287 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cd21373-101d-45d5-bba0-2b08b086aaf2 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:45.181823 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cd21373-101d-45d5-bba0-2b08b086aaf2 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:45.185883 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cd21373-101d-45d5-bba0-2b08b086aaf2 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:45.188175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cd21373-101d-45d5-bba0-2b08b086aaf2 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:45.197352 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cd21373-101d-45d5-bba0-2b08b086aaf2 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:45.198689 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4cd21373-101d-45d5-bba0-2b08b086aaf2 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:45.594256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4cd21373-101d-45d5-bba0-2b08b086aaf2 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:00:45.649004 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4cd21373-101d-45d5-bba0-2b08b086aaf2 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1229 microversion: 2.1 time: 0.527047 Aug 18 12:00:45.660254 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2620/5544] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:45 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1229 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:00:46.694293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0087dd26-9256-4d74-b942-db1fd96fd9aa tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:46.696162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0087dd26-9256-4d74-b942-db1fd96fd9aa tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:46.745016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0087dd26-9256-4d74-b942-db1fd96fd9aa tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:46.745613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0087dd26-9256-4d74-b942-db1fd96fd9aa tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:46.746049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0087dd26-9256-4d74-b942-db1fd96fd9aa tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:46.751283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0087dd26-9256-4d74-b942-db1fd96fd9aa tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:46.752127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0087dd26-9256-4d74-b942-db1fd96fd9aa tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:46.756253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0087dd26-9256-4d74-b942-db1fd96fd9aa tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:46.935616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0087dd26-9256-4d74-b942-db1fd96fd9aa tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:00:46.953713 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0087dd26-9256-4d74-b942-db1fd96fd9aa tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1229 microversion: 2.1 time: 0.275009 Aug 18 12:00:46.954334 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2925/5545] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:46 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1229 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:00:47.980594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-ca755d1c-9f57-498a-a258-a18295cb2826 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:47.981381 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-ca755d1c-9f57-498a-a258-a18295cb2826 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:48.018567 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca755d1c-9f57-498a-a258-a18295cb2826 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:48.027313 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca755d1c-9f57-498a-a258-a18295cb2826 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:48.027939 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca755d1c-9f57-498a-a258-a18295cb2826 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:48.029075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca755d1c-9f57-498a-a258-a18295cb2826 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:48.029932 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca755d1c-9f57-498a-a258-a18295cb2826 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:48.030396 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-ca755d1c-9f57-498a-a258-a18295cb2826 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:48.314232 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-ca755d1c-9f57-498a-a258-a18295cb2826 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:00:48.332306 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-ca755d1c-9f57-498a-a258-a18295cb2826 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1229 microversion: 2.1 time: 0.358932 Aug 18 12:00:48.332983 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2621/5546] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:47 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1229 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:00:49.371714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-95fef12c-5ba9-48f2-ab2c-c3b0b85e696b tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:49.372780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-95fef12c-5ba9-48f2-ab2c-c3b0b85e696b tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:49.436714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95fef12c-5ba9-48f2-ab2c-c3b0b85e696b tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:49.448602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95fef12c-5ba9-48f2-ab2c-c3b0b85e696b tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:49.449558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95fef12c-5ba9-48f2-ab2c-c3b0b85e696b tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:49.458995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95fef12c-5ba9-48f2-ab2c-c3b0b85e696b tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:49.459748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95fef12c-5ba9-48f2-ab2c-c3b0b85e696b tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:49.463429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95fef12c-5ba9-48f2-ab2c-c3b0b85e696b tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:49.692852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-95fef12c-5ba9-48f2-ab2c-c3b0b85e696b tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:00:49.744934 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-95fef12c-5ba9-48f2-ab2c-c3b0b85e696b tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1229 microversion: 2.1 time: 0.381619 Aug 18 12:00:49.782629 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2926/5547] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:49 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1229 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:00:50.782943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2ce5dea7-49ed-4029-ba56-5568b6f893db tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:50.783577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2ce5dea7-49ed-4029-ba56-5568b6f893db tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:50.798189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ce5dea7-49ed-4029-ba56-5568b6f893db tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:50.798189 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ce5dea7-49ed-4029-ba56-5568b6f893db tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:50.798943 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ce5dea7-49ed-4029-ba56-5568b6f893db tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:50.799107 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ce5dea7-49ed-4029-ba56-5568b6f893db tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:50.801022 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ce5dea7-49ed-4029-ba56-5568b6f893db tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:50.801482 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2ce5dea7-49ed-4029-ba56-5568b6f893db tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:51.070913 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2ce5dea7-49ed-4029-ba56-5568b6f893db tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:00:51.098141 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2ce5dea7-49ed-4029-ba56-5568b6f893db tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1229 microversion: 2.1 time: 0.319183 Aug 18 12:00:51.104570 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2622/5548] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:50 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1229 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:00:52.148711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-86664561-f482-46e0-a0f0-36fecc5dda29 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:52.149552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-86664561-f482-46e0-a0f0-36fecc5dda29 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:52.167041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86664561-f482-46e0-a0f0-36fecc5dda29 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:52.167883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86664561-f482-46e0-a0f0-36fecc5dda29 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:52.169381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86664561-f482-46e0-a0f0-36fecc5dda29 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:52.171151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86664561-f482-46e0-a0f0-36fecc5dda29 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:52.174090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86664561-f482-46e0-a0f0-36fecc5dda29 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:52.179251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86664561-f482-46e0-a0f0-36fecc5dda29 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:52.468568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-86664561-f482-46e0-a0f0-36fecc5dda29 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:00:52.480959 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-86664561-f482-46e0-a0f0-36fecc5dda29 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1229 microversion: 2.1 time: 0.341050 Aug 18 12:00:52.487783 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2927/5549] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:52 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1229 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:00:53.528373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4b6a0aed-d41b-4e9c-80c0-8554b2bd1a8d tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:53.534920 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4b6a0aed-d41b-4e9c-80c0-8554b2bd1a8d tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:53.575134 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b6a0aed-d41b-4e9c-80c0-8554b2bd1a8d tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:53.576452 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b6a0aed-d41b-4e9c-80c0-8554b2bd1a8d tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:53.577605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b6a0aed-d41b-4e9c-80c0-8554b2bd1a8d tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:53.579591 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b6a0aed-d41b-4e9c-80c0-8554b2bd1a8d tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:53.589507 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b6a0aed-d41b-4e9c-80c0-8554b2bd1a8d tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:53.590968 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4b6a0aed-d41b-4e9c-80c0-8554b2bd1a8d tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:54.020031 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-4b6a0aed-d41b-4e9c-80c0-8554b2bd1a8d tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11231212bdc4f10a30a5ccd6fd117a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c65e9924e8554a53a3842fd38b685410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:00:54.075754 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4b6a0aed-d41b-4e9c-80c0-8554b2bd1a8d tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 200 len: 1229 microversion: 2.1 time: 0.564425 Aug 18 12:00:54.079525 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2623/5550] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:53 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 1229 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:00:55.129065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-799c7275-4201-4a2f-aa00-0f6715027b63 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:55.137692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-799c7275-4201-4a2f-aa00-0f6715027b63 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] [instance: e77328cb-e6b5-40dd-b8ed-788cc97b88c5] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:00:55.166372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-799c7275-4201-4a2f-aa00-0f6715027b63 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:55.167329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-799c7275-4201-4a2f-aa00-0f6715027b63 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:55.168109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-799c7275-4201-4a2f-aa00-0f6715027b63 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:55.169380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-799c7275-4201-4a2f-aa00-0f6715027b63 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:00:55.174037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-799c7275-4201-4a2f-aa00-0f6715027b63 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:00:55.177027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-799c7275-4201-4a2f-aa00-0f6715027b63 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:00:55.270956 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-799c7275-4201-4a2f-aa00-0f6715027b63 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] HTTP exception thrown: Instance e77328cb-e6b5-40dd-b8ed-788cc97b88c5 could not be found. Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-799c7275-4201-4a2f-aa00-0f6715027b63 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Request method failure captured: Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 HTTP/1.1 Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iiDGdVORMbTQb2x0G1Iizul7zLn-REFAjJmLZAtgeszNj6LJCGBhlwxABFWtBSIo4uX8yYtdSQ84Y9hkJw_oAkYCiCQGIFqsvpQCSLEikTU7YuZvg7Y6JVD1cOsPjaTEgPtf1XGgqzkNS3U_CEELYlWsJancuG9ZyNCfRS6tyl1nzQ Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c65e9924e8554a53a3842fd38b685410 Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBackupRestore-1087624116 Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c65e9924e8554a53a3842fd38b685410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c65e9924e8554a53a3842fd38b685410"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c65e9924e8554a53a3842fd38b685410"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c65e9924e8554a53a3842fd38b685410"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBackupRestore-1087624116 Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c65e9924e8554a53a3842fd38b685410 Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1087624116 Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBackupRestore-1087624116-project Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c11231212bdc4f10a30a5ccd6fd117a0 Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBackupRestore-1087624116-project Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance e77328cb-e6b5-40dd-b8ed-788cc97b88c5 could not be found. Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'e77328cb-e6b5-40dd-b8ed-788cc97b88c5'} Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e77328cb-e6b5-40dd-b8ed-788cc97b88c5 could not be found. Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e77328cb-e6b5-40dd-b8ed-788cc97b88c5 could not be found. Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:00:55.277416 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:55.291703 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:00:55.291703 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:00:55.291703 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:00:55.291703 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:00:55.291703 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:00:55.291703 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e77328cb-e6b5-40dd-b8ed-788cc97b88c5 could not be found. Aug 18 12:00:55.291703 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:00:55.331084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-799c7275-4201-4a2f-aa00-0f6715027b63 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Returning 404 to user: Instance e77328cb-e6b5-40dd-b8ed-788cc97b88c5 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:00:55.337493 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-799c7275-4201-4a2f-aa00-0f6715027b63 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5" status: 404 len: 111 microversion: 2.1 time: 0.235618 Aug 18 12:00:55.361777 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2928/5551] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:00:55 2022] GET /compute/v2.1/servers/e77328cb-e6b5-40dd-b8ed-788cc97b88c5 => generated 111 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:00:55.740099 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-b68b79be-7c9a-4208-a491-a5ace10d4744 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] Calling method '.version_select at 0x7f519e3d1dc0>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:00:55.851408 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-b68b79be-7c9a-4208-a491-a5ace10d4744 tempest-TestVolumeBackupRestore-1087624116 tempest-TestVolumeBackupRestore-1087624116-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-935484746" status: 202 len: 0 microversion: 2.1 time: 0.118353 Aug 18 12:00:55.855651 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2624/5552] 10.222.0.73 () {58 vars in 1266 bytes} [Thu Aug 18 12:00:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-935484746 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:01:39.999721 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:01:40.001182 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:01:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:03:16.626043 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:03:16.626765 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 12:03:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:03:16.706357 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:03:16.706805 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 12:03:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:03:18.666820 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:03:18.675285 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:03:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:03:36.607298 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:03:36.608853 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:03:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:03:50.609404 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:03:50.610189 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 12:03:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:04:51.122721 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8703f2a-f745-4e9b-8afb-efe543c268f1] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 18 12:04:51.124115 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4032abb9-abb5-4d06-9561-525583ca96a6] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 18 12:04:51.124444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:04:51.125217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:04:51.830695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-323317510", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "d700b24c-baa8-4bb0-9235-097f9e6ad8bb"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:04:51.969892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] validate_networks() for [('d700b24c-baa8-4bb0-9235-097f9e6ad8bb', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:04:52.137562 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8703f2a-f745-4e9b-8afb-efe543c268f1] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 39344. Aug 18 12:04:52.157134 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] [4032abb9-abb5-4d06-9561-525583ca96a6] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 39346. Aug 18 12:04:53.958182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:04:53.960020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:04:53.961082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:04:53.961945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:04:53.962795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:04:54.066953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:04:54.071366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:04:54.073962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:04:54.083908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:04:54.103005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:04:54.105726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:04:54.213865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Getting quotas for project d2e54f23d43741018372552dcf067766. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:04:54.226460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Getting quotas for user 21fdbeb528714994b33e93fae512331f and project d2e54f23d43741018372552dcf067766. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:04:54.284416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:04:54.295093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:04:54.437236 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-64118eee-f054-42f4-9c87-546f3509f4eb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.323249 Aug 18 12:04:54.440354 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2929/5553] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:04:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:04:54.456247 n-d-853611-3 devstack@n-api.service[122209]: ERROR oslo.messaging._drivers.impl_rabbit [-] [016a67b1-d5ba-404a-98fa-4020807922b6] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 18 12:04:54.463403 n-d-853611-3 devstack@n-api.service[122209]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e87a0790-58dd-441c-8180-f4e5ad7a5e14] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 18 12:04:54.468584 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=60 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:04:54.475786 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:04:54.516206 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-6bce9dd1-e3ea-4704-941b-ea6b295cbcba tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:04:54.521637 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-6bce9dd1-e3ea-4704-941b-ea6b295cbcba tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:04:54.675091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-6bce9dd1-e3ea-4704-941b-ea6b295cbcba tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdbeb528714994b33e93fae512331f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e54f23d43741018372552dcf067766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:04:54.695031 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-6bce9dd1-e3ea-4704-941b-ea6b295cbcba tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 200 len: 1213 microversion: 2.1 time: 0.245799 Aug 18 12:04:54.696596 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2625/5554] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:04:54 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 1213 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:04:55.730863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ee485d09-3d1a-4361-af55-dd006677d4ba tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:04:55.738632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ee485d09-3d1a-4361-af55-dd006677d4ba tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:04:55.933068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ee485d09-3d1a-4361-af55-dd006677d4ba tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdbeb528714994b33e93fae512331f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e54f23d43741018372552dcf067766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:04:55.956950 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ee485d09-3d1a-4361-af55-dd006677d4ba tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 200 len: 1213 microversion: 2.1 time: 0.241387 Aug 18 12:04:55.961654 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2930/5555] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:04:55 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 1213 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:04:56.988488 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-f20feaa0-8835-470b-afa7-b5bb00d66b47 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:04:56.992418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-f20feaa0-8835-470b-afa7-b5bb00d66b47 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:04:57.033499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f20feaa0-8835-470b-afa7-b5bb00d66b47 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:04:57.034924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f20feaa0-8835-470b-afa7-b5bb00d66b47 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:04:57.035854 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f20feaa0-8835-470b-afa7-b5bb00d66b47 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:04:57.037222 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f20feaa0-8835-470b-afa7-b5bb00d66b47 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:04:57.038491 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f20feaa0-8835-470b-afa7-b5bb00d66b47 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:04:57.039683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-f20feaa0-8835-470b-afa7-b5bb00d66b47 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:04:57.074587 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] [e87a0790-58dd-441c-8180-f4e5ad7a5e14] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 39566. Aug 18 12:04:57.088983 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] [016a67b1-d5ba-404a-98fa-4020807922b6] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 39564. Aug 18 12:04:57.269237 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-f20feaa0-8835-470b-afa7-b5bb00d66b47 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdbeb528714994b33e93fae512331f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e54f23d43741018372552dcf067766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:04:57.289239 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-f20feaa0-8835-470b-afa7-b5bb00d66b47 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 200 len: 1265 microversion: 2.1 time: 0.306280 Aug 18 12:04:57.289239 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2626/5556] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:04:56 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:04:58.319727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-130e6a59-1a8f-4d3e-b0d0-d78edab7c54c tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:04:58.322136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-130e6a59-1a8f-4d3e-b0d0-d78edab7c54c tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:04:58.362913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-130e6a59-1a8f-4d3e-b0d0-d78edab7c54c tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:04:58.364010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-130e6a59-1a8f-4d3e-b0d0-d78edab7c54c tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:04:58.365146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-130e6a59-1a8f-4d3e-b0d0-d78edab7c54c tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:04:58.367582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-130e6a59-1a8f-4d3e-b0d0-d78edab7c54c tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:04:58.369065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-130e6a59-1a8f-4d3e-b0d0-d78edab7c54c tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:04:58.370463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-130e6a59-1a8f-4d3e-b0d0-d78edab7c54c tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:04:58.730992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-130e6a59-1a8f-4d3e-b0d0-d78edab7c54c tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdbeb528714994b33e93fae512331f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e54f23d43741018372552dcf067766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:04:58.739728 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-130e6a59-1a8f-4d3e-b0d0-d78edab7c54c tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 200 len: 1271 microversion: 2.1 time: 0.428390 Aug 18 12:04:58.764523 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2931/5557] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:04:58 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 1271 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:04:59.780109 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e0705fb4-9d29-4e86-9273-6edc4d1ec464 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:04:59.781738 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e0705fb4-9d29-4e86-9273-6edc4d1ec464 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:04:59.836209 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0705fb4-9d29-4e86-9273-6edc4d1ec464 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:04:59.855667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0705fb4-9d29-4e86-9273-6edc4d1ec464 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:04:59.856465 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0705fb4-9d29-4e86-9273-6edc4d1ec464 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:04:59.858499 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0705fb4-9d29-4e86-9273-6edc4d1ec464 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:04:59.859344 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0705fb4-9d29-4e86-9273-6edc4d1ec464 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:04:59.865541 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e0705fb4-9d29-4e86-9273-6edc4d1ec464 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:00.038313 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:05:00.038600 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:05:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 (ip 10.222.0.73) !!! Aug 18 12:05:01.225726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-e0705fb4-9d29-4e86-9273-6edc4d1ec464 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdbeb528714994b33e93fae512331f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e54f23d43741018372552dcf067766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:05:01.272320 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e0705fb4-9d29-4e86-9273-6edc4d1ec464 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 200 len: 1313 microversion: 2.1 time: 1.509855 Aug 18 12:05:01.312505 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2627/5558] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:04:59 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 1313 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:05:02.213543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5ae33b15-4ce2-4c56-a1b8-d75de5639f13 req-a684e3a4-3c5f-416d-ae34-7a3f2398b2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3922c1ee-6e95-4e84-86ff-7c47471553b6", "tag": "ec2ad1a9-631f-424b-b773-a7efa9c4af5f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:05:02.249307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5ae33b15-4ce2-4c56-a1b8-d75de5639f13 req-a684e3a4-3c5f-416d-ae34-7a3f2398b2f0 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:02.254817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5ae33b15-4ce2-4c56-a1b8-d75de5639f13 req-a684e3a4-3c5f-416d-ae34-7a3f2398b2f0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:02.256560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5ae33b15-4ce2-4c56-a1b8-d75de5639f13 req-a684e3a4-3c5f-416d-ae34-7a3f2398b2f0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:02.328863 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a6eebf41-8c62-495e-a7ae-e601383898ec tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:05:02.330044 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5ae33b15-4ce2-4c56-a1b8-d75de5639f13 req-a684e3a4-3c5f-416d-ae34-7a3f2398b2f0 service nova] Creating event network-changed:ec2ad1a9-631f-424b-b773-a7efa9c4af5f for instance 3922c1ee-6e95-4e84-86ff-7c47471553b6 on n-h2-853611-3 Aug 18 12:05:02.334055 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a6eebf41-8c62-495e-a7ae-e601383898ec tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:05:02.355832 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5ae33b15-4ce2-4c56-a1b8-d75de5639f13 req-a684e3a4-3c5f-416d-ae34-7a3f2398b2f0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.512772 Aug 18 12:05:02.364392 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2932/5559] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:05:02.367386 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6eebf41-8c62-495e-a7ae-e601383898ec tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:02.375087 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6eebf41-8c62-495e-a7ae-e601383898ec tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:02.376470 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6eebf41-8c62-495e-a7ae-e601383898ec tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:02.378083 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6eebf41-8c62-495e-a7ae-e601383898ec tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:02.386956 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6eebf41-8c62-495e-a7ae-e601383898ec tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:02.388828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a6eebf41-8c62-495e-a7ae-e601383898ec tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:03.356515 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-a6eebf41-8c62-495e-a7ae-e601383898ec tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdbeb528714994b33e93fae512331f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e54f23d43741018372552dcf067766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:05:03.398527 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a6eebf41-8c62-495e-a7ae-e601383898ec tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 200 len: 1313 microversion: 2.1 time: 1.080354 Aug 18 12:05:03.421524 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2628/5560] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:05:02 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 1313 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:05:04.459040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:05:04.475405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab5bea4e-bbe3-41f4-ac7b-7eb4fc770aeb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:05:04.476319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ab5bea4e-bbe3-41f4-ac7b-7eb4fc770aeb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:05:04.495114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab5bea4e-bbe3-41f4-ac7b-7eb4fc770aeb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:04.495981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab5bea4e-bbe3-41f4-ac7b-7eb4fc770aeb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:04.511797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab5bea4e-bbe3-41f4-ac7b-7eb4fc770aeb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:04.513764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab5bea4e-bbe3-41f4-ac7b-7eb4fc770aeb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:04.514690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab5bea4e-bbe3-41f4-ac7b-7eb4fc770aeb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:04.515478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab5bea4e-bbe3-41f4-ac7b-7eb4fc770aeb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:05.133757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ab5bea4e-bbe3-41f4-ac7b-7eb4fc770aeb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdbeb528714994b33e93fae512331f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e54f23d43741018372552dcf067766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:05:05.163535 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab5bea4e-bbe3-41f4-ac7b-7eb4fc770aeb tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 200 len: 1313 microversion: 2.1 time: 0.707294 Aug 18 12:05:05.167898 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2933/5561] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:05:04 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 1313 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:05:06.213444 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-8ecec1c1-9838-4e3c-8364-2cd8f923f9e9 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:05:06.214303 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-8ecec1c1-9838-4e3c-8364-2cd8f923f9e9 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:05:06.233086 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:05:06.249531 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ecec1c1-9838-4e3c-8364-2cd8f923f9e9 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:06.252960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ecec1c1-9838-4e3c-8364-2cd8f923f9e9 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:06.259212 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ecec1c1-9838-4e3c-8364-2cd8f923f9e9 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:06.260433 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ecec1c1-9838-4e3c-8364-2cd8f923f9e9 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:06.271569 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ecec1c1-9838-4e3c-8364-2cd8f923f9e9 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:06.272701 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-8ecec1c1-9838-4e3c-8364-2cd8f923f9e9 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:06.625683 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-8ecec1c1-9838-4e3c-8364-2cd8f923f9e9 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdbeb528714994b33e93fae512331f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e54f23d43741018372552dcf067766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:05:06.645508 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-8ecec1c1-9838-4e3c-8364-2cd8f923f9e9 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 200 len: 1313 microversion: 2.1 time: 0.432951 Aug 18 12:05:06.647000 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2629/5562] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:05:06 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:05:07.701962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-381d776e-ee94-42e8-901e-5f505a218ef8 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:05:07.706118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-381d776e-ee94-42e8-901e-5f505a218ef8 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:05:07.749237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:05:07.777299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-381d776e-ee94-42e8-901e-5f505a218ef8 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:07.786815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-381d776e-ee94-42e8-901e-5f505a218ef8 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:07.789320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-381d776e-ee94-42e8-901e-5f505a218ef8 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:07.797445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-381d776e-ee94-42e8-901e-5f505a218ef8 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:07.801030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-381d776e-ee94-42e8-901e-5f505a218ef8 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:07.802754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-381d776e-ee94-42e8-901e-5f505a218ef8 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:08.662760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-381d776e-ee94-42e8-901e-5f505a218ef8 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdbeb528714994b33e93fae512331f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e54f23d43741018372552dcf067766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:05:08.675322 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-381d776e-ee94-42e8-901e-5f505a218ef8 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 200 len: 1313 microversion: 2.1 time: 0.986009 Aug 18 12:05:08.675928 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2934/5563] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:05:07 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 1313 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:05:09.718522 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-7d4fae87-4dc4-4c68-b589-2b6dc1358c9f tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:05:09.725084 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-7d4fae87-4dc4-4c68-b589-2b6dc1358c9f tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:05:09.779667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d4fae87-4dc4-4c68-b589-2b6dc1358c9f tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:09.781813 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d4fae87-4dc4-4c68-b589-2b6dc1358c9f tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:09.786036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d4fae87-4dc4-4c68-b589-2b6dc1358c9f tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:09.788746 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d4fae87-4dc4-4c68-b589-2b6dc1358c9f tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:09.793853 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d4fae87-4dc4-4c68-b589-2b6dc1358c9f tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:09.799383 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-7d4fae87-4dc4-4c68-b589-2b6dc1358c9f tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:10.355737 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-7d4fae87-4dc4-4c68-b589-2b6dc1358c9f tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdbeb528714994b33e93fae512331f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e54f23d43741018372552dcf067766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:05:10.367233 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-7d4fae87-4dc4-4c68-b589-2b6dc1358c9f tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 200 len: 1313 microversion: 2.1 time: 0.657245 Aug 18 12:05:10.369983 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2630/5564] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:05:09 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 1313 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:05:10.603274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a44094e6-6640-4c20-bba1-5ce0c7c39257 req-d24f5928-72eb-4d6a-a3c8-9ecff184cda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3922c1ee-6e95-4e84-86ff-7c47471553b6", "name": "network-vif-plugged", "status": "completed", "tag": "ec2ad1a9-631f-424b-b773-a7efa9c4af5f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:05:10.632662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a44094e6-6640-4c20-bba1-5ce0c7c39257 req-d24f5928-72eb-4d6a-a3c8-9ecff184cda7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:10.632662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a44094e6-6640-4c20-bba1-5ce0c7c39257 req-d24f5928-72eb-4d6a-a3c8-9ecff184cda7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:10.632662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a44094e6-6640-4c20-bba1-5ce0c7c39257 req-d24f5928-72eb-4d6a-a3c8-9ecff184cda7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:10.638017 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a44094e6-6640-4c20-bba1-5ce0c7c39257 req-d24f5928-72eb-4d6a-a3c8-9ecff184cda7 service nova] Creating event network-vif-plugged:ec2ad1a9-631f-424b-b773-a7efa9c4af5f for instance 3922c1ee-6e95-4e84-86ff-7c47471553b6 on n-h2-853611-3 Aug 18 12:05:10.666719 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a44094e6-6640-4c20-bba1-5ce0c7c39257 req-d24f5928-72eb-4d6a-a3c8-9ecff184cda7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.590383 Aug 18 12:05:10.667427 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2935/5565] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:05:11.395148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-066d41bc-50e8-47cc-a89c-f38b3a4b4420 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:05:11.395985 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-066d41bc-50e8-47cc-a89c-f38b3a4b4420 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:05:11.410787 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-066d41bc-50e8-47cc-a89c-f38b3a4b4420 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:11.411436 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-066d41bc-50e8-47cc-a89c-f38b3a4b4420 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:11.411879 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-066d41bc-50e8-47cc-a89c-f38b3a4b4420 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:11.415011 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-066d41bc-50e8-47cc-a89c-f38b3a4b4420 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:11.415669 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-066d41bc-50e8-47cc-a89c-f38b3a4b4420 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:11.416641 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-066d41bc-50e8-47cc-a89c-f38b3a4b4420 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:11.858163 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-066d41bc-50e8-47cc-a89c-f38b3a4b4420 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdbeb528714994b33e93fae512331f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e54f23d43741018372552dcf067766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:05:11.908679 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-066d41bc-50e8-47cc-a89c-f38b3a4b4420 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 200 len: 1313 microversion: 2.1 time: 0.518051 Aug 18 12:05:11.910346 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2631/5566] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:05:11 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:05:12.949125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0fcb756c-335d-4ac5-8509-844c15794c51 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:05:12.951435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0fcb756c-335d-4ac5-8509-844c15794c51 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:05:12.978225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fcb756c-335d-4ac5-8509-844c15794c51 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:12.978962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fcb756c-335d-4ac5-8509-844c15794c51 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:12.979848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fcb756c-335d-4ac5-8509-844c15794c51 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:12.981117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fcb756c-335d-4ac5-8509-844c15794c51 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:12.981835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fcb756c-335d-4ac5-8509-844c15794c51 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:12.987266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0fcb756c-335d-4ac5-8509-844c15794c51 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:13.523938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0fcb756c-335d-4ac5-8509-844c15794c51 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdbeb528714994b33e93fae512331f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e54f23d43741018372552dcf067766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:05:13.551724 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0fcb756c-335d-4ac5-8509-844c15794c51 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 200 len: 1497 microversion: 2.1 time: 0.607123 Aug 18 12:05:13.552333 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2936/5567] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:05:12 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 1497 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:05:19.981818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-23b6d3a2-4b6d-48dd-996d-f1eb18082007 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:05:19.983657 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-23b6d3a2-4b6d-48dd-996d-f1eb18082007 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:05:19.991432 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23b6d3a2-4b6d-48dd-996d-f1eb18082007 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:19.991714 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23b6d3a2-4b6d-48dd-996d-f1eb18082007 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:19.992355 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23b6d3a2-4b6d-48dd-996d-f1eb18082007 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:19.993152 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23b6d3a2-4b6d-48dd-996d-f1eb18082007 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:19.994167 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23b6d3a2-4b6d-48dd-996d-f1eb18082007 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:19.994704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-23b6d3a2-4b6d-48dd-996d-f1eb18082007 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:20.026395 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-23b6d3a2-4b6d-48dd-996d-f1eb18082007 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Going to try to terminate instance {{(pid=122209) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:05:20.219876 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-23b6d3a2-4b6d-48dd-996d-f1eb18082007 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 204 len: 0 microversion: 2.1 time: 0.242895 Aug 18 12:05:20.238556 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2632/5568] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:05:19 2022] DELETE /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:05:20.241493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a686f87-da78-4085-ba90-f362d5aefe12 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:05:20.242968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6a686f87-da78-4085-ba90-f362d5aefe12 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:05:20.273677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a686f87-da78-4085-ba90-f362d5aefe12 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:20.274549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a686f87-da78-4085-ba90-f362d5aefe12 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:20.275327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a686f87-da78-4085-ba90-f362d5aefe12 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:20.284088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a686f87-da78-4085-ba90-f362d5aefe12 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:20.284990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a686f87-da78-4085-ba90-f362d5aefe12 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:20.285813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a686f87-da78-4085-ba90-f362d5aefe12 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:20.905427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6a686f87-da78-4085-ba90-f362d5aefe12 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdbeb528714994b33e93fae512331f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e54f23d43741018372552dcf067766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:05:20.957486 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6a686f87-da78-4085-ba90-f362d5aefe12 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 200 len: 1503 microversion: 2.1 time: 0.726706 Aug 18 12:05:20.966673 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2937/5569] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:05:20 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 1503 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:05:22.005338 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2fb18e40-7b9b-4657-8c8a-df9ccfbc24ed tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:05:22.006133 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2fb18e40-7b9b-4657-8c8a-df9ccfbc24ed tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:05:22.030027 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2fb18e40-7b9b-4657-8c8a-df9ccfbc24ed tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:22.030548 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2fb18e40-7b9b-4657-8c8a-df9ccfbc24ed tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:22.031124 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2fb18e40-7b9b-4657-8c8a-df9ccfbc24ed tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:22.031880 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2fb18e40-7b9b-4657-8c8a-df9ccfbc24ed tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:22.032342 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2fb18e40-7b9b-4657-8c8a-df9ccfbc24ed tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:22.032774 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2fb18e40-7b9b-4657-8c8a-df9ccfbc24ed tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:23.229668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-045aee38-ccf2-445c-a22a-a766af4a2823 req-00a31790-0f6a-4f4f-acec-5bae9776eec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3922c1ee-6e95-4e84-86ff-7c47471553b6", "name": "network-vif-deleted", "tag": "ec2ad1a9-631f-424b-b773-a7efa9c4af5f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:05:23.312379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:05:23.330249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-045aee38-ccf2-445c-a22a-a766af4a2823 req-00a31790-0f6a-4f4f-acec-5bae9776eec8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:23.331169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-045aee38-ccf2-445c-a22a-a766af4a2823 req-00a31790-0f6a-4f4f-acec-5bae9776eec8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:23.343867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-045aee38-ccf2-445c-a22a-a766af4a2823 req-00a31790-0f6a-4f4f-acec-5bae9776eec8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:23.424472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=37 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:05:23.445526 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-045aee38-ccf2-445c-a22a-a766af4a2823 req-00a31790-0f6a-4f4f-acec-5bae9776eec8 service nova] Creating event network-vif-deleted:ec2ad1a9-631f-424b-b773-a7efa9c4af5f for instance 3922c1ee-6e95-4e84-86ff-7c47471553b6 on n-h2-853611-3 Aug 18 12:05:23.484423 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-045aee38-ccf2-445c-a22a-a766af4a2823 req-00a31790-0f6a-4f4f-acec-5bae9776eec8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276172 Aug 18 12:05:23.495737 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2938/5570] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:05:23.973827 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.policy [None req-2fb18e40-7b9b-4657-8c8a-df9ccfbc24ed tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdbeb528714994b33e93fae512331f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e54f23d43741018372552dcf067766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122209) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:05:24.027304 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2fb18e40-7b9b-4657-8c8a-df9ccfbc24ed tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 200 len: 1503 microversion: 2.1 time: 2.027098 Aug 18 12:05:24.039276 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2633/5571] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:05:21 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 1503 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:05:25.070266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d47cb6d-7e68-451e-85b9-fae7c0805598 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:05:25.084979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9d47cb6d-7e68-451e-85b9-fae7c0805598 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] [instance: 3922c1ee-6e95-4e84-86ff-7c47471553b6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:05:25.141563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d47cb6d-7e68-451e-85b9-fae7c0805598 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:25.142489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d47cb6d-7e68-451e-85b9-fae7c0805598 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:25.143298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d47cb6d-7e68-451e-85b9-fae7c0805598 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:25.144535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d47cb6d-7e68-451e-85b9-fae7c0805598 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:25.145366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d47cb6d-7e68-451e-85b9-fae7c0805598 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:25.146151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d47cb6d-7e68-451e-85b9-fae7c0805598 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:25.241235 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-9d47cb6d-7e68-451e-85b9-fae7c0805598 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] HTTP exception thrown: Instance 3922c1ee-6e95-4e84-86ff-7c47471553b6 could not be found. Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d47cb6d-7e68-451e-85b9-fae7c0805598 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Request method failure captured: Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 HTTP/1.1 Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ire8xqT2QlcPndZuXbCV669fuO4GNd-VbBmpiXn0K1ZYIx6v6WgAnxoO9DFsThn42kLa8YFi4aaSZOzIOThrPGB6hj4aCfj1d5Bp4RhQmUPWnda9SAbGCgfOTOaoc5ARmkB8F_4rNWYa3lCYaui5X1WvP5OCdILFKDWz3XZTXpdB6c Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: d2e54f23d43741018372552dcf067766 Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-VolumesActionsTest-655518453 Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d2e54f23d43741018372552dcf067766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/d2e54f23d43741018372552dcf067766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_d2e54f23d43741018372552dcf067766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/d2e54f23d43741018372552dcf067766"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-VolumesActionsTest-655518453 Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: d2e54f23d43741018372552dcf067766 Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-VolumesActionsTest-655518453 Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-VolumesActionsTest-655518453-project Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 21fdbeb528714994b33e93fae512331f Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-VolumesActionsTest-655518453-project Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 3922c1ee-6e95-4e84-86ff-7c47471553b6 could not be found. Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '3922c1ee-6e95-4e84-86ff-7c47471553b6'} Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3922c1ee-6e95-4e84-86ff-7c47471553b6 could not be found. Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3922c1ee-6e95-4e84-86ff-7c47471553b6 could not be found. Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:05:25.246229 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:05:25.265871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:05:25.265871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:05:25.265871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:05:25.265871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:05:25.265871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:05:25.265871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3922c1ee-6e95-4e84-86ff-7c47471553b6 could not be found. Aug 18 12:05:25.265871 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:05:25.265871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d47cb6d-7e68-451e-85b9-fae7c0805598 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] Returning 404 to user: Instance 3922c1ee-6e95-4e84-86ff-7c47471553b6 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:05:25.269891 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9d47cb6d-7e68-451e-85b9-fae7c0805598 tempest-VolumesActionsTest-655518453 tempest-VolumesActionsTest-655518453-project] 10.222.0.73 "GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6" status: 404 len: 111 microversion: 2.1 time: 0.211883 Aug 18 12:05:25.272841 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2939/5572] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:05:25 2022] GET /compute/v2.1/servers/3922c1ee-6e95-4e84-86ff-7c47471553b6 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:05:53.781079 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:05:53.783557 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:05:54.276503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a93bc492-b549-4f4a-aa17-f4b273e7e336 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:05:54.277639 n-d-853611-3 devstack@n-api.service[122209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:05:54.277639 n-d-853611-3 devstack@n-api.service[122209]: warnings.warn(msg) Aug 18 12:05:54.278839 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a93bc492-b549-4f4a-aa17-f4b273e7e336 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:54.279418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a93bc492-b549-4f4a-aa17-f4b273e7e336 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:54.279929 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a93bc492-b549-4f4a-aa17-f4b273e7e336 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:54.283812 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a93bc492-b549-4f4a-aa17-f4b273e7e336 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:54.284840 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a93bc492-b549-4f4a-aa17-f4b273e7e336 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:54.285394 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a93bc492-b549-4f4a-aa17-f4b273e7e336 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:54.463991 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a93bc492-b549-4f4a-aa17-f4b273e7e336 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.691213 Aug 18 12:05:54.465092 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2634/5573] 10.222.0.73 () {58 vars in 1185 bytes} [Thu Aug 18 12:05:53 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:05:54.748400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1416531254", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "availability_zone": "nova:n-h2-853611-3", "networks": [{"uuid": "33a8b5c5-8fc7-4c76-b77a-b56505231990"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:05:54.808148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:05:54.816346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:05:55.795389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] validate_networks() for [('33a8b5c5-8fc7-4c76-b77a-b56505231990', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:05:57.359349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:05:57.359349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:05:57.359349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:05:57.359349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:05:57.359349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:05:57.395793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:57.396670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:57.397465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:57.398896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:05:57.399746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:05:57.400550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:05:57.488164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Getting quotas for project 60807e83fdba411580f23dee4c146fb2. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:05:57.519405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Getting quotas for user 230e12facb4b4d5daa74197bfcc7778d and project 60807e83fdba411580f23dee4c146fb2. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:05:57.551780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:05:57.555247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:05:57.717305 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-60ef0686-aa50-4368-a37e-7d8909a645df tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.973403 Aug 18 12:05:57.724062 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2940/5574] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:05:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:05:57.743842 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-23013c0a-165c-484e-8f96-453dc0b8849d tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:05:57.748967 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-23013c0a-165c-484e-8f96-453dc0b8849d tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:05:57.920228 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-23013c0a-165c-484e-8f96-453dc0b8849d tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1329 microversion: 2.1 time: 0.177623 Aug 18 12:05:57.924074 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2635/5575] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:05:57 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1329 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:05:58.945237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-61a0857a-0e95-4645-bd58-009f8a1e2f87 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:05:58.946917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-61a0857a-0e95-4645-bd58-009f8a1e2f87 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:05:59.185726 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-61a0857a-0e95-4645-bd58-009f8a1e2f87 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1329 microversion: 2.1 time: 0.245458 Aug 18 12:05:59.213357 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2941/5576] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:05:58 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1329 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:00.254801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-46d74539-69a3-41ec-b8e5-8387fa10020a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:00.259042 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-46d74539-69a3-41ec-b8e5-8387fa10020a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:00.295110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46d74539-69a3-41ec-b8e5-8387fa10020a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:00.296726 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46d74539-69a3-41ec-b8e5-8387fa10020a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:00.297655 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46d74539-69a3-41ec-b8e5-8387fa10020a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:00.299379 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46d74539-69a3-41ec-b8e5-8387fa10020a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:00.300252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46d74539-69a3-41ec-b8e5-8387fa10020a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:00.301424 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-46d74539-69a3-41ec-b8e5-8387fa10020a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:00.830964 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-46d74539-69a3-41ec-b8e5-8387fa10020a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1416 microversion: 2.1 time: 0.583966 Aug 18 12:06:00.831981 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2636/5577] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:00 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1416 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:01.880181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fd565e2c-443d-42f5-9ddc-8e71f3fd99bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:01.882131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fd565e2c-443d-42f5-9ddc-8e71f3fd99bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:01.928711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd565e2c-443d-42f5-9ddc-8e71f3fd99bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:01.931453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd565e2c-443d-42f5-9ddc-8e71f3fd99bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:01.955387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd565e2c-443d-42f5-9ddc-8e71f3fd99bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:01.957252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd565e2c-443d-42f5-9ddc-8e71f3fd99bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:01.958130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd565e2c-443d-42f5-9ddc-8e71f3fd99bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:01.959055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd565e2c-443d-42f5-9ddc-8e71f3fd99bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:02.532962 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fd565e2c-443d-42f5-9ddc-8e71f3fd99bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1464 microversion: 2.1 time: 0.659649 Aug 18 12:06:02.554990 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2942/5578] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:01 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1464 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:03.577213 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-2fd5c7e6-6cc7-4170-84ca-b8b59c7114b3 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:03.581971 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-2fd5c7e6-6cc7-4170-84ca-b8b59c7114b3 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:03.612922 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2fd5c7e6-6cc7-4170-84ca-b8b59c7114b3 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:03.620062 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2fd5c7e6-6cc7-4170-84ca-b8b59c7114b3 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:03.621046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2fd5c7e6-6cc7-4170-84ca-b8b59c7114b3 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:03.625343 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2fd5c7e6-6cc7-4170-84ca-b8b59c7114b3 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:03.629869 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2fd5c7e6-6cc7-4170-84ca-b8b59c7114b3 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:03.631473 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-2fd5c7e6-6cc7-4170-84ca-b8b59c7114b3 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:04.325448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:04.326894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-44085e2a-a45f-49a6-a37d-8671eb82936e req-db2dba77-0492-42da-a6d5-e59699c2fe71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1", "tag": "39c580f6-e03d-449c-b0c3-61f56823ddda"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:04.388624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-44085e2a-a45f-49a6-a37d-8671eb82936e req-db2dba77-0492-42da-a6d5-e59699c2fe71 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:04.388624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-44085e2a-a45f-49a6-a37d-8671eb82936e req-db2dba77-0492-42da-a6d5-e59699c2fe71 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:04.389198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-44085e2a-a45f-49a6-a37d-8671eb82936e req-db2dba77-0492-42da-a6d5-e59699c2fe71 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:04.471941 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-44085e2a-a45f-49a6-a37d-8671eb82936e req-db2dba77-0492-42da-a6d5-e59699c2fe71 service nova] Creating event network-changed:39c580f6-e03d-449c-b0c3-61f56823ddda for instance ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 on n-h2-853611-3 Aug 18 12:06:04.493658 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-44085e2a-a45f-49a6-a37d-8671eb82936e req-db2dba77-0492-42da-a6d5-e59699c2fe71 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181509 Aug 18 12:06:04.502191 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2943/5579] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:06:04.545897 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-2fd5c7e6-6cc7-4170-84ca-b8b59c7114b3 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1464 microversion: 2.1 time: 0.981070 Aug 18 12:06:04.563250 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2637/5580] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:03 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1464 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:05.585927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c7afcac1-6b32-4624-81ca-59311e69bcb9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:05.587360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c7afcac1-6b32-4624-81ca-59311e69bcb9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:05.597531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7afcac1-6b32-4624-81ca-59311e69bcb9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:05.598334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7afcac1-6b32-4624-81ca-59311e69bcb9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:05.598963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7afcac1-6b32-4624-81ca-59311e69bcb9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:05.599883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7afcac1-6b32-4624-81ca-59311e69bcb9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:05.600507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7afcac1-6b32-4624-81ca-59311e69bcb9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:05.601160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7afcac1-6b32-4624-81ca-59311e69bcb9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:05.991230 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c7afcac1-6b32-4624-81ca-59311e69bcb9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1464 microversion: 2.1 time: 0.410311 Aug 18 12:06:05.994817 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2944/5581] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:05 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1464 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:07.020667 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-a3405672-46d6-464f-befd-4b2a6ae7f0bf tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:07.021466 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-a3405672-46d6-464f-befd-4b2a6ae7f0bf tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:07.046219 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3405672-46d6-464f-befd-4b2a6ae7f0bf tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:07.047308 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3405672-46d6-464f-befd-4b2a6ae7f0bf tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:07.047818 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3405672-46d6-464f-befd-4b2a6ae7f0bf tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:07.048777 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3405672-46d6-464f-befd-4b2a6ae7f0bf tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:07.051249 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3405672-46d6-464f-befd-4b2a6ae7f0bf tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:07.052817 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-a3405672-46d6-464f-befd-4b2a6ae7f0bf tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:07.521005 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-a3405672-46d6-464f-befd-4b2a6ae7f0bf tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1464 microversion: 2.1 time: 0.507972 Aug 18 12:06:07.525757 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2638/5582] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:07 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1464 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:08.543837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-447faed0-326c-4586-b071-f08a9acda7f6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:08.544591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-447faed0-326c-4586-b071-f08a9acda7f6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:08.548335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:08.561016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-447faed0-326c-4586-b071-f08a9acda7f6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:08.561602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-447faed0-326c-4586-b071-f08a9acda7f6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:08.562729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-447faed0-326c-4586-b071-f08a9acda7f6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:08.567137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-447faed0-326c-4586-b071-f08a9acda7f6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:08.567680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-447faed0-326c-4586-b071-f08a9acda7f6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:08.567680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-447faed0-326c-4586-b071-f08a9acda7f6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:08.834928 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-447faed0-326c-4586-b071-f08a9acda7f6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1464 microversion: 2.1 time: 0.293472 Aug 18 12:06:08.854326 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2945/5583] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:08 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1464 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:06:09.863256 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-234922a6-78d8-44c9-aabc-e497c664b10e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:09.864603 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-234922a6-78d8-44c9-aabc-e497c664b10e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:09.868252 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:09.885673 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-234922a6-78d8-44c9-aabc-e497c664b10e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:09.886190 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-234922a6-78d8-44c9-aabc-e497c664b10e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:09.886690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-234922a6-78d8-44c9-aabc-e497c664b10e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:09.887448 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-234922a6-78d8-44c9-aabc-e497c664b10e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:09.887918 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-234922a6-78d8-44c9-aabc-e497c664b10e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:09.888365 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-234922a6-78d8-44c9-aabc-e497c664b10e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:10.354956 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-234922a6-78d8-44c9-aabc-e497c664b10e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1464 microversion: 2.1 time: 0.496258 Aug 18 12:06:10.364923 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2639/5584] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:09 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1464 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:06:11.410008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4adf578c-4a2d-48e5-ae91-e06672fb6211 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:11.411295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4adf578c-4a2d-48e5-ae91-e06672fb6211 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:11.417943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:11.421220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4adf578c-4a2d-48e5-ae91-e06672fb6211 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:11.422194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4adf578c-4a2d-48e5-ae91-e06672fb6211 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:11.422869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4adf578c-4a2d-48e5-ae91-e06672fb6211 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:11.425141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4adf578c-4a2d-48e5-ae91-e06672fb6211 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:11.425775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4adf578c-4a2d-48e5-ae91-e06672fb6211 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:11.426365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4adf578c-4a2d-48e5-ae91-e06672fb6211 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:11.651731 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4adf578c-4a2d-48e5-ae91-e06672fb6211 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1464 microversion: 2.1 time: 0.243612 Aug 18 12:06:11.653797 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2946/5585] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:11 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1464 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:12.235467 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-9b90c29b-11ba-41db-97f8-cc6b01d61787 req-3c000384-ad60-437c-9446-d46623c97f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1", "name": "network-vif-plugged", "status": "completed", "tag": "39c580f6-e03d-449c-b0c3-61f56823ddda"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:12.254270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9b90c29b-11ba-41db-97f8-cc6b01d61787 req-3c000384-ad60-437c-9446-d46623c97f74 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:12.254801 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9b90c29b-11ba-41db-97f8-cc6b01d61787 req-3c000384-ad60-437c-9446-d46623c97f74 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:12.255241 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9b90c29b-11ba-41db-97f8-cc6b01d61787 req-3c000384-ad60-437c-9446-d46623c97f74 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:12.280547 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-9b90c29b-11ba-41db-97f8-cc6b01d61787 req-3c000384-ad60-437c-9446-d46623c97f74 service nova] Creating event network-vif-plugged:39c580f6-e03d-449c-b0c3-61f56823ddda for instance ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 on n-h2-853611-3 Aug 18 12:06:12.312966 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-9b90c29b-11ba-41db-97f8-cc6b01d61787 req-3c000384-ad60-437c-9446-d46623c97f74 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092077 Aug 18 12:06:12.330459 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2640/5586] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:06:12.677721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3e4b8465-f1c3-410c-99ef-174aa6d703f8 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:12.678336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3e4b8465-f1c3-410c-99ef-174aa6d703f8 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:12.724842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e4b8465-f1c3-410c-99ef-174aa6d703f8 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:12.725374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e4b8465-f1c3-410c-99ef-174aa6d703f8 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:12.725815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e4b8465-f1c3-410c-99ef-174aa6d703f8 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:12.726815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e4b8465-f1c3-410c-99ef-174aa6d703f8 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:12.727454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e4b8465-f1c3-410c-99ef-174aa6d703f8 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:12.728046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e4b8465-f1c3-410c-99ef-174aa6d703f8 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:13.115228 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3e4b8465-f1c3-410c-99ef-174aa6d703f8 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1464 microversion: 2.1 time: 0.441052 Aug 18 12:06:13.128034 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2947/5587] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:12 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1464 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:14.149082 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-5999ce5d-df3d-47ac-b93a-1d8c3d798e67 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:14.151225 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-5999ce5d-df3d-47ac-b93a-1d8c3d798e67 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:14.168907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5999ce5d-df3d-47ac-b93a-1d8c3d798e67 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:14.169403 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5999ce5d-df3d-47ac-b93a-1d8c3d798e67 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:14.169859 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5999ce5d-df3d-47ac-b93a-1d8c3d798e67 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:14.170671 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5999ce5d-df3d-47ac-b93a-1d8c3d798e67 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:14.174653 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5999ce5d-df3d-47ac-b93a-1d8c3d798e67 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:14.175299 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-5999ce5d-df3d-47ac-b93a-1d8c3d798e67 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:14.496247 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-5999ce5d-df3d-47ac-b93a-1d8c3d798e67 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1650 microversion: 2.1 time: 0.354321 Aug 18 12:06:14.511976 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2641/5588] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:14 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1650 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:14.534763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c3ceee34-25a2-477d-8419-abb79d050c09 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:14.535552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c3ceee34-25a2-477d-8419-abb79d050c09 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:14.553668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3ceee34-25a2-477d-8419-abb79d050c09 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:14.554208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3ceee34-25a2-477d-8419-abb79d050c09 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:14.554734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3ceee34-25a2-477d-8419-abb79d050c09 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:14.555591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3ceee34-25a2-477d-8419-abb79d050c09 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:14.556093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3ceee34-25a2-477d-8419-abb79d050c09 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:14.556547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3ceee34-25a2-477d-8419-abb79d050c09 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:14.836742 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c3ceee34-25a2-477d-8419-abb79d050c09 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1650 microversion: 2.1 time: 0.315088 Aug 18 12:06:14.837625 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2948/5589] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:14 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1650 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:14.860934 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e4221863-1b4a-4082-930a-29a1d2b5c18d tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:14.861579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e4221863-1b4a-4082-930a-29a1d2b5c18d tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:14.869269 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4221863-1b4a-4082-930a-29a1d2b5c18d tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:14.869773 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4221863-1b4a-4082-930a-29a1d2b5c18d tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:14.870458 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4221863-1b4a-4082-930a-29a1d2b5c18d tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:14.871221 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4221863-1b4a-4082-930a-29a1d2b5c18d tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:14.871867 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4221863-1b4a-4082-930a-29a1d2b5c18d tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:14.872727 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e4221863-1b4a-4082-930a-29a1d2b5c18d tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:15.185089 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e4221863-1b4a-4082-930a-29a1d2b5c18d tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1650 microversion: 2.1 time: 0.329289 Aug 18 12:06:15.188616 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2642/5590] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:14 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1650 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:15.335327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-500006163", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "availability_zone": "nova:n-h1-853611-3", "networks": [{"uuid": "33a8b5c5-8fc7-4c76-b77a-b56505231990"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:15.462391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] validate_networks() for [('33a8b5c5-8fc7-4c76-b77a-b56505231990', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:06:16.632686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:06:16.635504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:06:16.636223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:06:16.636830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:06:16.637453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:06:16.665112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:16.665900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:16.666658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:16.667458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:16.668233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:16.669030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:16.731644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Getting quotas for project 60807e83fdba411580f23dee4c146fb2. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:06:16.748722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Getting quotas for user 230e12facb4b4d5daa74197bfcc7778d and project 60807e83fdba411580f23dee4c146fb2. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:06:16.784879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:06:16.790316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:06:16.879774 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d62fb206-8149-4052-aa64-bffbdc23f583 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.547903 Aug 18 12:06:16.881501 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2949/5591] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:06:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:06:16.920734 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-c36c2877-a8e5-4989-b720-9950f9304188 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:16.921402 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-c36c2877-a8e5-4989-b720-9950f9304188 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:17.168683 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-c36c2877-a8e5-4989-b720-9950f9304188 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1328 microversion: 2.1 time: 0.255930 Aug 18 12:06:17.169703 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2643/5592] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:16 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1328 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:06:18.211019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7a2e4d62-8457-49f7-a245-628ef9e34a63 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:18.212451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7a2e4d62-8457-49f7-a245-628ef9e34a63 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:18.224534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a2e4d62-8457-49f7-a245-628ef9e34a63 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:18.225928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a2e4d62-8457-49f7-a245-628ef9e34a63 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:18.227144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a2e4d62-8457-49f7-a245-628ef9e34a63 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:18.230077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a2e4d62-8457-49f7-a245-628ef9e34a63 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:18.230889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a2e4d62-8457-49f7-a245-628ef9e34a63 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:18.231707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a2e4d62-8457-49f7-a245-628ef9e34a63 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:18.492180 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7a2e4d62-8457-49f7-a245-628ef9e34a63 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1337 microversion: 2.1 time: 0.282870 Aug 18 12:06:18.506536 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2950/5593] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:18 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1337 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:06:19.537373 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4ba25917-724b-4bf7-90be-9f74d10526ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:19.541907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4ba25917-724b-4bf7-90be-9f74d10526ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:19.575520 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ba25917-724b-4bf7-90be-9f74d10526ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:19.583902 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ba25917-724b-4bf7-90be-9f74d10526ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:19.585034 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ba25917-724b-4bf7-90be-9f74d10526ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:19.586534 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ba25917-724b-4bf7-90be-9f74d10526ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:19.587554 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ba25917-724b-4bf7-90be-9f74d10526ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:19.594075 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4ba25917-724b-4bf7-90be-9f74d10526ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:19.930232 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4ba25917-724b-4bf7-90be-9f74d10526ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1421 microversion: 2.1 time: 0.401135 Aug 18 12:06:19.955631 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2644/5594] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:19 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1421 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:20.978392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a94941bb-ff0d-465a-a9d9-4d00b7b2dfe5 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:20.981976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a94941bb-ff0d-465a-a9d9-4d00b7b2dfe5 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:21.012543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a94941bb-ff0d-465a-a9d9-4d00b7b2dfe5 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:21.016222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a94941bb-ff0d-465a-a9d9-4d00b7b2dfe5 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:21.020981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a94941bb-ff0d-465a-a9d9-4d00b7b2dfe5 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:21.022236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a94941bb-ff0d-465a-a9d9-4d00b7b2dfe5 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:21.023117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a94941bb-ff0d-465a-a9d9-4d00b7b2dfe5 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:21.023926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a94941bb-ff0d-465a-a9d9-4d00b7b2dfe5 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:21.524579 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a94941bb-ff0d-465a-a9d9-4d00b7b2dfe5 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1463 microversion: 2.1 time: 0.550066 Aug 18 12:06:21.525596 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2951/5595] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:20 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1463 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:22.577619 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-568d4161-aed8-45d4-8252-b3af9265f6ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:22.591961 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-568d4161-aed8-45d4-8252-b3af9265f6ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:22.648948 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-568d4161-aed8-45d4-8252-b3af9265f6ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:22.650182 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-568d4161-aed8-45d4-8252-b3af9265f6ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:22.652705 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-568d4161-aed8-45d4-8252-b3af9265f6ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:22.655911 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-568d4161-aed8-45d4-8252-b3af9265f6ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:22.658263 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-568d4161-aed8-45d4-8252-b3af9265f6ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:22.659165 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-568d4161-aed8-45d4-8252-b3af9265f6ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:22.744314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d148d68f-e19f-4752-a58b-435dfa153856 req-883028fd-7ed1-4dec-b1c8-886619fd1c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1e4e16-a47a-4137-b059-c45fd3308070", "tag": "e26e961c-f42e-46f2-a6e5-3418a9d86638"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:22.776824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d148d68f-e19f-4752-a58b-435dfa153856 req-883028fd-7ed1-4dec-b1c8-886619fd1c9e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:22.777331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d148d68f-e19f-4752-a58b-435dfa153856 req-883028fd-7ed1-4dec-b1c8-886619fd1c9e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:22.777792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d148d68f-e19f-4752-a58b-435dfa153856 req-883028fd-7ed1-4dec-b1c8-886619fd1c9e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:22.838166 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d148d68f-e19f-4752-a58b-435dfa153856 req-883028fd-7ed1-4dec-b1c8-886619fd1c9e service nova] Creating event network-changed:e26e961c-f42e-46f2-a6e5-3418a9d86638 for instance 6f1e4e16-a47a-4137-b059-c45fd3308070 on n-h1-853611-3 Aug 18 12:06:22.847798 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d148d68f-e19f-4752-a58b-435dfa153856 req-883028fd-7ed1-4dec-b1c8-886619fd1c9e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109289 Aug 18 12:06:22.848803 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2952/5596] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:06:23.226063 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-568d4161-aed8-45d4-8252-b3af9265f6ec tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1463 microversion: 2.1 time: 0.664360 Aug 18 12:06:23.226723 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2645/5597] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:22 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1463 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:24.268963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3636d930-10b3-4cfa-ac95-4c933b428994 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:24.269702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3636d930-10b3-4cfa-ac95-4c933b428994 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:24.283212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3636d930-10b3-4cfa-ac95-4c933b428994 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:24.283403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3636d930-10b3-4cfa-ac95-4c933b428994 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:24.304351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3636d930-10b3-4cfa-ac95-4c933b428994 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:24.305703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3636d930-10b3-4cfa-ac95-4c933b428994 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:24.306228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3636d930-10b3-4cfa-ac95-4c933b428994 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:24.306733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3636d930-10b3-4cfa-ac95-4c933b428994 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:24.686162 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3636d930-10b3-4cfa-ac95-4c933b428994 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1463 microversion: 2.1 time: 0.418290 Aug 18 12:06:24.688294 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2953/5598] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:24 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1463 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:25.717056 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-45418b46-e0e8-48f7-985a-75990d46364a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:25.718341 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-45418b46-e0e8-48f7-985a-75990d46364a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:25.732670 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=31 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:25.739418 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45418b46-e0e8-48f7-985a-75990d46364a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:25.740525 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45418b46-e0e8-48f7-985a-75990d46364a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:25.741704 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45418b46-e0e8-48f7-985a-75990d46364a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:25.743175 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45418b46-e0e8-48f7-985a-75990d46364a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:25.743891 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45418b46-e0e8-48f7-985a-75990d46364a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:25.744620 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-45418b46-e0e8-48f7-985a-75990d46364a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:25.803036 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=53 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:26.514639 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-45418b46-e0e8-48f7-985a-75990d46364a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1463 microversion: 2.1 time: 0.805002 Aug 18 12:06:26.526938 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2646/5599] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:25 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1463 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:27.560529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2924613b-0bba-4878-9a92-95aac83d91bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:27.561908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2924613b-0bba-4878-9a92-95aac83d91bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:27.566142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:27.573072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:27.574346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:27.589752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2924613b-0bba-4878-9a92-95aac83d91bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:27.601616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2924613b-0bba-4878-9a92-95aac83d91bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:27.605706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2924613b-0bba-4878-9a92-95aac83d91bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:27.607488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2924613b-0bba-4878-9a92-95aac83d91bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:27.610906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2924613b-0bba-4878-9a92-95aac83d91bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:27.614282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2924613b-0bba-4878-9a92-95aac83d91bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:27.721300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=63 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:28.143227 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2924613b-0bba-4878-9a92-95aac83d91bc tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1463 microversion: 2.1 time: 0.583263 Aug 18 12:06:28.143928 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2954/5600] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:27 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1463 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:29.171435 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4133e2e4-cb12-47a2-ab41-4fdd660b1382 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:29.174148 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4133e2e4-cb12-47a2-ab41-4fdd660b1382 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:29.176924 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:29.183907 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4133e2e4-cb12-47a2-ab41-4fdd660b1382 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:29.184624 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4133e2e4-cb12-47a2-ab41-4fdd660b1382 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:29.185238 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4133e2e4-cb12-47a2-ab41-4fdd660b1382 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:29.186419 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4133e2e4-cb12-47a2-ab41-4fdd660b1382 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:29.187076 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4133e2e4-cb12-47a2-ab41-4fdd660b1382 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:29.188197 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4133e2e4-cb12-47a2-ab41-4fdd660b1382 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:29.515511 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4133e2e4-cb12-47a2-ab41-4fdd660b1382 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1463 microversion: 2.1 time: 0.351820 Aug 18 12:06:29.528966 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2647/5601] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:29 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1463 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:30.544917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7039a8fa-d9f4-4908-83d0-ca065bc48ba6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:30.556787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7039a8fa-d9f4-4908-83d0-ca065bc48ba6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:30.597528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7039a8fa-d9f4-4908-83d0-ca065bc48ba6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:30.598938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7039a8fa-d9f4-4908-83d0-ca065bc48ba6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:30.603201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7039a8fa-d9f4-4908-83d0-ca065bc48ba6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:30.608590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7039a8fa-d9f4-4908-83d0-ca065bc48ba6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:30.622659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7039a8fa-d9f4-4908-83d0-ca065bc48ba6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:30.644057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7039a8fa-d9f4-4908-83d0-ca065bc48ba6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:30.944928 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7039a8fa-d9f4-4908-83d0-ca065bc48ba6 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1463 microversion: 2.1 time: 0.401858 Aug 18 12:06:30.945642 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2955/5602] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:30 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1463 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:31.205996 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-9c1c855c-e2fa-41f1-b650-9e94a1f99a4c req-f162497d-d0b6-484a-921d-e6a30e71d53c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1e4e16-a47a-4137-b059-c45fd3308070", "name": "network-vif-plugged", "status": "completed", "tag": "e26e961c-f42e-46f2-a6e5-3418a9d86638"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:31.256103 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9c1c855c-e2fa-41f1-b650-9e94a1f99a4c req-f162497d-d0b6-484a-921d-e6a30e71d53c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:31.259574 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9c1c855c-e2fa-41f1-b650-9e94a1f99a4c req-f162497d-d0b6-484a-921d-e6a30e71d53c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:31.261987 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-9c1c855c-e2fa-41f1-b650-9e94a1f99a4c req-f162497d-d0b6-484a-921d-e6a30e71d53c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:31.293948 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-9c1c855c-e2fa-41f1-b650-9e94a1f99a4c req-f162497d-d0b6-484a-921d-e6a30e71d53c service nova] Creating event network-vif-plugged:e26e961c-f42e-46f2-a6e5-3418a9d86638 for instance 6f1e4e16-a47a-4137-b059-c45fd3308070 on n-h1-853611-3 Aug 18 12:06:31.305843 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-9c1c855c-e2fa-41f1-b650-9e94a1f99a4c req-f162497d-d0b6-484a-921d-e6a30e71d53c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116912 Aug 18 12:06:31.309681 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2648/5603] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:06:31.971943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cb5f5ffb-642c-4e6e-9865-e36a4f7ba7d1 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:31.972562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cb5f5ffb-642c-4e6e-9865-e36a4f7ba7d1 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:31.992339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb5f5ffb-642c-4e6e-9865-e36a4f7ba7d1 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:31.992837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb5f5ffb-642c-4e6e-9865-e36a4f7ba7d1 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:31.993284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb5f5ffb-642c-4e6e-9865-e36a4f7ba7d1 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:31.994013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb5f5ffb-642c-4e6e-9865-e36a4f7ba7d1 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:32.006063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb5f5ffb-642c-4e6e-9865-e36a4f7ba7d1 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:32.006659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb5f5ffb-642c-4e6e-9865-e36a4f7ba7d1 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:32.375230 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cb5f5ffb-642c-4e6e-9865-e36a4f7ba7d1 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1463 microversion: 2.1 time: 0.408050 Aug 18 12:06:32.381356 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2956/5604] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:31 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1463 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:33.425830 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-4904eebd-9e6c-47da-bc9d-45ed85b95091 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:33.427407 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-4904eebd-9e6c-47da-bc9d-45ed85b95091 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:33.443579 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4904eebd-9e6c-47da-bc9d-45ed85b95091 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:33.455270 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4904eebd-9e6c-47da-bc9d-45ed85b95091 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:33.456012 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4904eebd-9e6c-47da-bc9d-45ed85b95091 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:33.456940 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4904eebd-9e6c-47da-bc9d-45ed85b95091 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:33.457577 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4904eebd-9e6c-47da-bc9d-45ed85b95091 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:33.458185 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-4904eebd-9e6c-47da-bc9d-45ed85b95091 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:33.721974 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-4904eebd-9e6c-47da-bc9d-45ed85b95091 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1648 microversion: 2.1 time: 0.303898 Aug 18 12:06:33.727451 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2649/5605] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:33 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1648 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:33.763390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-285ba784-4866-4841-804c-8f639aa2f064 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:33.765110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-285ba784-4866-4841-804c-8f639aa2f064 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:33.774032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-285ba784-4866-4841-804c-8f639aa2f064 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:33.774587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-285ba784-4866-4841-804c-8f639aa2f064 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:33.775270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-285ba784-4866-4841-804c-8f639aa2f064 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:33.776370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-285ba784-4866-4841-804c-8f639aa2f064 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:33.777018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-285ba784-4866-4841-804c-8f639aa2f064 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:33.777625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-285ba784-4866-4841-804c-8f639aa2f064 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:34.087770 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-285ba784-4866-4841-804c-8f639aa2f064 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1648 microversion: 2.1 time: 0.328938 Aug 18 12:06:34.089697 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2957/5606] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:33 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1648 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:34.120914 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-33244719-cf5f-4165-b224-5f6ea0de767c tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:34.122091 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-33244719-cf5f-4165-b224-5f6ea0de767c tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:34.133677 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33244719-cf5f-4165-b224-5f6ea0de767c tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:34.134693 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33244719-cf5f-4165-b224-5f6ea0de767c tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:34.135490 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33244719-cf5f-4165-b224-5f6ea0de767c tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:34.136828 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33244719-cf5f-4165-b224-5f6ea0de767c tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:34.137706 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33244719-cf5f-4165-b224-5f6ea0de767c tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:34.138545 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-33244719-cf5f-4165-b224-5f6ea0de767c tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:34.400178 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-33244719-cf5f-4165-b224-5f6ea0de767c tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1648 microversion: 2.1 time: 0.286645 Aug 18 12:06:34.401780 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2650/5607] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:34 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1648 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:34.442575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1d5c392e-42df-4b66-9c47-8fb3067325be tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:34.443539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1d5c392e-42df-4b66-9c47-8fb3067325be tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:34.454169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d5c392e-42df-4b66-9c47-8fb3067325be tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:34.454939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d5c392e-42df-4b66-9c47-8fb3067325be tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:34.455878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d5c392e-42df-4b66-9c47-8fb3067325be tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:34.457149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d5c392e-42df-4b66-9c47-8fb3067325be tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:34.458224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d5c392e-42df-4b66-9c47-8fb3067325be tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:34.459299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d5c392e-42df-4b66-9c47-8fb3067325be tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:34.503415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1d5c392e-42df-4b66-9c47-8fb3067325be tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:06:34.638008 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1d5c392e-42df-4b66-9c47-8fb3067325be tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "DELETE /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 204 len: 0 microversion: 2.1 time: 0.203103 Aug 18 12:06:34.638610 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-128213415", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:34.642084 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2958/5608] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:06:34 2022] DELETE /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:06:34.663434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b94cd0f-1c28-45b4-a2d9-3b2e6cb2b4c7 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:34.665189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2b94cd0f-1c28-45b4-a2d9-3b2e6cb2b4c7 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:34.683957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b94cd0f-1c28-45b4-a2d9-3b2e6cb2b4c7 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:34.685461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b94cd0f-1c28-45b4-a2d9-3b2e6cb2b4c7 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:34.686565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b94cd0f-1c28-45b4-a2d9-3b2e6cb2b4c7 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:34.689043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b94cd0f-1c28-45b4-a2d9-3b2e6cb2b4c7 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:34.690213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b94cd0f-1c28-45b4-a2d9-3b2e6cb2b4c7 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:34.691323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b94cd0f-1c28-45b4-a2d9-3b2e6cb2b4c7 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:34.726207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.network.neutron [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] validate_networks() for None {{(pid=122209) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:06:34.934857 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2b94cd0f-1c28-45b4-a2d9-3b2e6cb2b4c7 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1654 microversion: 2.1 time: 0.287559 Aug 18 12:06:34.936171 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2959/5609] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:34 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1654 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:35.132503 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Flavor limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:06:35.133068 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Image limits 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:06:35.133627 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Flavor pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:06:35.134110 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Image pref 0:0:0 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:06:35.134805 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.virt.hardware [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:06:35.146494 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:35.147253 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:35.147960 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:35.148981 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:35.149690 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:35.150376 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:35.176606 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Getting quotas for project eece9c292977420eb94c05c2da135133. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:06:35.184077 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.quota [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Getting quotas for user 9d5c8d29e467497b8b4daf3cec4c5f28 and project eece9c292977420eb94c05c2da135133. Resources: {'instances', 'cores', 'ram'} {{(pid=122209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:06:35.206647 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Going to run 1 instances... {{(pid=122209) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:06:35.209430 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:06:35.349031 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-eb40c410-f976-42e3-82b1-53c23bb4be2d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714923 Aug 18 12:06:35.350248 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2651/5610] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:06:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:06:35.368488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-36795801-44fb-4874-bfdb-8b35240f70a4 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:35.380053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-36795801-44fb-4874-bfdb-8b35240f70a4 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:35.512707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-36795801-44fb-4874-bfdb-8b35240f70a4 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5c8d29e467497b8b4daf3cec4c5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eece9c292977420eb94c05c2da135133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:35.528184 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-36795801-44fb-4874-bfdb-8b35240f70a4 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f" status: 200 len: 1214 microversion: 2.1 time: 0.168644 Aug 18 12:06:35.539313 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2960/5611] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:35 2022] GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:35.961257 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-e1dbf91c-5dc9-491e-a7a9-614602254e40 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:35.962046 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-e1dbf91c-5dc9-491e-a7a9-614602254e40 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:35.975530 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1dbf91c-5dc9-491e-a7a9-614602254e40 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:35.980261 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1dbf91c-5dc9-491e-a7a9-614602254e40 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:35.981207 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1dbf91c-5dc9-491e-a7a9-614602254e40 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:35.982282 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1dbf91c-5dc9-491e-a7a9-614602254e40 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:35.983302 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1dbf91c-5dc9-491e-a7a9-614602254e40 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:35.988605 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-e1dbf91c-5dc9-491e-a7a9-614602254e40 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:36.271089 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-e1dbf91c-5dc9-491e-a7a9-614602254e40 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1654 microversion: 2.1 time: 0.315122 Aug 18 12:06:36.312654 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2652/5612] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:35 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1654 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:36.553713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a34bd70e-4537-4bef-9d84-ec903d90e107 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:36.555036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a34bd70e-4537-4bef-9d84-ec903d90e107 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:36.580947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34bd70e-4537-4bef-9d84-ec903d90e107 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:36.581893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34bd70e-4537-4bef-9d84-ec903d90e107 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:36.583727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34bd70e-4537-4bef-9d84-ec903d90e107 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:36.585311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34bd70e-4537-4bef-9d84-ec903d90e107 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:36.587167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34bd70e-4537-4bef-9d84-ec903d90e107 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:36.590802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a34bd70e-4537-4bef-9d84-ec903d90e107 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:36.651414 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:06:36.652085 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 12:06:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f (ip 10.222.0.73) !!! Aug 18 12:06:36.970807 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [req-14d692bb-ac79-4168-adc8-d8fca97c13d8 req-9d25a265-7b72-4b2e-be27-d620f011f416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1e4e16-a47a-4137-b059-c45fd3308070", "name": "network-vif-deleted", "tag": "e26e961c-f42e-46f2-a6e5-3418a9d86638"}]} {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:37.005594 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-14d692bb-ac79-4168-adc8-d8fca97c13d8 req-9d25a265-7b72-4b2e-be27-d620f011f416 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:37.006581 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-14d692bb-ac79-4168-adc8-d8fca97c13d8 req-9d25a265-7b72-4b2e-be27-d620f011f416 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:37.009306 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [req-14d692bb-ac79-4168-adc8-d8fca97c13d8 req-9d25a265-7b72-4b2e-be27-d620f011f416 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:37.053774 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.compute.server_external_events [req-14d692bb-ac79-4168-adc8-d8fca97c13d8 req-9d25a265-7b72-4b2e-be27-d620f011f416 service nova] Creating event network-vif-deleted:e26e961c-f42e-46f2-a6e5-3418a9d86638 for instance 6f1e4e16-a47a-4137-b059-c45fd3308070 on n-h1-853611-3 Aug 18 12:06:37.073505 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [req-14d692bb-ac79-4168-adc8-d8fca97c13d8 req-9d25a265-7b72-4b2e-be27-d620f011f416 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108415 Aug 18 12:06:37.080687 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2653/5613] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:06:37.209208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a34bd70e-4537-4bef-9d84-ec903d90e107 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5c8d29e467497b8b4daf3cec4c5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eece9c292977420eb94c05c2da135133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:37.228941 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a34bd70e-4537-4bef-9d84-ec903d90e107 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f" status: 200 len: 1218 microversion: 2.1 time: 0.679392 Aug 18 12:06:37.247952 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2961/5614] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:36 2022] GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f => generated 1218 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:37.320983 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-da1306fa-2460-4d83-900b-0e5fa323506a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:37.322193 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-da1306fa-2460-4d83-900b-0e5fa323506a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:37.333291 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da1306fa-2460-4d83-900b-0e5fa323506a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:37.334260 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da1306fa-2460-4d83-900b-0e5fa323506a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:37.335073 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da1306fa-2460-4d83-900b-0e5fa323506a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:37.336301 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da1306fa-2460-4d83-900b-0e5fa323506a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:37.337038 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da1306fa-2460-4d83-900b-0e5fa323506a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:37.337799 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da1306fa-2460-4d83-900b-0e5fa323506a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:37.417204 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da1306fa-2460-4d83-900b-0e5fa323506a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:37.417700 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da1306fa-2460-4d83-900b-0e5fa323506a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:37.418156 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-da1306fa-2460-4d83-900b-0e5fa323506a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:37.418659 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.objects.instance [None req-da1306fa-2460-4d83-900b-0e5fa323506a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lazy-loading 'fault' on Instance uuid 6f1e4e16-a47a-4137-b059-c45fd3308070 {{(pid=122209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:06:37.531916 n-d-853611-3 devstack@n-api.service[122209]: INFO nova.api.openstack.requestlog [None req-da1306fa-2460-4d83-900b-0e5fa323506a tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 200 len: 1453 microversion: 2.1 time: 0.218922 Aug 18 12:06:37.533870 n-d-853611-3 devstack@n-api.service[122209]: [pid: 122209|app: 0|req: 2654/5615] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:37 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 1453 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:06:38.264647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-314f73ae-0612-410c-a10b-a6e7223021d0 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:38.265281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-314f73ae-0612-410c-a10b-a6e7223021d0 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:38.280756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-314f73ae-0612-410c-a10b-a6e7223021d0 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:38.282194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-314f73ae-0612-410c-a10b-a6e7223021d0 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:38.283546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-314f73ae-0612-410c-a10b-a6e7223021d0 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:38.288047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-314f73ae-0612-410c-a10b-a6e7223021d0 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:38.288832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-314f73ae-0612-410c-a10b-a6e7223021d0 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:38.291586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-314f73ae-0612-410c-a10b-a6e7223021d0 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:38.498033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-314f73ae-0612-410c-a10b-a6e7223021d0 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5c8d29e467497b8b4daf3cec4c5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eece9c292977420eb94c05c2da135133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:38.516783 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-314f73ae-0612-410c-a10b-a6e7223021d0 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f" status: 200 len: 1272 microversion: 2.1 time: 0.255112 Aug 18 12:06:38.519211 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2962/5616] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:38 2022] GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:06:38.564434 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.api.openstack.wsgi [None req-42ae504f-3c45-4058-a85c-099c1884491e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:38.567101 n-d-853611-3 devstack@n-api.service[122209]: DEBUG nova.compute.api [None req-42ae504f-3c45-4058-a85c-099c1884491e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122209) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:38.607865 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42ae504f-3c45-4058-a85c-099c1884491e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:38.613486 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42ae504f-3c45-4058-a85c-099c1884491e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:38.616015 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42ae504f-3c45-4058-a85c-099c1884491e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:38.619993 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42ae504f-3c45-4058-a85c-099c1884491e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:38.621251 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42ae504f-3c45-4058-a85c-099c1884491e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:38.622153 n-d-853611-3 devstack@n-api.service[122209]: DEBUG oslo_concurrency.lockutils [None req-42ae504f-3c45-4058-a85c-099c1884491e tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:38.690083 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:06:38.693622 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:06:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:06:38.719137 n-d-853611-3 devstack@n-api.service[122209]: Traceback (most recent call last): Aug 18 12:06:38.720248 n-d-853611-3 devstack@n-api.service[122209]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 18 12:06:38.720248 n-d-853611-3 devstack@n-api.service[122209]: timer() Aug 18 12:06:38.720545 n-d-853611-3 devstack@n-api.service[122209]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 18 12:06:38.720545 n-d-853611-3 devstack@n-api.service[122209]: cb(*args, **kw) Aug 18 12:06:38.720545 n-d-853611-3 devstack@n-api.service[122209]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Aug 18 12:06:38.720545 n-d-853611-3 devstack@n-api.service[122209]: waiter.switch() Aug 18 12:06:38.720545 n-d-853611-3 devstack@n-api.service[122209]: greenlet.error: cannot switch to a different thread Aug 18 12:06:39.565915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e99018fb-4c46-4756-9751-bb8ff99e1a31 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:39.567644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e99018fb-4c46-4756-9751-bb8ff99e1a31 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:39.601765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e99018fb-4c46-4756-9751-bb8ff99e1a31 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:39.602823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e99018fb-4c46-4756-9751-bb8ff99e1a31 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:39.603640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e99018fb-4c46-4756-9751-bb8ff99e1a31 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:39.604916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e99018fb-4c46-4756-9751-bb8ff99e1a31 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:39.605734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e99018fb-4c46-4756-9751-bb8ff99e1a31 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:39.606590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e99018fb-4c46-4756-9751-bb8ff99e1a31 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:40.170890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e99018fb-4c46-4756-9751-bb8ff99e1a31 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5c8d29e467497b8b4daf3cec4c5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eece9c292977420eb94c05c2da135133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:40.204224 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e99018fb-4c46-4756-9751-bb8ff99e1a31 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f" status: 200 len: 1314 microversion: 2.1 time: 0.639643 Aug 18 12:06:40.218977 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2963/5617] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:39 2022] GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:41.232608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ca4acbcc-d08d-46a0-8cf8-e632d987d2d7 req-59578ae9-1d45-4191-992e-8e124929dac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11dcfffa-e0f0-4def-b01d-3341e972a09f", "tag": "cada426e-b9a0-48f2-9bf9-69ec08ccaf9e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:41.261204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ca4acbcc-d08d-46a0-8cf8-e632d987d2d7 req-59578ae9-1d45-4191-992e-8e124929dac4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:41.261204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ca4acbcc-d08d-46a0-8cf8-e632d987d2d7 req-59578ae9-1d45-4191-992e-8e124929dac4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:41.261204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ca4acbcc-d08d-46a0-8cf8-e632d987d2d7 req-59578ae9-1d45-4191-992e-8e124929dac4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:41.285824 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ca4acbcc-d08d-46a0-8cf8-e632d987d2d7 req-59578ae9-1d45-4191-992e-8e124929dac4 service nova] Creating event network-changed:cada426e-b9a0-48f2-9bf9-69ec08ccaf9e for instance 11dcfffa-e0f0-4def-b01d-3341e972a09f on n-h2-853611-3 Aug 18 12:06:41.299408 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ca4acbcc-d08d-46a0-8cf8-e632d987d2d7 req-59578ae9-1d45-4191-992e-8e124929dac4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069755 Aug 18 12:06:41.301035 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2964/5618] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:06:41.313396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9163a94-0902-440f-a00b-7bff1aab7d9c tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:41.315828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c9163a94-0902-440f-a00b-7bff1aab7d9c tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:41.327727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9163a94-0902-440f-a00b-7bff1aab7d9c tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:41.328970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9163a94-0902-440f-a00b-7bff1aab7d9c tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:41.329839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9163a94-0902-440f-a00b-7bff1aab7d9c tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:41.331229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9163a94-0902-440f-a00b-7bff1aab7d9c tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:41.332170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9163a94-0902-440f-a00b-7bff1aab7d9c tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:41.333050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9163a94-0902-440f-a00b-7bff1aab7d9c tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:41.648646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c9163a94-0902-440f-a00b-7bff1aab7d9c tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5c8d29e467497b8b4daf3cec4c5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eece9c292977420eb94c05c2da135133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:41.667724 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c9163a94-0902-440f-a00b-7bff1aab7d9c tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f" status: 200 len: 1314 microversion: 2.1 time: 0.363669 Aug 18 12:06:41.669750 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2965/5619] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:41 2022] GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:42.347419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2049873797", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "e970dc49-7408-430c-85fe-99c6832908ee"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:42.417180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] validate_networks() for [('e970dc49-7408-430c-85fe-99c6832908ee', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:06:42.944794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:06:42.945622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:06:42.946290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:06:42.946899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:06:42.947479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:06:42.963055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:42.964577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:42.965288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:42.966488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:42.967154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:42.967904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:43.005870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Getting quotas for project a9425d21643e40ee9a2807e0e844df00. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:06:43.018734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Getting quotas for user f67651ab2cc741c3b38bb520192b354d and project a9425d21643e40ee9a2807e0e844df00. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:06:43.038932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:06:43.041709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:06:43.155923 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-45190663-060a-4adb-8b70-1936e4b98429 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815814 Aug 18 12:06:43.158839 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2966/5620] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:06:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:06:43.170017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c931376b-4b04-4aff-a73e-81e640248302 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:43.171918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c931376b-4b04-4aff-a73e-81e640248302 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:43.184319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c931376b-4b04-4aff-a73e-81e640248302 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:43.185487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c931376b-4b04-4aff-a73e-81e640248302 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:43.186263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c931376b-4b04-4aff-a73e-81e640248302 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:43.187491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c931376b-4b04-4aff-a73e-81e640248302 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:43.188631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c931376b-4b04-4aff-a73e-81e640248302 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:43.189384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c931376b-4b04-4aff-a73e-81e640248302 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:43.541751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c931376b-4b04-4aff-a73e-81e640248302 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5c8d29e467497b8b4daf3cec4c5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eece9c292977420eb94c05c2da135133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:43.562111 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c931376b-4b04-4aff-a73e-81e640248302 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f" status: 200 len: 1314 microversion: 2.1 time: 0.400707 Aug 18 12:06:43.563520 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2967/5621] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:43 2022] GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:43.596935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-44568736-5ae4-416b-ba08-4300b927667e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:43.601279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-44568736-5ae4-416b-ba08-4300b927667e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:43.803460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-44568736-5ae4-416b-ba08-4300b927667e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:43.832830 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-44568736-5ae4-416b-ba08-4300b927667e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1214 microversion: 2.1 time: 0.267332 Aug 18 12:06:43.833569 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2968/5622] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:43 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1214 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:44.600644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7fa02c52-8584-416e-880c-2678bbacc035 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:44.602940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7fa02c52-8584-416e-880c-2678bbacc035 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:44.619452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7fa02c52-8584-416e-880c-2678bbacc035 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:44.620384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7fa02c52-8584-416e-880c-2678bbacc035 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:44.621084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7fa02c52-8584-416e-880c-2678bbacc035 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:44.622093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7fa02c52-8584-416e-880c-2678bbacc035 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:44.622856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7fa02c52-8584-416e-880c-2678bbacc035 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:44.623683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7fa02c52-8584-416e-880c-2678bbacc035 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:45.051042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7fa02c52-8584-416e-880c-2678bbacc035 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5c8d29e467497b8b4daf3cec4c5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eece9c292977420eb94c05c2da135133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:45.067660 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7fa02c52-8584-416e-880c-2678bbacc035 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f" status: 200 len: 1314 microversion: 2.1 time: 0.477174 Aug 18 12:06:45.068401 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2969/5623] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:44 2022] GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:06:45.074906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c5852d0b-b616-42e7-aa2d-f4cba16d9ea3 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:45.075661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c5852d0b-b616-42e7-aa2d-f4cba16d9ea3 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:45.087346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5852d0b-b616-42e7-aa2d-f4cba16d9ea3 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:45.088475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5852d0b-b616-42e7-aa2d-f4cba16d9ea3 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:45.089317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5852d0b-b616-42e7-aa2d-f4cba16d9ea3 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:45.090336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5852d0b-b616-42e7-aa2d-f4cba16d9ea3 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:45.091885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5852d0b-b616-42e7-aa2d-f4cba16d9ea3 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:45.092733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5852d0b-b616-42e7-aa2d-f4cba16d9ea3 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:45.159070 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=2 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:45.197764 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell0:SELECT=6 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:45.257128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c5852d0b-b616-42e7-aa2d-f4cba16d9ea3 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:45.290680 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c5852d0b-b616-42e7-aa2d-f4cba16d9ea3 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1210 microversion: 2.1 time: 0.216202 Aug 18 12:06:45.294849 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2970/5624] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:45 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1210 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:46.108171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-189562e0-b487-42f6-8ba6-529ac828cfc2 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:46.109069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-189562e0-b487-42f6-8ba6-529ac828cfc2 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:46.124152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-189562e0-b487-42f6-8ba6-529ac828cfc2 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:46.128848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-189562e0-b487-42f6-8ba6-529ac828cfc2 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:46.134775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-189562e0-b487-42f6-8ba6-529ac828cfc2 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:46.135777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-189562e0-b487-42f6-8ba6-529ac828cfc2 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:46.136395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-189562e0-b487-42f6-8ba6-529ac828cfc2 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:46.136926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-189562e0-b487-42f6-8ba6-529ac828cfc2 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:46.521631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-189562e0-b487-42f6-8ba6-529ac828cfc2 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5c8d29e467497b8b4daf3cec4c5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eece9c292977420eb94c05c2da135133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:46.541276 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-189562e0-b487-42f6-8ba6-529ac828cfc2 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f" status: 200 len: 1314 microversion: 2.1 time: 0.437605 Aug 18 12:06:46.559412 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2971/5625] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:46 2022] GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:06:46.567312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-04f4291b-c3c2-44aa-95ab-916cbf273b0d tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:46.569508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-04f4291b-c3c2-44aa-95ab-916cbf273b0d tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:46.577900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04f4291b-c3c2-44aa-95ab-916cbf273b0d tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:46.578477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04f4291b-c3c2-44aa-95ab-916cbf273b0d tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:46.580143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04f4291b-c3c2-44aa-95ab-916cbf273b0d tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:46.580979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04f4291b-c3c2-44aa-95ab-916cbf273b0d tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:46.581468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04f4291b-c3c2-44aa-95ab-916cbf273b0d tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:46.581916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04f4291b-c3c2-44aa-95ab-916cbf273b0d tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:46.605214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:46.736202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-04f4291b-c3c2-44aa-95ab-916cbf273b0d tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:46.751719 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-04f4291b-c3c2-44aa-95ab-916cbf273b0d tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1272 microversion: 2.1 time: 0.188518 Aug 18 12:06:46.752602 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2972/5626] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:46 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:46.764459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-454419f6-6a10-4e98-8214-9033d662828a req-d053049a-97d3-4f43-bde2-b2ff4bcb18ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11dcfffa-e0f0-4def-b01d-3341e972a09f", "name": "network-vif-plugged", "status": "completed", "tag": "cada426e-b9a0-48f2-9bf9-69ec08ccaf9e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:46.793148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-454419f6-6a10-4e98-8214-9033d662828a req-d053049a-97d3-4f43-bde2-b2ff4bcb18ec service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:46.795797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-454419f6-6a10-4e98-8214-9033d662828a req-d053049a-97d3-4f43-bde2-b2ff4bcb18ec service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:46.798995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-454419f6-6a10-4e98-8214-9033d662828a req-d053049a-97d3-4f43-bde2-b2ff4bcb18ec service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:46.833461 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-454419f6-6a10-4e98-8214-9033d662828a req-d053049a-97d3-4f43-bde2-b2ff4bcb18ec service nova] Creating event network-vif-plugged:cada426e-b9a0-48f2-9bf9-69ec08ccaf9e for instance 11dcfffa-e0f0-4def-b01d-3341e972a09f on n-h2-853611-3 Aug 18 12:06:46.865291 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-454419f6-6a10-4e98-8214-9033d662828a req-d053049a-97d3-4f43-bde2-b2ff4bcb18ec service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108073 Aug 18 12:06:46.882950 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2973/5627] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:06:47.574640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4052b8e7-7edd-48e2-973e-e044bd7b3012 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:47.576519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4052b8e7-7edd-48e2-973e-e044bd7b3012 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:47.635655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4052b8e7-7edd-48e2-973e-e044bd7b3012 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:47.638909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4052b8e7-7edd-48e2-973e-e044bd7b3012 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:47.644174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4052b8e7-7edd-48e2-973e-e044bd7b3012 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:47.645879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4052b8e7-7edd-48e2-973e-e044bd7b3012 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:47.650975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4052b8e7-7edd-48e2-973e-e044bd7b3012 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:47.654817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4052b8e7-7edd-48e2-973e-e044bd7b3012 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:48.004650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4052b8e7-7edd-48e2-973e-e044bd7b3012 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5c8d29e467497b8b4daf3cec4c5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eece9c292977420eb94c05c2da135133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:48.014142 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4052b8e7-7edd-48e2-973e-e044bd7b3012 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f" status: 200 len: 1314 microversion: 2.1 time: 0.449393 Aug 18 12:06:48.014925 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2974/5628] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:47 2022] GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:48.043988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f4879e76-37fa-4ae6-9f18-24ce69ddd37c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:48.045175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f4879e76-37fa-4ae6-9f18-24ce69ddd37c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:48.054570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4879e76-37fa-4ae6-9f18-24ce69ddd37c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:48.055083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4879e76-37fa-4ae6-9f18-24ce69ddd37c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:48.055576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4879e76-37fa-4ae6-9f18-24ce69ddd37c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:48.056279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4879e76-37fa-4ae6-9f18-24ce69ddd37c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:48.056832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4879e76-37fa-4ae6-9f18-24ce69ddd37c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:48.057268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4879e76-37fa-4ae6-9f18-24ce69ddd37c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:48.350683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f4879e76-37fa-4ae6-9f18-24ce69ddd37c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:48.371389 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f4879e76-37fa-4ae6-9f18-24ce69ddd37c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1314 microversion: 2.1 time: 0.354734 Aug 18 12:06:48.373074 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2975/5629] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:48 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:48.599168 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:48.658351 n-d-853611-3 devstack@n-api.service[122209]: DEBUG dbcounter [-] [122209] Writing DB stats nova_cell1:SELECT=45 {{(pid=122209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:49.017995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1befb992-e6c5-483c-b169-ff784eb3c165 req-ff20d962-2e54-4a9f-b7d7-f98da60b54ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33fcf0b4-bb08-4bbb-8d33-01bfee1f521a", "tag": "60e3c7f1-d1ab-4f61-a474-6392fd6a1f8e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:49.039291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1befb992-e6c5-483c-b169-ff784eb3c165 req-ff20d962-2e54-4a9f-b7d7-f98da60b54ce service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:49.040196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1befb992-e6c5-483c-b169-ff784eb3c165 req-ff20d962-2e54-4a9f-b7d7-f98da60b54ce service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:49.040811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1befb992-e6c5-483c-b169-ff784eb3c165 req-ff20d962-2e54-4a9f-b7d7-f98da60b54ce service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:49.059657 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1befb992-e6c5-483c-b169-ff784eb3c165 req-ff20d962-2e54-4a9f-b7d7-f98da60b54ce service nova] Creating event network-changed:60e3c7f1-d1ab-4f61-a474-6392fd6a1f8e for instance 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a on n-h1-853611-3 Aug 18 12:06:49.066590 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1befb992-e6c5-483c-b169-ff784eb3c165 req-ff20d962-2e54-4a9f-b7d7-f98da60b54ce service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054663 Aug 18 12:06:49.067656 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2976/5630] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:06:49.074992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e369e9e-1764-4af3-96f2-41e73830e946 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:49.076350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9e369e9e-1764-4af3-96f2-41e73830e946 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:49.084804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e369e9e-1764-4af3-96f2-41e73830e946 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:49.085211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e369e9e-1764-4af3-96f2-41e73830e946 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:49.085653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e369e9e-1764-4af3-96f2-41e73830e946 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:49.086684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e369e9e-1764-4af3-96f2-41e73830e946 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:49.087171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e369e9e-1764-4af3-96f2-41e73830e946 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:49.087602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e369e9e-1764-4af3-96f2-41e73830e946 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:49.258803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9e369e9e-1764-4af3-96f2-41e73830e946 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5c8d29e467497b8b4daf3cec4c5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eece9c292977420eb94c05c2da135133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:49.268948 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9e369e9e-1764-4af3-96f2-41e73830e946 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f" status: 200 len: 1464 microversion: 2.1 time: 0.200002 Aug 18 12:06:49.269564 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2977/5631] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:49 2022] GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f => generated 1464 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:49.336880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-31855eee-6c31-4faa-a173-c3f13f76dbbc tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:49.337275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-31855eee-6c31-4faa-a173-c3f13f76dbbc tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:49.344557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31855eee-6c31-4faa-a173-c3f13f76dbbc tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:49.346737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31855eee-6c31-4faa-a173-c3f13f76dbbc tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:49.347194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31855eee-6c31-4faa-a173-c3f13f76dbbc tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:49.347938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31855eee-6c31-4faa-a173-c3f13f76dbbc tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:49.348632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31855eee-6c31-4faa-a173-c3f13f76dbbc tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:49.349075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31855eee-6c31-4faa-a173-c3f13f76dbbc tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:49.384779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-31855eee-6c31-4faa-a173-c3f13f76dbbc tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:06:49.486186 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-31855eee-6c31-4faa-a173-c3f13f76dbbc tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "DELETE /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f" status: 204 len: 0 microversion: 2.1 time: 0.152539 Aug 18 12:06:49.487031 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2978/5632] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:06:49 2022] DELETE /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:06:49.496020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-be8ca7c2-474f-4625-b2e2-c8d8dc346d8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:49.496739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-be8ca7c2-474f-4625-b2e2-c8d8dc346d8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:49.508636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be8ca7c2-474f-4625-b2e2-c8d8dc346d8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:49.509136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be8ca7c2-474f-4625-b2e2-c8d8dc346d8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:49.509739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be8ca7c2-474f-4625-b2e2-c8d8dc346d8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:49.510503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be8ca7c2-474f-4625-b2e2-c8d8dc346d8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:49.510973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be8ca7c2-474f-4625-b2e2-c8d8dc346d8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:49.511407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be8ca7c2-474f-4625-b2e2-c8d8dc346d8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:49.710256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-be8ca7c2-474f-4625-b2e2-c8d8dc346d8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:49.726939 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-be8ca7c2-474f-4625-b2e2-c8d8dc346d8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1314 microversion: 2.1 time: 0.236506 Aug 18 12:06:49.728217 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2979/5633] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:49 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:49.741324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fde55e0a-d26a-49ea-804f-35993cdba313 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:49.743082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fde55e0a-d26a-49ea-804f-35993cdba313 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:49.754958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fde55e0a-d26a-49ea-804f-35993cdba313 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:49.755570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fde55e0a-d26a-49ea-804f-35993cdba313 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:49.756181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fde55e0a-d26a-49ea-804f-35993cdba313 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:49.757050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fde55e0a-d26a-49ea-804f-35993cdba313 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:49.757516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fde55e0a-d26a-49ea-804f-35993cdba313 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:49.757950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fde55e0a-d26a-49ea-804f-35993cdba313 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:49.994046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fde55e0a-d26a-49ea-804f-35993cdba313 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5c8d29e467497b8b4daf3cec4c5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eece9c292977420eb94c05c2da135133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:50.004017 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fde55e0a-d26a-49ea-804f-35993cdba313 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f" status: 200 len: 1470 microversion: 2.1 time: 0.273223 Aug 18 12:06:50.004626 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2980/5634] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:49 2022] GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f => generated 1470 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:50.009896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-526462272", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "52a220cf-667f-4744-9f0c-6edc45b19c78"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:50.075983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] validate_networks() for [('52a220cf-667f-4744-9f0c-6edc45b19c78', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:06:50.663330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:06:50.664126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:06:50.665031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:06:50.665814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:06:50.666638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:06:50.686159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:50.686827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:50.687366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:50.688206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:50.689708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:50.690480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:50.729766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Getting quotas for project c77ee0ffd5604e92b816cd8d80e7009c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:06:50.758064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Getting quotas for user 761db01e19c24ed5913371de82f86fdc and project c77ee0ffd5604e92b816cd8d80e7009c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:06:50.789656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:06:50.794400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:06:50.872154 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-042245c1-1493-43e2-a518-c536e360694a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.866187 Aug 18 12:06:50.880707 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2981/5635] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:06:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:06:50.885925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e4806c1e-866a-4a6b-b2e5-c9c2309b5ca6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:50.886598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e4806c1e-866a-4a6b-b2e5-c9c2309b5ca6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:50.888766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:50.905986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4806c1e-866a-4a6b-b2e5-c9c2309b5ca6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:50.908052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4806c1e-866a-4a6b-b2e5-c9c2309b5ca6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:50.909765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4806c1e-866a-4a6b-b2e5-c9c2309b5ca6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:50.911995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4806c1e-866a-4a6b-b2e5-c9c2309b5ca6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:50.913121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4806c1e-866a-4a6b-b2e5-c9c2309b5ca6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:50.913913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4806c1e-866a-4a6b-b2e5-c9c2309b5ca6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:51.323964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e4806c1e-866a-4a6b-b2e5-c9c2309b5ca6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:51.343548 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e4806c1e-866a-4a6b-b2e5-c9c2309b5ca6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1314 microversion: 2.1 time: 0.461200 Aug 18 12:06:51.346560 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2982/5636] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:50 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:51.355637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e0429575-3e6a-4576-96ff-c18cc183a40e tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:51.357149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e0429575-3e6a-4576-96ff-c18cc183a40e tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:51.480758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e0429575-3e6a-4576-96ff-c18cc183a40e tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:51.491827 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e0429575-3e6a-4576-96ff-c18cc183a40e tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d" status: 200 len: 1218 microversion: 2.1 time: 0.142258 Aug 18 12:06:51.492904 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2983/5637] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:51 2022] GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:51.505031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a6059c30-8c3a-4a91-963f-e964d09f429d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:51.508077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a6059c30-8c3a-4a91-963f-e964d09f429d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:51.520631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6059c30-8c3a-4a91-963f-e964d09f429d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:51.521513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6059c30-8c3a-4a91-963f-e964d09f429d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:51.522210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6059c30-8c3a-4a91-963f-e964d09f429d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:51.523231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6059c30-8c3a-4a91-963f-e964d09f429d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:51.524069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6059c30-8c3a-4a91-963f-e964d09f429d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:51.524828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6059c30-8c3a-4a91-963f-e964d09f429d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:51.838122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a6059c30-8c3a-4a91-963f-e964d09f429d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d5c8d29e467497b8b4daf3cec4c5f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eece9c292977420eb94c05c2da135133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:51.848134 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a6059c30-8c3a-4a91-963f-e964d09f429d tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f" status: 200 len: 1470 microversion: 2.1 time: 0.353888 Aug 18 12:06:51.849684 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2984/5638] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:51 2022] GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f => generated 1470 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:52.351140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1ca7743b-8e1a-429d-8e3b-1dc6e53c4388 req-2cecdcb9-0972-46cf-87d6-feb6d08adfe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11dcfffa-e0f0-4def-b01d-3341e972a09f", "name": "network-vif-deleted", "tag": "cada426e-b9a0-48f2-9bf9-69ec08ccaf9e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:52.372782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1ca7743b-8e1a-429d-8e3b-1dc6e53c4388 req-2cecdcb9-0972-46cf-87d6-feb6d08adfe4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:52.374497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1ca7743b-8e1a-429d-8e3b-1dc6e53c4388 req-2cecdcb9-0972-46cf-87d6-feb6d08adfe4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:52.376134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1ca7743b-8e1a-429d-8e3b-1dc6e53c4388 req-2cecdcb9-0972-46cf-87d6-feb6d08adfe4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:52.400875 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1ca7743b-8e1a-429d-8e3b-1dc6e53c4388 req-2cecdcb9-0972-46cf-87d6-feb6d08adfe4 service nova] Creating event network-vif-deleted:cada426e-b9a0-48f2-9bf9-69ec08ccaf9e for instance 11dcfffa-e0f0-4def-b01d-3341e972a09f on n-h2-853611-3 Aug 18 12:06:52.413381 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1ca7743b-8e1a-429d-8e3b-1dc6e53c4388 req-2cecdcb9-0972-46cf-87d6-feb6d08adfe4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087181 Aug 18 12:06:52.415248 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2985/5639] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:06:52.447001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-511217f3-4704-4a9e-84f7-5dee8a574f8c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:52.448809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-511217f3-4704-4a9e-84f7-5dee8a574f8c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:52.474244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-511217f3-4704-4a9e-84f7-5dee8a574f8c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:52.475530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-511217f3-4704-4a9e-84f7-5dee8a574f8c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:52.476582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-511217f3-4704-4a9e-84f7-5dee8a574f8c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:52.478969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-511217f3-4704-4a9e-84f7-5dee8a574f8c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:52.481865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-511217f3-4704-4a9e-84f7-5dee8a574f8c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:52.483356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-511217f3-4704-4a9e-84f7-5dee8a574f8c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:52.752157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-511217f3-4704-4a9e-84f7-5dee8a574f8c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:52.781042 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-511217f3-4704-4a9e-84f7-5dee8a574f8c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1314 microversion: 2.1 time: 0.361651 Aug 18 12:06:52.781749 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2986/5640] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:52 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:52.789304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-91e4ef5c-8819-41c7-9f64-1d7b993eaae3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:52.790481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-91e4ef5c-8819-41c7-9f64-1d7b993eaae3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:52.799749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e4ef5c-8819-41c7-9f64-1d7b993eaae3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:52.800627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e4ef5c-8819-41c7-9f64-1d7b993eaae3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:52.801371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e4ef5c-8819-41c7-9f64-1d7b993eaae3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:52.802406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e4ef5c-8819-41c7-9f64-1d7b993eaae3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:52.803132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e4ef5c-8819-41c7-9f64-1d7b993eaae3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:52.803854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91e4ef5c-8819-41c7-9f64-1d7b993eaae3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:52.950941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-91e4ef5c-8819-41c7-9f64-1d7b993eaae3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:52.971057 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-91e4ef5c-8819-41c7-9f64-1d7b993eaae3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d" status: 200 len: 1288 microversion: 2.1 time: 0.185579 Aug 18 12:06:52.972080 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2987/5641] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:52 2022] GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d => generated 1288 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:53.024810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9bfeac6b-070c-44ad-b364-853d158420f1 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:53.035124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9bfeac6b-070c-44ad-b364-853d158420f1 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] [instance: 11dcfffa-e0f0-4def-b01d-3341e972a09f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:53.061020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bfeac6b-070c-44ad-b364-853d158420f1 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:53.061952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bfeac6b-070c-44ad-b364-853d158420f1 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:53.062800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bfeac6b-070c-44ad-b364-853d158420f1 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:53.064293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bfeac6b-070c-44ad-b364-853d158420f1 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:53.065355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bfeac6b-070c-44ad-b364-853d158420f1 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:53.066311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bfeac6b-070c-44ad-b364-853d158420f1 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:53.100006 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-9bfeac6b-070c-44ad-b364-853d158420f1 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] HTTP exception thrown: Instance 11dcfffa-e0f0-4def-b01d-3341e972a09f could not be found. Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9bfeac6b-070c-44ad-b364-853d158420f1 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Request method failure captured: Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f HTTP/1.1 Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_itGAaOt2xptoHx-RVL07dGFNKnvJrLcfV7aQaGKOR_8YvgRjJzaBtHsL5djPEsebIUyLf0Ct2Hjos7lNwKS-gctCPlk5fc-YyrXXInjln4nlrtJM6TUQ9G_bJkgnUi81sORXHNgtnFrz1MiCXoYhFFpMlmv684uN8a5l0OaOLLCj1A Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: eece9c292977420eb94c05c2da135133 Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-VolumesNegativeTest-675309678 Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/eece9c292977420eb94c05c2da135133"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/eece9c292977420eb94c05c2da135133"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_eece9c292977420eb94c05c2da135133"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/eece9c292977420eb94c05c2da135133"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-VolumesNegativeTest-675309678 Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: eece9c292977420eb94c05c2da135133 Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-VolumesNegativeTest-675309678 Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-VolumesNegativeTest-675309678-project Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 9d5c8d29e467497b8b4daf3cec4c5f28 Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-VolumesNegativeTest-675309678-project Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 11dcfffa-e0f0-4def-b01d-3341e972a09f could not be found. Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '11dcfffa-e0f0-4def-b01d-3341e972a09f'} Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11dcfffa-e0f0-4def-b01d-3341e972a09f could not be found. Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11dcfffa-e0f0-4def-b01d-3341e972a09f could not be found. Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:06:53.103310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:06:53.116806 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:06:53.116806 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:06:53.116806 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:06:53.116806 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:06:53.116806 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:06:53.116806 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11dcfffa-e0f0-4def-b01d-3341e972a09f could not be found. Aug 18 12:06:53.116806 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:06:53.116806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9bfeac6b-070c-44ad-b364-853d158420f1 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] Returning 404 to user: Instance 11dcfffa-e0f0-4def-b01d-3341e972a09f could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:06:53.116806 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9bfeac6b-070c-44ad-b364-853d158420f1 tempest-VolumesNegativeTest-675309678 tempest-VolumesNegativeTest-675309678-project] 10.222.0.73 "GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f" status: 404 len: 111 microversion: 2.1 time: 0.108716 Aug 18 12:06:53.116806 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2988/5642] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:52 2022] GET /compute/v2.1/servers/11dcfffa-e0f0-4def-b01d-3341e972a09f => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:06:53.837711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3ed914d-365b-453d-b222-bcc4a884fd1e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:53.841851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3ed914d-365b-453d-b222-bcc4a884fd1e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:53.870621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3ed914d-365b-453d-b222-bcc4a884fd1e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:53.879937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3ed914d-365b-453d-b222-bcc4a884fd1e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:53.880732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3ed914d-365b-453d-b222-bcc4a884fd1e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:53.882079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3ed914d-365b-453d-b222-bcc4a884fd1e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:53.882973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3ed914d-365b-453d-b222-bcc4a884fd1e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:53.884263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3ed914d-365b-453d-b222-bcc4a884fd1e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:54.230886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d3ed914d-365b-453d-b222-bcc4a884fd1e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:54.271969 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3ed914d-365b-453d-b222-bcc4a884fd1e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1314 microversion: 2.1 time: 0.445615 Aug 18 12:06:54.272929 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2989/5643] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:53 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:54.305890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a48f7c35-abe6-4169-aadd-6bbb53d0fd34 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:54.307073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a48f7c35-abe6-4169-aadd-6bbb53d0fd34 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:54.324441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a48f7c35-abe6-4169-aadd-6bbb53d0fd34 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:54.326382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a48f7c35-abe6-4169-aadd-6bbb53d0fd34 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:54.337105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a48f7c35-abe6-4169-aadd-6bbb53d0fd34 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:54.338517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a48f7c35-abe6-4169-aadd-6bbb53d0fd34 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:54.339333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a48f7c35-abe6-4169-aadd-6bbb53d0fd34 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:54.340087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a48f7c35-abe6-4169-aadd-6bbb53d0fd34 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:54.699855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a48f7c35-abe6-4169-aadd-6bbb53d0fd34 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:54.712339 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a48f7c35-abe6-4169-aadd-6bbb53d0fd34 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d" status: 200 len: 1318 microversion: 2.1 time: 0.437842 Aug 18 12:06:54.730364 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2990/5644] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:54 2022] GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:55.312775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e4b27f4-b21f-4c00-b04a-3f3052d79fd6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:55.313483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e4b27f4-b21f-4c00-b04a-3f3052d79fd6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:55.336514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4b27f4-b21f-4c00-b04a-3f3052d79fd6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:55.340971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4b27f4-b21f-4c00-b04a-3f3052d79fd6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:55.342071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4b27f4-b21f-4c00-b04a-3f3052d79fd6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:55.343048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4b27f4-b21f-4c00-b04a-3f3052d79fd6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:55.343472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4b27f4-b21f-4c00-b04a-3f3052d79fd6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:55.343926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e4b27f4-b21f-4c00-b04a-3f3052d79fd6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:55.682753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e4b27f4-b21f-4c00-b04a-3f3052d79fd6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:55.686936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:06:55.700614 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e4b27f4-b21f-4c00-b04a-3f3052d79fd6 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1314 microversion: 2.1 time: 0.392852 Aug 18 12:06:55.702153 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2991/5645] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:55 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:06:55.712394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2d362921-7db2-4788-8d21-1a39cd431a9a req-7e386016-a2c7-4af5-a8be-610fc3beff07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c0ee229-69dc-4dd2-86ea-3afc2217462d", "tag": "75bee35a-30c9-4268-bad0-3b8abd4660e4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:55.727994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2d362921-7db2-4788-8d21-1a39cd431a9a req-7e386016-a2c7-4af5-a8be-610fc3beff07 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:55.729107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2d362921-7db2-4788-8d21-1a39cd431a9a req-7e386016-a2c7-4af5-a8be-610fc3beff07 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:55.732756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2d362921-7db2-4788-8d21-1a39cd431a9a req-7e386016-a2c7-4af5-a8be-610fc3beff07 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:55.762529 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2d362921-7db2-4788-8d21-1a39cd431a9a req-7e386016-a2c7-4af5-a8be-610fc3beff07 service nova] Creating event network-changed:75bee35a-30c9-4268-bad0-3b8abd4660e4 for instance 1c0ee229-69dc-4dd2-86ea-3afc2217462d on n-h1-853611-3 Aug 18 12:06:55.775867 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2d362921-7db2-4788-8d21-1a39cd431a9a req-7e386016-a2c7-4af5-a8be-610fc3beff07 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071251 Aug 18 12:06:55.777269 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2992/5646] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:06:55.787505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1c48c3e9-bea1-48e5-b27b-a920af5107c9 req-06511b81-8487-47f6-9b26-2b34fbd4f0eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33fcf0b4-bb08-4bbb-8d33-01bfee1f521a", "name": "network-vif-plugged", "status": "completed", "tag": "60e3c7f1-d1ab-4f61-a474-6392fd6a1f8e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:06:55.803085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1c48c3e9-bea1-48e5-b27b-a920af5107c9 req-06511b81-8487-47f6-9b26-2b34fbd4f0eb service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:55.803422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1c48c3e9-bea1-48e5-b27b-a920af5107c9 req-06511b81-8487-47f6-9b26-2b34fbd4f0eb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:55.803923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1c48c3e9-bea1-48e5-b27b-a920af5107c9 req-06511b81-8487-47f6-9b26-2b34fbd4f0eb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:55.842486 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1c48c3e9-bea1-48e5-b27b-a920af5107c9 req-06511b81-8487-47f6-9b26-2b34fbd4f0eb service nova] Creating event network-vif-plugged:60e3c7f1-d1ab-4f61-a474-6392fd6a1f8e for instance 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a on n-h1-853611-3 Aug 18 12:06:55.851534 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1c48c3e9-bea1-48e5-b27b-a920af5107c9 req-06511b81-8487-47f6-9b26-2b34fbd4f0eb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071259 Aug 18 12:06:55.851805 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2993/5647] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:06:55.861319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-38ea9e7d-cba7-466d-b6ff-27527d27208d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:55.862172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-38ea9e7d-cba7-466d-b6ff-27527d27208d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:55.874533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38ea9e7d-cba7-466d-b6ff-27527d27208d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:55.875665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38ea9e7d-cba7-466d-b6ff-27527d27208d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:55.876260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38ea9e7d-cba7-466d-b6ff-27527d27208d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:55.877157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38ea9e7d-cba7-466d-b6ff-27527d27208d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:55.877751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38ea9e7d-cba7-466d-b6ff-27527d27208d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:55.878502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38ea9e7d-cba7-466d-b6ff-27527d27208d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:56.292145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-38ea9e7d-cba7-466d-b6ff-27527d27208d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:56.311248 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-38ea9e7d-cba7-466d-b6ff-27527d27208d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d" status: 200 len: 1318 microversion: 2.1 time: 0.455979 Aug 18 12:06:56.312719 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2994/5648] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:55 2022] GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:56.779385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f779a88e-f995-4968-93f1-affefa03f8c0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:56.782043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f779a88e-f995-4968-93f1-affefa03f8c0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:56.798508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f779a88e-f995-4968-93f1-affefa03f8c0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:56.799284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f779a88e-f995-4968-93f1-affefa03f8c0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:56.800369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f779a88e-f995-4968-93f1-affefa03f8c0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:56.801884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f779a88e-f995-4968-93f1-affefa03f8c0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:56.803016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f779a88e-f995-4968-93f1-affefa03f8c0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:56.804046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f779a88e-f995-4968-93f1-affefa03f8c0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:57.082942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f779a88e-f995-4968-93f1-affefa03f8c0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:57.096860 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f779a88e-f995-4968-93f1-affefa03f8c0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1314 microversion: 2.1 time: 0.323540 Aug 18 12:06:57.103316 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2995/5649] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:56 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:57.361491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6829fbd2-70a5-4e4d-bc07-a64efdb59ab2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:57.362976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6829fbd2-70a5-4e4d-bc07-a64efdb59ab2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:57.377046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6829fbd2-70a5-4e4d-bc07-a64efdb59ab2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:57.377933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6829fbd2-70a5-4e4d-bc07-a64efdb59ab2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:57.378787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6829fbd2-70a5-4e4d-bc07-a64efdb59ab2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:57.380452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6829fbd2-70a5-4e4d-bc07-a64efdb59ab2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:57.381493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6829fbd2-70a5-4e4d-bc07-a64efdb59ab2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:57.382576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6829fbd2-70a5-4e4d-bc07-a64efdb59ab2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:57.643270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6829fbd2-70a5-4e4d-bc07-a64efdb59ab2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:57.652684 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6829fbd2-70a5-4e4d-bc07-a64efdb59ab2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d" status: 200 len: 1318 microversion: 2.1 time: 0.309554 Aug 18 12:06:57.654004 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2996/5650] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:57 2022] GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:58.130830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4bf97083-d2bd-43ec-aa20-5b85e139b0d0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:58.138241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4bf97083-d2bd-43ec-aa20-5b85e139b0d0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:58.168886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bf97083-d2bd-43ec-aa20-5b85e139b0d0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:58.170127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bf97083-d2bd-43ec-aa20-5b85e139b0d0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:58.171567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bf97083-d2bd-43ec-aa20-5b85e139b0d0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:58.180593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bf97083-d2bd-43ec-aa20-5b85e139b0d0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:58.182640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bf97083-d2bd-43ec-aa20-5b85e139b0d0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:58.183749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bf97083-d2bd-43ec-aa20-5b85e139b0d0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:58.450170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4bf97083-d2bd-43ec-aa20-5b85e139b0d0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:58.461193 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4bf97083-d2bd-43ec-aa20-5b85e139b0d0 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1497 microversion: 2.1 time: 0.345947 Aug 18 12:06:58.461817 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2997/5651] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:58 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1497 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:06:58.695007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1283f753-06d4-4b90-bf7a-879cf9fd14bf tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:58.696471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1283f753-06d4-4b90-bf7a-879cf9fd14bf tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:58.723379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1283f753-06d4-4b90-bf7a-879cf9fd14bf tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:58.724639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1283f753-06d4-4b90-bf7a-879cf9fd14bf tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:58.726217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1283f753-06d4-4b90-bf7a-879cf9fd14bf tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:58.727770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1283f753-06d4-4b90-bf7a-879cf9fd14bf tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:58.729045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1283f753-06d4-4b90-bf7a-879cf9fd14bf tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:58.729753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1283f753-06d4-4b90-bf7a-879cf9fd14bf tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:59.077181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1283f753-06d4-4b90-bf7a-879cf9fd14bf tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:06:59.092222 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1283f753-06d4-4b90-bf7a-879cf9fd14bf tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d" status: 200 len: 1318 microversion: 2.1 time: 0.419695 Aug 18 12:06:59.093209 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2998/5652] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:58 2022] GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:06:59.410615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-83cca376-361a-4e2f-870c-5f033f66ac52 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:59.411597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-83cca376-361a-4e2f-870c-5f033f66ac52 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:59.453310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83cca376-361a-4e2f-870c-5f033f66ac52 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:59.454327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83cca376-361a-4e2f-870c-5f033f66ac52 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:59.455125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83cca376-361a-4e2f-870c-5f033f66ac52 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:59.456486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83cca376-361a-4e2f-870c-5f033f66ac52 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:59.457487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83cca376-361a-4e2f-870c-5f033f66ac52 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:59.458620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83cca376-361a-4e2f-870c-5f033f66ac52 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:59.518631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-83cca376-361a-4e2f-870c-5f033f66ac52 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:06:59.753254 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-83cca376-361a-4e2f-870c-5f033f66ac52 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "DELETE /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 204 len: 0 microversion: 2.1 time: 0.345036 Aug 18 12:06:59.754548 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 2999/5653] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:06:59 2022] DELETE /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:06:59.769721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99f5b893-5597-40e7-aedd-b66e883b2d3b tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:06:59.770882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-99f5b893-5597-40e7-aedd-b66e883b2d3b tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:06:59.777947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99f5b893-5597-40e7-aedd-b66e883b2d3b tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:59.778473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99f5b893-5597-40e7-aedd-b66e883b2d3b tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:59.779879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99f5b893-5597-40e7-aedd-b66e883b2d3b tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:06:59.780687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99f5b893-5597-40e7-aedd-b66e883b2d3b tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:06:59.781165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99f5b893-5597-40e7-aedd-b66e883b2d3b tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:06:59.781603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99f5b893-5597-40e7-aedd-b66e883b2d3b tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:00.111656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-99f5b893-5597-40e7-aedd-b66e883b2d3b tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:00.122848 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-99f5b893-5597-40e7-aedd-b66e883b2d3b tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1503 microversion: 2.1 time: 0.358308 Aug 18 12:07:00.124098 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3000/5654] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:06:59 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1503 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:00.139475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b595ef8a-78ec-4f2a-8dbd-04e65a4acbf0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:00.140491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b595ef8a-78ec-4f2a-8dbd-04e65a4acbf0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:00.148477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b595ef8a-78ec-4f2a-8dbd-04e65a4acbf0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:00.149485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b595ef8a-78ec-4f2a-8dbd-04e65a4acbf0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:00.150138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b595ef8a-78ec-4f2a-8dbd-04e65a4acbf0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:00.151664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b595ef8a-78ec-4f2a-8dbd-04e65a4acbf0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:00.152462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b595ef8a-78ec-4f2a-8dbd-04e65a4acbf0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:00.153186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b595ef8a-78ec-4f2a-8dbd-04e65a4acbf0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:00.334195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b595ef8a-78ec-4f2a-8dbd-04e65a4acbf0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:00.343687 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b595ef8a-78ec-4f2a-8dbd-04e65a4acbf0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d" status: 200 len: 1318 microversion: 2.1 time: 0.209193 Aug 18 12:07:00.346480 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3001/5655] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:00 2022] GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:07:01.162494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f5ae2d9b-c944-4fab-92c1-b94f02375a94 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:01.165155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f5ae2d9b-c944-4fab-92c1-b94f02375a94 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:01.193303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:07:01.201996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5ae2d9b-c944-4fab-92c1-b94f02375a94 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:01.207522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5ae2d9b-c944-4fab-92c1-b94f02375a94 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:01.208412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5ae2d9b-c944-4fab-92c1-b94f02375a94 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:01.209920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5ae2d9b-c944-4fab-92c1-b94f02375a94 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:01.210674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5ae2d9b-c944-4fab-92c1-b94f02375a94 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:01.213524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5ae2d9b-c944-4fab-92c1-b94f02375a94 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:01.491036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=18 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:07:01.620007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f5ae2d9b-c944-4fab-92c1-b94f02375a94 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:01.646040 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f5ae2d9b-c944-4fab-92c1-b94f02375a94 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1503 microversion: 2.1 time: 0.490833 Aug 18 12:07:01.658480 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3002/5656] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:01 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1503 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:01.670756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f0b13739-e438-4cf3-8cef-7804441f499b req-456ad50d-3bb4-4d21-8378-8e46ad6f29f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c0ee229-69dc-4dd2-86ea-3afc2217462d", "name": "network-vif-plugged", "status": "completed", "tag": "75bee35a-30c9-4268-bad0-3b8abd4660e4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:07:01.695504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f0b13739-e438-4cf3-8cef-7804441f499b req-456ad50d-3bb4-4d21-8378-8e46ad6f29f6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:01.696351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f0b13739-e438-4cf3-8cef-7804441f499b req-456ad50d-3bb4-4d21-8378-8e46ad6f29f6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:01.697129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f0b13739-e438-4cf3-8cef-7804441f499b req-456ad50d-3bb4-4d21-8378-8e46ad6f29f6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:01.747647 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f0b13739-e438-4cf3-8cef-7804441f499b req-456ad50d-3bb4-4d21-8378-8e46ad6f29f6 service nova] Creating event network-vif-plugged:75bee35a-30c9-4268-bad0-3b8abd4660e4 for instance 1c0ee229-69dc-4dd2-86ea-3afc2217462d on n-h1-853611-3 Aug 18 12:07:01.760444 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f0b13739-e438-4cf3-8cef-7804441f499b req-456ad50d-3bb4-4d21-8378-8e46ad6f29f6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110754 Aug 18 12:07:01.761554 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3003/5657] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:07:01.774983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c3e363c8-27a3-4c70-9863-b8b868bb9458 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:01.776685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c3e363c8-27a3-4c70-9863-b8b868bb9458 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:01.836079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3e363c8-27a3-4c70-9863-b8b868bb9458 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:01.838835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3e363c8-27a3-4c70-9863-b8b868bb9458 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:01.838835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3e363c8-27a3-4c70-9863-b8b868bb9458 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:01.839854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3e363c8-27a3-4c70-9863-b8b868bb9458 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:01.847194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3e363c8-27a3-4c70-9863-b8b868bb9458 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:01.848587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c3e363c8-27a3-4c70-9863-b8b868bb9458 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:02.186828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c3e363c8-27a3-4c70-9863-b8b868bb9458 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:02.215681 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c3e363c8-27a3-4c70-9863-b8b868bb9458 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d" status: 200 len: 1318 microversion: 2.1 time: 0.451627 Aug 18 12:07:02.217099 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3004/5658] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:01 2022] GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:02.725367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b485640-5b1a-4ba9-bd24-098c9a172a10 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:02.726973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1b485640-5b1a-4ba9-bd24-098c9a172a10 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:02.743650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b485640-5b1a-4ba9-bd24-098c9a172a10 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:02.744880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b485640-5b1a-4ba9-bd24-098c9a172a10 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:02.762628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b485640-5b1a-4ba9-bd24-098c9a172a10 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:02.784948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b485640-5b1a-4ba9-bd24-098c9a172a10 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:02.784948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b485640-5b1a-4ba9-bd24-098c9a172a10 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:02.784948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b485640-5b1a-4ba9-bd24-098c9a172a10 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:03.004999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1b485640-5b1a-4ba9-bd24-098c9a172a10 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:03.025759 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1b485640-5b1a-4ba9-bd24-098c9a172a10 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1461 microversion: 2.1 time: 0.325310 Aug 18 12:07:03.051826 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3005/5659] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:02 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1461 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:03.093502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-93139b56-8ac5-4b4e-8513-483ca8452c25 req-e57ad3b0-0c13-424a-9adb-091af0fa89a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33fcf0b4-bb08-4bbb-8d33-01bfee1f521a", "name": "network-vif-deleted", "tag": "60e3c7f1-d1ab-4f61-a474-6392fd6a1f8e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:07:03.139851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-93139b56-8ac5-4b4e-8513-483ca8452c25 req-e57ad3b0-0c13-424a-9adb-091af0fa89a0 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:03.148734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-93139b56-8ac5-4b4e-8513-483ca8452c25 req-e57ad3b0-0c13-424a-9adb-091af0fa89a0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:03.149562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-93139b56-8ac5-4b4e-8513-483ca8452c25 req-e57ad3b0-0c13-424a-9adb-091af0fa89a0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:03.204125 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-93139b56-8ac5-4b4e-8513-483ca8452c25 req-e57ad3b0-0c13-424a-9adb-091af0fa89a0 service nova] Creating event network-vif-deleted:60e3c7f1-d1ab-4f61-a474-6392fd6a1f8e for instance 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a on n-h1-853611-3 Aug 18 12:07:03.210917 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-93139b56-8ac5-4b4e-8513-483ca8452c25 req-e57ad3b0-0c13-424a-9adb-091af0fa89a0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157048 Aug 18 12:07:03.211560 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3006/5660] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:07:03.261793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0addc434-1050-4362-a0a1-7d65d500c305 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:03.262670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0addc434-1050-4362-a0a1-7d65d500c305 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:03.276861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0addc434-1050-4362-a0a1-7d65d500c305 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:03.277820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0addc434-1050-4362-a0a1-7d65d500c305 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:03.278684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0addc434-1050-4362-a0a1-7d65d500c305 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:03.280124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0addc434-1050-4362-a0a1-7d65d500c305 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:03.280908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0addc434-1050-4362-a0a1-7d65d500c305 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:03.281621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0addc434-1050-4362-a0a1-7d65d500c305 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:03.521299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0addc434-1050-4362-a0a1-7d65d500c305 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:03.533640 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0addc434-1050-4362-a0a1-7d65d500c305 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d" status: 200 len: 1318 microversion: 2.1 time: 0.276509 Aug 18 12:07:03.536739 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3007/5661] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:03 2022] GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:07:04.075056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de341b72-f1fa-4bdb-96db-9260d586ae11 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:04.075697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-de341b72-f1fa-4bdb-96db-9260d586ae11 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:04.088772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de341b72-f1fa-4bdb-96db-9260d586ae11 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:04.089284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de341b72-f1fa-4bdb-96db-9260d586ae11 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:04.092664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de341b72-f1fa-4bdb-96db-9260d586ae11 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:04.093434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de341b72-f1fa-4bdb-96db-9260d586ae11 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:04.094173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de341b72-f1fa-4bdb-96db-9260d586ae11 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:04.094543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de341b72-f1fa-4bdb-96db-9260d586ae11 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:04.189702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de341b72-f1fa-4bdb-96db-9260d586ae11 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:04.191628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de341b72-f1fa-4bdb-96db-9260d586ae11 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:04.192879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de341b72-f1fa-4bdb-96db-9260d586ae11 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:04.194211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-de341b72-f1fa-4bdb-96db-9260d586ae11 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lazy-loading 'fault' on Instance uuid 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:07:04.339093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-de341b72-f1fa-4bdb-96db-9260d586ae11 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:04.367875 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de341b72-f1fa-4bdb-96db-9260d586ae11 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 200 len: 1304 microversion: 2.1 time: 0.300807 Aug 18 12:07:04.370522 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3008/5662] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:04 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 1304 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:07:04.577459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8d8c6f3d-2f43-4cc3-b214-d44cef2d8c54 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:04.578548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8d8c6f3d-2f43-4cc3-b214-d44cef2d8c54 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:04.588729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d8c6f3d-2f43-4cc3-b214-d44cef2d8c54 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:04.589611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d8c6f3d-2f43-4cc3-b214-d44cef2d8c54 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:04.590160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d8c6f3d-2f43-4cc3-b214-d44cef2d8c54 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:04.591605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d8c6f3d-2f43-4cc3-b214-d44cef2d8c54 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:04.592178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d8c6f3d-2f43-4cc3-b214-d44cef2d8c54 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:04.592759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d8c6f3d-2f43-4cc3-b214-d44cef2d8c54 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:04.601949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:07:04.816155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8d8c6f3d-2f43-4cc3-b214-d44cef2d8c54 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:04.831173 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8d8c6f3d-2f43-4cc3-b214-d44cef2d8c54 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d" status: 200 len: 1506 microversion: 2.1 time: 0.260344 Aug 18 12:07:04.832445 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3009/5663] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:04 2022] GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:07:05.400059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bec71fca-1d59-4d84-a2bd-5afc20a1f455 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:05.403801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bec71fca-1d59-4d84-a2bd-5afc20a1f455 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:05.442806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bec71fca-1d59-4d84-a2bd-5afc20a1f455 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:05.446792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bec71fca-1d59-4d84-a2bd-5afc20a1f455 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:05.448194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bec71fca-1d59-4d84-a2bd-5afc20a1f455 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:05.450183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bec71fca-1d59-4d84-a2bd-5afc20a1f455 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:05.453626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bec71fca-1d59-4d84-a2bd-5afc20a1f455 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:05.457132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bec71fca-1d59-4d84-a2bd-5afc20a1f455 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:05.527060 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-bec71fca-1d59-4d84-a2bd-5afc20a1f455 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] HTTP exception thrown: Instance 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a could not be found. Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bec71fca-1d59-4d84-a2bd-5afc20a1f455 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Request method failure captured: Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a HTTP/1.1 Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_itNaypnYkSgvlMoaFNSa_2KbFBNHrn_24tUg7yxOR7VwECAYT_QEHMDtJmu6AkRBlrNWE--fBk-qFFkAXJtl-LQxemq50PiNyvt4We4BqAv13-ZfZIbigxvBnoEeGMAdjRHHgSWcW0HgyYaiUr4HUMcFOGseY15PQOat2tHbkA6yyY Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a9425d21643e40ee9a2807e0e844df00 Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-VolumesActionsTest-707910832 Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a9425d21643e40ee9a2807e0e844df00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a9425d21643e40ee9a2807e0e844df00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a9425d21643e40ee9a2807e0e844df00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a9425d21643e40ee9a2807e0e844df00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-VolumesActionsTest-707910832 Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a9425d21643e40ee9a2807e0e844df00 Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-VolumesActionsTest-707910832 Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-VolumesActionsTest-707910832-project Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: f67651ab2cc741c3b38bb520192b354d Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-VolumesActionsTest-707910832-project Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a could not be found. Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '33fcf0b4-bb08-4bbb-8d33-01bfee1f521a'} Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a could not be found. Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a could not be found. Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:07:05.533836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:05.546484 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:07:05.546484 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:07:05.546484 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:07:05.546484 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:07:05.546484 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:07:05.546484 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a could not be found. Aug 18 12:07:05.546484 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:05.552466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bec71fca-1d59-4d84-a2bd-5afc20a1f455 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Returning 404 to user: Instance 33fcf0b4-bb08-4bbb-8d33-01bfee1f521a could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:07:05.555341 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bec71fca-1d59-4d84-a2bd-5afc20a1f455 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a" status: 404 len: 111 microversion: 2.1 time: 0.162782 Aug 18 12:07:05.556716 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3010/5664] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:05 2022] GET /compute/v2.1/servers/33fcf0b4-bb08-4bbb-8d33-01bfee1f521a => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:07:06.016991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1816641528", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "e970dc49-7408-430c-85fe-99c6832908ee"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:07:06.176883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] validate_networks() for [('e970dc49-7408-430c-85fe-99c6832908ee', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:07:07.469730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:07:07.472860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:07:07.474147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:07:07.475297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:07:07.476315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:07:07.502198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:07.504861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:07.505748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:07.507714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:07.508922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:07.510012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:07.543514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Getting quotas for project a9425d21643e40ee9a2807e0e844df00. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:07:07.551292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Getting quotas for user f67651ab2cc741c3b38bb520192b354d and project a9425d21643e40ee9a2807e0e844df00. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:07:07.575032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:07:07.577762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:07:07.654647 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-726540fd-d9c6-4af8-972d-49ad4bd72fdf tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.650553 Aug 18 12:07:07.656133 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3011/5665] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:07:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:07:07.946860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0d27bde1-d5a3-46f6-bb7c-ca617f8e4102 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'create', calling method: .version_select at 0x7f519f9aa5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1928947402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM62UuxXWp95w7mYA4TBgU0CTnAtpryfq4FrJ79uHyxd1iY0hs9aU7brPT68Wq1aOjyycxtTZlRyMaoUOs20GelJxulWNlDxmiYIN8hT9Xj+YVqT1Ttt5s3hszwkpCF9bA=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:07:07.973485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0d27bde1-d5a3-46f6-bb7c-ca617f8e4102 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:07:07.984425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0d27bde1-d5a3-46f6-bb7c-ca617f8e4102 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for user 916631a932304b6c9cec7ef622e2069d and project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:07:08.028285 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0d27bde1-d5a3-46f6-bb7c-ca617f8e4102 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.370274 Aug 18 12:07:08.029265 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3012/5666] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:07:07 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:07:08.050288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f4b416d2-f55d-4b7e-81e3-d5e33317b062 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:08.051867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f4b416d2-f55d-4b7e-81e3-d5e33317b062 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:08.178083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f4b416d2-f55d-4b7e-81e3-d5e33317b062 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:08.202099 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f4b416d2-f55d-4b7e-81e3-d5e33317b062 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 200 len: 1214 microversion: 2.1 time: 0.171101 Aug 18 12:07:08.211788 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3013/5667] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:08 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:09.252096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-baf264c2-aa4f-4c07-820b-34e4890c8f0e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:09.254826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-baf264c2-aa4f-4c07-820b-34e4890c8f0e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:09.260875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:07:09.279025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-baf264c2-aa4f-4c07-820b-34e4890c8f0e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:09.280417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-baf264c2-aa4f-4c07-820b-34e4890c8f0e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:09.281489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-baf264c2-aa4f-4c07-820b-34e4890c8f0e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:09.283873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-baf264c2-aa4f-4c07-820b-34e4890c8f0e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:09.285375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-baf264c2-aa4f-4c07-820b-34e4890c8f0e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:09.288160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-baf264c2-aa4f-4c07-820b-34e4890c8f0e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:09.555358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-baf264c2-aa4f-4c07-820b-34e4890c8f0e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:09.574367 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-baf264c2-aa4f-4c07-820b-34e4890c8f0e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 200 len: 1266 microversion: 2.1 time: 0.329298 Aug 18 12:07:09.576519 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3014/5668] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:09 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 1266 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:07:10.612170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ed5d6cd3-b99d-49ac-9099-4c0a95de1a67 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:10.622107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ed5d6cd3-b99d-49ac-9099-4c0a95de1a67 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:10.640202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed5d6cd3-b99d-49ac-9099-4c0a95de1a67 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:10.641341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed5d6cd3-b99d-49ac-9099-4c0a95de1a67 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:10.642944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed5d6cd3-b99d-49ac-9099-4c0a95de1a67 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:10.644947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed5d6cd3-b99d-49ac-9099-4c0a95de1a67 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:10.646072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed5d6cd3-b99d-49ac-9099-4c0a95de1a67 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:10.647190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ed5d6cd3-b99d-49ac-9099-4c0a95de1a67 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:10.932034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ed5d6cd3-b99d-49ac-9099-4c0a95de1a67 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:10.942898 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ed5d6cd3-b99d-49ac-9099-4c0a95de1a67 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 200 len: 1272 microversion: 2.1 time: 0.338294 Aug 18 12:07:10.946636 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3015/5669] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:10 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:11.974752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8f453d86-9dce-4a36-b7f8-e247258e0b91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:11.975954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8f453d86-9dce-4a36-b7f8-e247258e0b91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:12.019717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f453d86-9dce-4a36-b7f8-e247258e0b91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:12.020861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f453d86-9dce-4a36-b7f8-e247258e0b91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:12.026870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f453d86-9dce-4a36-b7f8-e247258e0b91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:12.029004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f453d86-9dce-4a36-b7f8-e247258e0b91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:12.033464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f453d86-9dce-4a36-b7f8-e247258e0b91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:12.035613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f453d86-9dce-4a36-b7f8-e247258e0b91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:12.477260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8f453d86-9dce-4a36-b7f8-e247258e0b91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:12.526786 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8f453d86-9dce-4a36-b7f8-e247258e0b91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 200 len: 1314 microversion: 2.1 time: 0.559726 Aug 18 12:07:12.540181 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3016/5670] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:11 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:12.691948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-aa06f8d9-2e4e-453d-81fe-63b1df07b142 req-4afdda8c-2716-4aaa-8f33-e15344e7fe37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0541639-4699-42cf-a280-722584bbeddc", "tag": "7e450f9d-85c8-47af-96bd-5c2be976c514"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:07:12.773213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aa06f8d9-2e4e-453d-81fe-63b1df07b142 req-4afdda8c-2716-4aaa-8f33-e15344e7fe37 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:12.775376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aa06f8d9-2e4e-453d-81fe-63b1df07b142 req-4afdda8c-2716-4aaa-8f33-e15344e7fe37 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:12.776680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aa06f8d9-2e4e-453d-81fe-63b1df07b142 req-4afdda8c-2716-4aaa-8f33-e15344e7fe37 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:12.800232 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-aa06f8d9-2e4e-453d-81fe-63b1df07b142 req-4afdda8c-2716-4aaa-8f33-e15344e7fe37 service nova] Creating event network-changed:7e450f9d-85c8-47af-96bd-5c2be976c514 for instance c0541639-4699-42cf-a280-722584bbeddc on n-h2-853611-3 Aug 18 12:07:12.810166 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-aa06f8d9-2e4e-453d-81fe-63b1df07b142 req-4afdda8c-2716-4aaa-8f33-e15344e7fe37 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130728 Aug 18 12:07:12.812794 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3017/5671] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:07:13.586582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b03dfa25-5fca-4f45-a3af-7ff4130d8f3c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:13.591687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b03dfa25-5fca-4f45-a3af-7ff4130d8f3c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:13.607562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b03dfa25-5fca-4f45-a3af-7ff4130d8f3c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:13.610604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b03dfa25-5fca-4f45-a3af-7ff4130d8f3c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:13.611885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b03dfa25-5fca-4f45-a3af-7ff4130d8f3c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:13.614902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b03dfa25-5fca-4f45-a3af-7ff4130d8f3c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:13.615767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b03dfa25-5fca-4f45-a3af-7ff4130d8f3c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:13.616545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b03dfa25-5fca-4f45-a3af-7ff4130d8f3c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:14.302494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b03dfa25-5fca-4f45-a3af-7ff4130d8f3c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:14.324174 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b03dfa25-5fca-4f45-a3af-7ff4130d8f3c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 200 len: 1314 microversion: 2.1 time: 0.753912 Aug 18 12:07:14.325454 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3018/5672] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:13 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 1314 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:15.349294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-07894725-1d32-49c1-ae1e-5a8d75735552 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:15.351398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-07894725-1d32-49c1-ae1e-5a8d75735552 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:15.360545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07894725-1d32-49c1-ae1e-5a8d75735552 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:15.362091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07894725-1d32-49c1-ae1e-5a8d75735552 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:15.362967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07894725-1d32-49c1-ae1e-5a8d75735552 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:15.364133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07894725-1d32-49c1-ae1e-5a8d75735552 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:15.364842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07894725-1d32-49c1-ae1e-5a8d75735552 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:15.365489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07894725-1d32-49c1-ae1e-5a8d75735552 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:15.630974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-07894725-1d32-49c1-ae1e-5a8d75735552 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:15.650739 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-07894725-1d32-49c1-ae1e-5a8d75735552 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 200 len: 1314 microversion: 2.1 time: 0.306318 Aug 18 12:07:15.652140 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3019/5673] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:15 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:16.688589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b306bf93-260d-4b98-8f19-0d6dd5625834 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:16.689808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b306bf93-260d-4b98-8f19-0d6dd5625834 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:16.709356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b306bf93-260d-4b98-8f19-0d6dd5625834 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:16.710187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b306bf93-260d-4b98-8f19-0d6dd5625834 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:16.716172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b306bf93-260d-4b98-8f19-0d6dd5625834 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:16.720361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b306bf93-260d-4b98-8f19-0d6dd5625834 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:16.722605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b306bf93-260d-4b98-8f19-0d6dd5625834 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:16.728961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b306bf93-260d-4b98-8f19-0d6dd5625834 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:17.136585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b306bf93-260d-4b98-8f19-0d6dd5625834 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:17.155971 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b306bf93-260d-4b98-8f19-0d6dd5625834 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 200 len: 1314 microversion: 2.1 time: 0.472744 Aug 18 12:07:17.159087 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3020/5674] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:16 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:18.183258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-feb111c2-070a-4787-8760-359a34127d2f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:18.183966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-feb111c2-070a-4787-8760-359a34127d2f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:18.209613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:07:18.217122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:07:18.222471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-feb111c2-070a-4787-8760-359a34127d2f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:18.224152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-feb111c2-070a-4787-8760-359a34127d2f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:18.225627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-feb111c2-070a-4787-8760-359a34127d2f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:18.226743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-feb111c2-070a-4787-8760-359a34127d2f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:18.227540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-feb111c2-070a-4787-8760-359a34127d2f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:18.228235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-feb111c2-070a-4787-8760-359a34127d2f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:18.758397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-feb111c2-070a-4787-8760-359a34127d2f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:18.770908 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-feb111c2-070a-4787-8760-359a34127d2f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 200 len: 1314 microversion: 2.1 time: 0.594678 Aug 18 12:07:18.771884 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3021/5675] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:18 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:19.800772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e1938d2-55a4-4eaa-bfd8-e582374cdc5e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:19.801738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2e1938d2-55a4-4eaa-bfd8-e582374cdc5e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:19.828692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e1938d2-55a4-4eaa-bfd8-e582374cdc5e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:19.829618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e1938d2-55a4-4eaa-bfd8-e582374cdc5e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:19.830363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e1938d2-55a4-4eaa-bfd8-e582374cdc5e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:19.831234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e1938d2-55a4-4eaa-bfd8-e582374cdc5e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:19.831771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e1938d2-55a4-4eaa-bfd8-e582374cdc5e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:19.832286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e1938d2-55a4-4eaa-bfd8-e582374cdc5e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:20.164732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2e1938d2-55a4-4eaa-bfd8-e582374cdc5e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:20.177115 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2e1938d2-55a4-4eaa-bfd8-e582374cdc5e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 200 len: 1314 microversion: 2.1 time: 0.383198 Aug 18 12:07:20.178031 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3022/5676] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:19 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:21.105934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-87df6f37-5cc1-4673-abcf-bcb7385a5c25 req-c2fa4482-0f84-43f6-ac44-aaffd8812a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0541639-4699-42cf-a280-722584bbeddc", "name": "network-vif-plugged", "status": "completed", "tag": "7e450f9d-85c8-47af-96bd-5c2be976c514"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:07:21.135155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-87df6f37-5cc1-4673-abcf-bcb7385a5c25 req-c2fa4482-0f84-43f6-ac44-aaffd8812a61 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:21.136440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-87df6f37-5cc1-4673-abcf-bcb7385a5c25 req-c2fa4482-0f84-43f6-ac44-aaffd8812a61 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:21.137404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-87df6f37-5cc1-4673-abcf-bcb7385a5c25 req-c2fa4482-0f84-43f6-ac44-aaffd8812a61 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:21.178717 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-87df6f37-5cc1-4673-abcf-bcb7385a5c25 req-c2fa4482-0f84-43f6-ac44-aaffd8812a61 service nova] Creating event network-vif-plugged:7e450f9d-85c8-47af-96bd-5c2be976c514 for instance c0541639-4699-42cf-a280-722584bbeddc on n-h2-853611-3 Aug 18 12:07:21.192170 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-87df6f37-5cc1-4673-abcf-bcb7385a5c25 req-c2fa4482-0f84-43f6-ac44-aaffd8812a61 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089943 Aug 18 12:07:21.194997 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3023/5677] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:07:21.220153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7ecf181-c09b-4c9f-97bf-c797f0e753ac tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:21.221273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e7ecf181-c09b-4c9f-97bf-c797f0e753ac tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:21.239783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ecf181-c09b-4c9f-97bf-c797f0e753ac tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:21.254290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ecf181-c09b-4c9f-97bf-c797f0e753ac tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:21.254783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ecf181-c09b-4c9f-97bf-c797f0e753ac tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:21.255575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ecf181-c09b-4c9f-97bf-c797f0e753ac tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:21.256819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ecf181-c09b-4c9f-97bf-c797f0e753ac tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:21.257473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ecf181-c09b-4c9f-97bf-c797f0e753ac tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:21.719875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e7ecf181-c09b-4c9f-97bf-c797f0e753ac tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:21.737814 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e7ecf181-c09b-4c9f-97bf-c797f0e753ac tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 200 len: 1314 microversion: 2.1 time: 0.540580 Aug 18 12:07:21.738806 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3024/5678] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:21 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:21.759611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-396543915", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "28873c88-6b4b-4a05-8c72-2d00ba1f096e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1928947402", "security_groups": [{"name": "tempest-secgroup-smoke-527052182"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:07:21.972529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] validate_networks() for [('28873c88-6b4b-4a05-8c72-2d00ba1f096e', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:07:22.669506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:07:22.671168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:07:22.671701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:07:22.672136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:07:22.673473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:07:22.701069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:22.701572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:22.702653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:22.704723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:22.706920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:22.709632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:22.754209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:07:22.778475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for user 916631a932304b6c9cec7ef622e2069d and project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:07:22.804268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:07:22.811902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:07:22.892442 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-24d01803-ec9e-47c7-912f-05e7b426a0e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.137848 Aug 18 12:07:22.895900 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3025/5679] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:07:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:07:22.911033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f5f6962a-ea48-4c0f-9726-69b720a9ff8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:22.911647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f5f6962a-ea48-4c0f-9726-69b720a9ff8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:22.920158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5f6962a-ea48-4c0f-9726-69b720a9ff8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:22.920934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5f6962a-ea48-4c0f-9726-69b720a9ff8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:22.922086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5f6962a-ea48-4c0f-9726-69b720a9ff8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:22.922919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5f6962a-ea48-4c0f-9726-69b720a9ff8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:22.923406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5f6962a-ea48-4c0f-9726-69b720a9ff8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:22.924462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5f6962a-ea48-4c0f-9726-69b720a9ff8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:23.326966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f5f6962a-ea48-4c0f-9726-69b720a9ff8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:23.350614 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f5f6962a-ea48-4c0f-9726-69b720a9ff8f tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 200 len: 1497 microversion: 2.1 time: 0.452166 Aug 18 12:07:23.351915 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3026/5680] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:22 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 1497 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:23.359666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9a607290-3537-4d08-99e8-4dcf1d2b3d70 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:23.360768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9a607290-3537-4d08-99e8-4dcf1d2b3d70 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:23.513705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9a607290-3537-4d08-99e8-4dcf1d2b3d70 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:23.542581 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9a607290-3537-4d08-99e8-4dcf1d2b3d70 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1266 microversion: 2.1 time: 0.189215 Aug 18 12:07:23.543729 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3027/5681] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:23 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:24.422681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e982f69-e0dc-46b9-b4b3-3ba9bc19764e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:24.423726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7e982f69-e0dc-46b9-b4b3-3ba9bc19764e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:24.458420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e982f69-e0dc-46b9-b4b3-3ba9bc19764e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:24.460058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e982f69-e0dc-46b9-b4b3-3ba9bc19764e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:24.461850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e982f69-e0dc-46b9-b4b3-3ba9bc19764e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:24.463532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e982f69-e0dc-46b9-b4b3-3ba9bc19764e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:24.464647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e982f69-e0dc-46b9-b4b3-3ba9bc19764e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:24.465717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e982f69-e0dc-46b9-b4b3-3ba9bc19764e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:24.548919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7e982f69-e0dc-46b9-b4b3-3ba9bc19764e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:07:24.888271 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e982f69-e0dc-46b9-b4b3-3ba9bc19764e tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 204 len: 0 microversion: 2.1 time: 0.473891 Aug 18 12:07:24.892658 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3028/5682] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:07:24 2022] DELETE /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:07:24.909550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-97eda5a8-53f0-4bf9-b233-10fa676d6ae9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:24.911334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-97eda5a8-53f0-4bf9-b233-10fa676d6ae9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:24.929128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97eda5a8-53f0-4bf9-b233-10fa676d6ae9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:24.930411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97eda5a8-53f0-4bf9-b233-10fa676d6ae9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:24.931520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97eda5a8-53f0-4bf9-b233-10fa676d6ae9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:24.933083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97eda5a8-53f0-4bf9-b233-10fa676d6ae9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:24.934206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97eda5a8-53f0-4bf9-b233-10fa676d6ae9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:24.935284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97eda5a8-53f0-4bf9-b233-10fa676d6ae9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:25.092394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-97eda5a8-53f0-4bf9-b233-10fa676d6ae9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:25.114379 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-97eda5a8-53f0-4bf9-b233-10fa676d6ae9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1318 microversion: 2.1 time: 0.214211 Aug 18 12:07:25.116480 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3029/5683] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:24 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:25.128017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a95dbb58-bb05-4156-b07d-1d1ada9c7004 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:25.129500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a95dbb58-bb05-4156-b07d-1d1ada9c7004 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:25.142406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a95dbb58-bb05-4156-b07d-1d1ada9c7004 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:25.144188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a95dbb58-bb05-4156-b07d-1d1ada9c7004 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:25.145206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a95dbb58-bb05-4156-b07d-1d1ada9c7004 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:25.147189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a95dbb58-bb05-4156-b07d-1d1ada9c7004 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:25.148294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a95dbb58-bb05-4156-b07d-1d1ada9c7004 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:25.149260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a95dbb58-bb05-4156-b07d-1d1ada9c7004 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:25.192385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:07:25.441024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a95dbb58-bb05-4156-b07d-1d1ada9c7004 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:25.466621 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a95dbb58-bb05-4156-b07d-1d1ada9c7004 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 200 len: 1503 microversion: 2.1 time: 0.346499 Aug 18 12:07:25.470126 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3030/5684] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:25 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 1503 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:26.160705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3f12b190-477b-4531-9cf3-df86ce79ab90 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:26.162302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3f12b190-477b-4531-9cf3-df86ce79ab90 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:26.179601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f12b190-477b-4531-9cf3-df86ce79ab90 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:26.180376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f12b190-477b-4531-9cf3-df86ce79ab90 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:26.183167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f12b190-477b-4531-9cf3-df86ce79ab90 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:26.184366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f12b190-477b-4531-9cf3-df86ce79ab90 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:26.185109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f12b190-477b-4531-9cf3-df86ce79ab90 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:26.191038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f12b190-477b-4531-9cf3-df86ce79ab90 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:26.344863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3f12b190-477b-4531-9cf3-df86ce79ab90 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:26.365181 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3f12b190-477b-4531-9cf3-df86ce79ab90 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1324 microversion: 2.1 time: 0.222749 Aug 18 12:07:26.366491 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3031/5685] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:26 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1324 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:26.523714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a65b6f9c-ee3e-42d6-949b-92e38cdcba5c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:26.525784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a65b6f9c-ee3e-42d6-949b-92e38cdcba5c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:26.535586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a65b6f9c-ee3e-42d6-949b-92e38cdcba5c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:26.536123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a65b6f9c-ee3e-42d6-949b-92e38cdcba5c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:26.536726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a65b6f9c-ee3e-42d6-949b-92e38cdcba5c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:26.538201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a65b6f9c-ee3e-42d6-949b-92e38cdcba5c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:26.539415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a65b6f9c-ee3e-42d6-949b-92e38cdcba5c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:26.540678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a65b6f9c-ee3e-42d6-949b-92e38cdcba5c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:26.865940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a65b6f9c-ee3e-42d6-949b-92e38cdcba5c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:26.900471 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a65b6f9c-ee3e-42d6-949b-92e38cdcba5c tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 200 len: 1503 microversion: 2.1 time: 0.390097 Aug 18 12:07:26.906328 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3032/5686] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:26 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 1503 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:07:27.414917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-849ebe92-b73f-41b0-9940-1088350fff84 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:27.417083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-849ebe92-b73f-41b0-9940-1088350fff84 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:27.441459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-849ebe92-b73f-41b0-9940-1088350fff84 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:27.443662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-849ebe92-b73f-41b0-9940-1088350fff84 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:27.444811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-849ebe92-b73f-41b0-9940-1088350fff84 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:27.447869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-849ebe92-b73f-41b0-9940-1088350fff84 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:27.449241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-849ebe92-b73f-41b0-9940-1088350fff84 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:27.450666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-849ebe92-b73f-41b0-9940-1088350fff84 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:27.799262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-849ebe92-b73f-41b0-9940-1088350fff84 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:27.833109 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-849ebe92-b73f-41b0-9940-1088350fff84 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1391 microversion: 2.1 time: 0.442970 Aug 18 12:07:27.847752 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3033/5687] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:27 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1391 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:27.953285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8db50fa6-82a9-4993-9939-8e393c8bfa91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:27.964810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8db50fa6-82a9-4993-9939-8e393c8bfa91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:27.994796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db50fa6-82a9-4993-9939-8e393c8bfa91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:27.995729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db50fa6-82a9-4993-9939-8e393c8bfa91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:27.996257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db50fa6-82a9-4993-9939-8e393c8bfa91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:27.997005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db50fa6-82a9-4993-9939-8e393c8bfa91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:27.998522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db50fa6-82a9-4993-9939-8e393c8bfa91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:27.999400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8db50fa6-82a9-4993-9939-8e393c8bfa91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:28.141564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8db50fa6-82a9-4993-9939-8e393c8bfa91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67651ab2cc741c3b38bb520192b354d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9425d21643e40ee9a2807e0e844df00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:28.154202 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8db50fa6-82a9-4993-9939-8e393c8bfa91 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 200 len: 1461 microversion: 2.1 time: 0.216998 Aug 18 12:07:28.155199 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3034/5688] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:27 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 1461 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:07:28.217798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-b9efa339-610f-4464-a981-5bebe127c7b6 req-19d40c38-44f3-4c84-8e75-7a4ea13307b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0541639-4699-42cf-a280-722584bbeddc", "name": "network-vif-deleted", "tag": "7e450f9d-85c8-47af-96bd-5c2be976c514"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:07:28.260824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b9efa339-610f-4464-a981-5bebe127c7b6 req-19d40c38-44f3-4c84-8e75-7a4ea13307b9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:28.263180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b9efa339-610f-4464-a981-5bebe127c7b6 req-19d40c38-44f3-4c84-8e75-7a4ea13307b9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:28.268824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b9efa339-610f-4464-a981-5bebe127c7b6 req-19d40c38-44f3-4c84-8e75-7a4ea13307b9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:28.329177 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-b9efa339-610f-4464-a981-5bebe127c7b6 req-19d40c38-44f3-4c84-8e75-7a4ea13307b9 service nova] Creating event network-vif-deleted:7e450f9d-85c8-47af-96bd-5c2be976c514 for instance c0541639-4699-42cf-a280-722584bbeddc on n-h2-853611-3 Aug 18 12:07:28.368886 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-b9efa339-610f-4464-a981-5bebe127c7b6 req-19d40c38-44f3-4c84-8e75-7a4ea13307b9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167213 Aug 18 12:07:28.369920 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3035/5689] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:07:28.881283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0a18d50a-9f66-43f1-9aff-06ddf752982d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:28.887965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0a18d50a-9f66-43f1-9aff-06ddf752982d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:28.925079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a18d50a-9f66-43f1-9aff-06ddf752982d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:28.928377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a18d50a-9f66-43f1-9aff-06ddf752982d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:28.932151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a18d50a-9f66-43f1-9aff-06ddf752982d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:28.936037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a18d50a-9f66-43f1-9aff-06ddf752982d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:28.939690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a18d50a-9f66-43f1-9aff-06ddf752982d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:28.941516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a18d50a-9f66-43f1-9aff-06ddf752982d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:29.306177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0a18d50a-9f66-43f1-9aff-06ddf752982d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:29.343403 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0a18d50a-9f66-43f1-9aff-06ddf752982d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1391 microversion: 2.1 time: 0.466870 Aug 18 12:07:29.354630 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3036/5690] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:28 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1391 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:07:29.360043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26c28cc7-5836-48a0-98bd-f77f505e6067 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:29.362865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26c28cc7-5836-48a0-98bd-f77f505e6067 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] [instance: c0541639-4699-42cf-a280-722584bbeddc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:29.375725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26c28cc7-5836-48a0-98bd-f77f505e6067 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:29.389785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26c28cc7-5836-48a0-98bd-f77f505e6067 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:29.390902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26c28cc7-5836-48a0-98bd-f77f505e6067 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:29.392207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26c28cc7-5836-48a0-98bd-f77f505e6067 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:29.393933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26c28cc7-5836-48a0-98bd-f77f505e6067 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:29.395007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26c28cc7-5836-48a0-98bd-f77f505e6067 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:29.433540 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-26c28cc7-5836-48a0-98bd-f77f505e6067 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] HTTP exception thrown: Instance c0541639-4699-42cf-a280-722584bbeddc could not be found. Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26c28cc7-5836-48a0-98bd-f77f505e6067 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Request method failure captured: Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc HTTP/1.1 Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_itNaypnYkSgvlMoaFNSa_2KbFBNHrn_24tUg7yxOR7VwECAYT_QEHMDtJmu6AkRBlrNWE--fBk-qFFkAXJtl-LQxemq50PiNyvt4We4BqAv13-ZfZIbigxvBnoEeGMAdjRHHgSWcW0HgyYaiUr4HUMcFOGseY15PQOat2tHbkA6yyY Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: a9425d21643e40ee9a2807e0e844df00 Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-VolumesActionsTest-707910832 Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a9425d21643e40ee9a2807e0e844df00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/a9425d21643e40ee9a2807e0e844df00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_a9425d21643e40ee9a2807e0e844df00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/a9425d21643e40ee9a2807e0e844df00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-VolumesActionsTest-707910832 Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: a9425d21643e40ee9a2807e0e844df00 Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-VolumesActionsTest-707910832 Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-VolumesActionsTest-707910832-project Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: f67651ab2cc741c3b38bb520192b354d Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-VolumesActionsTest-707910832-project Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance c0541639-4699-42cf-a280-722584bbeddc could not be found. Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'c0541639-4699-42cf-a280-722584bbeddc'} Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0541639-4699-42cf-a280-722584bbeddc could not be found. Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0541639-4699-42cf-a280-722584bbeddc could not be found. Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:07:29.439218 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:29.444515 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:07:29.444515 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:07:29.444515 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:07:29.444515 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:07:29.444515 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:07:29.444515 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0541639-4699-42cf-a280-722584bbeddc could not be found. Aug 18 12:07:29.444515 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:29.444515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26c28cc7-5836-48a0-98bd-f77f505e6067 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] Returning 404 to user: Instance c0541639-4699-42cf-a280-722584bbeddc could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:07:29.444515 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-26c28cc7-5836-48a0-98bd-f77f505e6067 tempest-VolumesActionsTest-707910832 tempest-VolumesActionsTest-707910832-project] 10.222.0.73 "GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc" status: 404 len: 111 microversion: 2.1 time: 0.086886 Aug 18 12:07:29.444515 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3037/5691] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:29 2022] GET /compute/v2.1/servers/c0541639-4699-42cf-a280-722584bbeddc => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:07:30.372820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d0de476-d252-47aa-9a65-9342a9e4a86f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:30.374000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7d0de476-d252-47aa-9a65-9342a9e4a86f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:30.428751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d0de476-d252-47aa-9a65-9342a9e4a86f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:30.430086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d0de476-d252-47aa-9a65-9342a9e4a86f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:30.433097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d0de476-d252-47aa-9a65-9342a9e4a86f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:30.435910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d0de476-d252-47aa-9a65-9342a9e4a86f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:30.437112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d0de476-d252-47aa-9a65-9342a9e4a86f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:30.438340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d0de476-d252-47aa-9a65-9342a9e4a86f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:30.775077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7d0de476-d252-47aa-9a65-9342a9e4a86f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:30.790135 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7d0de476-d252-47aa-9a65-9342a9e4a86f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1391 microversion: 2.1 time: 0.425827 Aug 18 12:07:30.794931 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3038/5692] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:30 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1391 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:30.815178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-3727243a-daa5-48b6-9fa2-fee07abd6abf req-0a28e217-6a89-448d-8320-4a4c97af2702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8126a245-e16e-4613-94a9-2deae6bdf4c1", "tag": "90389b42-aa2a-4808-9c1f-654fd4b07cf9"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:07:30.835471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3727243a-daa5-48b6-9fa2-fee07abd6abf req-0a28e217-6a89-448d-8320-4a4c97af2702 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:30.835969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3727243a-daa5-48b6-9fa2-fee07abd6abf req-0a28e217-6a89-448d-8320-4a4c97af2702 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:30.836562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3727243a-daa5-48b6-9fa2-fee07abd6abf req-0a28e217-6a89-448d-8320-4a4c97af2702 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:30.853725 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-3727243a-daa5-48b6-9fa2-fee07abd6abf req-0a28e217-6a89-448d-8320-4a4c97af2702 service nova] Creating event network-changed:90389b42-aa2a-4808-9c1f-654fd4b07cf9 for instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 on n-h1-853611-3 Aug 18 12:07:30.864954 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-3727243a-daa5-48b6-9fa2-fee07abd6abf req-0a28e217-6a89-448d-8320-4a4c97af2702 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055058 Aug 18 12:07:30.865864 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3039/5693] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:07:31.841562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-29f05355-413a-44c9-a964-a31dc4e1ba09 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:31.844624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-29f05355-413a-44c9-a964-a31dc4e1ba09 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:31.878855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29f05355-413a-44c9-a964-a31dc4e1ba09 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:31.881607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29f05355-413a-44c9-a964-a31dc4e1ba09 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:31.885100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29f05355-413a-44c9-a964-a31dc4e1ba09 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:31.887372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29f05355-413a-44c9-a964-a31dc4e1ba09 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:31.891682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29f05355-413a-44c9-a964-a31dc4e1ba09 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:31.894944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29f05355-413a-44c9-a964-a31dc4e1ba09 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:32.628210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-29f05355-413a-44c9-a964-a31dc4e1ba09 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:32.682931 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-29f05355-413a-44c9-a964-a31dc4e1ba09 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1391 microversion: 2.1 time: 0.853721 Aug 18 12:07:32.687732 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3040/5694] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:31 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1391 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:07:33.738789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3c250a56-6209-4c0e-b9f6-2f3be8c8ca3e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:33.746453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3c250a56-6209-4c0e-b9f6-2f3be8c8ca3e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:33.766371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:07:33.782716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:07:33.836615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c250a56-6209-4c0e-b9f6-2f3be8c8ca3e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:33.845924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c250a56-6209-4c0e-b9f6-2f3be8c8ca3e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:33.852965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c250a56-6209-4c0e-b9f6-2f3be8c8ca3e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:33.854354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c250a56-6209-4c0e-b9f6-2f3be8c8ca3e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:33.865864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c250a56-6209-4c0e-b9f6-2f3be8c8ca3e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:33.866862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c250a56-6209-4c0e-b9f6-2f3be8c8ca3e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:34.683262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3c250a56-6209-4c0e-b9f6-2f3be8c8ca3e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:34.722894 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3c250a56-6209-4c0e-b9f6-2f3be8c8ca3e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1391 microversion: 2.1 time: 0.989922 Aug 18 12:07:34.724252 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3041/5695] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:33 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1391 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:07:35.764195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aaac6bae-4bfb-4edc-9003-7d3cff9d3815 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:35.766342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aaac6bae-4bfb-4edc-9003-7d3cff9d3815 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:35.787519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaac6bae-4bfb-4edc-9003-7d3cff9d3815 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:35.788243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaac6bae-4bfb-4edc-9003-7d3cff9d3815 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:35.788824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaac6bae-4bfb-4edc-9003-7d3cff9d3815 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:35.789676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaac6bae-4bfb-4edc-9003-7d3cff9d3815 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:35.790224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaac6bae-4bfb-4edc-9003-7d3cff9d3815 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:35.790800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaac6bae-4bfb-4edc-9003-7d3cff9d3815 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:36.031863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aaac6bae-4bfb-4edc-9003-7d3cff9d3815 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:36.043615 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aaac6bae-4bfb-4edc-9003-7d3cff9d3815 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1391 microversion: 2.1 time: 0.286752 Aug 18 12:07:36.046265 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3042/5696] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:35 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:37.090856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3c50a51d-5e77-4e4f-bd30-277ff7135bd0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:37.091948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3c50a51d-5e77-4e4f-bd30-277ff7135bd0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:37.140266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c50a51d-5e77-4e4f-bd30-277ff7135bd0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:37.141245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c50a51d-5e77-4e4f-bd30-277ff7135bd0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:37.142111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c50a51d-5e77-4e4f-bd30-277ff7135bd0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:37.143771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c50a51d-5e77-4e4f-bd30-277ff7135bd0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:37.145160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c50a51d-5e77-4e4f-bd30-277ff7135bd0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:37.147688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c50a51d-5e77-4e4f-bd30-277ff7135bd0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:37.441771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3c50a51d-5e77-4e4f-bd30-277ff7135bd0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:37.461466 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3c50a51d-5e77-4e4f-bd30-277ff7135bd0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1391 microversion: 2.1 time: 0.383605 Aug 18 12:07:37.463427 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3043/5697] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:37 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1391 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:37.706157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7760c984-fd82-4c27-91db-1e87ae5f5a40 req-6aec1dc6-f8fe-43a7-9756-69e7f83da969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8126a245-e16e-4613-94a9-2deae6bdf4c1", "name": "network-vif-plugged", "status": "completed", "tag": "90389b42-aa2a-4808-9c1f-654fd4b07cf9"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:07:37.766320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7760c984-fd82-4c27-91db-1e87ae5f5a40 req-6aec1dc6-f8fe-43a7-9756-69e7f83da969 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:37.770776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7760c984-fd82-4c27-91db-1e87ae5f5a40 req-6aec1dc6-f8fe-43a7-9756-69e7f83da969 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:37.774989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7760c984-fd82-4c27-91db-1e87ae5f5a40 req-6aec1dc6-f8fe-43a7-9756-69e7f83da969 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:37.826542 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7760c984-fd82-4c27-91db-1e87ae5f5a40 req-6aec1dc6-f8fe-43a7-9756-69e7f83da969 service nova] Creating event network-vif-plugged:90389b42-aa2a-4808-9c1f-654fd4b07cf9 for instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 on n-h1-853611-3 Aug 18 12:07:37.844803 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7760c984-fd82-4c27-91db-1e87ae5f5a40 req-6aec1dc6-f8fe-43a7-9756-69e7f83da969 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154727 Aug 18 12:07:37.846196 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3044/5698] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:07:38.499289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e2defa75-8fc7-4901-a003-c3de026b94d1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:38.504872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e2defa75-8fc7-4901-a003-c3de026b94d1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:38.541381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2defa75-8fc7-4901-a003-c3de026b94d1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:38.542885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2defa75-8fc7-4901-a003-c3de026b94d1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:38.544190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2defa75-8fc7-4901-a003-c3de026b94d1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:38.563684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2defa75-8fc7-4901-a003-c3de026b94d1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:38.565039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2defa75-8fc7-4901-a003-c3de026b94d1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:38.571045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2defa75-8fc7-4901-a003-c3de026b94d1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:39.123060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e2defa75-8fc7-4901-a003-c3de026b94d1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:39.141229 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e2defa75-8fc7-4901-a003-c3de026b94d1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1391 microversion: 2.1 time: 0.659038 Aug 18 12:07:39.142313 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3045/5699] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:38 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1391 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:07:39.147661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11815326-e6a4-4d95-a863-8b79f4a4ee43 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:39.150748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-11815326-e6a4-4d95-a863-8b79f4a4ee43 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: 6f1e4e16-a47a-4137-b059-c45fd3308070] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:39.159974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11815326-e6a4-4d95-a863-8b79f4a4ee43 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:39.160928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11815326-e6a4-4d95-a863-8b79f4a4ee43 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:39.161778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11815326-e6a4-4d95-a863-8b79f4a4ee43 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:39.162986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11815326-e6a4-4d95-a863-8b79f4a4ee43 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:39.163749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11815326-e6a4-4d95-a863-8b79f4a4ee43 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:39.164452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11815326-e6a4-4d95-a863-8b79f4a4ee43 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:39.264428 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-11815326-e6a4-4d95-a863-8b79f4a4ee43 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] HTTP exception thrown: Instance 6f1e4e16-a47a-4137-b059-c45fd3308070 could not be found. Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11815326-e6a4-4d95-a863-8b79f4a4ee43 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Request method failure captured: Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 HTTP/1.1 Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ish0ID4vEv_ISChnqeru0zWYln9a1v3652ObCWsitcRK0NEvfQgBQ_sKwPYCL-OYKZOnS8iUtaDihomSCwLrY5cvk_OwvNJ7jq3ok12MMKLGA8IHRiIdy5_xN9JhbRdoTRBVDzj-9Z_Ce0MVX7B97ok2Xv8cBgOjjUUl9kIu3hWtnY Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 60807e83fdba411580f23dee4c146fb2 Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestServerMultinode-1267560100 Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/60807e83fdba411580f23dee4c146fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/60807e83fdba411580f23dee4c146fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_60807e83fdba411580f23dee4c146fb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/60807e83fdba411580f23dee4c146fb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestServerMultinode-1267560100 Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 60807e83fdba411580f23dee4c146fb2 Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestServerMultinode-1267560100 Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestServerMultinode-1267560100-project-admin Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 230e12facb4b4d5daa74197bfcc7778d Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestServerMultinode-1267560100-project-admin Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 6f1e4e16-a47a-4137-b059-c45fd3308070 could not be found. Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '6f1e4e16-a47a-4137-b059-c45fd3308070'} Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f1e4e16-a47a-4137-b059-c45fd3308070 could not be found. Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f1e4e16-a47a-4137-b059-c45fd3308070 could not be found. Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:07:39.265805 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:39.270933 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:07:39.270933 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:07:39.270933 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:07:39.270933 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:07:39.270933 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:07:39.270933 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f1e4e16-a47a-4137-b059-c45fd3308070 could not be found. Aug 18 12:07:39.270933 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:39.270933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11815326-e6a4-4d95-a863-8b79f4a4ee43 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Returning 404 to user: Instance 6f1e4e16-a47a-4137-b059-c45fd3308070 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:07:39.270933 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-11815326-e6a4-4d95-a863-8b79f4a4ee43 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070" status: 404 len: 111 microversion: 2.1 time: 0.124793 Aug 18 12:07:39.280277 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3046/5700] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:39 2022] GET /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:07:39.292212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-18021692-6543-4925-a58e-815ff7bb045b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:39.293043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-18021692-6543-4925-a58e-815ff7bb045b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:39.318080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18021692-6543-4925-a58e-815ff7bb045b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:39.319022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18021692-6543-4925-a58e-815ff7bb045b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:39.319803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18021692-6543-4925-a58e-815ff7bb045b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:39.321230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18021692-6543-4925-a58e-815ff7bb045b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:39.322132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18021692-6543-4925-a58e-815ff7bb045b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:39.335193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18021692-6543-4925-a58e-815ff7bb045b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:39.455244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-18021692-6543-4925-a58e-815ff7bb045b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:07:39.645479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:07:39.713457 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-18021692-6543-4925-a58e-815ff7bb045b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "DELETE /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 204 len: 0 microversion: 2.1 time: 0.431155 Aug 18 12:07:39.714064 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3047/5701] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:07:39 2022] DELETE /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:07:39.750374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ce3a78e-8c9a-4a0e-8a09-73436d0ce611 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:39.756792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6ce3a78e-8c9a-4a0e-8a09-73436d0ce611 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:39.786999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ce3a78e-8c9a-4a0e-8a09-73436d0ce611 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:39.787590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ce3a78e-8c9a-4a0e-8a09-73436d0ce611 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:39.788049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ce3a78e-8c9a-4a0e-8a09-73436d0ce611 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:39.788817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ce3a78e-8c9a-4a0e-8a09-73436d0ce611 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:39.789286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ce3a78e-8c9a-4a0e-8a09-73436d0ce611 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:39.789718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ce3a78e-8c9a-4a0e-8a09-73436d0ce611 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:40.143030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:07:40.152072 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6ce3a78e-8c9a-4a0e-8a09-73436d0ce611 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1656 microversion: 2.1 time: 0.430528 Aug 18 12:07:40.162536 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3048/5702] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:39 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1656 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:40.186842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f3118624-0494-44c4-9726-ed9325be06cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:40.187710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f3118624-0494-44c4-9726-ed9325be06cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:40.204505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3118624-0494-44c4-9726-ed9325be06cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:40.205039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3118624-0494-44c4-9726-ed9325be06cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:40.205536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3118624-0494-44c4-9726-ed9325be06cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:40.207746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3118624-0494-44c4-9726-ed9325be06cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:40.208434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3118624-0494-44c4-9726-ed9325be06cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:40.208884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3118624-0494-44c4-9726-ed9325be06cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:40.500421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f3118624-0494-44c4-9726-ed9325be06cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:40.517073 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f3118624-0494-44c4-9726-ed9325be06cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1563 microversion: 2.1 time: 0.334896 Aug 18 12:07:40.518053 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3049/5703] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:40 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1563 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:40.561909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dae99b44-c64b-43ab-9c30-046f05868b88 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:40.565888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dae99b44-c64b-43ab-9c30-046f05868b88 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:40.579638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dae99b44-c64b-43ab-9c30-046f05868b88 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:40.580599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dae99b44-c64b-43ab-9c30-046f05868b88 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:40.581997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dae99b44-c64b-43ab-9c30-046f05868b88 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:40.584012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dae99b44-c64b-43ab-9c30-046f05868b88 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:40.585048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dae99b44-c64b-43ab-9c30-046f05868b88 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:40.585700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dae99b44-c64b-43ab-9c30-046f05868b88 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:40.801862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dae99b44-c64b-43ab-9c30-046f05868b88 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:40.812042 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dae99b44-c64b-43ab-9c30-046f05868b88 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1563 microversion: 2.1 time: 0.254492 Aug 18 12:07:40.813564 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3050/5704] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:40 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1563 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:41.178954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3e35b389-021b-4c98-a324-e39889d70d66 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:41.179611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3e35b389-021b-4c98-a324-e39889d70d66 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:41.188972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e35b389-021b-4c98-a324-e39889d70d66 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:41.189495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e35b389-021b-4c98-a324-e39889d70d66 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:41.189944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e35b389-021b-4c98-a324-e39889d70d66 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:41.193638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e35b389-021b-4c98-a324-e39889d70d66 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:41.194152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e35b389-021b-4c98-a324-e39889d70d66 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:41.194652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3e35b389-021b-4c98-a324-e39889d70d66 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:41.907159 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3e35b389-021b-4c98-a324-e39889d70d66 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1656 microversion: 2.1 time: 0.726315 Aug 18 12:07:41.912142 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3051/5705] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:41 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1656 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:42.670675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-fa26458e-0e9a-40f9-b6eb-9509f1a35087 req-c32979ef-e148-4f22-98b1-8d95d2d69de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1", "name": "network-vif-deleted", "tag": "39c580f6-e03d-449c-b0c3-61f56823ddda"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:07:42.760923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fa26458e-0e9a-40f9-b6eb-9509f1a35087 req-c32979ef-e148-4f22-98b1-8d95d2d69de6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:42.762721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fa26458e-0e9a-40f9-b6eb-9509f1a35087 req-c32979ef-e148-4f22-98b1-8d95d2d69de6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:42.765334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fa26458e-0e9a-40f9-b6eb-9509f1a35087 req-c32979ef-e148-4f22-98b1-8d95d2d69de6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:42.813247 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-fa26458e-0e9a-40f9-b6eb-9509f1a35087 req-c32979ef-e148-4f22-98b1-8d95d2d69de6 service nova] Creating event network-vif-deleted:39c580f6-e03d-449c-b0c3-61f56823ddda for instance ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 on n-h2-853611-3 Aug 18 12:07:42.832434 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-fa26458e-0e9a-40f9-b6eb-9509f1a35087 req-c32979ef-e148-4f22-98b1-8d95d2d69de6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169262 Aug 18 12:07:42.840324 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3052/5706] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:07:42.947485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3efe2f74-0533-457a-ad7c-08dea3b92ae9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:42.948473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3efe2f74-0533-457a-ad7c-08dea3b92ae9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:42.984224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3efe2f74-0533-457a-ad7c-08dea3b92ae9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:42.995288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3efe2f74-0533-457a-ad7c-08dea3b92ae9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:42.996348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3efe2f74-0533-457a-ad7c-08dea3b92ae9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:42.997871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3efe2f74-0533-457a-ad7c-08dea3b92ae9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:43.001187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3efe2f74-0533-457a-ad7c-08dea3b92ae9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:43.007943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3efe2f74-0533-457a-ad7c-08dea3b92ae9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:43.203662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3efe2f74-0533-457a-ad7c-08dea3b92ae9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:43.204568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3efe2f74-0533-457a-ad7c-08dea3b92ae9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:43.205400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3efe2f74-0533-457a-ad7c-08dea3b92ae9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:43.219605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-3efe2f74-0533-457a-ad7c-08dea3b92ae9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lazy-loading 'fault' on Instance uuid ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:07:43.536298 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3efe2f74-0533-457a-ad7c-08dea3b92ae9 tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 200 len: 1454 microversion: 2.1 time: 0.593140 Aug 18 12:07:43.540051 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3053/5707] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:42 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 1454 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:44.635849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec685915-3142-46f2-b80c-bea66f8aba2b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:44.638970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ec685915-3142-46f2-b80c-bea66f8aba2b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] [instance: ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:44.673175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec685915-3142-46f2-b80c-bea66f8aba2b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:44.679977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec685915-3142-46f2-b80c-bea66f8aba2b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:44.681082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec685915-3142-46f2-b80c-bea66f8aba2b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:44.682840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec685915-3142-46f2-b80c-bea66f8aba2b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:44.687145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec685915-3142-46f2-b80c-bea66f8aba2b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:44.688878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec685915-3142-46f2-b80c-bea66f8aba2b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:44.769728 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-ec685915-3142-46f2-b80c-bea66f8aba2b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] HTTP exception thrown: Instance ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 could not be found. Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec685915-3142-46f2-b80c-bea66f8aba2b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Request method failure captured: Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 HTTP/1.1 Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ish0ID4vEv_ISChnqeru0zWYln9a1v3652ObCWsitcRK0NEvfQgBQ_sKwPYCL-OYKZOnS8iUtaDihomSCwLrY5cvk_OwvNJ7jq3ok12MMKLGA8IHRiIdy5_xN9JhbRdoTRBVDzj-9Z_Ce0MVX7B97ok2Xv8cBgOjjUUl9kIu3hWtnY Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 60807e83fdba411580f23dee4c146fb2 Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestServerMultinode-1267560100 Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/60807e83fdba411580f23dee4c146fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/60807e83fdba411580f23dee4c146fb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_60807e83fdba411580f23dee4c146fb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/60807e83fdba411580f23dee4c146fb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestServerMultinode-1267560100 Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 60807e83fdba411580f23dee4c146fb2 Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestServerMultinode-1267560100 Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestServerMultinode-1267560100-project-admin Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 230e12facb4b4d5daa74197bfcc7778d Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestServerMultinode-1267560100-project-admin Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 could not be found. Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1'} Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 could not be found. Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 could not be found. Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:07:44.785201 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:44.793572 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:07:44.793572 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:07:44.793572 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:07:44.793572 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:07:44.793572 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:07:44.793572 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 could not be found. Aug 18 12:07:44.793572 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:07:44.798673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec685915-3142-46f2-b80c-bea66f8aba2b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] Returning 404 to user: Instance ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:07:44.798673 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ec685915-3142-46f2-b80c-bea66f8aba2b tempest-TestServerMultinode-1267560100 tempest-TestServerMultinode-1267560100-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1" status: 404 len: 111 microversion: 2.1 time: 0.176343 Aug 18 12:07:44.801046 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3054/5708] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:44 2022] GET /compute/v2.1/servers/ce7e3eed-a2d3-4f7f-81b1-88d0e5fb2cd1 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:07:47.592705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-959d5038-295e-4795-bdfc-de501c3978c2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "325db7a3-6233-4e87-bacb-1a2e689df403", "device": "/dev/sdb"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:07:47.596260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-959d5038-295e-4795-bdfc-de501c3978c2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:47.621126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-959d5038-295e-4795-bdfc-de501c3978c2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:47.621634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-959d5038-295e-4795-bdfc-de501c3978c2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:47.622086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-959d5038-295e-4795-bdfc-de501c3978c2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:47.631616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-959d5038-295e-4795-bdfc-de501c3978c2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:47.632215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-959d5038-295e-4795-bdfc-de501c3978c2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:47.632684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-959d5038-295e-4795-bdfc-de501c3978c2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:48.480100 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-959d5038-295e-4795-bdfc-de501c3978c2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "POST /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.891088 Aug 18 12:07:48.480943 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3055/5709] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 12:07:47 2022] POST /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d/os-volume_attachments => generated 194 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:07:48.748391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5ca984ca-ad39-4829-a64a-166f7f3b30ee tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:07:48.749334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5ca984ca-ad39-4829-a64a-166f7f3b30ee tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:07:48.796697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ca984ca-ad39-4829-a64a-166f7f3b30ee tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:48.797499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ca984ca-ad39-4829-a64a-166f7f3b30ee tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:48.798774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ca984ca-ad39-4829-a64a-166f7f3b30ee tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:48.805676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ca984ca-ad39-4829-a64a-166f7f3b30ee tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:48.811512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ca984ca-ad39-4829-a64a-166f7f3b30ee tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:48.818912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ca984ca-ad39-4829-a64a-166f7f3b30ee tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:50.135778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5ca984ca-ad39-4829-a64a-166f7f3b30ee tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:07:50.178046 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5ca984ca-ad39-4829-a64a-166f7f3b30ee tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1563 microversion: 2.1 time: 1.437761 Aug 18 12:07:50.181781 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3056/5710] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:07:48 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1563 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:07:51.013506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-95fcc503-3a30-46b9-b6e8-c2b2bd2b632b req-e90b8efc-8292-43fb-8f66-cf5b0ccbe431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8126a245-e16e-4613-94a9-2deae6bdf4c1", "tag": "90389b42-aa2a-4808-9c1f-654fd4b07cf9"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:07:51.062381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-95fcc503-3a30-46b9-b6e8-c2b2bd2b632b req-e90b8efc-8292-43fb-8f66-cf5b0ccbe431 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:07:51.063752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-95fcc503-3a30-46b9-b6e8-c2b2bd2b632b req-e90b8efc-8292-43fb-8f66-cf5b0ccbe431 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:07:51.064889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-95fcc503-3a30-46b9-b6e8-c2b2bd2b632b req-e90b8efc-8292-43fb-8f66-cf5b0ccbe431 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:07:51.103852 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-95fcc503-3a30-46b9-b6e8-c2b2bd2b632b req-e90b8efc-8292-43fb-8f66-cf5b0ccbe431 service nova] Creating event network-changed:90389b42-aa2a-4808-9c1f-654fd4b07cf9 for instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 on n-h1-853611-3 Aug 18 12:07:51.123644 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-95fcc503-3a30-46b9-b6e8-c2b2bd2b632b req-e90b8efc-8292-43fb-8f66-cf5b0ccbe431 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.939568 Aug 18 12:07:51.124810 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3057/5711] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:08:05.463135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-184c1842-22b8-476a-8d38-3204fef74820 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:08:05.468759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-184c1842-22b8-476a-8d38-3204fef74820 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:05.481607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:08:05.483626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:08:05.486880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-184c1842-22b8-476a-8d38-3204fef74820 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:05.488352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-184c1842-22b8-476a-8d38-3204fef74820 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:05.489419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-184c1842-22b8-476a-8d38-3204fef74820 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:05.491166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-184c1842-22b8-476a-8d38-3204fef74820 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:05.492272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-184c1842-22b8-476a-8d38-3204fef74820 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:05.493248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-184c1842-22b8-476a-8d38-3204fef74820 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:05.592438 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-184c1842-22b8-476a-8d38-3204fef74820 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1/action" status: 200 len: 24570 microversion: 2.1 time: 0.139233 Aug 18 12:08:05.607738 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3058/5712] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:08:05 2022] POST /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1/action => generated 24570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:08:12.037647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cff0d66c-8265-4d3f-b8eb-e140265988fc tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:12.039347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cff0d66c-8265-4d3f-b8eb-e140265988fc tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:12.053800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cff0d66c-8265-4d3f-b8eb-e140265988fc tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:12.060999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cff0d66c-8265-4d3f-b8eb-e140265988fc tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:12.061856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cff0d66c-8265-4d3f-b8eb-e140265988fc tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:12.063071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cff0d66c-8265-4d3f-b8eb-e140265988fc tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:12.063803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cff0d66c-8265-4d3f-b8eb-e140265988fc tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:12.064516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cff0d66c-8265-4d3f-b8eb-e140265988fc tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:12.717410 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cff0d66c-8265-4d3f-b8eb-e140265988fc tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1832 microversion: 2.1 time: 0.683609 Aug 18 12:08:12.719966 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3059/5713] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:12 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1832 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:08:12.807612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c48973ad-8097-4734-9910-7984d005e2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:12.809662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c48973ad-8097-4734-9910-7984d005e2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:12.829099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c48973ad-8097-4734-9910-7984d005e2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:12.829901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c48973ad-8097-4734-9910-7984d005e2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:12.831647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c48973ad-8097-4734-9910-7984d005e2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:12.834073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c48973ad-8097-4734-9910-7984d005e2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:12.834911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c48973ad-8097-4734-9910-7984d005e2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:12.836085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c48973ad-8097-4734-9910-7984d005e2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:13.473080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c48973ad-8097-4734-9910-7984d005e2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:13.492003 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c48973ad-8097-4734-9910-7984d005e2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1681 microversion: 2.1 time: 0.714106 Aug 18 12:08:13.492727 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3060/5714] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:12 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1681 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:13.749432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c410cc40-cadd-4ded-b47b-cb8494f2adb7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:08:13.755364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c410cc40-cadd-4ded-b47b-cb8494f2adb7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:13.762779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c410cc40-cadd-4ded-b47b-cb8494f2adb7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:13.763354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c410cc40-cadd-4ded-b47b-cb8494f2adb7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:13.763810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c410cc40-cadd-4ded-b47b-cb8494f2adb7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:13.764557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c410cc40-cadd-4ded-b47b-cb8494f2adb7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:13.765029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c410cc40-cadd-4ded-b47b-cb8494f2adb7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:13.765538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c410cc40-cadd-4ded-b47b-cb8494f2adb7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:13.883920 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c410cc40-cadd-4ded-b47b-cb8494f2adb7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1/action" status: 200 len: 32640 microversion: 2.1 time: 0.139631 Aug 18 12:08:13.890333 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3061/5715] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:08:13 2022] POST /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1/action => generated 32640 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:08:14.070723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ad5e478a-8d68-43ef-9e8c-10d7d2b784f6 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:08:14.071589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ad5e478a-8d68-43ef-9e8c-10d7d2b784f6 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:14.091518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad5e478a-8d68-43ef-9e8c-10d7d2b784f6 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:14.095325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad5e478a-8d68-43ef-9e8c-10d7d2b784f6 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:14.099498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad5e478a-8d68-43ef-9e8c-10d7d2b784f6 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:14.100768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad5e478a-8d68-43ef-9e8c-10d7d2b784f6 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:14.101600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad5e478a-8d68-43ef-9e8c-10d7d2b784f6 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:14.105774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad5e478a-8d68-43ef-9e8c-10d7d2b784f6 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:14.689547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ad5e478a-8d68-43ef-9e8c-10d7d2b784f6 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2c5f3e7c88f34b1880291a3ff8d97195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07c3f01a3f7469d9d805dce01904bc8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:14.690476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ad5e478a-8d68-43ef-9e8c-10d7d2b784f6 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] flavor_id is None. Assuming migration. {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 18 12:08:14.690889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ad5e478a-8d68-43ef-9e8c-10d7d2b784f6 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 12:08:15.931487 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ad5e478a-8d68-43ef-9e8c-10d7d2b784f6 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1/action" status: 202 len: 0 microversion: 2.1 time: 1.866681 Aug 18 12:08:15.935041 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3062/5716] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:08:14 2022] POST /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1/action => generated 0 bytes in 1872 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:08:15.975293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b1207d6-1486-4417-9cbf-d5f15b1737b5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:15.978970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9b1207d6-1486-4417-9cbf-d5f15b1737b5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:16.003274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b1207d6-1486-4417-9cbf-d5f15b1737b5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:16.007633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b1207d6-1486-4417-9cbf-d5f15b1737b5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:16.008724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b1207d6-1486-4417-9cbf-d5f15b1737b5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:16.013434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b1207d6-1486-4417-9cbf-d5f15b1737b5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:16.016459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b1207d6-1486-4417-9cbf-d5f15b1737b5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:16.018283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b1207d6-1486-4417-9cbf-d5f15b1737b5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:16.636570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9b1207d6-1486-4417-9cbf-d5f15b1737b5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:16.656019 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b1207d6-1486-4417-9cbf-d5f15b1737b5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1690 microversion: 2.1 time: 0.714573 Aug 18 12:08:16.671979 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3063/5717] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:15 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1690 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:08:17.691355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-70873494-8e5f-4d4e-b94e-1f62895519ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:17.692769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-70873494-8e5f-4d4e-b94e-1f62895519ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:17.732767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70873494-8e5f-4d4e-b94e-1f62895519ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:17.740047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70873494-8e5f-4d4e-b94e-1f62895519ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:17.743694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70873494-8e5f-4d4e-b94e-1f62895519ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:17.748943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70873494-8e5f-4d4e-b94e-1f62895519ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:17.751844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70873494-8e5f-4d4e-b94e-1f62895519ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:17.752643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70873494-8e5f-4d4e-b94e-1f62895519ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:18.142496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-70873494-8e5f-4d4e-b94e-1f62895519ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:18.168429 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-70873494-8e5f-4d4e-b94e-1f62895519ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1690 microversion: 2.1 time: 0.490505 Aug 18 12:08:18.177192 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3064/5718] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:17 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1690 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:19.203970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b134c057-1d2d-4cd0-a601-cb260b664bbb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:19.205178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b134c057-1d2d-4cd0-a601-cb260b664bbb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:19.235143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b134c057-1d2d-4cd0-a601-cb260b664bbb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:19.236018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b134c057-1d2d-4cd0-a601-cb260b664bbb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:19.236591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b134c057-1d2d-4cd0-a601-cb260b664bbb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:19.238065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b134c057-1d2d-4cd0-a601-cb260b664bbb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:19.240208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b134c057-1d2d-4cd0-a601-cb260b664bbb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:19.242639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b134c057-1d2d-4cd0-a601-cb260b664bbb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:19.786258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b134c057-1d2d-4cd0-a601-cb260b664bbb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:19.843926 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b134c057-1d2d-4cd0-a601-cb260b664bbb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1690 microversion: 2.1 time: 0.646027 Aug 18 12:08:19.846935 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3065/5719] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:19 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1690 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:20.909942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1d085d73-2c56-4cd1-8735-dafea51ba249 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:20.919174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1d085d73-2c56-4cd1-8735-dafea51ba249 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:20.951549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d085d73-2c56-4cd1-8735-dafea51ba249 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:20.952287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d085d73-2c56-4cd1-8735-dafea51ba249 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:20.953268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d085d73-2c56-4cd1-8735-dafea51ba249 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:20.955004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d085d73-2c56-4cd1-8735-dafea51ba249 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:20.959572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d085d73-2c56-4cd1-8735-dafea51ba249 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:20.960582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d085d73-2c56-4cd1-8735-dafea51ba249 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:21.397025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1d085d73-2c56-4cd1-8735-dafea51ba249 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:21.413548 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1d085d73-2c56-4cd1-8735-dafea51ba249 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1690 microversion: 2.1 time: 0.524906 Aug 18 12:08:21.447908 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3066/5720] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:20 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1690 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:22.438399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2db3076f-2495-4b4f-961f-cfab852b452e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:22.439548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2db3076f-2495-4b4f-961f-cfab852b452e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:22.468248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2db3076f-2495-4b4f-961f-cfab852b452e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:22.470419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2db3076f-2495-4b4f-961f-cfab852b452e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:22.470918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2db3076f-2495-4b4f-961f-cfab852b452e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:22.478548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2db3076f-2495-4b4f-961f-cfab852b452e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:22.480723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2db3076f-2495-4b4f-961f-cfab852b452e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:22.481298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2db3076f-2495-4b4f-961f-cfab852b452e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:22.962580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2db3076f-2495-4b4f-961f-cfab852b452e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:22.992839 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2db3076f-2495-4b4f-961f-cfab852b452e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1690 microversion: 2.1 time: 0.559343 Aug 18 12:08:23.008522 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3067/5721] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:22 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1690 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:08:24.040834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-522acde4-e9c0-4ab0-9191-665cb2d4454d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:24.041962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-522acde4-e9c0-4ab0-9191-665cb2d4454d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:24.059930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-522acde4-e9c0-4ab0-9191-665cb2d4454d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:24.060535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-522acde4-e9c0-4ab0-9191-665cb2d4454d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:24.060994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-522acde4-e9c0-4ab0-9191-665cb2d4454d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:24.061758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-522acde4-e9c0-4ab0-9191-665cb2d4454d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:24.062226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-522acde4-e9c0-4ab0-9191-665cb2d4454d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:24.062695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-522acde4-e9c0-4ab0-9191-665cb2d4454d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:25.203886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-522acde4-e9c0-4ab0-9191-665cb2d4454d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:25.219984 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-522acde4-e9c0-4ab0-9191-665cb2d4454d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1695 microversion: 2.1 time: 1.183470 Aug 18 12:08:25.222342 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3068/5722] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:24 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1695 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:26.250390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-71ffdd79-2037-49ef-92a5-8e60e76c9661 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:26.252120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-71ffdd79-2037-49ef-92a5-8e60e76c9661 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:26.262147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71ffdd79-2037-49ef-92a5-8e60e76c9661 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:26.262675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71ffdd79-2037-49ef-92a5-8e60e76c9661 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:26.263321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71ffdd79-2037-49ef-92a5-8e60e76c9661 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:26.264215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71ffdd79-2037-49ef-92a5-8e60e76c9661 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:26.264851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71ffdd79-2037-49ef-92a5-8e60e76c9661 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:26.265594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71ffdd79-2037-49ef-92a5-8e60e76c9661 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:27.367537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-71ffdd79-2037-49ef-92a5-8e60e76c9661 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:27.382565 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-71ffdd79-2037-49ef-92a5-8e60e76c9661 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1695 microversion: 2.1 time: 1.139906 Aug 18 12:08:27.383466 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3069/5723] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:26 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1695 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:28.419968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8e640309-076c-4b2a-a0b6-63c58f8e99d7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:28.420942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8e640309-076c-4b2a-a0b6-63c58f8e99d7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:28.430317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e640309-076c-4b2a-a0b6-63c58f8e99d7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:28.430990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e640309-076c-4b2a-a0b6-63c58f8e99d7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:28.431647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e640309-076c-4b2a-a0b6-63c58f8e99d7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:28.432387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e640309-076c-4b2a-a0b6-63c58f8e99d7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:28.432833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e640309-076c-4b2a-a0b6-63c58f8e99d7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:28.433456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e640309-076c-4b2a-a0b6-63c58f8e99d7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:28.894020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8e640309-076c-4b2a-a0b6-63c58f8e99d7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:28.908971 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8e640309-076c-4b2a-a0b6-63c58f8e99d7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1695 microversion: 2.1 time: 0.493617 Aug 18 12:08:28.910187 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3070/5724] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:28 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1695 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:29.956125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b1c5096-9b8e-4170-8a39-d27ea772d90b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:29.963246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3b1c5096-9b8e-4170-8a39-d27ea772d90b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:30.000142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b1c5096-9b8e-4170-8a39-d27ea772d90b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:30.000142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b1c5096-9b8e-4170-8a39-d27ea772d90b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:30.003901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b1c5096-9b8e-4170-8a39-d27ea772d90b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:30.006466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b1c5096-9b8e-4170-8a39-d27ea772d90b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:30.007488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b1c5096-9b8e-4170-8a39-d27ea772d90b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:30.008230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b1c5096-9b8e-4170-8a39-d27ea772d90b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:30.572399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3b1c5096-9b8e-4170-8a39-d27ea772d90b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:30.610090 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3b1c5096-9b8e-4170-8a39-d27ea772d90b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1695 microversion: 2.1 time: 0.663759 Aug 18 12:08:30.618287 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3071/5725] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:29 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1695 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:31.662332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-330eeab7-725b-4bd5-bb9f-1da86f87cfb4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:31.663484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-330eeab7-725b-4bd5-bb9f-1da86f87cfb4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:31.717276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-330eeab7-725b-4bd5-bb9f-1da86f87cfb4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:31.718313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-330eeab7-725b-4bd5-bb9f-1da86f87cfb4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:31.719307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-330eeab7-725b-4bd5-bb9f-1da86f87cfb4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:31.724311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-330eeab7-725b-4bd5-bb9f-1da86f87cfb4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:31.725210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-330eeab7-725b-4bd5-bb9f-1da86f87cfb4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:31.725999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-330eeab7-725b-4bd5-bb9f-1da86f87cfb4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:32.820386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-330eeab7-725b-4bd5-bb9f-1da86f87cfb4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:32.839487 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-330eeab7-725b-4bd5-bb9f-1da86f87cfb4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1695 microversion: 2.1 time: 1.183459 Aug 18 12:08:32.840448 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3072/5726] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:31 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1695 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:33.868503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6e075a56-18c8-4ccb-a976-e6140ae3ec02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:33.869190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6e075a56-18c8-4ccb-a976-e6140ae3ec02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:33.886035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e075a56-18c8-4ccb-a976-e6140ae3ec02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:33.886594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e075a56-18c8-4ccb-a976-e6140ae3ec02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:33.887062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e075a56-18c8-4ccb-a976-e6140ae3ec02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:33.887848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e075a56-18c8-4ccb-a976-e6140ae3ec02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:33.888323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e075a56-18c8-4ccb-a976-e6140ae3ec02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:33.888761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6e075a56-18c8-4ccb-a976-e6140ae3ec02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:33.945691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:08:34.169905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6e075a56-18c8-4ccb-a976-e6140ae3ec02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:34.208031 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6e075a56-18c8-4ccb-a976-e6140ae3ec02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1695 microversion: 2.1 time: 0.344615 Aug 18 12:08:34.223917 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3073/5727] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:33 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1695 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:35.240969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e8cc8f9-6112-4533-aa9d-9f6b83b356da tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:35.246542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2e8cc8f9-6112-4533-aa9d-9f6b83b356da tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:35.278724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e8cc8f9-6112-4533-aa9d-9f6b83b356da tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:35.282297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e8cc8f9-6112-4533-aa9d-9f6b83b356da tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:35.287097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e8cc8f9-6112-4533-aa9d-9f6b83b356da tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:35.290881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e8cc8f9-6112-4533-aa9d-9f6b83b356da tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:35.292379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e8cc8f9-6112-4533-aa9d-9f6b83b356da tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:35.296440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e8cc8f9-6112-4533-aa9d-9f6b83b356da tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:35.703347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2e8cc8f9-6112-4533-aa9d-9f6b83b356da tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:35.738565 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2e8cc8f9-6112-4533-aa9d-9f6b83b356da tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1694 microversion: 2.1 time: 0.509347 Aug 18 12:08:35.743970 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3074/5728] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:35 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1694 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:08:36.764428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b906afef-18fd-4824-a000-bdf302ead7ed tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:36.765413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b906afef-18fd-4824-a000-bdf302ead7ed tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:36.768302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=37 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:08:36.787350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b906afef-18fd-4824-a000-bdf302ead7ed tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:36.789601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b906afef-18fd-4824-a000-bdf302ead7ed tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:36.790069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b906afef-18fd-4824-a000-bdf302ead7ed tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:36.797041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b906afef-18fd-4824-a000-bdf302ead7ed tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:36.797479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b906afef-18fd-4824-a000-bdf302ead7ed tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:36.798154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b906afef-18fd-4824-a000-bdf302ead7ed tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:37.033643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b906afef-18fd-4824-a000-bdf302ead7ed tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:37.053235 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b906afef-18fd-4824-a000-bdf302ead7ed tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1694 microversion: 2.1 time: 0.291608 Aug 18 12:08:37.062261 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3075/5729] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:36 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1694 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:08:37.281155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-e361c0b6-10bb-42f8-be6e-74b71121aec3 req-98a6f999-3a1d-4ee4-9b43-a8f1a30ec95e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8126a245-e16e-4613-94a9-2deae6bdf4c1", "name": "network-vif-unplugged", "status": "completed", "tag": "90389b42-aa2a-4808-9c1f-654fd4b07cf9"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:08:37.335513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e361c0b6-10bb-42f8-be6e-74b71121aec3 req-98a6f999-3a1d-4ee4-9b43-a8f1a30ec95e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:37.336475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e361c0b6-10bb-42f8-be6e-74b71121aec3 req-98a6f999-3a1d-4ee4-9b43-a8f1a30ec95e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:37.337263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e361c0b6-10bb-42f8-be6e-74b71121aec3 req-98a6f999-3a1d-4ee4-9b43-a8f1a30ec95e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:37.366051 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e361c0b6-10bb-42f8-be6e-74b71121aec3 req-98a6f999-3a1d-4ee4-9b43-a8f1a30ec95e service nova] Creating event network-vif-unplugged:90389b42-aa2a-4808-9c1f-654fd4b07cf9 for instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 on n-h2-853611-3 Aug 18 12:08:37.377897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-e361c0b6-10bb-42f8-be6e-74b71121aec3 req-98a6f999-3a1d-4ee4-9b43-a8f1a30ec95e service nova] Instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:08:37.425325 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-e361c0b6-10bb-42f8-be6e-74b71121aec3 req-98a6f999-3a1d-4ee4-9b43-a8f1a30ec95e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.179724 Aug 18 12:08:37.426636 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3076/5730] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:08:37.612620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8f0c8869-f165-4838-bfea-f61be0047f13 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:37.613701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8f0c8869-f165-4838-bfea-f61be0047f13 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:37.636649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f0c8869-f165-4838-bfea-f61be0047f13 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:37.637479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f0c8869-f165-4838-bfea-f61be0047f13 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:37.638239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f0c8869-f165-4838-bfea-f61be0047f13 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:37.639504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f0c8869-f165-4838-bfea-f61be0047f13 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:37.640306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f0c8869-f165-4838-bfea-f61be0047f13 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:37.640844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f0c8869-f165-4838-bfea-f61be0047f13 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:37.901258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-8f0c8869-f165-4838-bfea-f61be0047f13 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lazy-loading 'services' on Instance uuid 1c0ee229-69dc-4dd2-86ea-3afc2217462d {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:08:38.149137 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8f0c8869-f165-4838-bfea-f61be0047f13 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d/os-volume_attachments/325db7a3-6233-4e87-bacb-1a2e689df403" status: 202 len: 0 microversion: 2.1 time: 0.544252 Aug 18 12:08:38.163248 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3077/5731] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 12:08:37 2022] DELETE /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d/os-volume_attachments/325db7a3-6233-4e87-bacb-1a2e689df403 => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:08:38.186793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8208aafe-c19b-4d96-80b6-e8c51f2b8bfd tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:38.197318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8208aafe-c19b-4d96-80b6-e8c51f2b8bfd tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:38.219242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8208aafe-c19b-4d96-80b6-e8c51f2b8bfd tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:38.220959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8208aafe-c19b-4d96-80b6-e8c51f2b8bfd tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:38.222122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8208aafe-c19b-4d96-80b6-e8c51f2b8bfd tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:38.224521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8208aafe-c19b-4d96-80b6-e8c51f2b8bfd tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:38.225954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8208aafe-c19b-4d96-80b6-e8c51f2b8bfd tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:38.226862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8208aafe-c19b-4d96-80b6-e8c51f2b8bfd tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:38.527048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8208aafe-c19b-4d96-80b6-e8c51f2b8bfd tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:38.548318 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8208aafe-c19b-4d96-80b6-e8c51f2b8bfd tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1694 microversion: 2.1 time: 0.382050 Aug 18 12:08:38.549374 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3078/5732] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:38 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1694 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:39.483077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-10ce7fea-ddcd-456f-bd56-efbbb54fe898 req-a15d97e3-de76-4298-9983-e09657cac97a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8126a245-e16e-4613-94a9-2deae6bdf4c1", "tag": "90389b42-aa2a-4808-9c1f-654fd4b07cf9"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:08:39.544709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-10ce7fea-ddcd-456f-bd56-efbbb54fe898 req-a15d97e3-de76-4298-9983-e09657cac97a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:39.545535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-10ce7fea-ddcd-456f-bd56-efbbb54fe898 req-a15d97e3-de76-4298-9983-e09657cac97a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:39.548866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-10ce7fea-ddcd-456f-bd56-efbbb54fe898 req-a15d97e3-de76-4298-9983-e09657cac97a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:39.601292 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-10ce7fea-ddcd-456f-bd56-efbbb54fe898 req-a15d97e3-de76-4298-9983-e09657cac97a service nova] Creating event network-changed:90389b42-aa2a-4808-9c1f-654fd4b07cf9 for instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 on n-h2-853611-3 Aug 18 12:08:39.615654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-10ce7fea-ddcd-456f-bd56-efbbb54fe898 req-a15d97e3-de76-4298-9983-e09657cac97a service nova] Instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:08:39.658646 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-10ce7fea-ddcd-456f-bd56-efbbb54fe898 req-a15d97e3-de76-4298-9983-e09657cac97a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199498 Aug 18 12:08:39.662598 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3079/5733] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:08:39.676540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fdf54009-d5bb-40d1-9641-998f036c4676 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:39.679912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fdf54009-d5bb-40d1-9641-998f036c4676 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:39.693855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fdf54009-d5bb-40d1-9641-998f036c4676 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:39.695141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fdf54009-d5bb-40d1-9641-998f036c4676 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:39.696191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fdf54009-d5bb-40d1-9641-998f036c4676 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:39.697821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fdf54009-d5bb-40d1-9641-998f036c4676 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:39.699165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fdf54009-d5bb-40d1-9641-998f036c4676 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:39.700241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fdf54009-d5bb-40d1-9641-998f036c4676 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:39.944651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fdf54009-d5bb-40d1-9641-998f036c4676 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:39.953470 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fdf54009-d5bb-40d1-9641-998f036c4676 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1692 microversion: 2.1 time: 0.288078 Aug 18 12:08:39.955956 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3080/5734] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:39 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1692 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:40.995636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e824861-378f-4376-a667-aee5d3015d8a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:40.996361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7e824861-378f-4376-a667-aee5d3015d8a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:41.015078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e824861-378f-4376-a667-aee5d3015d8a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:41.016066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e824861-378f-4376-a667-aee5d3015d8a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:41.016706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e824861-378f-4376-a667-aee5d3015d8a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:41.017608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e824861-378f-4376-a667-aee5d3015d8a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:41.018238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e824861-378f-4376-a667-aee5d3015d8a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:41.018930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e824861-378f-4376-a667-aee5d3015d8a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:41.830630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7e824861-378f-4376-a667-aee5d3015d8a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:41.859870 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e824861-378f-4376-a667-aee5d3015d8a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1692 microversion: 2.1 time: 0.869752 Aug 18 12:08:41.860989 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3081/5735] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:40 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1692 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:08:42.903185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e891433-82da-4110-b2ce-e6b199c098ec tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:42.913069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2e891433-82da-4110-b2ce-e6b199c098ec tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:42.931709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e891433-82da-4110-b2ce-e6b199c098ec tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:42.938856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e891433-82da-4110-b2ce-e6b199c098ec tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:42.942466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e891433-82da-4110-b2ce-e6b199c098ec tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:42.947701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e891433-82da-4110-b2ce-e6b199c098ec tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:42.949264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e891433-82da-4110-b2ce-e6b199c098ec tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:42.950289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e891433-82da-4110-b2ce-e6b199c098ec tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:43.321041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2e891433-82da-4110-b2ce-e6b199c098ec tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:43.334120 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2e891433-82da-4110-b2ce-e6b199c098ec tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1689 microversion: 2.1 time: 0.437300 Aug 18 12:08:43.347875 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3082/5736] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:42 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1689 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:08:43.369755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-77a652af-05c6-47d0-9216-0dde6e39b0cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:08:43.372227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-77a652af-05c6-47d0-9216-0dde6e39b0cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:43.389316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77a652af-05c6-47d0-9216-0dde6e39b0cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:43.391863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77a652af-05c6-47d0-9216-0dde6e39b0cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:43.392539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77a652af-05c6-47d0-9216-0dde6e39b0cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:43.394102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77a652af-05c6-47d0-9216-0dde6e39b0cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:43.395991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77a652af-05c6-47d0-9216-0dde6e39b0cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:43.398315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77a652af-05c6-47d0-9216-0dde6e39b0cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:43.527056 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-77a652af-05c6-47d0-9216-0dde6e39b0cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1/action" status: 204 len: 0 microversion: 2.1 time: 0.170542 Aug 18 12:08:43.535906 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3083/5737] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:08:43 2022] POST /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1/action => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:08:43.554906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3be244d8-e9ca-4396-8e4e-d1ac2b0aa99b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:43.559313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3be244d8-e9ca-4396-8e4e-d1ac2b0aa99b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:43.581022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3be244d8-e9ca-4396-8e4e-d1ac2b0aa99b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:43.582130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3be244d8-e9ca-4396-8e4e-d1ac2b0aa99b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:43.583126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3be244d8-e9ca-4396-8e4e-d1ac2b0aa99b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:43.585933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3be244d8-e9ca-4396-8e4e-d1ac2b0aa99b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:43.590179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3be244d8-e9ca-4396-8e4e-d1ac2b0aa99b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:43.591302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3be244d8-e9ca-4396-8e4e-d1ac2b0aa99b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:43.964802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3be244d8-e9ca-4396-8e4e-d1ac2b0aa99b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:43.982202 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3be244d8-e9ca-4396-8e4e-d1ac2b0aa99b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1689 microversion: 2.1 time: 0.442496 Aug 18 12:08:43.998560 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3084/5738] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:43 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1689 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:45.016861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4bc65835-6955-470c-9516-593d5e0b8c58 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:45.018751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4bc65835-6955-470c-9516-593d5e0b8c58 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:45.029294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc65835-6955-470c-9516-593d5e0b8c58 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:45.030094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc65835-6955-470c-9516-593d5e0b8c58 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:45.030971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc65835-6955-470c-9516-593d5e0b8c58 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:45.032681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc65835-6955-470c-9516-593d5e0b8c58 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:45.033896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc65835-6955-470c-9516-593d5e0b8c58 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:45.035234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bc65835-6955-470c-9516-593d5e0b8c58 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:45.358781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4bc65835-6955-470c-9516-593d5e0b8c58 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:45.372865 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4bc65835-6955-470c-9516-593d5e0b8c58 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1689 microversion: 2.1 time: 0.363570 Aug 18 12:08:45.374587 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3085/5739] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:45 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1689 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:08:46.411203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-56111c35-8d7f-4db4-a26f-e7b3d36659d6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:46.412827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-56111c35-8d7f-4db4-a26f-e7b3d36659d6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:46.452248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56111c35-8d7f-4db4-a26f-e7b3d36659d6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:46.453148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56111c35-8d7f-4db4-a26f-e7b3d36659d6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:46.453959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56111c35-8d7f-4db4-a26f-e7b3d36659d6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:46.455345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56111c35-8d7f-4db4-a26f-e7b3d36659d6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:46.456196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56111c35-8d7f-4db4-a26f-e7b3d36659d6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:46.457027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56111c35-8d7f-4db4-a26f-e7b3d36659d6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:46.707681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-56111c35-8d7f-4db4-a26f-e7b3d36659d6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:46.725877 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-56111c35-8d7f-4db4-a26f-e7b3d36659d6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1689 microversion: 2.1 time: 0.321652 Aug 18 12:08:46.727048 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3086/5740] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:46 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1689 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:46.738297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e04b410-dfe2-497b-a587-fef14dc8e90a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:46.740334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2e04b410-dfe2-497b-a587-fef14dc8e90a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:46.753766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e04b410-dfe2-497b-a587-fef14dc8e90a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:46.756005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e04b410-dfe2-497b-a587-fef14dc8e90a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:46.757221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e04b410-dfe2-497b-a587-fef14dc8e90a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:46.759284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e04b410-dfe2-497b-a587-fef14dc8e90a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:46.760459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e04b410-dfe2-497b-a587-fef14dc8e90a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:46.761704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e04b410-dfe2-497b-a587-fef14dc8e90a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:46.878001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2e04b410-dfe2-497b-a587-fef14dc8e90a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:08:47.004593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:08:47.158492 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2e04b410-dfe2-497b-a587-fef14dc8e90a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "DELETE /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d" status: 204 len: 0 microversion: 2.1 time: 0.427916 Aug 18 12:08:47.160415 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3087/5741] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:08:46 2022] DELETE /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:08:47.182832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ad08fb05-a9d8-4c67-84a5-a6e80ac0b3a9 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:47.187151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ad08fb05-a9d8-4c67-84a5-a6e80ac0b3a9 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:47.216513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad08fb05-a9d8-4c67-84a5-a6e80ac0b3a9 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:47.219041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad08fb05-a9d8-4c67-84a5-a6e80ac0b3a9 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:47.221824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad08fb05-a9d8-4c67-84a5-a6e80ac0b3a9 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:47.226668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad08fb05-a9d8-4c67-84a5-a6e80ac0b3a9 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:47.228156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad08fb05-a9d8-4c67-84a5-a6e80ac0b3a9 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:47.231837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad08fb05-a9d8-4c67-84a5-a6e80ac0b3a9 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:47.689650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ad08fb05-a9d8-4c67-84a5-a6e80ac0b3a9 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:47.723287 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ad08fb05-a9d8-4c67-84a5-a6e80ac0b3a9 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d" status: 200 len: 1512 microversion: 2.1 time: 0.552927 Aug 18 12:08:47.725460 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3088/5742] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:47 2022] GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d => generated 1512 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:47.787142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59f1cc92-2c84-405c-af30-0c4da71af8fc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:47.789684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59f1cc92-2c84-405c-af30-0c4da71af8fc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:47.805378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59f1cc92-2c84-405c-af30-0c4da71af8fc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:47.806815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59f1cc92-2c84-405c-af30-0c4da71af8fc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:47.807069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59f1cc92-2c84-405c-af30-0c4da71af8fc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:47.808570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59f1cc92-2c84-405c-af30-0c4da71af8fc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:47.809265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59f1cc92-2c84-405c-af30-0c4da71af8fc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:47.810041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59f1cc92-2c84-405c-af30-0c4da71af8fc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:48.131002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-59f1cc92-2c84-405c-af30-0c4da71af8fc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:48.143948 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59f1cc92-2c84-405c-af30-0c4da71af8fc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1681 microversion: 2.1 time: 0.366120 Aug 18 12:08:48.144913 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3089/5743] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:47 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1681 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:48.419477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-bea1f0e2-5a59-4bb9-b927-b06a24a9ee6c req-1cefb5c6-1a96-461d-9bca-f7f67970564b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8126a245-e16e-4613-94a9-2deae6bdf4c1", "name": "network-vif-plugged", "status": "completed", "tag": "90389b42-aa2a-4808-9c1f-654fd4b07cf9"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:08:48.433058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bea1f0e2-5a59-4bb9-b927-b06a24a9ee6c req-1cefb5c6-1a96-461d-9bca-f7f67970564b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:48.434041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bea1f0e2-5a59-4bb9-b927-b06a24a9ee6c req-1cefb5c6-1a96-461d-9bca-f7f67970564b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:48.434974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bea1f0e2-5a59-4bb9-b927-b06a24a9ee6c req-1cefb5c6-1a96-461d-9bca-f7f67970564b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:48.479372 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-bea1f0e2-5a59-4bb9-b927-b06a24a9ee6c req-1cefb5c6-1a96-461d-9bca-f7f67970564b service nova] Creating event network-vif-plugged:90389b42-aa2a-4808-9c1f-654fd4b07cf9 for instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 on n-h2-853611-3 Aug 18 12:08:48.496757 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-bea1f0e2-5a59-4bb9-b927-b06a24a9ee6c req-1cefb5c6-1a96-461d-9bca-f7f67970564b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081865 Aug 18 12:08:48.501391 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3090/5744] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:08:48.795591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a360c1b1-87b4-46a4-8870-f60c7683fe4c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:48.801032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a360c1b1-87b4-46a4-8870-f60c7683fe4c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:48.829759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a360c1b1-87b4-46a4-8870-f60c7683fe4c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:48.830726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a360c1b1-87b4-46a4-8870-f60c7683fe4c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:48.831544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a360c1b1-87b4-46a4-8870-f60c7683fe4c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:48.835460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a360c1b1-87b4-46a4-8870-f60c7683fe4c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:48.836524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a360c1b1-87b4-46a4-8870-f60c7683fe4c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:48.837555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a360c1b1-87b4-46a4-8870-f60c7683fe4c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:49.390056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a360c1b1-87b4-46a4-8870-f60c7683fe4c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:08:49.409137 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a360c1b1-87b4-46a4-8870-f60c7683fe4c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d" status: 200 len: 1512 microversion: 2.1 time: 0.646730 Aug 18 12:08:49.433225 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3091/5745] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:48 2022] GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d => generated 1512 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:08:49.656947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2e9b6260-e73d-4e3c-9a1f-189724977c05 req-c4fec3c0-5292-4c9d-9b0f-d538b60cefa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c0ee229-69dc-4dd2-86ea-3afc2217462d", "name": "network-vif-deleted", "tag": "75bee35a-30c9-4268-bad0-3b8abd4660e4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:08:49.673008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2e9b6260-e73d-4e3c-9a1f-189724977c05 req-c4fec3c0-5292-4c9d-9b0f-d538b60cefa5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:49.673417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2e9b6260-e73d-4e3c-9a1f-189724977c05 req-c4fec3c0-5292-4c9d-9b0f-d538b60cefa5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:49.674162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2e9b6260-e73d-4e3c-9a1f-189724977c05 req-c4fec3c0-5292-4c9d-9b0f-d538b60cefa5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:49.732730 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2e9b6260-e73d-4e3c-9a1f-189724977c05 req-c4fec3c0-5292-4c9d-9b0f-d538b60cefa5 service nova] Creating event network-vif-deleted:75bee35a-30c9-4268-bad0-3b8abd4660e4 for instance 1c0ee229-69dc-4dd2-86ea-3afc2217462d on n-h1-853611-3 Aug 18 12:08:49.743239 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2e9b6260-e73d-4e3c-9a1f-189724977c05 req-c4fec3c0-5292-4c9d-9b0f-d538b60cefa5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090048 Aug 18 12:08:49.743881 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3092/5746] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:08:50.455082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-107ef537-224c-44c1-94f3-ab158be7ed0c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:08:50.456318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-107ef537-224c-44c1-94f3-ab158be7ed0c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: 1c0ee229-69dc-4dd2-86ea-3afc2217462d] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:08:50.479495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107ef537-224c-44c1-94f3-ab158be7ed0c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:50.480396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107ef537-224c-44c1-94f3-ab158be7ed0c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:50.481157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107ef537-224c-44c1-94f3-ab158be7ed0c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:50.482468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107ef537-224c-44c1-94f3-ab158be7ed0c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:08:50.491379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107ef537-224c-44c1-94f3-ab158be7ed0c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:08:50.491694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107ef537-224c-44c1-94f3-ab158be7ed0c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:08:50.548309 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-107ef537-224c-44c1-94f3-ab158be7ed0c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] HTTP exception thrown: Instance 1c0ee229-69dc-4dd2-86ea-3afc2217462d could not be found. Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-107ef537-224c-44c1-94f3-ab158be7ed0c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Request method failure captured: Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d HTTP/1.1 Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_irY4Sj_zy9xzjdmEYKangwIiZoa3ICGaCTcXaEREDh7gNdMYzmF8PQeCdyfuyWnPLf_6fUcBaSMAjVc3ILOtlbMnK2joloNgxCLxvyPm_MMqkHcgR3jjbg1Z2KtO1GPkBgTyGlbjd4u-c-_ClXbV_GibgNAvBJ0UeLRVN69ok4sq3I Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c77ee0ffd5604e92b816cd8d80e7009c Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-VolumesSnapshotTestJSON-580006872 Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c77ee0ffd5604e92b816cd8d80e7009c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c77ee0ffd5604e92b816cd8d80e7009c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c77ee0ffd5604e92b816cd8d80e7009c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c77ee0ffd5604e92b816cd8d80e7009c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-VolumesSnapshotTestJSON-580006872 Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c77ee0ffd5604e92b816cd8d80e7009c Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-580006872 Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-VolumesSnapshotTestJSON-580006872-project Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 761db01e19c24ed5913371de82f86fdc Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-VolumesSnapshotTestJSON-580006872-project Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 1c0ee229-69dc-4dd2-86ea-3afc2217462d could not be found. Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '1c0ee229-69dc-4dd2-86ea-3afc2217462d'} Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c0ee229-69dc-4dd2-86ea-3afc2217462d could not be found. Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c0ee229-69dc-4dd2-86ea-3afc2217462d could not be found. Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:08:50.554072 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:08:50.565044 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:08:50.565044 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:08:50.565044 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:08:50.565044 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:08:50.565044 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:08:50.565044 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c0ee229-69dc-4dd2-86ea-3afc2217462d could not be found. Aug 18 12:08:50.565044 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:08:50.565044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-107ef537-224c-44c1-94f3-ab158be7ed0c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Returning 404 to user: Instance 1c0ee229-69dc-4dd2-86ea-3afc2217462d could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:08:50.567197 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-107ef537-224c-44c1-94f3-ab158be7ed0c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d" status: 404 len: 111 microversion: 2.1 time: 0.116450 Aug 18 12:08:50.570381 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3093/5747] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:08:50 2022] GET /compute/v2.1/servers/1c0ee229-69dc-4dd2-86ea-3afc2217462d => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:09:01.630219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:09:01.633984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:09:01.894059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f2a9760-41a2-4eef-97a9-f1892915a44c tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-733274281", "availability_zone": "foo_zone"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:01.900642 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:09:01.900642 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:09:01.903261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.aggregate [None req-2f2a9760-41a2-4eef-97a9-f1892915a44c tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Generated uuid 6ff2036e-8ce1-40ed-b567-f0b5a377e374 for aggregate {{(pid=122210) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 18 12:09:02.026645 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f2a9760-41a2-4eef-97a9-f1892915a44c tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.408046 Aug 18 12:09:02.043951 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3094/5748] 10.222.0.73 () {60 vars in 1164 bytes} [Thu Aug 18 12:09:01 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:02.071837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b0c2f10-553d-4e81-94e6-5740504fb854 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:02.080079 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:09:02.080079 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:09:02.146077 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b0c2f10-553d-4e81-94e6-5740504fb854 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.092561 Aug 18 12:09:02.153898 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3095/5749] 10.222.0.73 () {60 vars in 1194 bytes} [Thu Aug 18 12:09:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:02.182410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b449c993-409c-4801-8a6a-08b7f5a6dae9 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:02.195305 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:09:02.195305 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:09:02.199428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b449c993-409c-4801-8a6a-08b7f5a6dae9 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:02.200045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b449c993-409c-4801-8a6a-08b7f5a6dae9 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:02.200514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b449c993-409c-4801-8a6a-08b7f5a6dae9 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:02.201348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b449c993-409c-4801-8a6a-08b7f5a6dae9 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:02.201820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b449c993-409c-4801-8a6a-08b7f5a6dae9 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:02.202611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b449c993-409c-4801-8a6a-08b7f5a6dae9 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:02.268647 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b449c993-409c-4801-8a6a-08b7f5a6dae9 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] 10.222.0.73 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.096109 Aug 18 12:09:02.292452 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3096/5750] 10.222.0.73 () {58 vars in 1176 bytes} [Thu Aug 18 12:09:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:02.298294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f69fdabb-18e7-4586-81f6-543a19e60d06 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:02.299192 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:09:02.299192 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:09:02.320754 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f69fdabb-18e7-4586-81f6-543a19e60d06 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] 10.222.0.73 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.026632 Aug 18 12:09:02.321635 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3097/5751] 10.222.0.73 () {58 vars in 1143 bytes} [Thu Aug 18 12:09:02 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:02.335589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-acd27c2c-f973-47d7-be9e-bc918a106372 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-853611-3"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:02.339053 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:09:02.339053 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:09:02.372701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-acd27c2c-f973-47d7-be9e-bc918a106372 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:02.379173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-acd27c2c-f973-47d7-be9e-bc918a106372 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:02.380061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-acd27c2c-f973-47d7-be9e-bc918a106372 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:02.914172 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-acd27c2c-f973-47d7-be9e-bc918a106372 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.583699 Aug 18 12:09:02.922479 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3098/5752] 10.222.0.73 () {60 vars in 1194 bytes} [Thu Aug 18 12:09:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:02.945298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-39dc710b-08e9-4435-8390-f9cf16808477 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:02.947231 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:09:02.947231 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:09:02.963982 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-39dc710b-08e9-4435-8390-f9cf16808477 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] 10.222.0.73 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.039692 Aug 18 12:09:02.965369 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3099/5753] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 12:09:02 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:02.993784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b9affad-2d8b-43a8-82e0-19b65b2422f0 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-810367312", "availability_zone": "foo_zone"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:03.178092 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:09:03.178092 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:09:03.295375 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1b9affad-2d8b-43a8-82e0-19b65b2422f0 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] 10.222.0.73 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.317070 Aug 18 12:09:03.296900 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3100/5754] 10.222.0.73 () {60 vars in 1173 bytes} [Thu Aug 18 12:09:02 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:03.306270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-880658963", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "52a220cf-667f-4744-9f0c-6edc45b19c78"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:03.456560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] validate_networks() for [('52a220cf-667f-4744-9f0c-6edc45b19c78', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:09:04.143773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:09:04.144804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:09:04.149035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:09:04.156292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:09:04.158944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:09:04.185632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:04.186096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:04.186589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:04.187549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:04.188098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:04.188531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:04.217973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Getting quotas for project c77ee0ffd5604e92b816cd8d80e7009c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:09:04.224865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Getting quotas for user 761db01e19c24ed5913371de82f86fdc and project c77ee0ffd5604e92b816cd8d80e7009c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:09:04.241479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:09:04.244253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:09:04.340405 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-62d01092-54e3-4480-99a8-c3b2d92f9168 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041815 Aug 18 12:09:04.353395 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3101/5755] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:09:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:09:04.364880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6cf3d8e7-8f77-47c6-8659-52902e88d3d5 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:04.372413 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:09:04.372413 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:09:04.442187 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6cf3d8e7-8f77-47c6-8659-52902e88d3d5 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.087062 Aug 18 12:09:04.448086 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3102/5756] 10.222.0.73 () {60 vars in 1194 bytes} [Thu Aug 18 12:09:04 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:04.475814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f7780ab8-0a00-4f17-a516-c0360d6e6e83 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:04.475814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f7780ab8-0a00-4f17-a516-c0360d6e6e83 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:04.648851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f7780ab8-0a00-4f17-a516-c0360d6e6e83 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:04.676045 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f7780ab8-0a00-4f17-a516-c0360d6e6e83 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 200 len: 1218 microversion: 2.1 time: 0.224488 Aug 18 12:09:04.677547 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3103/5757] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:04 2022] GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 1218 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:04.698235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eb98f8b4-2e57-4576-ac8d-ba32cdbdb9bc tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:04.699958 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:09:04.699958 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:09:04.729538 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eb98f8b4-2e57-4576-ac8d-ba32cdbdb9bc tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] 10.222.0.73 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.049896 Aug 18 12:09:04.741926 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3104/5758] 10.222.0.73 () {58 vars in 1152 bytes} [Thu Aug 18 12:09:04 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:04.767174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ee528c75-57b9-4748-b5fa-7d5c1aac5f43 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-853611-3"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:04.773861 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:09:04.773861 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:09:04.792316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee528c75-57b9-4748-b5fa-7d5c1aac5f43 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:04.793207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee528c75-57b9-4748-b5fa-7d5c1aac5f43 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:04.805495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee528c75-57b9-4748-b5fa-7d5c1aac5f43 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:04.971237 n-d-853611-3 devstack@n-api.service[122210]: WARNING nova.scheduler.client.report [None req-ee528c75-57b9-4748-b5fa-7d5c1aac5f43 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] [req-c9c910a3-5809-491c-b91a-8bbfbe208667] Failed to update aggregates to [] for resource provider with UUID 99698492-165b-4cdb-b187-2205df54903a. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Resource provider's generation already changed. Please update the generation and try again. ", "request_id": "req-c9c910a3-5809-491c-b91a-8bbfbe208667"}]} Aug 18 12:09:05.268205 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ee528c75-57b9-4748-b5fa-7d5c1aac5f43 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] 10.222.0.73 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.523830 Aug 18 12:09:05.269217 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3105/5759] 10.222.0.73 () {60 vars in 1194 bytes} [Thu Aug 18 12:09:04 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:05.294939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ef42942c-70cf-483e-bfd0-899a42dc6574 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:05.299446 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:09:05.299446 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:09:05.393797 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ef42942c-70cf-483e-bfd0-899a42dc6574 tempest-TestAggregatesBasicOps-154853489 tempest-TestAggregatesBasicOps-154853489-project-admin] 10.222.0.73 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.111137 Aug 18 12:09:05.415428 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3106/5760] 10.222.0.73 () {58 vars in 1155 bytes} [Thu Aug 18 12:09:05 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 18 12:09:05.702534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d478ff03-c64f-4141-9d88-595c826b2b0a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:05.703186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d478ff03-c64f-4141-9d88-595c826b2b0a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:05.738977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d478ff03-c64f-4141-9d88-595c826b2b0a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:05.740250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d478ff03-c64f-4141-9d88-595c826b2b0a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:05.741338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d478ff03-c64f-4141-9d88-595c826b2b0a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:05.744224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d478ff03-c64f-4141-9d88-595c826b2b0a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:05.751493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d478ff03-c64f-4141-9d88-595c826b2b0a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:05.752553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d478ff03-c64f-4141-9d88-595c826b2b0a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:05.909951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d478ff03-c64f-4141-9d88-595c826b2b0a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:05.921452 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d478ff03-c64f-4141-9d88-595c826b2b0a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 200 len: 1270 microversion: 2.1 time: 0.226654 Aug 18 12:09:05.936453 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3107/5761] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:05 2022] GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 1270 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:09:06.469220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-46018bff-b317-453a-a077-aa71fc7c8bd1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:06.473072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-46018bff-b317-453a-a077-aa71fc7c8bd1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:06.489100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46018bff-b317-453a-a077-aa71fc7c8bd1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:06.494693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46018bff-b317-453a-a077-aa71fc7c8bd1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:06.495453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46018bff-b317-453a-a077-aa71fc7c8bd1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:06.496210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46018bff-b317-453a-a077-aa71fc7c8bd1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:06.496876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46018bff-b317-453a-a077-aa71fc7c8bd1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:06.499747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46018bff-b317-453a-a077-aa71fc7c8bd1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:06.572421 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-46018bff-b317-453a-a077-aa71fc7c8bd1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1/action" status: 200 len: 24578 microversion: 2.1 time: 0.108626 Aug 18 12:09:06.581876 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3108/5762] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:09:06 2022] POST /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1/action => generated 24578 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:09:06.958311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f6b4b6e4-984c-4f70-9220-ad388d4e19eb tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:06.959806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f6b4b6e4-984c-4f70-9220-ad388d4e19eb tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:06.980604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6b4b6e4-984c-4f70-9220-ad388d4e19eb tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:06.982340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6b4b6e4-984c-4f70-9220-ad388d4e19eb tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:06.983931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6b4b6e4-984c-4f70-9220-ad388d4e19eb tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:06.985997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6b4b6e4-984c-4f70-9220-ad388d4e19eb tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:06.987970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6b4b6e4-984c-4f70-9220-ad388d4e19eb tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:06.989594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6b4b6e4-984c-4f70-9220-ad388d4e19eb tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:07.108409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f6b4b6e4-984c-4f70-9220-ad388d4e19eb tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:07.118087 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f6b4b6e4-984c-4f70-9220-ad388d4e19eb tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 200 len: 1276 microversion: 2.1 time: 0.173577 Aug 18 12:09:07.119139 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3109/5763] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:06 2022] GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:08.141864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-255078a8-2e59-4ad4-8c10-16e798c75535 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:08.145293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-255078a8-2e59-4ad4-8c10-16e798c75535 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:08.156028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-255078a8-2e59-4ad4-8c10-16e798c75535 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:08.156637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-255078a8-2e59-4ad4-8c10-16e798c75535 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:08.157157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-255078a8-2e59-4ad4-8c10-16e798c75535 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:08.158122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-255078a8-2e59-4ad4-8c10-16e798c75535 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:08.158839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-255078a8-2e59-4ad4-8c10-16e798c75535 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:08.159449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-255078a8-2e59-4ad4-8c10-16e798c75535 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:08.547430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-255078a8-2e59-4ad4-8c10-16e798c75535 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:08.561188 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-255078a8-2e59-4ad4-8c10-16e798c75535 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 200 len: 1318 microversion: 2.1 time: 0.424052 Aug 18 12:09:08.562508 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3110/5764] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:08 2022] GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:09:09.593145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-82aefb67-8709-4cb4-9f16-f966a50d8ea5 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:09.594740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-82aefb67-8709-4cb4-9f16-f966a50d8ea5 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:09.611367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82aefb67-8709-4cb4-9f16-f966a50d8ea5 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:09.614977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82aefb67-8709-4cb4-9f16-f966a50d8ea5 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:09.616551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82aefb67-8709-4cb4-9f16-f966a50d8ea5 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:09.621010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82aefb67-8709-4cb4-9f16-f966a50d8ea5 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:09.621476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82aefb67-8709-4cb4-9f16-f966a50d8ea5 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:09.624445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82aefb67-8709-4cb4-9f16-f966a50d8ea5 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:09.716345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:09:10.238410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-82aefb67-8709-4cb4-9f16-f966a50d8ea5 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:10.254051 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-82aefb67-8709-4cb4-9f16-f966a50d8ea5 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 200 len: 1318 microversion: 2.1 time: 0.663159 Aug 18 12:09:10.256918 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3111/5765] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:09 2022] GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 1318 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:10.265377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-14e85a89-9102-48c4-a4c0-7a8d4977b25c req-f22a3a76-000e-49e4-9256-e46b7cb92e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6b13101-ec75-454e-b101-376cfc9ec9b2", "tag": "a4c5a393-31bf-4342-b371-746f973563fe"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:10.281931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-14e85a89-9102-48c4-a4c0-7a8d4977b25c req-f22a3a76-000e-49e4-9256-e46b7cb92e9d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:10.283265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-14e85a89-9102-48c4-a4c0-7a8d4977b25c req-f22a3a76-000e-49e4-9256-e46b7cb92e9d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:10.284545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-14e85a89-9102-48c4-a4c0-7a8d4977b25c req-f22a3a76-000e-49e4-9256-e46b7cb92e9d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:10.310610 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-14e85a89-9102-48c4-a4c0-7a8d4977b25c req-f22a3a76-000e-49e4-9256-e46b7cb92e9d service nova] Creating event network-changed:a4c5a393-31bf-4342-b371-746f973563fe for instance e6b13101-ec75-454e-b101-376cfc9ec9b2 on n-h2-853611-3 Aug 18 12:09:10.318859 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-14e85a89-9102-48c4-a4c0-7a8d4977b25c req-f22a3a76-000e-49e4-9256-e46b7cb92e9d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059995 Aug 18 12:09:10.319754 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3112/5766] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:11.285770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c85e9249-2b46-4c67-9a99-2acfccd175b2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:11.289706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c85e9249-2b46-4c67-9a99-2acfccd175b2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:11.306756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c85e9249-2b46-4c67-9a99-2acfccd175b2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:11.307402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c85e9249-2b46-4c67-9a99-2acfccd175b2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:11.325465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c85e9249-2b46-4c67-9a99-2acfccd175b2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:11.326830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c85e9249-2b46-4c67-9a99-2acfccd175b2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:11.327431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c85e9249-2b46-4c67-9a99-2acfccd175b2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:11.327962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c85e9249-2b46-4c67-9a99-2acfccd175b2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:11.697299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c85e9249-2b46-4c67-9a99-2acfccd175b2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:11.722857 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c85e9249-2b46-4c67-9a99-2acfccd175b2 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 200 len: 1318 microversion: 2.1 time: 0.441677 Aug 18 12:09:11.724909 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3113/5767] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:11 2022] GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:12.761656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e5230a9-1258-4448-b6c4-ee67abe99146 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:12.762748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2e5230a9-1258-4448-b6c4-ee67abe99146 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:12.773152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e5230a9-1258-4448-b6c4-ee67abe99146 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:12.774758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e5230a9-1258-4448-b6c4-ee67abe99146 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:12.775386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e5230a9-1258-4448-b6c4-ee67abe99146 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:12.776256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e5230a9-1258-4448-b6c4-ee67abe99146 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:12.776839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e5230a9-1258-4448-b6c4-ee67abe99146 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:12.777401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e5230a9-1258-4448-b6c4-ee67abe99146 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:13.263598 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2e5230a9-1258-4448-b6c4-ee67abe99146 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1832 microversion: 2.1 time: 0.509446 Aug 18 12:09:13.264609 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3114/5768] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:12 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1832 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:09:13.271203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-88460c1f-2188-4f05-a7fe-a06a7aa63fb0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:13.271884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88460c1f-2188-4f05-a7fe-a06a7aa63fb0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:13.281057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88460c1f-2188-4f05-a7fe-a06a7aa63fb0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:13.281725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88460c1f-2188-4f05-a7fe-a06a7aa63fb0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:13.282183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88460c1f-2188-4f05-a7fe-a06a7aa63fb0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:13.284077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88460c1f-2188-4f05-a7fe-a06a7aa63fb0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:13.284557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88460c1f-2188-4f05-a7fe-a06a7aa63fb0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:13.285002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88460c1f-2188-4f05-a7fe-a06a7aa63fb0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:13.668648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-88460c1f-2188-4f05-a7fe-a06a7aa63fb0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:13.685622 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-88460c1f-2188-4f05-a7fe-a06a7aa63fb0 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 200 len: 1318 microversion: 2.1 time: 0.419416 Aug 18 12:09:13.688143 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3115/5769] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:13 2022] GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:14.724046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f070df3a-cdc9-40ce-a3b1-3e8f442e41d3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:14.726199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f070df3a-cdc9-40ce-a3b1-3e8f442e41d3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:14.733963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:09:14.734808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:09:14.736551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f070df3a-cdc9-40ce-a3b1-3e8f442e41d3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:14.737068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f070df3a-cdc9-40ce-a3b1-3e8f442e41d3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:14.737774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f070df3a-cdc9-40ce-a3b1-3e8f442e41d3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:14.739672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f070df3a-cdc9-40ce-a3b1-3e8f442e41d3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:14.740158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f070df3a-cdc9-40ce-a3b1-3e8f442e41d3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:14.742183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f070df3a-cdc9-40ce-a3b1-3e8f442e41d3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:15.589633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f070df3a-cdc9-40ce-a3b1-3e8f442e41d3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:15.598526 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f070df3a-cdc9-40ce-a3b1-3e8f442e41d3 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 200 len: 1318 microversion: 2.1 time: 0.880142 Aug 18 12:09:15.609647 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3116/5770] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:14 2022] GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 1318 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:09:15.629332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ef4d88d7-848d-420e-94c6-bf23c3dc54b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:15.629853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef4d88d7-848d-420e-94c6-bf23c3dc54b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:15.639745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef4d88d7-848d-420e-94c6-bf23c3dc54b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:15.651110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef4d88d7-848d-420e-94c6-bf23c3dc54b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:15.651874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef4d88d7-848d-420e-94c6-bf23c3dc54b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:15.652861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef4d88d7-848d-420e-94c6-bf23c3dc54b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:15.653533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef4d88d7-848d-420e-94c6-bf23c3dc54b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:15.654193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef4d88d7-848d-420e-94c6-bf23c3dc54b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:15.722888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef4d88d7-848d-420e-94c6-bf23c3dc54b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:09:15.951585 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ef4d88d7-848d-420e-94c6-bf23c3dc54b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 204 len: 0 microversion: 2.1 time: 0.340113 Aug 18 12:09:15.952510 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3117/5771] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:09:15 2022] DELETE /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:09:15.966073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c121f60b-e27a-43e4-a768-2877898cdc67 req-02712721-54e0-4a58-9447-fbdcfbb00b0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8126a245-e16e-4613-94a9-2deae6bdf4c1", "tag": "90389b42-aa2a-4808-9c1f-654fd4b07cf9"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:15.983053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c121f60b-e27a-43e4-a768-2877898cdc67 req-02712721-54e0-4a58-9447-fbdcfbb00b0e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:15.983745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c121f60b-e27a-43e4-a768-2877898cdc67 req-02712721-54e0-4a58-9447-fbdcfbb00b0e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:15.985135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c121f60b-e27a-43e4-a768-2877898cdc67 req-02712721-54e0-4a58-9447-fbdcfbb00b0e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:16.019083 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c121f60b-e27a-43e4-a768-2877898cdc67 req-02712721-54e0-4a58-9447-fbdcfbb00b0e service nova] Creating event network-changed:90389b42-aa2a-4808-9c1f-654fd4b07cf9 for instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 on n-h2-853611-3 Aug 18 12:09:16.033343 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c121f60b-e27a-43e4-a768-2877898cdc67 req-02712721-54e0-4a58-9447-fbdcfbb00b0e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074260 Aug 18 12:09:16.035630 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3118/5772] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:16.051289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eedd1db0-f912-4e60-922e-b131b5cf9a6c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:16.053042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eedd1db0-f912-4e60-922e-b131b5cf9a6c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:16.071438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eedd1db0-f912-4e60-922e-b131b5cf9a6c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:16.073782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eedd1db0-f912-4e60-922e-b131b5cf9a6c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:16.074606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eedd1db0-f912-4e60-922e-b131b5cf9a6c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:16.076177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eedd1db0-f912-4e60-922e-b131b5cf9a6c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:16.078195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eedd1db0-f912-4e60-922e-b131b5cf9a6c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:16.078195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eedd1db0-f912-4e60-922e-b131b5cf9a6c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:16.561331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-eedd1db0-f912-4e60-922e-b131b5cf9a6c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:16.572506 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eedd1db0-f912-4e60-922e-b131b5cf9a6c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1687 microversion: 2.1 time: 0.534194 Aug 18 12:09:16.578011 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3119/5773] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:16 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1687 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:16.648715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-10f9a132-b515-4cae-9ed6-a5859f21950b tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:16.650226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-10f9a132-b515-4cae-9ed6-a5859f21950b tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:16.661499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10f9a132-b515-4cae-9ed6-a5859f21950b tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:16.662297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10f9a132-b515-4cae-9ed6-a5859f21950b tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:16.664403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10f9a132-b515-4cae-9ed6-a5859f21950b tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:16.665769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10f9a132-b515-4cae-9ed6-a5859f21950b tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:16.666751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10f9a132-b515-4cae-9ed6-a5859f21950b tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:16.667525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10f9a132-b515-4cae-9ed6-a5859f21950b tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:16.929545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-10f9a132-b515-4cae-9ed6-a5859f21950b tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:16.953779 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-10f9a132-b515-4cae-9ed6-a5859f21950b tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 200 len: 1318 microversion: 2.1 time: 0.312869 Aug 18 12:09:16.971297 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3120/5774] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:16 2022] GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:09:17.238055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-009d1b42-8f88-4158-84e7-5c710bef9661 req-86746690-78c7-4751-9fab-6d09babf14f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b13101-ec75-454e-b101-376cfc9ec9b2", "name": "network-vif-plugged", "status": "completed", "tag": "a4c5a393-31bf-4342-b371-746f973563fe"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:17.258018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-009d1b42-8f88-4158-84e7-5c710bef9661 req-86746690-78c7-4751-9fab-6d09babf14f8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:17.260269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-009d1b42-8f88-4158-84e7-5c710bef9661 req-86746690-78c7-4751-9fab-6d09babf14f8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:17.262272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-009d1b42-8f88-4158-84e7-5c710bef9661 req-86746690-78c7-4751-9fab-6d09babf14f8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:17.280124 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-009d1b42-8f88-4158-84e7-5c710bef9661 req-86746690-78c7-4751-9fab-6d09babf14f8 service nova] Creating event network-vif-plugged:a4c5a393-31bf-4342-b371-746f973563fe for instance e6b13101-ec75-454e-b101-376cfc9ec9b2 on n-h2-853611-3 Aug 18 12:09:17.286605 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-009d1b42-8f88-4158-84e7-5c710bef9661 req-86746690-78c7-4751-9fab-6d09babf14f8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052098 Aug 18 12:09:17.288182 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3121/5775] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:17.595419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aa33c58a-c15b-45e4-b942-7cf599af6d57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:17.604683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aa33c58a-c15b-45e4-b942-7cf599af6d57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:17.610761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa33c58a-c15b-45e4-b942-7cf599af6d57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:17.611421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa33c58a-c15b-45e4-b942-7cf599af6d57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:17.612916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa33c58a-c15b-45e4-b942-7cf599af6d57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:17.612916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa33c58a-c15b-45e4-b942-7cf599af6d57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:17.613286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa33c58a-c15b-45e4-b942-7cf599af6d57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:17.613453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa33c58a-c15b-45e4-b942-7cf599af6d57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:17.624288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:09:17.819038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aa33c58a-c15b-45e4-b942-7cf599af6d57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:17.828654 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aa33c58a-c15b-45e4-b942-7cf599af6d57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1687 microversion: 2.1 time: 0.238358 Aug 18 12:09:17.844180 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3122/5776] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:17 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1687 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:09:17.980822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-41cf7775-b245-44f6-a5b2-ae4cf98e25e7 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:17.981866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-41cf7775-b245-44f6-a5b2-ae4cf98e25e7 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:17.995316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41cf7775-b245-44f6-a5b2-ae4cf98e25e7 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:17.995837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41cf7775-b245-44f6-a5b2-ae4cf98e25e7 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:17.999429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41cf7775-b245-44f6-a5b2-ae4cf98e25e7 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:18.003919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41cf7775-b245-44f6-a5b2-ae4cf98e25e7 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:18.004868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41cf7775-b245-44f6-a5b2-ae4cf98e25e7 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:18.009463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41cf7775-b245-44f6-a5b2-ae4cf98e25e7 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:18.346201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-41cf7775-b245-44f6-a5b2-ae4cf98e25e7 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:18.368316 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-41cf7775-b245-44f6-a5b2-ae4cf98e25e7 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 200 len: 1318 microversion: 2.1 time: 0.391595 Aug 18 12:09:18.370212 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3123/5777] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:17 2022] GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:09:18.855404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0f0ff90b-6efb-426d-af8a-a821869ed0e4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:18.860853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0f0ff90b-6efb-426d-af8a-a821869ed0e4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:18.877713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f0ff90b-6efb-426d-af8a-a821869ed0e4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:18.879805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f0ff90b-6efb-426d-af8a-a821869ed0e4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:18.880885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f0ff90b-6efb-426d-af8a-a821869ed0e4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:18.883249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f0ff90b-6efb-426d-af8a-a821869ed0e4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:18.884237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f0ff90b-6efb-426d-af8a-a821869ed0e4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:18.885386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f0ff90b-6efb-426d-af8a-a821869ed0e4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:19.080021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0f0ff90b-6efb-426d-af8a-a821869ed0e4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:19.091386 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0f0ff90b-6efb-426d-af8a-a821869ed0e4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 200 len: 1687 microversion: 2.1 time: 0.243666 Aug 18 12:09:19.092744 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3124/5778] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:18 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 1687 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:19.393366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b9804d0f-ce25-40ef-9a47-3e67f091023a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:19.394027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b9804d0f-ce25-40ef-9a47-3e67f091023a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:19.422503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9804d0f-ce25-40ef-9a47-3e67f091023a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:19.422503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9804d0f-ce25-40ef-9a47-3e67f091023a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:19.422503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9804d0f-ce25-40ef-9a47-3e67f091023a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:19.422503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9804d0f-ce25-40ef-9a47-3e67f091023a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:19.422503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9804d0f-ce25-40ef-9a47-3e67f091023a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:19.428128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9804d0f-ce25-40ef-9a47-3e67f091023a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:19.836723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b9804d0f-ce25-40ef-9a47-3e67f091023a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:19.853082 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b9804d0f-ce25-40ef-9a47-3e67f091023a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 200 len: 1506 microversion: 2.1 time: 0.466678 Aug 18 12:09:19.854189 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3125/5779] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:19 2022] GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:09:19.880863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec797a53-9719-4c6e-b5f5-f34d6fc1751d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9b846c4-792e-4c3a-8bbf-e8d36fb5a169", "device": "/dev/sdb"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:19.885562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ec797a53-9719-4c6e-b5f5-f34d6fc1751d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:19.902959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec797a53-9719-4c6e-b5f5-f34d6fc1751d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:19.904085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec797a53-9719-4c6e-b5f5-f34d6fc1751d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:19.904863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec797a53-9719-4c6e-b5f5-f34d6fc1751d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:19.906416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec797a53-9719-4c6e-b5f5-f34d6fc1751d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:19.907281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec797a53-9719-4c6e-b5f5-f34d6fc1751d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:19.908322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec797a53-9719-4c6e-b5f5-f34d6fc1751d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:20.419868 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ec797a53-9719-4c6e-b5f5-f34d6fc1751d tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "POST /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.546426 Aug 18 12:09:20.423053 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3126/5780] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 12:09:19 2022] POST /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:09:20.465569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-56dc70e6-a6b3-4c62-b1de-499a03c1d09e req-e66d24bd-30ed-4dc5-8ca6-4177d0de8452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8126a245-e16e-4613-94a9-2deae6bdf4c1", "name": "network-vif-deleted", "tag": "90389b42-aa2a-4808-9c1f-654fd4b07cf9"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:20.520525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-56dc70e6-a6b3-4c62-b1de-499a03c1d09e req-e66d24bd-30ed-4dc5-8ca6-4177d0de8452 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:20.522887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-56dc70e6-a6b3-4c62-b1de-499a03c1d09e req-e66d24bd-30ed-4dc5-8ca6-4177d0de8452 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:20.524482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-56dc70e6-a6b3-4c62-b1de-499a03c1d09e req-e66d24bd-30ed-4dc5-8ca6-4177d0de8452 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:20.563441 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-56dc70e6-a6b3-4c62-b1de-499a03c1d09e req-e66d24bd-30ed-4dc5-8ca6-4177d0de8452 service nova] Creating event network-vif-deleted:90389b42-aa2a-4808-9c1f-654fd4b07cf9 for instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 on n-h2-853611-3 Aug 18 12:09:20.589980 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-56dc70e6-a6b3-4c62-b1de-499a03c1d09e req-e66d24bd-30ed-4dc5-8ca6-4177d0de8452 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163870 Aug 18 12:09:20.594727 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3127/5781] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:20.609528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b03b1654-3996-43bb-a59f-7a82126414cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:20.610997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b03b1654-3996-43bb-a59f-7a82126414cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 8126a245-e16e-4613-94a9-2deae6bdf4c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:20.622808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b03b1654-3996-43bb-a59f-7a82126414cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:20.624007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b03b1654-3996-43bb-a59f-7a82126414cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:20.624867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b03b1654-3996-43bb-a59f-7a82126414cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:20.626328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b03b1654-3996-43bb-a59f-7a82126414cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:20.627203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b03b1654-3996-43bb-a59f-7a82126414cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:20.628139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b03b1654-3996-43bb-a59f-7a82126414cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:20.657591 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-b03b1654-3996-43bb-a59f-7a82126414cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] HTTP exception thrown: Instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 could not be found. Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b03b1654-3996-43bb-a59f-7a82126414cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Request method failure captured: Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 HTTP/1.1 Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_itpP3k2OQKDfTawi0kf9ygIVnfNVtKyQf6_y09raSLkqAu--Orcs7bv0PWg_M-JZcd1pI700Biy17mLWE4K6g_euM6YJIeHjhMvih1w9wsUGvonHEvYQGTA-0UcBLRhtzeS3Igm0aFaFMmv_Cl5gbWHiLNqehP12OxQYhEvTlr4F3c Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 75eb549fd4b44a4fb569dbfc1f507c3c Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-325550642 Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestNetworkAdvancedServerOps-325550642 Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 75eb549fd4b44a4fb569dbfc1f507c3c Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-325550642 Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestNetworkAdvancedServerOps-325550642-project Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 916631a932304b6c9cec7ef622e2069d Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestNetworkAdvancedServerOps-325550642-project Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 could not be found. Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '8126a245-e16e-4613-94a9-2deae6bdf4c1'} Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 could not be found. Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 could not be found. Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:09:20.661032 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:09:20.673963 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:09:20.673963 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:09:20.673963 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:09:20.673963 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:09:20.673963 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:09:20.673963 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:09:20.673963 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 could not be found. Aug 18 12:09:20.673963 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:09:20.673963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b03b1654-3996-43bb-a59f-7a82126414cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Returning 404 to user: Instance 8126a245-e16e-4613-94a9-2deae6bdf4c1 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:09:20.673963 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b03b1654-3996-43bb-a59f-7a82126414cf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1" status: 404 len: 111 microversion: 2.1 time: 0.069128 Aug 18 12:09:20.673963 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3128/5782] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:20 2022] GET /compute/v2.1/servers/8126a245-e16e-4613-94a9-2deae6bdf4c1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:09:28.200389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9f276dbc-a33f-4658-9b8b-b0aded83e14e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '.version_select at 0x7f519e94e310>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:28.282343 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9f276dbc-a33f-4658-9b8b-b0aded83e14e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1928947402" status: 202 len: 0 microversion: 2.1 time: 0.086205 Aug 18 12:09:28.283839 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3129/5783] 10.222.0.73 () {58 vars in 1284 bytes} [Thu Aug 18 12:09:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1928947402 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:09:28.349785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-675019a8-3836-4c09-be34-fd69f2003ef1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'create', calling method: .version_select at 0x7f519e9b35e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-771020213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNN3x5kuVIdJNj0CNb1c0Yh7o5eehKFmHksTXSoq3X1AoFB/BETJOcBatGYrEAc2MA2Mf06E+rg3wWPVHunKBeKKJwrvAC7tsGJBZGt7TPbb1Zo5O+QSum4bbHsHhOPg=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:28.390366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-675019a8-3836-4c09-be34-fd69f2003ef1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:09:28.401034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-675019a8-3836-4c09-be34-fd69f2003ef1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for user 916631a932304b6c9cec7ef622e2069d and project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:09:28.438589 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-675019a8-3836-4c09-be34-fd69f2003ef1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.095282 Aug 18 12:09:28.441467 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3130/5784] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:09:28 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:09:43.607247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:09:43.608332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:09:43.609286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:09:43.618693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-654772444", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "3dc19909-0b83-4c5b-ba2b-dd50f15b2a97"}], "key_name": "tempest-TestNetworkAdvancedServerOps-771020213", "security_groups": [{"name": "tempest-secgroup-smoke-970305422"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:44.113653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] validate_networks() for [('3dc19909-0b83-4c5b-ba2b-dd50f15b2a97', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:09:46.067590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:09:46.069747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:09:46.071554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:09:46.072576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:09:46.073571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:09:46.121118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:46.122724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:46.123934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:46.125689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:46.126917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:46.128385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:46.321590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:09:46.345636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for user 916631a932304b6c9cec7ef622e2069d and project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:09:46.392539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:09:46.398499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:09:46.516435 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0ff2008e-1c29-4a9b-95dd-ebe55a7147e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.911172 Aug 18 12:09:46.536062 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3131/5785] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:09:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 2932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:09:46.546828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-294408f9-d80d-4cb7-b62d-ca7956a0ad61 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Action: 'create', calling method: .version_select at 0x7f519e94edc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-892213693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsGpBkqpT50XMjXmAfzlTb+AV8lgse/JBh5rxYu3cqkW1qMbFfC6yeaK9kciBx43ngcKWpuUGVWGqaQomPARklGXv67x/Pntm/SNkrn6g2GAwSzeCFNbvGDysg0Dr1CKw=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:46.593760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-294408f9-d80d-4cb7-b62d-ca7956a0ad61 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Getting quotas for project 33e6a4cb7234446dae9a06b0a91810ad. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:09:46.618330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-294408f9-d80d-4cb7-b62d-ca7956a0ad61 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Getting quotas for user 84208046cadf456eb814d737b0bd516b and project 33e6a4cb7234446dae9a06b0a91810ad. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:09:46.775389 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-294408f9-d80d-4cb7-b62d-ca7956a0ad61 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.234799 Aug 18 12:09:46.777080 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3132/5786] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:09:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:46.847324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-78bd2417-d365-442b-b055-084641b94a18 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:46.852790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-78bd2417-d365-442b-b055-084641b94a18 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:47.058265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-78bd2417-d365-442b-b055-084641b94a18 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:47.088794 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-78bd2417-d365-442b-b055-084641b94a18 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1265 microversion: 2.1 time: 0.309692 Aug 18 12:09:47.093006 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3133/5787] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:46 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:48.151694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-27ac2542-c5ea-4b84-a419-e7e3b50402fe tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:48.152931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-27ac2542-c5ea-4b84-a419-e7e3b50402fe tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:48.232308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27ac2542-c5ea-4b84-a419-e7e3b50402fe tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:48.239562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27ac2542-c5ea-4b84-a419-e7e3b50402fe tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:48.240592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27ac2542-c5ea-4b84-a419-e7e3b50402fe tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:48.247452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27ac2542-c5ea-4b84-a419-e7e3b50402fe tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:48.261220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27ac2542-c5ea-4b84-a419-e7e3b50402fe tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:48.261220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27ac2542-c5ea-4b84-a419-e7e3b50402fe tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:48.454618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-27ac2542-c5ea-4b84-a419-e7e3b50402fe tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:48.482474 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-27ac2542-c5ea-4b84-a419-e7e3b50402fe tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1269 microversion: 2.1 time: 0.353185 Aug 18 12:09:48.504918 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3134/5788] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:48 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1269 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:49.528055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6bbf551a-1823-48ee-b616-c0886401ba4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:49.532587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6bbf551a-1823-48ee-b616-c0886401ba4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:49.591321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6bbf551a-1823-48ee-b616-c0886401ba4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:49.592231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6bbf551a-1823-48ee-b616-c0886401ba4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:49.595686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6bbf551a-1823-48ee-b616-c0886401ba4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:49.600218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6bbf551a-1823-48ee-b616-c0886401ba4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:49.607292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6bbf551a-1823-48ee-b616-c0886401ba4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:49.610452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6bbf551a-1823-48ee-b616-c0886401ba4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:49.778910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6bbf551a-1823-48ee-b616-c0886401ba4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:49.788615 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6bbf551a-1823-48ee-b616-c0886401ba4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1335 microversion: 2.1 time: 0.269731 Aug 18 12:09:49.790667 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3135/5789] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:49 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1335 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:50.597223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1852294705", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "71fb9776-3d36-43f1-805a-88193811db8b"}], "key_name": "tempest-TestNetworkBasicOps-892213693", "security_groups": [{"name": "tempest-secgroup-smoke-1944270154"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:50.865501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] validate_networks() for [('71fb9776-3d36-43f1-805a-88193811db8b', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:09:51.619383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:09:51.620573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:09:51.621080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:09:51.621501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:09:51.621923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:09:51.643954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:51.644473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:51.644919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:51.645706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:51.646174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:51.646677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:51.697201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Getting quotas for project 33e6a4cb7234446dae9a06b0a91810ad. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:09:51.709842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Getting quotas for user 84208046cadf456eb814d737b0bd516b and project 33e6a4cb7234446dae9a06b0a91810ad. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:09:51.749121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:09:51.756974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:09:51.874917 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0aa3b227-37d2-4df2-bed5-98ed9e7990e6 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.292862 Aug 18 12:09:51.876234 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3136/5790] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:09:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:09:51.888048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f2778a1b-a2e2-40d1-a2d5-a6805c9b87b7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:51.889763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f2778a1b-a2e2-40d1-a2d5-a6805c9b87b7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:51.904187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2778a1b-a2e2-40d1-a2d5-a6805c9b87b7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:51.904993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2778a1b-a2e2-40d1-a2d5-a6805c9b87b7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:51.905907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2778a1b-a2e2-40d1-a2d5-a6805c9b87b7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:51.906967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2778a1b-a2e2-40d1-a2d5-a6805c9b87b7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:51.907625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2778a1b-a2e2-40d1-a2d5-a6805c9b87b7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:51.908322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2778a1b-a2e2-40d1-a2d5-a6805c9b87b7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:52.311196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f2778a1b-a2e2-40d1-a2d5-a6805c9b87b7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:52.337408 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f2778a1b-a2e2-40d1-a2d5-a6805c9b87b7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1390 microversion: 2.1 time: 0.459728 Aug 18 12:09:52.338250 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3137/5791] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:51 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1390 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:52.343135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a3192a0-7bef-4f9b-b7d2-5dedae13ef17 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:52.343755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4a3192a0-7bef-4f9b-b7d2-5dedae13ef17 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:52.472678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4a3192a0-7bef-4f9b-b7d2-5dedae13ef17 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:52.488406 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4a3192a0-7bef-4f9b-b7d2-5dedae13ef17 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 200 len: 1248 microversion: 2.1 time: 0.148953 Aug 18 12:09:52.489359 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3138/5792] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:52 2022] GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 1248 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:53.376766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a51f0949-f90f-4f33-9f1d-7e23ac40fed4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:53.377733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a51f0949-f90f-4f33-9f1d-7e23ac40fed4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:53.386781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51f0949-f90f-4f33-9f1d-7e23ac40fed4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:53.387295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51f0949-f90f-4f33-9f1d-7e23ac40fed4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:53.387750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51f0949-f90f-4f33-9f1d-7e23ac40fed4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:53.388824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51f0949-f90f-4f33-9f1d-7e23ac40fed4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:53.389299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51f0949-f90f-4f33-9f1d-7e23ac40fed4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:53.389738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51f0949-f90f-4f33-9f1d-7e23ac40fed4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:53.783776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a51f0949-f90f-4f33-9f1d-7e23ac40fed4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:53.796971 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a51f0949-f90f-4f33-9f1d-7e23ac40fed4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1390 microversion: 2.1 time: 0.425584 Aug 18 12:09:53.798540 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3139/5793] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:53 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1390 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:53.804376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c2c73709-3f31-4deb-b237-a7e8eb51c581 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:53.806853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c2c73709-3f31-4deb-b237-a7e8eb51c581 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:53.830381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c73709-3f31-4deb-b237-a7e8eb51c581 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:53.831610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c73709-3f31-4deb-b237-a7e8eb51c581 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:53.832451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c73709-3f31-4deb-b237-a7e8eb51c581 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:53.837604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c73709-3f31-4deb-b237-a7e8eb51c581 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:53.842138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c73709-3f31-4deb-b237-a7e8eb51c581 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:53.848836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c73709-3f31-4deb-b237-a7e8eb51c581 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:53.981145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c2c73709-3f31-4deb-b237-a7e8eb51c581 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:54.012397 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c2c73709-3f31-4deb-b237-a7e8eb51c581 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 200 len: 1300 microversion: 2.1 time: 0.211609 Aug 18 12:09:54.026467 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3140/5794] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:53 2022] GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 1300 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:54.036304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-899940ac-2598-4404-b4b9-f2da01471672 req-9c7b953a-8da2-4688-8c30-b5806368d4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f1edc6-59e0-4f7c-96c7-7b369020eaf9", "tag": "f28d24fe-2bff-4919-b8aa-de06d7a2f574"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:54.060829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-899940ac-2598-4404-b4b9-f2da01471672 req-9c7b953a-8da2-4688-8c30-b5806368d4b4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:54.061934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-899940ac-2598-4404-b4b9-f2da01471672 req-9c7b953a-8da2-4688-8c30-b5806368d4b4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:54.063865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-899940ac-2598-4404-b4b9-f2da01471672 req-9c7b953a-8da2-4688-8c30-b5806368d4b4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:54.101501 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-899940ac-2598-4404-b4b9-f2da01471672 req-9c7b953a-8da2-4688-8c30-b5806368d4b4 service nova] Creating event network-changed:f28d24fe-2bff-4919-b8aa-de06d7a2f574 for instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 on n-h1-853611-3 Aug 18 12:09:54.114628 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-899940ac-2598-4404-b4b9-f2da01471672 req-9c7b953a-8da2-4688-8c30-b5806368d4b4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097739 Aug 18 12:09:54.122659 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3141/5795] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:54.849042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03503457-5614-47ed-b7bc-685c2ece1fa3 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:54.853020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-03503457-5614-47ed-b7bc-685c2ece1fa3 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:54.896547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03503457-5614-47ed-b7bc-685c2ece1fa3 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:54.898204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03503457-5614-47ed-b7bc-685c2ece1fa3 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:54.900416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03503457-5614-47ed-b7bc-685c2ece1fa3 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:54.901437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03503457-5614-47ed-b7bc-685c2ece1fa3 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:54.902867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03503457-5614-47ed-b7bc-685c2ece1fa3 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:54.904237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03503457-5614-47ed-b7bc-685c2ece1fa3 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:55.165833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-03503457-5614-47ed-b7bc-685c2ece1fa3 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:55.184320 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-03503457-5614-47ed-b7bc-685c2ece1fa3 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1390 microversion: 2.1 time: 0.340968 Aug 18 12:09:55.185694 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3142/5796] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:54 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1390 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:55.193204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b36aabec-8f24-4110-bb4e-bec409e68b24 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:55.193893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b36aabec-8f24-4110-bb4e-bec409e68b24 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:55.211961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b36aabec-8f24-4110-bb4e-bec409e68b24 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:55.212553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b36aabec-8f24-4110-bb4e-bec409e68b24 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:55.213516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b36aabec-8f24-4110-bb4e-bec409e68b24 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:55.214411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b36aabec-8f24-4110-bb4e-bec409e68b24 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:55.215098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b36aabec-8f24-4110-bb4e-bec409e68b24 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:55.215639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b36aabec-8f24-4110-bb4e-bec409e68b24 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:55.336827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b36aabec-8f24-4110-bb4e-bec409e68b24 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:55.348260 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b36aabec-8f24-4110-bb4e-bec409e68b24 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 200 len: 1306 microversion: 2.1 time: 0.161309 Aug 18 12:09:55.349657 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3143/5797] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:55 2022] GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 1306 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:56.219609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6db158b3-817e-48e3-8570-63fd6780bc3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:56.221172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6db158b3-817e-48e3-8570-63fd6780bc3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:56.238236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6db158b3-817e-48e3-8570-63fd6780bc3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:56.238772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6db158b3-817e-48e3-8570-63fd6780bc3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:56.239219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6db158b3-817e-48e3-8570-63fd6780bc3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:56.240180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6db158b3-817e-48e3-8570-63fd6780bc3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:56.241039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6db158b3-817e-48e3-8570-63fd6780bc3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:56.241914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6db158b3-817e-48e3-8570-63fd6780bc3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:56.651827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6db158b3-817e-48e3-8570-63fd6780bc3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:56.685357 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6db158b3-817e-48e3-8570-63fd6780bc3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1390 microversion: 2.1 time: 0.469214 Aug 18 12:09:56.702655 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3144/5798] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:56 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1390 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:09:56.708639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b4d9c8ff-3020-4b32-85bb-90e21e7279b5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:56.709539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b4d9c8ff-3020-4b32-85bb-90e21e7279b5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:56.718226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4d9c8ff-3020-4b32-85bb-90e21e7279b5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:56.718792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4d9c8ff-3020-4b32-85bb-90e21e7279b5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:56.719219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4d9c8ff-3020-4b32-85bb-90e21e7279b5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:56.719972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4d9c8ff-3020-4b32-85bb-90e21e7279b5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:56.720510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4d9c8ff-3020-4b32-85bb-90e21e7279b5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:56.721515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4d9c8ff-3020-4b32-85bb-90e21e7279b5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:56.989539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b4d9c8ff-3020-4b32-85bb-90e21e7279b5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:57.003955 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b4d9c8ff-3020-4b32-85bb-90e21e7279b5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 200 len: 1374 microversion: 2.1 time: 0.298859 Aug 18 12:09:57.004999 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3145/5799] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:56 2022] GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 1374 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:57.446296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-3547371f-247e-4477-8b39-adf4c3603587 req-68b7d0d7-f149-4b0e-9bbc-601a4aa8ac1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa4e457-042a-4cdc-8f86-3cc9e21ed12c", "tag": "968cd41e-1bbf-449a-a02d-dd422ccc7306"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:09:57.466840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3547371f-247e-4477-8b39-adf4c3603587 req-68b7d0d7-f149-4b0e-9bbc-601a4aa8ac1b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:57.467545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3547371f-247e-4477-8b39-adf4c3603587 req-68b7d0d7-f149-4b0e-9bbc-601a4aa8ac1b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:57.468372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3547371f-247e-4477-8b39-adf4c3603587 req-68b7d0d7-f149-4b0e-9bbc-601a4aa8ac1b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:57.492014 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-3547371f-247e-4477-8b39-adf4c3603587 req-68b7d0d7-f149-4b0e-9bbc-601a4aa8ac1b service nova] Creating event network-changed:968cd41e-1bbf-449a-a02d-dd422ccc7306 for instance 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c on n-h2-853611-3 Aug 18 12:09:57.501442 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-3547371f-247e-4477-8b39-adf4c3603587 req-68b7d0d7-f149-4b0e-9bbc-601a4aa8ac1b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063025 Aug 18 12:09:57.502708 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3146/5800] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:09:57.699017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bc83e242-a4e2-4330-9e51-00d683371a4a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:57.700477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bc83e242-a4e2-4330-9e51-00d683371a4a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:57.715108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc83e242-a4e2-4330-9e51-00d683371a4a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:57.716262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc83e242-a4e2-4330-9e51-00d683371a4a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:57.717314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc83e242-a4e2-4330-9e51-00d683371a4a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:57.719040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc83e242-a4e2-4330-9e51-00d683371a4a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:57.720112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc83e242-a4e2-4330-9e51-00d683371a4a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:57.721143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc83e242-a4e2-4330-9e51-00d683371a4a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:57.915990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-bc83e242-a4e2-4330-9e51-00d683371a4a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lazy-loading 'services' on Instance uuid e6b13101-ec75-454e-b101-376cfc9ec9b2 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:09:58.074586 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bc83e242-a4e2-4330-9e51-00d683371a4a tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2/os-volume_attachments/a9b846c4-792e-4c3a-8bbf-e8d36fb5a169" status: 202 len: 0 microversion: 2.1 time: 0.384974 Aug 18 12:09:58.076410 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3147/5801] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 12:09:57 2022] DELETE /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2/os-volume_attachments/a9b846c4-792e-4c3a-8bbf-e8d36fb5a169 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:09:58.108632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-934f0e36-eb45-43fe-a658-3780be5776c4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:58.117241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-934f0e36-eb45-43fe-a658-3780be5776c4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:58.145377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-934f0e36-eb45-43fe-a658-3780be5776c4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:58.147662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-934f0e36-eb45-43fe-a658-3780be5776c4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:58.148456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-934f0e36-eb45-43fe-a658-3780be5776c4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:58.154772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-934f0e36-eb45-43fe-a658-3780be5776c4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:58.155637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-934f0e36-eb45-43fe-a658-3780be5776c4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:58.156450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-934f0e36-eb45-43fe-a658-3780be5776c4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:58.409734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-934f0e36-eb45-43fe-a658-3780be5776c4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:58.423233 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-934f0e36-eb45-43fe-a658-3780be5776c4 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1390 microversion: 2.1 time: 0.343797 Aug 18 12:09:58.424193 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3148/5802] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:58 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1390 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:58.434887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cd21ed34-45d1-4d39-8e24-8656bcfae63d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:58.436213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cd21ed34-45d1-4d39-8e24-8656bcfae63d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:58.462659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd21ed34-45d1-4d39-8e24-8656bcfae63d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:58.462659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd21ed34-45d1-4d39-8e24-8656bcfae63d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:58.462659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd21ed34-45d1-4d39-8e24-8656bcfae63d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:58.464261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd21ed34-45d1-4d39-8e24-8656bcfae63d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:58.471041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd21ed34-45d1-4d39-8e24-8656bcfae63d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:58.474700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd21ed34-45d1-4d39-8e24-8656bcfae63d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:58.705970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cd21ed34-45d1-4d39-8e24-8656bcfae63d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:58.715810 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cd21ed34-45d1-4d39-8e24-8656bcfae63d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 200 len: 1374 microversion: 2.1 time: 0.289897 Aug 18 12:09:58.716420 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3149/5803] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:58 2022] GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 1374 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:09:58.728565 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:09:58.729477 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:09:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:09:59.475339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1481fe04-ef3d-4f1a-96cb-784dec4a0e4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:09:59.483161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1481fe04-ef3d-4f1a-96cb-784dec4a0e4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:09:59.499569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1481fe04-ef3d-4f1a-96cb-784dec4a0e4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:59.501214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1481fe04-ef3d-4f1a-96cb-784dec4a0e4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:59.503888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1481fe04-ef3d-4f1a-96cb-784dec4a0e4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:59.510009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1481fe04-ef3d-4f1a-96cb-784dec4a0e4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:09:59.517564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1481fe04-ef3d-4f1a-96cb-784dec4a0e4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:09:59.524720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1481fe04-ef3d-4f1a-96cb-784dec4a0e4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:09:59.970343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1481fe04-ef3d-4f1a-96cb-784dec4a0e4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:09:59.988208 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1481fe04-ef3d-4f1a-96cb-784dec4a0e4b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1390 microversion: 2.1 time: 0.527823 Aug 18 12:09:59.988833 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3150/5804] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:59 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1390 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:00.012095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8183f2ab-7487-4c8c-a730-922d4030d65c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:00.013056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8183f2ab-7487-4c8c-a730-922d4030d65c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:00.022115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8183f2ab-7487-4c8c-a730-922d4030d65c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:00.022897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8183f2ab-7487-4c8c-a730-922d4030d65c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:00.024252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8183f2ab-7487-4c8c-a730-922d4030d65c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:00.025450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8183f2ab-7487-4c8c-a730-922d4030d65c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:00.026117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8183f2ab-7487-4c8c-a730-922d4030d65c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:00.026881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8183f2ab-7487-4c8c-a730-922d4030d65c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:00.286247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8183f2ab-7487-4c8c-a730-922d4030d65c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:00.295464 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8183f2ab-7487-4c8c-a730-922d4030d65c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 200 len: 1374 microversion: 2.1 time: 0.289480 Aug 18 12:10:00.296367 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3151/5805] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:09:59 2022] GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 1374 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:00.302479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f1a5d8fe-49fd-49d6-9cbe-2220302f468d req-de07ae92-6a23-4533-9e63-156fc6e95bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f1edc6-59e0-4f7c-96c7-7b369020eaf9", "name": "network-vif-plugged", "status": "completed", "tag": "f28d24fe-2bff-4919-b8aa-de06d7a2f574"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:00.313915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f1a5d8fe-49fd-49d6-9cbe-2220302f468d req-de07ae92-6a23-4533-9e63-156fc6e95bd9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:00.314841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f1a5d8fe-49fd-49d6-9cbe-2220302f468d req-de07ae92-6a23-4533-9e63-156fc6e95bd9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:00.315549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f1a5d8fe-49fd-49d6-9cbe-2220302f468d req-de07ae92-6a23-4533-9e63-156fc6e95bd9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:00.330044 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f1a5d8fe-49fd-49d6-9cbe-2220302f468d req-de07ae92-6a23-4533-9e63-156fc6e95bd9 service nova] Creating event network-vif-plugged:f28d24fe-2bff-4919-b8aa-de06d7a2f574 for instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 on n-h1-853611-3 Aug 18 12:10:00.337088 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f1a5d8fe-49fd-49d6-9cbe-2220302f468d req-de07ae92-6a23-4533-9e63-156fc6e95bd9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038637 Aug 18 12:10:00.342578 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3152/5806] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:10:01.012557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-106aa2d1-c086-482c-8245-fd8a0182ed4c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:01.013600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-106aa2d1-c086-482c-8245-fd8a0182ed4c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:01.022415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-106aa2d1-c086-482c-8245-fd8a0182ed4c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:01.022944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-106aa2d1-c086-482c-8245-fd8a0182ed4c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:01.023393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-106aa2d1-c086-482c-8245-fd8a0182ed4c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:01.024753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-106aa2d1-c086-482c-8245-fd8a0182ed4c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:01.025245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-106aa2d1-c086-482c-8245-fd8a0182ed4c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:01.025674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-106aa2d1-c086-482c-8245-fd8a0182ed4c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:01.032495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:10:01.288384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-106aa2d1-c086-482c-8245-fd8a0182ed4c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:01.300128 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-106aa2d1-c086-482c-8245-fd8a0182ed4c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1390 microversion: 2.1 time: 0.293124 Aug 18 12:10:01.301271 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3153/5807] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:01 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1390 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:10:01.332626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a339c973-df93-46a2-8acd-ff534d760d3f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:01.333536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a339c973-df93-46a2-8acd-ff534d760d3f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:01.341610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a339c973-df93-46a2-8acd-ff534d760d3f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:01.342459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a339c973-df93-46a2-8acd-ff534d760d3f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:01.343081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a339c973-df93-46a2-8acd-ff534d760d3f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:01.344141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a339c973-df93-46a2-8acd-ff534d760d3f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:01.344825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a339c973-df93-46a2-8acd-ff534d760d3f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:01.345421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a339c973-df93-46a2-8acd-ff534d760d3f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:01.641178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a339c973-df93-46a2-8acd-ff534d760d3f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:01.661085 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a339c973-df93-46a2-8acd-ff534d760d3f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 200 len: 1374 microversion: 2.1 time: 0.332114 Aug 18 12:10:01.677054 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3154/5808] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:01 2022] GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 1374 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:10:02.346196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-74de0a00-d54e-430d-84dd-a60b427c427d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:02.346918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-74de0a00-d54e-430d-84dd-a60b427c427d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:02.348895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:10:02.359636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74de0a00-d54e-430d-84dd-a60b427c427d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:02.360137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74de0a00-d54e-430d-84dd-a60b427c427d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:02.360638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74de0a00-d54e-430d-84dd-a60b427c427d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:02.361370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74de0a00-d54e-430d-84dd-a60b427c427d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:02.362019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74de0a00-d54e-430d-84dd-a60b427c427d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:02.362532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74de0a00-d54e-430d-84dd-a60b427c427d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:02.478110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=20 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:10:02.593739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-74de0a00-d54e-430d-84dd-a60b427c427d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:02.612321 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-74de0a00-d54e-430d-84dd-a60b427c427d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1561 microversion: 2.1 time: 0.278052 Aug 18 12:10:02.613156 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3155/5809] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:02 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1561 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:02.668807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5651aaf4-836c-483e-8651-3b9078e43ad2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:02.669948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5651aaf4-836c-483e-8651-3b9078e43ad2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:02.677105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5651aaf4-836c-483e-8651-3b9078e43ad2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:02.679695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5651aaf4-836c-483e-8651-3b9078e43ad2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:02.681365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5651aaf4-836c-483e-8651-3b9078e43ad2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:02.690045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5651aaf4-836c-483e-8651-3b9078e43ad2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:02.690585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5651aaf4-836c-483e-8651-3b9078e43ad2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:02.691330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5651aaf4-836c-483e-8651-3b9078e43ad2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:02.971817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5651aaf4-836c-483e-8651-3b9078e43ad2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:02.996833 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5651aaf4-836c-483e-8651-3b9078e43ad2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1561 microversion: 2.1 time: 0.335665 Aug 18 12:10:03.016447 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3156/5810] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:02 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1561 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:10:03.043240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d331c931-fd1c-48b8-8b74-17c6e99d9981 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:03.044344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d331c931-fd1c-48b8-8b74-17c6e99d9981 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:03.053032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:10:03.058814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d331c931-fd1c-48b8-8b74-17c6e99d9981 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:03.059581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d331c931-fd1c-48b8-8b74-17c6e99d9981 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:03.060216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d331c931-fd1c-48b8-8b74-17c6e99d9981 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:03.062063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d331c931-fd1c-48b8-8b74-17c6e99d9981 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:03.063228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d331c931-fd1c-48b8-8b74-17c6e99d9981 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:03.063899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d331c931-fd1c-48b8-8b74-17c6e99d9981 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:03.382849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d331c931-fd1c-48b8-8b74-17c6e99d9981 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:03.399067 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d331c931-fd1c-48b8-8b74-17c6e99d9981 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 200 len: 1374 microversion: 2.1 time: 0.380630 Aug 18 12:10:03.401059 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3157/5811] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:03 2022] GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 1374 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:03.538204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-57bb6578-e10b-4db1-beeb-e274bdb64a00 req-f692ff99-40c8-460b-89a6-874c230294c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa4e457-042a-4cdc-8f86-3cc9e21ed12c", "name": "network-vif-plugged", "status": "completed", "tag": "968cd41e-1bbf-449a-a02d-dd422ccc7306"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:03.564825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-57bb6578-e10b-4db1-beeb-e274bdb64a00 req-f692ff99-40c8-460b-89a6-874c230294c2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:03.565335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-57bb6578-e10b-4db1-beeb-e274bdb64a00 req-f692ff99-40c8-460b-89a6-874c230294c2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:03.565781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-57bb6578-e10b-4db1-beeb-e274bdb64a00 req-f692ff99-40c8-460b-89a6-874c230294c2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:03.598460 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-57bb6578-e10b-4db1-beeb-e274bdb64a00 req-f692ff99-40c8-460b-89a6-874c230294c2 service nova] Creating event network-vif-plugged:968cd41e-1bbf-449a-a02d-dd422ccc7306 for instance 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c on n-h2-853611-3 Aug 18 12:10:03.613282 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-57bb6578-e10b-4db1-beeb-e274bdb64a00 req-f692ff99-40c8-460b-89a6-874c230294c2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075887 Aug 18 12:10:03.616439 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3158/5812] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:10:04.444225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f7f71f6-95b1-4dc5-8b06-b551421751f1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:04.447025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f7f71f6-95b1-4dc5-8b06-b551421751f1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:04.467258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f7f71f6-95b1-4dc5-8b06-b551421751f1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:04.472287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f7f71f6-95b1-4dc5-8b06-b551421751f1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:04.473556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f7f71f6-95b1-4dc5-8b06-b551421751f1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:04.475210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f7f71f6-95b1-4dc5-8b06-b551421751f1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:04.476380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f7f71f6-95b1-4dc5-8b06-b551421751f1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:04.478271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f7f71f6-95b1-4dc5-8b06-b551421751f1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:04.780619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2f7f71f6-95b1-4dc5-8b06-b551421751f1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:04.797842 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f7f71f6-95b1-4dc5-8b06-b551421751f1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 200 len: 1374 microversion: 2.1 time: 0.360752 Aug 18 12:10:04.799976 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3159/5813] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:04 2022] GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 1374 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:10:05.821358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5475ade5-fb96-4457-8af7-f64a6403b103 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:05.822345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5475ade5-fb96-4457-8af7-f64a6403b103 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:05.830311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5475ade5-fb96-4457-8af7-f64a6403b103 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:05.830955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5475ade5-fb96-4457-8af7-f64a6403b103 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:05.831514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5475ade5-fb96-4457-8af7-f64a6403b103 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:05.832394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5475ade5-fb96-4457-8af7-f64a6403b103 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:05.832938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5475ade5-fb96-4457-8af7-f64a6403b103 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:05.833470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5475ade5-fb96-4457-8af7-f64a6403b103 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:06.076987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5475ade5-fb96-4457-8af7-f64a6403b103 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:06.089739 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5475ade5-fb96-4457-8af7-f64a6403b103 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 200 len: 1546 microversion: 2.1 time: 0.272787 Aug 18 12:10:06.090852 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3160/5814] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:05 2022] GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 1546 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:10:06.096645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-90b35c0d-0b22-4223-b66b-8900406bd47c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:06.097153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-90b35c0d-0b22-4223-b66b-8900406bd47c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:06.110050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90b35c0d-0b22-4223-b66b-8900406bd47c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:06.110977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90b35c0d-0b22-4223-b66b-8900406bd47c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:06.111318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90b35c0d-0b22-4223-b66b-8900406bd47c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:06.112120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90b35c0d-0b22-4223-b66b-8900406bd47c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:06.113280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90b35c0d-0b22-4223-b66b-8900406bd47c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:06.113722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90b35c0d-0b22-4223-b66b-8900406bd47c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:06.177496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-90b35c0d-0b22-4223-b66b-8900406bd47c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:10:06.357993 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-90b35c0d-0b22-4223-b66b-8900406bd47c tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 204 len: 0 microversion: 2.1 time: 0.265411 Aug 18 12:10:06.359390 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3161/5815] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:10:06 2022] DELETE /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:10:06.373161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-085cb4ab-3785-430e-8613-113594abc5e5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:06.375401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-085cb4ab-3785-430e-8613-113594abc5e5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:06.385282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-085cb4ab-3785-430e-8613-113594abc5e5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:06.386212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-085cb4ab-3785-430e-8613-113594abc5e5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:06.386938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-085cb4ab-3785-430e-8613-113594abc5e5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:06.388157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-085cb4ab-3785-430e-8613-113594abc5e5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:06.388964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-085cb4ab-3785-430e-8613-113594abc5e5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:06.390537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-085cb4ab-3785-430e-8613-113594abc5e5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:06.651533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-085cb4ab-3785-430e-8613-113594abc5e5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:06.662997 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-085cb4ab-3785-430e-8613-113594abc5e5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 200 len: 1546 microversion: 2.1 time: 0.301643 Aug 18 12:10:06.664365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3162/5816] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:06 2022] GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 1546 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:06.671037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e3d1a186-38e0-4ee2-9ddb-5e51fe0c35f8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:06.671662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e3d1a186-38e0-4ee2-9ddb-5e51fe0c35f8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:06.684186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d1a186-38e0-4ee2-9ddb-5e51fe0c35f8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:06.684624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d1a186-38e0-4ee2-9ddb-5e51fe0c35f8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:06.685053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d1a186-38e0-4ee2-9ddb-5e51fe0c35f8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:06.685808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d1a186-38e0-4ee2-9ddb-5e51fe0c35f8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:06.686269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d1a186-38e0-4ee2-9ddb-5e51fe0c35f8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:06.686924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d1a186-38e0-4ee2-9ddb-5e51fe0c35f8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:07.137013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e3d1a186-38e0-4ee2-9ddb-5e51fe0c35f8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:07.160538 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e3d1a186-38e0-4ee2-9ddb-5e51fe0c35f8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1561 microversion: 2.1 time: 0.493595 Aug 18 12:10:07.183144 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3163/5817] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:06 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1561 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:07.431399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d5f5a787-dcec-4642-9026-bf47841abd91 req-9db59e05-097d-48e6-9be8-b653ecfbec90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f1edc6-59e0-4f7c-96c7-7b369020eaf9", "tag": "f28d24fe-2bff-4919-b8aa-de06d7a2f574"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:07.443785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d5f5a787-dcec-4642-9026-bf47841abd91 req-9db59e05-097d-48e6-9be8-b653ecfbec90 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:07.444366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d5f5a787-dcec-4642-9026-bf47841abd91 req-9db59e05-097d-48e6-9be8-b653ecfbec90 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:07.444805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d5f5a787-dcec-4642-9026-bf47841abd91 req-9db59e05-097d-48e6-9be8-b653ecfbec90 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:07.475804 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d5f5a787-dcec-4642-9026-bf47841abd91 req-9db59e05-097d-48e6-9be8-b653ecfbec90 service nova] Creating event network-changed:f28d24fe-2bff-4919-b8aa-de06d7a2f574 for instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 on n-h1-853611-3 Aug 18 12:10:07.494746 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d5f5a787-dcec-4642-9026-bf47841abd91 req-9db59e05-097d-48e6-9be8-b653ecfbec90 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.308101 Aug 18 12:10:07.495712 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3164/5818] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:10:07.501339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-61cad319-0c36-427b-9c66-76bfd8e02caa tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:07.503642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-61cad319-0c36-427b-9c66-76bfd8e02caa tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:07.518075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61cad319-0c36-427b-9c66-76bfd8e02caa tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:07.518606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61cad319-0c36-427b-9c66-76bfd8e02caa tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:07.519052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61cad319-0c36-427b-9c66-76bfd8e02caa tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:07.519784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61cad319-0c36-427b-9c66-76bfd8e02caa tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:07.520244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61cad319-0c36-427b-9c66-76bfd8e02caa tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:07.520802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61cad319-0c36-427b-9c66-76bfd8e02caa tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:07.995262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-61cad319-0c36-427b-9c66-76bfd8e02caa tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:08.004695 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-61cad319-0c36-427b-9c66-76bfd8e02caa tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 200 len: 1512 microversion: 2.1 time: 0.507621 Aug 18 12:10:08.005739 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3165/5819] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:07 2022] GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 1512 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:09.034067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4670f900-1ff4-4f0c-8fc8-bc594cf467db tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:09.035759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4670f900-1ff4-4f0c-8fc8-bc594cf467db tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:09.048246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4670f900-1ff4-4f0c-8fc8-bc594cf467db tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:09.049928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4670f900-1ff4-4f0c-8fc8-bc594cf467db tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:09.050970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4670f900-1ff4-4f0c-8fc8-bc594cf467db tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:09.053185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4670f900-1ff4-4f0c-8fc8-bc594cf467db tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:09.056400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4670f900-1ff4-4f0c-8fc8-bc594cf467db tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:09.059241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4670f900-1ff4-4f0c-8fc8-bc594cf467db tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:09.580751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4670f900-1ff4-4f0c-8fc8-bc594cf467db tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '761db01e19c24ed5913371de82f86fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77ee0ffd5604e92b816cd8d80e7009c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:09.591345 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4670f900-1ff4-4f0c-8fc8-bc594cf467db tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 200 len: 1303 microversion: 2.1 time: 0.565822 Aug 18 12:10:09.592743 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3166/5820] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:09 2022] GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 1303 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:10:09.597902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f937f95e-91d0-4275-aa8b-d67e8d4c1e05 req-c9bc6e58-4e73-43b6-980a-fda7ad8b16e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b13101-ec75-454e-b101-376cfc9ec9b2", "name": "network-vif-deleted", "tag": "a4c5a393-31bf-4342-b371-746f973563fe"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:09.627449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f937f95e-91d0-4275-aa8b-d67e8d4c1e05 req-c9bc6e58-4e73-43b6-980a-fda7ad8b16e2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:09.628312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f937f95e-91d0-4275-aa8b-d67e8d4c1e05 req-c9bc6e58-4e73-43b6-980a-fda7ad8b16e2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:09.629341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f937f95e-91d0-4275-aa8b-d67e8d4c1e05 req-c9bc6e58-4e73-43b6-980a-fda7ad8b16e2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:09.644946 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f937f95e-91d0-4275-aa8b-d67e8d4c1e05 req-c9bc6e58-4e73-43b6-980a-fda7ad8b16e2 service nova] Creating event network-vif-deleted:a4c5a393-31bf-4342-b371-746f973563fe for instance e6b13101-ec75-454e-b101-376cfc9ec9b2 on n-h2-853611-3 Aug 18 12:10:09.654304 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f937f95e-91d0-4275-aa8b-d67e8d4c1e05 req-c9bc6e58-4e73-43b6-980a-fda7ad8b16e2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059410 Aug 18 12:10:09.655906 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3167/5821] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:10:09.930114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-dc0f6079-5c7a-4012-81e4-3e4ab7155697 req-eefe62c7-0f07-4494-8d04-00a5a62b47da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa4e457-042a-4cdc-8f86-3cc9e21ed12c", "tag": "968cd41e-1bbf-449a-a02d-dd422ccc7306"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:09.950191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-dc0f6079-5c7a-4012-81e4-3e4ab7155697 req-eefe62c7-0f07-4494-8d04-00a5a62b47da service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:09.951450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-dc0f6079-5c7a-4012-81e4-3e4ab7155697 req-eefe62c7-0f07-4494-8d04-00a5a62b47da service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:09.952510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-dc0f6079-5c7a-4012-81e4-3e4ab7155697 req-eefe62c7-0f07-4494-8d04-00a5a62b47da service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:09.985233 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-dc0f6079-5c7a-4012-81e4-3e4ab7155697 req-eefe62c7-0f07-4494-8d04-00a5a62b47da service nova] Creating event network-changed:968cd41e-1bbf-449a-a02d-dd422ccc7306 for instance 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c on n-h2-853611-3 Aug 18 12:10:09.999550 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-dc0f6079-5c7a-4012-81e4-3e4ab7155697 req-eefe62c7-0f07-4494-8d04-00a5a62b47da service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077102 Aug 18 12:10:10.019166 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3168/5822] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:10:10.636498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ad74bdd9-2839-4208-9744-07050380e311 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:10.637908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ad74bdd9-2839-4208-9744-07050380e311 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] [instance: e6b13101-ec75-454e-b101-376cfc9ec9b2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:10.655931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad74bdd9-2839-4208-9744-07050380e311 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:10.656955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad74bdd9-2839-4208-9744-07050380e311 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:10.658031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad74bdd9-2839-4208-9744-07050380e311 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:10.660451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad74bdd9-2839-4208-9744-07050380e311 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:10.661991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad74bdd9-2839-4208-9744-07050380e311 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:10.663140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad74bdd9-2839-4208-9744-07050380e311 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:10.690465 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-ad74bdd9-2839-4208-9744-07050380e311 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] HTTP exception thrown: Instance e6b13101-ec75-454e-b101-376cfc9ec9b2 could not be found. Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ad74bdd9-2839-4208-9744-07050380e311 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Request method failure captured: Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 HTTP/1.1 Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_irY4Sj_zy9xzjdmEYKangwIiZoa3ICGaCTcXaEREDh7gNdMYzmF8PQeCdyfuyWnPLf_6fUcBaSMAjVc3ILOtlbMnK2joloNgxCLxvyPm_MMqkHcgR3jjbg1Z2KtO1GPkBgTyGlbjd4u-c-_ClXbV_GibgNAvBJ0UeLRVN69ok4sq3I Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: c77ee0ffd5604e92b816cd8d80e7009c Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-VolumesSnapshotTestJSON-580006872 Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c77ee0ffd5604e92b816cd8d80e7009c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/c77ee0ffd5604e92b816cd8d80e7009c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_c77ee0ffd5604e92b816cd8d80e7009c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/c77ee0ffd5604e92b816cd8d80e7009c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-VolumesSnapshotTestJSON-580006872 Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: c77ee0ffd5604e92b816cd8d80e7009c Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-580006872 Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-VolumesSnapshotTestJSON-580006872-project Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 761db01e19c24ed5913371de82f86fdc Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-VolumesSnapshotTestJSON-580006872-project Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance e6b13101-ec75-454e-b101-376cfc9ec9b2 could not be found. Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'e6b13101-ec75-454e-b101-376cfc9ec9b2'} Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b13101-ec75-454e-b101-376cfc9ec9b2 could not be found. Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b13101-ec75-454e-b101-376cfc9ec9b2 could not be found. Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:10:10.693246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:10:10.726709 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:10:10.726709 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:10:10.726709 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:10:10.726709 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:10:10.726709 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:10:10.726709 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b13101-ec75-454e-b101-376cfc9ec9b2 could not be found. Aug 18 12:10:10.726709 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:10:10.726709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ad74bdd9-2839-4208-9744-07050380e311 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] Returning 404 to user: Instance e6b13101-ec75-454e-b101-376cfc9ec9b2 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:10:10.726709 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ad74bdd9-2839-4208-9744-07050380e311 tempest-VolumesSnapshotTestJSON-580006872 tempest-VolumesSnapshotTestJSON-580006872-project] 10.222.0.73 "GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2" status: 404 len: 111 microversion: 2.1 time: 0.070386 Aug 18 12:10:10.726709 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3169/5823] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:10 2022] GET /compute/v2.1/servers/e6b13101-ec75-454e-b101-376cfc9ec9b2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:10:26.644877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:10:26.645863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:10:26.651111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-50b53a43-ff75-462e-830b-381befa74074 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:26.654706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-50b53a43-ff75-462e-830b-381befa74074 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:26.673217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50b53a43-ff75-462e-830b-381befa74074 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:26.674099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50b53a43-ff75-462e-830b-381befa74074 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:26.674790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50b53a43-ff75-462e-830b-381befa74074 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:26.675730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50b53a43-ff75-462e-830b-381befa74074 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:26.676380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50b53a43-ff75-462e-830b-381befa74074 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:26.677012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50b53a43-ff75-462e-830b-381befa74074 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:26.789688 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-50b53a43-ff75-462e-830b-381befa74074 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9/action" status: 200 len: 24571 microversion: 2.1 time: 0.144678 Aug 18 12:10:26.794147 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3170/5824] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:10:26 2022] POST /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9/action => generated 24571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:10:30.536333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb5d903e-71b4-4215-9c44-e4e9386754ba tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:30.545409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bb5d903e-71b4-4215-9c44-e4e9386754ba tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:30.560675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb5d903e-71b4-4215-9c44-e4e9386754ba tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:30.561555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb5d903e-71b4-4215-9c44-e4e9386754ba tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:30.562368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb5d903e-71b4-4215-9c44-e4e9386754ba tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:30.563736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb5d903e-71b4-4215-9c44-e4e9386754ba tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:30.564603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb5d903e-71b4-4215-9c44-e4e9386754ba tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:30.565483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb5d903e-71b4-4215-9c44-e4e9386754ba tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:30.672708 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bb5d903e-71b4-4215-9c44-e4e9386754ba tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "POST /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c/action" status: 200 len: 24570 microversion: 2.1 time: 0.144111 Aug 18 12:10:30.673691 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3171/5825] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:10:30 2022] POST /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c/action => generated 24570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:10:34.405913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-71af9ffb-5693-48fd-871b-ce1faf06df91 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Action: 'create', calling method: .version_select at 0x7f519e6b3280>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1538337373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9+vWd/IO0zRMGfvcdl0ZSSuPtQjWxU1Hqq6+J7n8t0L/B3U4ddkA3SUTPhKGoK+AcQIofqsTgutgedFKFqjazSipry5ps1JsRKhFfor1jnuQvPUtlwB8vbKCHXKepB0w=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:34.424606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-71af9ffb-5693-48fd-871b-ce1faf06df91 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Getting quotas for project 8d220fd218d6489b87efc85c07845466. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:10:34.431138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-71af9ffb-5693-48fd-871b-ce1faf06df91 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Getting quotas for user 846e61e4aec94b7895080117c55c2382 and project 8d220fd218d6489b87efc85c07845466. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:10:34.462470 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-71af9ffb-5693-48fd-871b-ce1faf06df91 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.316539 Aug 18 12:10:34.463987 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3172/5826] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:10:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:10:37.790144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e02bf990-b85f-4645-b09d-f5443397fced tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:37.792230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e02bf990-b85f-4645-b09d-f5443397fced tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:37.811655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e02bf990-b85f-4645-b09d-f5443397fced tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:37.814631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e02bf990-b85f-4645-b09d-f5443397fced tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:37.817060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e02bf990-b85f-4645-b09d-f5443397fced tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:37.822313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e02bf990-b85f-4645-b09d-f5443397fced tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:37.826016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e02bf990-b85f-4645-b09d-f5443397fced tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:37.826385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e02bf990-b85f-4645-b09d-f5443397fced tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:38.128465 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e02bf990-b85f-4645-b09d-f5443397fced tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1831 microversion: 2.1 time: 0.346686 Aug 18 12:10:38.152089 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3173/5827] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:37 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1831 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:10:38.172969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b3544d7-2139-4463-b078-60dc5254d8ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:38.174417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b3544d7-2139-4463-b078-60dc5254d8ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:38.185883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b3544d7-2139-4463-b078-60dc5254d8ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:38.187194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b3544d7-2139-4463-b078-60dc5254d8ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:38.188541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b3544d7-2139-4463-b078-60dc5254d8ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:38.190118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b3544d7-2139-4463-b078-60dc5254d8ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:38.191171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b3544d7-2139-4463-b078-60dc5254d8ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:38.192375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b3544d7-2139-4463-b078-60dc5254d8ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:38.545344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b3544d7-2139-4463-b078-60dc5254d8ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:38.559233 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b3544d7-2139-4463-b078-60dc5254d8ac tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1680 microversion: 2.1 time: 0.392420 Aug 18 12:10:38.560974 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3174/5828] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:38 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1680 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:38.848682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eb0d25bf-e7ba-45c1-b0af-e8a73805b1ca tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:38.851745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eb0d25bf-e7ba-45c1-b0af-e8a73805b1ca tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:38.878351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb0d25bf-e7ba-45c1-b0af-e8a73805b1ca tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:38.878911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb0d25bf-e7ba-45c1-b0af-e8a73805b1ca tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:38.879368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb0d25bf-e7ba-45c1-b0af-e8a73805b1ca tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:38.880122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb0d25bf-e7ba-45c1-b0af-e8a73805b1ca tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:38.880588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb0d25bf-e7ba-45c1-b0af-e8a73805b1ca tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:38.881342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb0d25bf-e7ba-45c1-b0af-e8a73805b1ca tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:38.971910 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eb0d25bf-e7ba-45c1-b0af-e8a73805b1ca tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9/action" status: 200 len: 32646 microversion: 2.1 time: 0.128742 Aug 18 12:10:38.973312 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3175/5829] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:10:38 2022] POST /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9/action => generated 32646 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:10:39.133965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-84c8e623-dc63-442c-b221-62599d0d1f1f tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:39.135610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-84c8e623-dc63-442c-b221-62599d0d1f1f tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:39.150249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84c8e623-dc63-442c-b221-62599d0d1f1f tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:39.152582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84c8e623-dc63-442c-b221-62599d0d1f1f tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:39.154260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84c8e623-dc63-442c-b221-62599d0d1f1f tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:39.156239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84c8e623-dc63-442c-b221-62599d0d1f1f tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:39.157083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84c8e623-dc63-442c-b221-62599d0d1f1f tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:39.160091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84c8e623-dc63-442c-b221-62599d0d1f1f tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:39.243779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-84c8e623-dc63-442c-b221-62599d0d1f1f tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2c5f3e7c88f34b1880291a3ff8d97195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07c3f01a3f7469d9d805dce01904bc8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:39.248424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-84c8e623-dc63-442c-b221-62599d0d1f1f tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] flavor_id is None. Assuming migration. {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 18 12:10:39.249183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-84c8e623-dc63-442c-b221-62599d0d1f1f tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 12:10:39.664836 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-84c8e623-dc63-442c-b221-62599d0d1f1f tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9/action" status: 202 len: 0 microversion: 2.1 time: 0.535211 Aug 18 12:10:39.670410 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3176/5830] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:10:39 2022] POST /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:10:39.704474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cd311443-5526-44c8-a5c5-18c178f5a554 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:39.705663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cd311443-5526-44c8-a5c5-18c178f5a554 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:39.748077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd311443-5526-44c8-a5c5-18c178f5a554 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:39.748983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd311443-5526-44c8-a5c5-18c178f5a554 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:39.749801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd311443-5526-44c8-a5c5-18c178f5a554 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:39.751549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd311443-5526-44c8-a5c5-18c178f5a554 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:39.752446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd311443-5526-44c8-a5c5-18c178f5a554 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:39.753260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd311443-5526-44c8-a5c5-18c178f5a554 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:40.484910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cd311443-5526-44c8-a5c5-18c178f5a554 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:40.543045 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cd311443-5526-44c8-a5c5-18c178f5a554 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1689 microversion: 2.1 time: 0.870541 Aug 18 12:10:40.544553 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3177/5831] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:39 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1689 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:41.585640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-368706a0-bf5a-42c3-9478-d8419209d2c7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:41.590877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-368706a0-bf5a-42c3-9478-d8419209d2c7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:41.621267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-368706a0-bf5a-42c3-9478-d8419209d2c7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:41.627370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-368706a0-bf5a-42c3-9478-d8419209d2c7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:41.630094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-368706a0-bf5a-42c3-9478-d8419209d2c7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:41.636103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-368706a0-bf5a-42c3-9478-d8419209d2c7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:41.637776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-368706a0-bf5a-42c3-9478-d8419209d2c7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:41.640302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-368706a0-bf5a-42c3-9478-d8419209d2c7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:42.596152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-368706a0-bf5a-42c3-9478-d8419209d2c7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:42.639135 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-368706a0-bf5a-42c3-9478-d8419209d2c7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1689 microversion: 2.1 time: 1.061186 Aug 18 12:10:42.654782 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3178/5832] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:41 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1689 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:43.669606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3d40a58f-3dd1-4b5f-811e-013d7d46268c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:43.670978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3d40a58f-3dd1-4b5f-811e-013d7d46268c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:43.692179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d40a58f-3dd1-4b5f-811e-013d7d46268c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:43.693758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d40a58f-3dd1-4b5f-811e-013d7d46268c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:43.696801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d40a58f-3dd1-4b5f-811e-013d7d46268c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:43.700042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d40a58f-3dd1-4b5f-811e-013d7d46268c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:43.705152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d40a58f-3dd1-4b5f-811e-013d7d46268c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:43.706016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d40a58f-3dd1-4b5f-811e-013d7d46268c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:44.440494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:10:44.548782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3d40a58f-3dd1-4b5f-811e-013d7d46268c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:44.604204 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3d40a58f-3dd1-4b5f-811e-013d7d46268c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1689 microversion: 2.1 time: 0.939262 Aug 18 12:10:44.620156 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3179/5833] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:43 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1689 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:10:45.662467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f2d192a4-7975-4dc6-9a2b-074ed628a90e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:45.667750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f2d192a4-7975-4dc6-9a2b-074ed628a90e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:45.710377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2d192a4-7975-4dc6-9a2b-074ed628a90e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:45.711111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2d192a4-7975-4dc6-9a2b-074ed628a90e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:45.716179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2d192a4-7975-4dc6-9a2b-074ed628a90e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:45.717232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2d192a4-7975-4dc6-9a2b-074ed628a90e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:45.717812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2d192a4-7975-4dc6-9a2b-074ed628a90e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:45.718348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2d192a4-7975-4dc6-9a2b-074ed628a90e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:46.165078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f2d192a4-7975-4dc6-9a2b-074ed628a90e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:46.188099 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f2d192a4-7975-4dc6-9a2b-074ed628a90e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1689 microversion: 2.1 time: 0.534633 Aug 18 12:10:46.188916 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3180/5834] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:45 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1689 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:46.221000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7c5a7a6-2a27-4a07-a296-b06ffaf3c40e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Action: 'create', calling method: .version_select at 0x7f519e92bee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1080243626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbud2w7Y4cbIvpmY3k5hQZ4nBeIHxYqo6B+dUZ3UsPgEGFdpbx1qaGxBcUs9dpGpyjWeyWj6JIY/xZub0cNXSHV+jR+R70ZNOx6jcwVGI8FOhBwsf0gactzz533sIkZSw=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:46.249401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-e7c5a7a6-2a27-4a07-a296-b06ffaf3c40e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Getting quotas for project 33e6a4cb7234446dae9a06b0a91810ad. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:10:46.262661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-e7c5a7a6-2a27-4a07-a296-b06ffaf3c40e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Getting quotas for user 84208046cadf456eb814d737b0bd516b and project 33e6a4cb7234446dae9a06b0a91810ad. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:10:46.336523 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e7c5a7a6-2a27-4a07-a296-b06ffaf3c40e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.145729 Aug 18 12:10:46.339270 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3181/5835] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:10:46 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:10:47.233081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c52cad0c-2b80-4c37-a78c-8f73ebfb7a26 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:47.236240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c52cad0c-2b80-4c37-a78c-8f73ebfb7a26 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:47.286852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52cad0c-2b80-4c37-a78c-8f73ebfb7a26 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:47.287932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52cad0c-2b80-4c37-a78c-8f73ebfb7a26 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:47.288970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52cad0c-2b80-4c37-a78c-8f73ebfb7a26 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:47.290557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52cad0c-2b80-4c37-a78c-8f73ebfb7a26 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:47.297197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52cad0c-2b80-4c37-a78c-8f73ebfb7a26 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:47.299172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52cad0c-2b80-4c37-a78c-8f73ebfb7a26 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:47.818384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c52cad0c-2b80-4c37-a78c-8f73ebfb7a26 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:47.832150 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c52cad0c-2b80-4c37-a78c-8f73ebfb7a26 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1694 microversion: 2.1 time: 0.614567 Aug 18 12:10:47.852133 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3182/5836] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:47 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1694 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:47.863078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1466217222-access_point-901993226", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "5f9de69d-ff38-4786-8482-508c6712ef50"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1538337373", "security_groups": [{"name": "tempest-secgroup_access--610756089"}, {"name": "tempest-secgroup_general--1365841921"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:48.399022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] validate_networks() for [('5f9de69d-ff38-4786-8482-508c6712ef50', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:10:49.715989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:10:49.717824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:10:49.718911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:10:49.719804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:10:49.720841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:10:49.741366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:49.742401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:49.743205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:49.745388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:49.746624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:49.747412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:49.788536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Getting quotas for project 8d220fd218d6489b87efc85c07845466. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:10:49.800229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Getting quotas for user 846e61e4aec94b7895080117c55c2382 and project 8d220fd218d6489b87efc85c07845466. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:10:49.833946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:10:49.839440 n-d-853611-3 devstack@n-api.service[122210]: WARNING nova.utils [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1466217222-access_point-901993226 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1466217222-ac Aug 18 12:10:49.841016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:10:49.973838 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9512def2-2fa7-4708-a6f2-68f807e52459 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.119466 Aug 18 12:10:49.975359 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3183/5837] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:10:47 2022] POST /compute/v2.1/servers => generated 457 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:10:49.989670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-af7602c2-f729-4a4c-a0b7-621c77dd426c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:49.991296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-af7602c2-f729-4a4c-a0b7-621c77dd426c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:50.006654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af7602c2-f729-4a4c-a0b7-621c77dd426c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:50.007949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af7602c2-f729-4a4c-a0b7-621c77dd426c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:50.009753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af7602c2-f729-4a4c-a0b7-621c77dd426c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:50.016170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af7602c2-f729-4a4c-a0b7-621c77dd426c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:50.017768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af7602c2-f729-4a4c-a0b7-621c77dd426c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:50.024856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af7602c2-f729-4a4c-a0b7-621c77dd426c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:50.337902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-af7602c2-f729-4a4c-a0b7-621c77dd426c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:50.347243 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-af7602c2-f729-4a4c-a0b7-621c77dd426c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1694 microversion: 2.1 time: 0.366890 Aug 18 12:10:50.349443 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3184/5838] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:49 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1694 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:50.360533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1924237227", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "1a4f6c8c-c18c-48fe-8e24-f19644b6f429"}], "key_name": "tempest-TestNetworkBasicOps-1080243626", "security_groups": [{"name": "tempest-secgroup-smoke-554234636"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:50.569328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] validate_networks() for [('1a4f6c8c-c18c-48fe-8e24-f19644b6f429', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:10:51.562396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:10:51.563816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:10:51.564535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:10:51.565263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:10:51.565933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:10:51.576927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:51.577862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:51.578630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:51.579776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:51.580504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:51.581193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:51.605679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Getting quotas for project 33e6a4cb7234446dae9a06b0a91810ad. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:10:51.612794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Getting quotas for user 84208046cadf456eb814d737b0bd516b and project 33e6a4cb7234446dae9a06b0a91810ad. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:10:51.640764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:10:51.644558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:10:51.715777 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-61738d61-b5a6-4881-bc1c-9f69ded8f68d tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.364731 Aug 18 12:10:51.716642 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3185/5839] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:10:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:10:51.727562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a5bd43d-1d06-458a-8715-0470bdbf1981 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:51.727562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4a5bd43d-1d06-458a-8715-0470bdbf1981 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:51.730020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a5bd43d-1d06-458a-8715-0470bdbf1981 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:51.730542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a5bd43d-1d06-458a-8715-0470bdbf1981 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:51.730984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a5bd43d-1d06-458a-8715-0470bdbf1981 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:51.731729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a5bd43d-1d06-458a-8715-0470bdbf1981 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:51.732197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a5bd43d-1d06-458a-8715-0470bdbf1981 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:51.732629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a5bd43d-1d06-458a-8715-0470bdbf1981 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:51.952322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4a5bd43d-1d06-458a-8715-0470bdbf1981 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:51.969565 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4a5bd43d-1d06-458a-8715-0470bdbf1981 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1346 microversion: 2.1 time: 0.251261 Aug 18 12:10:51.970751 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3186/5840] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:51 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1346 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:51.995516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-90f086b3-8143-46ea-b20c-8734f8827b57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:51.997514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-90f086b3-8143-46ea-b20c-8734f8827b57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:52.011525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f086b3-8143-46ea-b20c-8734f8827b57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:52.012980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f086b3-8143-46ea-b20c-8734f8827b57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:52.013905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f086b3-8143-46ea-b20c-8734f8827b57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:52.015251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f086b3-8143-46ea-b20c-8734f8827b57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:52.016115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f086b3-8143-46ea-b20c-8734f8827b57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:52.016944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f086b3-8143-46ea-b20c-8734f8827b57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:52.398070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-90f086b3-8143-46ea-b20c-8734f8827b57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:52.420119 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-90f086b3-8143-46ea-b20c-8734f8827b57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1694 microversion: 2.1 time: 0.447816 Aug 18 12:10:52.420938 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3187/5841] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:51 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1694 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:52.426462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-32ea0b01-f451-4f1e-a4be-84f224e1681e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:52.427378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-32ea0b01-f451-4f1e-a4be-84f224e1681e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:52.503294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-32ea0b01-f451-4f1e-a4be-84f224e1681e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:52.514106 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-32ea0b01-f451-4f1e-a4be-84f224e1681e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1249 microversion: 2.1 time: 0.091951 Aug 18 12:10:52.515718 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3188/5842] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:52 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:53.013445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0c0377df-1ba2-4f89-9c60-1281ca11638b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:53.014792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0c0377df-1ba2-4f89-9c60-1281ca11638b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:53.035809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c0377df-1ba2-4f89-9c60-1281ca11638b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:53.036958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c0377df-1ba2-4f89-9c60-1281ca11638b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:53.043913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c0377df-1ba2-4f89-9c60-1281ca11638b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:53.045210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c0377df-1ba2-4f89-9c60-1281ca11638b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:53.047236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c0377df-1ba2-4f89-9c60-1281ca11638b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:53.050250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c0377df-1ba2-4f89-9c60-1281ca11638b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:53.162884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0c0377df-1ba2-4f89-9c60-1281ca11638b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:53.179004 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0c0377df-1ba2-4f89-9c60-1281ca11638b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1352 microversion: 2.1 time: 0.172182 Aug 18 12:10:53.180298 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3189/5843] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:53 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1352 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:10:53.444266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b0d7869-324d-46ec-ade7-8e17545a800d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:53.446269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2b0d7869-324d-46ec-ade7-8e17545a800d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:53.460050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b0d7869-324d-46ec-ade7-8e17545a800d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:53.461156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b0d7869-324d-46ec-ade7-8e17545a800d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:53.461827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b0d7869-324d-46ec-ade7-8e17545a800d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:53.462890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b0d7869-324d-46ec-ade7-8e17545a800d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:53.465600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b0d7869-324d-46ec-ade7-8e17545a800d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:53.466923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b0d7869-324d-46ec-ade7-8e17545a800d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:53.473209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:10:53.738252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2b0d7869-324d-46ec-ade7-8e17545a800d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:53.751945 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2b0d7869-324d-46ec-ade7-8e17545a800d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1694 microversion: 2.1 time: 0.311144 Aug 18 12:10:53.753087 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3190/5844] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:53 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1694 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:53.760112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f9563af5-3d97-4084-9a51-b0ba2c5e5f45 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:53.762780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f9563af5-3d97-4084-9a51-b0ba2c5e5f45 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:53.768859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:10:53.773841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9563af5-3d97-4084-9a51-b0ba2c5e5f45 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:53.774348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9563af5-3d97-4084-9a51-b0ba2c5e5f45 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:53.774883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9563af5-3d97-4084-9a51-b0ba2c5e5f45 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:53.775688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9563af5-3d97-4084-9a51-b0ba2c5e5f45 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:53.778962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9563af5-3d97-4084-9a51-b0ba2c5e5f45 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:53.780175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9563af5-3d97-4084-9a51-b0ba2c5e5f45 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:53.904412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f9563af5-3d97-4084-9a51-b0ba2c5e5f45 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:53.920763 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f9563af5-3d97-4084-9a51-b0ba2c5e5f45 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1307 microversion: 2.1 time: 0.165978 Aug 18 12:10:53.922384 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3191/5845] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:53 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1307 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:54.212033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11029f60-ce48-4be0-b840-ba2845b49cbe tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:54.213320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-11029f60-ce48-4be0-b840-ba2845b49cbe tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:54.231196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11029f60-ce48-4be0-b840-ba2845b49cbe tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:54.232751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11029f60-ce48-4be0-b840-ba2845b49cbe tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:54.233967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11029f60-ce48-4be0-b840-ba2845b49cbe tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:54.235025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11029f60-ce48-4be0-b840-ba2845b49cbe tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:54.235743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11029f60-ce48-4be0-b840-ba2845b49cbe tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:54.236438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11029f60-ce48-4be0-b840-ba2845b49cbe tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:54.433676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11029f60-ce48-4be0-b840-ba2845b49cbe tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:54.444770 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-11029f60-ce48-4be0-b840-ba2845b49cbe tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1471 microversion: 2.1 time: 0.240788 Aug 18 12:10:54.446337 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3192/5846] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:54 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:54.783239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b37077d3-0399-4ccf-b0d4-62e6c775c584 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:54.785800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b37077d3-0399-4ccf-b0d4-62e6c775c584 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:54.801983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b37077d3-0399-4ccf-b0d4-62e6c775c584 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:54.803037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b37077d3-0399-4ccf-b0d4-62e6c775c584 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:54.804147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b37077d3-0399-4ccf-b0d4-62e6c775c584 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:54.805943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b37077d3-0399-4ccf-b0d4-62e6c775c584 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:54.806977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b37077d3-0399-4ccf-b0d4-62e6c775c584 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:54.807995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b37077d3-0399-4ccf-b0d4-62e6c775c584 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:55.213986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b37077d3-0399-4ccf-b0d4-62e6c775c584 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:55.227200 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b37077d3-0399-4ccf-b0d4-62e6c775c584 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1694 microversion: 2.1 time: 0.453913 Aug 18 12:10:55.228838 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3193/5847] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:54 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1694 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:10:55.238600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9540a720-54f3-4954-9735-9fcdcdb916d3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:55.239660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9540a720-54f3-4954-9735-9fcdcdb916d3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:55.250929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9540a720-54f3-4954-9735-9fcdcdb916d3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:55.252372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9540a720-54f3-4954-9735-9fcdcdb916d3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:55.253218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9540a720-54f3-4954-9735-9fcdcdb916d3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:55.254077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9540a720-54f3-4954-9735-9fcdcdb916d3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:55.254647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9540a720-54f3-4954-9735-9fcdcdb916d3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:55.255106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9540a720-54f3-4954-9735-9fcdcdb916d3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:55.365037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9540a720-54f3-4954-9735-9fcdcdb916d3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:55.376032 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9540a720-54f3-4954-9735-9fcdcdb916d3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1307 microversion: 2.1 time: 0.143170 Aug 18 12:10:55.377686 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3194/5848] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:55 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1307 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:55.382789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d8b66f36-75b0-49fc-8319-113033be0821 req-9e37b275-1045-4d35-b23f-07fae84fd7cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e77fafc-08a7-43f8-bf7f-97891d521eaa", "tag": "061fca7d-153a-4d50-ac8f-4846423f3180"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:55.399043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d8b66f36-75b0-49fc-8319-113033be0821 req-9e37b275-1045-4d35-b23f-07fae84fd7cb service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:55.399542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d8b66f36-75b0-49fc-8319-113033be0821 req-9e37b275-1045-4d35-b23f-07fae84fd7cb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:55.400320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d8b66f36-75b0-49fc-8319-113033be0821 req-9e37b275-1045-4d35-b23f-07fae84fd7cb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:55.416497 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d8b66f36-75b0-49fc-8319-113033be0821 req-9e37b275-1045-4d35-b23f-07fae84fd7cb service nova] Creating event network-changed:061fca7d-153a-4d50-ac8f-4846423f3180 for instance 6e77fafc-08a7-43f8-bf7f-97891d521eaa on n-h1-853611-3 Aug 18 12:10:55.423887 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d8b66f36-75b0-49fc-8319-113033be0821 req-9e37b275-1045-4d35-b23f-07fae84fd7cb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045428 Aug 18 12:10:55.424886 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3195/5849] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:10:55.488355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-63661d20-8bab-4add-9554-701f4e24d17d tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:55.489561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-63661d20-8bab-4add-9554-701f4e24d17d tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:55.501069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63661d20-8bab-4add-9554-701f4e24d17d tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:55.503649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63661d20-8bab-4add-9554-701f4e24d17d tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:55.504624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63661d20-8bab-4add-9554-701f4e24d17d tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:55.505776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63661d20-8bab-4add-9554-701f4e24d17d tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:55.506703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63661d20-8bab-4add-9554-701f4e24d17d tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:55.507385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63661d20-8bab-4add-9554-701f4e24d17d tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:55.839502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-63661d20-8bab-4add-9554-701f4e24d17d tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:55.850937 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-63661d20-8bab-4add-9554-701f4e24d17d tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1471 microversion: 2.1 time: 0.371560 Aug 18 12:10:55.852341 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3196/5850] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:55 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1471 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:56.261338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7b437c0d-77d7-41f6-9417-d2e50042b88a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:56.262893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7b437c0d-77d7-41f6-9417-d2e50042b88a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:56.270849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b437c0d-77d7-41f6-9417-d2e50042b88a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:56.271576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b437c0d-77d7-41f6-9417-d2e50042b88a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:56.272092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b437c0d-77d7-41f6-9417-d2e50042b88a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:56.272903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b437c0d-77d7-41f6-9417-d2e50042b88a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:56.273435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b437c0d-77d7-41f6-9417-d2e50042b88a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:56.274113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b437c0d-77d7-41f6-9417-d2e50042b88a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:56.446903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7b437c0d-77d7-41f6-9417-d2e50042b88a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:56.457209 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7b437c0d-77d7-41f6-9417-d2e50042b88a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1694 microversion: 2.1 time: 0.200762 Aug 18 12:10:56.458191 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3197/5851] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:56 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1694 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:10:56.463813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08aa6a4a-23c7-42b2-9751-a5343592e2f3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:56.464801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-08aa6a4a-23c7-42b2-9751-a5343592e2f3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:56.471911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08aa6a4a-23c7-42b2-9751-a5343592e2f3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:56.472558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08aa6a4a-23c7-42b2-9751-a5343592e2f3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:56.473123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08aa6a4a-23c7-42b2-9751-a5343592e2f3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:56.474172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08aa6a4a-23c7-42b2-9751-a5343592e2f3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:56.474571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08aa6a4a-23c7-42b2-9751-a5343592e2f3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:56.475109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08aa6a4a-23c7-42b2-9751-a5343592e2f3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:56.680756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-08aa6a4a-23c7-42b2-9751-a5343592e2f3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:56.700209 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-08aa6a4a-23c7-42b2-9751-a5343592e2f3 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1374 microversion: 2.1 time: 0.239825 Aug 18 12:10:56.701308 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3198/5852] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:56 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1374 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:56.896651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-781b2a7b-d7c1-4624-87fd-f5c5e79eeb4c tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:56.897731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-781b2a7b-d7c1-4624-87fd-f5c5e79eeb4c tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:56.910553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-781b2a7b-d7c1-4624-87fd-f5c5e79eeb4c tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:56.911348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-781b2a7b-d7c1-4624-87fd-f5c5e79eeb4c tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:56.912468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-781b2a7b-d7c1-4624-87fd-f5c5e79eeb4c tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:56.913684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-781b2a7b-d7c1-4624-87fd-f5c5e79eeb4c tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:56.914415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-781b2a7b-d7c1-4624-87fd-f5c5e79eeb4c tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:56.915126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-781b2a7b-d7c1-4624-87fd-f5c5e79eeb4c tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:57.202190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-781b2a7b-d7c1-4624-87fd-f5c5e79eeb4c tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:57.212116 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-781b2a7b-d7c1-4624-87fd-f5c5e79eeb4c tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1471 microversion: 2.1 time: 0.324059 Aug 18 12:10:57.226811 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3199/5853] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:56 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1471 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:57.450646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9a497e22-48b5-4033-9934-2ff689f59ba7 req-8acd696e-cbec-457b-9a85-e30043f44bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b3b387-16ee-4cf9-b49b-20fb8ba04621", "tag": "ba39fd07-f729-44f3-9319-62872adb2134"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:10:57.462796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9a497e22-48b5-4033-9934-2ff689f59ba7 req-8acd696e-cbec-457b-9a85-e30043f44bd6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:57.463298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9a497e22-48b5-4033-9934-2ff689f59ba7 req-8acd696e-cbec-457b-9a85-e30043f44bd6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:57.464019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9a497e22-48b5-4033-9934-2ff689f59ba7 req-8acd696e-cbec-457b-9a85-e30043f44bd6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:57.476893 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9a497e22-48b5-4033-9934-2ff689f59ba7 req-8acd696e-cbec-457b-9a85-e30043f44bd6 service nova] Creating event network-changed:ba39fd07-f729-44f3-9319-62872adb2134 for instance 02b3b387-16ee-4cf9-b49b-20fb8ba04621 on n-h2-853611-3 Aug 18 12:10:57.482833 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9a497e22-48b5-4033-9934-2ff689f59ba7 req-8acd696e-cbec-457b-9a85-e30043f44bd6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036889 Aug 18 12:10:57.484115 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3200/5854] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:10:57.490578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-656b580b-f216-470a-ae54-2254eeb0c341 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:57.491289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-656b580b-f216-470a-ae54-2254eeb0c341 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:57.499053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-656b580b-f216-470a-ae54-2254eeb0c341 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:57.499641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-656b580b-f216-470a-ae54-2254eeb0c341 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:57.500120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-656b580b-f216-470a-ae54-2254eeb0c341 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:57.500860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-656b580b-f216-470a-ae54-2254eeb0c341 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:57.501330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-656b580b-f216-470a-ae54-2254eeb0c341 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:57.501789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-656b580b-f216-470a-ae54-2254eeb0c341 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:57.689755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-656b580b-f216-470a-ae54-2254eeb0c341 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:57.700058 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-656b580b-f216-470a-ae54-2254eeb0c341 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1694 microversion: 2.1 time: 0.213809 Aug 18 12:10:57.700863 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3201/5855] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:57 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1694 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:57.732074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a6239947-fa87-4e82-830a-a2ade26d72c5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:57.732980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a6239947-fa87-4e82-830a-a2ade26d72c5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:57.741601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6239947-fa87-4e82-830a-a2ade26d72c5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:57.742235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6239947-fa87-4e82-830a-a2ade26d72c5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:57.742726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6239947-fa87-4e82-830a-a2ade26d72c5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:57.744941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6239947-fa87-4e82-830a-a2ade26d72c5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:57.744941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6239947-fa87-4e82-830a-a2ade26d72c5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:57.744941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6239947-fa87-4e82-830a-a2ade26d72c5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:57.993100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a6239947-fa87-4e82-830a-a2ade26d72c5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:58.001903 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a6239947-fa87-4e82-830a-a2ade26d72c5 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1374 microversion: 2.1 time: 0.275225 Aug 18 12:10:58.002542 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3202/5856] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:57 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1374 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:58.240602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-95b859ca-d09f-4259-9a61-eace69721122 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:58.241146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-95b859ca-d09f-4259-9a61-eace69721122 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:58.248806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95b859ca-d09f-4259-9a61-eace69721122 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:58.249300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95b859ca-d09f-4259-9a61-eace69721122 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:58.249743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95b859ca-d09f-4259-9a61-eace69721122 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:58.250498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95b859ca-d09f-4259-9a61-eace69721122 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:58.250962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95b859ca-d09f-4259-9a61-eace69721122 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:58.251397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95b859ca-d09f-4259-9a61-eace69721122 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:58.447872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-95b859ca-d09f-4259-9a61-eace69721122 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:58.461901 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-95b859ca-d09f-4259-9a61-eace69721122 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1471 microversion: 2.1 time: 0.224928 Aug 18 12:10:58.463412 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3203/5857] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:58 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1471 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:10:58.738227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-28c39e4d-c762-4fad-9e70-ab8567cb82e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:58.739243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-28c39e4d-c762-4fad-9e70-ab8567cb82e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:58.748367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28c39e4d-c762-4fad-9e70-ab8567cb82e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:58.749620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28c39e4d-c762-4fad-9e70-ab8567cb82e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:58.750261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28c39e4d-c762-4fad-9e70-ab8567cb82e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:58.751296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28c39e4d-c762-4fad-9e70-ab8567cb82e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:58.751974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28c39e4d-c762-4fad-9e70-ab8567cb82e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:58.752624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28c39e4d-c762-4fad-9e70-ab8567cb82e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:58.973966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-28c39e4d-c762-4fad-9e70-ab8567cb82e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:59.000124 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-28c39e4d-c762-4fad-9e70-ab8567cb82e8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1694 microversion: 2.1 time: 0.267741 Aug 18 12:10:59.009643 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3204/5858] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:58 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1694 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:10:59.024545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e06f189d-d108-486a-b4dc-843c0acce7dd tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:59.025171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e06f189d-d108-486a-b4dc-843c0acce7dd tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:59.032921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e06f189d-d108-486a-b4dc-843c0acce7dd tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:59.033424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e06f189d-d108-486a-b4dc-843c0acce7dd tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:59.034089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e06f189d-d108-486a-b4dc-843c0acce7dd tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:59.034732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e06f189d-d108-486a-b4dc-843c0acce7dd tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:59.035202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e06f189d-d108-486a-b4dc-843c0acce7dd tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:59.035629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e06f189d-d108-486a-b4dc-843c0acce7dd tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:59.216685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e06f189d-d108-486a-b4dc-843c0acce7dd tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:59.226150 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e06f189d-d108-486a-b4dc-843c0acce7dd tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1374 microversion: 2.1 time: 0.205690 Aug 18 12:10:59.226802 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3205/5859] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:59 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1374 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:10:59.505887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c1c4e105-c006-4b49-a16e-90d5e699eb78 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:10:59.507474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c1c4e105-c006-4b49-a16e-90d5e699eb78 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:10:59.523221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c4e105-c006-4b49-a16e-90d5e699eb78 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:59.525562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c4e105-c006-4b49-a16e-90d5e699eb78 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:59.527321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c4e105-c006-4b49-a16e-90d5e699eb78 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:59.528452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c4e105-c006-4b49-a16e-90d5e699eb78 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:10:59.529449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c4e105-c006-4b49-a16e-90d5e699eb78 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:10:59.530152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c4e105-c006-4b49-a16e-90d5e699eb78 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:10:59.795130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c1c4e105-c006-4b49-a16e-90d5e699eb78 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:10:59.804234 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c1c4e105-c006-4b49-a16e-90d5e699eb78 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1471 microversion: 2.1 time: 0.306222 Aug 18 12:10:59.804931 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3206/5860] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:10:59 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1471 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:00.040679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e54ef481-2964-4afd-ac75-49e17513873b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:00.045119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e54ef481-2964-4afd-ac75-49e17513873b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:00.063310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e54ef481-2964-4afd-ac75-49e17513873b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:00.065054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e54ef481-2964-4afd-ac75-49e17513873b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:00.065524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e54ef481-2964-4afd-ac75-49e17513873b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:00.066295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e54ef481-2964-4afd-ac75-49e17513873b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:00.066817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e54ef481-2964-4afd-ac75-49e17513873b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:00.067256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e54ef481-2964-4afd-ac75-49e17513873b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:00.327375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e54ef481-2964-4afd-ac75-49e17513873b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:00.338534 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e54ef481-2964-4afd-ac75-49e17513873b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1693 microversion: 2.1 time: 0.306224 Aug 18 12:11:00.355346 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3207/5861] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:00 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1693 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:11:00.361007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df013189-493f-428a-90d5-bb9c89cbc703 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:00.362019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df013189-493f-428a-90d5-bb9c89cbc703 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:00.369311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df013189-493f-428a-90d5-bb9c89cbc703 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:00.370795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df013189-493f-428a-90d5-bb9c89cbc703 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:00.371493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df013189-493f-428a-90d5-bb9c89cbc703 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:00.372466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df013189-493f-428a-90d5-bb9c89cbc703 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:00.373159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df013189-493f-428a-90d5-bb9c89cbc703 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:00.373823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df013189-493f-428a-90d5-bb9c89cbc703 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:00.379461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:11:00.580690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df013189-493f-428a-90d5-bb9c89cbc703 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:00.615202 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df013189-493f-428a-90d5-bb9c89cbc703 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1374 microversion: 2.1 time: 0.257929 Aug 18 12:11:00.619434 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3208/5862] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:00 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1374 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:00.634795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2cdbbbcd-f17f-445f-a027-4198c6c64d7e req-e51bdad4-2001-4155-a990-59e83429c5eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f1edc6-59e0-4f7c-96c7-7b369020eaf9", "name": "network-vif-unplugged", "status": "completed", "tag": "f28d24fe-2bff-4919-b8aa-de06d7a2f574"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:00.659641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2cdbbbcd-f17f-445f-a027-4198c6c64d7e req-e51bdad4-2001-4155-a990-59e83429c5eb service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:00.661177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2cdbbbcd-f17f-445f-a027-4198c6c64d7e req-e51bdad4-2001-4155-a990-59e83429c5eb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:00.662904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2cdbbbcd-f17f-445f-a027-4198c6c64d7e req-e51bdad4-2001-4155-a990-59e83429c5eb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:00.733858 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2cdbbbcd-f17f-445f-a027-4198c6c64d7e req-e51bdad4-2001-4155-a990-59e83429c5eb service nova] Creating event network-vif-unplugged:f28d24fe-2bff-4919-b8aa-de06d7a2f574 for instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 on n-h2-853611-3 Aug 18 12:11:00.748349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-2cdbbbcd-f17f-445f-a027-4198c6c64d7e req-e51bdad4-2001-4155-a990-59e83429c5eb service nova] Instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:11:00.781198 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2cdbbbcd-f17f-445f-a027-4198c6c64d7e req-e51bdad4-2001-4155-a990-59e83429c5eb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156410 Aug 18 12:11:00.782301 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3209/5863] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:11:00.836268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c743646-e750-4fd6-97b0-10350a709075 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:00.837990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c743646-e750-4fd6-97b0-10350a709075 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:00.850545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c743646-e750-4fd6-97b0-10350a709075 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:00.851773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c743646-e750-4fd6-97b0-10350a709075 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:00.852582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c743646-e750-4fd6-97b0-10350a709075 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:00.853859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c743646-e750-4fd6-97b0-10350a709075 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:00.855521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c743646-e750-4fd6-97b0-10350a709075 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:00.856299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c743646-e750-4fd6-97b0-10350a709075 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:01.151943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9c743646-e750-4fd6-97b0-10350a709075 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:01.162908 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c743646-e750-4fd6-97b0-10350a709075 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1471 microversion: 2.1 time: 0.336156 Aug 18 12:11:01.164004 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3210/5864] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:00 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1471 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:11:01.366108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ba04660-c738-48fb-ac16-caa200c059bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:01.367834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6ba04660-c738-48fb-ac16-caa200c059bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:01.380624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ba04660-c738-48fb-ac16-caa200c059bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:01.381640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ba04660-c738-48fb-ac16-caa200c059bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:01.382631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ba04660-c738-48fb-ac16-caa200c059bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:01.384056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ba04660-c738-48fb-ac16-caa200c059bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:01.384960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ba04660-c738-48fb-ac16-caa200c059bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:01.386253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ba04660-c738-48fb-ac16-caa200c059bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:01.591456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:11:01.660781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6ba04660-c738-48fb-ac16-caa200c059bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:01.670880 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6ba04660-c738-48fb-ac16-caa200c059bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1693 microversion: 2.1 time: 0.311353 Aug 18 12:11:01.671496 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3211/5865] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:01 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1693 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:11:01.677629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99c898bf-3da7-4ef7-8c99-79c3dd3b5bc2 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:01.678633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-99c898bf-3da7-4ef7-8c99-79c3dd3b5bc2 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:01.692995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99c898bf-3da7-4ef7-8c99-79c3dd3b5bc2 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:01.693940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99c898bf-3da7-4ef7-8c99-79c3dd3b5bc2 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:01.694776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99c898bf-3da7-4ef7-8c99-79c3dd3b5bc2 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:01.695736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99c898bf-3da7-4ef7-8c99-79c3dd3b5bc2 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:01.696424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99c898bf-3da7-4ef7-8c99-79c3dd3b5bc2 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:01.697059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99c898bf-3da7-4ef7-8c99-79c3dd3b5bc2 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:01.996927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-99c898bf-3da7-4ef7-8c99-79c3dd3b5bc2 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:02.010167 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-99c898bf-3da7-4ef7-8c99-79c3dd3b5bc2 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1374 microversion: 2.1 time: 0.336906 Aug 18 12:11:02.010887 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3212/5866] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:01 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1374 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:02.194453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8703d2f1-a86b-4009-a8d7-a19c9c23f8ef tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:02.195329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8703d2f1-a86b-4009-a8d7-a19c9c23f8ef tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:02.211662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8703d2f1-a86b-4009-a8d7-a19c9c23f8ef tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:02.214865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8703d2f1-a86b-4009-a8d7-a19c9c23f8ef tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:02.216266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8703d2f1-a86b-4009-a8d7-a19c9c23f8ef tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:02.218407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8703d2f1-a86b-4009-a8d7-a19c9c23f8ef tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:02.220532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8703d2f1-a86b-4009-a8d7-a19c9c23f8ef tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:02.221196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8703d2f1-a86b-4009-a8d7-a19c9c23f8ef tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:02.509303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=18 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:11:02.625489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8703d2f1-a86b-4009-a8d7-a19c9c23f8ef tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:02.657394 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8703d2f1-a86b-4009-a8d7-a19c9c23f8ef tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1471 microversion: 2.1 time: 0.467149 Aug 18 12:11:02.661366 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3213/5867] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:02 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1471 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:02.722328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab7defab-7016-4285-8887-6c80fbbbb51c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:02.724310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ab7defab-7016-4285-8887-6c80fbbbb51c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:02.738158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab7defab-7016-4285-8887-6c80fbbbb51c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:02.738987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab7defab-7016-4285-8887-6c80fbbbb51c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:02.739628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab7defab-7016-4285-8887-6c80fbbbb51c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:02.741413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab7defab-7016-4285-8887-6c80fbbbb51c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:02.746605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab7defab-7016-4285-8887-6c80fbbbb51c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:02.747368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab7defab-7016-4285-8887-6c80fbbbb51c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:03.101760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ab7defab-7016-4285-8887-6c80fbbbb51c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:03.114929 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab7defab-7016-4285-8887-6c80fbbbb51c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1693 microversion: 2.1 time: 0.397977 Aug 18 12:11:03.116278 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3214/5868] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:02 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1693 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:03.121925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-70f0cf2f-a867-4da0-84ef-93fb7be52ffe req-31ec1a6a-0d0b-4f45-a9b2-c2d188ee20ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f1edc6-59e0-4f7c-96c7-7b369020eaf9", "tag": "f28d24fe-2bff-4919-b8aa-de06d7a2f574"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:03.134304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-70f0cf2f-a867-4da0-84ef-93fb7be52ffe req-31ec1a6a-0d0b-4f45-a9b2-c2d188ee20ba service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:03.135116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-70f0cf2f-a867-4da0-84ef-93fb7be52ffe req-31ec1a6a-0d0b-4f45-a9b2-c2d188ee20ba service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:03.135969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-70f0cf2f-a867-4da0-84ef-93fb7be52ffe req-31ec1a6a-0d0b-4f45-a9b2-c2d188ee20ba service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:03.151748 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-70f0cf2f-a867-4da0-84ef-93fb7be52ffe req-31ec1a6a-0d0b-4f45-a9b2-c2d188ee20ba service nova] Creating event network-changed:f28d24fe-2bff-4919-b8aa-de06d7a2f574 for instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 on n-h2-853611-3 Aug 18 12:11:03.158699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-70f0cf2f-a867-4da0-84ef-93fb7be52ffe req-31ec1a6a-0d0b-4f45-a9b2-c2d188ee20ba service nova] Instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:11:03.172843 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-70f0cf2f-a867-4da0-84ef-93fb7be52ffe req-31ec1a6a-0d0b-4f45-a9b2-c2d188ee20ba service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054945 Aug 18 12:11:03.174105 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3215/5869] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:11:03.320745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ad2fc663-3dbc-480c-bd1a-c8c90831fe40 req-e4561d95-86ad-4c90-8d82-9ae977d2ffc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e77fafc-08a7-43f8-bf7f-97891d521eaa", "name": "network-vif-plugged", "status": "completed", "tag": "061fca7d-153a-4d50-ac8f-4846423f3180"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:03.334405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ad2fc663-3dbc-480c-bd1a-c8c90831fe40 req-e4561d95-86ad-4c90-8d82-9ae977d2ffc2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:03.335023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ad2fc663-3dbc-480c-bd1a-c8c90831fe40 req-e4561d95-86ad-4c90-8d82-9ae977d2ffc2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:03.335534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ad2fc663-3dbc-480c-bd1a-c8c90831fe40 req-e4561d95-86ad-4c90-8d82-9ae977d2ffc2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:03.349786 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ad2fc663-3dbc-480c-bd1a-c8c90831fe40 req-e4561d95-86ad-4c90-8d82-9ae977d2ffc2 service nova] Creating event network-vif-plugged:061fca7d-153a-4d50-ac8f-4846423f3180 for instance 6e77fafc-08a7-43f8-bf7f-97891d521eaa on n-h1-853611-3 Aug 18 12:11:03.356681 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ad2fc663-3dbc-480c-bd1a-c8c90831fe40 req-e4561d95-86ad-4c90-8d82-9ae977d2ffc2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181133 Aug 18 12:11:03.358120 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3216/5870] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:11:03.364373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc0f9f54-ba31-4a2c-9a97-777e49e98563 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:03.365741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dc0f9f54-ba31-4a2c-9a97-777e49e98563 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:03.382940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc0f9f54-ba31-4a2c-9a97-777e49e98563 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:03.383571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc0f9f54-ba31-4a2c-9a97-777e49e98563 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:03.384079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc0f9f54-ba31-4a2c-9a97-777e49e98563 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:03.384936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc0f9f54-ba31-4a2c-9a97-777e49e98563 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:03.386378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc0f9f54-ba31-4a2c-9a97-777e49e98563 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:03.393423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc0f9f54-ba31-4a2c-9a97-777e49e98563 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:03.673356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dc0f9f54-ba31-4a2c-9a97-777e49e98563 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:03.706098 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dc0f9f54-ba31-4a2c-9a97-777e49e98563 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1374 microversion: 2.1 time: 0.346746 Aug 18 12:11:03.707106 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3217/5871] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:03 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1374 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:03.728395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7ab0d323-65ed-43cd-af59-e70618938ee4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:03.728395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7ab0d323-65ed-43cd-af59-e70618938ee4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:03.735145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ab0d323-65ed-43cd-af59-e70618938ee4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:03.735748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ab0d323-65ed-43cd-af59-e70618938ee4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:03.736268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ab0d323-65ed-43cd-af59-e70618938ee4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:03.737082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ab0d323-65ed-43cd-af59-e70618938ee4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:03.737623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ab0d323-65ed-43cd-af59-e70618938ee4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:03.738131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ab0d323-65ed-43cd-af59-e70618938ee4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:03.966805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7ab0d323-65ed-43cd-af59-e70618938ee4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:04.016720 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7ab0d323-65ed-43cd-af59-e70618938ee4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1471 microversion: 2.1 time: 0.294180 Aug 18 12:11:04.023480 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3218/5872] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:03 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1471 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:04.142062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7884af44-32c3-49fb-895d-897bbb119493 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:04.143073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7884af44-32c3-49fb-895d-897bbb119493 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:04.155649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7884af44-32c3-49fb-895d-897bbb119493 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:04.156450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7884af44-32c3-49fb-895d-897bbb119493 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:04.157233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7884af44-32c3-49fb-895d-897bbb119493 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:04.158602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7884af44-32c3-49fb-895d-897bbb119493 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:04.159421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7884af44-32c3-49fb-895d-897bbb119493 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:04.160166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7884af44-32c3-49fb-895d-897bbb119493 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:04.390734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7884af44-32c3-49fb-895d-897bbb119493 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:04.400016 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7884af44-32c3-49fb-895d-897bbb119493 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1691 microversion: 2.1 time: 0.261935 Aug 18 12:11:04.400950 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3219/5873] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:04 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1691 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:04.740390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-038ab937-6a03-43e7-9f85-add780ceb900 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:04.741149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-038ab937-6a03-43e7-9f85-add780ceb900 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:04.750692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-038ab937-6a03-43e7-9f85-add780ceb900 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:04.751187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-038ab937-6a03-43e7-9f85-add780ceb900 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:04.751626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-038ab937-6a03-43e7-9f85-add780ceb900 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:04.752346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-038ab937-6a03-43e7-9f85-add780ceb900 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:04.752802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-038ab937-6a03-43e7-9f85-add780ceb900 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:04.753233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-038ab937-6a03-43e7-9f85-add780ceb900 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:04.935791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-038ab937-6a03-43e7-9f85-add780ceb900 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:04.944228 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-038ab937-6a03-43e7-9f85-add780ceb900 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1374 microversion: 2.1 time: 0.207714 Aug 18 12:11:04.944834 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3220/5874] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:04 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1374 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:11:05.041090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-144ef3c9-3d7f-4732-94db-8a8ec8a37474 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:05.042102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-144ef3c9-3d7f-4732-94db-8a8ec8a37474 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:05.049444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-144ef3c9-3d7f-4732-94db-8a8ec8a37474 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:05.049941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-144ef3c9-3d7f-4732-94db-8a8ec8a37474 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:05.050390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-144ef3c9-3d7f-4732-94db-8a8ec8a37474 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:05.051174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-144ef3c9-3d7f-4732-94db-8a8ec8a37474 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:05.051641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-144ef3c9-3d7f-4732-94db-8a8ec8a37474 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:05.052072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-144ef3c9-3d7f-4732-94db-8a8ec8a37474 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:05.227896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-144ef3c9-3d7f-4732-94db-8a8ec8a37474 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:05.236775 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-144ef3c9-3d7f-4732-94db-8a8ec8a37474 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1644 microversion: 2.1 time: 0.199944 Aug 18 12:11:05.237289 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3221/5875] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:05 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1644 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:11:05.257250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e0383db7-650a-4fec-a598-c187c07fe387 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:05.257877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e0383db7-650a-4fec-a598-c187c07fe387 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:05.264819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0383db7-650a-4fec-a598-c187c07fe387 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:05.265314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0383db7-650a-4fec-a598-c187c07fe387 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:05.265755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0383db7-650a-4fec-a598-c187c07fe387 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:05.266507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0383db7-650a-4fec-a598-c187c07fe387 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:05.266969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0383db7-650a-4fec-a598-c187c07fe387 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:05.267396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0383db7-650a-4fec-a598-c187c07fe387 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:05.449459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e0383db7-650a-4fec-a598-c187c07fe387 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:05.460604 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e0383db7-650a-4fec-a598-c187c07fe387 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1644 microversion: 2.1 time: 0.207179 Aug 18 12:11:05.461811 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3222/5876] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:05 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1644 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:11:05.467446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-daad7a81-ed44-4419-8bce-db72d43ae332 req-c07438ce-71ae-4585-8e86-a88b7237b14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b3b387-16ee-4cf9-b49b-20fb8ba04621", "name": "network-vif-plugged", "status": "completed", "tag": "ba39fd07-f729-44f3-9319-62872adb2134"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:05.479151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-daad7a81-ed44-4419-8bce-db72d43ae332 req-c07438ce-71ae-4585-8e86-a88b7237b14a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:05.479721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-daad7a81-ed44-4419-8bce-db72d43ae332 req-c07438ce-71ae-4585-8e86-a88b7237b14a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:05.480584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-daad7a81-ed44-4419-8bce-db72d43ae332 req-c07438ce-71ae-4585-8e86-a88b7237b14a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:05.492679 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-daad7a81-ed44-4419-8bce-db72d43ae332 req-c07438ce-71ae-4585-8e86-a88b7237b14a service nova] Creating event network-vif-plugged:ba39fd07-f729-44f3-9319-62872adb2134 for instance 02b3b387-16ee-4cf9-b49b-20fb8ba04621 on n-h2-853611-3 Aug 18 12:11:05.498603 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-daad7a81-ed44-4419-8bce-db72d43ae332 req-c07438ce-71ae-4585-8e86-a88b7237b14a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034910 Aug 18 12:11:05.499578 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3223/5877] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:11:05.504946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d306ea7b-008d-4eb5-baed-29f7d01ebd2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:05.505654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d306ea7b-008d-4eb5-baed-29f7d01ebd2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:05.515251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d306ea7b-008d-4eb5-baed-29f7d01ebd2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:05.515759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d306ea7b-008d-4eb5-baed-29f7d01ebd2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:05.516210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d306ea7b-008d-4eb5-baed-29f7d01ebd2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:05.516937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d306ea7b-008d-4eb5-baed-29f7d01ebd2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:05.517776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d306ea7b-008d-4eb5-baed-29f7d01ebd2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:05.518222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d306ea7b-008d-4eb5-baed-29f7d01ebd2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:05.770710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d306ea7b-008d-4eb5-baed-29f7d01ebd2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:05.780831 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d306ea7b-008d-4eb5-baed-29f7d01ebd2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1688 microversion: 2.1 time: 0.279971 Aug 18 12:11:05.781545 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3224/5878] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:05 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1688 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:05.786719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7c73281-1c6e-400e-8cb1-b2ee12b2553f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:05.787706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a7c73281-1c6e-400e-8cb1-b2ee12b2553f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:05.800890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7c73281-1c6e-400e-8cb1-b2ee12b2553f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:05.801789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7c73281-1c6e-400e-8cb1-b2ee12b2553f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:05.803268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7c73281-1c6e-400e-8cb1-b2ee12b2553f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:05.805626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7c73281-1c6e-400e-8cb1-b2ee12b2553f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:05.806510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7c73281-1c6e-400e-8cb1-b2ee12b2553f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:05.807202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7c73281-1c6e-400e-8cb1-b2ee12b2553f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:06.269842 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a7c73281-1c6e-400e-8cb1-b2ee12b2553f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1795 microversion: 2.1 time: 0.486503 Aug 18 12:11:06.270713 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3225/5879] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:05 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1795 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:06.279934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ca433084-704c-4b1a-b268-f2918feaac3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:06.280530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ca433084-704c-4b1a-b268-f2918feaac3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:06.289264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca433084-704c-4b1a-b268-f2918feaac3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:06.289796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca433084-704c-4b1a-b268-f2918feaac3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:06.290253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca433084-704c-4b1a-b268-f2918feaac3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:06.291037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca433084-704c-4b1a-b268-f2918feaac3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:06.291510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca433084-704c-4b1a-b268-f2918feaac3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:06.291946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca433084-704c-4b1a-b268-f2918feaac3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:06.347971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:11:06.852120 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ca433084-704c-4b1a-b268-f2918feaac3a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9/action" status: 202 len: 0 microversion: 2.1 time: 0.578920 Aug 18 12:11:06.852974 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3226/5880] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:11:06 2022] POST /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:11:06.859157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d23eba44-899c-4a8d-975e-5a7a93af1228 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:06.859876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d23eba44-899c-4a8d-975e-5a7a93af1228 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:06.866916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d23eba44-899c-4a8d-975e-5a7a93af1228 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:06.867475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d23eba44-899c-4a8d-975e-5a7a93af1228 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:06.867960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d23eba44-899c-4a8d-975e-5a7a93af1228 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:06.868768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d23eba44-899c-4a8d-975e-5a7a93af1228 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:06.869815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d23eba44-899c-4a8d-975e-5a7a93af1228 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:06.871879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d23eba44-899c-4a8d-975e-5a7a93af1228 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:07.137769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d23eba44-899c-4a8d-975e-5a7a93af1228 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:07.147675 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d23eba44-899c-4a8d-975e-5a7a93af1228 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1374 microversion: 2.1 time: 0.293385 Aug 18 12:11:07.148272 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3227/5881] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:06 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1374 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:07.155482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b84747c8-a632-46f7-9f58-1a715ebf329f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:07.158314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b84747c8-a632-46f7-9f58-1a715ebf329f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:07.180502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b84747c8-a632-46f7-9f58-1a715ebf329f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:07.181080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b84747c8-a632-46f7-9f58-1a715ebf329f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:07.181646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b84747c8-a632-46f7-9f58-1a715ebf329f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:07.182468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b84747c8-a632-46f7-9f58-1a715ebf329f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:07.184002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b84747c8-a632-46f7-9f58-1a715ebf329f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:07.184524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b84747c8-a632-46f7-9f58-1a715ebf329f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:07.520838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b84747c8-a632-46f7-9f58-1a715ebf329f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:07.534189 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b84747c8-a632-46f7-9f58-1a715ebf329f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1687 microversion: 2.1 time: 0.380222 Aug 18 12:11:07.534806 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3228/5882] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:07 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1687 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:07.861601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-aa80bccc-6ab3-48e2-a585-889b6343f7ad req-2faa9371-8576-4cdb-8d2a-8c4f560ef7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f1edc6-59e0-4f7c-96c7-7b369020eaf9", "name": "network-vif-plugged", "status": "completed", "tag": "f28d24fe-2bff-4919-b8aa-de06d7a2f574"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:07.882898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aa80bccc-6ab3-48e2-a585-889b6343f7ad req-2faa9371-8576-4cdb-8d2a-8c4f560ef7ec service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:07.883768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aa80bccc-6ab3-48e2-a585-889b6343f7ad req-2faa9371-8576-4cdb-8d2a-8c4f560ef7ec service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:07.884419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-aa80bccc-6ab3-48e2-a585-889b6343f7ad req-2faa9371-8576-4cdb-8d2a-8c4f560ef7ec service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:07.921977 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-aa80bccc-6ab3-48e2-a585-889b6343f7ad req-2faa9371-8576-4cdb-8d2a-8c4f560ef7ec service nova] Creating event network-vif-plugged:f28d24fe-2bff-4919-b8aa-de06d7a2f574 for instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 on n-h2-853611-3 Aug 18 12:11:07.937617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-aa80bccc-6ab3-48e2-a585-889b6343f7ad req-2faa9371-8576-4cdb-8d2a-8c4f560ef7ec service nova] Instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:11:07.952841 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-aa80bccc-6ab3-48e2-a585-889b6343f7ad req-2faa9371-8576-4cdb-8d2a-8c4f560ef7ec service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095255 Aug 18 12:11:07.954146 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3229/5883] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:11:08.190049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-808823bc-163d-456d-b31e-1e70b1d07caf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:08.191069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-808823bc-163d-456d-b31e-1e70b1d07caf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:08.202091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808823bc-163d-456d-b31e-1e70b1d07caf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:08.202875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808823bc-163d-456d-b31e-1e70b1d07caf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:08.203497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808823bc-163d-456d-b31e-1e70b1d07caf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:08.204500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808823bc-163d-456d-b31e-1e70b1d07caf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:08.205233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808823bc-163d-456d-b31e-1e70b1d07caf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:08.206059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808823bc-163d-456d-b31e-1e70b1d07caf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:08.499571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-808823bc-163d-456d-b31e-1e70b1d07caf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:08.527596 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-808823bc-163d-456d-b31e-1e70b1d07caf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1547 microversion: 2.1 time: 0.345344 Aug 18 12:11:08.531386 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3230/5884] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:08 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1547 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:11:08.557219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2edf7008-2d35-4797-a62d-4dc082a41cd8 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:08.559058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2edf7008-2d35-4797-a62d-4dc082a41cd8 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:08.570939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edf7008-2d35-4797-a62d-4dc082a41cd8 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:08.571854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edf7008-2d35-4797-a62d-4dc082a41cd8 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:08.572668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edf7008-2d35-4797-a62d-4dc082a41cd8 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:08.574128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edf7008-2d35-4797-a62d-4dc082a41cd8 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:08.575550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edf7008-2d35-4797-a62d-4dc082a41cd8 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:08.576370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2edf7008-2d35-4797-a62d-4dc082a41cd8 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:09.320004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2edf7008-2d35-4797-a62d-4dc082a41cd8 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:09.336117 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2edf7008-2d35-4797-a62d-4dc082a41cd8 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1547 microversion: 2.1 time: 0.787853 Aug 18 12:11:09.337730 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3231/5885] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:08 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1547 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:09.347970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-956151e5-7ad3-4bf4-ab42-8d0a9d73f1a2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:09.349436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-956151e5-7ad3-4bf4-ab42-8d0a9d73f1a2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:09.362242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-956151e5-7ad3-4bf4-ab42-8d0a9d73f1a2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:09.363885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-956151e5-7ad3-4bf4-ab42-8d0a9d73f1a2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:09.364998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-956151e5-7ad3-4bf4-ab42-8d0a9d73f1a2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:09.366707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-956151e5-7ad3-4bf4-ab42-8d0a9d73f1a2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:09.367971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-956151e5-7ad3-4bf4-ab42-8d0a9d73f1a2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:09.372916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-956151e5-7ad3-4bf4-ab42-8d0a9d73f1a2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:09.830831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-956151e5-7ad3-4bf4-ab42-8d0a9d73f1a2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:09.849216 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-956151e5-7ad3-4bf4-ab42-8d0a9d73f1a2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1687 microversion: 2.1 time: 0.508335 Aug 18 12:11:09.851308 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3232/5886] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:09 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1687 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:10.123659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f7853c57-8b70-4677-b065-0b0780e3723d req-1b550a22-47d3-4f16-815d-58f65897776a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e77fafc-08a7-43f8-bf7f-97891d521eaa", "tag": "061fca7d-153a-4d50-ac8f-4846423f3180"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:10.145704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f7853c57-8b70-4677-b065-0b0780e3723d req-1b550a22-47d3-4f16-815d-58f65897776a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:10.148618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f7853c57-8b70-4677-b065-0b0780e3723d req-1b550a22-47d3-4f16-815d-58f65897776a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:10.150235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f7853c57-8b70-4677-b065-0b0780e3723d req-1b550a22-47d3-4f16-815d-58f65897776a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:10.179373 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f7853c57-8b70-4677-b065-0b0780e3723d req-1b550a22-47d3-4f16-815d-58f65897776a service nova] Creating event network-changed:061fca7d-153a-4d50-ac8f-4846423f3180 for instance 6e77fafc-08a7-43f8-bf7f-97891d521eaa on n-h1-853611-3 Aug 18 12:11:10.191477 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f7853c57-8b70-4677-b065-0b0780e3723d req-1b550a22-47d3-4f16-815d-58f65897776a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076556 Aug 18 12:11:10.202594 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3233/5887] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:11:10.887816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59717695-28e9-4bbc-b7d5-aa9c0f77e13f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:10.888680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59717695-28e9-4bbc-b7d5-aa9c0f77e13f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:10.920933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59717695-28e9-4bbc-b7d5-aa9c0f77e13f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:10.921840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59717695-28e9-4bbc-b7d5-aa9c0f77e13f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:10.922694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59717695-28e9-4bbc-b7d5-aa9c0f77e13f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:10.924288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59717695-28e9-4bbc-b7d5-aa9c0f77e13f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:10.925265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59717695-28e9-4bbc-b7d5-aa9c0f77e13f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:10.926129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59717695-28e9-4bbc-b7d5-aa9c0f77e13f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:11.665566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-59717695-28e9-4bbc-b7d5-aa9c0f77e13f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:11.693970 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59717695-28e9-4bbc-b7d5-aa9c0f77e13f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1687 microversion: 2.1 time: 0.812777 Aug 18 12:11:11.707692 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3234/5888] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:10 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1687 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:12.474134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-dccdcdf7-3f20-4e41-9248-874d3c93cecd req-ba0bb533-b43c-4c34-9910-b400b094a6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f1edc6-59e0-4f7c-96c7-7b369020eaf9", "name": "network-vif-unplugged", "status": "completed", "tag": "f28d24fe-2bff-4919-b8aa-de06d7a2f574"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:12.494384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-dccdcdf7-3f20-4e41-9248-874d3c93cecd req-ba0bb533-b43c-4c34-9910-b400b094a6e3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:12.501540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-dccdcdf7-3f20-4e41-9248-874d3c93cecd req-ba0bb533-b43c-4c34-9910-b400b094a6e3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:12.502750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-dccdcdf7-3f20-4e41-9248-874d3c93cecd req-ba0bb533-b43c-4c34-9910-b400b094a6e3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:12.524801 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-dccdcdf7-3f20-4e41-9248-874d3c93cecd req-ba0bb533-b43c-4c34-9910-b400b094a6e3 service nova] Creating event network-vif-unplugged:f28d24fe-2bff-4919-b8aa-de06d7a2f574 for instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 on n-h1-853611-3 Aug 18 12:11:12.540066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-dccdcdf7-3f20-4e41-9248-874d3c93cecd req-ba0bb533-b43c-4c34-9910-b400b094a6e3 service nova] Instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:11:12.569001 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-dccdcdf7-3f20-4e41-9248-874d3c93cecd req-ba0bb533-b43c-4c34-9910-b400b094a6e3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101262 Aug 18 12:11:12.572174 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3235/5889] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:11:12.760724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a93668b6-fc91-4eb0-b7f2-88f195e4a1e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:12.765811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a93668b6-fc91-4eb0-b7f2-88f195e4a1e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:12.782904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a93668b6-fc91-4eb0-b7f2-88f195e4a1e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:12.784505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a93668b6-fc91-4eb0-b7f2-88f195e4a1e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:12.786011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a93668b6-fc91-4eb0-b7f2-88f195e4a1e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:12.787534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a93668b6-fc91-4eb0-b7f2-88f195e4a1e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:12.788495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a93668b6-fc91-4eb0-b7f2-88f195e4a1e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:12.790587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a93668b6-fc91-4eb0-b7f2-88f195e4a1e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:13.268661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a93668b6-fc91-4eb0-b7f2-88f195e4a1e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:13.279737 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a93668b6-fc91-4eb0-b7f2-88f195e4a1e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1687 microversion: 2.1 time: 0.533425 Aug 18 12:11:13.298841 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3236/5890] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:12 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1687 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:14.310021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a6617427-6001-4aba-9982-84b6cbf47224 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:14.311204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a6617427-6001-4aba-9982-84b6cbf47224 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:14.336136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6617427-6001-4aba-9982-84b6cbf47224 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:14.337463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6617427-6001-4aba-9982-84b6cbf47224 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:14.339109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6617427-6001-4aba-9982-84b6cbf47224 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:14.343215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6617427-6001-4aba-9982-84b6cbf47224 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:14.344517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6617427-6001-4aba-9982-84b6cbf47224 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:14.345714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6617427-6001-4aba-9982-84b6cbf47224 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:14.632000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a6617427-6001-4aba-9982-84b6cbf47224 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:14.688621 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a6617427-6001-4aba-9982-84b6cbf47224 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1687 microversion: 2.1 time: 0.386305 Aug 18 12:11:14.689667 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3237/5891] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:14 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1687 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:14.737834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a1ae7eae-19ae-4aea-8fa9-a30b5cc54102 req-2c78f338-d050-4480-9f19-473f3c2d08d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f1edc6-59e0-4f7c-96c7-7b369020eaf9", "tag": "f28d24fe-2bff-4919-b8aa-de06d7a2f574"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:14.758920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a1ae7eae-19ae-4aea-8fa9-a30b5cc54102 req-2c78f338-d050-4480-9f19-473f3c2d08d5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:14.759420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a1ae7eae-19ae-4aea-8fa9-a30b5cc54102 req-2c78f338-d050-4480-9f19-473f3c2d08d5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:14.759872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a1ae7eae-19ae-4aea-8fa9-a30b5cc54102 req-2c78f338-d050-4480-9f19-473f3c2d08d5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:14.784730 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a1ae7eae-19ae-4aea-8fa9-a30b5cc54102 req-2c78f338-d050-4480-9f19-473f3c2d08d5 service nova] Creating event network-changed:f28d24fe-2bff-4919-b8aa-de06d7a2f574 for instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 on n-h1-853611-3 Aug 18 12:11:14.796823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-a1ae7eae-19ae-4aea-8fa9-a30b5cc54102 req-2c78f338-d050-4480-9f19-473f3c2d08d5 service nova] Instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:11:14.810934 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a1ae7eae-19ae-4aea-8fa9-a30b5cc54102 req-2c78f338-d050-4480-9f19-473f3c2d08d5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076675 Aug 18 12:11:14.812209 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3238/5892] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:11:15.736741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3429dc52-360e-454c-84eb-2c9fed4a1326 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:15.737800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3429dc52-360e-454c-84eb-2c9fed4a1326 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:15.754357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:11:15.758354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3429dc52-360e-454c-84eb-2c9fed4a1326 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:15.759944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3429dc52-360e-454c-84eb-2c9fed4a1326 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:15.761821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3429dc52-360e-454c-84eb-2c9fed4a1326 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:15.766474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3429dc52-360e-454c-84eb-2c9fed4a1326 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:15.767213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3429dc52-360e-454c-84eb-2c9fed4a1326 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:15.769368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3429dc52-360e-454c-84eb-2c9fed4a1326 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:16.018951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3429dc52-360e-454c-84eb-2c9fed4a1326 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:16.035710 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3429dc52-360e-454c-84eb-2c9fed4a1326 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1687 microversion: 2.1 time: 0.306210 Aug 18 12:11:16.063227 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3239/5893] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:15 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1687 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:17.099504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-be6dbe56-006e-4cb6-bfba-28a51e67e032 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:17.100147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-be6dbe56-006e-4cb6-bfba-28a51e67e032 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:17.120593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be6dbe56-006e-4cb6-bfba-28a51e67e032 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:17.121907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be6dbe56-006e-4cb6-bfba-28a51e67e032 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:17.122606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be6dbe56-006e-4cb6-bfba-28a51e67e032 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:17.124460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be6dbe56-006e-4cb6-bfba-28a51e67e032 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:17.125595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be6dbe56-006e-4cb6-bfba-28a51e67e032 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:17.126225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be6dbe56-006e-4cb6-bfba-28a51e67e032 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:17.327073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-be6dbe56-006e-4cb6-bfba-28a51e67e032 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:17.335625 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-be6dbe56-006e-4cb6-bfba-28a51e67e032 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1680 microversion: 2.1 time: 0.240188 Aug 18 12:11:17.336229 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3240/5894] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:17 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:20.294769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-fdbcb450-867c-4448-8a59-70b87df70730 req-dccf6c75-3a40-49cc-b2fd-5836faff33e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f1edc6-59e0-4f7c-96c7-7b369020eaf9", "name": "network-vif-plugged", "status": "completed", "tag": "f28d24fe-2bff-4919-b8aa-de06d7a2f574"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:20.312281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fdbcb450-867c-4448-8a59-70b87df70730 req-dccf6c75-3a40-49cc-b2fd-5836faff33e0 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:20.312942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fdbcb450-867c-4448-8a59-70b87df70730 req-dccf6c75-3a40-49cc-b2fd-5836faff33e0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:20.313761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fdbcb450-867c-4448-8a59-70b87df70730 req-dccf6c75-3a40-49cc-b2fd-5836faff33e0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:20.335967 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-fdbcb450-867c-4448-8a59-70b87df70730 req-dccf6c75-3a40-49cc-b2fd-5836faff33e0 service nova] Creating event network-vif-plugged:f28d24fe-2bff-4919-b8aa-de06d7a2f574 for instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 on n-h1-853611-3 Aug 18 12:11:20.347750 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-fdbcb450-867c-4448-8a59-70b87df70730 req-dccf6c75-3a40-49cc-b2fd-5836faff33e0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058263 Aug 18 12:11:20.348892 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3241/5895] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:11:36.004648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:11:36.012903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:11:36.023837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-926dd8af-b798-4048-b0d1-abe214550b67 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:36.025363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-926dd8af-b798-4048-b0d1-abe214550b67 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:36.045354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-926dd8af-b798-4048-b0d1-abe214550b67 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:36.046595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-926dd8af-b798-4048-b0d1-abe214550b67 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:36.047888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-926dd8af-b798-4048-b0d1-abe214550b67 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:36.049479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-926dd8af-b798-4048-b0d1-abe214550b67 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:36.050582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-926dd8af-b798-4048-b0d1-abe214550b67 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:36.051626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-926dd8af-b798-4048-b0d1-abe214550b67 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:36.100050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-926dd8af-b798-4048-b0d1-abe214550b67 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:11:36.260911 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-926dd8af-b798-4048-b0d1-abe214550b67 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "DELETE /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 204 len: 0 microversion: 2.1 time: 0.263302 Aug 18 12:11:36.261836 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3242/5896] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:11:35 2022] DELETE /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:11:36.273202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2932a6d2-b14d-4724-827a-52cc6de16538 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:36.274525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2932a6d2-b14d-4724-827a-52cc6de16538 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:36.286299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2932a6d2-b14d-4724-827a-52cc6de16538 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:36.286752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2932a6d2-b14d-4724-827a-52cc6de16538 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:36.287496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2932a6d2-b14d-4724-827a-52cc6de16538 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:36.288485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2932a6d2-b14d-4724-827a-52cc6de16538 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:36.289134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2932a6d2-b14d-4724-827a-52cc6de16538 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:36.289669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2932a6d2-b14d-4724-827a-52cc6de16538 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:36.577043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2932a6d2-b14d-4724-827a-52cc6de16538 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:36.596879 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2932a6d2-b14d-4724-827a-52cc6de16538 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1553 microversion: 2.1 time: 0.328001 Aug 18 12:11:36.600334 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3243/5897] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:36 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1553 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:37.624582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4e8de3ed-f2c0-4ae9-ac46-4e701881061b tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:37.626917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4e8de3ed-f2c0-4ae9-ac46-4e701881061b tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:37.639278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e8de3ed-f2c0-4ae9-ac46-4e701881061b tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:37.640199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e8de3ed-f2c0-4ae9-ac46-4e701881061b tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:37.641599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e8de3ed-f2c0-4ae9-ac46-4e701881061b tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:37.642706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e8de3ed-f2c0-4ae9-ac46-4e701881061b tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:37.643426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e8de3ed-f2c0-4ae9-ac46-4e701881061b tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:37.644117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e8de3ed-f2c0-4ae9-ac46-4e701881061b tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:38.123264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4e8de3ed-f2c0-4ae9-ac46-4e701881061b tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:38.132973 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4e8de3ed-f2c0-4ae9-ac46-4e701881061b tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1553 microversion: 2.1 time: 0.512808 Aug 18 12:11:38.148647 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3244/5898] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:37 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1553 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:38.600510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-3f8e4b19-f7de-4b59-bdb0-47518868e2a5 req-ad623cb8-ca70-4c14-bd33-dfaa358884f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b3b387-16ee-4cf9-b49b-20fb8ba04621", "name": "network-vif-deleted", "tag": "ba39fd07-f729-44f3-9319-62872adb2134"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:38.645518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3f8e4b19-f7de-4b59-bdb0-47518868e2a5 req-ad623cb8-ca70-4c14-bd33-dfaa358884f5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:38.646879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3f8e4b19-f7de-4b59-bdb0-47518868e2a5 req-ad623cb8-ca70-4c14-bd33-dfaa358884f5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:38.647514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3f8e4b19-f7de-4b59-bdb0-47518868e2a5 req-ad623cb8-ca70-4c14-bd33-dfaa358884f5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:38.696366 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-3f8e4b19-f7de-4b59-bdb0-47518868e2a5 req-ad623cb8-ca70-4c14-bd33-dfaa358884f5 service nova] Creating event network-vif-deleted:ba39fd07-f729-44f3-9319-62872adb2134 for instance 02b3b387-16ee-4cf9-b49b-20fb8ba04621 on n-h2-853611-3 Aug 18 12:11:38.740523 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-3f8e4b19-f7de-4b59-bdb0-47518868e2a5 req-ad623cb8-ca70-4c14-bd33-dfaa358884f5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156661 Aug 18 12:11:38.748779 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3245/5899] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:11:39.175200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c1c422fd-30c1-47a1-9f4a-d5c6c1359067 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:39.177157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c1c422fd-30c1-47a1-9f4a-d5c6c1359067 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:39.192421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c422fd-30c1-47a1-9f4a-d5c6c1359067 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:39.194039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c422fd-30c1-47a1-9f4a-d5c6c1359067 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:39.195570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c422fd-30c1-47a1-9f4a-d5c6c1359067 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:39.200847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c422fd-30c1-47a1-9f4a-d5c6c1359067 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:39.202504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c422fd-30c1-47a1-9f4a-d5c6c1359067 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:39.204004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c422fd-30c1-47a1-9f4a-d5c6c1359067 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:39.278810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c422fd-30c1-47a1-9f4a-d5c6c1359067 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:39.279558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c422fd-30c1-47a1-9f4a-d5c6c1359067 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:39.280172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1c422fd-30c1-47a1-9f4a-d5c6c1359067 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:39.280836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-c1c422fd-30c1-47a1-9f4a-d5c6c1359067 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lazy-loading 'fault' on Instance uuid 02b3b387-16ee-4cf9-b49b-20fb8ba04621 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:11:39.461077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c1c422fd-30c1-47a1-9f4a-d5c6c1359067 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:39.474358 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c1c422fd-30c1-47a1-9f4a-d5c6c1359067 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 200 len: 1339 microversion: 2.1 time: 0.321825 Aug 18 12:11:39.475022 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3246/5900] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:39 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 1339 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:40.068225 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:11:40.069086 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:11:40.511061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0c249386-abf4-41bf-a66c-e37172e9816c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:40.511787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0c249386-abf4-41bf-a66c-e37172e9816c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 02b3b387-16ee-4cf9-b49b-20fb8ba04621] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:40.520247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c249386-abf4-41bf-a66c-e37172e9816c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:40.520753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c249386-abf4-41bf-a66c-e37172e9816c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:40.521195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c249386-abf4-41bf-a66c-e37172e9816c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:40.522371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c249386-abf4-41bf-a66c-e37172e9816c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:40.523028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c249386-abf4-41bf-a66c-e37172e9816c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:40.523654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c249386-abf4-41bf-a66c-e37172e9816c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:40.541483 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-0c249386-abf4-41bf-a66c-e37172e9816c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] HTTP exception thrown: Instance 02b3b387-16ee-4cf9-b49b-20fb8ba04621 could not be found. Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0c249386-abf4-41bf-a66c-e37172e9816c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Request method failure captured: Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 HTTP/1.1 Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iv2QziQoFmx-TWFaI518OSSPu9szUzMHWzQTHlmtEk_beZSvif_V3FqmJCvcGBx3a2WYJwZLY8JMLSi-wf3Iuf58LzRVE45b40_vxALx5W2NRcpCy5e8-AgwbJ14Eh6FbBowAbBL_a5hBwoCuK1E45bJL-2oa25Yxdkpm2PlKdgWU0 Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 33e6a4cb7234446dae9a06b0a91810ad Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestNetworkBasicOps-1304403141 Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/33e6a4cb7234446dae9a06b0a91810ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/33e6a4cb7234446dae9a06b0a91810ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_33e6a4cb7234446dae9a06b0a91810ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/33e6a4cb7234446dae9a06b0a91810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestNetworkBasicOps-1304403141 Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 33e6a4cb7234446dae9a06b0a91810ad Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestNetworkBasicOps-1304403141 Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestNetworkBasicOps-1304403141-project Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 84208046cadf456eb814d737b0bd516b Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestNetworkBasicOps-1304403141-project Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 02b3b387-16ee-4cf9-b49b-20fb8ba04621 could not be found. Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '02b3b387-16ee-4cf9-b49b-20fb8ba04621'} Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b3b387-16ee-4cf9-b49b-20fb8ba04621 could not be found. Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b3b387-16ee-4cf9-b49b-20fb8ba04621 could not be found. Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:11:40.543242 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:11:40.552762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:11:40.552762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:11:40.552762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:11:40.552762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:11:40.552762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:11:40.552762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b3b387-16ee-4cf9-b49b-20fb8ba04621 could not be found. Aug 18 12:11:40.552762 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:11:40.552762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0c249386-abf4-41bf-a66c-e37172e9816c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Returning 404 to user: Instance 02b3b387-16ee-4cf9-b49b-20fb8ba04621 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:11:40.552762 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0c249386-abf4-41bf-a66c-e37172e9816c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621" status: 404 len: 111 microversion: 2.1 time: 0.038093 Aug 18 12:11:40.552762 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3247/5901] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:40 2022] GET /compute/v2.1/servers/02b3b387-16ee-4cf9-b49b-20fb8ba04621 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:11:40.809184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0aa5be93-265d-4e32-8357-d845c7b86701 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '.version_select at 0x7f519e6608b0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:40.858416 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0aa5be93-265d-4e32-8357-d845c7b86701 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1080243626" status: 202 len: 0 microversion: 2.1 time: 0.056372 Aug 18 12:11:40.859830 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3248/5902] 10.222.0.73 () {58 vars in 1257 bytes} [Thu Aug 18 12:11:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1080243626 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:11:44.046261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2085387424", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "85e07994-6aab-495c-9dd8-ffb582c28c7c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11e09857-d75b-4b2b-82b3-fa5db86d3937"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:44.161145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] validate_networks() for [('11e09857-d75b-4b2b-82b3-fa5db86d3937', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:11:45.455598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:11:45.457718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:11:45.460016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:11:45.461287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:11:45.462317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:11:45.508411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:45.513216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:45.513858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:45.515387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:45.518170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:45.518758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:45.564529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:11:45.571912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for user 033d6aa61b5340189fbc5d895d3e8cba and project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:11:45.735111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:11:45.737611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='85e07994-6aab-495c-9dd8-ffb582c28c7c',volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:11:45.936948 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b34db34-2f54-4b4c-95cf-85eb0825ce88 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.896819 Aug 18 12:11:45.938338 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3249/5903] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:11:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:11:45.956220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b18750b8-8ba6-4048-97d8-eccfd8d95cd4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:45.957149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b18750b8-8ba6-4048-97d8-eccfd8d95cd4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:45.973603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b18750b8-8ba6-4048-97d8-eccfd8d95cd4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:45.974456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b18750b8-8ba6-4048-97d8-eccfd8d95cd4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:45.975132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b18750b8-8ba6-4048-97d8-eccfd8d95cd4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:45.976134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b18750b8-8ba6-4048-97d8-eccfd8d95cd4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:45.976787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b18750b8-8ba6-4048-97d8-eccfd8d95cd4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:45.977607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b18750b8-8ba6-4048-97d8-eccfd8d95cd4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:46.073909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b18750b8-8ba6-4048-97d8-eccfd8d95cd4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:11:46.311567 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b18750b8-8ba6-4048-97d8-eccfd8d95cd4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 204 len: 0 microversion: 2.1 time: 0.371123 Aug 18 12:11:46.317559 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3250/5904] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:11:45 2022] DELETE /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:11:46.332954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-436dd879-da8d-4ede-b23d-66ed005e6dd0 req-f9005b3a-a462-4d22-9e82-6a0f67a4e836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa4e457-042a-4cdc-8f86-3cc9e21ed12c", "tag": "968cd41e-1bbf-449a-a02d-dd422ccc7306"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:46.355704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-436dd879-da8d-4ede-b23d-66ed005e6dd0 req-f9005b3a-a462-4d22-9e82-6a0f67a4e836 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:46.357177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-436dd879-da8d-4ede-b23d-66ed005e6dd0 req-f9005b3a-a462-4d22-9e82-6a0f67a4e836 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:46.358245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-436dd879-da8d-4ede-b23d-66ed005e6dd0 req-f9005b3a-a462-4d22-9e82-6a0f67a4e836 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:46.381325 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-436dd879-da8d-4ede-b23d-66ed005e6dd0 req-f9005b3a-a462-4d22-9e82-6a0f67a4e836 service nova] Creating event network-changed:968cd41e-1bbf-449a-a02d-dd422ccc7306 for instance 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c on n-h2-853611-3 Aug 18 12:11:46.395286 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-436dd879-da8d-4ede-b23d-66ed005e6dd0 req-f9005b3a-a462-4d22-9e82-6a0f67a4e836 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079074 Aug 18 12:11:46.396401 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3251/5905] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:11:46.414379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c2337b82-4521-40c0-bedc-1f8a12d407df tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:46.420956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c2337b82-4521-40c0-bedc-1f8a12d407df tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:46.435635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2337b82-4521-40c0-bedc-1f8a12d407df tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:46.436511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2337b82-4521-40c0-bedc-1f8a12d407df tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:46.438627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2337b82-4521-40c0-bedc-1f8a12d407df tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:46.440349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2337b82-4521-40c0-bedc-1f8a12d407df tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:46.441502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2337b82-4521-40c0-bedc-1f8a12d407df tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:46.442296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2337b82-4521-40c0-bedc-1f8a12d407df tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:46.537496 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c2337b82-4521-40c0-bedc-1f8a12d407df tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9/action" status: 200 len: 63194 microversion: 2.1 time: 0.138221 Aug 18 12:11:46.539428 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3252/5906] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:11:46 2022] POST /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9/action => generated 63194 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:11:46.551192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd9301e4-dda9-467b-9667-73bf9cb5528f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:46.553218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dd9301e4-dda9-467b-9667-73bf9cb5528f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:46.753630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd9301e4-dda9-467b-9667-73bf9cb5528f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:46.769484 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd9301e4-dda9-467b-9667-73bf9cb5528f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1057 microversion: 2.1 time: 0.227134 Aug 18 12:11:46.786468 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3253/5907] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:46 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1057 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:46.800925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e88f201f-fbb8-4ae2-aa91-91c4dca44f58 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:46.802158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e88f201f-fbb8-4ae2-aa91-91c4dca44f58 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:46.811531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e88f201f-fbb8-4ae2-aa91-91c4dca44f58 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:46.812327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e88f201f-fbb8-4ae2-aa91-91c4dca44f58 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:46.812779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e88f201f-fbb8-4ae2-aa91-91c4dca44f58 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:46.813803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e88f201f-fbb8-4ae2-aa91-91c4dca44f58 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:46.814537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e88f201f-fbb8-4ae2-aa91-91c4dca44f58 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:46.815156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e88f201f-fbb8-4ae2-aa91-91c4dca44f58 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:47.195804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e88f201f-fbb8-4ae2-aa91-91c4dca44f58 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:47.213638 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e88f201f-fbb8-4ae2-aa91-91c4dca44f58 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 200 len: 1671 microversion: 2.1 time: 0.419428 Aug 18 12:11:47.216415 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3254/5908] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:46 2022] GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 1671 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:47.801816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-261ea474-f9dd-496f-b300-c49a618bdf9d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:47.805892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-261ea474-f9dd-496f-b300-c49a618bdf9d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:47.810002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-261ea474-f9dd-496f-b300-c49a618bdf9d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:47.810739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-261ea474-f9dd-496f-b300-c49a618bdf9d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:47.811271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-261ea474-f9dd-496f-b300-c49a618bdf9d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:47.812113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-261ea474-f9dd-496f-b300-c49a618bdf9d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:47.812675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-261ea474-f9dd-496f-b300-c49a618bdf9d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:47.813120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-261ea474-f9dd-496f-b300-c49a618bdf9d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:47.969043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-261ea474-f9dd-496f-b300-c49a618bdf9d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:48.020939 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-261ea474-f9dd-496f-b300-c49a618bdf9d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1155 microversion: 2.1 time: 0.214325 Aug 18 12:11:48.037906 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3255/5909] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:47 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1155 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:11:48.261986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dbb44d88-425e-4454-bec7-758b18a8d783 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:48.266232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dbb44d88-425e-4454-bec7-758b18a8d783 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:48.282568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbb44d88-425e-4454-bec7-758b18a8d783 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:48.283799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbb44d88-425e-4454-bec7-758b18a8d783 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:48.284824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbb44d88-425e-4454-bec7-758b18a8d783 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:48.286852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbb44d88-425e-4454-bec7-758b18a8d783 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:48.288101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbb44d88-425e-4454-bec7-758b18a8d783 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:48.290231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbb44d88-425e-4454-bec7-758b18a8d783 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:48.772789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dbb44d88-425e-4454-bec7-758b18a8d783 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:48.832856 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dbb44d88-425e-4454-bec7-758b18a8d783 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 200 len: 1671 microversion: 2.1 time: 0.579508 Aug 18 12:11:48.847126 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3256/5910] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:48 2022] GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 1671 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:49.045872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-6a39d418-e90e-4ece-832c-496820522a87 req-81ffb164-d267-4ee0-9c7d-f45367407db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa4e457-042a-4cdc-8f86-3cc9e21ed12c", "name": "network-vif-deleted", "tag": "968cd41e-1bbf-449a-a02d-dd422ccc7306"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:49.068760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6a39d418-e90e-4ece-832c-496820522a87 req-81ffb164-d267-4ee0-9c7d-f45367407db7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:49.070047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6a39d418-e90e-4ece-832c-496820522a87 req-81ffb164-d267-4ee0-9c7d-f45367407db7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:49.071272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6a39d418-e90e-4ece-832c-496820522a87 req-81ffb164-d267-4ee0-9c7d-f45367407db7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:49.100073 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6a39d418-e90e-4ece-832c-496820522a87 req-81ffb164-d267-4ee0-9c7d-f45367407db7 service nova] Creating event network-vif-deleted:968cd41e-1bbf-449a-a02d-dd422ccc7306 for instance 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c on n-h2-853611-3 Aug 18 12:11:49.111055 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-6a39d418-e90e-4ece-832c-496820522a87 req-81ffb164-d267-4ee0-9c7d-f45367407db7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072862 Aug 18 12:11:49.112953 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3257/5911] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:11:49.126243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2ba31902-2b2f-4afd-b622-ab7922e9557d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:49.128097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2ba31902-2b2f-4afd-b622-ab7922e9557d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:49.143966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ba31902-2b2f-4afd-b622-ab7922e9557d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:49.146171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ba31902-2b2f-4afd-b622-ab7922e9557d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:49.147232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ba31902-2b2f-4afd-b622-ab7922e9557d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:49.149511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ba31902-2b2f-4afd-b622-ab7922e9557d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:49.150944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ba31902-2b2f-4afd-b622-ab7922e9557d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:49.151750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ba31902-2b2f-4afd-b622-ab7922e9557d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:49.304909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2ba31902-2b2f-4afd-b622-ab7922e9557d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:49.320788 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2ba31902-2b2f-4afd-b622-ab7922e9557d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1173 microversion: 2.1 time: 0.204986 Aug 18 12:11:49.322243 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3258/5912] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:49 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1173 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:49.899761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-577b5b3c-856e-43a9-bb15-fa4bf9710b05 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:49.902794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-577b5b3c-856e-43a9-bb15-fa4bf9710b05 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:49.926667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-577b5b3c-856e-43a9-bb15-fa4bf9710b05 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:49.927343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-577b5b3c-856e-43a9-bb15-fa4bf9710b05 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:49.928702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-577b5b3c-856e-43a9-bb15-fa4bf9710b05 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:49.929659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-577b5b3c-856e-43a9-bb15-fa4bf9710b05 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:49.936532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-577b5b3c-856e-43a9-bb15-fa4bf9710b05 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:49.937520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-577b5b3c-856e-43a9-bb15-fa4bf9710b05 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:49.984731 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-577b5b3c-856e-43a9-bb15-fa4bf9710b05 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] HTTP exception thrown: Instance 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c could not be found. Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-577b5b3c-856e-43a9-bb15-fa4bf9710b05 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Request method failure captured: Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c HTTP/1.1 Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iv2QziQoFmx-TWFaI518OSSPu9szUzMHWzQTHlmtEk_beZSvif_V3FqmJCvcGBx3a2WYJwZLY8JMLSi-wf3Iuf58LzRVE45b40_vxALx5W2NRcpCy5e8-AgwbJ14Eh6FbBowAbBL_a5hBwoCuK1E45bJL-2oa25Yxdkpm2PlKdgWU0 Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 33e6a4cb7234446dae9a06b0a91810ad Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestNetworkBasicOps-1304403141 Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/33e6a4cb7234446dae9a06b0a91810ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/33e6a4cb7234446dae9a06b0a91810ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_33e6a4cb7234446dae9a06b0a91810ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/33e6a4cb7234446dae9a06b0a91810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestNetworkBasicOps-1304403141 Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 33e6a4cb7234446dae9a06b0a91810ad Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestNetworkBasicOps-1304403141 Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestNetworkBasicOps-1304403141-project Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 84208046cadf456eb814d737b0bd516b Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestNetworkBasicOps-1304403141-project Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c could not be found. Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '0aa4e457-042a-4cdc-8f86-3cc9e21ed12c'} Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c could not be found. Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c could not be found. Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:11:49.986780 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:11:49.991795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:11:49.991795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:11:49.991795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:11:49.991795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:11:49.991795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:11:49.991795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c could not be found. Aug 18 12:11:49.991795 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:11:49.991795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-577b5b3c-856e-43a9-bb15-fa4bf9710b05 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Returning 404 to user: Instance 0aa4e457-042a-4cdc-8f86-3cc9e21ed12c could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:11:49.991795 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-577b5b3c-856e-43a9-bb15-fa4bf9710b05 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c" status: 404 len: 111 microversion: 2.1 time: 0.117680 Aug 18 12:11:49.991795 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3259/5913] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:49 2022] GET /compute/v2.1/servers/0aa4e457-042a-4cdc-8f86-3cc9e21ed12c => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:11:50.345974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bd84c8df-2bed-4f85-821a-5d916eabbdbc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:50.346953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bd84c8df-2bed-4f85-821a-5d916eabbdbc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:50.360387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd84c8df-2bed-4f85-821a-5d916eabbdbc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:50.381678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd84c8df-2bed-4f85-821a-5d916eabbdbc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:50.382197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd84c8df-2bed-4f85-821a-5d916eabbdbc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:50.387685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd84c8df-2bed-4f85-821a-5d916eabbdbc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:50.388932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd84c8df-2bed-4f85-821a-5d916eabbdbc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:50.389637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd84c8df-2bed-4f85-821a-5d916eabbdbc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:51.462052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bd84c8df-2bed-4f85-821a-5d916eabbdbc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:51.497816 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bd84c8df-2bed-4f85-821a-5d916eabbdbc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1215 microversion: 2.1 time: 1.156394 Aug 18 12:11:51.526072 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3260/5914] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:50 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1215 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:11:51.543567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fcc6f3ee-03bf-447d-b384-8914298ab8da tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '.version_select at 0x7f519ef2b5e0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:51.609240 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fcc6f3ee-03bf-447d-b384-8914298ab8da tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-892213693" status: 202 len: 0 microversion: 2.1 time: 0.077683 Aug 18 12:11:51.611797 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3261/5915] 10.222.0.73 () {58 vars in 1254 bytes} [Thu Aug 18 12:11:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-892213693 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:11:51.666482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-cb4c923f-a063-4dd9-bcd8-0f46e59b7395 req-75f5aa39-a1ad-432c-bcb8-2912da9bcee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4953ba06-278b-4016-b790-cecdd3ee10c1", "tag": "af775c28-1855-47c1-a061-fd6dd63d61a4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:51.721888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cb4c923f-a063-4dd9-bcd8-0f46e59b7395 req-75f5aa39-a1ad-432c-bcb8-2912da9bcee2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:51.724341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cb4c923f-a063-4dd9-bcd8-0f46e59b7395 req-75f5aa39-a1ad-432c-bcb8-2912da9bcee2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:51.727338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cb4c923f-a063-4dd9-bcd8-0f46e59b7395 req-75f5aa39-a1ad-432c-bcb8-2912da9bcee2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:51.754546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:11:51.799956 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-cb4c923f-a063-4dd9-bcd8-0f46e59b7395 req-75f5aa39-a1ad-432c-bcb8-2912da9bcee2 service nova] Creating event network-changed:af775c28-1855-47c1-a061-fd6dd63d61a4 for instance 4953ba06-278b-4016-b790-cecdd3ee10c1 on n-h2-853611-3 Aug 18 12:11:51.834900 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-cb4c923f-a063-4dd9-bcd8-0f46e59b7395 req-75f5aa39-a1ad-432c-bcb8-2912da9bcee2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177047 Aug 18 12:11:51.841469 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3262/5916] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:11:52.571689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d5c54fc-e3ff-4315-81a2-b7a5ead03dfe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:52.589039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9d5c54fc-e3ff-4315-81a2-b7a5ead03dfe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:52.623819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d5c54fc-e3ff-4315-81a2-b7a5ead03dfe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:52.625295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d5c54fc-e3ff-4315-81a2-b7a5ead03dfe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:52.626855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d5c54fc-e3ff-4315-81a2-b7a5ead03dfe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:52.628499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d5c54fc-e3ff-4315-81a2-b7a5ead03dfe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:52.629682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d5c54fc-e3ff-4315-81a2-b7a5ead03dfe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:52.630785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d5c54fc-e3ff-4315-81a2-b7a5ead03dfe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:53.380039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9d5c54fc-e3ff-4315-81a2-b7a5ead03dfe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:53.394471 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9d5c54fc-e3ff-4315-81a2-b7a5ead03dfe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1215 microversion: 2.1 time: 0.853867 Aug 18 12:11:53.395327 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3263/5917] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:52 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1215 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:53.409475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c664ef62-98f8-40c2-ac44-bca07e5688b7 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:53.410383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c664ef62-98f8-40c2-ac44-bca07e5688b7 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:53.431696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c664ef62-98f8-40c2-ac44-bca07e5688b7 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:53.432679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c664ef62-98f8-40c2-ac44-bca07e5688b7 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:53.433361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c664ef62-98f8-40c2-ac44-bca07e5688b7 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:53.434303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c664ef62-98f8-40c2-ac44-bca07e5688b7 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:53.435607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c664ef62-98f8-40c2-ac44-bca07e5688b7 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:53.441795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c664ef62-98f8-40c2-ac44-bca07e5688b7 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:54.043332 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c664ef62-98f8-40c2-ac44-bca07e5688b7 tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1831 microversion: 2.1 time: 0.646658 Aug 18 12:11:54.060633 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3264/5918] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:53 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1831 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:54.426540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-18781d4b-11c9-40e2-9cb0-e087fd32f8f5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:54.427192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-18781d4b-11c9-40e2-9cb0-e087fd32f8f5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:54.435202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18781d4b-11c9-40e2-9cb0-e087fd32f8f5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:54.435726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18781d4b-11c9-40e2-9cb0-e087fd32f8f5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:54.436180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18781d4b-11c9-40e2-9cb0-e087fd32f8f5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:54.436935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18781d4b-11c9-40e2-9cb0-e087fd32f8f5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:54.437423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18781d4b-11c9-40e2-9cb0-e087fd32f8f5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:54.440981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18781d4b-11c9-40e2-9cb0-e087fd32f8f5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:55.034362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-18781d4b-11c9-40e2-9cb0-e087fd32f8f5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:55.048463 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-18781d4b-11c9-40e2-9cb0-e087fd32f8f5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1215 microversion: 2.1 time: 0.630751 Aug 18 12:11:55.062520 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3265/5919] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:54 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1215 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:11:56.081358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1407e75d-1a2a-4258-ad9e-a9cc319406c0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:56.088052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1407e75d-1a2a-4258-ad9e-a9cc319406c0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:56.106366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:11:56.117093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1407e75d-1a2a-4258-ad9e-a9cc319406c0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:56.137412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1407e75d-1a2a-4258-ad9e-a9cc319406c0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:56.142848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1407e75d-1a2a-4258-ad9e-a9cc319406c0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:56.145305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1407e75d-1a2a-4258-ad9e-a9cc319406c0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:56.151438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1407e75d-1a2a-4258-ad9e-a9cc319406c0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:56.152410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1407e75d-1a2a-4258-ad9e-a9cc319406c0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:56.656947 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:11:56.656947 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:11:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:11:56.760001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1407e75d-1a2a-4258-ad9e-a9cc319406c0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:56.769877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:11:56.799695 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1407e75d-1a2a-4258-ad9e-a9cc319406c0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1215 microversion: 2.1 time: 0.726577 Aug 18 12:11:56.801251 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3266/5920] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:56 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1215 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:57.436905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e4c49e3f-4f11-41f9-9db4-1576b5a527aa tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:57.445789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e4c49e3f-4f11-41f9-9db4-1576b5a527aa tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:57.463664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4c49e3f-4f11-41f9-9db4-1576b5a527aa tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:57.477644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4c49e3f-4f11-41f9-9db4-1576b5a527aa tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:57.478693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4c49e3f-4f11-41f9-9db4-1576b5a527aa tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:57.480577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4c49e3f-4f11-41f9-9db4-1576b5a527aa tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:57.482762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4c49e3f-4f11-41f9-9db4-1576b5a527aa tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:57.484255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e4c49e3f-4f11-41f9-9db4-1576b5a527aa tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:57.602797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e4c49e3f-4f11-41f9-9db4-1576b5a527aa tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:11:57.854259 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e4c49e3f-4f11-41f9-9db4-1576b5a527aa tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "DELETE /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 204 len: 0 microversion: 2.1 time: 0.425789 Aug 18 12:11:57.863538 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3267/5921] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:11:57 2022] DELETE /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:11:57.898817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-86779d56-ea90-4373-8948-c691552a66e1 req-664a0c51-056a-45d8-99a1-a9f41fe01f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f1edc6-59e0-4f7c-96c7-7b369020eaf9", "tag": "f28d24fe-2bff-4919-b8aa-de06d7a2f574"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:57.940366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-86779d56-ea90-4373-8948-c691552a66e1 req-664a0c51-056a-45d8-99a1-a9f41fe01f33 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:57.941346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-86779d56-ea90-4373-8948-c691552a66e1 req-664a0c51-056a-45d8-99a1-a9f41fe01f33 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:57.942096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-86779d56-ea90-4373-8948-c691552a66e1 req-664a0c51-056a-45d8-99a1-a9f41fe01f33 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:57.992736 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-86779d56-ea90-4373-8948-c691552a66e1 req-664a0c51-056a-45d8-99a1-a9f41fe01f33 service nova] Creating event network-changed:f28d24fe-2bff-4919-b8aa-de06d7a2f574 for instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 on n-h1-853611-3 Aug 18 12:11:58.016935 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-86779d56-ea90-4373-8948-c691552a66e1 req-664a0c51-056a-45d8-99a1-a9f41fe01f33 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148791 Aug 18 12:11:58.018105 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3268/5922] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:11:58.040529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-23c0a3c4-7f8f-4f60-8515-7257eca5a406 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:58.041933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-23c0a3c4-7f8f-4f60-8515-7257eca5a406 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:58.076864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23c0a3c4-7f8f-4f60-8515-7257eca5a406 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:58.077381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23c0a3c4-7f8f-4f60-8515-7257eca5a406 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:58.077842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23c0a3c4-7f8f-4f60-8515-7257eca5a406 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:58.078657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23c0a3c4-7f8f-4f60-8515-7257eca5a406 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:58.079142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23c0a3c4-7f8f-4f60-8515-7257eca5a406 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:58.079556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23c0a3c4-7f8f-4f60-8515-7257eca5a406 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:58.537986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-23c0a3c4-7f8f-4f60-8515-7257eca5a406 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:58.561803 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-23c0a3c4-7f8f-4f60-8515-7257eca5a406 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1215 microversion: 2.1 time: 0.539747 Aug 18 12:11:58.563305 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3269/5923] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:58 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1215 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:58.604121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac47bbef-64d9-409a-b7ae-de8479249d67 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:11:58.605835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ac47bbef-64d9-409a-b7ae-de8479249d67 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:11:58.624368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac47bbef-64d9-409a-b7ae-de8479249d67 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:58.625959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac47bbef-64d9-409a-b7ae-de8479249d67 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:58.627051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac47bbef-64d9-409a-b7ae-de8479249d67 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:58.628728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac47bbef-64d9-409a-b7ae-de8479249d67 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:11:58.629871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac47bbef-64d9-409a-b7ae-de8479249d67 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:11:58.631163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac47bbef-64d9-409a-b7ae-de8479249d67 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:11:59.531860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ac47bbef-64d9-409a-b7ae-de8479249d67 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:11:59.546214 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ac47bbef-64d9-409a-b7ae-de8479249d67 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1686 microversion: 2.1 time: 0.964774 Aug 18 12:11:59.546975 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3270/5924] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:11:58 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1686 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:11:59.552310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1998396199", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "3127938f-7884-47f9-8841-2cee2e861e57"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1538337373", "security_groups": []}, "os:scheduler_hints": {"different_host": ["6e77fafc-08a7-43f8-bf7f-97891d521eaa"]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:11:59.565855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:11:59.648644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] validate_networks() for [('3127938f-7884-47f9-8841-2cee2e861e57', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:12:00.387057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:12:00.387997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:12:00.390071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:12:00.390531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:12:00.391190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:12:00.402297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:00.403061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:00.403523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:00.405911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:00.406379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:00.406864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:00.434128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Getting quotas for project 8d220fd218d6489b87efc85c07845466. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:12:00.441893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Getting quotas for user 846e61e4aec94b7895080117c55c2382 and project 8d220fd218d6489b87efc85c07845466. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:12:00.458858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:12:00.461502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:12:00.526132 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7dc16e02-ab2c-48ed-b147-46513f74107b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.977840 Aug 18 12:12:00.527174 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3271/5925] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:11:59 2022] POST /compute/v2.1/servers => generated 361 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:12:00.533597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e76cd65-eabe-49e0-b577-4c13d3db7109 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:00.534585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e76cd65-eabe-49e0-b577-4c13d3db7109 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:00.542657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e76cd65-eabe-49e0-b577-4c13d3db7109 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:00.543446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e76cd65-eabe-49e0-b577-4c13d3db7109 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:00.544087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e76cd65-eabe-49e0-b577-4c13d3db7109 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:00.545742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e76cd65-eabe-49e0-b577-4c13d3db7109 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:00.546447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e76cd65-eabe-49e0-b577-4c13d3db7109 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:00.555663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e76cd65-eabe-49e0-b577-4c13d3db7109 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:00.915934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e76cd65-eabe-49e0-b577-4c13d3db7109 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:00.928996 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e76cd65-eabe-49e0-b577-4c13d3db7109 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1203 microversion: 2.1 time: 0.400043 Aug 18 12:12:00.930214 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3272/5926] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:00 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1203 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:00.937938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a731be0a-0c98-4a87-aecc-3e40363f61e7 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:00.938924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a731be0a-0c98-4a87-aecc-3e40363f61e7 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:01.025825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a731be0a-0c98-4a87-aecc-3e40363f61e7 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:01.036224 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a731be0a-0c98-4a87-aecc-3e40363f61e7 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1242 microversion: 2.1 time: 0.104225 Aug 18 12:12:01.037181 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3273/5927] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:00 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:01.043660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-deece405-fdb7-4714-90fc-e1aa2d89586a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:01.044608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-deece405-fdb7-4714-90fc-e1aa2d89586a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:01.053881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-deece405-fdb7-4714-90fc-e1aa2d89586a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:01.054761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-deece405-fdb7-4714-90fc-e1aa2d89586a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:01.055413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-deece405-fdb7-4714-90fc-e1aa2d89586a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:01.056501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-deece405-fdb7-4714-90fc-e1aa2d89586a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:01.057157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-deece405-fdb7-4714-90fc-e1aa2d89586a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:01.057777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-deece405-fdb7-4714-90fc-e1aa2d89586a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:01.299420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-deece405-fdb7-4714-90fc-e1aa2d89586a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:01.316118 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-deece405-fdb7-4714-90fc-e1aa2d89586a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1686 microversion: 2.1 time: 0.276980 Aug 18 12:12:01.317992 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3274/5928] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:01 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1686 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:01.964314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e846d01-839c-4bed-ae49-b9298bbddaf5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:01.965820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1e846d01-839c-4bed-ae49-b9298bbddaf5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:01.988387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e846d01-839c-4bed-ae49-b9298bbddaf5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:01.989645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e846d01-839c-4bed-ae49-b9298bbddaf5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:01.990862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e846d01-839c-4bed-ae49-b9298bbddaf5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:01.992794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e846d01-839c-4bed-ae49-b9298bbddaf5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:01.995279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e846d01-839c-4bed-ae49-b9298bbddaf5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:01.996850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e846d01-839c-4bed-ae49-b9298bbddaf5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:02.568457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1e846d01-839c-4bed-ae49-b9298bbddaf5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:02.609103 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1e846d01-839c-4bed-ae49-b9298bbddaf5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1203 microversion: 2.1 time: 0.659930 Aug 18 12:12:02.611787 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3275/5929] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:01 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1203 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:02.632902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-497a55c2-8666-45e0-86aa-a237747ee7e8 req-d21c0cfe-3709-405d-99b8-7e49ede54973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f1edc6-59e0-4f7c-96c7-7b369020eaf9", "name": "network-vif-deleted", "tag": "f28d24fe-2bff-4919-b8aa-de06d7a2f574"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:02.648209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-497a55c2-8666-45e0-86aa-a237747ee7e8 req-d21c0cfe-3709-405d-99b8-7e49ede54973 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:02.649109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-497a55c2-8666-45e0-86aa-a237747ee7e8 req-d21c0cfe-3709-405d-99b8-7e49ede54973 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:02.649842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-497a55c2-8666-45e0-86aa-a237747ee7e8 req-d21c0cfe-3709-405d-99b8-7e49ede54973 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:02.675244 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-497a55c2-8666-45e0-86aa-a237747ee7e8 req-d21c0cfe-3709-405d-99b8-7e49ede54973 service nova] Creating event network-vif-deleted:f28d24fe-2bff-4919-b8aa-de06d7a2f574 for instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 on n-h1-853611-3 Aug 18 12:12:02.680720 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-497a55c2-8666-45e0-86aa-a237747ee7e8 req-d21c0cfe-3709-405d-99b8-7e49ede54973 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064471 Aug 18 12:12:02.681869 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3276/5930] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:12:02.692057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6c4c23e1-77cf-42a5-a39c-7ccae96ac3e0 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:02.692057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6c4c23e1-77cf-42a5-a39c-7ccae96ac3e0 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:02.707262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c4c23e1-77cf-42a5-a39c-7ccae96ac3e0 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:02.707799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c4c23e1-77cf-42a5-a39c-7ccae96ac3e0 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:02.708425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c4c23e1-77cf-42a5-a39c-7ccae96ac3e0 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:02.709028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c4c23e1-77cf-42a5-a39c-7ccae96ac3e0 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:02.709509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c4c23e1-77cf-42a5-a39c-7ccae96ac3e0 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:02.709951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c4c23e1-77cf-42a5-a39c-7ccae96ac3e0 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:02.831231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6c4c23e1-77cf-42a5-a39c-7ccae96ac3e0 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:02.851176 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6c4c23e1-77cf-42a5-a39c-7ccae96ac3e0 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1294 microversion: 2.1 time: 0.164842 Aug 18 12:12:02.852700 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3277/5931] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:02 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1294 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:02.859008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-57a09fe2-bc20-4de1-97a0-d9d89d24e4ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:02.860119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-57a09fe2-bc20-4de1-97a0-d9d89d24e4ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:02.868421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a09fe2-bc20-4de1-97a0-d9d89d24e4ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:02.869936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a09fe2-bc20-4de1-97a0-d9d89d24e4ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:02.871020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a09fe2-bc20-4de1-97a0-d9d89d24e4ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:02.871900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a09fe2-bc20-4de1-97a0-d9d89d24e4ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:02.873098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a09fe2-bc20-4de1-97a0-d9d89d24e4ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:02.873578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a09fe2-bc20-4de1-97a0-d9d89d24e4ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:02.921440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a09fe2-bc20-4de1-97a0-d9d89d24e4ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:02.922268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a09fe2-bc20-4de1-97a0-d9d89d24e4ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:02.923061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57a09fe2-bc20-4de1-97a0-d9d89d24e4ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:02.923782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-57a09fe2-bc20-4de1-97a0-d9d89d24e4ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lazy-loading 'fault' on Instance uuid 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:12:03.089007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-57a09fe2-bc20-4de1-97a0-d9d89d24e4ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:03.104495 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-57a09fe2-bc20-4de1-97a0-d9d89d24e4ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 200 len: 1355 microversion: 2.1 time: 0.250174 Aug 18 12:12:03.122146 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3278/5932] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:02 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 1355 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:03.654702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76c05e24-94d8-435c-bc2c-6ab06a43b8a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:03.655968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-76c05e24-94d8-435c-bc2c-6ab06a43b8a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:03.663939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c05e24-94d8-435c-bc2c-6ab06a43b8a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:03.664538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c05e24-94d8-435c-bc2c-6ab06a43b8a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:03.665062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c05e24-94d8-435c-bc2c-6ab06a43b8a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:03.665884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c05e24-94d8-435c-bc2c-6ab06a43b8a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:03.666421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c05e24-94d8-435c-bc2c-6ab06a43b8a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:03.667149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76c05e24-94d8-435c-bc2c-6ab06a43b8a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:04.057226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-76c05e24-94d8-435c-bc2c-6ab06a43b8a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:04.068508 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76c05e24-94d8-435c-bc2c-6ab06a43b8a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1203 microversion: 2.1 time: 0.422545 Aug 18 12:12:04.069354 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3279/5933] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:03 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1203 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:12:04.087589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a9c4f35e-afee-419f-93a3-20ce7232ebaa tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:04.092796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a9c4f35e-afee-419f-93a3-20ce7232ebaa tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:04.123463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9c4f35e-afee-419f-93a3-20ce7232ebaa tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:04.125811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9c4f35e-afee-419f-93a3-20ce7232ebaa tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:04.128534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9c4f35e-afee-419f-93a3-20ce7232ebaa tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:04.139237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9c4f35e-afee-419f-93a3-20ce7232ebaa tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:04.140315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9c4f35e-afee-419f-93a3-20ce7232ebaa tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:04.141238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9c4f35e-afee-419f-93a3-20ce7232ebaa tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:04.216128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:04.704177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a9c4f35e-afee-419f-93a3-20ce7232ebaa tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:04.741372 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a9c4f35e-afee-419f-93a3-20ce7232ebaa tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1300 microversion: 2.1 time: 0.663787 Aug 18 12:12:04.745037 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3280/5934] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:04 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1300 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:04.764078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-af0e17b2-0884-431b-be33-4e243060edf7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:04.765437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-af0e17b2-0884-431b-be33-4e243060edf7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 62f1edc6-59e0-4f7c-96c7-7b369020eaf9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:04.774163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af0e17b2-0884-431b-be33-4e243060edf7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:04.775239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af0e17b2-0884-431b-be33-4e243060edf7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:04.776102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af0e17b2-0884-431b-be33-4e243060edf7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:04.777112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af0e17b2-0884-431b-be33-4e243060edf7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:04.777869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af0e17b2-0884-431b-be33-4e243060edf7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:04.778602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-af0e17b2-0884-431b-be33-4e243060edf7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:04.807104 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-af0e17b2-0884-431b-be33-4e243060edf7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] HTTP exception thrown: Instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 could not be found. Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-af0e17b2-0884-431b-be33-4e243060edf7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Request method failure captured: Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 HTTP/1.1 Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_itpP3k2OQKDfTawi0kf9ygIVnfNVtKyQf6_y09raSLkqAu--Orcs7bv0PWg_M-JZcd1pI700Biy17mLWE4K6g_euM6YJIeHjhMvih1w9wsUGvonHEvYQGTA-0UcBLRhtzeS3Igm0aFaFMmv_Cl5gbWHiLNqehP12OxQYhEvTlr4F3c Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 75eb549fd4b44a4fb569dbfc1f507c3c Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-325550642 Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestNetworkAdvancedServerOps-325550642 Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 75eb549fd4b44a4fb569dbfc1f507c3c Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-325550642 Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestNetworkAdvancedServerOps-325550642-project Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 916631a932304b6c9cec7ef622e2069d Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestNetworkAdvancedServerOps-325550642-project Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 could not be found. Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '62f1edc6-59e0-4f7c-96c7-7b369020eaf9'} Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 could not be found. Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 could not be found. Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:04.809670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:12:04.820076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:04.820076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:12:04.820076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:12:04.820076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:12:04.820076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:12:04.820076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:12:04.820076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 could not be found. Aug 18 12:12:04.820076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:04.823377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-af0e17b2-0884-431b-be33-4e243060edf7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Returning 404 to user: Instance 62f1edc6-59e0-4f7c-96c7-7b369020eaf9 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:12:04.831995 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-af0e17b2-0884-431b-be33-4e243060edf7 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9" status: 404 len: 111 microversion: 2.1 time: 0.073868 Aug 18 12:12:04.833850 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3281/5935] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:04 2022] GET /compute/v2.1/servers/62f1edc6-59e0-4f7c-96c7-7b369020eaf9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:12:05.110776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-54921e9d-3d33-41ae-99bc-90aaeac1e5e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:05.112417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-54921e9d-3d33-41ae-99bc-90aaeac1e5e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:05.120432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54921e9d-3d33-41ae-99bc-90aaeac1e5e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:05.121097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54921e9d-3d33-41ae-99bc-90aaeac1e5e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:05.121690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54921e9d-3d33-41ae-99bc-90aaeac1e5e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:05.122582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54921e9d-3d33-41ae-99bc-90aaeac1e5e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:05.123989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54921e9d-3d33-41ae-99bc-90aaeac1e5e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:05.131064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54921e9d-3d33-41ae-99bc-90aaeac1e5e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:05.444112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-54921e9d-3d33-41ae-99bc-90aaeac1e5e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:05.463463 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-54921e9d-3d33-41ae-99bc-90aaeac1e5e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1203 microversion: 2.1 time: 0.359639 Aug 18 12:12:05.464959 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3282/5936] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:05 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1203 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:05.774213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-296601e0-4e6a-472c-963f-0cfa6b2e664b req-db2c8843-5648-4857-b60a-ee68e77a2f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10a27925-b2d4-4f3c-a39b-a4ebe1d496b7", "tag": "17b6b14d-f9e3-441a-8af8-2ef3da7100b6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:05.796793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-296601e0-4e6a-472c-963f-0cfa6b2e664b req-db2c8843-5648-4857-b60a-ee68e77a2f5e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:05.798262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-296601e0-4e6a-472c-963f-0cfa6b2e664b req-db2c8843-5648-4857-b60a-ee68e77a2f5e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:05.799452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-296601e0-4e6a-472c-963f-0cfa6b2e664b req-db2c8843-5648-4857-b60a-ee68e77a2f5e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:05.817302 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-296601e0-4e6a-472c-963f-0cfa6b2e664b req-db2c8843-5648-4857-b60a-ee68e77a2f5e service nova] Creating event network-changed:17b6b14d-f9e3-441a-8af8-2ef3da7100b6 for instance 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 on n-h2-853611-3 Aug 18 12:12:05.823330 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-296601e0-4e6a-472c-963f-0cfa6b2e664b req-db2c8843-5648-4857-b60a-ee68e77a2f5e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060556 Aug 18 12:12:05.823963 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3283/5937] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:12:05.831962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b4e9415-d265-4f06-9f27-e1fe57cbeeed tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:05.833215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3b4e9415-d265-4f06-9f27-e1fe57cbeeed tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:05.843117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b4e9415-d265-4f06-9f27-e1fe57cbeeed tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:05.843622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b4e9415-d265-4f06-9f27-e1fe57cbeeed tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:05.844288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b4e9415-d265-4f06-9f27-e1fe57cbeeed tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:05.845365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b4e9415-d265-4f06-9f27-e1fe57cbeeed tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:05.846028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b4e9415-d265-4f06-9f27-e1fe57cbeeed tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:05.846682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b4e9415-d265-4f06-9f27-e1fe57cbeeed tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:06.033294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3b4e9415-d265-4f06-9f27-e1fe57cbeeed tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:06.049689 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3b4e9415-d265-4f06-9f27-e1fe57cbeeed tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1300 microversion: 2.1 time: 0.223771 Aug 18 12:12:06.051609 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3284/5938] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:05 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1300 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:06.490308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fba442ae-f62d-43bf-bc57-9233e390c0d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:06.493089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fba442ae-f62d-43bf-bc57-9233e390c0d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:06.503984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fba442ae-f62d-43bf-bc57-9233e390c0d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:06.504864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fba442ae-f62d-43bf-bc57-9233e390c0d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:06.505702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fba442ae-f62d-43bf-bc57-9233e390c0d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:06.506649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fba442ae-f62d-43bf-bc57-9233e390c0d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:06.507594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fba442ae-f62d-43bf-bc57-9233e390c0d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:06.508214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fba442ae-f62d-43bf-bc57-9233e390c0d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:06.767511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fba442ae-f62d-43bf-bc57-9233e390c0d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:06.776115 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fba442ae-f62d-43bf-bc57-9233e390c0d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1203 microversion: 2.1 time: 0.294143 Aug 18 12:12:06.777090 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3285/5939] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:06 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1203 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:07.096520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd10f4f4-8e91-4a8f-883a-9df67ff5f7d8 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:07.098153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dd10f4f4-8e91-4a8f-883a-9df67ff5f7d8 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:07.110089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd10f4f4-8e91-4a8f-883a-9df67ff5f7d8 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:07.111413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd10f4f4-8e91-4a8f-883a-9df67ff5f7d8 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:07.112234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd10f4f4-8e91-4a8f-883a-9df67ff5f7d8 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:07.113551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd10f4f4-8e91-4a8f-883a-9df67ff5f7d8 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:07.114736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd10f4f4-8e91-4a8f-883a-9df67ff5f7d8 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:07.115752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd10f4f4-8e91-4a8f-883a-9df67ff5f7d8 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:07.226300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dd10f4f4-8e91-4a8f-883a-9df67ff5f7d8 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:07.239579 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd10f4f4-8e91-4a8f-883a-9df67ff5f7d8 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1300 microversion: 2.1 time: 0.153102 Aug 18 12:12:07.240743 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3286/5940] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:07 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1300 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:07.808669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-daffa00b-1d92-4002-817c-5a1c575b4788 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:07.809626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-daffa00b-1d92-4002-817c-5a1c575b4788 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:07.824314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-daffa00b-1d92-4002-817c-5a1c575b4788 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:07.826844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-daffa00b-1d92-4002-817c-5a1c575b4788 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:07.829520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-daffa00b-1d92-4002-817c-5a1c575b4788 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:07.832255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-daffa00b-1d92-4002-817c-5a1c575b4788 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:07.832870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-daffa00b-1d92-4002-817c-5a1c575b4788 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:07.835342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-daffa00b-1d92-4002-817c-5a1c575b4788 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:08.151285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-daffa00b-1d92-4002-817c-5a1c575b4788 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:08.172703 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-daffa00b-1d92-4002-817c-5a1c575b4788 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1203 microversion: 2.1 time: 0.358140 Aug 18 12:12:08.174084 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3287/5941] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:07 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1203 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:12:08.273752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6b146629-fa38-4afa-97e1-535c584279ae tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:08.274884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6b146629-fa38-4afa-97e1-535c584279ae tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:08.289174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b146629-fa38-4afa-97e1-535c584279ae tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:08.293056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b146629-fa38-4afa-97e1-535c584279ae tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:08.293770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b146629-fa38-4afa-97e1-535c584279ae tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:08.294622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b146629-fa38-4afa-97e1-535c584279ae tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:08.297147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b146629-fa38-4afa-97e1-535c584279ae tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:08.298140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b146629-fa38-4afa-97e1-535c584279ae tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:08.477604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6b146629-fa38-4afa-97e1-535c584279ae tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:08.520063 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6b146629-fa38-4afa-97e1-535c584279ae tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1300 microversion: 2.1 time: 0.251454 Aug 18 12:12:08.523087 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3288/5942] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:08 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1300 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:12:09.215582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4fb94138-ef05-46eb-a6e2-28f918df1b90 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:09.223478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4fb94138-ef05-46eb-a6e2-28f918df1b90 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:09.256944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fb94138-ef05-46eb-a6e2-28f918df1b90 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:09.259478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fb94138-ef05-46eb-a6e2-28f918df1b90 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:09.260275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fb94138-ef05-46eb-a6e2-28f918df1b90 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:09.261623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fb94138-ef05-46eb-a6e2-28f918df1b90 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:09.262406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fb94138-ef05-46eb-a6e2-28f918df1b90 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:09.265345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fb94138-ef05-46eb-a6e2-28f918df1b90 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:09.593098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4fb94138-ef05-46eb-a6e2-28f918df1b90 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:09.608952 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4fb94138-ef05-46eb-a6e2-28f918df1b90 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1203 microversion: 2.1 time: 0.400250 Aug 18 12:12:09.610199 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3289/5943] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:09 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1203 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:12:09.618878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3f1eafcb-00c6-47fa-b052-1cedee17e9d4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:09.622129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3f1eafcb-00c6-47fa-b052-1cedee17e9d4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:09.649009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f1eafcb-00c6-47fa-b052-1cedee17e9d4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:09.650172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f1eafcb-00c6-47fa-b052-1cedee17e9d4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:09.651520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f1eafcb-00c6-47fa-b052-1cedee17e9d4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:09.661113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f1eafcb-00c6-47fa-b052-1cedee17e9d4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:09.662079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f1eafcb-00c6-47fa-b052-1cedee17e9d4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:09.662947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f1eafcb-00c6-47fa-b052-1cedee17e9d4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:09.958812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3f1eafcb-00c6-47fa-b052-1cedee17e9d4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:10.013944 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3f1eafcb-00c6-47fa-b052-1cedee17e9d4 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1300 microversion: 2.1 time: 0.401705 Aug 18 12:12:10.016698 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3290/5944] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:09 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1300 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:10.652413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e3058765-ac36-4944-8cde-07ff719dc5fc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:10.653988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e3058765-ac36-4944-8cde-07ff719dc5fc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:10.662260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:10.679171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3058765-ac36-4944-8cde-07ff719dc5fc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:10.680396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3058765-ac36-4944-8cde-07ff719dc5fc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:10.681451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3058765-ac36-4944-8cde-07ff719dc5fc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:10.681903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3058765-ac36-4944-8cde-07ff719dc5fc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:10.682382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3058765-ac36-4944-8cde-07ff719dc5fc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:10.682872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3058765-ac36-4944-8cde-07ff719dc5fc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:11.032517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:11.362532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e3058765-ac36-4944-8cde-07ff719dc5fc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:11.375256 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e3058765-ac36-4944-8cde-07ff719dc5fc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1203 microversion: 2.1 time: 0.730620 Aug 18 12:12:11.379081 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3291/5945] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:10 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1203 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:11.384395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d6d6991-943b-46ca-bf0b-3be4c8fb365e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:11.385005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2d6d6991-943b-46ca-bf0b-3be4c8fb365e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:11.404879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d6d6991-943b-46ca-bf0b-3be4c8fb365e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:11.405739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d6d6991-943b-46ca-bf0b-3be4c8fb365e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:11.406387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d6d6991-943b-46ca-bf0b-3be4c8fb365e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:11.407391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d6d6991-943b-46ca-bf0b-3be4c8fb365e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:11.419309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d6d6991-943b-46ca-bf0b-3be4c8fb365e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:11.420204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d6d6991-943b-46ca-bf0b-3be4c8fb365e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:11.614418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2d6d6991-943b-46ca-bf0b-3be4c8fb365e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:11.628615 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d6d6991-943b-46ca-bf0b-3be4c8fb365e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1300 microversion: 2.1 time: 0.248052 Aug 18 12:12:11.629251 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3292/5946] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:11 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1300 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:12.323228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-19fb9f21-0d09-4aad-856b-16742fb131e0 req-d15b297d-3705-46dc-ad12-e220903f99ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4953ba06-278b-4016-b790-cecdd3ee10c1", "name": "network-vif-plugged", "status": "completed", "tag": "af775c28-1855-47c1-a061-fd6dd63d61a4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:12.350938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-19fb9f21-0d09-4aad-856b-16742fb131e0 req-d15b297d-3705-46dc-ad12-e220903f99ac service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:12.357068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-19fb9f21-0d09-4aad-856b-16742fb131e0 req-d15b297d-3705-46dc-ad12-e220903f99ac service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:12.359384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-19fb9f21-0d09-4aad-856b-16742fb131e0 req-d15b297d-3705-46dc-ad12-e220903f99ac service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:12.387719 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-19fb9f21-0d09-4aad-856b-16742fb131e0 req-d15b297d-3705-46dc-ad12-e220903f99ac service nova] Creating event network-vif-plugged:af775c28-1855-47c1-a061-fd6dd63d61a4 for instance 4953ba06-278b-4016-b790-cecdd3ee10c1 on n-h2-853611-3 Aug 18 12:12:12.408098 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-19fb9f21-0d09-4aad-856b-16742fb131e0 req-d15b297d-3705-46dc-ad12-e220903f99ac service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089767 Aug 18 12:12:12.411000 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3293/5947] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:12:12.428505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8da253d-1939-40b8-a357-e3ebc2914156 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:12.433402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f8da253d-1939-40b8-a357-e3ebc2914156 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:12.451857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8da253d-1939-40b8-a357-e3ebc2914156 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:12.456986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8da253d-1939-40b8-a357-e3ebc2914156 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:12.457434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8da253d-1939-40b8-a357-e3ebc2914156 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:12.462941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8da253d-1939-40b8-a357-e3ebc2914156 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:12.463727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8da253d-1939-40b8-a357-e3ebc2914156 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:12.464852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8da253d-1939-40b8-a357-e3ebc2914156 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:13.268586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f8da253d-1939-40b8-a357-e3ebc2914156 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:13.289273 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8da253d-1939-40b8-a357-e3ebc2914156 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1203 microversion: 2.1 time: 0.876464 Aug 18 12:12:13.290360 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3294/5948] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:12 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1203 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:13.305172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b00e82da-b6e4-407a-a7e9-8d549f98fe83 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:13.305754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b00e82da-b6e4-407a-a7e9-8d549f98fe83 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:13.323212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b00e82da-b6e4-407a-a7e9-8d549f98fe83 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:13.323899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b00e82da-b6e4-407a-a7e9-8d549f98fe83 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:13.324755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b00e82da-b6e4-407a-a7e9-8d549f98fe83 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:13.328718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b00e82da-b6e4-407a-a7e9-8d549f98fe83 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:13.330225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b00e82da-b6e4-407a-a7e9-8d549f98fe83 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:13.330810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b00e82da-b6e4-407a-a7e9-8d549f98fe83 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:13.525920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b00e82da-b6e4-407a-a7e9-8d549f98fe83 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:13.537055 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b00e82da-b6e4-407a-a7e9-8d549f98fe83 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1300 microversion: 2.1 time: 0.243127 Aug 18 12:12:13.538184 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3295/5949] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:13 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1300 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:13.544573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-42ff0109-4865-482d-9ab2-bc0371472729 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '.version_select at 0x7f519ed8ae50>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:13.580553 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-42ff0109-4865-482d-9ab2-bc0371472729 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-771020213" status: 202 len: 0 microversion: 2.1 time: 0.040675 Aug 18 12:12:13.582219 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3296/5950] 10.222.0.73 () {58 vars in 1281 bytes} [Thu Aug 18 12:12:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-771020213 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:12:13.646745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3aa2293b-c5d4-4864-8ea8-58b0afbd37ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'create', calling method: .version_select at 0x7f519fc1e550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1629016217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlcUQl02RybQeW3uXNgcequYgCkAOm6g2S8gatLT3/wKlbOw7iqGmu8w2Zy01xHSoceU0oeqBRzhG8JpW5k4ROmYQ4T5wFT4S1wdRZJL4iXeO9p1gcTsG4Gx4NNOjfLBA=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:13.747435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-3aa2293b-c5d4-4864-8ea8-58b0afbd37ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:12:13.763441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-3aa2293b-c5d4-4864-8ea8-58b0afbd37ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for user 916631a932304b6c9cec7ef622e2069d and project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:12:13.869272 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3aa2293b-c5d4-4864-8ea8-58b0afbd37ce tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.234447 Aug 18 12:12:13.874221 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3297/5951] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:12:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:12:14.327663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5339f019-3465-408a-af75-d05919fb37f3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:14.328763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5339f019-3465-408a-af75-d05919fb37f3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:14.340242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5339f019-3465-408a-af75-d05919fb37f3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:14.340758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5339f019-3465-408a-af75-d05919fb37f3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:14.341216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5339f019-3465-408a-af75-d05919fb37f3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:14.342095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5339f019-3465-408a-af75-d05919fb37f3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:14.347210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5339f019-3465-408a-af75-d05919fb37f3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:14.348031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5339f019-3465-408a-af75-d05919fb37f3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:14.779157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5339f019-3465-408a-af75-d05919fb37f3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:14.803973 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5339f019-3465-408a-af75-d05919fb37f3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1203 microversion: 2.1 time: 0.479936 Aug 18 12:12:14.807343 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3298/5952] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:14 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1203 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:12:14.843514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-28a6cdff-c76b-405e-9389-d85b87631139 req-7c302e87-11dd-41b7-857a-4b3141c3d88c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a27925-b2d4-4f3c-a39b-a4ebe1d496b7", "name": "network-vif-plugged", "status": "completed", "tag": "17b6b14d-f9e3-441a-8af8-2ef3da7100b6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:14.862898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-28a6cdff-c76b-405e-9389-d85b87631139 req-7c302e87-11dd-41b7-857a-4b3141c3d88c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:14.863747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-28a6cdff-c76b-405e-9389-d85b87631139 req-7c302e87-11dd-41b7-857a-4b3141c3d88c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:14.864379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-28a6cdff-c76b-405e-9389-d85b87631139 req-7c302e87-11dd-41b7-857a-4b3141c3d88c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:14.892146 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-28a6cdff-c76b-405e-9389-d85b87631139 req-7c302e87-11dd-41b7-857a-4b3141c3d88c service nova] Creating event network-vif-plugged:17b6b14d-f9e3-441a-8af8-2ef3da7100b6 for instance 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 on n-h2-853611-3 Aug 18 12:12:14.898751 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-28a6cdff-c76b-405e-9389-d85b87631139 req-7c302e87-11dd-41b7-857a-4b3141c3d88c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088130 Aug 18 12:12:14.903559 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3299/5953] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:12:14.915271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f732d5a9-d66d-4830-8863-b0de1df1c532 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:14.922613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f732d5a9-d66d-4830-8863-b0de1df1c532 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:14.931714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f732d5a9-d66d-4830-8863-b0de1df1c532 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:14.933170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f732d5a9-d66d-4830-8863-b0de1df1c532 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:14.937615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f732d5a9-d66d-4830-8863-b0de1df1c532 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:14.938712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f732d5a9-d66d-4830-8863-b0de1df1c532 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:14.939370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f732d5a9-d66d-4830-8863-b0de1df1c532 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:14.943054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f732d5a9-d66d-4830-8863-b0de1df1c532 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:15.161775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f732d5a9-d66d-4830-8863-b0de1df1c532 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:15.178846 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f732d5a9-d66d-4830-8863-b0de1df1c532 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1300 microversion: 2.1 time: 0.273028 Aug 18 12:12:15.179459 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3300/5954] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:14 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1300 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:15.456545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c0a77695-3dc2-4a60-9e0a-17c515682f82 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Action: 'create', calling method: .version_select at 0x7f519ef2bf70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2034608955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDlj5eLD+gBCMVID5f1FE5USCiJkT3VmoomoJyolYonvNNGJcUI+RFYAe6+iSJQxUPt+UG+mafmoO/tEHjonwXSW//aAu+isp97dXBS5nekLGi4AjkMygD8u31tfCcA2w=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:15.478272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c0a77695-3dc2-4a60-9e0a-17c515682f82 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Getting quotas for project 33e6a4cb7234446dae9a06b0a91810ad. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:12:15.486513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c0a77695-3dc2-4a60-9e0a-17c515682f82 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Getting quotas for user 84208046cadf456eb814d737b0bd516b and project 33e6a4cb7234446dae9a06b0a91810ad. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:12:15.503901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:15.535091 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c0a77695-3dc2-4a60-9e0a-17c515682f82 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.085475 Aug 18 12:12:15.542351 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3301/5955] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:12:15 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:12:15.845029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d9bc9271-69a2-454e-86c5-10f443ed70df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:15.845729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d9bc9271-69a2-454e-86c5-10f443ed70df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:15.856198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9bc9271-69a2-454e-86c5-10f443ed70df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:15.857067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9bc9271-69a2-454e-86c5-10f443ed70df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:15.858090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9bc9271-69a2-454e-86c5-10f443ed70df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:15.859053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9bc9271-69a2-454e-86c5-10f443ed70df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:15.859627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9bc9271-69a2-454e-86c5-10f443ed70df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:15.860425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9bc9271-69a2-454e-86c5-10f443ed70df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:16.146909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d9bc9271-69a2-454e-86c5-10f443ed70df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:16.153645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:16.176503 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d9bc9271-69a2-454e-86c5-10f443ed70df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1390 microversion: 2.1 time: 0.336586 Aug 18 12:12:16.187668 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3302/5956] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:15 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1390 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:12:16.214177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-683c0615-e313-49ce-964c-f726c9be4f4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:16.216348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-683c0615-e313-49ce-964c-f726c9be4f4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:16.247783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-683c0615-e313-49ce-964c-f726c9be4f4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:16.250498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-683c0615-e313-49ce-964c-f726c9be4f4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:16.251666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-683c0615-e313-49ce-964c-f726c9be4f4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:16.256933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-683c0615-e313-49ce-964c-f726c9be4f4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:16.260777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-683c0615-e313-49ce-964c-f726c9be4f4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:16.261919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-683c0615-e313-49ce-964c-f726c9be4f4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:16.602214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-683c0615-e313-49ce-964c-f726c9be4f4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:16.613985 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-683c0615-e313-49ce-964c-f726c9be4f4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1390 microversion: 2.1 time: 0.418570 Aug 18 12:12:16.621418 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3303/5957] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:16 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1390 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:16.627075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-51010496-d083-4970-9ae3-8a8bef916292 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:16.627983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-51010496-d083-4970-9ae3-8a8bef916292 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:16.637018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51010496-d083-4970-9ae3-8a8bef916292 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:16.637961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51010496-d083-4970-9ae3-8a8bef916292 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:16.638624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51010496-d083-4970-9ae3-8a8bef916292 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:16.640673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51010496-d083-4970-9ae3-8a8bef916292 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:16.641387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51010496-d083-4970-9ae3-8a8bef916292 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:16.641997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-51010496-d083-4970-9ae3-8a8bef916292 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:16.819189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-51010496-d083-4970-9ae3-8a8bef916292 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:16.835223 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-51010496-d083-4970-9ae3-8a8bef916292 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1473 microversion: 2.1 time: 0.212318 Aug 18 12:12:16.850666 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3304/5958] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:16 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1473 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:16.857332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-88bacc05-a7ed-43e6-9628-b8d022cf8fe3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:16.861184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88bacc05-a7ed-43e6-9628-b8d022cf8fe3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:16.871465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88bacc05-a7ed-43e6-9628-b8d022cf8fe3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:16.872397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88bacc05-a7ed-43e6-9628-b8d022cf8fe3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:16.874111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88bacc05-a7ed-43e6-9628-b8d022cf8fe3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:16.875917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88bacc05-a7ed-43e6-9628-b8d022cf8fe3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:16.876795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88bacc05-a7ed-43e6-9628-b8d022cf8fe3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:16.877587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88bacc05-a7ed-43e6-9628-b8d022cf8fe3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:17.118479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-88bacc05-a7ed-43e6-9628-b8d022cf8fe3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:17.134270 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-88bacc05-a7ed-43e6-9628-b8d022cf8fe3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1390 microversion: 2.1 time: 0.281592 Aug 18 12:12:17.135030 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3305/5959] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:16 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1390 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:17.141181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-35b42c82-2bd1-4e1e-887f-7aa1340b4205 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:17.142206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-35b42c82-2bd1-4e1e-887f-7aa1340b4205 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:17.151989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35b42c82-2bd1-4e1e-887f-7aa1340b4205 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:17.152920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35b42c82-2bd1-4e1e-887f-7aa1340b4205 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:17.154139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35b42c82-2bd1-4e1e-887f-7aa1340b4205 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:17.156358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35b42c82-2bd1-4e1e-887f-7aa1340b4205 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:17.157688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35b42c82-2bd1-4e1e-887f-7aa1340b4205 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:17.158338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35b42c82-2bd1-4e1e-887f-7aa1340b4205 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:17.299355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-35b42c82-2bd1-4e1e-887f-7aa1340b4205 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:17.320769 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-35b42c82-2bd1-4e1e-887f-7aa1340b4205 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1473 microversion: 2.1 time: 0.181947 Aug 18 12:12:17.321878 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3306/5960] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:17 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1473 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:17.342822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0758b49d-6124-4c5a-a02c-79182e6cfc73 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:17.345508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0758b49d-6124-4c5a-a02c-79182e6cfc73 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:17.363748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0758b49d-6124-4c5a-a02c-79182e6cfc73 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:17.364936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0758b49d-6124-4c5a-a02c-79182e6cfc73 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:17.365685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0758b49d-6124-4c5a-a02c-79182e6cfc73 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:17.368169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0758b49d-6124-4c5a-a02c-79182e6cfc73 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:17.369377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0758b49d-6124-4c5a-a02c-79182e6cfc73 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:17.370180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0758b49d-6124-4c5a-a02c-79182e6cfc73 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:17.427547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0758b49d-6124-4c5a-a02c-79182e6cfc73 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:12:17.608966 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0758b49d-6124-4c5a-a02c-79182e6cfc73 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 204 len: 0 microversion: 2.1 time: 0.279183 Aug 18 12:12:17.610841 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3307/5961] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:12:17 2022] DELETE /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:12:17.625309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d60ee21d-b843-4ec9-97da-f79ee0e43b7f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:17.627186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d60ee21d-b843-4ec9-97da-f79ee0e43b7f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:17.638534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d60ee21d-b843-4ec9-97da-f79ee0e43b7f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:17.641542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d60ee21d-b843-4ec9-97da-f79ee0e43b7f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:17.642734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d60ee21d-b843-4ec9-97da-f79ee0e43b7f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:17.644382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d60ee21d-b843-4ec9-97da-f79ee0e43b7f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:17.645796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d60ee21d-b843-4ec9-97da-f79ee0e43b7f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:17.646968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d60ee21d-b843-4ec9-97da-f79ee0e43b7f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:17.857780 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d60ee21d-b843-4ec9-97da-f79ee0e43b7f tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1624 microversion: 2.1 time: 0.244497 Aug 18 12:12:17.858911 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3308/5962] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:17 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1624 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:17.868517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a8597d13-838c-441c-a01d-17580854c7d0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:17.870178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a8597d13-838c-441c-a01d-17580854c7d0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:17.896828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8597d13-838c-441c-a01d-17580854c7d0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:17.898124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8597d13-838c-441c-a01d-17580854c7d0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:17.900115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8597d13-838c-441c-a01d-17580854c7d0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:17.902679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8597d13-838c-441c-a01d-17580854c7d0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:17.908307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8597d13-838c-441c-a01d-17580854c7d0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:17.909720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8597d13-838c-441c-a01d-17580854c7d0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:18.266196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a8597d13-838c-441c-a01d-17580854c7d0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:18.286972 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a8597d13-838c-441c-a01d-17580854c7d0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1396 microversion: 2.1 time: 0.426042 Aug 18 12:12:18.288323 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3309/5963] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:17 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1396 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:18.297062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ea6c1abc-382d-48f0-8124-fd406fcf7d86 tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:18.299040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ea6c1abc-382d-48f0-8124-fd406fcf7d86 tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:18.309920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea6c1abc-382d-48f0-8124-fd406fcf7d86 tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:18.311831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea6c1abc-382d-48f0-8124-fd406fcf7d86 tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:18.312907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea6c1abc-382d-48f0-8124-fd406fcf7d86 tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:18.314557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea6c1abc-382d-48f0-8124-fd406fcf7d86 tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:18.315697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea6c1abc-382d-48f0-8124-fd406fcf7d86 tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:18.317674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea6c1abc-382d-48f0-8124-fd406fcf7d86 tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:18.636697 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ea6c1abc-382d-48f0-8124-fd406fcf7d86 tempest-TestSecurityGroupsBasicOps-770611774 tempest-TestSecurityGroupsBasicOps-770611774-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1914 microversion: 2.1 time: 0.346200 Aug 18 12:12:18.651505 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3310/5964] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:18 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1914 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:18.683551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1386272920", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "eaa5fe0a-e1a9-47b2-9cca-447e6a8fad2e"}], "key_name": "tempest-TestNetworkBasicOps-2034608955", "security_groups": [{"name": "tempest-secgroup-smoke-1055436746"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:18.923864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] validate_networks() for [('eaa5fe0a-e1a9-47b2-9cca-447e6a8fad2e', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:12:19.917278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:12:19.918247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:12:19.918509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:12:19.919080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:12:19.920222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:12:19.932639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:19.933225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:19.933952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:19.934864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:19.935704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:19.936591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:19.962789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Getting quotas for project 33e6a4cb7234446dae9a06b0a91810ad. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:12:19.970759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Getting quotas for user 84208046cadf456eb814d737b0bd516b and project 33e6a4cb7234446dae9a06b0a91810ad. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:12:20.022773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:12:20.025884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:12:20.134830 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6291f48d-ce33-4a09-bf63-3520c92843a1 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.480867 Aug 18 12:12:20.143739 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3311/5965] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:12:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:12:20.159464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b07028a-14ef-432c-b77a-2ca1a84ffa6b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:20.160124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1b07028a-14ef-432c-b77a-2ca1a84ffa6b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:20.168831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b07028a-14ef-432c-b77a-2ca1a84ffa6b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:20.170061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b07028a-14ef-432c-b77a-2ca1a84ffa6b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:20.170628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b07028a-14ef-432c-b77a-2ca1a84ffa6b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:20.171417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b07028a-14ef-432c-b77a-2ca1a84ffa6b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:20.171902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b07028a-14ef-432c-b77a-2ca1a84ffa6b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:20.172402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b07028a-14ef-432c-b77a-2ca1a84ffa6b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:20.234873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1b07028a-14ef-432c-b77a-2ca1a84ffa6b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:12:20.442137 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1b07028a-14ef-432c-b77a-2ca1a84ffa6b tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "DELETE /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 204 len: 0 microversion: 2.1 time: 0.295595 Aug 18 12:12:20.444031 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3312/5966] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:12:20 2022] DELETE /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:12:20.456550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-72f87cea-db8a-48da-a4b8-fede01d4a61e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:20.458027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-72f87cea-db8a-48da-a4b8-fede01d4a61e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:20.473577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72f87cea-db8a-48da-a4b8-fede01d4a61e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:20.475232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72f87cea-db8a-48da-a4b8-fede01d4a61e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:20.476047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72f87cea-db8a-48da-a4b8-fede01d4a61e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:20.477088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72f87cea-db8a-48da-a4b8-fede01d4a61e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:20.478016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72f87cea-db8a-48da-a4b8-fede01d4a61e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:20.479892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72f87cea-db8a-48da-a4b8-fede01d4a61e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:20.595906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-72f87cea-db8a-48da-a4b8-fede01d4a61e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:20.618667 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-72f87cea-db8a-48da-a4b8-fede01d4a61e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1354 microversion: 2.1 time: 0.170871 Aug 18 12:12:20.636258 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3313/5967] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:20 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1354 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:20.644112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8e0be1d9-dc60-4bf5-b555-9039fba65066 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:20.644809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8e0be1d9-dc60-4bf5-b555-9039fba65066 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:20.730142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8e0be1d9-dc60-4bf5-b555-9039fba65066 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:20.743423 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8e0be1d9-dc60-4bf5-b555-9039fba65066 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 200 len: 1249 microversion: 2.1 time: 0.105867 Aug 18 12:12:20.744968 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3314/5968] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:20 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 1249 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:20.753783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-023400b7-c117-4610-a5a5-c03d498ae47d req-8ca7b3ca-4e76-4e29-9850-eb46e298a96c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4953ba06-278b-4016-b790-cecdd3ee10c1", "name": "network-vif-deleted", "tag": "af775c28-1855-47c1-a061-fd6dd63d61a4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:20.772725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-023400b7-c117-4610-a5a5-c03d498ae47d req-8ca7b3ca-4e76-4e29-9850-eb46e298a96c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:20.773540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-023400b7-c117-4610-a5a5-c03d498ae47d req-8ca7b3ca-4e76-4e29-9850-eb46e298a96c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:20.774465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-023400b7-c117-4610-a5a5-c03d498ae47d req-8ca7b3ca-4e76-4e29-9850-eb46e298a96c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:20.789729 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-023400b7-c117-4610-a5a5-c03d498ae47d req-8ca7b3ca-4e76-4e29-9850-eb46e298a96c service nova] Creating event network-vif-deleted:af775c28-1855-47c1-a061-fd6dd63d61a4 for instance 4953ba06-278b-4016-b790-cecdd3ee10c1 on n-h2-853611-3 Aug 18 12:12:20.801117 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-023400b7-c117-4610-a5a5-c03d498ae47d req-8ca7b3ca-4e76-4e29-9850-eb46e298a96c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051292 Aug 18 12:12:20.808653 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3315/5969] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:12:20.816685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-90e055e5-3dd9-4500-ac99-0b65f5c7be14 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:20.818039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-90e055e5-3dd9-4500-ac99-0b65f5c7be14 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:20.826683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90e055e5-3dd9-4500-ac99-0b65f5c7be14 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:20.827768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90e055e5-3dd9-4500-ac99-0b65f5c7be14 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:20.828215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90e055e5-3dd9-4500-ac99-0b65f5c7be14 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:20.828981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90e055e5-3dd9-4500-ac99-0b65f5c7be14 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:20.829507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90e055e5-3dd9-4500-ac99-0b65f5c7be14 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:20.829893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90e055e5-3dd9-4500-ac99-0b65f5c7be14 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:20.958777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-90e055e5-3dd9-4500-ac99-0b65f5c7be14 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:20.968921 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-90e055e5-3dd9-4500-ac99-0b65f5c7be14 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1479 microversion: 2.1 time: 0.158606 Aug 18 12:12:20.983425 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3316/5970] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:20 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1479 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:21.648137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a5c6e210-9fe5-4cb6-96d2-218abd1e04e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:21.650240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a5c6e210-9fe5-4cb6-96d2-218abd1e04e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:21.674181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5c6e210-9fe5-4cb6-96d2-218abd1e04e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:21.676905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5c6e210-9fe5-4cb6-96d2-218abd1e04e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:21.677575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5c6e210-9fe5-4cb6-96d2-218abd1e04e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:21.679750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5c6e210-9fe5-4cb6-96d2-218abd1e04e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:21.685170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5c6e210-9fe5-4cb6-96d2-218abd1e04e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:21.686475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5c6e210-9fe5-4cb6-96d2-218abd1e04e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:21.884309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a5c6e210-9fe5-4cb6-96d2-218abd1e04e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:21.897631 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a5c6e210-9fe5-4cb6-96d2-218abd1e04e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1188 microversion: 2.1 time: 0.257212 Aug 18 12:12:21.921821 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3317/5971] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:21 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:21.936733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cf5df737-f32a-4357-bdcb-76f5941e55fc tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:21.936733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cf5df737-f32a-4357-bdcb-76f5941e55fc tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:21.945599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf5df737-f32a-4357-bdcb-76f5941e55fc tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:21.945599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf5df737-f32a-4357-bdcb-76f5941e55fc tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:21.945599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf5df737-f32a-4357-bdcb-76f5941e55fc tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:21.946293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf5df737-f32a-4357-bdcb-76f5941e55fc tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:21.946694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf5df737-f32a-4357-bdcb-76f5941e55fc tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:21.947140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cf5df737-f32a-4357-bdcb-76f5941e55fc tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:21.979754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:22.162256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cf5df737-f32a-4357-bdcb-76f5941e55fc tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:22.214034 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cf5df737-f32a-4357-bdcb-76f5941e55fc tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 200 len: 1301 microversion: 2.1 time: 0.287372 Aug 18 12:12:22.220837 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3318/5972] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:21 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 1301 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:22.270912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b53b095-fb0f-43e8-9e31-7391a36bf63f tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:22.271781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3b53b095-fb0f-43e8-9e31-7391a36bf63f tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:22.305804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b53b095-fb0f-43e8-9e31-7391a36bf63f tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:22.306832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b53b095-fb0f-43e8-9e31-7391a36bf63f tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:22.308078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b53b095-fb0f-43e8-9e31-7391a36bf63f tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:22.325917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b53b095-fb0f-43e8-9e31-7391a36bf63f tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:22.335479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b53b095-fb0f-43e8-9e31-7391a36bf63f tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:22.336049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b53b095-fb0f-43e8-9e31-7391a36bf63f tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:22.723417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3b53b095-fb0f-43e8-9e31-7391a36bf63f tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:22.740837 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3b53b095-fb0f-43e8-9e31-7391a36bf63f tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1479 microversion: 2.1 time: 0.501015 Aug 18 12:12:22.741555 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3319/5973] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:22 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1479 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:22.922855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-04178c80-9d45-404d-8893-2fb890ed1853 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:22.923954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-04178c80-9d45-404d-8893-2fb890ed1853 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:22.931622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04178c80-9d45-404d-8893-2fb890ed1853 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:22.935463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04178c80-9d45-404d-8893-2fb890ed1853 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:22.935997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04178c80-9d45-404d-8893-2fb890ed1853 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:22.936805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04178c80-9d45-404d-8893-2fb890ed1853 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:22.937304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04178c80-9d45-404d-8893-2fb890ed1853 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:22.937875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04178c80-9d45-404d-8893-2fb890ed1853 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:23.129631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-04178c80-9d45-404d-8893-2fb890ed1853 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:23.153576 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-04178c80-9d45-404d-8893-2fb890ed1853 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1188 microversion: 2.1 time: 0.233501 Aug 18 12:12:23.154615 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3320/5974] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:22 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1188 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:23.266286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1323db94-7668-4d25-ab07-27cd56bb88e9 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:23.266978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1323db94-7668-4d25-ab07-27cd56bb88e9 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:23.288374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1323db94-7668-4d25-ab07-27cd56bb88e9 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:23.290541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1323db94-7668-4d25-ab07-27cd56bb88e9 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:23.295543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1323db94-7668-4d25-ab07-27cd56bb88e9 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:23.296677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1323db94-7668-4d25-ab07-27cd56bb88e9 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:23.297353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1323db94-7668-4d25-ab07-27cd56bb88e9 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:23.297975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1323db94-7668-4d25-ab07-27cd56bb88e9 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:23.429951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1323db94-7668-4d25-ab07-27cd56bb88e9 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:23.442276 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1323db94-7668-4d25-ab07-27cd56bb88e9 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 200 len: 1307 microversion: 2.1 time: 0.180730 Aug 18 12:12:23.442911 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3321/5975] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:23 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 1307 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:12:23.448420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8eb61cdf-7da6-43dc-a4b7-3d0106185314 req-70dc1441-9bdc-4acc-94c2-551df9e882c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a27925-b2d4-4f3c-a39b-a4ebe1d496b7", "name": "network-vif-deleted", "tag": "17b6b14d-f9e3-441a-8af8-2ef3da7100b6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:23.474873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8eb61cdf-7da6-43dc-a4b7-3d0106185314 req-70dc1441-9bdc-4acc-94c2-551df9e882c5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:23.476208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8eb61cdf-7da6-43dc-a4b7-3d0106185314 req-70dc1441-9bdc-4acc-94c2-551df9e882c5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:23.476966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8eb61cdf-7da6-43dc-a4b7-3d0106185314 req-70dc1441-9bdc-4acc-94c2-551df9e882c5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:23.499537 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8eb61cdf-7da6-43dc-a4b7-3d0106185314 req-70dc1441-9bdc-4acc-94c2-551df9e882c5 service nova] Creating event network-vif-deleted:17b6b14d-f9e3-441a-8af8-2ef3da7100b6 for instance 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 on n-h2-853611-3 Aug 18 12:12:23.509336 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8eb61cdf-7da6-43dc-a4b7-3d0106185314 req-70dc1441-9bdc-4acc-94c2-551df9e882c5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064405 Aug 18 12:12:23.518578 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3322/5976] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:12:23.769989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8cae34f6-b1f1-43b5-84fa-ae436c7ba185 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:23.771303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8cae34f6-b1f1-43b5-84fa-ae436c7ba185 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:23.790869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8cae34f6-b1f1-43b5-84fa-ae436c7ba185 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:23.791767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8cae34f6-b1f1-43b5-84fa-ae436c7ba185 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:23.792391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8cae34f6-b1f1-43b5-84fa-ae436c7ba185 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:23.794546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8cae34f6-b1f1-43b5-84fa-ae436c7ba185 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:23.796698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8cae34f6-b1f1-43b5-84fa-ae436c7ba185 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:23.798005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8cae34f6-b1f1-43b5-84fa-ae436c7ba185 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:23.893321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8cae34f6-b1f1-43b5-84fa-ae436c7ba185 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:23.900505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8cae34f6-b1f1-43b5-84fa-ae436c7ba185 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:23.901517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8cae34f6-b1f1-43b5-84fa-ae436c7ba185 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:23.902934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-8cae34f6-b1f1-43b5-84fa-ae436c7ba185 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lazy-loading 'fault' on Instance uuid 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:12:23.984676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8cae34f6-b1f1-43b5-84fa-ae436c7ba185 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:24.000957 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8cae34f6-b1f1-43b5-84fa-ae436c7ba185 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 200 len: 1332 microversion: 2.1 time: 0.241572 Aug 18 12:12:24.003495 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3323/5977] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:23 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 1332 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:24.192450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-664f041a-7ce0-456b-8088-755c130d082a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:24.193110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-664f041a-7ce0-456b-8088-755c130d082a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:24.205828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-664f041a-7ce0-456b-8088-755c130d082a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:24.206150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-664f041a-7ce0-456b-8088-755c130d082a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:24.206772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-664f041a-7ce0-456b-8088-755c130d082a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:24.207521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-664f041a-7ce0-456b-8088-755c130d082a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:24.213190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-664f041a-7ce0-456b-8088-755c130d082a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:24.216906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-664f041a-7ce0-456b-8088-755c130d082a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:24.401985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-664f041a-7ce0-456b-8088-755c130d082a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:24.412932 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-664f041a-7ce0-456b-8088-755c130d082a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1188 microversion: 2.1 time: 0.225847 Aug 18 12:12:24.423059 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3324/5978] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:24 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1188 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:24.484091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-987bef1c-282c-42a3-8b2b-f809512a4d8e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:24.485048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-987bef1c-282c-42a3-8b2b-f809512a4d8e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:24.500170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-987bef1c-282c-42a3-8b2b-f809512a4d8e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:24.504876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-987bef1c-282c-42a3-8b2b-f809512a4d8e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:24.506891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-987bef1c-282c-42a3-8b2b-f809512a4d8e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:24.508387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-987bef1c-282c-42a3-8b2b-f809512a4d8e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:24.510661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-987bef1c-282c-42a3-8b2b-f809512a4d8e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:24.513402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-987bef1c-282c-42a3-8b2b-f809512a4d8e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:24.679008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-987bef1c-282c-42a3-8b2b-f809512a4d8e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:24.697553 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-987bef1c-282c-42a3-8b2b-f809512a4d8e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 200 len: 1307 microversion: 2.1 time: 0.219251 Aug 18 12:12:24.698570 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3325/5979] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:24 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 1307 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:25.034995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b34e1f7-4baf-482f-be18-31ba6d069b48 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:25.036854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9b34e1f7-4baf-482f-be18-31ba6d069b48 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:25.065586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b34e1f7-4baf-482f-be18-31ba6d069b48 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:25.066534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b34e1f7-4baf-482f-be18-31ba6d069b48 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:25.067412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b34e1f7-4baf-482f-be18-31ba6d069b48 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:25.068753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b34e1f7-4baf-482f-be18-31ba6d069b48 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:25.069670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b34e1f7-4baf-482f-be18-31ba6d069b48 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:25.070510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b34e1f7-4baf-482f-be18-31ba6d069b48 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:25.103917 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-9b34e1f7-4baf-482f-be18-31ba6d069b48 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] HTTP exception thrown: Instance 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 could not be found. Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b34e1f7-4baf-482f-be18-31ba6d069b48 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Request method failure captured: Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 HTTP/1.1 Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iw4RfuG5SvTVRHmYh_fwCwoBC9Jf2LTBUHLnHUgyU2966HDtzgLtbvO_ytYR6ONq6_x16D-Y-YzrDeMcj-qOPaecUC6t17m5z5JcvUYeDU4Swd8S0hW2HYog495Kga6zbSZddC8d5Eg8iiO51-jeG_G9tzYewgu6JZpZFKum7PeFOA Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 8d220fd218d6489b87efc85c07845466 Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1466217222 Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8d220fd218d6489b87efc85c07845466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8d220fd218d6489b87efc85c07845466"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8d220fd218d6489b87efc85c07845466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8d220fd218d6489b87efc85c07845466"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1466217222 Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 8d220fd218d6489b87efc85c07845466 Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1466217222 Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestSecurityGroupsBasicOps-1466217222-project Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 846e61e4aec94b7895080117c55c2382 Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1466217222-project Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 could not be found. Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '10a27925-b2d4-4f3c-a39b-a4ebe1d496b7'} Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 could not be found. Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 could not be found. Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:25.107521 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:12:25.112076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:25.112076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:12:25.112076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:12:25.112076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:12:25.112076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:12:25.112076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:12:25.112076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 could not be found. Aug 18 12:12:25.112076 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:25.115539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b34e1f7-4baf-482f-be18-31ba6d069b48 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Returning 404 to user: Instance 10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:12:25.117418 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b34e1f7-4baf-482f-be18-31ba6d069b48 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7" status: 404 len: 111 microversion: 2.1 time: 0.095478 Aug 18 12:12:25.118788 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3326/5980] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:25 2022] GET /compute/v2.1/servers/10a27925-b2d4-4f3c-a39b-a4ebe1d496b7 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:12:25.452678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f6a3d302-501c-48b4-884a-6fa61f7c6e37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:25.455296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f6a3d302-501c-48b4-884a-6fa61f7c6e37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:25.476961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a3d302-501c-48b4-884a-6fa61f7c6e37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:25.478737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a3d302-501c-48b4-884a-6fa61f7c6e37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:25.482526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a3d302-501c-48b4-884a-6fa61f7c6e37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:25.485687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a3d302-501c-48b4-884a-6fa61f7c6e37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:25.487022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a3d302-501c-48b4-884a-6fa61f7c6e37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:25.491011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a3d302-501c-48b4-884a-6fa61f7c6e37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:25.789949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f6a3d302-501c-48b4-884a-6fa61f7c6e37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:25.819011 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f6a3d302-501c-48b4-884a-6fa61f7c6e37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1188 microversion: 2.1 time: 0.365063 Aug 18 12:12:25.833133 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3327/5981] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:25 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1188 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:25.840597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c182610c-aaf4-4d16-b0fb-e2c5f4204e48 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:25.844764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c182610c-aaf4-4d16-b0fb-e2c5f4204e48 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:25.865966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c182610c-aaf4-4d16-b0fb-e2c5f4204e48 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:25.867080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c182610c-aaf4-4d16-b0fb-e2c5f4204e48 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:25.869810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c182610c-aaf4-4d16-b0fb-e2c5f4204e48 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:25.872934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c182610c-aaf4-4d16-b0fb-e2c5f4204e48 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:25.874156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c182610c-aaf4-4d16-b0fb-e2c5f4204e48 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:25.875096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c182610c-aaf4-4d16-b0fb-e2c5f4204e48 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:26.021477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c182610c-aaf4-4d16-b0fb-e2c5f4204e48 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:26.063369 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c182610c-aaf4-4d16-b0fb-e2c5f4204e48 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 200 len: 1307 microversion: 2.1 time: 0.237139 Aug 18 12:12:26.064493 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3328/5982] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:25 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 1307 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:26.869344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-091e922b-ff6e-456f-b19d-bffd86dcd8a5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:26.873958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-091e922b-ff6e-456f-b19d-bffd86dcd8a5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:26.891775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-091e922b-ff6e-456f-b19d-bffd86dcd8a5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:26.893409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-091e922b-ff6e-456f-b19d-bffd86dcd8a5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:26.894184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-091e922b-ff6e-456f-b19d-bffd86dcd8a5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:26.896418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-091e922b-ff6e-456f-b19d-bffd86dcd8a5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:26.899168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-091e922b-ff6e-456f-b19d-bffd86dcd8a5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:26.899954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-091e922b-ff6e-456f-b19d-bffd86dcd8a5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:27.434468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-091e922b-ff6e-456f-b19d-bffd86dcd8a5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:27.452870 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-091e922b-ff6e-456f-b19d-bffd86dcd8a5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1188 microversion: 2.1 time: 0.592473 Aug 18 12:12:27.454143 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3329/5983] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:26 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1188 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:27.459418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d140cdbc-828d-4206-be94-45135fb89634 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:27.467783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d140cdbc-828d-4206-be94-45135fb89634 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:27.484525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d140cdbc-828d-4206-be94-45135fb89634 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:27.485367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d140cdbc-828d-4206-be94-45135fb89634 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:27.485993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d140cdbc-828d-4206-be94-45135fb89634 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:27.486978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d140cdbc-828d-4206-be94-45135fb89634 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:27.487642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d140cdbc-828d-4206-be94-45135fb89634 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:27.488264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d140cdbc-828d-4206-be94-45135fb89634 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:27.916621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d140cdbc-828d-4206-be94-45135fb89634 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:27.929922 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d140cdbc-828d-4206-be94-45135fb89634 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 200 len: 1375 microversion: 2.1 time: 0.474327 Aug 18 12:12:27.930999 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3330/5984] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:27 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 1375 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:28.344230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-743849295", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "04b345c0-6a3a-41ae-adf6-b5ef7efaba71"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1629016217", "security_groups": [{"name": "tempest-secgroup-smoke-719788953"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:29.390419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] validate_networks() for [('04b345c0-6a3a-41ae-adf6-b5ef7efaba71', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:12:29.947793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:30.744031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=16 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:30.861812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:12:30.863748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:12:30.864987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:12:30.865877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:12:30.866826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:12:30.887059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:30.888157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:30.889117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:30.890852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:30.892155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:30.893422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:30.923271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:30.940614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:12:30.956501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for user 916631a932304b6c9cec7ef622e2069d and project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:12:30.997295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:12:31.006268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:12:31.189383 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-66605396-4eac-4af2-b14d-9c60fecae7cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.849187 Aug 18 12:12:31.198054 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3331/5985] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:12:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 2863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:12:31.224750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3eb03e10-0273-434e-9feb-39f2ed5eeab9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:31.237533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3eb03e10-0273-434e-9feb-39f2ed5eeab9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:31.277278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3eb03e10-0273-434e-9feb-39f2ed5eeab9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:31.278638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3eb03e10-0273-434e-9feb-39f2ed5eeab9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:31.284329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3eb03e10-0273-434e-9feb-39f2ed5eeab9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:31.291983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3eb03e10-0273-434e-9feb-39f2ed5eeab9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:31.309534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3eb03e10-0273-434e-9feb-39f2ed5eeab9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:31.317450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3eb03e10-0273-434e-9feb-39f2ed5eeab9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:31.512001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3eb03e10-0273-434e-9feb-39f2ed5eeab9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:31.517566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3eb03e10-0273-434e-9feb-39f2ed5eeab9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:31.518809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3eb03e10-0273-434e-9feb-39f2ed5eeab9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:31.519824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-3eb03e10-0273-434e-9feb-39f2ed5eeab9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lazy-loading 'fault' on Instance uuid 4953ba06-278b-4016-b790-cecdd3ee10c1 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:12:31.696178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3eb03e10-0273-434e-9feb-39f2ed5eeab9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:31.771966 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3eb03e10-0273-434e-9feb-39f2ed5eeab9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 200 len: 1147 microversion: 2.1 time: 0.571943 Aug 18 12:12:31.779494 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3332/5986] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:31 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 1147 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:31.795918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-63c0362d-b1a2-465b-abd8-6fa737b1062d req-7ea3d006-c8b8-46a9-ad99-f388ec3af677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1", "tag": "1f1c5a91-7258-47aa-b7f6-e92b602ddd00"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:31.858120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-63c0362d-b1a2-465b-abd8-6fa737b1062d req-7ea3d006-c8b8-46a9-ad99-f388ec3af677 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:31.859243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-63c0362d-b1a2-465b-abd8-6fa737b1062d req-7ea3d006-c8b8-46a9-ad99-f388ec3af677 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:31.861453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-63c0362d-b1a2-465b-abd8-6fa737b1062d req-7ea3d006-c8b8-46a9-ad99-f388ec3af677 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:31.921278 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-63c0362d-b1a2-465b-abd8-6fa737b1062d req-7ea3d006-c8b8-46a9-ad99-f388ec3af677 service nova] Creating event network-changed:1f1c5a91-7258-47aa-b7f6-e92b602ddd00 for instance 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 on n-h1-853611-3 Aug 18 12:12:31.948372 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-63c0362d-b1a2-465b-abd8-6fa737b1062d req-7ea3d006-c8b8-46a9-ad99-f388ec3af677 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161941 Aug 18 12:12:31.955076 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3333/5987] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:12:31.974112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-04e8d8d5-96d2-4cd0-b391-8c7092171577 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:31.987192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-04e8d8d5-96d2-4cd0-b391-8c7092171577 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:32.016772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04e8d8d5-96d2-4cd0-b391-8c7092171577 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:32.019445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04e8d8d5-96d2-4cd0-b391-8c7092171577 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:32.025179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04e8d8d5-96d2-4cd0-b391-8c7092171577 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:32.029663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04e8d8d5-96d2-4cd0-b391-8c7092171577 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:32.033407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04e8d8d5-96d2-4cd0-b391-8c7092171577 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:32.038406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04e8d8d5-96d2-4cd0-b391-8c7092171577 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:33.223954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-04e8d8d5-96d2-4cd0-b391-8c7092171577 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:33.247856 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-04e8d8d5-96d2-4cd0-b391-8c7092171577 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 200 len: 1375 microversion: 2.1 time: 1.290475 Aug 18 12:12:33.249116 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3334/5988] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:31 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 1375 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:33.254202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-52ee766f-b2b3-4729-8ce2-06d8a7aba883 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:33.257986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-52ee766f-b2b3-4729-8ce2-06d8a7aba883 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:33.277459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52ee766f-b2b3-4729-8ce2-06d8a7aba883 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:33.280490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52ee766f-b2b3-4729-8ce2-06d8a7aba883 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:33.281371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52ee766f-b2b3-4729-8ce2-06d8a7aba883 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:33.282395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52ee766f-b2b3-4729-8ce2-06d8a7aba883 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:33.283106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52ee766f-b2b3-4729-8ce2-06d8a7aba883 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:33.284139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52ee766f-b2b3-4729-8ce2-06d8a7aba883 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:33.446943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-52ee766f-b2b3-4729-8ce2-06d8a7aba883 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:33.458865 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-52ee766f-b2b3-4729-8ce2-06d8a7aba883 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1262 microversion: 2.1 time: 0.208346 Aug 18 12:12:33.462690 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3335/5989] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:33 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1262 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:33.473690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-58876f2d-c1fa-4d87-9a04-496e538a74da tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:33.480336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-58876f2d-c1fa-4d87-9a04-496e538a74da tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 4953ba06-278b-4016-b790-cecdd3ee10c1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:33.502417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58876f2d-c1fa-4d87-9a04-496e538a74da tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:33.511433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58876f2d-c1fa-4d87-9a04-496e538a74da tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:33.512425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58876f2d-c1fa-4d87-9a04-496e538a74da tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:33.518394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58876f2d-c1fa-4d87-9a04-496e538a74da tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:33.520643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58876f2d-c1fa-4d87-9a04-496e538a74da tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:33.521574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58876f2d-c1fa-4d87-9a04-496e538a74da tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:33.633785 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-58876f2d-c1fa-4d87-9a04-496e538a74da tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance 4953ba06-278b-4016-b790-cecdd3ee10c1 could not be found. Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-58876f2d-c1fa-4d87-9a04-496e538a74da tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 HTTP/1.1 Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 4953ba06-278b-4016-b790-cecdd3ee10c1 could not be found. Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '4953ba06-278b-4016-b790-cecdd3ee10c1'} Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4953ba06-278b-4016-b790-cecdd3ee10c1 could not be found. Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4953ba06-278b-4016-b790-cecdd3ee10c1 could not be found. Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:12:33.642109 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:33.655763 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:12:33.655763 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:12:33.655763 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:12:33.655763 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:12:33.655763 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:12:33.655763 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4953ba06-278b-4016-b790-cecdd3ee10c1 could not be found. Aug 18 12:12:33.655763 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:33.655763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-58876f2d-c1fa-4d87-9a04-496e538a74da tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance 4953ba06-278b-4016-b790-cecdd3ee10c1 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:12:33.659293 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-58876f2d-c1fa-4d87-9a04-496e538a74da tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1" status: 404 len: 111 microversion: 2.1 time: 0.191978 Aug 18 12:12:33.664172 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3336/5990] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:33 2022] GET /compute/v2.1/servers/4953ba06-278b-4016-b790-cecdd3ee10c1 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:12:34.318234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d5a8affe-15e7-41bb-ba41-5acee94d8c5f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:34.323544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d5a8affe-15e7-41bb-ba41-5acee94d8c5f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:34.352780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a8affe-15e7-41bb-ba41-5acee94d8c5f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:34.354140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a8affe-15e7-41bb-ba41-5acee94d8c5f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:34.358675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a8affe-15e7-41bb-ba41-5acee94d8c5f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:34.360622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a8affe-15e7-41bb-ba41-5acee94d8c5f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:34.361816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a8affe-15e7-41bb-ba41-5acee94d8c5f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:34.378282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5a8affe-15e7-41bb-ba41-5acee94d8c5f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:34.959531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d5a8affe-15e7-41bb-ba41-5acee94d8c5f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:34.967959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:34.986810 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d5a8affe-15e7-41bb-ba41-5acee94d8c5f tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 200 len: 1375 microversion: 2.1 time: 0.681465 Aug 18 12:12:34.998995 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3337/5991] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:34 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 1375 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:35.025765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aa4fc8ad-0f12-4c41-b628-bd398014b17f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:35.027704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aa4fc8ad-0f12-4c41-b628-bd398014b17f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:35.046559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa4fc8ad-0f12-4c41-b628-bd398014b17f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:35.048228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa4fc8ad-0f12-4c41-b628-bd398014b17f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:35.049407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa4fc8ad-0f12-4c41-b628-bd398014b17f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:35.051323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa4fc8ad-0f12-4c41-b628-bd398014b17f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:35.052586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa4fc8ad-0f12-4c41-b628-bd398014b17f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:35.053761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa4fc8ad-0f12-4c41-b628-bd398014b17f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:35.246253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aa4fc8ad-0f12-4c41-b628-bd398014b17f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:35.259672 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aa4fc8ad-0f12-4c41-b628-bd398014b17f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1324 microversion: 2.1 time: 0.258417 Aug 18 12:12:35.260629 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3338/5992] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:34 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1324 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:36.029397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-491acc3e-5319-477b-9de2-07419462b414 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:36.032066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-491acc3e-5319-477b-9de2-07419462b414 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:36.047038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-491acc3e-5319-477b-9de2-07419462b414 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:36.048475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-491acc3e-5319-477b-9de2-07419462b414 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:36.049634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-491acc3e-5319-477b-9de2-07419462b414 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:36.051385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-491acc3e-5319-477b-9de2-07419462b414 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:36.052617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-491acc3e-5319-477b-9de2-07419462b414 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:36.053811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-491acc3e-5319-477b-9de2-07419462b414 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:36.447584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-491acc3e-5319-477b-9de2-07419462b414 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:36.462088 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-491acc3e-5319-477b-9de2-07419462b414 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 200 len: 1375 microversion: 2.1 time: 0.438634 Aug 18 12:12:36.463397 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3339/5993] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:36 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 1375 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:12:36.470109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bbe5a1d3-f404-48d2-ae4e-7a14bc6bc3dc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:36.471207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bbe5a1d3-f404-48d2-ae4e-7a14bc6bc3dc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:36.496957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbe5a1d3-f404-48d2-ae4e-7a14bc6bc3dc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:36.498241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbe5a1d3-f404-48d2-ae4e-7a14bc6bc3dc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:36.499615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbe5a1d3-f404-48d2-ae4e-7a14bc6bc3dc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:36.501735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbe5a1d3-f404-48d2-ae4e-7a14bc6bc3dc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:36.502616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbe5a1d3-f404-48d2-ae4e-7a14bc6bc3dc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:36.503269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbe5a1d3-f404-48d2-ae4e-7a14bc6bc3dc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:37.614347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bbe5a1d3-f404-48d2-ae4e-7a14bc6bc3dc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:37.632123 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bbe5a1d3-f404-48d2-ae4e-7a14bc6bc3dc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1391 microversion: 2.1 time: 1.165482 Aug 18 12:12:37.633195 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3340/5994] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:36 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1391 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:37.645816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-19b53877-78df-446e-86d1-5b95d53485ee req-c49cecca-6cbe-4c14-abf5-4369c395b023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1", "name": "network-vif-plugged", "status": "completed", "tag": "1f1c5a91-7258-47aa-b7f6-e92b602ddd00"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:37.670818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-19b53877-78df-446e-86d1-5b95d53485ee req-c49cecca-6cbe-4c14-abf5-4369c395b023 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:37.671684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-19b53877-78df-446e-86d1-5b95d53485ee req-c49cecca-6cbe-4c14-abf5-4369c395b023 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:37.672479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-19b53877-78df-446e-86d1-5b95d53485ee req-c49cecca-6cbe-4c14-abf5-4369c395b023 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:37.697872 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-19b53877-78df-446e-86d1-5b95d53485ee req-c49cecca-6cbe-4c14-abf5-4369c395b023 service nova] Creating event network-vif-plugged:1f1c5a91-7258-47aa-b7f6-e92b602ddd00 for instance 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 on n-h1-853611-3 Aug 18 12:12:37.719428 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-19b53877-78df-446e-86d1-5b95d53485ee req-c49cecca-6cbe-4c14-abf5-4369c395b023 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077346 Aug 18 12:12:37.727364 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3341/5995] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:12:37.738076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab74685d-1d50-4603-b66e-4f2ab9f35c3e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:37.739729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ab74685d-1d50-4603-b66e-4f2ab9f35c3e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:37.750824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab74685d-1d50-4603-b66e-4f2ab9f35c3e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:37.751309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab74685d-1d50-4603-b66e-4f2ab9f35c3e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:37.752251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab74685d-1d50-4603-b66e-4f2ab9f35c3e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:37.753726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab74685d-1d50-4603-b66e-4f2ab9f35c3e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:37.754841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab74685d-1d50-4603-b66e-4f2ab9f35c3e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:37.756091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab74685d-1d50-4603-b66e-4f2ab9f35c3e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:38.294121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ab74685d-1d50-4603-b66e-4f2ab9f35c3e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:38.327305 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab74685d-1d50-4603-b66e-4f2ab9f35c3e tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 200 len: 1375 microversion: 2.1 time: 0.589646 Aug 18 12:12:38.335795 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3342/5996] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:37 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 1375 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:38.343484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-74b21dd3-e349-43ce-a2b8-6fefe5498128 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:38.344372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-74b21dd3-e349-43ce-a2b8-6fefe5498128 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:38.352594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74b21dd3-e349-43ce-a2b8-6fefe5498128 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:38.353372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74b21dd3-e349-43ce-a2b8-6fefe5498128 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:38.354028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74b21dd3-e349-43ce-a2b8-6fefe5498128 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:38.355308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74b21dd3-e349-43ce-a2b8-6fefe5498128 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:38.356095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74b21dd3-e349-43ce-a2b8-6fefe5498128 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:38.356498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74b21dd3-e349-43ce-a2b8-6fefe5498128 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:38.389767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-74b21dd3-e349-43ce-a2b8-6fefe5498128 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:12:38.525925 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-74b21dd3-e349-43ce-a2b8-6fefe5498128 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 204 len: 0 microversion: 2.1 time: 0.188273 Aug 18 12:12:38.526956 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3343/5997] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:12:38 2022] DELETE /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:12:38.535808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f7b141e9-c3c0-41eb-a165-27764e18a996 req-c1a61585-2eb5-4266-832c-28650ef8189c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e77fafc-08a7-43f8-bf7f-97891d521eaa", "tag": "061fca7d-153a-4d50-ac8f-4846423f3180"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:38.550764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f7b141e9-c3c0-41eb-a165-27764e18a996 req-c1a61585-2eb5-4266-832c-28650ef8189c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:38.552128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f7b141e9-c3c0-41eb-a165-27764e18a996 req-c1a61585-2eb5-4266-832c-28650ef8189c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:38.552972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f7b141e9-c3c0-41eb-a165-27764e18a996 req-c1a61585-2eb5-4266-832c-28650ef8189c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:38.573168 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f7b141e9-c3c0-41eb-a165-27764e18a996 req-c1a61585-2eb5-4266-832c-28650ef8189c service nova] Creating event network-changed:061fca7d-153a-4d50-ac8f-4846423f3180 for instance 6e77fafc-08a7-43f8-bf7f-97891d521eaa on n-h1-853611-3 Aug 18 12:12:38.579397 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f7b141e9-c3c0-41eb-a165-27764e18a996 req-c1a61585-2eb5-4266-832c-28650ef8189c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050418 Aug 18 12:12:38.581279 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3344/5998] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:12:38.589379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-12d6afb6-a8f3-4a64-bd0b-229f8a983db3 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:38.590593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-12d6afb6-a8f3-4a64-bd0b-229f8a983db3 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:38.604072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d6afb6-a8f3-4a64-bd0b-229f8a983db3 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:38.604597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d6afb6-a8f3-4a64-bd0b-229f8a983db3 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:38.605053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d6afb6-a8f3-4a64-bd0b-229f8a983db3 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:38.605899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d6afb6-a8f3-4a64-bd0b-229f8a983db3 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:38.606743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d6afb6-a8f3-4a64-bd0b-229f8a983db3 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:38.610068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12d6afb6-a8f3-4a64-bd0b-229f8a983db3 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:38.990869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-12d6afb6-a8f3-4a64-bd0b-229f8a983db3 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:39.006049 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-12d6afb6-a8f3-4a64-bd0b-229f8a983db3 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1650 microversion: 2.1 time: 0.422400 Aug 18 12:12:39.008265 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3345/5999] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:38 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1650 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:39.019271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8919761-a229-496d-bed2-2b2c1006bc7d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:39.020845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f8919761-a229-496d-bed2-2b2c1006bc7d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:39.035537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8919761-a229-496d-bed2-2b2c1006bc7d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:39.036394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8919761-a229-496d-bed2-2b2c1006bc7d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:39.037057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8919761-a229-496d-bed2-2b2c1006bc7d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:39.038084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8919761-a229-496d-bed2-2b2c1006bc7d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:39.038844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8919761-a229-496d-bed2-2b2c1006bc7d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:39.039579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8919761-a229-496d-bed2-2b2c1006bc7d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:39.419706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f8919761-a229-496d-bed2-2b2c1006bc7d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:39.440234 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8919761-a229-496d-bed2-2b2c1006bc7d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1391 microversion: 2.1 time: 0.429254 Aug 18 12:12:39.442566 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3346/6000] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:39 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1391 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:39.457065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-636b4bd3-0585-4371-aaf3-606d7985a2bf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:39.459007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-636b4bd3-0585-4371-aaf3-606d7985a2bf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:39.490202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-636b4bd3-0585-4371-aaf3-606d7985a2bf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:39.496832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-636b4bd3-0585-4371-aaf3-606d7985a2bf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:39.497761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-636b4bd3-0585-4371-aaf3-606d7985a2bf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:39.499393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-636b4bd3-0585-4371-aaf3-606d7985a2bf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:39.502791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-636b4bd3-0585-4371-aaf3-606d7985a2bf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:39.503918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-636b4bd3-0585-4371-aaf3-606d7985a2bf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:39.828722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-636b4bd3-0585-4371-aaf3-606d7985a2bf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:39.848532 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-636b4bd3-0585-4371-aaf3-606d7985a2bf tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 200 len: 1375 microversion: 2.1 time: 0.403184 Aug 18 12:12:39.862583 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3347/6001] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:39 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 1375 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:40.040194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8f6021c9-3dfd-430c-ad7a-4a99afcf8ced tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:40.041158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8f6021c9-3dfd-430c-ad7a-4a99afcf8ced tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:40.056256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f6021c9-3dfd-430c-ad7a-4a99afcf8ced tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:40.056822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f6021c9-3dfd-430c-ad7a-4a99afcf8ced tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:40.059175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f6021c9-3dfd-430c-ad7a-4a99afcf8ced tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:40.060904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f6021c9-3dfd-430c-ad7a-4a99afcf8ced tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:40.061635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f6021c9-3dfd-430c-ad7a-4a99afcf8ced tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:40.062383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f6021c9-3dfd-430c-ad7a-4a99afcf8ced tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:40.391229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8f6021c9-3dfd-430c-ad7a-4a99afcf8ced tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:40.406636 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8f6021c9-3dfd-430c-ad7a-4a99afcf8ced tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1650 microversion: 2.1 time: 0.372902 Aug 18 12:12:40.408470 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3348/6002] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:40 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1650 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:12:40.480375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0dc2ce17-613b-4a6b-b8c5-8d6d08a17c0b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:40.481008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0dc2ce17-613b-4a6b-b8c5-8d6d08a17c0b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:40.493965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dc2ce17-613b-4a6b-b8c5-8d6d08a17c0b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:40.494863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dc2ce17-613b-4a6b-b8c5-8d6d08a17c0b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:40.495550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dc2ce17-613b-4a6b-b8c5-8d6d08a17c0b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:40.496536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dc2ce17-613b-4a6b-b8c5-8d6d08a17c0b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:40.497393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dc2ce17-613b-4a6b-b8c5-8d6d08a17c0b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:40.498059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0dc2ce17-613b-4a6b-b8c5-8d6d08a17c0b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:40.764927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0dc2ce17-613b-4a6b-b8c5-8d6d08a17c0b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:40.779228 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0dc2ce17-613b-4a6b-b8c5-8d6d08a17c0b tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1391 microversion: 2.1 time: 0.302828 Aug 18 12:12:40.780274 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3349/6003] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:40 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1391 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:12:40.785489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-46e6f480-021d-49c9-bb05-8b81e9f1f3be req-37a09914-577f-464e-b898-a3f58d33d274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c1ead01-3a78-454b-a119-6198f0e46211", "tag": "1dd7d952-6010-4a29-869b-f56b957404f0"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:40.820582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-46e6f480-021d-49c9-bb05-8b81e9f1f3be req-37a09914-577f-464e-b898-a3f58d33d274 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:40.820994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-46e6f480-021d-49c9-bb05-8b81e9f1f3be req-37a09914-577f-464e-b898-a3f58d33d274 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:40.821437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-46e6f480-021d-49c9-bb05-8b81e9f1f3be req-37a09914-577f-464e-b898-a3f58d33d274 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:40.836415 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-46e6f480-021d-49c9-bb05-8b81e9f1f3be req-37a09914-577f-464e-b898-a3f58d33d274 service nova] Creating event network-changed:1dd7d952-6010-4a29-869b-f56b957404f0 for instance 2c1ead01-3a78-454b-a119-6198f0e46211 on n-h2-853611-3 Aug 18 12:12:40.843298 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-46e6f480-021d-49c9-bb05-8b81e9f1f3be req-37a09914-577f-464e-b898-a3f58d33d274 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061317 Aug 18 12:12:40.844681 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3350/6004] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:12:40.873140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-66ed5942-b7c1-4b3c-9136-375025fb7725 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:40.874371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-66ed5942-b7c1-4b3c-9136-375025fb7725 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:40.884643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66ed5942-b7c1-4b3c-9136-375025fb7725 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:40.885683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66ed5942-b7c1-4b3c-9136-375025fb7725 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:40.886167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66ed5942-b7c1-4b3c-9136-375025fb7725 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:40.887621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66ed5942-b7c1-4b3c-9136-375025fb7725 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:40.888196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66ed5942-b7c1-4b3c-9136-375025fb7725 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:40.888816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66ed5942-b7c1-4b3c-9136-375025fb7725 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:40.927540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:40.972132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:41.361403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-66ed5942-b7c1-4b3c-9136-375025fb7725 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:41.386870 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-66ed5942-b7c1-4b3c-9136-375025fb7725 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 200 len: 1546 microversion: 2.1 time: 0.518102 Aug 18 12:12:41.387939 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3351/6005] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:40 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 1546 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:41.414674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ef7370a5-4227-4122-9924-39dc07661147 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:41.415605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef7370a5-4227-4122-9924-39dc07661147 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:41.435948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7370a5-4227-4122-9924-39dc07661147 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:41.436815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7370a5-4227-4122-9924-39dc07661147 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:41.438684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7370a5-4227-4122-9924-39dc07661147 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:41.442817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7370a5-4227-4122-9924-39dc07661147 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:41.444632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7370a5-4227-4122-9924-39dc07661147 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:41.445691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7370a5-4227-4122-9924-39dc07661147 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:41.781950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ef7370a5-4227-4122-9924-39dc07661147 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:41.796846 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ef7370a5-4227-4122-9924-39dc07661147 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 200 len: 1546 microversion: 2.1 time: 0.385057 Aug 18 12:12:41.809175 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3352/6006] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:41 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 1546 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:41.809175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab259eef-ed77-4552-8d80-c8dc16b2a76e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:41.809175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ab259eef-ed77-4552-8d80-c8dc16b2a76e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:41.819990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab259eef-ed77-4552-8d80-c8dc16b2a76e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:41.819990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab259eef-ed77-4552-8d80-c8dc16b2a76e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:41.819990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab259eef-ed77-4552-8d80-c8dc16b2a76e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:41.819990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab259eef-ed77-4552-8d80-c8dc16b2a76e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:41.819990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab259eef-ed77-4552-8d80-c8dc16b2a76e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:41.819990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab259eef-ed77-4552-8d80-c8dc16b2a76e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:41.906683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab259eef-ed77-4552-8d80-c8dc16b2a76e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:41.912768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab259eef-ed77-4552-8d80-c8dc16b2a76e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:41.913359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab259eef-ed77-4552-8d80-c8dc16b2a76e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:41.913932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-ab259eef-ed77-4552-8d80-c8dc16b2a76e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lazy-loading 'fault' on Instance uuid 6e77fafc-08a7-43f8-bf7f-97891d521eaa {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:12:42.015696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ab259eef-ed77-4552-8d80-c8dc16b2a76e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846e61e4aec94b7895080117c55c2382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d220fd218d6489b87efc85c07845466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:42.032287 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab259eef-ed77-4552-8d80-c8dc16b2a76e tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 200 len: 1384 microversion: 2.1 time: 0.232972 Aug 18 12:12:42.033517 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3353/6007] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:41 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 1384 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:42.045237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8f5fa5d0-0337-4045-b7de-295ab56e7cb8 req-3dc517c0-9389-4104-82f2-1e978aafe2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e77fafc-08a7-43f8-bf7f-97891d521eaa", "name": "network-vif-deleted", "tag": "061fca7d-153a-4d50-ac8f-4846423f3180"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:42.077951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8f5fa5d0-0337-4045-b7de-295ab56e7cb8 req-3dc517c0-9389-4104-82f2-1e978aafe2c6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:42.082263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8f5fa5d0-0337-4045-b7de-295ab56e7cb8 req-3dc517c0-9389-4104-82f2-1e978aafe2c6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:42.083134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8f5fa5d0-0337-4045-b7de-295ab56e7cb8 req-3dc517c0-9389-4104-82f2-1e978aafe2c6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:42.114397 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8f5fa5d0-0337-4045-b7de-295ab56e7cb8 req-3dc517c0-9389-4104-82f2-1e978aafe2c6 service nova] Creating event network-vif-deleted:061fca7d-153a-4d50-ac8f-4846423f3180 for instance 6e77fafc-08a7-43f8-bf7f-97891d521eaa on n-h1-853611-3 Aug 18 12:12:42.126490 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8f5fa5d0-0337-4045-b7de-295ab56e7cb8 req-3dc517c0-9389-4104-82f2-1e978aafe2c6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091440 Aug 18 12:12:42.135352 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3354/6008] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:12:42.141418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1c28442e-c97c-4045-bf3e-724e35ebd354 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:42.142058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1c28442e-c97c-4045-bf3e-724e35ebd354 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:42.156505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c28442e-c97c-4045-bf3e-724e35ebd354 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:42.157023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c28442e-c97c-4045-bf3e-724e35ebd354 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:42.157736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c28442e-c97c-4045-bf3e-724e35ebd354 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:42.158778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c28442e-c97c-4045-bf3e-724e35ebd354 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:42.159475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c28442e-c97c-4045-bf3e-724e35ebd354 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:42.160585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c28442e-c97c-4045-bf3e-724e35ebd354 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:42.173175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:42.413924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1c28442e-c97c-4045-bf3e-724e35ebd354 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:42.423626 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1c28442e-c97c-4045-bf3e-724e35ebd354 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1391 microversion: 2.1 time: 0.286492 Aug 18 12:12:42.424349 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3355/6009] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:42 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1391 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:42.750499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-895963489", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "66637ff4-de80-41da-b128-d8045a5db39d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11e09857-d75b-4b2b-82b3-fa5db86d3937"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:42.874916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] validate_networks() for [('11e09857-d75b-4b2b-82b3-fa5db86d3937', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:12:43.401594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:12:43.402234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:12:43.403095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:12:43.403835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:12:43.404355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:12:43.415595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:43.416680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:43.416680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:43.417511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:43.418080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:43.418614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:43.440931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:12:43.449762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for user 033d6aa61b5340189fbc5d895d3e8cba and project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:12:43.531428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:12:43.533639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66637ff4-de80-41da-b128-d8045a5db39d',volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:12:43.699987 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2cd75f90-53da-4d7d-bfef-c2f0798d6cb5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957258 Aug 18 12:12:43.700923 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3356/6010] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:12:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:12:43.706236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1ea19bb9-cc36-4ef6-bc36-07891b355894 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:43.706891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1ea19bb9-cc36-4ef6-bc36-07891b355894 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] [instance: 6e77fafc-08a7-43f8-bf7f-97891d521eaa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:43.715835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ea19bb9-cc36-4ef6-bc36-07891b355894 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:43.716662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ea19bb9-cc36-4ef6-bc36-07891b355894 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:43.717283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ea19bb9-cc36-4ef6-bc36-07891b355894 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:43.718244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ea19bb9-cc36-4ef6-bc36-07891b355894 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:43.718764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ea19bb9-cc36-4ef6-bc36-07891b355894 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:43.719198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ea19bb9-cc36-4ef6-bc36-07891b355894 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:43.737827 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-1ea19bb9-cc36-4ef6-bc36-07891b355894 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] HTTP exception thrown: Instance 6e77fafc-08a7-43f8-bf7f-97891d521eaa could not be found. Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1ea19bb9-cc36-4ef6-bc36-07891b355894 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Request method failure captured: Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa HTTP/1.1 Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iw4RfuG5SvTVRHmYh_fwCwoBC9Jf2LTBUHLnHUgyU2966HDtzgLtbvO_ytYR6ONq6_x16D-Y-YzrDeMcj-qOPaecUC6t17m5z5JcvUYeDU4Swd8S0hW2HYog495Kga6zbSZddC8d5Eg8iiO51-jeG_G9tzYewgu6JZpZFKum7PeFOA Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 8d220fd218d6489b87efc85c07845466 Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1466217222 Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8d220fd218d6489b87efc85c07845466"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/8d220fd218d6489b87efc85c07845466"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_8d220fd218d6489b87efc85c07845466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/8d220fd218d6489b87efc85c07845466"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1466217222 Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 8d220fd218d6489b87efc85c07845466 Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1466217222 Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestSecurityGroupsBasicOps-1466217222-project Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 846e61e4aec94b7895080117c55c2382 Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1466217222-project Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 6e77fafc-08a7-43f8-bf7f-97891d521eaa could not be found. Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '6e77fafc-08a7-43f8-bf7f-97891d521eaa'} Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e77fafc-08a7-43f8-bf7f-97891d521eaa could not be found. Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e77fafc-08a7-43f8-bf7f-97891d521eaa could not be found. Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:43.740569 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:12:43.749318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:43.749318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:12:43.749318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:12:43.749318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:12:43.749318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:12:43.749318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:12:43.749318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e77fafc-08a7-43f8-bf7f-97891d521eaa could not be found. Aug 18 12:12:43.749318 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:12:43.749318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1ea19bb9-cc36-4ef6-bc36-07891b355894 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Returning 404 to user: Instance 6e77fafc-08a7-43f8-bf7f-97891d521eaa could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:12:43.749318 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1ea19bb9-cc36-4ef6-bc36-07891b355894 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa" status: 404 len: 111 microversion: 2.1 time: 0.039946 Aug 18 12:12:43.749318 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3357/6011] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:43 2022] GET /compute/v2.1/servers/6e77fafc-08a7-43f8-bf7f-97891d521eaa => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:12:43.755784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0d0ca99f-4514-4ce2-b30d-0796fcd8135d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:43.755784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0d0ca99f-4514-4ce2-b30d-0796fcd8135d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:43.759065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d0ca99f-4514-4ce2-b30d-0796fcd8135d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:43.759570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d0ca99f-4514-4ce2-b30d-0796fcd8135d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:43.760014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d0ca99f-4514-4ce2-b30d-0796fcd8135d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:43.760743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d0ca99f-4514-4ce2-b30d-0796fcd8135d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:43.761205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d0ca99f-4514-4ce2-b30d-0796fcd8135d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:43.761635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d0ca99f-4514-4ce2-b30d-0796fcd8135d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:44.040343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0d0ca99f-4514-4ce2-b30d-0796fcd8135d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:44.051813 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0d0ca99f-4514-4ce2-b30d-0796fcd8135d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1391 microversion: 2.1 time: 0.304204 Aug 18 12:12:44.052574 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3358/6012] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:43 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1391 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:44.058040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b0406b77-45ae-430a-99c7-1afea8a4ab78 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:44.059217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b0406b77-45ae-430a-99c7-1afea8a4ab78 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:44.208356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b0406b77-45ae-430a-99c7-1afea8a4ab78 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:44.236550 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b0406b77-45ae-430a-99c7-1afea8a4ab78 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1056 microversion: 2.1 time: 0.182554 Aug 18 12:12:44.245617 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3359/6013] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:44 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1056 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:44.340877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-bf18bcc2-1080-4cc6-a319-4ebb01fbfe9b req-573dce01-4880-4d09-befb-c0298c4c2f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1ead01-3a78-454b-a119-6198f0e46211", "name": "network-vif-plugged", "status": "completed", "tag": "1dd7d952-6010-4a29-869b-f56b957404f0"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:44.396935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bf18bcc2-1080-4cc6-a319-4ebb01fbfe9b req-573dce01-4880-4d09-befb-c0298c4c2f8f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:44.398037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bf18bcc2-1080-4cc6-a319-4ebb01fbfe9b req-573dce01-4880-4d09-befb-c0298c4c2f8f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:44.398966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bf18bcc2-1080-4cc6-a319-4ebb01fbfe9b req-573dce01-4880-4d09-befb-c0298c4c2f8f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:44.456138 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-bf18bcc2-1080-4cc6-a319-4ebb01fbfe9b req-573dce01-4880-4d09-befb-c0298c4c2f8f service nova] Creating event network-vif-plugged:1dd7d952-6010-4a29-869b-f56b957404f0 for instance 2c1ead01-3a78-454b-a119-6198f0e46211 on n-h2-853611-3 Aug 18 12:12:44.488530 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-bf18bcc2-1080-4cc6-a319-4ebb01fbfe9b req-573dce01-4880-4d09-befb-c0298c4c2f8f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161160 Aug 18 12:12:44.490225 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3360/6014] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:12:44.561580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-21c241ec-0c4b-4428-91a4-2349be4e3a38 req-d0e84b80-dfab-4d84-b310-1383ab19fad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1", "tag": "1f1c5a91-7258-47aa-b7f6-e92b602ddd00"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:44.584762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-21c241ec-0c4b-4428-91a4-2349be4e3a38 req-d0e84b80-dfab-4d84-b310-1383ab19fad7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:44.588613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-21c241ec-0c4b-4428-91a4-2349be4e3a38 req-d0e84b80-dfab-4d84-b310-1383ab19fad7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:44.589793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-21c241ec-0c4b-4428-91a4-2349be4e3a38 req-d0e84b80-dfab-4d84-b310-1383ab19fad7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:44.620429 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-21c241ec-0c4b-4428-91a4-2349be4e3a38 req-d0e84b80-dfab-4d84-b310-1383ab19fad7 service nova] Creating event network-changed:1f1c5a91-7258-47aa-b7f6-e92b602ddd00 for instance 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 on n-h1-853611-3 Aug 18 12:12:44.633936 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-21c241ec-0c4b-4428-91a4-2349be4e3a38 req-d0e84b80-dfab-4d84-b310-1383ab19fad7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083601 Aug 18 12:12:44.636303 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3361/6015] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:12:45.077611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b66ddb11-ca31-47d1-9c97-d1758fc472bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:45.081796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b66ddb11-ca31-47d1-9c97-d1758fc472bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:45.095365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b66ddb11-ca31-47d1-9c97-d1758fc472bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:45.096873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b66ddb11-ca31-47d1-9c97-d1758fc472bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:45.097980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b66ddb11-ca31-47d1-9c97-d1758fc472bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:45.101284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b66ddb11-ca31-47d1-9c97-d1758fc472bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:45.103223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b66ddb11-ca31-47d1-9c97-d1758fc472bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:45.117693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b66ddb11-ca31-47d1-9c97-d1758fc472bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:45.415815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b66ddb11-ca31-47d1-9c97-d1758fc472bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:45.432485 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b66ddb11-ca31-47d1-9c97-d1758fc472bf tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1391 microversion: 2.1 time: 0.361516 Aug 18 12:12:45.453359 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3362/6016] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:45 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1391 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:45.471638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-81c1b048-db8e-452b-9c87-5b451c09ac4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:45.472857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-81c1b048-db8e-452b-9c87-5b451c09ac4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:45.480170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:45.489751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81c1b048-db8e-452b-9c87-5b451c09ac4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:45.490725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81c1b048-db8e-452b-9c87-5b451c09ac4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:45.491368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81c1b048-db8e-452b-9c87-5b451c09ac4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:45.492473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81c1b048-db8e-452b-9c87-5b451c09ac4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:45.493281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81c1b048-db8e-452b-9c87-5b451c09ac4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:45.493983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81c1b048-db8e-452b-9c87-5b451c09ac4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:45.632085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-81c1b048-db8e-452b-9c87-5b451c09ac4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:45.645821 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-81c1b048-db8e-452b-9c87-5b451c09ac4a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1154 microversion: 2.1 time: 0.190058 Aug 18 12:12:45.646850 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3363/6017] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:45 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1154 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:46.470841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7191e4c7-b5e5-4ad5-85e9-757f99d6410f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:46.471492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7191e4c7-b5e5-4ad5-85e9-757f99d6410f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:46.481351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7191e4c7-b5e5-4ad5-85e9-757f99d6410f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:46.483043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7191e4c7-b5e5-4ad5-85e9-757f99d6410f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:46.483828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7191e4c7-b5e5-4ad5-85e9-757f99d6410f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:46.490043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7191e4c7-b5e5-4ad5-85e9-757f99d6410f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:46.491258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7191e4c7-b5e5-4ad5-85e9-757f99d6410f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:46.492036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7191e4c7-b5e5-4ad5-85e9-757f99d6410f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:47.218374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7191e4c7-b5e5-4ad5-85e9-757f99d6410f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:47.234217 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7191e4c7-b5e5-4ad5-85e9-757f99d6410f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1563 microversion: 2.1 time: 0.768201 Aug 18 12:12:47.235873 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3364/6018] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:46 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1563 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:12:47.246794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0ae12b09-b64d-495a-9881-d20ab0931031 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:47.248415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0ae12b09-b64d-495a-9881-d20ab0931031 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:47.265401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ae12b09-b64d-495a-9881-d20ab0931031 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:47.267504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ae12b09-b64d-495a-9881-d20ab0931031 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:47.268129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ae12b09-b64d-495a-9881-d20ab0931031 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:47.269529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ae12b09-b64d-495a-9881-d20ab0931031 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:47.270801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ae12b09-b64d-495a-9881-d20ab0931031 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:47.271450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0ae12b09-b64d-495a-9881-d20ab0931031 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:47.400864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0ae12b09-b64d-495a-9881-d20ab0931031 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:47.417675 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0ae12b09-b64d-495a-9881-d20ab0931031 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1172 microversion: 2.1 time: 0.179576 Aug 18 12:12:47.419103 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3365/6019] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:47 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1172 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:47.455955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-37a0a37f-a770-40f0-b2a6-2f6075532f57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:47.457554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-37a0a37f-a770-40f0-b2a6-2f6075532f57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:47.470997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37a0a37f-a770-40f0-b2a6-2f6075532f57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:47.472052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37a0a37f-a770-40f0-b2a6-2f6075532f57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:47.473872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37a0a37f-a770-40f0-b2a6-2f6075532f57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:47.475043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37a0a37f-a770-40f0-b2a6-2f6075532f57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:47.475966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37a0a37f-a770-40f0-b2a6-2f6075532f57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:47.476846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37a0a37f-a770-40f0-b2a6-2f6075532f57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:48.022606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-37a0a37f-a770-40f0-b2a6-2f6075532f57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:48.036833 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-37a0a37f-a770-40f0-b2a6-2f6075532f57 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1563 microversion: 2.1 time: 0.603904 Aug 18 12:12:48.037932 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3366/6020] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:47 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1563 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:48.476300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df7aaee0-916a-41c8-8b00-e47e5c3511f2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:48.480557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df7aaee0-916a-41c8-8b00-e47e5c3511f2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:48.503853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df7aaee0-916a-41c8-8b00-e47e5c3511f2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:48.505868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df7aaee0-916a-41c8-8b00-e47e5c3511f2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:48.506923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df7aaee0-916a-41c8-8b00-e47e5c3511f2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:48.508994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df7aaee0-916a-41c8-8b00-e47e5c3511f2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:48.511095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df7aaee0-916a-41c8-8b00-e47e5c3511f2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:48.514967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df7aaee0-916a-41c8-8b00-e47e5c3511f2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:49.067445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df7aaee0-916a-41c8-8b00-e47e5c3511f2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:49.091194 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df7aaee0-916a-41c8-8b00-e47e5c3511f2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1214 microversion: 2.1 time: 0.628927 Aug 18 12:12:49.091395 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3367/6021] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:48 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1214 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:50.143923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-78aaa505-84be-47c6-bed8-d86af3d12e7d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:50.147981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-78aaa505-84be-47c6-bed8-d86af3d12e7d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:50.176544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78aaa505-84be-47c6-bed8-d86af3d12e7d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:50.186073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78aaa505-84be-47c6-bed8-d86af3d12e7d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:50.190074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78aaa505-84be-47c6-bed8-d86af3d12e7d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:50.192402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78aaa505-84be-47c6-bed8-d86af3d12e7d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:50.197151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78aaa505-84be-47c6-bed8-d86af3d12e7d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:50.198568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78aaa505-84be-47c6-bed8-d86af3d12e7d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:50.779489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-78aaa505-84be-47c6-bed8-d86af3d12e7d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:50.794709 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-78aaa505-84be-47c6-bed8-d86af3d12e7d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1214 microversion: 2.1 time: 0.658993 Aug 18 12:12:50.806994 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3368/6022] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:50 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1214 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:51.789725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ea07115f-c76e-42e8-97ca-2c88514e4262 req-6511a995-18e6-4171-8cf7-c90971a03f6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a205884-fa6d-4ed4-a0e2-2aea9052bc2f", "tag": "aedc2dee-52c4-48a8-b025-52ff6f0ac8b6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:51.806746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ea07115f-c76e-42e8-97ca-2c88514e4262 req-6511a995-18e6-4171-8cf7-c90971a03f6d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:51.807659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ea07115f-c76e-42e8-97ca-2c88514e4262 req-6511a995-18e6-4171-8cf7-c90971a03f6d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:51.808353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ea07115f-c76e-42e8-97ca-2c88514e4262 req-6511a995-18e6-4171-8cf7-c90971a03f6d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:51.822969 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ea07115f-c76e-42e8-97ca-2c88514e4262 req-6511a995-18e6-4171-8cf7-c90971a03f6d service nova] Creating event network-changed:aedc2dee-52c4-48a8-b025-52ff6f0ac8b6 for instance 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f on n-h2-853611-3 Aug 18 12:12:51.831010 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ea07115f-c76e-42e8-97ca-2c88514e4262 req-6511a995-18e6-4171-8cf7-c90971a03f6d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.587350 Aug 18 12:12:51.832677 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3369/6023] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:12:51.840433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8082bc49-2b7a-4ec8-a972-6f60581076c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:51.841531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8082bc49-2b7a-4ec8-a972-6f60581076c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:51.852659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8082bc49-2b7a-4ec8-a972-6f60581076c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:51.853706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8082bc49-2b7a-4ec8-a972-6f60581076c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:51.854456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8082bc49-2b7a-4ec8-a972-6f60581076c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:51.855677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8082bc49-2b7a-4ec8-a972-6f60581076c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:51.856500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8082bc49-2b7a-4ec8-a972-6f60581076c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:51.857047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8082bc49-2b7a-4ec8-a972-6f60581076c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:52.889897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8082bc49-2b7a-4ec8-a972-6f60581076c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:52.916817 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8082bc49-2b7a-4ec8-a972-6f60581076c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1214 microversion: 2.1 time: 1.081007 Aug 18 12:12:52.936496 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3370/6024] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:51 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1214 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:52.958779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-07a2410e-6432-47a6-8108-e4da5d9751cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:52.961746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-07a2410e-6432-47a6-8108-e4da5d9751cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:52.975243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07a2410e-6432-47a6-8108-e4da5d9751cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:52.976344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07a2410e-6432-47a6-8108-e4da5d9751cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:52.977557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07a2410e-6432-47a6-8108-e4da5d9751cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:52.979349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07a2410e-6432-47a6-8108-e4da5d9751cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:52.982153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07a2410e-6432-47a6-8108-e4da5d9751cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:52.983283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07a2410e-6432-47a6-8108-e4da5d9751cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:53.325917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-07a2410e-6432-47a6-8108-e4da5d9751cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:53.341672 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-07a2410e-6432-47a6-8108-e4da5d9751cb tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1563 microversion: 2.1 time: 0.400194 Aug 18 12:12:53.342662 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3371/6025] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:52 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1563 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:53.358124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9be00e22-4be3-4340-938f-88df3b0c2cb3 req-56a7077e-967a-463a-9d49-bd3ec6e796cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c1ead01-3a78-454b-a119-6198f0e46211", "tag": "1dd7d952-6010-4a29-869b-f56b957404f0"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:12:53.369982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9be00e22-4be3-4340-938f-88df3b0c2cb3 req-56a7077e-967a-463a-9d49-bd3ec6e796cc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:53.369982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9be00e22-4be3-4340-938f-88df3b0c2cb3 req-56a7077e-967a-463a-9d49-bd3ec6e796cc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:53.369982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9be00e22-4be3-4340-938f-88df3b0c2cb3 req-56a7077e-967a-463a-9d49-bd3ec6e796cc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:53.425297 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9be00e22-4be3-4340-938f-88df3b0c2cb3 req-56a7077e-967a-463a-9d49-bd3ec6e796cc service nova] Creating event network-changed:1dd7d952-6010-4a29-869b-f56b957404f0 for instance 2c1ead01-3a78-454b-a119-6198f0e46211 on n-h2-853611-3 Aug 18 12:12:53.445465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:53.454702 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9be00e22-4be3-4340-938f-88df3b0c2cb3 req-56a7077e-967a-463a-9d49-bd3ec6e796cc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109921 Aug 18 12:12:53.458510 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3372/6026] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:12:53.968690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1dcc626d-a643-4143-a2ee-80ac9a999c7e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:53.970945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1dcc626d-a643-4143-a2ee-80ac9a999c7e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:54.000884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dcc626d-a643-4143-a2ee-80ac9a999c7e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:54.002376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dcc626d-a643-4143-a2ee-80ac9a999c7e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:54.003190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dcc626d-a643-4143-a2ee-80ac9a999c7e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:54.008892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dcc626d-a643-4143-a2ee-80ac9a999c7e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:54.011687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dcc626d-a643-4143-a2ee-80ac9a999c7e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:54.015531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dcc626d-a643-4143-a2ee-80ac9a999c7e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:54.226920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:54.497906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1dcc626d-a643-4143-a2ee-80ac9a999c7e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:54.537796 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1dcc626d-a643-4143-a2ee-80ac9a999c7e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1214 microversion: 2.1 time: 0.583277 Aug 18 12:12:54.558249 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3373/6027] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:53 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1214 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:12:54.676211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06a7549a-e5db-4dc7-9148-f7a98c96ab84 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] Calling method '.version_select at 0x7f519faf6dc0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:54.708480 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-06a7549a-e5db-4dc7-9148-f7a98c96ab84 tempest-TestSecurityGroupsBasicOps-1466217222 tempest-TestSecurityGroupsBasicOps-1466217222-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1538337373" status: 202 len: 0 microversion: 2.1 time: 0.037099 Aug 18 12:12:54.709324 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3374/6028] 10.222.0.73 () {58 vars in 1278 bytes} [Thu Aug 18 12:12:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1538337373 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:12:55.573868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b529749-6e64-46c5-bc00-95738ec303c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:55.574811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9b529749-6e64-46c5-bc00-95738ec303c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:55.584682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b529749-6e64-46c5-bc00-95738ec303c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:55.585226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b529749-6e64-46c5-bc00-95738ec303c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:55.585678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b529749-6e64-46c5-bc00-95738ec303c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:55.586464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b529749-6e64-46c5-bc00-95738ec303c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:55.586946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b529749-6e64-46c5-bc00-95738ec303c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:55.587384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b529749-6e64-46c5-bc00-95738ec303c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:55.846762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9b529749-6e64-46c5-bc00-95738ec303c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:55.857276 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b529749-6e64-46c5-bc00-95738ec303c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1202 microversion: 2.1 time: 0.287359 Aug 18 12:12:55.857995 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3375/6029] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:55 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1202 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:12:56.884213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11db067c-0aca-4907-96f0-81cdcb15b3d6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:56.885295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-11db067c-0aca-4907-96f0-81cdcb15b3d6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:56.893831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11db067c-0aca-4907-96f0-81cdcb15b3d6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:56.894335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11db067c-0aca-4907-96f0-81cdcb15b3d6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:56.894847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11db067c-0aca-4907-96f0-81cdcb15b3d6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:56.895611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11db067c-0aca-4907-96f0-81cdcb15b3d6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:56.896309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11db067c-0aca-4907-96f0-81cdcb15b3d6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:56.896519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11db067c-0aca-4907-96f0-81cdcb15b3d6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:57.090909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11db067c-0aca-4907-96f0-81cdcb15b3d6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:57.103702 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-11db067c-0aca-4907-96f0-81cdcb15b3d6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1202 microversion: 2.1 time: 0.223539 Aug 18 12:12:57.104517 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3376/6030] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:56 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1202 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:12:58.135998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc9206eb-6fde-4036-890c-1a9d98e405b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:58.136700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dc9206eb-6fde-4036-890c-1a9d98e405b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:58.145663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc9206eb-6fde-4036-890c-1a9d98e405b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:58.146171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc9206eb-6fde-4036-890c-1a9d98e405b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:58.146675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc9206eb-6fde-4036-890c-1a9d98e405b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:58.147412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc9206eb-6fde-4036-890c-1a9d98e405b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:58.147885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc9206eb-6fde-4036-890c-1a9d98e405b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:58.148333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc9206eb-6fde-4036-890c-1a9d98e405b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:58.362006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dc9206eb-6fde-4036-890c-1a9d98e405b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:58.368759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:12:58.376557 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dc9206eb-6fde-4036-890c-1a9d98e405b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1202 microversion: 2.1 time: 0.243958 Aug 18 12:12:58.377700 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3377/6031] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:58 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1202 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:12:59.415022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-18c3331b-9209-409b-876e-8ad3a7796ce8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:12:59.416146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-18c3331b-9209-409b-876e-8ad3a7796ce8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:12:59.430370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18c3331b-9209-409b-876e-8ad3a7796ce8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:59.430966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18c3331b-9209-409b-876e-8ad3a7796ce8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:59.431711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18c3331b-9209-409b-876e-8ad3a7796ce8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:59.432539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18c3331b-9209-409b-876e-8ad3a7796ce8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:12:59.433979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18c3331b-9209-409b-876e-8ad3a7796ce8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:12:59.434751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-18c3331b-9209-409b-876e-8ad3a7796ce8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:12:59.659741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-18c3331b-9209-409b-876e-8ad3a7796ce8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:12:59.674656 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-18c3331b-9209-409b-876e-8ad3a7796ce8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1202 microversion: 2.1 time: 0.267881 Aug 18 12:12:59.675724 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3378/6032] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:12:59 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1202 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:00.713112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-027603af-2748-44da-a929-4c2a25c968b0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:00.714208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-027603af-2748-44da-a929-4c2a25c968b0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:00.737672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-027603af-2748-44da-a929-4c2a25c968b0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:00.738951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-027603af-2748-44da-a929-4c2a25c968b0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:00.739971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-027603af-2748-44da-a929-4c2a25c968b0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:00.741535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-027603af-2748-44da-a929-4c2a25c968b0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:00.742635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-027603af-2748-44da-a929-4c2a25c968b0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:00.743629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-027603af-2748-44da-a929-4c2a25c968b0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:00.997149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-027603af-2748-44da-a929-4c2a25c968b0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:01.012756 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-027603af-2748-44da-a929-4c2a25c968b0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1202 microversion: 2.1 time: 0.305372 Aug 18 12:13:01.014771 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3379/6033] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:00 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1202 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:01.245517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1726356101", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "19539f6b-8357-4afe-88c6-b748e1870156"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:01.340757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] validate_networks() for [('19539f6b-8357-4afe-88c6-b748e1870156', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:13:01.766010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:13:01.766817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:13:01.767074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:13:01.767492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:13:01.767922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:13:01.778285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:01.778815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:01.779269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:01.780013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:01.781092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:01.781541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:01.801062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Getting quotas for project 2b307834607645f895657f71f3f6da85. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:13:01.807245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Getting quotas for user d900af30ba5c4e71b856f96cc77c963f and project 2b307834607645f895657f71f3f6da85. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:13:01.822598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:13:01.824953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:13:01.879213 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c673b4b0-e8b9-48ec-a742-afd9007020b2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804023 Aug 18 12:13:01.880374 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3380/6034] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:13:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:13:01.897023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-12f2f94f-fc6d-47b6-8d24-c4b8e2c3dfd8 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:01.898610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-12f2f94f-fc6d-47b6-8d24-c4b8e2c3dfd8 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:01.978237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-12f2f94f-fc6d-47b6-8d24-c4b8e2c3dfd8 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:01.988241 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-12f2f94f-fc6d-47b6-8d24-c4b8e2c3dfd8 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1215 microversion: 2.1 time: 0.098866 Aug 18 12:13:01.989246 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3381/6035] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:01 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:02.051663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e9987999-cd41-4ea4-a7f3-63fc8e1e93dc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:02.052875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e9987999-cd41-4ea4-a7f3-63fc8e1e93dc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:02.065063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9987999-cd41-4ea4-a7f3-63fc8e1e93dc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:02.065963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9987999-cd41-4ea4-a7f3-63fc8e1e93dc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:02.066860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9987999-cd41-4ea4-a7f3-63fc8e1e93dc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:02.068168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9987999-cd41-4ea4-a7f3-63fc8e1e93dc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:02.069047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9987999-cd41-4ea4-a7f3-63fc8e1e93dc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:02.069854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9987999-cd41-4ea4-a7f3-63fc8e1e93dc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:02.306324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e9987999-cd41-4ea4-a7f3-63fc8e1e93dc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:02.316038 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e9987999-cd41-4ea4-a7f3-63fc8e1e93dc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1202 microversion: 2.1 time: 0.272131 Aug 18 12:13:02.317369 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3382/6036] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:02 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1202 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:03.022000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-05a7ce8c-c877-46a7-9a5a-6db91cc2d2ce tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:03.022751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-05a7ce8c-c877-46a7-9a5a-6db91cc2d2ce tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:03.030454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05a7ce8c-c877-46a7-9a5a-6db91cc2d2ce tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:03.031042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05a7ce8c-c877-46a7-9a5a-6db91cc2d2ce tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:03.031545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05a7ce8c-c877-46a7-9a5a-6db91cc2d2ce tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:03.032317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05a7ce8c-c877-46a7-9a5a-6db91cc2d2ce tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:03.032788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05a7ce8c-c877-46a7-9a5a-6db91cc2d2ce tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:03.033225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05a7ce8c-c877-46a7-9a5a-6db91cc2d2ce tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:03.110807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-05a7ce8c-c877-46a7-9a5a-6db91cc2d2ce tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:03.126091 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-05a7ce8c-c877-46a7-9a5a-6db91cc2d2ce tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1267 microversion: 2.1 time: 0.107563 Aug 18 12:13:03.127226 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3383/6037] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:03 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1267 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:03.349444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab22e09b-c58d-40ff-802c-4bc1aa20547a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:03.350469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ab22e09b-c58d-40ff-802c-4bc1aa20547a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:03.364671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab22e09b-c58d-40ff-802c-4bc1aa20547a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:03.366128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab22e09b-c58d-40ff-802c-4bc1aa20547a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:03.366852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab22e09b-c58d-40ff-802c-4bc1aa20547a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:03.368373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab22e09b-c58d-40ff-802c-4bc1aa20547a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:03.369142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab22e09b-c58d-40ff-802c-4bc1aa20547a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:03.369982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab22e09b-c58d-40ff-802c-4bc1aa20547a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:03.542135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ab22e09b-c58d-40ff-802c-4bc1aa20547a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:03.550730 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab22e09b-c58d-40ff-802c-4bc1aa20547a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1202 microversion: 2.1 time: 0.207879 Aug 18 12:13:03.551356 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3384/6038] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:03 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1202 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:04.149774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b778093-fb4a-4f88-b3cb-8d024038b657 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:04.150948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3b778093-fb4a-4f88-b3cb-8d024038b657 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:04.160156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b778093-fb4a-4f88-b3cb-8d024038b657 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:04.160672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b778093-fb4a-4f88-b3cb-8d024038b657 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:04.161383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b778093-fb4a-4f88-b3cb-8d024038b657 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:04.162145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b778093-fb4a-4f88-b3cb-8d024038b657 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:04.162679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b778093-fb4a-4f88-b3cb-8d024038b657 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:04.163122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b778093-fb4a-4f88-b3cb-8d024038b657 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:04.387582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3b778093-fb4a-4f88-b3cb-8d024038b657 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:04.408586 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3b778093-fb4a-4f88-b3cb-8d024038b657 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1315 microversion: 2.1 time: 0.262955 Aug 18 12:13:04.410012 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3385/6039] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:04 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:04.421497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ca731d7a-46f5-4882-b63b-d66d431c1eab req-3eaa936f-14af-421e-9cf5-8e6cbcb7680d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a205884-fa6d-4ed4-a0e2-2aea9052bc2f", "name": "network-vif-plugged", "status": "completed", "tag": "aedc2dee-52c4-48a8-b025-52ff6f0ac8b6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:04.441540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ca731d7a-46f5-4882-b63b-d66d431c1eab req-3eaa936f-14af-421e-9cf5-8e6cbcb7680d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:04.443142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ca731d7a-46f5-4882-b63b-d66d431c1eab req-3eaa936f-14af-421e-9cf5-8e6cbcb7680d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:04.446325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ca731d7a-46f5-4882-b63b-d66d431c1eab req-3eaa936f-14af-421e-9cf5-8e6cbcb7680d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:04.472918 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ca731d7a-46f5-4882-b63b-d66d431c1eab req-3eaa936f-14af-421e-9cf5-8e6cbcb7680d service nova] Creating event network-vif-plugged:aedc2dee-52c4-48a8-b025-52ff6f0ac8b6 for instance 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f on n-h2-853611-3 Aug 18 12:13:04.485533 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ca731d7a-46f5-4882-b63b-d66d431c1eab req-3eaa936f-14af-421e-9cf5-8e6cbcb7680d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072534 Aug 18 12:13:04.487139 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3386/6040] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:04.587476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ef8865f3-8929-49c8-a9be-d9ad7756a72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:04.588626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef8865f3-8929-49c8-a9be-d9ad7756a72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:04.603081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef8865f3-8929-49c8-a9be-d9ad7756a72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:04.604670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef8865f3-8929-49c8-a9be-d9ad7756a72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:04.605407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef8865f3-8929-49c8-a9be-d9ad7756a72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:04.607186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef8865f3-8929-49c8-a9be-d9ad7756a72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:04.612520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef8865f3-8929-49c8-a9be-d9ad7756a72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:04.613424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef8865f3-8929-49c8-a9be-d9ad7756a72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:04.865526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ef8865f3-8929-49c8-a9be-d9ad7756a72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:04.880597 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ef8865f3-8929-49c8-a9be-d9ad7756a72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1202 microversion: 2.1 time: 0.299396 Aug 18 12:13:04.881727 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3387/6041] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:04 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1202 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:05.083957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4247dced-b8cf-467d-8f50-fddc648b10c5 req-662c0e86-e544-4262-993d-064d70c7b56d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96dffcb6-aa8e-4801-879c-44668bb30180", "tag": "a134e16d-9b2c-4ca8-a768-32ccece885e8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:05.102734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4247dced-b8cf-467d-8f50-fddc648b10c5 req-662c0e86-e544-4262-993d-064d70c7b56d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:05.104096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4247dced-b8cf-467d-8f50-fddc648b10c5 req-662c0e86-e544-4262-993d-064d70c7b56d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:05.105017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4247dced-b8cf-467d-8f50-fddc648b10c5 req-662c0e86-e544-4262-993d-064d70c7b56d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:05.131908 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4247dced-b8cf-467d-8f50-fddc648b10c5 req-662c0e86-e544-4262-993d-064d70c7b56d service nova] Creating event network-changed:a134e16d-9b2c-4ca8-a768-32ccece885e8 for instance 96dffcb6-aa8e-4801-879c-44668bb30180 on n-h1-853611-3 Aug 18 12:13:05.139390 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4247dced-b8cf-467d-8f50-fddc648b10c5 req-662c0e86-e544-4262-993d-064d70c7b56d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063384 Aug 18 12:13:05.140377 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3388/6042] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:13:05.197496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5218c7e2-9b0b-4dbc-ba2c-3371ae15aad4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:05.201136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5218c7e2-9b0b-4dbc-ba2c-3371ae15aad4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:05.211226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5218c7e2-9b0b-4dbc-ba2c-3371ae15aad4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:05.211734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5218c7e2-9b0b-4dbc-ba2c-3371ae15aad4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:05.212915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5218c7e2-9b0b-4dbc-ba2c-3371ae15aad4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:05.212915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5218c7e2-9b0b-4dbc-ba2c-3371ae15aad4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:05.213448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5218c7e2-9b0b-4dbc-ba2c-3371ae15aad4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:05.213847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5218c7e2-9b0b-4dbc-ba2c-3371ae15aad4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:05.280678 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5218c7e2-9b0b-4dbc-ba2c-3371ae15aad4 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "POST /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1/action" status: 200 len: 24568 microversion: 2.1 time: 0.089086 Aug 18 12:13:05.282210 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3389/6043] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:13:05 2022] POST /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1/action => generated 24568 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:13:05.446009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c4cb4bd-e33c-4bb6-a00b-70969f6993a1 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:05.447096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c4cb4bd-e33c-4bb6-a00b-70969f6993a1 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:05.459330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c4cb4bd-e33c-4bb6-a00b-70969f6993a1 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:05.459844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c4cb4bd-e33c-4bb6-a00b-70969f6993a1 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:05.460303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c4cb4bd-e33c-4bb6-a00b-70969f6993a1 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:05.461090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c4cb4bd-e33c-4bb6-a00b-70969f6993a1 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:05.461601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c4cb4bd-e33c-4bb6-a00b-70969f6993a1 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:05.462047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c4cb4bd-e33c-4bb6-a00b-70969f6993a1 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:05.664157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9c4cb4bd-e33c-4bb6-a00b-70969f6993a1 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:05.675837 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c4cb4bd-e33c-4bb6-a00b-70969f6993a1 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1315 microversion: 2.1 time: 0.237163 Aug 18 12:13:05.676542 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3390/6044] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:05 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:05.916417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec8330b0-4434-42df-adeb-d6f4d700d8f6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:05.917338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ec8330b0-4434-42df-adeb-d6f4d700d8f6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:05.927409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec8330b0-4434-42df-adeb-d6f4d700d8f6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:05.928224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec8330b0-4434-42df-adeb-d6f4d700d8f6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:05.928961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec8330b0-4434-42df-adeb-d6f4d700d8f6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:05.931005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec8330b0-4434-42df-adeb-d6f4d700d8f6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:05.932254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec8330b0-4434-42df-adeb-d6f4d700d8f6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:05.933043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec8330b0-4434-42df-adeb-d6f4d700d8f6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:06.118329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ec8330b0-4434-42df-adeb-d6f4d700d8f6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:06.127401 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ec8330b0-4434-42df-adeb-d6f4d700d8f6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1390 microversion: 2.1 time: 0.216116 Aug 18 12:13:06.128016 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3391/6045] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:05 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1390 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:06.149672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f736c416-0636-42c6-b693-19ce76686639 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:06.150304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f736c416-0636-42c6-b693-19ce76686639 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:06.157718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f736c416-0636-42c6-b693-19ce76686639 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:06.158218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f736c416-0636-42c6-b693-19ce76686639 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:06.158709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f736c416-0636-42c6-b693-19ce76686639 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:06.159453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f736c416-0636-42c6-b693-19ce76686639 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:06.159922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f736c416-0636-42c6-b693-19ce76686639 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:06.160393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f736c416-0636-42c6-b693-19ce76686639 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:06.326987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f736c416-0636-42c6-b693-19ce76686639 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:06.345679 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f736c416-0636-42c6-b693-19ce76686639 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1390 microversion: 2.1 time: 0.199909 Aug 18 12:13:06.346883 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3392/6046] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:06 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1390 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:06.369171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f69804d4-e82a-494c-838b-e68fbe63dac1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:06.369810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f69804d4-e82a-494c-838b-e68fbe63dac1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:06.379026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f69804d4-e82a-494c-838b-e68fbe63dac1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:06.379567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f69804d4-e82a-494c-838b-e68fbe63dac1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:06.380014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f69804d4-e82a-494c-838b-e68fbe63dac1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:06.380768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f69804d4-e82a-494c-838b-e68fbe63dac1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:06.381241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f69804d4-e82a-494c-838b-e68fbe63dac1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:06.381678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f69804d4-e82a-494c-838b-e68fbe63dac1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:06.545897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f69804d4-e82a-494c-838b-e68fbe63dac1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:06.554773 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f69804d4-e82a-494c-838b-e68fbe63dac1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1390 microversion: 2.1 time: 0.189548 Aug 18 12:13:06.555385 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3393/6047] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:06 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1390 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:06.585777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-485d8d66-1265-4021-a73b-261a4e7e61e0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:06.586282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-485d8d66-1265-4021-a73b-261a4e7e61e0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:06.598161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-485d8d66-1265-4021-a73b-261a4e7e61e0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:06.598853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-485d8d66-1265-4021-a73b-261a4e7e61e0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:06.599391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-485d8d66-1265-4021-a73b-261a4e7e61e0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:06.600199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-485d8d66-1265-4021-a73b-261a4e7e61e0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:06.600872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-485d8d66-1265-4021-a73b-261a4e7e61e0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:06.601566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-485d8d66-1265-4021-a73b-261a4e7e61e0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:06.632228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-485d8d66-1265-4021-a73b-261a4e7e61e0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:13:06.735085 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-485d8d66-1265-4021-a73b-261a4e7e61e0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 204 len: 0 microversion: 2.1 time: 0.154621 Aug 18 12:13:06.736130 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3394/6048] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:13:06 2022] DELETE /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:13:06.745197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8f2c471-6a50-4b1c-bfd6-d15253a966c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:06.746518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e8f2c471-6a50-4b1c-bfd6-d15253a966c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:06.756493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f2c471-6a50-4b1c-bfd6-d15253a966c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:06.757312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f2c471-6a50-4b1c-bfd6-d15253a966c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:06.758081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f2c471-6a50-4b1c-bfd6-d15253a966c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:06.759413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f2c471-6a50-4b1c-bfd6-d15253a966c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:06.760244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f2c471-6a50-4b1c-bfd6-d15253a966c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:06.761283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8f2c471-6a50-4b1c-bfd6-d15253a966c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:06.942521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e8f2c471-6a50-4b1c-bfd6-d15253a966c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:06.951952 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e8f2c471-6a50-4b1c-bfd6-d15253a966c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1315 microversion: 2.1 time: 0.213401 Aug 18 12:13:06.952797 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3395/6049] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:06 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:06.957820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c4005e8f-1cbb-4f32-ba4a-bad9c1896626 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:06.958663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c4005e8f-1cbb-4f32-ba4a-bad9c1896626 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:06.965215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4005e8f-1cbb-4f32-ba4a-bad9c1896626 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:06.965802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4005e8f-1cbb-4f32-ba4a-bad9c1896626 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:06.966249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4005e8f-1cbb-4f32-ba4a-bad9c1896626 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:06.967844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4005e8f-1cbb-4f32-ba4a-bad9c1896626 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:06.968423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4005e8f-1cbb-4f32-ba4a-bad9c1896626 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:06.968864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4005e8f-1cbb-4f32-ba4a-bad9c1896626 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:06.973767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:07.126649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c4005e8f-1cbb-4f32-ba4a-bad9c1896626 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:07.135121 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c4005e8f-1cbb-4f32-ba4a-bad9c1896626 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1396 microversion: 2.1 time: 0.181200 Aug 18 12:13:07.136003 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3396/6050] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:06 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1396 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:07.976313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d5560d7a-7122-4c9b-945a-43bb0415e61e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:07.977037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d5560d7a-7122-4c9b-945a-43bb0415e61e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:07.984502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5560d7a-7122-4c9b-945a-43bb0415e61e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:07.985002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5560d7a-7122-4c9b-945a-43bb0415e61e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:07.985448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5560d7a-7122-4c9b-945a-43bb0415e61e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:07.986178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5560d7a-7122-4c9b-945a-43bb0415e61e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:07.986682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5560d7a-7122-4c9b-945a-43bb0415e61e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:07.987121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5560d7a-7122-4c9b-945a-43bb0415e61e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:08.150714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d5560d7a-7122-4c9b-945a-43bb0415e61e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:08.161320 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d5560d7a-7122-4c9b-945a-43bb0415e61e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1315 microversion: 2.1 time: 0.189049 Aug 18 12:13:08.162081 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3397/6051] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:07 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:08.172457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-046643ec-2945-46b0-ad64-aa926e571369 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:08.173676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-046643ec-2945-46b0-ad64-aa926e571369 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:08.186907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-046643ec-2945-46b0-ad64-aa926e571369 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:08.187830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-046643ec-2945-46b0-ad64-aa926e571369 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:08.188635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-046643ec-2945-46b0-ad64-aa926e571369 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:08.189452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-046643ec-2945-46b0-ad64-aa926e571369 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:08.189971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-046643ec-2945-46b0-ad64-aa926e571369 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:08.190502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-046643ec-2945-46b0-ad64-aa926e571369 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:08.522191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-046643ec-2945-46b0-ad64-aa926e571369 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:08.531936 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-046643ec-2945-46b0-ad64-aa926e571369 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1396 microversion: 2.1 time: 0.368331 Aug 18 12:13:08.532801 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3398/6052] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:08 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1396 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:09.109709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9060aeda-f6bf-4bd3-b21d-3b027f233dd7 req-f5a438d3-e548-4a69-9951-d898791e4da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a205884-fa6d-4ed4-a0e2-2aea9052bc2f", "name": "network-vif-deleted", "tag": "aedc2dee-52c4-48a8-b025-52ff6f0ac8b6"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:09.126284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9060aeda-f6bf-4bd3-b21d-3b027f233dd7 req-f5a438d3-e548-4a69-9951-d898791e4da8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:09.127445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9060aeda-f6bf-4bd3-b21d-3b027f233dd7 req-f5a438d3-e548-4a69-9951-d898791e4da8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:09.128529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9060aeda-f6bf-4bd3-b21d-3b027f233dd7 req-f5a438d3-e548-4a69-9951-d898791e4da8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:09.164871 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9060aeda-f6bf-4bd3-b21d-3b027f233dd7 req-f5a438d3-e548-4a69-9951-d898791e4da8 service nova] Creating event network-vif-deleted:aedc2dee-52c4-48a8-b025-52ff6f0ac8b6 for instance 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f on n-h2-853611-3 Aug 18 12:13:09.172169 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9060aeda-f6bf-4bd3-b21d-3b027f233dd7 req-f5a438d3-e548-4a69-9951-d898791e4da8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067305 Aug 18 12:13:09.172836 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3399/6053] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:13:09.202395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2c23ed3b-4b5d-44ba-af42-ffe17cd94790 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:09.203560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2c23ed3b-4b5d-44ba-af42-ffe17cd94790 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:09.225117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c23ed3b-4b5d-44ba-af42-ffe17cd94790 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:09.225631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c23ed3b-4b5d-44ba-af42-ffe17cd94790 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:09.226247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c23ed3b-4b5d-44ba-af42-ffe17cd94790 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:09.227420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c23ed3b-4b5d-44ba-af42-ffe17cd94790 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:09.227896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c23ed3b-4b5d-44ba-af42-ffe17cd94790 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:09.228344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c23ed3b-4b5d-44ba-af42-ffe17cd94790 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:09.517308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2c23ed3b-4b5d-44ba-af42-ffe17cd94790 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:09.534390 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2c23ed3b-4b5d-44ba-af42-ffe17cd94790 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1315 microversion: 2.1 time: 0.339941 Aug 18 12:13:09.535770 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3400/6054] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:09 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:09.561357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7c9c28cd-e347-46c9-94c3-c1ef82f3a1e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:09.562264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7c9c28cd-e347-46c9-94c3-c1ef82f3a1e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:09.566001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:09.570846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c9c28cd-e347-46c9-94c3-c1ef82f3a1e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:09.571359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c9c28cd-e347-46c9-94c3-c1ef82f3a1e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:09.571811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c9c28cd-e347-46c9-94c3-c1ef82f3a1e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:09.572557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c9c28cd-e347-46c9-94c3-c1ef82f3a1e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:09.573038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c9c28cd-e347-46c9-94c3-c1ef82f3a1e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:09.573477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c9c28cd-e347-46c9-94c3-c1ef82f3a1e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:09.652276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c9c28cd-e347-46c9-94c3-c1ef82f3a1e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:09.662730 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7c9c28cd-e347-46c9-94c3-c1ef82f3a1e4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1187 microversion: 2.1 time: 0.106364 Aug 18 12:13:09.663530 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3401/6055] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:09 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1187 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:10.566550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-69e1e2d0-2407-49c2-8ef6-bc88b525493b tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:10.567438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-69e1e2d0-2407-49c2-8ef6-bc88b525493b tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:10.575494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69e1e2d0-2407-49c2-8ef6-bc88b525493b tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:10.575995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69e1e2d0-2407-49c2-8ef6-bc88b525493b tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:10.576435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69e1e2d0-2407-49c2-8ef6-bc88b525493b tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:10.577161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69e1e2d0-2407-49c2-8ef6-bc88b525493b tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:10.577617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69e1e2d0-2407-49c2-8ef6-bc88b525493b tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:10.578051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69e1e2d0-2407-49c2-8ef6-bc88b525493b tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:10.772472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-69e1e2d0-2407-49c2-8ef6-bc88b525493b tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:10.789445 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-69e1e2d0-2407-49c2-8ef6-bc88b525493b tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1315 microversion: 2.1 time: 0.226740 Aug 18 12:13:10.790926 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3402/6056] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:10 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:10.800139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76882968-cb74-49d1-829d-8aa2859220e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:10.802257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-76882968-cb74-49d1-829d-8aa2859220e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:10.815252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76882968-cb74-49d1-829d-8aa2859220e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:10.816303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76882968-cb74-49d1-829d-8aa2859220e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:10.817935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76882968-cb74-49d1-829d-8aa2859220e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:10.819540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76882968-cb74-49d1-829d-8aa2859220e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:10.820424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76882968-cb74-49d1-829d-8aa2859220e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:10.821637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76882968-cb74-49d1-829d-8aa2859220e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:10.926700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-76882968-cb74-49d1-829d-8aa2859220e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:10.942577 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76882968-cb74-49d1-829d-8aa2859220e1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1187 microversion: 2.1 time: 0.149787 Aug 18 12:13:10.950486 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3403/6057] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:10 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1187 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:11.050893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a7feaf70-508b-4534-8ad6-adca19f9635a req-c230ef68-8a81-44bf-ae35-9fda56aef7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dffcb6-aa8e-4801-879c-44668bb30180", "name": "network-vif-plugged", "status": "completed", "tag": "a134e16d-9b2c-4ca8-a768-32ccece885e8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:11.073439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a7feaf70-508b-4534-8ad6-adca19f9635a req-c230ef68-8a81-44bf-ae35-9fda56aef7d8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:11.074274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a7feaf70-508b-4534-8ad6-adca19f9635a req-c230ef68-8a81-44bf-ae35-9fda56aef7d8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:11.075224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a7feaf70-508b-4534-8ad6-adca19f9635a req-c230ef68-8a81-44bf-ae35-9fda56aef7d8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:11.099741 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a7feaf70-508b-4534-8ad6-adca19f9635a req-c230ef68-8a81-44bf-ae35-9fda56aef7d8 service nova] Creating event network-vif-plugged:a134e16d-9b2c-4ca8-a768-32ccece885e8 for instance 96dffcb6-aa8e-4801-879c-44668bb30180 on n-h1-853611-3 Aug 18 12:13:11.110514 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a7feaf70-508b-4534-8ad6-adca19f9635a req-c230ef68-8a81-44bf-ae35-9fda56aef7d8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071440 Aug 18 12:13:11.111967 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3404/6058] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:11.819120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:11.824711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-db475950-2550-4094-a829-4805dc434ed6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:11.825747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-db475950-2550-4094-a829-4805dc434ed6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:11.835297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db475950-2550-4094-a829-4805dc434ed6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:11.836149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db475950-2550-4094-a829-4805dc434ed6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:11.836938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db475950-2550-4094-a829-4805dc434ed6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:11.837935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db475950-2550-4094-a829-4805dc434ed6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:11.838879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db475950-2550-4094-a829-4805dc434ed6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:11.840313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db475950-2550-4094-a829-4805dc434ed6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:11.984130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:12.022356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-db475950-2550-4094-a829-4805dc434ed6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:12.036771 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-db475950-2550-4094-a829-4805dc434ed6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1315 microversion: 2.1 time: 0.219193 Aug 18 12:13:12.037775 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3405/6059] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:11 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:12.062474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a5b021e4-2d17-4928-9bd4-9c0a4d14db36 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:12.063340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a5b021e4-2d17-4928-9bd4-9c0a4d14db36 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:12.071095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5b021e4-2d17-4928-9bd4-9c0a4d14db36 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:12.071769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5b021e4-2d17-4928-9bd4-9c0a4d14db36 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:12.072337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5b021e4-2d17-4928-9bd4-9c0a4d14db36 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:12.073259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5b021e4-2d17-4928-9bd4-9c0a4d14db36 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:12.073842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5b021e4-2d17-4928-9bd4-9c0a4d14db36 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:12.075362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5b021e4-2d17-4928-9bd4-9c0a4d14db36 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:12.183740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a5b021e4-2d17-4928-9bd4-9c0a4d14db36 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:12.198509 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a5b021e4-2d17-4928-9bd4-9c0a4d14db36 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1187 microversion: 2.1 time: 0.142298 Aug 18 12:13:12.200137 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3406/6060] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:12 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1187 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:12.779442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-82deed67-bfc8-41ed-9c3c-088832eac27e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:12.782142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-82deed67-bfc8-41ed-9c3c-088832eac27e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:12.789922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82deed67-bfc8-41ed-9c3c-088832eac27e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:12.790656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82deed67-bfc8-41ed-9c3c-088832eac27e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:12.791350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82deed67-bfc8-41ed-9c3c-088832eac27e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:12.792243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82deed67-bfc8-41ed-9c3c-088832eac27e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:12.793397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82deed67-bfc8-41ed-9c3c-088832eac27e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:12.794565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82deed67-bfc8-41ed-9c3c-088832eac27e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:12.860192 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-82deed67-bfc8-41ed-9c3c-088832eac27e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211/action" status: 200 len: 24567 microversion: 2.1 time: 0.086239 Aug 18 12:13:12.861283 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3407/6061] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:13:12 2022] POST /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211/action => generated 24567 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:13:13.074782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-38841167-2f85-42bd-90c4-23716df69da7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:13.076375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-38841167-2f85-42bd-90c4-23716df69da7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:13.091348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38841167-2f85-42bd-90c4-23716df69da7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:13.092244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38841167-2f85-42bd-90c4-23716df69da7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:13.093043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38841167-2f85-42bd-90c4-23716df69da7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:13.094364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38841167-2f85-42bd-90c4-23716df69da7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:13.095283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38841167-2f85-42bd-90c4-23716df69da7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:13.096117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38841167-2f85-42bd-90c4-23716df69da7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:13.326134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-38841167-2f85-42bd-90c4-23716df69da7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:13.338218 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-38841167-2f85-42bd-90c4-23716df69da7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1501 microversion: 2.1 time: 0.271652 Aug 18 12:13:13.339100 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3408/6062] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:13 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1501 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:13.346021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-71d9db95-04e4-423e-b4a8-feb9646bb8c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:13.347102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-71d9db95-04e4-423e-b4a8-feb9646bb8c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:13.356010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71d9db95-04e4-423e-b4a8-feb9646bb8c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:13.356683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71d9db95-04e4-423e-b4a8-feb9646bb8c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:13.357365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71d9db95-04e4-423e-b4a8-feb9646bb8c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:13.358264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71d9db95-04e4-423e-b4a8-feb9646bb8c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:13.358916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71d9db95-04e4-423e-b4a8-feb9646bb8c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:13.359545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71d9db95-04e4-423e-b4a8-feb9646bb8c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:13.450325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-71d9db95-04e4-423e-b4a8-feb9646bb8c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:13.459832 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-71d9db95-04e4-423e-b4a8-feb9646bb8c8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1187 microversion: 2.1 time: 0.118695 Aug 18 12:13:13.460591 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3409/6063] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:13 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1187 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:13.473615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-262ff288-4628-4c52-8213-86c935985fe9 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:13.474772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-262ff288-4628-4c52-8213-86c935985fe9 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:13.484092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-262ff288-4628-4c52-8213-86c935985fe9 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:13.484887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-262ff288-4628-4c52-8213-86c935985fe9 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:13.485470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-262ff288-4628-4c52-8213-86c935985fe9 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:13.486472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-262ff288-4628-4c52-8213-86c935985fe9 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:13.487139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-262ff288-4628-4c52-8213-86c935985fe9 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:13.487709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-262ff288-4628-4c52-8213-86c935985fe9 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:13.717142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-262ff288-4628-4c52-8213-86c935985fe9 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:13.727048 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-262ff288-4628-4c52-8213-86c935985fe9 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1501 microversion: 2.1 time: 0.264718 Aug 18 12:13:13.727759 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3410/6064] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:13 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1501 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:13.750107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d11c7e1e-123d-462e-99ac-9c637f946b22 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:13.750694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d11c7e1e-123d-462e-99ac-9c637f946b22 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:13.757678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11c7e1e-123d-462e-99ac-9c637f946b22 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:13.758189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11c7e1e-123d-462e-99ac-9c637f946b22 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:13.758925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11c7e1e-123d-462e-99ac-9c637f946b22 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:13.759674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11c7e1e-123d-462e-99ac-9c637f946b22 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:13.760189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11c7e1e-123d-462e-99ac-9c637f946b22 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:13.760632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d11c7e1e-123d-462e-99ac-9c637f946b22 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:13.789656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-d11c7e1e-123d-462e-99ac-9c637f946b22 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lazy-loading 'flavor' on Instance uuid 96dffcb6-aa8e-4801-879c-44668bb30180 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:13:13.876198 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d11c7e1e-123d-462e-99ac-9c637f946b22 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "POST /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180/action" status: 202 len: 0 microversion: 2.1 time: 0.130713 Aug 18 12:13:13.877335 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3411/6065] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:13:13 2022] POST /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:13:13.886642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b2a05e6-4a32-4056-9900-6b08bed9440c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:13.887408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2b2a05e6-4a32-4056-9900-6b08bed9440c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:13.896660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b2a05e6-4a32-4056-9900-6b08bed9440c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:13.897521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b2a05e6-4a32-4056-9900-6b08bed9440c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:13.899062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b2a05e6-4a32-4056-9900-6b08bed9440c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:13.900379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b2a05e6-4a32-4056-9900-6b08bed9440c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:13.900937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b2a05e6-4a32-4056-9900-6b08bed9440c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:13.901753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b2a05e6-4a32-4056-9900-6b08bed9440c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:14.073693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2b2a05e6-4a32-4056-9900-6b08bed9440c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:14.084693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:14.090823 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2b2a05e6-4a32-4056-9900-6b08bed9440c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1509 microversion: 2.1 time: 0.208963 Aug 18 12:13:14.091913 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3412/6066] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:13 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:14.486859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-17f7096b-f65d-46e1-9bef-c63e351cd7b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:14.487374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-17f7096b-f65d-46e1-9bef-c63e351cd7b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:14.496384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17f7096b-f65d-46e1-9bef-c63e351cd7b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:14.497582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17f7096b-f65d-46e1-9bef-c63e351cd7b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:14.498053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17f7096b-f65d-46e1-9bef-c63e351cd7b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:14.498842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17f7096b-f65d-46e1-9bef-c63e351cd7b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:14.499320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17f7096b-f65d-46e1-9bef-c63e351cd7b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:14.499766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17f7096b-f65d-46e1-9bef-c63e351cd7b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:14.536790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17f7096b-f65d-46e1-9bef-c63e351cd7b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:14.537296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17f7096b-f65d-46e1-9bef-c63e351cd7b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:14.537744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17f7096b-f65d-46e1-9bef-c63e351cd7b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:14.538224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-17f7096b-f65d-46e1-9bef-c63e351cd7b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lazy-loading 'fault' on Instance uuid 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:13:14.585042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-17f7096b-f65d-46e1-9bef-c63e351cd7b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:14.594089 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-17f7096b-f65d-46e1-9bef-c63e351cd7b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 200 len: 1192 microversion: 2.1 time: 0.111465 Aug 18 12:13:14.594747 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3413/6067] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:14 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:15.113471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b8e8587c-6388-46cb-9175-6b92bb888c3c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:15.114287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b8e8587c-6388-46cb-9175-6b92bb888c3c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:15.121241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8e8587c-6388-46cb-9175-6b92bb888c3c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:15.121739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8e8587c-6388-46cb-9175-6b92bb888c3c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:15.122185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8e8587c-6388-46cb-9175-6b92bb888c3c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:15.122947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8e8587c-6388-46cb-9175-6b92bb888c3c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:15.123412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8e8587c-6388-46cb-9175-6b92bb888c3c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:15.123842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8e8587c-6388-46cb-9175-6b92bb888c3c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:15.283158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8e8587c-6388-46cb-9175-6b92bb888c3c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:15.291557 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b8e8587c-6388-46cb-9175-6b92bb888c3c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1492 microversion: 2.1 time: 0.182126 Aug 18 12:13:15.292726 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3414/6068] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:15 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1492 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:15.314698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-28497d21-a083-4f23-83c9-4ef93e0db3bc tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:15.315250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-28497d21-a083-4f23-83c9-4ef93e0db3bc tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:15.321708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28497d21-a083-4f23-83c9-4ef93e0db3bc tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:15.322229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28497d21-a083-4f23-83c9-4ef93e0db3bc tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:15.322706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28497d21-a083-4f23-83c9-4ef93e0db3bc tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:15.323986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28497d21-a083-4f23-83c9-4ef93e0db3bc tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:15.324547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28497d21-a083-4f23-83c9-4ef93e0db3bc tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:15.325034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28497d21-a083-4f23-83c9-4ef93e0db3bc tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:15.418152 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-28497d21-a083-4f23-83c9-4ef93e0db3bc tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "POST /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180/action" status: 202 len: 0 microversion: 2.1 time: 0.106623 Aug 18 12:13:15.419186 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3415/6069] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:13:15 2022] POST /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:13:15.429861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99722c01-a62b-445b-bb95-02eb71fd58b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:15.430860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-99722c01-a62b-445b-bb95-02eb71fd58b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:15.440262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99722c01-a62b-445b-bb95-02eb71fd58b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:15.440980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99722c01-a62b-445b-bb95-02eb71fd58b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:15.441487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99722c01-a62b-445b-bb95-02eb71fd58b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:15.442352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99722c01-a62b-445b-bb95-02eb71fd58b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:15.442911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99722c01-a62b-445b-bb95-02eb71fd58b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:15.443475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99722c01-a62b-445b-bb95-02eb71fd58b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:15.623348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-99722c01-a62b-445b-bb95-02eb71fd58b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:15.633615 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-99722c01-a62b-445b-bb95-02eb71fd58b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1498 microversion: 2.1 time: 0.208464 Aug 18 12:13:15.650495 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3416/6070] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:15 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1498 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:15.650495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5c8f0c5b-b157-43e7-a920-e8e682edc9dd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:15.650495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5c8f0c5b-b157-43e7-a920-e8e682edc9dd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:15.650495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c8f0c5b-b157-43e7-a920-e8e682edc9dd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:15.650495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c8f0c5b-b157-43e7-a920-e8e682edc9dd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:15.650495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c8f0c5b-b157-43e7-a920-e8e682edc9dd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:15.650495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c8f0c5b-b157-43e7-a920-e8e682edc9dd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:15.650495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c8f0c5b-b157-43e7-a920-e8e682edc9dd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:15.652623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c8f0c5b-b157-43e7-a920-e8e682edc9dd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:15.668522 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-5c8f0c5b-b157-43e7-a920-e8e682edc9dd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f could not be found. Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5c8f0c5b-b157-43e7-a920-e8e682edc9dd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f HTTP/1.1 Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f could not be found. Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '2a205884-fa6d-4ed4-a0e2-2aea9052bc2f'} Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f could not be found. Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f could not be found. Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:13:15.670278 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:15.681792 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:13:15.681792 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:13:15.681792 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:13:15.681792 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:13:15.681792 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:13:15.681792 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f could not be found. Aug 18 12:13:15.681792 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:15.681792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5c8f0c5b-b157-43e7-a920-e8e682edc9dd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance 2a205884-fa6d-4ed4-a0e2-2aea9052bc2f could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:13:15.681792 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5c8f0c5b-b157-43e7-a920-e8e682edc9dd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f" status: 404 len: 111 microversion: 2.1 time: 0.036625 Aug 18 12:13:15.681792 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3417/6071] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:15 2022] GET /compute/v2.1/servers/2a205884-fa6d-4ed4-a0e2-2aea9052bc2f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:13:16.545395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-77be6e3a-6704-43a6-98b5-9295c30e5d02 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:16.549439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-77be6e3a-6704-43a6-98b5-9295c30e5d02 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:16.563727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77be6e3a-6704-43a6-98b5-9295c30e5d02 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:16.565063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77be6e3a-6704-43a6-98b5-9295c30e5d02 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:16.565877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77be6e3a-6704-43a6-98b5-9295c30e5d02 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:16.567239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77be6e3a-6704-43a6-98b5-9295c30e5d02 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:16.568091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77be6e3a-6704-43a6-98b5-9295c30e5d02 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:16.568872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77be6e3a-6704-43a6-98b5-9295c30e5d02 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:16.664077 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-77be6e3a-6704-43a6-98b5-9295c30e5d02 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "POST /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1/action" status: 200 len: 32641 microversion: 2.1 time: 0.125968 Aug 18 12:13:16.674511 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3418/6072] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:13:16 2022] POST /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1/action => generated 32641 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:13:16.676872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-45094fbe-fd9b-4a36-a830-00fbd05e5a44 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:16.677711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-45094fbe-fd9b-4a36-a830-00fbd05e5a44 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:16.688260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45094fbe-fd9b-4a36-a830-00fbd05e5a44 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:16.688761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45094fbe-fd9b-4a36-a830-00fbd05e5a44 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:16.690007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45094fbe-fd9b-4a36-a830-00fbd05e5a44 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:16.690191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45094fbe-fd9b-4a36-a830-00fbd05e5a44 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:16.691858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45094fbe-fd9b-4a36-a830-00fbd05e5a44 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:16.691858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45094fbe-fd9b-4a36-a830-00fbd05e5a44 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:16.872153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-45094fbe-fd9b-4a36-a830-00fbd05e5a44 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:16.881797 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-45094fbe-fd9b-4a36-a830-00fbd05e5a44 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1498 microversion: 2.1 time: 0.215154 Aug 18 12:13:16.882615 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3419/6073] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:16 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1498 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:17.920347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-37072d38-1691-4df9-9f8a-69accc397988 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:17.921400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-37072d38-1691-4df9-9f8a-69accc397988 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:17.936271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37072d38-1691-4df9-9f8a-69accc397988 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:17.937142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37072d38-1691-4df9-9f8a-69accc397988 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:17.937924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37072d38-1691-4df9-9f8a-69accc397988 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:17.939590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37072d38-1691-4df9-9f8a-69accc397988 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:17.940428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37072d38-1691-4df9-9f8a-69accc397988 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:17.941157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37072d38-1691-4df9-9f8a-69accc397988 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:18.288904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-37072d38-1691-4df9-9f8a-69accc397988 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:18.305775 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-37072d38-1691-4df9-9f8a-69accc397988 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1501 microversion: 2.1 time: 0.393492 Aug 18 12:13:18.317707 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3420/6074] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:17 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1501 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:18.334684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c786b0f5-0275-4ca7-baed-99ae272fc5a8 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:18.336208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c786b0f5-0275-4ca7-baed-99ae272fc5a8 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:18.351411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c786b0f5-0275-4ca7-baed-99ae272fc5a8 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:18.353323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c786b0f5-0275-4ca7-baed-99ae272fc5a8 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:18.356358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c786b0f5-0275-4ca7-baed-99ae272fc5a8 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:18.357341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c786b0f5-0275-4ca7-baed-99ae272fc5a8 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:18.358257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c786b0f5-0275-4ca7-baed-99ae272fc5a8 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:18.358597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c786b0f5-0275-4ca7-baed-99ae272fc5a8 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:18.387014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-c786b0f5-0275-4ca7-baed-99ae272fc5a8 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lazy-loading 'flavor' on Instance uuid 96dffcb6-aa8e-4801-879c-44668bb30180 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:13:18.509423 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c786b0f5-0275-4ca7-baed-99ae272fc5a8 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "POST /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180/action" status: 202 len: 0 microversion: 2.1 time: 0.182673 Aug 18 12:13:18.511910 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3421/6075] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:13:18 2022] POST /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:13:18.531512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb54436e-2357-4fc2-b440-d6c2ef450e75 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:18.533784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bb54436e-2357-4fc2-b440-d6c2ef450e75 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:18.544948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb54436e-2357-4fc2-b440-d6c2ef450e75 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:18.545992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb54436e-2357-4fc2-b440-d6c2ef450e75 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:18.546674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb54436e-2357-4fc2-b440-d6c2ef450e75 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:18.547524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb54436e-2357-4fc2-b440-d6c2ef450e75 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:18.548148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb54436e-2357-4fc2-b440-d6c2ef450e75 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:18.548765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb54436e-2357-4fc2-b440-d6c2ef450e75 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:18.738791 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:13:18.739404 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:13:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:13:18.879088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bb54436e-2357-4fc2-b440-d6c2ef450e75 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:18.891921 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bb54436e-2357-4fc2-b440-d6c2ef450e75 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1509 microversion: 2.1 time: 0.374653 Aug 18 12:13:18.893025 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3422/6076] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:18 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1509 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:19.002662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0fbfbda-4723-46ee-bcd2-3cb4c5c09d94 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:19.003736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a0fbfbda-4723-46ee-bcd2-3cb4c5c09d94 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:19.019484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0fbfbda-4723-46ee-bcd2-3cb4c5c09d94 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:19.020847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0fbfbda-4723-46ee-bcd2-3cb4c5c09d94 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:19.021879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0fbfbda-4723-46ee-bcd2-3cb4c5c09d94 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:19.023894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0fbfbda-4723-46ee-bcd2-3cb4c5c09d94 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:19.025078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0fbfbda-4723-46ee-bcd2-3cb4c5c09d94 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:19.027084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0fbfbda-4723-46ee-bcd2-3cb4c5c09d94 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:19.093973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a0fbfbda-4723-46ee-bcd2-3cb4c5c09d94 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:13:19.276047 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a0fbfbda-4723-46ee-bcd2-3cb4c5c09d94 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 204 len: 0 microversion: 2.1 time: 0.283621 Aug 18 12:13:19.280382 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3423/6077] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:13:18 2022] DELETE /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:13:19.286778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c501b737-b4f5-4d50-8b7f-7c801641ce72 req-960e91a2-e5df-431d-8949-3aaa9a3ee915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1", "tag": "1f1c5a91-7258-47aa-b7f6-e92b602ddd00"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:19.298771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c501b737-b4f5-4d50-8b7f-7c801641ce72 req-960e91a2-e5df-431d-8949-3aaa9a3ee915 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:19.299866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c501b737-b4f5-4d50-8b7f-7c801641ce72 req-960e91a2-e5df-431d-8949-3aaa9a3ee915 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:19.299866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c501b737-b4f5-4d50-8b7f-7c801641ce72 req-960e91a2-e5df-431d-8949-3aaa9a3ee915 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:19.317770 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c501b737-b4f5-4d50-8b7f-7c801641ce72 req-960e91a2-e5df-431d-8949-3aaa9a3ee915 service nova] Creating event network-changed:1f1c5a91-7258-47aa-b7f6-e92b602ddd00 for instance 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 on n-h1-853611-3 Aug 18 12:13:19.328113 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c501b737-b4f5-4d50-8b7f-7c801641ce72 req-960e91a2-e5df-431d-8949-3aaa9a3ee915 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045442 Aug 18 12:13:19.329588 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3424/6078] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:19.343813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-68b47cda-90e0-4c40-a2a0-5bc8bab9c8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:19.345107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-68b47cda-90e0-4c40-a2a0-5bc8bab9c8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:19.357991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68b47cda-90e0-4c40-a2a0-5bc8bab9c8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:19.359116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68b47cda-90e0-4c40-a2a0-5bc8bab9c8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:19.359731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68b47cda-90e0-4c40-a2a0-5bc8bab9c8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:19.361037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68b47cda-90e0-4c40-a2a0-5bc8bab9c8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:19.361946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68b47cda-90e0-4c40-a2a0-5bc8bab9c8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:19.362930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68b47cda-90e0-4c40-a2a0-5bc8bab9c8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:19.562484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-68b47cda-90e0-4c40-a2a0-5bc8bab9c8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:19.572885 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-68b47cda-90e0-4c40-a2a0-5bc8bab9c8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1682 microversion: 2.1 time: 0.235608 Aug 18 12:13:19.589909 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3425/6079] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:19 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:19.589909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-29a2f2a3-32b0-4bf5-8e82-6344954a9b56 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:19.589909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-29a2f2a3-32b0-4bf5-8e82-6344954a9b56 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:19.591192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29a2f2a3-32b0-4bf5-8e82-6344954a9b56 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:19.591465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29a2f2a3-32b0-4bf5-8e82-6344954a9b56 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:19.591975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29a2f2a3-32b0-4bf5-8e82-6344954a9b56 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:19.592903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29a2f2a3-32b0-4bf5-8e82-6344954a9b56 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:19.593369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29a2f2a3-32b0-4bf5-8e82-6344954a9b56 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:19.593803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29a2f2a3-32b0-4bf5-8e82-6344954a9b56 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:19.617384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:19.816936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-29a2f2a3-32b0-4bf5-8e82-6344954a9b56 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84208046cadf456eb814d737b0bd516b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e6a4cb7234446dae9a06b0a91810ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:19.832237 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-29a2f2a3-32b0-4bf5-8e82-6344954a9b56 tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 200 len: 1670 microversion: 2.1 time: 0.257023 Aug 18 12:13:19.846639 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3426/6080] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:19 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 1670 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:19.863427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7b6524b8-e240-4b60-8fe6-992414768e0e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:19.868248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7b6524b8-e240-4b60-8fe6-992414768e0e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:19.880503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b6524b8-e240-4b60-8fe6-992414768e0e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:19.881416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b6524b8-e240-4b60-8fe6-992414768e0e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:19.882520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b6524b8-e240-4b60-8fe6-992414768e0e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:19.883841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b6524b8-e240-4b60-8fe6-992414768e0e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:19.884743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b6524b8-e240-4b60-8fe6-992414768e0e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:19.885609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b6524b8-e240-4b60-8fe6-992414768e0e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:19.981889 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7b6524b8-e240-4b60-8fe6-992414768e0e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211/action" status: 200 len: 32642 microversion: 2.1 time: 0.130963 Aug 18 12:13:19.983787 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3427/6081] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:13:19 2022] POST /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211/action => generated 32642 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:13:19.993476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-95c9b448-c8d4-4cf0-8b94-f88a67e1356c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:19.996288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-95c9b448-c8d4-4cf0-8b94-f88a67e1356c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:20.012819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95c9b448-c8d4-4cf0-8b94-f88a67e1356c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:20.013874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95c9b448-c8d4-4cf0-8b94-f88a67e1356c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:20.014896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95c9b448-c8d4-4cf0-8b94-f88a67e1356c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:20.016397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95c9b448-c8d4-4cf0-8b94-f88a67e1356c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:20.017528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95c9b448-c8d4-4cf0-8b94-f88a67e1356c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:20.018894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95c9b448-c8d4-4cf0-8b94-f88a67e1356c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:20.266059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-95c9b448-c8d4-4cf0-8b94-f88a67e1356c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:20.277135 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-95c9b448-c8d4-4cf0-8b94-f88a67e1356c tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1492 microversion: 2.1 time: 0.290968 Aug 18 12:13:20.288500 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3428/6082] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:19 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1492 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:20.300888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9398492b-224d-4670-b475-f0b662fd324d tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:20.301542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9398492b-224d-4670-b475-f0b662fd324d tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:20.311500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9398492b-224d-4670-b475-f0b662fd324d tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:20.312021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9398492b-224d-4670-b475-f0b662fd324d tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:20.313031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9398492b-224d-4670-b475-f0b662fd324d tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:20.314022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9398492b-224d-4670-b475-f0b662fd324d tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:20.314535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9398492b-224d-4670-b475-f0b662fd324d tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:20.316118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9398492b-224d-4670-b475-f0b662fd324d tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:20.647349 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9398492b-224d-4670-b475-f0b662fd324d tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1833 microversion: 2.1 time: 0.357065 Aug 18 12:13:20.652301 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3429/6083] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:20 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1833 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:20.668327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-290069a0-66e5-44fa-bb4c-4bdf80dfb4b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:20.669114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-290069a0-66e5-44fa-bb4c-4bdf80dfb4b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:20.693399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-290069a0-66e5-44fa-bb4c-4bdf80dfb4b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:20.700341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-290069a0-66e5-44fa-bb4c-4bdf80dfb4b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:20.701027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-290069a0-66e5-44fa-bb4c-4bdf80dfb4b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:20.703535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-290069a0-66e5-44fa-bb4c-4bdf80dfb4b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:20.703535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-290069a0-66e5-44fa-bb4c-4bdf80dfb4b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:20.706319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-290069a0-66e5-44fa-bb4c-4bdf80dfb4b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:20.894154 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-290069a0-66e5-44fa-bb4c-4bdf80dfb4b6 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "POST /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180/action" status: 202 len: 0 microversion: 2.1 time: 0.239470 Aug 18 12:13:20.895136 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3430/6084] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:13:20 2022] POST /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:13:20.908384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a24a003c-61c5-4771-a50a-8451a79efa3c tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:20.913158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a24a003c-61c5-4771-a50a-8451a79efa3c tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:20.933253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a24a003c-61c5-4771-a50a-8451a79efa3c tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:20.934243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a24a003c-61c5-4771-a50a-8451a79efa3c tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:20.935217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a24a003c-61c5-4771-a50a-8451a79efa3c tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:20.938665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a24a003c-61c5-4771-a50a-8451a79efa3c tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:20.939197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a24a003c-61c5-4771-a50a-8451a79efa3c tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:20.939995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a24a003c-61c5-4771-a50a-8451a79efa3c tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:21.021990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-a24a003c-61c5-4771-a50a-8451a79efa3c tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lazy-loading 'flavor' on Instance uuid 2c1ead01-3a78-454b-a119-6198f0e46211 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:13:21.055296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a24a003c-61c5-4771-a50a-8451a79efa3c tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Going to try to live migrate instance to another host {{(pid=122210) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 18 12:13:24.116758 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a24a003c-61c5-4771-a50a-8451a79efa3c tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211/action" status: 202 len: 0 microversion: 2.1 time: 3.214447 Aug 18 12:13:24.123830 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3431/6085] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:13:20 2022] POST /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211/action => generated 0 bytes in 3222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:13:24.130578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1107c8b-bdd8-4a82-bbc1-b2968976715c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:24.135019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1107c8b-bdd8-4a82-bbc1-b2968976715c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] [instance: 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:24.143262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1107c8b-bdd8-4a82-bbc1-b2968976715c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:24.143828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1107c8b-bdd8-4a82-bbc1-b2968976715c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:24.144276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1107c8b-bdd8-4a82-bbc1-b2968976715c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:24.144985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1107c8b-bdd8-4a82-bbc1-b2968976715c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:24.145464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1107c8b-bdd8-4a82-bbc1-b2968976715c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:24.145900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1107c8b-bdd8-4a82-bbc1-b2968976715c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:24.165399 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-a1107c8b-bdd8-4a82-bbc1-b2968976715c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] HTTP exception thrown: Instance 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 could not be found. Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1107c8b-bdd8-4a82-bbc1-b2968976715c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Request method failure captured: Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 HTTP/1.1 Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iv2QziQoFmx-TWFaI518OSSPu9szUzMHWzQTHlmtEk_beZSvif_V3FqmJCvcGBx3a2WYJwZLY8JMLSi-wf3Iuf58LzRVE45b40_vxALx5W2NRcpCy5e8-AgwbJ14Eh6FbBowAbBL_a5hBwoCuK1E45bJL-2oa25Yxdkpm2PlKdgWU0 Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 33e6a4cb7234446dae9a06b0a91810ad Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestNetworkBasicOps-1304403141 Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/33e6a4cb7234446dae9a06b0a91810ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/33e6a4cb7234446dae9a06b0a91810ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_33e6a4cb7234446dae9a06b0a91810ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/33e6a4cb7234446dae9a06b0a91810ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestNetworkBasicOps-1304403141 Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 33e6a4cb7234446dae9a06b0a91810ad Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestNetworkBasicOps-1304403141 Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestNetworkBasicOps-1304403141-project Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 84208046cadf456eb814d737b0bd516b Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestNetworkBasicOps-1304403141-project Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 could not be found. Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1'} Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 could not be found. Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 could not be found. Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:13:24.171986 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:24.177935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:13:24.177935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:13:24.177935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:13:24.177935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:13:24.177935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:13:24.177935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 could not be found. Aug 18 12:13:24.177935 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:24.177935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1107c8b-bdd8-4a82-bbc1-b2968976715c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Returning 404 to user: Instance 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:13:24.177935 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1107c8b-bdd8-4a82-bbc1-b2968976715c tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1" status: 404 len: 111 microversion: 2.1 time: 0.050175 Aug 18 12:13:24.177935 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3432/6086] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:24 2022] GET /compute/v2.1/servers/3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:13:24.182463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0bb55f07-ea20-43e0-b1ab-fc7a5622c186 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:24.183207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0bb55f07-ea20-43e0-b1ab-fc7a5622c186 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:24.204678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bb55f07-ea20-43e0-b1ab-fc7a5622c186 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:24.205068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bb55f07-ea20-43e0-b1ab-fc7a5622c186 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:24.208749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bb55f07-ea20-43e0-b1ab-fc7a5622c186 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:24.209879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bb55f07-ea20-43e0-b1ab-fc7a5622c186 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:24.210882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bb55f07-ea20-43e0-b1ab-fc7a5622c186 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:24.211401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bb55f07-ea20-43e0-b1ab-fc7a5622c186 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:24.494092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0bb55f07-ea20-43e0-b1ab-fc7a5622c186 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:24.506964 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0bb55f07-ea20-43e0-b1ab-fc7a5622c186 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1501 microversion: 2.1 time: 0.334026 Aug 18 12:13:24.507921 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3433/6087] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:24 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1501 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:24.514156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d3bc54a8-c41b-4067-b664-8d8c8c92f11a req-c45fc8ef-b0b0-4211-bb99-ff6fbbf1182b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1", "name": "network-vif-deleted", "tag": "1f1c5a91-7258-47aa-b7f6-e92b602ddd00"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:24.526355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d3bc54a8-c41b-4067-b664-8d8c8c92f11a req-c45fc8ef-b0b0-4211-bb99-ff6fbbf1182b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:24.526870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d3bc54a8-c41b-4067-b664-8d8c8c92f11a req-c45fc8ef-b0b0-4211-bb99-ff6fbbf1182b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:24.527541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d3bc54a8-c41b-4067-b664-8d8c8c92f11a req-c45fc8ef-b0b0-4211-bb99-ff6fbbf1182b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:24.541222 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d3bc54a8-c41b-4067-b664-8d8c8c92f11a req-c45fc8ef-b0b0-4211-bb99-ff6fbbf1182b service nova] Creating event network-vif-deleted:1f1c5a91-7258-47aa-b7f6-e92b602ddd00 for instance 3e00db3e-0b01-4ef6-a8dd-ccd4813e7ce1 on n-h1-853611-3 Aug 18 12:13:24.547830 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d3bc54a8-c41b-4067-b664-8d8c8c92f11a req-c45fc8ef-b0b0-4211-bb99-ff6fbbf1182b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037617 Aug 18 12:13:24.548989 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3434/6088] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:24.558856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-61dfcdf4-e4e5-438f-9178-1e52fb036e54 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:24.559642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-61dfcdf4-e4e5-438f-9178-1e52fb036e54 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:24.568010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61dfcdf4-e4e5-438f-9178-1e52fb036e54 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:24.568523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61dfcdf4-e4e5-438f-9178-1e52fb036e54 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:24.569031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61dfcdf4-e4e5-438f-9178-1e52fb036e54 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:24.569780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61dfcdf4-e4e5-438f-9178-1e52fb036e54 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:24.570294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61dfcdf4-e4e5-438f-9178-1e52fb036e54 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:24.573987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61dfcdf4-e4e5-438f-9178-1e52fb036e54 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:24.857911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-61dfcdf4-e4e5-438f-9178-1e52fb036e54 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:24.885096 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-61dfcdf4-e4e5-438f-9178-1e52fb036e54 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1692 microversion: 2.1 time: 0.331725 Aug 18 12:13:24.887675 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3435/6089] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:24 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1692 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:24.901462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-88cc0523-3530-42f8-af56-b457e7f57ffa tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:24.902910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88cc0523-3530-42f8-af56-b457e7f57ffa tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:24.916699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88cc0523-3530-42f8-af56-b457e7f57ffa tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:24.917628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88cc0523-3530-42f8-af56-b457e7f57ffa tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:24.918297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88cc0523-3530-42f8-af56-b457e7f57ffa tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:24.919274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88cc0523-3530-42f8-af56-b457e7f57ffa tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:24.920037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88cc0523-3530-42f8-af56-b457e7f57ffa tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:24.920771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88cc0523-3530-42f8-af56-b457e7f57ffa tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:24.952073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88cc0523-3530-42f8-af56-b457e7f57ffa tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:13:25.044417 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-88cc0523-3530-42f8-af56-b457e7f57ffa tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "DELETE /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 204 len: 0 microversion: 2.1 time: 0.154083 Aug 18 12:13:25.045362 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3436/6090] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:13:24 2022] DELETE /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:13:25.051254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-05d212eb-9f8d-4e33-8efa-1b49a6e4ec6a tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] Calling method '.version_select at 0x7f519f828160>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:25.078037 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-05d212eb-9f8d-4e33-8efa-1b49a6e4ec6a tempest-TestNetworkBasicOps-1304403141 tempest-TestNetworkBasicOps-1304403141-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2034608955" status: 202 len: 0 microversion: 2.1 time: 0.031118 Aug 18 12:13:25.080430 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3437/6091] 10.222.0.73 () {58 vars in 1257 bytes} [Thu Aug 18 12:13:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2034608955 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:13:25.085620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1f9bdb33-1663-40c0-90c2-48736028798e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:25.086734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1f9bdb33-1663-40c0-90c2-48736028798e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:25.095589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f9bdb33-1663-40c0-90c2-48736028798e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:25.096458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f9bdb33-1663-40c0-90c2-48736028798e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:25.097092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f9bdb33-1663-40c0-90c2-48736028798e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:25.098060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f9bdb33-1663-40c0-90c2-48736028798e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:25.098762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f9bdb33-1663-40c0-90c2-48736028798e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:25.099515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f9bdb33-1663-40c0-90c2-48736028798e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:25.399604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1f9bdb33-1663-40c0-90c2-48736028798e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:25.415699 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1f9bdb33-1663-40c0-90c2-48736028798e tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1507 microversion: 2.1 time: 0.332524 Aug 18 12:13:25.430816 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3438/6092] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:25 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:25.932097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1348a019-f98d-44d8-9f03-785791465d2d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:25.933610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1348a019-f98d-44d8-9f03-785791465d2d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:25.959493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1348a019-f98d-44d8-9f03-785791465d2d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:25.961361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1348a019-f98d-44d8-9f03-785791465d2d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:25.962178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1348a019-f98d-44d8-9f03-785791465d2d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:25.965232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1348a019-f98d-44d8-9f03-785791465d2d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:25.966189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1348a019-f98d-44d8-9f03-785791465d2d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:25.967461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1348a019-f98d-44d8-9f03-785791465d2d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:26.280432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1348a019-f98d-44d8-9f03-785791465d2d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:26.294738 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1348a019-f98d-44d8-9f03-785791465d2d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1692 microversion: 2.1 time: 0.373522 Aug 18 12:13:26.295252 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3439/6093] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:25 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1692 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:26.453921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ba7b3094-8f3a-4e99-81dd-dd97438f918a tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:26.455160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ba7b3094-8f3a-4e99-81dd-dd97438f918a tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:26.464673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba7b3094-8f3a-4e99-81dd-dd97438f918a tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:26.465445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba7b3094-8f3a-4e99-81dd-dd97438f918a tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:26.466077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba7b3094-8f3a-4e99-81dd-dd97438f918a tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:26.467814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba7b3094-8f3a-4e99-81dd-dd97438f918a tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:26.468640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba7b3094-8f3a-4e99-81dd-dd97438f918a tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:26.469413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba7b3094-8f3a-4e99-81dd-dd97438f918a tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:26.824868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ba7b3094-8f3a-4e99-81dd-dd97438f918a tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:26.864251 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ba7b3094-8f3a-4e99-81dd-dd97438f918a tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1507 microversion: 2.1 time: 0.415525 Aug 18 12:13:26.868952 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3440/6094] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:26 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:27.329994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-053ae6d3-6f04-4ab1-9cfb-0a968c3dcb71 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:27.331069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-053ae6d3-6f04-4ab1-9cfb-0a968c3dcb71 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:27.346317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-053ae6d3-6f04-4ab1-9cfb-0a968c3dcb71 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:27.347611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-053ae6d3-6f04-4ab1-9cfb-0a968c3dcb71 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:27.349391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-053ae6d3-6f04-4ab1-9cfb-0a968c3dcb71 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:27.351200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-053ae6d3-6f04-4ab1-9cfb-0a968c3dcb71 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:27.352773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-053ae6d3-6f04-4ab1-9cfb-0a968c3dcb71 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:27.353473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-053ae6d3-6f04-4ab1-9cfb-0a968c3dcb71 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:27.412615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:27.755363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-053ae6d3-6f04-4ab1-9cfb-0a968c3dcb71 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:27.791869 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-053ae6d3-6f04-4ab1-9cfb-0a968c3dcb71 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1692 microversion: 2.1 time: 0.467286 Aug 18 12:13:27.793927 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3441/6095] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:27 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1692 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:27.805751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-30a1e291-fd6b-48d0-b614-67997d972adb req-2184fded-29c8-4d3a-b9f7-3752b48cedfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1ead01-3a78-454b-a119-6198f0e46211", "name": "network-vif-unplugged", "status": "completed", "tag": "1dd7d952-6010-4a29-869b-f56b957404f0"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:27.826822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:27.831897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-30a1e291-fd6b-48d0-b614-67997d972adb req-2184fded-29c8-4d3a-b9f7-3752b48cedfa service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:27.833010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-30a1e291-fd6b-48d0-b614-67997d972adb req-2184fded-29c8-4d3a-b9f7-3752b48cedfa service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:27.833876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-30a1e291-fd6b-48d0-b614-67997d972adb req-2184fded-29c8-4d3a-b9f7-3752b48cedfa service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:27.863903 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-30a1e291-fd6b-48d0-b614-67997d972adb req-2184fded-29c8-4d3a-b9f7-3752b48cedfa service nova] Creating event network-vif-unplugged:1dd7d952-6010-4a29-869b-f56b957404f0 for instance 2c1ead01-3a78-454b-a119-6198f0e46211 on n-h2-853611-3 Aug 18 12:13:27.875349 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-30a1e291-fd6b-48d0-b614-67997d972adb req-2184fded-29c8-4d3a-b9f7-3752b48cedfa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079016 Aug 18 12:13:27.876623 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3442/6096] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:27.903698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eecc6188-0b46-406a-9bc5-1b5b29a2bcdb tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:27.905467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eecc6188-0b46-406a-9bc5-1b5b29a2bcdb tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:27.927398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eecc6188-0b46-406a-9bc5-1b5b29a2bcdb tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:27.928527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eecc6188-0b46-406a-9bc5-1b5b29a2bcdb tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:27.930271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eecc6188-0b46-406a-9bc5-1b5b29a2bcdb tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:27.932078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eecc6188-0b46-406a-9bc5-1b5b29a2bcdb tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:27.933971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eecc6188-0b46-406a-9bc5-1b5b29a2bcdb tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:27.934946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eecc6188-0b46-406a-9bc5-1b5b29a2bcdb tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:28.516577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-eecc6188-0b46-406a-9bc5-1b5b29a2bcdb tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:28.558063 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eecc6188-0b46-406a-9bc5-1b5b29a2bcdb tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1507 microversion: 2.1 time: 0.664796 Aug 18 12:13:28.564206 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3443/6097] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:27 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1507 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:28.576557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-bd743dd4-b470-4a68-a984-7ef2afc0daf8 req-310d8470-801e-4cda-a87b-462b0ff2baf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dffcb6-aa8e-4801-879c-44668bb30180", "name": "network-vif-deleted", "tag": "a134e16d-9b2c-4ca8-a768-32ccece885e8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:28.599315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bd743dd4-b470-4a68-a984-7ef2afc0daf8 req-310d8470-801e-4cda-a87b-462b0ff2baf9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:28.600118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bd743dd4-b470-4a68-a984-7ef2afc0daf8 req-310d8470-801e-4cda-a87b-462b0ff2baf9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:28.601910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bd743dd4-b470-4a68-a984-7ef2afc0daf8 req-310d8470-801e-4cda-a87b-462b0ff2baf9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:28.650276 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-bd743dd4-b470-4a68-a984-7ef2afc0daf8 req-310d8470-801e-4cda-a87b-462b0ff2baf9 service nova] Creating event network-vif-deleted:a134e16d-9b2c-4ca8-a768-32ccece885e8 for instance 96dffcb6-aa8e-4801-879c-44668bb30180 on n-h1-853611-3 Aug 18 12:13:28.672671 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-bd743dd4-b470-4a68-a984-7ef2afc0daf8 req-310d8470-801e-4cda-a87b-462b0ff2baf9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105923 Aug 18 12:13:28.679946 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3444/6098] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:28.824818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7f4e810b-7903-4a25-bbdc-31517682e65a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:28.826120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7f4e810b-7903-4a25-bbdc-31517682e65a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:28.851834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f4e810b-7903-4a25-bbdc-31517682e65a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:28.858547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f4e810b-7903-4a25-bbdc-31517682e65a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:28.858547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f4e810b-7903-4a25-bbdc-31517682e65a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:28.858547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f4e810b-7903-4a25-bbdc-31517682e65a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:28.858547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f4e810b-7903-4a25-bbdc-31517682e65a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:28.858547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7f4e810b-7903-4a25-bbdc-31517682e65a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:29.308363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7f4e810b-7903-4a25-bbdc-31517682e65a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:29.322658 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7f4e810b-7903-4a25-bbdc-31517682e65a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1692 microversion: 2.1 time: 0.507919 Aug 18 12:13:29.351629 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3445/6099] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:28 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1692 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:29.610670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d44af614-ee1b-49be-8b10-46e9bc3a04c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:29.611991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d44af614-ee1b-49be-8b10-46e9bc3a04c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:29.643571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d44af614-ee1b-49be-8b10-46e9bc3a04c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:29.645491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d44af614-ee1b-49be-8b10-46e9bc3a04c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:29.646369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d44af614-ee1b-49be-8b10-46e9bc3a04c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:29.648349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d44af614-ee1b-49be-8b10-46e9bc3a04c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:29.649217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d44af614-ee1b-49be-8b10-46e9bc3a04c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:29.650021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d44af614-ee1b-49be-8b10-46e9bc3a04c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:29.790988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d44af614-ee1b-49be-8b10-46e9bc3a04c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:29.791727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d44af614-ee1b-49be-8b10-46e9bc3a04c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:29.792513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d44af614-ee1b-49be-8b10-46e9bc3a04c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:29.793349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-d44af614-ee1b-49be-8b10-46e9bc3a04c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lazy-loading 'fault' on Instance uuid 96dffcb6-aa8e-4801-879c-44668bb30180 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:13:29.896669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d44af614-ee1b-49be-8b10-46e9bc3a04c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd900af30ba5c4e71b856f96cc77c963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b307834607645f895657f71f3f6da85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:29.929933 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d44af614-ee1b-49be-8b10-46e9bc3a04c7 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 200 len: 1305 microversion: 2.1 time: 0.333935 Aug 18 12:13:29.933063 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3446/6100] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:29 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 1305 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:29.979936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f6e0a681-19b7-425d-9767-d82957f1e1ed req-fbd87a16-11b4-4e7b-8b87-8bad0cb9a44f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c1ead01-3a78-454b-a119-6198f0e46211", "tag": "1dd7d952-6010-4a29-869b-f56b957404f0"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:30.026406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f6e0a681-19b7-425d-9767-d82957f1e1ed req-fbd87a16-11b4-4e7b-8b87-8bad0cb9a44f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:30.027154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f6e0a681-19b7-425d-9767-d82957f1e1ed req-fbd87a16-11b4-4e7b-8b87-8bad0cb9a44f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:30.027751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f6e0a681-19b7-425d-9767-d82957f1e1ed req-fbd87a16-11b4-4e7b-8b87-8bad0cb9a44f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:30.054820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f6e0a681-19b7-425d-9767-d82957f1e1ed req-fbd87a16-11b4-4e7b-8b87-8bad0cb9a44f service nova] Creating event network-changed:1dd7d952-6010-4a29-869b-f56b957404f0 for instance 2c1ead01-3a78-454b-a119-6198f0e46211 on n-h2-853611-3 Aug 18 12:13:30.081340 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f6e0a681-19b7-425d-9767-d82957f1e1ed req-fbd87a16-11b4-4e7b-8b87-8bad0cb9a44f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115373 Aug 18 12:13:30.085475 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3447/6101] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:30.348842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c051092d-dc06-4d96-afcb-f96662c6a9d5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:30.349734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c051092d-dc06-4d96-afcb-f96662c6a9d5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:30.379705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c051092d-dc06-4d96-afcb-f96662c6a9d5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:30.380573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c051092d-dc06-4d96-afcb-f96662c6a9d5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:30.381239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c051092d-dc06-4d96-afcb-f96662c6a9d5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:30.390644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c051092d-dc06-4d96-afcb-f96662c6a9d5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:30.391824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c051092d-dc06-4d96-afcb-f96662c6a9d5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:30.392809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c051092d-dc06-4d96-afcb-f96662c6a9d5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:31.431059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c051092d-dc06-4d96-afcb-f96662c6a9d5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:31.462469 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c051092d-dc06-4d96-afcb-f96662c6a9d5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1692 microversion: 2.1 time: 1.117554 Aug 18 12:13:31.464159 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3448/6102] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:30 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1692 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:31.491598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5646fb71-50d9-445f-9a1f-5fa1c15f36d2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:31.492599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5646fb71-50d9-445f-9a1f-5fa1c15f36d2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] [instance: 96dffcb6-aa8e-4801-879c-44668bb30180] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:31.509223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5646fb71-50d9-445f-9a1f-5fa1c15f36d2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:31.510970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5646fb71-50d9-445f-9a1f-5fa1c15f36d2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:31.511580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5646fb71-50d9-445f-9a1f-5fa1c15f36d2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:31.512458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5646fb71-50d9-445f-9a1f-5fa1c15f36d2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:31.513369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5646fb71-50d9-445f-9a1f-5fa1c15f36d2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:31.514399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5646fb71-50d9-445f-9a1f-5fa1c15f36d2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:31.538771 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-5646fb71-50d9-445f-9a1f-5fa1c15f36d2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] HTTP exception thrown: Instance 96dffcb6-aa8e-4801-879c-44668bb30180 could not be found. Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5646fb71-50d9-445f-9a1f-5fa1c15f36d2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Request method failure captured: Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 HTTP/1.1 Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_izLX1Nzb7Qjq9tm2UbUJTI1Yt1pnXcFaTDMdfUzzLS5RJGtsQJhDUFkAxcpdtYdzwKFb1_6qoMj0zqoA_NyyLjqB3kkxw_eT03asWWoZ8z6VwoRApLPLgKCHrF4cNzOWIeDzFdUSpqkeXGV_je-7Y4SvzdUMOt6Se1MkpjYLm8vasY Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 2b307834607645f895657f71f3f6da85 Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestServerAdvancedOps-468579925 Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2b307834607645f895657f71f3f6da85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/2b307834607645f895657f71f3f6da85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_2b307834607645f895657f71f3f6da85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/2b307834607645f895657f71f3f6da85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestServerAdvancedOps-468579925 Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 2b307834607645f895657f71f3f6da85 Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestServerAdvancedOps-468579925 Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestServerAdvancedOps-468579925-project Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d900af30ba5c4e71b856f96cc77c963f Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestServerAdvancedOps-468579925-project Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 96dffcb6-aa8e-4801-879c-44668bb30180 could not be found. Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '96dffcb6-aa8e-4801-879c-44668bb30180'} Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96dffcb6-aa8e-4801-879c-44668bb30180 could not be found. Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96dffcb6-aa8e-4801-879c-44668bb30180 could not be found. Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:13:31.540659 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:31.546102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:13:31.546102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:13:31.546102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:13:31.546102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:13:31.546102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:13:31.546102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96dffcb6-aa8e-4801-879c-44668bb30180 could not be found. Aug 18 12:13:31.546102 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:31.546102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5646fb71-50d9-445f-9a1f-5fa1c15f36d2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] Returning 404 to user: Instance 96dffcb6-aa8e-4801-879c-44668bb30180 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:13:31.550462 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5646fb71-50d9-445f-9a1f-5fa1c15f36d2 tempest-TestServerAdvancedOps-468579925 tempest-TestServerAdvancedOps-468579925-project] 10.222.0.73 "GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180" status: 404 len: 111 microversion: 2.1 time: 0.079815 Aug 18 12:13:31.551656 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3449/6103] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:31 2022] GET /compute/v2.1/servers/96dffcb6-aa8e-4801-879c-44668bb30180 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:13:32.487819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1984cec1-8064-44cd-a6a3-494beceec8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:32.488855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1984cec1-8064-44cd-a6a3-494beceec8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:32.499005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1984cec1-8064-44cd-a6a3-494beceec8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:32.499861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1984cec1-8064-44cd-a6a3-494beceec8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:32.500319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1984cec1-8064-44cd-a6a3-494beceec8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:32.501099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1984cec1-8064-44cd-a6a3-494beceec8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:32.501576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1984cec1-8064-44cd-a6a3-494beceec8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:32.502013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1984cec1-8064-44cd-a6a3-494beceec8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:32.871909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1984cec1-8064-44cd-a6a3-494beceec8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:32.893038 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1984cec1-8064-44cd-a6a3-494beceec8b2 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1692 microversion: 2.1 time: 0.409499 Aug 18 12:13:32.894827 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3450/6104] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:32 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1692 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:33.922744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2656f33c-87e5-4815-9d27-8d56e8610440 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:33.923591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2656f33c-87e5-4815-9d27-8d56e8610440 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:33.937639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2656f33c-87e5-4815-9d27-8d56e8610440 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:33.942012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2656f33c-87e5-4815-9d27-8d56e8610440 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:33.943606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2656f33c-87e5-4815-9d27-8d56e8610440 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:33.946398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2656f33c-87e5-4815-9d27-8d56e8610440 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:33.947193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2656f33c-87e5-4815-9d27-8d56e8610440 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:33.948867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2656f33c-87e5-4815-9d27-8d56e8610440 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:34.325971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2656f33c-87e5-4815-9d27-8d56e8610440 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:34.341961 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2656f33c-87e5-4815-9d27-8d56e8610440 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1692 microversion: 2.1 time: 0.425241 Aug 18 12:13:34.355218 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3451/6105] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:33 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1692 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:35.370471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c146f33a-75b5-4927-ae09-3acf1e344226 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:35.373122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c146f33a-75b5-4927-ae09-3acf1e344226 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:35.391630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c146f33a-75b5-4927-ae09-3acf1e344226 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:35.394200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c146f33a-75b5-4927-ae09-3acf1e344226 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:35.395181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c146f33a-75b5-4927-ae09-3acf1e344226 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:35.397594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c146f33a-75b5-4927-ae09-3acf1e344226 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:35.399111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c146f33a-75b5-4927-ae09-3acf1e344226 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:35.400273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c146f33a-75b5-4927-ae09-3acf1e344226 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:36.055800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c146f33a-75b5-4927-ae09-3acf1e344226 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:36.088938 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c146f33a-75b5-4927-ae09-3acf1e344226 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1692 microversion: 2.1 time: 0.726090 Aug 18 12:13:36.094290 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3452/6106] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:35 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1692 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:37.133748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f80be15d-7c61-4d62-82c0-60cf25750701 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:37.139974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f80be15d-7c61-4d62-82c0-60cf25750701 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:37.152794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80be15d-7c61-4d62-82c0-60cf25750701 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:37.153812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80be15d-7c61-4d62-82c0-60cf25750701 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:37.154839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80be15d-7c61-4d62-82c0-60cf25750701 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:37.156343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80be15d-7c61-4d62-82c0-60cf25750701 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:37.157385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80be15d-7c61-4d62-82c0-60cf25750701 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:37.158337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80be15d-7c61-4d62-82c0-60cf25750701 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:37.522993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f80be15d-7c61-4d62-82c0-60cf25750701 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:37.555123 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f80be15d-7c61-4d62-82c0-60cf25750701 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1682 microversion: 2.1 time: 0.428777 Aug 18 12:13:37.556249 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3453/6107] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:37 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1682 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:37.597150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2c6f2526-c1bc-47d8-b1f0-212dbdc55fed tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:37.602573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2c6f2526-c1bc-47d8-b1f0-212dbdc55fed tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:37.613448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c6f2526-c1bc-47d8-b1f0-212dbdc55fed tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:37.615906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c6f2526-c1bc-47d8-b1f0-212dbdc55fed tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:37.616933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c6f2526-c1bc-47d8-b1f0-212dbdc55fed tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:37.618095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c6f2526-c1bc-47d8-b1f0-212dbdc55fed tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:37.618875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c6f2526-c1bc-47d8-b1f0-212dbdc55fed tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:37.619489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2c6f2526-c1bc-47d8-b1f0-212dbdc55fed tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:38.040720 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2c6f2526-c1bc-47d8-b1f0-212dbdc55fed tempest-TestNetworkAdvancedServerOps-267355450 tempest-TestNetworkAdvancedServerOps-267355450-project-admin] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1833 microversion: 2.1 time: 0.449847 Aug 18 12:13:38.042025 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3454/6108] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:37 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1833 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:38.085077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ad2e3df4-5e46-471e-8bc5-cd47b96d29b1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:38.090624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ad2e3df4-5e46-471e-8bc5-cd47b96d29b1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:38.105223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad2e3df4-5e46-471e-8bc5-cd47b96d29b1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:38.106291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad2e3df4-5e46-471e-8bc5-cd47b96d29b1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:38.107992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad2e3df4-5e46-471e-8bc5-cd47b96d29b1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:38.109782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad2e3df4-5e46-471e-8bc5-cd47b96d29b1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:38.111605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad2e3df4-5e46-471e-8bc5-cd47b96d29b1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:38.112978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad2e3df4-5e46-471e-8bc5-cd47b96d29b1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:38.542643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ad2e3df4-5e46-471e-8bc5-cd47b96d29b1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:38.555358 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ad2e3df4-5e46-471e-8bc5-cd47b96d29b1 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1682 microversion: 2.1 time: 0.480433 Aug 18 12:13:38.555982 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3455/6109] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:38 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1682 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:40.784407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8a92af71-077b-4db8-9c52-99806be85e74 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:40.794314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8a92af71-077b-4db8-9c52-99806be85e74 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:40.817402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a92af71-077b-4db8-9c52-99806be85e74 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:40.818310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a92af71-077b-4db8-9c52-99806be85e74 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:40.819291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a92af71-077b-4db8-9c52-99806be85e74 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:40.820665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a92af71-077b-4db8-9c52-99806be85e74 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:40.821538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a92af71-077b-4db8-9c52-99806be85e74 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:40.822353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a92af71-077b-4db8-9c52-99806be85e74 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:40.913915 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8a92af71-077b-4db8-9c52-99806be85e74 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211/action" status: 200 len: 38631 microversion: 2.1 time: 0.142224 Aug 18 12:13:40.915349 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3456/6110] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:13:40 2022] POST /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211/action => generated 38631 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:13:42.768219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5ea716c6-f379-420b-ae5d-81d5b19875c8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:42.769763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5ea716c6-f379-420b-ae5d-81d5b19875c8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:42.804730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ea716c6-f379-420b-ae5d-81d5b19875c8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:42.806035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ea716c6-f379-420b-ae5d-81d5b19875c8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:42.807353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ea716c6-f379-420b-ae5d-81d5b19875c8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:42.808936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ea716c6-f379-420b-ae5d-81d5b19875c8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:42.810305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ea716c6-f379-420b-ae5d-81d5b19875c8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:42.811800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5ea716c6-f379-420b-ae5d-81d5b19875c8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:42.871356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5ea716c6-f379-420b-ae5d-81d5b19875c8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:13:43.119034 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5ea716c6-f379-420b-ae5d-81d5b19875c8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 204 len: 0 microversion: 2.1 time: 0.363325 Aug 18 12:13:43.120231 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3457/6111] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:13:42 2022] DELETE /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:13:43.140642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a51ea3e2-6af5-42c0-a36c-74230f6d3a41 req-75135dd3-845b-4cbe-a7b7-237ff7f5db61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c1ead01-3a78-454b-a119-6198f0e46211", "tag": "1dd7d952-6010-4a29-869b-f56b957404f0"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:43.156317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a51ea3e2-6af5-42c0-a36c-74230f6d3a41 req-75135dd3-845b-4cbe-a7b7-237ff7f5db61 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:43.157251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a51ea3e2-6af5-42c0-a36c-74230f6d3a41 req-75135dd3-845b-4cbe-a7b7-237ff7f5db61 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:43.158524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a51ea3e2-6af5-42c0-a36c-74230f6d3a41 req-75135dd3-845b-4cbe-a7b7-237ff7f5db61 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:43.174775 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a51ea3e2-6af5-42c0-a36c-74230f6d3a41 req-75135dd3-845b-4cbe-a7b7-237ff7f5db61 service nova] Creating event network-changed:1dd7d952-6010-4a29-869b-f56b957404f0 for instance 2c1ead01-3a78-454b-a119-6198f0e46211 on n-h1-853611-3 Aug 18 12:13:43.182601 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a51ea3e2-6af5-42c0-a36c-74230f6d3a41 req-75135dd3-845b-4cbe-a7b7-237ff7f5db61 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053078 Aug 18 12:13:43.188685 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3458/6112] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:43.196929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8df47a3-a6ca-45ae-814f-99d44d7fbb92 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:43.198239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f8df47a3-a6ca-45ae-814f-99d44d7fbb92 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:43.208602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8df47a3-a6ca-45ae-814f-99d44d7fbb92 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:43.209440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8df47a3-a6ca-45ae-814f-99d44d7fbb92 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:43.210099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8df47a3-a6ca-45ae-814f-99d44d7fbb92 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:43.211232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8df47a3-a6ca-45ae-814f-99d44d7fbb92 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:43.212081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8df47a3-a6ca-45ae-814f-99d44d7fbb92 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:43.212917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8df47a3-a6ca-45ae-814f-99d44d7fbb92 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:43.496068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f8df47a3-a6ca-45ae-814f-99d44d7fbb92 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:43.500686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:43.509962 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8df47a3-a6ca-45ae-814f-99d44d7fbb92 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1688 microversion: 2.1 time: 0.319523 Aug 18 12:13:43.515058 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3459/6113] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:43 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1688 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:13:44.553808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9677b7cc-dd47-44ba-bb55-5a29d78de611 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:44.554657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9677b7cc-dd47-44ba-bb55-5a29d78de611 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:44.577522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9677b7cc-dd47-44ba-bb55-5a29d78de611 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:44.584560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9677b7cc-dd47-44ba-bb55-5a29d78de611 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:44.585208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9677b7cc-dd47-44ba-bb55-5a29d78de611 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:44.590350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9677b7cc-dd47-44ba-bb55-5a29d78de611 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:44.591102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9677b7cc-dd47-44ba-bb55-5a29d78de611 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:44.592213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9677b7cc-dd47-44ba-bb55-5a29d78de611 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:44.838709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9677b7cc-dd47-44ba-bb55-5a29d78de611 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:44.855723 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9677b7cc-dd47-44ba-bb55-5a29d78de611 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 200 len: 1621 microversion: 2.1 time: 0.307502 Aug 18 12:13:44.867990 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3460/6114] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:44 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 1621 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:13:45.210338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-03463a66-408e-4355-bdfd-09ab754e4ece req-cc6386d2-d255-4f7a-bbd1-5b3b351fccbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1ead01-3a78-454b-a119-6198f0e46211", "name": "network-vif-deleted", "tag": "1dd7d952-6010-4a29-869b-f56b957404f0"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:45.241852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-03463a66-408e-4355-bdfd-09ab754e4ece req-cc6386d2-d255-4f7a-bbd1-5b3b351fccbf service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:45.243892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-03463a66-408e-4355-bdfd-09ab754e4ece req-cc6386d2-d255-4f7a-bbd1-5b3b351fccbf service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:45.245941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-03463a66-408e-4355-bdfd-09ab754e4ece req-cc6386d2-d255-4f7a-bbd1-5b3b351fccbf service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:45.277372 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-03463a66-408e-4355-bdfd-09ab754e4ece req-cc6386d2-d255-4f7a-bbd1-5b3b351fccbf service nova] Creating event network-vif-deleted:1dd7d952-6010-4a29-869b-f56b957404f0 for instance 2c1ead01-3a78-454b-a119-6198f0e46211 on n-h1-853611-3 Aug 18 12:13:45.291946 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-03463a66-408e-4355-bdfd-09ab754e4ece req-cc6386d2-d255-4f7a-bbd1-5b3b351fccbf service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089534 Aug 18 12:13:45.292575 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3461/6115] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:45.921429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc6253f7-5ce7-4019-b27c-932b41208c9c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:45.925098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dc6253f7-5ce7-4019-b27c-932b41208c9c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2c1ead01-3a78-454b-a119-6198f0e46211] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:45.947147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc6253f7-5ce7-4019-b27c-932b41208c9c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:45.948336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc6253f7-5ce7-4019-b27c-932b41208c9c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:45.949461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc6253f7-5ce7-4019-b27c-932b41208c9c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:45.951013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc6253f7-5ce7-4019-b27c-932b41208c9c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:45.952192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc6253f7-5ce7-4019-b27c-932b41208c9c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:45.956029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc6253f7-5ce7-4019-b27c-932b41208c9c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:46.012859 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-dc6253f7-5ce7-4019-b27c-932b41208c9c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] HTTP exception thrown: Instance 2c1ead01-3a78-454b-a119-6198f0e46211 could not be found. Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc6253f7-5ce7-4019-b27c-932b41208c9c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Request method failure captured: Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 HTTP/1.1 Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_itpP3k2OQKDfTawi0kf9ygIVnfNVtKyQf6_y09raSLkqAu--Orcs7bv0PWg_M-JZcd1pI700Biy17mLWE4K6g_euM6YJIeHjhMvih1w9wsUGvonHEvYQGTA-0UcBLRhtzeS3Igm0aFaFMmv_Cl5gbWHiLNqehP12OxQYhEvTlr4F3c Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 75eb549fd4b44a4fb569dbfc1f507c3c Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-325550642 Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestNetworkAdvancedServerOps-325550642 Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 75eb549fd4b44a4fb569dbfc1f507c3c Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-325550642 Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestNetworkAdvancedServerOps-325550642-project Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 916631a932304b6c9cec7ef622e2069d Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestNetworkAdvancedServerOps-325550642-project Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 2c1ead01-3a78-454b-a119-6198f0e46211 could not be found. Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '2c1ead01-3a78-454b-a119-6198f0e46211'} Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c1ead01-3a78-454b-a119-6198f0e46211 could not be found. Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c1ead01-3a78-454b-a119-6198f0e46211 could not be found. Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:46.015005 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:13:46.021314 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:46.021314 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:13:46.021314 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:13:46.021314 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:13:46.021314 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:13:46.021314 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:13:46.021314 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c1ead01-3a78-454b-a119-6198f0e46211 could not be found. Aug 18 12:13:46.021314 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:13:46.027140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc6253f7-5ce7-4019-b27c-932b41208c9c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Returning 404 to user: Instance 2c1ead01-3a78-454b-a119-6198f0e46211 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:13:46.029969 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dc6253f7-5ce7-4019-b27c-932b41208c9c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211" status: 404 len: 111 microversion: 2.1 time: 0.116745 Aug 18 12:13:46.031452 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3462/6116] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:45 2022] GET /compute/v2.1/servers/2c1ead01-3a78-454b-a119-6198f0e46211 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:13:54.943827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7215ab76-84a5-473d-aab1-a00aa6055e44 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '.version_select at 0x7f519edbbdc0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:55.004257 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7215ab76-84a5-473d-aab1-a00aa6055e44 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1629016217" status: 202 len: 0 microversion: 2.1 time: 0.064573 Aug 18 12:13:55.005635 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3463/6117] 10.222.0.73 () {58 vars in 1284 bytes} [Thu Aug 18 12:13:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1629016217 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:13:55.071395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d912f92-8795-4312-b4ff-823ae1e701b5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'create', calling method: .version_select at 0x7f519ee1fc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1860673782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuCKsmk4mTzBum3zr4B/t7foS2IGZn/GpT923qGzkvjg/W87aQ6a2MsoQUdKhmYZ8yxub14w2W6VsL+hL3h+aUplGsaDkQPirn2HuCQ9PFhm59u15IVN2BBco+QYenNog=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:55.119253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7d912f92-8795-4312-b4ff-823ae1e701b5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:13:55.151859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7d912f92-8795-4312-b4ff-823ae1e701b5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for user 916631a932304b6c9cec7ef622e2069d and project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:13:55.253217 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7d912f92-8795-4312-b4ff-823ae1e701b5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.186219 Aug 18 12:13:55.262884 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3464/6118] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:13:55 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:13:57.373618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1811518336", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8955b21c-90cf-4574-989a-a537451c350e", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "11e09857-d75b-4b2b-82b3-fa5db86d3937"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:57.399833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=10 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:57.557434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] validate_networks() for [('11e09857-d75b-4b2b-82b3-fa5db86d3937', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:13:58.187607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:13:58.188580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:13:58.189693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:13:58.190823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:13:58.191665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:13:58.195384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:13:58.213638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:58.214776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:58.215918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:58.217709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:13:58.219009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:13:58.219818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:13:58.249998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:13:58.257142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for user 033d6aa61b5340189fbc5d895d3e8cba and project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:13:58.274229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:13:58.276436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='8955b21c-90cf-4574-989a-a537451c350e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:13:58.368475 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7013764a-f1be-4960-80fe-990dc9a8367f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.002632 Aug 18 12:13:58.370669 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3465/6119] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:13:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:13:58.850232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-851c23b2-1394-4158-a094-2ebb679b9c7b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Action: 'create', calling method: .version_select at 0x7f519ed949d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1580032937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFH/YTfzHgVpLHP57Esl2crPue1pAWrGfhIAOaews6bkKWaSoHJd9v9yETCcLJ5CLtFoVo2qYJ2iMkVrI39FjYHoWZLZQ7/3v7rk7TkT6N5Bo1TS129b9EVpg5DStFSIzw=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:13:58.907236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-851c23b2-1394-4158-a094-2ebb679b9c7b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Getting quotas for project 9f7e069bf3fc4d058dff03e8470908b0. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:13:58.928914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-851c23b2-1394-4158-a094-2ebb679b9c7b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Getting quotas for user 3dbdade40dd04a09b1794f6391d8abdc and project 9f7e069bf3fc4d058dff03e8470908b0. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:13:59.023265 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-851c23b2-1394-4158-a094-2ebb679b9c7b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.650782 Aug 18 12:13:59.026552 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3466/6120] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:13:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:13:59.047162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7b7caf80-f5c4-4a6f-9700-eefe6a2afec6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:13:59.047951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7b7caf80-f5c4-4a6f-9700-eefe6a2afec6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:13:59.192614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7b7caf80-f5c4-4a6f-9700-eefe6a2afec6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:13:59.204083 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7b7caf80-f5c4-4a6f-9700-eefe6a2afec6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1057 microversion: 2.1 time: 0.170133 Aug 18 12:13:59.205117 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3467/6121] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:13:59 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1057 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:00.249809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e2bf4517-c842-4fbb-8942-4dcf90de389f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:00.252135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e2bf4517-c842-4fbb-8942-4dcf90de389f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:00.262951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2bf4517-c842-4fbb-8942-4dcf90de389f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:00.263910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2bf4517-c842-4fbb-8942-4dcf90de389f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:00.265001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2bf4517-c842-4fbb-8942-4dcf90de389f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:00.266192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2bf4517-c842-4fbb-8942-4dcf90de389f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:00.267196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2bf4517-c842-4fbb-8942-4dcf90de389f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:00.267945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2bf4517-c842-4fbb-8942-4dcf90de389f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:00.607653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e2bf4517-c842-4fbb-8942-4dcf90de389f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:00.650881 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e2bf4517-c842-4fbb-8942-4dcf90de389f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1109 microversion: 2.1 time: 0.406889 Aug 18 12:14:00.655530 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3468/6122] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:00 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1109 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:01.692007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-534c355d-944a-487f-a1c7-3e793bb7c70d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:01.693145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-534c355d-944a-487f-a1c7-3e793bb7c70d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:01.744681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-534c355d-944a-487f-a1c7-3e793bb7c70d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:01.746769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-534c355d-944a-487f-a1c7-3e793bb7c70d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:01.749939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-534c355d-944a-487f-a1c7-3e793bb7c70d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:01.755372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-534c355d-944a-487f-a1c7-3e793bb7c70d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:01.758703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-534c355d-944a-487f-a1c7-3e793bb7c70d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:01.761632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-534c355d-944a-487f-a1c7-3e793bb7c70d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:02.382531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-534c355d-944a-487f-a1c7-3e793bb7c70d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:02.396289 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-534c355d-944a-487f-a1c7-3e793bb7c70d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1169 microversion: 2.1 time: 0.712916 Aug 18 12:14:02.401047 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3469/6123] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:01 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1169 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:02.621917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1113243163", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1580032937", "security_groups": [{"name": "tempest-secgroup-smoke-1136423849"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "dafb8ec0-2e3e-4358-bf6f-12a072797099"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:03.547374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] validate_networks() for [('dafb8ec0-2e3e-4358-bf6f-12a072797099', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:14:05.913336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Getting quotas for project 9f7e069bf3fc4d058dff03e8470908b0. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:14:05.935175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Getting quotas for user 3dbdade40dd04a09b1794f6391d8abdc and project 9f7e069bf3fc4d058dff03e8470908b0. Resources: dict_keys(['metadata_items']) {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:14:05.995426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:14:05.996234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:14:06.001253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:14:06.002349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:14:06.006236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:14:06.046831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:06.048333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:06.051932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:06.055299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:06.059176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:06.060525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:06.137595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Getting quotas for project 9f7e069bf3fc4d058dff03e8470908b0. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:14:06.155380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Getting quotas for user 3dbdade40dd04a09b1794f6391d8abdc and project 9f7e069bf3fc4d058dff03e8470908b0. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:14:06.201250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:14:06.205177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:14:06.311985 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5c2cadc5-02f6-40fd-991b-49d05720a99b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.693605 Aug 18 12:14:06.312836 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3470/6124] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:14:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 3696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:14:06.319041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34ab252f-84dc-4cb4-a710-27b90569b398 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:06.320137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-34ab252f-84dc-4cb4-a710-27b90569b398 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:06.342065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34ab252f-84dc-4cb4-a710-27b90569b398 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:06.343221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34ab252f-84dc-4cb4-a710-27b90569b398 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:06.345001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34ab252f-84dc-4cb4-a710-27b90569b398 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:06.346412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34ab252f-84dc-4cb4-a710-27b90569b398 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:06.347037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34ab252f-84dc-4cb4-a710-27b90569b398 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:06.347505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34ab252f-84dc-4cb4-a710-27b90569b398 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:06.625607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-34ab252f-84dc-4cb4-a710-27b90569b398 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:06.681136 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34ab252f-84dc-4cb4-a710-27b90569b398 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1169 microversion: 2.1 time: 0.364072 Aug 18 12:14:06.715129 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3471/6125] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:06 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1169 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:06.736414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f6d0fe9c-1cf0-488e-978c-374e1455bb6e req-1987daaa-9aa7-4e7b-97f5-88105ab00745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abeb19bf-12f7-4554-b73d-e1684be54287", "tag": "fd01487b-e0dc-47f9-92ab-1a00ba1b12e4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:06.810677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f6d0fe9c-1cf0-488e-978c-374e1455bb6e req-1987daaa-9aa7-4e7b-97f5-88105ab00745 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:06.812520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f6d0fe9c-1cf0-488e-978c-374e1455bb6e req-1987daaa-9aa7-4e7b-97f5-88105ab00745 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:06.813840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f6d0fe9c-1cf0-488e-978c-374e1455bb6e req-1987daaa-9aa7-4e7b-97f5-88105ab00745 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:06.880736 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f6d0fe9c-1cf0-488e-978c-374e1455bb6e req-1987daaa-9aa7-4e7b-97f5-88105ab00745 service nova] Creating event network-changed:fd01487b-e0dc-47f9-92ab-1a00ba1b12e4 for instance abeb19bf-12f7-4554-b73d-e1684be54287 on n-h2-853611-3 Aug 18 12:14:06.908903 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f6d0fe9c-1cf0-488e-978c-374e1455bb6e req-1987daaa-9aa7-4e7b-97f5-88105ab00745 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191922 Aug 18 12:14:06.912263 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3472/6126] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:06.936639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3a992202-0362-4194-860f-f03b43d944e6 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:06.943476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3a992202-0362-4194-860f-f03b43d944e6 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:07.190075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3a992202-0362-4194-860f-f03b43d944e6 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbdade40dd04a09b1794f6391d8abdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e069bf3fc4d058dff03e8470908b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:07.214707 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3a992202-0362-4194-860f-f03b43d944e6 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 200 len: 1303 microversion: 2.1 time: 0.296288 Aug 18 12:14:07.214707 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3473/6127] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:06 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 1303 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:07.726233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9bfb2059-7c8b-44cd-aeac-5b7be321a8fa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:07.727954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9bfb2059-7c8b-44cd-aeac-5b7be321a8fa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:07.768909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bfb2059-7c8b-44cd-aeac-5b7be321a8fa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:07.769383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bfb2059-7c8b-44cd-aeac-5b7be321a8fa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:07.769932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bfb2059-7c8b-44cd-aeac-5b7be321a8fa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:07.770816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bfb2059-7c8b-44cd-aeac-5b7be321a8fa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:07.771378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bfb2059-7c8b-44cd-aeac-5b7be321a8fa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:07.771823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9bfb2059-7c8b-44cd-aeac-5b7be321a8fa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:08.984147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9bfb2059-7c8b-44cd-aeac-5b7be321a8fa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:09.007508 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9bfb2059-7c8b-44cd-aeac-5b7be321a8fa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1169 microversion: 2.1 time: 1.285431 Aug 18 12:14:09.024746 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3474/6128] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:07 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1169 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:09.057946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c7f6cdd5-691b-4b22-9d24-4ab354aa3842 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:09.061435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c7f6cdd5-691b-4b22-9d24-4ab354aa3842 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:09.112275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7f6cdd5-691b-4b22-9d24-4ab354aa3842 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:09.112958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7f6cdd5-691b-4b22-9d24-4ab354aa3842 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:09.113459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7f6cdd5-691b-4b22-9d24-4ab354aa3842 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:09.114234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7f6cdd5-691b-4b22-9d24-4ab354aa3842 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:09.114743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7f6cdd5-691b-4b22-9d24-4ab354aa3842 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:09.115195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7f6cdd5-691b-4b22-9d24-4ab354aa3842 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:09.565667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c7f6cdd5-691b-4b22-9d24-4ab354aa3842 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbdade40dd04a09b1794f6391d8abdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e069bf3fc4d058dff03e8470908b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:09.594695 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c7f6cdd5-691b-4b22-9d24-4ab354aa3842 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 200 len: 1363 microversion: 2.1 time: 0.562651 Aug 18 12:14:09.602507 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3475/6129] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:09 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 1363 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:09.674035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-555989339", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "efb142dd-f924-4145-bd01-c630d698da32"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1860673782", "security_groups": [{"name": "tempest-secgroup-smoke-392322813"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:09.956527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] validate_networks() for [('efb142dd-f924-4145-bd01-c630d698da32', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:14:10.879138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:14:10.880481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:14:10.880901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:14:10.881468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:14:10.882461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:14:10.905490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:10.910173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:10.919671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:10.922490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:10.924061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:10.925411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:10.973586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:14:10.987948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Getting quotas for user 916631a932304b6c9cec7ef622e2069d and project 75eb549fd4b44a4fb569dbfc1f507c3c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:14:11.050276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:14:11.056594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:14:11.322745 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-298ca8ee-b0ac-4d96-ae26-016612064e9e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.654844 Aug 18 12:14:11.361131 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3476/6130] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:14:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:14:11.384574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c0792208-b71c-4832-b11d-d9a5afe2306d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:11.386399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c0792208-b71c-4832-b11d-d9a5afe2306d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:11.404946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0792208-b71c-4832-b11d-d9a5afe2306d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:11.406459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0792208-b71c-4832-b11d-d9a5afe2306d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:11.408710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0792208-b71c-4832-b11d-d9a5afe2306d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:11.411945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0792208-b71c-4832-b11d-d9a5afe2306d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:11.413695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0792208-b71c-4832-b11d-d9a5afe2306d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:11.414585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0792208-b71c-4832-b11d-d9a5afe2306d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:11.784778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c0792208-b71c-4832-b11d-d9a5afe2306d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:11.835573 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c0792208-b71c-4832-b11d-d9a5afe2306d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1169 microversion: 2.1 time: 0.464488 Aug 18 12:14:11.860265 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3477/6131] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:11 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1169 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:11.893464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-90f02802-29ab-45bc-a2b9-62bdb75c93f3 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:11.895029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-90f02802-29ab-45bc-a2b9-62bdb75c93f3 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:11.905054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f02802-29ab-45bc-a2b9-62bdb75c93f3 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:11.906138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f02802-29ab-45bc-a2b9-62bdb75c93f3 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:11.907381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f02802-29ab-45bc-a2b9-62bdb75c93f3 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:11.908402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f02802-29ab-45bc-a2b9-62bdb75c93f3 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:11.909120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f02802-29ab-45bc-a2b9-62bdb75c93f3 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:11.909796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f02802-29ab-45bc-a2b9-62bdb75c93f3 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:12.289435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-90f02802-29ab-45bc-a2b9-62bdb75c93f3 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbdade40dd04a09b1794f6391d8abdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e069bf3fc4d058dff03e8470908b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:12.316008 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-90f02802-29ab-45bc-a2b9-62bdb75c93f3 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 200 len: 1429 microversion: 2.1 time: 0.432390 Aug 18 12:14:12.317421 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3478/6132] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:11 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 1429 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:12.328917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6b86a839-285e-4c13-aad3-c9781223a2a0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:12.330698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6b86a839-285e-4c13-aad3-c9781223a2a0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:12.461011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6b86a839-285e-4c13-aad3-c9781223a2a0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:12.475938 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6b86a839-285e-4c13-aad3-c9781223a2a0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1266 microversion: 2.1 time: 0.157069 Aug 18 12:14:12.476556 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3479/6133] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:12 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:12.899684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-04ab64d7-e916-4c96-b9ca-7ed5cb9b4917 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:12.902722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-04ab64d7-e916-4c96-b9ca-7ed5cb9b4917 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:12.930878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04ab64d7-e916-4c96-b9ca-7ed5cb9b4917 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:12.931586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04ab64d7-e916-4c96-b9ca-7ed5cb9b4917 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:12.932149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04ab64d7-e916-4c96-b9ca-7ed5cb9b4917 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:12.934073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04ab64d7-e916-4c96-b9ca-7ed5cb9b4917 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:12.935058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04ab64d7-e916-4c96-b9ca-7ed5cb9b4917 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:12.936470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04ab64d7-e916-4c96-b9ca-7ed5cb9b4917 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:13.237466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-04ab64d7-e916-4c96-b9ca-7ed5cb9b4917 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:13.255469 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-04ab64d7-e916-4c96-b9ca-7ed5cb9b4917 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1169 microversion: 2.1 time: 0.375517 Aug 18 12:14:13.257273 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3480/6134] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:12 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1169 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:13.339006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e39fd48-0d34-42d8-baca-c296576b36cc tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:13.340292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9e39fd48-0d34-42d8-baca-c296576b36cc tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:13.348620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:14:13.363521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e39fd48-0d34-42d8-baca-c296576b36cc tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:13.364296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e39fd48-0d34-42d8-baca-c296576b36cc tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:13.364914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e39fd48-0d34-42d8-baca-c296576b36cc tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:13.366150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e39fd48-0d34-42d8-baca-c296576b36cc tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:13.372065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e39fd48-0d34-42d8-baca-c296576b36cc tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:13.372803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e39fd48-0d34-42d8-baca-c296576b36cc tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:13.689093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9e39fd48-0d34-42d8-baca-c296576b36cc tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbdade40dd04a09b1794f6391d8abdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e069bf3fc4d058dff03e8470908b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:13.712438 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9e39fd48-0d34-42d8-baca-c296576b36cc tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 200 len: 1429 microversion: 2.1 time: 0.377594 Aug 18 12:14:13.727260 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3481/6135] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:13 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 1429 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:13.748276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-55bb0905-8720-4abc-b2c6-06da10034d2b req-adea5eea-5b8f-4fd2-a78b-e56b7dd085b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9046078e-c414-468b-93e2-07039eee2d23", "tag": "0832579b-4a0f-4cda-8bff-a032eceb684b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:13.798356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-55bb0905-8720-4abc-b2c6-06da10034d2b req-adea5eea-5b8f-4fd2-a78b-e56b7dd085b2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:13.798356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-55bb0905-8720-4abc-b2c6-06da10034d2b req-adea5eea-5b8f-4fd2-a78b-e56b7dd085b2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:13.798356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-55bb0905-8720-4abc-b2c6-06da10034d2b req-adea5eea-5b8f-4fd2-a78b-e56b7dd085b2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:13.861657 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-55bb0905-8720-4abc-b2c6-06da10034d2b req-adea5eea-5b8f-4fd2-a78b-e56b7dd085b2 service nova] Creating event network-changed:0832579b-4a0f-4cda-8bff-a032eceb684b for instance 9046078e-c414-468b-93e2-07039eee2d23 on n-h1-853611-3 Aug 18 12:14:13.874997 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-55bb0905-8720-4abc-b2c6-06da10034d2b req-adea5eea-5b8f-4fd2-a78b-e56b7dd085b2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138483 Aug 18 12:14:13.880403 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3482/6136] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:13.898396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ebac01d8-c08a-4cc5-a796-016c16a9b2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:13.899180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ebac01d8-c08a-4cc5-a796-016c16a9b2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:13.919166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebac01d8-c08a-4cc5-a796-016c16a9b2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:13.919881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebac01d8-c08a-4cc5-a796-016c16a9b2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:13.920085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebac01d8-c08a-4cc5-a796-016c16a9b2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:13.921041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebac01d8-c08a-4cc5-a796-016c16a9b2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:13.926182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebac01d8-c08a-4cc5-a796-016c16a9b2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:13.926996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ebac01d8-c08a-4cc5-a796-016c16a9b2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:14.146659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ebac01d8-c08a-4cc5-a796-016c16a9b2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:14.157612 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ebac01d8-c08a-4cc5-a796-016c16a9b2be tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1326 microversion: 2.1 time: 0.275367 Aug 18 12:14:14.158938 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3483/6137] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:13 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1326 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:14.296141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3d8da095-d4d0-4cd8-86b3-3dbf3cb0fd40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:14.298346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3d8da095-d4d0-4cd8-86b3-3dbf3cb0fd40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:14.353066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d8da095-d4d0-4cd8-86b3-3dbf3cb0fd40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:14.354865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d8da095-d4d0-4cd8-86b3-3dbf3cb0fd40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:14.356963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d8da095-d4d0-4cd8-86b3-3dbf3cb0fd40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:14.359101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d8da095-d4d0-4cd8-86b3-3dbf3cb0fd40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:14.361337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d8da095-d4d0-4cd8-86b3-3dbf3cb0fd40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:14.361853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d8da095-d4d0-4cd8-86b3-3dbf3cb0fd40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:14.751099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3d8da095-d4d0-4cd8-86b3-3dbf3cb0fd40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:14.769962 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3d8da095-d4d0-4cd8-86b3-3dbf3cb0fd40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1169 microversion: 2.1 time: 0.489252 Aug 18 12:14:14.792881 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3484/6138] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:14 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1169 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:14.803136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1130ab21-74f5-404d-91a8-825b0f33136b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:14.830519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1130ab21-74f5-404d-91a8-825b0f33136b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:14.844733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1130ab21-74f5-404d-91a8-825b0f33136b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:14.845281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1130ab21-74f5-404d-91a8-825b0f33136b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:14.845743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1130ab21-74f5-404d-91a8-825b0f33136b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:14.847498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1130ab21-74f5-404d-91a8-825b0f33136b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:14.848078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1130ab21-74f5-404d-91a8-825b0f33136b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:14.848321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1130ab21-74f5-404d-91a8-825b0f33136b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:15.294636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1130ab21-74f5-404d-91a8-825b0f33136b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbdade40dd04a09b1794f6391d8abdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e069bf3fc4d058dff03e8470908b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:15.316061 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1130ab21-74f5-404d-91a8-825b0f33136b tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 200 len: 1429 microversion: 2.1 time: 0.520777 Aug 18 12:14:15.324344 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3485/6139] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:14 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 1429 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:15.341705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3906aa8c-a809-4c0d-8229-b0e8c92b48e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:15.347562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3906aa8c-a809-4c0d-8229-b0e8c92b48e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:15.371941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3906aa8c-a809-4c0d-8229-b0e8c92b48e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:15.374011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3906aa8c-a809-4c0d-8229-b0e8c92b48e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:15.376132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3906aa8c-a809-4c0d-8229-b0e8c92b48e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:15.378379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3906aa8c-a809-4c0d-8229-b0e8c92b48e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:15.379929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3906aa8c-a809-4c0d-8229-b0e8c92b48e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:15.381919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3906aa8c-a809-4c0d-8229-b0e8c92b48e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:15.971496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3906aa8c-a809-4c0d-8229-b0e8c92b48e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:15.992668 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3906aa8c-a809-4c0d-8229-b0e8c92b48e9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1391 microversion: 2.1 time: 0.665818 Aug 18 12:14:15.995463 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3486/6140] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:15 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1391 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:16.006606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-38e9e54d-4032-4963-a7c9-47b0ba488d71 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:16.007262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-38e9e54d-4032-4963-a7c9-47b0ba488d71 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:16.039042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38e9e54d-4032-4963-a7c9-47b0ba488d71 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:16.039670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38e9e54d-4032-4963-a7c9-47b0ba488d71 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:16.041599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38e9e54d-4032-4963-a7c9-47b0ba488d71 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:16.043854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38e9e54d-4032-4963-a7c9-47b0ba488d71 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:16.046937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38e9e54d-4032-4963-a7c9-47b0ba488d71 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:16.047256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38e9e54d-4032-4963-a7c9-47b0ba488d71 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:16.431240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-38e9e54d-4032-4963-a7c9-47b0ba488d71 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:16.466167 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-38e9e54d-4032-4963-a7c9-47b0ba488d71 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1169 microversion: 2.1 time: 0.461871 Aug 18 12:14:16.481770 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3487/6141] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:15 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1169 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:16.503165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a619611b-ab0a-419e-bd1e-dcc60150d910 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:16.512348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a619611b-ab0a-419e-bd1e-dcc60150d910 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:16.527461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a619611b-ab0a-419e-bd1e-dcc60150d910 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:16.527868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a619611b-ab0a-419e-bd1e-dcc60150d910 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:16.528325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a619611b-ab0a-419e-bd1e-dcc60150d910 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:16.529102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a619611b-ab0a-419e-bd1e-dcc60150d910 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:16.529627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a619611b-ab0a-419e-bd1e-dcc60150d910 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:16.529963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a619611b-ab0a-419e-bd1e-dcc60150d910 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:16.941666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a619611b-ab0a-419e-bd1e-dcc60150d910 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbdade40dd04a09b1794f6391d8abdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e069bf3fc4d058dff03e8470908b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:16.959579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:14:16.968039 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a619611b-ab0a-419e-bd1e-dcc60150d910 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 200 len: 1429 microversion: 2.1 time: 0.484132 Aug 18 12:14:16.982617 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3488/6142] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:16 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 1429 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:17.019697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b1671ca-8d60-45c4-a533-78fa4687437d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:17.020463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b1671ca-8d60-45c4-a533-78fa4687437d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:17.030193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b1671ca-8d60-45c4-a533-78fa4687437d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:17.031465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b1671ca-8d60-45c4-a533-78fa4687437d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:17.032212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b1671ca-8d60-45c4-a533-78fa4687437d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:17.033577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b1671ca-8d60-45c4-a533-78fa4687437d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:17.034619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b1671ca-8d60-45c4-a533-78fa4687437d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:17.035414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b1671ca-8d60-45c4-a533-78fa4687437d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:17.450603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b1671ca-8d60-45c4-a533-78fa4687437d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:17.467477 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b1671ca-8d60-45c4-a533-78fa4687437d tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1391 microversion: 2.1 time: 0.452166 Aug 18 12:14:17.468101 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3489/6143] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:17 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1391 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:17.508753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d823dac6-673d-4ea2-9e36-8b893cc94556 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:17.509543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d823dac6-673d-4ea2-9e36-8b893cc94556 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:17.519385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d823dac6-673d-4ea2-9e36-8b893cc94556 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:17.520039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d823dac6-673d-4ea2-9e36-8b893cc94556 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:17.520652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d823dac6-673d-4ea2-9e36-8b893cc94556 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:17.522398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d823dac6-673d-4ea2-9e36-8b893cc94556 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:17.522398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d823dac6-673d-4ea2-9e36-8b893cc94556 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:17.522990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d823dac6-673d-4ea2-9e36-8b893cc94556 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:17.786422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d823dac6-673d-4ea2-9e36-8b893cc94556 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:17.796257 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d823dac6-673d-4ea2-9e36-8b893cc94556 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1169 microversion: 2.1 time: 0.292084 Aug 18 12:14:17.810911 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3490/6144] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:17 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1169 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:17.841578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-157fc29d-e1c5-4951-9ebb-474d6d9db2e5 req-9758f9a8-36e0-4016-a368-aeec0f8721c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a9b252c-618b-4ec9-b518-3bebbf1d0a30", "tag": "0b1f6e7a-181a-4fdd-bbaf-18537ead2b5c"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:17.872002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-157fc29d-e1c5-4951-9ebb-474d6d9db2e5 req-9758f9a8-36e0-4016-a368-aeec0f8721c2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:17.873339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-157fc29d-e1c5-4951-9ebb-474d6d9db2e5 req-9758f9a8-36e0-4016-a368-aeec0f8721c2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:17.874059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-157fc29d-e1c5-4951-9ebb-474d6d9db2e5 req-9758f9a8-36e0-4016-a368-aeec0f8721c2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:17.889439 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-157fc29d-e1c5-4951-9ebb-474d6d9db2e5 req-9758f9a8-36e0-4016-a368-aeec0f8721c2 service nova] Creating event network-changed:0b1f6e7a-181a-4fdd-bbaf-18537ead2b5c for instance 2a9b252c-618b-4ec9-b518-3bebbf1d0a30 on n-h2-853611-3 Aug 18 12:14:17.896790 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-157fc29d-e1c5-4951-9ebb-474d6d9db2e5 req-9758f9a8-36e0-4016-a368-aeec0f8721c2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065936 Aug 18 12:14:17.898301 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3491/6145] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:17.998410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-36a0ca35-5149-4ecc-b469-e9d8e62a1ca0 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:18.000808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-36a0ca35-5149-4ecc-b469-e9d8e62a1ca0 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:18.015771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36a0ca35-5149-4ecc-b469-e9d8e62a1ca0 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:18.017086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36a0ca35-5149-4ecc-b469-e9d8e62a1ca0 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:18.018307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36a0ca35-5149-4ecc-b469-e9d8e62a1ca0 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:18.019946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36a0ca35-5149-4ecc-b469-e9d8e62a1ca0 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:18.021331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36a0ca35-5149-4ecc-b469-e9d8e62a1ca0 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:18.023635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36a0ca35-5149-4ecc-b469-e9d8e62a1ca0 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:18.424283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-36a0ca35-5149-4ecc-b469-e9d8e62a1ca0 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbdade40dd04a09b1794f6391d8abdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e069bf3fc4d058dff03e8470908b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:18.440195 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-36a0ca35-5149-4ecc-b469-e9d8e62a1ca0 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 200 len: 1429 microversion: 2.1 time: 0.452704 Aug 18 12:14:18.441762 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3492/6146] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:17 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 1429 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:18.511642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c267bf95-9937-4ab6-a197-2f42d703d203 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:18.513408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c267bf95-9937-4ab6-a197-2f42d703d203 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:18.526182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c267bf95-9937-4ab6-a197-2f42d703d203 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:18.528108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c267bf95-9937-4ab6-a197-2f42d703d203 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:18.529035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c267bf95-9937-4ab6-a197-2f42d703d203 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:18.530759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c267bf95-9937-4ab6-a197-2f42d703d203 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:18.531947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c267bf95-9937-4ab6-a197-2f42d703d203 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:18.532870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c267bf95-9937-4ab6-a197-2f42d703d203 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:18.830317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c267bf95-9937-4ab6-a197-2f42d703d203 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:18.845579 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c267bf95-9937-4ab6-a197-2f42d703d203 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1391 microversion: 2.1 time: 0.342169 Aug 18 12:14:18.846650 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3493/6147] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:18 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1391 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:18.862641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-22ac9bf9-c244-4c09-ac13-8724161c4f57 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:18.863652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-22ac9bf9-c244-4c09-ac13-8724161c4f57 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:18.876650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22ac9bf9-c244-4c09-ac13-8724161c4f57 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:18.877389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22ac9bf9-c244-4c09-ac13-8724161c4f57 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:18.878125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22ac9bf9-c244-4c09-ac13-8724161c4f57 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:18.879463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22ac9bf9-c244-4c09-ac13-8724161c4f57 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:18.880311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22ac9bf9-c244-4c09-ac13-8724161c4f57 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:18.881323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22ac9bf9-c244-4c09-ac13-8724161c4f57 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:19.099674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-22ac9bf9-c244-4c09-ac13-8724161c4f57 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:19.109008 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-22ac9bf9-c244-4c09-ac13-8724161c4f57 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1169 microversion: 2.1 time: 0.256061 Aug 18 12:14:19.109926 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3494/6148] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:18 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1169 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:19.182322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7a34fb5f-865b-44d0-abce-d46255b09e56 req-4a7c8bbb-4103-410c-8010-66be9eee008a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9046078e-c414-468b-93e2-07039eee2d23", "name": "network-vif-plugged", "status": "completed", "tag": "0832579b-4a0f-4cda-8bff-a032eceb684b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:19.197843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a34fb5f-865b-44d0-abce-d46255b09e56 req-4a7c8bbb-4103-410c-8010-66be9eee008a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:19.199181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a34fb5f-865b-44d0-abce-d46255b09e56 req-4a7c8bbb-4103-410c-8010-66be9eee008a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:19.199691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a34fb5f-865b-44d0-abce-d46255b09e56 req-4a7c8bbb-4103-410c-8010-66be9eee008a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:19.217432 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7a34fb5f-865b-44d0-abce-d46255b09e56 req-4a7c8bbb-4103-410c-8010-66be9eee008a service nova] Creating event network-vif-plugged:0832579b-4a0f-4cda-8bff-a032eceb684b for instance 9046078e-c414-468b-93e2-07039eee2d23 on n-h1-853611-3 Aug 18 12:14:19.224915 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7a34fb5f-865b-44d0-abce-d46255b09e56 req-4a7c8bbb-4103-410c-8010-66be9eee008a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046849 Aug 18 12:14:19.226218 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3495/6149] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:14:19.463878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b30dc119-f728-40fc-a2dc-00bf1e9c2a97 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:19.464591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b30dc119-f728-40fc-a2dc-00bf1e9c2a97 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:19.471473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b30dc119-f728-40fc-a2dc-00bf1e9c2a97 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:19.471940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b30dc119-f728-40fc-a2dc-00bf1e9c2a97 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:19.472433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b30dc119-f728-40fc-a2dc-00bf1e9c2a97 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:19.473224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b30dc119-f728-40fc-a2dc-00bf1e9c2a97 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:19.473730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b30dc119-f728-40fc-a2dc-00bf1e9c2a97 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:19.474209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b30dc119-f728-40fc-a2dc-00bf1e9c2a97 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:19.705591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b30dc119-f728-40fc-a2dc-00bf1e9c2a97 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbdade40dd04a09b1794f6391d8abdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e069bf3fc4d058dff03e8470908b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:19.720923 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b30dc119-f728-40fc-a2dc-00bf1e9c2a97 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 200 len: 1429 microversion: 2.1 time: 0.261527 Aug 18 12:14:19.721679 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3496/6150] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:19 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 1429 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:19.881479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-32dadce2-16e0-46f4-b5d9-7bdca8ffa65c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:19.882386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-32dadce2-16e0-46f4-b5d9-7bdca8ffa65c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:19.890591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32dadce2-16e0-46f4-b5d9-7bdca8ffa65c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:19.891295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32dadce2-16e0-46f4-b5d9-7bdca8ffa65c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:19.891976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32dadce2-16e0-46f4-b5d9-7bdca8ffa65c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:19.892797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32dadce2-16e0-46f4-b5d9-7bdca8ffa65c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:19.893435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32dadce2-16e0-46f4-b5d9-7bdca8ffa65c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:19.894024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32dadce2-16e0-46f4-b5d9-7bdca8ffa65c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:20.266905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-32dadce2-16e0-46f4-b5d9-7bdca8ffa65c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:20.275757 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-32dadce2-16e0-46f4-b5d9-7bdca8ffa65c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1391 microversion: 2.1 time: 0.398342 Aug 18 12:14:20.276391 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3497/6151] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:19 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1391 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:20.290163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f92e0fe1-1b2b-4984-93e0-c9a4c4f7a184 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:20.291127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f92e0fe1-1b2b-4984-93e0-c9a4c4f7a184 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:20.301501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f92e0fe1-1b2b-4984-93e0-c9a4c4f7a184 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:20.302397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f92e0fe1-1b2b-4984-93e0-c9a4c4f7a184 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:20.303186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f92e0fe1-1b2b-4984-93e0-c9a4c4f7a184 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:20.304508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f92e0fe1-1b2b-4984-93e0-c9a4c4f7a184 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:20.305473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f92e0fe1-1b2b-4984-93e0-c9a4c4f7a184 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:20.305982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f92e0fe1-1b2b-4984-93e0-c9a4c4f7a184 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:20.623919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f92e0fe1-1b2b-4984-93e0-c9a4c4f7a184 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:20.640478 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f92e0fe1-1b2b-4984-93e0-c9a4c4f7a184 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1169 microversion: 2.1 time: 0.355313 Aug 18 12:14:20.642107 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3498/6152] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:20 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1169 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:20.744813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a554284d-c112-41fe-a3d3-dd2059b19b7e tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:20.746218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a554284d-c112-41fe-a3d3-dd2059b19b7e tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:20.753865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a554284d-c112-41fe-a3d3-dd2059b19b7e tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:20.754547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a554284d-c112-41fe-a3d3-dd2059b19b7e tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:20.755104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a554284d-c112-41fe-a3d3-dd2059b19b7e tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:20.755934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a554284d-c112-41fe-a3d3-dd2059b19b7e tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:20.756649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a554284d-c112-41fe-a3d3-dd2059b19b7e tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:20.757248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a554284d-c112-41fe-a3d3-dd2059b19b7e tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:20.942960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:14:20.950877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a554284d-c112-41fe-a3d3-dd2059b19b7e tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbdade40dd04a09b1794f6391d8abdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e069bf3fc4d058dff03e8470908b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:20.963530 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a554284d-c112-41fe-a3d3-dd2059b19b7e tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 200 len: 1609 microversion: 2.1 time: 0.223373 Aug 18 12:14:20.963530 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3499/6153] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:20 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 1609 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:20.983582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-66793ec0-4c2b-4336-b021-bff347b908f5 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:20.984209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-66793ec0-4c2b-4336-b021-bff347b908f5 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:20.990979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66793ec0-4c2b-4336-b021-bff347b908f5 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:20.991482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66793ec0-4c2b-4336-b021-bff347b908f5 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:20.991923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66793ec0-4c2b-4336-b021-bff347b908f5 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:20.992656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66793ec0-4c2b-4336-b021-bff347b908f5 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:20.993120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66793ec0-4c2b-4336-b021-bff347b908f5 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:20.993556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66793ec0-4c2b-4336-b021-bff347b908f5 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:21.470522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-66793ec0-4c2b-4336-b021-bff347b908f5 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbdade40dd04a09b1794f6391d8abdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e069bf3fc4d058dff03e8470908b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:21.480833 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-66793ec0-4c2b-4336-b021-bff347b908f5 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 200 len: 1609 microversion: 2.1 time: 0.501137 Aug 18 12:14:21.481650 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3500/6154] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:20 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 1609 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:21.491723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3af279c2-166e-43c6-b0bd-d3b5040f4edc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:21.492932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3af279c2-166e-43c6-b0bd-d3b5040f4edc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:21.505635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3af279c2-166e-43c6-b0bd-d3b5040f4edc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:21.506555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3af279c2-166e-43c6-b0bd-d3b5040f4edc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:21.507343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3af279c2-166e-43c6-b0bd-d3b5040f4edc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:21.508581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3af279c2-166e-43c6-b0bd-d3b5040f4edc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:21.509509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3af279c2-166e-43c6-b0bd-d3b5040f4edc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:21.510231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3af279c2-166e-43c6-b0bd-d3b5040f4edc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:21.695931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3af279c2-166e-43c6-b0bd-d3b5040f4edc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:21.711728 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3af279c2-166e-43c6-b0bd-d3b5040f4edc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1391 microversion: 2.1 time: 0.227844 Aug 18 12:14:21.713497 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3501/6155] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:21 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1391 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:21.724829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a443a44b-cfb5-4dbf-ad8b-4605c0f106ec tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:21.726177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a443a44b-cfb5-4dbf-ad8b-4605c0f106ec tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:21.740218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a443a44b-cfb5-4dbf-ad8b-4605c0f106ec tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:21.741128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a443a44b-cfb5-4dbf-ad8b-4605c0f106ec tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:21.746536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a443a44b-cfb5-4dbf-ad8b-4605c0f106ec tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:21.747317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a443a44b-cfb5-4dbf-ad8b-4605c0f106ec tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:21.747857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a443a44b-cfb5-4dbf-ad8b-4605c0f106ec tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:21.748312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a443a44b-cfb5-4dbf-ad8b-4605c0f106ec tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:21.918823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a443a44b-cfb5-4dbf-ad8b-4605c0f106ec tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbdade40dd04a09b1794f6391d8abdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e069bf3fc4d058dff03e8470908b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:21.927550 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a443a44b-cfb5-4dbf-ad8b-4605c0f106ec tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 200 len: 1609 microversion: 2.1 time: 0.212298 Aug 18 12:14:21.928289 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3502/6156] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:21 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 1609 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:21.934468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5831616a-9d90-49a6-8234-7acf3e801b8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:21.935138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5831616a-9d90-49a6-8234-7acf3e801b8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:21.942908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5831616a-9d90-49a6-8234-7acf3e801b8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:21.943714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5831616a-9d90-49a6-8234-7acf3e801b8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:21.944157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5831616a-9d90-49a6-8234-7acf3e801b8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:21.945095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5831616a-9d90-49a6-8234-7acf3e801b8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:21.945568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5831616a-9d90-49a6-8234-7acf3e801b8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:21.946078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5831616a-9d90-49a6-8234-7acf3e801b8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:22.182277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5831616a-9d90-49a6-8234-7acf3e801b8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:22.198798 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5831616a-9d90-49a6-8234-7acf3e801b8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1169 microversion: 2.1 time: 0.269127 Aug 18 12:14:22.213310 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3503/6157] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:21 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1169 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:22.751757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-75fc9686-4e15-445d-80f7-f34cad9621f0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:22.754400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-75fc9686-4e15-445d-80f7-f34cad9621f0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:22.761540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=36 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:14:22.767706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75fc9686-4e15-445d-80f7-f34cad9621f0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:22.769239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75fc9686-4e15-445d-80f7-f34cad9621f0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:22.770397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75fc9686-4e15-445d-80f7-f34cad9621f0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:22.772309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75fc9686-4e15-445d-80f7-f34cad9621f0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:22.773671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75fc9686-4e15-445d-80f7-f34cad9621f0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:22.776437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75fc9686-4e15-445d-80f7-f34cad9621f0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:23.173329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-75fc9686-4e15-445d-80f7-f34cad9621f0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:23.195003 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-75fc9686-4e15-445d-80f7-f34cad9621f0 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1391 microversion: 2.1 time: 0.451173 Aug 18 12:14:23.196985 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3504/6158] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:22 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1391 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:23.226858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-810a49ae-ac43-43e3-b842-e1ebeea3b5ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:23.230313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-810a49ae-ac43-43e3-b842-e1ebeea3b5ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:23.242070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-810a49ae-ac43-43e3-b842-e1ebeea3b5ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:23.245522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-810a49ae-ac43-43e3-b842-e1ebeea3b5ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:23.246502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-810a49ae-ac43-43e3-b842-e1ebeea3b5ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:23.248815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-810a49ae-ac43-43e3-b842-e1ebeea3b5ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:23.250222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-810a49ae-ac43-43e3-b842-e1ebeea3b5ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:23.251278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-810a49ae-ac43-43e3-b842-e1ebeea3b5ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:23.574184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-810a49ae-ac43-43e3-b842-e1ebeea3b5ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:23.587893 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-810a49ae-ac43-43e3-b842-e1ebeea3b5ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1169 microversion: 2.1 time: 0.369556 Aug 18 12:14:23.588765 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3505/6159] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:23 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1169 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:24.228894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8bfee9b-558f-409f-8e8c-9fd01c240254 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:24.231467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e8bfee9b-558f-409f-8e8c-9fd01c240254 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:24.246124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8bfee9b-558f-409f-8e8c-9fd01c240254 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:24.247578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8bfee9b-558f-409f-8e8c-9fd01c240254 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:24.248382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8bfee9b-558f-409f-8e8c-9fd01c240254 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:24.250309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8bfee9b-558f-409f-8e8c-9fd01c240254 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:24.251264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8bfee9b-558f-409f-8e8c-9fd01c240254 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:24.252836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8bfee9b-558f-409f-8e8c-9fd01c240254 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:24.611148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e8bfee9b-558f-409f-8e8c-9fd01c240254 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:24.615221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:14:24.623450 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e8bfee9b-558f-409f-8e8c-9fd01c240254 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1391 microversion: 2.1 time: 0.401751 Aug 18 12:14:24.624501 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3506/6160] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:24 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1391 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:24.629678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-db04f05b-6205-4341-9eb8-fab719dac675 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:24.630751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-db04f05b-6205-4341-9eb8-fab719dac675 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:24.638906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db04f05b-6205-4341-9eb8-fab719dac675 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:24.640041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db04f05b-6205-4341-9eb8-fab719dac675 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:24.640787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db04f05b-6205-4341-9eb8-fab719dac675 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:24.641816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db04f05b-6205-4341-9eb8-fab719dac675 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:24.642817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db04f05b-6205-4341-9eb8-fab719dac675 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:24.643544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-db04f05b-6205-4341-9eb8-fab719dac675 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:24.951597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-db04f05b-6205-4341-9eb8-fab719dac675 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:24.961468 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-db04f05b-6205-4341-9eb8-fab719dac675 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1169 microversion: 2.1 time: 0.335515 Aug 18 12:14:24.964201 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3507/6161] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:24 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1169 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:24.968533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-29209f47-6886-44ab-976f-4e53fcb2887e req-2e51fc33-9645-4e0e-9fe9-a589bb66c430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a9b252c-618b-4ec9-b518-3bebbf1d0a30", "name": "network-vif-plugged", "status": "completed", "tag": "0b1f6e7a-181a-4fdd-bbaf-18537ead2b5c"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:24.980361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-29209f47-6886-44ab-976f-4e53fcb2887e req-2e51fc33-9645-4e0e-9fe9-a589bb66c430 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:24.980877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-29209f47-6886-44ab-976f-4e53fcb2887e req-2e51fc33-9645-4e0e-9fe9-a589bb66c430 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:24.981314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-29209f47-6886-44ab-976f-4e53fcb2887e req-2e51fc33-9645-4e0e-9fe9-a589bb66c430 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:24.995454 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-29209f47-6886-44ab-976f-4e53fcb2887e req-2e51fc33-9645-4e0e-9fe9-a589bb66c430 service nova] Creating event network-vif-plugged:0b1f6e7a-181a-4fdd-bbaf-18537ead2b5c for instance 2a9b252c-618b-4ec9-b518-3bebbf1d0a30 on n-h2-853611-3 Aug 18 12:14:25.011173 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-29209f47-6886-44ab-976f-4e53fcb2887e req-2e51fc33-9645-4e0e-9fe9-a589bb66c430 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045933 Aug 18 12:14:25.012586 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3508/6162] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:25.662194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-30f9059f-366f-4d6d-a57b-b639c33bba02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:25.663785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-30f9059f-366f-4d6d-a57b-b639c33bba02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:25.673042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30f9059f-366f-4d6d-a57b-b639c33bba02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:25.673899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30f9059f-366f-4d6d-a57b-b639c33bba02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:25.674660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30f9059f-366f-4d6d-a57b-b639c33bba02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:25.675714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30f9059f-366f-4d6d-a57b-b639c33bba02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:25.676458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30f9059f-366f-4d6d-a57b-b639c33bba02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:25.677134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30f9059f-366f-4d6d-a57b-b639c33bba02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:26.315354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-30f9059f-366f-4d6d-a57b-b639c33bba02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:26.366771 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-30f9059f-366f-4d6d-a57b-b639c33bba02 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1391 microversion: 2.1 time: 0.708562 Aug 18 12:14:26.369078 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3509/6163] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:25 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1391 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:26.377972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cb95507e-562c-4eda-89b0-bf40628e5c92 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:26.379110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cb95507e-562c-4eda-89b0-bf40628e5c92 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:26.390930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb95507e-562c-4eda-89b0-bf40628e5c92 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:26.391629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb95507e-562c-4eda-89b0-bf40628e5c92 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:26.392230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb95507e-562c-4eda-89b0-bf40628e5c92 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:26.393014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb95507e-562c-4eda-89b0-bf40628e5c92 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:26.393718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb95507e-562c-4eda-89b0-bf40628e5c92 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:26.394351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb95507e-562c-4eda-89b0-bf40628e5c92 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:26.651240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cb95507e-562c-4eda-89b0-bf40628e5c92 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:26.663119 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cb95507e-562c-4eda-89b0-bf40628e5c92 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1169 microversion: 2.1 time: 0.292120 Aug 18 12:14:26.677538 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3510/6164] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:26 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1169 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:26.677538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c3a7b91d-8a8b-4571-bf0f-28987b06b1b1 req-68d4e6d4-8e57-42b1-bdaa-4fea0b83b26d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9046078e-c414-468b-93e2-07039eee2d23", "tag": "0832579b-4a0f-4cda-8bff-a032eceb684b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:26.698489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c3a7b91d-8a8b-4571-bf0f-28987b06b1b1 req-68d4e6d4-8e57-42b1-bdaa-4fea0b83b26d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:26.699464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c3a7b91d-8a8b-4571-bf0f-28987b06b1b1 req-68d4e6d4-8e57-42b1-bdaa-4fea0b83b26d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:26.701112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c3a7b91d-8a8b-4571-bf0f-28987b06b1b1 req-68d4e6d4-8e57-42b1-bdaa-4fea0b83b26d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:26.729076 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c3a7b91d-8a8b-4571-bf0f-28987b06b1b1 req-68d4e6d4-8e57-42b1-bdaa-4fea0b83b26d service nova] Creating event network-changed:0832579b-4a0f-4cda-8bff-a032eceb684b for instance 9046078e-c414-468b-93e2-07039eee2d23 on n-h1-853611-3 Aug 18 12:14:26.735618 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c3a7b91d-8a8b-4571-bf0f-28987b06b1b1 req-68d4e6d4-8e57-42b1-bdaa-4fea0b83b26d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068773 Aug 18 12:14:26.736275 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3511/6165] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:27.401922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ba3e956-9882-4002-b517-0af0a3d1fc65 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:27.404073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9ba3e956-9882-4002-b517-0af0a3d1fc65 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:27.417246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ba3e956-9882-4002-b517-0af0a3d1fc65 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:27.418702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ba3e956-9882-4002-b517-0af0a3d1fc65 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:27.419923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ba3e956-9882-4002-b517-0af0a3d1fc65 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:27.421676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ba3e956-9882-4002-b517-0af0a3d1fc65 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:27.422914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ba3e956-9882-4002-b517-0af0a3d1fc65 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:27.424250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ba3e956-9882-4002-b517-0af0a3d1fc65 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:27.703535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9ba3e956-9882-4002-b517-0af0a3d1fc65 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:27.715537 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9ba3e956-9882-4002-b517-0af0a3d1fc65 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1562 microversion: 2.1 time: 0.328269 Aug 18 12:14:27.717146 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3512/6166] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:27 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1562 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:27.730403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-304bab30-e5fb-4c7a-9d83-98a8bc92c85f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:27.731446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-304bab30-e5fb-4c7a-9d83-98a8bc92c85f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:27.739025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-304bab30-e5fb-4c7a-9d83-98a8bc92c85f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:27.739878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-304bab30-e5fb-4c7a-9d83-98a8bc92c85f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:27.740585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-304bab30-e5fb-4c7a-9d83-98a8bc92c85f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:27.741688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-304bab30-e5fb-4c7a-9d83-98a8bc92c85f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:27.743472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-304bab30-e5fb-4c7a-9d83-98a8bc92c85f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:27.744214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-304bab30-e5fb-4c7a-9d83-98a8bc92c85f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:27.976299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-304bab30-e5fb-4c7a-9d83-98a8bc92c85f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:27.992743 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-304bab30-e5fb-4c7a-9d83-98a8bc92c85f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1215 microversion: 2.1 time: 0.273032 Aug 18 12:14:27.994655 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3513/6167] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:27 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1215 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:28.013503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bd3d55c0-cede-41be-99f8-66fea900fb03 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:28.014850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bd3d55c0-cede-41be-99f8-66fea900fb03 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:28.026417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd3d55c0-cede-41be-99f8-66fea900fb03 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:28.027375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd3d55c0-cede-41be-99f8-66fea900fb03 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:28.028089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd3d55c0-cede-41be-99f8-66fea900fb03 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:28.029407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd3d55c0-cede-41be-99f8-66fea900fb03 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:28.030321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd3d55c0-cede-41be-99f8-66fea900fb03 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:28.031216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd3d55c0-cede-41be-99f8-66fea900fb03 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:28.217143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bd3d55c0-cede-41be-99f8-66fea900fb03 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:28.232606 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bd3d55c0-cede-41be-99f8-66fea900fb03 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1562 microversion: 2.1 time: 0.235852 Aug 18 12:14:28.233721 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3514/6168] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:27 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1562 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:29.017173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ffe4646e-8caf-40b0-bcd3-bb23135e3dea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:29.018140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ffe4646e-8caf-40b0-bcd3-bb23135e3dea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:29.031709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ffe4646e-8caf-40b0-bcd3-bb23135e3dea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:29.032533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ffe4646e-8caf-40b0-bcd3-bb23135e3dea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:29.032979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ffe4646e-8caf-40b0-bcd3-bb23135e3dea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:29.033926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ffe4646e-8caf-40b0-bcd3-bb23135e3dea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:29.034644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ffe4646e-8caf-40b0-bcd3-bb23135e3dea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:29.035078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ffe4646e-8caf-40b0-bcd3-bb23135e3dea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:29.354380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ffe4646e-8caf-40b0-bcd3-bb23135e3dea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:29.364962 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ffe4646e-8caf-40b0-bcd3-bb23135e3dea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1203 microversion: 2.1 time: 0.352014 Aug 18 12:14:29.365902 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3515/6169] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:29 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1203 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:30.389904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ea6bdcc9-ab8b-4f8f-9158-8397f2e64207 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:30.391133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ea6bdcc9-ab8b-4f8f-9158-8397f2e64207 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:30.401965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea6bdcc9-ab8b-4f8f-9158-8397f2e64207 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:30.402705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea6bdcc9-ab8b-4f8f-9158-8397f2e64207 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:30.403309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea6bdcc9-ab8b-4f8f-9158-8397f2e64207 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:30.404491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea6bdcc9-ab8b-4f8f-9158-8397f2e64207 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:30.405238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea6bdcc9-ab8b-4f8f-9158-8397f2e64207 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:30.405977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea6bdcc9-ab8b-4f8f-9158-8397f2e64207 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:30.645779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ea6bdcc9-ab8b-4f8f-9158-8397f2e64207 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:30.660874 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ea6bdcc9-ab8b-4f8f-9158-8397f2e64207 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1203 microversion: 2.1 time: 0.276423 Aug 18 12:14:30.661801 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3516/6170] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:30 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1203 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:30.809838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-40598c57-c4e3-415f-9dbf-1e85f72cfc95 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:30.810688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-40598c57-c4e3-415f-9dbf-1e85f72cfc95 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:30.818096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-40598c57-c4e3-415f-9dbf-1e85f72cfc95 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:30.818709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-40598c57-c4e3-415f-9dbf-1e85f72cfc95 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:30.819589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-40598c57-c4e3-415f-9dbf-1e85f72cfc95 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:30.821280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-40598c57-c4e3-415f-9dbf-1e85f72cfc95 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:30.821759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-40598c57-c4e3-415f-9dbf-1e85f72cfc95 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:30.822199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-40598c57-c4e3-415f-9dbf-1e85f72cfc95 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:31.017073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-40598c57-c4e3-415f-9dbf-1e85f72cfc95 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:31.026293 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-40598c57-c4e3-415f-9dbf-1e85f72cfc95 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1562 microversion: 2.1 time: 0.221918 Aug 18 12:14:31.027046 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3517/6171] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:30 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1562 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:31.032496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4fdacff1-992e-4727-8e22-f0941ae27c7b req-b2ea3a0d-dc45-4bd9-ba11-d97ae146d437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a9b252c-618b-4ec9-b518-3bebbf1d0a30", "tag": "0b1f6e7a-181a-4fdd-bbaf-18537ead2b5c"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:31.044038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4fdacff1-992e-4727-8e22-f0941ae27c7b req-b2ea3a0d-dc45-4bd9-ba11-d97ae146d437 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:31.045084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4fdacff1-992e-4727-8e22-f0941ae27c7b req-b2ea3a0d-dc45-4bd9-ba11-d97ae146d437 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:31.045783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4fdacff1-992e-4727-8e22-f0941ae27c7b req-b2ea3a0d-dc45-4bd9-ba11-d97ae146d437 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:31.060335 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4fdacff1-992e-4727-8e22-f0941ae27c7b req-b2ea3a0d-dc45-4bd9-ba11-d97ae146d437 service nova] Creating event network-changed:0b1f6e7a-181a-4fdd-bbaf-18537ead2b5c for instance 2a9b252c-618b-4ec9-b518-3bebbf1d0a30 on n-h2-853611-3 Aug 18 12:14:31.066577 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4fdacff1-992e-4727-8e22-f0941ae27c7b req-b2ea3a0d-dc45-4bd9-ba11-d97ae146d437 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037909 Aug 18 12:14:31.070884 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3518/6172] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:31.691799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-096d8210-1a62-401d-b056-a952639c4fd7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:31.692789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-096d8210-1a62-401d-b056-a952639c4fd7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:31.700610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-096d8210-1a62-401d-b056-a952639c4fd7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:31.701061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-096d8210-1a62-401d-b056-a952639c4fd7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:31.701522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-096d8210-1a62-401d-b056-a952639c4fd7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:31.702269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-096d8210-1a62-401d-b056-a952639c4fd7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:31.703244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-096d8210-1a62-401d-b056-a952639c4fd7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:31.704260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-096d8210-1a62-401d-b056-a952639c4fd7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:31.991189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-096d8210-1a62-401d-b056-a952639c4fd7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:32.001864 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-096d8210-1a62-401d-b056-a952639c4fd7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1203 microversion: 2.1 time: 0.320973 Aug 18 12:14:32.002533 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3519/6173] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:31 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1203 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:33.024375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e37c76b-ccf1-47e5-a2a7-fe8a303aa453 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:33.025459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2e37c76b-ccf1-47e5-a2a7-fe8a303aa453 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:33.034111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e37c76b-ccf1-47e5-a2a7-fe8a303aa453 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:33.034764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e37c76b-ccf1-47e5-a2a7-fe8a303aa453 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:33.035213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e37c76b-ccf1-47e5-a2a7-fe8a303aa453 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:33.036029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e37c76b-ccf1-47e5-a2a7-fe8a303aa453 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:33.036634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e37c76b-ccf1-47e5-a2a7-fe8a303aa453 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:33.037071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e37c76b-ccf1-47e5-a2a7-fe8a303aa453 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:33.225867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2e37c76b-ccf1-47e5-a2a7-fe8a303aa453 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:33.240735 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2e37c76b-ccf1-47e5-a2a7-fe8a303aa453 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1203 microversion: 2.1 time: 0.220254 Aug 18 12:14:33.243718 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3520/6174] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:33 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1203 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:34.265118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3f6266af-0025-4e6c-9aef-5b5dd77169b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:34.266163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3f6266af-0025-4e6c-9aef-5b5dd77169b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:34.274058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f6266af-0025-4e6c-9aef-5b5dd77169b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:34.274595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f6266af-0025-4e6c-9aef-5b5dd77169b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:34.275048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f6266af-0025-4e6c-9aef-5b5dd77169b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:34.275788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f6266af-0025-4e6c-9aef-5b5dd77169b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:34.276253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f6266af-0025-4e6c-9aef-5b5dd77169b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:34.276683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f6266af-0025-4e6c-9aef-5b5dd77169b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:34.433944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3f6266af-0025-4e6c-9aef-5b5dd77169b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:34.442035 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3f6266af-0025-4e6c-9aef-5b5dd77169b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1203 microversion: 2.1 time: 0.181051 Aug 18 12:14:34.442681 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3521/6175] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:34 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1203 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:35.465055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab1ad6a9-8ba2-4c87-90bd-43ce9515b389 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:35.465934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ab1ad6a9-8ba2-4c87-90bd-43ce9515b389 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:35.474216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab1ad6a9-8ba2-4c87-90bd-43ce9515b389 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:35.475542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab1ad6a9-8ba2-4c87-90bd-43ce9515b389 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:35.476141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab1ad6a9-8ba2-4c87-90bd-43ce9515b389 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:35.477131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab1ad6a9-8ba2-4c87-90bd-43ce9515b389 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:35.477752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab1ad6a9-8ba2-4c87-90bd-43ce9515b389 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:35.478297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab1ad6a9-8ba2-4c87-90bd-43ce9515b389 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:35.628315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ab1ad6a9-8ba2-4c87-90bd-43ce9515b389 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:35.637255 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab1ad6a9-8ba2-4c87-90bd-43ce9515b389 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1203 microversion: 2.1 time: 0.176568 Aug 18 12:14:35.637936 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3522/6176] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:35 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1203 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:36.660891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-71c56b57-bdf1-45a6-af8c-fca02a887356 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:36.662040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-71c56b57-bdf1-45a6-af8c-fca02a887356 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:36.673190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71c56b57-bdf1-45a6-af8c-fca02a887356 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:36.673933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71c56b57-bdf1-45a6-af8c-fca02a887356 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:36.674786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71c56b57-bdf1-45a6-af8c-fca02a887356 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:36.675617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71c56b57-bdf1-45a6-af8c-fca02a887356 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:36.676156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71c56b57-bdf1-45a6-af8c-fca02a887356 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:36.676664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71c56b57-bdf1-45a6-af8c-fca02a887356 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:36.899702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-71c56b57-bdf1-45a6-af8c-fca02a887356 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:36.909568 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-71c56b57-bdf1-45a6-af8c-fca02a887356 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1203 microversion: 2.1 time: 0.253539 Aug 18 12:14:36.910274 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3523/6177] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:36 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1203 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:37.940197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-43396857-ba5c-40c2-a6f9-d228a267f24e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:37.940882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-43396857-ba5c-40c2-a6f9-d228a267f24e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:37.950100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43396857-ba5c-40c2-a6f9-d228a267f24e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:37.950643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43396857-ba5c-40c2-a6f9-d228a267f24e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:37.951096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43396857-ba5c-40c2-a6f9-d228a267f24e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:37.951849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43396857-ba5c-40c2-a6f9-d228a267f24e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:37.952323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43396857-ba5c-40c2-a6f9-d228a267f24e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:37.952761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43396857-ba5c-40c2-a6f9-d228a267f24e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:38.120811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-43396857-ba5c-40c2-a6f9-d228a267f24e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:38.129202 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-43396857-ba5c-40c2-a6f9-d228a267f24e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1203 microversion: 2.1 time: 0.192893 Aug 18 12:14:38.129773 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3524/6178] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:37 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1203 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:38.733968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c7e2d4df-99ff-4d69-b47a-1b17a3d4a02d req-f2bb3f3a-2fb4-423e-bd04-3569d5a5310e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abeb19bf-12f7-4554-b73d-e1684be54287", "name": "network-vif-plugged", "status": "completed", "tag": "fd01487b-e0dc-47f9-92ab-1a00ba1b12e4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:38.752862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c7e2d4df-99ff-4d69-b47a-1b17a3d4a02d req-f2bb3f3a-2fb4-423e-bd04-3569d5a5310e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:38.753647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c7e2d4df-99ff-4d69-b47a-1b17a3d4a02d req-f2bb3f3a-2fb4-423e-bd04-3569d5a5310e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:38.754410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c7e2d4df-99ff-4d69-b47a-1b17a3d4a02d req-f2bb3f3a-2fb4-423e-bd04-3569d5a5310e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:38.778802 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c7e2d4df-99ff-4d69-b47a-1b17a3d4a02d req-f2bb3f3a-2fb4-423e-bd04-3569d5a5310e service nova] Creating event network-vif-plugged:fd01487b-e0dc-47f9-92ab-1a00ba1b12e4 for instance abeb19bf-12f7-4554-b73d-e1684be54287 on n-h2-853611-3 Aug 18 12:14:38.788813 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c7e2d4df-99ff-4d69-b47a-1b17a3d4a02d req-f2bb3f3a-2fb4-423e-bd04-3569d5a5310e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062184 Aug 18 12:14:38.789934 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3525/6179] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:14:39.153754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e27ce567-c658-4abb-8d0d-ec4807f520fe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:39.154603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e27ce567-c658-4abb-8d0d-ec4807f520fe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:39.161372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e27ce567-c658-4abb-8d0d-ec4807f520fe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:39.162094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e27ce567-c658-4abb-8d0d-ec4807f520fe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:39.162683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e27ce567-c658-4abb-8d0d-ec4807f520fe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:39.163440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e27ce567-c658-4abb-8d0d-ec4807f520fe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:39.164888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e27ce567-c658-4abb-8d0d-ec4807f520fe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:39.165321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e27ce567-c658-4abb-8d0d-ec4807f520fe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:39.170221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:14:39.665639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e27ce567-c658-4abb-8d0d-ec4807f520fe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:39.675769 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e27ce567-c658-4abb-8d0d-ec4807f520fe tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1203 microversion: 2.1 time: 0.527083 Aug 18 12:14:39.676638 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3526/6180] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:39 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1203 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:40.705483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-451c5e53-eca2-4593-8879-dc393417c486 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:40.706293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-451c5e53-eca2-4593-8879-dc393417c486 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:40.719844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-451c5e53-eca2-4593-8879-dc393417c486 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:40.720719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-451c5e53-eca2-4593-8879-dc393417c486 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:40.723503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-451c5e53-eca2-4593-8879-dc393417c486 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:40.723503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-451c5e53-eca2-4593-8879-dc393417c486 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:40.724275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-451c5e53-eca2-4593-8879-dc393417c486 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:40.724729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-451c5e53-eca2-4593-8879-dc393417c486 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:40.924413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-451c5e53-eca2-4593-8879-dc393417c486 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:40.934285 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-451c5e53-eca2-4593-8879-dc393417c486 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1390 microversion: 2.1 time: 0.236574 Aug 18 12:14:40.935173 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3527/6181] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:40 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1390 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:40.956716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0d8ad588-987c-489b-8991-83c281d99b3a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:40.957350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0d8ad588-987c-489b-8991-83c281d99b3a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:40.965542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d8ad588-987c-489b-8991-83c281d99b3a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:40.966287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d8ad588-987c-489b-8991-83c281d99b3a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:40.966955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d8ad588-987c-489b-8991-83c281d99b3a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:40.967812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d8ad588-987c-489b-8991-83c281d99b3a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:40.968401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d8ad588-987c-489b-8991-83c281d99b3a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:40.969017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d8ad588-987c-489b-8991-83c281d99b3a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:41.164304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0d8ad588-987c-489b-8991-83c281d99b3a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:41.179756 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0d8ad588-987c-489b-8991-83c281d99b3a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1390 microversion: 2.1 time: 0.226569 Aug 18 12:14:41.182170 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3528/6182] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:40 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1390 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:41.218721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03d4c8a7-4dec-44f9-b4c9-83f3d8598a84 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:41.219848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-03d4c8a7-4dec-44f9-b4c9-83f3d8598a84 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:41.230929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03d4c8a7-4dec-44f9-b4c9-83f3d8598a84 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:41.231678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03d4c8a7-4dec-44f9-b4c9-83f3d8598a84 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:41.232351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03d4c8a7-4dec-44f9-b4c9-83f3d8598a84 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:41.233451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03d4c8a7-4dec-44f9-b4c9-83f3d8598a84 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:41.234158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03d4c8a7-4dec-44f9-b4c9-83f3d8598a84 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:41.234848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03d4c8a7-4dec-44f9-b4c9-83f3d8598a84 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:41.421943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-03d4c8a7-4dec-44f9-b4c9-83f3d8598a84 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:41.431745 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-03d4c8a7-4dec-44f9-b4c9-83f3d8598a84 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1390 microversion: 2.1 time: 0.220310 Aug 18 12:14:41.432260 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3529/6183] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:41 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1390 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:41.522560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c2c3fcb9-b1ee-45d5-ab1b-899c4ab02f20 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:41.523082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c2c3fcb9-b1ee-45d5-ab1b-899c4ab02f20 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:41.529704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c3fcb9-b1ee-45d5-ab1b-899c4ab02f20 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:41.530201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c3fcb9-b1ee-45d5-ab1b-899c4ab02f20 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:41.530687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c3fcb9-b1ee-45d5-ab1b-899c4ab02f20 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:41.531417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c3fcb9-b1ee-45d5-ab1b-899c4ab02f20 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:41.531892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c3fcb9-b1ee-45d5-ab1b-899c4ab02f20 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:41.532325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c2c3fcb9-b1ee-45d5-ab1b-899c4ab02f20 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:41.562904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c2c3fcb9-b1ee-45d5-ab1b-899c4ab02f20 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:14:41.655212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:14:41.688764 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c2c3fcb9-b1ee-45d5-ab1b-899c4ab02f20 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "DELETE /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 204 len: 0 microversion: 2.1 time: 0.170385 Aug 18 12:14:41.689772 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3530/6184] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:14:41 2022] DELETE /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:14:41.706626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bed0bc64-ba53-42eb-9dcd-a838da83764f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:41.708029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bed0bc64-ba53-42eb-9dcd-a838da83764f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:41.721266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bed0bc64-ba53-42eb-9dcd-a838da83764f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:41.722156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bed0bc64-ba53-42eb-9dcd-a838da83764f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:41.722994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bed0bc64-ba53-42eb-9dcd-a838da83764f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:41.725111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bed0bc64-ba53-42eb-9dcd-a838da83764f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:41.726347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bed0bc64-ba53-42eb-9dcd-a838da83764f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:41.727387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bed0bc64-ba53-42eb-9dcd-a838da83764f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:41.896594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bed0bc64-ba53-42eb-9dcd-a838da83764f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:41.913038 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bed0bc64-ba53-42eb-9dcd-a838da83764f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1396 microversion: 2.1 time: 0.215107 Aug 18 12:14:41.914269 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3531/6185] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:41 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1396 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:42.935521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-242deb1b-c95c-4259-b8f6-baa06dcc67a9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:42.936306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-242deb1b-c95c-4259-b8f6-baa06dcc67a9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:42.944322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-242deb1b-c95c-4259-b8f6-baa06dcc67a9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:42.944906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-242deb1b-c95c-4259-b8f6-baa06dcc67a9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:42.945360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-242deb1b-c95c-4259-b8f6-baa06dcc67a9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:42.946096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-242deb1b-c95c-4259-b8f6-baa06dcc67a9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:42.946606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-242deb1b-c95c-4259-b8f6-baa06dcc67a9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:42.947058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-242deb1b-c95c-4259-b8f6-baa06dcc67a9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:43.111989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-242deb1b-c95c-4259-b8f6-baa06dcc67a9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:43.121722 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-242deb1b-c95c-4259-b8f6-baa06dcc67a9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1396 microversion: 2.1 time: 0.190125 Aug 18 12:14:43.122335 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3532/6186] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:42 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1396 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:43.781311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a010d1ea-4fa9-4c44-9152-a53a61aa4955 req-f846b2d0-8bd4-4718-8c5f-e4c970346a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abeb19bf-12f7-4554-b73d-e1684be54287", "name": "network-vif-deleted", "tag": "fd01487b-e0dc-47f9-92ab-1a00ba1b12e4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:43.801057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a010d1ea-4fa9-4c44-9152-a53a61aa4955 req-f846b2d0-8bd4-4718-8c5f-e4c970346a26 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:43.802707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a010d1ea-4fa9-4c44-9152-a53a61aa4955 req-f846b2d0-8bd4-4718-8c5f-e4c970346a26 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:43.803700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a010d1ea-4fa9-4c44-9152-a53a61aa4955 req-f846b2d0-8bd4-4718-8c5f-e4c970346a26 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:43.830941 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a010d1ea-4fa9-4c44-9152-a53a61aa4955 req-f846b2d0-8bd4-4718-8c5f-e4c970346a26 service nova] Creating event network-vif-deleted:fd01487b-e0dc-47f9-92ab-1a00ba1b12e4 for instance abeb19bf-12f7-4554-b73d-e1684be54287 on n-h2-853611-3 Aug 18 12:14:43.841310 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a010d1ea-4fa9-4c44-9152-a53a61aa4955 req-f846b2d0-8bd4-4718-8c5f-e4c970346a26 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067849 Aug 18 12:14:43.843209 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3533/6187] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:14:44.149709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ce0d3911-25ba-4895-b220-969ee1d02112 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:44.151191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ce0d3911-25ba-4895-b220-969ee1d02112 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:44.165246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce0d3911-25ba-4895-b220-969ee1d02112 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:44.166059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce0d3911-25ba-4895-b220-969ee1d02112 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:44.166907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce0d3911-25ba-4895-b220-969ee1d02112 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:44.168219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce0d3911-25ba-4895-b220-969ee1d02112 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:44.169064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce0d3911-25ba-4895-b220-969ee1d02112 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:44.169853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce0d3911-25ba-4895-b220-969ee1d02112 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:44.275070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ce0d3911-25ba-4895-b220-969ee1d02112 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:44.289870 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ce0d3911-25ba-4895-b220-969ee1d02112 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1188 microversion: 2.1 time: 0.148399 Aug 18 12:14:44.290984 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3534/6188] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:44 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1188 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:14:45.323941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a79a5a5b-bbdc-4454-96c7-908c4de6c26a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:45.324813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a79a5a5b-bbdc-4454-96c7-908c4de6c26a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:45.332814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a79a5a5b-bbdc-4454-96c7-908c4de6c26a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:45.333318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a79a5a5b-bbdc-4454-96c7-908c4de6c26a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:45.333773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a79a5a5b-bbdc-4454-96c7-908c4de6c26a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:45.334543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a79a5a5b-bbdc-4454-96c7-908c4de6c26a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:45.335017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a79a5a5b-bbdc-4454-96c7-908c4de6c26a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:45.335450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a79a5a5b-bbdc-4454-96c7-908c4de6c26a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:45.425567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a79a5a5b-bbdc-4454-96c7-908c4de6c26a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:45.435615 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a79a5a5b-bbdc-4454-96c7-908c4de6c26a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1188 microversion: 2.1 time: 0.115548 Aug 18 12:14:45.436336 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3535/6189] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:45 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1188 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:46.458272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-07bf15ef-d328-4242-bbfe-f5cd5477f2d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:46.459578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-07bf15ef-d328-4242-bbfe-f5cd5477f2d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:46.468754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07bf15ef-d328-4242-bbfe-f5cd5477f2d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:46.469269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07bf15ef-d328-4242-bbfe-f5cd5477f2d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:46.469722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07bf15ef-d328-4242-bbfe-f5cd5477f2d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:46.470637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07bf15ef-d328-4242-bbfe-f5cd5477f2d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:46.470989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07bf15ef-d328-4242-bbfe-f5cd5477f2d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:46.471432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07bf15ef-d328-4242-bbfe-f5cd5477f2d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:46.569989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-07bf15ef-d328-4242-bbfe-f5cd5477f2d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:46.579905 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-07bf15ef-d328-4242-bbfe-f5cd5477f2d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1188 microversion: 2.1 time: 0.125708 Aug 18 12:14:46.580774 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3536/6190] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:46 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1188 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:47.618496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cbdfcbd9-11c1-4bea-98f7-91bcb1ef7549 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:47.619646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cbdfcbd9-11c1-4bea-98f7-91bcb1ef7549 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:47.633479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbdfcbd9-11c1-4bea-98f7-91bcb1ef7549 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:47.634359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbdfcbd9-11c1-4bea-98f7-91bcb1ef7549 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:47.635183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbdfcbd9-11c1-4bea-98f7-91bcb1ef7549 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:47.636489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbdfcbd9-11c1-4bea-98f7-91bcb1ef7549 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:47.637345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbdfcbd9-11c1-4bea-98f7-91bcb1ef7549 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:47.638144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbdfcbd9-11c1-4bea-98f7-91bcb1ef7549 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:47.744711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cbdfcbd9-11c1-4bea-98f7-91bcb1ef7549 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:47.759610 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cbdfcbd9-11c1-4bea-98f7-91bcb1ef7549 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1188 microversion: 2.1 time: 0.149217 Aug 18 12:14:47.761640 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3537/6191] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:47 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1188 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:48.803403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-96835d73-97c0-4124-bf85-60690b48f0b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:48.804559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-96835d73-97c0-4124-bf85-60690b48f0b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:48.821520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96835d73-97c0-4124-bf85-60690b48f0b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:48.822352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96835d73-97c0-4124-bf85-60690b48f0b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:48.823227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96835d73-97c0-4124-bf85-60690b48f0b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:48.824409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96835d73-97c0-4124-bf85-60690b48f0b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:48.826909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96835d73-97c0-4124-bf85-60690b48f0b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:48.828561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96835d73-97c0-4124-bf85-60690b48f0b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:48.921701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96835d73-97c0-4124-bf85-60690b48f0b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:48.924056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96835d73-97c0-4124-bf85-60690b48f0b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:48.927655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96835d73-97c0-4124-bf85-60690b48f0b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:48.928924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-96835d73-97c0-4124-bf85-60690b48f0b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lazy-loading 'fault' on Instance uuid abeb19bf-12f7-4554-b73d-e1684be54287 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:14:49.045786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-96835d73-97c0-4124-bf85-60690b48f0b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:14:49.073625 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-96835d73-97c0-4124-bf85-60690b48f0b8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 200 len: 1193 microversion: 2.1 time: 0.279934 Aug 18 12:14:49.077546 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3538/6192] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:48 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 1193 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:14:50.109638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-61e8c546-cdc6-4966-8cfc-f8c67c43b727 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:50.112129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-61e8c546-cdc6-4966-8cfc-f8c67c43b727 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:50.125991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61e8c546-cdc6-4966-8cfc-f8c67c43b727 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:50.127236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61e8c546-cdc6-4966-8cfc-f8c67c43b727 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:50.129062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61e8c546-cdc6-4966-8cfc-f8c67c43b727 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:50.130569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61e8c546-cdc6-4966-8cfc-f8c67c43b727 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:50.131777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61e8c546-cdc6-4966-8cfc-f8c67c43b727 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:50.132785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-61e8c546-cdc6-4966-8cfc-f8c67c43b727 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:50.166529 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-61e8c546-cdc6-4966-8cfc-f8c67c43b727 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-61e8c546-cdc6-4966-8cfc-f8c67c43b727 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 HTTP/1.1 Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'abeb19bf-12f7-4554-b73d-e1684be54287'} Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:50.169722 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:50.178998 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:50.178998 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:50.178998 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:50.178998 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:14:50.178998 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:14:50.178998 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:50.178998 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:50.178998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-61e8c546-cdc6-4966-8cfc-f8c67c43b727 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:14:50.178998 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-61e8c546-cdc6-4966-8cfc-f8c67c43b727 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 404 len: 111 microversion: 2.1 time: 0.068238 Aug 18 12:14:50.178998 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3539/6193] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:50 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:14:51.503612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e3d41316-ec8c-4428-91ef-ada40ee30188 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:14:51.508040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e3d41316-ec8c-4428-91ef-ada40ee30188 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:51.521664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d41316-ec8c-4428-91ef-ada40ee30188 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:51.522578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d41316-ec8c-4428-91ef-ada40ee30188 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:51.523412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d41316-ec8c-4428-91ef-ada40ee30188 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:51.524429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d41316-ec8c-4428-91ef-ada40ee30188 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:51.525024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d41316-ec8c-4428-91ef-ada40ee30188 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:51.525565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3d41316-ec8c-4428-91ef-ada40ee30188 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:51.593510 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e3d41316-ec8c-4428-91ef-ada40ee30188 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30/action" status: 200 len: 24569 microversion: 2.1 time: 0.095552 Aug 18 12:14:51.602542 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3540/6194] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:14:51 2022] POST /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30/action => generated 24569 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:14:52.404761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b4b6d197-9512-4420-892e-86db85499095 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:52.405463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b4b6d197-9512-4420-892e-86db85499095 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:52.416032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4b6d197-9512-4420-892e-86db85499095 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:52.416745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4b6d197-9512-4420-892e-86db85499095 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:52.417435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4b6d197-9512-4420-892e-86db85499095 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:52.418463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4b6d197-9512-4420-892e-86db85499095 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:52.419067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4b6d197-9512-4420-892e-86db85499095 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:52.419715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b4b6d197-9512-4420-892e-86db85499095 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:52.439517 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-b4b6d197-9512-4420-892e-86db85499095 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b4b6d197-9512-4420-892e-86db85499095 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 HTTP/1.1 Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'abeb19bf-12f7-4554-b73d-e1684be54287'} Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:14:52.442065 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:14:52.452028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:52.452028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:52.452028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:52.452028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:52.452028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:52.452028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:52.452028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:52.452028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:14:52.452028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:14:52.452028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:52.452028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:52.452028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b4b6d197-9512-4420-892e-86db85499095 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:14:52.452028 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b4b6d197-9512-4420-892e-86db85499095 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "DELETE /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 404 len: 111 microversion: 2.1 time: 0.045383 Aug 18 12:14:52.452028 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3541/6195] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:14:52 2022] DELETE /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:14:52.454636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-230eb3bf-336d-4421-8896-22df273a0c6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:52.454817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-230eb3bf-336d-4421-8896-22df273a0c6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: abeb19bf-12f7-4554-b73d-e1684be54287] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:52.462481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-230eb3bf-336d-4421-8896-22df273a0c6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:52.462987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-230eb3bf-336d-4421-8896-22df273a0c6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:52.463429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-230eb3bf-336d-4421-8896-22df273a0c6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:52.464150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-230eb3bf-336d-4421-8896-22df273a0c6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:52.464612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-230eb3bf-336d-4421-8896-22df273a0c6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:52.465037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-230eb3bf-336d-4421-8896-22df273a0c6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:52.484537 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-230eb3bf-336d-4421-8896-22df273a0c6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-230eb3bf-336d-4421-8896-22df273a0c6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 HTTP/1.1 Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'abeb19bf-12f7-4554-b73d-e1684be54287'} Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:14:52.486275 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:52.497207 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:14:52.497207 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:14:52.497207 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:14:52.497207 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:14:52.497207 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:14:52.497207 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. Aug 18 12:14:52.497207 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:14:52.497207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-230eb3bf-336d-4421-8896-22df273a0c6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance abeb19bf-12f7-4554-b73d-e1684be54287 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:14:52.497207 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-230eb3bf-336d-4421-8896-22df273a0c6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287" status: 404 len: 111 microversion: 2.1 time: 0.037821 Aug 18 12:14:52.497207 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3542/6196] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:14:52 2022] GET /compute/v2.1/servers/abeb19bf-12f7-4554-b73d-e1684be54287 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:14:57.945969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bff63c23-90d6-4379-a79e-9fd8d883ff69 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:14:57.947124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bff63c23-90d6-4379-a79e-9fd8d883ff69 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:14:57.959540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bff63c23-90d6-4379-a79e-9fd8d883ff69 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:57.960397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bff63c23-90d6-4379-a79e-9fd8d883ff69 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:57.961027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bff63c23-90d6-4379-a79e-9fd8d883ff69 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:57.962270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bff63c23-90d6-4379-a79e-9fd8d883ff69 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:14:57.963103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bff63c23-90d6-4379-a79e-9fd8d883ff69 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:14:57.963762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bff63c23-90d6-4379-a79e-9fd8d883ff69 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:14:58.016446 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bff63c23-90d6-4379-a79e-9fd8d883ff69 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.077854 Aug 18 12:14:58.022477 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3543/6197] 10.222.0.73 () {58 vars in 1293 bytes} [Thu Aug 18 12:14:57 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23/os-server-password => generated 116 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:15:00.093214 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:15:00.094100 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:15:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:15:02.741368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:15:02.744777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:02.753823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:02.754336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:02.754829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:02.755570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:02.756043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:02.756489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:02.761494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:15:02.871690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:15:02.872431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:15:02.873278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:15:02.873982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:15:02.874777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:15:02.949458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:02.956946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:02.957445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:02.957897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:02.958760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:02.959363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:02.959562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:02.992061 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4d1692f3-32d2-4d47-929e-dddcbd714b5f tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30/action" status: 202 len: 1136 microversion: 2.1 time: 0.258769 Aug 18 12:15:03.006648 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3544/6198] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:15:02 2022] POST /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30/action => generated 1136 bytes in 271 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 18 12:15:03.020626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03822ba3-3eec-4a23-b827-a08f92490617 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:03.021774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-03822ba3-3eec-4a23-b827-a08f92490617 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:03.033429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03822ba3-3eec-4a23-b827-a08f92490617 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:03.034368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03822ba3-3eec-4a23-b827-a08f92490617 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:03.035246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03822ba3-3eec-4a23-b827-a08f92490617 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:03.047177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03822ba3-3eec-4a23-b827-a08f92490617 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:03.049489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03822ba3-3eec-4a23-b827-a08f92490617 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:03.051513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03822ba3-3eec-4a23-b827-a08f92490617 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:03.261966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-03822ba3-3eec-4a23-b827-a08f92490617 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:03.281637 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-03822ba3-3eec-4a23-b827-a08f92490617 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1690 microversion: 2.1 time: 0.269149 Aug 18 12:15:03.298567 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3545/6199] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:03 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1690 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:04.312625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ae984f25-b559-4533-b5c7-fe8c418dcfb6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:04.314075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ae984f25-b559-4533-b5c7-fe8c418dcfb6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:04.321790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae984f25-b559-4533-b5c7-fe8c418dcfb6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:04.322309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae984f25-b559-4533-b5c7-fe8c418dcfb6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:04.322763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae984f25-b559-4533-b5c7-fe8c418dcfb6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:04.323490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae984f25-b559-4533-b5c7-fe8c418dcfb6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:04.323978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae984f25-b559-4533-b5c7-fe8c418dcfb6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:04.324410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae984f25-b559-4533-b5c7-fe8c418dcfb6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:04.514686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ae984f25-b559-4533-b5c7-fe8c418dcfb6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:04.525565 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ae984f25-b559-4533-b5c7-fe8c418dcfb6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1690 microversion: 2.1 time: 0.219540 Aug 18 12:15:04.527034 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3546/6200] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:04 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1690 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:05.558398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e9b09ec-813c-44a3-886a-5d67dac84531 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:05.559702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e9b09ec-813c-44a3-886a-5d67dac84531 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:05.573338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e9b09ec-813c-44a3-886a-5d67dac84531 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:05.574172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e9b09ec-813c-44a3-886a-5d67dac84531 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:05.574995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e9b09ec-813c-44a3-886a-5d67dac84531 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:05.576359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e9b09ec-813c-44a3-886a-5d67dac84531 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:05.577342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e9b09ec-813c-44a3-886a-5d67dac84531 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:05.578310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e9b09ec-813c-44a3-886a-5d67dac84531 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:05.795156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e9b09ec-813c-44a3-886a-5d67dac84531 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:05.810468 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e9b09ec-813c-44a3-886a-5d67dac84531 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1690 microversion: 2.1 time: 0.258987 Aug 18 12:15:05.811625 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3547/6201] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:05 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1690 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:06.844865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3f2bc73a-fbe8-4878-bd12-23406ea3350a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:06.846147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3f2bc73a-fbe8-4878-bd12-23406ea3350a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:06.854713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f2bc73a-fbe8-4878-bd12-23406ea3350a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:06.855219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f2bc73a-fbe8-4878-bd12-23406ea3350a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:06.855940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f2bc73a-fbe8-4878-bd12-23406ea3350a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:06.856701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f2bc73a-fbe8-4878-bd12-23406ea3350a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:06.857164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f2bc73a-fbe8-4878-bd12-23406ea3350a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:06.857598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f2bc73a-fbe8-4878-bd12-23406ea3350a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:07.058110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3f2bc73a-fbe8-4878-bd12-23406ea3350a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:07.069482 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3f2bc73a-fbe8-4878-bd12-23406ea3350a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1690 microversion: 2.1 time: 0.230557 Aug 18 12:15:07.070290 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3548/6202] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:06 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1690 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:08.100392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-68ee02f2-0a51-49b9-b13a-8b1afe67e6a5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:08.101355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-68ee02f2-0a51-49b9-b13a-8b1afe67e6a5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:08.114784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68ee02f2-0a51-49b9-b13a-8b1afe67e6a5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:08.115710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68ee02f2-0a51-49b9-b13a-8b1afe67e6a5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:08.116526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68ee02f2-0a51-49b9-b13a-8b1afe67e6a5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:08.117904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68ee02f2-0a51-49b9-b13a-8b1afe67e6a5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:08.118832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68ee02f2-0a51-49b9-b13a-8b1afe67e6a5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:08.119631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68ee02f2-0a51-49b9-b13a-8b1afe67e6a5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:08.344542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-68ee02f2-0a51-49b9-b13a-8b1afe67e6a5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:08.355709 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-68ee02f2-0a51-49b9-b13a-8b1afe67e6a5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1690 microversion: 2.1 time: 0.264122 Aug 18 12:15:08.356803 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3549/6203] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:08 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1690 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:09.384970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ef26201-9915-4b22-913e-2e4fbe5089e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:09.385858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6ef26201-9915-4b22-913e-2e4fbe5089e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:09.393578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ef26201-9915-4b22-913e-2e4fbe5089e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:09.393954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ef26201-9915-4b22-913e-2e4fbe5089e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:09.394401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ef26201-9915-4b22-913e-2e4fbe5089e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:09.395174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ef26201-9915-4b22-913e-2e4fbe5089e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:09.395640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ef26201-9915-4b22-913e-2e4fbe5089e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:09.396078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ef26201-9915-4b22-913e-2e4fbe5089e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:09.559890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6ef26201-9915-4b22-913e-2e4fbe5089e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:09.570119 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6ef26201-9915-4b22-913e-2e4fbe5089e5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1690 microversion: 2.1 time: 0.189313 Aug 18 12:15:09.571058 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3550/6204] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:09 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1690 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:10.602088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ba4eaec-95fb-4318-a444-cafea2e1b045 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:10.603225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9ba4eaec-95fb-4318-a444-cafea2e1b045 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:10.615835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ba4eaec-95fb-4318-a444-cafea2e1b045 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:10.616708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ba4eaec-95fb-4318-a444-cafea2e1b045 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:10.617470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ba4eaec-95fb-4318-a444-cafea2e1b045 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:10.618481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ba4eaec-95fb-4318-a444-cafea2e1b045 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:10.619438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ba4eaec-95fb-4318-a444-cafea2e1b045 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:10.620172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ba4eaec-95fb-4318-a444-cafea2e1b045 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:10.861218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9ba4eaec-95fb-4318-a444-cafea2e1b045 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:10.869908 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9ba4eaec-95fb-4318-a444-cafea2e1b045 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1690 microversion: 2.1 time: 0.272098 Aug 18 12:15:10.870555 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3551/6205] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:10 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1690 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:11.896747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-466db95a-45f7-4758-aa95-0ff619e80819 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:11.897459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-466db95a-45f7-4758-aa95-0ff619e80819 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:11.900331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:15:11.909393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-466db95a-45f7-4758-aa95-0ff619e80819 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:11.910105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-466db95a-45f7-4758-aa95-0ff619e80819 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:11.910800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-466db95a-45f7-4758-aa95-0ff619e80819 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:11.911688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-466db95a-45f7-4758-aa95-0ff619e80819 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:11.912276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-466db95a-45f7-4758-aa95-0ff619e80819 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:11.912819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-466db95a-45f7-4758-aa95-0ff619e80819 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:12.078511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-466db95a-45f7-4758-aa95-0ff619e80819 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:12.087568 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-466db95a-45f7-4758-aa95-0ff619e80819 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1690 microversion: 2.1 time: 0.194740 Aug 18 12:15:12.088225 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3552/6206] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:11 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1690 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:13.115340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bd5a0ceb-c219-433c-8a34-4116a54f93bc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:13.116395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bd5a0ceb-c219-433c-8a34-4116a54f93bc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:13.126943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd5a0ceb-c219-433c-8a34-4116a54f93bc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:13.127430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd5a0ceb-c219-433c-8a34-4116a54f93bc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:13.128186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd5a0ceb-c219-433c-8a34-4116a54f93bc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:13.129019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd5a0ceb-c219-433c-8a34-4116a54f93bc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:13.129525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd5a0ceb-c219-433c-8a34-4116a54f93bc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:13.130090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd5a0ceb-c219-433c-8a34-4116a54f93bc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:13.364088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bd5a0ceb-c219-433c-8a34-4116a54f93bc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:13.373010 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bd5a0ceb-c219-433c-8a34-4116a54f93bc tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1690 microversion: 2.1 time: 0.265655 Aug 18 12:15:13.386465 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3553/6207] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:13 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1690 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:14.398061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a50cba19-9e73-4f68-a679-8a63f49f0c73 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:14.399424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a50cba19-9e73-4f68-a679-8a63f49f0c73 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:14.408031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a50cba19-9e73-4f68-a679-8a63f49f0c73 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:14.408533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a50cba19-9e73-4f68-a679-8a63f49f0c73 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:14.409047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a50cba19-9e73-4f68-a679-8a63f49f0c73 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:14.409786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a50cba19-9e73-4f68-a679-8a63f49f0c73 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:14.410260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a50cba19-9e73-4f68-a679-8a63f49f0c73 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:14.410808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a50cba19-9e73-4f68-a679-8a63f49f0c73 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:14.601592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a50cba19-9e73-4f68-a679-8a63f49f0c73 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:14.611379 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a50cba19-9e73-4f68-a679-8a63f49f0c73 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1690 microversion: 2.1 time: 0.217598 Aug 18 12:15:14.612494 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3554/6208] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:14 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1690 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:15.638332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0c412264-bb12-4331-ba62-8338e26d37b9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:15.639832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0c412264-bb12-4331-ba62-8338e26d37b9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:15.648856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c412264-bb12-4331-ba62-8338e26d37b9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:15.649471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c412264-bb12-4331-ba62-8338e26d37b9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:15.650106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c412264-bb12-4331-ba62-8338e26d37b9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:15.651301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c412264-bb12-4331-ba62-8338e26d37b9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:15.652099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c412264-bb12-4331-ba62-8338e26d37b9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:15.652680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c412264-bb12-4331-ba62-8338e26d37b9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:15.867749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0c412264-bb12-4331-ba62-8338e26d37b9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:15.881224 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0c412264-bb12-4331-ba62-8338e26d37b9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1690 microversion: 2.1 time: 0.247121 Aug 18 12:15:15.881933 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3555/6209] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:15 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1690 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:16.184989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-404805402", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "50dc7662-dfbb-4b57-93f4-d7d4f0a464a1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "11e09857-d75b-4b2b-82b3-fa5db86d3937"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:15:16.253103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] validate_networks() for [('11e09857-d75b-4b2b-82b3-fa5db86d3937', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:15:16.673124 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:15:16.674007 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:15:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:15:16.689036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:15:16.689595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:15:16.689929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:15:16.690348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:15:16.690790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:15:16.701119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:16.701658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:16.702308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:16.703314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:16.703820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:16.704379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:16.728890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:15:16.736706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for user 033d6aa61b5340189fbc5d895d3e8cba and project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:15:16.818321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:15:16.821205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50dc7662-dfbb-4b57-93f4-d7d4f0a464a1',volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:15:16.991237 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b72204c8-680b-4f9f-8155-3b8ecb5527d3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810298 Aug 18 12:15:16.992189 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3556/6210] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:15:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:15:16.996793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9a160d41-c81d-491e-9d39-2bec6c001ac5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:16.997461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9a160d41-c81d-491e-9d39-2bec6c001ac5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:17.006366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a160d41-c81d-491e-9d39-2bec6c001ac5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:17.006898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a160d41-c81d-491e-9d39-2bec6c001ac5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:17.007346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a160d41-c81d-491e-9d39-2bec6c001ac5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:17.008076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a160d41-c81d-491e-9d39-2bec6c001ac5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:17.008539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a160d41-c81d-491e-9d39-2bec6c001ac5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:17.008982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a160d41-c81d-491e-9d39-2bec6c001ac5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:17.237604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9a160d41-c81d-491e-9d39-2bec6c001ac5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:17.246398 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9a160d41-c81d-491e-9d39-2bec6c001ac5 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1690 microversion: 2.1 time: 0.253352 Aug 18 12:15:17.247048 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3557/6211] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:16 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1690 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:17.259515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e024593e-2437-443b-a854-ccd087278c78 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:17.260644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e024593e-2437-443b-a854-ccd087278c78 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:17.340447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e024593e-2437-443b-a854-ccd087278c78 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:17.350042 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e024593e-2437-443b-a854-ccd087278c78 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1070 microversion: 2.1 time: 0.098118 Aug 18 12:15:17.350943 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3558/6212] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:17 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1070 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:18.270097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7ed564e2-9f7c-4521-82af-e9f8fff9a1f9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:18.271592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7ed564e2-9f7c-4521-82af-e9f8fff9a1f9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:18.281059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ed564e2-9f7c-4521-82af-e9f8fff9a1f9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:18.281659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ed564e2-9f7c-4521-82af-e9f8fff9a1f9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:18.282414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ed564e2-9f7c-4521-82af-e9f8fff9a1f9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:18.283265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ed564e2-9f7c-4521-82af-e9f8fff9a1f9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:18.283876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ed564e2-9f7c-4521-82af-e9f8fff9a1f9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:18.284409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ed564e2-9f7c-4521-82af-e9f8fff9a1f9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:18.538107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7ed564e2-9f7c-4521-82af-e9f8fff9a1f9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:18.552038 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7ed564e2-9f7c-4521-82af-e9f8fff9a1f9 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1690 microversion: 2.1 time: 0.285585 Aug 18 12:15:18.553420 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3559/6213] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:18 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1690 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:18.563511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d2234558-26d6-4463-b73a-b04c93dc800c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:18.565250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d2234558-26d6-4463-b73a-b04c93dc800c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:18.577393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2234558-26d6-4463-b73a-b04c93dc800c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:18.578964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2234558-26d6-4463-b73a-b04c93dc800c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:18.579766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2234558-26d6-4463-b73a-b04c93dc800c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:18.581102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2234558-26d6-4463-b73a-b04c93dc800c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:18.581954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2234558-26d6-4463-b73a-b04c93dc800c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:18.582776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2234558-26d6-4463-b73a-b04c93dc800c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:18.620599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:15:18.720110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2234558-26d6-4463-b73a-b04c93dc800c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:18.734545 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d2234558-26d6-4463-b73a-b04c93dc800c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1186 microversion: 2.1 time: 0.178480 Aug 18 12:15:18.735787 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3560/6214] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:18 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1186 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:19.582392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-425f3936-a768-446e-83d7-096dd7a598f6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:19.583965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-425f3936-a768-446e-83d7-096dd7a598f6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:19.601058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-425f3936-a768-446e-83d7-096dd7a598f6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:19.603028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-425f3936-a768-446e-83d7-096dd7a598f6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:19.604284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-425f3936-a768-446e-83d7-096dd7a598f6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:19.606086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-425f3936-a768-446e-83d7-096dd7a598f6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:19.608856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-425f3936-a768-446e-83d7-096dd7a598f6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:19.611211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-425f3936-a768-446e-83d7-096dd7a598f6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:20.107270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-425f3936-a768-446e-83d7-096dd7a598f6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:20.129577 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-425f3936-a768-446e-83d7-096dd7a598f6 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1690 microversion: 2.1 time: 0.556097 Aug 18 12:15:20.131163 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3561/6215] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:19 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1690 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:20.140134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-946cb87c-8797-4dfd-bdf9-9fbf7bc58541 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:20.141773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-946cb87c-8797-4dfd-bdf9-9fbf7bc58541 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:20.156910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-946cb87c-8797-4dfd-bdf9-9fbf7bc58541 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:20.158487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-946cb87c-8797-4dfd-bdf9-9fbf7bc58541 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:20.159568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-946cb87c-8797-4dfd-bdf9-9fbf7bc58541 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:20.160920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-946cb87c-8797-4dfd-bdf9-9fbf7bc58541 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:20.162112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-946cb87c-8797-4dfd-bdf9-9fbf7bc58541 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:20.162942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-946cb87c-8797-4dfd-bdf9-9fbf7bc58541 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:20.489743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-946cb87c-8797-4dfd-bdf9-9fbf7bc58541 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:20.504873 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-946cb87c-8797-4dfd-bdf9-9fbf7bc58541 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1228 microversion: 2.1 time: 0.371715 Aug 18 12:15:20.505871 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3562/6216] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:20 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1228 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:21.014262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2d859f58-df34-49c3-a61a-9ba5df200fe0 req-cbaf07b3-0ed3-4f32-8a1c-98b5ac0cb049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc03f12d-d434-4356-ae4a-a6c9c5b77e6b", "tag": "b4471b6f-0117-4a63-866e-e170838f180e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:15:21.038139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2d859f58-df34-49c3-a61a-9ba5df200fe0 req-cbaf07b3-0ed3-4f32-8a1c-98b5ac0cb049 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:21.039540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2d859f58-df34-49c3-a61a-9ba5df200fe0 req-cbaf07b3-0ed3-4f32-8a1c-98b5ac0cb049 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:21.040382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2d859f58-df34-49c3-a61a-9ba5df200fe0 req-cbaf07b3-0ed3-4f32-8a1c-98b5ac0cb049 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:21.064744 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2d859f58-df34-49c3-a61a-9ba5df200fe0 req-cbaf07b3-0ed3-4f32-8a1c-98b5ac0cb049 service nova] Creating event network-changed:b4471b6f-0117-4a63-866e-e170838f180e for instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b on n-h2-853611-3 Aug 18 12:15:21.074592 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2d859f58-df34-49c3-a61a-9ba5df200fe0 req-cbaf07b3-0ed3-4f32-8a1c-98b5ac0cb049 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067277 Aug 18 12:15:21.076240 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3563/6217] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:15:21.160156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a729d05e-4a5f-4f2c-a1f3-d64785737fae tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:21.162721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a729d05e-4a5f-4f2c-a1f3-d64785737fae tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:21.184250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a729d05e-4a5f-4f2c-a1f3-d64785737fae tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:21.186341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a729d05e-4a5f-4f2c-a1f3-d64785737fae tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:21.187327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a729d05e-4a5f-4f2c-a1f3-d64785737fae tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:21.188722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a729d05e-4a5f-4f2c-a1f3-d64785737fae tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:21.189600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a729d05e-4a5f-4f2c-a1f3-d64785737fae tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:21.190752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a729d05e-4a5f-4f2c-a1f3-d64785737fae tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:21.628716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a729d05e-4a5f-4f2c-a1f3-d64785737fae tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:21.644661 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a729d05e-4a5f-4f2c-a1f3-d64785737fae tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1696 microversion: 2.1 time: 0.495414 Aug 18 12:15:21.646517 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3564/6218] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:21 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1696 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:21.655971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1dee7e2-7252-4c8b-b89e-69220a33c69c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:21.657475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1dee7e2-7252-4c8b-b89e-69220a33c69c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:21.669774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1dee7e2-7252-4c8b-b89e-69220a33c69c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:21.671363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1dee7e2-7252-4c8b-b89e-69220a33c69c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:21.672470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1dee7e2-7252-4c8b-b89e-69220a33c69c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:21.680252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1dee7e2-7252-4c8b-b89e-69220a33c69c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:21.681671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1dee7e2-7252-4c8b-b89e-69220a33c69c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:21.682778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1dee7e2-7252-4c8b-b89e-69220a33c69c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:21.941896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a1dee7e2-7252-4c8b-b89e-69220a33c69c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:21.956620 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1dee7e2-7252-4c8b-b89e-69220a33c69c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1228 microversion: 2.1 time: 0.307723 Aug 18 12:15:21.958126 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3565/6219] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:21 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1228 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:22.724385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cda4452b-40f1-4ec3-97e5-767037a97126 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:22.726822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cda4452b-40f1-4ec3-97e5-767037a97126 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:22.739750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cda4452b-40f1-4ec3-97e5-767037a97126 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:22.742150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cda4452b-40f1-4ec3-97e5-767037a97126 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:22.743610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cda4452b-40f1-4ec3-97e5-767037a97126 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:22.745634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cda4452b-40f1-4ec3-97e5-767037a97126 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:22.747631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cda4452b-40f1-4ec3-97e5-767037a97126 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:22.748947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cda4452b-40f1-4ec3-97e5-767037a97126 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:23.229292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cda4452b-40f1-4ec3-97e5-767037a97126 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:23.256189 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cda4452b-40f1-4ec3-97e5-767037a97126 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1681 microversion: 2.1 time: 0.574689 Aug 18 12:15:23.257649 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3566/6220] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:22 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1681 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:23.269725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aaefe5d3-321f-41f7-bc31-66ad36fbaa40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:23.272048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aaefe5d3-321f-41f7-bc31-66ad36fbaa40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:23.301411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaefe5d3-321f-41f7-bc31-66ad36fbaa40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:23.302100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaefe5d3-321f-41f7-bc31-66ad36fbaa40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:23.302704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaefe5d3-321f-41f7-bc31-66ad36fbaa40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:23.303520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaefe5d3-321f-41f7-bc31-66ad36fbaa40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:23.304297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaefe5d3-321f-41f7-bc31-66ad36fbaa40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:23.304629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aaefe5d3-321f-41f7-bc31-66ad36fbaa40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:23.549569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aaefe5d3-321f-41f7-bc31-66ad36fbaa40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:23.558509 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aaefe5d3-321f-41f7-bc31-66ad36fbaa40 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1228 microversion: 2.1 time: 0.298626 Aug 18 12:15:23.560159 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3567/6221] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:23 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1228 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:24.585889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b90977ea-2a15-494d-a3e1-14d3041074ce tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:24.587030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b90977ea-2a15-494d-a3e1-14d3041074ce tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:24.600947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b90977ea-2a15-494d-a3e1-14d3041074ce tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:24.601824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b90977ea-2a15-494d-a3e1-14d3041074ce tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:24.602662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b90977ea-2a15-494d-a3e1-14d3041074ce tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:24.603902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b90977ea-2a15-494d-a3e1-14d3041074ce tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:24.604710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b90977ea-2a15-494d-a3e1-14d3041074ce tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:24.605436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b90977ea-2a15-494d-a3e1-14d3041074ce tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:24.820644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b90977ea-2a15-494d-a3e1-14d3041074ce tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:24.836803 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b90977ea-2a15-494d-a3e1-14d3041074ce tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1228 microversion: 2.1 time: 0.258659 Aug 18 12:15:24.837848 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3568/6222] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:24 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1228 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:24.926140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a18e26d5-c6aa-4357-ab9d-a86b23143a6e req-83c2c6e4-8cdc-48a4-ad2f-4a61d670c7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a9b252c-618b-4ec9-b518-3bebbf1d0a30", "name": "network-vif-plugged", "status": "completed", "tag": "0b1f6e7a-181a-4fdd-bbaf-18537ead2b5c"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:15:24.936864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a18e26d5-c6aa-4357-ab9d-a86b23143a6e req-83c2c6e4-8cdc-48a4-ad2f-4a61d670c7da service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:24.937365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a18e26d5-c6aa-4357-ab9d-a86b23143a6e req-83c2c6e4-8cdc-48a4-ad2f-4a61d670c7da service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:24.937804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a18e26d5-c6aa-4357-ab9d-a86b23143a6e req-83c2c6e4-8cdc-48a4-ad2f-4a61d670c7da service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:24.952864 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a18e26d5-c6aa-4357-ab9d-a86b23143a6e req-83c2c6e4-8cdc-48a4-ad2f-4a61d670c7da service nova] Creating event network-vif-plugged:0b1f6e7a-181a-4fdd-bbaf-18537ead2b5c for instance 2a9b252c-618b-4ec9-b518-3bebbf1d0a30 on n-h2-853611-3 Aug 18 12:15:24.958351 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a18e26d5-c6aa-4357-ab9d-a86b23143a6e req-83c2c6e4-8cdc-48a4-ad2f-4a61d670c7da service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035920 Aug 18 12:15:24.959029 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3569/6223] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:15:25.869961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aa215b98-b12a-4540-afc3-f1f68398af27 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:25.870806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aa215b98-b12a-4540-afc3-f1f68398af27 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:25.877896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa215b98-b12a-4540-afc3-f1f68398af27 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:25.878413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa215b98-b12a-4540-afc3-f1f68398af27 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:25.878867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa215b98-b12a-4540-afc3-f1f68398af27 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:25.879594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa215b98-b12a-4540-afc3-f1f68398af27 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:25.880059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa215b98-b12a-4540-afc3-f1f68398af27 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:25.880488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa215b98-b12a-4540-afc3-f1f68398af27 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:26.064067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aa215b98-b12a-4540-afc3-f1f68398af27 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:26.072376 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aa215b98-b12a-4540-afc3-f1f68398af27 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1216 microversion: 2.1 time: 0.207930 Aug 18 12:15:26.072973 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3570/6224] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:25 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1216 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:27.098004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a83e5b9d-0a3c-4560-af77-85825eb5fbd8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:27.098829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a83e5b9d-0a3c-4560-af77-85825eb5fbd8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:27.100880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:15:27.115501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a83e5b9d-0a3c-4560-af77-85825eb5fbd8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:27.116017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a83e5b9d-0a3c-4560-af77-85825eb5fbd8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:27.116466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a83e5b9d-0a3c-4560-af77-85825eb5fbd8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:27.117207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a83e5b9d-0a3c-4560-af77-85825eb5fbd8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:27.118401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a83e5b9d-0a3c-4560-af77-85825eb5fbd8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:27.118889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a83e5b9d-0a3c-4560-af77-85825eb5fbd8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:27.276109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a83e5b9d-0a3c-4560-af77-85825eb5fbd8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:27.285849 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a83e5b9d-0a3c-4560-af77-85825eb5fbd8 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1216 microversion: 2.1 time: 0.194682 Aug 18 12:15:27.286491 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3571/6225] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:27 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1216 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:28.308200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-68344181-f95f-45e1-af42-bd45b8215e70 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:28.309504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-68344181-f95f-45e1-af42-bd45b8215e70 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:28.311631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:15:28.318415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68344181-f95f-45e1-af42-bd45b8215e70 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:28.319034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68344181-f95f-45e1-af42-bd45b8215e70 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:28.319590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68344181-f95f-45e1-af42-bd45b8215e70 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:28.320382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68344181-f95f-45e1-af42-bd45b8215e70 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:28.320884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68344181-f95f-45e1-af42-bd45b8215e70 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:28.321436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68344181-f95f-45e1-af42-bd45b8215e70 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:28.482376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-68344181-f95f-45e1-af42-bd45b8215e70 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:28.491047 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-68344181-f95f-45e1-af42-bd45b8215e70 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1216 microversion: 2.1 time: 0.186728 Aug 18 12:15:28.491658 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3572/6226] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:28 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1216 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:29.518134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fe82f5f8-9a0e-4fb6-9e4c-1d03482a5af7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:29.519279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fe82f5f8-9a0e-4fb6-9e4c-1d03482a5af7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:29.528399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe82f5f8-9a0e-4fb6-9e4c-1d03482a5af7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:29.528898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe82f5f8-9a0e-4fb6-9e4c-1d03482a5af7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:29.529379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe82f5f8-9a0e-4fb6-9e4c-1d03482a5af7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:29.530115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe82f5f8-9a0e-4fb6-9e4c-1d03482a5af7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:29.530627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe82f5f8-9a0e-4fb6-9e4c-1d03482a5af7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:29.531102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe82f5f8-9a0e-4fb6-9e4c-1d03482a5af7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:29.704971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fe82f5f8-9a0e-4fb6-9e4c-1d03482a5af7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:29.722831 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fe82f5f8-9a0e-4fb6-9e4c-1d03482a5af7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1216 microversion: 2.1 time: 0.211132 Aug 18 12:15:29.723923 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3573/6227] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:29 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1216 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:30.765621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-264dd7cf-6ab9-4604-b3cb-ad7d4e07f65f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:30.766948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-264dd7cf-6ab9-4604-b3cb-ad7d4e07f65f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:30.783276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264dd7cf-6ab9-4604-b3cb-ad7d4e07f65f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:30.784386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264dd7cf-6ab9-4604-b3cb-ad7d4e07f65f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:30.785502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264dd7cf-6ab9-4604-b3cb-ad7d4e07f65f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:30.786965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264dd7cf-6ab9-4604-b3cb-ad7d4e07f65f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:30.787899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264dd7cf-6ab9-4604-b3cb-ad7d4e07f65f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:30.789114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264dd7cf-6ab9-4604-b3cb-ad7d4e07f65f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:31.040508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-264dd7cf-6ab9-4604-b3cb-ad7d4e07f65f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:31.056673 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-264dd7cf-6ab9-4604-b3cb-ad7d4e07f65f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1216 microversion: 2.1 time: 0.299905 Aug 18 12:15:31.058551 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3574/6228] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:30 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1216 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:32.091939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a566d382-1cfd-4125-b26a-beab8ac4b89e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:32.093088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a566d382-1cfd-4125-b26a-beab8ac4b89e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:32.102662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a566d382-1cfd-4125-b26a-beab8ac4b89e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:32.103606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a566d382-1cfd-4125-b26a-beab8ac4b89e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:32.104381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a566d382-1cfd-4125-b26a-beab8ac4b89e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:32.105759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a566d382-1cfd-4125-b26a-beab8ac4b89e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:32.106394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a566d382-1cfd-4125-b26a-beab8ac4b89e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:32.106859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a566d382-1cfd-4125-b26a-beab8ac4b89e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:32.255851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a566d382-1cfd-4125-b26a-beab8ac4b89e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:32.264842 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a566d382-1cfd-4125-b26a-beab8ac4b89e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1216 microversion: 2.1 time: 0.177243 Aug 18 12:15:32.265472 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3575/6229] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:32 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1216 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:33.288392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7b18e059-446f-41d6-8748-34511e797e2f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:33.289474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7b18e059-446f-41d6-8748-34511e797e2f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:33.296744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b18e059-446f-41d6-8748-34511e797e2f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:33.297388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b18e059-446f-41d6-8748-34511e797e2f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:33.297889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b18e059-446f-41d6-8748-34511e797e2f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:33.298728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b18e059-446f-41d6-8748-34511e797e2f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:33.299197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b18e059-446f-41d6-8748-34511e797e2f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:33.299630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b18e059-446f-41d6-8748-34511e797e2f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:33.497560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7b18e059-446f-41d6-8748-34511e797e2f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:33.506209 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7b18e059-446f-41d6-8748-34511e797e2f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1216 microversion: 2.1 time: 0.221914 Aug 18 12:15:33.506968 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3576/6230] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:33 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1216 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:34.529415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1cecf341-4fd4-49a1-9524-06c0b07e4873 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:34.530473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1cecf341-4fd4-49a1-9524-06c0b07e4873 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:34.537708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cecf341-4fd4-49a1-9524-06c0b07e4873 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:34.538213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cecf341-4fd4-49a1-9524-06c0b07e4873 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:34.538705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cecf341-4fd4-49a1-9524-06c0b07e4873 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:34.539694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cecf341-4fd4-49a1-9524-06c0b07e4873 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:34.539931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cecf341-4fd4-49a1-9524-06c0b07e4873 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:34.540325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cecf341-4fd4-49a1-9524-06c0b07e4873 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:34.702607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1cecf341-4fd4-49a1-9524-06c0b07e4873 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:34.712962 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1cecf341-4fd4-49a1-9524-06c0b07e4873 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1216 microversion: 2.1 time: 0.188325 Aug 18 12:15:34.714920 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3577/6231] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:34 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1216 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:34.961510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4ae0a051-d59b-429f-a508-4ca9a48b66b5 req-40b63102-95c2-4b52-9757-d4a764ef5774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc03f12d-d434-4356-ae4a-a6c9c5b77e6b", "name": "network-vif-plugged", "status": "completed", "tag": "b4471b6f-0117-4a63-866e-e170838f180e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:15:34.982785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4ae0a051-d59b-429f-a508-4ca9a48b66b5 req-40b63102-95c2-4b52-9757-d4a764ef5774 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:34.983615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4ae0a051-d59b-429f-a508-4ca9a48b66b5 req-40b63102-95c2-4b52-9757-d4a764ef5774 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:34.984416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4ae0a051-d59b-429f-a508-4ca9a48b66b5 req-40b63102-95c2-4b52-9757-d4a764ef5774 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:35.012461 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4ae0a051-d59b-429f-a508-4ca9a48b66b5 req-40b63102-95c2-4b52-9757-d4a764ef5774 service nova] Creating event network-vif-plugged:b4471b6f-0117-4a63-866e-e170838f180e for instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b on n-h2-853611-3 Aug 18 12:15:35.027068 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4ae0a051-d59b-429f-a508-4ca9a48b66b5 req-40b63102-95c2-4b52-9757-d4a764ef5774 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071601 Aug 18 12:15:35.027874 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3578/6232] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:15:35.738965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5fc85644-7a00-45b1-900d-30bf4bca27aa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:35.739673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5fc85644-7a00-45b1-900d-30bf4bca27aa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:35.748464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fc85644-7a00-45b1-900d-30bf4bca27aa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:35.749172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fc85644-7a00-45b1-900d-30bf4bca27aa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:35.749685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fc85644-7a00-45b1-900d-30bf4bca27aa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:35.750526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fc85644-7a00-45b1-900d-30bf4bca27aa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:35.751056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fc85644-7a00-45b1-900d-30bf4bca27aa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:35.751549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5fc85644-7a00-45b1-900d-30bf4bca27aa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:35.758991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:15:35.947150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5fc85644-7a00-45b1-900d-30bf4bca27aa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:35.956972 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5fc85644-7a00-45b1-900d-30bf4bca27aa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1216 microversion: 2.1 time: 0.223292 Aug 18 12:15:35.957785 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3579/6233] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:35 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1216 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:36.980878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-85886377-33f6-4d8f-881a-3e848d86a558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:36.981850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-85886377-33f6-4d8f-881a-3e848d86a558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:36.989428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85886377-33f6-4d8f-881a-3e848d86a558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:36.989918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85886377-33f6-4d8f-881a-3e848d86a558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:36.990355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85886377-33f6-4d8f-881a-3e848d86a558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:36.991107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85886377-33f6-4d8f-881a-3e848d86a558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:36.991572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85886377-33f6-4d8f-881a-3e848d86a558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:36.992000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85886377-33f6-4d8f-881a-3e848d86a558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:37.145971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-85886377-33f6-4d8f-881a-3e848d86a558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:37.157465 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-85886377-33f6-4d8f-881a-3e848d86a558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1404 microversion: 2.1 time: 0.181116 Aug 18 12:15:37.158381 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3580/6234] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:36 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:37.179335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e2e3a87-48a0-4f47-9a39-be25eeb82e8f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:37.179965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7e2e3a87-48a0-4f47-9a39-be25eeb82e8f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:37.187283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e2e3a87-48a0-4f47-9a39-be25eeb82e8f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:37.187784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e2e3a87-48a0-4f47-9a39-be25eeb82e8f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:37.188234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e2e3a87-48a0-4f47-9a39-be25eeb82e8f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:37.188963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e2e3a87-48a0-4f47-9a39-be25eeb82e8f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:37.189426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e2e3a87-48a0-4f47-9a39-be25eeb82e8f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:37.189866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e2e3a87-48a0-4f47-9a39-be25eeb82e8f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:37.354846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7e2e3a87-48a0-4f47-9a39-be25eeb82e8f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:37.363628 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e2e3a87-48a0-4f47-9a39-be25eeb82e8f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1404 microversion: 2.1 time: 0.188176 Aug 18 12:15:37.364247 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3581/6235] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:37 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1404 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:37.386218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4145be60-824c-4d8e-b0b6-34d303b37fef tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-53026517"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:15:37.388686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4145be60-824c-4d8e-b0b6-34d303b37fef tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:37.395608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4145be60-824c-4d8e-b0b6-34d303b37fef tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:37.396106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4145be60-824c-4d8e-b0b6-34d303b37fef tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:37.396555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4145be60-824c-4d8e-b0b6-34d303b37fef tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:37.397285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4145be60-824c-4d8e-b0b6-34d303b37fef tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:37.397742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4145be60-824c-4d8e-b0b6-34d303b37fef tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:37.398166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4145be60-824c-4d8e-b0b6-34d303b37fef tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:37.511463 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.compute.api [None req-4145be60-824c-4d8e-b0b6-34d303b37fef tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Attempting to quiesce instance before volume snapshot. Aug 18 12:15:37.585253 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.compute.api [None req-4145be60-824c-4d8e-b0b6-34d303b37fef tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 18 12:15:37.681185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4145be60-824c-4d8e-b0b6-34d303b37fef tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Creating snapshot from volume 50dc7662-dfbb-4b57-93f4-d7d4f0a464a1. {{(pid=122210) snapshot_instance /opt/stack/nova/nova/compute/api.py:3456}} Aug 18 12:15:38.951823 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4145be60-824c-4d8e-b0b6-34d303b37fef tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "POST /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b/action" status: 202 len: 0 microversion: 2.1 time: 1.568843 Aug 18 12:15:38.953210 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3582/6236] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:15:37 2022] POST /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b/action => generated 0 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 18 12:15:40.179785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-906984163", "imageRef": "70be93a4-78a7-43a7-b348-12f3ac883c29", "flavorRef": "452", "networks": [{"uuid": "11e09857-d75b-4b2b-82b3-fa5db86d3937"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:15:40.241585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] validate_networks() for [('11e09857-d75b-4b2b-82b3-fa5db86d3937', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:15:40.750335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:15:40.750885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:15:40.751479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:15:40.751956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:15:40.752431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:15:40.766055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:40.766827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:40.767541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:40.768701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:40.769372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:40.770048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:40.792398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:15:40.799274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for user 033d6aa61b5340189fbc5d895d3e8cba and project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:15:40.815242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:15:40.817968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='baad799c-e676-4a20-92c1-b541907d1128',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:15:40.907927 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3347cad4-d387-4a16-863b-9d0974cdf04a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733249 Aug 18 12:15:40.909190 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3583/6237] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:15:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:15:40.923132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fdf65fe3-6242-4693-a2be-b6c0fc60595d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:40.924063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fdf65fe3-6242-4693-a2be-b6c0fc60595d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:41.014467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fdf65fe3-6242-4693-a2be-b6c0fc60595d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:41.023959 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fdf65fe3-6242-4693-a2be-b6c0fc60595d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1229 microversion: 2.1 time: 0.105083 Aug 18 12:15:41.024770 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3584/6238] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:40 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:42.052211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-292e6112-3b77-41c3-a5d5-3db4e40f2e95 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:42.053327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-292e6112-3b77-41c3-a5d5-3db4e40f2e95 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:42.057361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:15:42.064888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-292e6112-3b77-41c3-a5d5-3db4e40f2e95 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:42.065401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-292e6112-3b77-41c3-a5d5-3db4e40f2e95 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:42.065861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-292e6112-3b77-41c3-a5d5-3db4e40f2e95 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:42.066640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-292e6112-3b77-41c3-a5d5-3db4e40f2e95 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:42.067121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-292e6112-3b77-41c3-a5d5-3db4e40f2e95 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:42.067564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-292e6112-3b77-41c3-a5d5-3db4e40f2e95 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:42.142865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-292e6112-3b77-41c3-a5d5-3db4e40f2e95 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:42.153493 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-292e6112-3b77-41c3-a5d5-3db4e40f2e95 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1281 microversion: 2.1 time: 0.106368 Aug 18 12:15:42.161042 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3585/6239] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:42 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1281 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:43.177856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e78ad6e1-186d-4f1b-9d4d-09d0a37eacd6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:43.178957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e78ad6e1-186d-4f1b-9d4d-09d0a37eacd6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:43.190805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e78ad6e1-186d-4f1b-9d4d-09d0a37eacd6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:43.193252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e78ad6e1-186d-4f1b-9d4d-09d0a37eacd6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:43.194727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e78ad6e1-186d-4f1b-9d4d-09d0a37eacd6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:43.196161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e78ad6e1-186d-4f1b-9d4d-09d0a37eacd6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:43.198006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e78ad6e1-186d-4f1b-9d4d-09d0a37eacd6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:43.198590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e78ad6e1-186d-4f1b-9d4d-09d0a37eacd6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:43.448793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e78ad6e1-186d-4f1b-9d4d-09d0a37eacd6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:43.462175 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e78ad6e1-186d-4f1b-9d4d-09d0a37eacd6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1341 microversion: 2.1 time: 0.288386 Aug 18 12:15:43.464165 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3586/6240] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:43 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1341 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:44.089047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-6b3cb72b-f02a-4703-9346-4de383b31315 req-65ffd720-b362-413e-843c-189a7d6d191e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698da23f-ef02-4164-9a7f-a3a48f9dd142", "tag": "4032d49d-7767-4f40-ba64-80a7b0c58656"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:15:44.100002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6b3cb72b-f02a-4703-9346-4de383b31315 req-65ffd720-b362-413e-843c-189a7d6d191e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:44.100437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6b3cb72b-f02a-4703-9346-4de383b31315 req-65ffd720-b362-413e-843c-189a7d6d191e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:44.100895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6b3cb72b-f02a-4703-9346-4de383b31315 req-65ffd720-b362-413e-843c-189a7d6d191e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:44.116880 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6b3cb72b-f02a-4703-9346-4de383b31315 req-65ffd720-b362-413e-843c-189a7d6d191e service nova] Creating event network-changed:4032d49d-7767-4f40-ba64-80a7b0c58656 for instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 on n-h1-853611-3 Aug 18 12:15:44.123357 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-6b3cb72b-f02a-4703-9346-4de383b31315 req-65ffd720-b362-413e-843c-189a7d6d191e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158844 Aug 18 12:15:44.124923 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3587/6241] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:15:44.499614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a18a26b3-801a-4298-a1e6-7a0c0ee798f9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:44.502142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a18a26b3-801a-4298-a1e6-7a0c0ee798f9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:44.514292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a18a26b3-801a-4298-a1e6-7a0c0ee798f9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:44.516319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a18a26b3-801a-4298-a1e6-7a0c0ee798f9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:44.517137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a18a26b3-801a-4298-a1e6-7a0c0ee798f9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:44.518485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a18a26b3-801a-4298-a1e6-7a0c0ee798f9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:44.519365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a18a26b3-801a-4298-a1e6-7a0c0ee798f9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:44.520155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a18a26b3-801a-4298-a1e6-7a0c0ee798f9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:44.754839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a18a26b3-801a-4298-a1e6-7a0c0ee798f9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:44.775092 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a18a26b3-801a-4298-a1e6-7a0c0ee798f9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1341 microversion: 2.1 time: 0.285686 Aug 18 12:15:44.777457 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3588/6242] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:44 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1341 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:45.804850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-679476d9-4732-4515-8b30-dafbc521badc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:45.804850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-679476d9-4732-4515-8b30-dafbc521badc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:45.824079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-679476d9-4732-4515-8b30-dafbc521badc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:45.825467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-679476d9-4732-4515-8b30-dafbc521badc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:45.826349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-679476d9-4732-4515-8b30-dafbc521badc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:45.827770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-679476d9-4732-4515-8b30-dafbc521badc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:45.829014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-679476d9-4732-4515-8b30-dafbc521badc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:45.829857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-679476d9-4732-4515-8b30-dafbc521badc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:46.054802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-679476d9-4732-4515-8b30-dafbc521badc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:46.072598 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-679476d9-4732-4515-8b30-dafbc521badc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1341 microversion: 2.1 time: 0.275324 Aug 18 12:15:46.073393 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3589/6243] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:45 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1341 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:47.095637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-16f86665-5295-44f9-9214-48aacaf1862e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:47.096484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-16f86665-5295-44f9-9214-48aacaf1862e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:47.104546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16f86665-5295-44f9-9214-48aacaf1862e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:47.105068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16f86665-5295-44f9-9214-48aacaf1862e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:47.105811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16f86665-5295-44f9-9214-48aacaf1862e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:47.106848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16f86665-5295-44f9-9214-48aacaf1862e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:47.107319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16f86665-5295-44f9-9214-48aacaf1862e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:47.107774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16f86665-5295-44f9-9214-48aacaf1862e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:47.292051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-16f86665-5295-44f9-9214-48aacaf1862e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:47.308324 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-16f86665-5295-44f9-9214-48aacaf1862e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1341 microversion: 2.1 time: 0.216223 Aug 18 12:15:47.309353 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3590/6244] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:47 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1341 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:47.533488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e071123a-ef47-40fa-80ec-9dce686bfe2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:15:47.536874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e071123a-ef47-40fa-80ec-9dce686bfe2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:47.551614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e071123a-ef47-40fa-80ec-9dce686bfe2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:47.552471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e071123a-ef47-40fa-80ec-9dce686bfe2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:47.553052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e071123a-ef47-40fa-80ec-9dce686bfe2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:47.554361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e071123a-ef47-40fa-80ec-9dce686bfe2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:47.555799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e071123a-ef47-40fa-80ec-9dce686bfe2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:47.558071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e071123a-ef47-40fa-80ec-9dce686bfe2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:47.648436 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e071123a-ef47-40fa-80ec-9dce686bfe2e tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "POST /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30/action" status: 200 len: 24565 microversion: 2.1 time: 0.120126 Aug 18 12:15:47.651263 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3591/6245] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:15:47 2022] POST /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30/action => generated 24565 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:15:48.335475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-89dc87dd-9424-4e2d-8632-8d41bc2fc538 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:48.337689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-89dc87dd-9424-4e2d-8632-8d41bc2fc538 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:48.345372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89dc87dd-9424-4e2d-8632-8d41bc2fc538 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:48.346767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89dc87dd-9424-4e2d-8632-8d41bc2fc538 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:48.347792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89dc87dd-9424-4e2d-8632-8d41bc2fc538 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:48.348595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89dc87dd-9424-4e2d-8632-8d41bc2fc538 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:48.349083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89dc87dd-9424-4e2d-8632-8d41bc2fc538 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:48.349552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89dc87dd-9424-4e2d-8632-8d41bc2fc538 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:48.616137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-89dc87dd-9424-4e2d-8632-8d41bc2fc538 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:48.635438 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-89dc87dd-9424-4e2d-8632-8d41bc2fc538 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1341 microversion: 2.1 time: 0.304146 Aug 18 12:15:48.636511 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3592/6246] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:48 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1341 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:49.665262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c07b2450-abd3-4618-ba26-eb23b032a752 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:49.666774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c07b2450-abd3-4618-ba26-eb23b032a752 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:49.681348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c07b2450-abd3-4618-ba26-eb23b032a752 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:49.682455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c07b2450-abd3-4618-ba26-eb23b032a752 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:49.683296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c07b2450-abd3-4618-ba26-eb23b032a752 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:49.687101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c07b2450-abd3-4618-ba26-eb23b032a752 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:49.688510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c07b2450-abd3-4618-ba26-eb23b032a752 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:49.689724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c07b2450-abd3-4618-ba26-eb23b032a752 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:49.973929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c07b2450-abd3-4618-ba26-eb23b032a752 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:49.985710 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c07b2450-abd3-4618-ba26-eb23b032a752 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1341 microversion: 2.1 time: 0.326401 Aug 18 12:15:49.998414 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3593/6247] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:49 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1341 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:51.012687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3796032d-546b-445e-a819-17f2b3a1a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:51.013993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3796032d-546b-445e-a819-17f2b3a1a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:51.018248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:15:51.021811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:15:51.030800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3796032d-546b-445e-a819-17f2b3a1a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:51.031744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3796032d-546b-445e-a819-17f2b3a1a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:51.032490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3796032d-546b-445e-a819-17f2b3a1a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:51.033757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3796032d-546b-445e-a819-17f2b3a1a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:51.034570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3796032d-546b-445e-a819-17f2b3a1a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:51.035279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3796032d-546b-445e-a819-17f2b3a1a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:51.231376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3796032d-546b-445e-a819-17f2b3a1a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:51.240549 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3796032d-546b-445e-a819-17f2b3a1a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1341 microversion: 2.1 time: 0.234601 Aug 18 12:15:51.254458 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3594/6248] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:51 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1341 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:52.275183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0500e0df-5e4a-44b2-a2d0-9e97f3638783 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:52.276644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0500e0df-5e4a-44b2-a2d0-9e97f3638783 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:52.289037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0500e0df-5e4a-44b2-a2d0-9e97f3638783 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:52.290061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0500e0df-5e4a-44b2-a2d0-9e97f3638783 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:52.290940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0500e0df-5e4a-44b2-a2d0-9e97f3638783 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:52.292442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0500e0df-5e4a-44b2-a2d0-9e97f3638783 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:52.293322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0500e0df-5e4a-44b2-a2d0-9e97f3638783 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:52.294119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0500e0df-5e4a-44b2-a2d0-9e97f3638783 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:52.542407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0500e0df-5e4a-44b2-a2d0-9e97f3638783 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:52.555476 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0500e0df-5e4a-44b2-a2d0-9e97f3638783 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1341 microversion: 2.1 time: 0.288415 Aug 18 12:15:52.556560 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3595/6249] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:52 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1341 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:15:53.589495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-159af751-f54e-4bbc-8bd0-90075bf1c4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:53.590303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-159af751-f54e-4bbc-8bd0-90075bf1c4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:53.597892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-159af751-f54e-4bbc-8bd0-90075bf1c4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:53.598407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-159af751-f54e-4bbc-8bd0-90075bf1c4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:53.598906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-159af751-f54e-4bbc-8bd0-90075bf1c4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:53.599659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-159af751-f54e-4bbc-8bd0-90075bf1c4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:53.600148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-159af751-f54e-4bbc-8bd0-90075bf1c4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:53.600603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-159af751-f54e-4bbc-8bd0-90075bf1c4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:53.620694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:15:53.799693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-159af751-f54e-4bbc-8bd0-90075bf1c4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:53.815990 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-159af751-f54e-4bbc-8bd0-90075bf1c4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1341 microversion: 2.1 time: 0.231009 Aug 18 12:15:53.817067 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3596/6250] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:53 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1341 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:54.854005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2a7577a-654c-43a9-912f-113fbea9904e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:54.855382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b2a7577a-654c-43a9-912f-113fbea9904e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:54.862568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2a7577a-654c-43a9-912f-113fbea9904e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:54.863083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2a7577a-654c-43a9-912f-113fbea9904e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:54.863548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2a7577a-654c-43a9-912f-113fbea9904e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:54.864329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2a7577a-654c-43a9-912f-113fbea9904e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:54.864820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2a7577a-654c-43a9-912f-113fbea9904e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:54.865316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2a7577a-654c-43a9-912f-113fbea9904e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:55.021490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b2a7577a-654c-43a9-912f-113fbea9904e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:55.030557 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b2a7577a-654c-43a9-912f-113fbea9904e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1341 microversion: 2.1 time: 0.180877 Aug 18 12:15:55.031175 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3597/6251] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:54 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1341 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:56.065418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cbe7922a-9e67-4ee9-b671-dcf364ea724f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:56.066324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cbe7922a-9e67-4ee9-b671-dcf364ea724f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:56.075808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbe7922a-9e67-4ee9-b671-dcf364ea724f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:56.076514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbe7922a-9e67-4ee9-b671-dcf364ea724f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:56.077107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbe7922a-9e67-4ee9-b671-dcf364ea724f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:56.078024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbe7922a-9e67-4ee9-b671-dcf364ea724f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:56.078681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbe7922a-9e67-4ee9-b671-dcf364ea724f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:56.079377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbe7922a-9e67-4ee9-b671-dcf364ea724f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:56.369248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cbe7922a-9e67-4ee9-b671-dcf364ea724f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:56.383255 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cbe7922a-9e67-4ee9-b671-dcf364ea724f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1341 microversion: 2.1 time: 0.321366 Aug 18 12:15:56.383878 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3598/6252] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:56 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1341 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:57.406575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e587686-3080-482e-bbd3-be30c9013448 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:57.407592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7e587686-3080-482e-bbd3-be30c9013448 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:57.416002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e587686-3080-482e-bbd3-be30c9013448 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:57.416726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e587686-3080-482e-bbd3-be30c9013448 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:57.417252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e587686-3080-482e-bbd3-be30c9013448 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:57.418072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e587686-3080-482e-bbd3-be30c9013448 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:57.418751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e587686-3080-482e-bbd3-be30c9013448 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:57.419339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e587686-3080-482e-bbd3-be30c9013448 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:57.580789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7e587686-3080-482e-bbd3-be30c9013448 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:57.594229 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e587686-3080-482e-bbd3-be30c9013448 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1341 microversion: 2.1 time: 0.191713 Aug 18 12:15:57.595285 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3599/6253] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:57 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1341 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:58.636685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7d3640d-7ed4-420f-a633-316243603376 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:58.640512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a7d3640d-7ed4-420f-a633-316243603376 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:58.652626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7d3640d-7ed4-420f-a633-316243603376 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:58.653538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7d3640d-7ed4-420f-a633-316243603376 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:58.654301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7d3640d-7ed4-420f-a633-316243603376 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:58.655315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7d3640d-7ed4-420f-a633-316243603376 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:58.655953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7d3640d-7ed4-420f-a633-316243603376 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:58.656557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7d3640d-7ed4-420f-a633-316243603376 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:58.919467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a7d3640d-7ed4-420f-a633-316243603376 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:15:58.937379 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a7d3640d-7ed4-420f-a633-316243603376 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1341 microversion: 2.1 time: 0.307745 Aug 18 12:15:58.938532 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3600/6254] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:58 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1341 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:15:59.977404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7fbe7628-8f9b-4af4-8941-9f923643ba30 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:15:59.980284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7fbe7628-8f9b-4af4-8941-9f923643ba30 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:15:59.996108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7fbe7628-8f9b-4af4-8941-9f923643ba30 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:59.996837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7fbe7628-8f9b-4af4-8941-9f923643ba30 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:15:59.997679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7fbe7628-8f9b-4af4-8941-9f923643ba30 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:15:59.999113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7fbe7628-8f9b-4af4-8941-9f923643ba30 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:15:59.999984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7fbe7628-8f9b-4af4-8941-9f923643ba30 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:00.000792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7fbe7628-8f9b-4af4-8941-9f923643ba30 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:00.323101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7fbe7628-8f9b-4af4-8941-9f923643ba30 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:00.339029 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7fbe7628-8f9b-4af4-8941-9f923643ba30 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1341 microversion: 2.1 time: 0.370209 Aug 18 12:16:00.352151 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3601/6255] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:15:59 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1341 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:00.379573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1c50a8b3-dcf5-4806-b02d-1ee029a2c00a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:00.380405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1c50a8b3-dcf5-4806-b02d-1ee029a2c00a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:00.388861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c50a8b3-dcf5-4806-b02d-1ee029a2c00a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:00.389757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c50a8b3-dcf5-4806-b02d-1ee029a2c00a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:00.390325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c50a8b3-dcf5-4806-b02d-1ee029a2c00a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:00.391211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c50a8b3-dcf5-4806-b02d-1ee029a2c00a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:00.391765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c50a8b3-dcf5-4806-b02d-1ee029a2c00a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:00.392292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c50a8b3-dcf5-4806-b02d-1ee029a2c00a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:00.426518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1c50a8b3-dcf5-4806-b02d-1ee029a2c00a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:16:00.532033 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1c50a8b3-dcf5-4806-b02d-1ee029a2c00a tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 204 len: 0 microversion: 2.1 time: 0.163373 Aug 18 12:16:00.533386 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3602/6256] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:16:00 2022] DELETE /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:16:00.542854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5bada832-847d-48b9-9528-93e071558197 req-5197de0a-ec7c-4ac9-ac28-0c552775ae8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a9b252c-618b-4ec9-b518-3bebbf1d0a30", "tag": "0b1f6e7a-181a-4fdd-bbaf-18537ead2b5c"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:16:00.557375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5bada832-847d-48b9-9528-93e071558197 req-5197de0a-ec7c-4ac9-ac28-0c552775ae8b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:00.557894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5bada832-847d-48b9-9528-93e071558197 req-5197de0a-ec7c-4ac9-ac28-0c552775ae8b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:00.558362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5bada832-847d-48b9-9528-93e071558197 req-5197de0a-ec7c-4ac9-ac28-0c552775ae8b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:00.574379 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5bada832-847d-48b9-9528-93e071558197 req-5197de0a-ec7c-4ac9-ac28-0c552775ae8b service nova] Creating event network-changed:0b1f6e7a-181a-4fdd-bbaf-18537ead2b5c for instance 2a9b252c-618b-4ec9-b518-3bebbf1d0a30 on n-h2-853611-3 Aug 18 12:16:00.580198 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5bada832-847d-48b9-9528-93e071558197 req-5197de0a-ec7c-4ac9-ac28-0c552775ae8b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044039 Aug 18 12:16:00.581219 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3603/6257] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:16:00.588840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c106f15b-69b0-47cf-8cec-e450be5ea60c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:00.589745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c106f15b-69b0-47cf-8cec-e450be5ea60c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:00.598079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c106f15b-69b0-47cf-8cec-e450be5ea60c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:00.598648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c106f15b-69b0-47cf-8cec-e450be5ea60c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:00.599125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c106f15b-69b0-47cf-8cec-e450be5ea60c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:00.599891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c106f15b-69b0-47cf-8cec-e450be5ea60c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:00.601235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c106f15b-69b0-47cf-8cec-e450be5ea60c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:00.601974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c106f15b-69b0-47cf-8cec-e450be5ea60c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:00.864347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c106f15b-69b0-47cf-8cec-e450be5ea60c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:00.883095 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c106f15b-69b0-47cf-8cec-e450be5ea60c tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1687 microversion: 2.1 time: 0.300048 Aug 18 12:16:00.884520 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3604/6258] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:00 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1687 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:16:01.381859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fc507897-dcb1-4a5c-b8ba-b1c0e5ff2dd4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:01.383297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fc507897-dcb1-4a5c-b8ba-b1c0e5ff2dd4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:01.400627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc507897-dcb1-4a5c-b8ba-b1c0e5ff2dd4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:01.402217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc507897-dcb1-4a5c-b8ba-b1c0e5ff2dd4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:01.403541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc507897-dcb1-4a5c-b8ba-b1c0e5ff2dd4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:01.405365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc507897-dcb1-4a5c-b8ba-b1c0e5ff2dd4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:01.406948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc507897-dcb1-4a5c-b8ba-b1c0e5ff2dd4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:01.408117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc507897-dcb1-4a5c-b8ba-b1c0e5ff2dd4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:01.697764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fc507897-dcb1-4a5c-b8ba-b1c0e5ff2dd4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:01.717482 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fc507897-dcb1-4a5c-b8ba-b1c0e5ff2dd4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1387 microversion: 2.1 time: 0.344142 Aug 18 12:16:01.718745 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3605/6259] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:01 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1387 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:16:01.922766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1575b04-e6db-474b-88e7-169e7ad93528 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:01.923444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1575b04-e6db-474b-88e7-169e7ad93528 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:01.932102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1575b04-e6db-474b-88e7-169e7ad93528 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:01.932628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1575b04-e6db-474b-88e7-169e7ad93528 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:01.933097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1575b04-e6db-474b-88e7-169e7ad93528 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:01.933846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1575b04-e6db-474b-88e7-169e7ad93528 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:01.934329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1575b04-e6db-474b-88e7-169e7ad93528 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:01.934811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1575b04-e6db-474b-88e7-169e7ad93528 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:02.369933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a1575b04-e6db-474b-88e7-169e7ad93528 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916631a932304b6c9cec7ef622e2069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75eb549fd4b44a4fb569dbfc1f507c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:02.389597 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1575b04-e6db-474b-88e7-169e7ad93528 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 200 len: 1687 microversion: 2.1 time: 0.469988 Aug 18 12:16:02.392045 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3606/6260] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:01 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 1687 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:02.703090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-76617c15-0c91-4cf1-b3c3-9001fed06b57 req-adc4d291-5510-40ca-a5d0-dd80f4a9558e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a9b252c-618b-4ec9-b518-3bebbf1d0a30", "name": "network-vif-deleted", "tag": "0b1f6e7a-181a-4fdd-bbaf-18537ead2b5c"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:16:02.727191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-76617c15-0c91-4cf1-b3c3-9001fed06b57 req-adc4d291-5510-40ca-a5d0-dd80f4a9558e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:02.728178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-76617c15-0c91-4cf1-b3c3-9001fed06b57 req-adc4d291-5510-40ca-a5d0-dd80f4a9558e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:02.729233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-76617c15-0c91-4cf1-b3c3-9001fed06b57 req-adc4d291-5510-40ca-a5d0-dd80f4a9558e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:02.753072 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-76617c15-0c91-4cf1-b3c3-9001fed06b57 req-adc4d291-5510-40ca-a5d0-dd80f4a9558e service nova] Creating event network-vif-deleted:0b1f6e7a-181a-4fdd-bbaf-18537ead2b5c for instance 2a9b252c-618b-4ec9-b518-3bebbf1d0a30 on n-h2-853611-3 Aug 18 12:16:02.761006 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-76617c15-0c91-4cf1-b3c3-9001fed06b57 req-adc4d291-5510-40ca-a5d0-dd80f4a9558e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072458 Aug 18 12:16:02.762270 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3607/6261] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:16:02.769315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7c5fea34-a392-48a9-9927-864455c6d4d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:02.769974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7c5fea34-a392-48a9-9927-864455c6d4d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:02.777416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c5fea34-a392-48a9-9927-864455c6d4d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:02.777932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c5fea34-a392-48a9-9927-864455c6d4d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:02.778364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c5fea34-a392-48a9-9927-864455c6d4d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:02.779243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c5fea34-a392-48a9-9927-864455c6d4d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:02.779723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c5fea34-a392-48a9-9927-864455c6d4d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:02.780447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c5fea34-a392-48a9-9927-864455c6d4d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:02.975380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7c5fea34-a392-48a9-9927-864455c6d4d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:02.984986 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7c5fea34-a392-48a9-9927-864455c6d4d4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1375 microversion: 2.1 time: 0.220888 Aug 18 12:16:02.985669 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3608/6262] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:02 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1375 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:16:03.418857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f000cf4b-5399-4066-b91a-203cef5565b8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:03.420491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f000cf4b-5399-4066-b91a-203cef5565b8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] [instance: 2a9b252c-618b-4ec9-b518-3bebbf1d0a30] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:03.427495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f000cf4b-5399-4066-b91a-203cef5565b8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:03.429507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f000cf4b-5399-4066-b91a-203cef5565b8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:03.430120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f000cf4b-5399-4066-b91a-203cef5565b8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:03.431105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f000cf4b-5399-4066-b91a-203cef5565b8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:03.431727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f000cf4b-5399-4066-b91a-203cef5565b8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:03.432512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f000cf4b-5399-4066-b91a-203cef5565b8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:03.452051 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-f000cf4b-5399-4066-b91a-203cef5565b8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] HTTP exception thrown: Instance 2a9b252c-618b-4ec9-b518-3bebbf1d0a30 could not be found. Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f000cf4b-5399-4066-b91a-203cef5565b8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Request method failure captured: Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 HTTP/1.1 Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_itpP3k2OQKDfTawi0kf9ygIVnfNVtKyQf6_y09raSLkqAu--Orcs7bv0PWg_M-JZcd1pI700Biy17mLWE4K6g_euM6YJIeHjhMvih1w9wsUGvonHEvYQGTA-0UcBLRhtzeS3Igm0aFaFMmv_Cl5gbWHiLNqehP12OxQYhEvTlr4F3c Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 75eb549fd4b44a4fb569dbfc1f507c3c Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-325550642 Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/75eb549fd4b44a4fb569dbfc1f507c3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestNetworkAdvancedServerOps-325550642 Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 75eb549fd4b44a4fb569dbfc1f507c3c Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-325550642 Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestNetworkAdvancedServerOps-325550642-project Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 916631a932304b6c9cec7ef622e2069d Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestNetworkAdvancedServerOps-325550642-project Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 2a9b252c-618b-4ec9-b518-3bebbf1d0a30 could not be found. Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '2a9b252c-618b-4ec9-b518-3bebbf1d0a30'} Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a9b252c-618b-4ec9-b518-3bebbf1d0a30 could not be found. Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a9b252c-618b-4ec9-b518-3bebbf1d0a30 could not be found. Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:03.454070 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:16:03.463836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:03.463836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:03.463836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:16:03.463836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:16:03.463836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:16:03.463836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:16:03.463836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a9b252c-618b-4ec9-b518-3bebbf1d0a30 could not be found. Aug 18 12:16:03.463836 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:03.463836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f000cf4b-5399-4066-b91a-203cef5565b8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Returning 404 to user: Instance 2a9b252c-618b-4ec9-b518-3bebbf1d0a30 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:16:03.463836 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f000cf4b-5399-4066-b91a-203cef5565b8 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30" status: 404 len: 111 microversion: 2.1 time: 0.043456 Aug 18 12:16:03.463836 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3609/6263] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:03 2022] GET /compute/v2.1/servers/2a9b252c-618b-4ec9-b518-3bebbf1d0a30 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:16:04.012424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-80f257d4-478f-423d-9983-e558dbdca940 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:04.013503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-80f257d4-478f-423d-9983-e558dbdca940 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:04.024949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80f257d4-478f-423d-9983-e558dbdca940 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:04.025816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80f257d4-478f-423d-9983-e558dbdca940 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:04.026673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80f257d4-478f-423d-9983-e558dbdca940 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:04.027790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80f257d4-478f-423d-9983-e558dbdca940 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:04.028601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80f257d4-478f-423d-9983-e558dbdca940 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:04.029417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80f257d4-478f-423d-9983-e558dbdca940 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:04.260090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-80f257d4-478f-423d-9983-e558dbdca940 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:04.275114 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-80f257d4-478f-423d-9983-e558dbdca940 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1375 microversion: 2.1 time: 0.267935 Aug 18 12:16:04.276107 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3610/6264] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:04 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1375 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:05.311037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab656b5e-21d6-453d-a7f2-82c1ffcbd83d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:05.312306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ab656b5e-21d6-453d-a7f2-82c1ffcbd83d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:05.320729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab656b5e-21d6-453d-a7f2-82c1ffcbd83d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:05.321450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab656b5e-21d6-453d-a7f2-82c1ffcbd83d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:05.322050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab656b5e-21d6-453d-a7f2-82c1ffcbd83d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:05.323016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab656b5e-21d6-453d-a7f2-82c1ffcbd83d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:05.323615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab656b5e-21d6-453d-a7f2-82c1ffcbd83d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:05.324169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab656b5e-21d6-453d-a7f2-82c1ffcbd83d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:05.693772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ab656b5e-21d6-453d-a7f2-82c1ffcbd83d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:05.707098 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab656b5e-21d6-453d-a7f2-82c1ffcbd83d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1375 microversion: 2.1 time: 0.400760 Aug 18 12:16:05.709668 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3611/6265] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:05 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1375 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:06.748810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1bae1257-4f5f-4b1c-9902-79e18b8109ff tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:06.752049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1bae1257-4f5f-4b1c-9902-79e18b8109ff tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:06.764792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bae1257-4f5f-4b1c-9902-79e18b8109ff tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:06.765631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bae1257-4f5f-4b1c-9902-79e18b8109ff tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:06.766497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bae1257-4f5f-4b1c-9902-79e18b8109ff tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:06.767669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bae1257-4f5f-4b1c-9902-79e18b8109ff tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:06.768417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bae1257-4f5f-4b1c-9902-79e18b8109ff tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:06.769156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bae1257-4f5f-4b1c-9902-79e18b8109ff tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:07.070818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1bae1257-4f5f-4b1c-9902-79e18b8109ff tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:07.099125 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1bae1257-4f5f-4b1c-9902-79e18b8109ff tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1375 microversion: 2.1 time: 0.359593 Aug 18 12:16:07.107021 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3612/6266] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:06 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1375 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:16:08.162818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ecc47312-1bc5-42e6-80ec-c513e5fad98b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:08.164003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ecc47312-1bc5-42e6-80ec-c513e5fad98b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:08.174120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecc47312-1bc5-42e6-80ec-c513e5fad98b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:08.174847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecc47312-1bc5-42e6-80ec-c513e5fad98b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:08.175433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecc47312-1bc5-42e6-80ec-c513e5fad98b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:08.176384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecc47312-1bc5-42e6-80ec-c513e5fad98b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:08.177106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecc47312-1bc5-42e6-80ec-c513e5fad98b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:08.177676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecc47312-1bc5-42e6-80ec-c513e5fad98b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:08.203384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:16:08.392255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ecc47312-1bc5-42e6-80ec-c513e5fad98b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:08.407801 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ecc47312-1bc5-42e6-80ec-c513e5fad98b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1375 microversion: 2.1 time: 0.251593 Aug 18 12:16:08.409283 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3613/6267] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:08 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1375 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:08.419469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-72115a76-06b6-487b-bd95-bcc55ca96548 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] Calling method '.version_select at 0x7f519fb88a60>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:08.459539 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-72115a76-06b6-487b-bd95-bcc55ca96548 tempest-TestNetworkAdvancedServerOps-325550642 tempest-TestNetworkAdvancedServerOps-325550642-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1860673782" status: 202 len: 0 microversion: 2.1 time: 0.047606 Aug 18 12:16:08.460817 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3614/6268] 10.222.0.73 () {58 vars in 1284 bytes} [Thu Aug 18 12:16:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1860673782 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:16:09.435629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d4177761-91ac-4041-82b6-22588b608c6d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:09.436745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d4177761-91ac-4041-82b6-22588b608c6d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:09.444971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4177761-91ac-4041-82b6-22588b608c6d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:09.445460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4177761-91ac-4041-82b6-22588b608c6d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:09.445919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4177761-91ac-4041-82b6-22588b608c6d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:09.446714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4177761-91ac-4041-82b6-22588b608c6d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:09.447225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4177761-91ac-4041-82b6-22588b608c6d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:09.447662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4177761-91ac-4041-82b6-22588b608c6d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:09.678507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d4177761-91ac-4041-82b6-22588b608c6d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:09.692797 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d4177761-91ac-4041-82b6-22588b608c6d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1375 microversion: 2.1 time: 0.261571 Aug 18 12:16:09.695283 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3615/6269] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:09 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1375 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:10.729558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f43c2b18-03e3-42b5-84b7-b44c716b37ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:10.731178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f43c2b18-03e3-42b5-84b7-b44c716b37ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:10.745563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f43c2b18-03e3-42b5-84b7-b44c716b37ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:10.746787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f43c2b18-03e3-42b5-84b7-b44c716b37ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:10.747724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f43c2b18-03e3-42b5-84b7-b44c716b37ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:10.749248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f43c2b18-03e3-42b5-84b7-b44c716b37ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:10.750004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f43c2b18-03e3-42b5-84b7-b44c716b37ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:10.750776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f43c2b18-03e3-42b5-84b7-b44c716b37ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:10.996341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f43c2b18-03e3-42b5-84b7-b44c716b37ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:11.009943 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f43c2b18-03e3-42b5-84b7-b44c716b37ca tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1375 microversion: 2.1 time: 0.291650 Aug 18 12:16:11.030250 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3616/6270] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:10 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1375 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:16:12.059254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d3911f40-655a-4e6e-b964-0ef7fc0c21ab req-78eda512-1e42-4916-9dd6-5482ebbca343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698da23f-ef02-4164-9a7f-a3a48f9dd142", "name": "network-vif-plugged", "status": "completed", "tag": "4032d49d-7767-4f40-ba64-80a7b0c58656"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:16:12.070578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d3911f40-655a-4e6e-b964-0ef7fc0c21ab req-78eda512-1e42-4916-9dd6-5482ebbca343 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:12.071133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d3911f40-655a-4e6e-b964-0ef7fc0c21ab req-78eda512-1e42-4916-9dd6-5482ebbca343 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:12.071514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d3911f40-655a-4e6e-b964-0ef7fc0c21ab req-78eda512-1e42-4916-9dd6-5482ebbca343 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:12.085634 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d3911f40-655a-4e6e-b964-0ef7fc0c21ab req-78eda512-1e42-4916-9dd6-5482ebbca343 service nova] Creating event network-vif-plugged:4032d49d-7767-4f40-ba64-80a7b0c58656 for instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 on n-h1-853611-3 Aug 18 12:16:12.091632 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d3911f40-655a-4e6e-b964-0ef7fc0c21ab req-78eda512-1e42-4916-9dd6-5482ebbca343 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.328467 Aug 18 12:16:12.092668 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3617/6271] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:16:12.098141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7583015e-3faa-4bac-949d-6e12ffaa509d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:12.099453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7583015e-3faa-4bac-949d-6e12ffaa509d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:12.101617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:16:12.107977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7583015e-3faa-4bac-949d-6e12ffaa509d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:12.108460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7583015e-3faa-4bac-949d-6e12ffaa509d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:12.108913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7583015e-3faa-4bac-949d-6e12ffaa509d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:12.109674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7583015e-3faa-4bac-949d-6e12ffaa509d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:12.110238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7583015e-3faa-4bac-949d-6e12ffaa509d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:12.110670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7583015e-3faa-4bac-949d-6e12ffaa509d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:12.304840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7583015e-3faa-4bac-949d-6e12ffaa509d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:12.323473 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7583015e-3faa-4bac-949d-6e12ffaa509d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1375 microversion: 2.1 time: 0.228900 Aug 18 12:16:12.324726 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3618/6272] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:12 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1375 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:16:13.347424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-caae43ec-4d6b-4a23-bab8-6dfe4d6ea4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:13.349344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-caae43ec-4d6b-4a23-bab8-6dfe4d6ea4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:13.359848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-caae43ec-4d6b-4a23-bab8-6dfe4d6ea4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:13.360523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-caae43ec-4d6b-4a23-bab8-6dfe4d6ea4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:13.361134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-caae43ec-4d6b-4a23-bab8-6dfe4d6ea4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:13.362192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-caae43ec-4d6b-4a23-bab8-6dfe4d6ea4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:13.362834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-caae43ec-4d6b-4a23-bab8-6dfe4d6ea4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:13.363471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-caae43ec-4d6b-4a23-bab8-6dfe4d6ea4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:13.587143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-caae43ec-4d6b-4a23-bab8-6dfe4d6ea4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:13.595586 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-caae43ec-4d6b-4a23-bab8-6dfe4d6ea4ba tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1375 microversion: 2.1 time: 0.252726 Aug 18 12:16:13.596224 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3619/6273] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:13 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1375 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:14.619052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-38e961e0-0c8a-425e-b47d-c929e2c08f86 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:14.620133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-38e961e0-0c8a-425e-b47d-c929e2c08f86 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:14.627382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38e961e0-0c8a-425e-b47d-c929e2c08f86 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:14.627941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38e961e0-0c8a-425e-b47d-c929e2c08f86 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:14.628393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38e961e0-0c8a-425e-b47d-c929e2c08f86 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:14.629195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38e961e0-0c8a-425e-b47d-c929e2c08f86 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:14.630195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38e961e0-0c8a-425e-b47d-c929e2c08f86 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:14.630673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-38e961e0-0c8a-425e-b47d-c929e2c08f86 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:14.807341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-38e961e0-0c8a-425e-b47d-c929e2c08f86 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:14.816550 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-38e961e0-0c8a-425e-b47d-c929e2c08f86 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1563 microversion: 2.1 time: 0.202431 Aug 18 12:16:14.817964 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3620/6274] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:14 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1563 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:14.838622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aa0a9bcb-6b4e-409d-93aa-59d4dbbab4e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:14.839256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aa0a9bcb-6b4e-409d-93aa-59d4dbbab4e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:14.845807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa0a9bcb-6b4e-409d-93aa-59d4dbbab4e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:14.846314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa0a9bcb-6b4e-409d-93aa-59d4dbbab4e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:14.846795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa0a9bcb-6b4e-409d-93aa-59d4dbbab4e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:14.847527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa0a9bcb-6b4e-409d-93aa-59d4dbbab4e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:14.847992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa0a9bcb-6b4e-409d-93aa-59d4dbbab4e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:14.848431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aa0a9bcb-6b4e-409d-93aa-59d4dbbab4e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:15.016350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aa0a9bcb-6b4e-409d-93aa-59d4dbbab4e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:15.025741 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aa0a9bcb-6b4e-409d-93aa-59d4dbbab4e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1563 microversion: 2.1 time: 0.190999 Aug 18 12:16:15.026354 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3621/6275] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:14 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1563 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:15.116242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df6d2655-b5f3-4e33-97e1-86f0a950d086 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:15.117136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df6d2655-b5f3-4e33-97e1-86f0a950d086 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:15.124336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6d2655-b5f3-4e33-97e1-86f0a950d086 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:15.124837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6d2655-b5f3-4e33-97e1-86f0a950d086 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:15.125289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6d2655-b5f3-4e33-97e1-86f0a950d086 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:15.126037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6d2655-b5f3-4e33-97e1-86f0a950d086 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:15.126505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6d2655-b5f3-4e33-97e1-86f0a950d086 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:15.126947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6d2655-b5f3-4e33-97e1-86f0a950d086 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:15.159331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df6d2655-b5f3-4e33-97e1-86f0a950d086 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:16:15.267711 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df6d2655-b5f3-4e33-97e1-86f0a950d086 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "DELETE /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 204 len: 0 microversion: 2.1 time: 0.156642 Aug 18 12:16:15.268572 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3622/6276] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:16:15 2022] DELETE /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:16:15.278882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5256c332-5998-4752-9a41-e9679eb41558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:15.279769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5256c332-5998-4752-9a41-e9679eb41558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:15.286458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5256c332-5998-4752-9a41-e9679eb41558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:15.286964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5256c332-5998-4752-9a41-e9679eb41558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:15.287419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5256c332-5998-4752-9a41-e9679eb41558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:15.288259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5256c332-5998-4752-9a41-e9679eb41558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:15.288798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5256c332-5998-4752-9a41-e9679eb41558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:15.289263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5256c332-5998-4752-9a41-e9679eb41558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:15.447810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5256c332-5998-4752-9a41-e9679eb41558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:15.456876 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5256c332-5998-4752-9a41-e9679eb41558 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1569 microversion: 2.1 time: 0.182685 Aug 18 12:16:15.458695 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3623/6277] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:15 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:16.482022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-645c3cbb-b1e3-4a9b-a6a5-4c202367b771 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:16.482795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-645c3cbb-b1e3-4a9b-a6a5-4c202367b771 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:16.493005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-645c3cbb-b1e3-4a9b-a6a5-4c202367b771 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:16.493516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-645c3cbb-b1e3-4a9b-a6a5-4c202367b771 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:16.493973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-645c3cbb-b1e3-4a9b-a6a5-4c202367b771 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:16.494789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-645c3cbb-b1e3-4a9b-a6a5-4c202367b771 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:16.495598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-645c3cbb-b1e3-4a9b-a6a5-4c202367b771 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:16.496106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-645c3cbb-b1e3-4a9b-a6a5-4c202367b771 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:16.674574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-645c3cbb-b1e3-4a9b-a6a5-4c202367b771 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:16.687300 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-645c3cbb-b1e3-4a9b-a6a5-4c202367b771 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1569 microversion: 2.1 time: 0.209105 Aug 18 12:16:16.688170 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3624/6278] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:16 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:16:17.420015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-54b226ce-879c-48ca-a5a6-03cb0f94c442 req-eaa8b4af-d86a-46ef-8628-2c5af0680ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698da23f-ef02-4164-9a7f-a3a48f9dd142", "name": "network-vif-deleted", "tag": "4032d49d-7767-4f40-ba64-80a7b0c58656"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:16:17.458537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-54b226ce-879c-48ca-a5a6-03cb0f94c442 req-eaa8b4af-d86a-46ef-8628-2c5af0680ad6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:17.462636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-54b226ce-879c-48ca-a5a6-03cb0f94c442 req-eaa8b4af-d86a-46ef-8628-2c5af0680ad6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:17.463604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-54b226ce-879c-48ca-a5a6-03cb0f94c442 req-eaa8b4af-d86a-46ef-8628-2c5af0680ad6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:17.513727 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-54b226ce-879c-48ca-a5a6-03cb0f94c442 req-eaa8b4af-d86a-46ef-8628-2c5af0680ad6 service nova] Creating event network-vif-deleted:4032d49d-7767-4f40-ba64-80a7b0c58656 for instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 on n-h1-853611-3 Aug 18 12:16:17.525245 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-54b226ce-879c-48ca-a5a6-03cb0f94c442 req-eaa8b4af-d86a-46ef-8628-2c5af0680ad6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109318 Aug 18 12:16:17.527066 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3625/6279] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:16:17.736600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-23b7b16e-8be3-4a71-acb4-70855d14ba38 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:17.739314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-23b7b16e-8be3-4a71-acb4-70855d14ba38 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:17.751122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23b7b16e-8be3-4a71-acb4-70855d14ba38 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:17.752084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23b7b16e-8be3-4a71-acb4-70855d14ba38 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:17.753220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23b7b16e-8be3-4a71-acb4-70855d14ba38 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:17.755704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23b7b16e-8be3-4a71-acb4-70855d14ba38 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:17.756756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23b7b16e-8be3-4a71-acb4-70855d14ba38 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:17.757728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23b7b16e-8be3-4a71-acb4-70855d14ba38 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:17.865024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-23b7b16e-8be3-4a71-acb4-70855d14ba38 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:17.874305 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-23b7b16e-8be3-4a71-acb4-70855d14ba38 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1360 microversion: 2.1 time: 0.149967 Aug 18 12:16:17.875256 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3626/6280] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:17 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:18.902541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a49101c6-a3d5-408b-86c5-d5787fdff405 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:18.904100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a49101c6-a3d5-408b-86c5-d5787fdff405 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:18.914767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a49101c6-a3d5-408b-86c5-d5787fdff405 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:18.915391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a49101c6-a3d5-408b-86c5-d5787fdff405 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:18.915863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a49101c6-a3d5-408b-86c5-d5787fdff405 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:18.916764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a49101c6-a3d5-408b-86c5-d5787fdff405 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:18.917452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a49101c6-a3d5-408b-86c5-d5787fdff405 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:18.918017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a49101c6-a3d5-408b-86c5-d5787fdff405 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:19.049344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a49101c6-a3d5-408b-86c5-d5787fdff405 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:19.065632 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a49101c6-a3d5-408b-86c5-d5787fdff405 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1360 microversion: 2.1 time: 0.170035 Aug 18 12:16:19.067435 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3627/6281] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:18 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:16:20.092145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fe87d123-3177-4eb4-87ae-a6d26eb244f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:20.093521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fe87d123-3177-4eb4-87ae-a6d26eb244f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:20.109509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe87d123-3177-4eb4-87ae-a6d26eb244f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:20.110709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe87d123-3177-4eb4-87ae-a6d26eb244f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:20.114338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe87d123-3177-4eb4-87ae-a6d26eb244f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:20.114338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe87d123-3177-4eb4-87ae-a6d26eb244f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:20.114338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe87d123-3177-4eb4-87ae-a6d26eb244f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:20.114338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe87d123-3177-4eb4-87ae-a6d26eb244f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:20.235022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fe87d123-3177-4eb4-87ae-a6d26eb244f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:20.258855 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fe87d123-3177-4eb4-87ae-a6d26eb244f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1360 microversion: 2.1 time: 0.172281 Aug 18 12:16:20.260018 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3628/6282] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:20 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1360 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:21.291310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8287613f-282a-45ce-985f-0115ff90b804 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:21.292481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8287613f-282a-45ce-985f-0115ff90b804 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:21.306229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8287613f-282a-45ce-985f-0115ff90b804 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:21.307170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8287613f-282a-45ce-985f-0115ff90b804 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:21.308001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8287613f-282a-45ce-985f-0115ff90b804 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:21.309383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8287613f-282a-45ce-985f-0115ff90b804 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:21.310199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8287613f-282a-45ce-985f-0115ff90b804 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:21.311064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8287613f-282a-45ce-985f-0115ff90b804 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:21.418159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8287613f-282a-45ce-985f-0115ff90b804 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:21.433197 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8287613f-282a-45ce-985f-0115ff90b804 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1360 microversion: 2.1 time: 0.150894 Aug 18 12:16:21.434285 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3629/6283] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:21 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:22.469060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bfd72cd0-4f43-4b0e-98f2-c6d5972932f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:22.470598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bfd72cd0-4f43-4b0e-98f2-c6d5972932f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:22.479819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfd72cd0-4f43-4b0e-98f2-c6d5972932f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:22.480424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfd72cd0-4f43-4b0e-98f2-c6d5972932f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:22.480948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfd72cd0-4f43-4b0e-98f2-c6d5972932f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:22.481862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfd72cd0-4f43-4b0e-98f2-c6d5972932f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:22.482591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfd72cd0-4f43-4b0e-98f2-c6d5972932f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:22.483053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bfd72cd0-4f43-4b0e-98f2-c6d5972932f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:22.614992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bfd72cd0-4f43-4b0e-98f2-c6d5972932f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:22.619238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:16:22.633739 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bfd72cd0-4f43-4b0e-98f2-c6d5972932f1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 200 len: 1360 microversion: 2.1 time: 0.169673 Aug 18 12:16:22.634927 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3630/6284] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:22 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:23.660979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fad7490d-e91a-411b-8a11-90037a2e8da0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:23.662202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fad7490d-e91a-411b-8a11-90037a2e8da0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:23.673207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fad7490d-e91a-411b-8a11-90037a2e8da0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:23.673955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fad7490d-e91a-411b-8a11-90037a2e8da0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:23.675232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fad7490d-e91a-411b-8a11-90037a2e8da0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:23.676778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fad7490d-e91a-411b-8a11-90037a2e8da0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:23.677454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fad7490d-e91a-411b-8a11-90037a2e8da0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:23.677983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fad7490d-e91a-411b-8a11-90037a2e8da0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:23.698650 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-fad7490d-e91a-411b-8a11-90037a2e8da0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fad7490d-e91a-411b-8a11-90037a2e8da0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 HTTP/1.1 Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '698da23f-ef02-4164-9a7f-a3a48f9dd142'} Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:16:23.701124 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:23.712575 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:23.712575 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:16:23.712575 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:16:23.712575 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:16:23.712575 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:16:23.712575 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:23.712575 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:23.712575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fad7490d-e91a-411b-8a11-90037a2e8da0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:16:23.712575 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fad7490d-e91a-411b-8a11-90037a2e8da0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 404 len: 111 microversion: 2.1 time: 0.049028 Aug 18 12:16:23.712575 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3631/6285] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:23 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:16:28.132764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7939dff9-0bf9-407f-8e05-65cd9b892c31 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:28.133521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7939dff9-0bf9-407f-8e05-65cd9b892c31 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:28.141924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7939dff9-0bf9-407f-8e05-65cd9b892c31 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:28.142402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7939dff9-0bf9-407f-8e05-65cd9b892c31 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:28.143570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7939dff9-0bf9-407f-8e05-65cd9b892c31 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:28.145339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7939dff9-0bf9-407f-8e05-65cd9b892c31 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:28.145980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7939dff9-0bf9-407f-8e05-65cd9b892c31 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:28.146589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7939dff9-0bf9-407f-8e05-65cd9b892c31 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:28.177973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7939dff9-0bf9-407f-8e05-65cd9b892c31 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:16:28.284936 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7939dff9-0bf9-407f-8e05-65cd9b892c31 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 204 len: 0 microversion: 2.1 time: 0.156812 Aug 18 12:16:28.285571 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3632/6286] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:16:28 2022] DELETE /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:16:28.296254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-498d1bdc-2b28-4f17-b604-e0659b103c29 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:28.297148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-498d1bdc-2b28-4f17-b604-e0659b103c29 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:28.305931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-498d1bdc-2b28-4f17-b604-e0659b103c29 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:28.306475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-498d1bdc-2b28-4f17-b604-e0659b103c29 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:28.306952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-498d1bdc-2b28-4f17-b604-e0659b103c29 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:28.307748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-498d1bdc-2b28-4f17-b604-e0659b103c29 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:28.308242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-498d1bdc-2b28-4f17-b604-e0659b103c29 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:28.308698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-498d1bdc-2b28-4f17-b604-e0659b103c29 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:28.472431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-498d1bdc-2b28-4f17-b604-e0659b103c29 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:28.481976 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-498d1bdc-2b28-4f17-b604-e0659b103c29 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1410 microversion: 2.1 time: 0.190735 Aug 18 12:16:28.482877 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3633/6287] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:28 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1410 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:29.506045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e2d98c2-8a73-4dba-93f2-ddae736d32f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:29.506978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e2d98c2-8a73-4dba-93f2-ddae736d32f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:29.514232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2d98c2-8a73-4dba-93f2-ddae736d32f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:29.514782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2d98c2-8a73-4dba-93f2-ddae736d32f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:29.515245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2d98c2-8a73-4dba-93f2-ddae736d32f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:29.516003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2d98c2-8a73-4dba-93f2-ddae736d32f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:29.516563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2d98c2-8a73-4dba-93f2-ddae736d32f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:29.517024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e2d98c2-8a73-4dba-93f2-ddae736d32f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:29.688358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e2d98c2-8a73-4dba-93f2-ddae736d32f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:29.699893 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e2d98c2-8a73-4dba-93f2-ddae736d32f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1410 microversion: 2.1 time: 0.198468 Aug 18 12:16:29.700751 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3634/6288] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:29 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1410 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:30.374045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7958ec2c-cd82-4f60-b98c-72ff06976840 req-06de8fd5-2761-4c66-b398-d163dedae2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc03f12d-d434-4356-ae4a-a6c9c5b77e6b", "name": "network-vif-deleted", "tag": "b4471b6f-0117-4a63-866e-e170838f180e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:16:30.385224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7958ec2c-cd82-4f60-b98c-72ff06976840 req-06de8fd5-2761-4c66-b398-d163dedae2e4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:30.385722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7958ec2c-cd82-4f60-b98c-72ff06976840 req-06de8fd5-2761-4c66-b398-d163dedae2e4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:30.386566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7958ec2c-cd82-4f60-b98c-72ff06976840 req-06de8fd5-2761-4c66-b398-d163dedae2e4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:30.399974 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7958ec2c-cd82-4f60-b98c-72ff06976840 req-06de8fd5-2761-4c66-b398-d163dedae2e4 service nova] Creating event network-vif-deleted:b4471b6f-0117-4a63-866e-e170838f180e for instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b on n-h2-853611-3 Aug 18 12:16:30.405874 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7958ec2c-cd82-4f60-b98c-72ff06976840 req-06de8fd5-2761-4c66-b398-d163dedae2e4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035644 Aug 18 12:16:30.406879 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3635/6289] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:16:30.731911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cb267202-6f33-4597-bb7d-9b8fc1c2158f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:30.733300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cb267202-6f33-4597-bb7d-9b8fc1c2158f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:30.741806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb267202-6f33-4597-bb7d-9b8fc1c2158f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:30.742814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb267202-6f33-4597-bb7d-9b8fc1c2158f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:30.743384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb267202-6f33-4597-bb7d-9b8fc1c2158f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:30.744245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb267202-6f33-4597-bb7d-9b8fc1c2158f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:30.744832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb267202-6f33-4597-bb7d-9b8fc1c2158f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:30.745372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb267202-6f33-4597-bb7d-9b8fc1c2158f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:30.829636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cb267202-6f33-4597-bb7d-9b8fc1c2158f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:30.848192 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cb267202-6f33-4597-bb7d-9b8fc1c2158f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1201 microversion: 2.1 time: 0.120233 Aug 18 12:16:30.849889 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3636/6290] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:30 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1201 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:31.875040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bc9a6643-781b-4525-b868-679d58a96471 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:31.876765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bc9a6643-781b-4525-b868-679d58a96471 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:31.888523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc9a6643-781b-4525-b868-679d58a96471 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:31.889455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc9a6643-781b-4525-b868-679d58a96471 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:31.890162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc9a6643-781b-4525-b868-679d58a96471 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:31.891137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc9a6643-781b-4525-b868-679d58a96471 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:31.891718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc9a6643-781b-4525-b868-679d58a96471 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:31.892221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc9a6643-781b-4525-b868-679d58a96471 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:31.988342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bc9a6643-781b-4525-b868-679d58a96471 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:31.999267 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bc9a6643-781b-4525-b868-679d58a96471 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1201 microversion: 2.1 time: 0.129988 Aug 18 12:16:31.999977 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3637/6291] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:31 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1201 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:33.037617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a444aa23-15ab-4300-aec0-de0f04071dec tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:33.038817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a444aa23-15ab-4300-aec0-de0f04071dec tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:33.047521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a444aa23-15ab-4300-aec0-de0f04071dec tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:33.048123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a444aa23-15ab-4300-aec0-de0f04071dec tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:33.050083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a444aa23-15ab-4300-aec0-de0f04071dec tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:33.051174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a444aa23-15ab-4300-aec0-de0f04071dec tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:33.052388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a444aa23-15ab-4300-aec0-de0f04071dec tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:33.053036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a444aa23-15ab-4300-aec0-de0f04071dec tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:33.164784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a444aa23-15ab-4300-aec0-de0f04071dec tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:33.175992 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a444aa23-15ab-4300-aec0-de0f04071dec tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1201 microversion: 2.1 time: 0.145989 Aug 18 12:16:33.176854 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3638/6292] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:33 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1201 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:34.197692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2871668-5b9f-4b91-850b-dea5f610b5e9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:34.198730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b2871668-5b9f-4b91-850b-dea5f610b5e9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:34.207087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2871668-5b9f-4b91-850b-dea5f610b5e9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:34.207618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2871668-5b9f-4b91-850b-dea5f610b5e9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:34.208145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2871668-5b9f-4b91-850b-dea5f610b5e9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:34.208928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2871668-5b9f-4b91-850b-dea5f610b5e9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:34.209419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2871668-5b9f-4b91-850b-dea5f610b5e9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:34.209876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2871668-5b9f-4b91-850b-dea5f610b5e9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:34.310960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b2871668-5b9f-4b91-850b-dea5f610b5e9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:34.323325 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b2871668-5b9f-4b91-850b-dea5f610b5e9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1201 microversion: 2.1 time: 0.129667 Aug 18 12:16:34.324126 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3639/6293] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:34 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1201 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:16:35.362316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aea2379e-7924-4617-9615-6dc9949907f0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:35.363536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aea2379e-7924-4617-9615-6dc9949907f0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:35.377164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aea2379e-7924-4617-9615-6dc9949907f0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:35.378214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aea2379e-7924-4617-9615-6dc9949907f0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:35.379061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aea2379e-7924-4617-9615-6dc9949907f0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:35.380467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aea2379e-7924-4617-9615-6dc9949907f0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:35.381347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aea2379e-7924-4617-9615-6dc9949907f0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:35.382522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aea2379e-7924-4617-9615-6dc9949907f0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:35.502629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aea2379e-7924-4617-9615-6dc9949907f0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:16:35.516584 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aea2379e-7924-4617-9615-6dc9949907f0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 200 len: 1201 microversion: 2.1 time: 0.159620 Aug 18 12:16:35.518087 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3640/6294] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:35 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 1201 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:16:36.547276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6b74b9e4-8534-4a31-9df5-666f47b0a3b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:36.549096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6b74b9e4-8534-4a31-9df5-666f47b0a3b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:36.567076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b74b9e4-8534-4a31-9df5-666f47b0a3b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:36.567970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b74b9e4-8534-4a31-9df5-666f47b0a3b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:36.568789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b74b9e4-8534-4a31-9df5-666f47b0a3b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:36.570131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b74b9e4-8534-4a31-9df5-666f47b0a3b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:36.571063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b74b9e4-8534-4a31-9df5-666f47b0a3b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:36.571541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b74b9e4-8534-4a31-9df5-666f47b0a3b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:36.593302 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-6b74b9e4-8534-4a31-9df5-666f47b0a3b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6b74b9e4-8534-4a31-9df5-666f47b0a3b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b HTTP/1.1 Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'dc03f12d-d434-4356-ae4a-a6c9c5b77e6b'} Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:16:36.596528 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:36.607564 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:36.607564 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:16:36.607564 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:16:36.607564 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:16:36.607564 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:16:36.607564 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:36.607564 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:36.607564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6b74b9e4-8534-4a31-9df5-666f47b0a3b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:16:36.607564 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6b74b9e4-8534-4a31-9df5-666f47b0a3b9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 404 len: 111 microversion: 2.1 time: 0.059063 Aug 18 12:16:36.607564 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3641/6295] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:36 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:16:38.755897 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:16:38.756590 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:16:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:16:38.839091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-53ad3c66-f7bb-45dd-882a-738daed303f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:38.839757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-53ad3c66-f7bb-45dd-882a-738daed303f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:38.848677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53ad3c66-f7bb-45dd-882a-738daed303f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:38.849195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53ad3c66-f7bb-45dd-882a-738daed303f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:38.849980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53ad3c66-f7bb-45dd-882a-738daed303f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:38.850804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53ad3c66-f7bb-45dd-882a-738daed303f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:38.851286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53ad3c66-f7bb-45dd-882a-738daed303f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:38.851950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53ad3c66-f7bb-45dd-882a-738daed303f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:38.868981 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-53ad3c66-f7bb-45dd-882a-738daed303f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-53ad3c66-f7bb-45dd-882a-738daed303f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 HTTP/1.1 Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '698da23f-ef02-4164-9a7f-a3a48f9dd142'} Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:16:38.870698 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-53ad3c66-f7bb-45dd-882a-738daed303f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-53ad3c66-f7bb-45dd-882a-738daed303f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "DELETE /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 404 len: 111 microversion: 2.1 time: 0.037321 Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3642/6296] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:16:38 2022] DELETE /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c52fadec-3fd7-45d8-9ba3-f6443b742d41 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:38.883670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c52fadec-3fd7-45d8-9ba3-f6443b742d41 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 698da23f-ef02-4164-9a7f-a3a48f9dd142] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:38.890101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52fadec-3fd7-45d8-9ba3-f6443b742d41 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:38.890691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52fadec-3fd7-45d8-9ba3-f6443b742d41 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:38.891180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52fadec-3fd7-45d8-9ba3-f6443b742d41 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:38.891968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52fadec-3fd7-45d8-9ba3-f6443b742d41 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:38.892455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52fadec-3fd7-45d8-9ba3-f6443b742d41 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:38.892905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c52fadec-3fd7-45d8-9ba3-f6443b742d41 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:38.909636 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-c52fadec-3fd7-45d8-9ba3-f6443b742d41 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c52fadec-3fd7-45d8-9ba3-f6443b742d41 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 HTTP/1.1 Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '698da23f-ef02-4164-9a7f-a3a48f9dd142'} Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:16:38.911303 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:38.920351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:38.920351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:16:38.920351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:16:38.920351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:16:38.920351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:16:38.920351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. Aug 18 12:16:38.920351 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:38.920351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c52fadec-3fd7-45d8-9ba3-f6443b742d41 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance 698da23f-ef02-4164-9a7f-a3a48f9dd142 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:16:38.920351 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c52fadec-3fd7-45d8-9ba3-f6443b742d41 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142" status: 404 len: 111 microversion: 2.1 time: 0.034899 Aug 18 12:16:38.920351 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3643/6297] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:38 2022] GET /compute/v2.1/servers/698da23f-ef02-4164-9a7f-a3a48f9dd142 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:16:39.543228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-989e48c3-13e2-4af6-b743-bfb9d16e6e7c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:39.544253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-989e48c3-13e2-4af6-b743-bfb9d16e6e7c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:39.561641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-989e48c3-13e2-4af6-b743-bfb9d16e6e7c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:39.562749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-989e48c3-13e2-4af6-b743-bfb9d16e6e7c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:39.564568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-989e48c3-13e2-4af6-b743-bfb9d16e6e7c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:39.565975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-989e48c3-13e2-4af6-b743-bfb9d16e6e7c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:39.566898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-989e48c3-13e2-4af6-b743-bfb9d16e6e7c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:39.567685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-989e48c3-13e2-4af6-b743-bfb9d16e6e7c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:39.594989 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-989e48c3-13e2-4af6-b743-bfb9d16e6e7c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-989e48c3-13e2-4af6-b743-bfb9d16e6e7c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b HTTP/1.1 Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'dc03f12d-d434-4356-ae4a-a6c9c5b77e6b'} Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:16:39.598630 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:16:39.613401 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:39.613401 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:39.613401 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:16:39.613401 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:39.613401 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:39.613401 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:16:39.613401 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:16:39.613401 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:16:39.613401 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:16:39.613401 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:39.613401 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:39.613401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-989e48c3-13e2-4af6-b743-bfb9d16e6e7c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:16:39.613401 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-989e48c3-13e2-4af6-b743-bfb9d16e6e7c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 404 len: 111 microversion: 2.1 time: 0.064739 Aug 18 12:16:39.613401 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3644/6298] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:16:39 2022] DELETE /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:16:39.617396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-31d191e4-73e9-4897-9f58-fbd018ddccc2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:16:39.618103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-31d191e4-73e9-4897-9f58-fbd018ddccc2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: dc03f12d-d434-4356-ae4a-a6c9c5b77e6b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:16:39.630300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31d191e4-73e9-4897-9f58-fbd018ddccc2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:39.631210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31d191e4-73e9-4897-9f58-fbd018ddccc2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:39.632073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31d191e4-73e9-4897-9f58-fbd018ddccc2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:39.633402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31d191e4-73e9-4897-9f58-fbd018ddccc2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:16:39.634288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31d191e4-73e9-4897-9f58-fbd018ddccc2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:16:39.635149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31d191e4-73e9-4897-9f58-fbd018ddccc2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:16:39.670318 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-31d191e4-73e9-4897-9f58-fbd018ddccc2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-31d191e4-73e9-4897-9f58-fbd018ddccc2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b HTTP/1.1 Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'dc03f12d-d434-4356-ae4a-a6c9c5b77e6b'} Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:16:39.673310 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:39.685246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:16:39.685246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:16:39.685246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:16:39.685246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:16:39.685246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:16:39.685246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. Aug 18 12:16:39.685246 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:16:39.685246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-31d191e4-73e9-4897-9f58-fbd018ddccc2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance dc03f12d-d434-4356-ae4a-a6c9c5b77e6b could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:16:39.685246 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-31d191e4-73e9-4897-9f58-fbd018ddccc2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b" status: 404 len: 111 microversion: 2.1 time: 0.066170 Aug 18 12:16:39.685246 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3645/6299] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:16:39 2022] GET /compute/v2.1/servers/dc03f12d-d434-4356-ae4a-a6c9c5b77e6b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:16:39.787233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fce4a508-09e4-4125-a85c-b4aa718e3648 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Action: 'create', calling method: .version_select at 0x7f519fb88c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-107783012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5kGFpdSEUtPUN9tIqypuOdpbCkFqj8KLFamBUD8bCOkRx+X/Rj7D8+ixHqhTTMc98+to56+gn3kTT8F69mWJq9p5mbJgSmC6SoiEbFQIgcq0E0LSgFnU5Rlc8vNjTTzg=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:16:39.807708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-fce4a508-09e4-4125-a85c-b4aa718e3648 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:16:39.816488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-fce4a508-09e4-4125-a85c-b4aa718e3648 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for user 033d6aa61b5340189fbc5d895d3e8cba and project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:16:39.853289 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fce4a508-09e4-4125-a85c-b4aa718e3648 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.072246 Aug 18 12:16:39.854443 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3646/6300] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:16:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:17:00.692040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:17:00.692905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:17:00.693485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:17:00.698381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1014212910", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-107783012", "security_groups": [{"name": "tempest-secgroup-smoke-149503047"}], "block_device_mapping_v2": [{"uuid": "d2284d07-e7fe-4bfd-99c0-4e16414756a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11e09857-d75b-4b2b-82b3-fa5db86d3937"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:17:00.841721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] validate_networks() for [('11e09857-d75b-4b2b-82b3-fa5db86d3937', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:17:01.373682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:17:01.374468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:17:01.375337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:17:01.376091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:17:01.376843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:17:01.395211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:01.396133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:01.396969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:01.398415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:01.399313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:01.400132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:01.438217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:17:01.449389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for user 033d6aa61b5340189fbc5d895d3e8cba and project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:17:01.534790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:17:01.537000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d2284d07-e7fe-4bfd-99c0-4e16414756a5',volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:17:01.721451 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df6b6bd4-9dae-4286-97e8-0469d2d3757c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.031365 Aug 18 12:17:01.722938 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3647/6301] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:17:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:17:01.735816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bd924df6-3b65-492d-b40a-a9b5579230e5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:01.736644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bd924df6-3b65-492d-b40a-a9b5579230e5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:01.809187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bd924df6-3b65-492d-b40a-a9b5579230e5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:01.817216 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bd924df6-3b65-492d-b40a-a9b5579230e5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1094 microversion: 2.1 time: 0.086709 Aug 18 12:17:01.818309 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3648/6302] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:01 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:17:02.839125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-15bc68f2-afc6-41e6-b7e5-7623893d9368 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:02.841558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-15bc68f2-afc6-41e6-b7e5-7623893d9368 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:02.853034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15bc68f2-afc6-41e6-b7e5-7623893d9368 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:02.853820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15bc68f2-afc6-41e6-b7e5-7623893d9368 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:02.854567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15bc68f2-afc6-41e6-b7e5-7623893d9368 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:02.855745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15bc68f2-afc6-41e6-b7e5-7623893d9368 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:02.856440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15bc68f2-afc6-41e6-b7e5-7623893d9368 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:02.857733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-15bc68f2-afc6-41e6-b7e5-7623893d9368 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:03.402910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-15bc68f2-afc6-41e6-b7e5-7623893d9368 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:03.416398 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-15bc68f2-afc6-41e6-b7e5-7623893d9368 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1200 microversion: 2.1 time: 0.580946 Aug 18 12:17:03.417586 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3649/6303] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:02 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1200 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:17:04.445027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-99bf8598-8912-43b9-8e6c-081a8992d6b1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:04.446636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-99bf8598-8912-43b9-8e6c-081a8992d6b1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:04.456905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99bf8598-8912-43b9-8e6c-081a8992d6b1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:04.457721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99bf8598-8912-43b9-8e6c-081a8992d6b1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:04.458467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99bf8598-8912-43b9-8e6c-081a8992d6b1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:04.459481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99bf8598-8912-43b9-8e6c-081a8992d6b1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:04.460162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99bf8598-8912-43b9-8e6c-081a8992d6b1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:04.460813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-99bf8598-8912-43b9-8e6c-081a8992d6b1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:04.790166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-99bf8598-8912-43b9-8e6c-081a8992d6b1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:04.803385 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-99bf8598-8912-43b9-8e6c-081a8992d6b1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1277 microversion: 2.1 time: 0.362152 Aug 18 12:17:04.804247 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3650/6304] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:04 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1277 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:17:05.604027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-10a19e8f-441c-4b8c-9504-b1dd62292c57 req-b0564787-cbf4-420c-99b9-2915c0e65501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12", "tag": "f2248902-41ff-464e-b99e-09522d9334a7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:17:05.625821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-10a19e8f-441c-4b8c-9504-b1dd62292c57 req-b0564787-cbf4-420c-99b9-2915c0e65501 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:05.626527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-10a19e8f-441c-4b8c-9504-b1dd62292c57 req-b0564787-cbf4-420c-99b9-2915c0e65501 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:05.626985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-10a19e8f-441c-4b8c-9504-b1dd62292c57 req-b0564787-cbf4-420c-99b9-2915c0e65501 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:05.645029 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-10a19e8f-441c-4b8c-9504-b1dd62292c57 req-b0564787-cbf4-420c-99b9-2915c0e65501 service nova] Creating event network-changed:f2248902-41ff-464e-b99e-09522d9334a7 for instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 on n-h2-853611-3 Aug 18 12:17:05.650668 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-10a19e8f-441c-4b8c-9504-b1dd62292c57 req-b0564787-cbf4-420c-99b9-2915c0e65501 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050393 Aug 18 12:17:05.651496 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3651/6305] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:17:05.830213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1dc86060-ae16-4ea0-b0e4-77335c47e5c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:05.831383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1dc86060-ae16-4ea0-b0e4-77335c47e5c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:05.841312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dc86060-ae16-4ea0-b0e4-77335c47e5c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:05.842880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dc86060-ae16-4ea0-b0e4-77335c47e5c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:05.843670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dc86060-ae16-4ea0-b0e4-77335c47e5c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:05.845195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dc86060-ae16-4ea0-b0e4-77335c47e5c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:05.846532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dc86060-ae16-4ea0-b0e4-77335c47e5c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:05.847477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1dc86060-ae16-4ea0-b0e4-77335c47e5c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:06.207609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1dc86060-ae16-4ea0-b0e4-77335c47e5c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:06.223471 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1dc86060-ae16-4ea0-b0e4-77335c47e5c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1277 microversion: 2.1 time: 0.399401 Aug 18 12:17:06.225010 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3652/6306] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:05 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1277 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:17:07.257989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f88c12bb-786b-402f-bbae-9d5e57f79f8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:07.259128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f88c12bb-786b-402f-bbae-9d5e57f79f8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:07.268983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f88c12bb-786b-402f-bbae-9d5e57f79f8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:07.269726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f88c12bb-786b-402f-bbae-9d5e57f79f8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:07.270310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f88c12bb-786b-402f-bbae-9d5e57f79f8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:07.271425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f88c12bb-786b-402f-bbae-9d5e57f79f8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:07.272075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f88c12bb-786b-402f-bbae-9d5e57f79f8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:07.272748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f88c12bb-786b-402f-bbae-9d5e57f79f8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:07.494258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f88c12bb-786b-402f-bbae-9d5e57f79f8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:07.504766 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f88c12bb-786b-402f-bbae-9d5e57f79f8c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1277 microversion: 2.1 time: 0.250906 Aug 18 12:17:07.505503 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3653/6307] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:07 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1277 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:17:08.539926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ca5549a5-c2d2-46b8-8170-cb53e89f6b6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:08.540794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ca5549a5-c2d2-46b8-8170-cb53e89f6b6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:08.563679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca5549a5-c2d2-46b8-8170-cb53e89f6b6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:08.564205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca5549a5-c2d2-46b8-8170-cb53e89f6b6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:08.564672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca5549a5-c2d2-46b8-8170-cb53e89f6b6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:08.565886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca5549a5-c2d2-46b8-8170-cb53e89f6b6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:08.566520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca5549a5-c2d2-46b8-8170-cb53e89f6b6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:08.566944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ca5549a5-c2d2-46b8-8170-cb53e89f6b6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:08.784182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ca5549a5-c2d2-46b8-8170-cb53e89f6b6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:08.796014 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ca5549a5-c2d2-46b8-8170-cb53e89f6b6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1277 microversion: 2.1 time: 0.260139 Aug 18 12:17:08.796791 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3654/6308] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:08 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1277 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:17:09.826779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-abf54dbc-aef7-4471-9831-111e797a06a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:09.827956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-abf54dbc-aef7-4471-9831-111e797a06a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:09.842450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abf54dbc-aef7-4471-9831-111e797a06a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:09.843389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abf54dbc-aef7-4471-9831-111e797a06a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:09.844183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abf54dbc-aef7-4471-9831-111e797a06a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:09.845507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abf54dbc-aef7-4471-9831-111e797a06a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:09.846372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abf54dbc-aef7-4471-9831-111e797a06a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:09.847442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abf54dbc-aef7-4471-9831-111e797a06a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:10.041720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-abf54dbc-aef7-4471-9831-111e797a06a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:10.051111 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-abf54dbc-aef7-4471-9831-111e797a06a1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1265 microversion: 2.1 time: 0.232241 Aug 18 12:17:10.051795 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3655/6309] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:09 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:17:11.072873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-107a5bfc-b364-4aa7-9324-183715f54396 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:11.073728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-107a5bfc-b364-4aa7-9324-183715f54396 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:11.081112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107a5bfc-b364-4aa7-9324-183715f54396 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:11.081572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107a5bfc-b364-4aa7-9324-183715f54396 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:11.082226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107a5bfc-b364-4aa7-9324-183715f54396 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:11.083212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107a5bfc-b364-4aa7-9324-183715f54396 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:11.083717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107a5bfc-b364-4aa7-9324-183715f54396 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:11.084164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107a5bfc-b364-4aa7-9324-183715f54396 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:11.280220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-107a5bfc-b364-4aa7-9324-183715f54396 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:11.293510 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-107a5bfc-b364-4aa7-9324-183715f54396 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1265 microversion: 2.1 time: 0.224314 Aug 18 12:17:11.295092 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3656/6310] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:11 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:17:12.316570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b7e828f1-f5af-43c4-9e46-ff5f9259f3b6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:12.317303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b7e828f1-f5af-43c4-9e46-ff5f9259f3b6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:12.319354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:17:12.320270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:17:12.329439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7e828f1-f5af-43c4-9e46-ff5f9259f3b6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:12.330020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7e828f1-f5af-43c4-9e46-ff5f9259f3b6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:12.330726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7e828f1-f5af-43c4-9e46-ff5f9259f3b6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:12.331621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7e828f1-f5af-43c4-9e46-ff5f9259f3b6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:12.332165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7e828f1-f5af-43c4-9e46-ff5f9259f3b6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:12.332678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7e828f1-f5af-43c4-9e46-ff5f9259f3b6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:12.491106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b7e828f1-f5af-43c4-9e46-ff5f9259f3b6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:12.501982 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b7e828f1-f5af-43c4-9e46-ff5f9259f3b6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1265 microversion: 2.1 time: 0.189382 Aug 18 12:17:12.502629 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3657/6311] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:12 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:17:13.532465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9056f30a-ae22-4627-aea9-6e1d06d9b85a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:13.533353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9056f30a-ae22-4627-aea9-6e1d06d9b85a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:13.541204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9056f30a-ae22-4627-aea9-6e1d06d9b85a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:13.541724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9056f30a-ae22-4627-aea9-6e1d06d9b85a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:13.542180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9056f30a-ae22-4627-aea9-6e1d06d9b85a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:13.542968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9056f30a-ae22-4627-aea9-6e1d06d9b85a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:13.544010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9056f30a-ae22-4627-aea9-6e1d06d9b85a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:13.544804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9056f30a-ae22-4627-aea9-6e1d06d9b85a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:13.705045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9056f30a-ae22-4627-aea9-6e1d06d9b85a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:13.717874 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9056f30a-ae22-4627-aea9-6e1d06d9b85a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1265 microversion: 2.1 time: 0.190143 Aug 18 12:17:13.718357 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3658/6312] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:13 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:17:14.741296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b0442aca-5346-4283-ab06-e38127cd25b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:14.742140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b0442aca-5346-4283-ab06-e38127cd25b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:14.751354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0442aca-5346-4283-ab06-e38127cd25b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:14.751874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0442aca-5346-4283-ab06-e38127cd25b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:14.752338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0442aca-5346-4283-ab06-e38127cd25b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:14.753100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0442aca-5346-4283-ab06-e38127cd25b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:14.753586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0442aca-5346-4283-ab06-e38127cd25b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:14.754044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0442aca-5346-4283-ab06-e38127cd25b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:14.937811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b0442aca-5346-4283-ab06-e38127cd25b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:14.952450 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b0442aca-5346-4283-ab06-e38127cd25b3 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1265 microversion: 2.1 time: 0.215251 Aug 18 12:17:14.953507 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3659/6313] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:14 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:17:15.978542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8647767b-61ee-44ad-90e0-175545e892de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:15.979270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8647767b-61ee-44ad-90e0-175545e892de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:15.987394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8647767b-61ee-44ad-90e0-175545e892de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:15.987898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8647767b-61ee-44ad-90e0-175545e892de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:15.988349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8647767b-61ee-44ad-90e0-175545e892de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:15.989069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8647767b-61ee-44ad-90e0-175545e892de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:15.989536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8647767b-61ee-44ad-90e0-175545e892de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:15.989973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8647767b-61ee-44ad-90e0-175545e892de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:16.154114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8647767b-61ee-44ad-90e0-175545e892de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:16.162228 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8647767b-61ee-44ad-90e0-175545e892de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1265 microversion: 2.1 time: 0.187740 Aug 18 12:17:16.162861 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3660/6314] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:15 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:17:17.185359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4902729d-141b-4c30-9da4-ae476f3fa72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:17.186200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4902729d-141b-4c30-9da4-ae476f3fa72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:17.193675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4902729d-141b-4c30-9da4-ae476f3fa72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:17.194180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4902729d-141b-4c30-9da4-ae476f3fa72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:17.194675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4902729d-141b-4c30-9da4-ae476f3fa72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:17.195410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4902729d-141b-4c30-9da4-ae476f3fa72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:17.195878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4902729d-141b-4c30-9da4-ae476f3fa72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:17.196324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4902729d-141b-4c30-9da4-ae476f3fa72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:17.373645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4902729d-141b-4c30-9da4-ae476f3fa72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:17.388372 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4902729d-141b-4c30-9da4-ae476f3fa72b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1265 microversion: 2.1 time: 0.206924 Aug 18 12:17:17.389496 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3661/6315] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:17 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:17:18.425624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1d4e8f05-a727-4473-9770-98515fab159a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:18.429461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1d4e8f05-a727-4473-9770-98515fab159a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:18.443236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d4e8f05-a727-4473-9770-98515fab159a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:18.444025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d4e8f05-a727-4473-9770-98515fab159a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:18.444752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d4e8f05-a727-4473-9770-98515fab159a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:18.445947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d4e8f05-a727-4473-9770-98515fab159a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:18.446805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d4e8f05-a727-4473-9770-98515fab159a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:18.447510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d4e8f05-a727-4473-9770-98515fab159a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:18.640471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1d4e8f05-a727-4473-9770-98515fab159a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:18.649319 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1d4e8f05-a727-4473-9770-98515fab159a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1265 microversion: 2.1 time: 0.231402 Aug 18 12:17:18.649931 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3662/6316] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:18 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:17:19.476665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-cecc1645-2c87-4037-9950-1c49aab0e4d0 req-e910d779-fe40-4dba-8a51-fadbb0405b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12", "name": "network-vif-plugged", "status": "completed", "tag": "f2248902-41ff-464e-b99e-09522d9334a7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:17:19.495025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cecc1645-2c87-4037-9950-1c49aab0e4d0 req-e910d779-fe40-4dba-8a51-fadbb0405b15 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:19.496712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cecc1645-2c87-4037-9950-1c49aab0e4d0 req-e910d779-fe40-4dba-8a51-fadbb0405b15 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:19.497143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cecc1645-2c87-4037-9950-1c49aab0e4d0 req-e910d779-fe40-4dba-8a51-fadbb0405b15 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:19.512967 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-cecc1645-2c87-4037-9950-1c49aab0e4d0 req-e910d779-fe40-4dba-8a51-fadbb0405b15 service nova] Creating event network-vif-plugged:f2248902-41ff-464e-b99e-09522d9334a7 for instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 on n-h2-853611-3 Aug 18 12:17:19.518984 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-cecc1645-2c87-4037-9950-1c49aab0e4d0 req-e910d779-fe40-4dba-8a51-fadbb0405b15 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050009 Aug 18 12:17:19.519631 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3663/6317] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:17:19.686244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e00afd54-fb49-46f7-9d39-2b0cc275c610 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:19.687233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e00afd54-fb49-46f7-9d39-2b0cc275c610 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:19.696656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e00afd54-fb49-46f7-9d39-2b0cc275c610 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:19.697374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e00afd54-fb49-46f7-9d39-2b0cc275c610 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:19.697941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e00afd54-fb49-46f7-9d39-2b0cc275c610 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:19.699039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e00afd54-fb49-46f7-9d39-2b0cc275c610 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:19.699697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e00afd54-fb49-46f7-9d39-2b0cc275c610 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:19.700422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e00afd54-fb49-46f7-9d39-2b0cc275c610 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:19.878388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e00afd54-fb49-46f7-9d39-2b0cc275c610 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:19.888061 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e00afd54-fb49-46f7-9d39-2b0cc275c610 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1265 microversion: 2.1 time: 0.207585 Aug 18 12:17:19.888777 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3664/6318] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:19 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:17:20.911670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-91f2078d-0c1f-4829-b001-d33791576ec2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:20.912596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-91f2078d-0c1f-4829-b001-d33791576ec2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:20.921534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91f2078d-0c1f-4829-b001-d33791576ec2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:20.922229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91f2078d-0c1f-4829-b001-d33791576ec2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:20.922812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91f2078d-0c1f-4829-b001-d33791576ec2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:20.923613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91f2078d-0c1f-4829-b001-d33791576ec2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:20.924133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91f2078d-0c1f-4829-b001-d33791576ec2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:20.924735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91f2078d-0c1f-4829-b001-d33791576ec2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:21.086575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-91f2078d-0c1f-4829-b001-d33791576ec2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:21.100512 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-91f2078d-0c1f-4829-b001-d33791576ec2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1453 microversion: 2.1 time: 0.192452 Aug 18 12:17:21.101636 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3665/6319] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:20 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1453 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:17:21.125364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ccab80b6-1f57-4356-9ee6-9f1c0b7da08b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:17:21.126214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ccab80b6-1f57-4356-9ee6-9f1c0b7da08b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:17:21.133504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccab80b6-1f57-4356-9ee6-9f1c0b7da08b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:21.134032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccab80b6-1f57-4356-9ee6-9f1c0b7da08b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:21.134534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccab80b6-1f57-4356-9ee6-9f1c0b7da08b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:21.135407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccab80b6-1f57-4356-9ee6-9f1c0b7da08b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:21.136009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccab80b6-1f57-4356-9ee6-9f1c0b7da08b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:21.137082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccab80b6-1f57-4356-9ee6-9f1c0b7da08b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:21.158408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:17:21.304231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ccab80b6-1f57-4356-9ee6-9f1c0b7da08b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:17:21.314518 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ccab80b6-1f57-4356-9ee6-9f1c0b7da08b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1453 microversion: 2.1 time: 0.194211 Aug 18 12:17:21.315138 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3666/6320] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:17:21 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1453 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:17:23.941101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-708ad02e-a778-4ca5-aeb2-e744c67c6f5d req-1dafdc5c-e830-4d63-ae2a-3bc8f1bef94f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12", "tag": "f2248902-41ff-464e-b99e-09522d9334a7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:17:23.953450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-708ad02e-a778-4ca5-aeb2-e744c67c6f5d req-1dafdc5c-e830-4d63-ae2a-3bc8f1bef94f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:17:23.953960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-708ad02e-a778-4ca5-aeb2-e744c67c6f5d req-1dafdc5c-e830-4d63-ae2a-3bc8f1bef94f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:17:23.954410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-708ad02e-a778-4ca5-aeb2-e744c67c6f5d req-1dafdc5c-e830-4d63-ae2a-3bc8f1bef94f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:17:23.968040 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-708ad02e-a778-4ca5-aeb2-e744c67c6f5d req-1dafdc5c-e830-4d63-ae2a-3bc8f1bef94f service nova] Creating event network-changed:f2248902-41ff-464e-b99e-09522d9334a7 for instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 on n-h2-853611-3 Aug 18 12:17:23.974589 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-708ad02e-a778-4ca5-aeb2-e744c67c6f5d req-1dafdc5c-e830-4d63-ae2a-3bc8f1bef94f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037764 Aug 18 12:17:23.975248 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3667/6321] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:18:20.107142 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:18:20.108246 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:18:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:18:36.690545 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:18:36.691869 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:18:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:19:01.904639 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4032abb9-abb5-4d06-9561-525583ca96a6] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 18 12:19:01.906005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:19:01.907140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:19:02.056765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6da35987-d139-4714-a72e-92543d41b731 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:02.057788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6da35987-d139-4714-a72e-92543d41b731 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:02.069055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da35987-d139-4714-a72e-92543d41b731 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:02.069897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da35987-d139-4714-a72e-92543d41b731 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:02.070713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da35987-d139-4714-a72e-92543d41b731 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:02.072000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da35987-d139-4714-a72e-92543d41b731 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:02.072828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da35987-d139-4714-a72e-92543d41b731 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:02.073580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da35987-d139-4714-a72e-92543d41b731 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:02.122060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6da35987-d139-4714-a72e-92543d41b731 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:19:02.223913 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6da35987-d139-4714-a72e-92543d41b731 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "DELETE /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 204 len: 0 microversion: 2.1 time: 0.320642 Aug 18 12:19:02.224667 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3668/6322] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:19:01 2022] DELETE /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:19:02.235766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1369c034-47cd-4971-a30e-2bf5ae00b9c7 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:02.237076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1369c034-47cd-4971-a30e-2bf5ae00b9c7 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:02.244088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1369c034-47cd-4971-a30e-2bf5ae00b9c7 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:02.244832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1369c034-47cd-4971-a30e-2bf5ae00b9c7 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:02.245411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1369c034-47cd-4971-a30e-2bf5ae00b9c7 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:02.246233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1369c034-47cd-4971-a30e-2bf5ae00b9c7 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:02.246808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1369c034-47cd-4971-a30e-2bf5ae00b9c7 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:02.247310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1369c034-47cd-4971-a30e-2bf5ae00b9c7 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:02.420439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1369c034-47cd-4971-a30e-2bf5ae00b9c7 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbdade40dd04a09b1794f6391d8abdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e069bf3fc4d058dff03e8470908b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:02.429161 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1369c034-47cd-4971-a30e-2bf5ae00b9c7 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 200 len: 1734 microversion: 2.1 time: 0.198235 Aug 18 12:19:02.429881 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3669/6323] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:02 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 1734 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:03.451638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c7dd2fed-3a2b-4fb2-ab36-e26b1bcfe2ac tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:03.452502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c7dd2fed-3a2b-4fb2-ab36-e26b1bcfe2ac tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:03.464709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7dd2fed-3a2b-4fb2-ab36-e26b1bcfe2ac tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:03.465511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7dd2fed-3a2b-4fb2-ab36-e26b1bcfe2ac tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:03.466089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7dd2fed-3a2b-4fb2-ab36-e26b1bcfe2ac tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:03.467124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7dd2fed-3a2b-4fb2-ab36-e26b1bcfe2ac tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:03.467671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7dd2fed-3a2b-4fb2-ab36-e26b1bcfe2ac tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:03.468179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c7dd2fed-3a2b-4fb2-ab36-e26b1bcfe2ac tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:03.478967 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] [4032abb9-abb5-4d06-9561-525583ca96a6] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 49112. Aug 18 12:19:03.648374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c7dd2fed-3a2b-4fb2-ab36-e26b1bcfe2ac tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbdade40dd04a09b1794f6391d8abdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e069bf3fc4d058dff03e8470908b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:03.664862 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c7dd2fed-3a2b-4fb2-ab36-e26b1bcfe2ac tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 200 len: 1734 microversion: 2.1 time: 0.216591 Aug 18 12:19:03.665777 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3670/6324] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:03 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:04.707178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-39258938-34f8-425c-9086-0cc3cc235f86 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:04.710873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-39258938-34f8-425c-9086-0cc3cc235f86 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:04.727866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39258938-34f8-425c-9086-0cc3cc235f86 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:04.729338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39258938-34f8-425c-9086-0cc3cc235f86 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:04.730192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39258938-34f8-425c-9086-0cc3cc235f86 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:04.731587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39258938-34f8-425c-9086-0cc3cc235f86 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:04.732479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39258938-34f8-425c-9086-0cc3cc235f86 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:04.733315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39258938-34f8-425c-9086-0cc3cc235f86 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:04.870717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-39258938-34f8-425c-9086-0cc3cc235f86 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dbdade40dd04a09b1794f6391d8abdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7e069bf3fc4d058dff03e8470908b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:04.913665 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-39258938-34f8-425c-9086-0cc3cc235f86 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 200 len: 1666 microversion: 2.1 time: 0.215789 Aug 18 12:19:04.931793 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3671/6325] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:04 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 1666 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:19:04.950734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d938cb99-1682-409b-8350-bdcfc24e3fe6 req-6cd6f0c4-daf5-46df-a913-80758c43a2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9046078e-c414-468b-93e2-07039eee2d23", "name": "network-vif-deleted", "tag": "0832579b-4a0f-4cda-8bff-a032eceb684b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:19:04.975639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d938cb99-1682-409b-8350-bdcfc24e3fe6 req-6cd6f0c4-daf5-46df-a913-80758c43a2d5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:04.976524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d938cb99-1682-409b-8350-bdcfc24e3fe6 req-6cd6f0c4-daf5-46df-a913-80758c43a2d5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:04.977407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d938cb99-1682-409b-8350-bdcfc24e3fe6 req-6cd6f0c4-daf5-46df-a913-80758c43a2d5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:05.001244 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d938cb99-1682-409b-8350-bdcfc24e3fe6 req-6cd6f0c4-daf5-46df-a913-80758c43a2d5 service nova] Creating event network-vif-deleted:0832579b-4a0f-4cda-8bff-a032eceb684b for instance 9046078e-c414-468b-93e2-07039eee2d23 on n-h1-853611-3 Aug 18 12:19:05.013000 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d938cb99-1682-409b-8350-bdcfc24e3fe6 req-6cd6f0c4-daf5-46df-a913-80758c43a2d5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078551 Aug 18 12:19:05.014293 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3672/6326] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:19:05.955623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb1596f8-566c-4a0f-91f6-d764edf28a5f tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:05.956838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bb1596f8-566c-4a0f-91f6-d764edf28a5f tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:05.964655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb1596f8-566c-4a0f-91f6-d764edf28a5f tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:05.965566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb1596f8-566c-4a0f-91f6-d764edf28a5f tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:05.966169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb1596f8-566c-4a0f-91f6-d764edf28a5f tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:05.967236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb1596f8-566c-4a0f-91f6-d764edf28a5f tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:05.967822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb1596f8-566c-4a0f-91f6-d764edf28a5f tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:05.968370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb1596f8-566c-4a0f-91f6-d764edf28a5f tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:05.987445 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-bb1596f8-566c-4a0f-91f6-d764edf28a5f tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] HTTP exception thrown: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb1596f8-566c-4a0f-91f6-d764edf28a5f tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Request method failure captured: Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 HTTP/1.1 Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iz6wMIfWbQb7cjB-0SmK-NqV-vVI32IfoegLOPQAH0b3VbaAaOVi8KAq4pKE8X-wf_4GPJFrQtNNleGvun970E8JZ4IS4Gq3hHaCrlcyyGhJpMgg_iDO8Mz59WoDyOYVmFkYPhBbyLr93k8UjHZe7MiVZ9YADgB-guQKyR2dgfyMso Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 9f7e069bf3fc4d058dff03e8470908b0 Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestServerBasicOps-1092283463 Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9f7e069bf3fc4d058dff03e8470908b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9f7e069bf3fc4d058dff03e8470908b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9f7e069bf3fc4d058dff03e8470908b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9f7e069bf3fc4d058dff03e8470908b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestServerBasicOps-1092283463 Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 9f7e069bf3fc4d058dff03e8470908b0 Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestServerBasicOps-1092283463 Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestServerBasicOps-1092283463-project Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 3dbdade40dd04a09b1794f6391d8abdc Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestServerBasicOps-1092283463-project Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '9046078e-c414-468b-93e2-07039eee2d23'} Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:19:05.989567 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:06.002319 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:19:06.002319 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:19:06.002319 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:19:06.002319 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:19:06.002319 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:19:06.002319 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:06.002319 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:06.002319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb1596f8-566c-4a0f-91f6-d764edf28a5f tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Returning 404 to user: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:19:06.002319 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bb1596f8-566c-4a0f-91f6-d764edf28a5f tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 404 len: 111 microversion: 2.1 time: 0.042831 Aug 18 12:19:06.002319 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3673/6327] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:05 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:19:06.592934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9a189da5-bec4-4472-9f0a-bcddc8ced770 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:06.593459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9a189da5-bec4-4472-9f0a-bcddc8ced770 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:06.601586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a189da5-bec4-4472-9f0a-bcddc8ced770 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:06.602145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a189da5-bec4-4472-9f0a-bcddc8ced770 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:06.602724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a189da5-bec4-4472-9f0a-bcddc8ced770 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:06.603936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a189da5-bec4-4472-9f0a-bcddc8ced770 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:06.604777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a189da5-bec4-4472-9f0a-bcddc8ced770 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:06.605325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a189da5-bec4-4472-9f0a-bcddc8ced770 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:06.622094 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-9a189da5-bec4-4472-9f0a-bcddc8ced770 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] HTTP exception thrown: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9a189da5-bec4-4472-9f0a-bcddc8ced770 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Request method failure captured: Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 HTTP/1.1 Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iz6wMIfWbQb7cjB-0SmK-NqV-vVI32IfoegLOPQAH0b3VbaAaOVi8KAq4pKE8X-wf_4GPJFrQtNNleGvun970E8JZ4IS4Gq3hHaCrlcyyGhJpMgg_iDO8Mz59WoDyOYVmFkYPhBbyLr93k8UjHZe7MiVZ9YADgB-guQKyR2dgfyMso Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 9f7e069bf3fc4d058dff03e8470908b0 Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestServerBasicOps-1092283463 Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9f7e069bf3fc4d058dff03e8470908b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9f7e069bf3fc4d058dff03e8470908b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9f7e069bf3fc4d058dff03e8470908b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9f7e069bf3fc4d058dff03e8470908b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestServerBasicOps-1092283463 Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 9f7e069bf3fc4d058dff03e8470908b0 Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestServerBasicOps-1092283463 Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestServerBasicOps-1092283463-project Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 3dbdade40dd04a09b1794f6391d8abdc Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestServerBasicOps-1092283463-project Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '9046078e-c414-468b-93e2-07039eee2d23'} Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:19:06.623957 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:19:06.637365 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:06.637365 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:06.637365 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:19:06.637365 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:06.637365 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:19:06.637365 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:19:06.637365 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:19:06.637365 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:19:06.637365 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:19:06.637365 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:06.637365 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:06.637365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9a189da5-bec4-4472-9f0a-bcddc8ced770 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Returning 404 to user: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:19:06.637365 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9a189da5-bec4-4472-9f0a-bcddc8ced770 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "DELETE /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 404 len: 111 microversion: 2.1 time: 0.041831 Aug 18 12:19:06.637365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3674/6328] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:19:06 2022] DELETE /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:19:06.639392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8ed5276-616b-427c-90c9-566af84c888c tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:06.639392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e8ed5276-616b-427c-90c9-566af84c888c tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] [instance: 9046078e-c414-468b-93e2-07039eee2d23] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:06.646676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8ed5276-616b-427c-90c9-566af84c888c tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:06.647270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8ed5276-616b-427c-90c9-566af84c888c tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:06.647842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8ed5276-616b-427c-90c9-566af84c888c tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:06.648634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8ed5276-616b-427c-90c9-566af84c888c tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:06.649191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8ed5276-616b-427c-90c9-566af84c888c tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:06.649672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8ed5276-616b-427c-90c9-566af84c888c tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:06.665964 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-e8ed5276-616b-427c-90c9-566af84c888c tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] HTTP exception thrown: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8ed5276-616b-427c-90c9-566af84c888c tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Request method failure captured: Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 HTTP/1.1 Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_iz6wMIfWbQb7cjB-0SmK-NqV-vVI32IfoegLOPQAH0b3VbaAaOVi8KAq4pKE8X-wf_4GPJFrQtNNleGvun970E8JZ4IS4Gq3hHaCrlcyyGhJpMgg_iDO8Mz59WoDyOYVmFkYPhBbyLr93k8UjHZe7MiVZ9YADgB-guQKyR2dgfyMso Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 9f7e069bf3fc4d058dff03e8470908b0 Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestServerBasicOps-1092283463 Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9f7e069bf3fc4d058dff03e8470908b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/9f7e069bf3fc4d058dff03e8470908b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_9f7e069bf3fc4d058dff03e8470908b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/9f7e069bf3fc4d058dff03e8470908b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestServerBasicOps-1092283463 Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 9f7e069bf3fc4d058dff03e8470908b0 Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestServerBasicOps-1092283463 Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestServerBasicOps-1092283463-project Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 3dbdade40dd04a09b1794f6391d8abdc Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestServerBasicOps-1092283463-project Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '9046078e-c414-468b-93e2-07039eee2d23'} Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:19:06.667725 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:06.676594 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:19:06.676594 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:19:06.676594 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:19:06.676594 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:19:06.676594 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:19:06.676594 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. Aug 18 12:19:06.676594 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:06.676594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8ed5276-616b-427c-90c9-566af84c888c tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Returning 404 to user: Instance 9046078e-c414-468b-93e2-07039eee2d23 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:19:06.676594 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e8ed5276-616b-427c-90c9-566af84c888c tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23" status: 404 len: 111 microversion: 2.1 time: 0.036834 Aug 18 12:19:06.676594 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3675/6329] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:06 2022] GET /compute/v2.1/servers/9046078e-c414-468b-93e2-07039eee2d23 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:19:06.886210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7a8143d-99b3-4797-b475-91dbeb016ac3 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] Calling method '.version_select at 0x7f519e87baf0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:06.914646 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a7a8143d-99b3-4797-b475-91dbeb016ac3 tempest-TestServerBasicOps-1092283463 tempest-TestServerBasicOps-1092283463-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1580032937" status: 202 len: 0 microversion: 2.1 time: 0.032340 Aug 18 12:19:06.915261 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3676/6330] 10.222.0.73 () {58 vars in 1254 bytes} [Thu Aug 18 12:19:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1580032937 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:19:21.971073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:19:21.972916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:19:21.981417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-49604780-b4d1-4c70-8cd7-9189482f5b3b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:21.982343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-49604780-b4d1-4c70-8cd7-9189482f5b3b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:21.999391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49604780-b4d1-4c70-8cd7-9189482f5b3b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:22.000308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49604780-b4d1-4c70-8cd7-9189482f5b3b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:22.001744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49604780-b4d1-4c70-8cd7-9189482f5b3b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:22.003120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49604780-b4d1-4c70-8cd7-9189482f5b3b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:22.003996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49604780-b4d1-4c70-8cd7-9189482f5b3b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:22.004815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49604780-b4d1-4c70-8cd7-9189482f5b3b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:22.061155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-49604780-b4d1-4c70-8cd7-9189482f5b3b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:19:22.218261 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-49604780-b4d1-4c70-8cd7-9189482f5b3b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 204 len: 0 microversion: 2.1 time: 0.251851 Aug 18 12:19:22.220308 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3677/6331] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:19:21 2022] DELETE /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:19:22.237138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d4017b08-53bf-4e17-accf-245ce1c893a7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:22.238573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d4017b08-53bf-4e17-accf-245ce1c893a7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:22.251669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4017b08-53bf-4e17-accf-245ce1c893a7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:22.252414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4017b08-53bf-4e17-accf-245ce1c893a7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:22.253241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4017b08-53bf-4e17-accf-245ce1c893a7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:22.254602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4017b08-53bf-4e17-accf-245ce1c893a7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:22.255456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4017b08-53bf-4e17-accf-245ce1c893a7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:22.256272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4017b08-53bf-4e17-accf-245ce1c893a7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:22.427861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d4017b08-53bf-4e17-accf-245ce1c893a7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:22.437120 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d4017b08-53bf-4e17-accf-245ce1c893a7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1577 microversion: 2.1 time: 0.210152 Aug 18 12:19:22.438362 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3678/6332] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:22 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1577 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:23.467101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2ef55e08-405e-49be-a78e-a9460a22101f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:23.468274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2ef55e08-405e-49be-a78e-a9460a22101f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:23.483613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ef55e08-405e-49be-a78e-a9460a22101f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:23.484461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ef55e08-405e-49be-a78e-a9460a22101f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:23.486320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ef55e08-405e-49be-a78e-a9460a22101f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:23.487764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ef55e08-405e-49be-a78e-a9460a22101f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:23.488663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ef55e08-405e-49be-a78e-a9460a22101f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:23.489468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ef55e08-405e-49be-a78e-a9460a22101f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:23.688830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2ef55e08-405e-49be-a78e-a9460a22101f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:23.698052 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2ef55e08-405e-49be-a78e-a9460a22101f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1577 microversion: 2.1 time: 0.238804 Aug 18 12:19:23.698705 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3679/6333] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:23 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1577 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:19:24.734233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0bd47d56-2772-47b9-a6a4-cdf6ea95299a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:24.735916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0bd47d56-2772-47b9-a6a4-cdf6ea95299a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:24.747865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bd47d56-2772-47b9-a6a4-cdf6ea95299a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:24.748619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bd47d56-2772-47b9-a6a4-cdf6ea95299a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:24.749536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bd47d56-2772-47b9-a6a4-cdf6ea95299a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:24.750661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bd47d56-2772-47b9-a6a4-cdf6ea95299a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:24.751860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bd47d56-2772-47b9-a6a4-cdf6ea95299a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:24.752251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0bd47d56-2772-47b9-a6a4-cdf6ea95299a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:24.908744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0bd47d56-2772-47b9-a6a4-cdf6ea95299a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:24.926407 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0bd47d56-2772-47b9-a6a4-cdf6ea95299a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1510 microversion: 2.1 time: 0.196190 Aug 18 12:19:24.939519 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3680/6334] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:24 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:25.241626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-bec6ab24-aeaf-4497-8cab-cff636311779 req-ad0300a5-4695-476d-b299-b5f6d946d5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12", "name": "network-vif-deleted", "tag": "f2248902-41ff-464e-b99e-09522d9334a7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:19:25.254372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bec6ab24-aeaf-4497-8cab-cff636311779 req-ad0300a5-4695-476d-b299-b5f6d946d5c8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:25.255217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bec6ab24-aeaf-4497-8cab-cff636311779 req-ad0300a5-4695-476d-b299-b5f6d946d5c8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:25.255847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bec6ab24-aeaf-4497-8cab-cff636311779 req-ad0300a5-4695-476d-b299-b5f6d946d5c8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:25.269201 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-bec6ab24-aeaf-4497-8cab-cff636311779 req-ad0300a5-4695-476d-b299-b5f6d946d5c8 service nova] Creating event network-vif-deleted:f2248902-41ff-464e-b99e-09522d9334a7 for instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 on n-h2-853611-3 Aug 18 12:19:25.275578 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-bec6ab24-aeaf-4497-8cab-cff636311779 req-ad0300a5-4695-476d-b299-b5f6d946d5c8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.333946 Aug 18 12:19:25.276873 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3681/6335] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:19:25.973049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b630aa1-1dba-4432-b750-fbd71b091621 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:25.976725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b630aa1-1dba-4432-b750-fbd71b091621 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:25.991611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b630aa1-1dba-4432-b750-fbd71b091621 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:25.992678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b630aa1-1dba-4432-b750-fbd71b091621 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:25.993570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b630aa1-1dba-4432-b750-fbd71b091621 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:25.996838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b630aa1-1dba-4432-b750-fbd71b091621 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:25.998491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b630aa1-1dba-4432-b750-fbd71b091621 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:25.998808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b630aa1-1dba-4432-b750-fbd71b091621 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:26.114313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b630aa1-1dba-4432-b750-fbd71b091621 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:26.133263 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b630aa1-1dba-4432-b750-fbd71b091621 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1225 microversion: 2.1 time: 0.173907 Aug 18 12:19:26.134535 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3682/6336] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:25 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1225 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:27.166244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3df5b3c8-d52c-4563-af47-5fdf2833c552 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:27.167341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3df5b3c8-d52c-4563-af47-5fdf2833c552 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:27.179357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3df5b3c8-d52c-4563-af47-5fdf2833c552 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:27.180220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3df5b3c8-d52c-4563-af47-5fdf2833c552 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:27.181019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3df5b3c8-d52c-4563-af47-5fdf2833c552 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:27.182642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3df5b3c8-d52c-4563-af47-5fdf2833c552 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:27.183487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3df5b3c8-d52c-4563-af47-5fdf2833c552 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:27.184246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3df5b3c8-d52c-4563-af47-5fdf2833c552 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:27.283487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3df5b3c8-d52c-4563-af47-5fdf2833c552 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:27.297689 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3df5b3c8-d52c-4563-af47-5fdf2833c552 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1225 microversion: 2.1 time: 0.135188 Aug 18 12:19:27.298762 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3683/6337] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:27 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1225 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:28.338730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-124ec30b-9309-42df-8a2b-aa01555c15fd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:28.340150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-124ec30b-9309-42df-8a2b-aa01555c15fd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:28.353376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124ec30b-9309-42df-8a2b-aa01555c15fd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:28.354265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124ec30b-9309-42df-8a2b-aa01555c15fd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:28.355103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124ec30b-9309-42df-8a2b-aa01555c15fd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:28.356401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124ec30b-9309-42df-8a2b-aa01555c15fd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:28.357264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124ec30b-9309-42df-8a2b-aa01555c15fd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:28.358022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124ec30b-9309-42df-8a2b-aa01555c15fd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:28.465309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-124ec30b-9309-42df-8a2b-aa01555c15fd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:28.475773 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-124ec30b-9309-42df-8a2b-aa01555c15fd tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1225 microversion: 2.1 time: 0.147776 Aug 18 12:19:28.476756 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3684/6338] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:28 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1225 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:29.514897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a4262858-96eb-4372-9c28-5dd374f64500 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:29.516103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a4262858-96eb-4372-9c28-5dd374f64500 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:29.528965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4262858-96eb-4372-9c28-5dd374f64500 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:29.529860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4262858-96eb-4372-9c28-5dd374f64500 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:29.530735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4262858-96eb-4372-9c28-5dd374f64500 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:29.532648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4262858-96eb-4372-9c28-5dd374f64500 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:29.533679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4262858-96eb-4372-9c28-5dd374f64500 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:29.535066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4262858-96eb-4372-9c28-5dd374f64500 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:29.609191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a4262858-96eb-4372-9c28-5dd374f64500 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:29.618146 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a4262858-96eb-4372-9c28-5dd374f64500 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 200 len: 1225 microversion: 2.1 time: 0.110607 Aug 18 12:19:29.618846 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3685/6339] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:29 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:19:30.641686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06a5eae6-a325-40cc-a702-cedcaee352a4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:30.642832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-06a5eae6-a325-40cc-a702-cedcaee352a4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:30.655918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06a5eae6-a325-40cc-a702-cedcaee352a4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:30.657839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06a5eae6-a325-40cc-a702-cedcaee352a4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:30.658681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06a5eae6-a325-40cc-a702-cedcaee352a4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:30.660063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06a5eae6-a325-40cc-a702-cedcaee352a4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:30.660969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06a5eae6-a325-40cc-a702-cedcaee352a4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:30.662240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06a5eae6-a325-40cc-a702-cedcaee352a4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:30.685065 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-06a5eae6-a325-40cc-a702-cedcaee352a4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06a5eae6-a325-40cc-a702-cedcaee352a4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 HTTP/1.1 Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12'} Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:19:30.688103 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:30.704282 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:19:30.704282 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:19:30.704282 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:19:30.704282 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:19:30.704282 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:19:30.704282 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:19:30.704282 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:19:30.704282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06a5eae6-a325-40cc-a702-cedcaee352a4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:19:30.704282 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-06a5eae6-a325-40cc-a702-cedcaee352a4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 404 len: 111 microversion: 2.1 time: 0.055084 Aug 18 12:19:30.704282 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3686/6340] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:30 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:19:30.819834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-689469585", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-107783012", "security_groups": [{"name": "tempest-secgroup-smoke-149503047"}], "block_device_mapping_v2": [{"uuid": "d2284d07-e7fe-4bfd-99c0-4e16414756a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11e09857-d75b-4b2b-82b3-fa5db86d3937"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:19:30.957833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] validate_networks() for [('11e09857-d75b-4b2b-82b3-fa5db86d3937', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:19:31.436529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:19:31.436975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:19:31.437963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:19:31.439166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:19:31.439612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:19:31.450692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:31.451208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:31.451668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:31.452463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:31.453744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:31.454807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:31.476184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:19:31.482706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for user 033d6aa61b5340189fbc5d895d3e8cba and project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:19:31.555966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:19:31.558274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d2284d07-e7fe-4bfd-99c0-4e16414756a5',volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:19:31.710246 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [ad34efef-0f66-4b0e-ae92-01c0f6623531] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 12:19:32.720148 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [ad34efef-0f66-4b0e-ae92-01c0f6623531] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 49212. Aug 18 12:19:32.725179 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a205bbc0-11ed-4a43-bd37-4575fdf06395 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.909513 Aug 18 12:19:32.725930 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3687/6341] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:19:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:19:32.738497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c43d5bdb-7d1e-4271-92f0-62698bf417c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:32.739150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c43d5bdb-7d1e-4271-92f0-62698bf417c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:32.799761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c43d5bdb-7d1e-4271-92f0-62698bf417c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:32.808095 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c43d5bdb-7d1e-4271-92f0-62698bf417c6 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1093 microversion: 2.1 time: 0.074838 Aug 18 12:19:32.809085 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3688/6342] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:32 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:33.830613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ce39c53f-a00f-4785-b827-5ba61d1ae411 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:33.831366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ce39c53f-a00f-4785-b827-5ba61d1ae411 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:33.839469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce39c53f-a00f-4785-b827-5ba61d1ae411 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:33.840026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce39c53f-a00f-4785-b827-5ba61d1ae411 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:33.840480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce39c53f-a00f-4785-b827-5ba61d1ae411 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:33.841228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce39c53f-a00f-4785-b827-5ba61d1ae411 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:33.841703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce39c53f-a00f-4785-b827-5ba61d1ae411 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:33.842144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce39c53f-a00f-4785-b827-5ba61d1ae411 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:33.944414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ce39c53f-a00f-4785-b827-5ba61d1ae411 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:33.960533 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ce39c53f-a00f-4785-b827-5ba61d1ae411 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1191 microversion: 2.1 time: 0.134342 Aug 18 12:19:33.961418 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3689/6343] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:33 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1191 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:34.994565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fe39b8d8-0af4-4eb0-b7e1-4f8148848994 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:34.995936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fe39b8d8-0af4-4eb0-b7e1-4f8148848994 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:35.005119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe39b8d8-0af4-4eb0-b7e1-4f8148848994 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:35.005958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe39b8d8-0af4-4eb0-b7e1-4f8148848994 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:35.006612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe39b8d8-0af4-4eb0-b7e1-4f8148848994 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:35.007539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe39b8d8-0af4-4eb0-b7e1-4f8148848994 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:35.008295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe39b8d8-0af4-4eb0-b7e1-4f8148848994 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:35.009067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe39b8d8-0af4-4eb0-b7e1-4f8148848994 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:35.395740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fe39b8d8-0af4-4eb0-b7e1-4f8148848994 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:35.409033 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fe39b8d8-0af4-4eb0-b7e1-4f8148848994 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1276 microversion: 2.1 time: 0.419158 Aug 18 12:19:35.417284 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3690/6344] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:34 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1276 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:19:36.015468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4a45052a-4752-410f-bbf8-1295c8e6238c req-d794200a-6e44-4138-aa4a-291b8372b1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b32ea0e5-56f4-4702-a840-3f038a30e013", "tag": "44fb218b-11a4-45ca-8c84-ddd21b95e55f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:19:36.030516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4a45052a-4752-410f-bbf8-1295c8e6238c req-d794200a-6e44-4138-aa4a-291b8372b1c7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:36.032370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4a45052a-4752-410f-bbf8-1295c8e6238c req-d794200a-6e44-4138-aa4a-291b8372b1c7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:36.033230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4a45052a-4752-410f-bbf8-1295c8e6238c req-d794200a-6e44-4138-aa4a-291b8372b1c7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:36.050101 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4a45052a-4752-410f-bbf8-1295c8e6238c req-d794200a-6e44-4138-aa4a-291b8372b1c7 service nova] Creating event network-changed:44fb218b-11a4-45ca-8c84-ddd21b95e55f for instance b32ea0e5-56f4-4702-a840-3f038a30e013 on n-h2-853611-3 Aug 18 12:19:36.057207 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4a45052a-4752-410f-bbf8-1295c8e6238c req-d794200a-6e44-4138-aa4a-291b8372b1c7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047914 Aug 18 12:19:36.059048 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3691/6345] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:19:36.449265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0cded183-4c06-4d76-a25d-53528853fc6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:36.450614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0cded183-4c06-4d76-a25d-53528853fc6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:36.463873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cded183-4c06-4d76-a25d-53528853fc6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:36.465025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cded183-4c06-4d76-a25d-53528853fc6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:36.466143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cded183-4c06-4d76-a25d-53528853fc6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:36.467468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cded183-4c06-4d76-a25d-53528853fc6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:36.468289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cded183-4c06-4d76-a25d-53528853fc6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:36.469073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0cded183-4c06-4d76-a25d-53528853fc6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:36.824455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0cded183-4c06-4d76-a25d-53528853fc6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:36.839906 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0cded183-4c06-4d76-a25d-53528853fc6c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1276 microversion: 2.1 time: 0.398390 Aug 18 12:19:36.840939 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3692/6346] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:36 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1276 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:19:37.868567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0191d3c3-5f6c-471d-8358-16226c726254 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:37.870865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0191d3c3-5f6c-471d-8358-16226c726254 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:37.887978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0191d3c3-5f6c-471d-8358-16226c726254 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:37.888905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0191d3c3-5f6c-471d-8358-16226c726254 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:37.889715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0191d3c3-5f6c-471d-8358-16226c726254 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:37.891090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0191d3c3-5f6c-471d-8358-16226c726254 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:37.892009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0191d3c3-5f6c-471d-8358-16226c726254 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:37.892838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0191d3c3-5f6c-471d-8358-16226c726254 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:38.101900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0191d3c3-5f6c-471d-8358-16226c726254 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:38.113312 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0191d3c3-5f6c-471d-8358-16226c726254 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1276 microversion: 2.1 time: 0.252807 Aug 18 12:19:38.114313 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3693/6347] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:37 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1276 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:19:39.144559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2262148e-6e32-4c3f-b34d-179594df43c5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:39.145203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2262148e-6e32-4c3f-b34d-179594df43c5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:39.152934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2262148e-6e32-4c3f-b34d-179594df43c5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:39.153368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2262148e-6e32-4c3f-b34d-179594df43c5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:39.153929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2262148e-6e32-4c3f-b34d-179594df43c5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:39.154774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2262148e-6e32-4c3f-b34d-179594df43c5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:39.155267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2262148e-6e32-4c3f-b34d-179594df43c5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:39.156847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2262148e-6e32-4c3f-b34d-179594df43c5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:39.327293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2262148e-6e32-4c3f-b34d-179594df43c5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:39.338117 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2262148e-6e32-4c3f-b34d-179594df43c5 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1276 microversion: 2.1 time: 0.198188 Aug 18 12:19:39.338767 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3694/6348] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:39 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1276 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:40.367080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59f9a2d8-09d4-45ca-a098-9fef1949cecf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:40.368304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59f9a2d8-09d4-45ca-a098-9fef1949cecf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:40.377372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59f9a2d8-09d4-45ca-a098-9fef1949cecf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:40.377946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59f9a2d8-09d4-45ca-a098-9fef1949cecf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:40.378501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59f9a2d8-09d4-45ca-a098-9fef1949cecf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:40.379354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59f9a2d8-09d4-45ca-a098-9fef1949cecf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:40.379847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59f9a2d8-09d4-45ca-a098-9fef1949cecf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:40.380407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59f9a2d8-09d4-45ca-a098-9fef1949cecf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:40.402479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:19:40.590058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-59f9a2d8-09d4-45ca-a098-9fef1949cecf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:40.600880 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59f9a2d8-09d4-45ca-a098-9fef1949cecf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1276 microversion: 2.1 time: 0.242041 Aug 18 12:19:40.601506 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3695/6349] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:40 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:41.634915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b9a709f5-cf57-420c-9a0e-a2487c1d955f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:41.635583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b9a709f5-cf57-420c-9a0e-a2487c1d955f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:41.638359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:19:41.645962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9a709f5-cf57-420c-9a0e-a2487c1d955f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:41.646773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9a709f5-cf57-420c-9a0e-a2487c1d955f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:41.647285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9a709f5-cf57-420c-9a0e-a2487c1d955f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:41.648080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9a709f5-cf57-420c-9a0e-a2487c1d955f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:41.648616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9a709f5-cf57-420c-9a0e-a2487c1d955f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:41.649151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b9a709f5-cf57-420c-9a0e-a2487c1d955f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:41.820668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b9a709f5-cf57-420c-9a0e-a2487c1d955f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:41.830048 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b9a709f5-cf57-420c-9a0e-a2487c1d955f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1264 microversion: 2.1 time: 0.198881 Aug 18 12:19:41.830679 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3696/6350] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:41 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:42.851693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-597f7129-bf19-4ae0-8324-f62a94ac4a0a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:42.852312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-597f7129-bf19-4ae0-8324-f62a94ac4a0a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:42.855419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:19:42.863535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-597f7129-bf19-4ae0-8324-f62a94ac4a0a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:42.864052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-597f7129-bf19-4ae0-8324-f62a94ac4a0a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:42.864520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-597f7129-bf19-4ae0-8324-f62a94ac4a0a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:42.865285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-597f7129-bf19-4ae0-8324-f62a94ac4a0a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:42.865762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-597f7129-bf19-4ae0-8324-f62a94ac4a0a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:42.866211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-597f7129-bf19-4ae0-8324-f62a94ac4a0a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:43.019721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-597f7129-bf19-4ae0-8324-f62a94ac4a0a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:43.028920 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-597f7129-bf19-4ae0-8324-f62a94ac4a0a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1264 microversion: 2.1 time: 0.181151 Aug 18 12:19:43.029527 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3697/6351] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:42 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:19:44.055943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2866b026-7dfc-4c01-81b7-1a6b0a0104d1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:44.056966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2866b026-7dfc-4c01-81b7-1a6b0a0104d1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:44.066696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2866b026-7dfc-4c01-81b7-1a6b0a0104d1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:44.067316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2866b026-7dfc-4c01-81b7-1a6b0a0104d1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:44.067791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2866b026-7dfc-4c01-81b7-1a6b0a0104d1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:44.068552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2866b026-7dfc-4c01-81b7-1a6b0a0104d1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:44.069030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2866b026-7dfc-4c01-81b7-1a6b0a0104d1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:44.069501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2866b026-7dfc-4c01-81b7-1a6b0a0104d1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:44.257528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2866b026-7dfc-4c01-81b7-1a6b0a0104d1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:44.267212 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2866b026-7dfc-4c01-81b7-1a6b0a0104d1 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1264 microversion: 2.1 time: 0.217751 Aug 18 12:19:44.267819 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3698/6352] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:44 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:19:45.303097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a1d8ea5c-c774-4a33-a83a-ffd91469db5b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:45.303766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a1d8ea5c-c774-4a33-a83a-ffd91469db5b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:45.311961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1d8ea5c-c774-4a33-a83a-ffd91469db5b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:45.312484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1d8ea5c-c774-4a33-a83a-ffd91469db5b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:45.312934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1d8ea5c-c774-4a33-a83a-ffd91469db5b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:45.313674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1d8ea5c-c774-4a33-a83a-ffd91469db5b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:45.314142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1d8ea5c-c774-4a33-a83a-ffd91469db5b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:45.314625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a1d8ea5c-c774-4a33-a83a-ffd91469db5b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:45.505844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a1d8ea5c-c774-4a33-a83a-ffd91469db5b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:45.514133 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a1d8ea5c-c774-4a33-a83a-ffd91469db5b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1264 microversion: 2.1 time: 0.214857 Aug 18 12:19:45.514786 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3699/6353] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:45 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:46.536078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b5fbdac5-783c-4163-99dc-9b1449bc0f0c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:46.536888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b5fbdac5-783c-4163-99dc-9b1449bc0f0c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:46.544740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5fbdac5-783c-4163-99dc-9b1449bc0f0c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:46.545377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5fbdac5-783c-4163-99dc-9b1449bc0f0c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:46.546823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5fbdac5-783c-4163-99dc-9b1449bc0f0c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:46.547682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5fbdac5-783c-4163-99dc-9b1449bc0f0c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:46.548258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5fbdac5-783c-4163-99dc-9b1449bc0f0c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:46.548848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b5fbdac5-783c-4163-99dc-9b1449bc0f0c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:46.715804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b5fbdac5-783c-4163-99dc-9b1449bc0f0c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:46.730912 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b5fbdac5-783c-4163-99dc-9b1449bc0f0c tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1264 microversion: 2.1 time: 0.198575 Aug 18 12:19:46.732015 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3700/6354] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:46 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:47.754460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9459f655-6a51-4b30-a415-ac5c4d37e67d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:47.755141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9459f655-6a51-4b30-a415-ac5c4d37e67d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:47.763418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9459f655-6a51-4b30-a415-ac5c4d37e67d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:47.764138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9459f655-6a51-4b30-a415-ac5c4d37e67d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:47.765234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9459f655-6a51-4b30-a415-ac5c4d37e67d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:47.766056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9459f655-6a51-4b30-a415-ac5c4d37e67d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:47.766676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9459f655-6a51-4b30-a415-ac5c4d37e67d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:47.767202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9459f655-6a51-4b30-a415-ac5c4d37e67d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:48.288688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9459f655-6a51-4b30-a415-ac5c4d37e67d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:48.301719 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9459f655-6a51-4b30-a415-ac5c4d37e67d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1264 microversion: 2.1 time: 0.551289 Aug 18 12:19:48.308801 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3701/6355] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:47 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1264 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:49.324078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a41d2411-a8f4-4771-a44c-7b80a5900f8e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:49.324721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a41d2411-a8f4-4771-a44c-7b80a5900f8e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:49.332763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a41d2411-a8f4-4771-a44c-7b80a5900f8e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:49.333270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a41d2411-a8f4-4771-a44c-7b80a5900f8e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:49.333722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a41d2411-a8f4-4771-a44c-7b80a5900f8e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:49.334456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a41d2411-a8f4-4771-a44c-7b80a5900f8e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:49.334934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a41d2411-a8f4-4771-a44c-7b80a5900f8e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:49.335382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a41d2411-a8f4-4771-a44c-7b80a5900f8e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:49.482754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a41d2411-a8f4-4771-a44c-7b80a5900f8e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:49.496755 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a41d2411-a8f4-4771-a44c-7b80a5900f8e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1264 microversion: 2.1 time: 0.176170 Aug 18 12:19:49.497848 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3702/6356] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:49 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:50.218838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-efb458f8-c43d-4df4-b309-7c7e1b0442f9 req-9fead32e-0533-4756-84fb-2f4b3718b572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b32ea0e5-56f4-4702-a840-3f038a30e013", "name": "network-vif-plugged", "status": "completed", "tag": "44fb218b-11a4-45ca-8c84-ddd21b95e55f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:19:50.231902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-efb458f8-c43d-4df4-b309-7c7e1b0442f9 req-9fead32e-0533-4756-84fb-2f4b3718b572 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:50.232491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-efb458f8-c43d-4df4-b309-7c7e1b0442f9 req-9fead32e-0533-4756-84fb-2f4b3718b572 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:50.234528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-efb458f8-c43d-4df4-b309-7c7e1b0442f9 req-9fead32e-0533-4756-84fb-2f4b3718b572 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:50.248662 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-efb458f8-c43d-4df4-b309-7c7e1b0442f9 req-9fead32e-0533-4756-84fb-2f4b3718b572 service nova] Creating event network-vif-plugged:44fb218b-11a4-45ca-8c84-ddd21b95e55f for instance b32ea0e5-56f4-4702-a840-3f038a30e013 on n-h2-853611-3 Aug 18 12:19:50.254672 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-efb458f8-c43d-4df4-b309-7c7e1b0442f9 req-9fead32e-0533-4756-84fb-2f4b3718b572 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041381 Aug 18 12:19:50.255555 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3703/6357] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:19:50.521871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-72f66214-4eb3-4421-8484-6e95fe36b2a0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:50.522843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-72f66214-4eb3-4421-8484-6e95fe36b2a0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:50.529504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72f66214-4eb3-4421-8484-6e95fe36b2a0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:50.530665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72f66214-4eb3-4421-8484-6e95fe36b2a0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:50.531124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72f66214-4eb3-4421-8484-6e95fe36b2a0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:50.531865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72f66214-4eb3-4421-8484-6e95fe36b2a0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:50.532383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72f66214-4eb3-4421-8484-6e95fe36b2a0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:50.532826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-72f66214-4eb3-4421-8484-6e95fe36b2a0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:50.709626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-72f66214-4eb3-4421-8484-6e95fe36b2a0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:50.719212 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-72f66214-4eb3-4421-8484-6e95fe36b2a0 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1264 microversion: 2.1 time: 0.202221 Aug 18 12:19:50.720400 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3704/6358] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:50 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:51.754622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb66bb0b-7129-439e-b8ec-6ba4221b3bc9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:51.756126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bb66bb0b-7129-439e-b8ec-6ba4221b3bc9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:51.766270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb66bb0b-7129-439e-b8ec-6ba4221b3bc9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:51.767186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb66bb0b-7129-439e-b8ec-6ba4221b3bc9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:51.767957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb66bb0b-7129-439e-b8ec-6ba4221b3bc9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:51.769459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb66bb0b-7129-439e-b8ec-6ba4221b3bc9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:51.770290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb66bb0b-7129-439e-b8ec-6ba4221b3bc9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:51.771256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb66bb0b-7129-439e-b8ec-6ba4221b3bc9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:51.963424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bb66bb0b-7129-439e-b8ec-6ba4221b3bc9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:51.977359 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bb66bb0b-7129-439e-b8ec-6ba4221b3bc9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1452 microversion: 2.1 time: 0.226196 Aug 18 12:19:51.978394 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3705/6359] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:51 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1452 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:19:52.005853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3a0a695-0472-447d-9937-446ded0ab4de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:19:52.006545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3a0a695-0472-447d-9937-446ded0ab4de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:19:52.013573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3a0a695-0472-447d-9937-446ded0ab4de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:52.014113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3a0a695-0472-447d-9937-446ded0ab4de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:52.014600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3a0a695-0472-447d-9937-446ded0ab4de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:52.015443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3a0a695-0472-447d-9937-446ded0ab4de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:52.015941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3a0a695-0472-447d-9937-446ded0ab4de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:52.016390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3a0a695-0472-447d-9937-446ded0ab4de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:52.196375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d3a0a695-0472-447d-9937-446ded0ab4de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:19:52.209737 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3a0a695-0472-447d-9937-446ded0ab4de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1452 microversion: 2.1 time: 0.207762 Aug 18 12:19:52.210825 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3706/6360] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:19:52 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:19:54.193190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-44d89009-691e-48b9-b9e1-24017fedc655 req-ee182dd3-fe18-4116-b53b-6c92caedcf51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b32ea0e5-56f4-4702-a840-3f038a30e013", "tag": "44fb218b-11a4-45ca-8c84-ddd21b95e55f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:19:54.205770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:19:54.214871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-44d89009-691e-48b9-b9e1-24017fedc655 req-ee182dd3-fe18-4116-b53b-6c92caedcf51 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:19:54.215740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-44d89009-691e-48b9-b9e1-24017fedc655 req-ee182dd3-fe18-4116-b53b-6c92caedcf51 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:19:54.216559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-44d89009-691e-48b9-b9e1-24017fedc655 req-ee182dd3-fe18-4116-b53b-6c92caedcf51 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:19:54.243866 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-44d89009-691e-48b9-b9e1-24017fedc655 req-ee182dd3-fe18-4116-b53b-6c92caedcf51 service nova] Creating event network-changed:44fb218b-11a4-45ca-8c84-ddd21b95e55f for instance b32ea0e5-56f4-4702-a840-3f038a30e013 on n-h2-853611-3 Aug 18 12:19:54.252521 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-44d89009-691e-48b9-b9e1-24017fedc655 req-ee182dd3-fe18-4116-b53b-6c92caedcf51 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066886 Aug 18 12:19:54.253571 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3707/6361] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:19:58.767254 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:19:58.768024 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:19:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:21:36.209456 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4032abb9-abb5-4d06-9561-525583ca96a6] AMQP server on 10.222.0.73:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 18 12:21:36.210872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=66 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:36.217397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-71366754", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-107783012", "security_groups": [{"name": "tempest-secgroup-smoke-149503047"}], "block_device_mapping_v2": [{"uuid": "98631092-6d01-43de-888d-4cbaf73ed015", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11e09857-d75b-4b2b-82b3-fa5db86d3937"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:21:36.573962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] validate_networks() for [('11e09857-d75b-4b2b-82b3-fa5db86d3937', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:21:36.705250 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:21:36.707938 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 12:21:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.73) !!! Aug 18 12:21:37.025191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:21:37.025826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:21:37.026378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:21:37.026942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:21:37.027605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:21:37.037976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:37.038515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:37.038976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:37.039820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:37.040437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:37.041285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:37.061546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:21:37.067745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Getting quotas for user 033d6aa61b5340189fbc5d895d3e8cba and project b02ef4395d604ea1b4c1a26644cadbd3. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:21:37.136722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:21:37.139497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98631092-6d01-43de-888d-4cbaf73ed015',volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:21:37.224347 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] [4032abb9-abb5-4d06-9561-525583ca96a6] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 49380. Aug 18 12:21:37.293314 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-55b4bc93-aff2-48f4-8ede-be8c5cc9ff07 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.085646 Aug 18 12:21:37.301190 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3708/6362] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:21:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:21:37.307244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c753c9a0-f4bd-4fed-a74b-74a12ea1b74b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:37.307894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c753c9a0-f4bd-4fed-a74b-74a12ea1b74b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:37.389153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c753c9a0-f4bd-4fed-a74b-74a12ea1b74b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:37.398130 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c753c9a0-f4bd-4fed-a74b-74a12ea1b74b tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1092 microversion: 2.1 time: 0.095453 Aug 18 12:21:37.399692 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3709/6363] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:37 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1092 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:38.424530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7b31d40e-0176-4bdd-ac96-0670fac31d44 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:38.425506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7b31d40e-0176-4bdd-ac96-0670fac31d44 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:38.439448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b31d40e-0176-4bdd-ac96-0670fac31d44 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:38.440292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b31d40e-0176-4bdd-ac96-0670fac31d44 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:38.441282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b31d40e-0176-4bdd-ac96-0670fac31d44 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:38.442949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b31d40e-0176-4bdd-ac96-0670fac31d44 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:38.443818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b31d40e-0176-4bdd-ac96-0670fac31d44 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:38.444885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b31d40e-0176-4bdd-ac96-0670fac31d44 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:38.567604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7b31d40e-0176-4bdd-ac96-0670fac31d44 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:38.582913 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7b31d40e-0176-4bdd-ac96-0670fac31d44 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1198 microversion: 2.1 time: 0.164668 Aug 18 12:21:38.584056 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3710/6364] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:38 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1198 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:39.618814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08107018-b13f-490b-ba9c-c7985a97972a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:39.620258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-08107018-b13f-490b-ba9c-c7985a97972a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:39.630233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08107018-b13f-490b-ba9c-c7985a97972a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:39.631036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08107018-b13f-490b-ba9c-c7985a97972a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:39.631671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08107018-b13f-490b-ba9c-c7985a97972a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:39.632596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08107018-b13f-490b-ba9c-c7985a97972a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:39.633225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08107018-b13f-490b-ba9c-c7985a97972a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:39.634481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08107018-b13f-490b-ba9c-c7985a97972a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:39.831861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-08107018-b13f-490b-ba9c-c7985a97972a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:39.842467 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-08107018-b13f-490b-ba9c-c7985a97972a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1275 microversion: 2.1 time: 0.228272 Aug 18 12:21:39.843939 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3711/6365] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:39 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1275 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:40.116605 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:21:40.117228 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:21:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:21:40.587470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-98651060-a2a6-4d36-a211-47f9d5605832 req-786bc66b-b048-43d2-bccc-2bacf3a702a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "605b4a98-818e-4156-8e01-17e388dadff9", "tag": "d62cf802-7da5-4078-9d5f-9d4974aba00b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:21:40.598347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-98651060-a2a6-4d36-a211-47f9d5605832 req-786bc66b-b048-43d2-bccc-2bacf3a702a5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:40.599242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-98651060-a2a6-4d36-a211-47f9d5605832 req-786bc66b-b048-43d2-bccc-2bacf3a702a5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:40.599779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-98651060-a2a6-4d36-a211-47f9d5605832 req-786bc66b-b048-43d2-bccc-2bacf3a702a5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:40.613794 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-98651060-a2a6-4d36-a211-47f9d5605832 req-786bc66b-b048-43d2-bccc-2bacf3a702a5 service nova] Creating event network-changed:d62cf802-7da5-4078-9d5f-9d4974aba00b for instance 605b4a98-818e-4156-8e01-17e388dadff9 on n-h1-853611-3 Aug 18 12:21:40.620613 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-98651060-a2a6-4d36-a211-47f9d5605832 req-786bc66b-b048-43d2-bccc-2bacf3a702a5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163658 Aug 18 12:21:40.624410 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3712/6366] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:21:40.867163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-294ae399-8cb7-4412-afaa-1ac473211454 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:40.868025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-294ae399-8cb7-4412-afaa-1ac473211454 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:40.875234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-294ae399-8cb7-4412-afaa-1ac473211454 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:40.875756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-294ae399-8cb7-4412-afaa-1ac473211454 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:40.876212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-294ae399-8cb7-4412-afaa-1ac473211454 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:40.877356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-294ae399-8cb7-4412-afaa-1ac473211454 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:40.877857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-294ae399-8cb7-4412-afaa-1ac473211454 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:40.878308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-294ae399-8cb7-4412-afaa-1ac473211454 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:41.207181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-294ae399-8cb7-4412-afaa-1ac473211454 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:41.232652 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-294ae399-8cb7-4412-afaa-1ac473211454 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1275 microversion: 2.1 time: 0.370145 Aug 18 12:21:41.242132 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3713/6367] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:40 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1275 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:42.269254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bd454ea8-038d-46dd-a465-5673f57a8e46 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:42.270832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bd454ea8-038d-46dd-a465-5673f57a8e46 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:42.280081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd454ea8-038d-46dd-a465-5673f57a8e46 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:42.280755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd454ea8-038d-46dd-a465-5673f57a8e46 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:42.281329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd454ea8-038d-46dd-a465-5673f57a8e46 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:42.282142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd454ea8-038d-46dd-a465-5673f57a8e46 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:42.282793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd454ea8-038d-46dd-a465-5673f57a8e46 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:42.283499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd454ea8-038d-46dd-a465-5673f57a8e46 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:42.445131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bd454ea8-038d-46dd-a465-5673f57a8e46 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:42.454679 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bd454ea8-038d-46dd-a465-5673f57a8e46 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1275 microversion: 2.1 time: 0.189402 Aug 18 12:21:42.455445 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3714/6368] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:42 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:43.478180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c359df35-5b38-4d3f-911b-bdbd485267de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:43.479332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c359df35-5b38-4d3f-911b-bdbd485267de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:43.489864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c359df35-5b38-4d3f-911b-bdbd485267de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:43.490532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c359df35-5b38-4d3f-911b-bdbd485267de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:43.491155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c359df35-5b38-4d3f-911b-bdbd485267de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:43.492232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c359df35-5b38-4d3f-911b-bdbd485267de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:43.493380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c359df35-5b38-4d3f-911b-bdbd485267de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:43.494221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c359df35-5b38-4d3f-911b-bdbd485267de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:43.705965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c359df35-5b38-4d3f-911b-bdbd485267de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:43.719970 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c359df35-5b38-4d3f-911b-bdbd485267de tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1275 microversion: 2.1 time: 0.247003 Aug 18 12:21:43.720761 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3715/6369] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:43 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:44.744167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4683c8a0-c28e-4bbb-b6ee-fc6c6a12018a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:44.745324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4683c8a0-c28e-4bbb-b6ee-fc6c6a12018a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:44.754906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4683c8a0-c28e-4bbb-b6ee-fc6c6a12018a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:44.755709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4683c8a0-c28e-4bbb-b6ee-fc6c6a12018a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:44.756411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4683c8a0-c28e-4bbb-b6ee-fc6c6a12018a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:44.757565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4683c8a0-c28e-4bbb-b6ee-fc6c6a12018a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:44.759171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4683c8a0-c28e-4bbb-b6ee-fc6c6a12018a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:44.760041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4683c8a0-c28e-4bbb-b6ee-fc6c6a12018a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:44.970914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4683c8a0-c28e-4bbb-b6ee-fc6c6a12018a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:44.982879 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4683c8a0-c28e-4bbb-b6ee-fc6c6a12018a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1275 microversion: 2.1 time: 0.245210 Aug 18 12:21:44.984292 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3716/6370] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:44 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1275 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:46.017254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a69e572b-3016-4000-bdec-dc6095a469f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:46.018076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a69e572b-3016-4000-bdec-dc6095a469f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:46.026580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a69e572b-3016-4000-bdec-dc6095a469f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:46.027091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a69e572b-3016-4000-bdec-dc6095a469f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:46.027560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a69e572b-3016-4000-bdec-dc6095a469f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:46.028296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a69e572b-3016-4000-bdec-dc6095a469f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:46.028765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a69e572b-3016-4000-bdec-dc6095a469f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:46.029205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a69e572b-3016-4000-bdec-dc6095a469f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:46.192371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a69e572b-3016-4000-bdec-dc6095a469f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:46.201302 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a69e572b-3016-4000-bdec-dc6095a469f4 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1263 microversion: 2.1 time: 0.188087 Aug 18 12:21:46.201961 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3717/6371] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:46 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1263 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:47.223809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-82ff8057-0618-4a6e-a932-baf144f332ea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:47.224483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-82ff8057-0618-4a6e-a932-baf144f332ea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:47.227895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:47.234059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82ff8057-0618-4a6e-a932-baf144f332ea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:47.234638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82ff8057-0618-4a6e-a932-baf144f332ea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:47.235095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82ff8057-0618-4a6e-a932-baf144f332ea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:47.235835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82ff8057-0618-4a6e-a932-baf144f332ea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:47.236310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82ff8057-0618-4a6e-a932-baf144f332ea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:47.236754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82ff8057-0618-4a6e-a932-baf144f332ea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:47.388901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-82ff8057-0618-4a6e-a932-baf144f332ea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:47.395355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:47.398564 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-82ff8057-0618-4a6e-a932-baf144f332ea tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1263 microversion: 2.1 time: 0.178850 Aug 18 12:21:47.399886 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3718/6372] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:47 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1263 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:48.421626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-84deb902-b233-4f79-9c51-53fc9d52a60f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:48.422353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-84deb902-b233-4f79-9c51-53fc9d52a60f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:48.431830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84deb902-b233-4f79-9c51-53fc9d52a60f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:48.432401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84deb902-b233-4f79-9c51-53fc9d52a60f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:48.432921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84deb902-b233-4f79-9c51-53fc9d52a60f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:48.433751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84deb902-b233-4f79-9c51-53fc9d52a60f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:48.434282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84deb902-b233-4f79-9c51-53fc9d52a60f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:48.434818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84deb902-b233-4f79-9c51-53fc9d52a60f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:48.599835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-84deb902-b233-4f79-9c51-53fc9d52a60f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:48.608876 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-84deb902-b233-4f79-9c51-53fc9d52a60f tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1263 microversion: 2.1 time: 0.191195 Aug 18 12:21:48.609603 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3719/6373] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:48 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:49.632219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fcbd69f2-e152-42f4-819f-8c76fc8c4ddb tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:49.633886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fcbd69f2-e152-42f4-819f-8c76fc8c4ddb tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:49.641890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcbd69f2-e152-42f4-819f-8c76fc8c4ddb tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:49.642406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcbd69f2-e152-42f4-819f-8c76fc8c4ddb tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:49.642895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcbd69f2-e152-42f4-819f-8c76fc8c4ddb tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:49.643644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcbd69f2-e152-42f4-819f-8c76fc8c4ddb tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:49.644126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcbd69f2-e152-42f4-819f-8c76fc8c4ddb tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:49.644575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcbd69f2-e152-42f4-819f-8c76fc8c4ddb tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:49.810060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fcbd69f2-e152-42f4-819f-8c76fc8c4ddb tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:49.818490 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fcbd69f2-e152-42f4-819f-8c76fc8c4ddb tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1263 microversion: 2.1 time: 0.190383 Aug 18 12:21:49.819103 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3720/6374] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:49 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1263 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:50.846816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9f9f9c98-2dc0-462c-9d7a-de589da0a7cc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:50.848012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9f9f9c98-2dc0-462c-9d7a-de589da0a7cc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:50.859884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9f9f9c98-2dc0-462c-9d7a-de589da0a7cc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:50.860809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9f9f9c98-2dc0-462c-9d7a-de589da0a7cc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:50.861676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9f9f9c98-2dc0-462c-9d7a-de589da0a7cc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:50.862947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9f9f9c98-2dc0-462c-9d7a-de589da0a7cc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:50.863778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9f9f9c98-2dc0-462c-9d7a-de589da0a7cc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:50.864545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9f9f9c98-2dc0-462c-9d7a-de589da0a7cc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:51.035285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9f9f9c98-2dc0-462c-9d7a-de589da0a7cc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:51.044196 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9f9f9c98-2dc0-462c-9d7a-de589da0a7cc tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1263 microversion: 2.1 time: 0.205189 Aug 18 12:21:51.044808 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3721/6375] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:50 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1263 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:21:52.066042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-922cec54-4c4a-4995-86b2-6b9e6a2fb41e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:52.066810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-922cec54-4c4a-4995-86b2-6b9e6a2fb41e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:52.075112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-922cec54-4c4a-4995-86b2-6b9e6a2fb41e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:52.075635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-922cec54-4c4a-4995-86b2-6b9e6a2fb41e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:52.076246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-922cec54-4c4a-4995-86b2-6b9e6a2fb41e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:52.077014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-922cec54-4c4a-4995-86b2-6b9e6a2fb41e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:52.077604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-922cec54-4c4a-4995-86b2-6b9e6a2fb41e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:52.078059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-922cec54-4c4a-4995-86b2-6b9e6a2fb41e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:52.233620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-922cec54-4c4a-4995-86b2-6b9e6a2fb41e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:52.241809 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-922cec54-4c4a-4995-86b2-6b9e6a2fb41e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1263 microversion: 2.1 time: 0.179965 Aug 18 12:21:52.242606 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3722/6376] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:52 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1263 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:53.268382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-292e7c08-4f43-402a-8a05-dcd2c81f5d3d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:53.269535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-292e7c08-4f43-402a-8a05-dcd2c81f5d3d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:53.282599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-292e7c08-4f43-402a-8a05-dcd2c81f5d3d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:53.283507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-292e7c08-4f43-402a-8a05-dcd2c81f5d3d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:53.284352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-292e7c08-4f43-402a-8a05-dcd2c81f5d3d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:53.285704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-292e7c08-4f43-402a-8a05-dcd2c81f5d3d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:53.286621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-292e7c08-4f43-402a-8a05-dcd2c81f5d3d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:53.287455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-292e7c08-4f43-402a-8a05-dcd2c81f5d3d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:53.496103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-292e7c08-4f43-402a-8a05-dcd2c81f5d3d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:53.506304 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-292e7c08-4f43-402a-8a05-dcd2c81f5d3d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1263 microversion: 2.1 time: 0.245373 Aug 18 12:21:53.507174 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3723/6377] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:53 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1263 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:53.596378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-68f4b0e0-01ab-47d4-a990-3a3cf0d177ef req-4f41e3b6-ed58-4752-ab1b-c90a6b572518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "605b4a98-818e-4156-8e01-17e388dadff9", "name": "network-vif-plugged", "status": "completed", "tag": "d62cf802-7da5-4078-9d5f-9d4974aba00b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:21:53.606972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-68f4b0e0-01ab-47d4-a990-3a3cf0d177ef req-4f41e3b6-ed58-4752-ab1b-c90a6b572518 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:53.607471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-68f4b0e0-01ab-47d4-a990-3a3cf0d177ef req-4f41e3b6-ed58-4752-ab1b-c90a6b572518 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:53.607922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-68f4b0e0-01ab-47d4-a990-3a3cf0d177ef req-4f41e3b6-ed58-4752-ab1b-c90a6b572518 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:53.621142 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-68f4b0e0-01ab-47d4-a990-3a3cf0d177ef req-4f41e3b6-ed58-4752-ab1b-c90a6b572518 service nova] Creating event network-vif-plugged:d62cf802-7da5-4078-9d5f-9d4974aba00b for instance 605b4a98-818e-4156-8e01-17e388dadff9 on n-h1-853611-3 Aug 18 12:21:53.626758 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-68f4b0e0-01ab-47d4-a990-3a3cf0d177ef req-4f41e3b6-ed58-4752-ab1b-c90a6b572518 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117380 Aug 18 12:21:53.627405 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3724/6378] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:21:54.530166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4369faa8-2d5f-4dc7-9ac4-74c97a3890e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:54.531066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4369faa8-2d5f-4dc7-9ac4-74c97a3890e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:54.539427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4369faa8-2d5f-4dc7-9ac4-74c97a3890e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:54.539867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4369faa8-2d5f-4dc7-9ac4-74c97a3890e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:54.540315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4369faa8-2d5f-4dc7-9ac4-74c97a3890e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:54.541070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4369faa8-2d5f-4dc7-9ac4-74c97a3890e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:54.541545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4369faa8-2d5f-4dc7-9ac4-74c97a3890e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:54.542021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4369faa8-2d5f-4dc7-9ac4-74c97a3890e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:54.704857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4369faa8-2d5f-4dc7-9ac4-74c97a3890e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:54.713456 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4369faa8-2d5f-4dc7-9ac4-74c97a3890e7 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1263 microversion: 2.1 time: 0.187557 Aug 18 12:21:54.714063 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3725/6379] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:54 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1263 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:55.735587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06ed8cb0-c238-4f1b-b436-21df759c2d96 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:55.736562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-06ed8cb0-c238-4f1b-b436-21df759c2d96 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:55.748863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06ed8cb0-c238-4f1b-b436-21df759c2d96 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:55.749370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06ed8cb0-c238-4f1b-b436-21df759c2d96 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:55.749820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06ed8cb0-c238-4f1b-b436-21df759c2d96 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:55.750589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06ed8cb0-c238-4f1b-b436-21df759c2d96 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:55.751059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06ed8cb0-c238-4f1b-b436-21df759c2d96 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:55.751521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06ed8cb0-c238-4f1b-b436-21df759c2d96 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:55.906892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-06ed8cb0-c238-4f1b-b436-21df759c2d96 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:55.916244 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-06ed8cb0-c238-4f1b-b436-21df759c2d96 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1450 microversion: 2.1 time: 0.184671 Aug 18 12:21:55.916946 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3726/6380] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:55 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1450 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:55.939081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-edd0d889-0ee4-4992-aa89-95756bcadcab tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:21:55.939880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-edd0d889-0ee4-4992-aa89-95756bcadcab tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:21:55.948268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-edd0d889-0ee4-4992-aa89-95756bcadcab tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:55.948955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-edd0d889-0ee4-4992-aa89-95756bcadcab tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:55.949468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-edd0d889-0ee4-4992-aa89-95756bcadcab tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:55.950283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-edd0d889-0ee4-4992-aa89-95756bcadcab tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:55.950855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-edd0d889-0ee4-4992-aa89-95756bcadcab tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:55.951534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-edd0d889-0ee4-4992-aa89-95756bcadcab tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:55.973468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:21:56.125774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-edd0d889-0ee4-4992-aa89-95756bcadcab tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:21:56.136009 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-edd0d889-0ee4-4992-aa89-95756bcadcab tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1450 microversion: 2.1 time: 0.201231 Aug 18 12:21:56.136657 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3727/6381] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:21:55 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1450 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:21:56.700889 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:21:56.701704 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:21:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:21:58.595082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-edb906a6-872c-4fdd-8966-e3b2ee766494 req-5f3fd4bb-0e6d-4f91-9197-d3fe058e6f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "605b4a98-818e-4156-8e01-17e388dadff9", "tag": "d62cf802-7da5-4078-9d5f-9d4974aba00b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:21:58.606719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-edb906a6-872c-4fdd-8966-e3b2ee766494 req-5f3fd4bb-0e6d-4f91-9197-d3fe058e6f92 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:21:58.607216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-edb906a6-872c-4fdd-8966-e3b2ee766494 req-5f3fd4bb-0e6d-4f91-9197-d3fe058e6f92 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:21:58.607666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-edb906a6-872c-4fdd-8966-e3b2ee766494 req-5f3fd4bb-0e6d-4f91-9197-d3fe058e6f92 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:21:58.904430 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-edb906a6-872c-4fdd-8966-e3b2ee766494 req-5f3fd4bb-0e6d-4f91-9197-d3fe058e6f92 service nova] Creating event network-changed:d62cf802-7da5-4078-9d5f-9d4974aba00b for instance 605b4a98-818e-4156-8e01-17e388dadff9 on n-h1-853611-3 Aug 18 12:21:58.910505 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-edb906a6-872c-4fdd-8966-e3b2ee766494 req-5f3fd4bb-0e6d-4f91-9197-d3fe058e6f92 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.318864 Aug 18 12:21:58.911324 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3728/6382] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:23:18.778365 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:23:18.779109 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:23:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:23:38.831878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:38.834401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:38.844779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3a0287e0-3ff4-4076-9919-eef9fdd1ed50 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:38.846049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3a0287e0-3ff4-4076-9919-eef9fdd1ed50 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:38.860604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a0287e0-3ff4-4076-9919-eef9fdd1ed50 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:38.861533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a0287e0-3ff4-4076-9919-eef9fdd1ed50 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:38.862366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a0287e0-3ff4-4076-9919-eef9fdd1ed50 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:38.864250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a0287e0-3ff4-4076-9919-eef9fdd1ed50 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:38.865047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a0287e0-3ff4-4076-9919-eef9fdd1ed50 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:38.865835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a0287e0-3ff4-4076-9919-eef9fdd1ed50 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:38.933397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3a0287e0-3ff4-4076-9919-eef9fdd1ed50 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:23:39.062563 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3a0287e0-3ff4-4076-9919-eef9fdd1ed50 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "DELETE /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 204 len: 0 microversion: 2.1 time: 0.236214 Aug 18 12:23:39.063179 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3729/6383] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:23:38 2022] DELETE /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:23:39.203609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-fd74b6f5-d631-419d-a6d7-1a88786ebc80 req-b616302d-09f8-41e9-b35a-b7dd513ad97d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "605b4a98-818e-4156-8e01-17e388dadff9", "tag": "d62cf802-7da5-4078-9d5f-9d4974aba00b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:39.222278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fd74b6f5-d631-419d-a6d7-1a88786ebc80 req-b616302d-09f8-41e9-b35a-b7dd513ad97d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:39.223975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fd74b6f5-d631-419d-a6d7-1a88786ebc80 req-b616302d-09f8-41e9-b35a-b7dd513ad97d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:39.224839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fd74b6f5-d631-419d-a6d7-1a88786ebc80 req-b616302d-09f8-41e9-b35a-b7dd513ad97d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:39.248542 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-fd74b6f5-d631-419d-a6d7-1a88786ebc80 req-b616302d-09f8-41e9-b35a-b7dd513ad97d service nova] Creating event network-changed:d62cf802-7da5-4078-9d5f-9d4974aba00b for instance 605b4a98-818e-4156-8e01-17e388dadff9 on n-h1-853611-3 Aug 18 12:23:39.257672 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-fd74b6f5-d631-419d-a6d7-1a88786ebc80 req-b616302d-09f8-41e9-b35a-b7dd513ad97d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188585 Aug 18 12:23:39.258864 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3730/6384] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:23:39.265693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-972f58e3-2dfc-446b-83e6-ba94ac9b2990 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:39.266635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-972f58e3-2dfc-446b-83e6-ba94ac9b2990 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:39.276643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-972f58e3-2dfc-446b-83e6-ba94ac9b2990 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:39.277526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-972f58e3-2dfc-446b-83e6-ba94ac9b2990 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:39.278320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-972f58e3-2dfc-446b-83e6-ba94ac9b2990 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:39.279656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-972f58e3-2dfc-446b-83e6-ba94ac9b2990 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:39.280524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-972f58e3-2dfc-446b-83e6-ba94ac9b2990 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:39.281342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-972f58e3-2dfc-446b-83e6-ba94ac9b2990 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:39.622232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-972f58e3-2dfc-446b-83e6-ba94ac9b2990 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:39.632353 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-972f58e3-2dfc-446b-83e6-ba94ac9b2990 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1574 microversion: 2.1 time: 0.372160 Aug 18 12:23:39.633170 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3731/6385] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:39 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1574 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:40.671694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e861f1d9-f4f6-4f62-83b6-78f6c2a9a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:40.673096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e861f1d9-f4f6-4f62-83b6-78f6c2a9a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:40.688288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e861f1d9-f4f6-4f62-83b6-78f6c2a9a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:40.690094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e861f1d9-f4f6-4f62-83b6-78f6c2a9a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:40.691285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e861f1d9-f4f6-4f62-83b6-78f6c2a9a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:40.693003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e861f1d9-f4f6-4f62-83b6-78f6c2a9a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:40.694852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e861f1d9-f4f6-4f62-83b6-78f6c2a9a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:40.695682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e861f1d9-f4f6-4f62-83b6-78f6c2a9a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:41.068759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e861f1d9-f4f6-4f62-83b6-78f6c2a9a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:41.083143 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e861f1d9-f4f6-4f62-83b6-78f6c2a9a1e2 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1574 microversion: 2.1 time: 0.417183 Aug 18 12:23:41.085281 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3732/6386] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:40 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1574 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:23:41.740522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-48c46033-8870-432e-8776-f7cdcb51e1c4 req-e48af012-477f-4a63-8e3a-abaa7d7b2947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "605b4a98-818e-4156-8e01-17e388dadff9", "name": "network-vif-deleted", "tag": "d62cf802-7da5-4078-9d5f-9d4974aba00b"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:41.753049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-48c46033-8870-432e-8776-f7cdcb51e1c4 req-e48af012-477f-4a63-8e3a-abaa7d7b2947 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:41.753967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-48c46033-8870-432e-8776-f7cdcb51e1c4 req-e48af012-477f-4a63-8e3a-abaa7d7b2947 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:41.754608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-48c46033-8870-432e-8776-f7cdcb51e1c4 req-e48af012-477f-4a63-8e3a-abaa7d7b2947 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:41.774845 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-48c46033-8870-432e-8776-f7cdcb51e1c4 req-e48af012-477f-4a63-8e3a-abaa7d7b2947 service nova] Creating event network-vif-deleted:d62cf802-7da5-4078-9d5f-9d4974aba00b for instance 605b4a98-818e-4156-8e01-17e388dadff9 on n-h1-853611-3 Aug 18 12:23:41.784375 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-48c46033-8870-432e-8776-f7cdcb51e1c4 req-e48af012-477f-4a63-8e3a-abaa7d7b2947 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045274 Aug 18 12:23:41.785063 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3733/6387] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:23:42.127097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-513dcc0e-cbd8-4030-b8cb-fccc766ac93d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:42.129159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-513dcc0e-cbd8-4030-b8cb-fccc766ac93d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:42.141399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-513dcc0e-cbd8-4030-b8cb-fccc766ac93d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:42.142336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-513dcc0e-cbd8-4030-b8cb-fccc766ac93d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:42.143173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-513dcc0e-cbd8-4030-b8cb-fccc766ac93d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:42.144526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-513dcc0e-cbd8-4030-b8cb-fccc766ac93d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:42.146009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-513dcc0e-cbd8-4030-b8cb-fccc766ac93d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:42.146872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-513dcc0e-cbd8-4030-b8cb-fccc766ac93d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:42.260937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-513dcc0e-cbd8-4030-b8cb-fccc766ac93d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:42.275871 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-513dcc0e-cbd8-4030-b8cb-fccc766ac93d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1223 microversion: 2.1 time: 0.156785 Aug 18 12:23:42.276956 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3734/6388] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:42 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1223 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:23:43.312792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a2882469-c677-4768-a268-87e349086918 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:43.313885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a2882469-c677-4768-a268-87e349086918 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:43.328109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2882469-c677-4768-a268-87e349086918 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:43.329042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2882469-c677-4768-a268-87e349086918 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:43.329843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2882469-c677-4768-a268-87e349086918 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:43.331217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2882469-c677-4768-a268-87e349086918 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:43.332068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2882469-c677-4768-a268-87e349086918 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:43.333397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2882469-c677-4768-a268-87e349086918 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:43.439017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a2882469-c677-4768-a268-87e349086918 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:43.453683 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a2882469-c677-4768-a268-87e349086918 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1223 microversion: 2.1 time: 0.147558 Aug 18 12:23:43.454793 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3735/6389] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:43 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1223 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:23:44.492859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-919d10dd-9f74-4827-b59c-546453172bcf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:44.494014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-919d10dd-9f74-4827-b59c-546453172bcf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:44.503152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-919d10dd-9f74-4827-b59c-546453172bcf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:44.503739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-919d10dd-9f74-4827-b59c-546453172bcf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:44.504762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-919d10dd-9f74-4827-b59c-546453172bcf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:44.506048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-919d10dd-9f74-4827-b59c-546453172bcf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:44.506673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-919d10dd-9f74-4827-b59c-546453172bcf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:44.507253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-919d10dd-9f74-4827-b59c-546453172bcf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:44.589891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-919d10dd-9f74-4827-b59c-546453172bcf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:44.599288 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-919d10dd-9f74-4827-b59c-546453172bcf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1223 microversion: 2.1 time: 0.112430 Aug 18 12:23:44.600023 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3736/6390] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:44 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1223 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:45.625861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b0ba4589-042b-4989-8fb0-7293db7c9c21 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:45.627073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b0ba4589-042b-4989-8fb0-7293db7c9c21 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:45.640735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0ba4589-042b-4989-8fb0-7293db7c9c21 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:45.641614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0ba4589-042b-4989-8fb0-7293db7c9c21 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:45.642379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0ba4589-042b-4989-8fb0-7293db7c9c21 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:45.643749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0ba4589-042b-4989-8fb0-7293db7c9c21 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:45.644625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0ba4589-042b-4989-8fb0-7293db7c9c21 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:45.645417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0ba4589-042b-4989-8fb0-7293db7c9c21 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:45.742816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b0ba4589-042b-4989-8fb0-7293db7c9c21 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:45.751868 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b0ba4589-042b-4989-8fb0-7293db7c9c21 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1223 microversion: 2.1 time: 0.133632 Aug 18 12:23:45.752576 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3737/6391] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:45 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1223 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:46.776094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-64cf76a6-24df-460c-b464-93020130aa2e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:46.777129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-64cf76a6-24df-460c-b464-93020130aa2e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:46.786637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64cf76a6-24df-460c-b464-93020130aa2e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:46.787442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64cf76a6-24df-460c-b464-93020130aa2e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:46.788294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64cf76a6-24df-460c-b464-93020130aa2e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:46.789485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64cf76a6-24df-460c-b464-93020130aa2e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:46.790345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64cf76a6-24df-460c-b464-93020130aa2e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:46.791257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64cf76a6-24df-460c-b464-93020130aa2e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:46.831995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64cf76a6-24df-460c-b464-93020130aa2e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:46.832449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64cf76a6-24df-460c-b464-93020130aa2e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:46.833416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64cf76a6-24df-460c-b464-93020130aa2e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:46.833892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-64cf76a6-24df-460c-b464-93020130aa2e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lazy-loading 'fault' on Instance uuid 605b4a98-818e-4156-8e01-17e388dadff9 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:23:46.882245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-64cf76a6-24df-460c-b464-93020130aa2e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:46.890804 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-64cf76a6-24df-460c-b464-93020130aa2e tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 200 len: 1228 microversion: 2.1 time: 0.118766 Aug 18 12:23:46.891434 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3738/6392] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:46 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 1228 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:23:47.913699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0f30c01f-0bed-4bc3-ab74-f9b4f6db6248 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:47.914817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0f30c01f-0bed-4bc3-ab74-f9b4f6db6248 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: 605b4a98-818e-4156-8e01-17e388dadff9] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:47.923287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f30c01f-0bed-4bc3-ab74-f9b4f6db6248 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:47.923960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f30c01f-0bed-4bc3-ab74-f9b4f6db6248 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:47.924520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f30c01f-0bed-4bc3-ab74-f9b4f6db6248 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:47.925370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f30c01f-0bed-4bc3-ab74-f9b4f6db6248 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:47.926045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f30c01f-0bed-4bc3-ab74-f9b4f6db6248 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:47.927182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f30c01f-0bed-4bc3-ab74-f9b4f6db6248 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:47.944607 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-0f30c01f-0bed-4bc3-ab74-f9b4f6db6248 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance 605b4a98-818e-4156-8e01-17e388dadff9 could not be found. Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0f30c01f-0bed-4bc3-ab74-f9b4f6db6248 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 HTTP/1.1 Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 605b4a98-818e-4156-8e01-17e388dadff9 could not be found. Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '605b4a98-818e-4156-8e01-17e388dadff9'} Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 605b4a98-818e-4156-8e01-17e388dadff9 could not be found. Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 605b4a98-818e-4156-8e01-17e388dadff9 could not be found. Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:23:47.946415 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:23:47.951432 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:23:47.951432 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:23:47.951432 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:23:47.951432 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:23:47.951432 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:23:47.951432 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 605b4a98-818e-4156-8e01-17e388dadff9 could not be found. Aug 18 12:23:47.951432 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:23:47.951432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0f30c01f-0bed-4bc3-ab74-f9b4f6db6248 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance 605b4a98-818e-4156-8e01-17e388dadff9 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:23:47.951432 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0f30c01f-0bed-4bc3-ab74-f9b4f6db6248 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9" status: 404 len: 111 microversion: 2.1 time: 0.039084 Aug 18 12:23:47.951432 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3739/6393] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:47 2022] GET /compute/v2.1/servers/605b4a98-818e-4156-8e01-17e388dadff9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:23:54.628283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-569151be-6b81-47cf-8543-8a37a4c47a1d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:54.630048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-569151be-6b81-47cf-8543-8a37a4c47a1d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:54.645762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-569151be-6b81-47cf-8543-8a37a4c47a1d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:54.647111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-569151be-6b81-47cf-8543-8a37a4c47a1d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:54.647934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-569151be-6b81-47cf-8543-8a37a4c47a1d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:54.649286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-569151be-6b81-47cf-8543-8a37a4c47a1d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:54.650174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-569151be-6b81-47cf-8543-8a37a4c47a1d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:54.651021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-569151be-6b81-47cf-8543-8a37a4c47a1d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:54.704959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-569151be-6b81-47cf-8543-8a37a4c47a1d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:23:54.831491 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-569151be-6b81-47cf-8543-8a37a4c47a1d tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 204 len: 0 microversion: 2.1 time: 0.211126 Aug 18 12:23:54.838524 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3740/6394] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:23:54 2022] DELETE /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:23:54.841849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-73b61583-5636-4615-968a-611abbb2302b req-c4592472-84fc-4455-aa9d-f0b39224ff78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b32ea0e5-56f4-4702-a840-3f038a30e013", "tag": "44fb218b-11a4-45ca-8c84-ddd21b95e55f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:54.853396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-73b61583-5636-4615-968a-611abbb2302b req-c4592472-84fc-4455-aa9d-f0b39224ff78 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:54.854026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-73b61583-5636-4615-968a-611abbb2302b req-c4592472-84fc-4455-aa9d-f0b39224ff78 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:54.854584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-73b61583-5636-4615-968a-611abbb2302b req-c4592472-84fc-4455-aa9d-f0b39224ff78 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:54.872088 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-73b61583-5636-4615-968a-611abbb2302b req-c4592472-84fc-4455-aa9d-f0b39224ff78 service nova] Creating event network-changed:44fb218b-11a4-45ca-8c84-ddd21b95e55f for instance b32ea0e5-56f4-4702-a840-3f038a30e013 on n-h2-853611-3 Aug 18 12:23:54.878197 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-73b61583-5636-4615-968a-611abbb2302b req-c4592472-84fc-4455-aa9d-f0b39224ff78 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043176 Aug 18 12:23:54.879723 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3741/6395] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:23:54.885921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b8fcc919-6814-4e8b-9c47-b8c13fd07cfa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:54.886719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b8fcc919-6814-4e8b-9c47-b8c13fd07cfa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:54.893912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8fcc919-6814-4e8b-9c47-b8c13fd07cfa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:54.894467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8fcc919-6814-4e8b-9c47-b8c13fd07cfa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:54.895557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8fcc919-6814-4e8b-9c47-b8c13fd07cfa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:54.896377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8fcc919-6814-4e8b-9c47-b8c13fd07cfa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:54.897224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8fcc919-6814-4e8b-9c47-b8c13fd07cfa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:54.897935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8fcc919-6814-4e8b-9c47-b8c13fd07cfa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:55.092612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8fcc919-6814-4e8b-9c47-b8c13fd07cfa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:55.103530 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b8fcc919-6814-4e8b-9c47-b8c13fd07cfa tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1576 microversion: 2.1 time: 0.222669 Aug 18 12:23:55.104381 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3742/6396] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:54 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:23:56.140417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7dae8a9c-9fec-49f4-baa7-1a1533266c6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:56.141110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dae8a9c-9fec-49f4-baa7-1a1533266c6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:56.149459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dae8a9c-9fec-49f4-baa7-1a1533266c6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:56.149967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dae8a9c-9fec-49f4-baa7-1a1533266c6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:56.150423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dae8a9c-9fec-49f4-baa7-1a1533266c6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:56.151215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dae8a9c-9fec-49f4-baa7-1a1533266c6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:56.151696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dae8a9c-9fec-49f4-baa7-1a1533266c6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:56.152137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dae8a9c-9fec-49f4-baa7-1a1533266c6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:56.391650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7dae8a9c-9fec-49f4-baa7-1a1533266c6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:56.413181 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7dae8a9c-9fec-49f4-baa7-1a1533266c6a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1576 microversion: 2.1 time: 0.276485 Aug 18 12:23:56.419096 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3743/6397] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:56 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1576 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:23:57.255900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a4971de0-7084-4d59-9753-f1872b1448a8 req-b7dad7c9-eb22-4e8a-b4e9-5d66d930dfc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b32ea0e5-56f4-4702-a840-3f038a30e013", "name": "network-vif-deleted", "tag": "44fb218b-11a4-45ca-8c84-ddd21b95e55f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:23:57.268957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a4971de0-7084-4d59-9753-f1872b1448a8 req-b7dad7c9-eb22-4e8a-b4e9-5d66d930dfc6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:57.269609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a4971de0-7084-4d59-9753-f1872b1448a8 req-b7dad7c9-eb22-4e8a-b4e9-5d66d930dfc6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:57.270756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a4971de0-7084-4d59-9753-f1872b1448a8 req-b7dad7c9-eb22-4e8a-b4e9-5d66d930dfc6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:57.284571 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a4971de0-7084-4d59-9753-f1872b1448a8 req-b7dad7c9-eb22-4e8a-b4e9-5d66d930dfc6 service nova] Creating event network-vif-deleted:44fb218b-11a4-45ca-8c84-ddd21b95e55f for instance b32ea0e5-56f4-4702-a840-3f038a30e013 on n-h2-853611-3 Aug 18 12:23:57.290876 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a4971de0-7084-4d59-9753-f1872b1448a8 req-b7dad7c9-eb22-4e8a-b4e9-5d66d930dfc6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124426 Aug 18 12:23:57.291659 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3744/6398] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:23:57.445037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c84e181d-c041-4e8f-97da-ef5356291e9a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:57.446312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c84e181d-c041-4e8f-97da-ef5356291e9a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:57.456572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c84e181d-c041-4e8f-97da-ef5356291e9a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:57.457259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c84e181d-c041-4e8f-97da-ef5356291e9a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:57.458357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c84e181d-c041-4e8f-97da-ef5356291e9a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:57.459401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c84e181d-c041-4e8f-97da-ef5356291e9a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:57.460419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c84e181d-c041-4e8f-97da-ef5356291e9a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:57.461616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c84e181d-c041-4e8f-97da-ef5356291e9a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:57.470515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:23:57.572439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c84e181d-c041-4e8f-97da-ef5356291e9a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:57.588282 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c84e181d-c041-4e8f-97da-ef5356291e9a tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1224 microversion: 2.1 time: 0.149878 Aug 18 12:23:57.589291 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3745/6399] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:57 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1224 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:23:58.615252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b8f39b59-2bb6-4894-93d3-90884d341312 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:58.616267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b8f39b59-2bb6-4894-93d3-90884d341312 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:58.623832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8f39b59-2bb6-4894-93d3-90884d341312 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:58.624357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8f39b59-2bb6-4894-93d3-90884d341312 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:58.624854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8f39b59-2bb6-4894-93d3-90884d341312 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:58.625569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8f39b59-2bb6-4894-93d3-90884d341312 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:58.626051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8f39b59-2bb6-4894-93d3-90884d341312 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:58.626554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8f39b59-2bb6-4894-93d3-90884d341312 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:58.724687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8f39b59-2bb6-4894-93d3-90884d341312 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:58.734402 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b8f39b59-2bb6-4894-93d3-90884d341312 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1224 microversion: 2.1 time: 0.124219 Aug 18 12:23:58.735581 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3746/6400] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:58 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1224 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:23:59.758299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3ad7830d-1a1c-4309-8065-5e608a896177 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:23:59.759615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3ad7830d-1a1c-4309-8065-5e608a896177 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:23:59.768068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ad7830d-1a1c-4309-8065-5e608a896177 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:59.768737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ad7830d-1a1c-4309-8065-5e608a896177 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:59.769356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ad7830d-1a1c-4309-8065-5e608a896177 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:59.770796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ad7830d-1a1c-4309-8065-5e608a896177 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:23:59.771705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ad7830d-1a1c-4309-8065-5e608a896177 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:23:59.771922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ad7830d-1a1c-4309-8065-5e608a896177 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:23:59.861893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3ad7830d-1a1c-4309-8065-5e608a896177 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:23:59.877148 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3ad7830d-1a1c-4309-8065-5e608a896177 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1224 microversion: 2.1 time: 0.123068 Aug 18 12:23:59.878368 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3747/6401] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:23:59 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1224 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:00.909996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7b28e80c-872d-4e24-af19-0f922c613f37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:00.911489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7b28e80c-872d-4e24-af19-0f922c613f37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:00.923486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b28e80c-872d-4e24-af19-0f922c613f37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:00.924342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b28e80c-872d-4e24-af19-0f922c613f37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:00.925113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b28e80c-872d-4e24-af19-0f922c613f37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:00.926667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b28e80c-872d-4e24-af19-0f922c613f37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:00.927507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b28e80c-872d-4e24-af19-0f922c613f37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:00.928246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b28e80c-872d-4e24-af19-0f922c613f37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:01.034815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7b28e80c-872d-4e24-af19-0f922c613f37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:01.049630 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7b28e80c-872d-4e24-af19-0f922c613f37 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1224 microversion: 2.1 time: 0.147069 Aug 18 12:24:01.054620 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3748/6402] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:00 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1224 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:02.085206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6351caa-11d3-49e9-a005-484bcf150e47 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:02.086223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c6351caa-11d3-49e9-a005-484bcf150e47 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:02.094791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6351caa-11d3-49e9-a005-484bcf150e47 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:02.095429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6351caa-11d3-49e9-a005-484bcf150e47 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:02.096008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6351caa-11d3-49e9-a005-484bcf150e47 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:02.096793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6351caa-11d3-49e9-a005-484bcf150e47 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:02.097298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6351caa-11d3-49e9-a005-484bcf150e47 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:02.098402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6351caa-11d3-49e9-a005-484bcf150e47 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:02.133347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6351caa-11d3-49e9-a005-484bcf150e47 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:02.133849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6351caa-11d3-49e9-a005-484bcf150e47 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:02.134297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6351caa-11d3-49e9-a005-484bcf150e47 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:02.134834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-c6351caa-11d3-49e9-a005-484bcf150e47 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lazy-loading 'fault' on Instance uuid b32ea0e5-56f4-4702-a840-3f038a30e013 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:24:02.180255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c6351caa-11d3-49e9-a005-484bcf150e47 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033d6aa61b5340189fbc5d895d3e8cba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02ef4395d604ea1b4c1a26644cadbd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:02.188340 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c6351caa-11d3-49e9-a005-484bcf150e47 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 200 len: 1229 microversion: 2.1 time: 0.109625 Aug 18 12:24:02.188943 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3749/6403] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:02 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 1229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:03.211045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8c4162b-370a-47db-b277-4ff3ac6c28df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:03.211861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e8c4162b-370a-47db-b277-4ff3ac6c28df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: b32ea0e5-56f4-4702-a840-3f038a30e013] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:03.220102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8c4162b-370a-47db-b277-4ff3ac6c28df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:03.220675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8c4162b-370a-47db-b277-4ff3ac6c28df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:03.221182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8c4162b-370a-47db-b277-4ff3ac6c28df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:03.221973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8c4162b-370a-47db-b277-4ff3ac6c28df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:03.223097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8c4162b-370a-47db-b277-4ff3ac6c28df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:03.224425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8c4162b-370a-47db-b277-4ff3ac6c28df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:03.241000 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-e8c4162b-370a-47db-b277-4ff3ac6c28df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance b32ea0e5-56f4-4702-a840-3f038a30e013 could not be found. Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8c4162b-370a-47db-b277-4ff3ac6c28df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 HTTP/1.1 Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance b32ea0e5-56f4-4702-a840-3f038a30e013 could not be found. Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'b32ea0e5-56f4-4702-a840-3f038a30e013'} Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b32ea0e5-56f4-4702-a840-3f038a30e013 could not be found. Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b32ea0e5-56f4-4702-a840-3f038a30e013 could not be found. Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:03.242793 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.247137 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:03.247137 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:03.247137 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:03.247137 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:24:03.247137 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:24:03.247137 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b32ea0e5-56f4-4702-a840-3f038a30e013 could not be found. Aug 18 12:24:03.247137 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.247137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8c4162b-370a-47db-b277-4ff3ac6c28df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance b32ea0e5-56f4-4702-a840-3f038a30e013 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:24:03.247137 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e8c4162b-370a-47db-b277-4ff3ac6c28df tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013" status: 404 len: 111 microversion: 2.1 time: 0.038282 Aug 18 12:24:03.247137 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3750/6404] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:03 2022] GET /compute/v2.1/servers/b32ea0e5-56f4-4702-a840-3f038a30e013 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:24:03.775535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e950b97d-f9b4-418f-a0d4-40620b365238 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:03.776050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e950b97d-f9b4-418f-a0d4-40620b365238 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:03.782611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e950b97d-f9b4-418f-a0d4-40620b365238 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:03.783131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e950b97d-f9b4-418f-a0d4-40620b365238 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:03.783585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e950b97d-f9b4-418f-a0d4-40620b365238 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:03.784326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e950b97d-f9b4-418f-a0d4-40620b365238 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:03.784803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e950b97d-f9b4-418f-a0d4-40620b365238 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:03.785278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e950b97d-f9b4-418f-a0d4-40620b365238 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:03.800565 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-e950b97d-f9b4-418f-a0d4-40620b365238 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e950b97d-f9b4-418f-a0d4-40620b365238 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 HTTP/1.1 Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12'} Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:24:03.802755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:24:03.806673 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:24:03.806673 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.806673 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:03.806673 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.806673 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:03.806673 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:03.806673 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:03.806673 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:24:03.806673 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:24:03.806673 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:24:03.806673 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.806673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e950b97d-f9b4-418f-a0d4-40620b365238 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:24:03.807417 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e950b97d-f9b4-418f-a0d4-40620b365238 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 404 len: 111 microversion: 2.1 time: 0.035276 Aug 18 12:24:03.807417 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3751/6405] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:24:03 2022] DELETE /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:24:03.816872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8f7bbbc-b8bb-4966-8273-2183628eafbf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:03.818225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f8f7bbbc-b8bb-4966-8273-2183628eafbf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] [instance: a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:03.824648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8f7bbbc-b8bb-4966-8273-2183628eafbf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:03.825158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8f7bbbc-b8bb-4966-8273-2183628eafbf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:03.825617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8f7bbbc-b8bb-4966-8273-2183628eafbf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:03.826361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8f7bbbc-b8bb-4966-8273-2183628eafbf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:03.826875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8f7bbbc-b8bb-4966-8273-2183628eafbf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:03.827321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8f7bbbc-b8bb-4966-8273-2183628eafbf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:03.844030 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-f8f7bbbc-b8bb-4966-8273-2183628eafbf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] HTTP exception thrown: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8f7bbbc-b8bb-4966-8273-2183628eafbf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Request method failure captured: Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 HTTP/1.1 Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_ixxvTU1jOP88BTdwVH1TY7uppSSrp2GvHs7ozHT9eeZr2XJF93xkUsIkE1no8g5szSRi7OIDaC_9rQQwlB4K5P-eNIZQj0rk5TTRjA6vA-csTmK38etpaJH-EyLhw6fh45qKXXArhMeyYOMbh-EPyJW-4dL5wRSijPjWGj_jsXa85U Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b02ef4395d604ea1b4c1a26644cadbd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: b02ef4395d604ea1b4c1a26644cadbd3 Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestVolumeBootPattern-1024534763 Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 033d6aa61b5340189fbc5d895d3e8cba Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestVolumeBootPattern-1024534763-project Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12'} Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:03.845748 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.850760 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:03.850760 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:03.850760 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:03.850760 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:24:03.850760 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:24:03.850760 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. Aug 18 12:24:03.850760 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:03.850760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8f7bbbc-b8bb-4966-8273-2183628eafbf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Returning 404 to user: Instance a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:24:03.850760 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8f7bbbc-b8bb-4966-8273-2183628eafbf tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12" status: 404 len: 111 microversion: 2.1 time: 0.035026 Aug 18 12:24:03.850760 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3752/6406] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:03 2022] GET /compute/v2.1/servers/a2526e2b-1d50-4c83-bf7c-d2ed9e2b0e12 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:24:07.431071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ebfb28e6-1dd9-4ea2-9f8d-c08a27db55e9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] Calling method '.version_select at 0x7f519e7853a0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:07.481042 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ebfb28e6-1dd9-4ea2-9f8d-c08a27db55e9 tempest-TestVolumeBootPattern-1024534763 tempest-TestVolumeBootPattern-1024534763-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-107783012" status: 202 len: 0 microversion: 2.1 time: 0.056953 Aug 18 12:24:07.482046 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3753/6407] 10.222.0.73 () {58 vars in 1260 bytes} [Thu Aug 18 12:24:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-107783012 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:24:31.577407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=36 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:31.580150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:31.740068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1870279878", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:31.804839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] validate_networks() for None {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:24:32.447963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:24:32.447963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:24:32.448222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:24:32.448653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:24:32.449091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:24:32.461566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:32.462067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:32.462555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:32.463302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:32.464030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:32.464468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:32.493258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Getting quotas for project fd91dab81d7f4244904bfa2ed08b47e9. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:24:32.499462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Getting quotas for user c75d664913c24cf48b389992c3937e3d and project fd91dab81d7f4244904bfa2ed08b47e9. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:24:32.514990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:24:32.517360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:24:32.566338 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fda6ec57-f94b-44c7-983b-8cab90be4389 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996239 Aug 18 12:24:32.567230 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3754/6408] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:24:32.589725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8ad8f178-1839-4f52-af9a-44bacc2f4ed1 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:32.591030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8ad8f178-1839-4f52-af9a-44bacc2f4ed1 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:32.669802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8ad8f178-1839-4f52-af9a-44bacc2f4ed1 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d664913c24cf48b389992c3937e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd91dab81d7f4244904bfa2ed08b47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:32.679426 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8ad8f178-1839-4f52-af9a-44bacc2f4ed1 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c" status: 200 len: 1222 microversion: 2.1 time: 0.096925 Aug 18 12:24:32.680064 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3755/6409] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:32 2022] GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:33.705188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a35de673-c34e-49e9-aea8-b0835f66e5d6 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:33.705918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a35de673-c34e-49e9-aea8-b0835f66e5d6 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:33.714983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a35de673-c34e-49e9-aea8-b0835f66e5d6 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:33.715917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a35de673-c34e-49e9-aea8-b0835f66e5d6 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:33.716731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a35de673-c34e-49e9-aea8-b0835f66e5d6 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:33.718620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a35de673-c34e-49e9-aea8-b0835f66e5d6 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:33.718946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a35de673-c34e-49e9-aea8-b0835f66e5d6 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:33.719751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a35de673-c34e-49e9-aea8-b0835f66e5d6 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:33.813729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a35de673-c34e-49e9-aea8-b0835f66e5d6 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d664913c24cf48b389992c3937e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd91dab81d7f4244904bfa2ed08b47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:33.827511 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a35de673-c34e-49e9-aea8-b0835f66e5d6 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c" status: 200 len: 1274 microversion: 2.1 time: 0.127288 Aug 18 12:24:33.828191 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3756/6410] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:33 2022] GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:34.856167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5a7ed118-778c-4e66-b1c3-263edd2f6a6a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:34.857230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5a7ed118-778c-4e66-b1c3-263edd2f6a6a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:34.866164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a7ed118-778c-4e66-b1c3-263edd2f6a6a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:34.866879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a7ed118-778c-4e66-b1c3-263edd2f6a6a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:34.867522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a7ed118-778c-4e66-b1c3-263edd2f6a6a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:34.868403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a7ed118-778c-4e66-b1c3-263edd2f6a6a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:34.869017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a7ed118-778c-4e66-b1c3-263edd2f6a6a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:34.869691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a7ed118-778c-4e66-b1c3-263edd2f6a6a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:34.954581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5a7ed118-778c-4e66-b1c3-263edd2f6a6a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d664913c24cf48b389992c3937e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd91dab81d7f4244904bfa2ed08b47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:34.971699 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5a7ed118-778c-4e66-b1c3-263edd2f6a6a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c" status: 200 len: 1280 microversion: 2.1 time: 0.119802 Aug 18 12:24:34.974196 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3757/6411] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:34 2022] GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c => generated 1280 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:36.017886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2acccef5-f922-4eb4-b678-75678d7dbb8d tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:36.018752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2acccef5-f922-4eb4-b678-75678d7dbb8d tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:36.028383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2acccef5-f922-4eb4-b678-75678d7dbb8d tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:36.028912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2acccef5-f922-4eb4-b678-75678d7dbb8d tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:36.029376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2acccef5-f922-4eb4-b678-75678d7dbb8d tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:36.030347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2acccef5-f922-4eb4-b678-75678d7dbb8d tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:36.031021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2acccef5-f922-4eb4-b678-75678d7dbb8d tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:36.031479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2acccef5-f922-4eb4-b678-75678d7dbb8d tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:36.210767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2acccef5-f922-4eb4-b678-75678d7dbb8d tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d664913c24cf48b389992c3937e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd91dab81d7f4244904bfa2ed08b47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:36.226474 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2acccef5-f922-4eb4-b678-75678d7dbb8d tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c" status: 200 len: 1322 microversion: 2.1 time: 0.212527 Aug 18 12:24:36.227750 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3758/6412] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:36 2022] GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:36.322621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-12811b2b-7303-4fa6-903a-b6160b933609 req-c1e37a8f-2b12-4f25-9c44-d458f3205e20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0fe90bf-784d-41c6-a969-f3409758167c", "tag": "2263150f-b0dd-4ca4-b4f3-4e5314c36dd4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:36.335203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-12811b2b-7303-4fa6-903a-b6160b933609 req-c1e37a8f-2b12-4f25-9c44-d458f3205e20 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:36.335981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-12811b2b-7303-4fa6-903a-b6160b933609 req-c1e37a8f-2b12-4f25-9c44-d458f3205e20 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:36.336445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-12811b2b-7303-4fa6-903a-b6160b933609 req-c1e37a8f-2b12-4f25-9c44-d458f3205e20 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:36.351135 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-12811b2b-7303-4fa6-903a-b6160b933609 req-c1e37a8f-2b12-4f25-9c44-d458f3205e20 service nova] Creating event network-changed:2263150f-b0dd-4ca4-b4f3-4e5314c36dd4 for instance e0fe90bf-784d-41c6-a969-f3409758167c on n-h2-853611-3 Aug 18 12:24:36.356777 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-12811b2b-7303-4fa6-903a-b6160b933609 req-c1e37a8f-2b12-4f25-9c44-d458f3205e20 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041766 Aug 18 12:24:36.357413 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3759/6413] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:24:37.251228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a663eaf1-07e4-49c3-99f6-6768aa73059a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:37.252400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a663eaf1-07e4-49c3-99f6-6768aa73059a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:37.260908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a663eaf1-07e4-49c3-99f6-6768aa73059a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:37.261429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a663eaf1-07e4-49c3-99f6-6768aa73059a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:37.261890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a663eaf1-07e4-49c3-99f6-6768aa73059a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:37.262681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a663eaf1-07e4-49c3-99f6-6768aa73059a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:37.263164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a663eaf1-07e4-49c3-99f6-6768aa73059a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:37.263624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a663eaf1-07e4-49c3-99f6-6768aa73059a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:37.427420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a663eaf1-07e4-49c3-99f6-6768aa73059a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d664913c24cf48b389992c3937e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd91dab81d7f4244904bfa2ed08b47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:37.442117 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a663eaf1-07e4-49c3-99f6-6768aa73059a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c" status: 200 len: 1322 microversion: 2.1 time: 0.196703 Aug 18 12:24:37.442970 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3760/6414] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:37 2022] GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:38.468433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f34bb20-4b4b-43ba-bcbc-0bbb83fc49e7 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:38.469458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f34bb20-4b4b-43ba-bcbc-0bbb83fc49e7 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:38.478212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f34bb20-4b4b-43ba-bcbc-0bbb83fc49e7 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:38.479153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f34bb20-4b4b-43ba-bcbc-0bbb83fc49e7 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:38.479979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f34bb20-4b4b-43ba-bcbc-0bbb83fc49e7 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:38.480958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f34bb20-4b4b-43ba-bcbc-0bbb83fc49e7 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:38.481783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f34bb20-4b4b-43ba-bcbc-0bbb83fc49e7 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:38.482646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f34bb20-4b4b-43ba-bcbc-0bbb83fc49e7 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:38.702407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2f34bb20-4b4b-43ba-bcbc-0bbb83fc49e7 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d664913c24cf48b389992c3937e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd91dab81d7f4244904bfa2ed08b47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:38.718634 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f34bb20-4b4b-43ba-bcbc-0bbb83fc49e7 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c" status: 200 len: 1322 microversion: 2.1 time: 0.255432 Aug 18 12:24:38.719700 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3761/6415] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:38 2022] GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:39.747369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-19d3b36e-79be-4ed4-9b1e-1cef40e47ad2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:39.748538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-19d3b36e-79be-4ed4-9b1e-1cef40e47ad2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:39.761177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19d3b36e-79be-4ed4-9b1e-1cef40e47ad2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:39.762067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19d3b36e-79be-4ed4-9b1e-1cef40e47ad2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:39.762953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19d3b36e-79be-4ed4-9b1e-1cef40e47ad2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:39.764232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19d3b36e-79be-4ed4-9b1e-1cef40e47ad2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:39.764946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19d3b36e-79be-4ed4-9b1e-1cef40e47ad2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:39.765744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-19d3b36e-79be-4ed4-9b1e-1cef40e47ad2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:39.979396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-19d3b36e-79be-4ed4-9b1e-1cef40e47ad2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d664913c24cf48b389992c3937e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd91dab81d7f4244904bfa2ed08b47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:39.988707 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-19d3b36e-79be-4ed4-9b1e-1cef40e47ad2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c" status: 200 len: 1322 microversion: 2.1 time: 0.248642 Aug 18 12:24:39.989319 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3762/6416] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:39 2022] GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:41.022231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8dcd10d3-83dd-4b1b-8894-9eb07503465a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:41.023046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8dcd10d3-83dd-4b1b-8894-9eb07503465a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:41.032312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcd10d3-83dd-4b1b-8894-9eb07503465a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:41.032834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcd10d3-83dd-4b1b-8894-9eb07503465a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:41.033306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcd10d3-83dd-4b1b-8894-9eb07503465a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:41.034194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcd10d3-83dd-4b1b-8894-9eb07503465a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:41.034913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcd10d3-83dd-4b1b-8894-9eb07503465a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:41.035598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dcd10d3-83dd-4b1b-8894-9eb07503465a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:41.209982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8dcd10d3-83dd-4b1b-8894-9eb07503465a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d664913c24cf48b389992c3937e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd91dab81d7f4244904bfa2ed08b47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:41.218724 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8dcd10d3-83dd-4b1b-8894-9eb07503465a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c" status: 200 len: 1322 microversion: 2.1 time: 0.200871 Aug 18 12:24:41.219344 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3763/6417] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:41 2022] GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:41.893138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-58e4c511-5d15-4401-876c-bd0d6aee1fe9 req-6c7572d0-ef01-408a-8b8d-784052d525e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0fe90bf-784d-41c6-a969-f3409758167c", "name": "network-vif-plugged", "status": "completed", "tag": "2263150f-b0dd-4ca4-b4f3-4e5314c36dd4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:41.914208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-58e4c511-5d15-4401-876c-bd0d6aee1fe9 req-6c7572d0-ef01-408a-8b8d-784052d525e2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:41.915128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-58e4c511-5d15-4401-876c-bd0d6aee1fe9 req-6c7572d0-ef01-408a-8b8d-784052d525e2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:41.915964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-58e4c511-5d15-4401-876c-bd0d6aee1fe9 req-6c7572d0-ef01-408a-8b8d-784052d525e2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:41.939755 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-58e4c511-5d15-4401-876c-bd0d6aee1fe9 req-6c7572d0-ef01-408a-8b8d-784052d525e2 service nova] Creating event network-vif-plugged:2263150f-b0dd-4ca4-b4f3-4e5314c36dd4 for instance e0fe90bf-784d-41c6-a969-f3409758167c on n-h2-853611-3 Aug 18 12:24:41.948734 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-58e4c511-5d15-4401-876c-bd0d6aee1fe9 req-6c7572d0-ef01-408a-8b8d-784052d525e2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136001 Aug 18 12:24:41.949953 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3764/6418] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:24:42.243386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02bf09d7-5d2a-4935-9189-6e1ac9a5312a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:42.244158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-02bf09d7-5d2a-4935-9189-6e1ac9a5312a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:42.251188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02bf09d7-5d2a-4935-9189-6e1ac9a5312a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:42.251726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02bf09d7-5d2a-4935-9189-6e1ac9a5312a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:42.252192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02bf09d7-5d2a-4935-9189-6e1ac9a5312a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:42.253518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02bf09d7-5d2a-4935-9189-6e1ac9a5312a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:42.254158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02bf09d7-5d2a-4935-9189-6e1ac9a5312a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:42.254817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02bf09d7-5d2a-4935-9189-6e1ac9a5312a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:42.413419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-02bf09d7-5d2a-4935-9189-6e1ac9a5312a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d664913c24cf48b389992c3937e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd91dab81d7f4244904bfa2ed08b47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:42.426233 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-02bf09d7-5d2a-4935-9189-6e1ac9a5312a tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c" status: 200 len: 1322 microversion: 2.1 time: 0.187656 Aug 18 12:24:42.427366 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3765/6419] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:42 2022] GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:43.447362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-74af08b8-ec67-47de-aa75-8fe6cbedfe46 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:43.448098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-74af08b8-ec67-47de-aa75-8fe6cbedfe46 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:43.449980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:43.450743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:43.458641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74af08b8-ec67-47de-aa75-8fe6cbedfe46 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:43.459147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74af08b8-ec67-47de-aa75-8fe6cbedfe46 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:43.459600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74af08b8-ec67-47de-aa75-8fe6cbedfe46 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:43.460335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74af08b8-ec67-47de-aa75-8fe6cbedfe46 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:43.460806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74af08b8-ec67-47de-aa75-8fe6cbedfe46 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:43.461243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74af08b8-ec67-47de-aa75-8fe6cbedfe46 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:43.607158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-74af08b8-ec67-47de-aa75-8fe6cbedfe46 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d664913c24cf48b389992c3937e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd91dab81d7f4244904bfa2ed08b47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:43.616386 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-74af08b8-ec67-47de-aa75-8fe6cbedfe46 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c" status: 200 len: 1472 microversion: 2.1 time: 0.173035 Aug 18 12:24:43.616999 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3766/6420] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:43 2022] GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:43.691771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c7d3164-a7a8-43b3-8151-604a07731051 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Calling method '.version_select at 0x7f519e6abf70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:43.764977 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c7d3164-a7a8-43b3-8151-604a07731051 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/cd87674a149646ffa3674dc03bd550c1" status: 200 len: 371 microversion: 2.1 time: 0.128170 Aug 18 12:24:43.765645 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3767/6421] 10.222.0.73 () {58 vars in 1242 bytes} [Thu Aug 18 12:24:43 2022] GET /compute/v2.1/os-quota-sets/cd87674a149646ffa3674dc03bd550c1 => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:24:43.779058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-409bb64b-5219-4e34-b2a3-266cb6164168 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1459331043", "id": 1015262026, "os-flavor-access:is_public": "True"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:43.782387 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:24:43.782387 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:24:43.800749 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-409bb64b-5219-4e34-b2a3-266cb6164168 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.025569 Aug 18 12:24:43.801660 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3768/6422] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:24:43 2022] POST /compute/v2.1/flavors => generated 438 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:24:43.815020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1015262026"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:43.818076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:43.825092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:43.825607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:43.826135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:43.826905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:43.827390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:43.827842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.109325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '96ed36e872fe4b29b2e7488de7785899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd87674a149646ffa3674dc03bd550c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:44.117323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1459331043 {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 12:24:44.125007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.125519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.125985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.126796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.127275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.127727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.152467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Getting quotas for project fd91dab81d7f4244904bfa2ed08b47e9. Resources: {'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:24:44.158355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Getting quotas for user c75d664913c24cf48b389992c3937e3d and project fd91dab81d7f4244904bfa2ed08b47e9. Resources: {'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:24:44.173447 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.compute.api [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] ram quota exceeded for cd87674a149646ffa3674dc03bd550c1, tried to resize instance. Aug 18 12:24:44.174014 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Request method failure captured: Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c/action HTTP/1.1 Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 39 Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_i9_e-Qda4oMxwdPDtcAvMzBAL4VwCyJW9jh88-fn6cHq5HV631uD_XXoOBpIz0Y4Q8V-9QRFv_TPftiJRSF7g6xhy7OHh8Wot9EPsdS2_OSnPcFLXibh_CklgyQ4d8ZRZvpUOV5yZvKFjKFujUdts5UopUwecs3STj63ZZ_St5tPPA Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: cd87674a149646ffa3674dc03bd550c1 Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2087262540 Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cd87674a149646ffa3674dc03bd550c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cd87674a149646ffa3674dc03bd550c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cd87674a149646ffa3674dc03bd550c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cd87674a149646ffa3674dc03bd550c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2087262540 Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: cd87674a149646ffa3674dc03bd550c1 Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2087262540 Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersAdminNegativeTestJSON-2087262540-project-admin Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 96ed36e872fe4b29b2e7488de7785899 Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2087262540-project-admin Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: {"resize": {"flavorRef": "1015262026"}} Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'e0fe90bf-784d-41c6-a969-f3409758167c', 'body': {'resize': {'flavorRef': '1015262026'}}} Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 12:24:44.180250 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b6006776-2198-4acb-8158-4f18a046e37c tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c/action" status: 403 len: 118 microversion: 2.1 time: 0.371005 Aug 18 12:24:44.186720 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3769/6423] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:24:43 2022] POST /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c/action => generated 118 bytes in 373 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:24:44.191563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a950a564-e07c-4c78-b6bc-59dfa9055216 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:44.192318 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:24:44.192318 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:24:44.233776 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a950a564-e07c-4c78-b6bc-59dfa9055216 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/1015262026" status: 202 len: 0 microversion: 2.1 time: 0.046213 Aug 18 12:24:44.234602 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3770/6424] 10.222.0.73 () {58 vars in 1161 bytes} [Thu Aug 18 12:24:44 2022] DELETE /compute/v2.1/flavors/1015262026 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:24:44.244474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c2df28cc-9dac-4dc6-ab01-a9b707380045 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:44.271758 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c2df28cc-9dac-4dc6-ab01-a9b707380045 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031078 Aug 18 12:24:44.272386 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3771/6425] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 12:24:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:44.295773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b57aaf62-62c5-4b58-b2cf-dbda75656776 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Calling method '.version_select at 0x7f519e890d30>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:44.370753 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b57aaf62-62c5-4b58-b2cf-dbda75656776 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] 10.222.0.73 "GET /compute/v2.1/os-quota-sets/cd87674a149646ffa3674dc03bd550c1" status: 200 len: 371 microversion: 2.1 time: 0.080790 Aug 18 12:24:44.371354 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3772/6426] 10.222.0.73 () {58 vars in 1242 bytes} [Thu Aug 18 12:24:44 2022] GET /compute/v2.1/os-quota-sets/cd87674a149646ffa3674dc03bd550c1 => generated 371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:24:44.383206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-20a624c5-d6c3-41bc-a175-a92df61169e4 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-374281752", "id": 344082795, "os-flavor-access:is_public": "True"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:44.386198 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:24:44.386198 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:24:44.403082 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-20a624c5-d6c3-41bc-a175-a92df61169e4 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.023598 Aug 18 12:24:44.403701 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3773/6427] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:24:44 2022] POST /compute/v2.1/flavors => generated 433 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:24:44.416407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "344082795"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:44.418929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:44.426675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.427195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.427650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.428400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.428877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.429321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.464182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '96ed36e872fe4b29b2e7488de7785899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd87674a149646ffa3674dc03bd550c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:44.471574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-374281752 {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 12:24:44.479598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.480106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.480565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.481404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.481885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.482335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.509890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Getting quotas for project fd91dab81d7f4244904bfa2ed08b47e9. Resources: {'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:24:44.515747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Getting quotas for user c75d664913c24cf48b389992c3937e3d and project fd91dab81d7f4244904bfa2ed08b47e9. Resources: {'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:24:44.530689 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.compute.api [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] cores quota exceeded for cd87674a149646ffa3674dc03bd550c1, tried to resize instance. Aug 18 12:24:44.531248 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Request method failure captured: Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c/action HTTP/1.1 Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 38 Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_i9_e-Qda4oMxwdPDtcAvMzBAL4VwCyJW9jh88-fn6cHq5HV631uD_XXoOBpIz0Y4Q8V-9QRFv_TPftiJRSF7g6xhy7OHh8Wot9EPsdS2_OSnPcFLXibh_CklgyQ4d8ZRZvpUOV5yZvKFjKFujUdts5UopUwecs3STj63ZZ_St5tPPA Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: cd87674a149646ffa3674dc03bd550c1 Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2087262540 Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Role: admin,member,reader Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: admin,member,reader Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cd87674a149646ffa3674dc03bd550c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/cd87674a149646ffa3674dc03bd550c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_cd87674a149646ffa3674dc03bd550c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/cd87674a149646ffa3674dc03bd550c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2087262540 Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: cd87674a149646ffa3674dc03bd550c1 Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2087262540 Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersAdminNegativeTestJSON-2087262540-project-admin Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 96ed36e872fe4b29b2e7488de7785899 Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2087262540-project-admin Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: {"resize": {"flavorRef": "344082795"}} Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'e0fe90bf-784d-41c6-a969-f3409758167c', 'body': {'resize': {'flavorRef': '344082795'}}} Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 12:24:44.533510 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2a26e2d5-2925-4c24-adb2-f9d97fa7eaa6 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] 10.222.0.73 "POST /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c/action" status: 403 len: 113 microversion: 2.1 time: 0.124088 Aug 18 12:24:44.538290 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3774/6428] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:24:44 2022] POST /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c/action => generated 113 bytes in 126 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:24:44.546675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0adde411-899c-4aac-aaef-57bb01d5c930 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:44.547452 n-d-853611-3 devstack@n-api.service[122210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 12:24:44.547452 n-d-853611-3 devstack@n-api.service[122210]: warnings.warn(msg) Aug 18 12:24:44.567319 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0adde411-899c-4aac-aaef-57bb01d5c930 tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] 10.222.0.73 "DELETE /compute/v2.1/flavors/344082795" status: 202 len: 0 microversion: 2.1 time: 0.024053 Aug 18 12:24:44.568227 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3775/6429] 10.222.0.73 () {58 vars in 1158 bytes} [Thu Aug 18 12:24:44 2022] DELETE /compute/v2.1/flavors/344082795 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:24:44.580333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-36d69b7a-28c6-43ae-be1d-480741c5b29d tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:44.593453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:44.611073 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-36d69b7a-28c6-43ae-be1d-480741c5b29d tempest-ServersAdminNegativeTestJSON-2087262540 tempest-ServersAdminNegativeTestJSON-2087262540-project-admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036615 Aug 18 12:24:44.611688 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3776/6430] 10.222.0.73 () {58 vars in 1146 bytes} [Thu Aug 18 12:24:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:44.633497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e6408d36-dfc2-4bed-869d-9f18686e5754 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:44.634130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e6408d36-dfc2-4bed-869d-9f18686e5754 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:44.642680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6408d36-dfc2-4bed-869d-9f18686e5754 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.643255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6408d36-dfc2-4bed-869d-9f18686e5754 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.644585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6408d36-dfc2-4bed-869d-9f18686e5754 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.645609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6408d36-dfc2-4bed-869d-9f18686e5754 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.646174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6408d36-dfc2-4bed-869d-9f18686e5754 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.646862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6408d36-dfc2-4bed-869d-9f18686e5754 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.677469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e6408d36-dfc2-4bed-869d-9f18686e5754 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:24:44.731781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:44.769254 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e6408d36-dfc2-4bed-869d-9f18686e5754 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c" status: 204 len: 0 microversion: 2.1 time: 0.139530 Aug 18 12:24:44.773136 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3777/6431] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:24:44 2022] DELETE /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:24:44.779239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-548acf69-cad0-426d-bb6b-0d1adae61eb2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:44.779966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-548acf69-cad0-426d-bb6b-0d1adae61eb2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:44.786713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-548acf69-cad0-426d-bb6b-0d1adae61eb2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.787223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-548acf69-cad0-426d-bb6b-0d1adae61eb2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.787674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-548acf69-cad0-426d-bb6b-0d1adae61eb2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.788413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-548acf69-cad0-426d-bb6b-0d1adae61eb2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:44.788895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-548acf69-cad0-426d-bb6b-0d1adae61eb2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:44.789339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-548acf69-cad0-426d-bb6b-0d1adae61eb2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:44.948664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-548acf69-cad0-426d-bb6b-0d1adae61eb2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d664913c24cf48b389992c3937e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd91dab81d7f4244904bfa2ed08b47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:44.958564 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-548acf69-cad0-426d-bb6b-0d1adae61eb2 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c" status: 200 len: 1478 microversion: 2.1 time: 0.183656 Aug 18 12:24:44.959430 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3778/6432] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:44 2022] GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c => generated 1478 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:24:45.992427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c91efb3-2bc5-4f00-a328-0a8a45d04bcf tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:45.993101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4c91efb3-2bc5-4f00-a328-0a8a45d04bcf tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:46.005391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c91efb3-2bc5-4f00-a328-0a8a45d04bcf tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:46.005932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c91efb3-2bc5-4f00-a328-0a8a45d04bcf tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:46.006409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c91efb3-2bc5-4f00-a328-0a8a45d04bcf tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:46.007217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c91efb3-2bc5-4f00-a328-0a8a45d04bcf tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:46.007708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c91efb3-2bc5-4f00-a328-0a8a45d04bcf tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:46.008249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c91efb3-2bc5-4f00-a328-0a8a45d04bcf tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:46.193926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4c91efb3-2bc5-4f00-a328-0a8a45d04bcf tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75d664913c24cf48b389992c3937e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd91dab81d7f4244904bfa2ed08b47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:46.205428 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4c91efb3-2bc5-4f00-a328-0a8a45d04bcf tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c" status: 200 len: 1478 microversion: 2.1 time: 0.227633 Aug 18 12:24:46.206599 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3779/6433] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:45 2022] GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c => generated 1478 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:46.679914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a253d525-a7e2-4bbf-9a0d-e03cbaf78744 req-d6ff6662-7bee-4750-8ff6-5bd787638916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0fe90bf-784d-41c6-a969-f3409758167c", "name": "network-vif-deleted", "tag": "2263150f-b0dd-4ca4-b4f3-4e5314c36dd4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:46.695466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a253d525-a7e2-4bbf-9a0d-e03cbaf78744 req-d6ff6662-7bee-4750-8ff6-5bd787638916 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:46.696010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a253d525-a7e2-4bbf-9a0d-e03cbaf78744 req-d6ff6662-7bee-4750-8ff6-5bd787638916 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:46.696432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a253d525-a7e2-4bbf-9a0d-e03cbaf78744 req-d6ff6662-7bee-4750-8ff6-5bd787638916 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:46.713017 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a253d525-a7e2-4bbf-9a0d-e03cbaf78744 req-d6ff6662-7bee-4750-8ff6-5bd787638916 service nova] Creating event network-vif-deleted:2263150f-b0dd-4ca4-b4f3-4e5314c36dd4 for instance e0fe90bf-784d-41c6-a969-f3409758167c on n-h2-853611-3 Aug 18 12:24:46.720219 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a253d525-a7e2-4bbf-9a0d-e03cbaf78744 req-d6ff6662-7bee-4750-8ff6-5bd787638916 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047961 Aug 18 12:24:46.721213 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3780/6434] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:24:47.230367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d110a07d-a03b-4458-bcfb-200ab57e6763 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:47.231269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d110a07d-a03b-4458-bcfb-200ab57e6763 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] [instance: e0fe90bf-784d-41c6-a969-f3409758167c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:47.240411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d110a07d-a03b-4458-bcfb-200ab57e6763 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:47.240923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d110a07d-a03b-4458-bcfb-200ab57e6763 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:47.241384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d110a07d-a03b-4458-bcfb-200ab57e6763 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:47.242123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d110a07d-a03b-4458-bcfb-200ab57e6763 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:47.242634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d110a07d-a03b-4458-bcfb-200ab57e6763 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:47.243078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d110a07d-a03b-4458-bcfb-200ab57e6763 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:47.259686 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-d110a07d-a03b-4458-bcfb-200ab57e6763 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] HTTP exception thrown: Instance e0fe90bf-784d-41c6-a969-f3409758167c could not be found. Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d110a07d-a03b-4458-bcfb-200ab57e6763 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Request method failure captured: Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c HTTP/1.1 Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_i9-C_ih1jgHhx7hvv2ObBi8KKXdM7nCOi78Ve7ovu_s-VE4e1hPx_bbrJGGgJPhppjS376MB_iWfZcNov9Qm80Efdzm1-7cQn2NypVwF8v1eTnnR8H-nBLwZpQoHJMAxNFBHe3ItP19S01E8vUF4LV4tVsc4S3MLgpBCH7Vl29VvpI Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: fd91dab81d7f4244904bfa2ed08b47e9 Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1270533790 Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fd91dab81d7f4244904bfa2ed08b47e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/fd91dab81d7f4244904bfa2ed08b47e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_fd91dab81d7f4244904bfa2ed08b47e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fd91dab81d7f4244904bfa2ed08b47e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1270533790 Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: fd91dab81d7f4244904bfa2ed08b47e9 Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1270533790 Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersAdminNegativeTestJSON-1270533790-project Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: c75d664913c24cf48b389992c3937e3d Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1270533790-project Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance e0fe90bf-784d-41c6-a969-f3409758167c could not be found. Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'e0fe90bf-784d-41c6-a969-f3409758167c'} Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0fe90bf-784d-41c6-a969-f3409758167c could not be found. Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0fe90bf-784d-41c6-a969-f3409758167c could not be found. Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:47.261438 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:24:47.269946 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:47.269946 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:24:47.269946 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:24:47.269946 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:24:47.269946 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:24:47.269946 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:24:47.269946 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0fe90bf-784d-41c6-a969-f3409758167c could not be found. Aug 18 12:24:47.269946 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:24:47.269946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d110a07d-a03b-4458-bcfb-200ab57e6763 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] Returning 404 to user: Instance e0fe90bf-784d-41c6-a969-f3409758167c could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:24:47.269946 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d110a07d-a03b-4458-bcfb-200ab57e6763 tempest-ServersAdminNegativeTestJSON-1270533790 tempest-ServersAdminNegativeTestJSON-1270533790-project] 10.222.0.73 "GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c" status: 404 len: 111 microversion: 2.1 time: 0.037774 Aug 18 12:24:47.269946 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3781/6435] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:47 2022] GET /compute/v2.1/servers/e0fe90bf-784d-41c6-a969-f3409758167c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:24:55.938814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:55.939664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:24:56.134680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-850170513", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "ef9f3352-2fa6-4db1-b82b-0d9903e95c23"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:24:56.203326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] validate_networks() for [('ef9f3352-2fa6-4db1-b82b-0d9903e95c23', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:24:56.704133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:24:56.704695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:24:56.705300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:24:56.705901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:24:56.707342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:24:56.725206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:56.729349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:56.729349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:56.729349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:56.729837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:56.730986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:56.759066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Getting quotas for project 98c08ed313b746d1ab8f5692a8d56832. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:24:56.765835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Getting quotas for user 9fe59e9bbb4247c38f0991caf269cbfe and project 98c08ed313b746d1ab8f5692a8d56832. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:24:56.781325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:24:56.785024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:24:56.844853 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-26a36cd4-6da2-46c1-8d4a-50014ed1bd2a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912674 Aug 18 12:24:56.845636 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3782/6436] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:24:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:24:56.857950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6959a823-8df1-4044-a1f9-a860ccedbee6 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:56.858800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6959a823-8df1-4044-a1f9-a860ccedbee6 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:56.948460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6959a823-8df1-4044-a1f9-a860ccedbee6 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:56.961618 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6959a823-8df1-4044-a1f9-a860ccedbee6 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1214 microversion: 2.1 time: 0.107983 Aug 18 12:24:56.963097 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3783/6437] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:56 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:57.988500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8411fd12-9e73-4fcb-a685-64f8e1faa0e5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:57.989679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8411fd12-9e73-4fcb-a685-64f8e1faa0e5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:57.999633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8411fd12-9e73-4fcb-a685-64f8e1faa0e5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:58.000510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8411fd12-9e73-4fcb-a685-64f8e1faa0e5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:58.001341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8411fd12-9e73-4fcb-a685-64f8e1faa0e5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:58.003245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8411fd12-9e73-4fcb-a685-64f8e1faa0e5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:58.005166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8411fd12-9e73-4fcb-a685-64f8e1faa0e5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:58.005994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8411fd12-9e73-4fcb-a685-64f8e1faa0e5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:58.108892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8411fd12-9e73-4fcb-a685-64f8e1faa0e5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:58.126473 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8411fd12-9e73-4fcb-a685-64f8e1faa0e5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1266 microversion: 2.1 time: 0.143490 Aug 18 12:24:58.127909 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3784/6438] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:57 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:24:59.165725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-279744fb-12f9-48b5-a599-625b3421a29c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:24:59.166769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-279744fb-12f9-48b5-a599-625b3421a29c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:24:59.182497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-279744fb-12f9-48b5-a599-625b3421a29c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:59.186713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-279744fb-12f9-48b5-a599-625b3421a29c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:59.188671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-279744fb-12f9-48b5-a599-625b3421a29c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:59.190870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-279744fb-12f9-48b5-a599-625b3421a29c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:24:59.192530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-279744fb-12f9-48b5-a599-625b3421a29c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:24:59.193922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-279744fb-12f9-48b5-a599-625b3421a29c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:24:59.490519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-279744fb-12f9-48b5-a599-625b3421a29c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:24:59.505740 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-279744fb-12f9-48b5-a599-625b3421a29c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1314 microversion: 2.1 time: 0.358249 Aug 18 12:24:59.521158 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3785/6439] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:24:59 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:00.129874 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:25:00.130709 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:25:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:25:00.342413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2ff0abc3-f9e6-4402-8939-5cd902600c98 req-4d4a873e-e622-4088-9f54-c474c6075f1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b07fed9-3abb-43f2-a80f-4baabe2d2f47", "tag": "1bd52ab9-fad6-4cd3-8fab-a3e7a1aaa61d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:00.372330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2ff0abc3-f9e6-4402-8939-5cd902600c98 req-4d4a873e-e622-4088-9f54-c474c6075f1c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:00.373487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2ff0abc3-f9e6-4402-8939-5cd902600c98 req-4d4a873e-e622-4088-9f54-c474c6075f1c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:00.374344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2ff0abc3-f9e6-4402-8939-5cd902600c98 req-4d4a873e-e622-4088-9f54-c474c6075f1c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:00.403014 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2ff0abc3-f9e6-4402-8939-5cd902600c98 req-4d4a873e-e622-4088-9f54-c474c6075f1c service nova] Creating event network-changed:1bd52ab9-fad6-4cd3-8fab-a3e7a1aaa61d for instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 on n-h2-853611-3 Aug 18 12:25:00.415984 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2ff0abc3-f9e6-4402-8939-5cd902600c98 req-4d4a873e-e622-4088-9f54-c474c6075f1c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080774 Aug 18 12:25:00.417229 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3786/6440] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:00.536468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1eb0a573-441b-461a-b351-c4ebd95a1c9c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:00.537783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1eb0a573-441b-461a-b351-c4ebd95a1c9c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:00.549286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eb0a573-441b-461a-b351-c4ebd95a1c9c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:00.550757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eb0a573-441b-461a-b351-c4ebd95a1c9c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:00.551399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eb0a573-441b-461a-b351-c4ebd95a1c9c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:00.552348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eb0a573-441b-461a-b351-c4ebd95a1c9c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:00.553019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eb0a573-441b-461a-b351-c4ebd95a1c9c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:00.553679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1eb0a573-441b-461a-b351-c4ebd95a1c9c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:00.775111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1eb0a573-441b-461a-b351-c4ebd95a1c9c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:00.784256 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1eb0a573-441b-461a-b351-c4ebd95a1c9c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1314 microversion: 2.1 time: 0.256115 Aug 18 12:25:00.794533 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3787/6441] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:00 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:01.812186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-278d9d5e-dced-4965-bc2f-d937e9ecbc9b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:01.813456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-278d9d5e-dced-4965-bc2f-d937e9ecbc9b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:01.824447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-278d9d5e-dced-4965-bc2f-d937e9ecbc9b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:01.825093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-278d9d5e-dced-4965-bc2f-d937e9ecbc9b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:01.825681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-278d9d5e-dced-4965-bc2f-d937e9ecbc9b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:01.826640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-278d9d5e-dced-4965-bc2f-d937e9ecbc9b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:01.827279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-278d9d5e-dced-4965-bc2f-d937e9ecbc9b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:01.827792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-278d9d5e-dced-4965-bc2f-d937e9ecbc9b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:02.013494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-278d9d5e-dced-4965-bc2f-d937e9ecbc9b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:02.030704 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-278d9d5e-dced-4965-bc2f-d937e9ecbc9b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1314 microversion: 2.1 time: 0.225529 Aug 18 12:25:02.031877 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3788/6442] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:01 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:03.063914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c14f7ea4-84f9-4712-845b-daf8b91d9d26 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:03.064632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c14f7ea4-84f9-4712-845b-daf8b91d9d26 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:03.072803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c14f7ea4-84f9-4712-845b-daf8b91d9d26 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:03.073311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c14f7ea4-84f9-4712-845b-daf8b91d9d26 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:03.073776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c14f7ea4-84f9-4712-845b-daf8b91d9d26 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:03.074548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c14f7ea4-84f9-4712-845b-daf8b91d9d26 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:03.075028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c14f7ea4-84f9-4712-845b-daf8b91d9d26 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:03.075472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c14f7ea4-84f9-4712-845b-daf8b91d9d26 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:03.235889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c14f7ea4-84f9-4712-845b-daf8b91d9d26 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:03.244521 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c14f7ea4-84f9-4712-845b-daf8b91d9d26 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1314 microversion: 2.1 time: 0.184639 Aug 18 12:25:03.245173 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3789/6443] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:03 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:04.266780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a8ec9764-615f-40a1-9abd-245509f1b8ba tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:04.267785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a8ec9764-615f-40a1-9abd-245509f1b8ba tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:04.275805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8ec9764-615f-40a1-9abd-245509f1b8ba tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:04.276231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8ec9764-615f-40a1-9abd-245509f1b8ba tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:04.276721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8ec9764-615f-40a1-9abd-245509f1b8ba tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:04.277510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8ec9764-615f-40a1-9abd-245509f1b8ba tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:04.278007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8ec9764-615f-40a1-9abd-245509f1b8ba tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:04.278499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8ec9764-615f-40a1-9abd-245509f1b8ba tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:04.452645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a8ec9764-615f-40a1-9abd-245509f1b8ba tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:04.461406 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a8ec9764-615f-40a1-9abd-245509f1b8ba tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1314 microversion: 2.1 time: 0.198749 Aug 18 12:25:04.462022 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3790/6444] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:04 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:05.484053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-71966d25-9f55-49de-b2ca-816393bd5a32 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:05.484702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-71966d25-9f55-49de-b2ca-816393bd5a32 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:05.492729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71966d25-9f55-49de-b2ca-816393bd5a32 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:05.493452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71966d25-9f55-49de-b2ca-816393bd5a32 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:05.493994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71966d25-9f55-49de-b2ca-816393bd5a32 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:05.495098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71966d25-9f55-49de-b2ca-816393bd5a32 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:05.495898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71966d25-9f55-49de-b2ca-816393bd5a32 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:05.496622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71966d25-9f55-49de-b2ca-816393bd5a32 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:05.667067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-71966d25-9f55-49de-b2ca-816393bd5a32 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:05.676238 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-71966d25-9f55-49de-b2ca-816393bd5a32 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1314 microversion: 2.1 time: 0.196144 Aug 18 12:25:05.677011 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3791/6445] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:05 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:05.901554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-898d9b5f-2b6e-433b-b26f-8512d9efe445 req-960e005e-ba06-4694-9590-8e0165e1c44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b07fed9-3abb-43f2-a80f-4baabe2d2f47", "name": "network-vif-plugged", "status": "completed", "tag": "1bd52ab9-fad6-4cd3-8fab-a3e7a1aaa61d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:05.920306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-898d9b5f-2b6e-433b-b26f-8512d9efe445 req-960e005e-ba06-4694-9590-8e0165e1c44c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:05.921213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-898d9b5f-2b6e-433b-b26f-8512d9efe445 req-960e005e-ba06-4694-9590-8e0165e1c44c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:05.921919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-898d9b5f-2b6e-433b-b26f-8512d9efe445 req-960e005e-ba06-4694-9590-8e0165e1c44c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:05.945226 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-898d9b5f-2b6e-433b-b26f-8512d9efe445 req-960e005e-ba06-4694-9590-8e0165e1c44c service nova] Creating event network-vif-plugged:1bd52ab9-fad6-4cd3-8fab-a3e7a1aaa61d for instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 on n-h2-853611-3 Aug 18 12:25:05.953910 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-898d9b5f-2b6e-433b-b26f-8512d9efe445 req-960e005e-ba06-4694-9590-8e0165e1c44c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059445 Aug 18 12:25:05.955092 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3792/6446] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:06.703990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec504f51-bd7a-4a9b-bdd7-23aa5fc10062 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:06.704674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ec504f51-bd7a-4a9b-bdd7-23aa5fc10062 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:06.713417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec504f51-bd7a-4a9b-bdd7-23aa5fc10062 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:06.715400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec504f51-bd7a-4a9b-bdd7-23aa5fc10062 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:06.715400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec504f51-bd7a-4a9b-bdd7-23aa5fc10062 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:06.715657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec504f51-bd7a-4a9b-bdd7-23aa5fc10062 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:06.715928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec504f51-bd7a-4a9b-bdd7-23aa5fc10062 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:06.716369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec504f51-bd7a-4a9b-bdd7-23aa5fc10062 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:06.749491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:06.943084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ec504f51-bd7a-4a9b-bdd7-23aa5fc10062 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:06.947980 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ec504f51-bd7a-4a9b-bdd7-23aa5fc10062 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1314 microversion: 2.1 time: 0.249699 Aug 18 12:25:06.947980 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3793/6447] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:06 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:07.972263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-942af863-5236-40b4-b0cb-968e900481b8 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:07.973277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-942af863-5236-40b4-b0cb-968e900481b8 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:07.974936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:07.981622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-942af863-5236-40b4-b0cb-968e900481b8 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:07.982134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-942af863-5236-40b4-b0cb-968e900481b8 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:07.982629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-942af863-5236-40b4-b0cb-968e900481b8 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:07.983377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-942af863-5236-40b4-b0cb-968e900481b8 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:07.983852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-942af863-5236-40b4-b0cb-968e900481b8 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:07.984303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-942af863-5236-40b4-b0cb-968e900481b8 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:08.204411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-942af863-5236-40b4-b0cb-968e900481b8 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:08.214390 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-942af863-5236-40b4-b0cb-968e900481b8 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1501 microversion: 2.1 time: 0.247298 Aug 18 12:25:08.215033 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3794/6448] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:07 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1501 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:08.236453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:08.239221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:08.246013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:08.246568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:08.247042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:08.247794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:08.248275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:08.248727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:08.282998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:08.292002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Old instance type m1.heat2, new instance type m1.heat {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 12:25:08.301094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:25:08.301533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:25:08.302035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:25:08.302487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:25:08.302921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:25:08.377480 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c43656ce-d1f7-48e1-86d3-c6dd1bf0274b tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "POST /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47/action" status: 202 len: 0 microversion: 2.1 time: 0.145098 Aug 18 12:25:08.378400 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3795/6449] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:25:08 2022] POST /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:25:08.388567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bb9a1f3b-918f-4afe-9e67-645a96ce9c77 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:08.389263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bb9a1f3b-918f-4afe-9e67-645a96ce9c77 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:08.397053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb9a1f3b-918f-4afe-9e67-645a96ce9c77 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:08.397584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb9a1f3b-918f-4afe-9e67-645a96ce9c77 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:08.398046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb9a1f3b-918f-4afe-9e67-645a96ce9c77 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:08.398861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb9a1f3b-918f-4afe-9e67-645a96ce9c77 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:08.399355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb9a1f3b-918f-4afe-9e67-645a96ce9c77 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:08.399809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bb9a1f3b-918f-4afe-9e67-645a96ce9c77 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:08.640432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bb9a1f3b-918f-4afe-9e67-645a96ce9c77 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:08.650772 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bb9a1f3b-918f-4afe-9e67-645a96ce9c77 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1510 microversion: 2.1 time: 0.266199 Aug 18 12:25:08.651388 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3796/6450] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:08 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1510 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:09.694370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-56ac13fa-184d-4ea3-9e6b-c41a4078d749 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:09.695749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-56ac13fa-184d-4ea3-9e6b-c41a4078d749 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:09.710807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56ac13fa-184d-4ea3-9e6b-c41a4078d749 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:09.711915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56ac13fa-184d-4ea3-9e6b-c41a4078d749 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:09.712940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56ac13fa-184d-4ea3-9e6b-c41a4078d749 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:09.715014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56ac13fa-184d-4ea3-9e6b-c41a4078d749 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:09.715945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56ac13fa-184d-4ea3-9e6b-c41a4078d749 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:09.717003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56ac13fa-184d-4ea3-9e6b-c41a4078d749 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:09.728428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:09.945936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-56ac13fa-184d-4ea3-9e6b-c41a4078d749 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:09.956331 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-56ac13fa-184d-4ea3-9e6b-c41a4078d749 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1510 microversion: 2.1 time: 0.270197 Aug 18 12:25:09.957447 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3797/6451] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:09 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:10.981089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-97ded22d-1193-4b06-8051-2e7e31483769 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:10.982209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-97ded22d-1193-4b06-8051-2e7e31483769 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:10.996936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97ded22d-1193-4b06-8051-2e7e31483769 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:10.997850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97ded22d-1193-4b06-8051-2e7e31483769 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:10.998691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97ded22d-1193-4b06-8051-2e7e31483769 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:11.000027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97ded22d-1193-4b06-8051-2e7e31483769 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:11.000864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97ded22d-1193-4b06-8051-2e7e31483769 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:11.001733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97ded22d-1193-4b06-8051-2e7e31483769 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:11.165771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-97ded22d-1193-4b06-8051-2e7e31483769 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:11.175260 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-97ded22d-1193-4b06-8051-2e7e31483769 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.200326 Aug 18 12:25:11.176175 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3798/6452] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:10 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:12.210016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9a8f807e-7daf-461f-ab5f-79d313266476 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:12.210871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9a8f807e-7daf-461f-ab5f-79d313266476 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:12.218370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a8f807e-7daf-461f-ab5f-79d313266476 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:12.218922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a8f807e-7daf-461f-ab5f-79d313266476 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:12.219415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a8f807e-7daf-461f-ab5f-79d313266476 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:12.220281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a8f807e-7daf-461f-ab5f-79d313266476 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:12.220760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a8f807e-7daf-461f-ab5f-79d313266476 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:12.221904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a8f807e-7daf-461f-ab5f-79d313266476 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:12.407114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9a8f807e-7daf-461f-ab5f-79d313266476 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:12.417796 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9a8f807e-7daf-461f-ab5f-79d313266476 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.211885 Aug 18 12:25:12.418503 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3799/6453] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:12 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:13.440780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-944f016a-9679-4da6-a4b9-ea39a4473b22 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:13.441540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-944f016a-9679-4da6-a4b9-ea39a4473b22 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:13.448775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-944f016a-9679-4da6-a4b9-ea39a4473b22 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:13.449343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-944f016a-9679-4da6-a4b9-ea39a4473b22 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:13.449812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-944f016a-9679-4da6-a4b9-ea39a4473b22 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:13.450580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-944f016a-9679-4da6-a4b9-ea39a4473b22 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:13.451058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-944f016a-9679-4da6-a4b9-ea39a4473b22 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:13.451511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-944f016a-9679-4da6-a4b9-ea39a4473b22 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:13.620271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-944f016a-9679-4da6-a4b9-ea39a4473b22 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:13.629131 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-944f016a-9679-4da6-a4b9-ea39a4473b22 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.193281 Aug 18 12:25:13.629754 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3800/6454] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:13 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:14.651032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e53b18c2-6312-404c-8386-562ffd2cf07d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:14.651979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e53b18c2-6312-404c-8386-562ffd2cf07d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:14.654644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:14.660906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e53b18c2-6312-404c-8386-562ffd2cf07d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:14.661419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e53b18c2-6312-404c-8386-562ffd2cf07d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:14.661916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e53b18c2-6312-404c-8386-562ffd2cf07d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:14.662868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e53b18c2-6312-404c-8386-562ffd2cf07d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:14.663446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e53b18c2-6312-404c-8386-562ffd2cf07d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:14.663899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e53b18c2-6312-404c-8386-562ffd2cf07d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:14.829575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e53b18c2-6312-404c-8386-562ffd2cf07d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:14.838411 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e53b18c2-6312-404c-8386-562ffd2cf07d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.191313 Aug 18 12:25:14.839288 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3801/6455] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:14 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:15.861493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a6f62d84-a0a2-4ebb-8ca0-f670d5dd2e8c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:15.862931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a6f62d84-a0a2-4ebb-8ca0-f670d5dd2e8c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:15.873241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6f62d84-a0a2-4ebb-8ca0-f670d5dd2e8c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:15.874003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6f62d84-a0a2-4ebb-8ca0-f670d5dd2e8c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:15.874744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6f62d84-a0a2-4ebb-8ca0-f670d5dd2e8c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:15.876165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6f62d84-a0a2-4ebb-8ca0-f670d5dd2e8c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:15.876803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6f62d84-a0a2-4ebb-8ca0-f670d5dd2e8c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:15.878418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a6f62d84-a0a2-4ebb-8ca0-f670d5dd2e8c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:16.052448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a6f62d84-a0a2-4ebb-8ca0-f670d5dd2e8c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:16.061467 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a6f62d84-a0a2-4ebb-8ca0-f670d5dd2e8c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.204015 Aug 18 12:25:16.062144 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3802/6456] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:15 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:16.715690 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:25:16.715690 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:25:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:25:17.086729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b8366e7-6c11-4139-89d7-05382e584b72 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:17.087471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9b8366e7-6c11-4139-89d7-05382e584b72 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:17.097903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b8366e7-6c11-4139-89d7-05382e584b72 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:17.098595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b8366e7-6c11-4139-89d7-05382e584b72 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:17.098994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b8366e7-6c11-4139-89d7-05382e584b72 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:17.099667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b8366e7-6c11-4139-89d7-05382e584b72 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:17.100151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b8366e7-6c11-4139-89d7-05382e584b72 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:17.100607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b8366e7-6c11-4139-89d7-05382e584b72 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:17.277337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9b8366e7-6c11-4139-89d7-05382e584b72 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:17.286779 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b8366e7-6c11-4139-89d7-05382e584b72 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.204528 Aug 18 12:25:17.287413 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3803/6457] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:17 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:18.310066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bdf2f167-cbe3-4db5-94bd-2ecebac163c0 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:18.310846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bdf2f167-cbe3-4db5-94bd-2ecebac163c0 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:18.319713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdf2f167-cbe3-4db5-94bd-2ecebac163c0 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:18.320275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdf2f167-cbe3-4db5-94bd-2ecebac163c0 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:18.320756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdf2f167-cbe3-4db5-94bd-2ecebac163c0 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:18.321543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdf2f167-cbe3-4db5-94bd-2ecebac163c0 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:18.322068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdf2f167-cbe3-4db5-94bd-2ecebac163c0 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:18.322590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdf2f167-cbe3-4db5-94bd-2ecebac163c0 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:18.483758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bdf2f167-cbe3-4db5-94bd-2ecebac163c0 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:18.494027 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bdf2f167-cbe3-4db5-94bd-2ecebac163c0 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.188166 Aug 18 12:25:18.494830 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3804/6458] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:18 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:19.517864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-28720671-f1ce-4d43-a11d-29d3ee36ddae tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:19.519737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-28720671-f1ce-4d43-a11d-29d3ee36ddae tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:19.532885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28720671-f1ce-4d43-a11d-29d3ee36ddae tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:19.533429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28720671-f1ce-4d43-a11d-29d3ee36ddae tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:19.533890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28720671-f1ce-4d43-a11d-29d3ee36ddae tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:19.534690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28720671-f1ce-4d43-a11d-29d3ee36ddae tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:19.535172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28720671-f1ce-4d43-a11d-29d3ee36ddae tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:19.535617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28720671-f1ce-4d43-a11d-29d3ee36ddae tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:19.729625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-28720671-f1ce-4d43-a11d-29d3ee36ddae tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:19.738301 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-28720671-f1ce-4d43-a11d-29d3ee36ddae tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.224401 Aug 18 12:25:19.739390 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3805/6459] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:19 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:20.774339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c375cfc-4f3f-4339-b740-432cd0e92b6c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:20.775098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c375cfc-4f3f-4339-b740-432cd0e92b6c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:20.783108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c375cfc-4f3f-4339-b740-432cd0e92b6c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:20.784782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c375cfc-4f3f-4339-b740-432cd0e92b6c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:20.785400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c375cfc-4f3f-4339-b740-432cd0e92b6c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:20.786186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c375cfc-4f3f-4339-b740-432cd0e92b6c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:20.786710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c375cfc-4f3f-4339-b740-432cd0e92b6c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:20.787168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c375cfc-4f3f-4339-b740-432cd0e92b6c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:20.990671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9c375cfc-4f3f-4339-b740-432cd0e92b6c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:20.999308 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c375cfc-4f3f-4339-b740-432cd0e92b6c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.228935 Aug 18 12:25:21.000006 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3806/6460] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:20 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:22.021859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-be4ac8a7-e9ea-44d8-ab29-6a51aa697cb5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:22.022745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-be4ac8a7-e9ea-44d8-ab29-6a51aa697cb5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:22.029996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be4ac8a7-e9ea-44d8-ab29-6a51aa697cb5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:22.030555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be4ac8a7-e9ea-44d8-ab29-6a51aa697cb5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:22.031016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be4ac8a7-e9ea-44d8-ab29-6a51aa697cb5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:22.031764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be4ac8a7-e9ea-44d8-ab29-6a51aa697cb5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:22.032279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be4ac8a7-e9ea-44d8-ab29-6a51aa697cb5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:22.032724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be4ac8a7-e9ea-44d8-ab29-6a51aa697cb5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:22.217069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-be4ac8a7-e9ea-44d8-ab29-6a51aa697cb5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:22.226416 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-be4ac8a7-e9ea-44d8-ab29-6a51aa697cb5 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.208758 Aug 18 12:25:22.227228 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3807/6461] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:22 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:23.250004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0cf0160-0741-4940-9dc6-8fe97fc1883e tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:23.250782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a0cf0160-0741-4940-9dc6-8fe97fc1883e tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:23.259141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0cf0160-0741-4940-9dc6-8fe97fc1883e tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:23.259657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0cf0160-0741-4940-9dc6-8fe97fc1883e tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:23.260118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0cf0160-0741-4940-9dc6-8fe97fc1883e tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:23.260865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0cf0160-0741-4940-9dc6-8fe97fc1883e tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:23.261342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0cf0160-0741-4940-9dc6-8fe97fc1883e tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:23.261787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0cf0160-0741-4940-9dc6-8fe97fc1883e tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:23.431295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a0cf0160-0741-4940-9dc6-8fe97fc1883e tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:23.446171 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a0cf0160-0741-4940-9dc6-8fe97fc1883e tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.199855 Aug 18 12:25:23.447307 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3808/6462] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:23 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:24.481903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5dcb3c61-f618-4d1d-8acf-4ef0c43eb6c2 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:24.482736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5dcb3c61-f618-4d1d-8acf-4ef0c43eb6c2 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:24.491690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dcb3c61-f618-4d1d-8acf-4ef0c43eb6c2 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:24.492209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dcb3c61-f618-4d1d-8acf-4ef0c43eb6c2 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:24.492674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dcb3c61-f618-4d1d-8acf-4ef0c43eb6c2 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:24.493425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dcb3c61-f618-4d1d-8acf-4ef0c43eb6c2 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:24.493939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dcb3c61-f618-4d1d-8acf-4ef0c43eb6c2 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:24.494395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dcb3c61-f618-4d1d-8acf-4ef0c43eb6c2 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:24.649696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5dcb3c61-f618-4d1d-8acf-4ef0c43eb6c2 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:24.658333 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5dcb3c61-f618-4d1d-8acf-4ef0c43eb6c2 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.180703 Aug 18 12:25:24.659282 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3809/6463] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:24 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:25.680892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-926e68bf-c853-42ac-848f-84e7d4478253 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:25.681774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-926e68bf-c853-42ac-848f-84e7d4478253 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:25.689407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-926e68bf-c853-42ac-848f-84e7d4478253 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:25.690476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-926e68bf-c853-42ac-848f-84e7d4478253 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:25.690936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-926e68bf-c853-42ac-848f-84e7d4478253 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:25.691695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-926e68bf-c853-42ac-848f-84e7d4478253 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:25.692170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-926e68bf-c853-42ac-848f-84e7d4478253 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:25.692618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-926e68bf-c853-42ac-848f-84e7d4478253 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:25.850360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-926e68bf-c853-42ac-848f-84e7d4478253 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:25.858564 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-926e68bf-c853-42ac-848f-84e7d4478253 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.181683 Aug 18 12:25:25.859333 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3810/6464] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:25 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:26.882172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-81e41f69-8b1d-4fde-8a59-670818c7b576 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:26.883255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-81e41f69-8b1d-4fde-8a59-670818c7b576 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:26.890916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81e41f69-8b1d-4fde-8a59-670818c7b576 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:26.891505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81e41f69-8b1d-4fde-8a59-670818c7b576 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:26.891998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81e41f69-8b1d-4fde-8a59-670818c7b576 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:26.893359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81e41f69-8b1d-4fde-8a59-670818c7b576 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:26.893966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81e41f69-8b1d-4fde-8a59-670818c7b576 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:26.894615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81e41f69-8b1d-4fde-8a59-670818c7b576 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:27.062783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-81e41f69-8b1d-4fde-8a59-670818c7b576 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:27.072281 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-81e41f69-8b1d-4fde-8a59-670818c7b576 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.194400 Aug 18 12:25:27.072891 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3811/6465] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:26 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:28.095370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2461ba1f-dbb3-4004-b2cd-9f853974a272 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:28.096376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2461ba1f-dbb3-4004-b2cd-9f853974a272 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:28.104064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2461ba1f-dbb3-4004-b2cd-9f853974a272 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:28.104589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2461ba1f-dbb3-4004-b2cd-9f853974a272 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:28.105100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2461ba1f-dbb3-4004-b2cd-9f853974a272 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:28.105922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2461ba1f-dbb3-4004-b2cd-9f853974a272 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:28.106407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2461ba1f-dbb3-4004-b2cd-9f853974a272 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:28.106889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2461ba1f-dbb3-4004-b2cd-9f853974a272 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:28.264106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2461ba1f-dbb3-4004-b2cd-9f853974a272 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:28.273720 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2461ba1f-dbb3-4004-b2cd-9f853974a272 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.182409 Aug 18 12:25:28.274595 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3812/6466] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:28 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:29.295852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76864c6d-de19-49de-a048-0738e18d304d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:29.296566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-76864c6d-de19-49de-a048-0738e18d304d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:29.304958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76864c6d-de19-49de-a048-0738e18d304d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:29.305473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76864c6d-de19-49de-a048-0738e18d304d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:29.305933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76864c6d-de19-49de-a048-0738e18d304d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:29.306705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76864c6d-de19-49de-a048-0738e18d304d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:29.307257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76864c6d-de19-49de-a048-0738e18d304d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:29.307752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76864c6d-de19-49de-a048-0738e18d304d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:29.470517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-76864c6d-de19-49de-a048-0738e18d304d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:29.475781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:29.483052 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76864c6d-de19-49de-a048-0738e18d304d tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.191083 Aug 18 12:25:29.483765 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3813/6467] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:29 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:30.508162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9de62096-bf7f-4a2d-94cf-32244137f72c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:30.509479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9de62096-bf7f-4a2d-94cf-32244137f72c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:30.518515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9de62096-bf7f-4a2d-94cf-32244137f72c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:30.519080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9de62096-bf7f-4a2d-94cf-32244137f72c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:30.519553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9de62096-bf7f-4a2d-94cf-32244137f72c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:30.520322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9de62096-bf7f-4a2d-94cf-32244137f72c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:30.520893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9de62096-bf7f-4a2d-94cf-32244137f72c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:30.521367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9de62096-bf7f-4a2d-94cf-32244137f72c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:30.685697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9de62096-bf7f-4a2d-94cf-32244137f72c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:30.695855 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9de62096-bf7f-4a2d-94cf-32244137f72c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.192060 Aug 18 12:25:30.696683 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3814/6468] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:30 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:31.729190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-45ca03bc-948f-4787-9590-581b5ad6a111 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:31.729920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-45ca03bc-948f-4787-9590-581b5ad6a111 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:31.739057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45ca03bc-948f-4787-9590-581b5ad6a111 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:31.739667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45ca03bc-948f-4787-9590-581b5ad6a111 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:31.740178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45ca03bc-948f-4787-9590-581b5ad6a111 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:31.740987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45ca03bc-948f-4787-9590-581b5ad6a111 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:31.741521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45ca03bc-948f-4787-9590-581b5ad6a111 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:31.742146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45ca03bc-948f-4787-9590-581b5ad6a111 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:31.947924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-45ca03bc-948f-4787-9590-581b5ad6a111 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:31.957790 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-45ca03bc-948f-4787-9590-581b5ad6a111 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.232605 Aug 18 12:25:31.958465 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3815/6469] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:31 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:32.995570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-88e360c3-386b-46a2-8f50-3987ac4365c1 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:32.996282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88e360c3-386b-46a2-8f50-3987ac4365c1 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:33.004675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88e360c3-386b-46a2-8f50-3987ac4365c1 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:33.005186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88e360c3-386b-46a2-8f50-3987ac4365c1 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:33.005639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88e360c3-386b-46a2-8f50-3987ac4365c1 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:33.006371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88e360c3-386b-46a2-8f50-3987ac4365c1 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:33.006879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88e360c3-386b-46a2-8f50-3987ac4365c1 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:33.007320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88e360c3-386b-46a2-8f50-3987ac4365c1 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:33.197099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-88e360c3-386b-46a2-8f50-3987ac4365c1 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:33.205943 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-88e360c3-386b-46a2-8f50-3987ac4365c1 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.214148 Aug 18 12:25:33.206590 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3816/6470] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:32 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:34.229348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c572ba1-f370-4905-aa9b-cd8084e429f7 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:34.230069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c572ba1-f370-4905-aa9b-cd8084e429f7 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:34.239172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c572ba1-f370-4905-aa9b-cd8084e429f7 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:34.239744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c572ba1-f370-4905-aa9b-cd8084e429f7 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:34.240245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c572ba1-f370-4905-aa9b-cd8084e429f7 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:34.241042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c572ba1-f370-4905-aa9b-cd8084e429f7 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:34.241611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c572ba1-f370-4905-aa9b-cd8084e429f7 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:34.242105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c572ba1-f370-4905-aa9b-cd8084e429f7 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:34.435732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9c572ba1-f370-4905-aa9b-cd8084e429f7 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:34.444797 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c572ba1-f370-4905-aa9b-cd8084e429f7 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.219680 Aug 18 12:25:34.445409 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3817/6471] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:34 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:35.468029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6be7366-6512-43fc-8977-ecc6558d12b6 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:35.468708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c6be7366-6512-43fc-8977-ecc6558d12b6 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:35.477195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6be7366-6512-43fc-8977-ecc6558d12b6 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:35.477708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6be7366-6512-43fc-8977-ecc6558d12b6 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:35.478172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6be7366-6512-43fc-8977-ecc6558d12b6 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:35.478967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6be7366-6512-43fc-8977-ecc6558d12b6 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:35.479456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6be7366-6512-43fc-8977-ecc6558d12b6 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:35.479913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6be7366-6512-43fc-8977-ecc6558d12b6 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:35.633079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c6be7366-6512-43fc-8977-ecc6558d12b6 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:35.641624 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c6be7366-6512-43fc-8977-ecc6558d12b6 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.177995 Aug 18 12:25:35.642237 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3818/6472] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:35 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:36.665086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-88af6cea-cda8-45a8-92cd-b03a3f664895 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:36.665825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88af6cea-cda8-45a8-92cd-b03a3f664895 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:36.674890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88af6cea-cda8-45a8-92cd-b03a3f664895 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:36.675319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88af6cea-cda8-45a8-92cd-b03a3f664895 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:36.675776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88af6cea-cda8-45a8-92cd-b03a3f664895 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:36.676533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88af6cea-cda8-45a8-92cd-b03a3f664895 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:36.677016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88af6cea-cda8-45a8-92cd-b03a3f664895 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:36.677458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88af6cea-cda8-45a8-92cd-b03a3f664895 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:36.833554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-88af6cea-cda8-45a8-92cd-b03a3f664895 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:36.842933 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-88af6cea-cda8-45a8-92cd-b03a3f664895 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.183737 Aug 18 12:25:36.843707 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3819/6473] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:36 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:37.865836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7b5a8051-bc8c-40b8-8f85-0cf6f2f3f4a3 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:37.866753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7b5a8051-bc8c-40b8-8f85-0cf6f2f3f4a3 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:37.878401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b5a8051-bc8c-40b8-8f85-0cf6f2f3f4a3 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:37.879697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b5a8051-bc8c-40b8-8f85-0cf6f2f3f4a3 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:37.880591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b5a8051-bc8c-40b8-8f85-0cf6f2f3f4a3 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:37.881919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b5a8051-bc8c-40b8-8f85-0cf6f2f3f4a3 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:37.882892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b5a8051-bc8c-40b8-8f85-0cf6f2f3f4a3 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:37.883702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7b5a8051-bc8c-40b8-8f85-0cf6f2f3f4a3 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:38.053138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7b5a8051-bc8c-40b8-8f85-0cf6f2f3f4a3 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:38.061485 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7b5a8051-bc8c-40b8-8f85-0cf6f2f3f4a3 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.199819 Aug 18 12:25:38.062103 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3820/6474] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:37 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:39.085209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3eb64cb-b501-4893-9516-2966ef950f5f tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:39.085866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3eb64cb-b501-4893-9516-2966ef950f5f tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:39.093421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3eb64cb-b501-4893-9516-2966ef950f5f tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:39.093930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3eb64cb-b501-4893-9516-2966ef950f5f tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:39.094386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3eb64cb-b501-4893-9516-2966ef950f5f tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:39.095153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3eb64cb-b501-4893-9516-2966ef950f5f tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:39.096355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3eb64cb-b501-4893-9516-2966ef950f5f tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:39.096899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3eb64cb-b501-4893-9516-2966ef950f5f tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:39.246353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d3eb64cb-b501-4893-9516-2966ef950f5f tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:39.255843 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3eb64cb-b501-4893-9516-2966ef950f5f tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.175835 Aug 18 12:25:39.256446 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3821/6475] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:39 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:40.279059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9de5b821-b54a-4bfa-aaaf-538d87e97260 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:40.280077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9de5b821-b54a-4bfa-aaaf-538d87e97260 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:40.288052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9de5b821-b54a-4bfa-aaaf-538d87e97260 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:40.288557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9de5b821-b54a-4bfa-aaaf-538d87e97260 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:40.289007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9de5b821-b54a-4bfa-aaaf-538d87e97260 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:40.289737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9de5b821-b54a-4bfa-aaaf-538d87e97260 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:40.290215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9de5b821-b54a-4bfa-aaaf-538d87e97260 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:40.290693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9de5b821-b54a-4bfa-aaaf-538d87e97260 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:40.441814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9de5b821-b54a-4bfa-aaaf-538d87e97260 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:40.451737 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9de5b821-b54a-4bfa-aaaf-538d87e97260 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.176726 Aug 18 12:25:40.452473 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3822/6476] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:40 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:41.475504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-537921b0-8541-4451-91e6-7deb1a7c5424 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:41.476214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-537921b0-8541-4451-91e6-7deb1a7c5424 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:41.484114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-537921b0-8541-4451-91e6-7deb1a7c5424 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:41.484676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-537921b0-8541-4451-91e6-7deb1a7c5424 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:41.485151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-537921b0-8541-4451-91e6-7deb1a7c5424 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:41.485961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-537921b0-8541-4451-91e6-7deb1a7c5424 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:41.486713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-537921b0-8541-4451-91e6-7deb1a7c5424 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:41.487643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-537921b0-8541-4451-91e6-7deb1a7c5424 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:41.644986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-537921b0-8541-4451-91e6-7deb1a7c5424 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:41.653650 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-537921b0-8541-4451-91e6-7deb1a7c5424 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.182690 Aug 18 12:25:41.654260 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3823/6477] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:41 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:42.694382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-476ecb52-a8e8-423b-bdc7-a887b9e78f5c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:42.695502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-476ecb52-a8e8-423b-bdc7-a887b9e78f5c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:42.709556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-476ecb52-a8e8-423b-bdc7-a887b9e78f5c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:42.710489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-476ecb52-a8e8-423b-bdc7-a887b9e78f5c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:42.711647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-476ecb52-a8e8-423b-bdc7-a887b9e78f5c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:42.713365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-476ecb52-a8e8-423b-bdc7-a887b9e78f5c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:42.714281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-476ecb52-a8e8-423b-bdc7-a887b9e78f5c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:42.715485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-476ecb52-a8e8-423b-bdc7-a887b9e78f5c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:42.913143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-476ecb52-a8e8-423b-bdc7-a887b9e78f5c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:42.921350 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-476ecb52-a8e8-423b-bdc7-a887b9e78f5c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1515 microversion: 2.1 time: 0.235363 Aug 18 12:25:42.921998 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3824/6478] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:42 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:43.443899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-0949adc8-d4cd-422c-b7cc-eafb15825226 req-9ec9ad9f-60d2-4066-81bf-573555232ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b07fed9-3abb-43f2-a80f-4baabe2d2f47", "name": "network-vif-unplugged", "status": "completed", "tag": "1bd52ab9-fad6-4cd3-8fab-a3e7a1aaa61d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:43.457155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0949adc8-d4cd-422c-b7cc-eafb15825226 req-9ec9ad9f-60d2-4066-81bf-573555232ec0 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:43.458078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0949adc8-d4cd-422c-b7cc-eafb15825226 req-9ec9ad9f-60d2-4066-81bf-573555232ec0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:43.458922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0949adc8-d4cd-422c-b7cc-eafb15825226 req-9ec9ad9f-60d2-4066-81bf-573555232ec0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:43.476336 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-0949adc8-d4cd-422c-b7cc-eafb15825226 req-9ec9ad9f-60d2-4066-81bf-573555232ec0 service nova] Creating event network-vif-unplugged:1bd52ab9-fad6-4cd3-8fab-a3e7a1aaa61d for instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 on n-h1-853611-3 Aug 18 12:25:43.483930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-0949adc8-d4cd-422c-b7cc-eafb15825226 req-9ec9ad9f-60d2-4066-81bf-573555232ec0 service nova] Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:25:43.497554 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-0949adc8-d4cd-422c-b7cc-eafb15825226 req-9ec9ad9f-60d2-4066-81bf-573555232ec0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059335 Aug 18 12:25:43.498487 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3825/6479] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:25:43.956848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c04f7973-b30b-4291-b463-fe8120250655 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:43.958034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c04f7973-b30b-4291-b463-fe8120250655 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:43.969006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c04f7973-b30b-4291-b463-fe8120250655 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:43.969759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c04f7973-b30b-4291-b463-fe8120250655 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:43.970411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c04f7973-b30b-4291-b463-fe8120250655 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:43.971347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c04f7973-b30b-4291-b463-fe8120250655 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:43.971938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c04f7973-b30b-4291-b463-fe8120250655 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:43.972751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c04f7973-b30b-4291-b463-fe8120250655 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:44.390961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c04f7973-b30b-4291-b463-fe8120250655 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:44.399758 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c04f7973-b30b-4291-b463-fe8120250655 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1514 microversion: 2.1 time: 0.449107 Aug 18 12:25:44.400370 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3826/6480] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:43 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1514 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:45.425556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-14a22cf5-540c-4da5-ac5c-f089f3456890 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:45.426374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-14a22cf5-540c-4da5-ac5c-f089f3456890 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:45.429521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=52 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:45.435768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14a22cf5-540c-4da5-ac5c-f089f3456890 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:45.436287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14a22cf5-540c-4da5-ac5c-f089f3456890 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:45.436746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14a22cf5-540c-4da5-ac5c-f089f3456890 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:45.437489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14a22cf5-540c-4da5-ac5c-f089f3456890 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:45.438012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14a22cf5-540c-4da5-ac5c-f089f3456890 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:45.438499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-14a22cf5-540c-4da5-ac5c-f089f3456890 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:45.605557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-14a22cf5-540c-4da5-ac5c-f089f3456890 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:45.614606 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-14a22cf5-540c-4da5-ac5c-f089f3456890 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1512 microversion: 2.1 time: 0.194125 Aug 18 12:25:45.615308 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3827/6481] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:45 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1512 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:45.620813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-50cfff08-64f6-4061-832e-e29722755558 req-5545e9ca-d808-4b35-8ecd-45471968544b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b07fed9-3abb-43f2-a80f-4baabe2d2f47", "tag": "1bd52ab9-fad6-4cd3-8fab-a3e7a1aaa61d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:45.632776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-50cfff08-64f6-4061-832e-e29722755558 req-5545e9ca-d808-4b35-8ecd-45471968544b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:45.633273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-50cfff08-64f6-4061-832e-e29722755558 req-5545e9ca-d808-4b35-8ecd-45471968544b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:45.633716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-50cfff08-64f6-4061-832e-e29722755558 req-5545e9ca-d808-4b35-8ecd-45471968544b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:45.647551 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-50cfff08-64f6-4061-832e-e29722755558 req-5545e9ca-d808-4b35-8ecd-45471968544b service nova] Creating event network-changed:1bd52ab9-fad6-4cd3-8fab-a3e7a1aaa61d for instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 on n-h1-853611-3 Aug 18 12:25:45.653938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-50cfff08-64f6-4061-832e-e29722755558 req-5545e9ca-d808-4b35-8ecd-45471968544b service nova] Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:25:45.666410 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-50cfff08-64f6-4061-832e-e29722755558 req-5545e9ca-d808-4b35-8ecd-45471968544b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049571 Aug 18 12:25:45.667133 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3828/6482] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:46.643648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dcdfa5ac-bf0a-4a6f-9845-74d9d7966261 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:46.645085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dcdfa5ac-bf0a-4a6f-9845-74d9d7966261 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:46.654784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcdfa5ac-bf0a-4a6f-9845-74d9d7966261 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:46.655987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcdfa5ac-bf0a-4a6f-9845-74d9d7966261 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:46.658068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcdfa5ac-bf0a-4a6f-9845-74d9d7966261 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:46.660368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcdfa5ac-bf0a-4a6f-9845-74d9d7966261 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:46.662224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcdfa5ac-bf0a-4a6f-9845-74d9d7966261 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:46.663567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dcdfa5ac-bf0a-4a6f-9845-74d9d7966261 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:47.088868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dcdfa5ac-bf0a-4a6f-9845-74d9d7966261 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:47.098575 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dcdfa5ac-bf0a-4a6f-9845-74d9d7966261 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1509 microversion: 2.1 time: 0.462656 Aug 18 12:25:47.099341 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3829/6483] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:46 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1509 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:25:47.120155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-569bb191-38de-439b-b012-6d2432c6c788 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:47.120733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-569bb191-38de-439b-b012-6d2432c6c788 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:47.127837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-569bb191-38de-439b-b012-6d2432c6c788 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:47.128412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-569bb191-38de-439b-b012-6d2432c6c788 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:47.128945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-569bb191-38de-439b-b012-6d2432c6c788 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:47.129739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-569bb191-38de-439b-b012-6d2432c6c788 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:47.130268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-569bb191-38de-439b-b012-6d2432c6c788 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:47.130812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-569bb191-38de-439b-b012-6d2432c6c788 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:47.161858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-569bb191-38de-439b-b012-6d2432c6c788 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:25:47.179617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:25:47.226971 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.compute.api [None req-569bb191-38de-439b-b012-6d2432c6c788 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Found an unconfirmed migration during delete, id: 16, status: finished Aug 18 12:25:48.855635 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-569bb191-38de-439b-b012-6d2432c6c788 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "DELETE /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 204 len: 0 microversion: 2.1 time: 1.739058 Aug 18 12:25:48.857154 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3830/6484] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:25:47 2022] DELETE /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 0 bytes in 1742 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:25:48.872569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fbd33255-00dc-427c-9adb-04612f2ed03a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:48.873923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fbd33255-00dc-427c-9adb-04612f2ed03a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:48.886174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbd33255-00dc-427c-9adb-04612f2ed03a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:48.887189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbd33255-00dc-427c-9adb-04612f2ed03a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:48.888006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbd33255-00dc-427c-9adb-04612f2ed03a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:48.889153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbd33255-00dc-427c-9adb-04612f2ed03a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:48.890009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbd33255-00dc-427c-9adb-04612f2ed03a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:48.890833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fbd33255-00dc-427c-9adb-04612f2ed03a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:49.098386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fbd33255-00dc-427c-9adb-04612f2ed03a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:49.106884 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fbd33255-00dc-427c-9adb-04612f2ed03a tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1501 microversion: 2.1 time: 0.242411 Aug 18 12:25:49.107485 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3831/6485] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:48 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1501 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:50.129916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7649058c-e931-48b5-987f-24a5e49bfadf tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:50.131024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7649058c-e931-48b5-987f-24a5e49bfadf tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:50.141548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7649058c-e931-48b5-987f-24a5e49bfadf tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:50.143488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7649058c-e931-48b5-987f-24a5e49bfadf tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:50.144227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7649058c-e931-48b5-987f-24a5e49bfadf tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:50.145056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7649058c-e931-48b5-987f-24a5e49bfadf tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:50.145587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7649058c-e931-48b5-987f-24a5e49bfadf tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:50.146075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7649058c-e931-48b5-987f-24a5e49bfadf tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:50.533777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7649058c-e931-48b5-987f-24a5e49bfadf tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe59e9bbb4247c38f0991caf269cbfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c08ed313b746d1ab8f5692a8d56832', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:25:50.546375 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7649058c-e931-48b5-987f-24a5e49bfadf tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 200 len: 1501 microversion: 2.1 time: 0.421473 Aug 18 12:25:50.559697 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3832/6486] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:50 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 1501 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:25:50.570992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ea7ad2d2-bfb1-49d8-97e0-76c38034af61 req-f94e003f-5b72-47a5-8518-efd37d3d0336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b07fed9-3abb-43f2-a80f-4baabe2d2f47", "name": "network-vif-plugged", "status": "completed", "tag": "1bd52ab9-fad6-4cd3-8fab-a3e7a1aaa61d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:50.584234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ea7ad2d2-bfb1-49d8-97e0-76c38034af61 req-f94e003f-5b72-47a5-8518-efd37d3d0336 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:50.585200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ea7ad2d2-bfb1-49d8-97e0-76c38034af61 req-f94e003f-5b72-47a5-8518-efd37d3d0336 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:50.586039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ea7ad2d2-bfb1-49d8-97e0-76c38034af61 req-f94e003f-5b72-47a5-8518-efd37d3d0336 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:50.605156 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ea7ad2d2-bfb1-49d8-97e0-76c38034af61 req-f94e003f-5b72-47a5-8518-efd37d3d0336 service nova] Creating event network-vif-plugged:1bd52ab9-fad6-4cd3-8fab-a3e7a1aaa61d for instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 on n-h1-853611-3 Aug 18 12:25:50.613252 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ea7ad2d2-bfb1-49d8-97e0-76c38034af61 req-f94e003f-5b72-47a5-8518-efd37d3d0336 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048687 Aug 18 12:25:50.614806 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3833/6487] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:25:51.138298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-0e00da70-861b-4aa0-b512-06e4b48b3954 req-1187d7f2-b1bf-4db2-a4bb-613f03a9b182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b07fed9-3abb-43f2-a80f-4baabe2d2f47", "name": "network-vif-deleted", "tag": "1bd52ab9-fad6-4cd3-8fab-a3e7a1aaa61d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:25:51.150505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0e00da70-861b-4aa0-b512-06e4b48b3954 req-1187d7f2-b1bf-4db2-a4bb-613f03a9b182 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:51.151017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0e00da70-861b-4aa0-b512-06e4b48b3954 req-1187d7f2-b1bf-4db2-a4bb-613f03a9b182 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:51.151468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0e00da70-861b-4aa0-b512-06e4b48b3954 req-1187d7f2-b1bf-4db2-a4bb-613f03a9b182 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:51.165574 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-0e00da70-861b-4aa0-b512-06e4b48b3954 req-1187d7f2-b1bf-4db2-a4bb-613f03a9b182 service nova] Creating event network-vif-deleted:1bd52ab9-fad6-4cd3-8fab-a3e7a1aaa61d for instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 on n-h1-853611-3 Aug 18 12:25:51.172280 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-0e00da70-861b-4aa0-b512-06e4b48b3954 req-1187d7f2-b1bf-4db2-a4bb-613f03a9b182 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037972 Aug 18 12:25:51.173322 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3834/6488] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:25:51.572194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a7a5c01-cf41-4c67-a1ba-6c0f9d17d432 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:51.572967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6a7a5c01-cf41-4c67-a1ba-6c0f9d17d432 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:51.582420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a7a5c01-cf41-4c67-a1ba-6c0f9d17d432 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:51.583048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a7a5c01-cf41-4c67-a1ba-6c0f9d17d432 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:51.583595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a7a5c01-cf41-4c67-a1ba-6c0f9d17d432 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:51.584431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a7a5c01-cf41-4c67-a1ba-6c0f9d17d432 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:51.584955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a7a5c01-cf41-4c67-a1ba-6c0f9d17d432 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:51.585487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6a7a5c01-cf41-4c67-a1ba-6c0f9d17d432 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:51.603363 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-6a7a5c01-cf41-4c67-a1ba-6c0f9d17d432 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] HTTP exception thrown: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a7a5c01-cf41-4c67-a1ba-6c0f9d17d432 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Request method failure captured: Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 HTTP/1.1 Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_i-XfxZiKIChG9Y0fEu8n2v-0VSAV3UFSbXS7OkHLCjNlY-G9nepZNri8bAy7GLtRqt7ajecR5p79-4QJJvdYNGMfSEWf0-zryFVdtwElRxFMjjdAlIWGdSnH_p-vV1i14dOGHRX-A73ri3vLSI34ojkJfCkeSfgpeqCJbOCdRh2oiE Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 98c08ed313b746d1ab8f5692a8d56832 Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-DeleteServersTestJSON-1145885942 Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98c08ed313b746d1ab8f5692a8d56832"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/98c08ed313b746d1ab8f5692a8d56832"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_98c08ed313b746d1ab8f5692a8d56832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98c08ed313b746d1ab8f5692a8d56832"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-DeleteServersTestJSON-1145885942 Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 98c08ed313b746d1ab8f5692a8d56832 Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-DeleteServersTestJSON-1145885942 Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-DeleteServersTestJSON-1145885942-project Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 9fe59e9bbb4247c38f0991caf269cbfe Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-DeleteServersTestJSON-1145885942-project Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '9b07fed9-3abb-43f2-a80f-4baabe2d2f47'} Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:51.605136 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.613352 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:51.613352 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:51.613352 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:51.613352 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:25:51.613352 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:25:51.613352 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.613352 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.613352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6a7a5c01-cf41-4c67-a1ba-6c0f9d17d432 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Returning 404 to user: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:25:51.613352 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6a7a5c01-cf41-4c67-a1ba-6c0f9d17d432 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 404 len: 111 microversion: 2.1 time: 0.039957 Aug 18 12:25:51.613352 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3835/6489] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:51 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:25:51.629140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-28318d11-c148-4586-b43f-cdc6492cb988 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:51.629707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-28318d11-c148-4586-b43f-cdc6492cb988 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:51.637284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28318d11-c148-4586-b43f-cdc6492cb988 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:51.637917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28318d11-c148-4586-b43f-cdc6492cb988 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:51.638638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28318d11-c148-4586-b43f-cdc6492cb988 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:51.639711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28318d11-c148-4586-b43f-cdc6492cb988 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:51.640251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28318d11-c148-4586-b43f-cdc6492cb988 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:51.640744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-28318d11-c148-4586-b43f-cdc6492cb988 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:51.657329 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-28318d11-c148-4586-b43f-cdc6492cb988 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] HTTP exception thrown: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-28318d11-c148-4586-b43f-cdc6492cb988 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Request method failure captured: Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 HTTP/1.1 Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_i-XfxZiKIChG9Y0fEu8n2v-0VSAV3UFSbXS7OkHLCjNlY-G9nepZNri8bAy7GLtRqt7ajecR5p79-4QJJvdYNGMfSEWf0-zryFVdtwElRxFMjjdAlIWGdSnH_p-vV1i14dOGHRX-A73ri3vLSI34ojkJfCkeSfgpeqCJbOCdRh2oiE Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 98c08ed313b746d1ab8f5692a8d56832 Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-DeleteServersTestJSON-1145885942 Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98c08ed313b746d1ab8f5692a8d56832"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/98c08ed313b746d1ab8f5692a8d56832"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_98c08ed313b746d1ab8f5692a8d56832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98c08ed313b746d1ab8f5692a8d56832"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-DeleteServersTestJSON-1145885942 Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 98c08ed313b746d1ab8f5692a8d56832 Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-DeleteServersTestJSON-1145885942 Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-DeleteServersTestJSON-1145885942-project Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 9fe59e9bbb4247c38f0991caf269cbfe Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-DeleteServersTestJSON-1145885942-project Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '9b07fed9-3abb-43f2-a80f-4baabe2d2f47'} Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:25:51.659872 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:25:51.666255 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.666255 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.666255 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:51.666255 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.666255 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:51.666255 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:51.666255 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:51.666255 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:25:51.666255 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:25:51.666255 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.666255 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.666255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-28318d11-c148-4586-b43f-cdc6492cb988 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Returning 404 to user: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:25:51.666255 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-28318d11-c148-4586-b43f-cdc6492cb988 tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "DELETE /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 404 len: 111 microversion: 2.1 time: 0.037480 Aug 18 12:25:51.666255 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3836/6490] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:25:51 2022] DELETE /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:25:51.672583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a7b758e-99da-43fb-9f70-d97384a8539c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:25:51.673226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a7b758e-99da-43fb-9f70-d97384a8539c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] [instance: 9b07fed9-3abb-43f2-a80f-4baabe2d2f47] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:25:51.680402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a7b758e-99da-43fb-9f70-d97384a8539c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:51.680912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a7b758e-99da-43fb-9f70-d97384a8539c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:51.681370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a7b758e-99da-43fb-9f70-d97384a8539c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:51.682128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a7b758e-99da-43fb-9f70-d97384a8539c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:25:51.682658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a7b758e-99da-43fb-9f70-d97384a8539c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:25:51.683112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a7b758e-99da-43fb-9f70-d97384a8539c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:25:51.699517 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-1a7b758e-99da-43fb-9f70-d97384a8539c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] HTTP exception thrown: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a7b758e-99da-43fb-9f70-d97384a8539c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Request method failure captured: Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 HTTP/1.1 Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_i-XfxZiKIChG9Y0fEu8n2v-0VSAV3UFSbXS7OkHLCjNlY-G9nepZNri8bAy7GLtRqt7ajecR5p79-4QJJvdYNGMfSEWf0-zryFVdtwElRxFMjjdAlIWGdSnH_p-vV1i14dOGHRX-A73ri3vLSI34ojkJfCkeSfgpeqCJbOCdRh2oiE Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 98c08ed313b746d1ab8f5692a8d56832 Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-DeleteServersTestJSON-1145885942 Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98c08ed313b746d1ab8f5692a8d56832"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/98c08ed313b746d1ab8f5692a8d56832"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_98c08ed313b746d1ab8f5692a8d56832"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/98c08ed313b746d1ab8f5692a8d56832"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-DeleteServersTestJSON-1145885942 Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 98c08ed313b746d1ab8f5692a8d56832 Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-DeleteServersTestJSON-1145885942 Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-DeleteServersTestJSON-1145885942-project Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 9fe59e9bbb4247c38f0991caf269cbfe Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-DeleteServersTestJSON-1145885942-project Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '9b07fed9-3abb-43f2-a80f-4baabe2d2f47'} Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:25:51.701154 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.709279 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:25:51.709279 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:25:51.709279 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:25:51.709279 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:25:51.709279 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:25:51.709279 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. Aug 18 12:25:51.709279 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:25:51.709279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a7b758e-99da-43fb-9f70-d97384a8539c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] Returning 404 to user: Instance 9b07fed9-3abb-43f2-a80f-4baabe2d2f47 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:25:51.709279 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a7b758e-99da-43fb-9f70-d97384a8539c tempest-DeleteServersTestJSON-1145885942 tempest-DeleteServersTestJSON-1145885942-project] 10.222.0.73 "GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47" status: 404 len: 111 microversion: 2.1 time: 0.034209 Aug 18 12:25:51.709279 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3837/6491] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:25:51 2022] GET /compute/v2.1/servers/9b07fed9-3abb-43f2-a80f-4baabe2d2f47 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:26:03.391256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:03.393236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:03.647342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1201809984", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "02e7c4bf-cf66-4347-8ef5-e817eca5363f"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:03.727760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] validate_networks() for [('02e7c4bf-cf66-4347-8ef5-e817eca5363f', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:26:04.250774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:26:04.251744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:26:04.252489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:26:04.253066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:26:04.253684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:26:04.264574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:04.265066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:04.265697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:04.266481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:04.266954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:04.268061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:04.287149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Getting quotas for project f12a6bd5769b48c884369327c40e3d74. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:26:04.293270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Getting quotas for user 8eba94395015468b9bfcdef7918cc44f and project f12a6bd5769b48c884369327c40e3d74. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:26:04.308692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:26:04.311200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:26:04.362924 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cbf7f370-93b3-4ffd-ae0b-77c0edfa8054 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982677 Aug 18 12:26:04.373971 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3838/6492] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:26:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:26:04.380001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-21a80f57-cca4-47af-ad80-111ee11db521 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:04.381346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-21a80f57-cca4-47af-ad80-111ee11db521 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:04.469596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-21a80f57-cca4-47af-ad80-111ee11db521 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:04.480745 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-21a80f57-cca4-47af-ad80-111ee11db521 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1218 microversion: 2.1 time: 0.105252 Aug 18 12:26:04.482476 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3839/6493] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:04 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:05.516321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7194fe6a-1d15-4a80-9662-c6f52a735ae6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:05.517703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7194fe6a-1d15-4a80-9662-c6f52a735ae6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:05.527437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7194fe6a-1d15-4a80-9662-c6f52a735ae6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:05.529099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7194fe6a-1d15-4a80-9662-c6f52a735ae6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:05.531008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7194fe6a-1d15-4a80-9662-c6f52a735ae6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:05.533651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7194fe6a-1d15-4a80-9662-c6f52a735ae6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:05.534973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7194fe6a-1d15-4a80-9662-c6f52a735ae6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:05.536080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7194fe6a-1d15-4a80-9662-c6f52a735ae6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:05.677743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7194fe6a-1d15-4a80-9662-c6f52a735ae6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:05.698949 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7194fe6a-1d15-4a80-9662-c6f52a735ae6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1278 microversion: 2.1 time: 0.189076 Aug 18 12:26:05.700863 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3840/6494] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:05 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:06.726618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3d28250b-4f3c-41c8-91c1-643ce62ea0b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:06.727795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3d28250b-4f3c-41c8-91c1-643ce62ea0b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:06.742907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d28250b-4f3c-41c8-91c1-643ce62ea0b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:06.744463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d28250b-4f3c-41c8-91c1-643ce62ea0b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:06.745704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d28250b-4f3c-41c8-91c1-643ce62ea0b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:06.747363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d28250b-4f3c-41c8-91c1-643ce62ea0b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:06.748875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d28250b-4f3c-41c8-91c1-643ce62ea0b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:06.749634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d28250b-4f3c-41c8-91c1-643ce62ea0b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:07.722574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3d28250b-4f3c-41c8-91c1-643ce62ea0b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:07.731020 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3d28250b-4f3c-41c8-91c1-643ce62ea0b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1318 microversion: 2.1 time: 1.012784 Aug 18 12:26:07.731689 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3841/6495] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:06 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1318 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:26:08.164873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-78949c0f-3202-46c2-9d7c-eeaa77adf818 req-166eec21-6cc1-4735-8999-41aac54cd428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88296fcb-b862-41bb-91da-80c8491bd52f", "tag": "00fe9bc7-bcee-4cde-8c14-51995d2d534d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:08.180940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-78949c0f-3202-46c2-9d7c-eeaa77adf818 req-166eec21-6cc1-4735-8999-41aac54cd428 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:08.182239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-78949c0f-3202-46c2-9d7c-eeaa77adf818 req-166eec21-6cc1-4735-8999-41aac54cd428 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:08.183082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-78949c0f-3202-46c2-9d7c-eeaa77adf818 req-166eec21-6cc1-4735-8999-41aac54cd428 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:08.201783 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-78949c0f-3202-46c2-9d7c-eeaa77adf818 req-166eec21-6cc1-4735-8999-41aac54cd428 service nova] Creating event network-changed:00fe9bc7-bcee-4cde-8c14-51995d2d534d for instance 88296fcb-b862-41bb-91da-80c8491bd52f on n-h1-853611-3 Aug 18 12:26:08.208085 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-78949c0f-3202-46c2-9d7c-eeaa77adf818 req-166eec21-6cc1-4735-8999-41aac54cd428 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051307 Aug 18 12:26:08.208724 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3842/6496] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:26:08.754533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ae19088-7912-4435-8d4f-5fd53835f695 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:08.757127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6ae19088-7912-4435-8d4f-5fd53835f695 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:08.767447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ae19088-7912-4435-8d4f-5fd53835f695 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:08.769240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ae19088-7912-4435-8d4f-5fd53835f695 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:08.770041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ae19088-7912-4435-8d4f-5fd53835f695 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:08.771705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ae19088-7912-4435-8d4f-5fd53835f695 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:08.772536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ae19088-7912-4435-8d4f-5fd53835f695 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:08.773324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ae19088-7912-4435-8d4f-5fd53835f695 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:08.987154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6ae19088-7912-4435-8d4f-5fd53835f695 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:09.006760 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6ae19088-7912-4435-8d4f-5fd53835f695 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1318 microversion: 2.1 time: 0.255851 Aug 18 12:26:09.006760 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3843/6497] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:08 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:10.028353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-811f792c-c0c7-4abf-981e-a528bc6ccdda tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:10.029411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-811f792c-c0c7-4abf-981e-a528bc6ccdda tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:10.038782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-811f792c-c0c7-4abf-981e-a528bc6ccdda tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:10.039289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-811f792c-c0c7-4abf-981e-a528bc6ccdda tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:10.039743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-811f792c-c0c7-4abf-981e-a528bc6ccdda tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:10.040478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-811f792c-c0c7-4abf-981e-a528bc6ccdda tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:10.040946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-811f792c-c0c7-4abf-981e-a528bc6ccdda tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:10.041389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-811f792c-c0c7-4abf-981e-a528bc6ccdda tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:10.294192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-811f792c-c0c7-4abf-981e-a528bc6ccdda tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:10.304426 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-811f792c-c0c7-4abf-981e-a528bc6ccdda tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1318 microversion: 2.1 time: 0.280327 Aug 18 12:26:10.305146 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3844/6498] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:10 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:11.334467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3ee07159-c532-4f6a-aa0d-9f2afe94dade tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:11.335290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3ee07159-c532-4f6a-aa0d-9f2afe94dade tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:11.342966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ee07159-c532-4f6a-aa0d-9f2afe94dade tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:11.343473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ee07159-c532-4f6a-aa0d-9f2afe94dade tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:11.343924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ee07159-c532-4f6a-aa0d-9f2afe94dade tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:11.344660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ee07159-c532-4f6a-aa0d-9f2afe94dade tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:11.345230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ee07159-c532-4f6a-aa0d-9f2afe94dade tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:11.345779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ee07159-c532-4f6a-aa0d-9f2afe94dade tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:11.538233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3ee07159-c532-4f6a-aa0d-9f2afe94dade tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:11.548925 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3ee07159-c532-4f6a-aa0d-9f2afe94dade tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1318 microversion: 2.1 time: 0.218685 Aug 18 12:26:11.549685 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3845/6499] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:11 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:12.571847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c8607ea0-9ddc-4e21-9609-041b38345733 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:12.572846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c8607ea0-9ddc-4e21-9609-041b38345733 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:12.584359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8607ea0-9ddc-4e21-9609-041b38345733 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:12.585191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8607ea0-9ddc-4e21-9609-041b38345733 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:12.585902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8607ea0-9ddc-4e21-9609-041b38345733 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:12.587068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8607ea0-9ddc-4e21-9609-041b38345733 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:12.587768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8607ea0-9ddc-4e21-9609-041b38345733 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:12.588368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c8607ea0-9ddc-4e21-9609-041b38345733 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:12.778642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c8607ea0-9ddc-4e21-9609-041b38345733 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:12.791338 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c8607ea0-9ddc-4e21-9609-041b38345733 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1318 microversion: 2.1 time: 0.223892 Aug 18 12:26:12.792135 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3846/6500] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:12 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:26:13.813579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5e544e55-3ff2-4690-b0b5-0f38cae991d4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:13.815370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5e544e55-3ff2-4690-b0b5-0f38cae991d4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:13.825477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e544e55-3ff2-4690-b0b5-0f38cae991d4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:13.828162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e544e55-3ff2-4690-b0b5-0f38cae991d4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:13.829041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e544e55-3ff2-4690-b0b5-0f38cae991d4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:13.831219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e544e55-3ff2-4690-b0b5-0f38cae991d4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:13.831788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e544e55-3ff2-4690-b0b5-0f38cae991d4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:13.832457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e544e55-3ff2-4690-b0b5-0f38cae991d4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:14.038847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5e544e55-3ff2-4690-b0b5-0f38cae991d4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:14.048627 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5e544e55-3ff2-4690-b0b5-0f38cae991d4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1318 microversion: 2.1 time: 0.238829 Aug 18 12:26:14.049363 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3847/6501] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:13 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:14.657570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-de9a8a5b-dfda-48c5-a756-c4b07de2bb64 req-329e1d6b-c34a-48b0-8962-7cbe7f763651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88296fcb-b862-41bb-91da-80c8491bd52f", "name": "network-vif-plugged", "status": "completed", "tag": "00fe9bc7-bcee-4cde-8c14-51995d2d534d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:14.663466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:14.664225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:14.670762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-de9a8a5b-dfda-48c5-a756-c4b07de2bb64 req-329e1d6b-c34a-48b0-8962-7cbe7f763651 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:14.671276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-de9a8a5b-dfda-48c5-a756-c4b07de2bb64 req-329e1d6b-c34a-48b0-8962-7cbe7f763651 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:14.671729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-de9a8a5b-dfda-48c5-a756-c4b07de2bb64 req-329e1d6b-c34a-48b0-8962-7cbe7f763651 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:14.694966 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-de9a8a5b-dfda-48c5-a756-c4b07de2bb64 req-329e1d6b-c34a-48b0-8962-7cbe7f763651 service nova] Creating event network-vif-plugged:00fe9bc7-bcee-4cde-8c14-51995d2d534d for instance 88296fcb-b862-41bb-91da-80c8491bd52f on n-h1-853611-3 Aug 18 12:26:14.700887 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-de9a8a5b-dfda-48c5-a756-c4b07de2bb64 req-329e1d6b-c34a-48b0-8962-7cbe7f763651 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047084 Aug 18 12:26:14.701678 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3848/6502] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:26:15.094903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3369ecc6-19bd-411f-8d7e-8163e7835cac tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:15.096857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3369ecc6-19bd-411f-8d7e-8163e7835cac tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:15.108018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3369ecc6-19bd-411f-8d7e-8163e7835cac tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:15.108901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3369ecc6-19bd-411f-8d7e-8163e7835cac tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:15.109704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3369ecc6-19bd-411f-8d7e-8163e7835cac tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:15.112018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3369ecc6-19bd-411f-8d7e-8163e7835cac tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:15.112825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3369ecc6-19bd-411f-8d7e-8163e7835cac tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:15.113481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3369ecc6-19bd-411f-8d7e-8163e7835cac tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:15.281330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3369ecc6-19bd-411f-8d7e-8163e7835cac tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:15.291625 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3369ecc6-19bd-411f-8d7e-8163e7835cac tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1318 microversion: 2.1 time: 0.206609 Aug 18 12:26:15.292420 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3849/6503] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:15 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:26:16.316868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3ac6691-0b79-4f07-960b-c063bd37ffe5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:16.317653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3ac6691-0b79-4f07-960b-c063bd37ffe5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:16.326110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3ac6691-0b79-4f07-960b-c063bd37ffe5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:16.326675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3ac6691-0b79-4f07-960b-c063bd37ffe5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:16.327146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3ac6691-0b79-4f07-960b-c063bd37ffe5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:16.328188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3ac6691-0b79-4f07-960b-c063bd37ffe5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:16.328847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3ac6691-0b79-4f07-960b-c063bd37ffe5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:16.329948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3ac6691-0b79-4f07-960b-c063bd37ffe5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:16.487630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d3ac6691-0b79-4f07-960b-c063bd37ffe5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:16.497274 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3ac6691-0b79-4f07-960b-c063bd37ffe5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1507 microversion: 2.1 time: 0.185202 Aug 18 12:26:16.497983 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3850/6504] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:16 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:16.520554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-60dd2ff5-d7f5-43ab-acc3-c426b6d2e34c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:16.521219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-60dd2ff5-d7f5-43ab-acc3-c426b6d2e34c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:16.529595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60dd2ff5-d7f5-43ab-acc3-c426b6d2e34c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:16.530129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60dd2ff5-d7f5-43ab-acc3-c426b6d2e34c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:16.530647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60dd2ff5-d7f5-43ab-acc3-c426b6d2e34c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:16.531443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60dd2ff5-d7f5-43ab-acc3-c426b6d2e34c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:16.531933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60dd2ff5-d7f5-43ab-acc3-c426b6d2e34c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:16.532387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60dd2ff5-d7f5-43ab-acc3-c426b6d2e34c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:16.717235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-60dd2ff5-d7f5-43ab-acc3-c426b6d2e34c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:16.727140 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-60dd2ff5-d7f5-43ab-acc3-c426b6d2e34c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1507 microversion: 2.1 time: 0.211565 Aug 18 12:26:16.727750 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3851/6505] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:16 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:16.759337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-444d2fd5-f683-4cc5-aef2-a5499c8c8dfa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:16.762008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-444d2fd5-f683-4cc5-aef2-a5499c8c8dfa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:16.769538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-444d2fd5-f683-4cc5-aef2-a5499c8c8dfa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:16.770047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-444d2fd5-f683-4cc5-aef2-a5499c8c8dfa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:16.770540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-444d2fd5-f683-4cc5-aef2-a5499c8c8dfa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:16.771280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-444d2fd5-f683-4cc5-aef2-a5499c8c8dfa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:16.771749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-444d2fd5-f683-4cc5-aef2-a5499c8c8dfa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:16.772191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-444d2fd5-f683-4cc5-aef2-a5499c8c8dfa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:16.849012 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-444d2fd5-f683-4cc5-aef2-a5499c8c8dfa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "PUT /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1079 microversion: 2.1 time: 0.093476 Aug 18 12:26:16.849698 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3852/6506] 10.222.0.73 () {60 vars in 1256 bytes} [Thu Aug 18 12:26:16 2022] PUT /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1079 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:16.880823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-688659f8-8216-4502-8329-60dcbded3018 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:16.882756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-688659f8-8216-4502-8329-60dcbded3018 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:16.890876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-688659f8-8216-4502-8329-60dcbded3018 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:16.891530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-688659f8-8216-4502-8329-60dcbded3018 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:16.892615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-688659f8-8216-4502-8329-60dcbded3018 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:16.893597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-688659f8-8216-4502-8329-60dcbded3018 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:16.894173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-688659f8-8216-4502-8329-60dcbded3018 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:16.895024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-688659f8-8216-4502-8329-60dcbded3018 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:17.084026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-688659f8-8216-4502-8329-60dcbded3018 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:17.093817 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-688659f8-8216-4502-8329-60dcbded3018 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1505 microversion: 2.1 time: 0.217751 Aug 18 12:26:17.094457 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3853/6507] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:16 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:17.115825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-65dd727c-b1af-4f60-9ea9-7e1059f30f25 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:17.116491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-65dd727c-b1af-4f60-9ea9-7e1059f30f25 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:17.123079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65dd727c-b1af-4f60-9ea9-7e1059f30f25 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:17.123616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65dd727c-b1af-4f60-9ea9-7e1059f30f25 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:17.124117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65dd727c-b1af-4f60-9ea9-7e1059f30f25 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:17.124857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65dd727c-b1af-4f60-9ea9-7e1059f30f25 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:17.125386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65dd727c-b1af-4f60-9ea9-7e1059f30f25 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:17.125838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-65dd727c-b1af-4f60-9ea9-7e1059f30f25 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:17.294150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-65dd727c-b1af-4f60-9ea9-7e1059f30f25 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:17.303557 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-65dd727c-b1af-4f60-9ea9-7e1059f30f25 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1505 microversion: 2.1 time: 0.191771 Aug 18 12:26:17.304175 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3854/6508] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:17 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1505 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:17.325313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:17.327709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:17.336653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:17.337177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:17.337640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:17.338402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:17.338916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:17.339366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:17.372073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:17.385548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Old instance type m1.heat2, new instance type m1.heat {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 12:26:17.399351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:26:17.400142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:26:17.401062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:26:17.401878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:26:17.402685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:26:17.479603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:17.522534 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df3c04ad-246e-468f-90d3-9be8e0ac8092 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "POST /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f/action" status: 202 len: 0 microversion: 2.1 time: 0.200794 Aug 18 12:26:17.523813 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3855/6509] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:26:17 2022] POST /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:26:17.534336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5a678b57-f319-45fc-b5be-eba0f1ecc8cf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:17.535214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5a678b57-f319-45fc-b5be-eba0f1ecc8cf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:17.543548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a678b57-f319-45fc-b5be-eba0f1ecc8cf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:17.544358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a678b57-f319-45fc-b5be-eba0f1ecc8cf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:17.545105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a678b57-f319-45fc-b5be-eba0f1ecc8cf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:17.546212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a678b57-f319-45fc-b5be-eba0f1ecc8cf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:17.546922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a678b57-f319-45fc-b5be-eba0f1ecc8cf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:17.547474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a678b57-f319-45fc-b5be-eba0f1ecc8cf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:17.762069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5a678b57-f319-45fc-b5be-eba0f1ecc8cf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:17.773140 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5a678b57-f319-45fc-b5be-eba0f1ecc8cf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1516 microversion: 2.1 time: 0.244022 Aug 18 12:26:17.773913 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3856/6510] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:17 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:18.798388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d189f9c7-a59a-4789-b771-95c6732d675f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:18.800630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d189f9c7-a59a-4789-b771-95c6732d675f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:18.808870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d189f9c7-a59a-4789-b771-95c6732d675f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:18.810103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d189f9c7-a59a-4789-b771-95c6732d675f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:18.810828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d189f9c7-a59a-4789-b771-95c6732d675f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:18.811773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d189f9c7-a59a-4789-b771-95c6732d675f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:18.812261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d189f9c7-a59a-4789-b771-95c6732d675f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:18.812710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d189f9c7-a59a-4789-b771-95c6732d675f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:19.046557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d189f9c7-a59a-4789-b771-95c6732d675f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:19.058830 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d189f9c7-a59a-4789-b771-95c6732d675f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1516 microversion: 2.1 time: 0.265794 Aug 18 12:26:19.066777 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3857/6511] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:18 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1516 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:20.102805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ff0f43a6-d7ba-4104-a856-dde99136f711 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:20.103912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ff0f43a6-d7ba-4104-a856-dde99136f711 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:20.114401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff0f43a6-d7ba-4104-a856-dde99136f711 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:20.115216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff0f43a6-d7ba-4104-a856-dde99136f711 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:20.115793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff0f43a6-d7ba-4104-a856-dde99136f711 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:20.116689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff0f43a6-d7ba-4104-a856-dde99136f711 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:20.117384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff0f43a6-d7ba-4104-a856-dde99136f711 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:20.118016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff0f43a6-d7ba-4104-a856-dde99136f711 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:20.307323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ff0f43a6-d7ba-4104-a856-dde99136f711 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:20.316509 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ff0f43a6-d7ba-4104-a856-dde99136f711 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.218774 Aug 18 12:26:20.317110 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3858/6512] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:20 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:26:21.343203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aec1572f-1789-4f77-8466-8b8bdbd62f5f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:21.344431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aec1572f-1789-4f77-8466-8b8bdbd62f5f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:21.359474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aec1572f-1789-4f77-8466-8b8bdbd62f5f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:21.360404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aec1572f-1789-4f77-8466-8b8bdbd62f5f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:21.362083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aec1572f-1789-4f77-8466-8b8bdbd62f5f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:21.363773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aec1572f-1789-4f77-8466-8b8bdbd62f5f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:21.364655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aec1572f-1789-4f77-8466-8b8bdbd62f5f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:21.365445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aec1572f-1789-4f77-8466-8b8bdbd62f5f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:21.540664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aec1572f-1789-4f77-8466-8b8bdbd62f5f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:21.549672 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aec1572f-1789-4f77-8466-8b8bdbd62f5f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.214546 Aug 18 12:26:21.550286 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3859/6513] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:21 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:26:22.572428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d5fc6338-1201-4a0e-a368-2e15b5e34bbc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:22.573202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d5fc6338-1201-4a0e-a368-2e15b5e34bbc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:22.581796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5fc6338-1201-4a0e-a368-2e15b5e34bbc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:22.582311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5fc6338-1201-4a0e-a368-2e15b5e34bbc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:22.582806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5fc6338-1201-4a0e-a368-2e15b5e34bbc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:22.583567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5fc6338-1201-4a0e-a368-2e15b5e34bbc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:22.584051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5fc6338-1201-4a0e-a368-2e15b5e34bbc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:22.584504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5fc6338-1201-4a0e-a368-2e15b5e34bbc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:22.753366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d5fc6338-1201-4a0e-a368-2e15b5e34bbc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:22.762177 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d5fc6338-1201-4a0e-a368-2e15b5e34bbc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.193912 Aug 18 12:26:22.762905 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3860/6514] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:22 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:23.786820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-222b5ccf-3bd2-444d-a98d-035fb8a408c7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:23.787893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-222b5ccf-3bd2-444d-a98d-035fb8a408c7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:23.797428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-222b5ccf-3bd2-444d-a98d-035fb8a408c7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:23.797987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-222b5ccf-3bd2-444d-a98d-035fb8a408c7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:23.798625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-222b5ccf-3bd2-444d-a98d-035fb8a408c7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:23.799329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-222b5ccf-3bd2-444d-a98d-035fb8a408c7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:23.799846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-222b5ccf-3bd2-444d-a98d-035fb8a408c7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:23.800347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-222b5ccf-3bd2-444d-a98d-035fb8a408c7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:24.011048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-222b5ccf-3bd2-444d-a98d-035fb8a408c7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:24.020877 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-222b5ccf-3bd2-444d-a98d-035fb8a408c7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.239192 Aug 18 12:26:24.021493 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3861/6515] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:23 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:25.043457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fb72ea80-a07e-4d1f-a305-103e4456c9ae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:25.044183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fb72ea80-a07e-4d1f-a305-103e4456c9ae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:25.051904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb72ea80-a07e-4d1f-a305-103e4456c9ae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:25.052505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb72ea80-a07e-4d1f-a305-103e4456c9ae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:25.053002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb72ea80-a07e-4d1f-a305-103e4456c9ae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:25.053789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb72ea80-a07e-4d1f-a305-103e4456c9ae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:25.054371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb72ea80-a07e-4d1f-a305-103e4456c9ae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:25.054939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb72ea80-a07e-4d1f-a305-103e4456c9ae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:25.224181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fb72ea80-a07e-4d1f-a305-103e4456c9ae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:25.232603 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fb72ea80-a07e-4d1f-a305-103e4456c9ae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.193170 Aug 18 12:26:25.233210 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3862/6516] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:25 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:26.255837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c1614a89-81c8-400d-90c9-83e1414f4078 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:26.256811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c1614a89-81c8-400d-90c9-83e1414f4078 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:26.265336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1614a89-81c8-400d-90c9-83e1414f4078 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:26.265908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1614a89-81c8-400d-90c9-83e1414f4078 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:26.266464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1614a89-81c8-400d-90c9-83e1414f4078 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:26.268100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1614a89-81c8-400d-90c9-83e1414f4078 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:26.268817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1614a89-81c8-400d-90c9-83e1414f4078 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:26.269360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1614a89-81c8-400d-90c9-83e1414f4078 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:26.428177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c1614a89-81c8-400d-90c9-83e1414f4078 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:26.444462 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c1614a89-81c8-400d-90c9-83e1414f4078 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.192956 Aug 18 12:26:26.445523 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3863/6517] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:26 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:27.468715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec12a50b-ddca-4f01-9276-c07a99191fee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:27.469493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ec12a50b-ddca-4f01-9276-c07a99191fee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:27.477769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec12a50b-ddca-4f01-9276-c07a99191fee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:27.478265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec12a50b-ddca-4f01-9276-c07a99191fee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:27.478746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec12a50b-ddca-4f01-9276-c07a99191fee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:27.479483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec12a50b-ddca-4f01-9276-c07a99191fee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:27.479964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec12a50b-ddca-4f01-9276-c07a99191fee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:27.480413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec12a50b-ddca-4f01-9276-c07a99191fee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:27.649139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ec12a50b-ddca-4f01-9276-c07a99191fee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:27.657493 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ec12a50b-ddca-4f01-9276-c07a99191fee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.193995 Aug 18 12:26:27.658097 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3864/6518] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:27 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:28.680670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5eabb99c-fc6a-429e-adcd-a91e9e41b951 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:28.681744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5eabb99c-fc6a-429e-adcd-a91e9e41b951 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:28.693223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5eabb99c-fc6a-429e-adcd-a91e9e41b951 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:28.693881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5eabb99c-fc6a-429e-adcd-a91e9e41b951 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:28.694723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5eabb99c-fc6a-429e-adcd-a91e9e41b951 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:28.696080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5eabb99c-fc6a-429e-adcd-a91e9e41b951 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:28.696962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5eabb99c-fc6a-429e-adcd-a91e9e41b951 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:28.697525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5eabb99c-fc6a-429e-adcd-a91e9e41b951 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:28.890658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5eabb99c-fc6a-429e-adcd-a91e9e41b951 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:28.899393 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5eabb99c-fc6a-429e-adcd-a91e9e41b951 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.223385 Aug 18 12:26:28.899983 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3865/6519] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:28 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:26:29.921333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e3c3c339-6a34-4d2f-a47d-5a9ca7aede81 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:29.921333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e3c3c339-6a34-4d2f-a47d-5a9ca7aede81 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:29.931057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3c3c339-6a34-4d2f-a47d-5a9ca7aede81 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:29.931569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3c3c339-6a34-4d2f-a47d-5a9ca7aede81 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:29.932060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3c3c339-6a34-4d2f-a47d-5a9ca7aede81 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:29.933184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3c3c339-6a34-4d2f-a47d-5a9ca7aede81 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:29.933677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3c3c339-6a34-4d2f-a47d-5a9ca7aede81 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:29.934178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3c3c339-6a34-4d2f-a47d-5a9ca7aede81 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:30.119825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e3c3c339-6a34-4d2f-a47d-5a9ca7aede81 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:30.136758 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e3c3c339-6a34-4d2f-a47d-5a9ca7aede81 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.218989 Aug 18 12:26:30.137903 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3866/6520] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:29 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:31.166071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-83005f86-62ae-4626-a4e4-e97e01d51dcf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:31.167300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-83005f86-62ae-4626-a4e4-e97e01d51dcf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:31.189882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83005f86-62ae-4626-a4e4-e97e01d51dcf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:31.190812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83005f86-62ae-4626-a4e4-e97e01d51dcf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:31.191646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83005f86-62ae-4626-a4e4-e97e01d51dcf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:31.193000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83005f86-62ae-4626-a4e4-e97e01d51dcf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:31.193852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83005f86-62ae-4626-a4e4-e97e01d51dcf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:31.194710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83005f86-62ae-4626-a4e4-e97e01d51dcf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:31.381420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-83005f86-62ae-4626-a4e4-e97e01d51dcf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:31.396006 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-83005f86-62ae-4626-a4e4-e97e01d51dcf tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.237835 Aug 18 12:26:31.397694 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3867/6521] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:31 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:26:32.420799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-808ec759-a80a-4745-8722-a33e2eee624c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:32.421786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-808ec759-a80a-4745-8722-a33e2eee624c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:32.430205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808ec759-a80a-4745-8722-a33e2eee624c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:32.430724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808ec759-a80a-4745-8722-a33e2eee624c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:32.431193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808ec759-a80a-4745-8722-a33e2eee624c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:32.431974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808ec759-a80a-4745-8722-a33e2eee624c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:32.432471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808ec759-a80a-4745-8722-a33e2eee624c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:32.432927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-808ec759-a80a-4745-8722-a33e2eee624c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:32.609014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-808ec759-a80a-4745-8722-a33e2eee624c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:32.618919 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-808ec759-a80a-4745-8722-a33e2eee624c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.202292 Aug 18 12:26:32.619539 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3868/6522] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:32 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:33.654502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d26f145-b04e-4b7c-be3b-9c22e7e67e4d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:33.655294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2d26f145-b04e-4b7c-be3b-9c22e7e67e4d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:33.659489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:33.665407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d26f145-b04e-4b7c-be3b-9c22e7e67e4d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:33.665922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d26f145-b04e-4b7c-be3b-9c22e7e67e4d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:33.666382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d26f145-b04e-4b7c-be3b-9c22e7e67e4d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:33.667151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d26f145-b04e-4b7c-be3b-9c22e7e67e4d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:33.667628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d26f145-b04e-4b7c-be3b-9c22e7e67e4d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:33.668071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d26f145-b04e-4b7c-be3b-9c22e7e67e4d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:33.827447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2d26f145-b04e-4b7c-be3b-9c22e7e67e4d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:33.837456 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d26f145-b04e-4b7c-be3b-9c22e7e67e4d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.186926 Aug 18 12:26:33.838231 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3869/6523] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:33 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:34.862578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-12003095-3536-47ca-95fa-0fa80643e09c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:34.863387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-12003095-3536-47ca-95fa-0fa80643e09c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:34.871539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12003095-3536-47ca-95fa-0fa80643e09c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:34.872108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12003095-3536-47ca-95fa-0fa80643e09c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:34.872618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12003095-3536-47ca-95fa-0fa80643e09c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:34.873437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12003095-3536-47ca-95fa-0fa80643e09c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:34.874053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12003095-3536-47ca-95fa-0fa80643e09c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:34.874702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12003095-3536-47ca-95fa-0fa80643e09c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:35.038243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-12003095-3536-47ca-95fa-0fa80643e09c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:35.046894 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-12003095-3536-47ca-95fa-0fa80643e09c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.189865 Aug 18 12:26:35.047687 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3870/6524] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:34 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:36.070484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4e23042b-c8bd-4419-9ddd-9cf608d85b82 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:36.071234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4e23042b-c8bd-4419-9ddd-9cf608d85b82 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:36.078748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e23042b-c8bd-4419-9ddd-9cf608d85b82 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:36.079501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e23042b-c8bd-4419-9ddd-9cf608d85b82 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:36.079832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e23042b-c8bd-4419-9ddd-9cf608d85b82 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:36.080587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e23042b-c8bd-4419-9ddd-9cf608d85b82 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:36.081078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e23042b-c8bd-4419-9ddd-9cf608d85b82 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:36.081522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e23042b-c8bd-4419-9ddd-9cf608d85b82 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:36.249217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4e23042b-c8bd-4419-9ddd-9cf608d85b82 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:36.257740 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4e23042b-c8bd-4419-9ddd-9cf608d85b82 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.191262 Aug 18 12:26:36.258573 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3871/6525] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:36 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:36.723929 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:26:36.724247 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 12:26:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:26:37.280289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3fbffb6-d9cf-4098-89f8-2174e29f6a8f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:37.280963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3fbffb6-d9cf-4098-89f8-2174e29f6a8f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:37.288949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3fbffb6-d9cf-4098-89f8-2174e29f6a8f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:37.289624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3fbffb6-d9cf-4098-89f8-2174e29f6a8f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:37.290131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3fbffb6-d9cf-4098-89f8-2174e29f6a8f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:37.290992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3fbffb6-d9cf-4098-89f8-2174e29f6a8f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:37.291584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3fbffb6-d9cf-4098-89f8-2174e29f6a8f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:37.292080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3fbffb6-d9cf-4098-89f8-2174e29f6a8f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:37.297013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:37.464051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d3fbffb6-d9cf-4098-89f8-2174e29f6a8f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:37.479120 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3fbffb6-d9cf-4098-89f8-2174e29f6a8f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.203130 Aug 18 12:26:37.479960 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3872/6526] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:37 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:38.506530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-554d2715-cb6e-44b3-ad49-5ff8f768160a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:38.507297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-554d2715-cb6e-44b3-ad49-5ff8f768160a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:38.514765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-554d2715-cb6e-44b3-ad49-5ff8f768160a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:38.515272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-554d2715-cb6e-44b3-ad49-5ff8f768160a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:38.515723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-554d2715-cb6e-44b3-ad49-5ff8f768160a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:38.516457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-554d2715-cb6e-44b3-ad49-5ff8f768160a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:38.517289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-554d2715-cb6e-44b3-ad49-5ff8f768160a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:38.517745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-554d2715-cb6e-44b3-ad49-5ff8f768160a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:38.684637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-554d2715-cb6e-44b3-ad49-5ff8f768160a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:38.697502 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-554d2715-cb6e-44b3-ad49-5ff8f768160a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.195147 Aug 18 12:26:38.698271 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3873/6527] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:38 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:38.790240 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:26:38.790965 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:26:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:26:39.722771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08db49a2-8e11-456d-92c4-f59178c1529b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:39.723506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-08db49a2-8e11-456d-92c4-f59178c1529b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:39.731072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08db49a2-8e11-456d-92c4-f59178c1529b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:39.731632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08db49a2-8e11-456d-92c4-f59178c1529b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:39.732130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08db49a2-8e11-456d-92c4-f59178c1529b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:39.732975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08db49a2-8e11-456d-92c4-f59178c1529b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:39.733498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08db49a2-8e11-456d-92c4-f59178c1529b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:39.733987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08db49a2-8e11-456d-92c4-f59178c1529b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:39.906634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-08db49a2-8e11-456d-92c4-f59178c1529b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:39.917338 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-08db49a2-8e11-456d-92c4-f59178c1529b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.199166 Aug 18 12:26:39.918272 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3874/6528] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:39 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:40.941174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-70a42fdb-d7ce-4f1b-8a07-4c75c7ac9bae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:40.942209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-70a42fdb-d7ce-4f1b-8a07-4c75c7ac9bae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:40.950892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70a42fdb-d7ce-4f1b-8a07-4c75c7ac9bae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:40.951563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70a42fdb-d7ce-4f1b-8a07-4c75c7ac9bae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:40.952118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70a42fdb-d7ce-4f1b-8a07-4c75c7ac9bae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:40.953139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70a42fdb-d7ce-4f1b-8a07-4c75c7ac9bae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:40.953751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70a42fdb-d7ce-4f1b-8a07-4c75c7ac9bae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:40.954523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70a42fdb-d7ce-4f1b-8a07-4c75c7ac9bae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:41.126861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-70a42fdb-d7ce-4f1b-8a07-4c75c7ac9bae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:41.136267 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-70a42fdb-d7ce-4f1b-8a07-4c75c7ac9bae tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.200227 Aug 18 12:26:41.137483 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3875/6529] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:40 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:42.162620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d0a16ccf-3c56-4c2b-abc8-a9f220fb08a3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:42.163384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d0a16ccf-3c56-4c2b-abc8-a9f220fb08a3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:42.170971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0a16ccf-3c56-4c2b-abc8-a9f220fb08a3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:42.171483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0a16ccf-3c56-4c2b-abc8-a9f220fb08a3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:42.171936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0a16ccf-3c56-4c2b-abc8-a9f220fb08a3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:42.172695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0a16ccf-3c56-4c2b-abc8-a9f220fb08a3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:42.173391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0a16ccf-3c56-4c2b-abc8-a9f220fb08a3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:42.173843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d0a16ccf-3c56-4c2b-abc8-a9f220fb08a3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:42.386672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d0a16ccf-3c56-4c2b-abc8-a9f220fb08a3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:42.396354 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d0a16ccf-3c56-4c2b-abc8-a9f220fb08a3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.237775 Aug 18 12:26:42.397066 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3876/6530] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:42 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:43.420089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-734b07a5-0fc3-4be9-84e4-2795d803b268 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:43.420787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-734b07a5-0fc3-4be9-84e4-2795d803b268 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:43.431673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-734b07a5-0fc3-4be9-84e4-2795d803b268 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:43.432231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-734b07a5-0fc3-4be9-84e4-2795d803b268 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:43.432775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-734b07a5-0fc3-4be9-84e4-2795d803b268 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:43.433553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-734b07a5-0fc3-4be9-84e4-2795d803b268 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:43.434034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-734b07a5-0fc3-4be9-84e4-2795d803b268 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:43.434517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-734b07a5-0fc3-4be9-84e4-2795d803b268 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:43.640498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-734b07a5-0fc3-4be9-84e4-2795d803b268 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:43.654098 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-734b07a5-0fc3-4be9-84e4-2795d803b268 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.238096 Aug 18 12:26:43.655175 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3877/6531] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:43 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:44.691017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b8041b34-86b6-4d6f-aa12-f6b025443cee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:44.691723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b8041b34-86b6-4d6f-aa12-f6b025443cee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:44.701999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8041b34-86b6-4d6f-aa12-f6b025443cee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:44.702608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8041b34-86b6-4d6f-aa12-f6b025443cee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:44.703182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8041b34-86b6-4d6f-aa12-f6b025443cee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:44.705486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8041b34-86b6-4d6f-aa12-f6b025443cee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:44.705927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8041b34-86b6-4d6f-aa12-f6b025443cee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:44.706558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8041b34-86b6-4d6f-aa12-f6b025443cee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:44.885912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8041b34-86b6-4d6f-aa12-f6b025443cee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:44.896493 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b8041b34-86b6-4d6f-aa12-f6b025443cee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.210926 Aug 18 12:26:44.897394 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3878/6532] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:44 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:45.921283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-568d76ae-c00f-4330-a7c3-555c2f0016a0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:45.921980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-568d76ae-c00f-4330-a7c3-555c2f0016a0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:45.929652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-568d76ae-c00f-4330-a7c3-555c2f0016a0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:45.930163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-568d76ae-c00f-4330-a7c3-555c2f0016a0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:45.930656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-568d76ae-c00f-4330-a7c3-555c2f0016a0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:45.931396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-568d76ae-c00f-4330-a7c3-555c2f0016a0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:45.931868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-568d76ae-c00f-4330-a7c3-555c2f0016a0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:45.932312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-568d76ae-c00f-4330-a7c3-555c2f0016a0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:46.094275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-568d76ae-c00f-4330-a7c3-555c2f0016a0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:46.104244 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-568d76ae-c00f-4330-a7c3-555c2f0016a0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1521 microversion: 2.1 time: 0.188103 Aug 18 12:26:46.104858 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3879/6533] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:45 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:26:47.128668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0c6dc269-fe14-4867-a0da-a9c74ed5bdc7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:47.129827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0c6dc269-fe14-4867-a0da-a9c74ed5bdc7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:47.139045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c6dc269-fe14-4867-a0da-a9c74ed5bdc7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:47.139703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c6dc269-fe14-4867-a0da-a9c74ed5bdc7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:47.140275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c6dc269-fe14-4867-a0da-a9c74ed5bdc7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:47.141274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c6dc269-fe14-4867-a0da-a9c74ed5bdc7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:47.142830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c6dc269-fe14-4867-a0da-a9c74ed5bdc7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:47.143453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c6dc269-fe14-4867-a0da-a9c74ed5bdc7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:47.337147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0c6dc269-fe14-4867-a0da-a9c74ed5bdc7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:47.347571 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0c6dc269-fe14-4867-a0da-a9c74ed5bdc7 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1520 microversion: 2.1 time: 0.223865 Aug 18 12:26:47.348367 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3880/6534] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:47 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:47.702289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-bf3c9a2a-124e-43b9-8177-5097e1c7fbba req-ac436c8d-740f-4615-a551-e92db2749735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88296fcb-b862-41bb-91da-80c8491bd52f", "name": "network-vif-unplugged", "status": "completed", "tag": "00fe9bc7-bcee-4cde-8c14-51995d2d534d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:47.721362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bf3c9a2a-124e-43b9-8177-5097e1c7fbba req-ac436c8d-740f-4615-a551-e92db2749735 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:47.722281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bf3c9a2a-124e-43b9-8177-5097e1c7fbba req-ac436c8d-740f-4615-a551-e92db2749735 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:47.723098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bf3c9a2a-124e-43b9-8177-5097e1c7fbba req-ac436c8d-740f-4615-a551-e92db2749735 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:47.747128 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-bf3c9a2a-124e-43b9-8177-5097e1c7fbba req-ac436c8d-740f-4615-a551-e92db2749735 service nova] Creating event network-vif-unplugged:00fe9bc7-bcee-4cde-8c14-51995d2d534d for instance 88296fcb-b862-41bb-91da-80c8491bd52f on n-h2-853611-3 Aug 18 12:26:47.759108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-bf3c9a2a-124e-43b9-8177-5097e1c7fbba req-ac436c8d-740f-4615-a551-e92db2749735 service nova] Instance 88296fcb-b862-41bb-91da-80c8491bd52f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:26:47.779335 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-bf3c9a2a-124e-43b9-8177-5097e1c7fbba req-ac436c8d-740f-4615-a551-e92db2749735 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083911 Aug 18 12:26:47.780137 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3881/6535] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:48.372706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8950dfff-773f-47bf-b807-8c82fc0444d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:48.373556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8950dfff-773f-47bf-b807-8c82fc0444d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:48.380963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8950dfff-773f-47bf-b807-8c82fc0444d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:48.381466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8950dfff-773f-47bf-b807-8c82fc0444d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:48.381912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8950dfff-773f-47bf-b807-8c82fc0444d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:48.382671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8950dfff-773f-47bf-b807-8c82fc0444d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:48.383143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8950dfff-773f-47bf-b807-8c82fc0444d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:48.383581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8950dfff-773f-47bf-b807-8c82fc0444d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:48.580334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8950dfff-773f-47bf-b807-8c82fc0444d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:48.595204 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8950dfff-773f-47bf-b807-8c82fc0444d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1520 microversion: 2.1 time: 0.226797 Aug 18 12:26:48.596354 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3882/6536] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:48 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:26:49.618780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c711fba4-7c0d-40fa-adcc-9c8e6c85bad2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:49.619625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c711fba4-7c0d-40fa-adcc-9c8e6c85bad2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:49.627691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c711fba4-7c0d-40fa-adcc-9c8e6c85bad2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:49.628192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c711fba4-7c0d-40fa-adcc-9c8e6c85bad2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:49.628644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c711fba4-7c0d-40fa-adcc-9c8e6c85bad2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:49.629383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c711fba4-7c0d-40fa-adcc-9c8e6c85bad2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:49.629847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c711fba4-7c0d-40fa-adcc-9c8e6c85bad2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:49.630283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c711fba4-7c0d-40fa-adcc-9c8e6c85bad2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:49.796724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c711fba4-7c0d-40fa-adcc-9c8e6c85bad2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:49.806055 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c711fba4-7c0d-40fa-adcc-9c8e6c85bad2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1518 microversion: 2.1 time: 0.191346 Aug 18 12:26:49.806732 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3883/6537] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:49 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1518 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:49.811482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8e8f6498-db46-4934-9bd2-5d92bb639879 req-3db67b47-f2a7-4b02-89fb-4afbb4c9b935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88296fcb-b862-41bb-91da-80c8491bd52f", "tag": "00fe9bc7-bcee-4cde-8c14-51995d2d534d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:49.821799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8e8f6498-db46-4934-9bd2-5d92bb639879 req-3db67b47-f2a7-4b02-89fb-4afbb4c9b935 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:49.822301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8e8f6498-db46-4934-9bd2-5d92bb639879 req-3db67b47-f2a7-4b02-89fb-4afbb4c9b935 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:49.822787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8e8f6498-db46-4934-9bd2-5d92bb639879 req-3db67b47-f2a7-4b02-89fb-4afbb4c9b935 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:49.843820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8e8f6498-db46-4934-9bd2-5d92bb639879 req-3db67b47-f2a7-4b02-89fb-4afbb4c9b935 service nova] Creating event network-changed:00fe9bc7-bcee-4cde-8c14-51995d2d534d for instance 88296fcb-b862-41bb-91da-80c8491bd52f on n-h2-853611-3 Aug 18 12:26:49.855197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-8e8f6498-db46-4934-9bd2-5d92bb639879 req-3db67b47-f2a7-4b02-89fb-4afbb4c9b935 service nova] Instance 88296fcb-b862-41bb-91da-80c8491bd52f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:26:49.877436 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8e8f6498-db46-4934-9bd2-5d92bb639879 req-3db67b47-f2a7-4b02-89fb-4afbb4c9b935 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067697 Aug 18 12:26:49.878472 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3884/6538] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:50.833931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e6e3484-bad4-4d20-ba54-cbb810c84a37 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:50.835579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2e6e3484-bad4-4d20-ba54-cbb810c84a37 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:50.845395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e6e3484-bad4-4d20-ba54-cbb810c84a37 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:50.846257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e6e3484-bad4-4d20-ba54-cbb810c84a37 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:50.846938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e6e3484-bad4-4d20-ba54-cbb810c84a37 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:50.847809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e6e3484-bad4-4d20-ba54-cbb810c84a37 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:50.848424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e6e3484-bad4-4d20-ba54-cbb810c84a37 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:50.849017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e6e3484-bad4-4d20-ba54-cbb810c84a37 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:51.029089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2e6e3484-bad4-4d20-ba54-cbb810c84a37 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:51.038333 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2e6e3484-bad4-4d20-ba54-cbb810c84a37 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1515 microversion: 2.1 time: 0.210127 Aug 18 12:26:51.038977 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3885/6539] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:50 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:51.059388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-162d3cce-d464-47bd-922c-429c88f7eb54 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:51.059945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-162d3cce-d464-47bd-922c-429c88f7eb54 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:51.066568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-162d3cce-d464-47bd-922c-429c88f7eb54 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:51.067071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-162d3cce-d464-47bd-922c-429c88f7eb54 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:51.067529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-162d3cce-d464-47bd-922c-429c88f7eb54 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:51.068253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-162d3cce-d464-47bd-922c-429c88f7eb54 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:51.068726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-162d3cce-d464-47bd-922c-429c88f7eb54 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:51.069159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-162d3cce-d464-47bd-922c-429c88f7eb54 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:51.140399 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-162d3cce-d464-47bd-922c-429c88f7eb54 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "POST /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f/action" status: 204 len: 0 microversion: 2.1 time: 0.084734 Aug 18 12:26:51.141890 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3886/6540] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:26:51 2022] POST /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:26:51.156958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-77b74967-e006-4890-a53d-4fa3553b0ba0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:51.160141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-77b74967-e006-4890-a53d-4fa3553b0ba0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:51.171188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77b74967-e006-4890-a53d-4fa3553b0ba0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:51.172097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77b74967-e006-4890-a53d-4fa3553b0ba0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:51.173060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77b74967-e006-4890-a53d-4fa3553b0ba0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:51.174893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77b74967-e006-4890-a53d-4fa3553b0ba0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:51.175731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77b74967-e006-4890-a53d-4fa3553b0ba0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:51.176509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77b74967-e006-4890-a53d-4fa3553b0ba0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:51.511796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-77b74967-e006-4890-a53d-4fa3553b0ba0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:51.521718 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-77b74967-e006-4890-a53d-4fa3553b0ba0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1515 microversion: 2.1 time: 0.373510 Aug 18 12:26:51.522343 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3887/6541] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:51 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1515 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:52.368269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-b7171c03-c332-4d33-bb46-6045915f7040 req-36c4dad4-5afa-4c15-b46e-ec3dd23239cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88296fcb-b862-41bb-91da-80c8491bd52f", "name": "network-vif-plugged", "status": "completed", "tag": "00fe9bc7-bcee-4cde-8c14-51995d2d534d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:52.381809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b7171c03-c332-4d33-bb46-6045915f7040 req-36c4dad4-5afa-4c15-b46e-ec3dd23239cb service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:52.382681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b7171c03-c332-4d33-bb46-6045915f7040 req-36c4dad4-5afa-4c15-b46e-ec3dd23239cb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:52.383326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b7171c03-c332-4d33-bb46-6045915f7040 req-36c4dad4-5afa-4c15-b46e-ec3dd23239cb service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:52.403809 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-b7171c03-c332-4d33-bb46-6045915f7040 req-36c4dad4-5afa-4c15-b46e-ec3dd23239cb service nova] Creating event network-vif-plugged:00fe9bc7-bcee-4cde-8c14-51995d2d534d for instance 88296fcb-b862-41bb-91da-80c8491bd52f on n-h2-853611-3 Aug 18 12:26:52.409387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:26:52.417855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-b7171c03-c332-4d33-bb46-6045915f7040 req-36c4dad4-5afa-4c15-b46e-ec3dd23239cb service nova] Instance 88296fcb-b862-41bb-91da-80c8491bd52f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:26:52.436892 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-b7171c03-c332-4d33-bb46-6045915f7040 req-36c4dad4-5afa-4c15-b46e-ec3dd23239cb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072276 Aug 18 12:26:52.438055 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3888/6542] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:26:52.560006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8d79b868-1657-48e6-8d41-3e625a2954b5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:52.560890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8d79b868-1657-48e6-8d41-3e625a2954b5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:52.570977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d79b868-1657-48e6-8d41-3e625a2954b5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:52.571689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d79b868-1657-48e6-8d41-3e625a2954b5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:52.572344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d79b868-1657-48e6-8d41-3e625a2954b5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:52.573269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d79b868-1657-48e6-8d41-3e625a2954b5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:52.573879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d79b868-1657-48e6-8d41-3e625a2954b5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:52.574421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d79b868-1657-48e6-8d41-3e625a2954b5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:52.779570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8d79b868-1657-48e6-8d41-3e625a2954b5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:52.792981 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8d79b868-1657-48e6-8d41-3e625a2954b5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1507 microversion: 2.1 time: 0.239800 Aug 18 12:26:52.793910 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3889/6543] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:52 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:52.820223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e8aa70a-785c-4b82-b0ad-75e5349a9a84 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:52.820706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2e8aa70a-785c-4b82-b0ad-75e5349a9a84 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:52.827738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e8aa70a-785c-4b82-b0ad-75e5349a9a84 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:52.828222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e8aa70a-785c-4b82-b0ad-75e5349a9a84 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:52.828730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e8aa70a-785c-4b82-b0ad-75e5349a9a84 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:52.830268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e8aa70a-785c-4b82-b0ad-75e5349a9a84 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:52.830812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e8aa70a-785c-4b82-b0ad-75e5349a9a84 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:52.831321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e8aa70a-785c-4b82-b0ad-75e5349a9a84 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:52.990677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2e8aa70a-785c-4b82-b0ad-75e5349a9a84 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:52.999277 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2e8aa70a-785c-4b82-b0ad-75e5349a9a84 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1507 microversion: 2.1 time: 0.185902 Aug 18 12:26:52.999943 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3890/6544] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:52 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:26:53.024767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02b4dcf6-7cae-4c42-b0b0-1357c4957334 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Action: 'create', calling method: .version_select at 0x7f51b0d9aa60>, body: {"keypair": {"name": "tempest-keypair-1185349146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCaPGtXvLkohkCTwS8AOoJcQ+2GfUlnU+XJx8aB+QfDRxRxZm8sMoGjTZMuB8NvnwBkIBFNHOnrbAnkwk/ZqkhFPXfqPBVh1kyrL9fBi+eOgLU51oSugHHaCIn6YdDExg=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:53.044068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-02b4dcf6-7cae-4c42-b0b0-1357c4957334 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Getting quotas for project f12a6bd5769b48c884369327c40e3d74. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:26:53.051244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-02b4dcf6-7cae-4c42-b0b0-1357c4957334 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Getting quotas for user 8eba94395015468b9bfcdef7918cc44f and project f12a6bd5769b48c884369327c40e3d74. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:26:53.087055 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-02b4dcf6-7cae-4c42-b0b0-1357c4957334 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066130 Aug 18 12:26:53.087857 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3891/6545] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:26:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:26:54.685737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ceb83a9f-a026-4cdd-9713-6e07472084d3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:54.686776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ceb83a9f-a026-4cdd-9713-6e07472084d3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:54.695728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceb83a9f-a026-4cdd-9713-6e07472084d3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:54.696236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceb83a9f-a026-4cdd-9713-6e07472084d3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:54.696701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceb83a9f-a026-4cdd-9713-6e07472084d3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:54.697463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceb83a9f-a026-4cdd-9713-6e07472084d3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:54.697937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceb83a9f-a026-4cdd-9713-6e07472084d3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:54.698388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceb83a9f-a026-4cdd-9713-6e07472084d3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:54.860831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ceb83a9f-a026-4cdd-9713-6e07472084d3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:54.869409 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ceb83a9f-a026-4cdd-9713-6e07472084d3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 200 len: 1507 microversion: 2.1 time: 0.189055 Aug 18 12:26:54.870015 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3892/6546] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:54 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:54.905560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a17df596-2dd6-404f-817a-be9831e03360 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:54.906096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a17df596-2dd6-404f-817a-be9831e03360 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:54.913960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a17df596-2dd6-404f-817a-be9831e03360 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:54.914744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a17df596-2dd6-404f-817a-be9831e03360 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:54.915464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a17df596-2dd6-404f-817a-be9831e03360 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:54.916370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a17df596-2dd6-404f-817a-be9831e03360 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:54.917102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a17df596-2dd6-404f-817a-be9831e03360 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:54.917672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a17df596-2dd6-404f-817a-be9831e03360 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:54.951525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a17df596-2dd6-404f-817a-be9831e03360 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:26:55.054808 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a17df596-2dd6-404f-817a-be9831e03360 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "DELETE /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 204 len: 0 microversion: 2.1 time: 0.152915 Aug 18 12:26:55.055864 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3893/6547] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:26:54 2022] DELETE /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:26:55.123697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-506307488", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "02e7c4bf-cf66-4347-8ef5-e817eca5363f"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:55.190975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] validate_networks() for [('02e7c4bf-cf66-4347-8ef5-e817eca5363f', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:26:55.660219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:26:55.660589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:26:55.661085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:26:55.661506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:26:55.661931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:26:55.672033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:55.673017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:55.673470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:55.674213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:55.674725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:55.675172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:55.696867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Getting quotas for project f12a6bd5769b48c884369327c40e3d74. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:26:55.703254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Getting quotas for user 8eba94395015468b9bfcdef7918cc44f and project f12a6bd5769b48c884369327c40e3d74. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:26:55.720882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:26:55.723745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:26:55.779536 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7dfd2082-253a-44e9-a310-9026a43b6ce1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659930 Aug 18 12:26:55.781072 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3894/6548] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:26:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:26:55.795672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cd99ab16-964c-4bbd-ba71-7dd5c84802a6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:55.796343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cd99ab16-964c-4bbd-ba71-7dd5c84802a6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:55.866147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cd99ab16-964c-4bbd-ba71-7dd5c84802a6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:55.874462 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cd99ab16-964c-4bbd-ba71-7dd5c84802a6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1217 microversion: 2.1 time: 0.082942 Aug 18 12:26:55.875285 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3895/6549] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:55 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:56.902482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b53c45ef-8aee-4009-a0d3-d9b61946a376 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:56.903553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b53c45ef-8aee-4009-a0d3-d9b61946a376 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:56.924916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b53c45ef-8aee-4009-a0d3-d9b61946a376 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:56.925676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b53c45ef-8aee-4009-a0d3-d9b61946a376 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:56.926400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b53c45ef-8aee-4009-a0d3-d9b61946a376 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:56.927481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b53c45ef-8aee-4009-a0d3-d9b61946a376 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:56.928339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b53c45ef-8aee-4009-a0d3-d9b61946a376 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:56.929156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b53c45ef-8aee-4009-a0d3-d9b61946a376 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:57.095771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b53c45ef-8aee-4009-a0d3-d9b61946a376 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:57.104942 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b53c45ef-8aee-4009-a0d3-d9b61946a376 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1269 microversion: 2.1 time: 0.210365 Aug 18 12:26:57.106319 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3896/6550] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:56 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1269 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:57.111485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5c12b5ab-839d-4fb7-aa91-43d55f7272d4 req-9532fa55-6612-4925-aa2f-4b95e090ba96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88296fcb-b862-41bb-91da-80c8491bd52f", "name": "network-vif-deleted", "tag": "00fe9bc7-bcee-4cde-8c14-51995d2d534d"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:57.122939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c12b5ab-839d-4fb7-aa91-43d55f7272d4 req-9532fa55-6612-4925-aa2f-4b95e090ba96 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:57.123730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c12b5ab-839d-4fb7-aa91-43d55f7272d4 req-9532fa55-6612-4925-aa2f-4b95e090ba96 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:57.124438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c12b5ab-839d-4fb7-aa91-43d55f7272d4 req-9532fa55-6612-4925-aa2f-4b95e090ba96 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:57.141243 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5c12b5ab-839d-4fb7-aa91-43d55f7272d4 req-9532fa55-6612-4925-aa2f-4b95e090ba96 service nova] Creating event network-vif-deleted:00fe9bc7-bcee-4cde-8c14-51995d2d534d for instance 88296fcb-b862-41bb-91da-80c8491bd52f on n-h2-853611-3 Aug 18 12:26:57.149650 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5c12b5ab-839d-4fb7-aa91-43d55f7272d4 req-9532fa55-6612-4925-aa2f-4b95e090ba96 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041306 Aug 18 12:26:57.151132 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3897/6551] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:26:58.143899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5bbb827f-bc8f-4ffe-b878-845dff7bf0d2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:58.145433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5bbb827f-bc8f-4ffe-b878-845dff7bf0d2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:58.152372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bbb827f-bc8f-4ffe-b878-845dff7bf0d2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:58.152911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bbb827f-bc8f-4ffe-b878-845dff7bf0d2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:58.153370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bbb827f-bc8f-4ffe-b878-845dff7bf0d2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:58.154120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bbb827f-bc8f-4ffe-b878-845dff7bf0d2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:58.154837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bbb827f-bc8f-4ffe-b878-845dff7bf0d2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:58.155287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bbb827f-bc8f-4ffe-b878-845dff7bf0d2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:58.266973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5bbb827f-bc8f-4ffe-b878-845dff7bf0d2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:58.275846 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5bbb827f-bc8f-4ffe-b878-845dff7bf0d2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1275 microversion: 2.1 time: 0.139337 Aug 18 12:26:58.285063 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3898/6552] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:58 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1275 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:59.299267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-212dc472-a6b8-4c69-a743-03d1861bd667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:26:59.300377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-212dc472-a6b8-4c69-a743-03d1861bd667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:26:59.308965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212dc472-a6b8-4c69-a743-03d1861bd667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:59.309592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212dc472-a6b8-4c69-a743-03d1861bd667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:59.310168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212dc472-a6b8-4c69-a743-03d1861bd667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:59.311234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212dc472-a6b8-4c69-a743-03d1861bd667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:59.311811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212dc472-a6b8-4c69-a743-03d1861bd667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:59.312492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-212dc472-a6b8-4c69-a743-03d1861bd667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:59.621062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-212dc472-a6b8-4c69-a743-03d1861bd667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:26:59.632217 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-212dc472-a6b8-4c69-a743-03d1861bd667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1317 microversion: 2.1 time: 0.338341 Aug 18 12:26:59.632921 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3899/6553] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:26:59 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:26:59.642984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ef881e12-e161-483c-a586-5dad28192188 req-810bba38-1545-4fcc-b50a-938d3a95b413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61c97bb0-776f-4e59-97db-d3f92910a02f", "tag": "e65a500b-96bd-4875-a48a-bed6dd2224a7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:26:59.661494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ef881e12-e161-483c-a586-5dad28192188 req-810bba38-1545-4fcc-b50a-938d3a95b413 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:26:59.662211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ef881e12-e161-483c-a586-5dad28192188 req-810bba38-1545-4fcc-b50a-938d3a95b413 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:26:59.662776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ef881e12-e161-483c-a586-5dad28192188 req-810bba38-1545-4fcc-b50a-938d3a95b413 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:26:59.687935 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ef881e12-e161-483c-a586-5dad28192188 req-810bba38-1545-4fcc-b50a-938d3a95b413 service nova] Creating event network-changed:e65a500b-96bd-4875-a48a-bed6dd2224a7 for instance 61c97bb0-776f-4e59-97db-d3f92910a02f on n-h2-853611-3 Aug 18 12:26:59.697471 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ef881e12-e161-483c-a586-5dad28192188 req-810bba38-1545-4fcc-b50a-938d3a95b413 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062809 Aug 18 12:26:59.698548 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3900/6554] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:27:00.674953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b58e41b6-01f5-42a6-9977-a36e8d748d5b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:00.676254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b58e41b6-01f5-42a6-9977-a36e8d748d5b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:00.687898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b58e41b6-01f5-42a6-9977-a36e8d748d5b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:00.689676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b58e41b6-01f5-42a6-9977-a36e8d748d5b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:00.690114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b58e41b6-01f5-42a6-9977-a36e8d748d5b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:00.691448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b58e41b6-01f5-42a6-9977-a36e8d748d5b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:00.692267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b58e41b6-01f5-42a6-9977-a36e8d748d5b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:00.693054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b58e41b6-01f5-42a6-9977-a36e8d748d5b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:01.002805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b58e41b6-01f5-42a6-9977-a36e8d748d5b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:01.018109 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b58e41b6-01f5-42a6-9977-a36e8d748d5b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1317 microversion: 2.1 time: 0.353156 Aug 18 12:27:01.019408 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3901/6555] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:00 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:02.039826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0df99346-705e-412e-a28c-e64b65d15b03 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:02.040720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0df99346-705e-412e-a28c-e64b65d15b03 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:02.048899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0df99346-705e-412e-a28c-e64b65d15b03 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:02.049636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0df99346-705e-412e-a28c-e64b65d15b03 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:02.050164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0df99346-705e-412e-a28c-e64b65d15b03 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:02.051015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0df99346-705e-412e-a28c-e64b65d15b03 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:02.051533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0df99346-705e-412e-a28c-e64b65d15b03 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:02.052021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0df99346-705e-412e-a28c-e64b65d15b03 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:02.230767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0df99346-705e-412e-a28c-e64b65d15b03 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:02.246393 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0df99346-705e-412e-a28c-e64b65d15b03 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1317 microversion: 2.1 time: 0.210187 Aug 18 12:27:02.247521 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3902/6556] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:02 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:03.280090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-66660034-b03d-41b7-ac15-93e7ce5b5273 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:03.281240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-66660034-b03d-41b7-ac15-93e7ce5b5273 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:03.287415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:03.297751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66660034-b03d-41b7-ac15-93e7ce5b5273 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:03.298677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66660034-b03d-41b7-ac15-93e7ce5b5273 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:03.299426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66660034-b03d-41b7-ac15-93e7ce5b5273 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:03.300692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66660034-b03d-41b7-ac15-93e7ce5b5273 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:03.301534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66660034-b03d-41b7-ac15-93e7ce5b5273 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:03.302320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66660034-b03d-41b7-ac15-93e7ce5b5273 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:03.495256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-66660034-b03d-41b7-ac15-93e7ce5b5273 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:03.504358 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-66660034-b03d-41b7-ac15-93e7ce5b5273 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1317 microversion: 2.1 time: 0.231773 Aug 18 12:27:03.504974 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3903/6557] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:03 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:04.441926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-df9f1cb6-aabf-4e4f-8374-0f795c6a00e2 req-e931a1fc-e3b4-4dca-b7de-112f7f451913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c97bb0-776f-4e59-97db-d3f92910a02f", "name": "network-vif-plugged", "status": "completed", "tag": "e65a500b-96bd-4875-a48a-bed6dd2224a7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:04.452736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-df9f1cb6-aabf-4e4f-8374-0f795c6a00e2 req-e931a1fc-e3b4-4dca-b7de-112f7f451913 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:04.453257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-df9f1cb6-aabf-4e4f-8374-0f795c6a00e2 req-e931a1fc-e3b4-4dca-b7de-112f7f451913 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:04.454394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-df9f1cb6-aabf-4e4f-8374-0f795c6a00e2 req-e931a1fc-e3b4-4dca-b7de-112f7f451913 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:04.468318 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-df9f1cb6-aabf-4e4f-8374-0f795c6a00e2 req-e931a1fc-e3b4-4dca-b7de-112f7f451913 service nova] Creating event network-vif-plugged:e65a500b-96bd-4875-a48a-bed6dd2224a7 for instance 61c97bb0-776f-4e59-97db-d3f92910a02f on n-h2-853611-3 Aug 18 12:27:04.474060 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-df9f1cb6-aabf-4e4f-8374-0f795c6a00e2 req-e931a1fc-e3b4-4dca-b7de-112f7f451913 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036442 Aug 18 12:27:04.474726 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3904/6558] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:27:04.543628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8de209b1-1bfc-4a49-9de6-c2645953f02c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:04.544500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8de209b1-1bfc-4a49-9de6-c2645953f02c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:04.553126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8de209b1-1bfc-4a49-9de6-c2645953f02c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:04.553634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8de209b1-1bfc-4a49-9de6-c2645953f02c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:04.554085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8de209b1-1bfc-4a49-9de6-c2645953f02c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:04.554888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8de209b1-1bfc-4a49-9de6-c2645953f02c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:04.555342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8de209b1-1bfc-4a49-9de6-c2645953f02c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:04.555786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8de209b1-1bfc-4a49-9de6-c2645953f02c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:04.780525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8de209b1-1bfc-4a49-9de6-c2645953f02c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:04.790614 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8de209b1-1bfc-4a49-9de6-c2645953f02c tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1317 microversion: 2.1 time: 0.253755 Aug 18 12:27:04.791756 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3905/6559] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:04 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:05.814608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c5ca9baf-3cc4-4755-af26-a58ffdb6df52 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:05.815664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c5ca9baf-3cc4-4755-af26-a58ffdb6df52 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:05.820234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:05.830276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ca9baf-3cc4-4755-af26-a58ffdb6df52 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:05.830887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ca9baf-3cc4-4755-af26-a58ffdb6df52 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:05.831763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ca9baf-3cc4-4755-af26-a58ffdb6df52 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:05.832884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ca9baf-3cc4-4755-af26-a58ffdb6df52 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:05.833765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ca9baf-3cc4-4755-af26-a58ffdb6df52 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:05.834264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5ca9baf-3cc4-4755-af26-a58ffdb6df52 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:05.871293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:06.002759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c5ca9baf-3cc4-4755-af26-a58ffdb6df52 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:06.011591 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c5ca9baf-3cc4-4755-af26-a58ffdb6df52 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1506 microversion: 2.1 time: 0.203134 Aug 18 12:27:06.012212 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3906/6560] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:05 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:06.034807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3a0f1ade-bddd-4a05-9084-d8f784f2c4e2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:06.035456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3a0f1ade-bddd-4a05-9084-d8f784f2c4e2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:06.043532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a0f1ade-bddd-4a05-9084-d8f784f2c4e2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:06.043532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a0f1ade-bddd-4a05-9084-d8f784f2c4e2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:06.043532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a0f1ade-bddd-4a05-9084-d8f784f2c4e2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:06.044401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a0f1ade-bddd-4a05-9084-d8f784f2c4e2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:06.045024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a0f1ade-bddd-4a05-9084-d8f784f2c4e2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:06.045551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a0f1ade-bddd-4a05-9084-d8f784f2c4e2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:06.223669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3a0f1ade-bddd-4a05-9084-d8f784f2c4e2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:06.232673 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3a0f1ade-bddd-4a05-9084-d8f784f2c4e2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1506 microversion: 2.1 time: 0.202480 Aug 18 12:27:06.233365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3907/6561] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:06 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1506 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:06.255913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:06.258363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:06.265113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:06.265625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:06.266089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:06.268081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:06.268579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:06.269050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:06.289925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:06.309464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:06.318188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Old instance type m1.heat2, new instance type m1.heat {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 12:27:06.326312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:27:06.326788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:27:06.327285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:27:06.327741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:27:06.328177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:27:06.410590 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dc6ef297-8857-420f-b3de-d192802ce386 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "POST /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f/action" status: 202 len: 0 microversion: 2.1 time: 0.159011 Aug 18 12:27:06.411506 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3908/6562] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:27:06 2022] POST /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:27:06.419861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1daf9ec0-a751-4a97-9dea-bc871b9530e1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:06.420498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1daf9ec0-a751-4a97-9dea-bc871b9530e1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:06.427548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1daf9ec0-a751-4a97-9dea-bc871b9530e1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:06.428031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1daf9ec0-a751-4a97-9dea-bc871b9530e1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:06.428483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1daf9ec0-a751-4a97-9dea-bc871b9530e1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:06.429241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1daf9ec0-a751-4a97-9dea-bc871b9530e1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:06.429748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1daf9ec0-a751-4a97-9dea-bc871b9530e1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:06.430313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1daf9ec0-a751-4a97-9dea-bc871b9530e1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:06.660334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1daf9ec0-a751-4a97-9dea-bc871b9530e1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:06.668687 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1daf9ec0-a751-4a97-9dea-bc871b9530e1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1513 microversion: 2.1 time: 0.252709 Aug 18 12:27:06.669305 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3909/6563] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:06 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:07.693061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1ec4dede-da90-4577-98a2-1e268c7a93d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:07.693848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1ec4dede-da90-4577-98a2-1e268c7a93d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:07.701439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ec4dede-da90-4577-98a2-1e268c7a93d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:07.702014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ec4dede-da90-4577-98a2-1e268c7a93d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:07.702559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ec4dede-da90-4577-98a2-1e268c7a93d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:07.703347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ec4dede-da90-4577-98a2-1e268c7a93d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:07.704487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ec4dede-da90-4577-98a2-1e268c7a93d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:07.705243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ec4dede-da90-4577-98a2-1e268c7a93d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:07.863297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1ec4dede-da90-4577-98a2-1e268c7a93d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:07.872978 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1ec4dede-da90-4577-98a2-1e268c7a93d1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1513 microversion: 2.1 time: 0.184798 Aug 18 12:27:07.873949 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3910/6564] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:07 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:08.908836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0d04dd2f-38c1-4090-b299-f5a72147b311 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:08.910092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0d04dd2f-38c1-4090-b299-f5a72147b311 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:08.918223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d04dd2f-38c1-4090-b299-f5a72147b311 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:08.918776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d04dd2f-38c1-4090-b299-f5a72147b311 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:08.919238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d04dd2f-38c1-4090-b299-f5a72147b311 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:08.920015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d04dd2f-38c1-4090-b299-f5a72147b311 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:08.920490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d04dd2f-38c1-4090-b299-f5a72147b311 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:08.920931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d04dd2f-38c1-4090-b299-f5a72147b311 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:09.082057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0d04dd2f-38c1-4090-b299-f5a72147b311 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:09.090313 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0d04dd2f-38c1-4090-b299-f5a72147b311 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.185812 Aug 18 12:27:09.090964 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3911/6565] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:08 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:10.114459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-00b76754-bf2d-4a65-bccc-078bf045a8f2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:10.115348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-00b76754-bf2d-4a65-bccc-078bf045a8f2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:10.122684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00b76754-bf2d-4a65-bccc-078bf045a8f2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:10.123185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00b76754-bf2d-4a65-bccc-078bf045a8f2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:10.123666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00b76754-bf2d-4a65-bccc-078bf045a8f2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:10.124366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00b76754-bf2d-4a65-bccc-078bf045a8f2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:10.124828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00b76754-bf2d-4a65-bccc-078bf045a8f2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:10.125266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00b76754-bf2d-4a65-bccc-078bf045a8f2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:10.321006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-00b76754-bf2d-4a65-bccc-078bf045a8f2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:10.330775 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-00b76754-bf2d-4a65-bccc-078bf045a8f2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.220165 Aug 18 12:27:10.331435 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3912/6566] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:10 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:11.368457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fe978f25-2988-4db4-99be-c6d04f7a17f9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:11.369216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fe978f25-2988-4db4-99be-c6d04f7a17f9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:11.377565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe978f25-2988-4db4-99be-c6d04f7a17f9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:11.378142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe978f25-2988-4db4-99be-c6d04f7a17f9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:11.378665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe978f25-2988-4db4-99be-c6d04f7a17f9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:11.379408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe978f25-2988-4db4-99be-c6d04f7a17f9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:11.379875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe978f25-2988-4db4-99be-c6d04f7a17f9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:11.380319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe978f25-2988-4db4-99be-c6d04f7a17f9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:11.543532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fe978f25-2988-4db4-99be-c6d04f7a17f9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:11.552923 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fe978f25-2988-4db4-99be-c6d04f7a17f9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.188843 Aug 18 12:27:11.553526 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3913/6567] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:11 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:12.585660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-63c5c238-8481-4cba-9054-78354e7dec05 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:12.586412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-63c5c238-8481-4cba-9054-78354e7dec05 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:12.595425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63c5c238-8481-4cba-9054-78354e7dec05 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:12.596075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63c5c238-8481-4cba-9054-78354e7dec05 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:12.596552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63c5c238-8481-4cba-9054-78354e7dec05 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:12.597329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63c5c238-8481-4cba-9054-78354e7dec05 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:12.597825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63c5c238-8481-4cba-9054-78354e7dec05 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:12.598281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63c5c238-8481-4cba-9054-78354e7dec05 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:12.764329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-63c5c238-8481-4cba-9054-78354e7dec05 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:12.774497 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-63c5c238-8481-4cba-9054-78354e7dec05 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.193034 Aug 18 12:27:12.775112 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3914/6568] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:12 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:13.797434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d19800da-a481-4329-86ff-839f39b367aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:13.798392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d19800da-a481-4329-86ff-839f39b367aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:13.806643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d19800da-a481-4329-86ff-839f39b367aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:13.807264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d19800da-a481-4329-86ff-839f39b367aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:13.807731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d19800da-a481-4329-86ff-839f39b367aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:13.808611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d19800da-a481-4329-86ff-839f39b367aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:13.809105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d19800da-a481-4329-86ff-839f39b367aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:13.809556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d19800da-a481-4329-86ff-839f39b367aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:13.992093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d19800da-a481-4329-86ff-839f39b367aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:14.004898 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d19800da-a481-4329-86ff-839f39b367aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.211308 Aug 18 12:27:14.005802 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3915/6569] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:13 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:15.033911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1862b3ac-94fd-4655-a3d8-ee7f8b9ef9d5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:15.034771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1862b3ac-94fd-4655-a3d8-ee7f8b9ef9d5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:15.041960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1862b3ac-94fd-4655-a3d8-ee7f8b9ef9d5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:15.042479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1862b3ac-94fd-4655-a3d8-ee7f8b9ef9d5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:15.042934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1862b3ac-94fd-4655-a3d8-ee7f8b9ef9d5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:15.043667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1862b3ac-94fd-4655-a3d8-ee7f8b9ef9d5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:15.044136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1862b3ac-94fd-4655-a3d8-ee7f8b9ef9d5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:15.044574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1862b3ac-94fd-4655-a3d8-ee7f8b9ef9d5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:15.210204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1862b3ac-94fd-4655-a3d8-ee7f8b9ef9d5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:15.219903 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1862b3ac-94fd-4655-a3d8-ee7f8b9ef9d5 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.189506 Aug 18 12:27:15.220689 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3916/6570] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:15 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:16.242730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6adc93da-6ddd-46f0-b32e-0f5f5d00f2b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:16.243461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6adc93da-6ddd-46f0-b32e-0f5f5d00f2b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:16.251923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6adc93da-6ddd-46f0-b32e-0f5f5d00f2b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:16.252541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6adc93da-6ddd-46f0-b32e-0f5f5d00f2b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:16.252998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6adc93da-6ddd-46f0-b32e-0f5f5d00f2b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:16.253750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6adc93da-6ddd-46f0-b32e-0f5f5d00f2b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:16.254228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6adc93da-6ddd-46f0-b32e-0f5f5d00f2b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:16.254711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6adc93da-6ddd-46f0-b32e-0f5f5d00f2b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:16.417529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6adc93da-6ddd-46f0-b32e-0f5f5d00f2b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:16.426157 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6adc93da-6ddd-46f0-b32e-0f5f5d00f2b0 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.187684 Aug 18 12:27:16.426879 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3917/6571] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:16 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:17.452637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-29719603-ff7d-4bc0-b65b-df00e8b789ee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:17.454232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-29719603-ff7d-4bc0-b65b-df00e8b789ee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:17.462910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29719603-ff7d-4bc0-b65b-df00e8b789ee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:17.463583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29719603-ff7d-4bc0-b65b-df00e8b789ee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:17.464090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29719603-ff7d-4bc0-b65b-df00e8b789ee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:17.465074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29719603-ff7d-4bc0-b65b-df00e8b789ee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:17.465597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29719603-ff7d-4bc0-b65b-df00e8b789ee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:17.466267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29719603-ff7d-4bc0-b65b-df00e8b789ee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:17.682667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-29719603-ff7d-4bc0-b65b-df00e8b789ee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:17.695640 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-29719603-ff7d-4bc0-b65b-df00e8b789ee tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.248371 Aug 18 12:27:17.696386 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3918/6572] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:17 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:18.721775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec783fc4-f99d-4dee-9a3a-476e8f077a27 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:18.722628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ec783fc4-f99d-4dee-9a3a-476e8f077a27 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:18.730509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec783fc4-f99d-4dee-9a3a-476e8f077a27 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:18.731030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec783fc4-f99d-4dee-9a3a-476e8f077a27 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:18.731492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec783fc4-f99d-4dee-9a3a-476e8f077a27 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:18.732257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec783fc4-f99d-4dee-9a3a-476e8f077a27 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:18.732733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec783fc4-f99d-4dee-9a3a-476e8f077a27 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:18.733225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec783fc4-f99d-4dee-9a3a-476e8f077a27 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:18.915611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ec783fc4-f99d-4dee-9a3a-476e8f077a27 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:18.927102 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ec783fc4-f99d-4dee-9a3a-476e8f077a27 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.211300 Aug 18 12:27:18.928033 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3919/6573] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:18 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:19.969568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-040677da-0f09-4554-b050-558c4e59acb9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:19.972368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-040677da-0f09-4554-b050-558c4e59acb9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:19.993695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-040677da-0f09-4554-b050-558c4e59acb9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:19.994254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-040677da-0f09-4554-b050-558c4e59acb9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:19.994837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-040677da-0f09-4554-b050-558c4e59acb9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:19.995676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-040677da-0f09-4554-b050-558c4e59acb9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:19.996464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-040677da-0f09-4554-b050-558c4e59acb9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:19.996964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-040677da-0f09-4554-b050-558c4e59acb9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:20.184282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-040677da-0f09-4554-b050-558c4e59acb9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:20.197243 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-040677da-0f09-4554-b050-558c4e59acb9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.236887 Aug 18 12:27:20.198021 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3920/6574] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:19 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:21.224689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4200ab28-ea3e-4b40-9960-b5a5ea56591d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:21.225420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4200ab28-ea3e-4b40-9960-b5a5ea56591d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:21.232790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4200ab28-ea3e-4b40-9960-b5a5ea56591d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:21.233304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4200ab28-ea3e-4b40-9960-b5a5ea56591d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:21.233766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4200ab28-ea3e-4b40-9960-b5a5ea56591d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:21.234540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4200ab28-ea3e-4b40-9960-b5a5ea56591d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:21.235817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4200ab28-ea3e-4b40-9960-b5a5ea56591d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:21.236637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4200ab28-ea3e-4b40-9960-b5a5ea56591d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:21.396240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4200ab28-ea3e-4b40-9960-b5a5ea56591d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:21.410202 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4200ab28-ea3e-4b40-9960-b5a5ea56591d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.190000 Aug 18 12:27:21.411311 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3921/6575] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:21 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:22.445940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-282d4a5a-a63a-4936-a280-d6ee065058be tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:22.447073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-282d4a5a-a63a-4936-a280-d6ee065058be tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:22.453775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-282d4a5a-a63a-4936-a280-d6ee065058be tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:22.454287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-282d4a5a-a63a-4936-a280-d6ee065058be tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:22.454780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-282d4a5a-a63a-4936-a280-d6ee065058be tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:22.455518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-282d4a5a-a63a-4936-a280-d6ee065058be tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:22.455996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-282d4a5a-a63a-4936-a280-d6ee065058be tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:22.456443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-282d4a5a-a63a-4936-a280-d6ee065058be tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:22.642821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-282d4a5a-a63a-4936-a280-d6ee065058be tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:22.651206 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-282d4a5a-a63a-4936-a280-d6ee065058be tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.209491 Aug 18 12:27:22.651831 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3922/6576] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:22 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:23.674684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-37d5af0d-5186-448f-b1eb-1c83971b961d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:23.675424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-37d5af0d-5186-448f-b1eb-1c83971b961d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:23.683468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37d5af0d-5186-448f-b1eb-1c83971b961d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:23.683982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37d5af0d-5186-448f-b1eb-1c83971b961d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:23.684441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37d5af0d-5186-448f-b1eb-1c83971b961d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:23.685194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37d5af0d-5186-448f-b1eb-1c83971b961d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:23.685705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37d5af0d-5186-448f-b1eb-1c83971b961d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:23.686121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-37d5af0d-5186-448f-b1eb-1c83971b961d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:23.841306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-37d5af0d-5186-448f-b1eb-1c83971b961d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:23.843917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:23.852734 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-37d5af0d-5186-448f-b1eb-1c83971b961d tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.182996 Aug 18 12:27:23.853361 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3923/6577] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:23 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:24.877531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-da3b524a-f2a1-4ea6-8e6f-1257157642d8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:24.878270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-da3b524a-f2a1-4ea6-8e6f-1257157642d8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:24.887067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da3b524a-f2a1-4ea6-8e6f-1257157642d8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:24.887584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da3b524a-f2a1-4ea6-8e6f-1257157642d8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:24.888038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da3b524a-f2a1-4ea6-8e6f-1257157642d8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:24.888862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da3b524a-f2a1-4ea6-8e6f-1257157642d8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:24.889269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da3b524a-f2a1-4ea6-8e6f-1257157642d8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:24.889712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da3b524a-f2a1-4ea6-8e6f-1257157642d8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:25.065462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-da3b524a-f2a1-4ea6-8e6f-1257157642d8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:25.079706 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-da3b524a-f2a1-4ea6-8e6f-1257157642d8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.206523 Aug 18 12:27:25.081123 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3924/6578] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:24 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:26.104483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fd5b79db-263c-42fd-b88b-6f138760e667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:26.105210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fd5b79db-263c-42fd-b88b-6f138760e667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:26.114179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd5b79db-263c-42fd-b88b-6f138760e667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:26.114863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd5b79db-263c-42fd-b88b-6f138760e667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:26.115415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd5b79db-263c-42fd-b88b-6f138760e667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:26.116271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd5b79db-263c-42fd-b88b-6f138760e667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:26.116883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd5b79db-263c-42fd-b88b-6f138760e667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:26.117429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd5b79db-263c-42fd-b88b-6f138760e667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:26.281255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fd5b79db-263c-42fd-b88b-6f138760e667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:26.290656 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fd5b79db-263c-42fd-b88b-6f138760e667 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.190058 Aug 18 12:27:26.291272 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3925/6579] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:26 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:27.312561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-907caadd-4776-4945-8d82-0af7e27850aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:27.314200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-907caadd-4776-4945-8d82-0af7e27850aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:27.325002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-907caadd-4776-4945-8d82-0af7e27850aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:27.325577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-907caadd-4776-4945-8d82-0af7e27850aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:27.326106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-907caadd-4776-4945-8d82-0af7e27850aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:27.327104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-907caadd-4776-4945-8d82-0af7e27850aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:27.327646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-907caadd-4776-4945-8d82-0af7e27850aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:27.328181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-907caadd-4776-4945-8d82-0af7e27850aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:27.495183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-907caadd-4776-4945-8d82-0af7e27850aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:27.510395 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-907caadd-4776-4945-8d82-0af7e27850aa tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.201248 Aug 18 12:27:27.511501 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3926/6580] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:27 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:28.544395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34b8f43f-58ae-4a65-9d82-140d6147579f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:28.545117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-34b8f43f-58ae-4a65-9d82-140d6147579f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:28.553933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34b8f43f-58ae-4a65-9d82-140d6147579f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:28.554482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34b8f43f-58ae-4a65-9d82-140d6147579f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:28.554949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34b8f43f-58ae-4a65-9d82-140d6147579f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:28.555760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34b8f43f-58ae-4a65-9d82-140d6147579f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:28.556366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34b8f43f-58ae-4a65-9d82-140d6147579f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:28.556841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34b8f43f-58ae-4a65-9d82-140d6147579f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:28.706191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-34b8f43f-58ae-4a65-9d82-140d6147579f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:28.715167 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34b8f43f-58ae-4a65-9d82-140d6147579f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.174844 Aug 18 12:27:28.715781 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3927/6581] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:28 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:29.738171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5a08307b-9449-4f0d-8f32-0e3b608d29b3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:29.738932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5a08307b-9449-4f0d-8f32-0e3b608d29b3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:29.746677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a08307b-9449-4f0d-8f32-0e3b608d29b3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:29.747282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a08307b-9449-4f0d-8f32-0e3b608d29b3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:29.747777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a08307b-9449-4f0d-8f32-0e3b608d29b3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:29.748562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a08307b-9449-4f0d-8f32-0e3b608d29b3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:29.749076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a08307b-9449-4f0d-8f32-0e3b608d29b3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:29.749557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a08307b-9449-4f0d-8f32-0e3b608d29b3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:29.913559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5a08307b-9449-4f0d-8f32-0e3b608d29b3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:29.922753 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5a08307b-9449-4f0d-8f32-0e3b608d29b3 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.188808 Aug 18 12:27:29.923732 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3928/6582] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:29 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:30.951471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4d9ca3d1-152d-4cbf-bbeb-aac4b09e2cc9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:30.952902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4d9ca3d1-152d-4cbf-bbeb-aac4b09e2cc9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:30.966764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d9ca3d1-152d-4cbf-bbeb-aac4b09e2cc9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:30.968076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d9ca3d1-152d-4cbf-bbeb-aac4b09e2cc9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:30.969102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d9ca3d1-152d-4cbf-bbeb-aac4b09e2cc9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:30.970640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d9ca3d1-152d-4cbf-bbeb-aac4b09e2cc9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:30.971784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d9ca3d1-152d-4cbf-bbeb-aac4b09e2cc9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:30.972695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d9ca3d1-152d-4cbf-bbeb-aac4b09e2cc9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:31.322894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4d9ca3d1-152d-4cbf-bbeb-aac4b09e2cc9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:31.331865 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4d9ca3d1-152d-4cbf-bbeb-aac4b09e2cc9 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.389122 Aug 18 12:27:31.332491 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3929/6583] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:30 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:32.367903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a782c4b9-9266-4848-9e26-e2683b7d9440 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:32.368682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a782c4b9-9266-4848-9e26-e2683b7d9440 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:32.376863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a782c4b9-9266-4848-9e26-e2683b7d9440 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:32.377525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a782c4b9-9266-4848-9e26-e2683b7d9440 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:32.378102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a782c4b9-9266-4848-9e26-e2683b7d9440 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:32.379158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a782c4b9-9266-4848-9e26-e2683b7d9440 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:32.379862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a782c4b9-9266-4848-9e26-e2683b7d9440 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:32.380393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a782c4b9-9266-4848-9e26-e2683b7d9440 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:32.548364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a782c4b9-9266-4848-9e26-e2683b7d9440 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:32.556769 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a782c4b9-9266-4848-9e26-e2683b7d9440 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.193310 Aug 18 12:27:32.557389 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3930/6584] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:32 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:33.593506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-58ce1fcb-debe-4f0c-bacc-14dcb3dd0de1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:33.594540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-58ce1fcb-debe-4f0c-bacc-14dcb3dd0de1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:33.597413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=60 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:33.603827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58ce1fcb-debe-4f0c-bacc-14dcb3dd0de1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:33.604343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58ce1fcb-debe-4f0c-bacc-14dcb3dd0de1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:33.604800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58ce1fcb-debe-4f0c-bacc-14dcb3dd0de1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:33.605625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58ce1fcb-debe-4f0c-bacc-14dcb3dd0de1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:33.606103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58ce1fcb-debe-4f0c-bacc-14dcb3dd0de1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:33.606579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58ce1fcb-debe-4f0c-bacc-14dcb3dd0de1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:33.791056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-58ce1fcb-debe-4f0c-bacc-14dcb3dd0de1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:33.800990 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-58ce1fcb-debe-4f0c-bacc-14dcb3dd0de1 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.212004 Aug 18 12:27:33.801647 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3931/6585] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:33 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:34.823684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de9cb90f-7296-4246-a889-a3fb7b83cda2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:34.827715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-de9cb90f-7296-4246-a889-a3fb7b83cda2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:34.841959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de9cb90f-7296-4246-a889-a3fb7b83cda2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:34.842748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de9cb90f-7296-4246-a889-a3fb7b83cda2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:34.843202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de9cb90f-7296-4246-a889-a3fb7b83cda2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:34.843973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de9cb90f-7296-4246-a889-a3fb7b83cda2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:34.845038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de9cb90f-7296-4246-a889-a3fb7b83cda2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:34.845531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de9cb90f-7296-4246-a889-a3fb7b83cda2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:34.996599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-de9cb90f-7296-4246-a889-a3fb7b83cda2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:35.006088 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de9cb90f-7296-4246-a889-a3fb7b83cda2 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1518 microversion: 2.1 time: 0.186570 Aug 18 12:27:35.007051 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3932/6586] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:34 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:35.858022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9660a555-da8c-4605-bb2d-3d731e2922a2 req-43c46627-259c-4ba7-8ae3-5740115f96dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c97bb0-776f-4e59-97db-d3f92910a02f", "name": "network-vif-unplugged", "status": "completed", "tag": "e65a500b-96bd-4875-a48a-bed6dd2224a7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:35.881236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9660a555-da8c-4605-bb2d-3d731e2922a2 req-43c46627-259c-4ba7-8ae3-5740115f96dd service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:35.881236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9660a555-da8c-4605-bb2d-3d731e2922a2 req-43c46627-259c-4ba7-8ae3-5740115f96dd service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:35.881783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9660a555-da8c-4605-bb2d-3d731e2922a2 req-43c46627-259c-4ba7-8ae3-5740115f96dd service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:35.900728 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9660a555-da8c-4605-bb2d-3d731e2922a2 req-43c46627-259c-4ba7-8ae3-5740115f96dd service nova] Creating event network-vif-unplugged:e65a500b-96bd-4875-a48a-bed6dd2224a7 for instance 61c97bb0-776f-4e59-97db-d3f92910a02f on n-h1-853611-3 Aug 18 12:27:35.914694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-9660a555-da8c-4605-bb2d-3d731e2922a2 req-43c46627-259c-4ba7-8ae3-5740115f96dd service nova] Instance 61c97bb0-776f-4e59-97db-d3f92910a02f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:27:35.928833 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9660a555-da8c-4605-bb2d-3d731e2922a2 req-43c46627-259c-4ba7-8ae3-5740115f96dd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078597 Aug 18 12:27:35.929740 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3933/6587] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:27:36.030574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f47899ea-7d34-479c-9bf9-8e318229cb78 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:36.031313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f47899ea-7d34-479c-9bf9-8e318229cb78 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:36.038827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f47899ea-7d34-479c-9bf9-8e318229cb78 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:36.039493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f47899ea-7d34-479c-9bf9-8e318229cb78 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:36.040084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f47899ea-7d34-479c-9bf9-8e318229cb78 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:36.040949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f47899ea-7d34-479c-9bf9-8e318229cb78 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:36.041527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f47899ea-7d34-479c-9bf9-8e318229cb78 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:36.042154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f47899ea-7d34-479c-9bf9-8e318229cb78 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:36.323778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f47899ea-7d34-479c-9bf9-8e318229cb78 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:36.339020 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f47899ea-7d34-479c-9bf9-8e318229cb78 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1517 microversion: 2.1 time: 0.312575 Aug 18 12:27:36.340230 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3934/6588] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:36 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1517 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:37.376598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f5e1fbb8-2072-487a-835d-0ea649bff11f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:37.377343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f5e1fbb8-2072-487a-835d-0ea649bff11f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:37.384530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5e1fbb8-2072-487a-835d-0ea649bff11f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:37.385041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5e1fbb8-2072-487a-835d-0ea649bff11f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:37.385504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5e1fbb8-2072-487a-835d-0ea649bff11f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:37.386240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5e1fbb8-2072-487a-835d-0ea649bff11f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:37.386765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5e1fbb8-2072-487a-835d-0ea649bff11f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:37.387223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5e1fbb8-2072-487a-835d-0ea649bff11f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:37.589570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f5e1fbb8-2072-487a-835d-0ea649bff11f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:37.598399 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f5e1fbb8-2072-487a-835d-0ea649bff11f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1515 microversion: 2.1 time: 0.226698 Aug 18 12:27:37.599042 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3935/6589] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:37 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:37.951096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-72712d67-fd27-452f-a363-280f458eb5b9 req-87454b0e-8e90-43b3-a1ed-769b6526433f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61c97bb0-776f-4e59-97db-d3f92910a02f", "tag": "e65a500b-96bd-4875-a48a-bed6dd2224a7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:37.961549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-72712d67-fd27-452f-a363-280f458eb5b9 req-87454b0e-8e90-43b3-a1ed-769b6526433f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:37.962059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-72712d67-fd27-452f-a363-280f458eb5b9 req-87454b0e-8e90-43b3-a1ed-769b6526433f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:37.962573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-72712d67-fd27-452f-a363-280f458eb5b9 req-87454b0e-8e90-43b3-a1ed-769b6526433f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:37.976703 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-72712d67-fd27-452f-a363-280f458eb5b9 req-87454b0e-8e90-43b3-a1ed-769b6526433f service nova] Creating event network-changed:e65a500b-96bd-4875-a48a-bed6dd2224a7 for instance 61c97bb0-776f-4e59-97db-d3f92910a02f on n-h1-853611-3 Aug 18 12:27:37.983660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-72712d67-fd27-452f-a363-280f458eb5b9 req-87454b0e-8e90-43b3-a1ed-769b6526433f service nova] Instance 61c97bb0-776f-4e59-97db-d3f92910a02f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:27:37.997159 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-72712d67-fd27-452f-a363-280f458eb5b9 req-87454b0e-8e90-43b3-a1ed-769b6526433f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050868 Aug 18 12:27:37.997837 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3936/6590] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:27:38.629738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ecc1512a-a1b3-47dc-8bed-a7aa68f24cb6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:38.634852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ecc1512a-a1b3-47dc-8bed-a7aa68f24cb6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:38.651532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecc1512a-a1b3-47dc-8bed-a7aa68f24cb6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:38.652603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecc1512a-a1b3-47dc-8bed-a7aa68f24cb6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:38.654022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecc1512a-a1b3-47dc-8bed-a7aa68f24cb6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:38.660371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecc1512a-a1b3-47dc-8bed-a7aa68f24cb6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:38.661538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecc1512a-a1b3-47dc-8bed-a7aa68f24cb6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:38.663310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ecc1512a-a1b3-47dc-8bed-a7aa68f24cb6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:38.965604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ecc1512a-a1b3-47dc-8bed-a7aa68f24cb6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:38.982185 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ecc1512a-a1b3-47dc-8bed-a7aa68f24cb6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1515 microversion: 2.1 time: 0.362662 Aug 18 12:27:38.983358 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3937/6591] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:38 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1515 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:40.004786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-104f1a26-f74e-412f-af52-e09d9be43453 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:40.005577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-104f1a26-f74e-412f-af52-e09d9be43453 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:40.013310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-104f1a26-f74e-412f-af52-e09d9be43453 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:40.013826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-104f1a26-f74e-412f-af52-e09d9be43453 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:40.014286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-104f1a26-f74e-412f-af52-e09d9be43453 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:40.015064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-104f1a26-f74e-412f-af52-e09d9be43453 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:40.015540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-104f1a26-f74e-412f-af52-e09d9be43453 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:40.016572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-104f1a26-f74e-412f-af52-e09d9be43453 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:40.190408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-104f1a26-f74e-412f-af52-e09d9be43453 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:40.199066 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-104f1a26-f74e-412f-af52-e09d9be43453 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1512 microversion: 2.1 time: 0.198662 Aug 18 12:27:40.199685 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3938/6592] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:39 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1512 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:40.222637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5748a52e-9659-449a-a161-fb6f0827ae70 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:40.223205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5748a52e-9659-449a-a161-fb6f0827ae70 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:40.229997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5748a52e-9659-449a-a161-fb6f0827ae70 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:40.230532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5748a52e-9659-449a-a161-fb6f0827ae70 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:40.230993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5748a52e-9659-449a-a161-fb6f0827ae70 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:40.231738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5748a52e-9659-449a-a161-fb6f0827ae70 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:40.232220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5748a52e-9659-449a-a161-fb6f0827ae70 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:40.232670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5748a52e-9659-449a-a161-fb6f0827ae70 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:40.291448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:40.305555 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5748a52e-9659-449a-a161-fb6f0827ae70 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "POST /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f/action" status: 204 len: 0 microversion: 2.1 time: 0.088081 Aug 18 12:27:40.306684 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3939/6593] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:27:40 2022] POST /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f/action => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:27:40.318360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d840fd15-ce4d-4381-acb1-8d33a4bff269 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:40.319667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d840fd15-ce4d-4381-acb1-8d33a4bff269 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:40.329937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d840fd15-ce4d-4381-acb1-8d33a4bff269 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:40.330881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d840fd15-ce4d-4381-acb1-8d33a4bff269 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:40.331713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d840fd15-ce4d-4381-acb1-8d33a4bff269 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:40.332673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d840fd15-ce4d-4381-acb1-8d33a4bff269 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:40.333342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d840fd15-ce4d-4381-acb1-8d33a4bff269 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:40.333950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d840fd15-ce4d-4381-acb1-8d33a4bff269 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:40.625005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d840fd15-ce4d-4381-acb1-8d33a4bff269 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:40.634844 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d840fd15-ce4d-4381-acb1-8d33a4bff269 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1512 microversion: 2.1 time: 0.323243 Aug 18 12:27:40.635459 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3940/6594] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:40 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:41.658682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8ae59df0-2bd4-40c5-b0ca-82f1182ab053 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:41.659742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8ae59df0-2bd4-40c5-b0ca-82f1182ab053 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:41.667888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ae59df0-2bd4-40c5-b0ca-82f1182ab053 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:41.668522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ae59df0-2bd4-40c5-b0ca-82f1182ab053 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:41.669113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ae59df0-2bd4-40c5-b0ca-82f1182ab053 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:41.669988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ae59df0-2bd4-40c5-b0ca-82f1182ab053 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:41.670832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ae59df0-2bd4-40c5-b0ca-82f1182ab053 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:41.671528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ae59df0-2bd4-40c5-b0ca-82f1182ab053 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:41.841825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8ae59df0-2bd4-40c5-b0ca-82f1182ab053 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:41.854519 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8ae59df0-2bd4-40c5-b0ca-82f1182ab053 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1512 microversion: 2.1 time: 0.200473 Aug 18 12:27:41.860307 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3941/6595] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:41 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:42.884925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f38c1b1f-f539-4197-804e-8f6f60e157fc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:42.885612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f38c1b1f-f539-4197-804e-8f6f60e157fc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:42.892880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f38c1b1f-f539-4197-804e-8f6f60e157fc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:42.893384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f38c1b1f-f539-4197-804e-8f6f60e157fc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:42.893840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f38c1b1f-f539-4197-804e-8f6f60e157fc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:42.894640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f38c1b1f-f539-4197-804e-8f6f60e157fc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:42.895138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f38c1b1f-f539-4197-804e-8f6f60e157fc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:42.895581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f38c1b1f-f539-4197-804e-8f6f60e157fc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.093083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f38c1b1f-f539-4197-804e-8f6f60e157fc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:43.102975 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f38c1b1f-f539-4197-804e-8f6f60e157fc tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1504 microversion: 2.1 time: 0.222017 Aug 18 12:27:43.103845 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3942/6596] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:42 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:43.135947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-799fbd9d-2441-419d-898d-b85bcf9e41e4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:43.136930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-799fbd9d-2441-419d-898d-b85bcf9e41e4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:43.144346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-799fbd9d-2441-419d-898d-b85bcf9e41e4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.144861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-799fbd9d-2441-419d-898d-b85bcf9e41e4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.145330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-799fbd9d-2441-419d-898d-b85bcf9e41e4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.146124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-799fbd9d-2441-419d-898d-b85bcf9e41e4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.146645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-799fbd9d-2441-419d-898d-b85bcf9e41e4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.147096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-799fbd9d-2441-419d-898d-b85bcf9e41e4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.361615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-799fbd9d-2441-419d-898d-b85bcf9e41e4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:43.370075 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-799fbd9d-2441-419d-898d-b85bcf9e41e4 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1504 microversion: 2.1 time: 0.249221 Aug 18 12:27:43.370726 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3943/6597] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:43 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:43.375626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c136195f-64a6-49ce-8421-f918b0391215 req-ae3b2530-d80e-4034-8241-eaa6ee87ef25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c97bb0-776f-4e59-97db-d3f92910a02f", "name": "network-vif-plugged", "status": "completed", "tag": "e65a500b-96bd-4875-a48a-bed6dd2224a7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:43.386094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c136195f-64a6-49ce-8421-f918b0391215 req-ae3b2530-d80e-4034-8241-eaa6ee87ef25 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.386540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c136195f-64a6-49ce-8421-f918b0391215 req-ae3b2530-d80e-4034-8241-eaa6ee87ef25 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.386954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c136195f-64a6-49ce-8421-f918b0391215 req-ae3b2530-d80e-4034-8241-eaa6ee87ef25 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.400055 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c136195f-64a6-49ce-8421-f918b0391215 req-ae3b2530-d80e-4034-8241-eaa6ee87ef25 service nova] Creating event network-vif-plugged:e65a500b-96bd-4875-a48a-bed6dd2224a7 for instance 61c97bb0-776f-4e59-97db-d3f92910a02f on n-h1-853611-3 Aug 18 12:27:43.405638 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c136195f-64a6-49ce-8421-f918b0391215 req-ae3b2530-d80e-4034-8241-eaa6ee87ef25 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033642 Aug 18 12:27:43.406263 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3944/6598] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:27:43.412306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03eae0de-58c3-4228-9906-9bf0c31458f6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:43.413026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-03eae0de-58c3-4228-9906-9bf0c31458f6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:43.419821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03eae0de-58c3-4228-9906-9bf0c31458f6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.420325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03eae0de-58c3-4228-9906-9bf0c31458f6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.420774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03eae0de-58c3-4228-9906-9bf0c31458f6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.421505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03eae0de-58c3-4228-9906-9bf0c31458f6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.422006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03eae0de-58c3-4228-9906-9bf0c31458f6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.422993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03eae0de-58c3-4228-9906-9bf0c31458f6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.585231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-03eae0de-58c3-4228-9906-9bf0c31458f6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:43.594084 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-03eae0de-58c3-4228-9906-9bf0c31458f6 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1504 microversion: 2.1 time: 0.185770 Aug 18 12:27:43.595482 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3945/6599] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:43 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:43.617722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b22fe2fd-7e6e-404d-8526-b479393746ea tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:43.618037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b22fe2fd-7e6e-404d-8526-b479393746ea tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:43.624769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b22fe2fd-7e6e-404d-8526-b479393746ea tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.625406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b22fe2fd-7e6e-404d-8526-b479393746ea tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.625880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b22fe2fd-7e6e-404d-8526-b479393746ea tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.626726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b22fe2fd-7e6e-404d-8526-b479393746ea tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.627196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b22fe2fd-7e6e-404d-8526-b479393746ea tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.627640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b22fe2fd-7e6e-404d-8526-b479393746ea tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.659267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b22fe2fd-7e6e-404d-8526-b479393746ea tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:27:43.756315 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b22fe2fd-7e6e-404d-8526-b479393746ea tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "DELETE /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 204 len: 0 microversion: 2.1 time: 0.141933 Aug 18 12:27:43.757641 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3946/6600] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:27:43 2022] DELETE /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:27:43.779004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-64b593bb-3991-4bc1-9a71-fb9bffe6852a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:43.779956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-64b593bb-3991-4bc1-9a71-fb9bffe6852a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:43.788058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64b593bb-3991-4bc1-9a71-fb9bffe6852a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.788550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64b593bb-3991-4bc1-9a71-fb9bffe6852a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.788995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64b593bb-3991-4bc1-9a71-fb9bffe6852a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.789716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64b593bb-3991-4bc1-9a71-fb9bffe6852a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.790176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64b593bb-3991-4bc1-9a71-fb9bffe6852a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.790639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64b593bb-3991-4bc1-9a71-fb9bffe6852a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.821830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-64b593bb-3991-4bc1-9a71-fb9bffe6852a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:27:43.876992 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.compute.api [None req-64b593bb-3991-4bc1-9a71-fb9bffe6852a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Instance is already in deleting state, ignoring this request Aug 18 12:27:43.877916 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-64b593bb-3991-4bc1-9a71-fb9bffe6852a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "DELETE /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 204 len: 0 microversion: 2.1 time: 0.104715 Aug 18 12:27:43.878610 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3947/6601] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:27:43 2022] DELETE /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:27:43.893557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b60543b-9b56-42ad-981c-e99f09ad2ca8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:43.894890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9b60543b-9b56-42ad-981c-e99f09ad2ca8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:43.909173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b60543b-9b56-42ad-981c-e99f09ad2ca8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.910174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b60543b-9b56-42ad-981c-e99f09ad2ca8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.911015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b60543b-9b56-42ad-981c-e99f09ad2ca8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:43.912381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b60543b-9b56-42ad-981c-e99f09ad2ca8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:43.913332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b60543b-9b56-42ad-981c-e99f09ad2ca8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:43.914228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b60543b-9b56-42ad-981c-e99f09ad2ca8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:44.115472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9b60543b-9b56-42ad-981c-e99f09ad2ca8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:44.130680 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b60543b-9b56-42ad-981c-e99f09ad2ca8 tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1510 microversion: 2.1 time: 0.244628 Aug 18 12:27:44.131811 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3948/6602] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:43 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:27:45.153413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-399ac00b-b73a-404a-96d7-cbe0e479811a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:45.154339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-399ac00b-b73a-404a-96d7-cbe0e479811a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:45.162302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-399ac00b-b73a-404a-96d7-cbe0e479811a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:45.162856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-399ac00b-b73a-404a-96d7-cbe0e479811a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:45.163320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-399ac00b-b73a-404a-96d7-cbe0e479811a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:45.164066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-399ac00b-b73a-404a-96d7-cbe0e479811a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:45.164543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-399ac00b-b73a-404a-96d7-cbe0e479811a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:45.164990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-399ac00b-b73a-404a-96d7-cbe0e479811a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:45.401487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-399ac00b-b73a-404a-96d7-cbe0e479811a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eba94395015468b9bfcdef7918cc44f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f12a6bd5769b48c884369327c40e3d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:27:45.411117 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-399ac00b-b73a-404a-96d7-cbe0e479811a tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 200 len: 1510 microversion: 2.1 time: 0.261555 Aug 18 12:27:45.411743 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3949/6603] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:45 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:27:45.662281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d4e3f178-bf0e-4793-ad0b-62226ccffac5 req-6ff83df0-3914-4044-bab3-49b9ccc2694e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c97bb0-776f-4e59-97db-d3f92910a02f", "name": "network-vif-deleted", "tag": "e65a500b-96bd-4875-a48a-bed6dd2224a7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:45.701279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d4e3f178-bf0e-4793-ad0b-62226ccffac5 req-6ff83df0-3914-4044-bab3-49b9ccc2694e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:45.702040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d4e3f178-bf0e-4793-ad0b-62226ccffac5 req-6ff83df0-3914-4044-bab3-49b9ccc2694e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:45.703929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d4e3f178-bf0e-4793-ad0b-62226ccffac5 req-6ff83df0-3914-4044-bab3-49b9ccc2694e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:45.724175 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d4e3f178-bf0e-4793-ad0b-62226ccffac5 req-6ff83df0-3914-4044-bab3-49b9ccc2694e service nova] Creating event network-vif-deleted:e65a500b-96bd-4875-a48a-bed6dd2224a7 for instance 61c97bb0-776f-4e59-97db-d3f92910a02f on n-h1-853611-3 Aug 18 12:27:45.732067 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d4e3f178-bf0e-4793-ad0b-62226ccffac5 req-6ff83df0-3914-4044-bab3-49b9ccc2694e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073584 Aug 18 12:27:45.732791 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3950/6604] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:27:46.440430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03f78bb0-c8bd-4f3e-852f-acc921ce67da tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:46.441560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-03f78bb0-c8bd-4f3e-852f-acc921ce67da tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 61c97bb0-776f-4e59-97db-d3f92910a02f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:46.455474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03f78bb0-c8bd-4f3e-852f-acc921ce67da tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:46.456356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03f78bb0-c8bd-4f3e-852f-acc921ce67da tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:46.457121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03f78bb0-c8bd-4f3e-852f-acc921ce67da tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:46.458295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03f78bb0-c8bd-4f3e-852f-acc921ce67da tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:46.459146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03f78bb0-c8bd-4f3e-852f-acc921ce67da tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:46.459935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03f78bb0-c8bd-4f3e-852f-acc921ce67da tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:46.479031 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-03f78bb0-c8bd-4f3e-852f-acc921ce67da tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] HTTP exception thrown: Instance 61c97bb0-776f-4e59-97db-d3f92910a02f could not be found. Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03f78bb0-c8bd-4f3e-852f-acc921ce67da tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Request method failure captured: Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f HTTP/1.1 Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_i_bynOlXRk1O7-Btz_bOJbqIB1XHC_rCHOHc2Kq-R2B_EKsU8UN2Hp0BworXfSvdyNvJuv8Y5AzxxzR41ZjhvizxYV5BYxs6zG2jPYNIvXMhZPiEYOiYOkciPZpRzl6SsWoe2rQ_9NnHs50p9HYJZZ54-B-01QCV7AeZHosInESKbA Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f12a6bd5769b48c884369327c40e3d74 Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1740773654 Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f12a6bd5769b48c884369327c40e3d74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f12a6bd5769b48c884369327c40e3d74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f12a6bd5769b48c884369327c40e3d74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f12a6bd5769b48c884369327c40e3d74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerDiskConfigTestJSON-1740773654 Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f12a6bd5769b48c884369327c40e3d74 Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1740773654 Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerDiskConfigTestJSON-1740773654-project Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 8eba94395015468b9bfcdef7918cc44f Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerDiskConfigTestJSON-1740773654-project Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 61c97bb0-776f-4e59-97db-d3f92910a02f could not be found. Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '61c97bb0-776f-4e59-97db-d3f92910a02f'} Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c97bb0-776f-4e59-97db-d3f92910a02f could not be found. Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c97bb0-776f-4e59-97db-d3f92910a02f could not be found. Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:27:46.480765 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:46.489385 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:27:46.489385 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:27:46.489385 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:27:46.489385 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:27:46.489385 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:27:46.489385 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c97bb0-776f-4e59-97db-d3f92910a02f could not be found. Aug 18 12:27:46.489385 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:46.489385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03f78bb0-c8bd-4f3e-852f-acc921ce67da tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Returning 404 to user: Instance 61c97bb0-776f-4e59-97db-d3f92910a02f could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:27:46.489385 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-03f78bb0-c8bd-4f3e-852f-acc921ce67da tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f" status: 404 len: 111 microversion: 2.1 time: 0.052399 Aug 18 12:27:46.489385 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3951/6605] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:46 2022] GET /compute/v2.1/servers/61c97bb0-776f-4e59-97db-d3f92910a02f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:27:46.492608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8ec44fde-0608-4be0-9602-54bd2832b01b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '.version_select at 0x7f519f8805e0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:46.516370 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8ec44fde-0608-4be0-9602-54bd2832b01b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185349146" status: 202 len: 0 microversion: 2.1 time: 0.027054 Aug 18 12:27:46.517393 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3952/6606] 10.222.0.73 () {58 vars in 1221 bytes} [Thu Aug 18 12:27:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1185349146 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:27:47.301759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8664bb26-a8f0-4a02-930c-9d05908d408b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:47.302325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8664bb26-a8f0-4a02-930c-9d05908d408b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:47.313187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8664bb26-a8f0-4a02-930c-9d05908d408b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:47.313703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8664bb26-a8f0-4a02-930c-9d05908d408b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:47.314163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8664bb26-a8f0-4a02-930c-9d05908d408b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:47.314947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8664bb26-a8f0-4a02-930c-9d05908d408b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:47.315416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8664bb26-a8f0-4a02-930c-9d05908d408b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:47.315858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8664bb26-a8f0-4a02-930c-9d05908d408b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:47.332189 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-8664bb26-a8f0-4a02-930c-9d05908d408b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] HTTP exception thrown: Instance 88296fcb-b862-41bb-91da-80c8491bd52f could not be found. Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8664bb26-a8f0-4a02-930c-9d05908d408b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Request method failure captured: Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f HTTP/1.1 Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_i_bynOlXRk1O7-Btz_bOJbqIB1XHC_rCHOHc2Kq-R2B_EKsU8UN2Hp0BworXfSvdyNvJuv8Y5AzxxzR41ZjhvizxYV5BYxs6zG2jPYNIvXMhZPiEYOiYOkciPZpRzl6SsWoe2rQ_9NnHs50p9HYJZZ54-B-01QCV7AeZHosInESKbA Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f12a6bd5769b48c884369327c40e3d74 Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1740773654 Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f12a6bd5769b48c884369327c40e3d74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f12a6bd5769b48c884369327c40e3d74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f12a6bd5769b48c884369327c40e3d74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f12a6bd5769b48c884369327c40e3d74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerDiskConfigTestJSON-1740773654 Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f12a6bd5769b48c884369327c40e3d74 Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1740773654 Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerDiskConfigTestJSON-1740773654-project Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 8eba94395015468b9bfcdef7918cc44f Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerDiskConfigTestJSON-1740773654-project Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 88296fcb-b862-41bb-91da-80c8491bd52f could not be found. Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '88296fcb-b862-41bb-91da-80c8491bd52f'} Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88296fcb-b862-41bb-91da-80c8491bd52f could not be found. Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:27:47.333940 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88296fcb-b862-41bb-91da-80c8491bd52f could not be found. Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88296fcb-b862-41bb-91da-80c8491bd52f could not be found. Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8664bb26-a8f0-4a02-930c-9d05908d408b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Returning 404 to user: Instance 88296fcb-b862-41bb-91da-80c8491bd52f could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8664bb26-a8f0-4a02-930c-9d05908d408b tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "DELETE /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 404 len: 111 microversion: 2.1 time: 0.039143 Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3953/6607] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:27:47 2022] DELETE /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-345d128a-1bca-49fa-9e5a-c983d2a17e0f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:27:47.350717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-345d128a-1bca-49fa-9e5a-c983d2a17e0f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] [instance: 88296fcb-b862-41bb-91da-80c8491bd52f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:27:47.355484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-345d128a-1bca-49fa-9e5a-c983d2a17e0f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:47.355987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-345d128a-1bca-49fa-9e5a-c983d2a17e0f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:47.356439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-345d128a-1bca-49fa-9e5a-c983d2a17e0f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:47.357157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-345d128a-1bca-49fa-9e5a-c983d2a17e0f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:27:47.357621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-345d128a-1bca-49fa-9e5a-c983d2a17e0f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:27:47.358055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-345d128a-1bca-49fa-9e5a-c983d2a17e0f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:27:47.372913 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-345d128a-1bca-49fa-9e5a-c983d2a17e0f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] HTTP exception thrown: Instance 88296fcb-b862-41bb-91da-80c8491bd52f could not be found. Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-345d128a-1bca-49fa-9e5a-c983d2a17e0f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Request method failure captured: Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f HTTP/1.1 Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_i_bynOlXRk1O7-Btz_bOJbqIB1XHC_rCHOHc2Kq-R2B_EKsU8UN2Hp0BworXfSvdyNvJuv8Y5AzxxzR41ZjhvizxYV5BYxs6zG2jPYNIvXMhZPiEYOiYOkciPZpRzl6SsWoe2rQ_9NnHs50p9HYJZZ54-B-01QCV7AeZHosInESKbA Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: f12a6bd5769b48c884369327c40e3d74 Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1740773654 Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f12a6bd5769b48c884369327c40e3d74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f12a6bd5769b48c884369327c40e3d74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f12a6bd5769b48c884369327c40e3d74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f12a6bd5769b48c884369327c40e3d74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerDiskConfigTestJSON-1740773654 Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: f12a6bd5769b48c884369327c40e3d74 Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1740773654 Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerDiskConfigTestJSON-1740773654-project Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 8eba94395015468b9bfcdef7918cc44f Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerDiskConfigTestJSON-1740773654-project Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 88296fcb-b862-41bb-91da-80c8491bd52f could not be found. Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '88296fcb-b862-41bb-91da-80c8491bd52f'} Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88296fcb-b862-41bb-91da-80c8491bd52f could not be found. Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88296fcb-b862-41bb-91da-80c8491bd52f could not be found. Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:27:47.374642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:47.383220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:27:47.383220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:27:47.383220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:27:47.383220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:27:47.383220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:27:47.383220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88296fcb-b862-41bb-91da-80c8491bd52f could not be found. Aug 18 12:27:47.383220 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:27:47.383220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-345d128a-1bca-49fa-9e5a-c983d2a17e0f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] Returning 404 to user: Instance 88296fcb-b862-41bb-91da-80c8491bd52f could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:27:47.383220 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-345d128a-1bca-49fa-9e5a-c983d2a17e0f tempest-ServerDiskConfigTestJSON-1740773654 tempest-ServerDiskConfigTestJSON-1740773654-project] 10.222.0.73 "GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f" status: 404 len: 111 microversion: 2.1 time: 0.033334 Aug 18 12:27:47.383220 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3954/6608] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:27:47 2022] GET /compute/v2.1/servers/88296fcb-b862-41bb-91da-80c8491bd52f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:27:59.033689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:59.035554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:27:59.218512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-962acd42-6f3c-4d59-ba71-324a3585b106 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'create', calling method: .version_select at 0x7f519efeb3a0>, body: {"keypair": {"name": "tempest-keypair-128691123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7Iwh6Q0KmHN4OcZfxj2qyvZQUWGML0gQg4ILSTcxZeSLVERX6DCaBdbz5uFh7yKiuN/OIwVYp3JvBUBP2oXqXJVbhkiu5DbpI3AHveexL5td9RBhBzZEY7eIuPD2yZ+A=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:27:59.253206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-962acd42-6f3c-4d59-ba71-324a3585b106 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Getting quotas for project 52c152e60a4d4bce86773ea6a2e25fc4. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:27:59.264627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-962acd42-6f3c-4d59-ba71-324a3585b106 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Getting quotas for user 6da9f8c739314b6a842c84bf71786f78 and project 52c152e60a4d4bce86773ea6a2e25fc4. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:27:59.321080 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-962acd42-6f3c-4d59-ba71-324a3585b106 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.294410 Aug 18 12:27:59.322534 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3955/6609] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:27:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:28:01.041378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-232267633", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "223e769f-74d3-491d-9f22-cb5f7423c3de"}], "security_groups": [{"name": "tempest-securitygroup--514773839"}], "key_name": "tempest-keypair-128691123", "user_data": "}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:28:01.165818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] validate_networks() for [('223e769f-74d3-491d-9f22-cb5f7423c3de', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:28:01.842578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:28:01.843499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:28:01.845555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:28:01.846254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:28:01.846900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:28:01.859101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:01.861088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:01.861689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:01.862642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:01.863238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:01.863787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:01.885049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Getting quotas for project 52c152e60a4d4bce86773ea6a2e25fc4. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:28:01.894161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Getting quotas for user 6da9f8c739314b6a842c84bf71786f78 and project 52c152e60a4d4bce86773ea6a2e25fc4. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:28:01.918378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:28:01.924073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:28:02.001684 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b0c658ac-f1f0-4dc3-8148-6fd2930226bd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.963868 Aug 18 12:28:02.002831 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3956/6610] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:28:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:28:02.015407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4676a3b7-2d52-4dd3-9045-efd22694ad56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:02.016838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4676a3b7-2d52-4dd3-9045-efd22694ad56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:02.119987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4676a3b7-2d52-4dd3-9045-efd22694ad56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:02.135109 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4676a3b7-2d52-4dd3-9045-efd22694ad56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1237 microversion: 2.1 time: 0.124149 Aug 18 12:28:02.142698 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3957/6611] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:02 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1237 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:03.159631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1f175f88-99f9-4e89-b1f3-79c6a7703dff tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:03.160645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1f175f88-99f9-4e89-b1f3-79c6a7703dff tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:03.176179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f175f88-99f9-4e89-b1f3-79c6a7703dff tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:03.176979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f175f88-99f9-4e89-b1f3-79c6a7703dff tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:03.177721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f175f88-99f9-4e89-b1f3-79c6a7703dff tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:03.179124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f175f88-99f9-4e89-b1f3-79c6a7703dff tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:03.180236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f175f88-99f9-4e89-b1f3-79c6a7703dff tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:03.181008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f175f88-99f9-4e89-b1f3-79c6a7703dff tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:03.393138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1f175f88-99f9-4e89-b1f3-79c6a7703dff tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:03.424639 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1f175f88-99f9-4e89-b1f3-79c6a7703dff tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1289 microversion: 2.1 time: 0.270631 Aug 18 12:28:03.428428 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3958/6612] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:03 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1289 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:04.463055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-56da098a-c28a-4919-bada-2121099efbee tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:04.464753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-56da098a-c28a-4919-bada-2121099efbee tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:04.481847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56da098a-c28a-4919-bada-2121099efbee tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:04.483419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56da098a-c28a-4919-bada-2121099efbee tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:04.486138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56da098a-c28a-4919-bada-2121099efbee tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:04.487766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56da098a-c28a-4919-bada-2121099efbee tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:04.488764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56da098a-c28a-4919-bada-2121099efbee tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:04.489780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56da098a-c28a-4919-bada-2121099efbee tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:05.397143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-56da098a-c28a-4919-bada-2121099efbee tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:05.410382 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-56da098a-c28a-4919-bada-2121099efbee tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1362 microversion: 2.1 time: 0.954450 Aug 18 12:28:05.411795 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3959/6613] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:04 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1362 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:05.956952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-0825393b-8fff-4408-be41-ce8c4f498651 req-156a0a96-06e6-4302-afb7-527b3a3fd43d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd70be6-b296-4aed-8ce7-b873c0267aba", "tag": "0bc54021-4402-4e3a-9ed6-59196001bd33"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:28:05.975726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0825393b-8fff-4408-be41-ce8c4f498651 req-156a0a96-06e6-4302-afb7-527b3a3fd43d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:05.976970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0825393b-8fff-4408-be41-ce8c4f498651 req-156a0a96-06e6-4302-afb7-527b3a3fd43d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:05.978084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0825393b-8fff-4408-be41-ce8c4f498651 req-156a0a96-06e6-4302-afb7-527b3a3fd43d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:05.998824 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-0825393b-8fff-4408-be41-ce8c4f498651 req-156a0a96-06e6-4302-afb7-527b3a3fd43d service nova] Creating event network-changed:0bc54021-4402-4e3a-9ed6-59196001bd33 for instance 5cd70be6-b296-4aed-8ce7-b873c0267aba on n-h2-853611-3 Aug 18 12:28:06.007972 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-0825393b-8fff-4408-be41-ce8c4f498651 req-156a0a96-06e6-4302-afb7-527b3a3fd43d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057496 Aug 18 12:28:06.009691 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3960/6614] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:28:06.447930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d668ccd3-f524-4ae6-83f4-9288cf540535 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:06.449040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d668ccd3-f524-4ae6-83f4-9288cf540535 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:06.457022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d668ccd3-f524-4ae6-83f4-9288cf540535 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:06.457699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d668ccd3-f524-4ae6-83f4-9288cf540535 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:06.458167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d668ccd3-f524-4ae6-83f4-9288cf540535 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:06.459365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d668ccd3-f524-4ae6-83f4-9288cf540535 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:06.459984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d668ccd3-f524-4ae6-83f4-9288cf540535 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:06.460427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d668ccd3-f524-4ae6-83f4-9288cf540535 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:06.720316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d668ccd3-f524-4ae6-83f4-9288cf540535 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:06.728869 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d668ccd3-f524-4ae6-83f4-9288cf540535 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1362 microversion: 2.1 time: 0.286816 Aug 18 12:28:06.729487 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3961/6615] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:06 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:07.753946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-48cda96f-6a74-4b49-98ed-2cda61816db7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:07.754747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-48cda96f-6a74-4b49-98ed-2cda61816db7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:07.763325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48cda96f-6a74-4b49-98ed-2cda61816db7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:07.763844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48cda96f-6a74-4b49-98ed-2cda61816db7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:07.764328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48cda96f-6a74-4b49-98ed-2cda61816db7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:07.765275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48cda96f-6a74-4b49-98ed-2cda61816db7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:07.767076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48cda96f-6a74-4b49-98ed-2cda61816db7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:07.767556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48cda96f-6a74-4b49-98ed-2cda61816db7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:08.154360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-48cda96f-6a74-4b49-98ed-2cda61816db7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:08.165982 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-48cda96f-6a74-4b49-98ed-2cda61816db7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1362 microversion: 2.1 time: 0.419207 Aug 18 12:28:08.166639 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3962/6616] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:07 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1362 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:09.190010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df7770dd-92fa-4f4f-b33f-34c59ef47afe tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:09.190958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df7770dd-92fa-4f4f-b33f-34c59ef47afe tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:09.198580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df7770dd-92fa-4f4f-b33f-34c59ef47afe tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:09.199094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df7770dd-92fa-4f4f-b33f-34c59ef47afe tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:09.199577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df7770dd-92fa-4f4f-b33f-34c59ef47afe tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:09.200294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df7770dd-92fa-4f4f-b33f-34c59ef47afe tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:09.201239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df7770dd-92fa-4f4f-b33f-34c59ef47afe tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:09.201239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df7770dd-92fa-4f4f-b33f-34c59ef47afe tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:09.349607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df7770dd-92fa-4f4f-b33f-34c59ef47afe tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:09.357594 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df7770dd-92fa-4f4f-b33f-34c59ef47afe tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1362 microversion: 2.1 time: 0.172028 Aug 18 12:28:09.358281 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3963/6617] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:09 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:10.380700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c4f9164f-a331-4a72-a6c4-e2c1964bf33e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:10.381353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c4f9164f-a331-4a72-a6c4-e2c1964bf33e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:10.389631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4f9164f-a331-4a72-a6c4-e2c1964bf33e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:10.390285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4f9164f-a331-4a72-a6c4-e2c1964bf33e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:10.390869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4f9164f-a331-4a72-a6c4-e2c1964bf33e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:10.391731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4f9164f-a331-4a72-a6c4-e2c1964bf33e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:10.392304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4f9164f-a331-4a72-a6c4-e2c1964bf33e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:10.392838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c4f9164f-a331-4a72-a6c4-e2c1964bf33e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:10.559680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c4f9164f-a331-4a72-a6c4-e2c1964bf33e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:10.569347 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c4f9164f-a331-4a72-a6c4-e2c1964bf33e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1362 microversion: 2.1 time: 0.193223 Aug 18 12:28:10.570008 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3964/6618] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:10 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:10.800075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4d50313d-ee55-4ee7-a3d1-943a276e89c8 req-abc82836-02cc-4787-8ff2-f4816a3bf550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd70be6-b296-4aed-8ce7-b873c0267aba", "name": "network-vif-plugged", "status": "completed", "tag": "0bc54021-4402-4e3a-9ed6-59196001bd33"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:28:10.810390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4d50313d-ee55-4ee7-a3d1-943a276e89c8 req-abc82836-02cc-4787-8ff2-f4816a3bf550 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:10.810929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4d50313d-ee55-4ee7-a3d1-943a276e89c8 req-abc82836-02cc-4787-8ff2-f4816a3bf550 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:10.811381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4d50313d-ee55-4ee7-a3d1-943a276e89c8 req-abc82836-02cc-4787-8ff2-f4816a3bf550 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:10.826171 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4d50313d-ee55-4ee7-a3d1-943a276e89c8 req-abc82836-02cc-4787-8ff2-f4816a3bf550 service nova] Creating event network-vif-plugged:0bc54021-4402-4e3a-9ed6-59196001bd33 for instance 5cd70be6-b296-4aed-8ce7-b873c0267aba on n-h2-853611-3 Aug 18 12:28:10.836756 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4d50313d-ee55-4ee7-a3d1-943a276e89c8 req-abc82836-02cc-4787-8ff2-f4816a3bf550 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041022 Aug 18 12:28:10.837416 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3965/6619] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:28:11.608910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3536d67d-eb85-4e93-888d-a46ceb3177ed tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:11.611184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3536d67d-eb85-4e93-888d-a46ceb3177ed tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:11.628083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3536d67d-eb85-4e93-888d-a46ceb3177ed tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:11.628988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3536d67d-eb85-4e93-888d-a46ceb3177ed tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:11.629821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3536d67d-eb85-4e93-888d-a46ceb3177ed tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:11.631675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3536d67d-eb85-4e93-888d-a46ceb3177ed tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:11.632645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3536d67d-eb85-4e93-888d-a46ceb3177ed tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:11.633521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3536d67d-eb85-4e93-888d-a46ceb3177ed tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:11.816892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3536d67d-eb85-4e93-888d-a46ceb3177ed tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:11.825563 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3536d67d-eb85-4e93-888d-a46ceb3177ed tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1362 microversion: 2.1 time: 0.224619 Aug 18 12:28:11.826223 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3966/6620] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:11 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:12.858770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b591601d-6cec-4ccc-9348-858979a9cdde tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:12.860750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b591601d-6cec-4ccc-9348-858979a9cdde tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:12.862095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:28:12.862854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:28:12.869923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b591601d-6cec-4ccc-9348-858979a9cdde tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:12.870448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b591601d-6cec-4ccc-9348-858979a9cdde tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:12.870934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b591601d-6cec-4ccc-9348-858979a9cdde tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:12.871666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b591601d-6cec-4ccc-9348-858979a9cdde tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:12.872135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b591601d-6cec-4ccc-9348-858979a9cdde tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:12.872573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b591601d-6cec-4ccc-9348-858979a9cdde tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:13.039644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b591601d-6cec-4ccc-9348-858979a9cdde tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:13.049521 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b591601d-6cec-4ccc-9348-858979a9cdde tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1548 microversion: 2.1 time: 0.194896 Aug 18 12:28:13.050156 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3967/6621] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:12 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1548 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:13.085618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fd59d399-9938-4a16-bcc9-c24e119dd5c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:13.086151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fd59d399-9938-4a16-bcc9-c24e119dd5c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:13.092993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd59d399-9938-4a16-bcc9-c24e119dd5c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:13.093815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd59d399-9938-4a16-bcc9-c24e119dd5c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:13.094633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd59d399-9938-4a16-bcc9-c24e119dd5c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:13.095567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd59d399-9938-4a16-bcc9-c24e119dd5c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:13.096171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd59d399-9938-4a16-bcc9-c24e119dd5c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:13.096753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fd59d399-9938-4a16-bcc9-c24e119dd5c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:13.194019 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fd59d399-9938-4a16-bcc9-c24e119dd5c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112446 Aug 18 12:28:13.194666 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3968/6622] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 12:28:13 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:28:14.346020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f17770be-f805-4994-bd91-35b02ea7b2b2 req-7d9b67b6-c766-4599-ad8d-456afadd59a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd70be6-b296-4aed-8ce7-b873c0267aba", "tag": "0bc54021-4402-4e3a-9ed6-59196001bd33"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:28:14.362037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f17770be-f805-4994-bd91-35b02ea7b2b2 req-7d9b67b6-c766-4599-ad8d-456afadd59a8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:14.362568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f17770be-f805-4994-bd91-35b02ea7b2b2 req-7d9b67b6-c766-4599-ad8d-456afadd59a8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:14.363022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f17770be-f805-4994-bd91-35b02ea7b2b2 req-7d9b67b6-c766-4599-ad8d-456afadd59a8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:14.379287 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f17770be-f805-4994-bd91-35b02ea7b2b2 req-7d9b67b6-c766-4599-ad8d-456afadd59a8 service nova] Creating event network-changed:0bc54021-4402-4e3a-9ed6-59196001bd33 for instance 5cd70be6-b296-4aed-8ce7-b873c0267aba on n-h2-853611-3 Aug 18 12:28:14.384972 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f17770be-f805-4994-bd91-35b02ea7b2b2 req-7d9b67b6-c766-4599-ad8d-456afadd59a8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048192 Aug 18 12:28:14.385653 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3969/6623] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:28:20.142191 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:28:20.143170 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:28:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:28:36.726804 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:28:36.727956 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:28:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:28:48.593140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:28:48.595064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=60 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:28:48.599371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d60ae2e-dc3c-48db-b969-8af36465557b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:48.600306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9d60ae2e-dc3c-48db-b969-8af36465557b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:48.608295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d60ae2e-dc3c-48db-b969-8af36465557b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:48.609842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d60ae2e-dc3c-48db-b969-8af36465557b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:48.610556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d60ae2e-dc3c-48db-b969-8af36465557b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:48.611364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d60ae2e-dc3c-48db-b969-8af36465557b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:48.611901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d60ae2e-dc3c-48db-b969-8af36465557b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:48.612393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d60ae2e-dc3c-48db-b969-8af36465557b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:48.855573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9d60ae2e-dc3c-48db-b969-8af36465557b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:48.864436 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9d60ae2e-dc3c-48db-b969-8af36465557b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1666 microversion: 2.1 time: 0.273430 Aug 18 12:28:48.865114 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3970/6624] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:48 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1666 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:48.886819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d85b5466-a01a-4e8f-8c43-656c0b4e86f5 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:48.887701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d85b5466-a01a-4e8f-8c43-656c0b4e86f5 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:48.895862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d85b5466-a01a-4e8f-8c43-656c0b4e86f5 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:48.896508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d85b5466-a01a-4e8f-8c43-656c0b4e86f5 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:48.897012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d85b5466-a01a-4e8f-8c43-656c0b4e86f5 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:48.897915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d85b5466-a01a-4e8f-8c43-656c0b4e86f5 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:48.898561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d85b5466-a01a-4e8f-8c43-656c0b4e86f5 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:48.899046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d85b5466-a01a-4e8f-8c43-656c0b4e86f5 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:49.081010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d85b5466-a01a-4e8f-8c43-656c0b4e86f5 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:49.089295 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d85b5466-a01a-4e8f-8c43-656c0b4e86f5 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1666 microversion: 2.1 time: 0.206614 Aug 18 12:28:49.089985 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3971/6625] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:48 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1666 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:28:49.112961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-50095378-cc92-49a7-a3b9-1a5a59a569d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:49.113519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-50095378-cc92-49a7-a3b9-1a5a59a569d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:49.120117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50095378-cc92-49a7-a3b9-1a5a59a569d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:49.120795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50095378-cc92-49a7-a3b9-1a5a59a569d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:49.121321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50095378-cc92-49a7-a3b9-1a5a59a569d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:49.122124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50095378-cc92-49a7-a3b9-1a5a59a569d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:49.122718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50095378-cc92-49a7-a3b9-1a5a59a569d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:49.123217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50095378-cc92-49a7-a3b9-1a5a59a569d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:49.282698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-50095378-cc92-49a7-a3b9-1a5a59a569d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:49.291669 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-50095378-cc92-49a7-a3b9-1a5a59a569d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1666 microversion: 2.1 time: 0.183568 Aug 18 12:28:49.292292 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3972/6626] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:49 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1666 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:49.314498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:28:49.316956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:49.323959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:49.324536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:49.325053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:49.325859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:49.326454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:49.326965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:49.366723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:49.373649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Old instance type m1.heat2, new instance type m1.heat {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 12:28:49.382032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:28:49.382450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:28:49.382951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:28:49.383385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:28:49.383816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:28:49.461956 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-68f47783-96c7-4842-985e-7efc4823b6c9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba/action" status: 202 len: 0 microversion: 2.1 time: 0.152791 Aug 18 12:28:49.462812 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3973/6627] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:28:49 2022] POST /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:28:49.472953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cb1cfd68-f199-4111-bba5-a6daff98af72 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:49.473541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cb1cfd68-f199-4111-bba5-a6daff98af72 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:49.480242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb1cfd68-f199-4111-bba5-a6daff98af72 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:49.480773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb1cfd68-f199-4111-bba5-a6daff98af72 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:49.481243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb1cfd68-f199-4111-bba5-a6daff98af72 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:49.482008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb1cfd68-f199-4111-bba5-a6daff98af72 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:49.483257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb1cfd68-f199-4111-bba5-a6daff98af72 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:49.483257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb1cfd68-f199-4111-bba5-a6daff98af72 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:49.704230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cb1cfd68-f199-4111-bba5-a6daff98af72 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:49.713422 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cb1cfd68-f199-4111-bba5-a6daff98af72 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1675 microversion: 2.1 time: 0.245780 Aug 18 12:28:49.714181 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3974/6628] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:49 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1675 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:50.738414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-943eeaeb-ae85-4a3b-b778-31b32834f374 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:50.739192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-943eeaeb-ae85-4a3b-b778-31b32834f374 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:50.746446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-943eeaeb-ae85-4a3b-b778-31b32834f374 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:50.746987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-943eeaeb-ae85-4a3b-b778-31b32834f374 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:50.747454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-943eeaeb-ae85-4a3b-b778-31b32834f374 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:50.748197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-943eeaeb-ae85-4a3b-b778-31b32834f374 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:50.748670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-943eeaeb-ae85-4a3b-b778-31b32834f374 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:50.749119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-943eeaeb-ae85-4a3b-b778-31b32834f374 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:50.900485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-943eeaeb-ae85-4a3b-b778-31b32834f374 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:50.911561 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-943eeaeb-ae85-4a3b-b778-31b32834f374 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1675 microversion: 2.1 time: 0.177724 Aug 18 12:28:50.914523 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3975/6629] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:50 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:51.937671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6cdfba50-cf48-4473-8bcd-0891a5f28a71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:51.938926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6cdfba50-cf48-4473-8bcd-0891a5f28a71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:51.949104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cdfba50-cf48-4473-8bcd-0891a5f28a71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:51.949665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cdfba50-cf48-4473-8bcd-0891a5f28a71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:51.950172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cdfba50-cf48-4473-8bcd-0891a5f28a71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:51.951430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cdfba50-cf48-4473-8bcd-0891a5f28a71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:51.952063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cdfba50-cf48-4473-8bcd-0891a5f28a71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:51.953571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6cdfba50-cf48-4473-8bcd-0891a5f28a71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:52.132021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6cdfba50-cf48-4473-8bcd-0891a5f28a71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:52.140744 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6cdfba50-cf48-4473-8bcd-0891a5f28a71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1680 microversion: 2.1 time: 0.208789 Aug 18 12:28:52.141531 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3976/6630] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:51 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:53.177803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e9edbaf-6946-4c89-92e9-7624ba4dfa2a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:53.178929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e9edbaf-6946-4c89-92e9-7624ba4dfa2a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:53.186340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e9edbaf-6946-4c89-92e9-7624ba4dfa2a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:53.187637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e9edbaf-6946-4c89-92e9-7624ba4dfa2a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:53.188768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e9edbaf-6946-4c89-92e9-7624ba4dfa2a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:53.189457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e9edbaf-6946-4c89-92e9-7624ba4dfa2a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:53.190046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e9edbaf-6946-4c89-92e9-7624ba4dfa2a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:53.190638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e9edbaf-6946-4c89-92e9-7624ba4dfa2a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:53.375595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e9edbaf-6946-4c89-92e9-7624ba4dfa2a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:53.384211 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e9edbaf-6946-4c89-92e9-7624ba4dfa2a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1680 microversion: 2.1 time: 0.211766 Aug 18 12:28:53.384817 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3977/6631] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:53 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1680 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:54.412642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-133a1964-add3-43b2-8a66-bbeceb29bd09 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:54.413336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-133a1964-add3-43b2-8a66-bbeceb29bd09 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:54.420979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-133a1964-add3-43b2-8a66-bbeceb29bd09 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:54.421557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-133a1964-add3-43b2-8a66-bbeceb29bd09 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:54.422385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-133a1964-add3-43b2-8a66-bbeceb29bd09 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:54.422808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-133a1964-add3-43b2-8a66-bbeceb29bd09 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:54.423277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-133a1964-add3-43b2-8a66-bbeceb29bd09 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:54.423719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-133a1964-add3-43b2-8a66-bbeceb29bd09 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:54.598872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-133a1964-add3-43b2-8a66-bbeceb29bd09 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:54.607644 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-133a1964-add3-43b2-8a66-bbeceb29bd09 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1680 microversion: 2.1 time: 0.199378 Aug 18 12:28:54.608438 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3978/6632] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:54 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:55.631685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5f773376-bd0f-4303-b008-ae5fbe2b5bbc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:55.632493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5f773376-bd0f-4303-b008-ae5fbe2b5bbc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:55.640038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f773376-bd0f-4303-b008-ae5fbe2b5bbc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:55.640559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f773376-bd0f-4303-b008-ae5fbe2b5bbc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:55.641021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f773376-bd0f-4303-b008-ae5fbe2b5bbc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:55.641770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f773376-bd0f-4303-b008-ae5fbe2b5bbc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:55.642290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f773376-bd0f-4303-b008-ae5fbe2b5bbc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:55.642764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f773376-bd0f-4303-b008-ae5fbe2b5bbc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:55.793460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5f773376-bd0f-4303-b008-ae5fbe2b5bbc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:55.803412 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5f773376-bd0f-4303-b008-ae5fbe2b5bbc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1680 microversion: 2.1 time: 0.175951 Aug 18 12:28:55.804166 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3979/6633] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:55 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:56.839254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a4fe7998-74ea-475e-9fb0-1710c06b9d96 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:56.840082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a4fe7998-74ea-475e-9fb0-1710c06b9d96 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:56.847850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4fe7998-74ea-475e-9fb0-1710c06b9d96 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:56.848363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4fe7998-74ea-475e-9fb0-1710c06b9d96 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:56.848819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4fe7998-74ea-475e-9fb0-1710c06b9d96 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:56.849566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4fe7998-74ea-475e-9fb0-1710c06b9d96 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:56.850038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4fe7998-74ea-475e-9fb0-1710c06b9d96 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:56.850511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a4fe7998-74ea-475e-9fb0-1710c06b9d96 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:57.006604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a4fe7998-74ea-475e-9fb0-1710c06b9d96 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:57.016175 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a4fe7998-74ea-475e-9fb0-1710c06b9d96 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1680 microversion: 2.1 time: 0.180022 Aug 18 12:28:57.016790 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3980/6634] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:56 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:58.039620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e6a22d75-58d4-48d2-91ed-beb7d24cb5b9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:58.040397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e6a22d75-58d4-48d2-91ed-beb7d24cb5b9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:58.048751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6a22d75-58d4-48d2-91ed-beb7d24cb5b9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:58.049260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6a22d75-58d4-48d2-91ed-beb7d24cb5b9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:58.049725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6a22d75-58d4-48d2-91ed-beb7d24cb5b9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:58.050499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6a22d75-58d4-48d2-91ed-beb7d24cb5b9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:58.050978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6a22d75-58d4-48d2-91ed-beb7d24cb5b9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:58.051422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6a22d75-58d4-48d2-91ed-beb7d24cb5b9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:58.215191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e6a22d75-58d4-48d2-91ed-beb7d24cb5b9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:58.228190 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e6a22d75-58d4-48d2-91ed-beb7d24cb5b9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1680 microversion: 2.1 time: 0.193174 Aug 18 12:28:58.229099 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3981/6635] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:58 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:28:59.261114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-483159aa-9280-4d7d-8440-d8fb329cae18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:28:59.262141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-483159aa-9280-4d7d-8440-d8fb329cae18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:28:59.270415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-483159aa-9280-4d7d-8440-d8fb329cae18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:59.271060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-483159aa-9280-4d7d-8440-d8fb329cae18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:59.271529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-483159aa-9280-4d7d-8440-d8fb329cae18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:59.272269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-483159aa-9280-4d7d-8440-d8fb329cae18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:28:59.272741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-483159aa-9280-4d7d-8440-d8fb329cae18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:28:59.273183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-483159aa-9280-4d7d-8440-d8fb329cae18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:28:59.445686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-483159aa-9280-4d7d-8440-d8fb329cae18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:28:59.455237 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-483159aa-9280-4d7d-8440-d8fb329cae18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1680 microversion: 2.1 time: 0.198154 Aug 18 12:28:59.456007 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3982/6636] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:28:59 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:00.478229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e0823a20-feda-4371-a44f-cd4dd81d72af tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:00.478982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e0823a20-feda-4371-a44f-cd4dd81d72af tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:00.487151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0823a20-feda-4371-a44f-cd4dd81d72af tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:00.487747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0823a20-feda-4371-a44f-cd4dd81d72af tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:00.488249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0823a20-feda-4371-a44f-cd4dd81d72af tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:00.489078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0823a20-feda-4371-a44f-cd4dd81d72af tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:00.489647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0823a20-feda-4371-a44f-cd4dd81d72af tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:00.490171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0823a20-feda-4371-a44f-cd4dd81d72af tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:01.036377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e0823a20-feda-4371-a44f-cd4dd81d72af tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:01.044585 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e0823a20-feda-4371-a44f-cd4dd81d72af tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1680 microversion: 2.1 time: 0.570515 Aug 18 12:29:01.045360 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3983/6637] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:00 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1680 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:02.068899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f2e867d-1047-4b1a-a52c-08cd905181bf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:02.069673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6f2e867d-1047-4b1a-a52c-08cd905181bf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:02.078626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f2e867d-1047-4b1a-a52c-08cd905181bf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:02.079414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f2e867d-1047-4b1a-a52c-08cd905181bf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:02.079888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f2e867d-1047-4b1a-a52c-08cd905181bf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:02.080650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f2e867d-1047-4b1a-a52c-08cd905181bf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:02.081132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f2e867d-1047-4b1a-a52c-08cd905181bf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:02.081583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f2e867d-1047-4b1a-a52c-08cd905181bf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:02.234094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6f2e867d-1047-4b1a-a52c-08cd905181bf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:02.242712 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6f2e867d-1047-4b1a-a52c-08cd905181bf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1680 microversion: 2.1 time: 0.177784 Aug 18 12:29:02.243321 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3984/6638] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:02 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:03.266196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c0d81f6-ea58-4b8f-8b42-d80f31bd1dea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:03.266948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c0d81f6-ea58-4b8f-8b42-d80f31bd1dea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:03.274665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c0d81f6-ea58-4b8f-8b42-d80f31bd1dea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:03.275400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c0d81f6-ea58-4b8f-8b42-d80f31bd1dea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:03.275953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c0d81f6-ea58-4b8f-8b42-d80f31bd1dea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:03.276820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c0d81f6-ea58-4b8f-8b42-d80f31bd1dea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:03.277396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c0d81f6-ea58-4b8f-8b42-d80f31bd1dea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:03.277848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c0d81f6-ea58-4b8f-8b42-d80f31bd1dea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:03.283397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:03.442639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9c0d81f6-ea58-4b8f-8b42-d80f31bd1dea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:03.452373 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c0d81f6-ea58-4b8f-8b42-d80f31bd1dea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1680 microversion: 2.1 time: 0.191192 Aug 18 12:29:03.453705 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3985/6639] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:03 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:04.414811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c45f286b-bca1-411f-ab10-e37ec0e86786 req-4f7d540c-8fbf-4ed0-bb60-66751361a777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd70be6-b296-4aed-8ce7-b873c0267aba", "name": "network-vif-unplugged", "status": "completed", "tag": "0bc54021-4402-4e3a-9ed6-59196001bd33"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:04.429361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c45f286b-bca1-411f-ab10-e37ec0e86786 req-4f7d540c-8fbf-4ed0-bb60-66751361a777 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:04.430129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c45f286b-bca1-411f-ab10-e37ec0e86786 req-4f7d540c-8fbf-4ed0-bb60-66751361a777 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:04.431045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c45f286b-bca1-411f-ab10-e37ec0e86786 req-4f7d540c-8fbf-4ed0-bb60-66751361a777 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:04.449546 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c45f286b-bca1-411f-ab10-e37ec0e86786 req-4f7d540c-8fbf-4ed0-bb60-66751361a777 service nova] Creating event network-vif-unplugged:0bc54021-4402-4e3a-9ed6-59196001bd33 for instance 5cd70be6-b296-4aed-8ce7-b873c0267aba on n-h1-853611-3 Aug 18 12:29:04.457107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-c45f286b-bca1-411f-ab10-e37ec0e86786 req-4f7d540c-8fbf-4ed0-bb60-66751361a777 service nova] Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:29:04.480433 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c45f286b-bca1-411f-ab10-e37ec0e86786 req-4f7d540c-8fbf-4ed0-bb60-66751361a777 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.163526 Aug 18 12:29:04.481625 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3986/6640] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:29:04.493453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f736ef71-37a4-4f4c-a58d-23654abc7d75 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:04.495057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f736ef71-37a4-4f4c-a58d-23654abc7d75 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:04.506775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f736ef71-37a4-4f4c-a58d-23654abc7d75 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:04.507726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f736ef71-37a4-4f4c-a58d-23654abc7d75 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:04.508580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f736ef71-37a4-4f4c-a58d-23654abc7d75 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:04.509938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f736ef71-37a4-4f4c-a58d-23654abc7d75 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:04.510875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f736ef71-37a4-4f4c-a58d-23654abc7d75 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:04.511693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f736ef71-37a4-4f4c-a58d-23654abc7d75 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:04.744743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f736ef71-37a4-4f4c-a58d-23654abc7d75 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:04.753819 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f736ef71-37a4-4f4c-a58d-23654abc7d75 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1679 microversion: 2.1 time: 0.270248 Aug 18 12:29:04.754567 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3987/6641] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:04 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1679 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:05.779421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e48d0597-31f8-48dd-a0bf-6a2b3dff2b71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:05.781261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e48d0597-31f8-48dd-a0bf-6a2b3dff2b71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:05.789837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e48d0597-31f8-48dd-a0bf-6a2b3dff2b71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:05.790348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e48d0597-31f8-48dd-a0bf-6a2b3dff2b71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:05.790907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e48d0597-31f8-48dd-a0bf-6a2b3dff2b71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:05.791709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e48d0597-31f8-48dd-a0bf-6a2b3dff2b71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:05.792235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e48d0597-31f8-48dd-a0bf-6a2b3dff2b71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:05.792736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e48d0597-31f8-48dd-a0bf-6a2b3dff2b71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:05.967535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e48d0597-31f8-48dd-a0bf-6a2b3dff2b71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:05.979293 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e48d0597-31f8-48dd-a0bf-6a2b3dff2b71 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1677 microversion: 2.1 time: 0.204434 Aug 18 12:29:05.980190 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3988/6642] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:05 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1677 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:06.507962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a2e67a9f-7327-4f48-adf5-0458fbb62c80 req-35f1345b-2e00-45f7-9dc0-d62dc1dfa8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd70be6-b296-4aed-8ce7-b873c0267aba", "tag": "0bc54021-4402-4e3a-9ed6-59196001bd33"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:06.519885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a2e67a9f-7327-4f48-adf5-0458fbb62c80 req-35f1345b-2e00-45f7-9dc0-d62dc1dfa8a2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:06.520449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a2e67a9f-7327-4f48-adf5-0458fbb62c80 req-35f1345b-2e00-45f7-9dc0-d62dc1dfa8a2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:06.520964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a2e67a9f-7327-4f48-adf5-0458fbb62c80 req-35f1345b-2e00-45f7-9dc0-d62dc1dfa8a2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:06.539675 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a2e67a9f-7327-4f48-adf5-0458fbb62c80 req-35f1345b-2e00-45f7-9dc0-d62dc1dfa8a2 service nova] Creating event network-changed:0bc54021-4402-4e3a-9ed6-59196001bd33 for instance 5cd70be6-b296-4aed-8ce7-b873c0267aba on n-h1-853611-3 Aug 18 12:29:06.546161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-a2e67a9f-7327-4f48-adf5-0458fbb62c80 req-35f1345b-2e00-45f7-9dc0-d62dc1dfa8a2 service nova] Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:29:06.560357 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a2e67a9f-7327-4f48-adf5-0458fbb62c80 req-35f1345b-2e00-45f7-9dc0-d62dc1dfa8a2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055762 Aug 18 12:29:06.561481 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3989/6643] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:29:07.016918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0180138c-05f5-4d5c-a37c-76eed7e2aebc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:07.018577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0180138c-05f5-4d5c-a37c-76eed7e2aebc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:07.026806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0180138c-05f5-4d5c-a37c-76eed7e2aebc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:07.027441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0180138c-05f5-4d5c-a37c-76eed7e2aebc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:07.028132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0180138c-05f5-4d5c-a37c-76eed7e2aebc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:07.029073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0180138c-05f5-4d5c-a37c-76eed7e2aebc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:07.029733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0180138c-05f5-4d5c-a37c-76eed7e2aebc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:07.030349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0180138c-05f5-4d5c-a37c-76eed7e2aebc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:07.520791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0180138c-05f5-4d5c-a37c-76eed7e2aebc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:07.530250 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0180138c-05f5-4d5c-a37c-76eed7e2aebc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1677 microversion: 2.1 time: 0.519079 Aug 18 12:29:07.546718 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3990/6644] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:07 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1677 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:08.556816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9155d8d8-b383-4387-925d-e15097689141 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:08.557537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9155d8d8-b383-4387-925d-e15097689141 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:08.565850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9155d8d8-b383-4387-925d-e15097689141 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:08.566354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9155d8d8-b383-4387-925d-e15097689141 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:08.566849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9155d8d8-b383-4387-925d-e15097689141 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:08.567587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9155d8d8-b383-4387-925d-e15097689141 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:08.568086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9155d8d8-b383-4387-925d-e15097689141 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:08.568508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9155d8d8-b383-4387-925d-e15097689141 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:08.764322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9155d8d8-b383-4387-925d-e15097689141 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:08.775620 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9155d8d8-b383-4387-925d-e15097689141 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1674 microversion: 2.1 time: 0.223390 Aug 18 12:29:08.776446 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3991/6645] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:08 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1674 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:08.800922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-47692126-b8e7-4841-866a-5320b9d259be tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:08.801474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-47692126-b8e7-4841-866a-5320b9d259be tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:08.808766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47692126-b8e7-4841-866a-5320b9d259be tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:08.809172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47692126-b8e7-4841-866a-5320b9d259be tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:08.809821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47692126-b8e7-4841-866a-5320b9d259be tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:08.810755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47692126-b8e7-4841-866a-5320b9d259be tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:08.811246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47692126-b8e7-4841-866a-5320b9d259be tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:08.811694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-47692126-b8e7-4841-866a-5320b9d259be tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:08.884504 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-47692126-b8e7-4841-866a-5320b9d259be tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba/action" status: 204 len: 0 microversion: 2.1 time: 0.088412 Aug 18 12:29:08.885187 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3992/6646] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:29:08 2022] POST /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba/action => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:29:08.894497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f80a9c53-09e5-4a52-8663-a4db19ec8ad4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:08.895225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f80a9c53-09e5-4a52-8663-a4db19ec8ad4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:08.902215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80a9c53-09e5-4a52-8663-a4db19ec8ad4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:08.902789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80a9c53-09e5-4a52-8663-a4db19ec8ad4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:08.903502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80a9c53-09e5-4a52-8663-a4db19ec8ad4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:08.904385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80a9c53-09e5-4a52-8663-a4db19ec8ad4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:08.904868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80a9c53-09e5-4a52-8663-a4db19ec8ad4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:08.905458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80a9c53-09e5-4a52-8663-a4db19ec8ad4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:09.287386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f80a9c53-09e5-4a52-8663-a4db19ec8ad4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:09.298624 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f80a9c53-09e5-4a52-8663-a4db19ec8ad4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1674 microversion: 2.1 time: 0.408464 Aug 18 12:29:09.299989 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3993/6647] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:08 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1674 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:10.324118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b91514b4-721d-44ce-ba0e-7708621fbdcb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:10.324882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b91514b4-721d-44ce-ba0e-7708621fbdcb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:10.333061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b91514b4-721d-44ce-ba0e-7708621fbdcb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:10.333570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b91514b4-721d-44ce-ba0e-7708621fbdcb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:10.334017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b91514b4-721d-44ce-ba0e-7708621fbdcb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:10.334777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b91514b4-721d-44ce-ba0e-7708621fbdcb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:10.335282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b91514b4-721d-44ce-ba0e-7708621fbdcb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:10.335718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b91514b4-721d-44ce-ba0e-7708621fbdcb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:10.510930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b91514b4-721d-44ce-ba0e-7708621fbdcb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:10.527400 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b91514b4-721d-44ce-ba0e-7708621fbdcb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1674 microversion: 2.1 time: 0.207031 Aug 18 12:29:10.528450 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3994/6648] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:10 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1674 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:11.491567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-19148e7b-6b93-4bb3-bd14-86ba3741138b req-af9f774d-7ad2-4f13-b136-2ecc22add6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd70be6-b296-4aed-8ce7-b873c0267aba", "name": "network-vif-plugged", "status": "completed", "tag": "0bc54021-4402-4e3a-9ed6-59196001bd33"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:11.511123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-19148e7b-6b93-4bb3-bd14-86ba3741138b req-af9f774d-7ad2-4f13-b136-2ecc22add6c7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:11.511669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-19148e7b-6b93-4bb3-bd14-86ba3741138b req-af9f774d-7ad2-4f13-b136-2ecc22add6c7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:11.512192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-19148e7b-6b93-4bb3-bd14-86ba3741138b req-af9f774d-7ad2-4f13-b136-2ecc22add6c7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:11.526795 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-19148e7b-6b93-4bb3-bd14-86ba3741138b req-af9f774d-7ad2-4f13-b136-2ecc22add6c7 service nova] Creating event network-vif-plugged:0bc54021-4402-4e3a-9ed6-59196001bd33 for instance 5cd70be6-b296-4aed-8ce7-b873c0267aba on n-h1-853611-3 Aug 18 12:29:11.533694 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-19148e7b-6b93-4bb3-bd14-86ba3741138b req-af9f774d-7ad2-4f13-b136-2ecc22add6c7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049526 Aug 18 12:29:11.534472 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3995/6649] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:29:11.563985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ef7705c6-c631-4597-9381-894637f7358e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:11.564754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef7705c6-c631-4597-9381-894637f7358e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:11.571812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7705c6-c631-4597-9381-894637f7358e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:11.572326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7705c6-c631-4597-9381-894637f7358e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:11.572782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7705c6-c631-4597-9381-894637f7358e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:11.573564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7705c6-c631-4597-9381-894637f7358e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:11.574027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7705c6-c631-4597-9381-894637f7358e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:11.574512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef7705c6-c631-4597-9381-894637f7358e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:11.772526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ef7705c6-c631-4597-9381-894637f7358e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:11.782884 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ef7705c6-c631-4597-9381-894637f7358e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1666 microversion: 2.1 time: 0.224913 Aug 18 12:29:11.783516 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3996/6650] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:11 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1666 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:11.805901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fa76e975-c712-479b-8e3e-30345ea383f3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:11.806687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fa76e975-c712-479b-8e3e-30345ea383f3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:11.814172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa76e975-c712-479b-8e3e-30345ea383f3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:11.814732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa76e975-c712-479b-8e3e-30345ea383f3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:11.815201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa76e975-c712-479b-8e3e-30345ea383f3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:11.815962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa76e975-c712-479b-8e3e-30345ea383f3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:11.816429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa76e975-c712-479b-8e3e-30345ea383f3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:11.817748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa76e975-c712-479b-8e3e-30345ea383f3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:11.978103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fa76e975-c712-479b-8e3e-30345ea383f3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:11.987733 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fa76e975-c712-479b-8e3e-30345ea383f3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1666 microversion: 2.1 time: 0.185889 Aug 18 12:29:11.988392 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3997/6651] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:11 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1666 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:12.011944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d8429d56-d92a-46a6-9218-c54d425cf2c4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:12.012652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d8429d56-d92a-46a6-9218-c54d425cf2c4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:12.020773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8429d56-d92a-46a6-9218-c54d425cf2c4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:12.021218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8429d56-d92a-46a6-9218-c54d425cf2c4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:12.021700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8429d56-d92a-46a6-9218-c54d425cf2c4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:12.022549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8429d56-d92a-46a6-9218-c54d425cf2c4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:12.023082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8429d56-d92a-46a6-9218-c54d425cf2c4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:12.023542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8429d56-d92a-46a6-9218-c54d425cf2c4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:12.183839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d8429d56-d92a-46a6-9218-c54d425cf2c4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:12.194058 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d8429d56-d92a-46a6-9218-c54d425cf2c4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1666 microversion: 2.1 time: 0.186699 Aug 18 12:29:12.194787 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3998/6652] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:12 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1666 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:12.217472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-021e89a7-43c9-4c33-9a67-ee3e874f90e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:12.218964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-021e89a7-43c9-4c33-9a67-ee3e874f90e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:12.226025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-021e89a7-43c9-4c33-9a67-ee3e874f90e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:12.226656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-021e89a7-43c9-4c33-9a67-ee3e874f90e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:12.227189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-021e89a7-43c9-4c33-9a67-ee3e874f90e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:12.228062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-021e89a7-43c9-4c33-9a67-ee3e874f90e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:12.228689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-021e89a7-43c9-4c33-9a67-ee3e874f90e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:12.229186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-021e89a7-43c9-4c33-9a67-ee3e874f90e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:12.258946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-021e89a7-43c9-4c33-9a67-ee3e874f90e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:29:12.363568 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-021e89a7-43c9-4c33-9a67-ee3e874f90e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 204 len: 0 microversion: 2.1 time: 0.149839 Aug 18 12:29:12.364312 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 3999/6653] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:29:12 2022] DELETE /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:29:12.373631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ff5ad62f-fc51-4001-8813-a87802652481 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:12.375209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ff5ad62f-fc51-4001-8813-a87802652481 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:12.382081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff5ad62f-fc51-4001-8813-a87802652481 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:12.382626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff5ad62f-fc51-4001-8813-a87802652481 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:12.383087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff5ad62f-fc51-4001-8813-a87802652481 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:12.383838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff5ad62f-fc51-4001-8813-a87802652481 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:12.384316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff5ad62f-fc51-4001-8813-a87802652481 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:12.384766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ff5ad62f-fc51-4001-8813-a87802652481 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:12.403098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:12.552617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ff5ad62f-fc51-4001-8813-a87802652481 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:12.561184 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ff5ad62f-fc51-4001-8813-a87802652481 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1672 microversion: 2.1 time: 0.191912 Aug 18 12:29:12.562403 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4000/6654] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:12 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:13.588408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-29933c7b-a8b2-4233-bb32-920672f4d4a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:13.589154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-29933c7b-a8b2-4233-bb32-920672f4d4a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:13.597486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29933c7b-a8b2-4233-bb32-920672f4d4a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:13.598188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29933c7b-a8b2-4233-bb32-920672f4d4a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:13.598780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29933c7b-a8b2-4233-bb32-920672f4d4a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:13.599609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29933c7b-a8b2-4233-bb32-920672f4d4a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:13.600125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29933c7b-a8b2-4233-bb32-920672f4d4a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:13.600676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29933c7b-a8b2-4233-bb32-920672f4d4a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:13.774285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-29933c7b-a8b2-4233-bb32-920672f4d4a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:13.788803 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-29933c7b-a8b2-4233-bb32-920672f4d4a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1672 microversion: 2.1 time: 0.203996 Aug 18 12:29:13.789913 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4001/6655] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:13 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1672 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:14.832259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c7fca54-33b8-4af6-a8be-74371acb45aa tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:14.833503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c7fca54-33b8-4af6-a8be-74371acb45aa tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:14.843413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7fca54-33b8-4af6-a8be-74371acb45aa tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:14.844046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7fca54-33b8-4af6-a8be-74371acb45aa tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:14.844597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7fca54-33b8-4af6-a8be-74371acb45aa tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:14.845740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7fca54-33b8-4af6-a8be-74371acb45aa tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:14.846260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7fca54-33b8-4af6-a8be-74371acb45aa tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:14.846882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7fca54-33b8-4af6-a8be-74371acb45aa tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:15.045668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9c7fca54-33b8-4af6-a8be-74371acb45aa tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:15.061093 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c7fca54-33b8-4af6-a8be-74371acb45aa tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 200 len: 1605 microversion: 2.1 time: 0.236326 Aug 18 12:29:15.063135 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4002/6656] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:14 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 1605 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:15.330110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4f6e64c2-42ca-4e5f-addf-93ae2f43fcc5 req-2a0d7b57-be6d-4a4b-b60b-9488008902d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd70be6-b296-4aed-8ce7-b873c0267aba", "name": "network-vif-deleted", "tag": "0bc54021-4402-4e3a-9ed6-59196001bd33"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:15.341573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4f6e64c2-42ca-4e5f-addf-93ae2f43fcc5 req-2a0d7b57-be6d-4a4b-b60b-9488008902d5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:15.342080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4f6e64c2-42ca-4e5f-addf-93ae2f43fcc5 req-2a0d7b57-be6d-4a4b-b60b-9488008902d5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:15.342594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4f6e64c2-42ca-4e5f-addf-93ae2f43fcc5 req-2a0d7b57-be6d-4a4b-b60b-9488008902d5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:15.356214 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4f6e64c2-42ca-4e5f-addf-93ae2f43fcc5 req-2a0d7b57-be6d-4a4b-b60b-9488008902d5 service nova] Creating event network-vif-deleted:0bc54021-4402-4e3a-9ed6-59196001bd33 for instance 5cd70be6-b296-4aed-8ce7-b873c0267aba on n-h1-853611-3 Aug 18 12:29:15.362531 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4f6e64c2-42ca-4e5f-addf-93ae2f43fcc5 req-2a0d7b57-be6d-4a4b-b60b-9488008902d5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036790 Aug 18 12:29:15.363573 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4003/6657] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:29:16.091255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac0b135c-6ed5-4bb9-9a54-0600f8565f4a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:16.092049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ac0b135c-6ed5-4bb9-9a54-0600f8565f4a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:16.099914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac0b135c-6ed5-4bb9-9a54-0600f8565f4a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:16.100707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac0b135c-6ed5-4bb9-9a54-0600f8565f4a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:16.101362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac0b135c-6ed5-4bb9-9a54-0600f8565f4a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:16.102376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac0b135c-6ed5-4bb9-9a54-0600f8565f4a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:16.103005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac0b135c-6ed5-4bb9-9a54-0600f8565f4a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:16.103553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac0b135c-6ed5-4bb9-9a54-0600f8565f4a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:16.126003 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-ac0b135c-6ed5-4bb9-9a54-0600f8565f4a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac0b135c-6ed5-4bb9-9a54-0600f8565f4a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba HTTP/1.1 Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5cd70be6-b296-4aed-8ce7-b873c0267aba'} Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:29:16.128243 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:29:16.132433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:29:16.132433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:29:16.132433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:29:16.132433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:29:16.132433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:29:16.132433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:29:16.132433 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:29:16.132433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac0b135c-6ed5-4bb9-9a54-0600f8565f4a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:29:16.132433 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ac0b135c-6ed5-4bb9-9a54-0600f8565f4a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 404 len: 111 microversion: 2.1 time: 0.044978 Aug 18 12:29:16.132433 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4004/6658] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:16 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:29:16.149626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-58fa4d99-c6a3-4306-bc08-3f21557b063e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:16.150365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-58fa4d99-c6a3-4306-bc08-3f21557b063e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:16.158318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58fa4d99-c6a3-4306-bc08-3f21557b063e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:16.159030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58fa4d99-c6a3-4306-bc08-3f21557b063e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:16.159613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58fa4d99-c6a3-4306-bc08-3f21557b063e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:16.160546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58fa4d99-c6a3-4306-bc08-3f21557b063e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:16.161025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58fa4d99-c6a3-4306-bc08-3f21557b063e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:16.161477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58fa4d99-c6a3-4306-bc08-3f21557b063e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:16.178912 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-58fa4d99-c6a3-4306-bc08-3f21557b063e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-58fa4d99-c6a3-4306-bc08-3f21557b063e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba HTTP/1.1 Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5cd70be6-b296-4aed-8ce7-b873c0267aba'} Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:29:16.180633 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:29:16.188108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:29:16.188108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:29:16.188108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:29:16.188108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:29:16.188108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:29:16.188108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:29:16.188108 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:29:16.188108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-58fa4d99-c6a3-4306-bc08-3f21557b063e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:29:16.188108 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-58fa4d99-c6a3-4306-bc08-3f21557b063e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 404 len: 111 microversion: 2.1 time: 0.037131 Aug 18 12:29:16.188108 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4005/6659] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:16 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:29:16.250683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-656698089", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "223e769f-74d3-491d-9f22-cb5f7423c3de"}], "security_groups": [{"name": "tempest-securitygroup--514773839"}], "key_name": "tempest-keypair-128691123", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:16.417942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] validate_networks() for [('223e769f-74d3-491d-9f22-cb5f7423c3de', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:29:16.955301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:29:16.956104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:29:16.956621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:29:16.957058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:29:16.957515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:29:16.971881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:16.972547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:16.973202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:16.974671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:16.975432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:16.976102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:17.010135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Getting quotas for project 52c152e60a4d4bce86773ea6a2e25fc4. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:29:17.021434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Getting quotas for user 6da9f8c739314b6a842c84bf71786f78 and project 52c152e60a4d4bce86773ea6a2e25fc4. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:29:17.040449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:29:17.043039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:29:17.083649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:17.121766 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c264f235-8368-421f-9434-114c59004ff9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.875785 Aug 18 12:29:17.122904 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4006/6660] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:29:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:29:17.137190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-208c3080-409e-4c5e-88d8-3a8c72d07288 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:17.138174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-208c3080-409e-4c5e-88d8-3a8c72d07288 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:17.223289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-208c3080-409e-4c5e-88d8-3a8c72d07288 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:17.231845 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-208c3080-409e-4c5e-88d8-3a8c72d07288 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1237 microversion: 2.1 time: 0.099725 Aug 18 12:29:17.232622 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4007/6661] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:17 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:18.260378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7aa120f5-11ba-4914-89b7-96f20214b51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:18.261647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7aa120f5-11ba-4914-89b7-96f20214b51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:18.272470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7aa120f5-11ba-4914-89b7-96f20214b51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:18.273239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7aa120f5-11ba-4914-89b7-96f20214b51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:18.273856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7aa120f5-11ba-4914-89b7-96f20214b51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:18.274840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7aa120f5-11ba-4914-89b7-96f20214b51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:18.275476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7aa120f5-11ba-4914-89b7-96f20214b51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:18.276122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7aa120f5-11ba-4914-89b7-96f20214b51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:18.377577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7aa120f5-11ba-4914-89b7-96f20214b51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:18.391112 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7aa120f5-11ba-4914-89b7-96f20214b51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1297 microversion: 2.1 time: 0.135089 Aug 18 12:29:18.407283 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4008/6662] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:18 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1297 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:19.432148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b49be3d9-b6ee-4d67-9300-07c7abe829c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:19.433118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b49be3d9-b6ee-4d67-9300-07c7abe829c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:19.453071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b49be3d9-b6ee-4d67-9300-07c7abe829c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:19.453910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b49be3d9-b6ee-4d67-9300-07c7abe829c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:19.454378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b49be3d9-b6ee-4d67-9300-07c7abe829c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:19.455158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b49be3d9-b6ee-4d67-9300-07c7abe829c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:19.455863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b49be3d9-b6ee-4d67-9300-07c7abe829c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:19.456305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b49be3d9-b6ee-4d67-9300-07c7abe829c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:19.833330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b49be3d9-b6ee-4d67-9300-07c7abe829c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:19.842640 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b49be3d9-b6ee-4d67-9300-07c7abe829c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1362 microversion: 2.1 time: 0.415695 Aug 18 12:29:19.857693 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4009/6663] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:19 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:20.311438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-cc78602e-ee82-4b7c-849f-1f30275c466b req-df5dd79c-273c-4530-b7b9-a07450333e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "543b0855-c82a-4ccf-aac0-3b6feecde8e6", "tag": "92b040e4-c42e-4653-af00-39d91e77f4d2"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:20.337901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cc78602e-ee82-4b7c-849f-1f30275c466b req-df5dd79c-273c-4530-b7b9-a07450333e30 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:20.339278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cc78602e-ee82-4b7c-849f-1f30275c466b req-df5dd79c-273c-4530-b7b9-a07450333e30 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:20.340076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cc78602e-ee82-4b7c-849f-1f30275c466b req-df5dd79c-273c-4530-b7b9-a07450333e30 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:20.356871 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-cc78602e-ee82-4b7c-849f-1f30275c466b req-df5dd79c-273c-4530-b7b9-a07450333e30 service nova] Creating event network-changed:92b040e4-c42e-4653-af00-39d91e77f4d2 for instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 on n-h2-853611-3 Aug 18 12:29:20.364024 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-cc78602e-ee82-4b7c-849f-1f30275c466b req-df5dd79c-273c-4530-b7b9-a07450333e30 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059617 Aug 18 12:29:20.365231 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4010/6664] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:29:20.867134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55b08d40-9354-43d1-b69a-a38d588c8ac1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:20.868100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-55b08d40-9354-43d1-b69a-a38d588c8ac1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:20.877488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b08d40-9354-43d1-b69a-a38d588c8ac1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:20.878259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b08d40-9354-43d1-b69a-a38d588c8ac1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:20.878885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b08d40-9354-43d1-b69a-a38d588c8ac1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:20.879773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b08d40-9354-43d1-b69a-a38d588c8ac1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:20.880368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b08d40-9354-43d1-b69a-a38d588c8ac1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:20.880945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55b08d40-9354-43d1-b69a-a38d588c8ac1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:21.049941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-55b08d40-9354-43d1-b69a-a38d588c8ac1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:21.065160 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-55b08d40-9354-43d1-b69a-a38d588c8ac1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1362 microversion: 2.1 time: 0.202981 Aug 18 12:29:21.066220 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4011/6665] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:20 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:29:22.090685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8638896c-fbea-445c-820d-45ff2621c858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:22.091753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8638896c-fbea-445c-820d-45ff2621c858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:22.111766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8638896c-fbea-445c-820d-45ff2621c858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:22.112700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8638896c-fbea-445c-820d-45ff2621c858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:22.116413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8638896c-fbea-445c-820d-45ff2621c858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:22.119846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8638896c-fbea-445c-820d-45ff2621c858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:22.120922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8638896c-fbea-445c-820d-45ff2621c858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:22.122151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8638896c-fbea-445c-820d-45ff2621c858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:22.386474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8638896c-fbea-445c-820d-45ff2621c858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:22.399932 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8638896c-fbea-445c-820d-45ff2621c858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1362 microversion: 2.1 time: 0.311754 Aug 18 12:29:22.400649 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4012/6666] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:22 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:23.424827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f7733eae-754f-4aef-96c7-0b2f1b9fa150 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:23.425635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f7733eae-754f-4aef-96c7-0b2f1b9fa150 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:23.433361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7733eae-754f-4aef-96c7-0b2f1b9fa150 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:23.433880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7733eae-754f-4aef-96c7-0b2f1b9fa150 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:23.434385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7733eae-754f-4aef-96c7-0b2f1b9fa150 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:23.435165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7733eae-754f-4aef-96c7-0b2f1b9fa150 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:23.435690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7733eae-754f-4aef-96c7-0b2f1b9fa150 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:23.436190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f7733eae-754f-4aef-96c7-0b2f1b9fa150 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:23.597002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f7733eae-754f-4aef-96c7-0b2f1b9fa150 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:23.605192 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f7733eae-754f-4aef-96c7-0b2f1b9fa150 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1362 microversion: 2.1 time: 0.185692 Aug 18 12:29:23.605808 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4013/6667] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:23 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:24.628486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-07fd1b2f-95c7-4a38-aa11-adead9289619 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:24.629189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-07fd1b2f-95c7-4a38-aa11-adead9289619 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:24.636487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07fd1b2f-95c7-4a38-aa11-adead9289619 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:24.637011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07fd1b2f-95c7-4a38-aa11-adead9289619 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:24.637462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07fd1b2f-95c7-4a38-aa11-adead9289619 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:24.638209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07fd1b2f-95c7-4a38-aa11-adead9289619 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:24.638716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07fd1b2f-95c7-4a38-aa11-adead9289619 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:24.639161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07fd1b2f-95c7-4a38-aa11-adead9289619 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:24.789618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-07fd1b2f-95c7-4a38-aa11-adead9289619 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:24.799419 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-07fd1b2f-95c7-4a38-aa11-adead9289619 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1362 microversion: 2.1 time: 0.175239 Aug 18 12:29:24.800172 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4014/6668] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:24 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:25.821527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-da057e23-15d4-4779-ac78-779d96144de6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:25.822602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-da057e23-15d4-4779-ac78-779d96144de6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:25.830040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da057e23-15d4-4779-ac78-779d96144de6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:25.830592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da057e23-15d4-4779-ac78-779d96144de6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:25.831054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da057e23-15d4-4779-ac78-779d96144de6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:25.831791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da057e23-15d4-4779-ac78-779d96144de6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:25.832265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da057e23-15d4-4779-ac78-779d96144de6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:25.832736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da057e23-15d4-4779-ac78-779d96144de6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:26.021552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-da057e23-15d4-4779-ac78-779d96144de6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:26.030060 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-da057e23-15d4-4779-ac78-779d96144de6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1362 microversion: 2.1 time: 0.212311 Aug 18 12:29:26.031251 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4015/6669] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:25 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:27.067026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c6ab717-5c50-426b-8487-4f9ba678a70b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:27.068526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4c6ab717-5c50-426b-8487-4f9ba678a70b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:27.072572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:27.078938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c6ab717-5c50-426b-8487-4f9ba678a70b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:27.079550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c6ab717-5c50-426b-8487-4f9ba678a70b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:27.080017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c6ab717-5c50-426b-8487-4f9ba678a70b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:27.080759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c6ab717-5c50-426b-8487-4f9ba678a70b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:27.081236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c6ab717-5c50-426b-8487-4f9ba678a70b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:27.081687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c6ab717-5c50-426b-8487-4f9ba678a70b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:27.228399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:27.253538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4c6ab717-5c50-426b-8487-4f9ba678a70b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:27.262918 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4c6ab717-5c50-426b-8487-4f9ba678a70b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1362 microversion: 2.1 time: 0.200681 Aug 18 12:29:27.263844 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4016/6670] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:27 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:27.270153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f59d5213-52bb-4aa6-9bd4-e028bf71daf9 req-aef15363-50ea-48f5-be95-f11467b207f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543b0855-c82a-4ccf-aac0-3b6feecde8e6", "name": "network-vif-plugged", "status": "completed", "tag": "92b040e4-c42e-4653-af00-39d91e77f4d2"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:27.282171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f59d5213-52bb-4aa6-9bd4-e028bf71daf9 req-aef15363-50ea-48f5-be95-f11467b207f8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:27.282741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f59d5213-52bb-4aa6-9bd4-e028bf71daf9 req-aef15363-50ea-48f5-be95-f11467b207f8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:27.283202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f59d5213-52bb-4aa6-9bd4-e028bf71daf9 req-aef15363-50ea-48f5-be95-f11467b207f8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:27.295756 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f59d5213-52bb-4aa6-9bd4-e028bf71daf9 req-aef15363-50ea-48f5-be95-f11467b207f8 service nova] Creating event network-vif-plugged:92b040e4-c42e-4653-af00-39d91e77f4d2 for instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 on n-h2-853611-3 Aug 18 12:29:27.302226 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f59d5213-52bb-4aa6-9bd4-e028bf71daf9 req-aef15363-50ea-48f5-be95-f11467b207f8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037029 Aug 18 12:29:27.303111 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4017/6671] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:29:28.291050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e825145a-ebee-4b7b-b3c5-339101ac589d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:28.291858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e825145a-ebee-4b7b-b3c5-339101ac589d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:28.298778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e825145a-ebee-4b7b-b3c5-339101ac589d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:28.299290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e825145a-ebee-4b7b-b3c5-339101ac589d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:28.299750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e825145a-ebee-4b7b-b3c5-339101ac589d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:28.300497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e825145a-ebee-4b7b-b3c5-339101ac589d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:28.300975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e825145a-ebee-4b7b-b3c5-339101ac589d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:28.301426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e825145a-ebee-4b7b-b3c5-339101ac589d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:28.472232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e825145a-ebee-4b7b-b3c5-339101ac589d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:28.481534 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e825145a-ebee-4b7b-b3c5-339101ac589d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1362 microversion: 2.1 time: 0.195564 Aug 18 12:29:28.482419 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4018/6672] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:28 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:29.505117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dc0b93f9-6999-46d8-ae41-b71de7cb3a84 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:29.505831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dc0b93f9-6999-46d8-ae41-b71de7cb3a84 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:29.513646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc0b93f9-6999-46d8-ae41-b71de7cb3a84 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:29.514287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc0b93f9-6999-46d8-ae41-b71de7cb3a84 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:29.514880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc0b93f9-6999-46d8-ae41-b71de7cb3a84 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:29.515713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc0b93f9-6999-46d8-ae41-b71de7cb3a84 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:29.516522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc0b93f9-6999-46d8-ae41-b71de7cb3a84 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:29.517313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dc0b93f9-6999-46d8-ae41-b71de7cb3a84 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:29.680809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dc0b93f9-6999-46d8-ae41-b71de7cb3a84 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:29:29.691065 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dc0b93f9-6999-46d8-ae41-b71de7cb3a84 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1549 microversion: 2.1 time: 0.190069 Aug 18 12:29:29.691745 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4019/6673] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:29 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1549 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:29:29.715797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6172dc12-63d7-4261-9411-e87a7228e799 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:29.715797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6172dc12-63d7-4261-9411-e87a7228e799 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:29.723915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6172dc12-63d7-4261-9411-e87a7228e799 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:29.724433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6172dc12-63d7-4261-9411-e87a7228e799 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:29.724893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6172dc12-63d7-4261-9411-e87a7228e799 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:29.725636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6172dc12-63d7-4261-9411-e87a7228e799 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:29.726116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6172dc12-63d7-4261-9411-e87a7228e799 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:29.726596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6172dc12-63d7-4261-9411-e87a7228e799 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:29.820654 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6172dc12-63d7-4261-9411-e87a7228e799 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110458 Aug 18 12:29:29.821371 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4020/6674] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 12:29:29 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:29:31.158369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9375eae2-1748-45a0-9394-b90c26d17ee1 req-43631ed0-0d3a-45e2-9f4e-8f142ce88690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "543b0855-c82a-4ccf-aac0-3b6feecde8e6", "tag": "92b040e4-c42e-4653-af00-39d91e77f4d2"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:31.177177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9375eae2-1748-45a0-9394-b90c26d17ee1 req-43631ed0-0d3a-45e2-9f4e-8f142ce88690 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:31.177937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9375eae2-1748-45a0-9394-b90c26d17ee1 req-43631ed0-0d3a-45e2-9f4e-8f142ce88690 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:31.178739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9375eae2-1748-45a0-9394-b90c26d17ee1 req-43631ed0-0d3a-45e2-9f4e-8f142ce88690 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:31.202396 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9375eae2-1748-45a0-9394-b90c26d17ee1 req-43631ed0-0d3a-45e2-9f4e-8f142ce88690 service nova] Creating event network-changed:92b040e4-c42e-4653-af00-39d91e77f4d2 for instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 on n-h2-853611-3 Aug 18 12:29:31.212537 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9375eae2-1748-45a0-9394-b90c26d17ee1 req-43631ed0-0d3a-45e2-9f4e-8f142ce88690 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125476 Aug 18 12:29:31.213562 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4021/6675] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:29:58.800047 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:29:58.800697 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:29:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:29:59.789504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=32 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:59.790368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=93 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:29:59.795780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0d880ecc-18b2-41d5-b950-728dbdd470a6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:29:59.805789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d880ecc-18b2-41d5-b950-728dbdd470a6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:59.806315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d880ecc-18b2-41d5-b950-728dbdd470a6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:59.806899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d880ecc-18b2-41d5-b950-728dbdd470a6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:59.834259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0d880ecc-18b2-41d5-b950-728dbdd470a6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Going to try to stop instance {{(pid=122210) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 12:29:59.891685 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0d880ecc-18b2-41d5-b950-728dbdd470a6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6/action" status: 202 len: 0 microversion: 2.1 time: 0.104036 Aug 18 12:29:59.892504 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4022/6676] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:29:59 2022] POST /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:29:59.902462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-86efc581-7a25-4da7-97a4-24db769e1f6b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:29:59.903190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-86efc581-7a25-4da7-97a4-24db769e1f6b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:29:59.910631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86efc581-7a25-4da7-97a4-24db769e1f6b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:59.911135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86efc581-7a25-4da7-97a4-24db769e1f6b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:59.911612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86efc581-7a25-4da7-97a4-24db769e1f6b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:29:59.912332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86efc581-7a25-4da7-97a4-24db769e1f6b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:29:59.912805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86efc581-7a25-4da7-97a4-24db769e1f6b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:29:59.913258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86efc581-7a25-4da7-97a4-24db769e1f6b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:00.080548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-86efc581-7a25-4da7-97a4-24db769e1f6b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:00.088896 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-86efc581-7a25-4da7-97a4-24db769e1f6b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1677 microversion: 2.1 time: 0.191298 Aug 18 12:30:00.089619 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4023/6677] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:29:59 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:01.113099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ce2aa85-017f-425d-be56-cc2b60f61d37 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:01.114390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6ce2aa85-017f-425d-be56-cc2b60f61d37 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:01.122087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ce2aa85-017f-425d-be56-cc2b60f61d37 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:01.122812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ce2aa85-017f-425d-be56-cc2b60f61d37 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:01.123379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ce2aa85-017f-425d-be56-cc2b60f61d37 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:01.125586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ce2aa85-017f-425d-be56-cc2b60f61d37 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:01.126103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ce2aa85-017f-425d-be56-cc2b60f61d37 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:01.126595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ce2aa85-017f-425d-be56-cc2b60f61d37 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:01.314909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6ce2aa85-017f-425d-be56-cc2b60f61d37 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:01.324150 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6ce2aa85-017f-425d-be56-cc2b60f61d37 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1677 microversion: 2.1 time: 0.215492 Aug 18 12:30:01.324508 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4024/6678] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:01 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:02.351738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-86f184ec-8c8f-4565-b893-37021b213e5b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:02.352760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-86f184ec-8c8f-4565-b893-37021b213e5b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:02.360051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f184ec-8c8f-4565-b893-37021b213e5b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:02.360557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f184ec-8c8f-4565-b893-37021b213e5b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:02.361028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f184ec-8c8f-4565-b893-37021b213e5b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:02.361755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f184ec-8c8f-4565-b893-37021b213e5b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:02.362222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f184ec-8c8f-4565-b893-37021b213e5b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:02.362694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-86f184ec-8c8f-4565-b893-37021b213e5b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:02.532131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-86f184ec-8c8f-4565-b893-37021b213e5b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:02.540528 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-86f184ec-8c8f-4565-b893-37021b213e5b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1677 microversion: 2.1 time: 0.192613 Aug 18 12:30:02.541140 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4025/6679] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:02 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:03.565211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d957b40-78a2-4e57-8b88-e305e03d7216 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:03.566201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7d957b40-78a2-4e57-8b88-e305e03d7216 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:03.575693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d957b40-78a2-4e57-8b88-e305e03d7216 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:03.576270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d957b40-78a2-4e57-8b88-e305e03d7216 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:03.576779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d957b40-78a2-4e57-8b88-e305e03d7216 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:03.578397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d957b40-78a2-4e57-8b88-e305e03d7216 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:03.579100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d957b40-78a2-4e57-8b88-e305e03d7216 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:03.579549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d957b40-78a2-4e57-8b88-e305e03d7216 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:03.752200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7d957b40-78a2-4e57-8b88-e305e03d7216 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:03.761352 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7d957b40-78a2-4e57-8b88-e305e03d7216 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1677 microversion: 2.1 time: 0.201659 Aug 18 12:30:03.762016 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4026/6680] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:03 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:04.798333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d5c72062-75da-4c38-a7d2-8b7b3956fb90 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:04.800350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d5c72062-75da-4c38-a7d2-8b7b3956fb90 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:04.809671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5c72062-75da-4c38-a7d2-8b7b3956fb90 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:04.810097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5c72062-75da-4c38-a7d2-8b7b3956fb90 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:04.810663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5c72062-75da-4c38-a7d2-8b7b3956fb90 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:04.812660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5c72062-75da-4c38-a7d2-8b7b3956fb90 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:04.813248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5c72062-75da-4c38-a7d2-8b7b3956fb90 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:04.813749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d5c72062-75da-4c38-a7d2-8b7b3956fb90 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:05.003254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d5c72062-75da-4c38-a7d2-8b7b3956fb90 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:05.017378 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d5c72062-75da-4c38-a7d2-8b7b3956fb90 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1677 microversion: 2.1 time: 0.223370 Aug 18 12:30:05.018842 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4027/6681] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:04 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:06.052761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-033c8418-e956-40b4-b603-979df4dcdf11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:06.053847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-033c8418-e956-40b4-b603-979df4dcdf11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:06.063001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-033c8418-e956-40b4-b603-979df4dcdf11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:06.063530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-033c8418-e956-40b4-b603-979df4dcdf11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:06.063997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-033c8418-e956-40b4-b603-979df4dcdf11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:06.064761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-033c8418-e956-40b4-b603-979df4dcdf11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:06.065241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-033c8418-e956-40b4-b603-979df4dcdf11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:06.065692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-033c8418-e956-40b4-b603-979df4dcdf11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:06.236657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-033c8418-e956-40b4-b603-979df4dcdf11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:06.246258 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-033c8418-e956-40b4-b603-979df4dcdf11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1677 microversion: 2.1 time: 0.201116 Aug 18 12:30:06.246916 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4028/6682] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:06 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:07.271068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-be631af2-ebed-44ee-a489-0c4410064062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:07.271068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-be631af2-ebed-44ee-a489-0c4410064062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:07.277872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be631af2-ebed-44ee-a489-0c4410064062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:07.278376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be631af2-ebed-44ee-a489-0c4410064062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:07.278868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be631af2-ebed-44ee-a489-0c4410064062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:07.279601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be631af2-ebed-44ee-a489-0c4410064062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:07.280075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be631af2-ebed-44ee-a489-0c4410064062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:07.280513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be631af2-ebed-44ee-a489-0c4410064062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:07.455719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-be631af2-ebed-44ee-a489-0c4410064062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:07.465711 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-be631af2-ebed-44ee-a489-0c4410064062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1677 microversion: 2.1 time: 0.199470 Aug 18 12:30:07.466420 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4029/6683] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:07 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1677 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:08.495067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d462a897-24f0-42b1-8445-ccd540215175 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:08.496236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d462a897-24f0-42b1-8445-ccd540215175 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:08.509018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d462a897-24f0-42b1-8445-ccd540215175 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:08.509919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d462a897-24f0-42b1-8445-ccd540215175 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:08.510761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d462a897-24f0-42b1-8445-ccd540215175 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:08.512041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d462a897-24f0-42b1-8445-ccd540215175 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:08.512860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d462a897-24f0-42b1-8445-ccd540215175 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:08.513640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d462a897-24f0-42b1-8445-ccd540215175 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:08.714861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d462a897-24f0-42b1-8445-ccd540215175 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:08.724143 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d462a897-24f0-42b1-8445-ccd540215175 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1677 microversion: 2.1 time: 0.236570 Aug 18 12:30:08.724759 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4030/6684] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:08 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:09.749674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5edde0d4-538e-4262-a988-3cc1a0cc4ee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:09.750479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5edde0d4-538e-4262-a988-3cc1a0cc4ee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:09.759126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5edde0d4-538e-4262-a988-3cc1a0cc4ee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:09.759696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5edde0d4-538e-4262-a988-3cc1a0cc4ee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:09.760216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5edde0d4-538e-4262-a988-3cc1a0cc4ee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:09.761096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5edde0d4-538e-4262-a988-3cc1a0cc4ee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:09.761638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5edde0d4-538e-4262-a988-3cc1a0cc4ee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:09.762157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5edde0d4-538e-4262-a988-3cc1a0cc4ee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:09.919796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5edde0d4-538e-4262-a988-3cc1a0cc4ee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:09.934656 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5edde0d4-538e-4262-a988-3cc1a0cc4ee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1677 microversion: 2.1 time: 0.189140 Aug 18 12:30:09.935687 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4031/6685] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:09 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:10.963414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f48df9d4-71f2-4db4-bab6-a3b1ec6f7005 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:10.964695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f48df9d4-71f2-4db4-bab6-a3b1ec6f7005 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:10.978725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f48df9d4-71f2-4db4-bab6-a3b1ec6f7005 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:10.979688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f48df9d4-71f2-4db4-bab6-a3b1ec6f7005 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:10.980530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f48df9d4-71f2-4db4-bab6-a3b1ec6f7005 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:10.981984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f48df9d4-71f2-4db4-bab6-a3b1ec6f7005 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:10.982869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f48df9d4-71f2-4db4-bab6-a3b1ec6f7005 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:10.984936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f48df9d4-71f2-4db4-bab6-a3b1ec6f7005 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:11.164848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f48df9d4-71f2-4db4-bab6-a3b1ec6f7005 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:11.174793 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f48df9d4-71f2-4db4-bab6-a3b1ec6f7005 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1654 microversion: 2.1 time: 0.218953 Aug 18 12:30:11.175423 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4032/6686] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:10 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1654 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:11.196237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:11.198809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:11.206311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:11.206858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:11.207322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:11.208061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:11.208727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:11.208991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:11.243687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:11.251457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Old instance type m1.heat2, new instance type m1.heat {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 12:30:11.258862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:30:11.259306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:30:11.259801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:30:11.260234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:30:11.260665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:30:11.339279 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3c93274a-1fe9-4c4c-89f4-b1aaa64761a3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6/action" status: 202 len: 0 microversion: 2.1 time: 0.146877 Aug 18 12:30:11.339997 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4033/6687] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:30:11 2022] POST /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:30:11.350092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-25adad04-7f11-463a-b0a1-84b9416cd8f9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:11.350774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-25adad04-7f11-463a-b0a1-84b9416cd8f9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:11.359377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25adad04-7f11-463a-b0a1-84b9416cd8f9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:11.360043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25adad04-7f11-463a-b0a1-84b9416cd8f9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:11.360620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25adad04-7f11-463a-b0a1-84b9416cd8f9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:11.361910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25adad04-7f11-463a-b0a1-84b9416cd8f9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:11.362846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25adad04-7f11-463a-b0a1-84b9416cd8f9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:11.363499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-25adad04-7f11-463a-b0a1-84b9416cd8f9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:11.584889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-25adad04-7f11-463a-b0a1-84b9416cd8f9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:11.600255 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-25adad04-7f11-463a-b0a1-84b9416cd8f9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1677 microversion: 2.1 time: 0.254249 Aug 18 12:30:11.601180 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4034/6688] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:11 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1677 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:12.638627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3cce972d-112a-4e22-a724-20ed81614e6a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:12.639489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3cce972d-112a-4e22-a724-20ed81614e6a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:12.648501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cce972d-112a-4e22-a724-20ed81614e6a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:12.649027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cce972d-112a-4e22-a724-20ed81614e6a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:12.649507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cce972d-112a-4e22-a724-20ed81614e6a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:12.650341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cce972d-112a-4e22-a724-20ed81614e6a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:12.650976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cce972d-112a-4e22-a724-20ed81614e6a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:12.651351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3cce972d-112a-4e22-a724-20ed81614e6a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:12.835397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3cce972d-112a-4e22-a724-20ed81614e6a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:12.845476 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3cce972d-112a-4e22-a724-20ed81614e6a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1677 microversion: 2.1 time: 0.211631 Aug 18 12:30:12.846113 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4035/6689] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:12 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1677 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:13.875980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c30e69ee-a3c4-4a44-b8a8-cf1b78ac5bdd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:13.879873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c30e69ee-a3c4-4a44-b8a8-cf1b78ac5bdd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:13.897223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c30e69ee-a3c4-4a44-b8a8-cf1b78ac5bdd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:13.898114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c30e69ee-a3c4-4a44-b8a8-cf1b78ac5bdd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:13.898973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c30e69ee-a3c4-4a44-b8a8-cf1b78ac5bdd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:13.901012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c30e69ee-a3c4-4a44-b8a8-cf1b78ac5bdd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:13.901901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c30e69ee-a3c4-4a44-b8a8-cf1b78ac5bdd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:13.902773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c30e69ee-a3c4-4a44-b8a8-cf1b78ac5bdd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:13.911617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:14.212636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c30e69ee-a3c4-4a44-b8a8-cf1b78ac5bdd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:14.223140 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c30e69ee-a3c4-4a44-b8a8-cf1b78ac5bdd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1677 microversion: 2.1 time: 0.356926 Aug 18 12:30:14.223760 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4036/6690] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:13 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1677 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:15.247470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e5c3a4a8-4764-4380-b895-6626dfd44e15 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:15.248456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e5c3a4a8-4764-4380-b895-6626dfd44e15 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:15.256577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5c3a4a8-4764-4380-b895-6626dfd44e15 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:15.257095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5c3a4a8-4764-4380-b895-6626dfd44e15 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:15.257548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5c3a4a8-4764-4380-b895-6626dfd44e15 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:15.258286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5c3a4a8-4764-4380-b895-6626dfd44e15 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:15.258802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5c3a4a8-4764-4380-b895-6626dfd44e15 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:15.259250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e5c3a4a8-4764-4380-b895-6626dfd44e15 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:15.441892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e5c3a4a8-4764-4380-b895-6626dfd44e15 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:15.450146 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e5c3a4a8-4764-4380-b895-6626dfd44e15 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1682 microversion: 2.1 time: 0.206911 Aug 18 12:30:15.450872 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4037/6691] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:15 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1682 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:16.474324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8a3d915c-20b1-40f7-9509-770b3dfa26c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:16.475313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8a3d915c-20b1-40f7-9509-770b3dfa26c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:16.483516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a3d915c-20b1-40f7-9509-770b3dfa26c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:16.484190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a3d915c-20b1-40f7-9509-770b3dfa26c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:16.484876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a3d915c-20b1-40f7-9509-770b3dfa26c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:16.485666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a3d915c-20b1-40f7-9509-770b3dfa26c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:16.486157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a3d915c-20b1-40f7-9509-770b3dfa26c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:16.486650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a3d915c-20b1-40f7-9509-770b3dfa26c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:16.801612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8a3d915c-20b1-40f7-9509-770b3dfa26c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:16.813595 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8a3d915c-20b1-40f7-9509-770b3dfa26c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1681 microversion: 2.1 time: 0.343698 Aug 18 12:30:16.814236 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4038/6692] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:16 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1681 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:16.819092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-64fd63d0-32c7-4a34-8b1d-856991ea31ba req-d55b22c8-c6e1-4f18-b4ff-8716500a5a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543b0855-c82a-4ccf-aac0-3b6feecde8e6", "name": "network-vif-unplugged", "status": "completed", "tag": "92b040e4-c42e-4653-af00-39d91e77f4d2"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:16.830907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-64fd63d0-32c7-4a34-8b1d-856991ea31ba req-d55b22c8-c6e1-4f18-b4ff-8716500a5a41 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:16.831645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-64fd63d0-32c7-4a34-8b1d-856991ea31ba req-d55b22c8-c6e1-4f18-b4ff-8716500a5a41 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:16.832226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-64fd63d0-32c7-4a34-8b1d-856991ea31ba req-d55b22c8-c6e1-4f18-b4ff-8716500a5a41 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:16.853346 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-64fd63d0-32c7-4a34-8b1d-856991ea31ba req-d55b22c8-c6e1-4f18-b4ff-8716500a5a41 service nova] Creating event network-vif-unplugged:92b040e4-c42e-4653-af00-39d91e77f4d2 for instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 on n-h1-853611-3 Aug 18 12:30:16.860873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-64fd63d0-32c7-4a34-8b1d-856991ea31ba req-d55b22c8-c6e1-4f18-b4ff-8716500a5a41 service nova] Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:30:16.875499 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-64fd63d0-32c7-4a34-8b1d-856991ea31ba req-d55b22c8-c6e1-4f18-b4ff-8716500a5a41 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059680 Aug 18 12:30:16.876556 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4039/6693] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:30:17.855310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0952d8bb-c3a0-41f5-85ba-beebf22ed705 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:17.856392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0952d8bb-c3a0-41f5-85ba-beebf22ed705 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:17.864935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0952d8bb-c3a0-41f5-85ba-beebf22ed705 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:17.866212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0952d8bb-c3a0-41f5-85ba-beebf22ed705 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:17.867248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0952d8bb-c3a0-41f5-85ba-beebf22ed705 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:17.868350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0952d8bb-c3a0-41f5-85ba-beebf22ed705 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:17.868910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0952d8bb-c3a0-41f5-85ba-beebf22ed705 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:17.869784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0952d8bb-c3a0-41f5-85ba-beebf22ed705 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:18.094359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0952d8bb-c3a0-41f5-85ba-beebf22ed705 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:18.103201 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0952d8bb-c3a0-41f5-85ba-beebf22ed705 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1679 microversion: 2.1 time: 0.253761 Aug 18 12:30:18.103808 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4040/6694] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:17 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1679 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:18.894593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-651fe543-8261-4351-b426-da9bf8897b92 req-80efa11b-5fdf-4d37-aeb3-8eb7bd451c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "543b0855-c82a-4ccf-aac0-3b6feecde8e6", "tag": "92b040e4-c42e-4653-af00-39d91e77f4d2"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:18.906409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-651fe543-8261-4351-b426-da9bf8897b92 req-80efa11b-5fdf-4d37-aeb3-8eb7bd451c37 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:18.907134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-651fe543-8261-4351-b426-da9bf8897b92 req-80efa11b-5fdf-4d37-aeb3-8eb7bd451c37 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:18.907558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-651fe543-8261-4351-b426-da9bf8897b92 req-80efa11b-5fdf-4d37-aeb3-8eb7bd451c37 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:18.921320 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-651fe543-8261-4351-b426-da9bf8897b92 req-80efa11b-5fdf-4d37-aeb3-8eb7bd451c37 service nova] Creating event network-changed:92b040e4-c42e-4653-af00-39d91e77f4d2 for instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 on n-h1-853611-3 Aug 18 12:30:18.928195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-651fe543-8261-4351-b426-da9bf8897b92 req-80efa11b-5fdf-4d37-aeb3-8eb7bd451c37 service nova] Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:30:18.947087 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-651fe543-8261-4351-b426-da9bf8897b92 req-80efa11b-5fdf-4d37-aeb3-8eb7bd451c37 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057034 Aug 18 12:30:18.947971 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4041/6695] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:30:19.127503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f67aebfe-840d-4b61-be0f-4d668d91a31c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:19.129062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f67aebfe-840d-4b61-be0f-4d668d91a31c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:19.136719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f67aebfe-840d-4b61-be0f-4d668d91a31c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:19.137641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f67aebfe-840d-4b61-be0f-4d668d91a31c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:19.138311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f67aebfe-840d-4b61-be0f-4d668d91a31c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:19.139103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f67aebfe-840d-4b61-be0f-4d668d91a31c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:19.139698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f67aebfe-840d-4b61-be0f-4d668d91a31c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:19.140480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f67aebfe-840d-4b61-be0f-4d668d91a31c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:19.549354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f67aebfe-840d-4b61-be0f-4d668d91a31c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:19.565191 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f67aebfe-840d-4b61-be0f-4d668d91a31c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1675 microversion: 2.1 time: 0.442681 Aug 18 12:30:19.566291 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4042/6696] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:19 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1675 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:19.604925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5abb570d-9590-4b83-b04a-ad3f7dcd01a4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:19.605900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5abb570d-9590-4b83-b04a-ad3f7dcd01a4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:19.617606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5abb570d-9590-4b83-b04a-ad3f7dcd01a4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:19.618527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5abb570d-9590-4b83-b04a-ad3f7dcd01a4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:19.619346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5abb570d-9590-4b83-b04a-ad3f7dcd01a4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:19.620648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5abb570d-9590-4b83-b04a-ad3f7dcd01a4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:19.621512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5abb570d-9590-4b83-b04a-ad3f7dcd01a4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:19.622319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5abb570d-9590-4b83-b04a-ad3f7dcd01a4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:19.731454 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5abb570d-9590-4b83-b04a-ad3f7dcd01a4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6/action" status: 204 len: 0 microversion: 2.1 time: 0.133981 Aug 18 12:30:19.732531 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4043/6697] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:30:19 2022] POST /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6/action => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:30:19.751706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6efd90c8-ccaa-45b4-8e3e-d2843feb96e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:19.752979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6efd90c8-ccaa-45b4-8e3e-d2843feb96e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:19.764988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6efd90c8-ccaa-45b4-8e3e-d2843feb96e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:19.766056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6efd90c8-ccaa-45b4-8e3e-d2843feb96e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:19.766893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6efd90c8-ccaa-45b4-8e3e-d2843feb96e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:19.768282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6efd90c8-ccaa-45b4-8e3e-d2843feb96e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:19.769171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6efd90c8-ccaa-45b4-8e3e-d2843feb96e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:19.770009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6efd90c8-ccaa-45b4-8e3e-d2843feb96e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:20.205052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6efd90c8-ccaa-45b4-8e3e-d2843feb96e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:20.215567 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6efd90c8-ccaa-45b4-8e3e-d2843feb96e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1675 microversion: 2.1 time: 0.473153 Aug 18 12:30:20.216410 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4044/6698] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:19 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1675 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:21.257926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2816cfac-e9d0-4c18-88b2-9dab7865abab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:21.259045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2816cfac-e9d0-4c18-88b2-9dab7865abab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:21.270784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2816cfac-e9d0-4c18-88b2-9dab7865abab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:21.271307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2816cfac-e9d0-4c18-88b2-9dab7865abab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:21.271778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2816cfac-e9d0-4c18-88b2-9dab7865abab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:21.272528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2816cfac-e9d0-4c18-88b2-9dab7865abab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:21.272999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2816cfac-e9d0-4c18-88b2-9dab7865abab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:21.273450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2816cfac-e9d0-4c18-88b2-9dab7865abab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:21.512797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2816cfac-e9d0-4c18-88b2-9dab7865abab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:21.529048 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2816cfac-e9d0-4c18-88b2-9dab7865abab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1675 microversion: 2.1 time: 0.278616 Aug 18 12:30:21.531005 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4045/6699] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:21 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1675 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:22.564223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-365ebfc1-c212-46d9-a810-4a0ef736699b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:22.565344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-365ebfc1-c212-46d9-a810-4a0ef736699b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:22.574422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-365ebfc1-c212-46d9-a810-4a0ef736699b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:22.575047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-365ebfc1-c212-46d9-a810-4a0ef736699b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:22.576469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-365ebfc1-c212-46d9-a810-4a0ef736699b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:22.576773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-365ebfc1-c212-46d9-a810-4a0ef736699b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:22.577378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-365ebfc1-c212-46d9-a810-4a0ef736699b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:22.578136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-365ebfc1-c212-46d9-a810-4a0ef736699b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:22.765196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-365ebfc1-c212-46d9-a810-4a0ef736699b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:22.774126 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-365ebfc1-c212-46d9-a810-4a0ef736699b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1654 microversion: 2.1 time: 0.213744 Aug 18 12:30:22.775532 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4046/6700] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:22 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1654 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:22.799423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c633307d-5448-432e-8a45-46ad1fb035eb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:22.800575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c633307d-5448-432e-8a45-46ad1fb035eb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:22.808532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c633307d-5448-432e-8a45-46ad1fb035eb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:22.809424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c633307d-5448-432e-8a45-46ad1fb035eb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:22.810213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c633307d-5448-432e-8a45-46ad1fb035eb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:22.811174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c633307d-5448-432e-8a45-46ad1fb035eb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:22.811708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c633307d-5448-432e-8a45-46ad1fb035eb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:22.812366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c633307d-5448-432e-8a45-46ad1fb035eb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:23.018590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c633307d-5448-432e-8a45-46ad1fb035eb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:23.028186 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c633307d-5448-432e-8a45-46ad1fb035eb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1654 microversion: 2.1 time: 0.234246 Aug 18 12:30:23.028869 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4047/6701] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:22 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1654 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:23.050716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a9758666-fa71-4b79-87c9-c79b3ae3fdf6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:23.057924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9758666-fa71-4b79-87c9-c79b3ae3fdf6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:23.060202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9758666-fa71-4b79-87c9-c79b3ae3fdf6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:23.060202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9758666-fa71-4b79-87c9-c79b3ae3fdf6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:23.096446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a9758666-fa71-4b79-87c9-c79b3ae3fdf6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Going to try to start instance {{(pid=122210) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 18 12:30:23.157143 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a9758666-fa71-4b79-87c9-c79b3ae3fdf6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6/action" status: 202 len: 0 microversion: 2.1 time: 0.109627 Aug 18 12:30:23.158062 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4048/6702] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:30:23 2022] POST /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:30:23.168303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1c25bebc-321f-464e-abea-37bdc2c7575f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:23.169021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1c25bebc-321f-464e-abea-37bdc2c7575f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:23.178922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c25bebc-321f-464e-abea-37bdc2c7575f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:23.179693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c25bebc-321f-464e-abea-37bdc2c7575f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:23.180578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c25bebc-321f-464e-abea-37bdc2c7575f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:23.182283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c25bebc-321f-464e-abea-37bdc2c7575f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:23.186458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c25bebc-321f-464e-abea-37bdc2c7575f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:23.187594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c25bebc-321f-464e-abea-37bdc2c7575f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:23.493947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1c25bebc-321f-464e-abea-37bdc2c7575f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:23.508302 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1c25bebc-321f-464e-abea-37bdc2c7575f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1663 microversion: 2.1 time: 0.344558 Aug 18 12:30:23.509360 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4049/6703] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:23 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1663 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:23.904600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-b6156510-1153-4787-a5bc-f7999d37a035 req-1543dafb-f5dc-421b-8662-c242c1fdf8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543b0855-c82a-4ccf-aac0-3b6feecde8e6", "name": "network-vif-plugged", "status": "completed", "tag": "92b040e4-c42e-4653-af00-39d91e77f4d2"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:23.925235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b6156510-1153-4787-a5bc-f7999d37a035 req-1543dafb-f5dc-421b-8662-c242c1fdf8c8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:23.926520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b6156510-1153-4787-a5bc-f7999d37a035 req-1543dafb-f5dc-421b-8662-c242c1fdf8c8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:23.928418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-b6156510-1153-4787-a5bc-f7999d37a035 req-1543dafb-f5dc-421b-8662-c242c1fdf8c8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:23.949515 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-b6156510-1153-4787-a5bc-f7999d37a035 req-1543dafb-f5dc-421b-8662-c242c1fdf8c8 service nova] Creating event network-vif-plugged:92b040e4-c42e-4653-af00-39d91e77f4d2 for instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 on n-h1-853611-3 Aug 18 12:30:23.958467 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-b6156510-1153-4787-a5bc-f7999d37a035 req-1543dafb-f5dc-421b-8662-c242c1fdf8c8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141244 Aug 18 12:30:23.959586 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4050/6704] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:30:24.545524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-31f6bc55-a131-460a-b963-45cab0b6ddbd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:24.548156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-31f6bc55-a131-460a-b963-45cab0b6ddbd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:24.559884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31f6bc55-a131-460a-b963-45cab0b6ddbd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:24.560927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31f6bc55-a131-460a-b963-45cab0b6ddbd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:24.563356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31f6bc55-a131-460a-b963-45cab0b6ddbd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:24.565424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31f6bc55-a131-460a-b963-45cab0b6ddbd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:24.566463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31f6bc55-a131-460a-b963-45cab0b6ddbd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:24.567373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-31f6bc55-a131-460a-b963-45cab0b6ddbd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:24.749876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-31f6bc55-a131-460a-b963-45cab0b6ddbd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:24.759575 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-31f6bc55-a131-460a-b963-45cab0b6ddbd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1663 microversion: 2.1 time: 0.224685 Aug 18 12:30:24.760285 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4051/6705] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:24 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1663 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:25.782648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5c8c4486-2ce6-4d53-837f-00a4a52d74b7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:25.783450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5c8c4486-2ce6-4d53-837f-00a4a52d74b7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:25.793860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c8c4486-2ce6-4d53-837f-00a4a52d74b7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:25.794870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c8c4486-2ce6-4d53-837f-00a4a52d74b7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:25.796846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c8c4486-2ce6-4d53-837f-00a4a52d74b7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:25.798240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c8c4486-2ce6-4d53-837f-00a4a52d74b7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:25.799160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c8c4486-2ce6-4d53-837f-00a4a52d74b7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:25.799978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c8c4486-2ce6-4d53-837f-00a4a52d74b7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:25.810751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:25.966363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5c8c4486-2ce6-4d53-837f-00a4a52d74b7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:25.980433 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5c8c4486-2ce6-4d53-837f-00a4a52d74b7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1667 microversion: 2.1 time: 0.201640 Aug 18 12:30:25.981506 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4052/6706] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:25 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1667 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:26.015954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eb851a5c-bc58-4daa-97f1-f3b14b4139ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:26.016459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eb851a5c-bc58-4daa-97f1-f3b14b4139ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:26.023534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb851a5c-bc58-4daa-97f1-f3b14b4139ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:26.024056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb851a5c-bc58-4daa-97f1-f3b14b4139ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:26.024521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb851a5c-bc58-4daa-97f1-f3b14b4139ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:26.025275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb851a5c-bc58-4daa-97f1-f3b14b4139ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:26.025758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb851a5c-bc58-4daa-97f1-f3b14b4139ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:26.026206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb851a5c-bc58-4daa-97f1-f3b14b4139ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:26.057686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eb851a5c-bc58-4daa-97f1-f3b14b4139ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:30:26.157728 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eb851a5c-bc58-4daa-97f1-f3b14b4139ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "DELETE /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 204 len: 0 microversion: 2.1 time: 0.146091 Aug 18 12:30:26.158803 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4053/6707] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:30:26 2022] DELETE /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:30:26.170295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bbe98f0f-eafb-45e8-a29b-9299e25f020e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:26.171756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bbe98f0f-eafb-45e8-a29b-9299e25f020e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:26.179328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbe98f0f-eafb-45e8-a29b-9299e25f020e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:26.179991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbe98f0f-eafb-45e8-a29b-9299e25f020e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:26.180650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbe98f0f-eafb-45e8-a29b-9299e25f020e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:26.181572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbe98f0f-eafb-45e8-a29b-9299e25f020e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:26.182142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbe98f0f-eafb-45e8-a29b-9299e25f020e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:26.182743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bbe98f0f-eafb-45e8-a29b-9299e25f020e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:26.345942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bbe98f0f-eafb-45e8-a29b-9299e25f020e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:26.355684 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bbe98f0f-eafb-45e8-a29b-9299e25f020e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1673 microversion: 2.1 time: 0.190725 Aug 18 12:30:26.356332 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4054/6708] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:26 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1673 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:27.380027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-48df03b0-520e-4c06-a8b7-8e51f1ea770a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:27.380995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-48df03b0-520e-4c06-a8b7-8e51f1ea770a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:27.389991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48df03b0-520e-4c06-a8b7-8e51f1ea770a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:27.390589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48df03b0-520e-4c06-a8b7-8e51f1ea770a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:27.391318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48df03b0-520e-4c06-a8b7-8e51f1ea770a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:27.392082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48df03b0-520e-4c06-a8b7-8e51f1ea770a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:27.392595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48df03b0-520e-4c06-a8b7-8e51f1ea770a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:27.393052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48df03b0-520e-4c06-a8b7-8e51f1ea770a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:27.553949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-48df03b0-520e-4c06-a8b7-8e51f1ea770a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:27.568785 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-48df03b0-520e-4c06-a8b7-8e51f1ea770a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1673 microversion: 2.1 time: 0.192690 Aug 18 12:30:27.569951 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4055/6709] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:27 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1673 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:28.606765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e702e1b-d593-4131-9de1-b68858c341e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:28.607718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9e702e1b-d593-4131-9de1-b68858c341e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:28.616728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e702e1b-d593-4131-9de1-b68858c341e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:28.617328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e702e1b-d593-4131-9de1-b68858c341e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:28.617914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e702e1b-d593-4131-9de1-b68858c341e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:28.618955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e702e1b-d593-4131-9de1-b68858c341e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:28.619640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e702e1b-d593-4131-9de1-b68858c341e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:28.620208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e702e1b-d593-4131-9de1-b68858c341e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:28.906184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9e702e1b-d593-4131-9de1-b68858c341e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:28.914393 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9e702e1b-d593-4131-9de1-b68858c341e6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 200 len: 1606 microversion: 2.1 time: 0.311885 Aug 18 12:30:28.916571 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4056/6710] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:28 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 1606 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:29.042361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-861cbd18-423f-40ab-8cf9-2bfc44629913 req-2bb233ee-8dd5-42be-8827-e564d0c320b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543b0855-c82a-4ccf-aac0-3b6feecde8e6", "name": "network-vif-deleted", "tag": "92b040e4-c42e-4653-af00-39d91e77f4d2"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:29.057823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-861cbd18-423f-40ab-8cf9-2bfc44629913 req-2bb233ee-8dd5-42be-8827-e564d0c320b6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:29.058754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-861cbd18-423f-40ab-8cf9-2bfc44629913 req-2bb233ee-8dd5-42be-8827-e564d0c320b6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:29.059509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-861cbd18-423f-40ab-8cf9-2bfc44629913 req-2bb233ee-8dd5-42be-8827-e564d0c320b6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:29.082116 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-861cbd18-423f-40ab-8cf9-2bfc44629913 req-2bb233ee-8dd5-42be-8827-e564d0c320b6 service nova] Creating event network-vif-deleted:92b040e4-c42e-4653-af00-39d91e77f4d2 for instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 on n-h1-853611-3 Aug 18 12:30:29.088602 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-861cbd18-423f-40ab-8cf9-2bfc44629913 req-2bb233ee-8dd5-42be-8827-e564d0c320b6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051601 Aug 18 12:30:29.089469 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4057/6711] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:30:29.943292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ae28b537-d074-4512-a894-4e944ce4bab8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:29.944233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ae28b537-d074-4512-a894-4e944ce4bab8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:29.946756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:29.956306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae28b537-d074-4512-a894-4e944ce4bab8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:29.957104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae28b537-d074-4512-a894-4e944ce4bab8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:29.957904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae28b537-d074-4512-a894-4e944ce4bab8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:29.959154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae28b537-d074-4512-a894-4e944ce4bab8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:29.959937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae28b537-d074-4512-a894-4e944ce4bab8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:29.960613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae28b537-d074-4512-a894-4e944ce4bab8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:29.987212 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-ae28b537-d074-4512-a894-4e944ce4bab8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ae28b537-d074-4512-a894-4e944ce4bab8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 HTTP/1.1 Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '543b0855-c82a-4ccf-aac0-3b6feecde8e6'} Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:30:29.989886 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:30:29.998594 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:30:29.998594 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:30:29.998594 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:30:29.998594 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:30:29.998594 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:30:29.998594 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:30:29.998594 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:30:29.998594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ae28b537-d074-4512-a894-4e944ce4bab8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:30:29.998594 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ae28b537-d074-4512-a894-4e944ce4bab8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 404 len: 111 microversion: 2.1 time: 0.058814 Aug 18 12:30:29.998594 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4058/6712] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:29 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:30:30.012098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-35f5e447-a8bb-4df8-add1-936fb3c2d19c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:30.012861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-35f5e447-a8bb-4df8-add1-936fb3c2d19c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:30.020770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35f5e447-a8bb-4df8-add1-936fb3c2d19c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:30.021332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35f5e447-a8bb-4df8-add1-936fb3c2d19c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:30.021824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35f5e447-a8bb-4df8-add1-936fb3c2d19c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:30.022751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35f5e447-a8bb-4df8-add1-936fb3c2d19c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:30.023371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35f5e447-a8bb-4df8-add1-936fb3c2d19c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:30.024138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35f5e447-a8bb-4df8-add1-936fb3c2d19c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:30.043889 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-35f5e447-a8bb-4df8-add1-936fb3c2d19c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-35f5e447-a8bb-4df8-add1-936fb3c2d19c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 HTTP/1.1 Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '543b0855-c82a-4ccf-aac0-3b6feecde8e6'} Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:30:30.044890 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:30:30.059738 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:30:30.059738 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:30:30.059738 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:30:30.059738 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:30:30.059738 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:30:30.059738 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:30:30.059738 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:30:30.059738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-35f5e447-a8bb-4df8-add1-936fb3c2d19c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:30:30.059738 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-35f5e447-a8bb-4df8-add1-936fb3c2d19c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 404 len: 111 microversion: 2.1 time: 0.040392 Aug 18 12:30:30.059738 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4059/6713] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:30 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:30:30.138626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-552649464", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "223e769f-74d3-491d-9f22-cb5f7423c3de"}], "security_groups": [{"name": "tempest-securitygroup--514773839"}], "key_name": "tempest-keypair-128691123", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:30.326482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] validate_networks() for [('223e769f-74d3-491d-9f22-cb5f7423c3de', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:30:30.960658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:30:30.961279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:30:30.961577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:30:30.962054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:30:30.962538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:30:30.973092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:30.973485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:30.974135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:30.975126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:30.975602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:30.976052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:30.997887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Getting quotas for project 52c152e60a4d4bce86773ea6a2e25fc4. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:30:31.005087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Getting quotas for user 6da9f8c739314b6a842c84bf71786f78 and project 52c152e60a4d4bce86773ea6a2e25fc4. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:30:31.021395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:30:31.023855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:30:31.075820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-264ae6f6-8738-47fa-8a69-3db1212607d3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.944831 Aug 18 12:30:31.076687 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4060/6714] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:30:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:30:31.097210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3e0bb5f7-c99b-4051-bda1-6c1d5c1a3b1c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:31.098593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3e0bb5f7-c99b-4051-bda1-6c1d5c1a3b1c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:31.199764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3e0bb5f7-c99b-4051-bda1-6c1d5c1a3b1c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:31.212429 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3e0bb5f7-c99b-4051-bda1-6c1d5c1a3b1c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1237 microversion: 2.1 time: 0.121365 Aug 18 12:30:31.212429 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4061/6715] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:31 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1237 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:32.235437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d4d42132-fde8-418b-9478-99fd5c7916c1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:32.236948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d4d42132-fde8-418b-9478-99fd5c7916c1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:32.247466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4d42132-fde8-418b-9478-99fd5c7916c1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:32.248988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4d42132-fde8-418b-9478-99fd5c7916c1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:32.250151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4d42132-fde8-418b-9478-99fd5c7916c1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:32.251892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4d42132-fde8-418b-9478-99fd5c7916c1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:32.253103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4d42132-fde8-418b-9478-99fd5c7916c1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:32.254233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4d42132-fde8-418b-9478-99fd5c7916c1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:32.366144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d4d42132-fde8-418b-9478-99fd5c7916c1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:32.377346 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d4d42132-fde8-418b-9478-99fd5c7916c1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1297 microversion: 2.1 time: 0.146712 Aug 18 12:30:32.378160 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4062/6716] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:32 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1297 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:33.401501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b3078fe-75f7-4982-9a3c-67804dff0f92 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:33.402413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b3078fe-75f7-4982-9a3c-67804dff0f92 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:33.412305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b3078fe-75f7-4982-9a3c-67804dff0f92 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:33.412831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b3078fe-75f7-4982-9a3c-67804dff0f92 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:33.413295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b3078fe-75f7-4982-9a3c-67804dff0f92 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:33.414065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b3078fe-75f7-4982-9a3c-67804dff0f92 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:33.414590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b3078fe-75f7-4982-9a3c-67804dff0f92 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:33.415051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b3078fe-75f7-4982-9a3c-67804dff0f92 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:33.654511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5b3078fe-75f7-4982-9a3c-67804dff0f92 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:33.662959 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b3078fe-75f7-4982-9a3c-67804dff0f92 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1362 microversion: 2.1 time: 0.265465 Aug 18 12:30:33.663703 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4063/6717] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:33 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:34.085063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1d24b4b6-d0be-49b6-9723-c0b64bbf3e66 req-2cb8c5d1-2cfb-42df-8854-eceb3ec38c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f910523b-f6f1-4366-9fd8-5316a184943c", "tag": "96612db5-9979-4a5d-9255-e7a3dc9a3d96"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:34.110648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1d24b4b6-d0be-49b6-9723-c0b64bbf3e66 req-2cb8c5d1-2cfb-42df-8854-eceb3ec38c43 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:34.111175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1d24b4b6-d0be-49b6-9723-c0b64bbf3e66 req-2cb8c5d1-2cfb-42df-8854-eceb3ec38c43 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:34.111636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1d24b4b6-d0be-49b6-9723-c0b64bbf3e66 req-2cb8c5d1-2cfb-42df-8854-eceb3ec38c43 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:34.125590 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1d24b4b6-d0be-49b6-9723-c0b64bbf3e66 req-2cb8c5d1-2cfb-42df-8854-eceb3ec38c43 service nova] Creating event network-changed:96612db5-9979-4a5d-9255-e7a3dc9a3d96 for instance f910523b-f6f1-4366-9fd8-5316a184943c on n-h2-853611-3 Aug 18 12:30:34.131567 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1d24b4b6-d0be-49b6-9723-c0b64bbf3e66 req-2cb8c5d1-2cfb-42df-8854-eceb3ec38c43 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055726 Aug 18 12:30:34.132204 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4064/6718] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:30:34.693607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3693d453-9817-4f93-9630-9e10d0160e26 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:34.694466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3693d453-9817-4f93-9630-9e10d0160e26 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:34.705649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3693d453-9817-4f93-9630-9e10d0160e26 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:34.706621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3693d453-9817-4f93-9630-9e10d0160e26 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:34.707445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3693d453-9817-4f93-9630-9e10d0160e26 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:34.708802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3693d453-9817-4f93-9630-9e10d0160e26 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:34.709668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3693d453-9817-4f93-9630-9e10d0160e26 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:34.710496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3693d453-9817-4f93-9630-9e10d0160e26 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:34.897736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3693d453-9817-4f93-9630-9e10d0160e26 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:34.906986 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3693d453-9817-4f93-9630-9e10d0160e26 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1362 microversion: 2.1 time: 0.219320 Aug 18 12:30:34.907685 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4065/6719] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:34 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:35.930997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-81372c94-d010-4ebe-ac1a-ad520a5a70b1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:35.931969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-81372c94-d010-4ebe-ac1a-ad520a5a70b1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:35.942577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81372c94-d010-4ebe-ac1a-ad520a5a70b1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:35.943458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81372c94-d010-4ebe-ac1a-ad520a5a70b1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:35.944246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81372c94-d010-4ebe-ac1a-ad520a5a70b1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:35.945515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81372c94-d010-4ebe-ac1a-ad520a5a70b1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:35.946339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81372c94-d010-4ebe-ac1a-ad520a5a70b1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:35.947169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81372c94-d010-4ebe-ac1a-ad520a5a70b1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:36.111797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-81372c94-d010-4ebe-ac1a-ad520a5a70b1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:36.120647 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-81372c94-d010-4ebe-ac1a-ad520a5a70b1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1362 microversion: 2.1 time: 0.195158 Aug 18 12:30:36.121405 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4066/6720] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:35 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:37.144510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1026ce28-a0fa-41e1-a9ed-ee50f9a4fd52 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:37.145364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1026ce28-a0fa-41e1-a9ed-ee50f9a4fd52 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:37.152849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1026ce28-a0fa-41e1-a9ed-ee50f9a4fd52 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:37.153359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1026ce28-a0fa-41e1-a9ed-ee50f9a4fd52 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:37.153811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1026ce28-a0fa-41e1-a9ed-ee50f9a4fd52 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:37.154594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1026ce28-a0fa-41e1-a9ed-ee50f9a4fd52 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:37.155076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1026ce28-a0fa-41e1-a9ed-ee50f9a4fd52 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:37.155515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1026ce28-a0fa-41e1-a9ed-ee50f9a4fd52 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:37.332803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1026ce28-a0fa-41e1-a9ed-ee50f9a4fd52 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:37.344344 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1026ce28-a0fa-41e1-a9ed-ee50f9a4fd52 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1362 microversion: 2.1 time: 0.204446 Aug 18 12:30:37.345302 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4067/6721] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:37 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:38.370034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94497201-8742-41f1-9a32-3041c3e77a8a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:38.370959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-94497201-8742-41f1-9a32-3041c3e77a8a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:38.379053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94497201-8742-41f1-9a32-3041c3e77a8a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:38.379572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94497201-8742-41f1-9a32-3041c3e77a8a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:38.380028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94497201-8742-41f1-9a32-3041c3e77a8a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:38.380767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94497201-8742-41f1-9a32-3041c3e77a8a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:38.381243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94497201-8742-41f1-9a32-3041c3e77a8a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:38.381692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94497201-8742-41f1-9a32-3041c3e77a8a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:38.541797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-94497201-8742-41f1-9a32-3041c3e77a8a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:38.554042 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-94497201-8742-41f1-9a32-3041c3e77a8a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1362 microversion: 2.1 time: 0.187732 Aug 18 12:30:38.555126 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4068/6722] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:38 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:39.486514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-38f6d49f-f5a6-4ea5-bafd-429b35ece602 req-33737e03-d053-440f-a2e6-581083c5c170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f910523b-f6f1-4366-9fd8-5316a184943c", "name": "network-vif-plugged", "status": "completed", "tag": "96612db5-9979-4a5d-9255-e7a3dc9a3d96"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:39.497721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-38f6d49f-f5a6-4ea5-bafd-429b35ece602 req-33737e03-d053-440f-a2e6-581083c5c170 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:39.498217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-38f6d49f-f5a6-4ea5-bafd-429b35ece602 req-33737e03-d053-440f-a2e6-581083c5c170 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:39.499573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-38f6d49f-f5a6-4ea5-bafd-429b35ece602 req-33737e03-d053-440f-a2e6-581083c5c170 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:39.512913 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-38f6d49f-f5a6-4ea5-bafd-429b35ece602 req-33737e03-d053-440f-a2e6-581083c5c170 service nova] Creating event network-vif-plugged:96612db5-9979-4a5d-9255-e7a3dc9a3d96 for instance f910523b-f6f1-4366-9fd8-5316a184943c on n-h2-853611-3 Aug 18 12:30:39.520355 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-38f6d49f-f5a6-4ea5-bafd-429b35ece602 req-33737e03-d053-440f-a2e6-581083c5c170 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037701 Aug 18 12:30:39.521445 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4069/6723] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:30:39.582544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3fbeba67-12d1-4c2f-9071-9ceedfd88187 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:39.583421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3fbeba67-12d1-4c2f-9071-9ceedfd88187 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:39.594308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3fbeba67-12d1-4c2f-9071-9ceedfd88187 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:39.595271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3fbeba67-12d1-4c2f-9071-9ceedfd88187 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:39.596099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3fbeba67-12d1-4c2f-9071-9ceedfd88187 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:39.597418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3fbeba67-12d1-4c2f-9071-9ceedfd88187 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:39.598652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3fbeba67-12d1-4c2f-9071-9ceedfd88187 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:39.599468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3fbeba67-12d1-4c2f-9071-9ceedfd88187 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:39.821920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3fbeba67-12d1-4c2f-9071-9ceedfd88187 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:39.831999 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3fbeba67-12d1-4c2f-9071-9ceedfd88187 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1362 microversion: 2.1 time: 0.256890 Aug 18 12:30:39.832831 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4070/6724] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:39 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:30:40.861952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c3e41a0-4af0-4a10-9aff-5049c2afdc18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:40.863236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4c3e41a0-4af0-4a10-9aff-5049c2afdc18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:40.877318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c3e41a0-4af0-4a10-9aff-5049c2afdc18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:40.878078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c3e41a0-4af0-4a10-9aff-5049c2afdc18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:40.878831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c3e41a0-4af0-4a10-9aff-5049c2afdc18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:40.880057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c3e41a0-4af0-4a10-9aff-5049c2afdc18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:40.880909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c3e41a0-4af0-4a10-9aff-5049c2afdc18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:40.881832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c3e41a0-4af0-4a10-9aff-5049c2afdc18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:40.987661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:41.112670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4c3e41a0-4af0-4a10-9aff-5049c2afdc18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:41.121235 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4c3e41a0-4af0-4a10-9aff-5049c2afdc18 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1362 microversion: 2.1 time: 0.268071 Aug 18 12:30:41.121996 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4071/6725] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:40 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:42.144919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3f0b01b4-486f-4faf-88af-8a0ae80d20cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:42.145920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3f0b01b4-486f-4faf-88af-8a0ae80d20cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:42.148219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:42.156281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f0b01b4-486f-4faf-88af-8a0ae80d20cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:42.156794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f0b01b4-486f-4faf-88af-8a0ae80d20cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:42.157250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f0b01b4-486f-4faf-88af-8a0ae80d20cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:42.157992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f0b01b4-486f-4faf-88af-8a0ae80d20cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:42.158498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f0b01b4-486f-4faf-88af-8a0ae80d20cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:42.158944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f0b01b4-486f-4faf-88af-8a0ae80d20cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:42.162069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:30:42.331613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3f0b01b4-486f-4faf-88af-8a0ae80d20cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:30:42.340599 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3f0b01b4-486f-4faf-88af-8a0ae80d20cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1548 microversion: 2.1 time: 0.200081 Aug 18 12:30:42.341209 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4072/6726] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:30:42 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1548 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:30:42.379702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d4b39166-9067-4835-908f-35800d07a7fc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:30:42.380213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d4b39166-9067-4835-908f-35800d07a7fc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:30:42.386716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4b39166-9067-4835-908f-35800d07a7fc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:42.387225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4b39166-9067-4835-908f-35800d07a7fc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:42.387677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4b39166-9067-4835-908f-35800d07a7fc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:42.388416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4b39166-9067-4835-908f-35800d07a7fc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:42.388867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4b39166-9067-4835-908f-35800d07a7fc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:42.390063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d4b39166-9067-4835-908f-35800d07a7fc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:42.483096 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d4b39166-9067-4835-908f-35800d07a7fc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107568 Aug 18 12:30:42.484081 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4073/6727] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 12:30:42 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:30:44.045751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ad6b6be3-1400-42f6-a0ed-41db8663cf96 req-351fa46e-0031-4732-ad78-a96cd7b8fa76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f910523b-f6f1-4366-9fd8-5316a184943c", "tag": "96612db5-9979-4a5d-9255-e7a3dc9a3d96"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:30:44.056252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ad6b6be3-1400-42f6-a0ed-41db8663cf96 req-351fa46e-0031-4732-ad78-a96cd7b8fa76 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:30:44.056854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ad6b6be3-1400-42f6-a0ed-41db8663cf96 req-351fa46e-0031-4732-ad78-a96cd7b8fa76 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:30:44.057309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ad6b6be3-1400-42f6-a0ed-41db8663cf96 req-351fa46e-0031-4732-ad78-a96cd7b8fa76 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:30:44.071620 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ad6b6be3-1400-42f6-a0ed-41db8663cf96 req-351fa46e-0031-4732-ad78-a96cd7b8fa76 service nova] Creating event network-changed:96612db5-9979-4a5d-9255-e7a3dc9a3d96 for instance f910523b-f6f1-4366-9fd8-5316a184943c on n-h2-853611-3 Aug 18 12:30:44.078209 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ad6b6be3-1400-42f6-a0ed-41db8663cf96 req-351fa46e-0031-4732-ad78-a96cd7b8fa76 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037234 Aug 18 12:30:44.079192 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4074/6728] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:31:19.336736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:19.339559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:19.342247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:19.343979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=11 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:19.352096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:19.352657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:19.353172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:19.354014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:19.354757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:19.355283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:19.393828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:19.401867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Old instance type m1.heat2, new instance type m1.heat {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 12:31:19.410320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:31:19.410799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:31:19.411295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:31:19.411724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:31:19.412158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:31:19.493437 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fe2a37ba-ec96-4c71-9ae9-fd030f0bff56 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c/action" status: 202 len: 0 microversion: 2.1 time: 0.161753 Aug 18 12:31:19.494464 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4075/6729] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:31:19 2022] POST /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:31:19.508365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f15ffc9c-be7e-46e4-b6df-3512539a7273 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:19.509578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f15ffc9c-be7e-46e4-b6df-3512539a7273 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:19.521738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f15ffc9c-be7e-46e4-b6df-3512539a7273 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:19.522700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f15ffc9c-be7e-46e4-b6df-3512539a7273 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:19.523514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f15ffc9c-be7e-46e4-b6df-3512539a7273 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:19.524822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f15ffc9c-be7e-46e4-b6df-3512539a7273 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:19.525687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f15ffc9c-be7e-46e4-b6df-3512539a7273 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:19.526536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f15ffc9c-be7e-46e4-b6df-3512539a7273 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:19.822661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f15ffc9c-be7e-46e4-b6df-3512539a7273 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:19.834056 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f15ffc9c-be7e-46e4-b6df-3512539a7273 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1675 microversion: 2.1 time: 0.333233 Aug 18 12:31:19.835058 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4076/6730] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:19 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1675 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:20.866552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-45a7f0fc-fec3-44dc-8755-c9d36c481465 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:20.867407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-45a7f0fc-fec3-44dc-8755-c9d36c481465 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:20.876865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45a7f0fc-fec3-44dc-8755-c9d36c481465 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:20.877448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45a7f0fc-fec3-44dc-8755-c9d36c481465 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:20.877989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45a7f0fc-fec3-44dc-8755-c9d36c481465 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:20.878916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45a7f0fc-fec3-44dc-8755-c9d36c481465 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:20.879501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45a7f0fc-fec3-44dc-8755-c9d36c481465 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:20.879995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45a7f0fc-fec3-44dc-8755-c9d36c481465 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:21.072941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-45a7f0fc-fec3-44dc-8755-c9d36c481465 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:21.082702 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-45a7f0fc-fec3-44dc-8755-c9d36c481465 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1675 microversion: 2.1 time: 0.221115 Aug 18 12:31:21.083323 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4077/6731] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:20 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1675 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:22.106271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-410d0eca-edb6-4505-ab4f-832e371f54a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:22.107227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-410d0eca-edb6-4505-ab4f-832e371f54a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:22.116763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-410d0eca-edb6-4505-ab4f-832e371f54a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:22.117414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-410d0eca-edb6-4505-ab4f-832e371f54a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:22.117964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-410d0eca-edb6-4505-ab4f-832e371f54a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:22.118805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-410d0eca-edb6-4505-ab4f-832e371f54a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:22.119342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-410d0eca-edb6-4505-ab4f-832e371f54a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:22.119830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-410d0eca-edb6-4505-ab4f-832e371f54a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:22.299237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-410d0eca-edb6-4505-ab4f-832e371f54a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:22.307486 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-410d0eca-edb6-4505-ab4f-832e371f54a1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1680 microversion: 2.1 time: 0.205283 Aug 18 12:31:22.308095 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4078/6732] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:22 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1680 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:23.335813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a67434b6-46ff-4dba-9ece-272ef516969d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:23.336917 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a67434b6-46ff-4dba-9ece-272ef516969d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:23.355774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a67434b6-46ff-4dba-9ece-272ef516969d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:23.356287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a67434b6-46ff-4dba-9ece-272ef516969d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:23.356747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a67434b6-46ff-4dba-9ece-272ef516969d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:23.357494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a67434b6-46ff-4dba-9ece-272ef516969d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:23.358519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a67434b6-46ff-4dba-9ece-272ef516969d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:23.359589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a67434b6-46ff-4dba-9ece-272ef516969d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:23.529134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a67434b6-46ff-4dba-9ece-272ef516969d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:23.538699 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a67434b6-46ff-4dba-9ece-272ef516969d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1680 microversion: 2.1 time: 0.211815 Aug 18 12:31:23.539535 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4079/6733] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:23 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1680 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:24.566055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-75851721-2d05-4ebe-826a-0c7bb86bc570 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:24.566860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-75851721-2d05-4ebe-826a-0c7bb86bc570 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:24.574910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75851721-2d05-4ebe-826a-0c7bb86bc570 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:24.575420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75851721-2d05-4ebe-826a-0c7bb86bc570 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:24.575873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75851721-2d05-4ebe-826a-0c7bb86bc570 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:24.577206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75851721-2d05-4ebe-826a-0c7bb86bc570 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:24.577797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75851721-2d05-4ebe-826a-0c7bb86bc570 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:24.578305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75851721-2d05-4ebe-826a-0c7bb86bc570 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:24.739752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-75851721-2d05-4ebe-826a-0c7bb86bc570 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:24.755203 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-75851721-2d05-4ebe-826a-0c7bb86bc570 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1680 microversion: 2.1 time: 0.193844 Aug 18 12:31:24.756286 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4080/6734] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:24 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1680 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:25.792502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f3c34b8f-f534-40f2-a8f3-f2d784b58530 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:25.793382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f3c34b8f-f534-40f2-a8f3-f2d784b58530 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:25.801004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c34b8f-f534-40f2-a8f3-f2d784b58530 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:25.801515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c34b8f-f534-40f2-a8f3-f2d784b58530 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:25.801974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c34b8f-f534-40f2-a8f3-f2d784b58530 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:25.802737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c34b8f-f534-40f2-a8f3-f2d784b58530 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:25.803244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c34b8f-f534-40f2-a8f3-f2d784b58530 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:25.803703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c34b8f-f534-40f2-a8f3-f2d784b58530 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:25.960195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f3c34b8f-f534-40f2-a8f3-f2d784b58530 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:25.973422 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f3c34b8f-f534-40f2-a8f3-f2d784b58530 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1680 microversion: 2.1 time: 0.184625 Aug 18 12:31:25.974418 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4081/6735] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:25 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:27.011533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8acf630d-a8e6-4c1a-81a9-bfe5f010cf3d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:27.012379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8acf630d-a8e6-4c1a-81a9-bfe5f010cf3d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:27.022499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8acf630d-a8e6-4c1a-81a9-bfe5f010cf3d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:27.023001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8acf630d-a8e6-4c1a-81a9-bfe5f010cf3d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:27.023464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8acf630d-a8e6-4c1a-81a9-bfe5f010cf3d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:27.024209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8acf630d-a8e6-4c1a-81a9-bfe5f010cf3d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:27.024688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8acf630d-a8e6-4c1a-81a9-bfe5f010cf3d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:27.025134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8acf630d-a8e6-4c1a-81a9-bfe5f010cf3d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:27.179419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8acf630d-a8e6-4c1a-81a9-bfe5f010cf3d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:27.188496 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8acf630d-a8e6-4c1a-81a9-bfe5f010cf3d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1680 microversion: 2.1 time: 0.181682 Aug 18 12:31:27.189174 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4082/6736] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:27 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:28.211708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e8630e3-3d21-4050-a50c-400c2a487c44 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:28.212543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9e8630e3-3d21-4050-a50c-400c2a487c44 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:28.220577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e8630e3-3d21-4050-a50c-400c2a487c44 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:28.221096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e8630e3-3d21-4050-a50c-400c2a487c44 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:28.221560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e8630e3-3d21-4050-a50c-400c2a487c44 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:28.222317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e8630e3-3d21-4050-a50c-400c2a487c44 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:28.222847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e8630e3-3d21-4050-a50c-400c2a487c44 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:28.223311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e8630e3-3d21-4050-a50c-400c2a487c44 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:28.390669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9e8630e3-3d21-4050-a50c-400c2a487c44 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:28.399429 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9e8630e3-3d21-4050-a50c-400c2a487c44 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1680 microversion: 2.1 time: 0.191684 Aug 18 12:31:28.400127 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4083/6737] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:28 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:29.422671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a53068c4-47d7-4bfb-8768-0add1c5153e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:29.423437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a53068c4-47d7-4bfb-8768-0add1c5153e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:29.431080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a53068c4-47d7-4bfb-8768-0add1c5153e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:29.431462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a53068c4-47d7-4bfb-8768-0add1c5153e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:29.431925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a53068c4-47d7-4bfb-8768-0add1c5153e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:29.432670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a53068c4-47d7-4bfb-8768-0add1c5153e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:29.433145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a53068c4-47d7-4bfb-8768-0add1c5153e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:29.433597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a53068c4-47d7-4bfb-8768-0add1c5153e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:29.596117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a53068c4-47d7-4bfb-8768-0add1c5153e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:29.604915 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a53068c4-47d7-4bfb-8768-0add1c5153e4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1680 microversion: 2.1 time: 0.187302 Aug 18 12:31:29.605520 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4084/6738] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:29 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:30.643830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-69f002ed-67b0-4e32-b662-cf98be2bd652 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:30.644613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-69f002ed-67b0-4e32-b662-cf98be2bd652 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:30.652262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69f002ed-67b0-4e32-b662-cf98be2bd652 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:30.652775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69f002ed-67b0-4e32-b662-cf98be2bd652 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:30.653233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69f002ed-67b0-4e32-b662-cf98be2bd652 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:30.653977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69f002ed-67b0-4e32-b662-cf98be2bd652 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:30.654482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69f002ed-67b0-4e32-b662-cf98be2bd652 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:30.655490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69f002ed-67b0-4e32-b662-cf98be2bd652 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:30.875634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-69f002ed-67b0-4e32-b662-cf98be2bd652 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:30.884201 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-69f002ed-67b0-4e32-b662-cf98be2bd652 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1680 microversion: 2.1 time: 0.246819 Aug 18 12:31:30.884831 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4085/6739] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:30 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1680 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:31.911328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b6c46616-4cb5-454c-900a-40b852e72cfd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:31.912375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b6c46616-4cb5-454c-900a-40b852e72cfd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:31.925702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6c46616-4cb5-454c-900a-40b852e72cfd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:31.926614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6c46616-4cb5-454c-900a-40b852e72cfd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:31.927404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6c46616-4cb5-454c-900a-40b852e72cfd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:31.928685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6c46616-4cb5-454c-900a-40b852e72cfd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:31.929748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6c46616-4cb5-454c-900a-40b852e72cfd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:31.930553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6c46616-4cb5-454c-900a-40b852e72cfd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:32.130217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b6c46616-4cb5-454c-900a-40b852e72cfd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:32.145173 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b6c46616-4cb5-454c-900a-40b852e72cfd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1680 microversion: 2.1 time: 0.241403 Aug 18 12:31:32.146354 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4086/6740] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:31 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1680 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:33.182053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a60d8f7-e9e3-4a68-93cc-33300d15d071 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:33.182851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4a60d8f7-e9e3-4a68-93cc-33300d15d071 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:33.190950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a60d8f7-e9e3-4a68-93cc-33300d15d071 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:33.191469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a60d8f7-e9e3-4a68-93cc-33300d15d071 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:33.191920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a60d8f7-e9e3-4a68-93cc-33300d15d071 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:33.192660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a60d8f7-e9e3-4a68-93cc-33300d15d071 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:33.193138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a60d8f7-e9e3-4a68-93cc-33300d15d071 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:33.193611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a60d8f7-e9e3-4a68-93cc-33300d15d071 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:33.352118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4a60d8f7-e9e3-4a68-93cc-33300d15d071 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:33.360706 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4a60d8f7-e9e3-4a68-93cc-33300d15d071 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1680 microversion: 2.1 time: 0.182653 Aug 18 12:31:33.361319 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4087/6741] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:33 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:34.384476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ea28b7ee-4b79-4fa7-b9f4-39d42e11e991 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:34.385572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ea28b7ee-4b79-4fa7-b9f4-39d42e11e991 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:34.395799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea28b7ee-4b79-4fa7-b9f4-39d42e11e991 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:34.396456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea28b7ee-4b79-4fa7-b9f4-39d42e11e991 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:34.397021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea28b7ee-4b79-4fa7-b9f4-39d42e11e991 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:34.398018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea28b7ee-4b79-4fa7-b9f4-39d42e11e991 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:34.398853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea28b7ee-4b79-4fa7-b9f4-39d42e11e991 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:34.399367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea28b7ee-4b79-4fa7-b9f4-39d42e11e991 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:35.005887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ea28b7ee-4b79-4fa7-b9f4-39d42e11e991 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:35.019946 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ea28b7ee-4b79-4fa7-b9f4-39d42e11e991 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1679 microversion: 2.1 time: 0.639363 Aug 18 12:31:35.021032 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4088/6742] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:34 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1679 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:35.030746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-15efe8c4-d343-4b3c-9c83-12890a479309 req-40f926a4-010c-40cd-bc57-9fc2b5c343ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f910523b-f6f1-4366-9fd8-5316a184943c", "name": "network-vif-unplugged", "status": "completed", "tag": "96612db5-9979-4a5d-9255-e7a3dc9a3d96"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:35.049191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-15efe8c4-d343-4b3c-9c83-12890a479309 req-40f926a4-010c-40cd-bc57-9fc2b5c343ab service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:35.050107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-15efe8c4-d343-4b3c-9c83-12890a479309 req-40f926a4-010c-40cd-bc57-9fc2b5c343ab service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:35.051089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-15efe8c4-d343-4b3c-9c83-12890a479309 req-40f926a4-010c-40cd-bc57-9fc2b5c343ab service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:35.077102 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-15efe8c4-d343-4b3c-9c83-12890a479309 req-40f926a4-010c-40cd-bc57-9fc2b5c343ab service nova] Creating event network-vif-unplugged:96612db5-9979-4a5d-9255-e7a3dc9a3d96 for instance f910523b-f6f1-4366-9fd8-5316a184943c on n-h1-853611-3 Aug 18 12:31:35.088249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-15efe8c4-d343-4b3c-9c83-12890a479309 req-40f926a4-010c-40cd-bc57-9fc2b5c343ab service nova] Instance f910523b-f6f1-4366-9fd8-5316a184943c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:31:35.107489 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-15efe8c4-d343-4b3c-9c83-12890a479309 req-40f926a4-010c-40cd-bc57-9fc2b5c343ab service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084590 Aug 18 12:31:35.109848 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4089/6743] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:36.051041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f5387bc1-3ccf-4797-b2c7-68e66641bbef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:36.051974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f5387bc1-3ccf-4797-b2c7-68e66641bbef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:36.065298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5387bc1-3ccf-4797-b2c7-68e66641bbef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:36.066211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5387bc1-3ccf-4797-b2c7-68e66641bbef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:36.067061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5387bc1-3ccf-4797-b2c7-68e66641bbef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:36.068454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5387bc1-3ccf-4797-b2c7-68e66641bbef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:36.069348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5387bc1-3ccf-4797-b2c7-68e66641bbef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:36.070158 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5387bc1-3ccf-4797-b2c7-68e66641bbef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:36.110261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:36.300409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f5387bc1-3ccf-4797-b2c7-68e66641bbef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:36.315343 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f5387bc1-3ccf-4797-b2c7-68e66641bbef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1679 microversion: 2.1 time: 0.270941 Aug 18 12:31:36.316444 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4090/6744] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:36 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1679 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:37.131931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7a6e8d06-2061-44e2-b50e-a6693541123a req-9bcb7922-4837-4efe-86bd-40377686e21f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f910523b-f6f1-4366-9fd8-5316a184943c", "tag": "96612db5-9979-4a5d-9255-e7a3dc9a3d96"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:37.144581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a6e8d06-2061-44e2-b50e-a6693541123a req-9bcb7922-4837-4efe-86bd-40377686e21f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:37.145198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a6e8d06-2061-44e2-b50e-a6693541123a req-9bcb7922-4837-4efe-86bd-40377686e21f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:37.145716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a6e8d06-2061-44e2-b50e-a6693541123a req-9bcb7922-4837-4efe-86bd-40377686e21f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:37.160543 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7a6e8d06-2061-44e2-b50e-a6693541123a req-9bcb7922-4837-4efe-86bd-40377686e21f service nova] Creating event network-changed:96612db5-9979-4a5d-9255-e7a3dc9a3d96 for instance f910523b-f6f1-4366-9fd8-5316a184943c on n-h1-853611-3 Aug 18 12:31:37.167008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-7a6e8d06-2061-44e2-b50e-a6693541123a req-9bcb7922-4837-4efe-86bd-40377686e21f service nova] Instance f910523b-f6f1-4366-9fd8-5316a184943c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:31:37.180154 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7a6e8d06-2061-44e2-b50e-a6693541123a req-9bcb7922-4837-4efe-86bd-40377686e21f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052004 Aug 18 12:31:37.180978 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4091/6745] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:31:37.341954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d52839ea-8a81-4fa6-8245-44c6443c736f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:37.343499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d52839ea-8a81-4fa6-8245-44c6443c736f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:37.351786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d52839ea-8a81-4fa6-8245-44c6443c736f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:37.352435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d52839ea-8a81-4fa6-8245-44c6443c736f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:37.352902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d52839ea-8a81-4fa6-8245-44c6443c736f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:37.353699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d52839ea-8a81-4fa6-8245-44c6443c736f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:37.354228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d52839ea-8a81-4fa6-8245-44c6443c736f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:37.354715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d52839ea-8a81-4fa6-8245-44c6443c736f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:37.653449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d52839ea-8a81-4fa6-8245-44c6443c736f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:37.668046 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d52839ea-8a81-4fa6-8245-44c6443c736f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1677 microversion: 2.1 time: 0.330586 Aug 18 12:31:37.668851 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4092/6746] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:37 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1677 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:38.695615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8f676fee-7829-407b-9465-5b6ced8f4a93 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:38.696318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8f676fee-7829-407b-9465-5b6ced8f4a93 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:38.704521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f676fee-7829-407b-9465-5b6ced8f4a93 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:38.705036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f676fee-7829-407b-9465-5b6ced8f4a93 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:38.705497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f676fee-7829-407b-9465-5b6ced8f4a93 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:38.706338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f676fee-7829-407b-9465-5b6ced8f4a93 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:38.707794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f676fee-7829-407b-9465-5b6ced8f4a93 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:38.707794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8f676fee-7829-407b-9465-5b6ced8f4a93 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:38.865209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8f676fee-7829-407b-9465-5b6ced8f4a93 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:38.874697 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8f676fee-7829-407b-9465-5b6ced8f4a93 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1674 microversion: 2.1 time: 0.182273 Aug 18 12:31:38.875303 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4093/6747] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:38 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:38.896316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:38.896864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:38.904138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:38.905421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:38.906145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:38.907392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:38.907996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:38.908558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:38.955362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:38.955872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:38.956333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:38.957163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:38.957652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:38.958103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:38.987789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Getting quotas for project 52c152e60a4d4bce86773ea6a2e25fc4. Resources: {'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:31:39.001234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Getting quotas for user 6da9f8c739314b6a842c84bf71786f78 and project 52c152e60a4d4bce86773ea6a2e25fc4. Resources: {'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:31:39.149452 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-364f31f6-9a00-4c88-b45c-d8e0f456d6ea tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c/action" status: 202 len: 0 microversion: 2.1 time: 0.256809 Aug 18 12:31:39.150240 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4094/6748] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:31:38 2022] POST /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:31:39.163010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b498ba37-9176-48f2-82eb-564c1855378a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:39.163744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b498ba37-9176-48f2-82eb-564c1855378a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:39.170868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b498ba37-9176-48f2-82eb-564c1855378a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:39.171372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b498ba37-9176-48f2-82eb-564c1855378a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:39.171836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b498ba37-9176-48f2-82eb-564c1855378a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:39.172616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b498ba37-9176-48f2-82eb-564c1855378a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:39.173098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b498ba37-9176-48f2-82eb-564c1855378a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:39.173544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b498ba37-9176-48f2-82eb-564c1855378a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:39.411558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b498ba37-9176-48f2-82eb-564c1855378a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:39.420910 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b498ba37-9176-48f2-82eb-564c1855378a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1673 microversion: 2.1 time: 0.262475 Aug 18 12:31:39.421999 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4095/6749] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:39 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1673 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:40.155643 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:31:40.155643 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:31:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:31:40.443470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-eb4191da-f132-4e96-b429-99da6027a080 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:40.444137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-eb4191da-f132-4e96-b429-99da6027a080 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:40.452446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb4191da-f132-4e96-b429-99da6027a080 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:40.453130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb4191da-f132-4e96-b429-99da6027a080 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:40.453591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb4191da-f132-4e96-b429-99da6027a080 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:40.454345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb4191da-f132-4e96-b429-99da6027a080 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:40.454847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb4191da-f132-4e96-b429-99da6027a080 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:40.455296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-eb4191da-f132-4e96-b429-99da6027a080 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:40.628385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-eb4191da-f132-4e96-b429-99da6027a080 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:40.636571 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-eb4191da-f132-4e96-b429-99da6027a080 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1673 microversion: 2.1 time: 0.197051 Aug 18 12:31:40.637169 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4096/6750] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:40 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:41.661157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3040dab9-f0c2-46fe-93e6-ff12a7080c80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:41.662234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3040dab9-f0c2-46fe-93e6-ff12a7080c80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:41.668646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3040dab9-f0c2-46fe-93e6-ff12a7080c80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:41.669155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3040dab9-f0c2-46fe-93e6-ff12a7080c80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:41.669612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3040dab9-f0c2-46fe-93e6-ff12a7080c80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:41.670981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3040dab9-f0c2-46fe-93e6-ff12a7080c80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:41.671533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3040dab9-f0c2-46fe-93e6-ff12a7080c80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:41.672006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3040dab9-f0c2-46fe-93e6-ff12a7080c80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:41.864077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3040dab9-f0c2-46fe-93e6-ff12a7080c80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:41.874277 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3040dab9-f0c2-46fe-93e6-ff12a7080c80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1673 microversion: 2.1 time: 0.218975 Aug 18 12:31:41.875160 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4097/6751] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:41 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1673 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:42.155455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-068b98f8-ded8-43bf-a2a4-d456c6aad88b req-25e8729a-4672-4d6a-9028-81fefc8b5370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f910523b-f6f1-4366-9fd8-5316a184943c", "name": "network-vif-plugged", "status": "completed", "tag": "96612db5-9979-4a5d-9255-e7a3dc9a3d96"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:42.166055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-068b98f8-ded8-43bf-a2a4-d456c6aad88b req-25e8729a-4672-4d6a-9028-81fefc8b5370 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:42.166590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-068b98f8-ded8-43bf-a2a4-d456c6aad88b req-25e8729a-4672-4d6a-9028-81fefc8b5370 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:42.167047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-068b98f8-ded8-43bf-a2a4-d456c6aad88b req-25e8729a-4672-4d6a-9028-81fefc8b5370 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:42.184545 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-068b98f8-ded8-43bf-a2a4-d456c6aad88b req-25e8729a-4672-4d6a-9028-81fefc8b5370 service nova] Creating event network-vif-plugged:96612db5-9979-4a5d-9255-e7a3dc9a3d96 for instance f910523b-f6f1-4366-9fd8-5316a184943c on n-h1-853611-3 Aug 18 12:31:42.192053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-068b98f8-ded8-43bf-a2a4-d456c6aad88b req-25e8729a-4672-4d6a-9028-81fefc8b5370 service nova] Instance f910523b-f6f1-4366-9fd8-5316a184943c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:31:42.206589 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-068b98f8-ded8-43bf-a2a4-d456c6aad88b req-25e8729a-4672-4d6a-9028-81fefc8b5370 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054768 Aug 18 12:31:42.207330 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4098/6752] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:31:42.901685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-23100a87-0d76-4399-afb8-cb245f10c64e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:42.902893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-23100a87-0d76-4399-afb8-cb245f10c64e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:42.911020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23100a87-0d76-4399-afb8-cb245f10c64e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:42.911530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23100a87-0d76-4399-afb8-cb245f10c64e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:42.911982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23100a87-0d76-4399-afb8-cb245f10c64e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:42.912716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23100a87-0d76-4399-afb8-cb245f10c64e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:42.913182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23100a87-0d76-4399-afb8-cb245f10c64e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:42.913622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23100a87-0d76-4399-afb8-cb245f10c64e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:43.183675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-23100a87-0d76-4399-afb8-cb245f10c64e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:43.193478 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-23100a87-0d76-4399-afb8-cb245f10c64e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1673 microversion: 2.1 time: 0.297371 Aug 18 12:31:43.194462 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4099/6753] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:42 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1673 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:43.321599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-755c2ce3-d261-4a2d-bc56-d3c17a59fd3c req-a46bd76a-8efd-4d58-842e-5a38123a680a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f910523b-f6f1-4366-9fd8-5316a184943c", "name": "network-vif-unplugged", "status": "completed", "tag": "96612db5-9979-4a5d-9255-e7a3dc9a3d96"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:43.333220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-755c2ce3-d261-4a2d-bc56-d3c17a59fd3c req-a46bd76a-8efd-4d58-842e-5a38123a680a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:43.333728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-755c2ce3-d261-4a2d-bc56-d3c17a59fd3c req-a46bd76a-8efd-4d58-842e-5a38123a680a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:43.334183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-755c2ce3-d261-4a2d-bc56-d3c17a59fd3c req-a46bd76a-8efd-4d58-842e-5a38123a680a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:43.348526 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-755c2ce3-d261-4a2d-bc56-d3c17a59fd3c req-a46bd76a-8efd-4d58-842e-5a38123a680a service nova] Creating event network-vif-unplugged:96612db5-9979-4a5d-9255-e7a3dc9a3d96 for instance f910523b-f6f1-4366-9fd8-5316a184943c on n-h2-853611-3 Aug 18 12:31:43.357278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-755c2ce3-d261-4a2d-bc56-d3c17a59fd3c req-a46bd76a-8efd-4d58-842e-5a38123a680a service nova] Instance f910523b-f6f1-4366-9fd8-5316a184943c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:31:43.370620 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-755c2ce3-d261-4a2d-bc56-d3c17a59fd3c req-a46bd76a-8efd-4d58-842e-5a38123a680a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052923 Aug 18 12:31:43.371263 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4100/6754] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:31:44.222802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-35c6dae7-c695-489d-8e60-36df21957662 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:44.224038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-35c6dae7-c695-489d-8e60-36df21957662 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:44.232287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35c6dae7-c695-489d-8e60-36df21957662 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:44.233418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35c6dae7-c695-489d-8e60-36df21957662 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:44.234278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35c6dae7-c695-489d-8e60-36df21957662 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:44.235174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35c6dae7-c695-489d-8e60-36df21957662 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:44.235735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35c6dae7-c695-489d-8e60-36df21957662 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:44.236341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35c6dae7-c695-489d-8e60-36df21957662 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:44.501238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-35c6dae7-c695-489d-8e60-36df21957662 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:44.513127 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-35c6dae7-c695-489d-8e60-36df21957662 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1673 microversion: 2.1 time: 0.296385 Aug 18 12:31:44.515361 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4101/6755] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:44 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1673 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:45.398563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-22f56287-a6a3-47c6-bcc6-87a48e1dbd2b req-a61b2c10-0a70-4d41-8214-d0e83508d906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f910523b-f6f1-4366-9fd8-5316a184943c", "tag": "96612db5-9979-4a5d-9255-e7a3dc9a3d96"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:45.410791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-22f56287-a6a3-47c6-bcc6-87a48e1dbd2b req-a61b2c10-0a70-4d41-8214-d0e83508d906 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:45.411364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-22f56287-a6a3-47c6-bcc6-87a48e1dbd2b req-a61b2c10-0a70-4d41-8214-d0e83508d906 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:45.411864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-22f56287-a6a3-47c6-bcc6-87a48e1dbd2b req-a61b2c10-0a70-4d41-8214-d0e83508d906 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:45.426175 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-22f56287-a6a3-47c6-bcc6-87a48e1dbd2b req-a61b2c10-0a70-4d41-8214-d0e83508d906 service nova] Creating event network-changed:96612db5-9979-4a5d-9255-e7a3dc9a3d96 for instance f910523b-f6f1-4366-9fd8-5316a184943c on n-h2-853611-3 Aug 18 12:31:45.432876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-22f56287-a6a3-47c6-bcc6-87a48e1dbd2b req-a61b2c10-0a70-4d41-8214-d0e83508d906 service nova] Instance f910523b-f6f1-4366-9fd8-5316a184943c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:31:45.445704 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-22f56287-a6a3-47c6-bcc6-87a48e1dbd2b req-a61b2c10-0a70-4d41-8214-d0e83508d906 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050936 Aug 18 12:31:45.446639 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4102/6756] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:31:45.551045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d22526b-5999-4593-9c9c-0fabd1900b9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:45.552688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7d22526b-5999-4593-9c9c-0fabd1900b9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:45.565718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d22526b-5999-4593-9c9c-0fabd1900b9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:45.566676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d22526b-5999-4593-9c9c-0fabd1900b9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:45.567507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d22526b-5999-4593-9c9c-0fabd1900b9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:45.568840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d22526b-5999-4593-9c9c-0fabd1900b9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:45.569717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d22526b-5999-4593-9c9c-0fabd1900b9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:45.570567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d22526b-5999-4593-9c9c-0fabd1900b9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:46.275107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7d22526b-5999-4593-9c9c-0fabd1900b9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:46.287507 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7d22526b-5999-4593-9c9c-0fabd1900b9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1673 microversion: 2.1 time: 0.750165 Aug 18 12:31:46.288326 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4103/6757] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:45 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1673 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:47.314389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3135bdd4-c3f4-4a1e-b1fd-d2124683f772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:47.315142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3135bdd4-c3f4-4a1e-b1fd-d2124683f772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:47.323335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3135bdd4-c3f4-4a1e-b1fd-d2124683f772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:47.327596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3135bdd4-c3f4-4a1e-b1fd-d2124683f772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:47.327596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3135bdd4-c3f4-4a1e-b1fd-d2124683f772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:47.327596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3135bdd4-c3f4-4a1e-b1fd-d2124683f772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:47.327596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3135bdd4-c3f4-4a1e-b1fd-d2124683f772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:47.327596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3135bdd4-c3f4-4a1e-b1fd-d2124683f772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:47.500617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3135bdd4-c3f4-4a1e-b1fd-d2124683f772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:47.509321 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3135bdd4-c3f4-4a1e-b1fd-d2124683f772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1666 microversion: 2.1 time: 0.199359 Aug 18 12:31:47.510112 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4104/6758] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:47 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1666 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:47.532673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-42d197c8-00f5-45fd-91d5-4a9a7c0e1e11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:47.533322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-42d197c8-00f5-45fd-91d5-4a9a7c0e1e11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:47.540098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42d197c8-00f5-45fd-91d5-4a9a7c0e1e11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:47.540610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42d197c8-00f5-45fd-91d5-4a9a7c0e1e11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:47.541062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42d197c8-00f5-45fd-91d5-4a9a7c0e1e11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:47.541831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42d197c8-00f5-45fd-91d5-4a9a7c0e1e11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:47.542280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42d197c8-00f5-45fd-91d5-4a9a7c0e1e11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:47.542758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42d197c8-00f5-45fd-91d5-4a9a7c0e1e11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:47.563868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:47.726778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-42d197c8-00f5-45fd-91d5-4a9a7c0e1e11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:47.742591 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-42d197c8-00f5-45fd-91d5-4a9a7c0e1e11 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1666 microversion: 2.1 time: 0.214039 Aug 18 12:31:47.743689 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4105/6759] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:47 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1666 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:47.781326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a5ec0bb2-e4ea-4f3b-ba61-4bac1fcea08b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:47.782506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a5ec0bb2-e4ea-4f3b-ba61-4bac1fcea08b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:47.793523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5ec0bb2-e4ea-4f3b-ba61-4bac1fcea08b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:47.793970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5ec0bb2-e4ea-4f3b-ba61-4bac1fcea08b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:47.794830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5ec0bb2-e4ea-4f3b-ba61-4bac1fcea08b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:47.796753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5ec0bb2-e4ea-4f3b-ba61-4bac1fcea08b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:47.797718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5ec0bb2-e4ea-4f3b-ba61-4bac1fcea08b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:47.798578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5ec0bb2-e4ea-4f3b-ba61-4bac1fcea08b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:48.022893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a5ec0bb2-e4ea-4f3b-ba61-4bac1fcea08b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:48.032973 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a5ec0bb2-e4ea-4f3b-ba61-4bac1fcea08b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1666 microversion: 2.1 time: 0.259602 Aug 18 12:31:48.033665 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4106/6760] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:47 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1666 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:48.068003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06d034fd-a39e-4869-9ca2-e104e51f29d6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:48.068671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-06d034fd-a39e-4869-9ca2-e104e51f29d6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:48.076103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06d034fd-a39e-4869-9ca2-e104e51f29d6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:48.076806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06d034fd-a39e-4869-9ca2-e104e51f29d6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:48.077497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06d034fd-a39e-4869-9ca2-e104e51f29d6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:48.078280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06d034fd-a39e-4869-9ca2-e104e51f29d6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:48.078869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06d034fd-a39e-4869-9ca2-e104e51f29d6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:48.079484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06d034fd-a39e-4869-9ca2-e104e51f29d6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:48.113396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-06d034fd-a39e-4869-9ca2-e104e51f29d6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:31:48.222522 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-06d034fd-a39e-4869-9ca2-e104e51f29d6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 204 len: 0 microversion: 2.1 time: 0.157960 Aug 18 12:31:48.223577 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4107/6761] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:31:48 2022] DELETE /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:31:48.234467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2b793254-e720-45f6-943c-25e312c32ad3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:48.235193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2b793254-e720-45f6-943c-25e312c32ad3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:48.241788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b793254-e720-45f6-943c-25e312c32ad3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:48.242354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b793254-e720-45f6-943c-25e312c32ad3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:48.242926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b793254-e720-45f6-943c-25e312c32ad3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:48.243690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b793254-e720-45f6-943c-25e312c32ad3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:48.244225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b793254-e720-45f6-943c-25e312c32ad3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:48.244795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2b793254-e720-45f6-943c-25e312c32ad3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:48.399615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2b793254-e720-45f6-943c-25e312c32ad3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:48.409078 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2b793254-e720-45f6-943c-25e312c32ad3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1672 microversion: 2.1 time: 0.179623 Aug 18 12:31:48.409846 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4108/6762] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:48 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:49.432986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-306e9b30-2e01-4354-ba11-d023d6410cfc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:49.433799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-306e9b30-2e01-4354-ba11-d023d6410cfc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:49.436279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:49.438598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:31:49.447208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-306e9b30-2e01-4354-ba11-d023d6410cfc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:49.447935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-306e9b30-2e01-4354-ba11-d023d6410cfc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:49.448488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-306e9b30-2e01-4354-ba11-d023d6410cfc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:49.449354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-306e9b30-2e01-4354-ba11-d023d6410cfc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:49.449984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-306e9b30-2e01-4354-ba11-d023d6410cfc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:49.450562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-306e9b30-2e01-4354-ba11-d023d6410cfc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:49.794947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-306e9b30-2e01-4354-ba11-d023d6410cfc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:49.809094 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-306e9b30-2e01-4354-ba11-d023d6410cfc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1672 microversion: 2.1 time: 0.379962 Aug 18 12:31:49.819884 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4109/6763] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:49 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1672 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:49.819884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9db55d58-a742-4151-835a-9fa1e16cedc7 req-e3f2a3bc-696b-441b-8158-842e17886ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f910523b-f6f1-4366-9fd8-5316a184943c", "name": "network-vif-plugged", "status": "completed", "tag": "96612db5-9979-4a5d-9255-e7a3dc9a3d96"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:49.830483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9db55d58-a742-4151-835a-9fa1e16cedc7 req-e3f2a3bc-696b-441b-8158-842e17886ae5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:49.830887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9db55d58-a742-4151-835a-9fa1e16cedc7 req-e3f2a3bc-696b-441b-8158-842e17886ae5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:49.831481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9db55d58-a742-4151-835a-9fa1e16cedc7 req-e3f2a3bc-696b-441b-8158-842e17886ae5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:49.847820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9db55d58-a742-4151-835a-9fa1e16cedc7 req-e3f2a3bc-696b-441b-8158-842e17886ae5 service nova] Creating event network-vif-plugged:96612db5-9979-4a5d-9255-e7a3dc9a3d96 for instance f910523b-f6f1-4366-9fd8-5316a184943c on n-h2-853611-3 Aug 18 12:31:49.854791 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9db55d58-a742-4151-835a-9fa1e16cedc7 req-e3f2a3bc-696b-441b-8158-842e17886ae5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041510 Aug 18 12:31:49.856078 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4110/6764] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:50.850719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b8a3bfe0-7a25-4484-9c5d-58fd123860ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:50.852217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b8a3bfe0-7a25-4484-9c5d-58fd123860ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:50.864391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8a3bfe0-7a25-4484-9c5d-58fd123860ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:50.865253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8a3bfe0-7a25-4484-9c5d-58fd123860ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:50.866264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8a3bfe0-7a25-4484-9c5d-58fd123860ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:50.867303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8a3bfe0-7a25-4484-9c5d-58fd123860ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:50.868157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8a3bfe0-7a25-4484-9c5d-58fd123860ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:50.869052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8a3bfe0-7a25-4484-9c5d-58fd123860ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:50.980526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8a3bfe0-7a25-4484-9c5d-58fd123860ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:50.993567 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b8a3bfe0-7a25-4484-9c5d-58fd123860ab tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 200 len: 1605 microversion: 2.1 time: 0.154092 Aug 18 12:31:51.006981 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4111/6765] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:50 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 1605 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:51.006981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7fcaa584-6851-499e-8a56-8e521bf07545 req-e19fe4a7-cfc2-433b-a312-b395fa765620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f910523b-f6f1-4366-9fd8-5316a184943c", "name": "network-vif-deleted", "tag": "96612db5-9979-4a5d-9255-e7a3dc9a3d96"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:51.031709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7fcaa584-6851-499e-8a56-8e521bf07545 req-e19fe4a7-cfc2-433b-a312-b395fa765620 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:51.033569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7fcaa584-6851-499e-8a56-8e521bf07545 req-e19fe4a7-cfc2-433b-a312-b395fa765620 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:51.033569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7fcaa584-6851-499e-8a56-8e521bf07545 req-e19fe4a7-cfc2-433b-a312-b395fa765620 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:51.063889 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7fcaa584-6851-499e-8a56-8e521bf07545 req-e19fe4a7-cfc2-433b-a312-b395fa765620 service nova] Creating event network-vif-deleted:96612db5-9979-4a5d-9255-e7a3dc9a3d96 for instance f910523b-f6f1-4366-9fd8-5316a184943c on n-h2-853611-3 Aug 18 12:31:51.073676 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7fcaa584-6851-499e-8a56-8e521bf07545 req-e19fe4a7-cfc2-433b-a312-b395fa765620 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076813 Aug 18 12:31:51.075322 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4112/6766] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:52.038824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cd217627-ff23-482f-9e0c-3c92395814e9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:52.039821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cd217627-ff23-482f-9e0c-3c92395814e9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:52.050161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd217627-ff23-482f-9e0c-3c92395814e9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:52.050865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd217627-ff23-482f-9e0c-3c92395814e9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:52.051487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd217627-ff23-482f-9e0c-3c92395814e9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:52.052436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd217627-ff23-482f-9e0c-3c92395814e9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:52.053009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd217627-ff23-482f-9e0c-3c92395814e9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:52.053580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cd217627-ff23-482f-9e0c-3c92395814e9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:52.077579 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-cd217627-ff23-482f-9e0c-3c92395814e9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cd217627-ff23-482f-9e0c-3c92395814e9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c HTTP/1.1 Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'f910523b-f6f1-4366-9fd8-5316a184943c'} Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:31:52.081001 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:31:52.088544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:31:52.088544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:31:52.088544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:31:52.088544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:31:52.088544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:31:52.088544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:31:52.088544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:31:52.088544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cd217627-ff23-482f-9e0c-3c92395814e9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:31:52.088544 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cd217627-ff23-482f-9e0c-3c92395814e9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 404 len: 111 microversion: 2.1 time: 0.049736 Aug 18 12:31:52.088544 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4113/6767] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:52 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:31:52.109358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3285ed7e-cf91-4caf-bf4e-ec48d1041741 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:52.110110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3285ed7e-cf91-4caf-bf4e-ec48d1041741 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:52.117071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3285ed7e-cf91-4caf-bf4e-ec48d1041741 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:52.117582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3285ed7e-cf91-4caf-bf4e-ec48d1041741 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:52.118192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3285ed7e-cf91-4caf-bf4e-ec48d1041741 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:52.118975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3285ed7e-cf91-4caf-bf4e-ec48d1041741 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:52.119572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3285ed7e-cf91-4caf-bf4e-ec48d1041741 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:52.119871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3285ed7e-cf91-4caf-bf4e-ec48d1041741 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:52.136781 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-3285ed7e-cf91-4caf-bf4e-ec48d1041741 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3285ed7e-cf91-4caf-bf4e-ec48d1041741 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c HTTP/1.1 Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'f910523b-f6f1-4366-9fd8-5316a184943c'} Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:31:52.138377 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:31:52.146324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:31:52.146324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:31:52.146324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:31:52.146324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:31:52.146324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:31:52.146324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:31:52.146324 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:31:52.146324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3285ed7e-cf91-4caf-bf4e-ec48d1041741 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:31:52.146324 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3285ed7e-cf91-4caf-bf4e-ec48d1041741 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 404 len: 111 microversion: 2.1 time: 0.036215 Aug 18 12:31:52.151419 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4114/6768] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:52 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:31:52.198254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1843546101", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "223e769f-74d3-491d-9f22-cb5f7423c3de"}], "security_groups": [{"name": "tempest-securitygroup--514773839"}], "key_name": "tempest-keypair-128691123", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:52.369782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] validate_networks() for [('223e769f-74d3-491d-9f22-cb5f7423c3de', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:31:52.837043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:31:52.837570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:31:52.838060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:31:52.838516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:31:52.838941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:31:52.855447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:52.856353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:52.857185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:52.859713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:52.860609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:52.861432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:52.898183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Getting quotas for project 52c152e60a4d4bce86773ea6a2e25fc4. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:31:52.907170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Getting quotas for user 6da9f8c739314b6a842c84bf71786f78 and project 52c152e60a4d4bce86773ea6a2e25fc4. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:31:52.922592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:31:52.925067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:31:52.980371 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-17594d11-4771-4799-a4ba-cb90fe50f962 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.786119 Aug 18 12:31:52.981500 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4115/6769] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:31:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:31:52.999717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-28b5cf53-ca5b-4a39-8fe5-3f8b0f374a66 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:53.000585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-28b5cf53-ca5b-4a39-8fe5-3f8b0f374a66 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:53.081719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-28b5cf53-ca5b-4a39-8fe5-3f8b0f374a66 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:53.095810 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-28b5cf53-ca5b-4a39-8fe5-3f8b0f374a66 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1238 microversion: 2.1 time: 0.100748 Aug 18 12:31:53.096797 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4116/6770] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:52 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1238 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:54.134967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4620c90d-6d92-4647-923e-67778208419a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:54.135656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4620c90d-6d92-4647-923e-67778208419a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:54.145770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4620c90d-6d92-4647-923e-67778208419a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:54.146612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4620c90d-6d92-4647-923e-67778208419a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:54.147360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4620c90d-6d92-4647-923e-67778208419a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:54.148473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4620c90d-6d92-4647-923e-67778208419a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:54.149196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4620c90d-6d92-4647-923e-67778208419a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:54.149812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4620c90d-6d92-4647-923e-67778208419a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:54.284524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4620c90d-6d92-4647-923e-67778208419a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:54.297233 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4620c90d-6d92-4647-923e-67778208419a tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1298 microversion: 2.1 time: 0.167032 Aug 18 12:31:54.298222 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4117/6771] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:54 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1298 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:55.328558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-33d776b8-1c7e-47bd-8cd0-a1cde7994596 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:55.329683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-33d776b8-1c7e-47bd-8cd0-a1cde7994596 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:55.343474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33d776b8-1c7e-47bd-8cd0-a1cde7994596 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:55.345469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33d776b8-1c7e-47bd-8cd0-a1cde7994596 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:55.346846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33d776b8-1c7e-47bd-8cd0-a1cde7994596 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:55.348081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33d776b8-1c7e-47bd-8cd0-a1cde7994596 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:55.349046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33d776b8-1c7e-47bd-8cd0-a1cde7994596 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:55.349888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33d776b8-1c7e-47bd-8cd0-a1cde7994596 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:55.738139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-33d776b8-1c7e-47bd-8cd0-a1cde7994596 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:55.748411 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-33d776b8-1c7e-47bd-8cd0-a1cde7994596 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1363 microversion: 2.1 time: 0.426454 Aug 18 12:31:55.749219 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4118/6772] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:55 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1363 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:56.299587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-0a75061b-11db-44bc-aacf-60d3636798cb req-05accf3c-77b3-4eef-bcfd-2825a8e64d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5496ff6f-8dd3-4bca-8e59-cfe197d8d46b", "tag": "ab728485-d1e1-442e-a668-4fa93866a093"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:31:56.323699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0a75061b-11db-44bc-aacf-60d3636798cb req-05accf3c-77b3-4eef-bcfd-2825a8e64d91 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:56.325084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0a75061b-11db-44bc-aacf-60d3636798cb req-05accf3c-77b3-4eef-bcfd-2825a8e64d91 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:56.325703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0a75061b-11db-44bc-aacf-60d3636798cb req-05accf3c-77b3-4eef-bcfd-2825a8e64d91 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:56.347064 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-0a75061b-11db-44bc-aacf-60d3636798cb req-05accf3c-77b3-4eef-bcfd-2825a8e64d91 service nova] Creating event network-changed:ab728485-d1e1-442e-a668-4fa93866a093 for instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b on n-h2-853611-3 Aug 18 12:31:56.358983 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-0a75061b-11db-44bc-aacf-60d3636798cb req-05accf3c-77b3-4eef-bcfd-2825a8e64d91 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063730 Aug 18 12:31:56.360936 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4119/6773] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:31:56.737305 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:31:56.738134 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:31:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:31:56.781111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b344eaac-c6de-4fef-8238-6aec267accf9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:56.782499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b344eaac-c6de-4fef-8238-6aec267accf9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:56.795086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b344eaac-c6de-4fef-8238-6aec267accf9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:56.796436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b344eaac-c6de-4fef-8238-6aec267accf9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:56.797288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b344eaac-c6de-4fef-8238-6aec267accf9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:56.798676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b344eaac-c6de-4fef-8238-6aec267accf9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:56.799569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b344eaac-c6de-4fef-8238-6aec267accf9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:56.800388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b344eaac-c6de-4fef-8238-6aec267accf9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:57.011869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b344eaac-c6de-4fef-8238-6aec267accf9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:57.021715 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b344eaac-c6de-4fef-8238-6aec267accf9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1363 microversion: 2.1 time: 0.250032 Aug 18 12:31:57.022465 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4120/6774] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:56 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:31:58.047768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-095b836e-1389-4b81-a11f-6cde5981efaf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:58.048861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-095b836e-1389-4b81-a11f-6cde5981efaf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:58.061509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-095b836e-1389-4b81-a11f-6cde5981efaf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:58.062400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-095b836e-1389-4b81-a11f-6cde5981efaf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:58.063202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-095b836e-1389-4b81-a11f-6cde5981efaf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:58.064519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-095b836e-1389-4b81-a11f-6cde5981efaf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:58.065375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-095b836e-1389-4b81-a11f-6cde5981efaf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:58.066373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-095b836e-1389-4b81-a11f-6cde5981efaf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:58.346979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-095b836e-1389-4b81-a11f-6cde5981efaf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:58.357010 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-095b836e-1389-4b81-a11f-6cde5981efaf tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1363 microversion: 2.1 time: 0.317112 Aug 18 12:31:58.359144 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4121/6775] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:58 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:31:59.383205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1829ebaf-54bb-43d6-a071-7c1238924f4b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:31:59.384146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1829ebaf-54bb-43d6-a071-7c1238924f4b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:31:59.391771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1829ebaf-54bb-43d6-a071-7c1238924f4b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:59.392284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1829ebaf-54bb-43d6-a071-7c1238924f4b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:59.392743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1829ebaf-54bb-43d6-a071-7c1238924f4b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:59.393489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1829ebaf-54bb-43d6-a071-7c1238924f4b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:31:59.393965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1829ebaf-54bb-43d6-a071-7c1238924f4b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:31:59.394406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1829ebaf-54bb-43d6-a071-7c1238924f4b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:31:59.556947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1829ebaf-54bb-43d6-a071-7c1238924f4b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:31:59.566048 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1829ebaf-54bb-43d6-a071-7c1238924f4b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1363 microversion: 2.1 time: 0.187099 Aug 18 12:31:59.566706 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4122/6776] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:31:59 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:32:00.589509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-74cea69b-a187-4cb8-aa50-2c24a951b10f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:00.590297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-74cea69b-a187-4cb8-aa50-2c24a951b10f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:00.598633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74cea69b-a187-4cb8-aa50-2c24a951b10f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:00.599200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74cea69b-a187-4cb8-aa50-2c24a951b10f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:00.599650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74cea69b-a187-4cb8-aa50-2c24a951b10f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:00.600631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74cea69b-a187-4cb8-aa50-2c24a951b10f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:00.601098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74cea69b-a187-4cb8-aa50-2c24a951b10f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:00.601531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74cea69b-a187-4cb8-aa50-2c24a951b10f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:00.755731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-74cea69b-a187-4cb8-aa50-2c24a951b10f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:00.765089 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-74cea69b-a187-4cb8-aa50-2c24a951b10f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1363 microversion: 2.1 time: 0.178563 Aug 18 12:32:00.765856 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4123/6777] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:00 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:32:01.788813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2ffcaa69-17b5-4b7d-83c9-56e29f1ab16d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:01.790071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2ffcaa69-17b5-4b7d-83c9-56e29f1ab16d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:01.800180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ffcaa69-17b5-4b7d-83c9-56e29f1ab16d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:01.800748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ffcaa69-17b5-4b7d-83c9-56e29f1ab16d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:01.801226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ffcaa69-17b5-4b7d-83c9-56e29f1ab16d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:01.802024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ffcaa69-17b5-4b7d-83c9-56e29f1ab16d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:01.802564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ffcaa69-17b5-4b7d-83c9-56e29f1ab16d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:01.803031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ffcaa69-17b5-4b7d-83c9-56e29f1ab16d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:02.010044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2ffcaa69-17b5-4b7d-83c9-56e29f1ab16d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:02.018612 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2ffcaa69-17b5-4b7d-83c9-56e29f1ab16d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1363 microversion: 2.1 time: 0.234440 Aug 18 12:32:02.019235 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4124/6778] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:01 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:32:02.024153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-08dae3a0-998c-4939-a809-56ce6eed59ac req-d16d7a48-78fc-4b40-9a97-57bf5ddc24ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5496ff6f-8dd3-4bca-8e59-cfe197d8d46b", "name": "network-vif-plugged", "status": "completed", "tag": "ab728485-d1e1-442e-a668-4fa93866a093"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:32:02.037333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-08dae3a0-998c-4939-a809-56ce6eed59ac req-d16d7a48-78fc-4b40-9a97-57bf5ddc24ac service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:02.037333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-08dae3a0-998c-4939-a809-56ce6eed59ac req-d16d7a48-78fc-4b40-9a97-57bf5ddc24ac service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:02.038045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-08dae3a0-998c-4939-a809-56ce6eed59ac req-d16d7a48-78fc-4b40-9a97-57bf5ddc24ac service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:02.056351 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-08dae3a0-998c-4939-a809-56ce6eed59ac req-d16d7a48-78fc-4b40-9a97-57bf5ddc24ac service nova] Creating event network-vif-plugged:ab728485-d1e1-442e-a668-4fa93866a093 for instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b on n-h2-853611-3 Aug 18 12:32:02.064199 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-08dae3a0-998c-4939-a809-56ce6eed59ac req-d16d7a48-78fc-4b40-9a97-57bf5ddc24ac service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043663 Aug 18 12:32:02.064957 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4125/6779] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:32:03.046212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:03.051197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24e81774-906a-4885-a146-e1eb60f0bee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:03.051944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-24e81774-906a-4885-a146-e1eb60f0bee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:03.059108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e81774-906a-4885-a146-e1eb60f0bee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:03.059625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e81774-906a-4885-a146-e1eb60f0bee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:03.060100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e81774-906a-4885-a146-e1eb60f0bee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:03.061490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e81774-906a-4885-a146-e1eb60f0bee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:03.062749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e81774-906a-4885-a146-e1eb60f0bee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:03.063209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24e81774-906a-4885-a146-e1eb60f0bee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:03.067959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:03.089910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:03.251947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-24e81774-906a-4885-a146-e1eb60f0bee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:03.263271 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-24e81774-906a-4885-a146-e1eb60f0bee9 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1363 microversion: 2.1 time: 0.219538 Aug 18 12:32:03.264833 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4126/6780] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:03 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:32:04.287107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ad98571d-8dfe-4c97-b71c-78161604e560 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:04.287821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ad98571d-8dfe-4c97-b71c-78161604e560 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:04.295438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad98571d-8dfe-4c97-b71c-78161604e560 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:04.295947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad98571d-8dfe-4c97-b71c-78161604e560 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:04.296588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad98571d-8dfe-4c97-b71c-78161604e560 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:04.297329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad98571d-8dfe-4c97-b71c-78161604e560 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:04.297807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad98571d-8dfe-4c97-b71c-78161604e560 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:04.298251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad98571d-8dfe-4c97-b71c-78161604e560 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:04.456969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ad98571d-8dfe-4c97-b71c-78161604e560 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:04.465276 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ad98571d-8dfe-4c97-b71c-78161604e560 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1549 microversion: 2.1 time: 0.182310 Aug 18 12:32:04.465950 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4127/6781] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:04 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1549 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:32:04.491958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2e6ebf05-9a71-4a2f-9575-966790c23bef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:04.492473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2e6ebf05-9a71-4a2f-9575-966790c23bef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:04.499629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e6ebf05-9a71-4a2f-9575-966790c23bef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:04.500147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e6ebf05-9a71-4a2f-9575-966790c23bef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:04.500606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e6ebf05-9a71-4a2f-9575-966790c23bef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:04.501345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e6ebf05-9a71-4a2f-9575-966790c23bef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:04.501840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e6ebf05-9a71-4a2f-9575-966790c23bef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:04.502281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2e6ebf05-9a71-4a2f-9575-966790c23bef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:04.597058 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2e6ebf05-9a71-4a2f-9575-966790c23bef tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110088 Aug 18 12:32:04.598471 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4128/6782] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 12:32:04 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:32:05.723362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-519fc0a7-3611-4ef0-b36b-fc9fb8c5e722 req-e4c81015-2e1b-4c42-ac43-55b258e2aec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5496ff6f-8dd3-4bca-8e59-cfe197d8d46b", "tag": "ab728485-d1e1-442e-a668-4fa93866a093"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:32:05.736739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-519fc0a7-3611-4ef0-b36b-fc9fb8c5e722 req-e4c81015-2e1b-4c42-ac43-55b258e2aec8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:05.737251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-519fc0a7-3611-4ef0-b36b-fc9fb8c5e722 req-e4c81015-2e1b-4c42-ac43-55b258e2aec8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:05.737695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-519fc0a7-3611-4ef0-b36b-fc9fb8c5e722 req-e4c81015-2e1b-4c42-ac43-55b258e2aec8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:05.750685 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-519fc0a7-3611-4ef0-b36b-fc9fb8c5e722 req-e4c81015-2e1b-4c42-ac43-55b258e2aec8 service nova] Creating event network-changed:ab728485-d1e1-442e-a668-4fa93866a093 for instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b on n-h2-853611-3 Aug 18 12:32:05.756147 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-519fc0a7-3611-4ef0-b36b-fc9fb8c5e722 req-e4c81015-2e1b-4c42-ac43-55b258e2aec8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037645 Aug 18 12:32:05.756965 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4129/6783] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:32:42.554168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:42.555142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=16 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:42.559948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-322072c3-65fb-445f-9241-36af02c2ca58 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:42.561174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-322072c3-65fb-445f-9241-36af02c2ca58 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:42.569824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-322072c3-65fb-445f-9241-36af02c2ca58 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:42.570337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-322072c3-65fb-445f-9241-36af02c2ca58 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:42.570820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-322072c3-65fb-445f-9241-36af02c2ca58 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:42.571555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-322072c3-65fb-445f-9241-36af02c2ca58 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:42.572029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-322072c3-65fb-445f-9241-36af02c2ca58 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:42.572465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-322072c3-65fb-445f-9241-36af02c2ca58 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:42.728152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-322072c3-65fb-445f-9241-36af02c2ca58 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:42.737923 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-322072c3-65fb-445f-9241-36af02c2ca58 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1667 microversion: 2.1 time: 0.185880 Aug 18 12:32:42.738589 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4130/6784] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:42 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1667 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:32:42.758411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-27440872-acf5-4aec-8fc9-4ee90af4a333 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "963af599-2190-436d-aa00-90d84e8fdd22"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:32:42.760840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-27440872-acf5-4aec-8fc9-4ee90af4a333 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:42.768860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27440872-acf5-4aec-8fc9-4ee90af4a333 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:42.769378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27440872-acf5-4aec-8fc9-4ee90af4a333 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:42.769842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27440872-acf5-4aec-8fc9-4ee90af4a333 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:42.770625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27440872-acf5-4aec-8fc9-4ee90af4a333 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:42.771107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27440872-acf5-4aec-8fc9-4ee90af4a333 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:42.771586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-27440872-acf5-4aec-8fc9-4ee90af4a333 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:43.054092 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-27440872-acf5-4aec-8fc9-4ee90af4a333 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299531 Aug 18 12:32:43.054980 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4131/6785] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 12:32:42 2022] POST /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:32:55.137550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:32:55.140137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:55.143325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:55.144050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:32:55.151130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:55.151647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:55.152095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:55.152816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:55.153278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:55.153711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:55.186854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:55.194098 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Old instance type m1.heat2, new instance type m1.heat {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 12:32:55.202413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:32:55.202877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:32:55.203363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:32:55.203817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:32:55.204223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:32:55.278873 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6b430234-fe54-4031-aa72-9f9f2760a37b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b/action" status: 202 len: 0 microversion: 2.1 time: 0.145528 Aug 18 12:32:55.283746 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4132/6786] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:32:55 2022] POST /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:32:55.289880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-81f89b58-78b9-4aed-a5db-51e310d2a3fb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:55.290585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-81f89b58-78b9-4aed-a5db-51e310d2a3fb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:55.298411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81f89b58-78b9-4aed-a5db-51e310d2a3fb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:55.299112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81f89b58-78b9-4aed-a5db-51e310d2a3fb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:55.299744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81f89b58-78b9-4aed-a5db-51e310d2a3fb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:55.300754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81f89b58-78b9-4aed-a5db-51e310d2a3fb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:55.301349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81f89b58-78b9-4aed-a5db-51e310d2a3fb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:55.301891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81f89b58-78b9-4aed-a5db-51e310d2a3fb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:55.584810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-81f89b58-78b9-4aed-a5db-51e310d2a3fb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:55.594976 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-81f89b58-78b9-4aed-a5db-51e310d2a3fb tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1722 microversion: 2.1 time: 0.309337 Aug 18 12:32:55.596090 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4133/6787] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:55 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:32:56.620544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-35242b80-eda8-4ac0-8241-402fa6111761 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:56.621598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-35242b80-eda8-4ac0-8241-402fa6111761 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:56.635095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35242b80-eda8-4ac0-8241-402fa6111761 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:56.636256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35242b80-eda8-4ac0-8241-402fa6111761 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:56.637209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35242b80-eda8-4ac0-8241-402fa6111761 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:56.639484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35242b80-eda8-4ac0-8241-402fa6111761 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:56.640869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35242b80-eda8-4ac0-8241-402fa6111761 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:56.641646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35242b80-eda8-4ac0-8241-402fa6111761 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:56.836165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-35242b80-eda8-4ac0-8241-402fa6111761 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:56.846571 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-35242b80-eda8-4ac0-8241-402fa6111761 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1722 microversion: 2.1 time: 0.231204 Aug 18 12:32:56.847214 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4134/6788] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:56 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:32:57.933669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08749711-8ba8-4ba9-8a56-69183f06c937 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:57.934902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-08749711-8ba8-4ba9-8a56-69183f06c937 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:57.947858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08749711-8ba8-4ba9-8a56-69183f06c937 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:57.948773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08749711-8ba8-4ba9-8a56-69183f06c937 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:57.949558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08749711-8ba8-4ba9-8a56-69183f06c937 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:57.950950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08749711-8ba8-4ba9-8a56-69183f06c937 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:57.952805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08749711-8ba8-4ba9-8a56-69183f06c937 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:57.953630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08749711-8ba8-4ba9-8a56-69183f06c937 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:58.139422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-08749711-8ba8-4ba9-8a56-69183f06c937 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:58.148184 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-08749711-8ba8-4ba9-8a56-69183f06c937 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1727 microversion: 2.1 time: 0.278573 Aug 18 12:32:58.148812 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4135/6789] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:57 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1727 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:32:59.171059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-683ff2f3-dee3-4739-b363-ae65580ac5e3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:32:59.171851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-683ff2f3-dee3-4739-b363-ae65580ac5e3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:32:59.180279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-683ff2f3-dee3-4739-b363-ae65580ac5e3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:59.180851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-683ff2f3-dee3-4739-b363-ae65580ac5e3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:59.181602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-683ff2f3-dee3-4739-b363-ae65580ac5e3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:59.182422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-683ff2f3-dee3-4739-b363-ae65580ac5e3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:32:59.182988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-683ff2f3-dee3-4739-b363-ae65580ac5e3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:32:59.183501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-683ff2f3-dee3-4739-b363-ae65580ac5e3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:32:59.349257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-683ff2f3-dee3-4739-b363-ae65580ac5e3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:32:59.359462 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-683ff2f3-dee3-4739-b363-ae65580ac5e3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1727 microversion: 2.1 time: 0.192628 Aug 18 12:32:59.360264 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4136/6790] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:32:59 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1727 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:00.381674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26e536c8-1b94-4b6f-93e7-e72607903537 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:00.382464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26e536c8-1b94-4b6f-93e7-e72607903537 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:00.391587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e536c8-1b94-4b6f-93e7-e72607903537 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:00.392095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e536c8-1b94-4b6f-93e7-e72607903537 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:00.392549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e536c8-1b94-4b6f-93e7-e72607903537 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:00.393282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e536c8-1b94-4b6f-93e7-e72607903537 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:00.393761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e536c8-1b94-4b6f-93e7-e72607903537 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:00.394203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e536c8-1b94-4b6f-93e7-e72607903537 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:00.607177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-26e536c8-1b94-4b6f-93e7-e72607903537 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:00.616366 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-26e536c8-1b94-4b6f-93e7-e72607903537 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1727 microversion: 2.1 time: 0.238760 Aug 18 12:33:00.616994 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4137/6791] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:00 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1727 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:01.639601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0a46db8f-64dd-434d-afe1-9afe76fca852 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:01.640336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0a46db8f-64dd-434d-afe1-9afe76fca852 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:01.648081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a46db8f-64dd-434d-afe1-9afe76fca852 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:01.648638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a46db8f-64dd-434d-afe1-9afe76fca852 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:01.649130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a46db8f-64dd-434d-afe1-9afe76fca852 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:01.649973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a46db8f-64dd-434d-afe1-9afe76fca852 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:01.650540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a46db8f-64dd-434d-afe1-9afe76fca852 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:01.651031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a46db8f-64dd-434d-afe1-9afe76fca852 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:01.818177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0a46db8f-64dd-434d-afe1-9afe76fca852 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:01.833568 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0a46db8f-64dd-434d-afe1-9afe76fca852 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1727 microversion: 2.1 time: 0.198077 Aug 18 12:33:01.834704 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4138/6792] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:01 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1727 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:02.870076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2affe169-8454-4794-b86d-d4daeb69079c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:02.870881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2affe169-8454-4794-b86d-d4daeb69079c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:02.879493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2affe169-8454-4794-b86d-d4daeb69079c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:02.880015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2affe169-8454-4794-b86d-d4daeb69079c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:02.880475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2affe169-8454-4794-b86d-d4daeb69079c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:02.881232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2affe169-8454-4794-b86d-d4daeb69079c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:02.881717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2affe169-8454-4794-b86d-d4daeb69079c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:02.882280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2affe169-8454-4794-b86d-d4daeb69079c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:03.064467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2affe169-8454-4794-b86d-d4daeb69079c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:03.074284 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2affe169-8454-4794-b86d-d4daeb69079c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1727 microversion: 2.1 time: 0.208459 Aug 18 12:33:03.075013 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4139/6793] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:02 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:04.098592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e212875a-0ce2-403b-8669-62964e4b9155 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:04.099332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e212875a-0ce2-403b-8669-62964e4b9155 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:04.107191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e212875a-0ce2-403b-8669-62964e4b9155 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:04.107846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e212875a-0ce2-403b-8669-62964e4b9155 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:04.108463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e212875a-0ce2-403b-8669-62964e4b9155 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:04.109307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e212875a-0ce2-403b-8669-62964e4b9155 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:04.109910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e212875a-0ce2-403b-8669-62964e4b9155 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:04.110472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e212875a-0ce2-403b-8669-62964e4b9155 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:04.299133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e212875a-0ce2-403b-8669-62964e4b9155 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:04.308337 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e212875a-0ce2-403b-8669-62964e4b9155 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1727 microversion: 2.1 time: 0.214048 Aug 18 12:33:04.309025 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4140/6794] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:04 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:05.333742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8c5b42cf-9372-4775-b004-c8b24008b7c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:05.335092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8c5b42cf-9372-4775-b004-c8b24008b7c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:05.347125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c5b42cf-9372-4775-b004-c8b24008b7c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:05.347764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c5b42cf-9372-4775-b004-c8b24008b7c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:05.348413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c5b42cf-9372-4775-b004-c8b24008b7c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:05.349308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c5b42cf-9372-4775-b004-c8b24008b7c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:05.349898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c5b42cf-9372-4775-b004-c8b24008b7c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:05.350466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8c5b42cf-9372-4775-b004-c8b24008b7c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:05.521846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8c5b42cf-9372-4775-b004-c8b24008b7c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:05.531380 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8c5b42cf-9372-4775-b004-c8b24008b7c3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1727 microversion: 2.1 time: 0.203791 Aug 18 12:33:05.532005 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4141/6795] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:05 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1727 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:06.553569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-157b18e1-4964-44d2-a45b-7f2d9c621a42 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:06.554350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-157b18e1-4964-44d2-a45b-7f2d9c621a42 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:06.562759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-157b18e1-4964-44d2-a45b-7f2d9c621a42 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:06.563271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-157b18e1-4964-44d2-a45b-7f2d9c621a42 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:06.563728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-157b18e1-4964-44d2-a45b-7f2d9c621a42 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:06.564465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-157b18e1-4964-44d2-a45b-7f2d9c621a42 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:06.564939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-157b18e1-4964-44d2-a45b-7f2d9c621a42 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:06.565384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-157b18e1-4964-44d2-a45b-7f2d9c621a42 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:06.762965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-157b18e1-4964-44d2-a45b-7f2d9c621a42 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:06.773124 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-157b18e1-4964-44d2-a45b-7f2d9c621a42 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1727 microversion: 2.1 time: 0.223400 Aug 18 12:33:06.773754 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4142/6796] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:06 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1727 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:07.798030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1ccebee5-1641-4cb8-bc55-5dd9e729d51f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:07.798939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1ccebee5-1641-4cb8-bc55-5dd9e729d51f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:07.806172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ccebee5-1641-4cb8-bc55-5dd9e729d51f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:07.806728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ccebee5-1641-4cb8-bc55-5dd9e729d51f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:07.807182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ccebee5-1641-4cb8-bc55-5dd9e729d51f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:07.807926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ccebee5-1641-4cb8-bc55-5dd9e729d51f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:07.808402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ccebee5-1641-4cb8-bc55-5dd9e729d51f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:07.808851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ccebee5-1641-4cb8-bc55-5dd9e729d51f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:07.965140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1ccebee5-1641-4cb8-bc55-5dd9e729d51f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:07.974656 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1ccebee5-1641-4cb8-bc55-5dd9e729d51f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1727 microversion: 2.1 time: 0.181284 Aug 18 12:33:07.975181 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4143/6797] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:07 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:08.997017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4b49c6d6-dec7-4720-b3a6-5ae209f63f51 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:08.998414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4b49c6d6-dec7-4720-b3a6-5ae209f63f51 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:09.007447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b49c6d6-dec7-4720-b3a6-5ae209f63f51 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:09.008243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b49c6d6-dec7-4720-b3a6-5ae209f63f51 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:09.008865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b49c6d6-dec7-4720-b3a6-5ae209f63f51 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:09.009679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b49c6d6-dec7-4720-b3a6-5ae209f63f51 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:09.010213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b49c6d6-dec7-4720-b3a6-5ae209f63f51 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:09.010763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b49c6d6-dec7-4720-b3a6-5ae209f63f51 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:09.205951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4b49c6d6-dec7-4720-b3a6-5ae209f63f51 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:09.215395 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4b49c6d6-dec7-4720-b3a6-5ae209f63f51 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1727 microversion: 2.1 time: 0.222615 Aug 18 12:33:09.216286 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4144/6798] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:08 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:10.239214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c87aae79-2206-4ab9-8979-ca43942675dc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:10.239994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c87aae79-2206-4ab9-8979-ca43942675dc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:10.247188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c87aae79-2206-4ab9-8979-ca43942675dc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:10.247704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c87aae79-2206-4ab9-8979-ca43942675dc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:10.248655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c87aae79-2206-4ab9-8979-ca43942675dc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:10.249793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c87aae79-2206-4ab9-8979-ca43942675dc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:10.250279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c87aae79-2206-4ab9-8979-ca43942675dc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:10.250764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c87aae79-2206-4ab9-8979-ca43942675dc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:10.412923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c87aae79-2206-4ab9-8979-ca43942675dc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:10.423681 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c87aae79-2206-4ab9-8979-ca43942675dc tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1727 microversion: 2.1 time: 0.188171 Aug 18 12:33:10.424728 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4145/6799] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:10 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:11.452125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b8aadf2d-c0b7-409f-bf59-6b393cf25b8e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:11.453199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b8aadf2d-c0b7-409f-bf59-6b393cf25b8e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:11.461513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8aadf2d-c0b7-409f-bf59-6b393cf25b8e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:11.462302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8aadf2d-c0b7-409f-bf59-6b393cf25b8e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:11.462898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8aadf2d-c0b7-409f-bf59-6b393cf25b8e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:11.463774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8aadf2d-c0b7-409f-bf59-6b393cf25b8e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:11.464472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8aadf2d-c0b7-409f-bf59-6b393cf25b8e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:11.465876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8aadf2d-c0b7-409f-bf59-6b393cf25b8e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:11.665618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8aadf2d-c0b7-409f-bf59-6b393cf25b8e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:11.675143 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b8aadf2d-c0b7-409f-bf59-6b393cf25b8e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1727 microversion: 2.1 time: 0.229284 Aug 18 12:33:11.675765 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4146/6800] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:11 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1727 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:12.633301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5604a615-7410-4a87-afc2-c8d0f3537848 req-d4790b25-b3c6-4bd9-97ea-baf8788c64fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5496ff6f-8dd3-4bca-8e59-cfe197d8d46b", "name": "network-vif-unplugged", "status": "completed", "tag": "ab728485-d1e1-442e-a668-4fa93866a093"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:33:12.647277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5604a615-7410-4a87-afc2-c8d0f3537848 req-d4790b25-b3c6-4bd9-97ea-baf8788c64fe service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:12.647784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5604a615-7410-4a87-afc2-c8d0f3537848 req-d4790b25-b3c6-4bd9-97ea-baf8788c64fe service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:12.648243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5604a615-7410-4a87-afc2-c8d0f3537848 req-d4790b25-b3c6-4bd9-97ea-baf8788c64fe service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:12.652733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:12.666930 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5604a615-7410-4a87-afc2-c8d0f3537848 req-d4790b25-b3c6-4bd9-97ea-baf8788c64fe service nova] Creating event network-vif-unplugged:ab728485-d1e1-442e-a668-4fa93866a093 for instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b on n-h1-853611-3 Aug 18 12:33:12.677002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-5604a615-7410-4a87-afc2-c8d0f3537848 req-d4790b25-b3c6-4bd9-97ea-baf8788c64fe service nova] Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:33:12.695010 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5604a615-7410-4a87-afc2-c8d0f3537848 req-d4790b25-b3c6-4bd9-97ea-baf8788c64fe service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066606 Aug 18 12:33:12.695652 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4147/6801] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:33:12.702237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0178f3c7-d72b-4582-bb17-759974b33c16 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:12.704313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0178f3c7-d72b-4582-bb17-759974b33c16 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:12.716110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0178f3c7-d72b-4582-bb17-759974b33c16 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:12.718243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0178f3c7-d72b-4582-bb17-759974b33c16 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:12.718243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0178f3c7-d72b-4582-bb17-759974b33c16 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:12.719601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0178f3c7-d72b-4582-bb17-759974b33c16 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:12.720476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0178f3c7-d72b-4582-bb17-759974b33c16 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:12.722142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0178f3c7-d72b-4582-bb17-759974b33c16 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:13.033180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0178f3c7-d72b-4582-bb17-759974b33c16 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:13.044885 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0178f3c7-d72b-4582-bb17-759974b33c16 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1726 microversion: 2.1 time: 0.347923 Aug 18 12:33:13.046197 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4148/6802] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:12 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1726 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:14.086321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9a353dec-e155-45a0-94f7-0141197061f1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:14.087454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9a353dec-e155-45a0-94f7-0141197061f1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:14.096501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a353dec-e155-45a0-94f7-0141197061f1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:14.097144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a353dec-e155-45a0-94f7-0141197061f1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:14.097668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a353dec-e155-45a0-94f7-0141197061f1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:14.098625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a353dec-e155-45a0-94f7-0141197061f1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:14.099145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a353dec-e155-45a0-94f7-0141197061f1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:14.099786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a353dec-e155-45a0-94f7-0141197061f1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:14.314878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9a353dec-e155-45a0-94f7-0141197061f1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:14.324819 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9a353dec-e155-45a0-94f7-0141197061f1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1724 microversion: 2.1 time: 0.245610 Aug 18 12:33:14.325586 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4149/6803] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:14 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:14.722080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-fffb4392-9c5a-4381-b48f-27e560e4a408 req-14b846a2-7963-4385-8f62-fafc91779600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5496ff6f-8dd3-4bca-8e59-cfe197d8d46b", "tag": "ab728485-d1e1-442e-a668-4fa93866a093"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:33:14.734460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fffb4392-9c5a-4381-b48f-27e560e4a408 req-14b846a2-7963-4385-8f62-fafc91779600 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:14.735046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fffb4392-9c5a-4381-b48f-27e560e4a408 req-14b846a2-7963-4385-8f62-fafc91779600 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:14.735564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fffb4392-9c5a-4381-b48f-27e560e4a408 req-14b846a2-7963-4385-8f62-fafc91779600 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:14.750604 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-fffb4392-9c5a-4381-b48f-27e560e4a408 req-14b846a2-7963-4385-8f62-fafc91779600 service nova] Creating event network-changed:ab728485-d1e1-442e-a668-4fa93866a093 for instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b on n-h1-853611-3 Aug 18 12:33:14.757600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-fffb4392-9c5a-4381-b48f-27e560e4a408 req-14b846a2-7963-4385-8f62-fafc91779600 service nova] Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:33:14.772383 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-fffb4392-9c5a-4381-b48f-27e560e4a408 req-14b846a2-7963-4385-8f62-fafc91779600 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055432 Aug 18 12:33:14.773758 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4150/6804] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:33:15.362085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fabab862-3e18-4a8c-bf39-fd0c43b4b874 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:15.363599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fabab862-3e18-4a8c-bf39-fd0c43b4b874 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:15.378929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fabab862-3e18-4a8c-bf39-fd0c43b4b874 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:15.379997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fabab862-3e18-4a8c-bf39-fd0c43b4b874 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:15.381282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fabab862-3e18-4a8c-bf39-fd0c43b4b874 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:15.382650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fabab862-3e18-4a8c-bf39-fd0c43b4b874 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:15.383582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fabab862-3e18-4a8c-bf39-fd0c43b4b874 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:15.384394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fabab862-3e18-4a8c-bf39-fd0c43b4b874 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:15.759971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fabab862-3e18-4a8c-bf39-fd0c43b4b874 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:15.770006 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fabab862-3e18-4a8c-bf39-fd0c43b4b874 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1724 microversion: 2.1 time: 0.420706 Aug 18 12:33:15.778346 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4151/6805] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:15 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1724 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:16.739260 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:33:16.740287 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 12:33:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 12:33:16.804651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-83561dcc-9b42-44dc-acbf-17d1e49fe43d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:16.805855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-83561dcc-9b42-44dc-acbf-17d1e49fe43d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:16.813727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83561dcc-9b42-44dc-acbf-17d1e49fe43d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:16.814228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83561dcc-9b42-44dc-acbf-17d1e49fe43d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:16.814725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83561dcc-9b42-44dc-acbf-17d1e49fe43d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:16.815497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83561dcc-9b42-44dc-acbf-17d1e49fe43d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:16.815965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83561dcc-9b42-44dc-acbf-17d1e49fe43d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:16.816439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83561dcc-9b42-44dc-acbf-17d1e49fe43d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:16.979051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-83561dcc-9b42-44dc-acbf-17d1e49fe43d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:16.988878 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-83561dcc-9b42-44dc-acbf-17d1e49fe43d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1724 microversion: 2.1 time: 0.188657 Aug 18 12:33:17.002472 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4152/6806] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:16 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:18.017639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b6625108-7dfa-4a95-9c33-1c5e38aeff21 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:18.018600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b6625108-7dfa-4a95-9c33-1c5e38aeff21 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:18.027462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6625108-7dfa-4a95-9c33-1c5e38aeff21 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:18.028165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6625108-7dfa-4a95-9c33-1c5e38aeff21 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:18.028957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6625108-7dfa-4a95-9c33-1c5e38aeff21 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:18.031179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6625108-7dfa-4a95-9c33-1c5e38aeff21 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:18.031825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6625108-7dfa-4a95-9c33-1c5e38aeff21 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:18.032371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b6625108-7dfa-4a95-9c33-1c5e38aeff21 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:18.230192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b6625108-7dfa-4a95-9c33-1c5e38aeff21 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:18.247380 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b6625108-7dfa-4a95-9c33-1c5e38aeff21 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1724 microversion: 2.1 time: 0.237324 Aug 18 12:33:18.249391 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4153/6807] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:18 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:18.810419 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:33:18.811399 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:33:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:33:19.291821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fc82bee8-5adf-4ca0-9e1b-00021d26b2ac tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:19.292877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fc82bee8-5adf-4ca0-9e1b-00021d26b2ac tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:19.302820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc82bee8-5adf-4ca0-9e1b-00021d26b2ac tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:19.303441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc82bee8-5adf-4ca0-9e1b-00021d26b2ac tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:19.304279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc82bee8-5adf-4ca0-9e1b-00021d26b2ac tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:19.305494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc82bee8-5adf-4ca0-9e1b-00021d26b2ac tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:19.306146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc82bee8-5adf-4ca0-9e1b-00021d26b2ac tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:19.306787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fc82bee8-5adf-4ca0-9e1b-00021d26b2ac tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:19.505292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fc82bee8-5adf-4ca0-9e1b-00021d26b2ac tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:19.515318 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fc82bee8-5adf-4ca0-9e1b-00021d26b2ac tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1724 microversion: 2.1 time: 0.228009 Aug 18 12:33:19.515924 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4154/6808] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:19 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:20.537306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f2c50cae-fbfc-441f-b2e6-efca7ee7f395 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:20.538108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f2c50cae-fbfc-441f-b2e6-efca7ee7f395 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:20.546267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2c50cae-fbfc-441f-b2e6-efca7ee7f395 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:20.546866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2c50cae-fbfc-441f-b2e6-efca7ee7f395 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:20.547320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2c50cae-fbfc-441f-b2e6-efca7ee7f395 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:20.548056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2c50cae-fbfc-441f-b2e6-efca7ee7f395 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:20.548520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2c50cae-fbfc-441f-b2e6-efca7ee7f395 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:20.548955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f2c50cae-fbfc-441f-b2e6-efca7ee7f395 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:20.719837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f2c50cae-fbfc-441f-b2e6-efca7ee7f395 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:20.728930 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f2c50cae-fbfc-441f-b2e6-efca7ee7f395 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1724 microversion: 2.1 time: 0.195529 Aug 18 12:33:20.729655 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4155/6809] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:20 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:21.752630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bd19c71f-8a32-4f4a-a9ed-ce67d6faeeb1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:21.753370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bd19c71f-8a32-4f4a-a9ed-ce67d6faeeb1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:21.760994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd19c71f-8a32-4f4a-a9ed-ce67d6faeeb1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:21.761622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd19c71f-8a32-4f4a-a9ed-ce67d6faeeb1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:21.762175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd19c71f-8a32-4f4a-a9ed-ce67d6faeeb1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:21.763039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd19c71f-8a32-4f4a-a9ed-ce67d6faeeb1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:21.764264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd19c71f-8a32-4f4a-a9ed-ce67d6faeeb1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:21.764933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bd19c71f-8a32-4f4a-a9ed-ce67d6faeeb1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:21.930215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bd19c71f-8a32-4f4a-a9ed-ce67d6faeeb1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:21.940228 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bd19c71f-8a32-4f4a-a9ed-ce67d6faeeb1 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1724 microversion: 2.1 time: 0.191694 Aug 18 12:33:21.940833 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4156/6810] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:21 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:22.964448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a88b40e2-fa84-47db-b3db-ace7efcae792 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:22.965212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a88b40e2-fa84-47db-b3db-ace7efcae792 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:22.972969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a88b40e2-fa84-47db-b3db-ace7efcae792 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:22.973608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a88b40e2-fa84-47db-b3db-ace7efcae792 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:22.974200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a88b40e2-fa84-47db-b3db-ace7efcae792 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:22.975135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a88b40e2-fa84-47db-b3db-ace7efcae792 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:22.975758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a88b40e2-fa84-47db-b3db-ace7efcae792 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:22.976309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a88b40e2-fa84-47db-b3db-ace7efcae792 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:23.141035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a88b40e2-fa84-47db-b3db-ace7efcae792 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:23.156851 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a88b40e2-fa84-47db-b3db-ace7efcae792 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1724 microversion: 2.1 time: 0.196390 Aug 18 12:33:23.157890 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4157/6811] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:22 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:24.194406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-259ea5e7-4d98-4267-b7a7-02b7656c3c9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:24.195389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-259ea5e7-4d98-4267-b7a7-02b7656c3c9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:24.203911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-259ea5e7-4d98-4267-b7a7-02b7656c3c9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:24.204618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-259ea5e7-4d98-4267-b7a7-02b7656c3c9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:24.205151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-259ea5e7-4d98-4267-b7a7-02b7656c3c9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:24.206325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-259ea5e7-4d98-4267-b7a7-02b7656c3c9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:24.206997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-259ea5e7-4d98-4267-b7a7-02b7656c3c9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:24.207628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-259ea5e7-4d98-4267-b7a7-02b7656c3c9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:24.405991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-259ea5e7-4d98-4267-b7a7-02b7656c3c9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:24.417867 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-259ea5e7-4d98-4267-b7a7-02b7656c3c9c tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1724 microversion: 2.1 time: 0.227331 Aug 18 12:33:24.419008 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4158/6812] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:24 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:25.446765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-009bf245-3566-4a5e-9207-2a5c880ce016 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:25.447459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-009bf245-3566-4a5e-9207-2a5c880ce016 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:25.450648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=59 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:25.457831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009bf245-3566-4a5e-9207-2a5c880ce016 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:25.458339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009bf245-3566-4a5e-9207-2a5c880ce016 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:25.458830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009bf245-3566-4a5e-9207-2a5c880ce016 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:25.459567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009bf245-3566-4a5e-9207-2a5c880ce016 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:25.460192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009bf245-3566-4a5e-9207-2a5c880ce016 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:25.460639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009bf245-3566-4a5e-9207-2a5c880ce016 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:25.615125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-009bf245-3566-4a5e-9207-2a5c880ce016 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:25.624698 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-009bf245-3566-4a5e-9207-2a5c880ce016 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1724 microversion: 2.1 time: 0.181820 Aug 18 12:33:25.625316 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4159/6813] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:25 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:26.651093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-78b4f1bd-f118-4257-9b57-6828a9bbfde3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:26.652025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-78b4f1bd-f118-4257-9b57-6828a9bbfde3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:26.660200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78b4f1bd-f118-4257-9b57-6828a9bbfde3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:26.660704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78b4f1bd-f118-4257-9b57-6828a9bbfde3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:26.661152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78b4f1bd-f118-4257-9b57-6828a9bbfde3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:26.661881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78b4f1bd-f118-4257-9b57-6828a9bbfde3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:26.662349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78b4f1bd-f118-4257-9b57-6828a9bbfde3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:26.662810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-78b4f1bd-f118-4257-9b57-6828a9bbfde3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:26.825106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-78b4f1bd-f118-4257-9b57-6828a9bbfde3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:26.834625 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-78b4f1bd-f118-4257-9b57-6828a9bbfde3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1724 microversion: 2.1 time: 0.188436 Aug 18 12:33:26.835270 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4160/6814] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:26 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:27.858696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e907a773-a863-46c4-b312-a68915c09d4f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:27.859574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e907a773-a863-46c4-b312-a68915c09d4f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:27.868028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e907a773-a863-46c4-b312-a68915c09d4f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:27.868564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e907a773-a863-46c4-b312-a68915c09d4f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:27.869021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e907a773-a863-46c4-b312-a68915c09d4f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:27.869760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e907a773-a863-46c4-b312-a68915c09d4f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:27.870219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e907a773-a863-46c4-b312-a68915c09d4f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:27.870690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e907a773-a863-46c4-b312-a68915c09d4f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:28.041616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e907a773-a863-46c4-b312-a68915c09d4f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:28.050904 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e907a773-a863-46c4-b312-a68915c09d4f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1721 microversion: 2.1 time: 0.196998 Aug 18 12:33:28.051577 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4161/6815] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:27 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:28.073256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:33:28.073821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:28.082793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:28.083321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:28.083781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:28.084550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:28.085003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:28.085454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:28.133664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:28.135222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:28.136024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:28.137395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:28.138291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:28.139842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:28.177928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Getting quotas for project 52c152e60a4d4bce86773ea6a2e25fc4. Resources: {'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:33:28.187106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Getting quotas for user 6da9f8c739314b6a842c84bf71786f78 and project 52c152e60a4d4bce86773ea6a2e25fc4. Resources: {'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:33:28.267200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:28.350643 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9d0b8a95-23c1-4dba-8247-352a99637f87 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "POST /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b/action" status: 202 len: 0 microversion: 2.1 time: 0.280595 Aug 18 12:33:28.351996 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4162/6816] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:33:28 2022] POST /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:33:28.367151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ccb83efb-e296-43f9-9602-1cfea23b8833 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:28.368482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ccb83efb-e296-43f9-9602-1cfea23b8833 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:28.380552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccb83efb-e296-43f9-9602-1cfea23b8833 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:28.381436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccb83efb-e296-43f9-9602-1cfea23b8833 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:28.382232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccb83efb-e296-43f9-9602-1cfea23b8833 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:28.383547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccb83efb-e296-43f9-9602-1cfea23b8833 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:28.384427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccb83efb-e296-43f9-9602-1cfea23b8833 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:28.385233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ccb83efb-e296-43f9-9602-1cfea23b8833 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:28.636899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ccb83efb-e296-43f9-9602-1cfea23b8833 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:28.650764 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ccb83efb-e296-43f9-9602-1cfea23b8833 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.291750 Aug 18 12:33:28.651691 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4163/6817] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:28 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:29.674634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ae73384c-8091-468e-b626-b317c3d9ae80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:29.675351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ae73384c-8091-468e-b626-b317c3d9ae80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:29.682754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae73384c-8091-468e-b626-b317c3d9ae80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:29.683263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae73384c-8091-468e-b626-b317c3d9ae80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:29.683710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae73384c-8091-468e-b626-b317c3d9ae80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:29.684455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae73384c-8091-468e-b626-b317c3d9ae80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:29.684929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae73384c-8091-468e-b626-b317c3d9ae80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:29.686423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae73384c-8091-468e-b626-b317c3d9ae80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:29.847887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ae73384c-8091-468e-b626-b317c3d9ae80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:29.857815 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ae73384c-8091-468e-b626-b317c3d9ae80 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.187411 Aug 18 12:33:29.858450 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4164/6818] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:29 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:30.759002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-da0bc383-5ef8-41b2-8a37-5fdea574f127 req-520ba7ad-0578-45c2-9687-3e0bc5f0883e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5496ff6f-8dd3-4bca-8e59-cfe197d8d46b", "name": "network-vif-plugged", "status": "completed", "tag": "ab728485-d1e1-442e-a668-4fa93866a093"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:33:30.779343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-da0bc383-5ef8-41b2-8a37-5fdea574f127 req-520ba7ad-0578-45c2-9687-3e0bc5f0883e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:30.780377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-da0bc383-5ef8-41b2-8a37-5fdea574f127 req-520ba7ad-0578-45c2-9687-3e0bc5f0883e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:30.781213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-da0bc383-5ef8-41b2-8a37-5fdea574f127 req-520ba7ad-0578-45c2-9687-3e0bc5f0883e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:30.807909 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-da0bc383-5ef8-41b2-8a37-5fdea574f127 req-520ba7ad-0578-45c2-9687-3e0bc5f0883e service nova] Creating event network-vif-plugged:ab728485-d1e1-442e-a668-4fa93866a093 for instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b on n-h1-853611-3 Aug 18 12:33:30.820062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-da0bc383-5ef8-41b2-8a37-5fdea574f127 req-520ba7ad-0578-45c2-9687-3e0bc5f0883e service nova] Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:33:30.843660 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-da0bc383-5ef8-41b2-8a37-5fdea574f127 req-520ba7ad-0578-45c2-9687-3e0bc5f0883e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089992 Aug 18 12:33:30.845002 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4165/6819] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:33:30.884335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d6d3674c-dfba-4ff3-b007-9a4cc23da772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:30.885641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d6d3674c-dfba-4ff3-b007-9a4cc23da772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:30.896240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6d3674c-dfba-4ff3-b007-9a4cc23da772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:30.897138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6d3674c-dfba-4ff3-b007-9a4cc23da772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:30.897935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6d3674c-dfba-4ff3-b007-9a4cc23da772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:30.899262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6d3674c-dfba-4ff3-b007-9a4cc23da772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:30.900116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6d3674c-dfba-4ff3-b007-9a4cc23da772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:30.900957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d6d3674c-dfba-4ff3-b007-9a4cc23da772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:31.153700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d6d3674c-dfba-4ff3-b007-9a4cc23da772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:31.169811 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d6d3674c-dfba-4ff3-b007-9a4cc23da772 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.292744 Aug 18 12:33:31.170995 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4166/6820] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:30 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:32.210156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4f9eb65a-0c04-4516-a561-c97b50c92ef3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:32.211441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4f9eb65a-0c04-4516-a561-c97b50c92ef3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:32.224902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f9eb65a-0c04-4516-a561-c97b50c92ef3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:32.225753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f9eb65a-0c04-4516-a561-c97b50c92ef3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:32.226622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f9eb65a-0c04-4516-a561-c97b50c92ef3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:32.227898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f9eb65a-0c04-4516-a561-c97b50c92ef3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:32.229028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f9eb65a-0c04-4516-a561-c97b50c92ef3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:32.229800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f9eb65a-0c04-4516-a561-c97b50c92ef3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:32.449254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4f9eb65a-0c04-4516-a561-c97b50c92ef3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:32.460776 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4f9eb65a-0c04-4516-a561-c97b50c92ef3 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.258134 Aug 18 12:33:32.461713 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4167/6821] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:32 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:33.492698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8d0f9bf8-ac91-462c-93d7-b542cd32b391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:33.493428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8d0f9bf8-ac91-462c-93d7-b542cd32b391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:33.502824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d0f9bf8-ac91-462c-93d7-b542cd32b391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:33.503349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d0f9bf8-ac91-462c-93d7-b542cd32b391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:33.503809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d0f9bf8-ac91-462c-93d7-b542cd32b391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:33.504561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d0f9bf8-ac91-462c-93d7-b542cd32b391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:33.505038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d0f9bf8-ac91-462c-93d7-b542cd32b391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:33.505489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8d0f9bf8-ac91-462c-93d7-b542cd32b391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:33.661838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8d0f9bf8-ac91-462c-93d7-b542cd32b391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:33.671511 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8d0f9bf8-ac91-462c-93d7-b542cd32b391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.184324 Aug 18 12:33:33.672168 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4168/6822] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:33 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:34.354544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-75c2461c-df52-41a9-83bc-f7ec126dbbef req-409d4e8b-b1a8-42d3-bea5-52d8f8a6406e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5496ff6f-8dd3-4bca-8e59-cfe197d8d46b", "name": "network-vif-unplugged", "status": "completed", "tag": "ab728485-d1e1-442e-a668-4fa93866a093"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:33:34.373756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-75c2461c-df52-41a9-83bc-f7ec126dbbef req-409d4e8b-b1a8-42d3-bea5-52d8f8a6406e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:34.374738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-75c2461c-df52-41a9-83bc-f7ec126dbbef req-409d4e8b-b1a8-42d3-bea5-52d8f8a6406e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:34.375578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-75c2461c-df52-41a9-83bc-f7ec126dbbef req-409d4e8b-b1a8-42d3-bea5-52d8f8a6406e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:34.398017 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-75c2461c-df52-41a9-83bc-f7ec126dbbef req-409d4e8b-b1a8-42d3-bea5-52d8f8a6406e service nova] Creating event network-vif-unplugged:ab728485-d1e1-442e-a668-4fa93866a093 for instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b on n-h2-853611-3 Aug 18 12:33:34.405102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-75c2461c-df52-41a9-83bc-f7ec126dbbef req-409d4e8b-b1a8-42d3-bea5-52d8f8a6406e service nova] Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:33:34.421313 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-75c2461c-df52-41a9-83bc-f7ec126dbbef req-409d4e8b-b1a8-42d3-bea5-52d8f8a6406e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074552 Aug 18 12:33:34.422304 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4169/6823] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:34.695636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-45533226-3201-41df-8530-be1f4b77c391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:34.696379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-45533226-3201-41df-8530-be1f4b77c391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:34.706733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45533226-3201-41df-8530-be1f4b77c391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:34.707596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45533226-3201-41df-8530-be1f4b77c391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:34.708670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45533226-3201-41df-8530-be1f4b77c391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:34.710174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45533226-3201-41df-8530-be1f4b77c391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:34.710922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45533226-3201-41df-8530-be1f4b77c391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:34.711375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-45533226-3201-41df-8530-be1f4b77c391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:35.019321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-45533226-3201-41df-8530-be1f4b77c391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:35.035669 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-45533226-3201-41df-8530-be1f4b77c391 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.345140 Aug 18 12:33:35.036443 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4170/6824] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:34 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:36.072797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-391a8357-b891-49fe-9271-9898b55dc438 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:36.073973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-391a8357-b891-49fe-9271-9898b55dc438 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:36.087862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-391a8357-b891-49fe-9271-9898b55dc438 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:36.088800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-391a8357-b891-49fe-9271-9898b55dc438 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:36.089594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-391a8357-b891-49fe-9271-9898b55dc438 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:36.092091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-391a8357-b891-49fe-9271-9898b55dc438 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:36.093004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-391a8357-b891-49fe-9271-9898b55dc438 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:36.093745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-391a8357-b891-49fe-9271-9898b55dc438 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:36.285861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-391a8357-b891-49fe-9271-9898b55dc438 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:36.297097 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-391a8357-b891-49fe-9271-9898b55dc438 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.231545 Aug 18 12:33:36.297831 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4171/6825] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:36 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:36.450639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f2884acd-5d33-46c1-a754-71d04c0c0718 req-64437b60-dda7-4cf7-a783-c13603127644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5496ff6f-8dd3-4bca-8e59-cfe197d8d46b", "tag": "ab728485-d1e1-442e-a668-4fa93866a093"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:33:36.461898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f2884acd-5d33-46c1-a754-71d04c0c0718 req-64437b60-dda7-4cf7-a783-c13603127644 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:36.462386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f2884acd-5d33-46c1-a754-71d04c0c0718 req-64437b60-dda7-4cf7-a783-c13603127644 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:36.462956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f2884acd-5d33-46c1-a754-71d04c0c0718 req-64437b60-dda7-4cf7-a783-c13603127644 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:36.476618 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f2884acd-5d33-46c1-a754-71d04c0c0718 req-64437b60-dda7-4cf7-a783-c13603127644 service nova] Creating event network-changed:ab728485-d1e1-442e-a668-4fa93866a093 for instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b on n-h2-853611-3 Aug 18 12:33:36.486149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-f2884acd-5d33-46c1-a754-71d04c0c0718 req-64437b60-dda7-4cf7-a783-c13603127644 service nova] Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:33:36.506210 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f2884acd-5d33-46c1-a754-71d04c0c0718 req-64437b60-dda7-4cf7-a783-c13603127644 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059258 Aug 18 12:33:36.507707 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4172/6826] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:33:37.328909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-12e973c0-55df-44b8-8f4e-07cc4eec717e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:37.329957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-12e973c0-55df-44b8-8f4e-07cc4eec717e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:37.345735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12e973c0-55df-44b8-8f4e-07cc4eec717e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:37.346715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12e973c0-55df-44b8-8f4e-07cc4eec717e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:37.347559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12e973c0-55df-44b8-8f4e-07cc4eec717e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:37.348883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12e973c0-55df-44b8-8f4e-07cc4eec717e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:37.349770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12e973c0-55df-44b8-8f4e-07cc4eec717e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:37.350691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-12e973c0-55df-44b8-8f4e-07cc4eec717e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:37.996114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-12e973c0-55df-44b8-8f4e-07cc4eec717e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:38.005878 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-12e973c0-55df-44b8-8f4e-07cc4eec717e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.687284 Aug 18 12:33:38.006533 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4173/6827] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:37 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:39.032294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-80871325-f388-4e12-86bc-94af13aee062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:39.033439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-80871325-f388-4e12-86bc-94af13aee062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:39.037070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:39.049806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80871325-f388-4e12-86bc-94af13aee062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:39.050638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80871325-f388-4e12-86bc-94af13aee062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:39.051456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80871325-f388-4e12-86bc-94af13aee062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:39.052707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80871325-f388-4e12-86bc-94af13aee062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:39.053525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80871325-f388-4e12-86bc-94af13aee062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:39.054305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80871325-f388-4e12-86bc-94af13aee062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:39.256479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-80871325-f388-4e12-86bc-94af13aee062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:39.268549 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-80871325-f388-4e12-86bc-94af13aee062 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.242450 Aug 18 12:33:39.269242 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4174/6828] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:39 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:40.291693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-46a81d9d-88b8-4d88-b7ef-85fae5ca4c02 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:40.292579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-46a81d9d-88b8-4d88-b7ef-85fae5ca4c02 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:40.300792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46a81d9d-88b8-4d88-b7ef-85fae5ca4c02 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:40.301332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46a81d9d-88b8-4d88-b7ef-85fae5ca4c02 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:40.301788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46a81d9d-88b8-4d88-b7ef-85fae5ca4c02 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:40.302691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46a81d9d-88b8-4d88-b7ef-85fae5ca4c02 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:40.303182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46a81d9d-88b8-4d88-b7ef-85fae5ca4c02 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:40.303637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46a81d9d-88b8-4d88-b7ef-85fae5ca4c02 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:40.463388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-46a81d9d-88b8-4d88-b7ef-85fae5ca4c02 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:40.473462 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-46a81d9d-88b8-4d88-b7ef-85fae5ca4c02 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.185710 Aug 18 12:33:40.474065 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4175/6829] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:40 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:41.497084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59eda93c-ffc7-4805-a835-5b0ea3b6c0c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:41.497821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59eda93c-ffc7-4805-a835-5b0ea3b6c0c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:41.506636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59eda93c-ffc7-4805-a835-5b0ea3b6c0c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:41.507152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59eda93c-ffc7-4805-a835-5b0ea3b6c0c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:41.507610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59eda93c-ffc7-4805-a835-5b0ea3b6c0c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:41.508346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59eda93c-ffc7-4805-a835-5b0ea3b6c0c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:41.508841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59eda93c-ffc7-4805-a835-5b0ea3b6c0c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:41.509273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59eda93c-ffc7-4805-a835-5b0ea3b6c0c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:41.700370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-59eda93c-ffc7-4805-a835-5b0ea3b6c0c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:41.712311 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59eda93c-ffc7-4805-a835-5b0ea3b6c0c7 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.219069 Aug 18 12:33:41.713167 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4176/6830] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:41 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:42.736278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-02f337ed-59f0-4a92-9124-c57194b21862 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:42.737043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-02f337ed-59f0-4a92-9124-c57194b21862 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:42.744870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02f337ed-59f0-4a92-9124-c57194b21862 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:42.745501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02f337ed-59f0-4a92-9124-c57194b21862 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:42.746057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02f337ed-59f0-4a92-9124-c57194b21862 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:42.747014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02f337ed-59f0-4a92-9124-c57194b21862 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:42.747541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02f337ed-59f0-4a92-9124-c57194b21862 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:42.748550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-02f337ed-59f0-4a92-9124-c57194b21862 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:42.907044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-02f337ed-59f0-4a92-9124-c57194b21862 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:42.916096 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-02f337ed-59f0-4a92-9124-c57194b21862 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.184105 Aug 18 12:33:42.916690 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4177/6831] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:42 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:43.940152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-20859919-58fb-4637-bf39-8cb2e12b5bf2 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:43.941641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-20859919-58fb-4637-bf39-8cb2e12b5bf2 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:43.949351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20859919-58fb-4637-bf39-8cb2e12b5bf2 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:43.950176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20859919-58fb-4637-bf39-8cb2e12b5bf2 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:43.952196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20859919-58fb-4637-bf39-8cb2e12b5bf2 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:43.953146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20859919-58fb-4637-bf39-8cb2e12b5bf2 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:43.953902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20859919-58fb-4637-bf39-8cb2e12b5bf2 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:43.954542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-20859919-58fb-4637-bf39-8cb2e12b5bf2 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:44.182941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-20859919-58fb-4637-bf39-8cb2e12b5bf2 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:44.192907 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-20859919-58fb-4637-bf39-8cb2e12b5bf2 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.258687 Aug 18 12:33:44.193525 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4178/6832] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:43 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:45.216520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26ff1a44-cfaa-4709-9484-bb8b005583e0 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:45.218001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26ff1a44-cfaa-4709-9484-bb8b005583e0 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:45.225267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26ff1a44-cfaa-4709-9484-bb8b005583e0 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:45.225769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26ff1a44-cfaa-4709-9484-bb8b005583e0 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:45.226217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26ff1a44-cfaa-4709-9484-bb8b005583e0 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:45.226968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26ff1a44-cfaa-4709-9484-bb8b005583e0 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:45.227435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26ff1a44-cfaa-4709-9484-bb8b005583e0 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:45.227870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26ff1a44-cfaa-4709-9484-bb8b005583e0 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:45.233138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:45.380912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-26ff1a44-cfaa-4709-9484-bb8b005583e0 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:45.391185 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-26ff1a44-cfaa-4709-9484-bb8b005583e0 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.178513 Aug 18 12:33:45.391824 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4179/6833] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:45 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:46.427394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-da742af2-8713-40fc-9eee-742308be1a2f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:46.428464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-da742af2-8713-40fc-9eee-742308be1a2f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:46.435768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da742af2-8713-40fc-9eee-742308be1a2f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:46.436157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da742af2-8713-40fc-9eee-742308be1a2f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:46.436952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da742af2-8713-40fc-9eee-742308be1a2f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:46.437330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da742af2-8713-40fc-9eee-742308be1a2f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:46.437793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da742af2-8713-40fc-9eee-742308be1a2f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:46.438231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-da742af2-8713-40fc-9eee-742308be1a2f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:46.599460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-da742af2-8713-40fc-9eee-742308be1a2f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:46.614030 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-da742af2-8713-40fc-9eee-742308be1a2f tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.190443 Aug 18 12:33:46.614842 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4180/6834] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:46 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:47.636970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-67f1e60e-a9a2-4626-93b8-f6d617c37a57 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:47.637702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-67f1e60e-a9a2-4626-93b8-f6d617c37a57 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:47.644920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-67f1e60e-a9a2-4626-93b8-f6d617c37a57 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:47.645415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-67f1e60e-a9a2-4626-93b8-f6d617c37a57 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:47.645860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-67f1e60e-a9a2-4626-93b8-f6d617c37a57 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:47.646611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-67f1e60e-a9a2-4626-93b8-f6d617c37a57 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:47.647076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-67f1e60e-a9a2-4626-93b8-f6d617c37a57 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:47.647506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-67f1e60e-a9a2-4626-93b8-f6d617c37a57 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:47.827646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-67f1e60e-a9a2-4626-93b8-f6d617c37a57 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:47.836300 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-67f1e60e-a9a2-4626-93b8-f6d617c37a57 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1720 microversion: 2.1 time: 0.203171 Aug 18 12:33:47.836999 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4181/6835] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:47 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1720 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:48.861519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b1ca8e5c-9065-44ca-818e-75cded20a252 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:48.862465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b1ca8e5c-9065-44ca-818e-75cded20a252 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:48.869994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1ca8e5c-9065-44ca-818e-75cded20a252 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:48.870542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1ca8e5c-9065-44ca-818e-75cded20a252 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:48.870998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1ca8e5c-9065-44ca-818e-75cded20a252 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:48.871748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1ca8e5c-9065-44ca-818e-75cded20a252 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:48.872231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1ca8e5c-9065-44ca-818e-75cded20a252 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:48.872762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1ca8e5c-9065-44ca-818e-75cded20a252 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:49.131793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b1ca8e5c-9065-44ca-818e-75cded20a252 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:49.141415 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b1ca8e5c-9065-44ca-818e-75cded20a252 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1713 microversion: 2.1 time: 0.285450 Aug 18 12:33:49.142031 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4182/6836] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:48 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1713 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:49.164541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1ab51c66-0c74-4f6e-b737-6501b7f5f198 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:49.165216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1ab51c66-0c74-4f6e-b737-6501b7f5f198 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:49.173141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ab51c66-0c74-4f6e-b737-6501b7f5f198 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:49.173666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ab51c66-0c74-4f6e-b737-6501b7f5f198 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:49.174126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ab51c66-0c74-4f6e-b737-6501b7f5f198 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:49.174900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ab51c66-0c74-4f6e-b737-6501b7f5f198 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:49.175380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ab51c66-0c74-4f6e-b737-6501b7f5f198 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:49.175830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1ab51c66-0c74-4f6e-b737-6501b7f5f198 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:49.325070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1ab51c66-0c74-4f6e-b737-6501b7f5f198 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:49.335031 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1ab51c66-0c74-4f6e-b737-6501b7f5f198 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1713 microversion: 2.1 time: 0.174641 Aug 18 12:33:49.335672 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4183/6837] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:49 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1713 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:49.356821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f35bd93d-216c-4bb6-b032-6e95f728eaf4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:49.357552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f35bd93d-216c-4bb6-b032-6e95f728eaf4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:49.364283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f35bd93d-216c-4bb6-b032-6e95f728eaf4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:49.364713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f35bd93d-216c-4bb6-b032-6e95f728eaf4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:49.365168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f35bd93d-216c-4bb6-b032-6e95f728eaf4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:49.365907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f35bd93d-216c-4bb6-b032-6e95f728eaf4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:49.366382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f35bd93d-216c-4bb6-b032-6e95f728eaf4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:49.366861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f35bd93d-216c-4bb6-b032-6e95f728eaf4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:49.514132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f35bd93d-216c-4bb6-b032-6e95f728eaf4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:49.525529 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f35bd93d-216c-4bb6-b032-6e95f728eaf4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1713 microversion: 2.1 time: 0.172771 Aug 18 12:33:49.526135 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4184/6838] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:49 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1713 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:49.546993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b269498-d548-4015-9825-4e4ed1a69858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:49.547516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b269498-d548-4015-9825-4e4ed1a69858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:49.554038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b269498-d548-4015-9825-4e4ed1a69858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:49.554594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b269498-d548-4015-9825-4e4ed1a69858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:49.555055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b269498-d548-4015-9825-4e4ed1a69858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:49.555790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b269498-d548-4015-9825-4e4ed1a69858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:49.556264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b269498-d548-4015-9825-4e4ed1a69858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:49.556710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b269498-d548-4015-9825-4e4ed1a69858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:49.588517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b269498-d548-4015-9825-4e4ed1a69858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:33:49.677799 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b269498-d548-4015-9825-4e4ed1a69858 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 204 len: 0 microversion: 2.1 time: 0.135174 Aug 18 12:33:49.678316 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4185/6839] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:33:49 2022] DELETE /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:33:49.689936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c24b5b69-fe39-4f28-9c13-381026ef7644 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:49.690697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c24b5b69-fe39-4f28-9c13-381026ef7644 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:49.697286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c24b5b69-fe39-4f28-9c13-381026ef7644 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:49.697785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c24b5b69-fe39-4f28-9c13-381026ef7644 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:49.698236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c24b5b69-fe39-4f28-9c13-381026ef7644 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:49.698988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c24b5b69-fe39-4f28-9c13-381026ef7644 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:49.699454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c24b5b69-fe39-4f28-9c13-381026ef7644 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:49.699890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c24b5b69-fe39-4f28-9c13-381026ef7644 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:49.877427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c24b5b69-fe39-4f28-9c13-381026ef7644 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:49.886393 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c24b5b69-fe39-4f28-9c13-381026ef7644 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1719 microversion: 2.1 time: 0.201498 Aug 18 12:33:49.887038 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4186/6840] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:49 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1719 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:50.912220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1562d9a3-0a24-4656-a9cc-6835968ff51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:50.913279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1562d9a3-0a24-4656-a9cc-6835968ff51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:50.925385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1562d9a3-0a24-4656-a9cc-6835968ff51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:50.926031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1562d9a3-0a24-4656-a9cc-6835968ff51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:50.926520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1562d9a3-0a24-4656-a9cc-6835968ff51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:50.927274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1562d9a3-0a24-4656-a9cc-6835968ff51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:50.927754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1562d9a3-0a24-4656-a9cc-6835968ff51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:50.928203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1562d9a3-0a24-4656-a9cc-6835968ff51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:51.098868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1562d9a3-0a24-4656-a9cc-6835968ff51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:51.108539 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1562d9a3-0a24-4656-a9cc-6835968ff51d tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1719 microversion: 2.1 time: 0.201714 Aug 18 12:33:51.109311 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4187/6841] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:50 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1719 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:52.137877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d42be783-2d26-4a00-b178-e06118a983cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:52.140413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d42be783-2d26-4a00-b178-e06118a983cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:52.151003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d42be783-2d26-4a00-b178-e06118a983cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:52.151527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d42be783-2d26-4a00-b178-e06118a983cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:52.152156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d42be783-2d26-4a00-b178-e06118a983cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:52.152730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d42be783-2d26-4a00-b178-e06118a983cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:52.153203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d42be783-2d26-4a00-b178-e06118a983cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:52.153648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d42be783-2d26-4a00-b178-e06118a983cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:52.268535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d42be783-2d26-4a00-b178-e06118a983cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:52.280456 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d42be783-2d26-4a00-b178-e06118a983cd tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1652 microversion: 2.1 time: 0.151381 Aug 18 12:33:52.281106 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4188/6842] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:52 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1652 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:52.470940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ec90ca6d-bc50-49a0-926f-df5af84b6113 req-7600dc04-4f76-4c0d-af2b-ca3e1a475d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5496ff6f-8dd3-4bca-8e59-cfe197d8d46b", "name": "network-vif-deleted", "tag": "ab728485-d1e1-442e-a668-4fa93866a093"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:33:52.491984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ec90ca6d-bc50-49a0-926f-df5af84b6113 req-7600dc04-4f76-4c0d-af2b-ca3e1a475d67 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:52.493333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ec90ca6d-bc50-49a0-926f-df5af84b6113 req-7600dc04-4f76-4c0d-af2b-ca3e1a475d67 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:52.494260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ec90ca6d-bc50-49a0-926f-df5af84b6113 req-7600dc04-4f76-4c0d-af2b-ca3e1a475d67 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:52.520664 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ec90ca6d-bc50-49a0-926f-df5af84b6113 req-7600dc04-4f76-4c0d-af2b-ca3e1a475d67 service nova] Creating event network-vif-deleted:ab728485-d1e1-442e-a668-4fa93866a093 for instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b on n-h2-853611-3 Aug 18 12:33:52.530638 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ec90ca6d-bc50-49a0-926f-df5af84b6113 req-7600dc04-4f76-4c0d-af2b-ca3e1a475d67 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068817 Aug 18 12:33:52.531941 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4189/6843] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:33:53.310014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ef1a68a8-a4ba-4d95-ba28-3a2bd3197c53 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:53.311836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef1a68a8-a4ba-4d95-ba28-3a2bd3197c53 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:53.324707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef1a68a8-a4ba-4d95-ba28-3a2bd3197c53 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:53.327535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef1a68a8-a4ba-4d95-ba28-3a2bd3197c53 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:53.328639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef1a68a8-a4ba-4d95-ba28-3a2bd3197c53 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:53.330309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef1a68a8-a4ba-4d95-ba28-3a2bd3197c53 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:53.331191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef1a68a8-a4ba-4d95-ba28-3a2bd3197c53 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:53.332127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef1a68a8-a4ba-4d95-ba28-3a2bd3197c53 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:53.459121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ef1a68a8-a4ba-4d95-ba28-3a2bd3197c53 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:53.474056 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ef1a68a8-a4ba-4d95-ba28-3a2bd3197c53 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1369 microversion: 2.1 time: 0.173232 Aug 18 12:33:53.475271 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4190/6844] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:53 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1369 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:54.500964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9fcd2c02-839c-4100-8a42-6cbc5da8ef3b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:54.501695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9fcd2c02-839c-4100-8a42-6cbc5da8ef3b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:54.509246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9fcd2c02-839c-4100-8a42-6cbc5da8ef3b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:54.509765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9fcd2c02-839c-4100-8a42-6cbc5da8ef3b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:54.510227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9fcd2c02-839c-4100-8a42-6cbc5da8ef3b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:54.511009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9fcd2c02-839c-4100-8a42-6cbc5da8ef3b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:54.511484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9fcd2c02-839c-4100-8a42-6cbc5da8ef3b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:54.511929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9fcd2c02-839c-4100-8a42-6cbc5da8ef3b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:54.608201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9fcd2c02-839c-4100-8a42-6cbc5da8ef3b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:54.625278 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9fcd2c02-839c-4100-8a42-6cbc5da8ef3b tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1369 microversion: 2.1 time: 0.129426 Aug 18 12:33:54.626075 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4191/6845] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:54 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1369 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:33:55.659938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9766e9f3-89e6-4654-8327-5e40430738b8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:55.661089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9766e9f3-89e6-4654-8327-5e40430738b8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:55.666127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:33:55.676207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9766e9f3-89e6-4654-8327-5e40430738b8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:55.677204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9766e9f3-89e6-4654-8327-5e40430738b8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:55.677818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9766e9f3-89e6-4654-8327-5e40430738b8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:55.678953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9766e9f3-89e6-4654-8327-5e40430738b8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:55.680287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9766e9f3-89e6-4654-8327-5e40430738b8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:55.680846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9766e9f3-89e6-4654-8327-5e40430738b8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:56.064375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9766e9f3-89e6-4654-8327-5e40430738b8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:56.073612 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9766e9f3-89e6-4654-8327-5e40430738b8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1369 microversion: 2.1 time: 0.420831 Aug 18 12:33:56.074212 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4192/6846] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:55 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1369 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:57.100366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c6f2b3a-7787-4fa9-8235-acbab7b9f302 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:57.101095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4c6f2b3a-7787-4fa9-8235-acbab7b9f302 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:57.110409 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c6f2b3a-7787-4fa9-8235-acbab7b9f302 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:57.110947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c6f2b3a-7787-4fa9-8235-acbab7b9f302 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:57.111405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c6f2b3a-7787-4fa9-8235-acbab7b9f302 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:57.112150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c6f2b3a-7787-4fa9-8235-acbab7b9f302 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:57.112624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c6f2b3a-7787-4fa9-8235-acbab7b9f302 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:57.113068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c6f2b3a-7787-4fa9-8235-acbab7b9f302 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:57.190206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4c6f2b3a-7787-4fa9-8235-acbab7b9f302 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da9f8c739314b6a842c84bf71786f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c152e60a4d4bce86773ea6a2e25fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:33:57.199766 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4c6f2b3a-7787-4fa9-8235-acbab7b9f302 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 200 len: 1369 microversion: 2.1 time: 0.103930 Aug 18 12:33:57.200667 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4193/6847] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:57 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:33:58.225024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f369506c-254f-4eef-8528-b76817950591 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:58.226181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f369506c-254f-4eef-8528-b76817950591 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:58.235696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f369506c-254f-4eef-8528-b76817950591 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:58.236343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f369506c-254f-4eef-8528-b76817950591 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:58.236875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f369506c-254f-4eef-8528-b76817950591 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:58.237676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f369506c-254f-4eef-8528-b76817950591 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:58.238167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f369506c-254f-4eef-8528-b76817950591 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:58.238877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f369506c-254f-4eef-8528-b76817950591 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:58.255523 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-f369506c-254f-4eef-8528-b76817950591 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f369506c-254f-4eef-8528-b76817950591 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b HTTP/1.1 Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5496ff6f-8dd3-4bca-8e59-cfe197d8d46b'} Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:58.257546 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:33:58.264089 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:58.264089 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:58.264089 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:58.264089 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:58.264089 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:58.264089 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:33:58.264089 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:33:58.264089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f369506c-254f-4eef-8528-b76817950591 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:58.264089 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f369506c-254f-4eef-8528-b76817950591 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 404 len: 111 microversion: 2.1 time: 0.039208 Aug 18 12:33:58.264089 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4194/6848] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:33:58 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:33:58.347532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a9714cd0-b4f7-4540-81e7-6971eeb6d31e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:33:58.349684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a9714cd0-b4f7-4540-81e7-6971eeb6d31e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:33:58.356479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9714cd0-b4f7-4540-81e7-6971eeb6d31e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:58.356995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9714cd0-b4f7-4540-81e7-6971eeb6d31e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:58.358029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9714cd0-b4f7-4540-81e7-6971eeb6d31e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:58.358869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9714cd0-b4f7-4540-81e7-6971eeb6d31e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:33:58.359265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9714cd0-b4f7-4540-81e7-6971eeb6d31e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:33:58.359708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9714cd0-b4f7-4540-81e7-6971eeb6d31e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:33:58.375525 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-a9714cd0-b4f7-4540-81e7-6971eeb6d31e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a9714cd0-b4f7-4540-81e7-6971eeb6d31e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b/os-volume_attachments HTTP/1.1 Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': '5496ff6f-8dd3-4bca-8e59-cfe197d8d46b'} Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:33:58.377429 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:33:58.384524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:33:58.384524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:33:58.384524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:33:58.384524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:33:58.384524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:33:58.384524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:33:58.384524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:33:58.384524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:33:58.384524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:33:58.384524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:33:58.384524 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:33:58.384524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a9714cd0-b4f7-4540-81e7-6971eeb6d31e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:33:58.384524 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a9714cd0-b4f7-4540-81e7-6971eeb6d31e tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036127 Aug 18 12:33:58.384524 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4195/6849] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:33:58 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:34:02.885834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7917df71-9242-45a0-8da0-acb2d979c2ba tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:02.886597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7917df71-9242-45a0-8da0-acb2d979c2ba tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:02.894171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7917df71-9242-45a0-8da0-acb2d979c2ba tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:02.894734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7917df71-9242-45a0-8da0-acb2d979c2ba tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:02.895190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7917df71-9242-45a0-8da0-acb2d979c2ba tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:02.895944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7917df71-9242-45a0-8da0-acb2d979c2ba tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:02.896435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7917df71-9242-45a0-8da0-acb2d979c2ba tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:02.896873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7917df71-9242-45a0-8da0-acb2d979c2ba tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:02.901781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:34:02.915006 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-7917df71-9242-45a0-8da0-acb2d979c2ba tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7917df71-9242-45a0-8da0-acb2d979c2ba tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b HTTP/1.1 Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5496ff6f-8dd3-4bca-8e59-cfe197d8d46b'} Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:34:02.916724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:34:02.924755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:34:02.924755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:02.924755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:02.924755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:02.924755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:02.924755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:02.924755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:02.924755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:34:02.924755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:34:02.924755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:34:02.924755 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:02.924755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7917df71-9242-45a0-8da0-acb2d979c2ba tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:02.924755 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7917df71-9242-45a0-8da0-acb2d979c2ba tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 404 len: 111 microversion: 2.1 time: 0.036911 Aug 18 12:34:02.924755 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4196/6850] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:34:02 2022] DELETE /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:34:02.928100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2f258b7-495c-4b70-99e8-6f2041eb46f4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:02.928747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b2f258b7-495c-4b70-99e8-6f2041eb46f4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:02.936477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2f258b7-495c-4b70-99e8-6f2041eb46f4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:02.936986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2f258b7-495c-4b70-99e8-6f2041eb46f4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:02.937444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2f258b7-495c-4b70-99e8-6f2041eb46f4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:02.938215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2f258b7-495c-4b70-99e8-6f2041eb46f4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:02.938730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2f258b7-495c-4b70-99e8-6f2041eb46f4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:02.939221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2f258b7-495c-4b70-99e8-6f2041eb46f4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:02.955817 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-b2f258b7-495c-4b70-99e8-6f2041eb46f4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2f258b7-495c-4b70-99e8-6f2041eb46f4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b HTTP/1.1 Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5496ff6f-8dd3-4bca-8e59-cfe197d8d46b'} Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:02.957475 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:02.966360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:02.966360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:02.966360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:02.966360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:34:02.966360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:34:02.966360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. Aug 18 12:34:02.966360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:02.966360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2f258b7-495c-4b70-99e8-6f2041eb46f4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance 5496ff6f-8dd3-4bca-8e59-cfe197d8d46b could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:02.966360 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b2f258b7-495c-4b70-99e8-6f2041eb46f4 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b" status: 404 len: 111 microversion: 2.1 time: 0.034971 Aug 18 12:34:02.966360 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4197/6851] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:02 2022] GET /compute/v2.1/servers/5496ff6f-8dd3-4bca-8e59-cfe197d8d46b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:34:02.971448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4ad69f53-9803-4535-8f24-4991d8491668 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:02.972006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4ad69f53-9803-4535-8f24-4991d8491668 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:02.982109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ad69f53-9803-4535-8f24-4991d8491668 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:02.983921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ad69f53-9803-4535-8f24-4991d8491668 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:02.984798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ad69f53-9803-4535-8f24-4991d8491668 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:02.986291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ad69f53-9803-4535-8f24-4991d8491668 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:02.987180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ad69f53-9803-4535-8f24-4991d8491668 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:02.987952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ad69f53-9803-4535-8f24-4991d8491668 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:03.016960 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-4ad69f53-9803-4535-8f24-4991d8491668 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4ad69f53-9803-4535-8f24-4991d8491668 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c HTTP/1.1 Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'f910523b-f6f1-4366-9fd8-5316a184943c'} Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:34:03.020213 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:34:03.023841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:34:03.023841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.023841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:03.023841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.023841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.023841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:03.023841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:03.023841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:34:03.023841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:34:03.023841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:34:03.023841 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.023841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4ad69f53-9803-4535-8f24-4991d8491668 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:03.023841 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4ad69f53-9803-4535-8f24-4991d8491668 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 404 len: 111 microversion: 2.1 time: 0.056493 Aug 18 12:34:03.024732 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4198/6852] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:34:02 2022] DELETE /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:34:03.034298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7c86e2e0-8233-4659-a2e2-6c528fb00590 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:03.034973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7c86e2e0-8233-4659-a2e2-6c528fb00590 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: f910523b-f6f1-4366-9fd8-5316a184943c] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:03.042128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c86e2e0-8233-4659-a2e2-6c528fb00590 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:03.042687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c86e2e0-8233-4659-a2e2-6c528fb00590 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:03.043148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c86e2e0-8233-4659-a2e2-6c528fb00590 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:03.043898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c86e2e0-8233-4659-a2e2-6c528fb00590 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:03.044374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c86e2e0-8233-4659-a2e2-6c528fb00590 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:03.045735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7c86e2e0-8233-4659-a2e2-6c528fb00590 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:03.063667 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-7c86e2e0-8233-4659-a2e2-6c528fb00590 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7c86e2e0-8233-4659-a2e2-6c528fb00590 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c HTTP/1.1 Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'f910523b-f6f1-4366-9fd8-5316a184943c'} Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:03.066697 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.074407 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.074407 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:03.074407 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:03.074407 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:34:03.074407 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:34:03.074407 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. Aug 18 12:34:03.074407 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.074407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7c86e2e0-8233-4659-a2e2-6c528fb00590 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance f910523b-f6f1-4366-9fd8-5316a184943c could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:03.074407 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7c86e2e0-8233-4659-a2e2-6c528fb00590 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c" status: 404 len: 111 microversion: 2.1 time: 0.039142 Aug 18 12:34:03.077397 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4199/6853] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:03 2022] GET /compute/v2.1/servers/f910523b-f6f1-4366-9fd8-5316a184943c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:34:03.084638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5253b298-9121-47dd-b454-fc3d95ab9a43 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:03.085567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5253b298-9121-47dd-b454-fc3d95ab9a43 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:03.097318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5253b298-9121-47dd-b454-fc3d95ab9a43 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:03.098216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5253b298-9121-47dd-b454-fc3d95ab9a43 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:03.099044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5253b298-9121-47dd-b454-fc3d95ab9a43 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:03.100351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5253b298-9121-47dd-b454-fc3d95ab9a43 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:03.101207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5253b298-9121-47dd-b454-fc3d95ab9a43 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:03.102015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5253b298-9121-47dd-b454-fc3d95ab9a43 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:03.130687 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-5253b298-9121-47dd-b454-fc3d95ab9a43 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5253b298-9121-47dd-b454-fc3d95ab9a43 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 HTTP/1.1 Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '543b0855-c82a-4ccf-aac0-3b6feecde8e6'} Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:34:03.133570 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:34:03.141019 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:34:03.141019 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.141019 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:03.141019 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.141019 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.141019 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:03.141019 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:03.141019 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:34:03.141019 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:34:03.141019 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:34:03.141019 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.141019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5253b298-9121-47dd-b454-fc3d95ab9a43 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:03.141019 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5253b298-9121-47dd-b454-fc3d95ab9a43 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "DELETE /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 404 len: 111 microversion: 2.1 time: 0.058543 Aug 18 12:34:03.141019 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4200/6854] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:34:03 2022] DELETE /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:34:03.150979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a7bc773-960a-42e2-9f14-ad30fcf5ad45 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:03.152167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4a7bc773-960a-42e2-9f14-ad30fcf5ad45 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 543b0855-c82a-4ccf-aac0-3b6feecde8e6] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:03.163247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7bc773-960a-42e2-9f14-ad30fcf5ad45 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:03.164146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7bc773-960a-42e2-9f14-ad30fcf5ad45 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:03.164979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7bc773-960a-42e2-9f14-ad30fcf5ad45 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:03.166304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7bc773-960a-42e2-9f14-ad30fcf5ad45 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:03.167236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7bc773-960a-42e2-9f14-ad30fcf5ad45 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:03.168071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4a7bc773-960a-42e2-9f14-ad30fcf5ad45 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:03.198618 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-4a7bc773-960a-42e2-9f14-ad30fcf5ad45 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a7bc773-960a-42e2-9f14-ad30fcf5ad45 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 HTTP/1.1 Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '543b0855-c82a-4ccf-aac0-3b6feecde8e6'} Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:03.202322 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.210852 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.210852 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:03.210852 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:03.210852 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:34:03.210852 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:34:03.210852 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. Aug 18 12:34:03.210852 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.210852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4a7bc773-960a-42e2-9f14-ad30fcf5ad45 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance 543b0855-c82a-4ccf-aac0-3b6feecde8e6 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:03.210852 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4a7bc773-960a-42e2-9f14-ad30fcf5ad45 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6" status: 404 len: 111 microversion: 2.1 time: 0.061244 Aug 18 12:34:03.210852 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4201/6855] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:03 2022] GET /compute/v2.1/servers/543b0855-c82a-4ccf-aac0-3b6feecde8e6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:34:03.220758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac825b63-522d-4b1d-b189-3ac58cc50905 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:03.221595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ac825b63-522d-4b1d-b189-3ac58cc50905 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:03.232982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac825b63-522d-4b1d-b189-3ac58cc50905 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:03.233888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac825b63-522d-4b1d-b189-3ac58cc50905 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:03.234709 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac825b63-522d-4b1d-b189-3ac58cc50905 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:03.236015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac825b63-522d-4b1d-b189-3ac58cc50905 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:03.236871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac825b63-522d-4b1d-b189-3ac58cc50905 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:03.237676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ac825b63-522d-4b1d-b189-3ac58cc50905 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:03.265275 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-ac825b63-522d-4b1d-b189-3ac58cc50905 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac825b63-522d-4b1d-b189-3ac58cc50905 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba HTTP/1.1 Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5cd70be6-b296-4aed-8ce7-b873c0267aba'} Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:34:03.268556 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:34:03.276058 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:34:03.276058 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.276058 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:03.276058 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.276058 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.276058 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:03.276058 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:03.276058 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:34:03.276058 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:34:03.276058 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:34:03.276058 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.276058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ac825b63-522d-4b1d-b189-3ac58cc50905 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:03.276058 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ac825b63-522d-4b1d-b189-3ac58cc50905 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 404 len: 111 microversion: 2.1 time: 0.058327 Aug 18 12:34:03.276058 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4202/6856] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:34:03 2022] DELETE /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:34:03.287058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b16b319-16cf-4e9a-ba2d-259d880610a8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:03.288529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3b16b319-16cf-4e9a-ba2d-259d880610a8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] [instance: 5cd70be6-b296-4aed-8ce7-b873c0267aba] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:03.299575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b16b319-16cf-4e9a-ba2d-259d880610a8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:03.300470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b16b319-16cf-4e9a-ba2d-259d880610a8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:03.301271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b16b319-16cf-4e9a-ba2d-259d880610a8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:03.302606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b16b319-16cf-4e9a-ba2d-259d880610a8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:03.303472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b16b319-16cf-4e9a-ba2d-259d880610a8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:03.304290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b16b319-16cf-4e9a-ba2d-259d880610a8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:03.333292 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-3b16b319-16cf-4e9a-ba2d-259d880610a8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] HTTP exception thrown: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b16b319-16cf-4e9a-ba2d-259d880610a8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Request method failure captured: Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba HTTP/1.1 Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jBOjK6qHODIBhLv1hivkBZxdm9rjZHCdqSqWOPt5hIvk8u19fV0GrdFwZMckk-h3VH998ggvmvfXED3i3YYA1bPgB0qvUjzvDpTjHeXI6s-IcbfuB9SrY-XXMbwR0ycPqU_QUiPZPb0K8aZojmN99Jyl_Z4ARcmWRxOkjc24M56I3U Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/52c152e60a4d4bce86773ea6a2e25fc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 52c152e60a4d4bce86773ea6a2e25fc4 Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServerActionsTestJSON-2112902156 Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 6da9f8c739314b6a842c84bf71786f78 Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServerActionsTestJSON-2112902156-project Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5cd70be6-b296-4aed-8ce7-b873c0267aba'} Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:03.336545 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.344813 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:03.344813 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:03.344813 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:03.344813 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:34:03.344813 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:34:03.344813 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. Aug 18 12:34:03.344813 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:03.344813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b16b319-16cf-4e9a-ba2d-259d880610a8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Returning 404 to user: Instance 5cd70be6-b296-4aed-8ce7-b873c0267aba could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:03.344813 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3b16b319-16cf-4e9a-ba2d-259d880610a8 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba" status: 404 len: 111 microversion: 2.1 time: 0.059938 Aug 18 12:34:03.346338 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4203/6857] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:03 2022] GET /compute/v2.1/servers/5cd70be6-b296-4aed-8ce7-b873c0267aba => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:34:03.355588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b0e01fc-5681-4ad6-9404-63d0936853a6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] Calling method '.version_select at 0x7f51ae4e7d30>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:03.394709 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3b0e01fc-5681-4ad6-9404-63d0936853a6 tempest-ServerActionsTestJSON-2112902156 tempest-ServerActionsTestJSON-2112902156-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-128691123" status: 202 len: 0 microversion: 2.1 time: 0.046426 Aug 18 12:34:03.395862 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4204/6858] 10.222.0.73 () {58 vars in 1218 bytes} [Thu Aug 18 12:34:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-128691123 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:34:16.281790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=14 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:34:16.283359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:34:16.468489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1069028410", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "c7dc8dd2-505e-4b69-8679-5bf3df86ef16"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:34:16.551399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] validate_networks() for [('c7dc8dd2-505e-4b69-8679-5bf3df86ef16', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:34:17.488096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:34:17.489066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:34:17.489693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:34:17.490306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:34:17.491037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:34:17.507256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:17.508049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:17.508841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:17.510028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:17.510746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:17.511531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:17.560116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Getting quotas for project db1f6291aa384cdab6c527523bbec5ea. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:34:17.568052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Getting quotas for user d88bc2c9ddc84d4a988ab90a131d358f and project db1f6291aa384cdab6c527523bbec5ea. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:34:17.584027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:34:17.586526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:34:17.640529 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ef6cea2f-6a90-441a-98bb-02ef7cdbe3d2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.362328 Aug 18 12:34:17.651669 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4205/6859] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:34:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:34:17.659055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2da68506-d675-4fd1-a013-4b8aa9d7d04d tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:17.660029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2da68506-d675-4fd1-a013-4b8aa9d7d04d tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:17.723367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2da68506-d675-4fd1-a013-4b8aa9d7d04d tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:17.731459 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2da68506-d675-4fd1-a013-4b8aa9d7d04d tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1217 microversion: 2.1 time: 0.077949 Aug 18 12:34:17.732097 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4206/6860] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:17 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:18.768157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f38ddf04-c6d4-4293-87e7-9e315390cfef tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:18.770775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f38ddf04-c6d4-4293-87e7-9e315390cfef tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:18.886320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f38ddf04-c6d4-4293-87e7-9e315390cfef tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:18.899801 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f38ddf04-c6d4-4293-87e7-9e315390cfef tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1217 microversion: 2.1 time: 0.139374 Aug 18 12:34:18.903242 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4207/6861] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:18 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1217 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:19.942067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e461d0a1-eb9c-4a13-83ba-15ca1f2a1562 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:19.944467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e461d0a1-eb9c-4a13-83ba-15ca1f2a1562 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:20.021512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e461d0a1-eb9c-4a13-83ba-15ca1f2a1562 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:20.032816 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e461d0a1-eb9c-4a13-83ba-15ca1f2a1562 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1217 microversion: 2.1 time: 0.098716 Aug 18 12:34:20.033879 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4208/6862] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:19 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:21.063493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6b7a73f2-5142-4b7f-bb46-6ec95db3b777 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:21.064534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6b7a73f2-5142-4b7f-bb46-6ec95db3b777 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:21.124573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6b7a73f2-5142-4b7f-bb46-6ec95db3b777 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:21.132857 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6b7a73f2-5142-4b7f-bb46-6ec95db3b777 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1217 microversion: 2.1 time: 0.074705 Aug 18 12:34:21.133552 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4209/6863] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:21 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:22.154506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e9d13061-fdea-497e-8ea7-3804c2b44383 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:22.155436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e9d13061-fdea-497e-8ea7-3804c2b44383 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:22.164615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9d13061-fdea-497e-8ea7-3804c2b44383 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:22.165174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9d13061-fdea-497e-8ea7-3804c2b44383 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:22.165676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9d13061-fdea-497e-8ea7-3804c2b44383 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:22.166570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9d13061-fdea-497e-8ea7-3804c2b44383 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:22.167115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9d13061-fdea-497e-8ea7-3804c2b44383 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:22.167617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e9d13061-fdea-497e-8ea7-3804c2b44383 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:22.245311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e9d13061-fdea-497e-8ea7-3804c2b44383 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:22.255202 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e9d13061-fdea-497e-8ea7-3804c2b44383 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1221 microversion: 2.1 time: 0.104754 Aug 18 12:34:22.255868 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4210/6864] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:22 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:23.282350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c070d99f-f157-44e1-b529-9858049b81a1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:23.283839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c070d99f-f157-44e1-b529-9858049b81a1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:23.296941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c070d99f-f157-44e1-b529-9858049b81a1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:23.297854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c070d99f-f157-44e1-b529-9858049b81a1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:23.298708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c070d99f-f157-44e1-b529-9858049b81a1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:23.300057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c070d99f-f157-44e1-b529-9858049b81a1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:23.300981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c070d99f-f157-44e1-b529-9858049b81a1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:23.301978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c070d99f-f157-44e1-b529-9858049b81a1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:23.412637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c070d99f-f157-44e1-b529-9858049b81a1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:23.424269 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c070d99f-f157-44e1-b529-9858049b81a1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1275 microversion: 2.1 time: 0.148716 Aug 18 12:34:23.425113 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4211/6865] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:23 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1275 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:24.454852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-49eb49a0-521c-4547-84e2-61bc53b4a572 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:24.456429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-49eb49a0-521c-4547-84e2-61bc53b4a572 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:24.472397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49eb49a0-521c-4547-84e2-61bc53b4a572 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:24.473188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49eb49a0-521c-4547-84e2-61bc53b4a572 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:24.473859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49eb49a0-521c-4547-84e2-61bc53b4a572 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:24.475148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49eb49a0-521c-4547-84e2-61bc53b4a572 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:24.476762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49eb49a0-521c-4547-84e2-61bc53b4a572 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:24.477726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49eb49a0-521c-4547-84e2-61bc53b4a572 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:24.786275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-49eb49a0-521c-4547-84e2-61bc53b4a572 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:24.798053 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-49eb49a0-521c-4547-84e2-61bc53b4a572 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1317 microversion: 2.1 time: 0.350066 Aug 18 12:34:24.799017 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4212/6866] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:24 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:25.228220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-6c374833-0da5-4f5e-95e2-4c1f1fdf738c req-c184110c-b654-4bf5-b363-341358726863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69006e70-1a9c-47f8-93b7-dad6700f5ca8", "tag": "661cfe60-beef-49ba-8f62-05be65311adc"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:34:25.246635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6c374833-0da5-4f5e-95e2-4c1f1fdf738c req-c184110c-b654-4bf5-b363-341358726863 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:25.247469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6c374833-0da5-4f5e-95e2-4c1f1fdf738c req-c184110c-b654-4bf5-b363-341358726863 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:25.248844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6c374833-0da5-4f5e-95e2-4c1f1fdf738c req-c184110c-b654-4bf5-b363-341358726863 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:25.273065 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6c374833-0da5-4f5e-95e2-4c1f1fdf738c req-c184110c-b654-4bf5-b363-341358726863 service nova] Creating event network-changed:661cfe60-beef-49ba-8f62-05be65311adc for instance 69006e70-1a9c-47f8-93b7-dad6700f5ca8 on n-h2-853611-3 Aug 18 12:34:25.281636 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-6c374833-0da5-4f5e-95e2-4c1f1fdf738c req-c184110c-b654-4bf5-b363-341358726863 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160248 Aug 18 12:34:25.283074 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4213/6867] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:34:25.823173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e1049dd0-dd58-45cc-843c-6698a39aab93 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:25.823849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e1049dd0-dd58-45cc-843c-6698a39aab93 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:25.831183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1049dd0-dd58-45cc-843c-6698a39aab93 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:25.831686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1049dd0-dd58-45cc-843c-6698a39aab93 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:25.832135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1049dd0-dd58-45cc-843c-6698a39aab93 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:25.832856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1049dd0-dd58-45cc-843c-6698a39aab93 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:25.833552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1049dd0-dd58-45cc-843c-6698a39aab93 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:25.834137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1049dd0-dd58-45cc-843c-6698a39aab93 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:25.996123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e1049dd0-dd58-45cc-843c-6698a39aab93 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:26.005853 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e1049dd0-dd58-45cc-843c-6698a39aab93 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1317 microversion: 2.1 time: 0.187928 Aug 18 12:34:26.006490 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4214/6868] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:25 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:27.028541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f1dca28b-ab72-4ce6-a1b1-7ee3b55e994c tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:27.029237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f1dca28b-ab72-4ce6-a1b1-7ee3b55e994c tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:27.037196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1dca28b-ab72-4ce6-a1b1-7ee3b55e994c tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:27.037707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1dca28b-ab72-4ce6-a1b1-7ee3b55e994c tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:27.038159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1dca28b-ab72-4ce6-a1b1-7ee3b55e994c tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:27.038924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1dca28b-ab72-4ce6-a1b1-7ee3b55e994c tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:27.039404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1dca28b-ab72-4ce6-a1b1-7ee3b55e994c tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:27.039846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1dca28b-ab72-4ce6-a1b1-7ee3b55e994c tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:27.205054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f1dca28b-ab72-4ce6-a1b1-7ee3b55e994c tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:27.213693 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f1dca28b-ab72-4ce6-a1b1-7ee3b55e994c tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1317 microversion: 2.1 time: 0.189050 Aug 18 12:34:27.214300 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4215/6869] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:27 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:28.238654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e1fe11c0-b1de-4ea5-8e9d-caafa5c3a704 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:28.239411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e1fe11c0-b1de-4ea5-8e9d-caafa5c3a704 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:28.241499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:34:28.249264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1fe11c0-b1de-4ea5-8e9d-caafa5c3a704 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:28.249794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1fe11c0-b1de-4ea5-8e9d-caafa5c3a704 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:28.250261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1fe11c0-b1de-4ea5-8e9d-caafa5c3a704 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:28.251127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1fe11c0-b1de-4ea5-8e9d-caafa5c3a704 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:28.251610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1fe11c0-b1de-4ea5-8e9d-caafa5c3a704 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:28.252057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1fe11c0-b1de-4ea5-8e9d-caafa5c3a704 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:28.398230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e1fe11c0-b1de-4ea5-8e9d-caafa5c3a704 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:28.406726 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e1fe11c0-b1de-4ea5-8e9d-caafa5c3a704 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1317 microversion: 2.1 time: 0.172063 Aug 18 12:34:28.407331 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4216/6870] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:28 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:29.428292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e389557-52fd-4ffd-8c44-fea211b38c67 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:29.429086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7e389557-52fd-4ffd-8c44-fea211b38c67 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:29.442941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e389557-52fd-4ffd-8c44-fea211b38c67 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:29.444711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e389557-52fd-4ffd-8c44-fea211b38c67 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:29.444711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e389557-52fd-4ffd-8c44-fea211b38c67 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:29.445776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e389557-52fd-4ffd-8c44-fea211b38c67 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:29.446306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e389557-52fd-4ffd-8c44-fea211b38c67 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:29.446790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e389557-52fd-4ffd-8c44-fea211b38c67 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:29.663729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7e389557-52fd-4ffd-8c44-fea211b38c67 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:29.679971 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e389557-52fd-4ffd-8c44-fea211b38c67 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1317 microversion: 2.1 time: 0.255316 Aug 18 12:34:29.697033 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4217/6871] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:29 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:29.816720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2af9ab78-d3f7-4737-8c8d-cdb1270fbc49 req-f08dbe5b-c726-4230-abf7-c69576e49179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69006e70-1a9c-47f8-93b7-dad6700f5ca8", "name": "network-vif-plugged", "status": "completed", "tag": "661cfe60-beef-49ba-8f62-05be65311adc"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:34:29.835399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2af9ab78-d3f7-4737-8c8d-cdb1270fbc49 req-f08dbe5b-c726-4230-abf7-c69576e49179 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:29.836268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2af9ab78-d3f7-4737-8c8d-cdb1270fbc49 req-f08dbe5b-c726-4230-abf7-c69576e49179 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:29.836989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2af9ab78-d3f7-4737-8c8d-cdb1270fbc49 req-f08dbe5b-c726-4230-abf7-c69576e49179 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:29.859786 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2af9ab78-d3f7-4737-8c8d-cdb1270fbc49 req-f08dbe5b-c726-4230-abf7-c69576e49179 service nova] Creating event network-vif-plugged:661cfe60-beef-49ba-8f62-05be65311adc for instance 69006e70-1a9c-47f8-93b7-dad6700f5ca8 on n-h2-853611-3 Aug 18 12:34:29.868978 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2af9ab78-d3f7-4737-8c8d-cdb1270fbc49 req-f08dbe5b-c726-4230-abf7-c69576e49179 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059796 Aug 18 12:34:29.870196 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4218/6872] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:34:30.727258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7a33dc80-2166-4b19-9383-cf477bfaa8a5 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:30.728001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7a33dc80-2166-4b19-9383-cf477bfaa8a5 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:30.735817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a33dc80-2166-4b19-9383-cf477bfaa8a5 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:30.736335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a33dc80-2166-4b19-9383-cf477bfaa8a5 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:30.736805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a33dc80-2166-4b19-9383-cf477bfaa8a5 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:30.737552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a33dc80-2166-4b19-9383-cf477bfaa8a5 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:30.738036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a33dc80-2166-4b19-9383-cf477bfaa8a5 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:30.738516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7a33dc80-2166-4b19-9383-cf477bfaa8a5 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:30.901754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7a33dc80-2166-4b19-9383-cf477bfaa8a5 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:30.911643 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7a33dc80-2166-4b19-9383-cf477bfaa8a5 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1317 microversion: 2.1 time: 0.189665 Aug 18 12:34:30.912365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4219/6873] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:30 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:31.935096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d644d27b-237a-418d-b8a4-8c78db12a682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:31.936361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d644d27b-237a-418d-b8a4-8c78db12a682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:31.938800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=14 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:34:31.946082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d644d27b-237a-418d-b8a4-8c78db12a682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:31.946692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d644d27b-237a-418d-b8a4-8c78db12a682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:31.947190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d644d27b-237a-418d-b8a4-8c78db12a682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:31.947968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d644d27b-237a-418d-b8a4-8c78db12a682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:31.948480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d644d27b-237a-418d-b8a4-8c78db12a682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:31.948962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d644d27b-237a-418d-b8a4-8c78db12a682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:32.106227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d644d27b-237a-418d-b8a4-8c78db12a682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:32.117710 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d644d27b-237a-418d-b8a4-8c78db12a682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1505 microversion: 2.1 time: 0.187279 Aug 18 12:34:32.118596 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4220/6874] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:31 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:32.204402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-267418467", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "c7dc8dd2-505e-4b69-8679-5bf3df86ef16"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:34:32.275149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] validate_networks() for [('c7dc8dd2-505e-4b69-8679-5bf3df86ef16', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:34:32.719387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:34:32.720045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:34:32.720787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:34:32.721420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:34:32.726062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:34:32.736576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:32.737204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:32.737750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:32.738647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:32.739171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:32.739625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:32.761439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Getting quotas for project db1f6291aa384cdab6c527523bbec5ea. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:34:32.769672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Getting quotas for user d88bc2c9ddc84d4a988ab90a131d358f and project db1f6291aa384cdab6c527523bbec5ea. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:34:32.787225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:34:32.789619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:34:32.843592 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-66340725-42e5-4dc2-8f1b-2be3561de163 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643309 Aug 18 12:34:32.844458 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4221/6875] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:34:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:34:32.857056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3594578d-6f9b-44fb-a3f8-d804791176b4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:32.858828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3594578d-6f9b-44fb-a3f8-d804791176b4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:32.949575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3594578d-6f9b-44fb-a3f8-d804791176b4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:32.960574 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3594578d-6f9b-44fb-a3f8-d804791176b4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 200 len: 1216 microversion: 2.1 time: 0.108185 Aug 18 12:34:32.961459 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4222/6876] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:32 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 1216 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:33.985734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34cd9ca6-80a7-42fe-8960-f8c3346a2cfa tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:33.986698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-34cd9ca6-80a7-42fe-8960-f8c3346a2cfa tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:33.995089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cd9ca6-80a7-42fe-8960-f8c3346a2cfa tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:33.995604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cd9ca6-80a7-42fe-8960-f8c3346a2cfa tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:33.996204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cd9ca6-80a7-42fe-8960-f8c3346a2cfa tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:33.997097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cd9ca6-80a7-42fe-8960-f8c3346a2cfa tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:33.997570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cd9ca6-80a7-42fe-8960-f8c3346a2cfa tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:33.998021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34cd9ca6-80a7-42fe-8960-f8c3346a2cfa tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:34.141390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-34cd9ca6-80a7-42fe-8960-f8c3346a2cfa tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:34.156134 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34cd9ca6-80a7-42fe-8960-f8c3346a2cfa tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 200 len: 1276 microversion: 2.1 time: 0.174359 Aug 18 12:34:34.162500 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4223/6877] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:33 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:35.196022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f53267c1-f2af-4846-9d16-53020bcad6d9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:35.197191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f53267c1-f2af-4846-9d16-53020bcad6d9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:35.211545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f53267c1-f2af-4846-9d16-53020bcad6d9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:35.213532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f53267c1-f2af-4846-9d16-53020bcad6d9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:35.214723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f53267c1-f2af-4846-9d16-53020bcad6d9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:35.217224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f53267c1-f2af-4846-9d16-53020bcad6d9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:35.220044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f53267c1-f2af-4846-9d16-53020bcad6d9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:35.220044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f53267c1-f2af-4846-9d16-53020bcad6d9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:35.737812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f53267c1-f2af-4846-9d16-53020bcad6d9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:35.748092 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f53267c1-f2af-4846-9d16-53020bcad6d9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 200 len: 1316 microversion: 2.1 time: 0.558876 Aug 18 12:34:35.749090 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4224/6878] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:35 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 1316 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:36.728903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-3b59d04b-26e2-496d-a782-54fb57e8f9d4 req-6f1b6d46-a5a4-4a96-995f-7e7abffe8112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd9f427-61cf-4107-bc33-21f1c16aa106", "tag": "9efd5998-7da7-47f7-970c-582829d9561c"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:34:36.755554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3b59d04b-26e2-496d-a782-54fb57e8f9d4 req-6f1b6d46-a5a4-4a96-995f-7e7abffe8112 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:36.756400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3b59d04b-26e2-496d-a782-54fb57e8f9d4 req-6f1b6d46-a5a4-4a96-995f-7e7abffe8112 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:36.760412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-3b59d04b-26e2-496d-a782-54fb57e8f9d4 req-6f1b6d46-a5a4-4a96-995f-7e7abffe8112 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:36.778377 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-3b59d04b-26e2-496d-a782-54fb57e8f9d4 req-6f1b6d46-a5a4-4a96-995f-7e7abffe8112 service nova] Creating event network-changed:9efd5998-7da7-47f7-970c-582829d9561c for instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 on n-h1-853611-3 Aug 18 12:34:36.785587 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-3b59d04b-26e2-496d-a782-54fb57e8f9d4 req-6f1b6d46-a5a4-4a96-995f-7e7abffe8112 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063444 Aug 18 12:34:36.786968 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4225/6879] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:34:36.798206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3c50abd6-0b40-4f27-a725-1471737b7ced tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:36.799595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3c50abd6-0b40-4f27-a725-1471737b7ced tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:36.812107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c50abd6-0b40-4f27-a725-1471737b7ced tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:36.813044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c50abd6-0b40-4f27-a725-1471737b7ced tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:36.813879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c50abd6-0b40-4f27-a725-1471737b7ced tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:36.815312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c50abd6-0b40-4f27-a725-1471737b7ced tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:36.816192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c50abd6-0b40-4f27-a725-1471737b7ced tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:36.816961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c50abd6-0b40-4f27-a725-1471737b7ced tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:37.120856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3c50abd6-0b40-4f27-a725-1471737b7ced tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:37.130975 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3c50abd6-0b40-4f27-a725-1471737b7ced tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 200 len: 1316 microversion: 2.1 time: 0.342159 Aug 18 12:34:37.131620 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4226/6880] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:36 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:38.163144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-22aaff58-20ed-4a37-97be-aba468675af2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:38.163896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-22aaff58-20ed-4a37-97be-aba468675af2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:38.172750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22aaff58-20ed-4a37-97be-aba468675af2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:38.173661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22aaff58-20ed-4a37-97be-aba468675af2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:38.174518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22aaff58-20ed-4a37-97be-aba468675af2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:38.176091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22aaff58-20ed-4a37-97be-aba468675af2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:38.177024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22aaff58-20ed-4a37-97be-aba468675af2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:38.177827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22aaff58-20ed-4a37-97be-aba468675af2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:38.448838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-22aaff58-20ed-4a37-97be-aba468675af2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:38.459848 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-22aaff58-20ed-4a37-97be-aba468675af2 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 200 len: 1316 microversion: 2.1 time: 0.300365 Aug 18 12:34:38.460719 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4227/6881] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:38 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:39.484772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7cca18bb-7f2a-4acc-9da6-fd09681588f4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:39.485503 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7cca18bb-7f2a-4acc-9da6-fd09681588f4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:39.492918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cca18bb-7f2a-4acc-9da6-fd09681588f4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:39.493433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cca18bb-7f2a-4acc-9da6-fd09681588f4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:39.493894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cca18bb-7f2a-4acc-9da6-fd09681588f4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:39.494672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cca18bb-7f2a-4acc-9da6-fd09681588f4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:39.495162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cca18bb-7f2a-4acc-9da6-fd09681588f4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:39.495612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7cca18bb-7f2a-4acc-9da6-fd09681588f4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:39.684856 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7cca18bb-7f2a-4acc-9da6-fd09681588f4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:39.694749 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7cca18bb-7f2a-4acc-9da6-fd09681588f4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 200 len: 1316 microversion: 2.1 time: 0.214711 Aug 18 12:34:39.695605 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4228/6882] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:39 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:40.719154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-01643bad-d359-46fa-ad8c-9b4aa60893ec tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:40.719796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-01643bad-d359-46fa-ad8c-9b4aa60893ec tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:40.728374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01643bad-d359-46fa-ad8c-9b4aa60893ec tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:40.729048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01643bad-d359-46fa-ad8c-9b4aa60893ec tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:40.729610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01643bad-d359-46fa-ad8c-9b4aa60893ec tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:40.730834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01643bad-d359-46fa-ad8c-9b4aa60893ec tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:40.731423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01643bad-d359-46fa-ad8c-9b4aa60893ec tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:40.732505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01643bad-d359-46fa-ad8c-9b4aa60893ec tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:40.920068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-01643bad-d359-46fa-ad8c-9b4aa60893ec tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:40.924159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:34:40.929727 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-01643bad-d359-46fa-ad8c-9b4aa60893ec tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 200 len: 1316 microversion: 2.1 time: 0.214520 Aug 18 12:34:40.930421 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4229/6883] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:40 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:41.960730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-96f17519-4bea-42b6-953e-37f388584741 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:41.962247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-96f17519-4bea-42b6-953e-37f388584741 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:41.976083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f17519-4bea-42b6-953e-37f388584741 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:41.976965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f17519-4bea-42b6-953e-37f388584741 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:41.977820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f17519-4bea-42b6-953e-37f388584741 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:41.979349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f17519-4bea-42b6-953e-37f388584741 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:41.980217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f17519-4bea-42b6-953e-37f388584741 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:41.981312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f17519-4bea-42b6-953e-37f388584741 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:42.164487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-96f17519-4bea-42b6-953e-37f388584741 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:42.174804 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-96f17519-4bea-42b6-953e-37f388584741 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 200 len: 1316 microversion: 2.1 time: 0.223626 Aug 18 12:34:42.175419 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4230/6884] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:41 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:43.183677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c8a59d2e-9591-4be3-bc3d-6ff8899ac2a1 req-8e1879fd-f49f-4ad4-b8ef-35a1a3b3f554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd9f427-61cf-4107-bc33-21f1c16aa106", "name": "network-vif-plugged", "status": "completed", "tag": "9efd5998-7da7-47f7-970c-582829d9561c"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:34:43.193887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:34:43.195319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:34:43.206339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c8a59d2e-9591-4be3-bc3d-6ff8899ac2a1 req-8e1879fd-f49f-4ad4-b8ef-35a1a3b3f554 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:43.207095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c8a59d2e-9591-4be3-bc3d-6ff8899ac2a1 req-8e1879fd-f49f-4ad4-b8ef-35a1a3b3f554 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:43.207684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c8a59d2e-9591-4be3-bc3d-6ff8899ac2a1 req-8e1879fd-f49f-4ad4-b8ef-35a1a3b3f554 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:43.224991 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c8a59d2e-9591-4be3-bc3d-6ff8899ac2a1 req-8e1879fd-f49f-4ad4-b8ef-35a1a3b3f554 service nova] Creating event network-vif-plugged:9efd5998-7da7-47f7-970c-582829d9561c for instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 on n-h1-853611-3 Aug 18 12:34:43.234242 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c8a59d2e-9591-4be3-bc3d-6ff8899ac2a1 req-8e1879fd-f49f-4ad4-b8ef-35a1a3b3f554 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053063 Aug 18 12:34:43.235156 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4231/6885] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:34:43.243569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-572db1eb-92f0-46cf-984b-ce159c4572a4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:43.244678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-572db1eb-92f0-46cf-984b-ce159c4572a4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:43.257956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-572db1eb-92f0-46cf-984b-ce159c4572a4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:43.258765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-572db1eb-92f0-46cf-984b-ce159c4572a4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:43.259769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-572db1eb-92f0-46cf-984b-ce159c4572a4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:43.261417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-572db1eb-92f0-46cf-984b-ce159c4572a4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:43.262343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-572db1eb-92f0-46cf-984b-ce159c4572a4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:43.263397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-572db1eb-92f0-46cf-984b-ce159c4572a4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:43.517593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-572db1eb-92f0-46cf-984b-ce159c4572a4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:43.527623 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-572db1eb-92f0-46cf-984b-ce159c4572a4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 200 len: 1316 microversion: 2.1 time: 0.290999 Aug 18 12:34:43.528329 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4232/6886] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:43 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:44.555456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2a2b48ca-8645-4bf4-a318-8fae9c9b3682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:44.556680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2a2b48ca-8645-4bf4-a318-8fae9c9b3682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:44.570667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a2b48ca-8645-4bf4-a318-8fae9c9b3682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:44.571577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a2b48ca-8645-4bf4-a318-8fae9c9b3682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:44.572407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a2b48ca-8645-4bf4-a318-8fae9c9b3682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:44.573748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a2b48ca-8645-4bf4-a318-8fae9c9b3682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:44.574648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a2b48ca-8645-4bf4-a318-8fae9c9b3682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:44.575520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2a2b48ca-8645-4bf4-a318-8fae9c9b3682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:44.796638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2a2b48ca-8645-4bf4-a318-8fae9c9b3682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:44.811514 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2a2b48ca-8645-4bf4-a318-8fae9c9b3682 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 200 len: 1316 microversion: 2.1 time: 0.262476 Aug 18 12:34:44.812539 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4233/6887] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:44 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:45.838202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7ce30962-a2f5-4711-82ca-e9b789d92008 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:45.839090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7ce30962-a2f5-4711-82ca-e9b789d92008 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:45.847776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ce30962-a2f5-4711-82ca-e9b789d92008 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:45.848296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ce30962-a2f5-4711-82ca-e9b789d92008 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:45.848764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ce30962-a2f5-4711-82ca-e9b789d92008 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:45.849530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ce30962-a2f5-4711-82ca-e9b789d92008 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:45.850023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ce30962-a2f5-4711-82ca-e9b789d92008 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:45.850512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ce30962-a2f5-4711-82ca-e9b789d92008 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:46.054855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7ce30962-a2f5-4711-82ca-e9b789d92008 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:46.064450 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7ce30962-a2f5-4711-82ca-e9b789d92008 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 200 len: 1505 microversion: 2.1 time: 0.230364 Aug 18 12:34:46.065080 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4234/6888] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:45 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:46.085374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-77ea274e-72e1-4708-8e38-44b26dfc4d11 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:46.085900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-77ea274e-72e1-4708-8e38-44b26dfc4d11 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:46.089518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:34:46.094561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77ea274e-72e1-4708-8e38-44b26dfc4d11 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:46.095083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77ea274e-72e1-4708-8e38-44b26dfc4d11 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:46.095561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77ea274e-72e1-4708-8e38-44b26dfc4d11 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:46.096296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77ea274e-72e1-4708-8e38-44b26dfc4d11 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:46.096771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77ea274e-72e1-4708-8e38-44b26dfc4d11 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:46.097217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-77ea274e-72e1-4708-8e38-44b26dfc4d11 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:46.132544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-77ea274e-72e1-4708-8e38-44b26dfc4d11 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:34:46.243045 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-77ea274e-72e1-4708-8e38-44b26dfc4d11 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 204 len: 0 microversion: 2.1 time: 0.161438 Aug 18 12:34:46.243875 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4235/6889] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:34:46 2022] DELETE /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:34:46.253985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d7caa9fe-abef-421a-917d-92c4a79e2b20 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:46.254755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d7caa9fe-abef-421a-917d-92c4a79e2b20 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:46.261685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7caa9fe-abef-421a-917d-92c4a79e2b20 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:46.262334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7caa9fe-abef-421a-917d-92c4a79e2b20 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:46.263017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7caa9fe-abef-421a-917d-92c4a79e2b20 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:46.265438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7caa9fe-abef-421a-917d-92c4a79e2b20 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:46.266065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7caa9fe-abef-421a-917d-92c4a79e2b20 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:46.266725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d7caa9fe-abef-421a-917d-92c4a79e2b20 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:46.435657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d7caa9fe-abef-421a-917d-92c4a79e2b20 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:46.450156 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d7caa9fe-abef-421a-917d-92c4a79e2b20 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 200 len: 1511 microversion: 2.1 time: 0.200219 Aug 18 12:34:46.451889 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4236/6890] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:46 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 1511 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:47.487047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6c50c7b4-3ba9-489b-b8c2-692a35ccaaf4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:47.487777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6c50c7b4-3ba9-489b-b8c2-692a35ccaaf4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:47.495359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c50c7b4-3ba9-489b-b8c2-692a35ccaaf4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:47.495871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c50c7b4-3ba9-489b-b8c2-692a35ccaaf4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:47.496333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c50c7b4-3ba9-489b-b8c2-692a35ccaaf4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:47.497086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c50c7b4-3ba9-489b-b8c2-692a35ccaaf4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:47.498151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c50c7b4-3ba9-489b-b8c2-692a35ccaaf4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:47.498884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c50c7b4-3ba9-489b-b8c2-692a35ccaaf4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:47.776520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6c50c7b4-3ba9-489b-b8c2-692a35ccaaf4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:47.790249 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6c50c7b4-3ba9-489b-b8c2-692a35ccaaf4 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 200 len: 1511 microversion: 2.1 time: 0.307984 Aug 18 12:34:47.791648 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4237/6891] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:47 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:48.269933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-280027af-8f11-4e8f-86b0-b0a7eb952911 req-e7274cd1-ad00-4390-b9cf-83b45b5657e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd9f427-61cf-4107-bc33-21f1c16aa106", "name": "network-vif-deleted", "tag": "9efd5998-7da7-47f7-970c-582829d9561c"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:34:48.289656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-280027af-8f11-4e8f-86b0-b0a7eb952911 req-e7274cd1-ad00-4390-b9cf-83b45b5657e1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:48.290823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-280027af-8f11-4e8f-86b0-b0a7eb952911 req-e7274cd1-ad00-4390-b9cf-83b45b5657e1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:48.291661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-280027af-8f11-4e8f-86b0-b0a7eb952911 req-e7274cd1-ad00-4390-b9cf-83b45b5657e1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:48.321343 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-280027af-8f11-4e8f-86b0-b0a7eb952911 req-e7274cd1-ad00-4390-b9cf-83b45b5657e1 service nova] Creating event network-vif-deleted:9efd5998-7da7-47f7-970c-582829d9561c for instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 on n-h1-853611-3 Aug 18 12:34:48.331557 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-280027af-8f11-4e8f-86b0-b0a7eb952911 req-e7274cd1-ad00-4390-b9cf-83b45b5657e1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070562 Aug 18 12:34:48.333160 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4238/6892] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:34:48.825558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8ce68891-0bb3-4f52-9ecc-7f581ab25af3 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:48.827048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8ce68891-0bb3-4f52-9ecc-7f581ab25af3 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:48.834758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ce68891-0bb3-4f52-9ecc-7f581ab25af3 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:48.835233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ce68891-0bb3-4f52-9ecc-7f581ab25af3 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:48.835684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ce68891-0bb3-4f52-9ecc-7f581ab25af3 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:48.836423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ce68891-0bb3-4f52-9ecc-7f581ab25af3 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:48.836888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ce68891-0bb3-4f52-9ecc-7f581ab25af3 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:48.837329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ce68891-0bb3-4f52-9ecc-7f581ab25af3 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:48.853371 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-8ce68891-0bb3-4f52-9ecc-7f581ab25af3 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] HTTP exception thrown: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8ce68891-0bb3-4f52-9ecc-7f581ab25af3 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Request method failure captured: Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 HTTP/1.1 Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jHIXDPgW3qLSvej2e1k6x1q8dleVbgnvIc2TRvaUAQL4fcIcj7TxHDpr-bdYrxkUTNYK7hpHW9FwyaKzwrMltlpUFAj8TR0d6MpY45NzhQxArrnmT8ioC16UfoMnLGw_yBAFhwBS-VLZSRFXUXq2Pa-C5sIwH0lIdEn_FJZzoEfXYs Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: db1f6291aa384cdab6c527523bbec5ea Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: db1f6291aa384cdab6c527523bbec5ea Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-399875529-project Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d88bc2c9ddc84d4a988ab90a131d358f Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-399875529-project Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5bd9f427-61cf-4107-bc33-21f1c16aa106'} Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:48.855143 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:48.864026 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:48.864026 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:48.864026 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:48.864026 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:34:48.864026 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:34:48.864026 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:48.864026 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:48.864026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8ce68891-0bb3-4f52-9ecc-7f581ab25af3 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Returning 404 to user: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:48.864026 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8ce68891-0bb3-4f52-9ecc-7f581ab25af3 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 404 len: 111 microversion: 2.1 time: 0.035837 Aug 18 12:34:48.864026 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4239/6893] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:48 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:34:48.868440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-10406bdf-acf1-4232-835a-fea56b2c2770 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:48.869094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-10406bdf-acf1-4232-835a-fea56b2c2770 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:48.876051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10406bdf-acf1-4232-835a-fea56b2c2770 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:48.876558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10406bdf-acf1-4232-835a-fea56b2c2770 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:48.877012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10406bdf-acf1-4232-835a-fea56b2c2770 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:48.877747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10406bdf-acf1-4232-835a-fea56b2c2770 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:48.878225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10406bdf-acf1-4232-835a-fea56b2c2770 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:48.878773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10406bdf-acf1-4232-835a-fea56b2c2770 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:49.036872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-10406bdf-acf1-4232-835a-fea56b2c2770 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:49.045981 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-10406bdf-acf1-4232-835a-fea56b2c2770 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1505 microversion: 2.1 time: 0.181367 Aug 18 12:34:49.046625 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4240/6894] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:48 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:49.071507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fde8f46c-067d-4a67-aab6-f8e8231669fe tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:34:49.075505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fde8f46c-067d-4a67-aab6-f8e8231669fe tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 14babdb2-10f3-4043-9b70-33956c18021f] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:49.085684 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-fde8f46c-067d-4a67-aab6-f8e8231669fe tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] HTTP exception thrown: Instance 14babdb2-10f3-4043-9b70-33956c18021f could not be found. Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fde8f46c-067d-4a67-aab6-f8e8231669fe tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Request method failure captured: Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/14babdb2-10f3-4043-9b70-33956c18021f/action HTTP/1.1 Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 32 Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jHIXDPgW3qLSvej2e1k6x1q8dleVbgnvIc2TRvaUAQL4fcIcj7TxHDpr-bdYrxkUTNYK7hpHW9FwyaKzwrMltlpUFAj8TR0d6MpY45NzhQxArrnmT8ioC16UfoMnLGw_yBAFhwBS-VLZSRFXUXq2Pa-C5sIwH0lIdEn_FJZzoEfXYs Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: db1f6291aa384cdab6c527523bbec5ea Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: db1f6291aa384cdab6c527523bbec5ea Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-399875529-project Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d88bc2c9ddc84d4a988ab90a131d358f Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-399875529-project Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: {"resize": {"flavorRef": "452"}} Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 14babdb2-10f3-4043-9b70-33956c18021f could not be found. Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '14babdb2-10f3-4043-9b70-33956c18021f', 'body': {'resize': {'flavorRef': '452'}}} Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14babdb2-10f3-4043-9b70-33956c18021f could not be found. Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:34:49.088177 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:34:49.097724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14babdb2-10f3-4043-9b70-33956c18021f could not be found. Aug 18 12:34:49.097724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:49.097724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:49.097724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:49.097724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:49.097724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:49.097724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:49.097724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:34:49.097724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:34:49.097724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14babdb2-10f3-4043-9b70-33956c18021f could not be found. Aug 18 12:34:49.097724 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:49.097724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fde8f46c-067d-4a67-aab6-f8e8231669fe tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Returning 404 to user: Instance 14babdb2-10f3-4043-9b70-33956c18021f could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:49.097724 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fde8f46c-067d-4a67-aab6-f8e8231669fe tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "POST /compute/v2.1/servers/14babdb2-10f3-4043-9b70-33956c18021f/action" status: 404 len: 111 microversion: 2.1 time: 0.026958 Aug 18 12:34:49.097724 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4241/6895] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:34:49 2022] POST /compute/v2.1/servers/14babdb2-10f3-4043-9b70-33956c18021f/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:34:49.101013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b2ca576a-e350-4fad-a5e7-bd3ab9923650 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:49.101657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b2ca576a-e350-4fad-a5e7-bd3ab9923650 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:49.111457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2ca576a-e350-4fad-a5e7-bd3ab9923650 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:49.111967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2ca576a-e350-4fad-a5e7-bd3ab9923650 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:49.112422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2ca576a-e350-4fad-a5e7-bd3ab9923650 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:49.113156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2ca576a-e350-4fad-a5e7-bd3ab9923650 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:49.113625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2ca576a-e350-4fad-a5e7-bd3ab9923650 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:49.114068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b2ca576a-e350-4fad-a5e7-bd3ab9923650 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:49.279348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b2ca576a-e350-4fad-a5e7-bd3ab9923650 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:49.288928 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b2ca576a-e350-4fad-a5e7-bd3ab9923650 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1505 microversion: 2.1 time: 0.191763 Aug 18 12:34:49.289649 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4242/6896] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:49 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1505 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:49.312209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3aed8cc7-e67e-4c28-9c81-1f0346e8f468 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:49.313016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3aed8cc7-e67e-4c28-9c81-1f0346e8f468 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:49.320108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3aed8cc7-e67e-4c28-9c81-1f0346e8f468 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:49.320632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3aed8cc7-e67e-4c28-9c81-1f0346e8f468 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:49.321114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3aed8cc7-e67e-4c28-9c81-1f0346e8f468 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:49.322253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3aed8cc7-e67e-4c28-9c81-1f0346e8f468 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:49.322791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3aed8cc7-e67e-4c28-9c81-1f0346e8f468 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:49.323258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3aed8cc7-e67e-4c28-9c81-1f0346e8f468 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:49.479749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3aed8cc7-e67e-4c28-9c81-1f0346e8f468 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:49.488472 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3aed8cc7-e67e-4c28-9c81-1f0346e8f468 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1505 microversion: 2.1 time: 0.180560 Aug 18 12:34:49.489079 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4243/6897] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:49 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:49.510061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55308089-a3e2-4a8e-ad2e-ee1513981ee1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d9cbc4d2-608f-4d79-a810-4d3421b9b273"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:34:49.512429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-55308089-a3e2-4a8e-ad2e-ee1513981ee1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:49.519649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55308089-a3e2-4a8e-ad2e-ee1513981ee1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:49.520342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55308089-a3e2-4a8e-ad2e-ee1513981ee1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:49.520966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55308089-a3e2-4a8e-ad2e-ee1513981ee1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:49.521779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55308089-a3e2-4a8e-ad2e-ee1513981ee1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:49.522332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55308089-a3e2-4a8e-ad2e-ee1513981ee1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:49.522851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55308089-a3e2-4a8e-ad2e-ee1513981ee1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:49.590741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-55308089-a3e2-4a8e-ad2e-ee1513981ee1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:49.599252 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-55308089-a3e2-4a8e-ad2e-ee1513981ee1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] HTTP exception thrown: Flavor d9cbc4d2-608f-4d79-a810-4d3421b9b273 could not be found. Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55308089-a3e2-4a8e-ad2e-ee1513981ee1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Request method failure captured: Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8/action HTTP/1.1 Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 65 Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jHIXDPgW3qLSvej2e1k6x1q8dleVbgnvIc2TRvaUAQL4fcIcj7TxHDpr-bdYrxkUTNYK7hpHW9FwyaKzwrMltlpUFAj8TR0d6MpY45NzhQxArrnmT8ioC16UfoMnLGw_yBAFhwBS-VLZSRFXUXq2Pa-C5sIwH0lIdEn_FJZzoEfXYs Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: db1f6291aa384cdab6c527523bbec5ea Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: db1f6291aa384cdab6c527523bbec5ea Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-399875529-project Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d88bc2c9ddc84d4a988ab90a131d358f Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-399875529-project Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: {"resize": {"flavorRef": "d9cbc4d2-608f-4d79-a810-4d3421b9b273"}} Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: exception: Flavor d9cbc4d2-608f-4d79-a810-4d3421b9b273 could not be found. Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '69006e70-1a9c-47f8-93b7-dad6700f5ca8', 'body': {'resize': {'flavorRef': 'd9cbc4d2-608f-4d79-a810-4d3421b9b273'}}} Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 12:34:49.616797 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d9cbc4d2-608f-4d79-a810-4d3421b9b273 could not be found. Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor d9cbc4d2-608f-4d79-a810-4d3421b9b273 could not be found. Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d9cbc4d2-608f-4d79-a810-4d3421b9b273 could not be found. Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55308089-a3e2-4a8e-ad2e-ee1513981ee1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Returning 400 to user: Flavor d9cbc4d2-608f-4d79-a810-4d3421b9b273 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-55308089-a3e2-4a8e-ad2e-ee1513981ee1 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "POST /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8/action" status: 400 len: 107 microversion: 2.1 time: 0.113376 Aug 18 12:34:49.621291 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4244/6898] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:34:49 2022] POST /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8/action => generated 107 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 12:34:49.634489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-594c8cc1-82fe-4e21-af81-34515197c322 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:49.635676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-594c8cc1-82fe-4e21-af81-34515197c322 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:49.645541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-594c8cc1-82fe-4e21-af81-34515197c322 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:49.646052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-594c8cc1-82fe-4e21-af81-34515197c322 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:49.646603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-594c8cc1-82fe-4e21-af81-34515197c322 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:49.647372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-594c8cc1-82fe-4e21-af81-34515197c322 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:49.647854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-594c8cc1-82fe-4e21-af81-34515197c322 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:49.648300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-594c8cc1-82fe-4e21-af81-34515197c322 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:49.820537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-594c8cc1-82fe-4e21-af81-34515197c322 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:49.829855 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-594c8cc1-82fe-4e21-af81-34515197c322 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1505 microversion: 2.1 time: 0.202577 Aug 18 12:34:49.830671 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4245/6899] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:49 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:49.852312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f9f7857a-77d6-4bdd-9021-6ead87a09b14 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:49.853316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f9f7857a-77d6-4bdd-9021-6ead87a09b14 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:49.864216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9f7857a-77d6-4bdd-9021-6ead87a09b14 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:49.864744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9f7857a-77d6-4bdd-9021-6ead87a09b14 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:49.865209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9f7857a-77d6-4bdd-9021-6ead87a09b14 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:49.865967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9f7857a-77d6-4bdd-9021-6ead87a09b14 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:49.866485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9f7857a-77d6-4bdd-9021-6ead87a09b14 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:49.866940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f9f7857a-77d6-4bdd-9021-6ead87a09b14 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:50.024942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f9f7857a-77d6-4bdd-9021-6ead87a09b14 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:50.034102 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f9f7857a-77d6-4bdd-9021-6ead87a09b14 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1505 microversion: 2.1 time: 0.185772 Aug 18 12:34:50.034746 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4246/6900] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:49 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:50.055780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-64c40df9-0b6b-4890-a4dc-1ab40991cea8 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-64c40df9-0b6b-4890-a4dc-1ab40991cea8 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Request method failure captured: Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: request: POST /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8/action HTTP/1.1 Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 29 Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jHIXDPgW3qLSvej2e1k6x1q8dleVbgnvIc2TRvaUAQL4fcIcj7TxHDpr-bdYrxkUTNYK7hpHW9FwyaKzwrMltlpUFAj8TR0d6MpY45NzhQxArrnmT8ioC16UfoMnLGw_yBAFhwBS-VLZSRFXUXq2Pa-C5sIwH0lIdEn_FJZzoEfXYs Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: db1f6291aa384cdab6c527523bbec5ea Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: db1f6291aa384cdab6c527523bbec5ea Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-399875529-project Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d88bc2c9ddc84d4a988ab90a131d358f Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-399875529-project Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: {"resize": {"flavorRef": ""}} Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '69006e70-1a9c-47f8-93b7-dad6700f5ca8', 'body': {'resize': {'flavorRef': ''}}} Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise error Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi '' Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.065028 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:50.072203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.072203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:50.072203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:50.072203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:50.072203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 12:34:50.072203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 12:34:50.072203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 18 12:34:50.072203 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.072203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-64c40df9-0b6b-4890-a4dc-1ab40991cea8 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:50.072203 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-64c40df9-0b6b-4890-a4dc-1ab40991cea8 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "POST /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8/action" status: 400 len: 113 microversion: 2.1 time: 0.015171 Aug 18 12:34:50.072203 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4247/6901] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:34:50 2022] POST /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8/action => generated 113 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 12:34:50.077074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b8562b56-7ae9-4a39-88da-f9e823b1c0b8 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:50.077716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b8562b56-7ae9-4a39-88da-f9e823b1c0b8 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:50.085509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8562b56-7ae9-4a39-88da-f9e823b1c0b8 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:50.086027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8562b56-7ae9-4a39-88da-f9e823b1c0b8 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:50.086537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8562b56-7ae9-4a39-88da-f9e823b1c0b8 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:50.087290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8562b56-7ae9-4a39-88da-f9e823b1c0b8 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:50.087772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8562b56-7ae9-4a39-88da-f9e823b1c0b8 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:50.088223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b8562b56-7ae9-4a39-88da-f9e823b1c0b8 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:50.251770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b8562b56-7ae9-4a39-88da-f9e823b1c0b8 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:50.260577 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b8562b56-7ae9-4a39-88da-f9e823b1c0b8 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1505 microversion: 2.1 time: 0.187992 Aug 18 12:34:50.261182 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4248/6902] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:50 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:50.287331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76bd54f0-fd20-41be-bd0a-e7b9deceffc9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:50.288034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-76bd54f0-fd20-41be-bd0a-e7b9deceffc9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:50.295771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76bd54f0-fd20-41be-bd0a-e7b9deceffc9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:50.296540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76bd54f0-fd20-41be-bd0a-e7b9deceffc9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:50.297060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76bd54f0-fd20-41be-bd0a-e7b9deceffc9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:50.297861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76bd54f0-fd20-41be-bd0a-e7b9deceffc9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:50.298419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76bd54f0-fd20-41be-bd0a-e7b9deceffc9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:50.299033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-76bd54f0-fd20-41be-bd0a-e7b9deceffc9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:50.304396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:34:50.318880 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-76bd54f0-fd20-41be-bd0a-e7b9deceffc9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] HTTP exception thrown: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76bd54f0-fd20-41be-bd0a-e7b9deceffc9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Request method failure captured: Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 HTTP/1.1 Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jHIXDPgW3qLSvej2e1k6x1q8dleVbgnvIc2TRvaUAQL4fcIcj7TxHDpr-bdYrxkUTNYK7hpHW9FwyaKzwrMltlpUFAj8TR0d6MpY45NzhQxArrnmT8ioC16UfoMnLGw_yBAFhwBS-VLZSRFXUXq2Pa-C5sIwH0lIdEn_FJZzoEfXYs Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: db1f6291aa384cdab6c527523bbec5ea Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: db1f6291aa384cdab6c527523bbec5ea Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-399875529-project Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d88bc2c9ddc84d4a988ab90a131d358f Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-399875529-project Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5bd9f427-61cf-4107-bc33-21f1c16aa106'} Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:34:50.320642 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:34:50.328523 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:50.328523 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.328523 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:50.328523 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.328523 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:50.328523 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:50.328523 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:50.328523 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:34:50.328523 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:34:50.328523 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:50.328523 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.328523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-76bd54f0-fd20-41be-bd0a-e7b9deceffc9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Returning 404 to user: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:50.328523 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-76bd54f0-fd20-41be-bd0a-e7b9deceffc9 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 404 len: 111 microversion: 2.1 time: 0.039177 Aug 18 12:34:50.328523 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4249/6903] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:34:50 2022] DELETE /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:34:50.333200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-93c9bc89-3ee9-4043-9eb2-8d003df883b7 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:50.333850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-93c9bc89-3ee9-4043-9eb2-8d003df883b7 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 5bd9f427-61cf-4107-bc33-21f1c16aa106] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:50.342557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93c9bc89-3ee9-4043-9eb2-8d003df883b7 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:50.343326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93c9bc89-3ee9-4043-9eb2-8d003df883b7 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:50.343807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93c9bc89-3ee9-4043-9eb2-8d003df883b7 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:50.344595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93c9bc89-3ee9-4043-9eb2-8d003df883b7 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:50.345087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93c9bc89-3ee9-4043-9eb2-8d003df883b7 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:50.345539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93c9bc89-3ee9-4043-9eb2-8d003df883b7 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:50.362055 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-93c9bc89-3ee9-4043-9eb2-8d003df883b7 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] HTTP exception thrown: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-93c9bc89-3ee9-4043-9eb2-8d003df883b7 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Request method failure captured: Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 HTTP/1.1 Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jHIXDPgW3qLSvej2e1k6x1q8dleVbgnvIc2TRvaUAQL4fcIcj7TxHDpr-bdYrxkUTNYK7hpHW9FwyaKzwrMltlpUFAj8TR0d6MpY45NzhQxArrnmT8ioC16UfoMnLGw_yBAFhwBS-VLZSRFXUXq2Pa-C5sIwH0lIdEn_FJZzoEfXYs Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: db1f6291aa384cdab6c527523bbec5ea Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: db1f6291aa384cdab6c527523bbec5ea Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-399875529-project Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d88bc2c9ddc84d4a988ab90a131d358f Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-399875529-project Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5bd9f427-61cf-4107-bc33-21f1c16aa106'} Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:50.363744 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.371618 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:50.371618 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:50.371618 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:50.371618 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:34:50.371618 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:34:50.371618 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. Aug 18 12:34:50.371618 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:50.371618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-93c9bc89-3ee9-4043-9eb2-8d003df883b7 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Returning 404 to user: Instance 5bd9f427-61cf-4107-bc33-21f1c16aa106 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:50.371618 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-93c9bc89-3ee9-4043-9eb2-8d003df883b7 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106" status: 404 len: 111 microversion: 2.1 time: 0.036057 Aug 18 12:34:50.371618 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4250/6904] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:50 2022] GET /compute/v2.1/servers/5bd9f427-61cf-4107-bc33-21f1c16aa106 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:34:50.376238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-313aca39-b065-44ea-ad15-e2c03c9b324f tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:50.376819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-313aca39-b065-44ea-ad15-e2c03c9b324f tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:50.383592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-313aca39-b065-44ea-ad15-e2c03c9b324f tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:50.384108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-313aca39-b065-44ea-ad15-e2c03c9b324f tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:50.384573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-313aca39-b065-44ea-ad15-e2c03c9b324f tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:50.385317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-313aca39-b065-44ea-ad15-e2c03c9b324f tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:50.385799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-313aca39-b065-44ea-ad15-e2c03c9b324f tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:50.386256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-313aca39-b065-44ea-ad15-e2c03c9b324f tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:50.415843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-313aca39-b065-44ea-ad15-e2c03c9b324f tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:34:50.509890 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-313aca39-b065-44ea-ad15-e2c03c9b324f tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "DELETE /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 204 len: 0 microversion: 2.1 time: 0.137556 Aug 18 12:34:50.510331 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4251/6905] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:34:50 2022] DELETE /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:34:50.522049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-05a82e1d-fdea-4402-ba66-833d42a74e0d tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:50.522822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-05a82e1d-fdea-4402-ba66-833d42a74e0d tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:50.530257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05a82e1d-fdea-4402-ba66-833d42a74e0d tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:50.530817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05a82e1d-fdea-4402-ba66-833d42a74e0d tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:50.531277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05a82e1d-fdea-4402-ba66-833d42a74e0d tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:50.532031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05a82e1d-fdea-4402-ba66-833d42a74e0d tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:50.532518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05a82e1d-fdea-4402-ba66-833d42a74e0d tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:50.532961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05a82e1d-fdea-4402-ba66-833d42a74e0d tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:50.695745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-05a82e1d-fdea-4402-ba66-833d42a74e0d tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:50.706222 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-05a82e1d-fdea-4402-ba66-833d42a74e0d tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1511 microversion: 2.1 time: 0.189993 Aug 18 12:34:50.707045 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4252/6906] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:50 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:34:51.729868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-413b01e8-7047-4138-8658-4e898d824d44 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:51.730607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-413b01e8-7047-4138-8658-4e898d824d44 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:51.739223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-413b01e8-7047-4138-8658-4e898d824d44 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:51.739808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-413b01e8-7047-4138-8658-4e898d824d44 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:51.740318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-413b01e8-7047-4138-8658-4e898d824d44 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:51.741128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-413b01e8-7047-4138-8658-4e898d824d44 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:51.741674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-413b01e8-7047-4138-8658-4e898d824d44 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:51.742257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-413b01e8-7047-4138-8658-4e898d824d44 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:51.931276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-413b01e8-7047-4138-8658-4e898d824d44 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88bc2c9ddc84d4a988ab90a131d358f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db1f6291aa384cdab6c527523bbec5ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:34:51.943137 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-413b01e8-7047-4138-8658-4e898d824d44 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 200 len: 1511 microversion: 2.1 time: 0.217483 Aug 18 12:34:51.943827 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4253/6907] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:51 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:34:52.474687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-6b7b00e2-f352-4851-a2b6-e099a7ffc7ae req-ab20a11f-cec6-4c78-8a14-ead8b24b55fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69006e70-1a9c-47f8-93b7-dad6700f5ca8", "name": "network-vif-deleted", "tag": "661cfe60-beef-49ba-8f62-05be65311adc"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:34:52.502735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6b7b00e2-f352-4851-a2b6-e099a7ffc7ae req-ab20a11f-cec6-4c78-8a14-ead8b24b55fc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:52.503487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6b7b00e2-f352-4851-a2b6-e099a7ffc7ae req-ab20a11f-cec6-4c78-8a14-ead8b24b55fc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:52.503935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6b7b00e2-f352-4851-a2b6-e099a7ffc7ae req-ab20a11f-cec6-4c78-8a14-ead8b24b55fc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:52.519296 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6b7b00e2-f352-4851-a2b6-e099a7ffc7ae req-ab20a11f-cec6-4c78-8a14-ead8b24b55fc service nova] Creating event network-vif-deleted:661cfe60-beef-49ba-8f62-05be65311adc for instance 69006e70-1a9c-47f8-93b7-dad6700f5ca8 on n-h2-853611-3 Aug 18 12:34:52.524996 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-6b7b00e2-f352-4851-a2b6-e099a7ffc7ae req-ab20a11f-cec6-4c78-8a14-ead8b24b55fc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057995 Aug 18 12:34:52.525887 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4254/6908] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:34:52.974382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-191f8fc1-5332-43a2-b202-7716f8312e41 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:34:52.975786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-191f8fc1-5332-43a2-b202-7716f8312e41 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] [instance: 69006e70-1a9c-47f8-93b7-dad6700f5ca8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:34:52.986562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-191f8fc1-5332-43a2-b202-7716f8312e41 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:52.987487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-191f8fc1-5332-43a2-b202-7716f8312e41 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:52.988303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-191f8fc1-5332-43a2-b202-7716f8312e41 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:52.989639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-191f8fc1-5332-43a2-b202-7716f8312e41 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:34:52.990563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-191f8fc1-5332-43a2-b202-7716f8312e41 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:34:52.991393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-191f8fc1-5332-43a2-b202-7716f8312e41 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:34:53.015720 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-191f8fc1-5332-43a2-b202-7716f8312e41 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] HTTP exception thrown: Instance 69006e70-1a9c-47f8-93b7-dad6700f5ca8 could not be found. Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-191f8fc1-5332-43a2-b202-7716f8312e41 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Request method failure captured: Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 HTTP/1.1 Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jHIXDPgW3qLSvej2e1k6x1q8dleVbgnvIc2TRvaUAQL4fcIcj7TxHDpr-bdYrxkUTNYK7hpHW9FwyaKzwrMltlpUFAj8TR0d6MpY45NzhQxArrnmT8ioC16UfoMnLGw_yBAFhwBS-VLZSRFXUXq2Pa-C5sIwH0lIdEn_FJZzoEfXYs Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: db1f6291aa384cdab6c527523bbec5ea Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/db1f6291aa384cdab6c527523bbec5ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: db1f6291aa384cdab6c527523bbec5ea Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-399875529 Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-ServersNegativeTestJSON-399875529-project Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: d88bc2c9ddc84d4a988ab90a131d358f Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-ServersNegativeTestJSON-399875529-project Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 69006e70-1a9c-47f8-93b7-dad6700f5ca8 could not be found. Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '69006e70-1a9c-47f8-93b7-dad6700f5ca8'} Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69006e70-1a9c-47f8-93b7-dad6700f5ca8 could not be found. Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69006e70-1a9c-47f8-93b7-dad6700f5ca8 could not be found. Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:34:53.017512 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:53.024676 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:34:53.024676 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:34:53.024676 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:34:53.024676 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:34:53.024676 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:34:53.024676 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69006e70-1a9c-47f8-93b7-dad6700f5ca8 could not be found. Aug 18 12:34:53.024676 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:34:53.024676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-191f8fc1-5332-43a2-b202-7716f8312e41 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] Returning 404 to user: Instance 69006e70-1a9c-47f8-93b7-dad6700f5ca8 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:34:53.024676 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-191f8fc1-5332-43a2-b202-7716f8312e41 tempest-ServersNegativeTestJSON-399875529 tempest-ServersNegativeTestJSON-399875529-project] 10.222.0.73 "GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8" status: 404 len: 111 microversion: 2.1 time: 0.054418 Aug 18 12:34:53.026583 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4255/6909] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:34:52 2022] GET /compute/v2.1/servers/69006e70-1a9c-47f8-93b7-dad6700f5ca8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 12:35:00.172747 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:35:00.173531 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:35:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:35:16.749329 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:35:16.750309 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:35:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:35:37.084463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:35:37.085985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:35:37.341925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0493419c-3d8f-4f0c-afe3-9a9dbc37073d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Action: 'create', calling method: .version_select at 0x7f519fb820d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-478989581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsxTtal5LuX1q3HGhLlaPiZROCvmrVuPss6NAFa/+Flb+ecNP4deDjNQD58QzYqpnRnffMkBYH5mB2CEwl+wabg64LD14nrRYiUJBVlCfxKYXWjAx3+YfrrVGTMasljVw=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:35:37.363730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0493419c-3d8f-4f0c-afe3-9a9dbc37073d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Getting quotas for project 24e40dd3fdf64057b1d1a0b13827c553. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:35:37.370489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-0493419c-3d8f-4f0c-afe3-9a9dbc37073d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Getting quotas for user ec18f372bcf145ccb8e59f89e8528601 and project 24e40dd3fdf64057b1d1a0b13827c553. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:35:37.404428 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0493419c-3d8f-4f0c-afe3-9a9dbc37073d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.325968 Aug 18 12:35:37.405093 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4256/6910] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:35:37 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:35:37.466873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1705586416", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-478989581", "networks": [{"uuid": "1ae58700-9b9d-41e3-86ed-442da94fbe38"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:35:37.527335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] validate_networks() for [('1ae58700-9b9d-41e3-86ed-442da94fbe38', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:35:38.257629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:35:38.258391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:35:38.258742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:35:38.259361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:35:38.259789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:35:38.274859 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:38.275841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:38.276728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:38.278516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:38.280780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:38.281390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:38.311876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Getting quotas for project 24e40dd3fdf64057b1d1a0b13827c553. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:35:38.321808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Getting quotas for user ec18f372bcf145ccb8e59f89e8528601 and project 24e40dd3fdf64057b1d1a0b13827c553. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:35:38.345742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:35:38.348489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:35:38.409212 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9e9fe469-2082-4c80-b083-69db123876f3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946889 Aug 18 12:35:38.410574 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4257/6911] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:35:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:35:38.428311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5c397999-c366-4412-a3ff-9d0c80a384fc tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:38.429408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5c397999-c366-4412-a3ff-9d0c80a384fc tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:38.521136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5c397999-c366-4412-a3ff-9d0c80a384fc tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:38.530477 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5c397999-c366-4412-a3ff-9d0c80a384fc tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 200 len: 1262 microversion: 2.1 time: 0.109285 Aug 18 12:35:38.531483 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4258/6912] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:38 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 1262 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:35:39.570593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6c289b77-8123-4fbb-923e-607f90563001 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:39.571816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6c289b77-8123-4fbb-923e-607f90563001 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:39.586160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c289b77-8123-4fbb-923e-607f90563001 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:39.587211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c289b77-8123-4fbb-923e-607f90563001 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:39.587531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c289b77-8123-4fbb-923e-607f90563001 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:39.588559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c289b77-8123-4fbb-923e-607f90563001 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:39.589649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c289b77-8123-4fbb-923e-607f90563001 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:39.589819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c289b77-8123-4fbb-923e-607f90563001 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:39.727390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6c289b77-8123-4fbb-923e-607f90563001 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:39.746250 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6c289b77-8123-4fbb-923e-607f90563001 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 200 len: 1314 microversion: 2.1 time: 0.183466 Aug 18 12:35:39.760262 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4259/6913] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:39 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:35:40.788638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-16bc8a4b-1a7c-429e-a940-57dfa5a12393 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:40.789830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-16bc8a4b-1a7c-429e-a940-57dfa5a12393 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:40.805545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16bc8a4b-1a7c-429e-a940-57dfa5a12393 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:40.806295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16bc8a4b-1a7c-429e-a940-57dfa5a12393 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:40.807110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16bc8a4b-1a7c-429e-a940-57dfa5a12393 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:40.808399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16bc8a4b-1a7c-429e-a940-57dfa5a12393 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:40.809220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16bc8a4b-1a7c-429e-a940-57dfa5a12393 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:40.810028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-16bc8a4b-1a7c-429e-a940-57dfa5a12393 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:41.165108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-16bc8a4b-1a7c-429e-a940-57dfa5a12393 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:41.181084 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-16bc8a4b-1a7c-429e-a940-57dfa5a12393 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 200 len: 1362 microversion: 2.1 time: 0.399145 Aug 18 12:35:41.182632 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4260/6914] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:40 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:35:41.650699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-cd4470b8-875d-4db5-8348-f0361c671f3c req-a21e5db8-c009-4885-8a09-701df037bc70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513ef1a7-095e-48c2-b818-53bb0e8dfd14", "tag": "09c225c7-bf90-4a7e-b6d0-250654ce3579"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:35:41.687216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cd4470b8-875d-4db5-8348-f0361c671f3c req-a21e5db8-c009-4885-8a09-701df037bc70 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:41.688654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cd4470b8-875d-4db5-8348-f0361c671f3c req-a21e5db8-c009-4885-8a09-701df037bc70 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:41.690362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-cd4470b8-875d-4db5-8348-f0361c671f3c req-a21e5db8-c009-4885-8a09-701df037bc70 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:41.715614 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-cd4470b8-875d-4db5-8348-f0361c671f3c req-a21e5db8-c009-4885-8a09-701df037bc70 service nova] Creating event network-changed:09c225c7-bf90-4a7e-b6d0-250654ce3579 for instance 513ef1a7-095e-48c2-b818-53bb0e8dfd14 on n-h2-853611-3 Aug 18 12:35:41.726173 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-cd4470b8-875d-4db5-8348-f0361c671f3c req-a21e5db8-c009-4885-8a09-701df037bc70 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083791 Aug 18 12:35:41.728070 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4261/6915] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:35:42.227675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b138525b-3d9a-4c7d-b627-a19f999dae63 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:42.229249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b138525b-3d9a-4c7d-b627-a19f999dae63 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:42.242351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b138525b-3d9a-4c7d-b627-a19f999dae63 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:42.243263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b138525b-3d9a-4c7d-b627-a19f999dae63 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:42.244055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b138525b-3d9a-4c7d-b627-a19f999dae63 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:42.245364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b138525b-3d9a-4c7d-b627-a19f999dae63 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:42.246210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b138525b-3d9a-4c7d-b627-a19f999dae63 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:42.247241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b138525b-3d9a-4c7d-b627-a19f999dae63 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:42.562561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b138525b-3d9a-4c7d-b627-a19f999dae63 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:42.572859 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b138525b-3d9a-4c7d-b627-a19f999dae63 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 200 len: 1362 microversion: 2.1 time: 0.353324 Aug 18 12:35:42.586726 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4262/6916] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:42 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:35:43.610383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e7ed23aa-406a-435f-963b-08842e2f89a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:43.612650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e7ed23aa-406a-435f-963b-08842e2f89a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:43.634035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ed23aa-406a-435f-963b-08842e2f89a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:43.635554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ed23aa-406a-435f-963b-08842e2f89a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:43.636498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ed23aa-406a-435f-963b-08842e2f89a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:43.637864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ed23aa-406a-435f-963b-08842e2f89a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:43.640221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ed23aa-406a-435f-963b-08842e2f89a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:43.641176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e7ed23aa-406a-435f-963b-08842e2f89a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:44.033435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e7ed23aa-406a-435f-963b-08842e2f89a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:44.048574 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e7ed23aa-406a-435f-963b-08842e2f89a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 200 len: 1362 microversion: 2.1 time: 0.444943 Aug 18 12:35:44.049629 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4263/6917] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:43 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 1362 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:35:45.072216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e6286999-06da-4406-842d-382fb992bda9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:45.073256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e6286999-06da-4406-842d-382fb992bda9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:45.082156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6286999-06da-4406-842d-382fb992bda9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:45.082846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6286999-06da-4406-842d-382fb992bda9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:45.083436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6286999-06da-4406-842d-382fb992bda9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:45.084331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6286999-06da-4406-842d-382fb992bda9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:45.084853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6286999-06da-4406-842d-382fb992bda9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:45.085433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6286999-06da-4406-842d-382fb992bda9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:45.275733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e6286999-06da-4406-842d-382fb992bda9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:45.285586 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e6286999-06da-4406-842d-382fb992bda9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 200 len: 1362 microversion: 2.1 time: 0.218060 Aug 18 12:35:45.286592 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4264/6918] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:45 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:35:46.307729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-391ec7ec-3286-401a-8be7-03e66edde85a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:46.308519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-391ec7ec-3286-401a-8be7-03e66edde85a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:46.316570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-391ec7ec-3286-401a-8be7-03e66edde85a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:46.317272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-391ec7ec-3286-401a-8be7-03e66edde85a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:46.317807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-391ec7ec-3286-401a-8be7-03e66edde85a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:46.318656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-391ec7ec-3286-401a-8be7-03e66edde85a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:46.319190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-391ec7ec-3286-401a-8be7-03e66edde85a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:46.319711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-391ec7ec-3286-401a-8be7-03e66edde85a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:46.537472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-391ec7ec-3286-401a-8be7-03e66edde85a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:46.547206 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-391ec7ec-3286-401a-8be7-03e66edde85a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 200 len: 1362 microversion: 2.1 time: 0.243691 Aug 18 12:35:46.548269 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4265/6919] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:46 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:35:47.582077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5dbe0f10-cc92-4e13-9c21-aee6f7df14c3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:47.582922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5dbe0f10-cc92-4e13-9c21-aee6f7df14c3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:47.590866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dbe0f10-cc92-4e13-9c21-aee6f7df14c3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:47.591460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dbe0f10-cc92-4e13-9c21-aee6f7df14c3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:47.592006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dbe0f10-cc92-4e13-9c21-aee6f7df14c3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:47.592860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dbe0f10-cc92-4e13-9c21-aee6f7df14c3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:47.593440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dbe0f10-cc92-4e13-9c21-aee6f7df14c3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:47.593976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5dbe0f10-cc92-4e13-9c21-aee6f7df14c3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:47.760059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5dbe0f10-cc92-4e13-9c21-aee6f7df14c3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:47.769626 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5dbe0f10-cc92-4e13-9c21-aee6f7df14c3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 200 len: 1362 microversion: 2.1 time: 0.191825 Aug 18 12:35:47.770394 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4266/6920] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:47 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:35:48.178983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-164317da-b524-473a-b06a-cc4772030b04 req-ef15f872-60df-4172-bc86-42d1551fcfdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513ef1a7-095e-48c2-b818-53bb0e8dfd14", "name": "network-vif-plugged", "status": "completed", "tag": "09c225c7-bf90-4a7e-b6d0-250654ce3579"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:35:48.196699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-164317da-b524-473a-b06a-cc4772030b04 req-ef15f872-60df-4172-bc86-42d1551fcfdc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:48.197558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-164317da-b524-473a-b06a-cc4772030b04 req-ef15f872-60df-4172-bc86-42d1551fcfdc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:48.198321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-164317da-b524-473a-b06a-cc4772030b04 req-ef15f872-60df-4172-bc86-42d1551fcfdc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:48.218659 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-164317da-b524-473a-b06a-cc4772030b04 req-ef15f872-60df-4172-bc86-42d1551fcfdc service nova] Creating event network-vif-plugged:09c225c7-bf90-4a7e-b6d0-250654ce3579 for instance 513ef1a7-095e-48c2-b818-53bb0e8dfd14 on n-h2-853611-3 Aug 18 12:35:48.227092 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-164317da-b524-473a-b06a-cc4772030b04 req-ef15f872-60df-4172-bc86-42d1551fcfdc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114739 Aug 18 12:35:48.228113 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4267/6921] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:35:48.793553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4cc55c0b-6380-4e25-9b42-83b6961f10b7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:48.794391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4cc55c0b-6380-4e25-9b42-83b6961f10b7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:48.797089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:35:48.798253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:35:48.806554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc55c0b-6380-4e25-9b42-83b6961f10b7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:48.807059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc55c0b-6380-4e25-9b42-83b6961f10b7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:48.807510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc55c0b-6380-4e25-9b42-83b6961f10b7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:48.808229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc55c0b-6380-4e25-9b42-83b6961f10b7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:48.808693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc55c0b-6380-4e25-9b42-83b6961f10b7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:48.809130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4cc55c0b-6380-4e25-9b42-83b6961f10b7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:48.958798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4cc55c0b-6380-4e25-9b42-83b6961f10b7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:48.972211 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4cc55c0b-6380-4e25-9b42-83b6961f10b7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 200 len: 1362 microversion: 2.1 time: 0.183390 Aug 18 12:35:48.973086 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4268/6922] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:48 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:35:49.997302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cae2bf1c-9423-490f-ae66-33b59e7b12f2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:49.998753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cae2bf1c-9423-490f-ae66-33b59e7b12f2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:50.006690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cae2bf1c-9423-490f-ae66-33b59e7b12f2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:50.007215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cae2bf1c-9423-490f-ae66-33b59e7b12f2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:50.007717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cae2bf1c-9423-490f-ae66-33b59e7b12f2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:50.008494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cae2bf1c-9423-490f-ae66-33b59e7b12f2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:50.009059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cae2bf1c-9423-490f-ae66-33b59e7b12f2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:50.009463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cae2bf1c-9423-490f-ae66-33b59e7b12f2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:50.180519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cae2bf1c-9423-490f-ae66-33b59e7b12f2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:50.190759 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cae2bf1c-9423-490f-ae66-33b59e7b12f2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 200 len: 1553 microversion: 2.1 time: 0.197596 Aug 18 12:35:50.191391 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4269/6923] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:49 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 1553 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:35:50.228652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-602db543-f393-4f02-8d21-be962e76c23c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:35:50.229470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-602db543-f393-4f02-8d21-be962e76c23c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:50.237326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-602db543-f393-4f02-8d21-be962e76c23c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:50.238154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-602db543-f393-4f02-8d21-be962e76c23c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:50.238748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-602db543-f393-4f02-8d21-be962e76c23c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:50.239555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-602db543-f393-4f02-8d21-be962e76c23c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:50.240100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-602db543-f393-4f02-8d21-be962e76c23c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:50.240666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-602db543-f393-4f02-8d21-be962e76c23c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:50.406223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-602db543-f393-4f02-8d21-be962e76c23c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:35:50.417230 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-602db543-f393-4f02-8d21-be962e76c23c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 200 len: 1553 microversion: 2.1 time: 0.193303 Aug 18 12:35:50.417847 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4270/6924] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:35:50 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:35:53.399199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ddfbdbcb-6f35-4706-ae6b-2df3d148077f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7fc9534-441f-40d1-98c0-4cddabac0e54"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:35:53.401830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ddfbdbcb-6f35-4706-ae6b-2df3d148077f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:35:53.409587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddfbdbcb-6f35-4706-ae6b-2df3d148077f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:53.410117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddfbdbcb-6f35-4706-ae6b-2df3d148077f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:53.410588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddfbdbcb-6f35-4706-ae6b-2df3d148077f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:53.411313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddfbdbcb-6f35-4706-ae6b-2df3d148077f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:35:53.411779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddfbdbcb-6f35-4706-ae6b-2df3d148077f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:35:53.412218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddfbdbcb-6f35-4706-ae6b-2df3d148077f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:35:53.707115 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ddfbdbcb-6f35-4706-ae6b-2df3d148077f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "POST /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311958 Aug 18 12:35:53.707978 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4271/6925] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 12:35:53 2022] POST /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:36:05.801492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2ffc5de5-07b3-4e57-a79e-245c1cb3dd79 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:05.802245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2ffc5de5-07b3-4e57-a79e-245c1cb3dd79 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:05.805257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:36:05.806135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:36:05.814604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ffc5de5-07b3-4e57-a79e-245c1cb3dd79 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:05.815118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ffc5de5-07b3-4e57-a79e-245c1cb3dd79 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:05.815700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ffc5de5-07b3-4e57-a79e-245c1cb3dd79 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:05.816436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ffc5de5-07b3-4e57-a79e-245c1cb3dd79 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:05.816905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ffc5de5-07b3-4e57-a79e-245c1cb3dd79 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:05.817350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ffc5de5-07b3-4e57-a79e-245c1cb3dd79 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:05.909324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-2ffc5de5-07b3-4e57-a79e-245c1cb3dd79 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lazy-loading 'services' on Instance uuid 513ef1a7-095e-48c2-b818-53bb0e8dfd14 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:36:06.006707 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2ffc5de5-07b3-4e57-a79e-245c1cb3dd79 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "DELETE /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments/d7fc9534-441f-40d1-98c0-4cddabac0e54" status: 202 len: 0 microversion: 2.1 time: 0.208758 Aug 18 12:36:06.009698 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4272/6926] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 12:36:05 2022] DELETE /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments/d7fc9534-441f-40d1-98c0-4cddabac0e54 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:36:06.021921 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8ece25cd-569f-4c03-a373-cf392033d865 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:06.024530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8ece25cd-569f-4c03-a373-cf392033d865 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:06.033216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ece25cd-569f-4c03-a373-cf392033d865 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:06.033997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ece25cd-569f-4c03-a373-cf392033d865 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:06.034812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ece25cd-569f-4c03-a373-cf392033d865 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:06.035777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ece25cd-569f-4c03-a373-cf392033d865 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:06.036508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ece25cd-569f-4c03-a373-cf392033d865 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:06.036981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ece25cd-569f-4c03-a373-cf392033d865 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:06.076048 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8ece25cd-569f-4c03-a373-cf392033d865 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058949 Aug 18 12:36:06.077886 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4273/6927] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:36:06 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:36:07.090595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3041964-2a23-4714-817d-1fff409445e9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:07.094708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3041964-2a23-4714-817d-1fff409445e9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:07.102486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3041964-2a23-4714-817d-1fff409445e9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:07.103076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3041964-2a23-4714-817d-1fff409445e9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:07.103545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3041964-2a23-4714-817d-1fff409445e9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:07.104311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3041964-2a23-4714-817d-1fff409445e9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:07.104821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3041964-2a23-4714-817d-1fff409445e9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:07.105277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3041964-2a23-4714-817d-1fff409445e9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:07.150291 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3041964-2a23-4714-817d-1fff409445e9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063839 Aug 18 12:36:07.151384 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4274/6928] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:36:07 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:36:08.167060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-96aea3de-1e36-4f6a-bdfc-6343f1c43bcb tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:08.171970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-96aea3de-1e36-4f6a-bdfc-6343f1c43bcb tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:08.180654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96aea3de-1e36-4f6a-bdfc-6343f1c43bcb tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:08.181278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96aea3de-1e36-4f6a-bdfc-6343f1c43bcb tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:08.181829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96aea3de-1e36-4f6a-bdfc-6343f1c43bcb tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:08.182841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96aea3de-1e36-4f6a-bdfc-6343f1c43bcb tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:08.183432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96aea3de-1e36-4f6a-bdfc-6343f1c43bcb tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:08.184026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96aea3de-1e36-4f6a-bdfc-6343f1c43bcb tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:08.226737 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-96aea3de-1e36-4f6a-bdfc-6343f1c43bcb tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065647 Aug 18 12:36:08.227457 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4275/6929] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:36:08 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:36:09.241474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-833a9cb9-00d6-4038-b57e-dcbfe704369c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:09.244829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-833a9cb9-00d6-4038-b57e-dcbfe704369c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:09.253712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-833a9cb9-00d6-4038-b57e-dcbfe704369c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:09.254234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-833a9cb9-00d6-4038-b57e-dcbfe704369c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:09.254733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-833a9cb9-00d6-4038-b57e-dcbfe704369c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:09.255500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-833a9cb9-00d6-4038-b57e-dcbfe704369c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:09.255974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-833a9cb9-00d6-4038-b57e-dcbfe704369c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:09.256417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-833a9cb9-00d6-4038-b57e-dcbfe704369c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:09.292920 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-833a9cb9-00d6-4038-b57e-dcbfe704369c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056170 Aug 18 12:36:09.293533 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4276/6930] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:36:09 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:36:10.309833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9181bd5-7eba-4e10-983c-5ed320666f8a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:10.313105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c9181bd5-7eba-4e10-983c-5ed320666f8a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:10.321634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9181bd5-7eba-4e10-983c-5ed320666f8a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:10.322331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9181bd5-7eba-4e10-983c-5ed320666f8a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:10.322972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9181bd5-7eba-4e10-983c-5ed320666f8a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:10.323912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9181bd5-7eba-4e10-983c-5ed320666f8a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:10.324490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9181bd5-7eba-4e10-983c-5ed320666f8a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:10.325035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9181bd5-7eba-4e10-983c-5ed320666f8a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:10.364794 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c9181bd5-7eba-4e10-983c-5ed320666f8a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059443 Aug 18 12:36:10.365590 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4277/6931] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:36:10 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:36:11.378731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-afde415e-9057-4c03-9d6e-83fd6bc20f17 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:11.381135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-afde415e-9057-4c03-9d6e-83fd6bc20f17 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:11.391056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afde415e-9057-4c03-9d6e-83fd6bc20f17 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:11.391633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afde415e-9057-4c03-9d6e-83fd6bc20f17 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:11.392140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afde415e-9057-4c03-9d6e-83fd6bc20f17 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:11.393087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afde415e-9057-4c03-9d6e-83fd6bc20f17 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:11.393617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afde415e-9057-4c03-9d6e-83fd6bc20f17 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:11.394116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-afde415e-9057-4c03-9d6e-83fd6bc20f17 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:11.434282 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-afde415e-9057-4c03-9d6e-83fd6bc20f17 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059872 Aug 18 12:36:11.435442 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4278/6932] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:36:11 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 12:36:11.454306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-00a99dd4-3135-4ba6-97cd-94478e5fdaaf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:11.454964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-00a99dd4-3135-4ba6-97cd-94478e5fdaaf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:11.468935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00a99dd4-3135-4ba6-97cd-94478e5fdaaf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:11.469947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00a99dd4-3135-4ba6-97cd-94478e5fdaaf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:11.470674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00a99dd4-3135-4ba6-97cd-94478e5fdaaf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:11.471566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00a99dd4-3135-4ba6-97cd-94478e5fdaaf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:11.472102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00a99dd4-3135-4ba6-97cd-94478e5fdaaf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:11.472637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00a99dd4-3135-4ba6-97cd-94478e5fdaaf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:11.578614 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-00a99dd4-3135-4ba6-97cd-94478e5fdaaf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] HTTP exception thrown: Instance 513ef1a7-095e-48c2-b818-53bb0e8dfd14 is not attached to volume d7fc9534-441f-40d1-98c0-4cddabac0e54 Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-00a99dd4-3135-4ba6-97cd-94478e5fdaaf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Request method failure captured: Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments/d7fc9534-441f-40d1-98c0-4cddabac0e54 HTTP/1.1 Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jISE2u8UCIWA2SUGKuHNA7SGeZgFVM_oNgVbEBuMJXvpjBe0VA-aMhM806HJXRfUfcJ5UIkxsXEig8LAeGlKtasgKQOC12b_SWQYaPArEcD4kBOaYLgs2Xske6hiKw27K5baPCaszy3G4a5etE7JgXvN-HXog3_4Gg3GA7TkvDJH9k Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 24e40dd3fdf64057b1d1a0b13827c553 Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 24e40dd3fdf64057b1d1a0b13827c553 Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestEncryptedCinderVolumes-2049131897-project Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ec18f372bcf145ccb8e59f89e8528601 Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestEncryptedCinderVolumes-2049131897-project Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 513ef1a7-095e-48c2-b818-53bb0e8dfd14 is not attached to volume d7fc9534-441f-40d1-98c0-4cddabac0e54 Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': '513ef1a7-095e-48c2-b818-53bb0e8dfd14', 'id': 'd7fc9534-441f-40d1-98c0-4cddabac0e54'} Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d7fc9534-441f-40d1-98c0-4cddabac0e54. Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 513ef1a7-095e-48c2-b818-53bb0e8dfd14 is not attached to volume d7fc9534-441f-40d1-98c0-4cddabac0e54 Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:36:11.585926 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:36:11.594939 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:36:11.594939 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:36:11.594939 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 513ef1a7-095e-48c2-b818-53bb0e8dfd14 is not attached to volume d7fc9534-441f-40d1-98c0-4cddabac0e54 Aug 18 12:36:11.594939 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:11.594939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-00a99dd4-3135-4ba6-97cd-94478e5fdaaf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Returning 404 to user: Instance 513ef1a7-095e-48c2-b818-53bb0e8dfd14 is not attached to volume d7fc9534-441f-40d1-98c0-4cddabac0e54 {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:36:11.594939 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-00a99dd4-3135-4ba6-97cd-94478e5fdaaf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "DELETE /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments/d7fc9534-441f-40d1-98c0-4cddabac0e54" status: 404 len: 154 microversion: 2.1 time: 0.144144 Aug 18 12:36:11.594939 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4279/6933] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 12:36:11 2022] DELETE /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14/os-volume_attachments/d7fc9534-441f-40d1-98c0-4cddabac0e54 => generated 154 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:36:16.191458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8073e5ec-1e22-4ce8-89f5-155991f32919 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:16.192517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8073e5ec-1e22-4ce8-89f5-155991f32919 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:16.201600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8073e5ec-1e22-4ce8-89f5-155991f32919 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:16.202597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8073e5ec-1e22-4ce8-89f5-155991f32919 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:16.203205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8073e5ec-1e22-4ce8-89f5-155991f32919 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:16.204049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8073e5ec-1e22-4ce8-89f5-155991f32919 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:16.204717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8073e5ec-1e22-4ce8-89f5-155991f32919 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:16.205314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8073e5ec-1e22-4ce8-89f5-155991f32919 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:16.241487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8073e5ec-1e22-4ce8-89f5-155991f32919 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:36:16.360387 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8073e5ec-1e22-4ce8-89f5-155991f32919 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "DELETE /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 204 len: 0 microversion: 2.1 time: 0.172832 Aug 18 12:36:16.361321 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4280/6934] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:36:16 2022] DELETE /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:36:16.374375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-900c4ed2-8fc1-4c95-851c-996bd060210b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:16.375260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-900c4ed2-8fc1-4c95-851c-996bd060210b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:16.382743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-900c4ed2-8fc1-4c95-851c-996bd060210b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:16.383375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-900c4ed2-8fc1-4c95-851c-996bd060210b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:16.383879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-900c4ed2-8fc1-4c95-851c-996bd060210b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:16.384904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-900c4ed2-8fc1-4c95-851c-996bd060210b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:16.385518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-900c4ed2-8fc1-4c95-851c-996bd060210b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:16.386147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-900c4ed2-8fc1-4c95-851c-996bd060210b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:16.583322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-900c4ed2-8fc1-4c95-851c-996bd060210b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:16.591987 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-900c4ed2-8fc1-4c95-851c-996bd060210b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 200 len: 1559 microversion: 2.1 time: 0.223743 Aug 18 12:36:16.592757 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4281/6935] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:16 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:36:17.615073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8a28d34b-1930-4de6-8102-ef560c70c14d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:17.615900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8a28d34b-1930-4de6-8102-ef560c70c14d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:17.624111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a28d34b-1930-4de6-8102-ef560c70c14d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:17.624670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a28d34b-1930-4de6-8102-ef560c70c14d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:17.625162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a28d34b-1930-4de6-8102-ef560c70c14d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:17.625942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a28d34b-1930-4de6-8102-ef560c70c14d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:17.626532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a28d34b-1930-4de6-8102-ef560c70c14d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:17.627039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8a28d34b-1930-4de6-8102-ef560c70c14d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:17.805772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8a28d34b-1930-4de6-8102-ef560c70c14d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:17.814949 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8a28d34b-1930-4de6-8102-ef560c70c14d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 200 len: 1559 microversion: 2.1 time: 0.204040 Aug 18 12:36:17.815716 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4282/6936] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:17 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:36:18.607249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-43c586ce-81ae-40ea-81ed-a0ec6273ffeb req-5ec72bb8-1ddb-4527-b39e-94b6097fa2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513ef1a7-095e-48c2-b818-53bb0e8dfd14", "name": "network-vif-deleted", "tag": "09c225c7-bf90-4a7e-b6d0-250654ce3579"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:36:18.627026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-43c586ce-81ae-40ea-81ed-a0ec6273ffeb req-5ec72bb8-1ddb-4527-b39e-94b6097fa2c4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:18.628288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-43c586ce-81ae-40ea-81ed-a0ec6273ffeb req-5ec72bb8-1ddb-4527-b39e-94b6097fa2c4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:18.628998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-43c586ce-81ae-40ea-81ed-a0ec6273ffeb req-5ec72bb8-1ddb-4527-b39e-94b6097fa2c4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:18.650012 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-43c586ce-81ae-40ea-81ed-a0ec6273ffeb req-5ec72bb8-1ddb-4527-b39e-94b6097fa2c4 service nova] Creating event network-vif-deleted:09c225c7-bf90-4a7e-b6d0-250654ce3579 for instance 513ef1a7-095e-48c2-b818-53bb0e8dfd14 on n-h2-853611-3 Aug 18 12:36:18.658594 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-43c586ce-81ae-40ea-81ed-a0ec6273ffeb req-5ec72bb8-1ddb-4527-b39e-94b6097fa2c4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055892 Aug 18 12:36:18.659395 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4283/6937] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:36:18.838509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bef153c8-4a0c-41ce-9e14-9fb1f9f264ce tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:18.839296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bef153c8-4a0c-41ce-9e14-9fb1f9f264ce tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:18.848309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bef153c8-4a0c-41ce-9e14-9fb1f9f264ce tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:18.848867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bef153c8-4a0c-41ce-9e14-9fb1f9f264ce tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:18.849327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bef153c8-4a0c-41ce-9e14-9fb1f9f264ce tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:18.850076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bef153c8-4a0c-41ce-9e14-9fb1f9f264ce tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:18.850608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bef153c8-4a0c-41ce-9e14-9fb1f9f264ce tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:18.851049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bef153c8-4a0c-41ce-9e14-9fb1f9f264ce tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:18.894237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bef153c8-4a0c-41ce-9e14-9fb1f9f264ce tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:18.894787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bef153c8-4a0c-41ce-9e14-9fb1f9f264ce tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:18.895255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bef153c8-4a0c-41ce-9e14-9fb1f9f264ce tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:18.895741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-bef153c8-4a0c-41ce-9e14-9fb1f9f264ce tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lazy-loading 'fault' on Instance uuid 513ef1a7-095e-48c2-b818-53bb0e8dfd14 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:36:18.972393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bef153c8-4a0c-41ce-9e14-9fb1f9f264ce tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:18.988752 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bef153c8-4a0c-41ce-9e14-9fb1f9f264ce tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 200 len: 1352 microversion: 2.1 time: 0.154194 Aug 18 12:36:18.989629 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4284/6938] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:18 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 1352 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:36:20.022032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-69e2d244-a1a7-4d0d-aa94-7ff1c4d4f513 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:20.023061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-69e2d244-a1a7-4d0d-aa94-7ff1c4d4f513 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 513ef1a7-095e-48c2-b818-53bb0e8dfd14] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:20.035362 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69e2d244-a1a7-4d0d-aa94-7ff1c4d4f513 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:20.036141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69e2d244-a1a7-4d0d-aa94-7ff1c4d4f513 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:20.036834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69e2d244-a1a7-4d0d-aa94-7ff1c4d4f513 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:20.037966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69e2d244-a1a7-4d0d-aa94-7ff1c4d4f513 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:20.038748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69e2d244-a1a7-4d0d-aa94-7ff1c4d4f513 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:20.039487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-69e2d244-a1a7-4d0d-aa94-7ff1c4d4f513 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:20.060854 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-69e2d244-a1a7-4d0d-aa94-7ff1c4d4f513 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] HTTP exception thrown: Instance 513ef1a7-095e-48c2-b818-53bb0e8dfd14 could not be found. Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-69e2d244-a1a7-4d0d-aa94-7ff1c4d4f513 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Request method failure captured: Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 HTTP/1.1 Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jISE2u8UCIWA2SUGKuHNA7SGeZgFVM_oNgVbEBuMJXvpjBe0VA-aMhM806HJXRfUfcJ5UIkxsXEig8LAeGlKtasgKQOC12b_SWQYaPArEcD4kBOaYLgs2Xske6hiKw27K5baPCaszy3G4a5etE7JgXvN-HXog3_4Gg3GA7TkvDJH9k Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 24e40dd3fdf64057b1d1a0b13827c553 Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 24e40dd3fdf64057b1d1a0b13827c553 Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestEncryptedCinderVolumes-2049131897-project Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ec18f372bcf145ccb8e59f89e8528601 Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestEncryptedCinderVolumes-2049131897-project Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 513ef1a7-095e-48c2-b818-53bb0e8dfd14 could not be found. Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '513ef1a7-095e-48c2-b818-53bb0e8dfd14'} Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 513ef1a7-095e-48c2-b818-53bb0e8dfd14 could not be found. Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 513ef1a7-095e-48c2-b818-53bb0e8dfd14 could not be found. Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:20.062925 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:36:20.071360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:20.071360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:20.071360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:36:20.071360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:36:20.071360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:36:20.071360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:36:20.071360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 513ef1a7-095e-48c2-b818-53bb0e8dfd14 could not be found. Aug 18 12:36:20.071360 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:20.071360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-69e2d244-a1a7-4d0d-aa94-7ff1c4d4f513 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Returning 404 to user: Instance 513ef1a7-095e-48c2-b818-53bb0e8dfd14 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:36:20.071360 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-69e2d244-a1a7-4d0d-aa94-7ff1c4d4f513 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14" status: 404 len: 111 microversion: 2.1 time: 0.048759 Aug 18 12:36:20.071360 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4285/6939] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:20 2022] GET /compute/v2.1/servers/513ef1a7-095e-48c2-b818-53bb0e8dfd14 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:36:20.077678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-16f3923e-a9fa-4bc5-8b19-23410e1f38e3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '.version_select at 0x7f519fb82550>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:20.103128 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-16f3923e-a9fa-4bc5-8b19-23410e1f38e3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-478989581" status: 202 len: 0 microversion: 2.1 time: 0.031081 Aug 18 12:36:20.103998 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4286/6940] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 12:36:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-478989581 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:36:20.127447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d0fc57f-93ca-492b-8201-30f29feb7244 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Action: 'create', calling method: .version_select at 0x7f519f01e160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-938649701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV7zZQuy5B88C+BjbnXCA9CMuewrCBfkXDG4Qvv+CpUMyIFD9wu+sGhvEzAN3yV0qnM9uIUpPwewjlHEgjHoevjp5KjDRKc5sYY8Cby0PfRXsYtT2GbNzSgvp19HTwI2Q=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:36:20.149313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-2d0fc57f-93ca-492b-8201-30f29feb7244 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Getting quotas for project 24e40dd3fdf64057b1d1a0b13827c553. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:36:20.157655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-2d0fc57f-93ca-492b-8201-30f29feb7244 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Getting quotas for user ec18f372bcf145ccb8e59f89e8528601 and project 24e40dd3fdf64057b1d1a0b13827c553. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:36:20.199953 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d0fc57f-93ca-492b-8201-30f29feb7244 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.077407 Aug 18 12:36:20.201130 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4287/6941] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:36:20 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:36:20.260056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-669131260", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-938649701", "networks": [{"uuid": "1ae58700-9b9d-41e3-86ed-442da94fbe38"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:36:20.323370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] validate_networks() for [('1ae58700-9b9d-41e3-86ed-442da94fbe38', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:36:20.801423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:36:20.801865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:36:20.802360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:36:20.802826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:36:20.803263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:36:20.813660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:20.814174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:20.814715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:20.815752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:20.816411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:20.816920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:20.837347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Getting quotas for project 24e40dd3fdf64057b1d1a0b13827c553. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:36:20.845103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Getting quotas for user ec18f372bcf145ccb8e59f89e8528601 and project 24e40dd3fdf64057b1d1a0b13827c553. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:36:20.862087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:36:20.864786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:36:20.917837 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-912d88ca-cbc3-421e-8908-0c8ee769a9e6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661812 Aug 18 12:36:20.919036 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4288/6942] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:36:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:36:20.932372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8bb0d066-a59e-4f06-b604-f757301b4e77 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:20.933201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8bb0d066-a59e-4f06-b604-f757301b4e77 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:21.021556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8bb0d066-a59e-4f06-b604-f757301b4e77 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:21.031092 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8bb0d066-a59e-4f06-b604-f757301b4e77 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2" status: 200 len: 1261 microversion: 2.1 time: 0.103376 Aug 18 12:36:21.032024 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4289/6943] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:20 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:36:22.071280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-078bbf13-b25e-40a8-a2e9-eb2a633c8f34 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:22.072435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-078bbf13-b25e-40a8-a2e9-eb2a633c8f34 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:22.087682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-078bbf13-b25e-40a8-a2e9-eb2a633c8f34 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:22.088614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-078bbf13-b25e-40a8-a2e9-eb2a633c8f34 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:22.089952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-078bbf13-b25e-40a8-a2e9-eb2a633c8f34 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:22.090828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-078bbf13-b25e-40a8-a2e9-eb2a633c8f34 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:22.092838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-078bbf13-b25e-40a8-a2e9-eb2a633c8f34 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:22.093655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-078bbf13-b25e-40a8-a2e9-eb2a633c8f34 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:22.218866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-078bbf13-b25e-40a8-a2e9-eb2a633c8f34 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:22.222943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:36:22.229443 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-078bbf13-b25e-40a8-a2e9-eb2a633c8f34 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2" status: 200 len: 1313 microversion: 2.1 time: 0.165712 Aug 18 12:36:22.242467 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4290/6944] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:22 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:36:23.270729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c62a2da0-79f8-4e50-8819-53193431c6a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:23.271817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c62a2da0-79f8-4e50-8819-53193431c6a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:23.290498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c62a2da0-79f8-4e50-8819-53193431c6a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:23.291400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c62a2da0-79f8-4e50-8819-53193431c6a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:23.292508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c62a2da0-79f8-4e50-8819-53193431c6a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:23.294129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c62a2da0-79f8-4e50-8819-53193431c6a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:23.295063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c62a2da0-79f8-4e50-8819-53193431c6a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:23.295950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c62a2da0-79f8-4e50-8819-53193431c6a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:23.617594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c62a2da0-79f8-4e50-8819-53193431c6a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:23.627022 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c62a2da0-79f8-4e50-8819-53193431c6a2 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2" status: 200 len: 1361 microversion: 2.1 time: 0.362035 Aug 18 12:36:23.627689 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4291/6945] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:23 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 => generated 1361 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:36:24.004443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-6db0b8be-250e-45df-947e-13661325bf7c req-759db46f-11f3-40a3-973a-2ebd75f9d5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9018b369-5d1c-4f75-94ba-37c406171bb2", "tag": "62ac07ce-0af6-45e9-8ca3-9acd2d6d7725"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:36:24.023571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6db0b8be-250e-45df-947e-13661325bf7c req-759db46f-11f3-40a3-973a-2ebd75f9d5e1 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:24.024539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6db0b8be-250e-45df-947e-13661325bf7c req-759db46f-11f3-40a3-973a-2ebd75f9d5e1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:24.025099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6db0b8be-250e-45df-947e-13661325bf7c req-759db46f-11f3-40a3-973a-2ebd75f9d5e1 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:24.047136 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6db0b8be-250e-45df-947e-13661325bf7c req-759db46f-11f3-40a3-973a-2ebd75f9d5e1 service nova] Creating event network-changed:62ac07ce-0af6-45e9-8ca3-9acd2d6d7725 for instance 9018b369-5d1c-4f75-94ba-37c406171bb2 on n-h2-853611-3 Aug 18 12:36:24.054038 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-6db0b8be-250e-45df-947e-13661325bf7c req-759db46f-11f3-40a3-973a-2ebd75f9d5e1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053427 Aug 18 12:36:24.054930 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4292/6946] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:36:24.650653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8199a52b-8e95-45ed-bb70-1d7fb7ff1831 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:24.651420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8199a52b-8e95-45ed-bb70-1d7fb7ff1831 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:24.659129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8199a52b-8e95-45ed-bb70-1d7fb7ff1831 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:24.659779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8199a52b-8e95-45ed-bb70-1d7fb7ff1831 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:24.660352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8199a52b-8e95-45ed-bb70-1d7fb7ff1831 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:24.661162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8199a52b-8e95-45ed-bb70-1d7fb7ff1831 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:24.661724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8199a52b-8e95-45ed-bb70-1d7fb7ff1831 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:24.662290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8199a52b-8e95-45ed-bb70-1d7fb7ff1831 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:24.822813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8199a52b-8e95-45ed-bb70-1d7fb7ff1831 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:24.832375 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8199a52b-8e95-45ed-bb70-1d7fb7ff1831 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2" status: 200 len: 1361 microversion: 2.1 time: 0.186909 Aug 18 12:36:24.833149 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4293/6947] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:24 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:36:25.855432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b84cd1d7-7f51-4029-af02-cf2596311407 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:25.856462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b84cd1d7-7f51-4029-af02-cf2596311407 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:25.865732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b84cd1d7-7f51-4029-af02-cf2596311407 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:25.866254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b84cd1d7-7f51-4029-af02-cf2596311407 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:25.866764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b84cd1d7-7f51-4029-af02-cf2596311407 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:25.867561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b84cd1d7-7f51-4029-af02-cf2596311407 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:25.868044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b84cd1d7-7f51-4029-af02-cf2596311407 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:25.868502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b84cd1d7-7f51-4029-af02-cf2596311407 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:26.028442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b84cd1d7-7f51-4029-af02-cf2596311407 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:26.042049 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b84cd1d7-7f51-4029-af02-cf2596311407 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2" status: 200 len: 1361 microversion: 2.1 time: 0.190146 Aug 18 12:36:26.043320 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4294/6948] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:25 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:36:27.067313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6eb3e43-d293-4446-9d51-382e75b6e531 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:27.068213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c6eb3e43-d293-4446-9d51-382e75b6e531 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:27.076441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6eb3e43-d293-4446-9d51-382e75b6e531 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:27.077050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6eb3e43-d293-4446-9d51-382e75b6e531 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:27.077518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6eb3e43-d293-4446-9d51-382e75b6e531 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:27.078274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6eb3e43-d293-4446-9d51-382e75b6e531 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:27.078779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6eb3e43-d293-4446-9d51-382e75b6e531 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:27.079211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6eb3e43-d293-4446-9d51-382e75b6e531 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:27.251162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c6eb3e43-d293-4446-9d51-382e75b6e531 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:27.260004 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c6eb3e43-d293-4446-9d51-382e75b6e531 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2" status: 200 len: 1361 microversion: 2.1 time: 0.196613 Aug 18 12:36:27.260734 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4295/6949] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:27 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:36:28.285634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3a4ae116-1bfe-44f7-8706-e457c165383e tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:28.286767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3a4ae116-1bfe-44f7-8706-e457c165383e tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:28.294879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a4ae116-1bfe-44f7-8706-e457c165383e tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:28.295392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a4ae116-1bfe-44f7-8706-e457c165383e tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:28.295900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a4ae116-1bfe-44f7-8706-e457c165383e tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:28.296742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a4ae116-1bfe-44f7-8706-e457c165383e tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:28.297241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a4ae116-1bfe-44f7-8706-e457c165383e tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:28.297701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3a4ae116-1bfe-44f7-8706-e457c165383e tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:28.517852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3a4ae116-1bfe-44f7-8706-e457c165383e tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:28.525961 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3a4ae116-1bfe-44f7-8706-e457c165383e tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2" status: 200 len: 1361 microversion: 2.1 time: 0.244546 Aug 18 12:36:28.526594 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4296/6950] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:28 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:36:28.532133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8ac704af-94e6-4f4a-96db-3dc421f3ff98 req-8046c01f-7641-4d02-ab23-d3dac6a8edd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9018b369-5d1c-4f75-94ba-37c406171bb2", "name": "network-vif-plugged", "status": "completed", "tag": "62ac07ce-0af6-45e9-8ca3-9acd2d6d7725"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:36:28.542972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8ac704af-94e6-4f4a-96db-3dc421f3ff98 req-8046c01f-7641-4d02-ab23-d3dac6a8edd8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:28.543701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8ac704af-94e6-4f4a-96db-3dc421f3ff98 req-8046c01f-7641-4d02-ab23-d3dac6a8edd8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:28.545314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8ac704af-94e6-4f4a-96db-3dc421f3ff98 req-8046c01f-7641-4d02-ab23-d3dac6a8edd8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:28.558810 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8ac704af-94e6-4f4a-96db-3dc421f3ff98 req-8046c01f-7641-4d02-ab23-d3dac6a8edd8 service nova] Creating event network-vif-plugged:62ac07ce-0af6-45e9-8ca3-9acd2d6d7725 for instance 9018b369-5d1c-4f75-94ba-37c406171bb2 on n-h2-853611-3 Aug 18 12:36:28.565681 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8ac704af-94e6-4f4a-96db-3dc421f3ff98 req-8046c01f-7641-4d02-ab23-d3dac6a8edd8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037828 Aug 18 12:36:28.566333 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4297/6951] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:36:29.563040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e64a8df-d51e-4a14-970b-f382a69101a7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:29.563947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e64a8df-d51e-4a14-970b-f382a69101a7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:29.571164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e64a8df-d51e-4a14-970b-f382a69101a7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:29.571683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e64a8df-d51e-4a14-970b-f382a69101a7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:29.572147 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e64a8df-d51e-4a14-970b-f382a69101a7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:29.572903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e64a8df-d51e-4a14-970b-f382a69101a7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:29.573380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e64a8df-d51e-4a14-970b-f382a69101a7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:29.573855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e64a8df-d51e-4a14-970b-f382a69101a7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:29.755370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e64a8df-d51e-4a14-970b-f382a69101a7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:29.764497 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e64a8df-d51e-4a14-970b-f382a69101a7 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2" status: 200 len: 1361 microversion: 2.1 time: 0.207228 Aug 18 12:36:29.765193 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4298/6952] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:29 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:36:30.790530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4361adb7-1f75-40c9-ae56-d722459c840c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:30.791653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4361adb7-1f75-40c9-ae56-d722459c840c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:30.801137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4361adb7-1f75-40c9-ae56-d722459c840c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:30.801804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4361adb7-1f75-40c9-ae56-d722459c840c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:30.802528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4361adb7-1f75-40c9-ae56-d722459c840c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:30.803446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4361adb7-1f75-40c9-ae56-d722459c840c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:30.804085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4361adb7-1f75-40c9-ae56-d722459c840c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:30.804638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4361adb7-1f75-40c9-ae56-d722459c840c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:30.836139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:36:31.008805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4361adb7-1f75-40c9-ae56-d722459c840c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:31.021697 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4361adb7-1f75-40c9-ae56-d722459c840c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2" status: 200 len: 1553 microversion: 2.1 time: 0.235536 Aug 18 12:36:31.022809 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4299/6953] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:30 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 => generated 1553 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:36:31.058452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-005f977e-d3c1-43ac-989f-9e94908d942a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:31.060241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-005f977e-d3c1-43ac-989f-9e94908d942a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:31.063239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:36:31.073465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-005f977e-d3c1-43ac-989f-9e94908d942a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:31.074269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-005f977e-d3c1-43ac-989f-9e94908d942a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:31.074962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-005f977e-d3c1-43ac-989f-9e94908d942a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:31.077349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-005f977e-d3c1-43ac-989f-9e94908d942a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:31.077967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-005f977e-d3c1-43ac-989f-9e94908d942a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:31.078587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-005f977e-d3c1-43ac-989f-9e94908d942a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:31.282134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-005f977e-d3c1-43ac-989f-9e94908d942a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:31.296798 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-005f977e-d3c1-43ac-989f-9e94908d942a tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2" status: 200 len: 1553 microversion: 2.1 time: 0.244869 Aug 18 12:36:31.297919 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4300/6954] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:31 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 => generated 1553 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:36:32.975033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c26b4811-1e79-4ae5-9a09-f4fe4769dfb9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aedd2c97-3109-462b-81bd-24e3047ad836"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:36:32.977478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c26b4811-1e79-4ae5-9a09-f4fe4769dfb9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:32.986805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c26b4811-1e79-4ae5-9a09-f4fe4769dfb9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:32.987332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c26b4811-1e79-4ae5-9a09-f4fe4769dfb9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:32.987802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c26b4811-1e79-4ae5-9a09-f4fe4769dfb9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:32.988559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c26b4811-1e79-4ae5-9a09-f4fe4769dfb9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:32.989049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c26b4811-1e79-4ae5-9a09-f4fe4769dfb9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:32.989498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c26b4811-1e79-4ae5-9a09-f4fe4769dfb9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:33.324554 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c26b4811-1e79-4ae5-9a09-f4fe4769dfb9 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "POST /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353823 Aug 18 12:36:33.325517 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4301/6955] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 12:36:32 2022] POST /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:36:38.821959 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:36:38.823000 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:36:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:36:45.384237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:36:45.385261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:36:45.392493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f6c3dfff-8b80-4a48-9a84-2bc14b2759b8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:45.393615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f6c3dfff-8b80-4a48-9a84-2bc14b2759b8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:45.408378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6c3dfff-8b80-4a48-9a84-2bc14b2759b8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:45.409075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6c3dfff-8b80-4a48-9a84-2bc14b2759b8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:45.409541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6c3dfff-8b80-4a48-9a84-2bc14b2759b8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:45.410295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6c3dfff-8b80-4a48-9a84-2bc14b2759b8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:45.410812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6c3dfff-8b80-4a48-9a84-2bc14b2759b8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:45.411303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6c3dfff-8b80-4a48-9a84-2bc14b2759b8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:45.543065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-f6c3dfff-8b80-4a48-9a84-2bc14b2759b8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lazy-loading 'services' on Instance uuid 9018b369-5d1c-4f75-94ba-37c406171bb2 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:36:45.633399 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f6c3dfff-8b80-4a48-9a84-2bc14b2759b8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "DELETE /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments/aedd2c97-3109-462b-81bd-24e3047ad836" status: 202 len: 0 microversion: 2.1 time: 0.251363 Aug 18 12:36:45.634095 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4302/6956] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 12:36:45 2022] DELETE /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments/aedd2c97-3109-462b-81bd-24e3047ad836 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:36:45.645095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9af97f87-9b6c-4fb2-ab2d-3300653a294c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:45.648250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9af97f87-9b6c-4fb2-ab2d-3300653a294c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:45.656596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af97f87-9b6c-4fb2-ab2d-3300653a294c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:45.657282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af97f87-9b6c-4fb2-ab2d-3300653a294c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:45.657945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af97f87-9b6c-4fb2-ab2d-3300653a294c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:45.659132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af97f87-9b6c-4fb2-ab2d-3300653a294c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:45.659715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af97f87-9b6c-4fb2-ab2d-3300653a294c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:45.660302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9af97f87-9b6c-4fb2-ab2d-3300653a294c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:45.707189 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9af97f87-9b6c-4fb2-ab2d-3300653a294c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067453 Aug 18 12:36:45.707803 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4303/6957] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:36:45 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:36:46.728315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b8d5996-37f2-464b-9ad4-249fc629942b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:46.732353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1b8d5996-37f2-464b-9ad4-249fc629942b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:46.744221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b8d5996-37f2-464b-9ad4-249fc629942b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:46.744898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b8d5996-37f2-464b-9ad4-249fc629942b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:46.745481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b8d5996-37f2-464b-9ad4-249fc629942b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:46.746359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b8d5996-37f2-464b-9ad4-249fc629942b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:46.746998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b8d5996-37f2-464b-9ad4-249fc629942b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:46.747645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b8d5996-37f2-464b-9ad4-249fc629942b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:46.787844 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1b8d5996-37f2-464b-9ad4-249fc629942b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067002 Aug 18 12:36:46.788764 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4304/6958] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:36:46 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:36:47.802680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f5a5702e-324e-4c83-9b19-7b88be29003f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:47.805994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f5a5702e-324e-4c83-9b19-7b88be29003f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:47.815786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5a5702e-324e-4c83-9b19-7b88be29003f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:47.816453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5a5702e-324e-4c83-9b19-7b88be29003f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:47.817052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5a5702e-324e-4c83-9b19-7b88be29003f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:47.817914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5a5702e-324e-4c83-9b19-7b88be29003f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:47.818482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5a5702e-324e-4c83-9b19-7b88be29003f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:47.819259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f5a5702e-324e-4c83-9b19-7b88be29003f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:47.859503 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f5a5702e-324e-4c83-9b19-7b88be29003f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061650 Aug 18 12:36:47.860547 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4305/6959] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:36:47 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:36:48.874145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d677ac00-627c-4546-b5f4-e37f27f22f2f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:48.877327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d677ac00-627c-4546-b5f4-e37f27f22f2f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:48.885825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d677ac00-627c-4546-b5f4-e37f27f22f2f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:48.886514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d677ac00-627c-4546-b5f4-e37f27f22f2f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:48.887086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d677ac00-627c-4546-b5f4-e37f27f22f2f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:48.888595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d677ac00-627c-4546-b5f4-e37f27f22f2f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:48.889753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d677ac00-627c-4546-b5f4-e37f27f22f2f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:48.889753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d677ac00-627c-4546-b5f4-e37f27f22f2f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:48.927853 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d677ac00-627c-4546-b5f4-e37f27f22f2f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058929 Aug 18 12:36:48.930319 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4306/6960] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:36:48 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:36:49.946114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-96ce300b-009e-4442-abf8-12e65ebcbf46 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:49.949695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-96ce300b-009e-4442-abf8-12e65ebcbf46 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:49.961129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96ce300b-009e-4442-abf8-12e65ebcbf46 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:49.961962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96ce300b-009e-4442-abf8-12e65ebcbf46 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:49.962754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96ce300b-009e-4442-abf8-12e65ebcbf46 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:49.963984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96ce300b-009e-4442-abf8-12e65ebcbf46 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:49.964618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96ce300b-009e-4442-abf8-12e65ebcbf46 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:49.965258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96ce300b-009e-4442-abf8-12e65ebcbf46 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:50.020136 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-96ce300b-009e-4442-abf8-12e65ebcbf46 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079536 Aug 18 12:36:50.021316 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4307/6961] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:36:49 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:36:51.039033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e2a7aec2-1f1f-45ef-b8a3-a12ad0971a4f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:51.042415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e2a7aec2-1f1f-45ef-b8a3-a12ad0971a4f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:51.052293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2a7aec2-1f1f-45ef-b8a3-a12ad0971a4f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:51.053004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2a7aec2-1f1f-45ef-b8a3-a12ad0971a4f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:51.053617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2a7aec2-1f1f-45ef-b8a3-a12ad0971a4f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:51.054719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2a7aec2-1f1f-45ef-b8a3-a12ad0971a4f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:51.055387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2a7aec2-1f1f-45ef-b8a3-a12ad0971a4f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:51.056028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e2a7aec2-1f1f-45ef-b8a3-a12ad0971a4f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:51.108871 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e2a7aec2-1f1f-45ef-b8a3-a12ad0971a4f tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075746 Aug 18 12:36:51.109712 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4308/6962] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:36:51 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:36:52.123226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-526d6fe9-3941-42f8-a010-f7f6161a9c6d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:52.125809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-526d6fe9-3941-42f8-a010-f7f6161a9c6d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:52.134235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-526d6fe9-3941-42f8-a010-f7f6161a9c6d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:52.134850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-526d6fe9-3941-42f8-a010-f7f6161a9c6d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:52.135348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-526d6fe9-3941-42f8-a010-f7f6161a9c6d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:52.136146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-526d6fe9-3941-42f8-a010-f7f6161a9c6d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:52.136828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-526d6fe9-3941-42f8-a010-f7f6161a9c6d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:52.137347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-526d6fe9-3941-42f8-a010-f7f6161a9c6d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:52.172740 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-526d6fe9-3941-42f8-a010-f7f6161a9c6d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054542 Aug 18 12:36:52.173349 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4309/6963] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:36:52 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 12:36:52.185499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8985dcda-6a6b-435a-a3ca-a2d786807ba1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:52.186011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8985dcda-6a6b-435a-a3ca-a2d786807ba1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:52.194912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8985dcda-6a6b-435a-a3ca-a2d786807ba1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:52.195505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8985dcda-6a6b-435a-a3ca-a2d786807ba1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:52.196001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8985dcda-6a6b-435a-a3ca-a2d786807ba1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:52.196833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8985dcda-6a6b-435a-a3ca-a2d786807ba1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:52.197420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8985dcda-6a6b-435a-a3ca-a2d786807ba1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:52.197906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8985dcda-6a6b-435a-a3ca-a2d786807ba1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:52.296951 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-8985dcda-6a6b-435a-a3ca-a2d786807ba1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] HTTP exception thrown: Instance 9018b369-5d1c-4f75-94ba-37c406171bb2 is not attached to volume aedd2c97-3109-462b-81bd-24e3047ad836 Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8985dcda-6a6b-435a-a3ca-a2d786807ba1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Request method failure captured: Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments/aedd2c97-3109-462b-81bd-24e3047ad836 HTTP/1.1 Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jISE2u8UCIWA2SUGKuHNA7SGeZgFVM_oNgVbEBuMJXvpjBe0VA-aMhM806HJXRfUfcJ5UIkxsXEig8LAeGlKtasgKQOC12b_SWQYaPArEcD4kBOaYLgs2Xske6hiKw27K5baPCaszy3G4a5etE7JgXvN-HXog3_4Gg3GA7TkvDJH9k Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 24e40dd3fdf64057b1d1a0b13827c553 Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 24e40dd3fdf64057b1d1a0b13827c553 Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestEncryptedCinderVolumes-2049131897-project Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ec18f372bcf145ccb8e59f89e8528601 Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestEncryptedCinderVolumes-2049131897-project Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 9018b369-5d1c-4f75-94ba-37c406171bb2 is not attached to volume aedd2c97-3109-462b-81bd-24e3047ad836 Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': '9018b369-5d1c-4f75-94ba-37c406171bb2', 'id': 'aedd2c97-3109-462b-81bd-24e3047ad836'} Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id aedd2c97-3109-462b-81bd-24e3047ad836. Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9018b369-5d1c-4f75-94ba-37c406171bb2 is not attached to volume aedd2c97-3109-462b-81bd-24e3047ad836 Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:36:52.300317 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:36:52.308358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:36:52.308358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:36:52.308358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9018b369-5d1c-4f75-94ba-37c406171bb2 is not attached to volume aedd2c97-3109-462b-81bd-24e3047ad836 Aug 18 12:36:52.308358 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:52.308358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8985dcda-6a6b-435a-a3ca-a2d786807ba1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Returning 404 to user: Instance 9018b369-5d1c-4f75-94ba-37c406171bb2 is not attached to volume aedd2c97-3109-462b-81bd-24e3047ad836 {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:36:52.308358 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8985dcda-6a6b-435a-a3ca-a2d786807ba1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "DELETE /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments/aedd2c97-3109-462b-81bd-24e3047ad836" status: 404 len: 154 microversion: 2.1 time: 0.122103 Aug 18 12:36:52.308358 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4310/6964] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 12:36:52 2022] DELETE /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2/os-volume_attachments/aedd2c97-3109-462b-81bd-24e3047ad836 => generated 154 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:36:56.847900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f331178-e46d-46cd-9202-0e247a4df849 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:56.848768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f331178-e46d-46cd-9202-0e247a4df849 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:56.861941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f331178-e46d-46cd-9202-0e247a4df849 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:56.862879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f331178-e46d-46cd-9202-0e247a4df849 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:56.863719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f331178-e46d-46cd-9202-0e247a4df849 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:56.865075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f331178-e46d-46cd-9202-0e247a4df849 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:56.866060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f331178-e46d-46cd-9202-0e247a4df849 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:56.866857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f331178-e46d-46cd-9202-0e247a4df849 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:56.905405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f331178-e46d-46cd-9202-0e247a4df849 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:36:57.021679 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f331178-e46d-46cd-9202-0e247a4df849 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "DELETE /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2" status: 204 len: 0 microversion: 2.1 time: 0.182066 Aug 18 12:36:57.022802 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4311/6965] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:36:56 2022] DELETE /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:36:57.033264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ced306f3-83d4-4600-98cd-9470d7069035 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:57.034009 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ced306f3-83d4-4600-98cd-9470d7069035 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:57.040662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ced306f3-83d4-4600-98cd-9470d7069035 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:57.041172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ced306f3-83d4-4600-98cd-9470d7069035 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:57.041637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ced306f3-83d4-4600-98cd-9470d7069035 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:57.042381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ced306f3-83d4-4600-98cd-9470d7069035 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:57.042901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ced306f3-83d4-4600-98cd-9470d7069035 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:57.043444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ced306f3-83d4-4600-98cd-9470d7069035 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:57.590710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ced306f3-83d4-4600-98cd-9470d7069035 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:57.599792 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ced306f3-83d4-4600-98cd-9470d7069035 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2" status: 200 len: 1559 microversion: 2.1 time: 0.571728 Aug 18 12:36:57.600407 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4312/6966] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:57 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 => generated 1559 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:36:58.638042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0706b957-7a53-472a-b23c-fd2e854ca9d5 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:58.639190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0706b957-7a53-472a-b23c-fd2e854ca9d5 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:58.648401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0706b957-7a53-472a-b23c-fd2e854ca9d5 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:58.648927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0706b957-7a53-472a-b23c-fd2e854ca9d5 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:58.649452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0706b957-7a53-472a-b23c-fd2e854ca9d5 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:58.650383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0706b957-7a53-472a-b23c-fd2e854ca9d5 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:58.651033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0706b957-7a53-472a-b23c-fd2e854ca9d5 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:58.651543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0706b957-7a53-472a-b23c-fd2e854ca9d5 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:58.920461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0706b957-7a53-472a-b23c-fd2e854ca9d5 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:36:58.932790 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0706b957-7a53-472a-b23c-fd2e854ca9d5 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2" status: 200 len: 1559 microversion: 2.1 time: 0.298809 Aug 18 12:36:58.934095 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4313/6967] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:58 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 => generated 1559 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:36:59.231379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c2b4ad0c-9a22-4b83-aa2b-3f80524394dc req-2b0e5eae-d0d3-410c-bdcf-8e7ac9369a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9018b369-5d1c-4f75-94ba-37c406171bb2", "name": "network-vif-deleted", "tag": "62ac07ce-0af6-45e9-8ca3-9acd2d6d7725"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:36:59.242391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c2b4ad0c-9a22-4b83-aa2b-3f80524394dc req-2b0e5eae-d0d3-410c-bdcf-8e7ac9369a9b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:59.242918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c2b4ad0c-9a22-4b83-aa2b-3f80524394dc req-2b0e5eae-d0d3-410c-bdcf-8e7ac9369a9b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:59.243460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c2b4ad0c-9a22-4b83-aa2b-3f80524394dc req-2b0e5eae-d0d3-410c-bdcf-8e7ac9369a9b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:59.260121 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c2b4ad0c-9a22-4b83-aa2b-3f80524394dc req-2b0e5eae-d0d3-410c-bdcf-8e7ac9369a9b service nova] Creating event network-vif-deleted:62ac07ce-0af6-45e9-8ca3-9acd2d6d7725 for instance 9018b369-5d1c-4f75-94ba-37c406171bb2 on n-h2-853611-3 Aug 18 12:36:59.266092 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c2b4ad0c-9a22-4b83-aa2b-3f80524394dc req-2b0e5eae-d0d3-410c-bdcf-8e7ac9369a9b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038681 Aug 18 12:36:59.266766 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4314/6968] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:36:59.961515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9fdc169-b077-4dbc-b245-a0004dddc708 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:36:59.962348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c9fdc169-b077-4dbc-b245-a0004dddc708 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 9018b369-5d1c-4f75-94ba-37c406171bb2] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:36:59.969951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9fdc169-b077-4dbc-b245-a0004dddc708 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:59.970640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9fdc169-b077-4dbc-b245-a0004dddc708 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:59.971132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9fdc169-b077-4dbc-b245-a0004dddc708 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:59.972019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9fdc169-b077-4dbc-b245-a0004dddc708 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:36:59.972496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9fdc169-b077-4dbc-b245-a0004dddc708 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:36:59.972938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9fdc169-b077-4dbc-b245-a0004dddc708 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:36:59.988757 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-c9fdc169-b077-4dbc-b245-a0004dddc708 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] HTTP exception thrown: Instance 9018b369-5d1c-4f75-94ba-37c406171bb2 could not be found. Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9fdc169-b077-4dbc-b245-a0004dddc708 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Request method failure captured: Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 HTTP/1.1 Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jISE2u8UCIWA2SUGKuHNA7SGeZgFVM_oNgVbEBuMJXvpjBe0VA-aMhM806HJXRfUfcJ5UIkxsXEig8LAeGlKtasgKQOC12b_SWQYaPArEcD4kBOaYLgs2Xske6hiKw27K5baPCaszy3G4a5etE7JgXvN-HXog3_4Gg3GA7TkvDJH9k Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 24e40dd3fdf64057b1d1a0b13827c553 Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 24e40dd3fdf64057b1d1a0b13827c553 Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestEncryptedCinderVolumes-2049131897-project Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ec18f372bcf145ccb8e59f89e8528601 Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestEncryptedCinderVolumes-2049131897-project Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 9018b369-5d1c-4f75-94ba-37c406171bb2 could not be found. Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '9018b369-5d1c-4f75-94ba-37c406171bb2'} Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9018b369-5d1c-4f75-94ba-37c406171bb2 could not be found. Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9018b369-5d1c-4f75-94ba-37c406171bb2 could not be found. Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:59.990544 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:36:59.995612 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:59.995612 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:36:59.995612 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:36:59.995612 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:36:59.995612 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:36:59.995612 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:36:59.995612 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9018b369-5d1c-4f75-94ba-37c406171bb2 could not be found. Aug 18 12:36:59.995612 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:36:59.995612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9fdc169-b077-4dbc-b245-a0004dddc708 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Returning 404 to user: Instance 9018b369-5d1c-4f75-94ba-37c406171bb2 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:36:59.995612 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c9fdc169-b077-4dbc-b245-a0004dddc708 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2" status: 404 len: 111 microversion: 2.1 time: 0.036006 Aug 18 12:36:59.995612 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4315/6969] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:36:59 2022] GET /compute/v2.1/servers/9018b369-5d1c-4f75-94ba-37c406171bb2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:37:00.004595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3229c379-960e-406c-ac86-da5bcc7a63a8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '.version_select at 0x7f519efe0820>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:00.027568 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3229c379-960e-406c-ac86-da5bcc7a63a8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-938649701" status: 202 len: 0 microversion: 2.1 time: 0.026863 Aug 18 12:37:00.028159 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4316/6970] 10.222.0.73 () {58 vars in 1275 bytes} [Thu Aug 18 12:36:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-938649701 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:37:00.054732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-84fab5b8-d4a6-405d-ac42-38c3cf0f96f8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Action: 'create', calling method: .version_select at 0x7f519f0124c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1186167044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6OoSIJA7A9TVlRqufd3zMdi6wlW+7gM4OnOxdzHxjrAih1jby+tDoRJTX7f2QvBc6AhVdhRVSrYQs5TipqP+H5HOCEYi7Zc2HLrdq8aavvPGoGqYxGDu0fm7NYpoMF5w=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:37:00.073426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-84fab5b8-d4a6-405d-ac42-38c3cf0f96f8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Getting quotas for project 24e40dd3fdf64057b1d1a0b13827c553. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:37:00.079912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-84fab5b8-d4a6-405d-ac42-38c3cf0f96f8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Getting quotas for user ec18f372bcf145ccb8e59f89e8528601 and project 24e40dd3fdf64057b1d1a0b13827c553. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:37:00.107166 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-84fab5b8-d4a6-405d-ac42-38c3cf0f96f8 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.056365 Aug 18 12:37:00.108285 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4317/6971] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:37:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:37:00.166657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1641754868", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1186167044", "networks": [{"uuid": "1ae58700-9b9d-41e3-86ed-442da94fbe38"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:37:00.232120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] validate_networks() for [('1ae58700-9b9d-41e3-86ed-442da94fbe38', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:37:00.691210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:37:00.691821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:37:00.692431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:37:00.692969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:37:00.693505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:37:00.705241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:00.705786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:00.706214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:00.707017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:00.707497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:00.707951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:00.728920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Getting quotas for project 24e40dd3fdf64057b1d1a0b13827c553. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:37:00.735586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Getting quotas for user ec18f372bcf145ccb8e59f89e8528601 and project 24e40dd3fdf64057b1d1a0b13827c553. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:37:00.751086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:37:00.753569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:37:00.804769 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-89a53fe8-61d7-4677-8e86-9c75740a2acf tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643598 Aug 18 12:37:00.805450 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4318/6972] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:37:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:37:00.825985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9d37f05-5963-4508-9e57-bad46bd2dcc3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:00.827159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c9d37f05-5963-4508-9e57-bad46bd2dcc3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:00.887209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c9d37f05-5963-4508-9e57-bad46bd2dcc3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:37:00.895428 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c9d37f05-5963-4508-9e57-bad46bd2dcc3 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 200 len: 1263 microversion: 2.1 time: 0.077631 Aug 18 12:37:00.896173 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4319/6973] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:37:00 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 1263 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:37:01.924026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1af19eb1-a63f-4c2d-9ff3-acfc87d0bb8d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:01.925101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1af19eb1-a63f-4c2d-9ff3-acfc87d0bb8d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:01.939150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1af19eb1-a63f-4c2d-9ff3-acfc87d0bb8d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:01.940014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1af19eb1-a63f-4c2d-9ff3-acfc87d0bb8d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:01.940752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1af19eb1-a63f-4c2d-9ff3-acfc87d0bb8d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:01.942130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1af19eb1-a63f-4c2d-9ff3-acfc87d0bb8d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:01.944152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1af19eb1-a63f-4c2d-9ff3-acfc87d0bb8d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:01.944960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1af19eb1-a63f-4c2d-9ff3-acfc87d0bb8d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:02.105172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1af19eb1-a63f-4c2d-9ff3-acfc87d0bb8d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:37:02.122148 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1af19eb1-a63f-4c2d-9ff3-acfc87d0bb8d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 200 len: 1323 microversion: 2.1 time: 0.206930 Aug 18 12:37:02.127327 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4320/6974] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:37:01 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 1323 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:37:03.147234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-283b511e-9070-4e32-82d4-cefc262960d6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:03.148038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-283b511e-9070-4e32-82d4-cefc262960d6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:03.156261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-283b511e-9070-4e32-82d4-cefc262960d6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:03.156875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-283b511e-9070-4e32-82d4-cefc262960d6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:03.157419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-283b511e-9070-4e32-82d4-cefc262960d6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:03.158188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-283b511e-9070-4e32-82d4-cefc262960d6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:03.158700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-283b511e-9070-4e32-82d4-cefc262960d6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:03.159155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-283b511e-9070-4e32-82d4-cefc262960d6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:03.164083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:37:03.458371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-283b511e-9070-4e32-82d4-cefc262960d6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:37:03.471501 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-283b511e-9070-4e32-82d4-cefc262960d6 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 200 len: 1363 microversion: 2.1 time: 0.328240 Aug 18 12:37:03.472314 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4321/6975] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:37:03 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:37:03.835187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-46ac43aa-ccd3-4f9b-b024-d66d974019ca req-42881908-595e-4969-9d67-7b3003ffe40f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c8c961-ab60-406a-a634-0fefec184f8e", "tag": "171a0c57-d7b9-444d-9d51-2f13c54fa464"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:37:03.859661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-46ac43aa-ccd3-4f9b-b024-d66d974019ca req-42881908-595e-4969-9d67-7b3003ffe40f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:03.861046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-46ac43aa-ccd3-4f9b-b024-d66d974019ca req-42881908-595e-4969-9d67-7b3003ffe40f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:03.861884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-46ac43aa-ccd3-4f9b-b024-d66d974019ca req-42881908-595e-4969-9d67-7b3003ffe40f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:03.885244 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-46ac43aa-ccd3-4f9b-b024-d66d974019ca req-42881908-595e-4969-9d67-7b3003ffe40f service nova] Creating event network-changed:171a0c57-d7b9-444d-9d51-2f13c54fa464 for instance 19c8c961-ab60-406a-a634-0fefec184f8e on n-h2-853611-3 Aug 18 12:37:03.895293 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-46ac43aa-ccd3-4f9b-b024-d66d974019ca req-42881908-595e-4969-9d67-7b3003ffe40f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067329 Aug 18 12:37:03.898034 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4322/6976] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:37:04.503114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0a08d80c-6dec-4e04-8dee-d44e4189821b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:04.504412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0a08d80c-6dec-4e04-8dee-d44e4189821b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:04.516337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a08d80c-6dec-4e04-8dee-d44e4189821b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:04.517262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a08d80c-6dec-4e04-8dee-d44e4189821b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:04.518069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a08d80c-6dec-4e04-8dee-d44e4189821b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:04.519376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a08d80c-6dec-4e04-8dee-d44e4189821b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:04.520205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a08d80c-6dec-4e04-8dee-d44e4189821b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:04.521007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0a08d80c-6dec-4e04-8dee-d44e4189821b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:04.709918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0a08d80c-6dec-4e04-8dee-d44e4189821b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:37:04.719720 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0a08d80c-6dec-4e04-8dee-d44e4189821b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 200 len: 1363 microversion: 2.1 time: 0.226501 Aug 18 12:37:04.720511 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4323/6977] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:37:04 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:37:05.742167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4833df4d-2583-4d31-acf8-d2560fe8c62d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:05.743260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4833df4d-2583-4d31-acf8-d2560fe8c62d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:05.751239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4833df4d-2583-4d31-acf8-d2560fe8c62d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:05.751857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4833df4d-2583-4d31-acf8-d2560fe8c62d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:05.752399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4833df4d-2583-4d31-acf8-d2560fe8c62d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:05.753250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4833df4d-2583-4d31-acf8-d2560fe8c62d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:05.753798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4833df4d-2583-4d31-acf8-d2560fe8c62d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:05.754321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4833df4d-2583-4d31-acf8-d2560fe8c62d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:05.942884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4833df4d-2583-4d31-acf8-d2560fe8c62d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:37:05.953814 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4833df4d-2583-4d31-acf8-d2560fe8c62d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 200 len: 1363 microversion: 2.1 time: 0.215896 Aug 18 12:37:05.954473 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4324/6978] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:37:05 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:37:06.976722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4aacc03b-4a0b-4136-ba58-8bfc80723210 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:06.977548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4aacc03b-4a0b-4136-ba58-8bfc80723210 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:06.987142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aacc03b-4a0b-4136-ba58-8bfc80723210 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:06.987653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aacc03b-4a0b-4136-ba58-8bfc80723210 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:06.988108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aacc03b-4a0b-4136-ba58-8bfc80723210 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:06.988997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aacc03b-4a0b-4136-ba58-8bfc80723210 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:06.989628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aacc03b-4a0b-4136-ba58-8bfc80723210 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:06.990088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aacc03b-4a0b-4136-ba58-8bfc80723210 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:07.144150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4aacc03b-4a0b-4136-ba58-8bfc80723210 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:37:07.152428 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4aacc03b-4a0b-4136-ba58-8bfc80723210 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 200 len: 1363 microversion: 2.1 time: 0.180674 Aug 18 12:37:07.153219 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4325/6979] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:37:06 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:37:08.179046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-33172130-67b9-4d7a-a8dd-fdc5fe2eae2d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:08.180883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-33172130-67b9-4d7a-a8dd-fdc5fe2eae2d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:08.191065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33172130-67b9-4d7a-a8dd-fdc5fe2eae2d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:08.191902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33172130-67b9-4d7a-a8dd-fdc5fe2eae2d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:08.192518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33172130-67b9-4d7a-a8dd-fdc5fe2eae2d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:08.193484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33172130-67b9-4d7a-a8dd-fdc5fe2eae2d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:08.194614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33172130-67b9-4d7a-a8dd-fdc5fe2eae2d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:08.194746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-33172130-67b9-4d7a-a8dd-fdc5fe2eae2d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:08.360849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-33172130-67b9-4d7a-a8dd-fdc5fe2eae2d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:37:08.375653 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-33172130-67b9-4d7a-a8dd-fdc5fe2eae2d tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 200 len: 1363 microversion: 2.1 time: 0.203517 Aug 18 12:37:08.376715 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4326/6980] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:37:08 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:37:08.568565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8204f6c4-4e17-41ed-8400-429e0477b423 req-e99b3c9f-a41d-43e5-b088-376715ef90e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c8c961-ab60-406a-a634-0fefec184f8e", "name": "network-vif-plugged", "status": "completed", "tag": "171a0c57-d7b9-444d-9d51-2f13c54fa464"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:37:08.584526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8204f6c4-4e17-41ed-8400-429e0477b423 req-e99b3c9f-a41d-43e5-b088-376715ef90e3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:08.585378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8204f6c4-4e17-41ed-8400-429e0477b423 req-e99b3c9f-a41d-43e5-b088-376715ef90e3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:08.586194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8204f6c4-4e17-41ed-8400-429e0477b423 req-e99b3c9f-a41d-43e5-b088-376715ef90e3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:08.603275 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8204f6c4-4e17-41ed-8400-429e0477b423 req-e99b3c9f-a41d-43e5-b088-376715ef90e3 service nova] Creating event network-vif-plugged:171a0c57-d7b9-444d-9d51-2f13c54fa464 for instance 19c8c961-ab60-406a-a634-0fefec184f8e on n-h2-853611-3 Aug 18 12:37:08.612341 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8204f6c4-4e17-41ed-8400-429e0477b423 req-e99b3c9f-a41d-43e5-b088-376715ef90e3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047847 Aug 18 12:37:08.613993 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4327/6981] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:37:09.410696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8001f3bf-52f5-48d7-be92-3d0da78b32fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:09.411582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8001f3bf-52f5-48d7-be92-3d0da78b32fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:09.418413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8001f3bf-52f5-48d7-be92-3d0da78b32fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:09.418952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8001f3bf-52f5-48d7-be92-3d0da78b32fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:09.419467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8001f3bf-52f5-48d7-be92-3d0da78b32fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:09.420203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8001f3bf-52f5-48d7-be92-3d0da78b32fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:09.420677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8001f3bf-52f5-48d7-be92-3d0da78b32fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:09.421129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8001f3bf-52f5-48d7-be92-3d0da78b32fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:09.579334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8001f3bf-52f5-48d7-be92-3d0da78b32fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:37:09.587815 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8001f3bf-52f5-48d7-be92-3d0da78b32fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 200 len: 1363 microversion: 2.1 time: 0.182414 Aug 18 12:37:09.588446 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4328/6982] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:37:09 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:37:10.610083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dbcac1f3-ae36-48d8-a596-acd3321d8c7c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:10.611462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dbcac1f3-ae36-48d8-a596-acd3321d8c7c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:10.618547 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbcac1f3-ae36-48d8-a596-acd3321d8c7c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:10.619060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbcac1f3-ae36-48d8-a596-acd3321d8c7c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:10.619519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbcac1f3-ae36-48d8-a596-acd3321d8c7c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:10.620258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbcac1f3-ae36-48d8-a596-acd3321d8c7c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:10.620737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbcac1f3-ae36-48d8-a596-acd3321d8c7c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:10.621183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dbcac1f3-ae36-48d8-a596-acd3321d8c7c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:10.717992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:37:10.786318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-dbcac1f3-ae36-48d8-a596-acd3321d8c7c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:37:10.795469 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dbcac1f3-ae36-48d8-a596-acd3321d8c7c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 200 len: 1555 microversion: 2.1 time: 0.189821 Aug 18 12:37:10.796290 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4329/6983] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:37:10 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:37:10.817452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fe761870-183d-44fc-9b6c-d07119be408c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:10.818108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fe761870-183d-44fc-9b6c-d07119be408c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:10.824855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe761870-183d-44fc-9b6c-d07119be408c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:10.825465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe761870-183d-44fc-9b6c-d07119be408c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:10.826068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe761870-183d-44fc-9b6c-d07119be408c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:10.826895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe761870-183d-44fc-9b6c-d07119be408c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:10.827381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe761870-183d-44fc-9b6c-d07119be408c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:10.827831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe761870-183d-44fc-9b6c-d07119be408c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:10.892991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:37:11.000042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fe761870-183d-44fc-9b6c-d07119be408c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:37:11.009289 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fe761870-183d-44fc-9b6c-d07119be408c tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 200 len: 1555 microversion: 2.1 time: 0.195857 Aug 18 12:37:11.009906 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4330/6984] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:37:10 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 1555 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:37:12.673394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5a781048-b3e8-414d-91f3-8bf008115eac tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c66fc71d-97ba-46e2-ac7b-a88b5c480985"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:37:12.676005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5a781048-b3e8-414d-91f3-8bf008115eac tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:12.683819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a781048-b3e8-414d-91f3-8bf008115eac tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:12.684342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a781048-b3e8-414d-91f3-8bf008115eac tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:12.684878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a781048-b3e8-414d-91f3-8bf008115eac tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:12.685660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a781048-b3e8-414d-91f3-8bf008115eac tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:12.686148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a781048-b3e8-414d-91f3-8bf008115eac tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:12.686637 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a781048-b3e8-414d-91f3-8bf008115eac tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:12.977197 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5a781048-b3e8-414d-91f3-8bf008115eac tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "POST /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308840 Aug 18 12:37:12.977788 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4331/6985] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 12:37:12 2022] POST /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:37:24.985431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:37:24.986615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:37:24.991356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59472d3b-8513-438c-b2e5-975d08f3cab1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:24.993457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59472d3b-8513-438c-b2e5-975d08f3cab1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:25.003839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59472d3b-8513-438c-b2e5-975d08f3cab1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:25.004395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59472d3b-8513-438c-b2e5-975d08f3cab1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:25.004860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59472d3b-8513-438c-b2e5-975d08f3cab1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:25.005666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59472d3b-8513-438c-b2e5-975d08f3cab1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:25.006159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59472d3b-8513-438c-b2e5-975d08f3cab1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:25.006656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59472d3b-8513-438c-b2e5-975d08f3cab1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:25.105660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-59472d3b-8513-438c-b2e5-975d08f3cab1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lazy-loading 'services' on Instance uuid 19c8c961-ab60-406a-a634-0fefec184f8e {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:37:25.209526 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59472d3b-8513-438c-b2e5-975d08f3cab1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "DELETE /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments/c66fc71d-97ba-46e2-ac7b-a88b5c480985" status: 202 len: 0 microversion: 2.1 time: 0.227516 Aug 18 12:37:25.210203 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4332/6986] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 12:37:24 2022] DELETE /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments/c66fc71d-97ba-46e2-ac7b-a88b5c480985 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:37:25.224520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-699fd344-a505-48ea-b808-7dac785aedd1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:25.228521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-699fd344-a505-48ea-b808-7dac785aedd1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:25.240332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-699fd344-a505-48ea-b808-7dac785aedd1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:25.241231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-699fd344-a505-48ea-b808-7dac785aedd1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:25.242052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-699fd344-a505-48ea-b808-7dac785aedd1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:25.243299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-699fd344-a505-48ea-b808-7dac785aedd1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:25.244006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-699fd344-a505-48ea-b808-7dac785aedd1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:25.244666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-699fd344-a505-48ea-b808-7dac785aedd1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:25.286069 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-699fd344-a505-48ea-b808-7dac785aedd1 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069719 Aug 18 12:37:25.288810 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4333/6987] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:37:25 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:37:26.301223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7eea40bd-a98a-4133-bbcf-2febba4481fe tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:26.303791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7eea40bd-a98a-4133-bbcf-2febba4481fe tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:26.312570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eea40bd-a98a-4133-bbcf-2febba4481fe tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:26.313086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eea40bd-a98a-4133-bbcf-2febba4481fe tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:26.313545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eea40bd-a98a-4133-bbcf-2febba4481fe tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:26.314291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eea40bd-a98a-4133-bbcf-2febba4481fe tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:26.314801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eea40bd-a98a-4133-bbcf-2febba4481fe tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:26.315254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7eea40bd-a98a-4133-bbcf-2febba4481fe tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:26.349418 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7eea40bd-a98a-4133-bbcf-2febba4481fe tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052566 Aug 18 12:37:26.350036 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4334/6988] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:37:26 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:37:27.366221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dd3aafdc-3049-4ac4-82e1-d7d6a02c61df tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:27.369386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dd3aafdc-3049-4ac4-82e1-d7d6a02c61df tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:27.380913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd3aafdc-3049-4ac4-82e1-d7d6a02c61df tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:27.381793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd3aafdc-3049-4ac4-82e1-d7d6a02c61df tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:27.382345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd3aafdc-3049-4ac4-82e1-d7d6a02c61df tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:27.383531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd3aafdc-3049-4ac4-82e1-d7d6a02c61df tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:27.384169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd3aafdc-3049-4ac4-82e1-d7d6a02c61df tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:27.384764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dd3aafdc-3049-4ac4-82e1-d7d6a02c61df tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:27.427894 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dd3aafdc-3049-4ac4-82e1-d7d6a02c61df tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069493 Aug 18 12:37:27.428811 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4335/6989] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:37:27 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:37:28.447624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d0693b9-c31e-410d-b410-d1838e9c4a80 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:28.452032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7d0693b9-c31e-410d-b410-d1838e9c4a80 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:28.463750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d0693b9-c31e-410d-b410-d1838e9c4a80 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:28.464561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d0693b9-c31e-410d-b410-d1838e9c4a80 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:28.465211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d0693b9-c31e-410d-b410-d1838e9c4a80 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:28.467081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d0693b9-c31e-410d-b410-d1838e9c4a80 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:28.467843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d0693b9-c31e-410d-b410-d1838e9c4a80 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:28.468631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7d0693b9-c31e-410d-b410-d1838e9c4a80 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:28.523003 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7d0693b9-c31e-410d-b410-d1838e9c4a80 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082208 Aug 18 12:37:28.524798 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4336/6990] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:37:28 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:37:29.543061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0543bdb7-8c39-4fd3-b3bb-90716389f37b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:29.554945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0543bdb7-8c39-4fd3-b3bb-90716389f37b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:29.571038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0543bdb7-8c39-4fd3-b3bb-90716389f37b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:29.571981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0543bdb7-8c39-4fd3-b3bb-90716389f37b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:29.572814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0543bdb7-8c39-4fd3-b3bb-90716389f37b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:29.574170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0543bdb7-8c39-4fd3-b3bb-90716389f37b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:29.575085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0543bdb7-8c39-4fd3-b3bb-90716389f37b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:29.577487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0543bdb7-8c39-4fd3-b3bb-90716389f37b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:29.663366 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0543bdb7-8c39-4fd3-b3bb-90716389f37b tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127681 Aug 18 12:37:29.664406 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4337/6991] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:37:29 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:37:30.682472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f12549c4-2907-49fd-b046-fad1498bb912 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:30.686245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f12549c4-2907-49fd-b046-fad1498bb912 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:30.695057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f12549c4-2907-49fd-b046-fad1498bb912 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:30.695584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f12549c4-2907-49fd-b046-fad1498bb912 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:30.696155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f12549c4-2907-49fd-b046-fad1498bb912 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:30.697040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f12549c4-2907-49fd-b046-fad1498bb912 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:30.697622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f12549c4-2907-49fd-b046-fad1498bb912 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:30.698081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f12549c4-2907-49fd-b046-fad1498bb912 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:30.736900 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f12549c4-2907-49fd-b046-fad1498bb912 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059053 Aug 18 12:37:30.737526 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4338/6992] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:37:30 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 12:37:30.749492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7486cd0b-3384-4de1-92ab-0aaee4a7a005 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:30.750021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7486cd0b-3384-4de1-92ab-0aaee4a7a005 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:30.756955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7486cd0b-3384-4de1-92ab-0aaee4a7a005 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:30.757475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7486cd0b-3384-4de1-92ab-0aaee4a7a005 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:30.757937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7486cd0b-3384-4de1-92ab-0aaee4a7a005 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:30.758723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7486cd0b-3384-4de1-92ab-0aaee4a7a005 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:30.759210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7486cd0b-3384-4de1-92ab-0aaee4a7a005 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:30.759664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7486cd0b-3384-4de1-92ab-0aaee4a7a005 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:30.876736 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-7486cd0b-3384-4de1-92ab-0aaee4a7a005 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] HTTP exception thrown: Instance 19c8c961-ab60-406a-a634-0fefec184f8e is not attached to volume c66fc71d-97ba-46e2-ac7b-a88b5c480985 Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7486cd0b-3384-4de1-92ab-0aaee4a7a005 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Request method failure captured: Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments/c66fc71d-97ba-46e2-ac7b-a88b5c480985 HTTP/1.1 Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jISE2u8UCIWA2SUGKuHNA7SGeZgFVM_oNgVbEBuMJXvpjBe0VA-aMhM806HJXRfUfcJ5UIkxsXEig8LAeGlKtasgKQOC12b_SWQYaPArEcD4kBOaYLgs2Xske6hiKw27K5baPCaszy3G4a5etE7JgXvN-HXog3_4Gg3GA7TkvDJH9k Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 24e40dd3fdf64057b1d1a0b13827c553 Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 24e40dd3fdf64057b1d1a0b13827c553 Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestEncryptedCinderVolumes-2049131897-project Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ec18f372bcf145ccb8e59f89e8528601 Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestEncryptedCinderVolumes-2049131897-project Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 19c8c961-ab60-406a-a634-0fefec184f8e is not attached to volume c66fc71d-97ba-46e2-ac7b-a88b5c480985 Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': '19c8c961-ab60-406a-a634-0fefec184f8e', 'id': 'c66fc71d-97ba-46e2-ac7b-a88b5c480985'} Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c66fc71d-97ba-46e2-ac7b-a88b5c480985. Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c8c961-ab60-406a-a634-0fefec184f8e is not attached to volume c66fc71d-97ba-46e2-ac7b-a88b5c480985 Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:37:30.878949 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:37:30.888462 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:37:30.888462 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:37:30.888462 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c8c961-ab60-406a-a634-0fefec184f8e is not attached to volume c66fc71d-97ba-46e2-ac7b-a88b5c480985 Aug 18 12:37:30.888462 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:37:30.888462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7486cd0b-3384-4de1-92ab-0aaee4a7a005 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Returning 404 to user: Instance 19c8c961-ab60-406a-a634-0fefec184f8e is not attached to volume c66fc71d-97ba-46e2-ac7b-a88b5c480985 {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:37:30.888462 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7486cd0b-3384-4de1-92ab-0aaee4a7a005 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "DELETE /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments/c66fc71d-97ba-46e2-ac7b-a88b5c480985" status: 404 len: 154 microversion: 2.1 time: 0.136092 Aug 18 12:37:30.888462 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4339/6993] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 12:37:30 2022] DELETE /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e/os-volume_attachments/c66fc71d-97ba-46e2-ac7b-a88b5c480985 => generated 154 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:37:34.373583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d2660526-9b64-4e02-8650-af3c7d5ac224 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:34.374783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d2660526-9b64-4e02-8650-af3c7d5ac224 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:34.383173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2660526-9b64-4e02-8650-af3c7d5ac224 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:34.384004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2660526-9b64-4e02-8650-af3c7d5ac224 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:34.384666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2660526-9b64-4e02-8650-af3c7d5ac224 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:34.385643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2660526-9b64-4e02-8650-af3c7d5ac224 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:34.386367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2660526-9b64-4e02-8650-af3c7d5ac224 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:34.386988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2660526-9b64-4e02-8650-af3c7d5ac224 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:34.419606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d2660526-9b64-4e02-8650-af3c7d5ac224 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:37:34.518772 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d2660526-9b64-4e02-8650-af3c7d5ac224 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "DELETE /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 204 len: 0 microversion: 2.1 time: 0.150109 Aug 18 12:37:34.519582 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4340/6994] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:37:34 2022] DELETE /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:37:34.531244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6403fbb3-763b-4ac8-87db-bd9553b38738 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:34.532385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6403fbb3-763b-4ac8-87db-bd9553b38738 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:34.541727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6403fbb3-763b-4ac8-87db-bd9553b38738 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:34.542286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6403fbb3-763b-4ac8-87db-bd9553b38738 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:34.542791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6403fbb3-763b-4ac8-87db-bd9553b38738 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:34.543565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6403fbb3-763b-4ac8-87db-bd9553b38738 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:34.544987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6403fbb3-763b-4ac8-87db-bd9553b38738 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:34.548021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6403fbb3-763b-4ac8-87db-bd9553b38738 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:34.791911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6403fbb3-763b-4ac8-87db-bd9553b38738 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:37:34.801194 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6403fbb3-763b-4ac8-87db-bd9553b38738 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 200 len: 1561 microversion: 2.1 time: 0.275914 Aug 18 12:37:34.801835 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4341/6995] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:37:34 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 1561 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:37:35.836476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b72f686-e1f5-4da2-b4d3-bcd3920b4965 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:35.837250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1b72f686-e1f5-4da2-b4d3-bcd3920b4965 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:35.845744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b72f686-e1f5-4da2-b4d3-bcd3920b4965 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:35.846267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b72f686-e1f5-4da2-b4d3-bcd3920b4965 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:35.846778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b72f686-e1f5-4da2-b4d3-bcd3920b4965 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:35.847537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b72f686-e1f5-4da2-b4d3-bcd3920b4965 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:35.848143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b72f686-e1f5-4da2-b4d3-bcd3920b4965 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:35.848625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b72f686-e1f5-4da2-b4d3-bcd3920b4965 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:36.043537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1b72f686-e1f5-4da2-b4d3-bcd3920b4965 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:37:36.058010 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1b72f686-e1f5-4da2-b4d3-bcd3920b4965 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 200 len: 1561 microversion: 2.1 time: 0.225271 Aug 18 12:37:36.059076 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4342/6996] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:37:35 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 1561 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:37:36.681226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-f1eb5b96-4028-4d40-8d6a-6173bc544ac2 req-9113ee9c-4b11-4039-ad72-69e4ed9bcece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c8c961-ab60-406a-a634-0fefec184f8e", "name": "network-vif-deleted", "tag": "171a0c57-d7b9-444d-9d51-2f13c54fa464"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:37:36.696927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f1eb5b96-4028-4d40-8d6a-6173bc544ac2 req-9113ee9c-4b11-4039-ad72-69e4ed9bcece service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:36.697528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f1eb5b96-4028-4d40-8d6a-6173bc544ac2 req-9113ee9c-4b11-4039-ad72-69e4ed9bcece service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:36.698064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-f1eb5b96-4028-4d40-8d6a-6173bc544ac2 req-9113ee9c-4b11-4039-ad72-69e4ed9bcece service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:36.716218 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-f1eb5b96-4028-4d40-8d6a-6173bc544ac2 req-9113ee9c-4b11-4039-ad72-69e4ed9bcece service nova] Creating event network-vif-deleted:171a0c57-d7b9-444d-9d51-2f13c54fa464 for instance 19c8c961-ab60-406a-a634-0fefec184f8e on n-h2-853611-3 Aug 18 12:37:36.724460 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-f1eb5b96-4028-4d40-8d6a-6173bc544ac2 req-9113ee9c-4b11-4039-ad72-69e4ed9bcece service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050623 Aug 18 12:37:36.725278 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4343/6997] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:37:37.097479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e1669fc-19e3-4f59-9758-dd32b07f52fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:37.102292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1e1669fc-19e3-4f59-9758-dd32b07f52fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:37.117364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e1669fc-19e3-4f59-9758-dd32b07f52fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:37.118068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e1669fc-19e3-4f59-9758-dd32b07f52fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:37.118722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e1669fc-19e3-4f59-9758-dd32b07f52fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:37.119894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e1669fc-19e3-4f59-9758-dd32b07f52fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:37.120739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e1669fc-19e3-4f59-9758-dd32b07f52fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:37.121453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e1669fc-19e3-4f59-9758-dd32b07f52fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:37.192345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e1669fc-19e3-4f59-9758-dd32b07f52fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:37.193031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e1669fc-19e3-4f59-9758-dd32b07f52fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:37.193672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e1669fc-19e3-4f59-9758-dd32b07f52fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:37.194354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-1e1669fc-19e3-4f59-9758-dd32b07f52fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lazy-loading 'fault' on Instance uuid 19c8c961-ab60-406a-a634-0fefec184f8e {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:37:37.249972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1e1669fc-19e3-4f59-9758-dd32b07f52fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18f372bcf145ccb8e59f89e8528601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e40dd3fdf64057b1d1a0b13827c553', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:37:37.257925 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1e1669fc-19e3-4f59-9758-dd32b07f52fd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 200 len: 1353 microversion: 2.1 time: 0.167440 Aug 18 12:37:37.258835 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4344/6998] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:37:37 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 1353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:37:38.281862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-abc30800-0169-45c1-810b-be240dcd3216 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:38.282674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-abc30800-0169-45c1-810b-be240dcd3216 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] [instance: 19c8c961-ab60-406a-a634-0fefec184f8e] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:37:38.290364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abc30800-0169-45c1-810b-be240dcd3216 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:38.290915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abc30800-0169-45c1-810b-be240dcd3216 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:38.291375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abc30800-0169-45c1-810b-be240dcd3216 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:38.292116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abc30800-0169-45c1-810b-be240dcd3216 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:37:38.292591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abc30800-0169-45c1-810b-be240dcd3216 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:37:38.293051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-abc30800-0169-45c1-810b-be240dcd3216 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:37:38.308769 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-abc30800-0169-45c1-810b-be240dcd3216 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] HTTP exception thrown: Instance 19c8c961-ab60-406a-a634-0fefec184f8e could not be found. Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-abc30800-0169-45c1-810b-be240dcd3216 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Request method failure captured: Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e HTTP/1.1 Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jISE2u8UCIWA2SUGKuHNA7SGeZgFVM_oNgVbEBuMJXvpjBe0VA-aMhM806HJXRfUfcJ5UIkxsXEig8LAeGlKtasgKQOC12b_SWQYaPArEcD4kBOaYLgs2Xske6hiKw27K5baPCaszy3G4a5etE7JgXvN-HXog3_4Gg3GA7TkvDJH9k Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 24e40dd3fdf64057b1d1a0b13827c553 Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/24e40dd3fdf64057b1d1a0b13827c553"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 24e40dd3fdf64057b1d1a0b13827c553 Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2049131897 Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestEncryptedCinderVolumes-2049131897-project Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: ec18f372bcf145ccb8e59f89e8528601 Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestEncryptedCinderVolumes-2049131897-project Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 19c8c961-ab60-406a-a634-0fefec184f8e could not be found. Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '19c8c961-ab60-406a-a634-0fefec184f8e'} Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c8c961-ab60-406a-a634-0fefec184f8e could not be found. Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c8c961-ab60-406a-a634-0fefec184f8e could not be found. Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:37:38.311537 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:37:38.319411 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:37:38.319411 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:37:38.319411 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:37:38.319411 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:37:38.319411 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:37:38.319411 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:37:38.319411 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c8c961-ab60-406a-a634-0fefec184f8e could not be found. Aug 18 12:37:38.319411 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:37:38.319411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-abc30800-0169-45c1-810b-be240dcd3216 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Returning 404 to user: Instance 19c8c961-ab60-406a-a634-0fefec184f8e could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:37:38.319411 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-abc30800-0169-45c1-810b-be240dcd3216 tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e" status: 404 len: 111 microversion: 2.1 time: 0.035556 Aug 18 12:37:38.319411 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4345/6999] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:37:38 2022] GET /compute/v2.1/servers/19c8c961-ab60-406a-a634-0fefec184f8e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:37:38.322286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-129dc98b-250e-4d57-b30a-f27ec1fa51cd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] Calling method '.version_select at 0x7f519efe0ca0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:37:38.347024 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-129dc98b-250e-4d57-b30a-f27ec1fa51cd tempest-TestEncryptedCinderVolumes-2049131897 tempest-TestEncryptedCinderVolumes-2049131897-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1186167044" status: 202 len: 0 microversion: 2.1 time: 0.028499 Aug 18 12:37:38.347789 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4346/7000] 10.222.0.73 () {58 vars in 1278 bytes} [Thu Aug 18 12:37:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1186167044 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:38:13.642275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:38:13.643510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:38:13.649323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a473f8c5-1615-4285-a448-d903311dd54b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Action: 'create', calling method: .version_select at 0x7f519fcd6430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-913523775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONiLGlWmBtRQv/zMZNwpJOPunfYkxpU1oGL+iW9KxGnrs3c4yGMjOW505mpZlbfcqdHTaTi7ZRk4Evqp0dJduZt4wwpyKQRB5spzIu5/n4n6zPiN+jfGfQQ5tMko57chg=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:38:13.674788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a473f8c5-1615-4285-a448-d903311dd54b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Getting quotas for project 6254faa7d5e34f2092f213aa2bc0ae42. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:38:13.681537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-a473f8c5-1615-4285-a448-d903311dd54b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Getting quotas for user 9bb8acb005ee49a9ba883f7427750440 and project 6254faa7d5e34f2092f213aa2bc0ae42. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:38:13.718622 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a473f8c5-1615-4285-a448-d903311dd54b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.077745 Aug 18 12:38:13.718622 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4347/7001] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:38:13 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:38:13.775182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-840995854", "imageRef": "0045f483-a9d3-4476-a901-9b37f4dc8472", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-913523775", "networks": [{"uuid": "eb7cce60-ff5d-49f8-89a6-512c950591ad"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:38:13.848883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] validate_networks() for [('eb7cce60-ff5d-49f8-89a6-512c950591ad', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:38:14.335219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:38:14.335780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:38:14.336429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:38:14.336971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:38:14.337684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:38:14.348851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:14.349359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:14.349815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:14.350626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:14.351102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:14.351551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:14.373217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Getting quotas for project 6254faa7d5e34f2092f213aa2bc0ae42. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:38:14.379735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Getting quotas for user 9bb8acb005ee49a9ba883f7427750440 and project 6254faa7d5e34f2092f213aa2bc0ae42. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:38:14.394470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:38:14.398490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0045f483-a9d3-4476-a901-9b37f4dc8472',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:38:14.459170 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6f9ba46d-878f-4887-8347-5c9cddbd0cf1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688760 Aug 18 12:38:14.460160 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4348/7002] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:38:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:38:14.479680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9281d213-8eb0-4f9f-910d-0210ceb16653 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:14.480230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9281d213-8eb0-4f9f-910d-0210ceb16653 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:14.562055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9281d213-8eb0-4f9f-910d-0210ceb16653 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:14.573928 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9281d213-8eb0-4f9f-910d-0210ceb16653 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1257 microversion: 2.1 time: 0.105954 Aug 18 12:38:14.575161 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4349/7003] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:14 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1257 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:15.599101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-909a87f6-62f8-4906-9501-44e24fc0deb9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:15.600186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-909a87f6-62f8-4906-9501-44e24fc0deb9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:15.610325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-909a87f6-62f8-4906-9501-44e24fc0deb9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:15.611045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-909a87f6-62f8-4906-9501-44e24fc0deb9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:15.611610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-909a87f6-62f8-4906-9501-44e24fc0deb9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:15.612858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-909a87f6-62f8-4906-9501-44e24fc0deb9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:15.615196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-909a87f6-62f8-4906-9501-44e24fc0deb9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:15.616089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-909a87f6-62f8-4906-9501-44e24fc0deb9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:15.734243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-909a87f6-62f8-4906-9501-44e24fc0deb9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:15.749980 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-909a87f6-62f8-4906-9501-44e24fc0deb9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1309 microversion: 2.1 time: 0.155596 Aug 18 12:38:15.751135 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4350/7004] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:15 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1309 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:16.792959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c5550f6a-a450-4f4e-bd6e-907866dc7afa tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:16.796754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c5550f6a-a450-4f4e-bd6e-907866dc7afa tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:16.814580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5550f6a-a450-4f4e-bd6e-907866dc7afa tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:16.816175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5550f6a-a450-4f4e-bd6e-907866dc7afa tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:16.817209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5550f6a-a450-4f4e-bd6e-907866dc7afa tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:16.818769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5550f6a-a450-4f4e-bd6e-907866dc7afa tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:16.819845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5550f6a-a450-4f4e-bd6e-907866dc7afa tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:16.820868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5550f6a-a450-4f4e-bd6e-907866dc7afa tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:17.003511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c5550f6a-a450-4f4e-bd6e-907866dc7afa tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:17.030818 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c5550f6a-a450-4f4e-bd6e-907866dc7afa tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1315 microversion: 2.1 time: 0.244749 Aug 18 12:38:17.033065 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4351/7005] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:16 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:18.079735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-860f68b6-27ec-460d-a536-ab3ee9af424b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:18.080570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-860f68b6-27ec-460d-a536-ab3ee9af424b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:18.090107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-860f68b6-27ec-460d-a536-ab3ee9af424b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:18.090902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-860f68b6-27ec-460d-a536-ab3ee9af424b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:18.091292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-860f68b6-27ec-460d-a536-ab3ee9af424b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:18.092146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-860f68b6-27ec-460d-a536-ab3ee9af424b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:18.092822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-860f68b6-27ec-460d-a536-ab3ee9af424b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:18.093372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-860f68b6-27ec-460d-a536-ab3ee9af424b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:18.332412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-860f68b6-27ec-460d-a536-ab3ee9af424b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:18.347862 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-860f68b6-27ec-460d-a536-ab3ee9af424b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1357 microversion: 2.1 time: 0.272600 Aug 18 12:38:18.349180 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4352/7006] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:18 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1357 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:19.384782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9a56ad01-2396-459d-92d4-d9be87bd739a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:19.388222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9a56ad01-2396-459d-92d4-d9be87bd739a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:19.403598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a56ad01-2396-459d-92d4-d9be87bd739a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:19.405058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a56ad01-2396-459d-92d4-d9be87bd739a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:19.406194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a56ad01-2396-459d-92d4-d9be87bd739a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:19.407720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a56ad01-2396-459d-92d4-d9be87bd739a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:19.408811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a56ad01-2396-459d-92d4-d9be87bd739a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:19.409714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a56ad01-2396-459d-92d4-d9be87bd739a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:19.608543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9a56ad01-2396-459d-92d4-d9be87bd739a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:19.617886 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9a56ad01-2396-459d-92d4-d9be87bd739a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1357 microversion: 2.1 time: 0.241146 Aug 18 12:38:19.632198 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4353/7007] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:19 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1357 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:20.185339 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:38:20.186147 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:38:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:38:20.639808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e690fb5a-7000-4716-af47-f594f9040d8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:20.640433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e690fb5a-7000-4716-af47-f594f9040d8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:20.648161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e690fb5a-7000-4716-af47-f594f9040d8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:20.648675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e690fb5a-7000-4716-af47-f594f9040d8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:20.649128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e690fb5a-7000-4716-af47-f594f9040d8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:20.649875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e690fb5a-7000-4716-af47-f594f9040d8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:20.650350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e690fb5a-7000-4716-af47-f594f9040d8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:20.650818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e690fb5a-7000-4716-af47-f594f9040d8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:20.930124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e690fb5a-7000-4716-af47-f594f9040d8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:20.949128 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e690fb5a-7000-4716-af47-f594f9040d8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1357 microversion: 2.1 time: 0.312907 Aug 18 12:38:20.951080 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4354/7008] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:20 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1357 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:21.986862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bc7fd499-795b-4508-9977-53adb3eea41d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:21.988992 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bc7fd499-795b-4508-9977-53adb3eea41d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:22.000627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc7fd499-795b-4508-9977-53adb3eea41d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:22.001478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc7fd499-795b-4508-9977-53adb3eea41d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:22.002085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc7fd499-795b-4508-9977-53adb3eea41d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:22.003303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc7fd499-795b-4508-9977-53adb3eea41d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:22.004631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc7fd499-795b-4508-9977-53adb3eea41d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:22.017049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bc7fd499-795b-4508-9977-53adb3eea41d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:22.275284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bc7fd499-795b-4508-9977-53adb3eea41d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:22.291790 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bc7fd499-795b-4508-9977-53adb3eea41d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1357 microversion: 2.1 time: 0.310823 Aug 18 12:38:22.292988 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4355/7009] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:21 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1357 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:23.320726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5382c5fb-4e7c-4eb9-b765-95f11ee3cd42 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:23.321746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5382c5fb-4e7c-4eb9-b765-95f11ee3cd42 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:23.334976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5382c5fb-4e7c-4eb9-b765-95f11ee3cd42 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:23.335999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5382c5fb-4e7c-4eb9-b765-95f11ee3cd42 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:23.336845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5382c5fb-4e7c-4eb9-b765-95f11ee3cd42 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:23.338222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5382c5fb-4e7c-4eb9-b765-95f11ee3cd42 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:23.339189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5382c5fb-4e7c-4eb9-b765-95f11ee3cd42 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:23.340027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5382c5fb-4e7c-4eb9-b765-95f11ee3cd42 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:23.586530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5382c5fb-4e7c-4eb9-b765-95f11ee3cd42 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:23.595608 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5382c5fb-4e7c-4eb9-b765-95f11ee3cd42 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1357 microversion: 2.1 time: 0.281804 Aug 18 12:38:23.596245 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4356/7010] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:23 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1357 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:24.621533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-57921281-80ca-491a-bf64-ca946c785343 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:24.622843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-57921281-80ca-491a-bf64-ca946c785343 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:24.627713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:38:24.629063 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:38:24.640844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57921281-80ca-491a-bf64-ca946c785343 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:24.641726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57921281-80ca-491a-bf64-ca946c785343 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:24.642559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57921281-80ca-491a-bf64-ca946c785343 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:24.643897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57921281-80ca-491a-bf64-ca946c785343 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:24.644734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57921281-80ca-491a-bf64-ca946c785343 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:24.645491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-57921281-80ca-491a-bf64-ca946c785343 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:25.114912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-57921281-80ca-491a-bf64-ca946c785343 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:25.125001 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-57921281-80ca-491a-bf64-ca946c785343 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1357 microversion: 2.1 time: 0.510593 Aug 18 12:38:25.125990 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4357/7011] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:24 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1357 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:25.130906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-e4a79053-923d-4ed7-b3dd-5d942c1f8b91 req-b14c1eb7-8fdc-4e9b-b527-5e3e6f8fc381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a28582-acdd-4109-a7c4-9a4a495a60bc", "tag": "2cb9fafa-10b3-4f28-9306-822fe0c76b7e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:38:25.143198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e4a79053-923d-4ed7-b3dd-5d942c1f8b91 req-b14c1eb7-8fdc-4e9b-b527-5e3e6f8fc381 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:25.143702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e4a79053-923d-4ed7-b3dd-5d942c1f8b91 req-b14c1eb7-8fdc-4e9b-b527-5e3e6f8fc381 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:25.144168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e4a79053-923d-4ed7-b3dd-5d942c1f8b91 req-b14c1eb7-8fdc-4e9b-b527-5e3e6f8fc381 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:25.157707 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e4a79053-923d-4ed7-b3dd-5d942c1f8b91 req-b14c1eb7-8fdc-4e9b-b527-5e3e6f8fc381 service nova] Creating event network-changed:2cb9fafa-10b3-4f28-9306-822fe0c76b7e for instance 28a28582-acdd-4109-a7c4-9a4a495a60bc on n-h2-853611-3 Aug 18 12:38:25.164421 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-e4a79053-923d-4ed7-b3dd-5d942c1f8b91 req-b14c1eb7-8fdc-4e9b-b527-5e3e6f8fc381 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036940 Aug 18 12:38:25.165593 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4358/7012] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:38:26.158803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b27054c2-dc7e-489f-8263-adacbaeef765 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:26.159781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b27054c2-dc7e-489f-8263-adacbaeef765 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:26.167584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b27054c2-dc7e-489f-8263-adacbaeef765 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:26.168097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b27054c2-dc7e-489f-8263-adacbaeef765 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:26.168556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b27054c2-dc7e-489f-8263-adacbaeef765 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:26.169845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b27054c2-dc7e-489f-8263-adacbaeef765 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:26.170319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b27054c2-dc7e-489f-8263-adacbaeef765 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:26.170818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b27054c2-dc7e-489f-8263-adacbaeef765 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:26.327494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b27054c2-dc7e-489f-8263-adacbaeef765 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:26.336067 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b27054c2-dc7e-489f-8263-adacbaeef765 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1357 microversion: 2.1 time: 0.181807 Aug 18 12:38:26.336677 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4359/7013] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:26 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:27.375436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b3e38ae-4393-433b-87f7-11502bc1af81 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:27.376693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8b3e38ae-4393-433b-87f7-11502bc1af81 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:27.384938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b3e38ae-4393-433b-87f7-11502bc1af81 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:27.385453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b3e38ae-4393-433b-87f7-11502bc1af81 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:27.385913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b3e38ae-4393-433b-87f7-11502bc1af81 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:27.386748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b3e38ae-4393-433b-87f7-11502bc1af81 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:27.387233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b3e38ae-4393-433b-87f7-11502bc1af81 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:27.387942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b3e38ae-4393-433b-87f7-11502bc1af81 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:27.556797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8b3e38ae-4393-433b-87f7-11502bc1af81 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:27.566219 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8b3e38ae-4393-433b-87f7-11502bc1af81 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1357 microversion: 2.1 time: 0.199136 Aug 18 12:38:27.566938 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4360/7014] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:27 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:28.588404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6da3016c-e9e1-43c8-811b-bad1f884e6a6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:28.589160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6da3016c-e9e1-43c8-811b-bad1f884e6a6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:28.597346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da3016c-e9e1-43c8-811b-bad1f884e6a6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:28.597860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da3016c-e9e1-43c8-811b-bad1f884e6a6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:28.598320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da3016c-e9e1-43c8-811b-bad1f884e6a6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:28.599121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da3016c-e9e1-43c8-811b-bad1f884e6a6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:28.599608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da3016c-e9e1-43c8-811b-bad1f884e6a6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:28.600056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da3016c-e9e1-43c8-811b-bad1f884e6a6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:28.764500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6da3016c-e9e1-43c8-811b-bad1f884e6a6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:28.773197 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6da3016c-e9e1-43c8-811b-bad1f884e6a6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1357 microversion: 2.1 time: 0.188750 Aug 18 12:38:28.773825 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4361/7015] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:28 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:29.796467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-81faffa6-31b2-405d-a3b1-1cb62c04e3f2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:29.797600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-81faffa6-31b2-405d-a3b1-1cb62c04e3f2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:29.805133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81faffa6-31b2-405d-a3b1-1cb62c04e3f2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:29.805643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81faffa6-31b2-405d-a3b1-1cb62c04e3f2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:29.806230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81faffa6-31b2-405d-a3b1-1cb62c04e3f2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:29.807087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81faffa6-31b2-405d-a3b1-1cb62c04e3f2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:29.807572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81faffa6-31b2-405d-a3b1-1cb62c04e3f2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:29.808023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-81faffa6-31b2-405d-a3b1-1cb62c04e3f2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:29.968469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-81faffa6-31b2-405d-a3b1-1cb62c04e3f2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:29.978045 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-81faffa6-31b2-405d-a3b1-1cb62c04e3f2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1357 microversion: 2.1 time: 0.185849 Aug 18 12:38:29.978697 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4362/7016] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:29 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:31.003753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-54ce43af-691a-44e6-83c2-e35f401149a4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:31.005208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-54ce43af-691a-44e6-83c2-e35f401149a4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:31.014479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54ce43af-691a-44e6-83c2-e35f401149a4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:31.015411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54ce43af-691a-44e6-83c2-e35f401149a4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:31.015800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54ce43af-691a-44e6-83c2-e35f401149a4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:31.017268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54ce43af-691a-44e6-83c2-e35f401149a4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:31.017990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54ce43af-691a-44e6-83c2-e35f401149a4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:31.018723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54ce43af-691a-44e6-83c2-e35f401149a4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:31.218570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-54ce43af-691a-44e6-83c2-e35f401149a4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:31.228482 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-54ce43af-691a-44e6-83c2-e35f401149a4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1357 microversion: 2.1 time: 0.230145 Aug 18 12:38:31.229398 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4363/7017] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:30 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:31.245155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-853a16d3-fcca-4948-b527-3ee0f55a5a5c req-98c0d009-e347-4965-801d-64a05511d3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a28582-acdd-4109-a7c4-9a4a495a60bc", "name": "network-vif-plugged", "status": "completed", "tag": "2cb9fafa-10b3-4f28-9306-822fe0c76b7e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:38:31.267987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-853a16d3-fcca-4948-b527-3ee0f55a5a5c req-98c0d009-e347-4965-801d-64a05511d3f7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:31.268748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-853a16d3-fcca-4948-b527-3ee0f55a5a5c req-98c0d009-e347-4965-801d-64a05511d3f7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:31.269860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-853a16d3-fcca-4948-b527-3ee0f55a5a5c req-98c0d009-e347-4965-801d-64a05511d3f7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:31.296777 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-853a16d3-fcca-4948-b527-3ee0f55a5a5c req-98c0d009-e347-4965-801d-64a05511d3f7 service nova] Creating event network-vif-plugged:2cb9fafa-10b3-4f28-9306-822fe0c76b7e for instance 28a28582-acdd-4109-a7c4-9a4a495a60bc on n-h2-853611-3 Aug 18 12:38:31.308842 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-853a16d3-fcca-4948-b527-3ee0f55a5a5c req-98c0d009-e347-4965-801d-64a05511d3f7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077959 Aug 18 12:38:31.309819 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4364/7018] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:38:32.255091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a741bac-641d-4e01-a1b9-7f139ed74e49 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:32.255827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a741bac-641d-4e01-a1b9-7f139ed74e49 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:32.263377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a741bac-641d-4e01-a1b9-7f139ed74e49 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:32.264522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a741bac-641d-4e01-a1b9-7f139ed74e49 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:32.265130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a741bac-641d-4e01-a1b9-7f139ed74e49 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:32.265987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a741bac-641d-4e01-a1b9-7f139ed74e49 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:32.266559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a741bac-641d-4e01-a1b9-7f139ed74e49 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:32.267064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a741bac-641d-4e01-a1b9-7f139ed74e49 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:32.442887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a741bac-641d-4e01-a1b9-7f139ed74e49 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:32.459471 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a741bac-641d-4e01-a1b9-7f139ed74e49 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1357 microversion: 2.1 time: 0.209329 Aug 18 12:38:32.461145 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4365/7019] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:32 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:38:33.482089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3192c633-601e-4f5b-a84b-1e3a461229d5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:33.482984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3192c633-601e-4f5b-a84b-1e3a461229d5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:33.491772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3192c633-601e-4f5b-a84b-1e3a461229d5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:33.492370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3192c633-601e-4f5b-a84b-1e3a461229d5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:33.492875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3192c633-601e-4f5b-a84b-1e3a461229d5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:33.495167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3192c633-601e-4f5b-a84b-1e3a461229d5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:33.495167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3192c633-601e-4f5b-a84b-1e3a461229d5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:33.495167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3192c633-601e-4f5b-a84b-1e3a461229d5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:33.667732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3192c633-601e-4f5b-a84b-1e3a461229d5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:33.676860 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3192c633-601e-4f5b-a84b-1e3a461229d5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1546 microversion: 2.1 time: 0.199106 Aug 18 12:38:33.677470 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4366/7020] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:33 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1546 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:33.697504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-04cb54b0-1600-40d1-aa99-1a160b2a748f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:33.698144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-04cb54b0-1600-40d1-aa99-1a160b2a748f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:33.705258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04cb54b0-1600-40d1-aa99-1a160b2a748f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:33.705777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04cb54b0-1600-40d1-aa99-1a160b2a748f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:33.706235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04cb54b0-1600-40d1-aa99-1a160b2a748f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:33.707038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04cb54b0-1600-40d1-aa99-1a160b2a748f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:33.707518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04cb54b0-1600-40d1-aa99-1a160b2a748f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:33.707968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04cb54b0-1600-40d1-aa99-1a160b2a748f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:33.732903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:38:33.867495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-04cb54b0-1600-40d1-aa99-1a160b2a748f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:33.876473 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-04cb54b0-1600-40d1-aa99-1a160b2a748f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1546 microversion: 2.1 time: 0.182805 Aug 18 12:38:33.877091 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4367/7021] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:33 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1546 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:33.896827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d357add1-3c94-40d3-ba3e-e094d9231398 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:33.901871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d357add1-3c94-40d3-ba3e-e094d9231398 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:33.902726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d357add1-3c94-40d3-ba3e-e094d9231398 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Searching by: {'deleted': False, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 12:38:33.909722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d357add1-3c94-40d3-ba3e-e094d9231398 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:33.910250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d357add1-3c94-40d3-ba3e-e094d9231398 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:33.910773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d357add1-3c94-40d3-ba3e-e094d9231398 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:33.911676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d357add1-3c94-40d3-ba3e-e094d9231398 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:33.912949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d357add1-3c94-40d3-ba3e-e094d9231398 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:33.914159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d357add1-3c94-40d3-ba3e-e094d9231398 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:33.944405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-d357add1-3c94-40d3-ba3e-e094d9231398 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 12:38:33.977908 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d357add1-3c94-40d3-ba3e-e094d9231398 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.085092 Aug 18 12:38:33.978564 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4368/7022] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 18 12:38:33 2022] GET /compute/v2.1/servers => generated 342 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:38:33.992837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-24ce81b8-03a3-406d-a6d3-c207a140fdb5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:33.993390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-24ce81b8-03a3-406d-a6d3-c207a140fdb5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:34.000089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24ce81b8-03a3-406d-a6d3-c207a140fdb5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:34.000603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24ce81b8-03a3-406d-a6d3-c207a140fdb5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:34.001122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24ce81b8-03a3-406d-a6d3-c207a140fdb5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:34.001855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24ce81b8-03a3-406d-a6d3-c207a140fdb5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:34.002328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24ce81b8-03a3-406d-a6d3-c207a140fdb5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:34.002799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-24ce81b8-03a3-406d-a6d3-c207a140fdb5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:34.157905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-24ce81b8-03a3-406d-a6d3-c207a140fdb5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:34.166312 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-24ce81b8-03a3-406d-a6d3-c207a140fdb5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1546 microversion: 2.1 time: 0.177776 Aug 18 12:38:34.166979 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4369/7023] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:33 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:36.761890 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:38:36.763165 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:38:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:38:36.902091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9a057318-dc33-4d60-9c93-5d3ff264be83 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecdd33dd-54d8-4132-ba4a-8cb120ca0c4e"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:38:36.905834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9a057318-dc33-4d60-9c93-5d3ff264be83 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:36.914209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a057318-dc33-4d60-9c93-5d3ff264be83 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:36.914789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a057318-dc33-4d60-9c93-5d3ff264be83 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:36.915257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a057318-dc33-4d60-9c93-5d3ff264be83 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:36.916052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a057318-dc33-4d60-9c93-5d3ff264be83 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:36.916576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a057318-dc33-4d60-9c93-5d3ff264be83 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:36.917027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9a057318-dc33-4d60-9c93-5d3ff264be83 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:37.212540 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9a057318-dc33-4d60-9c93-5d3ff264be83 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "POST /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314724 Aug 18 12:38:37.213320 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4370/7024] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 12:38:36 2022] POST /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:38:51.697571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:38:51.699329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:38:51.701154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:38:51.707837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-85465224-949e-485e-837c-7700e8eaf0c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:51.708589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-85465224-949e-485e-837c-7700e8eaf0c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:51.719598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85465224-949e-485e-837c-7700e8eaf0c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:51.720165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85465224-949e-485e-837c-7700e8eaf0c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:51.720663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85465224-949e-485e-837c-7700e8eaf0c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:51.721556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85465224-949e-485e-837c-7700e8eaf0c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:51.722087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85465224-949e-485e-837c-7700e8eaf0c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:51.722695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85465224-949e-485e-837c-7700e8eaf0c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:52.046933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-85465224-949e-485e-837c-7700e8eaf0c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:52.056663 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-85465224-949e-485e-837c-7700e8eaf0c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1592 microversion: 2.1 time: 0.361369 Aug 18 12:38:52.057284 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4371/7025] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:51 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1592 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:54.213905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c06a9b21-5c94-4ce1-ae78-daacd24cf948 req-dc5fa7e3-4196-4678-8e7f-2df382a18d7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a28582-acdd-4109-a7c4-9a4a495a60bc", "tag": "2cb9fafa-10b3-4f28-9306-822fe0c76b7e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:38:54.238335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c06a9b21-5c94-4ce1-ae78-daacd24cf948 req-dc5fa7e3-4196-4678-8e7f-2df382a18d7d service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:54.239094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c06a9b21-5c94-4ce1-ae78-daacd24cf948 req-dc5fa7e3-4196-4678-8e7f-2df382a18d7d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:54.239781 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c06a9b21-5c94-4ce1-ae78-daacd24cf948 req-dc5fa7e3-4196-4678-8e7f-2df382a18d7d service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:54.254339 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c06a9b21-5c94-4ce1-ae78-daacd24cf948 req-dc5fa7e3-4196-4678-8e7f-2df382a18d7d service nova] Creating event network-changed:2cb9fafa-10b3-4f28-9306-822fe0c76b7e for instance 28a28582-acdd-4109-a7c4-9a4a495a60bc on n-h2-853611-3 Aug 18 12:38:54.260625 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c06a9b21-5c94-4ce1-ae78-daacd24cf948 req-dc5fa7e3-4196-4678-8e7f-2df382a18d7d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051014 Aug 18 12:38:54.262073 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4372/7026] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:38:55.728341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4bd8f9de-f4e8-4fca-994a-235b7ee659b3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-307422656"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:38:55.730067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4bd8f9de-f4e8-4fca-994a-235b7ee659b3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:55.737902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bd8f9de-f4e8-4fca-994a-235b7ee659b3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:55.738730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bd8f9de-f4e8-4fca-994a-235b7ee659b3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:55.739597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bd8f9de-f4e8-4fca-994a-235b7ee659b3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:55.740512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bd8f9de-f4e8-4fca-994a-235b7ee659b3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:55.741326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bd8f9de-f4e8-4fca-994a-235b7ee659b3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:55.742105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4bd8f9de-f4e8-4fca-994a-235b7ee659b3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:55.917649 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.network.security_group_api [None req-4bd8f9de-f4e8-4fca-994a-235b7ee659b3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Adding security group f87eda26-ffa8-404d-a810-34ea5a7a9296 to port 2cb9fafa-10b3-4f28-9306-822fe0c76b7e Aug 18 12:38:56.355664 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4bd8f9de-f4e8-4fca-994a-235b7ee659b3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "POST /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/action" status: 202 len: 0 microversion: 2.1 time: 0.633553 Aug 18 12:38:56.357239 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4373/7027] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:38:55 2022] POST /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:38:56.367909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5d8f5440-7ff8-4785-90f3-607a6b4dbcf4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:38:56.369402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5d8f5440-7ff8-4785-90f3-607a6b4dbcf4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:38:56.378595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d8f5440-7ff8-4785-90f3-607a6b4dbcf4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:56.379482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d8f5440-7ff8-4785-90f3-607a6b4dbcf4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:56.380171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d8f5440-7ff8-4785-90f3-607a6b4dbcf4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:56.381102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d8f5440-7ff8-4785-90f3-607a6b4dbcf4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:56.381765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d8f5440-7ff8-4785-90f3-607a6b4dbcf4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:56.382837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5d8f5440-7ff8-4785-90f3-607a6b4dbcf4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:56.667446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5d8f5440-7ff8-4785-90f3-607a6b4dbcf4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:38:56.686712 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5d8f5440-7ff8-4785-90f3-607a6b4dbcf4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1757 microversion: 2.1 time: 0.322415 Aug 18 12:38:56.688769 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4374/7028] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:38:56 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1757 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:38:56.695032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-6693263b-b4dd-4510-9be8-cf298d4201ea req-6c17256e-6ef4-467c-ae9e-c7b9538eecd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a28582-acdd-4109-a7c4-9a4a495a60bc", "tag": "2cb9fafa-10b3-4f28-9306-822fe0c76b7e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:38:56.708293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6693263b-b4dd-4510-9be8-cf298d4201ea req-6c17256e-6ef4-467c-ae9e-c7b9538eecd2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:38:56.709225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6693263b-b4dd-4510-9be8-cf298d4201ea req-6c17256e-6ef4-467c-ae9e-c7b9538eecd2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:38:56.709943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6693263b-b4dd-4510-9be8-cf298d4201ea req-6c17256e-6ef4-467c-ae9e-c7b9538eecd2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:38:56.731914 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6693263b-b4dd-4510-9be8-cf298d4201ea req-6c17256e-6ef4-467c-ae9e-c7b9538eecd2 service nova] Creating event network-changed:2cb9fafa-10b3-4f28-9306-822fe0c76b7e for instance 28a28582-acdd-4109-a7c4-9a4a495a60bc on n-h2-853611-3 Aug 18 12:38:56.738550 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-6693263b-b4dd-4510-9be8-cf298d4201ea req-6c17256e-6ef4-467c-ae9e-c7b9538eecd2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047908 Aug 18 12:38:56.739613 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4375/7029] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:39:58.835806 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:39:58.836688 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:39:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:40:28.959092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=10 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:40:28.960038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=20 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:40:28.964855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-63045ed7-c87f-4a64-83cb-7889ef473f8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:40:28.968217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-63045ed7-c87f-4a64-83cb-7889ef473f8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:40:28.975813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63045ed7-c87f-4a64-83cb-7889ef473f8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:40:28.976335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63045ed7-c87f-4a64-83cb-7889ef473f8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:40:28.976792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63045ed7-c87f-4a64-83cb-7889ef473f8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:40:28.977528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63045ed7-c87f-4a64-83cb-7889ef473f8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:40:28.978001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63045ed7-c87f-4a64-83cb-7889ef473f8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:40:28.978472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63045ed7-c87f-4a64-83cb-7889ef473f8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:40:29.070939 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-63045ed7-c87f-4a64-83cb-7889ef473f8d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "POST /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/action" status: 202 len: 0 microversion: 2.1 time: 0.114259 Aug 18 12:40:29.071599 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4376/7030] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:40:28 2022] POST /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:40:29.082360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-53c97f40-dc6b-4ae9-b5d4-8141324477c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:40:29.083135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-53c97f40-dc6b-4ae9-b5d4-8141324477c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:40:29.090030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53c97f40-dc6b-4ae9-b5d4-8141324477c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:40:29.090851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53c97f40-dc6b-4ae9-b5d4-8141324477c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:40:29.091793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53c97f40-dc6b-4ae9-b5d4-8141324477c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:40:29.092765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53c97f40-dc6b-4ae9-b5d4-8141324477c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:40:29.093385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53c97f40-dc6b-4ae9-b5d4-8141324477c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:40:29.093690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53c97f40-dc6b-4ae9-b5d4-8141324477c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:40:29.379963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-53c97f40-dc6b-4ae9-b5d4-8141324477c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:40:29.391484 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-53c97f40-dc6b-4ae9-b5d4-8141324477c3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1759 microversion: 2.1 time: 0.313921 Aug 18 12:40:29.392561 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4377/7031] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:40:29 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1759 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:40:30.420573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4e12cf0c-2ab5-4ea7-8072-8acd1ad0580c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:40:30.423001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4e12cf0c-2ab5-4ea7-8072-8acd1ad0580c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:40:30.439722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e12cf0c-2ab5-4ea7-8072-8acd1ad0580c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:40:30.440478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e12cf0c-2ab5-4ea7-8072-8acd1ad0580c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:40:30.441142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e12cf0c-2ab5-4ea7-8072-8acd1ad0580c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:40:30.442252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e12cf0c-2ab5-4ea7-8072-8acd1ad0580c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:40:30.442982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e12cf0c-2ab5-4ea7-8072-8acd1ad0580c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:40:30.443629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e12cf0c-2ab5-4ea7-8072-8acd1ad0580c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:40:30.679073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4e12cf0c-2ab5-4ea7-8072-8acd1ad0580c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:40:30.694271 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4e12cf0c-2ab5-4ea7-8072-8acd1ad0580c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1757 microversion: 2.1 time: 0.279671 Aug 18 12:40:30.695193 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4378/7032] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:40:30 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1757 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:41:40.201072 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:41:40.201961 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:41:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:41:43.747237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=6 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:41:43.748250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:41:43.753265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11b06d38-4ce4-4194-a974-4984fe06eaf8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-307422656"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:41:43.753835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-11b06d38-4ce4-4194-a974-4984fe06eaf8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:41:43.762380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11b06d38-4ce4-4194-a974-4984fe06eaf8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:43.763344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11b06d38-4ce4-4194-a974-4984fe06eaf8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:43.763495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11b06d38-4ce4-4194-a974-4984fe06eaf8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:43.764127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11b06d38-4ce4-4194-a974-4984fe06eaf8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:43.764606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11b06d38-4ce4-4194-a974-4984fe06eaf8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:43.765049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11b06d38-4ce4-4194-a974-4984fe06eaf8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:43.938516 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.network.security_group_api [None req-11b06d38-4ce4-4194-a974-4984fe06eaf8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Removing security group f87eda26-ffa8-404d-a810-34ea5a7a9296 from port 2cb9fafa-10b3-4f28-9306-822fe0c76b7e Aug 18 12:41:44.444535 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-11b06d38-4ce4-4194-a974-4984fe06eaf8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "POST /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/action" status: 202 len: 0 microversion: 2.1 time: 0.697131 Aug 18 12:41:44.448076 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4379/7033] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:41:43 2022] POST /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:41:44.527719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-528aea00-9ef0-4d1c-946b-0a98a53cfaf5 req-18d75a1b-261d-4c2b-b34e-1ae881d54c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a28582-acdd-4109-a7c4-9a4a495a60bc", "tag": "2cb9fafa-10b3-4f28-9306-822fe0c76b7e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:41:44.541402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-528aea00-9ef0-4d1c-946b-0a98a53cfaf5 req-18d75a1b-261d-4c2b-b34e-1ae881d54c62 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:44.542070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-528aea00-9ef0-4d1c-946b-0a98a53cfaf5 req-18d75a1b-261d-4c2b-b34e-1ae881d54c62 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:44.542675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-528aea00-9ef0-4d1c-946b-0a98a53cfaf5 req-18d75a1b-261d-4c2b-b34e-1ae881d54c62 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:44.561740 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-528aea00-9ef0-4d1c-946b-0a98a53cfaf5 req-18d75a1b-261d-4c2b-b34e-1ae881d54c62 service nova] Creating event network-changed:2cb9fafa-10b3-4f28-9306-822fe0c76b7e for instance 28a28582-acdd-4109-a7c4-9a4a495a60bc on n-h2-853611-3 Aug 18 12:41:44.572197 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-528aea00-9ef0-4d1c-946b-0a98a53cfaf5 req-18d75a1b-261d-4c2b-b34e-1ae881d54c62 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122555 Aug 18 12:41:44.573219 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4380/7034] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:41:46.216383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-33f38454-813e-4218-9a45-d544807faf67 req-83803084-0fec-406e-96d8-0115b4dda08e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a28582-acdd-4109-a7c4-9a4a495a60bc", "tag": "2cb9fafa-10b3-4f28-9306-822fe0c76b7e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:41:46.228209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-33f38454-813e-4218-9a45-d544807faf67 req-83803084-0fec-406e-96d8-0115b4dda08e service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:46.228914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-33f38454-813e-4218-9a45-d544807faf67 req-83803084-0fec-406e-96d8-0115b4dda08e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:46.229440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-33f38454-813e-4218-9a45-d544807faf67 req-83803084-0fec-406e-96d8-0115b4dda08e service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:46.244411 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-33f38454-813e-4218-9a45-d544807faf67 req-83803084-0fec-406e-96d8-0115b4dda08e service nova] Creating event network-changed:2cb9fafa-10b3-4f28-9306-822fe0c76b7e for instance 28a28582-acdd-4109-a7c4-9a4a495a60bc on n-h2-853611-3 Aug 18 12:41:46.250536 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-33f38454-813e-4218-9a45-d544807faf67 req-83803084-0fec-406e-96d8-0115b4dda08e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134643 Aug 18 12:41:46.251140 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4381/7035] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:41:46.257001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-90f449b3-2ed9-407f-a1f6-b80c9f40bc0d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:41:46.257742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-90f449b3-2ed9-407f-a1f6-b80c9f40bc0d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:41:46.265411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f449b3-2ed9-407f-a1f6-b80c9f40bc0d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:46.265915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f449b3-2ed9-407f-a1f6-b80c9f40bc0d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:46.266380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f449b3-2ed9-407f-a1f6-b80c9f40bc0d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:46.267211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f449b3-2ed9-407f-a1f6-b80c9f40bc0d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:46.267887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f449b3-2ed9-407f-a1f6-b80c9f40bc0d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:46.268327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90f449b3-2ed9-407f-a1f6-b80c9f40bc0d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:46.397902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-90f449b3-2ed9-407f-a1f6-b80c9f40bc0d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lazy-loading 'services' on Instance uuid 28a28582-acdd-4109-a7c4-9a4a495a60bc {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:41:46.544134 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-90f449b3-2ed9-407f-a1f6-b80c9f40bc0d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "DELETE /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments/ecdd33dd-54d8-4132-ba4a-8cb120ca0c4e" status: 202 len: 0 microversion: 2.1 time: 0.290088 Aug 18 12:41:46.545226 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4382/7036] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 12:41:46 2022] DELETE /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments/ecdd33dd-54d8-4132-ba4a-8cb120ca0c4e => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:41:46.563502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-09f8e0a2-52f0-48ee-998f-08eb7cae45ba tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:41:46.568089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-09f8e0a2-52f0-48ee-998f-08eb7cae45ba tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:41:46.595573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09f8e0a2-52f0-48ee-998f-08eb7cae45ba tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:46.596514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09f8e0a2-52f0-48ee-998f-08eb7cae45ba tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:46.597356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09f8e0a2-52f0-48ee-998f-08eb7cae45ba tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:46.599543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09f8e0a2-52f0-48ee-998f-08eb7cae45ba tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:46.599796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09f8e0a2-52f0-48ee-998f-08eb7cae45ba tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:46.607619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09f8e0a2-52f0-48ee-998f-08eb7cae45ba tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:46.687810 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-09f8e0a2-52f0-48ee-998f-08eb7cae45ba tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128488 Aug 18 12:41:46.687810 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4383/7037] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:41:46 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:41:47.701442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5119e44f-9e4f-4dcd-95d3-dbfeffb73d87 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:41:47.705265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5119e44f-9e4f-4dcd-95d3-dbfeffb73d87 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:41:47.717499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5119e44f-9e4f-4dcd-95d3-dbfeffb73d87 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:47.718343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5119e44f-9e4f-4dcd-95d3-dbfeffb73d87 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:47.719175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5119e44f-9e4f-4dcd-95d3-dbfeffb73d87 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:47.720461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5119e44f-9e4f-4dcd-95d3-dbfeffb73d87 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:47.721128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5119e44f-9e4f-4dcd-95d3-dbfeffb73d87 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:47.721758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5119e44f-9e4f-4dcd-95d3-dbfeffb73d87 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:47.758503 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5119e44f-9e4f-4dcd-95d3-dbfeffb73d87 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062731 Aug 18 12:41:47.759118 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4384/7038] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:41:47 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:41:48.775578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-67a79779-714f-4de7-be84-5d1b838e000b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:41:48.779567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-67a79779-714f-4de7-be84-5d1b838e000b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:41:48.788176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-67a79779-714f-4de7-be84-5d1b838e000b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:48.788893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-67a79779-714f-4de7-be84-5d1b838e000b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:48.789466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-67a79779-714f-4de7-be84-5d1b838e000b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:48.790328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-67a79779-714f-4de7-be84-5d1b838e000b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:48.790947 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-67a79779-714f-4de7-be84-5d1b838e000b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:48.791498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-67a79779-714f-4de7-be84-5d1b838e000b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:48.831578 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-67a79779-714f-4de7-be84-5d1b838e000b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062721 Aug 18 12:41:48.832190 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4385/7039] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:41:48 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:41:49.848047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e6965603-b17a-4b86-807d-d5e78b36a92c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:41:49.851617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e6965603-b17a-4b86-807d-d5e78b36a92c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:41:49.862410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6965603-b17a-4b86-807d-d5e78b36a92c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:49.863377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6965603-b17a-4b86-807d-d5e78b36a92c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:49.864218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6965603-b17a-4b86-807d-d5e78b36a92c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:49.865567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6965603-b17a-4b86-807d-d5e78b36a92c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:49.866420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6965603-b17a-4b86-807d-d5e78b36a92c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:49.867243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e6965603-b17a-4b86-807d-d5e78b36a92c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:49.928072 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e6965603-b17a-4b86-807d-d5e78b36a92c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084417 Aug 18 12:41:49.928950 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4386/7040] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:41:49 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:41:50.949343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-50a81b08-b4bf-4573-ac0d-f75a9b213971 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:41:50.953293 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-50a81b08-b4bf-4573-ac0d-f75a9b213971 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:41:50.966537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50a81b08-b4bf-4573-ac0d-f75a9b213971 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:50.967404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50a81b08-b4bf-4573-ac0d-f75a9b213971 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:50.968322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50a81b08-b4bf-4573-ac0d-f75a9b213971 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:50.969657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50a81b08-b4bf-4573-ac0d-f75a9b213971 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:50.970592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50a81b08-b4bf-4573-ac0d-f75a9b213971 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:50.971364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50a81b08-b4bf-4573-ac0d-f75a9b213971 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:51.020101 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-50a81b08-b4bf-4573-ac0d-f75a9b213971 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078321 Aug 18 12:41:51.021004 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4387/7041] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:41:50 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:41:52.034521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-09a51a5c-ef9a-4498-bb8e-ae9fa1b2fa2f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:41:52.036824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-09a51a5c-ef9a-4498-bb8e-ae9fa1b2fa2f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:41:52.045652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09a51a5c-ef9a-4498-bb8e-ae9fa1b2fa2f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:52.046167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09a51a5c-ef9a-4498-bb8e-ae9fa1b2fa2f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:52.046661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09a51a5c-ef9a-4498-bb8e-ae9fa1b2fa2f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:52.047407 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09a51a5c-ef9a-4498-bb8e-ae9fa1b2fa2f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:52.047887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09a51a5c-ef9a-4498-bb8e-ae9fa1b2fa2f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:52.048336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-09a51a5c-ef9a-4498-bb8e-ae9fa1b2fa2f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:52.090030 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-09a51a5c-ef9a-4498-bb8e-ae9fa1b2fa2f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059281 Aug 18 12:41:52.091735 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4388/7042] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:41:52 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 12:41:52.103476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-617ba8e2-9a47-46a2-bc3e-3a6dafc167f5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:41:52.104002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-617ba8e2-9a47-46a2-bc3e-3a6dafc167f5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:41:52.116628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-617ba8e2-9a47-46a2-bc3e-3a6dafc167f5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:52.117151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-617ba8e2-9a47-46a2-bc3e-3a6dafc167f5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:52.117618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-617ba8e2-9a47-46a2-bc3e-3a6dafc167f5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:52.118373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-617ba8e2-9a47-46a2-bc3e-3a6dafc167f5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:52.118900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-617ba8e2-9a47-46a2-bc3e-3a6dafc167f5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:52.119352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-617ba8e2-9a47-46a2-bc3e-3a6dafc167f5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:52.211112 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-617ba8e2-9a47-46a2-bc3e-3a6dafc167f5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] HTTP exception thrown: Instance 28a28582-acdd-4109-a7c4-9a4a495a60bc is not attached to volume ecdd33dd-54d8-4132-ba4a-8cb120ca0c4e Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-617ba8e2-9a47-46a2-bc3e-3a6dafc167f5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Request method failure captured: Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments/ecdd33dd-54d8-4132-ba4a-8cb120ca0c4e HTTP/1.1 Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jKjcsUgtgWTzYovp0vDXYdgZIO730Mcf3qEh2rHBztvzm68wv91irHoLc_BKh_7fdXHRfd5BFSt2OADJr1fqKq3dav6O5IZ0iffvw0QgYpluCGKsQ9FQ7dNBaYJlRj0hOZAURpohb-lUnUgMHtKj_hWIMf5KsUVSA_gEtXr0UhHPqU Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6254faa7d5e34f2092f213aa2bc0ae42 Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestMinimumBasicScenario-1222071027 Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestMinimumBasicScenario-1222071027 Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6254faa7d5e34f2092f213aa2bc0ae42 Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1222071027 Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestMinimumBasicScenario-1222071027-project Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 9bb8acb005ee49a9ba883f7427750440 Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestMinimumBasicScenario-1222071027-project Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 28a28582-acdd-4109-a7c4-9a4a495a60bc is not attached to volume ecdd33dd-54d8-4132-ba4a-8cb120ca0c4e Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': '28a28582-acdd-4109-a7c4-9a4a495a60bc', 'id': 'ecdd33dd-54d8-4132-ba4a-8cb120ca0c4e'} Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ecdd33dd-54d8-4132-ba4a-8cb120ca0c4e. Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a28582-acdd-4109-a7c4-9a4a495a60bc is not attached to volume ecdd33dd-54d8-4132-ba4a-8cb120ca0c4e Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:41:52.212850 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:41:52.220885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:41:52.220885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:41:52.220885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a28582-acdd-4109-a7c4-9a4a495a60bc is not attached to volume ecdd33dd-54d8-4132-ba4a-8cb120ca0c4e Aug 18 12:41:52.220885 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:41:52.220885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-617ba8e2-9a47-46a2-bc3e-3a6dafc167f5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Returning 404 to user: Instance 28a28582-acdd-4109-a7c4-9a4a495a60bc is not attached to volume ecdd33dd-54d8-4132-ba4a-8cb120ca0c4e {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:41:52.220885 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-617ba8e2-9a47-46a2-bc3e-3a6dafc167f5 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "DELETE /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments/ecdd33dd-54d8-4132-ba4a-8cb120ca0c4e" status: 404 len: 154 microversion: 2.1 time: 0.115464 Aug 18 12:41:52.220885 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4389/7043] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 12:41:52 2022] DELETE /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc/os-volume_attachments/ecdd33dd-54d8-4132-ba4a-8cb120ca0c4e => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:41:55.594265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d3d486fc-e1aa-4cb4-a3d6-cfa7af47a2d3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:41:55.595128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3d486fc-e1aa-4cb4-a3d6-cfa7af47a2d3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:41:55.609124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3d486fc-e1aa-4cb4-a3d6-cfa7af47a2d3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:55.609898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3d486fc-e1aa-4cb4-a3d6-cfa7af47a2d3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:55.610713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3d486fc-e1aa-4cb4-a3d6-cfa7af47a2d3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:55.612012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3d486fc-e1aa-4cb4-a3d6-cfa7af47a2d3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:55.612855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3d486fc-e1aa-4cb4-a3d6-cfa7af47a2d3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:55.613655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d3d486fc-e1aa-4cb4-a3d6-cfa7af47a2d3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:55.667243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d3d486fc-e1aa-4cb4-a3d6-cfa7af47a2d3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:41:55.803431 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d3d486fc-e1aa-4cb4-a3d6-cfa7af47a2d3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "DELETE /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 204 len: 0 microversion: 2.1 time: 0.216131 Aug 18 12:41:55.804413 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4390/7044] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:41:55 2022] DELETE /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:41:55.817275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-97b83707-b365-4fc6-baf0-f4027e9a3870 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:41:55.818171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-97b83707-b365-4fc6-baf0-f4027e9a3870 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:41:55.827647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97b83707-b365-4fc6-baf0-f4027e9a3870 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:55.828253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97b83707-b365-4fc6-baf0-f4027e9a3870 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:55.828877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97b83707-b365-4fc6-baf0-f4027e9a3870 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:55.829786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97b83707-b365-4fc6-baf0-f4027e9a3870 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:55.830465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97b83707-b365-4fc6-baf0-f4027e9a3870 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:55.831201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97b83707-b365-4fc6-baf0-f4027e9a3870 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:56.047076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-97b83707-b365-4fc6-baf0-f4027e9a3870 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:41:56.058975 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-97b83707-b365-4fc6-baf0-f4027e9a3870 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1552 microversion: 2.1 time: 0.246864 Aug 18 12:41:56.060291 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4391/7045] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:41:55 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1552 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:41:56.774127 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:41:56.774952 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:41:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:41:57.087023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-70a8622a-f0f9-4b2d-bffd-0abba4b7a536 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:41:57.087829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-70a8622a-f0f9-4b2d-bffd-0abba4b7a536 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:41:57.096507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70a8622a-f0f9-4b2d-bffd-0abba4b7a536 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:57.097024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70a8622a-f0f9-4b2d-bffd-0abba4b7a536 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:57.097485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70a8622a-f0f9-4b2d-bffd-0abba4b7a536 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:57.098308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70a8622a-f0f9-4b2d-bffd-0abba4b7a536 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:57.098760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70a8622a-f0f9-4b2d-bffd-0abba4b7a536 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:57.099201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70a8622a-f0f9-4b2d-bffd-0abba4b7a536 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:57.264854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-70a8622a-f0f9-4b2d-bffd-0abba4b7a536 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:41:57.273261 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-70a8622a-f0f9-4b2d-bffd-0abba4b7a536 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1552 microversion: 2.1 time: 0.190398 Aug 18 12:41:57.273874 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4392/7046] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:41:57 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1552 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:41:58.009456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-e2954963-6c58-4057-839d-9b11f752e0fb req-e78deeb3-adfb-4826-8e81-62dc12f15247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a28582-acdd-4109-a7c4-9a4a495a60bc", "name": "network-vif-deleted", "tag": "2cb9fafa-10b3-4f28-9306-822fe0c76b7e"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:41:58.027575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e2954963-6c58-4057-839d-9b11f752e0fb req-e78deeb3-adfb-4826-8e81-62dc12f15247 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:58.028919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e2954963-6c58-4057-839d-9b11f752e0fb req-e78deeb3-adfb-4826-8e81-62dc12f15247 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:58.029747 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e2954963-6c58-4057-839d-9b11f752e0fb req-e78deeb3-adfb-4826-8e81-62dc12f15247 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:58.052260 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e2954963-6c58-4057-839d-9b11f752e0fb req-e78deeb3-adfb-4826-8e81-62dc12f15247 service nova] Creating event network-vif-deleted:2cb9fafa-10b3-4f28-9306-822fe0c76b7e for instance 28a28582-acdd-4109-a7c4-9a4a495a60bc on n-h2-853611-3 Aug 18 12:41:58.061944 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-e2954963-6c58-4057-839d-9b11f752e0fb req-e78deeb3-adfb-4826-8e81-62dc12f15247 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059107 Aug 18 12:41:58.063215 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4393/7047] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:41:58.298597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de759afd-c281-4f6e-9f87-f5246f59cc34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:41:58.299840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-de759afd-c281-4f6e-9f87-f5246f59cc34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:41:58.307704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de759afd-c281-4f6e-9f87-f5246f59cc34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:58.308403 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de759afd-c281-4f6e-9f87-f5246f59cc34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:58.308972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de759afd-c281-4f6e-9f87-f5246f59cc34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:58.310634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de759afd-c281-4f6e-9f87-f5246f59cc34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:58.311345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de759afd-c281-4f6e-9f87-f5246f59cc34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:58.311933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de759afd-c281-4f6e-9f87-f5246f59cc34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:58.357044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de759afd-c281-4f6e-9f87-f5246f59cc34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:58.357766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de759afd-c281-4f6e-9f87-f5246f59cc34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:58.358226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-de759afd-c281-4f6e-9f87-f5246f59cc34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:58.358757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-de759afd-c281-4f6e-9f87-f5246f59cc34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lazy-loading 'fault' on Instance uuid 28a28582-acdd-4109-a7c4-9a4a495a60bc {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:41:58.435193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-de759afd-c281-4f6e-9f87-f5246f59cc34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:41:58.447201 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de759afd-c281-4f6e-9f87-f5246f59cc34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 200 len: 1347 microversion: 2.1 time: 0.154901 Aug 18 12:41:58.448375 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4394/7048] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:41:58 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 1347 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:41:59.472961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-263bef61-7d3d-4f89-98a8-8f28aec07fa9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:41:59.479732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-263bef61-7d3d-4f89-98a8-8f28aec07fa9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 28a28582-acdd-4109-a7c4-9a4a495a60bc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:41:59.491585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-263bef61-7d3d-4f89-98a8-8f28aec07fa9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:59.492279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-263bef61-7d3d-4f89-98a8-8f28aec07fa9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:59.492870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-263bef61-7d3d-4f89-98a8-8f28aec07fa9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:59.493858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-263bef61-7d3d-4f89-98a8-8f28aec07fa9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:41:59.494718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-263bef61-7d3d-4f89-98a8-8f28aec07fa9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:41:59.495328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-263bef61-7d3d-4f89-98a8-8f28aec07fa9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:41:59.502756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:41:59.519947 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-263bef61-7d3d-4f89-98a8-8f28aec07fa9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] HTTP exception thrown: Instance 28a28582-acdd-4109-a7c4-9a4a495a60bc could not be found. Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-263bef61-7d3d-4f89-98a8-8f28aec07fa9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Request method failure captured: Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc HTTP/1.1 Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jKjcsUgtgWTzYovp0vDXYdgZIO730Mcf3qEh2rHBztvzm68wv91irHoLc_BKh_7fdXHRfd5BFSt2OADJr1fqKq3dav6O5IZ0iffvw0QgYpluCGKsQ9FQ7dNBaYJlRj0hOZAURpohb-lUnUgMHtKj_hWIMf5KsUVSA_gEtXr0UhHPqU Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6254faa7d5e34f2092f213aa2bc0ae42 Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestMinimumBasicScenario-1222071027 Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestMinimumBasicScenario-1222071027 Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6254faa7d5e34f2092f213aa2bc0ae42 Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1222071027 Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestMinimumBasicScenario-1222071027-project Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 9bb8acb005ee49a9ba883f7427750440 Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestMinimumBasicScenario-1222071027-project Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 28a28582-acdd-4109-a7c4-9a4a495a60bc could not be found. Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '28a28582-acdd-4109-a7c4-9a4a495a60bc'} Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28a28582-acdd-4109-a7c4-9a4a495a60bc could not be found. Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a28582-acdd-4109-a7c4-9a4a495a60bc could not be found. Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:41:59.522751 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:41:59.529345 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:41:59.529345 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:41:59.529345 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:41:59.529345 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:41:59.529345 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:41:59.529345 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a28582-acdd-4109-a7c4-9a4a495a60bc could not be found. Aug 18 12:41:59.529345 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:41:59.532150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-263bef61-7d3d-4f89-98a8-8f28aec07fa9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Returning 404 to user: Instance 28a28582-acdd-4109-a7c4-9a4a495a60bc could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:41:59.533344 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-263bef61-7d3d-4f89-98a8-8f28aec07fa9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc" status: 404 len: 111 microversion: 2.1 time: 0.066884 Aug 18 12:41:59.534198 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4395/7049] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:41:59 2022] GET /compute/v2.1/servers/28a28582-acdd-4109-a7c4-9a4a495a60bc => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:41:59.548303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c7ab201f-e5b3-46a7-93bd-dff952ce8a2c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '.version_select at 0x7f519efa1a60>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:41:59.583919 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c7ab201f-e5b3-46a7-93bd-dff952ce8a2c tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-913523775" status: 202 len: 0 microversion: 2.1 time: 0.043958 Aug 18 12:41:59.590180 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4396/7050] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 12:41:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-913523775 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:42:10.502615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:42:10.507035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d9cb5887-3ada-479c-98c3-e25f73e54df6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Action: 'create', calling method: .version_select at 0x7f519f060670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-241329777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTTKsPNKY4pwjF2fFMaJAzHy9XqMiefrOshcOUVgxfLcx8Hqa0y13kOfnh9Br2Cjrgoe5k5wL96jhs7V0bSTh8oCtyx2q6S99iXr9TkhYtAiGR4Vf9j9AoKu5mAp3J82Q=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:42:10.531536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d9cb5887-3ada-479c-98c3-e25f73e54df6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Getting quotas for project 6254faa7d5e34f2092f213aa2bc0ae42. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:42:10.543354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-d9cb5887-3ada-479c-98c3-e25f73e54df6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Getting quotas for user 9bb8acb005ee49a9ba883f7427750440 and project 6254faa7d5e34f2092f213aa2bc0ae42. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:42:10.587946 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d9cb5887-3ada-479c-98c3-e25f73e54df6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.087114 Aug 18 12:42:10.588540 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4397/7051] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:42:10 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:42:10.653458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-267460222", "imageRef": "d3f6e3e3-d2e8-476f-ae1c-770a61a67815", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-241329777", "networks": [{"uuid": "eb7cce60-ff5d-49f8-89a6-512c950591ad"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:42:10.726275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] validate_networks() for [('eb7cce60-ff5d-49f8-89a6-512c950591ad', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:42:11.298328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:42:11.299144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:42:11.300018 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:42:11.300775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:42:11.301477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:42:11.316988 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:11.317889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:11.318622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:11.319903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:11.320746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:11.321432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:11.356823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Getting quotas for project 6254faa7d5e34f2092f213aa2bc0ae42. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:42:11.365192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Getting quotas for user 9bb8acb005ee49a9ba883f7427750440 and project 6254faa7d5e34f2092f213aa2bc0ae42. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:42:11.381090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:42:11.383446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d3f6e3e3-d2e8-476f-ae1c-770a61a67815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:42:11.433636 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5c14891d-ea76-4389-94fd-944f43121b91 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.784160 Aug 18 12:42:11.434964 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4398/7052] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:42:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:42:11.446755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b514bc3-cb93-429d-8949-73a2ec887b22 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:11.447563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9b514bc3-cb93-429d-8949-73a2ec887b22 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:11.522695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9b514bc3-cb93-429d-8949-73a2ec887b22 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:11.536375 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b514bc3-cb93-429d-8949-73a2ec887b22 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1257 microversion: 2.1 time: 0.093900 Aug 18 12:42:11.537214 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4399/7053] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:11 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1257 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:12.560827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3ae0f71f-1de6-40e8-bac7-eecbeef894f1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:12.561870 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3ae0f71f-1de6-40e8-bac7-eecbeef894f1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:12.570050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ae0f71f-1de6-40e8-bac7-eecbeef894f1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:12.570638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ae0f71f-1de6-40e8-bac7-eecbeef894f1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:12.571247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ae0f71f-1de6-40e8-bac7-eecbeef894f1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:12.572030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ae0f71f-1de6-40e8-bac7-eecbeef894f1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:12.572510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ae0f71f-1de6-40e8-bac7-eecbeef894f1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:12.573097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3ae0f71f-1de6-40e8-bac7-eecbeef894f1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:12.653169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3ae0f71f-1de6-40e8-bac7-eecbeef894f1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:12.663515 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3ae0f71f-1de6-40e8-bac7-eecbeef894f1 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1309 microversion: 2.1 time: 0.107989 Aug 18 12:42:12.664212 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4400/7054] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:12 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:13.697457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26897e00-6ac9-4093-bb8d-6f18bf400f7b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:13.702648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26897e00-6ac9-4093-bb8d-6f18bf400f7b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:13.725342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26897e00-6ac9-4093-bb8d-6f18bf400f7b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:13.726722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26897e00-6ac9-4093-bb8d-6f18bf400f7b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:13.728231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26897e00-6ac9-4093-bb8d-6f18bf400f7b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:13.730182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26897e00-6ac9-4093-bb8d-6f18bf400f7b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:13.732418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26897e00-6ac9-4093-bb8d-6f18bf400f7b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:13.734082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26897e00-6ac9-4093-bb8d-6f18bf400f7b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:13.896327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-26897e00-6ac9-4093-bb8d-6f18bf400f7b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:13.928932 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-26897e00-6ac9-4093-bb8d-6f18bf400f7b tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1315 microversion: 2.1 time: 0.243183 Aug 18 12:42:13.931541 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4401/7055] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:13 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:14.970857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-95f40ddc-1e03-425f-964d-7d94cc251670 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:14.972570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-95f40ddc-1e03-425f-964d-7d94cc251670 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:14.983448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95f40ddc-1e03-425f-964d-7d94cc251670 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:14.984186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95f40ddc-1e03-425f-964d-7d94cc251670 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:14.984724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95f40ddc-1e03-425f-964d-7d94cc251670 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:14.985691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95f40ddc-1e03-425f-964d-7d94cc251670 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:14.986660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95f40ddc-1e03-425f-964d-7d94cc251670 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:14.987121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95f40ddc-1e03-425f-964d-7d94cc251670 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:15.221367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-95f40ddc-1e03-425f-964d-7d94cc251670 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:15.236856 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-95f40ddc-1e03-425f-964d-7d94cc251670 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1357 microversion: 2.1 time: 0.271237 Aug 18 12:42:15.238230 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4402/7056] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:14 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1357 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:16.279894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d063cefc-0089-48d8-8da1-b202e30382d2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:16.282141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d063cefc-0089-48d8-8da1-b202e30382d2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:16.293761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d063cefc-0089-48d8-8da1-b202e30382d2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:16.294703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d063cefc-0089-48d8-8da1-b202e30382d2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:16.295375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d063cefc-0089-48d8-8da1-b202e30382d2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:16.296145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d063cefc-0089-48d8-8da1-b202e30382d2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:16.297029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d063cefc-0089-48d8-8da1-b202e30382d2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:16.297476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d063cefc-0089-48d8-8da1-b202e30382d2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:16.516915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d063cefc-0089-48d8-8da1-b202e30382d2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:16.527805 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d063cefc-0089-48d8-8da1-b202e30382d2 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1357 microversion: 2.1 time: 0.255671 Aug 18 12:42:16.529037 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4403/7057] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:16 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:17.554359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-060bac7b-187a-445d-80b7-aea2008aea5a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:17.555803 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-060bac7b-187a-445d-80b7-aea2008aea5a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:17.575430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-060bac7b-187a-445d-80b7-aea2008aea5a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:17.577851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-060bac7b-187a-445d-80b7-aea2008aea5a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:17.579171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-060bac7b-187a-445d-80b7-aea2008aea5a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:17.581517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-060bac7b-187a-445d-80b7-aea2008aea5a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:17.582908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-060bac7b-187a-445d-80b7-aea2008aea5a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:17.583972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-060bac7b-187a-445d-80b7-aea2008aea5a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:17.924826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-060bac7b-187a-445d-80b7-aea2008aea5a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:17.939184 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-060bac7b-187a-445d-80b7-aea2008aea5a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1357 microversion: 2.1 time: 0.389621 Aug 18 12:42:17.940759 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4404/7058] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:17 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1357 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:18.977589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2f237caf-a8f3-4e8e-ac13-13dd66088063 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:18.978968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2f237caf-a8f3-4e8e-ac13-13dd66088063 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:18.988991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f237caf-a8f3-4e8e-ac13-13dd66088063 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:18.989511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f237caf-a8f3-4e8e-ac13-13dd66088063 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:18.989973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f237caf-a8f3-4e8e-ac13-13dd66088063 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:18.990767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f237caf-a8f3-4e8e-ac13-13dd66088063 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:18.991247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f237caf-a8f3-4e8e-ac13-13dd66088063 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:18.991739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2f237caf-a8f3-4e8e-ac13-13dd66088063 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:19.214131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2f237caf-a8f3-4e8e-ac13-13dd66088063 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:19.226837 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2f237caf-a8f3-4e8e-ac13-13dd66088063 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1357 microversion: 2.1 time: 0.253644 Aug 18 12:42:19.228365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4405/7059] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:18 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1357 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:42:20.262745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-87a71b0b-4656-44e7-bb7c-47790ce0f543 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:20.263869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-87a71b0b-4656-44e7-bb7c-47790ce0f543 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:20.274331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87a71b0b-4656-44e7-bb7c-47790ce0f543 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:20.275266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87a71b0b-4656-44e7-bb7c-47790ce0f543 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:20.276103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87a71b0b-4656-44e7-bb7c-47790ce0f543 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:20.277380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87a71b0b-4656-44e7-bb7c-47790ce0f543 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:20.279346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87a71b0b-4656-44e7-bb7c-47790ce0f543 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:20.280221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87a71b0b-4656-44e7-bb7c-47790ce0f543 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:20.464375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-87a71b0b-4656-44e7-bb7c-47790ce0f543 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:20.474048 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-87a71b0b-4656-44e7-bb7c-47790ce0f543 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1357 microversion: 2.1 time: 0.216065 Aug 18 12:42:20.474808 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4406/7060] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:20 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:21.501848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b043e723-bdd1-40b5-9457-f135fb6691e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:21.503145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b043e723-bdd1-40b5-9457-f135fb6691e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:21.508454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:42:21.517791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b043e723-bdd1-40b5-9457-f135fb6691e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:21.518395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b043e723-bdd1-40b5-9457-f135fb6691e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:21.519016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b043e723-bdd1-40b5-9457-f135fb6691e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:21.519900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b043e723-bdd1-40b5-9457-f135fb6691e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:21.520583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b043e723-bdd1-40b5-9457-f135fb6691e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:21.521099 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b043e723-bdd1-40b5-9457-f135fb6691e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:21.539123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:42:21.791649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b043e723-bdd1-40b5-9457-f135fb6691e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:21.803097 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b043e723-bdd1-40b5-9457-f135fb6691e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1357 microversion: 2.1 time: 0.310424 Aug 18 12:42:21.803885 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4407/7061] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:21 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1357 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:21.970683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-033d455e-e6d1-426b-a840-8202ea28d4a2 req-a4e10343-64fe-42b3-a5fe-80b40a22d6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "116d561d-d592-4dfe-b0e4-f03a599c91fa", "tag": "9a20a20a-3516-47ad-bf53-e9f8fbc5ed10"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:42:21.992368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-033d455e-e6d1-426b-a840-8202ea28d4a2 req-a4e10343-64fe-42b3-a5fe-80b40a22d6a7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:21.992726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-033d455e-e6d1-426b-a840-8202ea28d4a2 req-a4e10343-64fe-42b3-a5fe-80b40a22d6a7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:21.993286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-033d455e-e6d1-426b-a840-8202ea28d4a2 req-a4e10343-64fe-42b3-a5fe-80b40a22d6a7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:22.013295 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-033d455e-e6d1-426b-a840-8202ea28d4a2 req-a4e10343-64fe-42b3-a5fe-80b40a22d6a7 service nova] Creating event network-changed:9a20a20a-3516-47ad-bf53-e9f8fbc5ed10 for instance 116d561d-d592-4dfe-b0e4-f03a599c91fa on n-h2-853611-3 Aug 18 12:42:22.020132 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-033d455e-e6d1-426b-a840-8202ea28d4a2 req-a4e10343-64fe-42b3-a5fe-80b40a22d6a7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057671 Aug 18 12:42:22.021011 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4408/7062] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:42:22.831367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d8706c93-7c77-4560-811d-de07916fff0e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:22.832216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d8706c93-7c77-4560-811d-de07916fff0e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:22.839818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8706c93-7c77-4560-811d-de07916fff0e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:22.841327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8706c93-7c77-4560-811d-de07916fff0e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:22.842108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8706c93-7c77-4560-811d-de07916fff0e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:22.842913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8706c93-7c77-4560-811d-de07916fff0e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:22.843405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8706c93-7c77-4560-811d-de07916fff0e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:22.843866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8706c93-7c77-4560-811d-de07916fff0e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:22.998845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d8706c93-7c77-4560-811d-de07916fff0e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:23.007880 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d8706c93-7c77-4560-811d-de07916fff0e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1357 microversion: 2.1 time: 0.181676 Aug 18 12:42:23.008499 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4409/7063] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:22 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:24.049557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-04e0e316-52e8-46f5-9514-978f433a27f0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:24.051491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-04e0e316-52e8-46f5-9514-978f433a27f0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:24.064436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04e0e316-52e8-46f5-9514-978f433a27f0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:24.065302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04e0e316-52e8-46f5-9514-978f433a27f0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:24.066051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04e0e316-52e8-46f5-9514-978f433a27f0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:24.067351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04e0e316-52e8-46f5-9514-978f433a27f0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:24.068178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04e0e316-52e8-46f5-9514-978f433a27f0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:24.068938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-04e0e316-52e8-46f5-9514-978f433a27f0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:24.272256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-04e0e316-52e8-46f5-9514-978f433a27f0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:24.284609 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-04e0e316-52e8-46f5-9514-978f433a27f0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1357 microversion: 2.1 time: 0.243709 Aug 18 12:42:24.285444 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4410/7064] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:24 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:25.317855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b7cc0c63-e513-4065-af88-4d6f76257d68 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:25.318746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b7cc0c63-e513-4065-af88-4d6f76257d68 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:25.334758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7cc0c63-e513-4065-af88-4d6f76257d68 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:25.335297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7cc0c63-e513-4065-af88-4d6f76257d68 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:25.335776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7cc0c63-e513-4065-af88-4d6f76257d68 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:25.337617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7cc0c63-e513-4065-af88-4d6f76257d68 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:25.339077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7cc0c63-e513-4065-af88-4d6f76257d68 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:25.339585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7cc0c63-e513-4065-af88-4d6f76257d68 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:25.521858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b7cc0c63-e513-4065-af88-4d6f76257d68 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:25.530822 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b7cc0c63-e513-4065-af88-4d6f76257d68 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1357 microversion: 2.1 time: 0.222425 Aug 18 12:42:25.531445 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4411/7065] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:25 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:26.272950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1181b35c-b82e-4820-9347-dded2b507b10 req-a09fb4e5-a6b7-4e79-a3aa-f5056b60ef6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "116d561d-d592-4dfe-b0e4-f03a599c91fa", "name": "network-vif-plugged", "status": "completed", "tag": "9a20a20a-3516-47ad-bf53-e9f8fbc5ed10"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:42:26.284643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1181b35c-b82e-4820-9347-dded2b507b10 req-a09fb4e5-a6b7-4e79-a3aa-f5056b60ef6a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:26.285145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1181b35c-b82e-4820-9347-dded2b507b10 req-a09fb4e5-a6b7-4e79-a3aa-f5056b60ef6a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:26.285604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1181b35c-b82e-4820-9347-dded2b507b10 req-a09fb4e5-a6b7-4e79-a3aa-f5056b60ef6a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:26.302451 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1181b35c-b82e-4820-9347-dded2b507b10 req-a09fb4e5-a6b7-4e79-a3aa-f5056b60ef6a service nova] Creating event network-vif-plugged:9a20a20a-3516-47ad-bf53-e9f8fbc5ed10 for instance 116d561d-d592-4dfe-b0e4-f03a599c91fa on n-h2-853611-3 Aug 18 12:42:26.308146 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1181b35c-b82e-4820-9347-dded2b507b10 req-a09fb4e5-a6b7-4e79-a3aa-f5056b60ef6a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129511 Aug 18 12:42:26.308959 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4412/7066] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:42:26.566645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06410a68-0143-45a0-bca4-c903158545de tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:26.567392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-06410a68-0143-45a0-bca4-c903158545de tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:26.574240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06410a68-0143-45a0-bca4-c903158545de tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:26.574931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06410a68-0143-45a0-bca4-c903158545de tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:26.575768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06410a68-0143-45a0-bca4-c903158545de tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:26.576496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06410a68-0143-45a0-bca4-c903158545de tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:26.576968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06410a68-0143-45a0-bca4-c903158545de tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:26.577406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06410a68-0143-45a0-bca4-c903158545de tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:26.764793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-06410a68-0143-45a0-bca4-c903158545de tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:26.773060 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-06410a68-0143-45a0-bca4-c903158545de tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1357 microversion: 2.1 time: 0.211550 Aug 18 12:42:26.773666 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4413/7067] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:26 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:27.795260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e156c31-7ec3-469c-bec5-86975c71674e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:27.796035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e156c31-7ec3-469c-bec5-86975c71674e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:27.803616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e156c31-7ec3-469c-bec5-86975c71674e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:27.804128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e156c31-7ec3-469c-bec5-86975c71674e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:27.804588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e156c31-7ec3-469c-bec5-86975c71674e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:27.805328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e156c31-7ec3-469c-bec5-86975c71674e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:27.805799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e156c31-7ec3-469c-bec5-86975c71674e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:27.806241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e156c31-7ec3-469c-bec5-86975c71674e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:27.963726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e156c31-7ec3-469c-bec5-86975c71674e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:27.979054 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e156c31-7ec3-469c-bec5-86975c71674e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1546 microversion: 2.1 time: 0.187978 Aug 18 12:42:27.980168 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4414/7068] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:27 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1546 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:28.027670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0006488b-4a5c-4412-8b7e-eddaede5b73e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:28.030369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0006488b-4a5c-4412-8b7e-eddaede5b73e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:28.051816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0006488b-4a5c-4412-8b7e-eddaede5b73e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:28.052706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0006488b-4a5c-4412-8b7e-eddaede5b73e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:28.053505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0006488b-4a5c-4412-8b7e-eddaede5b73e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:28.054819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0006488b-4a5c-4412-8b7e-eddaede5b73e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:28.055700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0006488b-4a5c-4412-8b7e-eddaede5b73e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:28.056576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0006488b-4a5c-4412-8b7e-eddaede5b73e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:28.253748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0006488b-4a5c-4412-8b7e-eddaede5b73e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:28.268896 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0006488b-4a5c-4412-8b7e-eddaede5b73e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1546 microversion: 2.1 time: 0.248458 Aug 18 12:42:28.269936 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4415/7069] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:28 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1546 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:28.290302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec3461d0-c586-4ab0-b8f2-ed7ee5af23a8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:28.296109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ec3461d0-c586-4ab0-b8f2-ed7ee5af23a8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:28.296913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ec3461d0-c586-4ab0-b8f2-ed7ee5af23a8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Searching by: {'deleted': False, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42'} {{(pid=122210) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 18 12:42:28.303025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec3461d0-c586-4ab0-b8f2-ed7ee5af23a8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:28.303531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec3461d0-c586-4ab0-b8f2-ed7ee5af23a8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:28.303990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec3461d0-c586-4ab0-b8f2-ed7ee5af23a8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:28.304776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec3461d0-c586-4ab0-b8f2-ed7ee5af23a8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:28.305263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec3461d0-c586-4ab0-b8f2-ed7ee5af23a8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:28.305719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec3461d0-c586-4ab0-b8f2-ed7ee5af23a8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:28.334042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.multi_cell_list [None req-ec3461d0-c586-4ab0-b8f2-ed7ee5af23a8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 12:42:28.368606 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ec3461d0-c586-4ab0-b8f2-ed7ee5af23a8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.082310 Aug 18 12:42:28.369335 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4416/7070] 10.222.0.73 () {58 vars in 1125 bytes} [Thu Aug 18 12:42:28 2022] GET /compute/v2.1/servers => generated 342 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:42:28.382189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2501c6b7-a9d8-45ec-b380-73ae8ee64122 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:28.382869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2501c6b7-a9d8-45ec-b380-73ae8ee64122 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:28.389710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2501c6b7-a9d8-45ec-b380-73ae8ee64122 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:28.390222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2501c6b7-a9d8-45ec-b380-73ae8ee64122 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:28.390717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2501c6b7-a9d8-45ec-b380-73ae8ee64122 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:28.391459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2501c6b7-a9d8-45ec-b380-73ae8ee64122 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:28.391938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2501c6b7-a9d8-45ec-b380-73ae8ee64122 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:28.392386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2501c6b7-a9d8-45ec-b380-73ae8ee64122 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:28.398183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:42:28.581263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2501c6b7-a9d8-45ec-b380-73ae8ee64122 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:28.589501 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2501c6b7-a9d8-45ec-b380-73ae8ee64122 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1546 microversion: 2.1 time: 0.211332 Aug 18 12:42:28.590102 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4417/7071] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:28 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1546 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:31.335267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8df06dc-4c56-499d-bb1e-4740aa29f3e3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec62f42d-6b67-4c10-9307-fcc1978fb703"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:42:31.337751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e8df06dc-4c56-499d-bb1e-4740aa29f3e3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:31.346798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8df06dc-4c56-499d-bb1e-4740aa29f3e3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:31.347322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8df06dc-4c56-499d-bb1e-4740aa29f3e3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:31.347790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8df06dc-4c56-499d-bb1e-4740aa29f3e3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:31.348543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8df06dc-4c56-499d-bb1e-4740aa29f3e3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:31.349028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8df06dc-4c56-499d-bb1e-4740aa29f3e3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:31.349482 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8df06dc-4c56-499d-bb1e-4740aa29f3e3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:31.656557 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e8df06dc-4c56-499d-bb1e-4740aa29f3e3 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "POST /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325365 Aug 18 12:42:31.657310 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4418/7072] 10.222.0.73 () {60 vars in 1323 bytes} [Thu Aug 18 12:42:31 2022] POST /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:42:43.841259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:42:43.842551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:42:43.843496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:42:43.849160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-70fb6989-918b-43de-97a1-177040c1aabf tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:43.849983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-70fb6989-918b-43de-97a1-177040c1aabf tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:43.869290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70fb6989-918b-43de-97a1-177040c1aabf tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:43.869808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70fb6989-918b-43de-97a1-177040c1aabf tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:43.870276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70fb6989-918b-43de-97a1-177040c1aabf tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:43.871044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70fb6989-918b-43de-97a1-177040c1aabf tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:43.872058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70fb6989-918b-43de-97a1-177040c1aabf tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:43.872883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70fb6989-918b-43de-97a1-177040c1aabf tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:44.122373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-70fb6989-918b-43de-97a1-177040c1aabf tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:44.140360 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-70fb6989-918b-43de-97a1-177040c1aabf tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1592 microversion: 2.1 time: 0.301166 Aug 18 12:42:44.141654 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4419/7073] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:43 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1592 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:42:46.192470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ac8c9b3f-a5f3-49ab-9e27-cbc23753741b req-df79626e-b2a2-46fb-81a5-bd539d23c4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "116d561d-d592-4dfe-b0e4-f03a599c91fa", "tag": "9a20a20a-3516-47ad-bf53-e9f8fbc5ed10"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:42:46.213802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ac8c9b3f-a5f3-49ab-9e27-cbc23753741b req-df79626e-b2a2-46fb-81a5-bd539d23c4b9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:46.214783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ac8c9b3f-a5f3-49ab-9e27-cbc23753741b req-df79626e-b2a2-46fb-81a5-bd539d23c4b9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:46.216159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ac8c9b3f-a5f3-49ab-9e27-cbc23753741b req-df79626e-b2a2-46fb-81a5-bd539d23c4b9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:46.241685 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ac8c9b3f-a5f3-49ab-9e27-cbc23753741b req-df79626e-b2a2-46fb-81a5-bd539d23c4b9 service nova] Creating event network-changed:9a20a20a-3516-47ad-bf53-e9f8fbc5ed10 for instance 116d561d-d592-4dfe-b0e4-f03a599c91fa on n-h2-853611-3 Aug 18 12:42:46.250642 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ac8c9b3f-a5f3-49ab-9e27-cbc23753741b req-df79626e-b2a2-46fb-81a5-bd539d23c4b9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066379 Aug 18 12:42:46.251639 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4420/7074] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:42:47.647777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2ef80827-124e-4e0f-a9ec-aa07c55a8f04 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1868559100"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:42:47.648864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2ef80827-124e-4e0f-a9ec-aa07c55a8f04 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:47.661927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ef80827-124e-4e0f-a9ec-aa07c55a8f04 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:47.662750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ef80827-124e-4e0f-a9ec-aa07c55a8f04 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:47.663899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ef80827-124e-4e0f-a9ec-aa07c55a8f04 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:47.665115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ef80827-124e-4e0f-a9ec-aa07c55a8f04 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:47.666253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ef80827-124e-4e0f-a9ec-aa07c55a8f04 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:47.666987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ef80827-124e-4e0f-a9ec-aa07c55a8f04 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:47.849570 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.network.security_group_api [None req-2ef80827-124e-4e0f-a9ec-aa07c55a8f04 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Adding security group 65eff493-705a-496b-afbb-ec2809aef2a2 to port 9a20a20a-3516-47ad-bf53-e9f8fbc5ed10 Aug 18 12:42:48.291333 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2ef80827-124e-4e0f-a9ec-aa07c55a8f04 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "POST /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/action" status: 202 len: 0 microversion: 2.1 time: 0.649922 Aug 18 12:42:48.298037 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4421/7075] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:42:47 2022] POST /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/action => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:42:48.309851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a98bc469-a442-4cfe-87e4-df471cccbd4d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:42:48.311529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a98bc469-a442-4cfe-87e4-df471cccbd4d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:42:48.324140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a98bc469-a442-4cfe-87e4-df471cccbd4d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:48.325986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a98bc469-a442-4cfe-87e4-df471cccbd4d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:48.327298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a98bc469-a442-4cfe-87e4-df471cccbd4d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:48.329205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a98bc469-a442-4cfe-87e4-df471cccbd4d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:48.330117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a98bc469-a442-4cfe-87e4-df471cccbd4d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:48.330919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a98bc469-a442-4cfe-87e4-df471cccbd4d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:48.606541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a98bc469-a442-4cfe-87e4-df471cccbd4d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:42:48.623273 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a98bc469-a442-4cfe-87e4-df471cccbd4d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1757 microversion: 2.1 time: 0.321995 Aug 18 12:42:48.624761 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4422/7076] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:42:48 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1757 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:42:48.640151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ff3c43d5-77f8-41b3-ac9a-d344cea7acec req-07bc68b3-e9ed-4a16-bd5f-7401209afed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "116d561d-d592-4dfe-b0e4-f03a599c91fa", "tag": "9a20a20a-3516-47ad-bf53-e9f8fbc5ed10"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:42:48.659159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ff3c43d5-77f8-41b3-ac9a-d344cea7acec req-07bc68b3-e9ed-4a16-bd5f-7401209afed3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:42:48.660196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ff3c43d5-77f8-41b3-ac9a-d344cea7acec req-07bc68b3-e9ed-4a16-bd5f-7401209afed3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:42:48.660530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ff3c43d5-77f8-41b3-ac9a-d344cea7acec req-07bc68b3-e9ed-4a16-bd5f-7401209afed3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:42:48.682838 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ff3c43d5-77f8-41b3-ac9a-d344cea7acec req-07bc68b3-e9ed-4a16-bd5f-7401209afed3 service nova] Creating event network-changed:9a20a20a-3516-47ad-bf53-e9f8fbc5ed10 for instance 116d561d-d592-4dfe-b0e4-f03a599c91fa on n-h2-853611-3 Aug 18 12:42:48.693477 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ff3c43d5-77f8-41b3-ac9a-d344cea7acec req-07bc68b3-e9ed-4a16-bd5f-7401209afed3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066515 Aug 18 12:42:48.694222 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4423/7077] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:43:02.791418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=10 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:43:02.792567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=20 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:43:02.851623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bdc12284-3cc4-4240-b33a-3b43240b958e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:43:02.854171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bdc12284-3cc4-4240-b33a-3b43240b958e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:02.861679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdc12284-3cc4-4240-b33a-3b43240b958e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:02.862187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdc12284-3cc4-4240-b33a-3b43240b958e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:02.862677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdc12284-3cc4-4240-b33a-3b43240b958e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:02.863411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdc12284-3cc4-4240-b33a-3b43240b958e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:02.863881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdc12284-3cc4-4240-b33a-3b43240b958e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:02.864316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdc12284-3cc4-4240-b33a-3b43240b958e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:02.956696 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bdc12284-3cc4-4240-b33a-3b43240b958e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "POST /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/action" status: 202 len: 0 microversion: 2.1 time: 0.167050 Aug 18 12:43:02.957468 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4424/7078] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:43:02 2022] POST /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:43:02.969093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-71ebe0e9-339c-4abe-9536-f041c72b6740 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:02.969937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-71ebe0e9-339c-4abe-9536-f041c72b6740 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:02.978538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71ebe0e9-339c-4abe-9536-f041c72b6740 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:02.979373 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71ebe0e9-339c-4abe-9536-f041c72b6740 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:02.980087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71ebe0e9-339c-4abe-9536-f041c72b6740 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:02.981793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71ebe0e9-339c-4abe-9536-f041c72b6740 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:02.982477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71ebe0e9-339c-4abe-9536-f041c72b6740 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:02.983043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-71ebe0e9-339c-4abe-9536-f041c72b6740 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:03.273599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-71ebe0e9-339c-4abe-9536-f041c72b6740 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:03.294560 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-71ebe0e9-339c-4abe-9536-f041c72b6740 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1749 microversion: 2.1 time: 0.330232 Aug 18 12:43:03.296128 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4425/7079] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:02 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1749 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:04.327667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-22fbf4b8-480d-4a20-9ff4-22d363cc8559 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:04.328767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-22fbf4b8-480d-4a20-9ff4-22d363cc8559 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:04.339625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22fbf4b8-480d-4a20-9ff4-22d363cc8559 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:04.341071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22fbf4b8-480d-4a20-9ff4-22d363cc8559 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:04.341941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22fbf4b8-480d-4a20-9ff4-22d363cc8559 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:04.342895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22fbf4b8-480d-4a20-9ff4-22d363cc8559 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:04.343512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22fbf4b8-480d-4a20-9ff4-22d363cc8559 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:04.344058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22fbf4b8-480d-4a20-9ff4-22d363cc8559 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:04.521599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-22fbf4b8-480d-4a20-9ff4-22d363cc8559 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:04.532789 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-22fbf4b8-480d-4a20-9ff4-22d363cc8559 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1754 microversion: 2.1 time: 0.210175 Aug 18 12:43:04.533631 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4426/7080] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:04 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1754 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:05.557173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f4d1b594-9b2a-4ee6-b1df-222b81641966 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:05.558232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f4d1b594-9b2a-4ee6-b1df-222b81641966 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:05.566352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4d1b594-9b2a-4ee6-b1df-222b81641966 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:05.566905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4d1b594-9b2a-4ee6-b1df-222b81641966 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:05.567365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4d1b594-9b2a-4ee6-b1df-222b81641966 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:05.568112 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4d1b594-9b2a-4ee6-b1df-222b81641966 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:05.568593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4d1b594-9b2a-4ee6-b1df-222b81641966 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:05.569054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f4d1b594-9b2a-4ee6-b1df-222b81641966 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:05.770520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f4d1b594-9b2a-4ee6-b1df-222b81641966 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:05.780865 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f4d1b594-9b2a-4ee6-b1df-222b81641966 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1754 microversion: 2.1 time: 0.227647 Aug 18 12:43:05.781554 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4427/7081] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:05 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1754 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:06.803720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d35e062-1309-4e32-b80e-cd754f5ab19f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:06.804505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2d35e062-1309-4e32-b80e-cd754f5ab19f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:06.811919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d35e062-1309-4e32-b80e-cd754f5ab19f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:06.812428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d35e062-1309-4e32-b80e-cd754f5ab19f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:06.812883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d35e062-1309-4e32-b80e-cd754f5ab19f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:06.813618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d35e062-1309-4e32-b80e-cd754f5ab19f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:06.814122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d35e062-1309-4e32-b80e-cd754f5ab19f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:06.814604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d35e062-1309-4e32-b80e-cd754f5ab19f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:06.987985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2d35e062-1309-4e32-b80e-cd754f5ab19f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:06.997597 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d35e062-1309-4e32-b80e-cd754f5ab19f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1754 microversion: 2.1 time: 0.197435 Aug 18 12:43:06.998647 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4428/7082] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:06 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1754 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:08.021900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a68a1772-42da-43a3-92bf-ee0da909b2e9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:08.022820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a68a1772-42da-43a3-92bf-ee0da909b2e9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:08.030854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a68a1772-42da-43a3-92bf-ee0da909b2e9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:08.031369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a68a1772-42da-43a3-92bf-ee0da909b2e9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:08.031823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a68a1772-42da-43a3-92bf-ee0da909b2e9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:08.032567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a68a1772-42da-43a3-92bf-ee0da909b2e9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:08.033037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a68a1772-42da-43a3-92bf-ee0da909b2e9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:08.033478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a68a1772-42da-43a3-92bf-ee0da909b2e9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:08.276537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a68a1772-42da-43a3-92bf-ee0da909b2e9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:08.287826 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a68a1772-42da-43a3-92bf-ee0da909b2e9 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1754 microversion: 2.1 time: 0.270162 Aug 18 12:43:08.288466 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4429/7083] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:08 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1754 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:09.322716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-41274643-2586-43d1-87e2-243e60f35430 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:09.323638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-41274643-2586-43d1-87e2-243e60f35430 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:09.331763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41274643-2586-43d1-87e2-243e60f35430 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:09.332280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41274643-2586-43d1-87e2-243e60f35430 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:09.332745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41274643-2586-43d1-87e2-243e60f35430 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:09.333496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41274643-2586-43d1-87e2-243e60f35430 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:09.333980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41274643-2586-43d1-87e2-243e60f35430 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:09.334451 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-41274643-2586-43d1-87e2-243e60f35430 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:09.553339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-41274643-2586-43d1-87e2-243e60f35430 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:09.564469 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-41274643-2586-43d1-87e2-243e60f35430 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1754 microversion: 2.1 time: 0.245896 Aug 18 12:43:09.565090 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4430/7084] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:09 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1754 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:10.587714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ded9bef6-431a-487b-bbac-0d33bb379583 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:10.588478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ded9bef6-431a-487b-bbac-0d33bb379583 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:10.596318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded9bef6-431a-487b-bbac-0d33bb379583 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:10.596831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded9bef6-431a-487b-bbac-0d33bb379583 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:10.597287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded9bef6-431a-487b-bbac-0d33bb379583 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:10.598049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded9bef6-431a-487b-bbac-0d33bb379583 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:10.598571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded9bef6-431a-487b-bbac-0d33bb379583 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:10.599027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ded9bef6-431a-487b-bbac-0d33bb379583 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:10.778680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ded9bef6-431a-487b-bbac-0d33bb379583 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:10.788030 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ded9bef6-431a-487b-bbac-0d33bb379583 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1754 microversion: 2.1 time: 0.204438 Aug 18 12:43:10.788637 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4431/7085] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:10 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1754 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:11.810880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8552cf80-44d7-4732-84f6-96e17717254a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:11.811625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8552cf80-44d7-4732-84f6-96e17717254a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:11.819627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8552cf80-44d7-4732-84f6-96e17717254a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:11.820283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8552cf80-44d7-4732-84f6-96e17717254a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:11.820808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8552cf80-44d7-4732-84f6-96e17717254a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:11.821643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8552cf80-44d7-4732-84f6-96e17717254a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:11.822413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8552cf80-44d7-4732-84f6-96e17717254a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:11.823090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8552cf80-44d7-4732-84f6-96e17717254a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:12.027600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8552cf80-44d7-4732-84f6-96e17717254a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:12.037210 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8552cf80-44d7-4732-84f6-96e17717254a tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1754 microversion: 2.1 time: 0.231545 Aug 18 12:43:12.037893 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4432/7086] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:11 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1754 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:13.062246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-17ad2b4a-defb-4831-a483-3b27e0506ca0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:13.063393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-17ad2b4a-defb-4831-a483-3b27e0506ca0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:13.071001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17ad2b4a-defb-4831-a483-3b27e0506ca0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:13.071505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17ad2b4a-defb-4831-a483-3b27e0506ca0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:13.071957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17ad2b4a-defb-4831-a483-3b27e0506ca0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:13.072686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17ad2b4a-defb-4831-a483-3b27e0506ca0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:13.073197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17ad2b4a-defb-4831-a483-3b27e0506ca0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:13.073624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-17ad2b4a-defb-4831-a483-3b27e0506ca0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:13.268759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-17ad2b4a-defb-4831-a483-3b27e0506ca0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:13.279422 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-17ad2b4a-defb-4831-a483-3b27e0506ca0 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1754 microversion: 2.1 time: 0.222704 Aug 18 12:43:13.280025 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4433/7087] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:13 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1754 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:14.302515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-459e40f8-664a-4f9b-baba-77a732665af7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:14.303291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-459e40f8-664a-4f9b-baba-77a732665af7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:14.311053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-459e40f8-664a-4f9b-baba-77a732665af7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:14.311566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-459e40f8-664a-4f9b-baba-77a732665af7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:14.312024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-459e40f8-664a-4f9b-baba-77a732665af7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:14.312769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-459e40f8-664a-4f9b-baba-77a732665af7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:14.313246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-459e40f8-664a-4f9b-baba-77a732665af7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:14.313695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-459e40f8-664a-4f9b-baba-77a732665af7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:14.495610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-459e40f8-664a-4f9b-baba-77a732665af7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:14.505576 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-459e40f8-664a-4f9b-baba-77a732665af7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1754 microversion: 2.1 time: 0.206959 Aug 18 12:43:14.506187 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4434/7088] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:14 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1754 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:15.529123 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-96f8c729-e1c9-4b1f-9825-eb953658f4f6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:15.530001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-96f8c729-e1c9-4b1f-9825-eb953658f4f6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:15.537368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f8c729-e1c9-4b1f-9825-eb953658f4f6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:15.537945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f8c729-e1c9-4b1f-9825-eb953658f4f6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:15.538481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f8c729-e1c9-4b1f-9825-eb953658f4f6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:15.539233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f8c729-e1c9-4b1f-9825-eb953658f4f6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:15.539741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f8c729-e1c9-4b1f-9825-eb953658f4f6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:15.540196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f8c729-e1c9-4b1f-9825-eb953658f4f6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:15.722125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-96f8c729-e1c9-4b1f-9825-eb953658f4f6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:15.731951 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-96f8c729-e1c9-4b1f-9825-eb953658f4f6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1754 microversion: 2.1 time: 0.207119 Aug 18 12:43:15.732706 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4435/7089] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:15 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1754 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:16.754399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7ea2dd60-5a64-456f-96bf-87f48f900b4f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:16.755229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7ea2dd60-5a64-456f-96bf-87f48f900b4f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:16.763429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ea2dd60-5a64-456f-96bf-87f48f900b4f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:16.763942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ea2dd60-5a64-456f-96bf-87f48f900b4f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:16.764396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ea2dd60-5a64-456f-96bf-87f48f900b4f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:16.765148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ea2dd60-5a64-456f-96bf-87f48f900b4f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:16.765623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ea2dd60-5a64-456f-96bf-87f48f900b4f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:16.766069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7ea2dd60-5a64-456f-96bf-87f48f900b4f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:16.944344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7ea2dd60-5a64-456f-96bf-87f48f900b4f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:16.955974 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7ea2dd60-5a64-456f-96bf-87f48f900b4f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1754 microversion: 2.1 time: 0.205346 Aug 18 12:43:16.956610 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4436/7090] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:16 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1754 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:17.983799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b15f993e-fa77-4ddc-a0b3-244423d6a33d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:17.984642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b15f993e-fa77-4ddc-a0b3-244423d6a33d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:17.991913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b15f993e-fa77-4ddc-a0b3-244423d6a33d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:17.992424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b15f993e-fa77-4ddc-a0b3-244423d6a33d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:17.992880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b15f993e-fa77-4ddc-a0b3-244423d6a33d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:17.993620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b15f993e-fa77-4ddc-a0b3-244423d6a33d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:17.994095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b15f993e-fa77-4ddc-a0b3-244423d6a33d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:17.994577 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b15f993e-fa77-4ddc-a0b3-244423d6a33d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:18.164892 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b15f993e-fa77-4ddc-a0b3-244423d6a33d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:18.173668 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b15f993e-fa77-4ddc-a0b3-244423d6a33d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1754 microversion: 2.1 time: 0.194330 Aug 18 12:43:18.174273 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4437/7091] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:17 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1754 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:18.847852 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:43:18.848533 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:43:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:43:19.197144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9f4172c5-a11f-4834-a6d4-0ced4c13cc72 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:19.197945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9f4172c5-a11f-4834-a6d4-0ced4c13cc72 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:19.206786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9f4172c5-a11f-4834-a6d4-0ced4c13cc72 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:19.207303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9f4172c5-a11f-4834-a6d4-0ced4c13cc72 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:19.207769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9f4172c5-a11f-4834-a6d4-0ced4c13cc72 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:19.208605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9f4172c5-a11f-4834-a6d4-0ced4c13cc72 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:19.209071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9f4172c5-a11f-4834-a6d4-0ced4c13cc72 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:19.209525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9f4172c5-a11f-4834-a6d4-0ced4c13cc72 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:19.404206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9f4172c5-a11f-4834-a6d4-0ced4c13cc72 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:19.413427 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9f4172c5-a11f-4834-a6d4-0ced4c13cc72 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1754 microversion: 2.1 time: 0.220610 Aug 18 12:43:19.414242 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4438/7092] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:19 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1754 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:20.440540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b85037b1-dba2-4e00-a9a0-92682c8bc313 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:20.441377 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b85037b1-dba2-4e00-a9a0-92682c8bc313 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:20.449034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b85037b1-dba2-4e00-a9a0-92682c8bc313 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:20.450270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b85037b1-dba2-4e00-a9a0-92682c8bc313 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:20.451060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b85037b1-dba2-4e00-a9a0-92682c8bc313 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:20.452051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b85037b1-dba2-4e00-a9a0-92682c8bc313 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:20.452546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b85037b1-dba2-4e00-a9a0-92682c8bc313 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:20.453033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b85037b1-dba2-4e00-a9a0-92682c8bc313 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:20.478718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:43:20.628083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b85037b1-dba2-4e00-a9a0-92682c8bc313 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:43:20.639074 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b85037b1-dba2-4e00-a9a0-92682c8bc313 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1757 microversion: 2.1 time: 0.202626 Aug 18 12:43:20.640046 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4439/7093] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:43:20 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1757 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:43:49.404136 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2ba75e43-0168-4c56-b3d0-25376e59ad56 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1868559100"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:43:49.404889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2ba75e43-0168-4c56-b3d0-25376e59ad56 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:49.407336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=32 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:43:49.408024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:43:49.414066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ba75e43-0168-4c56-b3d0-25376e59ad56 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:49.414616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ba75e43-0168-4c56-b3d0-25376e59ad56 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:49.415068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ba75e43-0168-4c56-b3d0-25376e59ad56 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:49.415794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ba75e43-0168-4c56-b3d0-25376e59ad56 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:49.416326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ba75e43-0168-4c56-b3d0-25376e59ad56 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:49.416722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2ba75e43-0168-4c56-b3d0-25376e59ad56 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:49.560551 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.network.security_group_api [None req-2ba75e43-0168-4c56-b3d0-25376e59ad56 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Removing security group 65eff493-705a-496b-afbb-ec2809aef2a2 from port 9a20a20a-3516-47ad-bf53-e9f8fbc5ed10 Aug 18 12:43:49.871809 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2ba75e43-0168-4c56-b3d0-25376e59ad56 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "POST /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/action" status: 202 len: 0 microversion: 2.1 time: 0.472350 Aug 18 12:43:49.876523 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4440/7094] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:43:49 2022] POST /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:43:49.884774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-fc99b529-4bbb-48c6-ba5a-8c4f5dfda9fa req-e326b2eb-ae05-4aee-94e5-41b49ace5fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "116d561d-d592-4dfe-b0e4-f03a599c91fa", "tag": "9a20a20a-3516-47ad-bf53-e9f8fbc5ed10"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:43:49.894885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fc99b529-4bbb-48c6-ba5a-8c4f5dfda9fa req-e326b2eb-ae05-4aee-94e5-41b49ace5fd8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:49.895390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fc99b529-4bbb-48c6-ba5a-8c4f5dfda9fa req-e326b2eb-ae05-4aee-94e5-41b49ace5fd8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:49.895840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-fc99b529-4bbb-48c6-ba5a-8c4f5dfda9fa req-e326b2eb-ae05-4aee-94e5-41b49ace5fd8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:49.909543 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-fc99b529-4bbb-48c6-ba5a-8c4f5dfda9fa req-e326b2eb-ae05-4aee-94e5-41b49ace5fd8 service nova] Creating event network-changed:9a20a20a-3516-47ad-bf53-e9f8fbc5ed10 for instance 116d561d-d592-4dfe-b0e4-f03a599c91fa on n-h2-853611-3 Aug 18 12:43:49.915563 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-fc99b529-4bbb-48c6-ba5a-8c4f5dfda9fa req-e326b2eb-ae05-4aee-94e5-41b49ace5fd8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034458 Aug 18 12:43:49.916993 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4441/7095] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:43:51.208480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-52fb5ff4-7c6b-4d0a-ad33-80bb2c9de1f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:51.209130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-52fb5ff4-7c6b-4d0a-ad33-80bb2c9de1f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:51.217427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52fb5ff4-7c6b-4d0a-ad33-80bb2c9de1f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:51.217944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52fb5ff4-7c6b-4d0a-ad33-80bb2c9de1f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:51.218465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52fb5ff4-7c6b-4d0a-ad33-80bb2c9de1f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:51.219183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52fb5ff4-7c6b-4d0a-ad33-80bb2c9de1f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:51.219658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52fb5ff4-7c6b-4d0a-ad33-80bb2c9de1f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:51.220106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52fb5ff4-7c6b-4d0a-ad33-80bb2c9de1f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:51.314272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-52fb5ff4-7c6b-4d0a-ad33-80bb2c9de1f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lazy-loading 'services' on Instance uuid 116d561d-d592-4dfe-b0e4-f03a599c91fa {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:43:51.395057 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-52fb5ff4-7c6b-4d0a-ad33-80bb2c9de1f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "DELETE /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments/ec62f42d-6b67-4c10-9307-fcc1978fb703" status: 202 len: 0 microversion: 2.1 time: 0.190730 Aug 18 12:43:51.396217 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4442/7096] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 12:43:51 2022] DELETE /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments/ec62f42d-6b67-4c10-9307-fcc1978fb703 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:43:51.404927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9a1dcbb6-f653-4170-a7a6-f667a0f4664a req-96fcf46d-dd8c-4d65-9138-601c81859bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "116d561d-d592-4dfe-b0e4-f03a599c91fa", "tag": "9a20a20a-3516-47ad-bf53-e9f8fbc5ed10"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:43:51.424802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9a1dcbb6-f653-4170-a7a6-f667a0f4664a req-96fcf46d-dd8c-4d65-9138-601c81859bc2 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:51.425563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9a1dcbb6-f653-4170-a7a6-f667a0f4664a req-96fcf46d-dd8c-4d65-9138-601c81859bc2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:51.426363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9a1dcbb6-f653-4170-a7a6-f667a0f4664a req-96fcf46d-dd8c-4d65-9138-601c81859bc2 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:51.443663 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9a1dcbb6-f653-4170-a7a6-f667a0f4664a req-96fcf46d-dd8c-4d65-9138-601c81859bc2 service nova] Creating event network-changed:9a20a20a-3516-47ad-bf53-e9f8fbc5ed10 for instance 116d561d-d592-4dfe-b0e4-f03a599c91fa on n-h2-853611-3 Aug 18 12:43:51.449357 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9a1dcbb6-f653-4170-a7a6-f667a0f4664a req-96fcf46d-dd8c-4d65-9138-601c81859bc2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051773 Aug 18 12:43:51.450765 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4443/7097] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:43:51.456372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a5658a5e-2ce6-4435-b605-919ae29a3444 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:51.458731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a5658a5e-2ce6-4435-b605-919ae29a3444 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:51.466324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5658a5e-2ce6-4435-b605-919ae29a3444 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:51.466683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5658a5e-2ce6-4435-b605-919ae29a3444 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:51.467146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5658a5e-2ce6-4435-b605-919ae29a3444 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:51.468031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5658a5e-2ce6-4435-b605-919ae29a3444 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:51.468535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5658a5e-2ce6-4435-b605-919ae29a3444 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:51.468956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5658a5e-2ce6-4435-b605-919ae29a3444 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:51.502350 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a5658a5e-2ce6-4435-b605-919ae29a3444 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050237 Aug 18 12:43:51.506997 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4444/7098] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:43:51 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:43:52.515022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b8ffaea-038c-4a88-9618-339383c2136d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:52.517262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b8ffaea-038c-4a88-9618-339383c2136d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:52.524183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ffaea-038c-4a88-9618-339383c2136d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:52.524681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ffaea-038c-4a88-9618-339383c2136d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:52.525130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ffaea-038c-4a88-9618-339383c2136d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:52.525837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ffaea-038c-4a88-9618-339383c2136d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:52.526301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ffaea-038c-4a88-9618-339383c2136d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:52.526766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b8ffaea-038c-4a88-9618-339383c2136d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:52.557594 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b8ffaea-038c-4a88-9618-339383c2136d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047170 Aug 18 12:43:52.558358 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4445/7099] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:43:52 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:43:53.569920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-039948d5-6c2a-4435-a22d-fe6c8352a9e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:53.572419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-039948d5-6c2a-4435-a22d-fe6c8352a9e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:53.581173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-039948d5-6c2a-4435-a22d-fe6c8352a9e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:53.581683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-039948d5-6c2a-4435-a22d-fe6c8352a9e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:53.582135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-039948d5-6c2a-4435-a22d-fe6c8352a9e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:53.582900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-039948d5-6c2a-4435-a22d-fe6c8352a9e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:53.583369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-039948d5-6c2a-4435-a22d-fe6c8352a9e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:53.583817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-039948d5-6c2a-4435-a22d-fe6c8352a9e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:53.617121 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-039948d5-6c2a-4435-a22d-fe6c8352a9e8 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051372 Aug 18 12:43:53.617714 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4446/7100] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:43:53 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:43:54.630526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-95e7dcf5-679f-4af2-be00-8e6abdc8994f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:54.632755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-95e7dcf5-679f-4af2-be00-8e6abdc8994f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:54.645175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95e7dcf5-679f-4af2-be00-8e6abdc8994f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:54.645702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95e7dcf5-679f-4af2-be00-8e6abdc8994f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:54.646171 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95e7dcf5-679f-4af2-be00-8e6abdc8994f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:54.646950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95e7dcf5-679f-4af2-be00-8e6abdc8994f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:54.647431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95e7dcf5-679f-4af2-be00-8e6abdc8994f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:54.647900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-95e7dcf5-679f-4af2-be00-8e6abdc8994f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:54.679226 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-95e7dcf5-679f-4af2-be00-8e6abdc8994f tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052634 Aug 18 12:43:54.680995 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4447/7101] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:43:54 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:43:55.692770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-58e913b2-f7fd-4572-bbe5-6e642cef36f4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:55.695096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-58e913b2-f7fd-4572-bbe5-6e642cef36f4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:55.702751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58e913b2-f7fd-4572-bbe5-6e642cef36f4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:55.703263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58e913b2-f7fd-4572-bbe5-6e642cef36f4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:55.703719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58e913b2-f7fd-4572-bbe5-6e642cef36f4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:55.704457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58e913b2-f7fd-4572-bbe5-6e642cef36f4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:55.704934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58e913b2-f7fd-4572-bbe5-6e642cef36f4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:55.705395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-58e913b2-f7fd-4572-bbe5-6e642cef36f4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:55.746383 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-58e913b2-f7fd-4572-bbe5-6e642cef36f4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057618 Aug 18 12:43:55.747382 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4448/7102] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:43:55 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:43:56.759281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a82b4bb0-b50d-4d14-81d1-78d424946068 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:56.761594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a82b4bb0-b50d-4d14-81d1-78d424946068 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:56.769896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a82b4bb0-b50d-4d14-81d1-78d424946068 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:56.770401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a82b4bb0-b50d-4d14-81d1-78d424946068 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:56.770888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a82b4bb0-b50d-4d14-81d1-78d424946068 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:56.771620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a82b4bb0-b50d-4d14-81d1-78d424946068 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:56.772095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a82b4bb0-b50d-4d14-81d1-78d424946068 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:56.772539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a82b4bb0-b50d-4d14-81d1-78d424946068 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:56.805741 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a82b4bb0-b50d-4d14-81d1-78d424946068 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050589 Aug 18 12:43:56.806341 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4449/7103] 10.222.0.73 () {58 vars in 1302 bytes} [Thu Aug 18 12:43:56 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 12:43:56.818900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c70443c-ac10-40d9-a0ef-1372635574f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:43:56.819423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c70443c-ac10-40d9-a0ef-1372635574f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:43:56.826800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c70443c-ac10-40d9-a0ef-1372635574f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:56.827313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c70443c-ac10-40d9-a0ef-1372635574f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:56.827772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c70443c-ac10-40d9-a0ef-1372635574f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:56.828514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c70443c-ac10-40d9-a0ef-1372635574f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:43:56.828995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c70443c-ac10-40d9-a0ef-1372635574f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:43:56.829440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c70443c-ac10-40d9-a0ef-1372635574f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:43:57.063959 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-9c70443c-ac10-40d9-a0ef-1372635574f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] HTTP exception thrown: Instance 116d561d-d592-4dfe-b0e4-f03a599c91fa is not attached to volume ec62f42d-6b67-4c10-9307-fcc1978fb703 Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c70443c-ac10-40d9-a0ef-1372635574f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Request method failure captured: Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: request: DELETE /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments/ec62f42d-6b67-4c10-9307-fcc1978fb703 HTTP/1.1 Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jKjcsUgtgWTzYovp0vDXYdgZIO730Mcf3qEh2rHBztvzm68wv91irHoLc_BKh_7fdXHRfd5BFSt2OADJr1fqKq3dav6O5IZ0iffvw0QgYpluCGKsQ9FQ7dNBaYJlRj0hOZAURpohb-lUnUgMHtKj_hWIMf5KsUVSA_gEtXr0UhHPqU Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6254faa7d5e34f2092f213aa2bc0ae42 Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestMinimumBasicScenario-1222071027 Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestMinimumBasicScenario-1222071027 Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6254faa7d5e34f2092f213aa2bc0ae42 Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1222071027 Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestMinimumBasicScenario-1222071027-project Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 9bb8acb005ee49a9ba883f7427750440 Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestMinimumBasicScenario-1222071027-project Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 116d561d-d592-4dfe-b0e4-f03a599c91fa is not attached to volume ec62f42d-6b67-4c10-9307-fcc1978fb703 Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'server_id': '116d561d-d592-4dfe-b0e4-f03a599c91fa', 'id': 'ec62f42d-6b67-4c10-9307-fcc1978fb703'} Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ec62f42d-6b67-4c10-9307-fcc1978fb703. Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 116d561d-d592-4dfe-b0e4-f03a599c91fa is not attached to volume ec62f42d-6b67-4c10-9307-fcc1978fb703 Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:43:57.065614 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:43:57.069701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:43:57.069701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:43:57.069701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 116d561d-d592-4dfe-b0e4-f03a599c91fa is not attached to volume ec62f42d-6b67-4c10-9307-fcc1978fb703 Aug 18 12:43:57.069701 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:43:57.069701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c70443c-ac10-40d9-a0ef-1372635574f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Returning 404 to user: Instance 116d561d-d592-4dfe-b0e4-f03a599c91fa is not attached to volume ec62f42d-6b67-4c10-9307-fcc1978fb703 {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:43:57.069701 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c70443c-ac10-40d9-a0ef-1372635574f7 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "DELETE /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments/ec62f42d-6b67-4c10-9307-fcc1978fb703" status: 404 len: 154 microversion: 2.1 time: 0.253068 Aug 18 12:43:57.069701 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4450/7104] 10.222.0.73 () {58 vars in 1416 bytes} [Thu Aug 18 12:43:56 2022] DELETE /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa/os-volume_attachments/ec62f42d-6b67-4c10-9307-fcc1978fb703 => generated 154 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:44:00.418160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3323abce-7382-4c9a-a721-6e265c46bf8e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:00.420647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3323abce-7382-4c9a-a721-6e265c46bf8e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:00.437862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3323abce-7382-4c9a-a721-6e265c46bf8e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:00.438779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3323abce-7382-4c9a-a721-6e265c46bf8e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:00.439611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3323abce-7382-4c9a-a721-6e265c46bf8e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:00.440847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3323abce-7382-4c9a-a721-6e265c46bf8e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:00.441575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3323abce-7382-4c9a-a721-6e265c46bf8e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:00.442291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3323abce-7382-4c9a-a721-6e265c46bf8e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:00.488845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3323abce-7382-4c9a-a721-6e265c46bf8e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:44:00.600167 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3323abce-7382-4c9a-a721-6e265c46bf8e tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "DELETE /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 204 len: 0 microversion: 2.1 time: 0.187680 Aug 18 12:44:00.600839 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4451/7105] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:44:00 2022] DELETE /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:44:00.611304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-52c6c905-0533-4db0-a38a-540ec76d7bd6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:00.612049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-52c6c905-0533-4db0-a38a-540ec76d7bd6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:00.618888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52c6c905-0533-4db0-a38a-540ec76d7bd6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:00.619415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52c6c905-0533-4db0-a38a-540ec76d7bd6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:00.619876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52c6c905-0533-4db0-a38a-540ec76d7bd6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:00.620697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52c6c905-0533-4db0-a38a-540ec76d7bd6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:00.621140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52c6c905-0533-4db0-a38a-540ec76d7bd6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:00.621654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-52c6c905-0533-4db0-a38a-540ec76d7bd6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:00.813161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-52c6c905-0533-4db0-a38a-540ec76d7bd6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:00.821802 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-52c6c905-0533-4db0-a38a-540ec76d7bd6 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1552 microversion: 2.1 time: 0.216146 Aug 18 12:44:00.822633 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4452/7106] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:00 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1552 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:44:01.843862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c556a571-f0aa-4761-9b50-2c4ff5eeabce tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:01.844622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c556a571-f0aa-4761-9b50-2c4ff5eeabce tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:01.852114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c556a571-f0aa-4761-9b50-2c4ff5eeabce tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:01.852621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c556a571-f0aa-4761-9b50-2c4ff5eeabce tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:01.853080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c556a571-f0aa-4761-9b50-2c4ff5eeabce tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:01.853813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c556a571-f0aa-4761-9b50-2c4ff5eeabce tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:01.854283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c556a571-f0aa-4761-9b50-2c4ff5eeabce tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:01.854761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c556a571-f0aa-4761-9b50-2c4ff5eeabce tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:02.054821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c556a571-f0aa-4761-9b50-2c4ff5eeabce tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:02.063926 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c556a571-f0aa-4761-9b50-2c4ff5eeabce tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1552 microversion: 2.1 time: 0.224926 Aug 18 12:44:02.064536 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4453/7107] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:01 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1552 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:44:02.784057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9e4c3e5d-13e0-480c-bbd5-5bbf89683c7f req-7b5062b7-9c92-49ec-b4d2-fe20179257c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "116d561d-d592-4dfe-b0e4-f03a599c91fa", "name": "network-vif-deleted", "tag": "9a20a20a-3516-47ad-bf53-e9f8fbc5ed10"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:44:02.796261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9e4c3e5d-13e0-480c-bbd5-5bbf89683c7f req-7b5062b7-9c92-49ec-b4d2-fe20179257c6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:02.796815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9e4c3e5d-13e0-480c-bbd5-5bbf89683c7f req-7b5062b7-9c92-49ec-b4d2-fe20179257c6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:02.797343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9e4c3e5d-13e0-480c-bbd5-5bbf89683c7f req-7b5062b7-9c92-49ec-b4d2-fe20179257c6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:02.811090 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9e4c3e5d-13e0-480c-bbd5-5bbf89683c7f req-7b5062b7-9c92-49ec-b4d2-fe20179257c6 service nova] Creating event network-vif-deleted:9a20a20a-3516-47ad-bf53-e9f8fbc5ed10 for instance 116d561d-d592-4dfe-b0e4-f03a599c91fa on n-h2-853611-3 Aug 18 12:44:02.816571 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9e4c3e5d-13e0-480c-bbd5-5bbf89683c7f req-7b5062b7-9c92-49ec-b4d2-fe20179257c6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040043 Aug 18 12:44:02.817189 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4454/7108] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:44:03.088888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a5cb8998-9778-4b8e-b472-9e71b5279db4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:03.089726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a5cb8998-9778-4b8e-b472-9e71b5279db4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:03.096548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5cb8998-9778-4b8e-b472-9e71b5279db4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:03.097057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5cb8998-9778-4b8e-b472-9e71b5279db4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:03.097559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5cb8998-9778-4b8e-b472-9e71b5279db4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:03.098285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5cb8998-9778-4b8e-b472-9e71b5279db4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:03.098972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5cb8998-9778-4b8e-b472-9e71b5279db4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:03.099388 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5cb8998-9778-4b8e-b472-9e71b5279db4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:03.138964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5cb8998-9778-4b8e-b472-9e71b5279db4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:03.139785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5cb8998-9778-4b8e-b472-9e71b5279db4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:03.140425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a5cb8998-9778-4b8e-b472-9e71b5279db4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:03.141085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-a5cb8998-9778-4b8e-b472-9e71b5279db4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lazy-loading 'fault' on Instance uuid 116d561d-d592-4dfe-b0e4-f03a599c91fa {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:44:03.198221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a5cb8998-9778-4b8e-b472-9e71b5279db4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bb8acb005ee49a9ba883f7427750440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6254faa7d5e34f2092f213aa2bc0ae42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:03.207346 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a5cb8998-9778-4b8e-b472-9e71b5279db4 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 200 len: 1347 microversion: 2.1 time: 0.123719 Aug 18 12:44:03.207944 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4455/7109] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:03 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 1347 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:44:04.240809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0b7ba33-6300-4b4a-8add-7ffa78550a9d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:04.241541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a0b7ba33-6300-4b4a-8add-7ffa78550a9d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] [instance: 116d561d-d592-4dfe-b0e4-f03a599c91fa] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:04.249604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0b7ba33-6300-4b4a-8add-7ffa78550a9d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:04.250119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0b7ba33-6300-4b4a-8add-7ffa78550a9d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:04.250888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0b7ba33-6300-4b4a-8add-7ffa78550a9d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:04.251629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0b7ba33-6300-4b4a-8add-7ffa78550a9d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:04.252105 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0b7ba33-6300-4b4a-8add-7ffa78550a9d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:04.252554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a0b7ba33-6300-4b4a-8add-7ffa78550a9d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:04.257514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:44:04.269620 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-a0b7ba33-6300-4b4a-8add-7ffa78550a9d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] HTTP exception thrown: Instance 116d561d-d592-4dfe-b0e4-f03a599c91fa could not be found. Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0b7ba33-6300-4b4a-8add-7ffa78550a9d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Request method failure captured: Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa HTTP/1.1 Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jKjcsUgtgWTzYovp0vDXYdgZIO730Mcf3qEh2rHBztvzm68wv91irHoLc_BKh_7fdXHRfd5BFSt2OADJr1fqKq3dav6O5IZ0iffvw0QgYpluCGKsQ9FQ7dNBaYJlRj0hOZAURpohb-lUnUgMHtKj_hWIMf5KsUVSA_gEtXr0UhHPqU Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 6254faa7d5e34f2092f213aa2bc0ae42 Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestMinimumBasicScenario-1222071027 Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/6254faa7d5e34f2092f213aa2bc0ae42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestMinimumBasicScenario-1222071027 Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 6254faa7d5e34f2092f213aa2bc0ae42 Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1222071027 Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestMinimumBasicScenario-1222071027-project Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 9bb8acb005ee49a9ba883f7427750440 Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestMinimumBasicScenario-1222071027-project Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 116d561d-d592-4dfe-b0e4-f03a599c91fa could not be found. Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '116d561d-d592-4dfe-b0e4-f03a599c91fa'} Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 116d561d-d592-4dfe-b0e4-f03a599c91fa could not be found. Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 116d561d-d592-4dfe-b0e4-f03a599c91fa could not be found. Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:44:04.271490 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:44:04.276236 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:44:04.276236 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:44:04.276236 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:44:04.276236 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:44:04.276236 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:44:04.276236 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 116d561d-d592-4dfe-b0e4-f03a599c91fa could not be found. Aug 18 12:44:04.276236 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:44:04.276236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a0b7ba33-6300-4b4a-8add-7ffa78550a9d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Returning 404 to user: Instance 116d561d-d592-4dfe-b0e4-f03a599c91fa could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:44:04.276236 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a0b7ba33-6300-4b4a-8add-7ffa78550a9d tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa" status: 404 len: 111 microversion: 2.1 time: 0.036427 Aug 18 12:44:04.276236 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4456/7110] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:04 2022] GET /compute/v2.1/servers/116d561d-d592-4dfe-b0e4-f03a599c91fa => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:44:04.283250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4056fa44-f2a4-4384-9b0e-1e9a8658ce34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] Calling method '.version_select at 0x7f519ee173a0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:04.305746 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4056fa44-f2a4-4384-9b0e-1e9a8658ce34 tempest-TestMinimumBasicScenario-1222071027 tempest-TestMinimumBasicScenario-1222071027-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-241329777" status: 202 len: 0 microversion: 2.1 time: 0.027581 Aug 18 12:44:04.306335 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4457/7111] 10.222.0.73 () {58 vars in 1269 bytes} [Thu Aug 18 12:44:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-241329777 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:44:14.853426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:44:15.051443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c5b8afa2-8488-4dd2-8e66-c46de4020cf8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'create', calling method: .version_select at 0x7f519fd89d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1475000999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKQP+h9e3pB35qYxsVfH3Sm3xLNsM/Iv6Fh6H6wNGE3yiOp/o6nEtrFxUgGD0Nntr88oXILQQG9Iv1eNEa9u3s2+LWrGaGp8CKJFnwvZzGxDtB9z3TMa6SS0/EMz0Z8/g=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:44:15.069912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c5b8afa2-8488-4dd2-8e66-c46de4020cf8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:44:15.076093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c5b8afa2-8488-4dd2-8e66-c46de4020cf8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for user 064db809a9034ebc85b986c87d0036d1 and project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:44:15.104974 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c5b8afa2-8488-4dd2-8e66-c46de4020cf8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.253441 Aug 18 12:44:15.108530 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4458/7112] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:44:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:44:22.231389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-641718704", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "e02f837e-0a64-4383-9e51-4095c7e7499d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1475000999", "security_groups": [{"name": "tempest-secgroup-smoke-802882258"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:44:22.358975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] validate_networks() for [('e02f837e-0a64-4383-9e51-4095c7e7499d', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:44:23.009065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:44:23.009515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:44:23.010008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:44:23.010665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:44:23.013240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:44:23.026935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:23.027462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:23.028031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:23.029204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:23.033924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:23.034394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:23.056550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:44:23.064002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for user 064db809a9034ebc85b986c87d0036d1 and project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:44:23.081397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:44:23.084256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:44:23.139324 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5cd011bb-6cee-4e01-8c59-4dd5894526f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.912761 Aug 18 12:44:23.139995 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4459/7113] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:44:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:44:23.151720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e3de702-47f2-421e-b677-f9f79257e07f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:23.152370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1e3de702-47f2-421e-b677-f9f79257e07f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:23.224381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1e3de702-47f2-421e-b677-f9f79257e07f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:23.235477 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1e3de702-47f2-421e-b677-f9f79257e07f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1266 microversion: 2.1 time: 0.087485 Aug 18 12:44:23.237930 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4460/7114] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:23 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:44:24.268831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d1fdd26-3614-4dc0-a35b-47b6ab26921b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:24.270107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2d1fdd26-3614-4dc0-a35b-47b6ab26921b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:24.282618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d1fdd26-3614-4dc0-a35b-47b6ab26921b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:24.283541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d1fdd26-3614-4dc0-a35b-47b6ab26921b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:24.284365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d1fdd26-3614-4dc0-a35b-47b6ab26921b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:24.285679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d1fdd26-3614-4dc0-a35b-47b6ab26921b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:24.286309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d1fdd26-3614-4dc0-a35b-47b6ab26921b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:24.286793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d1fdd26-3614-4dc0-a35b-47b6ab26921b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:24.362306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2d1fdd26-3614-4dc0-a35b-47b6ab26921b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:24.371787 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d1fdd26-3614-4dc0-a35b-47b6ab26921b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1318 microversion: 2.1 time: 0.110860 Aug 18 12:44:24.373258 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4461/7115] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:24 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1318 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:44:25.395595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34813f6b-e64a-4ba2-ac11-f0a2b4547f65 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:25.396965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-34813f6b-e64a-4ba2-ac11-f0a2b4547f65 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:25.406274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34813f6b-e64a-4ba2-ac11-f0a2b4547f65 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:25.407164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34813f6b-e64a-4ba2-ac11-f0a2b4547f65 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:25.408010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34813f6b-e64a-4ba2-ac11-f0a2b4547f65 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:25.408772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34813f6b-e64a-4ba2-ac11-f0a2b4547f65 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:25.411064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34813f6b-e64a-4ba2-ac11-f0a2b4547f65 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:25.412584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-34813f6b-e64a-4ba2-ac11-f0a2b4547f65 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:26.006764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-34813f6b-e64a-4ba2-ac11-f0a2b4547f65 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:26.016080 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34813f6b-e64a-4ba2-ac11-f0a2b4547f65 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1391 microversion: 2.1 time: 0.624892 Aug 18 12:44:26.032253 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4462/7116] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:25 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1391 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:44:26.489898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-050837f3-fbce-4208-808d-ae4f122a1096 req-6711701b-7d1e-4178-a2f9-edda80cb703f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5623b261-d066-42f8-96df-cd68ae819f15", "tag": "a09daea5-e890-4aba-8e16-132ea28642b4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:44:26.505510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-050837f3-fbce-4208-808d-ae4f122a1096 req-6711701b-7d1e-4178-a2f9-edda80cb703f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:26.507273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-050837f3-fbce-4208-808d-ae4f122a1096 req-6711701b-7d1e-4178-a2f9-edda80cb703f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:26.507794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-050837f3-fbce-4208-808d-ae4f122a1096 req-6711701b-7d1e-4178-a2f9-edda80cb703f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:26.527743 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-050837f3-fbce-4208-808d-ae4f122a1096 req-6711701b-7d1e-4178-a2f9-edda80cb703f service nova] Creating event network-changed:a09daea5-e890-4aba-8e16-132ea28642b4 for instance 5623b261-d066-42f8-96df-cd68ae819f15 on n-h1-853611-3 Aug 18 12:44:26.532767 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-050837f3-fbce-4208-808d-ae4f122a1096 req-6711701b-7d1e-4178-a2f9-edda80cb703f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046456 Aug 18 12:44:26.533435 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4463/7117] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:44:27.040450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df6cc7c7-5f07-4209-ae85-892edd05a976 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:27.041177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df6cc7c7-5f07-4209-ae85-892edd05a976 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:27.049355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6cc7c7-5f07-4209-ae85-892edd05a976 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:27.049873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6cc7c7-5f07-4209-ae85-892edd05a976 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:27.051021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6cc7c7-5f07-4209-ae85-892edd05a976 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:27.051021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6cc7c7-5f07-4209-ae85-892edd05a976 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:27.051671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6cc7c7-5f07-4209-ae85-892edd05a976 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:27.052019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df6cc7c7-5f07-4209-ae85-892edd05a976 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:27.200881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df6cc7c7-5f07-4209-ae85-892edd05a976 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:27.208684 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df6cc7c7-5f07-4209-ae85-892edd05a976 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1391 microversion: 2.1 time: 0.172651 Aug 18 12:44:27.209279 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4464/7118] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:27 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:44:28.232224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-adc9324f-c606-4496-bcb8-dc6528480822 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:28.232945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-adc9324f-c606-4496-bcb8-dc6528480822 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:28.240969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-adc9324f-c606-4496-bcb8-dc6528480822 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:28.241478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-adc9324f-c606-4496-bcb8-dc6528480822 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:28.241942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-adc9324f-c606-4496-bcb8-dc6528480822 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:28.242712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-adc9324f-c606-4496-bcb8-dc6528480822 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:28.243192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-adc9324f-c606-4496-bcb8-dc6528480822 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:28.243648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-adc9324f-c606-4496-bcb8-dc6528480822 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:28.411951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-adc9324f-c606-4496-bcb8-dc6528480822 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:28.420487 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-adc9324f-c606-4496-bcb8-dc6528480822 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1391 microversion: 2.1 time: 0.193418 Aug 18 12:44:28.421103 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4465/7119] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:28 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1391 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:44:29.443074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-897ac056-9607-4e24-9be6-e07198e12eba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:29.444068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-897ac056-9607-4e24-9be6-e07198e12eba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:29.452053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-897ac056-9607-4e24-9be6-e07198e12eba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:29.452566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-897ac056-9607-4e24-9be6-e07198e12eba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:29.453028 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-897ac056-9607-4e24-9be6-e07198e12eba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:29.453761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-897ac056-9607-4e24-9be6-e07198e12eba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:29.454242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-897ac056-9607-4e24-9be6-e07198e12eba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:29.454763 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-897ac056-9607-4e24-9be6-e07198e12eba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:29.610307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-897ac056-9607-4e24-9be6-e07198e12eba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:29.618376 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-897ac056-9607-4e24-9be6-e07198e12eba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1391 microversion: 2.1 time: 0.179191 Aug 18 12:44:29.619006 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4466/7120] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:29 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:44:30.643149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-85d33b21-53d0-4b87-9ca3-6f0865109a21 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:30.644030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-85d33b21-53d0-4b87-9ca3-6f0865109a21 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:30.650404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85d33b21-53d0-4b87-9ca3-6f0865109a21 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:30.650951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85d33b21-53d0-4b87-9ca3-6f0865109a21 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:30.651416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85d33b21-53d0-4b87-9ca3-6f0865109a21 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:30.652164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85d33b21-53d0-4b87-9ca3-6f0865109a21 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:30.653425 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85d33b21-53d0-4b87-9ca3-6f0865109a21 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:30.653714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-85d33b21-53d0-4b87-9ca3-6f0865109a21 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:30.829883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-85d33b21-53d0-4b87-9ca3-6f0865109a21 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:30.838588 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-85d33b21-53d0-4b87-9ca3-6f0865109a21 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1391 microversion: 2.1 time: 0.201390 Aug 18 12:44:30.839399 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4467/7121] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:30 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:44:31.864327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ce2aa11-4e31-46b1-ba32-d316887aee6d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:31.865424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9ce2aa11-4e31-46b1-ba32-d316887aee6d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:31.878352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ce2aa11-4e31-46b1-ba32-d316887aee6d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:31.879215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ce2aa11-4e31-46b1-ba32-d316887aee6d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:31.880046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ce2aa11-4e31-46b1-ba32-d316887aee6d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:31.881170 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ce2aa11-4e31-46b1-ba32-d316887aee6d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:31.882073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ce2aa11-4e31-46b1-ba32-d316887aee6d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:31.882909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ce2aa11-4e31-46b1-ba32-d316887aee6d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:32.068421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9ce2aa11-4e31-46b1-ba32-d316887aee6d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:32.079441 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9ce2aa11-4e31-46b1-ba32-d316887aee6d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1391 microversion: 2.1 time: 0.221536 Aug 18 12:44:32.080252 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4468/7122] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:31 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1391 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:44:32.114263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-04a5a57b-87da-45fb-b771-0755f1995a38 req-ae68a284-f0db-4603-a21f-2e59c91ad1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5623b261-d066-42f8-96df-cd68ae819f15", "name": "network-vif-plugged", "status": "completed", "tag": "a09daea5-e890-4aba-8e16-132ea28642b4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:44:32.128322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-04a5a57b-87da-45fb-b771-0755f1995a38 req-ae68a284-f0db-4603-a21f-2e59c91ad1d9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:32.130447 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-04a5a57b-87da-45fb-b771-0755f1995a38 req-ae68a284-f0db-4603-a21f-2e59c91ad1d9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:32.131236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-04a5a57b-87da-45fb-b771-0755f1995a38 req-ae68a284-f0db-4603-a21f-2e59c91ad1d9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:32.146372 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-04a5a57b-87da-45fb-b771-0755f1995a38 req-ae68a284-f0db-4603-a21f-2e59c91ad1d9 service nova] Creating event network-vif-plugged:a09daea5-e890-4aba-8e16-132ea28642b4 for instance 5623b261-d066-42f8-96df-cd68ae819f15 on n-h1-853611-3 Aug 18 12:44:32.152288 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-04a5a57b-87da-45fb-b771-0755f1995a38 req-ae68a284-f0db-4603-a21f-2e59c91ad1d9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042307 Aug 18 12:44:32.153194 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4469/7123] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:44:33.100620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:44:33.105378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-13a82320-1ee6-489a-8a3f-fb38d4e7e96b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:33.107075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-13a82320-1ee6-489a-8a3f-fb38d4e7e96b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:33.114693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13a82320-1ee6-489a-8a3f-fb38d4e7e96b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:33.115204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13a82320-1ee6-489a-8a3f-fb38d4e7e96b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:33.115654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13a82320-1ee6-489a-8a3f-fb38d4e7e96b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:33.116374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13a82320-1ee6-489a-8a3f-fb38d4e7e96b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:33.116845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13a82320-1ee6-489a-8a3f-fb38d4e7e96b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:33.117279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-13a82320-1ee6-489a-8a3f-fb38d4e7e96b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:33.233570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:44:33.269056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-13a82320-1ee6-489a-8a3f-fb38d4e7e96b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:33.281314 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-13a82320-1ee6-489a-8a3f-fb38d4e7e96b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1391 microversion: 2.1 time: 0.182690 Aug 18 12:44:33.281920 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4470/7124] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:33 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:44:34.303182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-74dc3875-c442-4335-adcc-6226f45fb363 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:34.304291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-74dc3875-c442-4335-adcc-6226f45fb363 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:34.311660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74dc3875-c442-4335-adcc-6226f45fb363 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:34.312165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74dc3875-c442-4335-adcc-6226f45fb363 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:34.312616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74dc3875-c442-4335-adcc-6226f45fb363 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:34.313340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74dc3875-c442-4335-adcc-6226f45fb363 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:34.313808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74dc3875-c442-4335-adcc-6226f45fb363 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:34.314248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-74dc3875-c442-4335-adcc-6226f45fb363 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:34.470833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-74dc3875-c442-4335-adcc-6226f45fb363 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:34.478913 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-74dc3875-c442-4335-adcc-6226f45fb363 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1563 microversion: 2.1 time: 0.179675 Aug 18 12:44:34.479582 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4471/7125] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:34 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:44:34.501344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6eded6b1-c6a5-4eef-96db-d2a2161b5a0e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:34.502228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6eded6b1-c6a5-4eef-96db-d2a2161b5a0e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:34.508586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eded6b1-c6a5-4eef-96db-d2a2161b5a0e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:34.509097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eded6b1-c6a5-4eef-96db-d2a2161b5a0e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:34.509833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eded6b1-c6a5-4eef-96db-d2a2161b5a0e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:34.510625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eded6b1-c6a5-4eef-96db-d2a2161b5a0e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:34.511111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eded6b1-c6a5-4eef-96db-d2a2161b5a0e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:34.511558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6eded6b1-c6a5-4eef-96db-d2a2161b5a0e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:34.655272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6eded6b1-c6a5-4eef-96db-d2a2161b5a0e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:34.663421 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6eded6b1-c6a5-4eef-96db-d2a2161b5a0e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1563 microversion: 2.1 time: 0.166662 Aug 18 12:44:34.664020 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4472/7126] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:34 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:44:36.617324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-53f5778f-408c-4251-853e-0c98c50f77d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:44:36.619543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-53f5778f-408c-4251-853e-0c98c50f77d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:44:36.628176 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53f5778f-408c-4251-853e-0c98c50f77d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:36.628839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53f5778f-408c-4251-853e-0c98c50f77d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:36.629398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53f5778f-408c-4251-853e-0c98c50f77d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:36.630413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53f5778f-408c-4251-853e-0c98c50f77d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:36.630993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53f5778f-408c-4251-853e-0c98c50f77d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:36.631708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53f5778f-408c-4251-853e-0c98c50f77d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:36.824178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-53f5778f-408c-4251-853e-0c98c50f77d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:44:36.837519 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-53f5778f-408c-4251-853e-0c98c50f77d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1563 microversion: 2.1 time: 0.225453 Aug 18 12:44:36.838416 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4473/7127] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:44:36 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1563 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:44:36.847715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-860a7aa2-5d96-45ae-88d6-0df70b8666d9 req-3c2ca3fe-1528-4fc6-9eb8-b842d65b9743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5623b261-d066-42f8-96df-cd68ae819f15", "tag": "a09daea5-e890-4aba-8e16-132ea28642b4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:44:36.866581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-860a7aa2-5d96-45ae-88d6-0df70b8666d9 req-3c2ca3fe-1528-4fc6-9eb8-b842d65b9743 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:44:36.867562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-860a7aa2-5d96-45ae-88d6-0df70b8666d9 req-3c2ca3fe-1528-4fc6-9eb8-b842d65b9743 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:44:36.868604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-860a7aa2-5d96-45ae-88d6-0df70b8666d9 req-3c2ca3fe-1528-4fc6-9eb8-b842d65b9743 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:44:36.889596 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-860a7aa2-5d96-45ae-88d6-0df70b8666d9 req-3c2ca3fe-1528-4fc6-9eb8-b842d65b9743 service nova] Creating event network-changed:a09daea5-e890-4aba-8e16-132ea28642b4 for instance 5623b261-d066-42f8-96df-cd68ae819f15 on n-h1-853611-3 Aug 18 12:44:36.898907 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-860a7aa2-5d96-45ae-88d6-0df70b8666d9 req-3c2ca3fe-1528-4fc6-9eb8-b842d65b9743 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058205 Aug 18 12:44:36.900028 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4474/7128] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:45:00.153752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:45:00.154590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=74 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:45:00.160197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8476a977-5b45-4958-9fc2-20346855978b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:45:00.162731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8476a977-5b45-4958-9fc2-20346855978b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:00.171300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8476a977-5b45-4958-9fc2-20346855978b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:00.172449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8476a977-5b45-4958-9fc2-20346855978b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:00.172912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8476a977-5b45-4958-9fc2-20346855978b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:00.173672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8476a977-5b45-4958-9fc2-20346855978b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:00.174149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8476a977-5b45-4958-9fc2-20346855978b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:00.174626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8476a977-5b45-4958-9fc2-20346855978b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:00.212812 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:45:00.213651 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:45:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:45:00.229577 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8476a977-5b45-4958-9fc2-20346855978b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15/action" status: 200 len: 24569 microversion: 2.1 time: 0.077764 Aug 18 12:45:00.230250 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4475/7129] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:45:00 2022] POST /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15/action => generated 24569 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:45:06.644464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-dfa437d1-aba6-48f3-a000-4b5863334c73 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:45:06.645194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-dfa437d1-aba6-48f3-a000-4b5863334c73 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:06.653258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfa437d1-aba6-48f3-a000-4b5863334c73 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:06.653767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfa437d1-aba6-48f3-a000-4b5863334c73 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:06.654229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfa437d1-aba6-48f3-a000-4b5863334c73 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:06.655122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfa437d1-aba6-48f3-a000-4b5863334c73 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:06.655602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfa437d1-aba6-48f3-a000-4b5863334c73 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:06.656343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-dfa437d1-aba6-48f3-a000-4b5863334c73 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:06.736988 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-dfa437d1-aba6-48f3-a000-4b5863334c73 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15/action" status: 202 len: 0 microversion: 2.1 time: 0.097927 Aug 18 12:45:06.737648 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4476/7130] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:45:06 2022] POST /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:45:06.746756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-354d03b9-89e4-4c99-a02a-50867ccc5b9e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:06.747641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-354d03b9-89e4-4c99-a02a-50867ccc5b9e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:06.755538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-354d03b9-89e4-4c99-a02a-50867ccc5b9e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:06.756041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-354d03b9-89e4-4c99-a02a-50867ccc5b9e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:06.756497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-354d03b9-89e4-4c99-a02a-50867ccc5b9e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:06.757215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-354d03b9-89e4-4c99-a02a-50867ccc5b9e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:06.757682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-354d03b9-89e4-4c99-a02a-50867ccc5b9e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:06.758118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-354d03b9-89e4-4c99-a02a-50867ccc5b9e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:06.951710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-354d03b9-89e4-4c99-a02a-50867ccc5b9e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:06.960434 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-354d03b9-89e4-4c99-a02a-50867ccc5b9e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1687 microversion: 2.1 time: 0.217957 Aug 18 12:45:06.961032 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4477/7131] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:06 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1687 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:45:07.989741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3257c095-7484-4500-818b-347d61c421f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:07.990545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3257c095-7484-4500-818b-347d61c421f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:08.000381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3257c095-7484-4500-818b-347d61c421f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:08.001305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3257c095-7484-4500-818b-347d61c421f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:08.002081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3257c095-7484-4500-818b-347d61c421f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:08.003647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3257c095-7484-4500-818b-347d61c421f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:08.004480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3257c095-7484-4500-818b-347d61c421f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:08.005261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3257c095-7484-4500-818b-347d61c421f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:08.168686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3257c095-7484-4500-818b-347d61c421f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:08.180826 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3257c095-7484-4500-818b-347d61c421f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1667 microversion: 2.1 time: 0.194861 Aug 18 12:45:08.181734 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4478/7132] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:07 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1667 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:45:09.282742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-583bba2d-e779-4b9e-b40a-b846c46cda5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:45:09.285371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-583bba2d-e779-4b9e-b40a-b846c46cda5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:09.293049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-583bba2d-e779-4b9e-b40a-b846c46cda5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:09.293555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-583bba2d-e779-4b9e-b40a-b846c46cda5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:09.294010 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-583bba2d-e779-4b9e-b40a-b846c46cda5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:09.294928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-583bba2d-e779-4b9e-b40a-b846c46cda5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:09.295405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-583bba2d-e779-4b9e-b40a-b846c46cda5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:09.295841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-583bba2d-e779-4b9e-b40a-b846c46cda5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:09.350813 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-583bba2d-e779-4b9e-b40a-b846c46cda5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15/action" status: 200 len: 32643 microversion: 2.1 time: 0.072957 Aug 18 12:45:09.358277 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4479/7133] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:45:09 2022] POST /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15/action => generated 32643 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:45:09.365323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7bed0d90-edbc-41c2-bb09-6651f4eb2e03 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:45:09.366166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7bed0d90-edbc-41c2-bb09-6651f4eb2e03 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:09.373907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bed0d90-edbc-41c2-bb09-6651f4eb2e03 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:09.374632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bed0d90-edbc-41c2-bb09-6651f4eb2e03 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:09.375089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bed0d90-edbc-41c2-bb09-6651f4eb2e03 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:09.376149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bed0d90-edbc-41c2-bb09-6651f4eb2e03 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:09.376644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bed0d90-edbc-41c2-bb09-6651f4eb2e03 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:09.377101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7bed0d90-edbc-41c2-bb09-6651f4eb2e03 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:09.456423 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7bed0d90-edbc-41c2-bb09-6651f4eb2e03 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15/action" status: 202 len: 0 microversion: 2.1 time: 0.095460 Aug 18 12:45:09.457276 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4480/7134] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:45:09 2022] POST /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:45:09.470004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-423c34ce-cae5-48c7-84f1-be273042f43d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:09.470703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-423c34ce-cae5-48c7-84f1-be273042f43d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:09.479609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-423c34ce-cae5-48c7-84f1-be273042f43d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:09.480380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-423c34ce-cae5-48c7-84f1-be273042f43d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:09.480894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-423c34ce-cae5-48c7-84f1-be273042f43d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:09.482343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-423c34ce-cae5-48c7-84f1-be273042f43d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:09.483145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-423c34ce-cae5-48c7-84f1-be273042f43d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:09.483739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-423c34ce-cae5-48c7-84f1-be273042f43d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:09.717675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-423c34ce-cae5-48c7-84f1-be273042f43d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:09.728400 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-423c34ce-cae5-48c7-84f1-be273042f43d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1674 microversion: 2.1 time: 0.263728 Aug 18 12:45:09.728905 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4481/7135] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:09 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1674 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:45:10.751820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bf8e6ae6-f9b9-4896-86a9-f3a2b30272ff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:10.753029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bf8e6ae6-f9b9-4896-86a9-f3a2b30272ff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:10.760304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf8e6ae6-f9b9-4896-86a9-f3a2b30272ff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:10.760821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf8e6ae6-f9b9-4896-86a9-f3a2b30272ff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:10.761283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf8e6ae6-f9b9-4896-86a9-f3a2b30272ff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:10.762035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf8e6ae6-f9b9-4896-86a9-f3a2b30272ff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:10.762553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf8e6ae6-f9b9-4896-86a9-f3a2b30272ff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:10.763008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bf8e6ae6-f9b9-4896-86a9-f3a2b30272ff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:10.914396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bf8e6ae6-f9b9-4896-86a9-f3a2b30272ff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:10.923976 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bf8e6ae6-f9b9-4896-86a9-f3a2b30272ff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1682 microversion: 2.1 time: 0.177023 Aug 18 12:45:10.924586 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4482/7136] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:10 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:45:11.045735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a9e0f6e1-01a9-45dd-aebe-1f626a7c3094 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:45:11.048780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a9e0f6e1-01a9-45dd-aebe-1f626a7c3094 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:11.055289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9e0f6e1-01a9-45dd-aebe-1f626a7c3094 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:11.055790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9e0f6e1-01a9-45dd-aebe-1f626a7c3094 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:11.056240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9e0f6e1-01a9-45dd-aebe-1f626a7c3094 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:11.056971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9e0f6e1-01a9-45dd-aebe-1f626a7c3094 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:11.057435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9e0f6e1-01a9-45dd-aebe-1f626a7c3094 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:11.057873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a9e0f6e1-01a9-45dd-aebe-1f626a7c3094 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:11.112516 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a9e0f6e1-01a9-45dd-aebe-1f626a7c3094 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15/action" status: 200 len: 35048 microversion: 2.1 time: 0.070498 Aug 18 12:45:11.113415 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4483/7137] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:45:11 2022] POST /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15/action => generated 35048 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:45:12.678932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ba763502-6599-4f82-b4e4-46fd57e85768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:12.680782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ba763502-6599-4f82-b4e4-46fd57e85768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:12.695436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba763502-6599-4f82-b4e4-46fd57e85768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:12.696159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba763502-6599-4f82-b4e4-46fd57e85768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:12.697013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba763502-6599-4f82-b4e4-46fd57e85768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:12.698381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba763502-6599-4f82-b4e4-46fd57e85768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:12.699338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba763502-6599-4f82-b4e4-46fd57e85768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:12.700200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba763502-6599-4f82-b4e4-46fd57e85768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:12.758306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ba763502-6599-4f82-b4e4-46fd57e85768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:45:12.868330 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ba763502-6599-4f82-b4e4-46fd57e85768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "DELETE /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 204 len: 0 microversion: 2.1 time: 0.195726 Aug 18 12:45:12.872713 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4484/7138] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:45:12 2022] DELETE /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:45:12.875938 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-e80b2713-e558-430f-b315-2d1a305099ac req-0b85ccea-f5e7-4a03-add6-c35c68446a63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5623b261-d066-42f8-96df-cd68ae819f15", "tag": "a09daea5-e890-4aba-8e16-132ea28642b4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:45:12.886819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e80b2713-e558-430f-b315-2d1a305099ac req-0b85ccea-f5e7-4a03-add6-c35c68446a63 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:12.887429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e80b2713-e558-430f-b315-2d1a305099ac req-0b85ccea-f5e7-4a03-add6-c35c68446a63 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:12.888619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e80b2713-e558-430f-b315-2d1a305099ac req-0b85ccea-f5e7-4a03-add6-c35c68446a63 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:12.900684 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e80b2713-e558-430f-b315-2d1a305099ac req-0b85ccea-f5e7-4a03-add6-c35c68446a63 service nova] Creating event network-changed:a09daea5-e890-4aba-8e16-132ea28642b4 for instance 5623b261-d066-42f8-96df-cd68ae819f15 on n-h1-853611-3 Aug 18 12:45:12.905634 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-e80b2713-e558-430f-b315-2d1a305099ac req-0b85ccea-f5e7-4a03-add6-c35c68446a63 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034808 Aug 18 12:45:12.906804 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4485/7139] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:45:12.912084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d1ce8ae6-d0f9-46ef-8dd3-fa8a4a12868e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:12.912789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d1ce8ae6-d0f9-46ef-8dd3-fa8a4a12868e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:12.919764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1ce8ae6-d0f9-46ef-8dd3-fa8a4a12868e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:12.920281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1ce8ae6-d0f9-46ef-8dd3-fa8a4a12868e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:12.920733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1ce8ae6-d0f9-46ef-8dd3-fa8a4a12868e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:12.922000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1ce8ae6-d0f9-46ef-8dd3-fa8a4a12868e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:12.922505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1ce8ae6-d0f9-46ef-8dd3-fa8a4a12868e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:12.922956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d1ce8ae6-d0f9-46ef-8dd3-fa8a4a12868e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:13.078950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d1ce8ae6-d0f9-46ef-8dd3-fa8a4a12868e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:13.087774 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d1ce8ae6-d0f9-46ef-8dd3-fa8a4a12868e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1688 microversion: 2.1 time: 0.179817 Aug 18 12:45:13.088678 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4486/7140] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:12 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:45:14.111704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-07440f16-665e-4646-928b-3b0cb1ff4954 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:14.112499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-07440f16-665e-4646-928b-3b0cb1ff4954 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:14.121021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07440f16-665e-4646-928b-3b0cb1ff4954 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:14.121596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07440f16-665e-4646-928b-3b0cb1ff4954 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:14.122107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07440f16-665e-4646-928b-3b0cb1ff4954 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:14.123016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07440f16-665e-4646-928b-3b0cb1ff4954 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:14.123554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07440f16-665e-4646-928b-3b0cb1ff4954 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:14.124073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07440f16-665e-4646-928b-3b0cb1ff4954 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:14.384374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-07440f16-665e-4646-928b-3b0cb1ff4954 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:14.392166 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-07440f16-665e-4646-928b-3b0cb1ff4954 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1688 microversion: 2.1 time: 0.285288 Aug 18 12:45:14.392755 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4487/7141] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:14 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1688 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:45:15.413609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7dfba1fa-d1c7-420e-a161-15501d60f704 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:15.414657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7dfba1fa-d1c7-420e-a161-15501d60f704 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:15.423245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dfba1fa-d1c7-420e-a161-15501d60f704 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:15.424082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dfba1fa-d1c7-420e-a161-15501d60f704 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:15.424544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dfba1fa-d1c7-420e-a161-15501d60f704 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:15.425304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dfba1fa-d1c7-420e-a161-15501d60f704 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:15.425778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dfba1fa-d1c7-420e-a161-15501d60f704 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:15.426468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7dfba1fa-d1c7-420e-a161-15501d60f704 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:15.504057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7dfba1fa-d1c7-420e-a161-15501d60f704 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:15.515374 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7dfba1fa-d1c7-420e-a161-15501d60f704 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 200 len: 1502 microversion: 2.1 time: 0.105555 Aug 18 12:45:15.516187 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4488/7142] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:15 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 1502 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:45:15.521521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-60ebb03b-4037-438f-ab09-1547110aac5a req-e4a7ff3f-d60b-49fb-8107-402b74545ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5623b261-d066-42f8-96df-cd68ae819f15", "name": "network-vif-deleted", "tag": "a09daea5-e890-4aba-8e16-132ea28642b4"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:45:15.532561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-60ebb03b-4037-438f-ab09-1547110aac5a req-e4a7ff3f-d60b-49fb-8107-402b74545ed4 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:15.533206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-60ebb03b-4037-438f-ab09-1547110aac5a req-e4a7ff3f-d60b-49fb-8107-402b74545ed4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:15.533642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-60ebb03b-4037-438f-ab09-1547110aac5a req-e4a7ff3f-d60b-49fb-8107-402b74545ed4 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:15.546643 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-60ebb03b-4037-438f-ab09-1547110aac5a req-e4a7ff3f-d60b-49fb-8107-402b74545ed4 service nova] Creating event network-vif-deleted:a09daea5-e890-4aba-8e16-132ea28642b4 for instance 5623b261-d066-42f8-96df-cd68ae819f15 on n-h1-853611-3 Aug 18 12:45:15.552643 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-60ebb03b-4037-438f-ab09-1547110aac5a req-e4a7ff3f-d60b-49fb-8107-402b74545ed4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035184 Aug 18 12:45:15.553369 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4489/7143] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:45:16.552537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ade6922-0039-4b02-b5bd-5cca7d849133 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:16.553298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9ade6922-0039-4b02-b5bd-5cca7d849133 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 5623b261-d066-42f8-96df-cd68ae819f15] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:16.559998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ade6922-0039-4b02-b5bd-5cca7d849133 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:16.560504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ade6922-0039-4b02-b5bd-5cca7d849133 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:16.560957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ade6922-0039-4b02-b5bd-5cca7d849133 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:16.561686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ade6922-0039-4b02-b5bd-5cca7d849133 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:16.562826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ade6922-0039-4b02-b5bd-5cca7d849133 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:16.563271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ade6922-0039-4b02-b5bd-5cca7d849133 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:16.568024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:45:16.579747 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-9ade6922-0039-4b02-b5bd-5cca7d849133 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] HTTP exception thrown: Instance 5623b261-d066-42f8-96df-cd68ae819f15 could not be found. Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ade6922-0039-4b02-b5bd-5cca7d849133 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Request method failure captured: Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 HTTP/1.1 Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jQeQZPOFUsCvPq9KJ45C83hU_4PBqTwbXRk1jzU3ZGP69rWq4GCsfSstUtl_fGSuFj9IIScCSANx3NuCkMMOA9dHVMwOwl_vghoFlSI0Mp5C2A5UMmer5lfR-ujm4tsvONIGKbYuCFqRFqUS-ZdywsiNZI2ndTb8o6EwBql0c3GNVE Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 0f1aa7dfe3f74f5ab3b45373c1a17574 Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 0f1aa7dfe3f74f5ab3b45373c1a17574 Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestNetworkAdvancedServerOps-1530263574-project Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 064db809a9034ebc85b986c87d0036d1 Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1530263574-project Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 5623b261-d066-42f8-96df-cd68ae819f15 could not be found. Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '5623b261-d066-42f8-96df-cd68ae819f15'} Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5623b261-d066-42f8-96df-cd68ae819f15 could not be found. Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5623b261-d066-42f8-96df-cd68ae819f15 could not be found. Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:45:16.581538 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:45:16.587555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:45:16.587555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:45:16.587555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:45:16.587555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:45:16.587555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:45:16.587555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:45:16.587555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5623b261-d066-42f8-96df-cd68ae819f15 could not be found. Aug 18 12:45:16.587555 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:45:16.587555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ade6922-0039-4b02-b5bd-5cca7d849133 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Returning 404 to user: Instance 5623b261-d066-42f8-96df-cd68ae819f15 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:45:16.587555 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9ade6922-0039-4b02-b5bd-5cca7d849133 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15" status: 404 len: 111 microversion: 2.1 time: 0.036289 Aug 18 12:45:16.587555 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4490/7144] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:16 2022] GET /compute/v2.1/servers/5623b261-d066-42f8-96df-cd68ae819f15 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:45:16.785182 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:45:16.785788 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:45:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:45:20.419470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1c70763b-8fa3-4a98-b803-b91ce2acb810 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '.version_select at 0x7f51b0dada60>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:20.454348 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1c70763b-8fa3-4a98-b803-b91ce2acb810 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1475000999" status: 202 len: 0 microversion: 2.1 time: 0.037102 Aug 18 12:45:20.455649 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4491/7145] 10.222.0.73 () {58 vars in 1284 bytes} [Thu Aug 18 12:45:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1475000999 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:45:20.489537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-91393ff2-311c-40b4-823e-2bce85694e55 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'create', calling method: .version_select at 0x7f519ed94820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-996753428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkpLjcOR19oVZuRCkvoOpRaUXhDyENMM/gduyS+2XOThEEbADcft6Uef7LD1K80JIdWfn0KktGLZ/S8lyoa3T4eWwe6I2Hy2Kl7Ps5+F1zonkaQdz1ZrJJ3q5TGsOs0RA=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:45:20.510523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-91393ff2-311c-40b4-823e-2bce85694e55 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:45:20.516663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-91393ff2-311c-40b4-823e-2bce85694e55 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for user 064db809a9034ebc85b986c87d0036d1 and project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:45:20.544634 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-91393ff2-311c-40b4-823e-2bce85694e55 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.059437 Aug 18 12:45:20.545254 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4492/7146] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:45:20 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:45:27.620478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2020247062", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "83ccf720-0f21-4f11-b1a7-22ccf7395855"}], "key_name": "tempest-TestNetworkAdvancedServerOps-996753428", "security_groups": [{"name": "tempest-secgroup-smoke-771384860"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:45:27.784390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] validate_networks() for [('83ccf720-0f21-4f11-b1a7-22ccf7395855', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:45:28.411317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:45:28.412033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:45:28.412774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:45:28.413340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:45:28.414089 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:45:28.426767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:28.427422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:28.428011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:28.428882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:28.429673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:28.430304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:28.457913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:45:28.466488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for user 064db809a9034ebc85b986c87d0036d1 and project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:45:28.487419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:45:28.490397 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:45:28.557652 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c0b505ff-087b-4500-a66c-07ba340d97b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.944341 Aug 18 12:45:28.559832 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4493/7147] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:45:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:45:28.575795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1eb44dbd-1a7e-4656-8b61-b636c634d0f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:28.577384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1eb44dbd-1a7e-4656-8b61-b636c634d0f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:28.668966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1eb44dbd-1a7e-4656-8b61-b636c634d0f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:28.681448 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1eb44dbd-1a7e-4656-8b61-b636c634d0f0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1266 microversion: 2.1 time: 0.112091 Aug 18 12:45:28.682285 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4494/7148] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:28 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:45:29.727566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a93a5065-4b46-450e-b6e1-b3105818b97a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:29.729110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a93a5065-4b46-450e-b6e1-b3105818b97a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:29.743806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a93a5065-4b46-450e-b6e1-b3105818b97a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:29.744728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a93a5065-4b46-450e-b6e1-b3105818b97a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:29.745530 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a93a5065-4b46-450e-b6e1-b3105818b97a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:29.746887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a93a5065-4b46-450e-b6e1-b3105818b97a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:29.747719 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a93a5065-4b46-450e-b6e1-b3105818b97a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:29.748512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a93a5065-4b46-450e-b6e1-b3105818b97a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:29.860343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a93a5065-4b46-450e-b6e1-b3105818b97a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:29.880906 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a93a5065-4b46-450e-b6e1-b3105818b97a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1318 microversion: 2.1 time: 0.161819 Aug 18 12:45:29.888098 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4495/7149] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:29 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:45:30.913834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-43d95d7c-16a9-4f6b-b92b-83a7fc3d47b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:30.915003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-43d95d7c-16a9-4f6b-b92b-83a7fc3d47b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:30.918810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:45:30.934029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43d95d7c-16a9-4f6b-b92b-83a7fc3d47b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:30.944499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43d95d7c-16a9-4f6b-b92b-83a7fc3d47b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:30.945677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43d95d7c-16a9-4f6b-b92b-83a7fc3d47b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:30.947248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43d95d7c-16a9-4f6b-b92b-83a7fc3d47b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:30.949319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43d95d7c-16a9-4f6b-b92b-83a7fc3d47b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:30.950115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43d95d7c-16a9-4f6b-b92b-83a7fc3d47b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:31.449005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-43d95d7c-16a9-4f6b-b92b-83a7fc3d47b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:31.460979 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-43d95d7c-16a9-4f6b-b92b-83a7fc3d47b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1391 microversion: 2.1 time: 0.552177 Aug 18 12:45:31.461983 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4496/7150] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:30 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1391 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:45:32.363132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-0f2b2de9-a6d8-48ec-b723-0a3966d8be1c req-7e8a6f69-4167-4b17-a101-8cd8e86e8615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7adac7b-70c7-41d8-b5cb-11230bd47066", "tag": "8776e01e-784d-4f9b-90a4-36ed88496cfc"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:45:32.374521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0f2b2de9-a6d8-48ec-b723-0a3966d8be1c req-7e8a6f69-4167-4b17-a101-8cd8e86e8615 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:32.375347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0f2b2de9-a6d8-48ec-b723-0a3966d8be1c req-7e8a6f69-4167-4b17-a101-8cd8e86e8615 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:32.375811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-0f2b2de9-a6d8-48ec-b723-0a3966d8be1c req-7e8a6f69-4167-4b17-a101-8cd8e86e8615 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:32.389019 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-0f2b2de9-a6d8-48ec-b723-0a3966d8be1c req-7e8a6f69-4167-4b17-a101-8cd8e86e8615 service nova] Creating event network-changed:8776e01e-784d-4f9b-90a4-36ed88496cfc for instance f7adac7b-70c7-41d8-b5cb-11230bd47066 on n-h2-853611-3 Aug 18 12:45:32.396522 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-0f2b2de9-a6d8-48ec-b723-0a3966d8be1c req-7e8a6f69-4167-4b17-a101-8cd8e86e8615 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037184 Aug 18 12:45:32.397628 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4497/7151] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:45:32.488542 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8ed15566-394a-4c71-af50-405251eba6b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:32.489168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8ed15566-394a-4c71-af50-405251eba6b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:32.496757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ed15566-394a-4c71-af50-405251eba6b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:32.497507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ed15566-394a-4c71-af50-405251eba6b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:32.498286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ed15566-394a-4c71-af50-405251eba6b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:32.499078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ed15566-394a-4c71-af50-405251eba6b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:32.500236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ed15566-394a-4c71-af50-405251eba6b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:32.501539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8ed15566-394a-4c71-af50-405251eba6b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:32.748042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8ed15566-394a-4c71-af50-405251eba6b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:32.759922 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8ed15566-394a-4c71-af50-405251eba6b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1391 microversion: 2.1 time: 0.278494 Aug 18 12:45:32.760708 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4498/7152] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:32 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1391 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:45:33.784269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cdf72286-c6e0-4a72-bca0-3feb7d7cf9db tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:33.785143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cdf72286-c6e0-4a72-bca0-3feb7d7cf9db tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:33.792584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdf72286-c6e0-4a72-bca0-3feb7d7cf9db tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:33.793120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdf72286-c6e0-4a72-bca0-3feb7d7cf9db tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:33.793563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdf72286-c6e0-4a72-bca0-3feb7d7cf9db tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:33.794320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdf72286-c6e0-4a72-bca0-3feb7d7cf9db tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:33.794851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdf72286-c6e0-4a72-bca0-3feb7d7cf9db tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:33.795298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cdf72286-c6e0-4a72-bca0-3feb7d7cf9db tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:34.038918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cdf72286-c6e0-4a72-bca0-3feb7d7cf9db tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:34.055039 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cdf72286-c6e0-4a72-bca0-3feb7d7cf9db tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1391 microversion: 2.1 time: 0.274998 Aug 18 12:45:34.056784 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4499/7153] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:33 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1391 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:45:35.078578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-63077ac6-7f61-40d3-ab81-6df1166d4ba5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:35.079966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-63077ac6-7f61-40d3-ab81-6df1166d4ba5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:35.087842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63077ac6-7f61-40d3-ab81-6df1166d4ba5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:35.088350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63077ac6-7f61-40d3-ab81-6df1166d4ba5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:35.088804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63077ac6-7f61-40d3-ab81-6df1166d4ba5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:35.089548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63077ac6-7f61-40d3-ab81-6df1166d4ba5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:35.090084 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63077ac6-7f61-40d3-ab81-6df1166d4ba5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:35.090497 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63077ac6-7f61-40d3-ab81-6df1166d4ba5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:35.284131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-63077ac6-7f61-40d3-ab81-6df1166d4ba5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:35.293699 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-63077ac6-7f61-40d3-ab81-6df1166d4ba5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1391 microversion: 2.1 time: 0.219889 Aug 18 12:45:35.294331 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4500/7154] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:35 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1391 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:45:36.326110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-23ff2a30-a7e1-4fe2-b35d-0ddcc594b3e1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:36.326825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-23ff2a30-a7e1-4fe2-b35d-0ddcc594b3e1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:36.334610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23ff2a30-a7e1-4fe2-b35d-0ddcc594b3e1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:36.335133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23ff2a30-a7e1-4fe2-b35d-0ddcc594b3e1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:36.335608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23ff2a30-a7e1-4fe2-b35d-0ddcc594b3e1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:36.336334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23ff2a30-a7e1-4fe2-b35d-0ddcc594b3e1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:36.336811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23ff2a30-a7e1-4fe2-b35d-0ddcc594b3e1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:36.337258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-23ff2a30-a7e1-4fe2-b35d-0ddcc594b3e1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:36.488953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-23ff2a30-a7e1-4fe2-b35d-0ddcc594b3e1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:36.497688 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-23ff2a30-a7e1-4fe2-b35d-0ddcc594b3e1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1391 microversion: 2.1 time: 0.175576 Aug 18 12:45:36.498335 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4501/7155] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:36 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:45:36.979615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7a63dfff-9136-4c94-a8c3-c68566c7c666 req-99efafe0-9912-46b0-950a-f671a23b95ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7adac7b-70c7-41d8-b5cb-11230bd47066", "name": "network-vif-plugged", "status": "completed", "tag": "8776e01e-784d-4f9b-90a4-36ed88496cfc"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:45:36.997266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a63dfff-9136-4c94-a8c3-c68566c7c666 req-99efafe0-9912-46b0-950a-f671a23b95ac service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:36.998218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a63dfff-9136-4c94-a8c3-c68566c7c666 req-99efafe0-9912-46b0-950a-f671a23b95ac service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:36.999054 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7a63dfff-9136-4c94-a8c3-c68566c7c666 req-99efafe0-9912-46b0-950a-f671a23b95ac service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:37.021736 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7a63dfff-9136-4c94-a8c3-c68566c7c666 req-99efafe0-9912-46b0-950a-f671a23b95ac service nova] Creating event network-vif-plugged:8776e01e-784d-4f9b-90a4-36ed88496cfc for instance f7adac7b-70c7-41d8-b5cb-11230bd47066 on n-h2-853611-3 Aug 18 12:45:37.030826 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7a63dfff-9136-4c94-a8c3-c68566c7c666 req-99efafe0-9912-46b0-950a-f671a23b95ac service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057770 Aug 18 12:45:37.032889 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4502/7156] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:45:37.522654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-30d8bf9d-1178-4d4c-8c39-c3aff491acc8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:37.523382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-30d8bf9d-1178-4d4c-8c39-c3aff491acc8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:37.529920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d8bf9d-1178-4d4c-8c39-c3aff491acc8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:37.530474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d8bf9d-1178-4d4c-8c39-c3aff491acc8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:37.530972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d8bf9d-1178-4d4c-8c39-c3aff491acc8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:37.531710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d8bf9d-1178-4d4c-8c39-c3aff491acc8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:37.532357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d8bf9d-1178-4d4c-8c39-c3aff491acc8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:37.532906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-30d8bf9d-1178-4d4c-8c39-c3aff491acc8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:37.681852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-30d8bf9d-1178-4d4c-8c39-c3aff491acc8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:37.691011 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-30d8bf9d-1178-4d4c-8c39-c3aff491acc8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1391 microversion: 2.1 time: 0.173385 Aug 18 12:45:37.691622 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4503/7157] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:37 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:45:38.726202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c17dcadd-8173-4c8b-9c07-4304049ac71a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:38.726990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c17dcadd-8173-4c8b-9c07-4304049ac71a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:38.729106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:45:38.731064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:45:38.740523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c17dcadd-8173-4c8b-9c07-4304049ac71a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:38.741091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c17dcadd-8173-4c8b-9c07-4304049ac71a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:38.741587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c17dcadd-8173-4c8b-9c07-4304049ac71a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:38.742379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c17dcadd-8173-4c8b-9c07-4304049ac71a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:38.743047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c17dcadd-8173-4c8b-9c07-4304049ac71a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:38.743531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c17dcadd-8173-4c8b-9c07-4304049ac71a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:38.909617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c17dcadd-8173-4c8b-9c07-4304049ac71a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:38.918016 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c17dcadd-8173-4c8b-9c07-4304049ac71a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1563 microversion: 2.1 time: 0.196008 Aug 18 12:45:38.918655 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4504/7158] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:38 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1563 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:45:38.942778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec646e06-3ec7-4c7a-ba0d-ea036fed02b6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:38.943484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ec646e06-3ec7-4c7a-ba0d-ea036fed02b6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:38.951665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec646e06-3ec7-4c7a-ba0d-ea036fed02b6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:38.952179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec646e06-3ec7-4c7a-ba0d-ea036fed02b6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:38.952653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec646e06-3ec7-4c7a-ba0d-ea036fed02b6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:38.953458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec646e06-3ec7-4c7a-ba0d-ea036fed02b6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:38.953933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec646e06-3ec7-4c7a-ba0d-ea036fed02b6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:38.954379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec646e06-3ec7-4c7a-ba0d-ea036fed02b6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:39.114280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ec646e06-3ec7-4c7a-ba0d-ea036fed02b6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:39.122275 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ec646e06-3ec7-4c7a-ba0d-ea036fed02b6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1563 microversion: 2.1 time: 0.185803 Aug 18 12:45:39.122905 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4505/7159] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:38 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:45:41.283928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-774cebb3-da64-4538-a660-77de604fc126 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:45:41.284581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-774cebb3-da64-4538-a660-77de604fc126 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:45:41.291818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-774cebb3-da64-4538-a660-77de604fc126 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:41.292322 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-774cebb3-da64-4538-a660-77de604fc126 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:41.292778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-774cebb3-da64-4538-a660-77de604fc126 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:41.293504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-774cebb3-da64-4538-a660-77de604fc126 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:41.293975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-774cebb3-da64-4538-a660-77de604fc126 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:41.294413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-774cebb3-da64-4538-a660-77de604fc126 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:41.440566 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-774cebb3-da64-4538-a660-77de604fc126 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:45:41.448362 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-774cebb3-da64-4538-a660-77de604fc126 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1563 microversion: 2.1 time: 0.168831 Aug 18 12:45:41.448947 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4506/7160] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:45:41 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:45:41.453951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-17cad79e-c770-4e25-8257-146b3a828c97 req-82e058c3-1e3f-45b3-9edc-6eb48ce00a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7adac7b-70c7-41d8-b5cb-11230bd47066", "tag": "8776e01e-784d-4f9b-90a4-36ed88496cfc"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:45:41.463600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-17cad79e-c770-4e25-8257-146b3a828c97 req-82e058c3-1e3f-45b3-9edc-6eb48ce00a20 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:45:41.466206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-17cad79e-c770-4e25-8257-146b3a828c97 req-82e058c3-1e3f-45b3-9edc-6eb48ce00a20 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:45:41.466756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-17cad79e-c770-4e25-8257-146b3a828c97 req-82e058c3-1e3f-45b3-9edc-6eb48ce00a20 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:45:41.480596 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-17cad79e-c770-4e25-8257-146b3a828c97 req-82e058c3-1e3f-45b3-9edc-6eb48ce00a20 service nova] Creating event network-changed:8776e01e-784d-4f9b-90a4-36ed88496cfc for instance f7adac7b-70c7-41d8-b5cb-11230bd47066 on n-h2-853611-3 Aug 18 12:45:41.487402 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-17cad79e-c770-4e25-8257-146b3a828c97 req-82e058c3-1e3f-45b3-9edc-6eb48ce00a20 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036666 Aug 18 12:45:41.488110 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4507/7161] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:46:02.721013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e76d78e9-c95e-4167-b507-ae71c5392b6f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:46:02.723365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e76d78e9-c95e-4167-b507-ae71c5392b6f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:02.726132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=23 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:46:02.726812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=68 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:46:02.732755 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e76d78e9-c95e-4167-b507-ae71c5392b6f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:02.733264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e76d78e9-c95e-4167-b507-ae71c5392b6f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:02.733711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e76d78e9-c95e-4167-b507-ae71c5392b6f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:02.735462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e76d78e9-c95e-4167-b507-ae71c5392b6f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:02.735931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e76d78e9-c95e-4167-b507-ae71c5392b6f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:02.736372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e76d78e9-c95e-4167-b507-ae71c5392b6f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:02.793957 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e76d78e9-c95e-4167-b507-ae71c5392b6f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066/action" status: 200 len: 24575 microversion: 2.1 time: 0.078117 Aug 18 12:46:02.794899 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4508/7162] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:46:02 2022] POST /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066/action => generated 24575 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:46:13.756121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-96fc3574-14e4-4d42-aa2d-7b1d08d72ed7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:46:13.758624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-96fc3574-14e4-4d42-aa2d-7b1d08d72ed7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:13.761427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:46:13.762107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:46:13.769080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96fc3574-14e4-4d42-aa2d-7b1d08d72ed7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:13.769595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96fc3574-14e4-4d42-aa2d-7b1d08d72ed7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:13.770056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96fc3574-14e4-4d42-aa2d-7b1d08d72ed7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:13.770940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96fc3574-14e4-4d42-aa2d-7b1d08d72ed7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:13.771453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96fc3574-14e4-4d42-aa2d-7b1d08d72ed7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:13.771904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96fc3574-14e4-4d42-aa2d-7b1d08d72ed7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:13.858196 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-96fc3574-14e4-4d42-aa2d-7b1d08d72ed7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066/action" status: 202 len: 0 microversion: 2.1 time: 0.107461 Aug 18 12:46:13.859532 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4509/7163] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:46:13 2022] POST /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:46:13.870449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-75085964-5b8d-4287-8ee5-324bea5ae32c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:13.871754 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-75085964-5b8d-4287-8ee5-324bea5ae32c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:13.882931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75085964-5b8d-4287-8ee5-324bea5ae32c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:13.884088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75085964-5b8d-4287-8ee5-324bea5ae32c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:13.884714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75085964-5b8d-4287-8ee5-324bea5ae32c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:13.887116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75085964-5b8d-4287-8ee5-324bea5ae32c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:13.887116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75085964-5b8d-4287-8ee5-324bea5ae32c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:13.888249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-75085964-5b8d-4287-8ee5-324bea5ae32c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:14.167915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-75085964-5b8d-4287-8ee5-324bea5ae32c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:14.176467 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-75085964-5b8d-4287-8ee5-324bea5ae32c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1674 microversion: 2.1 time: 0.310483 Aug 18 12:46:14.177512 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4510/7164] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:13 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1674 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:46:15.200533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e03f5c8a-4149-4044-b349-8cf1e01c20a7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:15.201400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e03f5c8a-4149-4044-b349-8cf1e01c20a7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:15.209970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e03f5c8a-4149-4044-b349-8cf1e01c20a7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:15.210567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e03f5c8a-4149-4044-b349-8cf1e01c20a7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:15.211055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e03f5c8a-4149-4044-b349-8cf1e01c20a7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:15.211790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e03f5c8a-4149-4044-b349-8cf1e01c20a7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:15.212271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e03f5c8a-4149-4044-b349-8cf1e01c20a7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:15.212724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e03f5c8a-4149-4044-b349-8cf1e01c20a7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:15.356830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e03f5c8a-4149-4044-b349-8cf1e01c20a7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:15.365518 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e03f5c8a-4149-4044-b349-8cf1e01c20a7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1679 microversion: 2.1 time: 0.169572 Aug 18 12:46:15.366113 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4511/7165] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:15 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:46:16.387624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3002dfa9-ec3f-4968-9aa5-3d06e00c1829 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:16.388446 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3002dfa9-ec3f-4968-9aa5-3d06e00c1829 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:16.395590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3002dfa9-ec3f-4968-9aa5-3d06e00c1829 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:16.396093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3002dfa9-ec3f-4968-9aa5-3d06e00c1829 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:16.396553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3002dfa9-ec3f-4968-9aa5-3d06e00c1829 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:16.397288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3002dfa9-ec3f-4968-9aa5-3d06e00c1829 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:16.397762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3002dfa9-ec3f-4968-9aa5-3d06e00c1829 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:16.398201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3002dfa9-ec3f-4968-9aa5-3d06e00c1829 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:16.553498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3002dfa9-ec3f-4968-9aa5-3d06e00c1829 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:16.562299 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3002dfa9-ec3f-4968-9aa5-3d06e00c1829 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1679 microversion: 2.1 time: 0.178243 Aug 18 12:46:16.562971 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4512/7166] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:16 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:46:17.584704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55d6191e-b372-4946-b58f-83383c73d471 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:17.585457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-55d6191e-b372-4946-b58f-83383c73d471 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:17.592929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55d6191e-b372-4946-b58f-83383c73d471 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:17.593586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55d6191e-b372-4946-b58f-83383c73d471 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:17.593961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55d6191e-b372-4946-b58f-83383c73d471 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:17.594752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55d6191e-b372-4946-b58f-83383c73d471 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:17.595230 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55d6191e-b372-4946-b58f-83383c73d471 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:17.595675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55d6191e-b372-4946-b58f-83383c73d471 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:17.766236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-55d6191e-b372-4946-b58f-83383c73d471 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:17.774566 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-55d6191e-b372-4946-b58f-83383c73d471 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1679 microversion: 2.1 time: 0.193843 Aug 18 12:46:17.775170 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4513/7167] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:17 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:46:18.798338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4e2244b9-077a-4904-b1cf-f0d9d3b0dc31 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:18.799164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4e2244b9-077a-4904-b1cf-f0d9d3b0dc31 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:18.806620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e2244b9-077a-4904-b1cf-f0d9d3b0dc31 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:18.807124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e2244b9-077a-4904-b1cf-f0d9d3b0dc31 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:18.807575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e2244b9-077a-4904-b1cf-f0d9d3b0dc31 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:18.808305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e2244b9-077a-4904-b1cf-f0d9d3b0dc31 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:18.808775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e2244b9-077a-4904-b1cf-f0d9d3b0dc31 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:18.809216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4e2244b9-077a-4904-b1cf-f0d9d3b0dc31 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:18.970795 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4e2244b9-077a-4904-b1cf-f0d9d3b0dc31 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:18.984956 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4e2244b9-077a-4904-b1cf-f0d9d3b0dc31 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1679 microversion: 2.1 time: 0.190406 Aug 18 12:46:18.986062 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4514/7168] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:18 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:46:20.007675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f8ee3967-17b9-4494-b99f-6cec8d42774d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:20.008775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f8ee3967-17b9-4494-b99f-6cec8d42774d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:20.015687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ee3967-17b9-4494-b99f-6cec8d42774d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:20.016197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ee3967-17b9-4494-b99f-6cec8d42774d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:20.016683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ee3967-17b9-4494-b99f-6cec8d42774d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:20.017415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ee3967-17b9-4494-b99f-6cec8d42774d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:20.017882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ee3967-17b9-4494-b99f-6cec8d42774d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:20.018326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f8ee3967-17b9-4494-b99f-6cec8d42774d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:20.527194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f8ee3967-17b9-4494-b99f-6cec8d42774d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:20.536601 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f8ee3967-17b9-4494-b99f-6cec8d42774d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1679 microversion: 2.1 time: 0.533135 Aug 18 12:46:20.537221 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4515/7169] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:20 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1679 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:46:21.558990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ad1c030-9aef-453f-a9a6-15a700974104 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:21.559694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9ad1c030-9aef-453f-a9a6-15a700974104 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:21.567684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ad1c030-9aef-453f-a9a6-15a700974104 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:21.568194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ad1c030-9aef-453f-a9a6-15a700974104 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:21.568651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ad1c030-9aef-453f-a9a6-15a700974104 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:21.569379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ad1c030-9aef-453f-a9a6-15a700974104 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:21.569853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ad1c030-9aef-453f-a9a6-15a700974104 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:21.570300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ad1c030-9aef-453f-a9a6-15a700974104 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:21.712383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9ad1c030-9aef-453f-a9a6-15a700974104 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:21.720746 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9ad1c030-9aef-453f-a9a6-15a700974104 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1679 microversion: 2.1 time: 0.165802 Aug 18 12:46:21.721458 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4516/7170] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:21 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:46:22.743404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2592197a-0077-486a-8523-7ea8f1b5c635 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:22.744311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2592197a-0077-486a-8523-7ea8f1b5c635 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:22.752661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2592197a-0077-486a-8523-7ea8f1b5c635 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:22.753175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2592197a-0077-486a-8523-7ea8f1b5c635 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:22.753643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2592197a-0077-486a-8523-7ea8f1b5c635 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:22.754392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2592197a-0077-486a-8523-7ea8f1b5c635 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:22.754898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2592197a-0077-486a-8523-7ea8f1b5c635 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:22.755611 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2592197a-0077-486a-8523-7ea8f1b5c635 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:22.907458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2592197a-0077-486a-8523-7ea8f1b5c635 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:22.915753 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2592197a-0077-486a-8523-7ea8f1b5c635 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1679 microversion: 2.1 time: 0.176394 Aug 18 12:46:22.916357 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4517/7171] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:22 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:46:23.940116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c0fcb5fa-d6a1-4773-8ff5-26cc22f1c039 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:23.940827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c0fcb5fa-d6a1-4773-8ff5-26cc22f1c039 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:23.948332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0fcb5fa-d6a1-4773-8ff5-26cc22f1c039 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:23.948850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0fcb5fa-d6a1-4773-8ff5-26cc22f1c039 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:23.949297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0fcb5fa-d6a1-4773-8ff5-26cc22f1c039 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:23.950020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0fcb5fa-d6a1-4773-8ff5-26cc22f1c039 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:23.950511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0fcb5fa-d6a1-4773-8ff5-26cc22f1c039 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:23.950949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c0fcb5fa-d6a1-4773-8ff5-26cc22f1c039 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:24.104139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c0fcb5fa-d6a1-4773-8ff5-26cc22f1c039 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:24.114073 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c0fcb5fa-d6a1-4773-8ff5-26cc22f1c039 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1679 microversion: 2.1 time: 0.178383 Aug 18 12:46:24.115102 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4518/7172] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:23 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:46:25.137809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-63caf78a-cbad-44d2-84d6-5d104972d566 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:25.138608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-63caf78a-cbad-44d2-84d6-5d104972d566 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:25.146002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63caf78a-cbad-44d2-84d6-5d104972d566 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:25.146543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63caf78a-cbad-44d2-84d6-5d104972d566 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:25.147029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63caf78a-cbad-44d2-84d6-5d104972d566 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:25.147766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63caf78a-cbad-44d2-84d6-5d104972d566 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:25.148242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63caf78a-cbad-44d2-84d6-5d104972d566 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:25.148690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-63caf78a-cbad-44d2-84d6-5d104972d566 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:25.311117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-63caf78a-cbad-44d2-84d6-5d104972d566 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:25.320497 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-63caf78a-cbad-44d2-84d6-5d104972d566 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1679 microversion: 2.1 time: 0.186710 Aug 18 12:46:25.321105 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4519/7173] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:25 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:46:26.343933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2355aa19-80b7-4f78-b50e-ea2387a99a3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:26.344997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2355aa19-80b7-4f78-b50e-ea2387a99a3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:26.352232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2355aa19-80b7-4f78-b50e-ea2387a99a3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:26.352743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2355aa19-80b7-4f78-b50e-ea2387a99a3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:26.353202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2355aa19-80b7-4f78-b50e-ea2387a99a3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:26.353944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2355aa19-80b7-4f78-b50e-ea2387a99a3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:26.354452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2355aa19-80b7-4f78-b50e-ea2387a99a3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:26.354915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2355aa19-80b7-4f78-b50e-ea2387a99a3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:26.507095 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2355aa19-80b7-4f78-b50e-ea2387a99a3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:26.516908 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2355aa19-80b7-4f78-b50e-ea2387a99a3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1679 microversion: 2.1 time: 0.177336 Aug 18 12:46:26.517510 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4520/7174] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:26 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:46:27.539771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f78b37f3-9fce-46c2-a05d-b2cfc8868aaa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:27.540471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f78b37f3-9fce-46c2-a05d-b2cfc8868aaa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:27.548591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f78b37f3-9fce-46c2-a05d-b2cfc8868aaa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:27.549161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f78b37f3-9fce-46c2-a05d-b2cfc8868aaa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:27.549624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f78b37f3-9fce-46c2-a05d-b2cfc8868aaa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:27.550370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f78b37f3-9fce-46c2-a05d-b2cfc8868aaa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:27.550911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f78b37f3-9fce-46c2-a05d-b2cfc8868aaa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:27.551359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f78b37f3-9fce-46c2-a05d-b2cfc8868aaa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:27.698134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f78b37f3-9fce-46c2-a05d-b2cfc8868aaa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:27.707274 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f78b37f3-9fce-46c2-a05d-b2cfc8868aaa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1679 microversion: 2.1 time: 0.171262 Aug 18 12:46:27.707743 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4521/7175] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:27 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:46:28.731693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5047688f-f337-4653-8c8d-cd291a42e7f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:28.732422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5047688f-f337-4653-8c8d-cd291a42e7f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:28.741075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5047688f-f337-4653-8c8d-cd291a42e7f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:28.741589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5047688f-f337-4653-8c8d-cd291a42e7f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:28.742068 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5047688f-f337-4653-8c8d-cd291a42e7f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:28.742839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5047688f-f337-4653-8c8d-cd291a42e7f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:28.743323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5047688f-f337-4653-8c8d-cd291a42e7f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:28.743775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5047688f-f337-4653-8c8d-cd291a42e7f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:28.897564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5047688f-f337-4653-8c8d-cd291a42e7f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:28.906382 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5047688f-f337-4653-8c8d-cd291a42e7f7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1679 microversion: 2.1 time: 0.178504 Aug 18 12:46:28.907025 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4522/7176] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:28 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:46:29.928058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ea180d54-9428-46f8-89b9-a8f763b9274e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:29.928766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ea180d54-9428-46f8-89b9-a8f763b9274e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:29.936834 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea180d54-9428-46f8-89b9-a8f763b9274e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:29.937872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea180d54-9428-46f8-89b9-a8f763b9274e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:29.938539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea180d54-9428-46f8-89b9-a8f763b9274e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:29.939240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea180d54-9428-46f8-89b9-a8f763b9274e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:29.939720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea180d54-9428-46f8-89b9-a8f763b9274e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:29.940168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea180d54-9428-46f8-89b9-a8f763b9274e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:30.108213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ea180d54-9428-46f8-89b9-a8f763b9274e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:30.123505 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ea180d54-9428-46f8-89b9-a8f763b9274e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1679 microversion: 2.1 time: 0.198957 Aug 18 12:46:30.125527 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4523/7177] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:29 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:46:31.157673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-330936ee-b3bd-409e-a265-d3646af46a91 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:46:31.158372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-330936ee-b3bd-409e-a265-d3646af46a91 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:31.165539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-330936ee-b3bd-409e-a265-d3646af46a91 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:31.166052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-330936ee-b3bd-409e-a265-d3646af46a91 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:31.166525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-330936ee-b3bd-409e-a265-d3646af46a91 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:31.167255 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-330936ee-b3bd-409e-a265-d3646af46a91 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:31.167725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-330936ee-b3bd-409e-a265-d3646af46a91 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:31.168168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-330936ee-b3bd-409e-a265-d3646af46a91 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:31.189085 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:46:31.325020 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-330936ee-b3bd-409e-a265-d3646af46a91 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:46:31.334623 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-330936ee-b3bd-409e-a265-d3646af46a91 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1682 microversion: 2.1 time: 0.180850 Aug 18 12:46:31.335229 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4524/7178] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:46:31 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:46:38.859152 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:46:38.859776 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:46:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:46:55.544899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-90a550a7-e819-43c0-a0ed-01133eb820b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:46:55.547783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-90a550a7-e819-43c0-a0ed-01133eb820b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:46:55.550625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=32 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:46:55.551348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:46:55.557801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90a550a7-e819-43c0-a0ed-01133eb820b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:55.558316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90a550a7-e819-43c0-a0ed-01133eb820b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:55.558819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90a550a7-e819-43c0-a0ed-01133eb820b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:55.559558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90a550a7-e819-43c0-a0ed-01133eb820b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:46:55.560030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90a550a7-e819-43c0-a0ed-01133eb820b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:46:55.560481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-90a550a7-e819-43c0-a0ed-01133eb820b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:46:55.619969 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-90a550a7-e819-43c0-a0ed-01133eb820b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066/action" status: 200 len: 69113 microversion: 2.1 time: 0.078864 Aug 18 12:46:55.620672 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4525/7179] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:46:55 2022] POST /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066/action => generated 69113 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:47:02.842814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4aa028ee-de29-48f1-94c4-67278f75fe19 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:02.845533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4aa028ee-de29-48f1-94c4-67278f75fe19 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:02.854244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aa028ee-de29-48f1-94c4-67278f75fe19 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:02.854786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aa028ee-de29-48f1-94c4-67278f75fe19 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:02.855247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aa028ee-de29-48f1-94c4-67278f75fe19 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:02.856163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aa028ee-de29-48f1-94c4-67278f75fe19 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:02.856646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aa028ee-de29-48f1-94c4-67278f75fe19 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:02.857102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4aa028ee-de29-48f1-94c4-67278f75fe19 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:02.890920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4aa028ee-de29-48f1-94c4-67278f75fe19 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:47:02.998464 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4aa028ee-de29-48f1-94c4-67278f75fe19 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 204 len: 0 microversion: 2.1 time: 0.159851 Aug 18 12:47:03.000314 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4526/7180] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:47:02 2022] DELETE /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:47:03.114471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8be09341-e2aa-4c3a-9071-d49062caab66 req-5177b400-0dcd-4cf2-878e-62eba04f9d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7adac7b-70c7-41d8-b5cb-11230bd47066", "tag": "8776e01e-784d-4f9b-90a4-36ed88496cfc"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:47:03.128971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8be09341-e2aa-4c3a-9071-d49062caab66 req-5177b400-0dcd-4cf2-878e-62eba04f9d93 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:03.129876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8be09341-e2aa-4c3a-9071-d49062caab66 req-5177b400-0dcd-4cf2-878e-62eba04f9d93 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:03.130735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8be09341-e2aa-4c3a-9071-d49062caab66 req-5177b400-0dcd-4cf2-878e-62eba04f9d93 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:03.153716 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8be09341-e2aa-4c3a-9071-d49062caab66 req-5177b400-0dcd-4cf2-878e-62eba04f9d93 service nova] Creating event network-changed:8776e01e-784d-4f9b-90a4-36ed88496cfc for instance f7adac7b-70c7-41d8-b5cb-11230bd47066 on n-h2-853611-3 Aug 18 12:47:03.162825 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8be09341-e2aa-4c3a-9071-d49062caab66 req-5177b400-0dcd-4cf2-878e-62eba04f9d93 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159969 Aug 18 12:47:03.163943 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4527/7181] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:47:03.175022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a2a9bf11-791d-40c4-a18d-eb4d651d49cd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:03.175900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a2a9bf11-791d-40c4-a18d-eb4d651d49cd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:03.188217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2a9bf11-791d-40c4-a18d-eb4d651d49cd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:03.189162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2a9bf11-791d-40c4-a18d-eb4d651d49cd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:03.190250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2a9bf11-791d-40c4-a18d-eb4d651d49cd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:03.191622 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2a9bf11-791d-40c4-a18d-eb4d651d49cd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:03.192555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2a9bf11-791d-40c4-a18d-eb4d651d49cd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:03.193379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2a9bf11-791d-40c4-a18d-eb4d651d49cd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:03.435791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a2a9bf11-791d-40c4-a18d-eb4d651d49cd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:47:03.445242 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a2a9bf11-791d-40c4-a18d-eb4d651d49cd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1688 microversion: 2.1 time: 0.279407 Aug 18 12:47:03.445864 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4528/7182] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:03 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1688 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:47:04.484220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-386c5481-1c08-496e-84f1-270ff9d0000b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:04.485561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-386c5481-1c08-496e-84f1-270ff9d0000b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:04.498298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-386c5481-1c08-496e-84f1-270ff9d0000b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:04.499476 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-386c5481-1c08-496e-84f1-270ff9d0000b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:04.500633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-386c5481-1c08-496e-84f1-270ff9d0000b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:04.502179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-386c5481-1c08-496e-84f1-270ff9d0000b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:04.503232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-386c5481-1c08-496e-84f1-270ff9d0000b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:04.504847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-386c5481-1c08-496e-84f1-270ff9d0000b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:04.786963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-386c5481-1c08-496e-84f1-270ff9d0000b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:47:04.808280 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-386c5481-1c08-496e-84f1-270ff9d0000b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 200 len: 1688 microversion: 2.1 time: 0.331509 Aug 18 12:47:04.809587 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4529/7183] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:04 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 1688 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:47:05.182140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-6f726b79-b593-425a-9d5d-7f28212ee2f8 req-473d6791-7ba1-4cf1-89af-f1de38b8d120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7adac7b-70c7-41d8-b5cb-11230bd47066", "name": "network-vif-deleted", "tag": "8776e01e-784d-4f9b-90a4-36ed88496cfc"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:47:05.192902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6f726b79-b593-425a-9d5d-7f28212ee2f8 req-473d6791-7ba1-4cf1-89af-f1de38b8d120 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:05.193400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6f726b79-b593-425a-9d5d-7f28212ee2f8 req-473d6791-7ba1-4cf1-89af-f1de38b8d120 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:05.193854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6f726b79-b593-425a-9d5d-7f28212ee2f8 req-473d6791-7ba1-4cf1-89af-f1de38b8d120 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:05.207944 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6f726b79-b593-425a-9d5d-7f28212ee2f8 req-473d6791-7ba1-4cf1-89af-f1de38b8d120 service nova] Creating event network-vif-deleted:8776e01e-784d-4f9b-90a4-36ed88496cfc for instance f7adac7b-70c7-41d8-b5cb-11230bd47066 on n-h2-853611-3 Aug 18 12:47:05.213716 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-6f726b79-b593-425a-9d5d-7f28212ee2f8 req-473d6791-7ba1-4cf1-89af-f1de38b8d120 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036408 Aug 18 12:47:05.214359 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4530/7184] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:47:05.847627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-353567c5-b259-4b4d-8542-057b9416d69f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:05.848762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-353567c5-b259-4b4d-8542-057b9416d69f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: f7adac7b-70c7-41d8-b5cb-11230bd47066] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:05.855254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-353567c5-b259-4b4d-8542-057b9416d69f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:05.855753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-353567c5-b259-4b4d-8542-057b9416d69f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:05.856208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-353567c5-b259-4b4d-8542-057b9416d69f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:05.856928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-353567c5-b259-4b4d-8542-057b9416d69f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:05.857390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-353567c5-b259-4b4d-8542-057b9416d69f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:05.857824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-353567c5-b259-4b4d-8542-057b9416d69f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:05.873108 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-353567c5-b259-4b4d-8542-057b9416d69f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] HTTP exception thrown: Instance f7adac7b-70c7-41d8-b5cb-11230bd47066 could not be found. Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-353567c5-b259-4b4d-8542-057b9416d69f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Request method failure captured: Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 HTTP/1.1 Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jQeQZPOFUsCvPq9KJ45C83hU_4PBqTwbXRk1jzU3ZGP69rWq4GCsfSstUtl_fGSuFj9IIScCSANx3NuCkMMOA9dHVMwOwl_vghoFlSI0Mp5C2A5UMmer5lfR-ujm4tsvONIGKbYuCFqRFqUS-ZdywsiNZI2ndTb8o6EwBql0c3GNVE Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 0f1aa7dfe3f74f5ab3b45373c1a17574 Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 0f1aa7dfe3f74f5ab3b45373c1a17574 Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestNetworkAdvancedServerOps-1530263574-project Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 064db809a9034ebc85b986c87d0036d1 Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1530263574-project Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance f7adac7b-70c7-41d8-b5cb-11230bd47066 could not be found. Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'f7adac7b-70c7-41d8-b5cb-11230bd47066'} Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7adac7b-70c7-41d8-b5cb-11230bd47066 could not be found. Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7adac7b-70c7-41d8-b5cb-11230bd47066 could not be found. Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:47:05.875550 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:47:05.883031 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:47:05.883031 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:47:05.883031 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:47:05.883031 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:47:05.883031 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:47:05.883031 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:47:05.883031 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7adac7b-70c7-41d8-b5cb-11230bd47066 could not be found. Aug 18 12:47:05.883031 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:47:05.883031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-353567c5-b259-4b4d-8542-057b9416d69f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Returning 404 to user: Instance f7adac7b-70c7-41d8-b5cb-11230bd47066 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:47:05.883031 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-353567c5-b259-4b4d-8542-057b9416d69f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066" status: 404 len: 111 microversion: 2.1 time: 0.035083 Aug 18 12:47:05.883031 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4531/7185] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:05 2022] GET /compute/v2.1/servers/f7adac7b-70c7-41d8-b5cb-11230bd47066 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:47:10.233279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d154dcb6-11a3-4e59-b4ed-6ce90e323cc2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '.version_select at 0x7f519ee17a60>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:10.276906 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d154dcb6-11a3-4e59-b4ed-6ce90e323cc2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-996753428" status: 202 len: 0 microversion: 2.1 time: 0.051991 Aug 18 12:47:10.278279 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4532/7186] 10.222.0.73 () {58 vars in 1281 bytes} [Thu Aug 18 12:47:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-996753428 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:47:10.316483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab00deb7-3851-41d0-9bc7-72c2d3cce659 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'create', calling method: .version_select at 0x7f51b0de0550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1936947773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtC+2ndf+U6sgHEFTtrs8E9IVkZOcQwxITVyK3AuimM8chX3fSKVA1vpPUq1o3LsVJuAw0sIkMJjoepZAeSPECYQhSHqcK8QAM8x95kUp7EU2hmb2R7dCHWXhrd+xW3zw=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:47:10.338188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-ab00deb7-3851-41d0-9bc7-72c2d3cce659 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:47:10.344316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-ab00deb7-3851-41d0-9bc7-72c2d3cce659 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for user 064db809a9034ebc85b986c87d0036d1 and project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:47:10.372268 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab00deb7-3851-41d0-9bc7-72c2d3cce659 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.060140 Aug 18 12:47:10.373044 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4533/7187] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:47:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:47:17.156269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:47:17.165272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1134978436", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "baf38922-cf18-4df6-9c03-7cf95359a586"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1936947773", "security_groups": [{"name": "tempest-secgroup-smoke-1031510430"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:47:17.304690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] validate_networks() for [('baf38922-cf18-4df6-9c03-7cf95359a586', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:47:17.887567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:47:17.887797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:47:17.888479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:47:17.888920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:47:17.889456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:47:17.901459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:17.901990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:17.902616 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:17.903432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:17.903909 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:17.904359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:17.933668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:47:17.941296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for user 064db809a9034ebc85b986c87d0036d1 and project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:47:17.966275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:47:17.969505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:47:18.043162 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5f223e16-9309-4d8e-8213-f756011e3ee0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.890748 Aug 18 12:47:18.051278 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4534/7188] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:47:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:47:18.057096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-355babd8-0add-4d09-9aae-1e6badfbd25b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:18.057978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-355babd8-0add-4d09-9aae-1e6badfbd25b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:18.131364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-355babd8-0add-4d09-9aae-1e6badfbd25b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:47:18.148562 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-355babd8-0add-4d09-9aae-1e6badfbd25b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1267 microversion: 2.1 time: 0.095663 Aug 18 12:47:18.150039 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4535/7189] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:18 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:47:19.170004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8def174a-9426-4046-ae35-68fbae3959c9 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:19.170711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8def174a-9426-4046-ae35-68fbae3959c9 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:19.178848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8def174a-9426-4046-ae35-68fbae3959c9 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:19.179374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8def174a-9426-4046-ae35-68fbae3959c9 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:19.179833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8def174a-9426-4046-ae35-68fbae3959c9 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:19.180578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8def174a-9426-4046-ae35-68fbae3959c9 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:19.181042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8def174a-9426-4046-ae35-68fbae3959c9 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:19.181488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8def174a-9426-4046-ae35-68fbae3959c9 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:19.259893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8def174a-9426-4046-ae35-68fbae3959c9 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:47:19.276017 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8def174a-9426-4046-ae35-68fbae3959c9 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1319 microversion: 2.1 time: 0.109391 Aug 18 12:47:19.284688 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4536/7190] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:19 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1319 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:47:20.320172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-367bde45-f419-406a-aedd-9b6d2e27268d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:20.320823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-367bde45-f419-406a-aedd-9b6d2e27268d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:20.331820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-367bde45-f419-406a-aedd-9b6d2e27268d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:20.339262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-367bde45-f419-406a-aedd-9b6d2e27268d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:20.339757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-367bde45-f419-406a-aedd-9b6d2e27268d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:20.340553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-367bde45-f419-406a-aedd-9b6d2e27268d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:20.341355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-367bde45-f419-406a-aedd-9b6d2e27268d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:20.342704 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-367bde45-f419-406a-aedd-9b6d2e27268d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:20.585866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-367bde45-f419-406a-aedd-9b6d2e27268d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:47:20.599129 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-367bde45-f419-406a-aedd-9b6d2e27268d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1393 microversion: 2.1 time: 0.289222 Aug 18 12:47:20.621609 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4537/7191] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:20 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1393 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:47:21.240886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-e5895f44-bea4-4de2-aa76-99f1af9f1a23 req-f7ed69c1-93e8-4357-aa49-1276c95a86e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb0b0e0-53ce-4135-b981-a206a5d89eed", "tag": "35d2e1b2-23f1-4ab2-8543-b35721296ed7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:47:21.256077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e5895f44-bea4-4de2-aa76-99f1af9f1a23 req-f7ed69c1-93e8-4357-aa49-1276c95a86e5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:21.257824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e5895f44-bea4-4de2-aa76-99f1af9f1a23 req-f7ed69c1-93e8-4357-aa49-1276c95a86e5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:21.258656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-e5895f44-bea4-4de2-aa76-99f1af9f1a23 req-f7ed69c1-93e8-4357-aa49-1276c95a86e5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:21.272206 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-e5895f44-bea4-4de2-aa76-99f1af9f1a23 req-f7ed69c1-93e8-4357-aa49-1276c95a86e5 service nova] Creating event network-changed:35d2e1b2-23f1-4ab2-8543-b35721296ed7 for instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed on n-h1-853611-3 Aug 18 12:47:21.278574 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-e5895f44-bea4-4de2-aa76-99f1af9f1a23 req-f7ed69c1-93e8-4357-aa49-1276c95a86e5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041293 Aug 18 12:47:21.280155 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4538/7192] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:47:21.622386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1bf19814-1f8d-4e70-ab4c-ecfb69c0201b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:21.623438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1bf19814-1f8d-4e70-ab4c-ecfb69c0201b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:21.633287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bf19814-1f8d-4e70-ab4c-ecfb69c0201b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:21.633807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bf19814-1f8d-4e70-ab4c-ecfb69c0201b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:21.634471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bf19814-1f8d-4e70-ab4c-ecfb69c0201b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:21.635333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bf19814-1f8d-4e70-ab4c-ecfb69c0201b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:21.637961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bf19814-1f8d-4e70-ab4c-ecfb69c0201b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:21.638487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1bf19814-1f8d-4e70-ab4c-ecfb69c0201b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:21.844467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1bf19814-1f8d-4e70-ab4c-ecfb69c0201b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:47:21.852769 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1bf19814-1f8d-4e70-ab4c-ecfb69c0201b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1393 microversion: 2.1 time: 0.235651 Aug 18 12:47:21.853386 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4539/7193] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:21 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1393 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:47:22.873606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cb366324-d623-426f-acf6-8e8858fcca15 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:22.874993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cb366324-d623-426f-acf6-8e8858fcca15 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:22.881969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb366324-d623-426f-acf6-8e8858fcca15 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:22.882838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb366324-d623-426f-acf6-8e8858fcca15 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:22.883299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb366324-d623-426f-acf6-8e8858fcca15 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:22.884045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb366324-d623-426f-acf6-8e8858fcca15 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:22.884519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb366324-d623-426f-acf6-8e8858fcca15 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:22.884960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb366324-d623-426f-acf6-8e8858fcca15 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:23.084900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cb366324-d623-426f-acf6-8e8858fcca15 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:47:23.095708 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cb366324-d623-426f-acf6-8e8858fcca15 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1393 microversion: 2.1 time: 0.225592 Aug 18 12:47:23.096395 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4540/7194] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:22 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1393 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:47:24.117727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-542c8f1c-4de1-40c5-bc60-d996fc7b4ce7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:24.118532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-542c8f1c-4de1-40c5-bc60-d996fc7b4ce7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:24.126815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-542c8f1c-4de1-40c5-bc60-d996fc7b4ce7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:24.127759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-542c8f1c-4de1-40c5-bc60-d996fc7b4ce7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:24.127966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-542c8f1c-4de1-40c5-bc60-d996fc7b4ce7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:24.129012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-542c8f1c-4de1-40c5-bc60-d996fc7b4ce7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:24.129160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-542c8f1c-4de1-40c5-bc60-d996fc7b4ce7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:24.129516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-542c8f1c-4de1-40c5-bc60-d996fc7b4ce7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:24.284559 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-542c8f1c-4de1-40c5-bc60-d996fc7b4ce7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:47:24.297406 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-542c8f1c-4de1-40c5-bc60-d996fc7b4ce7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1393 microversion: 2.1 time: 0.183049 Aug 18 12:47:24.298779 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4541/7195] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:24 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1393 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:47:25.320286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-751b4bd3-c6a8-4a0f-ba85-67bb34c10bb6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:25.322298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-751b4bd3-c6a8-4a0f-ba85-67bb34c10bb6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:25.328632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-751b4bd3-c6a8-4a0f-ba85-67bb34c10bb6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:25.329146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-751b4bd3-c6a8-4a0f-ba85-67bb34c10bb6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:25.329597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-751b4bd3-c6a8-4a0f-ba85-67bb34c10bb6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:25.330325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-751b4bd3-c6a8-4a0f-ba85-67bb34c10bb6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:25.330817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-751b4bd3-c6a8-4a0f-ba85-67bb34c10bb6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:25.331258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-751b4bd3-c6a8-4a0f-ba85-67bb34c10bb6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:25.473107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-751b4bd3-c6a8-4a0f-ba85-67bb34c10bb6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:47:25.480845 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-751b4bd3-c6a8-4a0f-ba85-67bb34c10bb6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1393 microversion: 2.1 time: 0.164936 Aug 18 12:47:25.481445 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4542/7196] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:25 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:47:26.503359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-238c9109-7579-4248-bd4b-3bbf99917ee5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:26.504520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-238c9109-7579-4248-bd4b-3bbf99917ee5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:26.507004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:47:26.512948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-238c9109-7579-4248-bd4b-3bbf99917ee5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:26.513466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-238c9109-7579-4248-bd4b-3bbf99917ee5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:26.513924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-238c9109-7579-4248-bd4b-3bbf99917ee5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:26.514691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-238c9109-7579-4248-bd4b-3bbf99917ee5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:26.515986 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-238c9109-7579-4248-bd4b-3bbf99917ee5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:26.516681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-238c9109-7579-4248-bd4b-3bbf99917ee5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:26.683672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-238c9109-7579-4248-bd4b-3bbf99917ee5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:47:26.696881 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-238c9109-7579-4248-bd4b-3bbf99917ee5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1393 microversion: 2.1 time: 0.197977 Aug 18 12:47:26.697777 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4543/7197] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:26 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1393 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:47:26.988846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-2659b75e-9f2a-4b85-987c-e6440a1b707a req-2ca8693c-70ef-42c9-acf4-0a57161fdfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb0b0e0-53ce-4135-b981-a206a5d89eed", "name": "network-vif-plugged", "status": "completed", "tag": "35d2e1b2-23f1-4ab2-8543-b35721296ed7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:47:27.001268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2659b75e-9f2a-4b85-987c-e6440a1b707a req-2ca8693c-70ef-42c9-acf4-0a57161fdfe6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:27.001993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2659b75e-9f2a-4b85-987c-e6440a1b707a req-2ca8693c-70ef-42c9-acf4-0a57161fdfe6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:27.002923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-2659b75e-9f2a-4b85-987c-e6440a1b707a req-2ca8693c-70ef-42c9-acf4-0a57161fdfe6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:27.017482 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-2659b75e-9f2a-4b85-987c-e6440a1b707a req-2ca8693c-70ef-42c9-acf4-0a57161fdfe6 service nova] Creating event network-vif-plugged:35d2e1b2-23f1-4ab2-8543-b35721296ed7 for instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed on n-h1-853611-3 Aug 18 12:47:27.023089 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-2659b75e-9f2a-4b85-987c-e6440a1b707a req-2ca8693c-70ef-42c9-acf4-0a57161fdfe6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107554 Aug 18 12:47:27.023721 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4544/7198] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:47:27.725268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fcac7bbe-ecec-4675-8057-ba2ae138cea6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:27.726052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fcac7bbe-ecec-4675-8057-ba2ae138cea6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:27.732824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcac7bbe-ecec-4675-8057-ba2ae138cea6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:27.733323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcac7bbe-ecec-4675-8057-ba2ae138cea6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:27.733902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcac7bbe-ecec-4675-8057-ba2ae138cea6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:27.734804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcac7bbe-ecec-4675-8057-ba2ae138cea6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:27.735274 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcac7bbe-ecec-4675-8057-ba2ae138cea6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:27.735718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fcac7bbe-ecec-4675-8057-ba2ae138cea6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:27.890492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fcac7bbe-ecec-4675-8057-ba2ae138cea6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:47:27.899346 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fcac7bbe-ecec-4675-8057-ba2ae138cea6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1393 microversion: 2.1 time: 0.179138 Aug 18 12:47:27.899959 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4545/7199] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:27 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:47:28.923610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f0ec5a55-57a3-45b3-8e88-237da99203ab tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:28.924708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f0ec5a55-57a3-45b3-8e88-237da99203ab tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:28.926383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:47:28.927916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:47:28.935212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0ec5a55-57a3-45b3-8e88-237da99203ab tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:28.936055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0ec5a55-57a3-45b3-8e88-237da99203ab tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:28.936521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0ec5a55-57a3-45b3-8e88-237da99203ab tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:28.937334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0ec5a55-57a3-45b3-8e88-237da99203ab tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:28.938189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0ec5a55-57a3-45b3-8e88-237da99203ab tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:28.938681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f0ec5a55-57a3-45b3-8e88-237da99203ab tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:29.144661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f0ec5a55-57a3-45b3-8e88-237da99203ab tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:47:29.152935 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f0ec5a55-57a3-45b3-8e88-237da99203ab tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1565 microversion: 2.1 time: 0.234710 Aug 18 12:47:29.153581 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4546/7200] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:28 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1565 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:47:29.174959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-780b454d-3bfa-446a-8ada-232ba59ea406 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:29.175597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-780b454d-3bfa-446a-8ada-232ba59ea406 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:29.182207 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-780b454d-3bfa-446a-8ada-232ba59ea406 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:29.182753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-780b454d-3bfa-446a-8ada-232ba59ea406 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:29.183213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-780b454d-3bfa-446a-8ada-232ba59ea406 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:29.183958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-780b454d-3bfa-446a-8ada-232ba59ea406 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:29.184441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-780b454d-3bfa-446a-8ada-232ba59ea406 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:29.184881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-780b454d-3bfa-446a-8ada-232ba59ea406 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:29.351164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-780b454d-3bfa-446a-8ada-232ba59ea406 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:47:29.360288 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-780b454d-3bfa-446a-8ada-232ba59ea406 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1565 microversion: 2.1 time: 0.189461 Aug 18 12:47:29.361036 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4547/7201] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:29 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1565 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:47:31.384625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fa54bf1f-bca5-48e0-8064-1ee975f37457 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:47:31.386333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fa54bf1f-bca5-48e0-8064-1ee975f37457 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:31.395318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa54bf1f-bca5-48e0-8064-1ee975f37457 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:31.395942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa54bf1f-bca5-48e0-8064-1ee975f37457 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:31.396478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa54bf1f-bca5-48e0-8064-1ee975f37457 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:31.397518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa54bf1f-bca5-48e0-8064-1ee975f37457 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:31.398245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa54bf1f-bca5-48e0-8064-1ee975f37457 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:31.398785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa54bf1f-bca5-48e0-8064-1ee975f37457 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:31.582470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fa54bf1f-bca5-48e0-8064-1ee975f37457 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:47:31.591572 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fa54bf1f-bca5-48e0-8064-1ee975f37457 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1565 microversion: 2.1 time: 0.211251 Aug 18 12:47:31.592174 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4548/7202] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:47:31 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1565 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:47:31.611946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9650736e-4b56-4c1f-ad4b-c7a12e25adb0 req-66dde548-c2b1-414e-a1f4-a8b961c8dece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb0b0e0-53ce-4135-b981-a206a5d89eed", "tag": "35d2e1b2-23f1-4ab2-8543-b35721296ed7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:47:31.622580 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9650736e-4b56-4c1f-ad4b-c7a12e25adb0 req-66dde548-c2b1-414e-a1f4-a8b961c8dece service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:31.623083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9650736e-4b56-4c1f-ad4b-c7a12e25adb0 req-66dde548-c2b1-414e-a1f4-a8b961c8dece service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:31.623788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9650736e-4b56-4c1f-ad4b-c7a12e25adb0 req-66dde548-c2b1-414e-a1f4-a8b961c8dece service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:31.636945 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9650736e-4b56-4c1f-ad4b-c7a12e25adb0 req-66dde548-c2b1-414e-a1f4-a8b961c8dece service nova] Creating event network-changed:35d2e1b2-23f1-4ab2-8543-b35721296ed7 for instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed on n-h1-853611-3 Aug 18 12:47:31.644507 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9650736e-4b56-4c1f-ad4b-c7a12e25adb0 req-66dde548-c2b1-414e-a1f4-a8b961c8dece service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035739 Aug 18 12:47:31.646797 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4549/7203] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:47:53.974106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08e2b41d-560b-40df-af9e-1cf2608159af tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:47:53.976363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-08e2b41d-560b-40df-af9e-1cf2608159af tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:47:53.979091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=13 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:47:53.979941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=74 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:47:53.987465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e2b41d-560b-40df-af9e-1cf2608159af tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:53.987686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e2b41d-560b-40df-af9e-1cf2608159af tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:53.988285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e2b41d-560b-40df-af9e-1cf2608159af tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:53.988787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e2b41d-560b-40df-af9e-1cf2608159af tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:47:53.989257 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e2b41d-560b-40df-af9e-1cf2608159af tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:47:53.989699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e2b41d-560b-40df-af9e-1cf2608159af tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:47:54.047544 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-08e2b41d-560b-40df-af9e-1cf2608159af tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed/action" status: 200 len: 24571 microversion: 2.1 time: 0.077788 Aug 18 12:47:54.048216 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4550/7204] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:47:53 2022] POST /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed/action => generated 24571 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:48:05.128305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:48:05.131671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:05.136402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:48:05.137286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:48:05.147518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:05.148044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:05.148509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:05.149252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:05.149743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:05.150195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:05.199925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:05.208079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Old instance type m1.heat2, new instance type m1.heat {{(pid=122210) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 18 12:48:05.215564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:48:05.216000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:48:05.216493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:48:05.217023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:48:05.217545 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:48:05.286918 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59db69c8-1722-474b-a9d0-c20038696b08 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed/action" status: 202 len: 0 microversion: 2.1 time: 0.167114 Aug 18 12:48:05.290812 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4551/7205] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:48:05 2022] POST /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:48:05.295961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fb7390e2-68eb-48af-8a02-5ebae6cd5713 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:05.296602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fb7390e2-68eb-48af-8a02-5ebae6cd5713 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:05.305113 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb7390e2-68eb-48af-8a02-5ebae6cd5713 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:05.305630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb7390e2-68eb-48af-8a02-5ebae6cd5713 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:05.306120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb7390e2-68eb-48af-8a02-5ebae6cd5713 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:05.306855 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb7390e2-68eb-48af-8a02-5ebae6cd5713 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:05.307326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb7390e2-68eb-48af-8a02-5ebae6cd5713 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:05.307802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fb7390e2-68eb-48af-8a02-5ebae6cd5713 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:05.462651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fb7390e2-68eb-48af-8a02-5ebae6cd5713 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:05.471199 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fb7390e2-68eb-48af-8a02-5ebae6cd5713 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1692 microversion: 2.1 time: 0.178991 Aug 18 12:48:05.471802 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4552/7206] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:05 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:48:06.496109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2d4ad17c-beb0-4d07-9bc1-b0b0066ce9c1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:06.496807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2d4ad17c-beb0-4d07-9bc1-b0b0066ce9c1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:06.504964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d4ad17c-beb0-4d07-9bc1-b0b0066ce9c1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:06.505491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d4ad17c-beb0-4d07-9bc1-b0b0066ce9c1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:06.505939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d4ad17c-beb0-4d07-9bc1-b0b0066ce9c1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:06.506712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d4ad17c-beb0-4d07-9bc1-b0b0066ce9c1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:06.507193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d4ad17c-beb0-4d07-9bc1-b0b0066ce9c1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:06.507762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2d4ad17c-beb0-4d07-9bc1-b0b0066ce9c1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:06.671904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2d4ad17c-beb0-4d07-9bc1-b0b0066ce9c1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:06.681314 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2d4ad17c-beb0-4d07-9bc1-b0b0066ce9c1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1692 microversion: 2.1 time: 0.189815 Aug 18 12:48:06.681904 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4553/7207] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:06 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1692 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:48:07.717716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9945f89f-7c65-41a1-a0b5-d6b35dddb825 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:07.718376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9945f89f-7c65-41a1-a0b5-d6b35dddb825 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:07.725114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9945f89f-7c65-41a1-a0b5-d6b35dddb825 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:07.725632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9945f89f-7c65-41a1-a0b5-d6b35dddb825 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:07.726097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9945f89f-7c65-41a1-a0b5-d6b35dddb825 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:07.726890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9945f89f-7c65-41a1-a0b5-d6b35dddb825 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:07.727374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9945f89f-7c65-41a1-a0b5-d6b35dddb825 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:07.727827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9945f89f-7c65-41a1-a0b5-d6b35dddb825 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:07.904798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9945f89f-7c65-41a1-a0b5-d6b35dddb825 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:07.912772 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9945f89f-7c65-41a1-a0b5-d6b35dddb825 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1692 microversion: 2.1 time: 0.199754 Aug 18 12:48:07.920803 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4554/7208] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:07 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1692 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:48:08.938178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8e40ed40-a21d-4a0b-bd10-20b7d5bf8293 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:08.939039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8e40ed40-a21d-4a0b-bd10-20b7d5bf8293 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:08.947549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e40ed40-a21d-4a0b-bd10-20b7d5bf8293 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:08.948151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e40ed40-a21d-4a0b-bd10-20b7d5bf8293 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:08.948818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e40ed40-a21d-4a0b-bd10-20b7d5bf8293 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:08.950016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e40ed40-a21d-4a0b-bd10-20b7d5bf8293 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:08.950860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e40ed40-a21d-4a0b-bd10-20b7d5bf8293 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:08.951400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8e40ed40-a21d-4a0b-bd10-20b7d5bf8293 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:09.099336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8e40ed40-a21d-4a0b-bd10-20b7d5bf8293 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:09.107589 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8e40ed40-a21d-4a0b-bd10-20b7d5bf8293 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1697 microversion: 2.1 time: 0.173497 Aug 18 12:48:09.108178 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4555/7209] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:08 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:48:10.131699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-535d67d2-345e-4a58-b6d8-64db93f08022 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:10.132659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-535d67d2-345e-4a58-b6d8-64db93f08022 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:10.141194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-535d67d2-345e-4a58-b6d8-64db93f08022 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:10.142874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-535d67d2-345e-4a58-b6d8-64db93f08022 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:10.143491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-535d67d2-345e-4a58-b6d8-64db93f08022 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:10.144269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-535d67d2-345e-4a58-b6d8-64db93f08022 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:10.144766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-535d67d2-345e-4a58-b6d8-64db93f08022 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:10.145226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-535d67d2-345e-4a58-b6d8-64db93f08022 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:10.306017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-535d67d2-345e-4a58-b6d8-64db93f08022 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:10.317473 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-535d67d2-345e-4a58-b6d8-64db93f08022 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1697 microversion: 2.1 time: 0.190245 Aug 18 12:48:10.318144 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4556/7210] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:10 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:11.346269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b69001ee-6a36-468b-87c6-cb9308d86724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:11.346983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b69001ee-6a36-468b-87c6-cb9308d86724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:11.353893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b69001ee-6a36-468b-87c6-cb9308d86724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:11.354396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b69001ee-6a36-468b-87c6-cb9308d86724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:11.354970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b69001ee-6a36-468b-87c6-cb9308d86724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:11.355693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b69001ee-6a36-468b-87c6-cb9308d86724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:11.356174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b69001ee-6a36-468b-87c6-cb9308d86724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:11.356627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b69001ee-6a36-468b-87c6-cb9308d86724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:11.500590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b69001ee-6a36-468b-87c6-cb9308d86724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:11.511092 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b69001ee-6a36-468b-87c6-cb9308d86724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1697 microversion: 2.1 time: 0.169250 Aug 18 12:48:11.511691 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4557/7211] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:11 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:12.534130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-443f3298-5091-4002-a3ac-e9efaa300f28 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:12.534879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-443f3298-5091-4002-a3ac-e9efaa300f28 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:12.543163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-443f3298-5091-4002-a3ac-e9efaa300f28 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:12.543669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-443f3298-5091-4002-a3ac-e9efaa300f28 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:12.544148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-443f3298-5091-4002-a3ac-e9efaa300f28 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:12.544894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-443f3298-5091-4002-a3ac-e9efaa300f28 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:12.545393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-443f3298-5091-4002-a3ac-e9efaa300f28 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:12.545838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-443f3298-5091-4002-a3ac-e9efaa300f28 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:12.691213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-443f3298-5091-4002-a3ac-e9efaa300f28 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:12.700912 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-443f3298-5091-4002-a3ac-e9efaa300f28 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1697 microversion: 2.1 time: 0.170501 Aug 18 12:48:12.701702 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4558/7212] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:12 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:13.725524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0f2f4ec2-c999-45b1-9bae-692e9cf742da tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:13.726352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0f2f4ec2-c999-45b1-9bae-692e9cf742da tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:13.733392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2f4ec2-c999-45b1-9bae-692e9cf742da tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:13.733905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2f4ec2-c999-45b1-9bae-692e9cf742da tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:13.734359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2f4ec2-c999-45b1-9bae-692e9cf742da tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:13.735121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2f4ec2-c999-45b1-9bae-692e9cf742da tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:13.736688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2f4ec2-c999-45b1-9bae-692e9cf742da tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:13.737141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0f2f4ec2-c999-45b1-9bae-692e9cf742da tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:13.892539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0f2f4ec2-c999-45b1-9bae-692e9cf742da tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:13.903178 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0f2f4ec2-c999-45b1-9bae-692e9cf742da tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1697 microversion: 2.1 time: 0.182195 Aug 18 12:48:13.904205 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4559/7213] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:13 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:14.931467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b658f898-cb63-4e0c-a37b-922ba8e55cbb tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:14.932175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b658f898-cb63-4e0c-a37b-922ba8e55cbb tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:14.940114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b658f898-cb63-4e0c-a37b-922ba8e55cbb tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:14.940694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b658f898-cb63-4e0c-a37b-922ba8e55cbb tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:14.941259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b658f898-cb63-4e0c-a37b-922ba8e55cbb tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:14.941808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b658f898-cb63-4e0c-a37b-922ba8e55cbb tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:14.942284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b658f898-cb63-4e0c-a37b-922ba8e55cbb tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:14.942779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b658f898-cb63-4e0c-a37b-922ba8e55cbb tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:15.097999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b658f898-cb63-4e0c-a37b-922ba8e55cbb tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:15.106232 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b658f898-cb63-4e0c-a37b-922ba8e55cbb tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1697 microversion: 2.1 time: 0.178670 Aug 18 12:48:15.106864 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4560/7214] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:14 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:16.129584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ec20b947-4d51-4da3-aba8-a74201696f3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:16.130717 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ec20b947-4d51-4da3-aba8-a74201696f3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:16.138831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec20b947-4d51-4da3-aba8-a74201696f3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:16.139320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec20b947-4d51-4da3-aba8-a74201696f3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:16.139783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec20b947-4d51-4da3-aba8-a74201696f3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:16.140514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec20b947-4d51-4da3-aba8-a74201696f3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:16.141008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec20b947-4d51-4da3-aba8-a74201696f3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:16.142103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ec20b947-4d51-4da3-aba8-a74201696f3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:16.302922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ec20b947-4d51-4da3-aba8-a74201696f3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:16.311140 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ec20b947-4d51-4da3-aba8-a74201696f3c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1697 microversion: 2.1 time: 0.186408 Aug 18 12:48:16.311762 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4561/7215] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:16 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:17.334070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f361c8ce-1a77-44eb-96a9-345815a54fb2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:17.334824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f361c8ce-1a77-44eb-96a9-345815a54fb2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:17.342225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f361c8ce-1a77-44eb-96a9-345815a54fb2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:17.342765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f361c8ce-1a77-44eb-96a9-345815a54fb2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:17.343220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f361c8ce-1a77-44eb-96a9-345815a54fb2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:17.343976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f361c8ce-1a77-44eb-96a9-345815a54fb2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:17.344443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f361c8ce-1a77-44eb-96a9-345815a54fb2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:17.345379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f361c8ce-1a77-44eb-96a9-345815a54fb2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:17.487628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f361c8ce-1a77-44eb-96a9-345815a54fb2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:17.495551 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f361c8ce-1a77-44eb-96a9-345815a54fb2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1697 microversion: 2.1 time: 0.166386 Aug 18 12:48:17.496139 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4562/7216] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:17 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:18.517256 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c908d1ab-dfad-4bed-9169-96d0aa68da5c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:18.518262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c908d1ab-dfad-4bed-9169-96d0aa68da5c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:18.525553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c908d1ab-dfad-4bed-9169-96d0aa68da5c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:18.526069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c908d1ab-dfad-4bed-9169-96d0aa68da5c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:18.526560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c908d1ab-dfad-4bed-9169-96d0aa68da5c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:18.527299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c908d1ab-dfad-4bed-9169-96d0aa68da5c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:18.527776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c908d1ab-dfad-4bed-9169-96d0aa68da5c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:18.528225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c908d1ab-dfad-4bed-9169-96d0aa68da5c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:18.675518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c908d1ab-dfad-4bed-9169-96d0aa68da5c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:18.683612 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c908d1ab-dfad-4bed-9169-96d0aa68da5c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1697 microversion: 2.1 time: 0.170902 Aug 18 12:48:18.684570 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4563/7217] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:18 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:19.705842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c776c13-a5eb-49ad-9204-685c3c518c46 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:19.706639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c776c13-a5eb-49ad-9204-685c3c518c46 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:19.714378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c776c13-a5eb-49ad-9204-685c3c518c46 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:19.714785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c776c13-a5eb-49ad-9204-685c3c518c46 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:19.716071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c776c13-a5eb-49ad-9204-685c3c518c46 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:19.717216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c776c13-a5eb-49ad-9204-685c3c518c46 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:19.717807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c776c13-a5eb-49ad-9204-685c3c518c46 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:19.718329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c776c13-a5eb-49ad-9204-685c3c518c46 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:19.870441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9c776c13-a5eb-49ad-9204-685c3c518c46 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:19.880182 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c776c13-a5eb-49ad-9204-685c3c518c46 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1697 microversion: 2.1 time: 0.178854 Aug 18 12:48:19.880788 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4564/7218] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:19 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:20.224213 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:48:20.224794 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:48:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:48:20.902873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11168eee-1f0c-471e-a218-2be95e63ffff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:20.903502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-11168eee-1f0c-471e-a218-2be95e63ffff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:20.911945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11168eee-1f0c-471e-a218-2be95e63ffff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:20.912457 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11168eee-1f0c-471e-a218-2be95e63ffff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:20.912907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11168eee-1f0c-471e-a218-2be95e63ffff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:20.913642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11168eee-1f0c-471e-a218-2be95e63ffff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:20.914110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11168eee-1f0c-471e-a218-2be95e63ffff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:20.914578 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11168eee-1f0c-471e-a218-2be95e63ffff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:21.067329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11168eee-1f0c-471e-a218-2be95e63ffff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:21.075136 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-11168eee-1f0c-471e-a218-2be95e63ffff tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1697 microversion: 2.1 time: 0.176403 Aug 18 12:48:21.075716 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4565/7219] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:20 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:22.098595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94aac575-1517-409f-be50-11d59ead04f3 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:22.099396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-94aac575-1517-409f-be50-11d59ead04f3 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:22.106805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94aac575-1517-409f-be50-11d59ead04f3 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:22.107329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94aac575-1517-409f-be50-11d59ead04f3 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:22.107790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94aac575-1517-409f-be50-11d59ead04f3 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:22.108541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94aac575-1517-409f-be50-11d59ead04f3 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:22.109015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94aac575-1517-409f-be50-11d59ead04f3 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:22.109467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94aac575-1517-409f-be50-11d59ead04f3 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:22.114984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:48:22.291172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-94aac575-1517-409f-be50-11d59ead04f3 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:22.301257 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-94aac575-1517-409f-be50-11d59ead04f3 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1697 microversion: 2.1 time: 0.207774 Aug 18 12:48:22.301868 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4566/7220] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:22 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1697 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:23.325191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f609b367-c2c7-4951-95ea-3a145cc09768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:23.326495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f609b367-c2c7-4951-95ea-3a145cc09768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:23.333078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f609b367-c2c7-4951-95ea-3a145cc09768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:23.333591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f609b367-c2c7-4951-95ea-3a145cc09768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:23.334047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f609b367-c2c7-4951-95ea-3a145cc09768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:23.334805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f609b367-c2c7-4951-95ea-3a145cc09768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:23.335278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f609b367-c2c7-4951-95ea-3a145cc09768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:23.335725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f609b367-c2c7-4951-95ea-3a145cc09768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:23.484353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f609b367-c2c7-4951-95ea-3a145cc09768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:23.493093 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f609b367-c2c7-4951-95ea-3a145cc09768 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1697 microversion: 2.1 time: 0.173543 Aug 18 12:48:23.493703 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4567/7221] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:23 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:24.517280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-64bd2b52-5770-428e-81a0-f75bd22f4026 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:24.518035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-64bd2b52-5770-428e-81a0-f75bd22f4026 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:24.525152 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64bd2b52-5770-428e-81a0-f75bd22f4026 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:24.525658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64bd2b52-5770-428e-81a0-f75bd22f4026 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:24.526111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64bd2b52-5770-428e-81a0-f75bd22f4026 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:24.526863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64bd2b52-5770-428e-81a0-f75bd22f4026 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:24.527335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64bd2b52-5770-428e-81a0-f75bd22f4026 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:24.527776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-64bd2b52-5770-428e-81a0-f75bd22f4026 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:24.677102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-64bd2b52-5770-428e-81a0-f75bd22f4026 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:24.685421 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-64bd2b52-5770-428e-81a0-f75bd22f4026 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1697 microversion: 2.1 time: 0.172781 Aug 18 12:48:24.686034 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4568/7222] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:24 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:25.505419 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a86f74d4-4781-46a6-b123-f0d3ac81976b req-e35af982-8f78-44d0-a05a-4b3fde581a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb0b0e0-53ce-4135-b981-a206a5d89eed", "name": "network-vif-unplugged", "status": "completed", "tag": "35d2e1b2-23f1-4ab2-8543-b35721296ed7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:48:25.519913 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a86f74d4-4781-46a6-b123-f0d3ac81976b req-e35af982-8f78-44d0-a05a-4b3fde581a23 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:25.520882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a86f74d4-4781-46a6-b123-f0d3ac81976b req-e35af982-8f78-44d0-a05a-4b3fde581a23 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:25.521741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a86f74d4-4781-46a6-b123-f0d3ac81976b req-e35af982-8f78-44d0-a05a-4b3fde581a23 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:25.543702 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a86f74d4-4781-46a6-b123-f0d3ac81976b req-e35af982-8f78-44d0-a05a-4b3fde581a23 service nova] Creating event network-vif-unplugged:35d2e1b2-23f1-4ab2-8543-b35721296ed7 for instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed on n-h2-853611-3 Aug 18 12:48:25.553027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-a86f74d4-4781-46a6-b123-f0d3ac81976b req-e35af982-8f78-44d0-a05a-4b3fde581a23 service nova] Instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:48:25.566138 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a86f74d4-4781-46a6-b123-f0d3ac81976b req-e35af982-8f78-44d0-a05a-4b3fde581a23 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064905 Aug 18 12:48:25.567121 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4569/7223] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:48:25.709237 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-603f7a72-5a11-4091-a462-188d014b75dd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:25.710589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-603f7a72-5a11-4091-a462-188d014b75dd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:25.717073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-603f7a72-5a11-4091-a462-188d014b75dd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:25.717590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-603f7a72-5a11-4091-a462-188d014b75dd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:25.718044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-603f7a72-5a11-4091-a462-188d014b75dd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:25.718840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-603f7a72-5a11-4091-a462-188d014b75dd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:25.719315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-603f7a72-5a11-4091-a462-188d014b75dd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:25.720264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-603f7a72-5a11-4091-a462-188d014b75dd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:25.879335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-603f7a72-5a11-4091-a462-188d014b75dd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:25.888225 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-603f7a72-5a11-4091-a462-188d014b75dd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1696 microversion: 2.1 time: 0.183397 Aug 18 12:48:25.888835 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4570/7224] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:25 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:48:26.925970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-00032ed1-af41-4c19-84c3-f73f3979400d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:26.926643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-00032ed1-af41-4c19-84c3-f73f3979400d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:26.934356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00032ed1-af41-4c19-84c3-f73f3979400d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:26.934889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00032ed1-af41-4c19-84c3-f73f3979400d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:26.935340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00032ed1-af41-4c19-84c3-f73f3979400d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:26.936117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00032ed1-af41-4c19-84c3-f73f3979400d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:26.936594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00032ed1-af41-4c19-84c3-f73f3979400d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:26.937035 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-00032ed1-af41-4c19-84c3-f73f3979400d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:27.098369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-00032ed1-af41-4c19-84c3-f73f3979400d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:27.106167 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-00032ed1-af41-4c19-84c3-f73f3979400d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1694 microversion: 2.1 time: 0.184669 Aug 18 12:48:27.107047 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4571/7225] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:26 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1694 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:27.600157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-07aa5d0f-3354-4961-9dd0-83395b35e149 req-40ab8097-e01f-45ed-88ec-a04dc58113a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb0b0e0-53ce-4135-b981-a206a5d89eed", "tag": "35d2e1b2-23f1-4ab2-8543-b35721296ed7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:48:27.609798 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-07aa5d0f-3354-4961-9dd0-83395b35e149 req-40ab8097-e01f-45ed-88ec-a04dc58113a5 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:27.610312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-07aa5d0f-3354-4961-9dd0-83395b35e149 req-40ab8097-e01f-45ed-88ec-a04dc58113a5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:27.610790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-07aa5d0f-3354-4961-9dd0-83395b35e149 req-40ab8097-e01f-45ed-88ec-a04dc58113a5 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:27.623002 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-07aa5d0f-3354-4961-9dd0-83395b35e149 req-40ab8097-e01f-45ed-88ec-a04dc58113a5 service nova] Creating event network-changed:35d2e1b2-23f1-4ab2-8543-b35721296ed7 for instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed on n-h2-853611-3 Aug 18 12:48:27.629641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [req-07aa5d0f-3354-4961-9dd0-83395b35e149 req-40ab8097-e01f-45ed-88ec-a04dc58113a5 service nova] Instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed is migrating within the same cell, copying events to all relevant hosts: {'n-h2-853611-3', 'n-h1-853611-3'} {{(pid=122210) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 18 12:48:27.641288 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-07aa5d0f-3354-4961-9dd0-83395b35e149 req-40ab8097-e01f-45ed-88ec-a04dc58113a5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045878 Aug 18 12:48:27.642658 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4572/7226] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:48:28.137094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9ce9f595-f084-4863-b2ec-b05e63555a7f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:28.140101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9ce9f595-f084-4863-b2ec-b05e63555a7f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:28.155463 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ce9f595-f084-4863-b2ec-b05e63555a7f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:28.158337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ce9f595-f084-4863-b2ec-b05e63555a7f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:28.159461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ce9f595-f084-4863-b2ec-b05e63555a7f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:28.160638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ce9f595-f084-4863-b2ec-b05e63555a7f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:28.161631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ce9f595-f084-4863-b2ec-b05e63555a7f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:28.162564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9ce9f595-f084-4863-b2ec-b05e63555a7f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:28.364179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9ce9f595-f084-4863-b2ec-b05e63555a7f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:28.375880 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9ce9f595-f084-4863-b2ec-b05e63555a7f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1694 microversion: 2.1 time: 0.249306 Aug 18 12:48:28.382499 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4573/7227] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:28 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1694 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:48:29.398887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0efe1e85-a29f-46cc-a710-7bff31af032c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:29.399685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0efe1e85-a29f-46cc-a710-7bff31af032c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:29.406833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0efe1e85-a29f-46cc-a710-7bff31af032c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:29.407838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0efe1e85-a29f-46cc-a710-7bff31af032c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:29.408478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0efe1e85-a29f-46cc-a710-7bff31af032c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:29.409221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0efe1e85-a29f-46cc-a710-7bff31af032c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:29.409701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0efe1e85-a29f-46cc-a710-7bff31af032c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:29.410144 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0efe1e85-a29f-46cc-a710-7bff31af032c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:29.583590 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0efe1e85-a29f-46cc-a710-7bff31af032c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:29.592331 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0efe1e85-a29f-46cc-a710-7bff31af032c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1691 microversion: 2.1 time: 0.197318 Aug 18 12:48:29.592942 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4574/7228] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:29 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:48:29.616489 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-93573226-d6b8-4153-a906-958a1e66371b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:48:29.617057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-93573226-d6b8-4153-a906-958a1e66371b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:29.623653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93573226-d6b8-4153-a906-958a1e66371b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:29.624164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93573226-d6b8-4153-a906-958a1e66371b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:29.624626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93573226-d6b8-4153-a906-958a1e66371b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:29.625636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93573226-d6b8-4153-a906-958a1e66371b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:29.626385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93573226-d6b8-4153-a906-958a1e66371b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:29.626993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93573226-d6b8-4153-a906-958a1e66371b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:29.695038 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-93573226-d6b8-4153-a906-958a1e66371b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed/action" status: 204 len: 0 microversion: 2.1 time: 0.082742 Aug 18 12:48:29.695702 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4575/7229] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:48:29 2022] POST /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:48:29.705239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5211de1b-322f-4d1c-8fc4-1a8cc41d7259 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:29.706100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5211de1b-322f-4d1c-8fc4-1a8cc41d7259 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:29.713495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5211de1b-322f-4d1c-8fc4-1a8cc41d7259 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:29.714127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5211de1b-322f-4d1c-8fc4-1a8cc41d7259 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:29.714696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5211de1b-322f-4d1c-8fc4-1a8cc41d7259 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:29.715554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5211de1b-322f-4d1c-8fc4-1a8cc41d7259 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:29.716119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5211de1b-322f-4d1c-8fc4-1a8cc41d7259 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:29.716655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5211de1b-322f-4d1c-8fc4-1a8cc41d7259 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:29.927005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5211de1b-322f-4d1c-8fc4-1a8cc41d7259 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:29.937500 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5211de1b-322f-4d1c-8fc4-1a8cc41d7259 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1691 microversion: 2.1 time: 0.236996 Aug 18 12:48:29.938306 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4576/7230] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:29 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1691 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:48:29.967195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ea30b292-4790-4b9e-bd7d-79a90e9b61a6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:29.968715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ea30b292-4790-4b9e-bd7d-79a90e9b61a6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:29.980313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea30b292-4790-4b9e-bd7d-79a90e9b61a6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:29.981231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea30b292-4790-4b9e-bd7d-79a90e9b61a6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:29.982222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea30b292-4790-4b9e-bd7d-79a90e9b61a6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:29.983519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea30b292-4790-4b9e-bd7d-79a90e9b61a6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:29.984354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea30b292-4790-4b9e-bd7d-79a90e9b61a6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:29.985174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea30b292-4790-4b9e-bd7d-79a90e9b61a6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:30.191678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ea30b292-4790-4b9e-bd7d-79a90e9b61a6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:30.202211 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ea30b292-4790-4b9e-bd7d-79a90e9b61a6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1691 microversion: 2.1 time: 0.246062 Aug 18 12:48:30.218871 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4577/7231] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:29 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1691 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:48:31.227346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2269a51b-24de-4a20-8384-a8caa777f98f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:48:31.228439 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2269a51b-24de-4a20-8384-a8caa777f98f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:31.239490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2269a51b-24de-4a20-8384-a8caa777f98f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:31.240106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2269a51b-24de-4a20-8384-a8caa777f98f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:31.240639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2269a51b-24de-4a20-8384-a8caa777f98f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:31.241488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2269a51b-24de-4a20-8384-a8caa777f98f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:31.242043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2269a51b-24de-4a20-8384-a8caa777f98f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:31.242628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2269a51b-24de-4a20-8384-a8caa777f98f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:31.417805 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2269a51b-24de-4a20-8384-a8caa777f98f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:48:31.430123 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2269a51b-24de-4a20-8384-a8caa777f98f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1683 microversion: 2.1 time: 0.208115 Aug 18 12:48:31.430772 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4578/7232] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:48:31 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1683 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:48:31.741379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1564616b-3657-4580-91b4-078996a9d3bb req-c9f1a9f4-51fb-4c4f-b2b7-28104b9d667f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb0b0e0-53ce-4135-b981-a206a5d89eed", "name": "network-vif-plugged", "status": "completed", "tag": "35d2e1b2-23f1-4ab2-8543-b35721296ed7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:48:31.754076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1564616b-3657-4580-91b4-078996a9d3bb req-c9f1a9f4-51fb-4c4f-b2b7-28104b9d667f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:31.754613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1564616b-3657-4580-91b4-078996a9d3bb req-c9f1a9f4-51fb-4c4f-b2b7-28104b9d667f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:31.755060 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1564616b-3657-4580-91b4-078996a9d3bb req-c9f1a9f4-51fb-4c4f-b2b7-28104b9d667f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:31.771417 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1564616b-3657-4580-91b4-078996a9d3bb req-c9f1a9f4-51fb-4c4f-b2b7-28104b9d667f service nova] Creating event network-vif-plugged:35d2e1b2-23f1-4ab2-8543-b35721296ed7 for instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed on n-h2-853611-3 Aug 18 12:48:31.777345 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1564616b-3657-4580-91b4-078996a9d3bb req-c9f1a9f4-51fb-4c4f-b2b7-28104b9d667f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039771 Aug 18 12:48:31.778153 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4579/7233] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:48:36.797528 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:48:36.798867 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:48:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:48:53.640502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b55b4047-6fd8-48cf-8282-96f5a7555140 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:48:53.643814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b55b4047-6fd8-48cf-8282-96f5a7555140 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:48:53.646402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=62 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:48:53.647079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:48:53.653471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b55b4047-6fd8-48cf-8282-96f5a7555140 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:53.653977 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b55b4047-6fd8-48cf-8282-96f5a7555140 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:53.654448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b55b4047-6fd8-48cf-8282-96f5a7555140 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:53.655181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b55b4047-6fd8-48cf-8282-96f5a7555140 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:48:53.655647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b55b4047-6fd8-48cf-8282-96f5a7555140 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:48:53.656083 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b55b4047-6fd8-48cf-8282-96f5a7555140 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:48:53.711721 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b55b4047-6fd8-48cf-8282-96f5a7555140 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed/action" status: 200 len: 24581 microversion: 2.1 time: 0.076434 Aug 18 12:48:53.712492 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4580/7234] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:48:53 2022] POST /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed/action => generated 24581 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:49:01.266748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-53714e5b-07a2-4d3d-9fa9-4ba9192c85d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:01.267844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-53714e5b-07a2-4d3d-9fa9-4ba9192c85d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:01.282394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53714e5b-07a2-4d3d-9fa9-4ba9192c85d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:01.283324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53714e5b-07a2-4d3d-9fa9-4ba9192c85d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:01.284137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53714e5b-07a2-4d3d-9fa9-4ba9192c85d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:01.285458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53714e5b-07a2-4d3d-9fa9-4ba9192c85d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:01.286304 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53714e5b-07a2-4d3d-9fa9-4ba9192c85d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:01.287128 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-53714e5b-07a2-4d3d-9fa9-4ba9192c85d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:01.320292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-53714e5b-07a2-4d3d-9fa9-4ba9192c85d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:49:01.443584 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-53714e5b-07a2-4d3d-9fa9-4ba9192c85d8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "DELETE /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 204 len: 0 microversion: 2.1 time: 0.181730 Aug 18 12:49:01.443584 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4581/7235] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:49:01 2022] DELETE /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:49:01.599778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-34aa5a22-6185-4f98-9626-3eea2e6bd48d req-1ad1edae-3a18-490c-ac17-49f693da2080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb0b0e0-53ce-4135-b981-a206a5d89eed", "tag": "35d2e1b2-23f1-4ab2-8543-b35721296ed7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:49:01.619624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-34aa5a22-6185-4f98-9626-3eea2e6bd48d req-1ad1edae-3a18-490c-ac17-49f693da2080 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:01.620355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-34aa5a22-6185-4f98-9626-3eea2e6bd48d req-1ad1edae-3a18-490c-ac17-49f693da2080 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:01.620810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-34aa5a22-6185-4f98-9626-3eea2e6bd48d req-1ad1edae-3a18-490c-ac17-49f693da2080 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:01.636949 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-34aa5a22-6185-4f98-9626-3eea2e6bd48d req-1ad1edae-3a18-490c-ac17-49f693da2080 service nova] Creating event network-changed:35d2e1b2-23f1-4ab2-8543-b35721296ed7 for instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed on n-h2-853611-3 Aug 18 12:49:01.649621 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-34aa5a22-6185-4f98-9626-3eea2e6bd48d req-1ad1edae-3a18-490c-ac17-49f693da2080 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207086 Aug 18 12:49:01.650485 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4582/7236] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:49:01.656527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7db4f42e-8879-46da-a564-476d35ac9705 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:01.657786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7db4f42e-8879-46da-a564-476d35ac9705 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:01.665605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7db4f42e-8879-46da-a564-476d35ac9705 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:01.666131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7db4f42e-8879-46da-a564-476d35ac9705 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:01.666628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7db4f42e-8879-46da-a564-476d35ac9705 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:01.667627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7db4f42e-8879-46da-a564-476d35ac9705 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:01.668116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7db4f42e-8879-46da-a564-476d35ac9705 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:01.668563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7db4f42e-8879-46da-a564-476d35ac9705 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:01.967883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7db4f42e-8879-46da-a564-476d35ac9705 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:49:01.979471 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7db4f42e-8879-46da-a564-476d35ac9705 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1689 microversion: 2.1 time: 0.327070 Aug 18 12:49:01.980290 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4583/7237] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:01 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1689 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:49:03.014067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a372f0aa-f784-4283-b68f-06d92c6df240 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:03.015381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a372f0aa-f784-4283-b68f-06d92c6df240 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:03.027735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a372f0aa-f784-4283-b68f-06d92c6df240 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:03.028546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a372f0aa-f784-4283-b68f-06d92c6df240 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:03.028995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a372f0aa-f784-4283-b68f-06d92c6df240 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:03.030258 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a372f0aa-f784-4283-b68f-06d92c6df240 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:03.031082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a372f0aa-f784-4283-b68f-06d92c6df240 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:03.031743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a372f0aa-f784-4283-b68f-06d92c6df240 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:03.241638 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a372f0aa-f784-4283-b68f-06d92c6df240 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:49:03.250051 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a372f0aa-f784-4283-b68f-06d92c6df240 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 200 len: 1689 microversion: 2.1 time: 0.243241 Aug 18 12:49:03.262468 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4584/7238] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:03 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 1689 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:49:03.668303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-afaf7942-9539-4247-a324-07beed9ce3ed req-ceae4382-684f-48fb-bc11-da75ffdce9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb0b0e0-53ce-4135-b981-a206a5d89eed", "name": "network-vif-deleted", "tag": "35d2e1b2-23f1-4ab2-8543-b35721296ed7"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:49:03.679780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-afaf7942-9539-4247-a324-07beed9ce3ed req-ceae4382-684f-48fb-bc11-da75ffdce9e7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:03.680311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-afaf7942-9539-4247-a324-07beed9ce3ed req-ceae4382-684f-48fb-bc11-da75ffdce9e7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:03.680773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-afaf7942-9539-4247-a324-07beed9ce3ed req-ceae4382-684f-48fb-bc11-da75ffdce9e7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:03.699910 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-afaf7942-9539-4247-a324-07beed9ce3ed req-ceae4382-684f-48fb-bc11-da75ffdce9e7 service nova] Creating event network-vif-deleted:35d2e1b2-23f1-4ab2-8543-b35721296ed7 for instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed on n-h2-853611-3 Aug 18 12:49:03.708801 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-afaf7942-9539-4247-a324-07beed9ce3ed req-ceae4382-684f-48fb-bc11-da75ffdce9e7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043815 Aug 18 12:49:03.709792 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4585/7239] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:49:04.278065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4f8b7e63-e84a-4b95-948c-215ebe7e4491 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:04.278875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4f8b7e63-e84a-4b95-948c-215ebe7e4491 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 7bb0b0e0-53ce-4135-b981-a206a5d89eed] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:04.287204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f8b7e63-e84a-4b95-948c-215ebe7e4491 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:04.287765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f8b7e63-e84a-4b95-948c-215ebe7e4491 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:04.288361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f8b7e63-e84a-4b95-948c-215ebe7e4491 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:04.289157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f8b7e63-e84a-4b95-948c-215ebe7e4491 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:04.289676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f8b7e63-e84a-4b95-948c-215ebe7e4491 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:04.290175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f8b7e63-e84a-4b95-948c-215ebe7e4491 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:04.306205 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-4f8b7e63-e84a-4b95-948c-215ebe7e4491 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] HTTP exception thrown: Instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed could not be found. Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4f8b7e63-e84a-4b95-948c-215ebe7e4491 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Request method failure captured: Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed HTTP/1.1 Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jQeQZPOFUsCvPq9KJ45C83hU_4PBqTwbXRk1jzU3ZGP69rWq4GCsfSstUtl_fGSuFj9IIScCSANx3NuCkMMOA9dHVMwOwl_vghoFlSI0Mp5C2A5UMmer5lfR-ujm4tsvONIGKbYuCFqRFqUS-ZdywsiNZI2ndTb8o6EwBql0c3GNVE Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 0f1aa7dfe3f74f5ab3b45373c1a17574 Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 0f1aa7dfe3f74f5ab3b45373c1a17574 Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestNetworkAdvancedServerOps-1530263574-project Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 064db809a9034ebc85b986c87d0036d1 Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1530263574-project Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed could not be found. Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '7bb0b0e0-53ce-4135-b981-a206a5d89eed'} Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed could not be found. Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed could not be found. Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:49:04.308162 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:49:04.316899 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:49:04.316899 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:49:04.316899 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:49:04.316899 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:49:04.316899 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:49:04.316899 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:49:04.316899 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed could not be found. Aug 18 12:49:04.316899 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:49:04.316899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4f8b7e63-e84a-4b95-948c-215ebe7e4491 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Returning 404 to user: Instance 7bb0b0e0-53ce-4135-b981-a206a5d89eed could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:49:04.316899 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4f8b7e63-e84a-4b95-948c-215ebe7e4491 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed" status: 404 len: 111 microversion: 2.1 time: 0.036706 Aug 18 12:49:04.316899 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4586/7240] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:04 2022] GET /compute/v2.1/servers/7bb0b0e0-53ce-4135-b981-a206a5d89eed => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:49:08.692216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-64f3ea7f-d48e-41b0-a857-be0212fe0a23 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '.version_select at 0x7f519ed424c0>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:08.725936 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-64f3ea7f-d48e-41b0-a857-be0212fe0a23 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1936947773" status: 202 len: 0 microversion: 2.1 time: 0.039494 Aug 18 12:49:08.726573 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4587/7241] 10.222.0.73 () {58 vars in 1284 bytes} [Thu Aug 18 12:49:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1936947773 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:49:08.763295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-81815514-bc45-4e00-9060-8c4c96675594 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'create', calling method: .version_select at 0x7f519e7c2af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1787826261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOTK2Cb3InTxYSewXzsah85HnHgKaRZpHCIsmvWB+I+lhYTWBdURSRPzBUtMFCJGzbY+2LVnuNFMyjwE12g3Uh0qHPjRxs70lR8cHdZcWpFOs2JBiRjVedugrWXULRR1g=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:49:08.782473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-81815514-bc45-4e00-9060-8c4c96675594 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:49:08.788568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-81815514-bc45-4e00-9060-8c4c96675594 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for user 064db809a9034ebc85b986c87d0036d1 and project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:49:08.817777 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-81815514-bc45-4e00-9060-8c4c96675594 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.059065 Aug 18 12:49:08.818613 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4588/7242] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:49:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:49:15.634228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:49:15.715865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-170686043", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "99087363-0d0d-4acd-9e12-42ecbbd59f1e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1787826261", "security_groups": [{"name": "tempest-secgroup-smoke-1486224356"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:49:15.864605 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] validate_networks() for [('99087363-0d0d-4acd-9e12-42ecbbd59f1e', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:49:16.437975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:49:16.440190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:49:16.440815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:49:16.441575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:49:16.442480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:49:16.458108 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:16.458757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:16.459228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:16.460066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:16.460758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:16.461263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:16.483209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:49:16.493885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for user 064db809a9034ebc85b986c87d0036d1 and project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:49:16.515459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:49:16.520090 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:49:16.598671 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5e32834d-5c09-4239-b3a4-e8248acbf772 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.970019 Aug 18 12:49:16.599719 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4589/7243] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:49:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:49:16.613708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-de650724-c78f-43e6-84ef-662382408f6c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:16.614366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-de650724-c78f-43e6-84ef-662382408f6c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:16.713367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-de650724-c78f-43e6-84ef-662382408f6c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:49:16.724616 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-de650724-c78f-43e6-84ef-662382408f6c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1266 microversion: 2.1 time: 0.116410 Aug 18 12:49:16.726034 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4590/7244] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:16 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:49:17.752205 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-086be931-c0b4-420a-b444-a93f84103aba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:17.757188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-086be931-c0b4-420a-b444-a93f84103aba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:17.771003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-086be931-c0b4-420a-b444-a93f84103aba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:17.771910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-086be931-c0b4-420a-b444-a93f84103aba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:17.772724 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-086be931-c0b4-420a-b444-a93f84103aba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:17.774277 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-086be931-c0b4-420a-b444-a93f84103aba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:17.775363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-086be931-c0b4-420a-b444-a93f84103aba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:17.775818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-086be931-c0b4-420a-b444-a93f84103aba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:17.872915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-086be931-c0b4-420a-b444-a93f84103aba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:49:17.891999 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-086be931-c0b4-420a-b444-a93f84103aba tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1318 microversion: 2.1 time: 0.146999 Aug 18 12:49:17.896024 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4591/7245] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:17 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:49:18.939511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aec461b4-3ac1-45b2-b518-ef2c5712d3b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:18.940523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aec461b4-3ac1-45b2-b518-ef2c5712d3b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:18.958506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aec461b4-3ac1-45b2-b518-ef2c5712d3b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:18.959316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aec461b4-3ac1-45b2-b518-ef2c5712d3b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:18.959779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aec461b4-3ac1-45b2-b518-ef2c5712d3b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:18.960802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aec461b4-3ac1-45b2-b518-ef2c5712d3b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:18.961603 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aec461b4-3ac1-45b2-b518-ef2c5712d3b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:18.962310 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aec461b4-3ac1-45b2-b518-ef2c5712d3b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:19.217412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aec461b4-3ac1-45b2-b518-ef2c5712d3b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:49:19.229847 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aec461b4-3ac1-45b2-b518-ef2c5712d3b5 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1392 microversion: 2.1 time: 0.304230 Aug 18 12:49:19.244283 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4592/7246] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:18 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1392 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:49:19.939569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-eb0a2024-ac5f-4ad1-a4ef-33daeb404f74 req-915e3592-edd0-4af3-a6f6-655ebc66eab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94e481f-3211-43eb-8f31-8a7719d6fc96", "tag": "58978e7e-fb52-402a-89c5-1b413c994c8f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:49:19.953666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eb0a2024-ac5f-4ad1-a4ef-33daeb404f74 req-915e3592-edd0-4af3-a6f6-655ebc66eab3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:19.955014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eb0a2024-ac5f-4ad1-a4ef-33daeb404f74 req-915e3592-edd0-4af3-a6f6-655ebc66eab3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:19.967050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-eb0a2024-ac5f-4ad1-a4ef-33daeb404f74 req-915e3592-edd0-4af3-a6f6-655ebc66eab3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:19.979908 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-eb0a2024-ac5f-4ad1-a4ef-33daeb404f74 req-915e3592-edd0-4af3-a6f6-655ebc66eab3 service nova] Creating event network-changed:58978e7e-fb52-402a-89c5-1b413c994c8f for instance b94e481f-3211-43eb-8f31-8a7719d6fc96 on n-h2-853611-3 Aug 18 12:49:19.993198 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-eb0a2024-ac5f-4ad1-a4ef-33daeb404f74 req-915e3592-edd0-4af3-a6f6-655ebc66eab3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059901 Aug 18 12:49:19.994075 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4593/7247] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:49:20.260347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-809fa208-6676-4ed3-8586-a921bea42628 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:20.262381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-809fa208-6676-4ed3-8586-a921bea42628 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:20.280449 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-809fa208-6676-4ed3-8586-a921bea42628 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:20.282191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-809fa208-6676-4ed3-8586-a921bea42628 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:20.283185 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-809fa208-6676-4ed3-8586-a921bea42628 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:20.284628 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-809fa208-6676-4ed3-8586-a921bea42628 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:20.285783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-809fa208-6676-4ed3-8586-a921bea42628 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:20.286612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-809fa208-6676-4ed3-8586-a921bea42628 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:20.748998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-809fa208-6676-4ed3-8586-a921bea42628 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:49:20.759027 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-809fa208-6676-4ed3-8586-a921bea42628 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1392 microversion: 2.1 time: 0.506912 Aug 18 12:49:20.760100 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4594/7248] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:20 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1392 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:49:21.798499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-05650506-09c5-4fc8-932a-4a2b71d7337c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:21.799846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-05650506-09c5-4fc8-932a-4a2b71d7337c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:21.808529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05650506-09c5-4fc8-932a-4a2b71d7337c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:21.809190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05650506-09c5-4fc8-932a-4a2b71d7337c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:21.809761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05650506-09c5-4fc8-932a-4a2b71d7337c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:21.810788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05650506-09c5-4fc8-932a-4a2b71d7337c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:21.811487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05650506-09c5-4fc8-932a-4a2b71d7337c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:21.812047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-05650506-09c5-4fc8-932a-4a2b71d7337c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:22.111771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-05650506-09c5-4fc8-932a-4a2b71d7337c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:49:22.128914 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-05650506-09c5-4fc8-932a-4a2b71d7337c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1392 microversion: 2.1 time: 0.334984 Aug 18 12:49:22.130421 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4595/7249] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:21 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1392 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:49:23.165715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-48081fe9-1f7f-417e-adcb-55f848a258e6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:23.166466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-48081fe9-1f7f-417e-adcb-55f848a258e6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:23.175385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48081fe9-1f7f-417e-adcb-55f848a258e6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:23.175896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48081fe9-1f7f-417e-adcb-55f848a258e6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:23.176353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48081fe9-1f7f-417e-adcb-55f848a258e6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:23.177620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48081fe9-1f7f-417e-adcb-55f848a258e6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:23.178486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48081fe9-1f7f-417e-adcb-55f848a258e6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:23.179279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-48081fe9-1f7f-417e-adcb-55f848a258e6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:23.340259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-48081fe9-1f7f-417e-adcb-55f848a258e6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:49:23.348957 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-48081fe9-1f7f-417e-adcb-55f848a258e6 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1392 microversion: 2.1 time: 0.188466 Aug 18 12:49:23.349573 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4596/7250] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:23 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:49:24.385588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1f4af6c8-2f22-481b-9aab-4e563578cdb7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:24.386632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1f4af6c8-2f22-481b-9aab-4e563578cdb7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:24.390697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:49:24.396565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f4af6c8-2f22-481b-9aab-4e563578cdb7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:24.397093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f4af6c8-2f22-481b-9aab-4e563578cdb7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:24.397558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f4af6c8-2f22-481b-9aab-4e563578cdb7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:24.398328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f4af6c8-2f22-481b-9aab-4e563578cdb7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:24.398847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f4af6c8-2f22-481b-9aab-4e563578cdb7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:24.399309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1f4af6c8-2f22-481b-9aab-4e563578cdb7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:24.598329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1f4af6c8-2f22-481b-9aab-4e563578cdb7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:49:24.607140 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1f4af6c8-2f22-481b-9aab-4e563578cdb7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1392 microversion: 2.1 time: 0.226069 Aug 18 12:49:24.607776 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4597/7251] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:24 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1392 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:49:25.631318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-43e3fd44-bbe1-46a9-9211-4f6344399d80 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:25.632137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-43e3fd44-bbe1-46a9-9211-4f6344399d80 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:25.640335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43e3fd44-bbe1-46a9-9211-4f6344399d80 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:25.640844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43e3fd44-bbe1-46a9-9211-4f6344399d80 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:25.641954 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43e3fd44-bbe1-46a9-9211-4f6344399d80 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:25.642753 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43e3fd44-bbe1-46a9-9211-4f6344399d80 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:25.643226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43e3fd44-bbe1-46a9-9211-4f6344399d80 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:25.643668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43e3fd44-bbe1-46a9-9211-4f6344399d80 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:25.799683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-43e3fd44-bbe1-46a9-9211-4f6344399d80 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:49:25.808008 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-43e3fd44-bbe1-46a9-9211-4f6344399d80 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1392 microversion: 2.1 time: 0.181176 Aug 18 12:49:25.808625 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4598/7252] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:25 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:49:26.049670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1abe8ff3-ba6c-47e9-85cf-162f7eb99533 req-1ab4828e-3e68-40d7-8ac5-6bfdeb160719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94e481f-3211-43eb-8f31-8a7719d6fc96", "name": "network-vif-plugged", "status": "completed", "tag": "58978e7e-fb52-402a-89c5-1b413c994c8f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:49:26.070780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1abe8ff3-ba6c-47e9-85cf-162f7eb99533 req-1ab4828e-3e68-40d7-8ac5-6bfdeb160719 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:26.071830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1abe8ff3-ba6c-47e9-85cf-162f7eb99533 req-1ab4828e-3e68-40d7-8ac5-6bfdeb160719 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:26.072839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1abe8ff3-ba6c-47e9-85cf-162f7eb99533 req-1ab4828e-3e68-40d7-8ac5-6bfdeb160719 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:26.088789 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1abe8ff3-ba6c-47e9-85cf-162f7eb99533 req-1ab4828e-3e68-40d7-8ac5-6bfdeb160719 service nova] Creating event network-vif-plugged:58978e7e-fb52-402a-89c5-1b413c994c8f for instance b94e481f-3211-43eb-8f31-8a7719d6fc96 on n-h2-853611-3 Aug 18 12:49:26.096176 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1abe8ff3-ba6c-47e9-85cf-162f7eb99533 req-1ab4828e-3e68-40d7-8ac5-6bfdeb160719 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053039 Aug 18 12:49:26.096948 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4599/7253] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:49:26.827599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:49:26.830253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:49:26.834996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1af179fb-9b98-4936-bbba-2f7fb6133ced tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:26.835713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1af179fb-9b98-4936-bbba-2f7fb6133ced tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:26.843689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1af179fb-9b98-4936-bbba-2f7fb6133ced tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:26.844202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1af179fb-9b98-4936-bbba-2f7fb6133ced tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:26.847571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1af179fb-9b98-4936-bbba-2f7fb6133ced tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:26.848459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1af179fb-9b98-4936-bbba-2f7fb6133ced tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:26.849347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1af179fb-9b98-4936-bbba-2f7fb6133ced tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:26.849770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1af179fb-9b98-4936-bbba-2f7fb6133ced tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:27.010751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1af179fb-9b98-4936-bbba-2f7fb6133ced tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:49:27.019422 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1af179fb-9b98-4936-bbba-2f7fb6133ced tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1392 microversion: 2.1 time: 0.192863 Aug 18 12:49:27.020023 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4600/7254] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:26 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:49:28.045022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d17b4dcd-6fce-4107-9499-72013d917e61 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:28.045708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d17b4dcd-6fce-4107-9499-72013d917e61 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:28.055073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d17b4dcd-6fce-4107-9499-72013d917e61 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:28.055587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d17b4dcd-6fce-4107-9499-72013d917e61 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:28.056051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d17b4dcd-6fce-4107-9499-72013d917e61 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:28.056841 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d17b4dcd-6fce-4107-9499-72013d917e61 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:28.057319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d17b4dcd-6fce-4107-9499-72013d917e61 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:28.057767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d17b4dcd-6fce-4107-9499-72013d917e61 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:28.208429 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d17b4dcd-6fce-4107-9499-72013d917e61 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:49:28.216686 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d17b4dcd-6fce-4107-9499-72013d917e61 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1565 microversion: 2.1 time: 0.175418 Aug 18 12:49:28.217292 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4601/7255] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:28 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:49:28.237927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2642ebca-9977-4f83-8dbd-d00a67ea60cc tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:28.238598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2642ebca-9977-4f83-8dbd-d00a67ea60cc tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:28.245031 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2642ebca-9977-4f83-8dbd-d00a67ea60cc tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:28.245536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2642ebca-9977-4f83-8dbd-d00a67ea60cc tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:28.245996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2642ebca-9977-4f83-8dbd-d00a67ea60cc tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:28.246804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2642ebca-9977-4f83-8dbd-d00a67ea60cc tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:28.247241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2642ebca-9977-4f83-8dbd-d00a67ea60cc tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:28.247665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2642ebca-9977-4f83-8dbd-d00a67ea60cc tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:28.383694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2642ebca-9977-4f83-8dbd-d00a67ea60cc tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:49:28.392217 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2642ebca-9977-4f83-8dbd-d00a67ea60cc tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1565 microversion: 2.1 time: 0.157833 Aug 18 12:49:28.392804 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4602/7256] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:28 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:49:30.395264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-8e620f11-16e7-45f1-ada8-6b117f025d8a req-b90f9dbb-0e77-4e93-abb2-8a8f6542374b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94e481f-3211-43eb-8f31-8a7719d6fc96", "tag": "58978e7e-fb52-402a-89c5-1b413c994c8f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:49:30.405695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8e620f11-16e7-45f1-ada8-6b117f025d8a req-b90f9dbb-0e77-4e93-abb2-8a8f6542374b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:30.406202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8e620f11-16e7-45f1-ada8-6b117f025d8a req-b90f9dbb-0e77-4e93-abb2-8a8f6542374b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:30.406683 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-8e620f11-16e7-45f1-ada8-6b117f025d8a req-b90f9dbb-0e77-4e93-abb2-8a8f6542374b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:30.420062 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-8e620f11-16e7-45f1-ada8-6b117f025d8a req-b90f9dbb-0e77-4e93-abb2-8a8f6542374b service nova] Creating event network-changed:58978e7e-fb52-402a-89c5-1b413c994c8f for instance b94e481f-3211-43eb-8f31-8a7719d6fc96 on n-h2-853611-3 Aug 18 12:49:30.427747 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-8e620f11-16e7-45f1-ada8-6b117f025d8a req-b90f9dbb-0e77-4e93-abb2-8a8f6542374b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036067 Aug 18 12:49:30.428853 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4603/7257] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:49:30.447639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9c7929f0-dbdb-4327-8f89-aea3b93793de tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:49:30.448762 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9c7929f0-dbdb-4327-8f89-aea3b93793de tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:30.460819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7929f0-dbdb-4327-8f89-aea3b93793de tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:30.461640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7929f0-dbdb-4327-8f89-aea3b93793de tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:30.462104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7929f0-dbdb-4327-8f89-aea3b93793de tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:30.463571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7929f0-dbdb-4327-8f89-aea3b93793de tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:30.463571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7929f0-dbdb-4327-8f89-aea3b93793de tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:30.464138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9c7929f0-dbdb-4327-8f89-aea3b93793de tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:30.750957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9c7929f0-dbdb-4327-8f89-aea3b93793de tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:49:30.768233 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9c7929f0-dbdb-4327-8f89-aea3b93793de tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1565 microversion: 2.1 time: 0.337082 Aug 18 12:49:30.779577 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4604/7258] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:49:30 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1565 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:49:52.068138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-312c37d9-dc81-4ba1-ab77-10afacdda0b8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:49:52.070354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-312c37d9-dc81-4ba1-ab77-10afacdda0b8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:49:52.073290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=15 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:49:52.074036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=74 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:49:52.080016 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-312c37d9-dc81-4ba1-ab77-10afacdda0b8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:52.080524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-312c37d9-dc81-4ba1-ab77-10afacdda0b8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:52.080980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-312c37d9-dc81-4ba1-ab77-10afacdda0b8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:52.081713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-312c37d9-dc81-4ba1-ab77-10afacdda0b8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:49:52.082183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-312c37d9-dc81-4ba1-ab77-10afacdda0b8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:49:52.082660 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-312c37d9-dc81-4ba1-ab77-10afacdda0b8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:49:52.142680 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-312c37d9-dc81-4ba1-ab77-10afacdda0b8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96/action" status: 200 len: 24560 microversion: 2.1 time: 0.078298 Aug 18 12:49:52.143358 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4605/7259] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:49:52 2022] POST /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96/action => generated 24560 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:49:58.870608 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:49:58.871240 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:49:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:50:03.227149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4fe7fffb-6aa8-46be-8e40-3e1856fe5741 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:50:03.233604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:50:03.237886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:50:03.241626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fe7fffb-6aa8-46be-8e40-3e1856fe5741 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:03.242129 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fe7fffb-6aa8-46be-8e40-3e1856fe5741 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:03.242609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4fe7fffb-6aa8-46be-8e40-3e1856fe5741 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:03.268591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4fe7fffb-6aa8-46be-8e40-3e1856fe5741 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Going to try to stop instance {{(pid=122210) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 12:50:03.316272 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4fe7fffb-6aa8-46be-8e40-3e1856fe5741 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96/action" status: 202 len: 0 microversion: 2.1 time: 0.096493 Aug 18 12:50:03.316885 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4606/7260] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:50:03 2022] POST /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:50:03.326338 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5aaa6037-3fdd-4e74-bd9b-c351c07bef45 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:03.327166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5aaa6037-3fdd-4e74-bd9b-c351c07bef45 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:03.334226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5aaa6037-3fdd-4e74-bd9b-c351c07bef45 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:03.334757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5aaa6037-3fdd-4e74-bd9b-c351c07bef45 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:03.335228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5aaa6037-3fdd-4e74-bd9b-c351c07bef45 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:03.336613 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5aaa6037-3fdd-4e74-bd9b-c351c07bef45 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:03.337086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5aaa6037-3fdd-4e74-bd9b-c351c07bef45 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:03.337522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5aaa6037-3fdd-4e74-bd9b-c351c07bef45 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:03.484807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5aaa6037-3fdd-4e74-bd9b-c351c07bef45 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:03.493079 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5aaa6037-3fdd-4e74-bd9b-c351c07bef45 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1693 microversion: 2.1 time: 0.171230 Aug 18 12:50:03.493674 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4607/7261] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:03 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:04.516260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5e5bc597-4461-4cd0-a9e9-46f7b2f4125e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:04.517623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5e5bc597-4461-4cd0-a9e9-46f7b2f4125e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:04.524325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e5bc597-4461-4cd0-a9e9-46f7b2f4125e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:04.524816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e5bc597-4461-4cd0-a9e9-46f7b2f4125e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:04.525270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e5bc597-4461-4cd0-a9e9-46f7b2f4125e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:04.525985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e5bc597-4461-4cd0-a9e9-46f7b2f4125e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:04.526461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e5bc597-4461-4cd0-a9e9-46f7b2f4125e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:04.526888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5e5bc597-4461-4cd0-a9e9-46f7b2f4125e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:04.660730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5e5bc597-4461-4cd0-a9e9-46f7b2f4125e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:04.668310 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5e5bc597-4461-4cd0-a9e9-46f7b2f4125e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1693 microversion: 2.1 time: 0.156201 Aug 18 12:50:04.668886 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4608/7262] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:04 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:05.689372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-009d1fbe-1c4d-4889-a0a6-91136596e77c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:05.690059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-009d1fbe-1c4d-4889-a0a6-91136596e77c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:05.696826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009d1fbe-1c4d-4889-a0a6-91136596e77c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:05.697330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009d1fbe-1c4d-4889-a0a6-91136596e77c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:05.697777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009d1fbe-1c4d-4889-a0a6-91136596e77c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:05.698510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009d1fbe-1c4d-4889-a0a6-91136596e77c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:05.698984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009d1fbe-1c4d-4889-a0a6-91136596e77c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:05.699424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-009d1fbe-1c4d-4889-a0a6-91136596e77c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:05.836765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-009d1fbe-1c4d-4889-a0a6-91136596e77c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:05.844394 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-009d1fbe-1c4d-4889-a0a6-91136596e77c tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1693 microversion: 2.1 time: 0.159031 Aug 18 12:50:05.845678 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4609/7263] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:05 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:06.867166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-93697847-2820-4878-bf7d-4c0c28a2061a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:06.868220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-93697847-2820-4878-bf7d-4c0c28a2061a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:06.875178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93697847-2820-4878-bf7d-4c0c28a2061a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:06.875711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93697847-2820-4878-bf7d-4c0c28a2061a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:06.876156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93697847-2820-4878-bf7d-4c0c28a2061a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:06.876885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93697847-2820-4878-bf7d-4c0c28a2061a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:06.877351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93697847-2820-4878-bf7d-4c0c28a2061a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:06.878173 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93697847-2820-4878-bf7d-4c0c28a2061a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:07.028032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-93697847-2820-4878-bf7d-4c0c28a2061a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:07.037581 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-93697847-2820-4878-bf7d-4c0c28a2061a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1693 microversion: 2.1 time: 0.174364 Aug 18 12:50:07.038189 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4610/7264] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:06 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:08.061636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-96f99a85-2616-4555-9d1e-edd309513f2f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:08.062337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-96f99a85-2616-4555-9d1e-edd309513f2f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:08.068533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f99a85-2616-4555-9d1e-edd309513f2f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:08.069067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f99a85-2616-4555-9d1e-edd309513f2f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:08.069487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f99a85-2616-4555-9d1e-edd309513f2f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:08.070200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f99a85-2616-4555-9d1e-edd309513f2f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:08.070697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f99a85-2616-4555-9d1e-edd309513f2f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:08.071134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-96f99a85-2616-4555-9d1e-edd309513f2f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:08.238534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-96f99a85-2616-4555-9d1e-edd309513f2f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:08.246280 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-96f99a85-2616-4555-9d1e-edd309513f2f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1693 microversion: 2.1 time: 0.189336 Aug 18 12:50:08.246899 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4611/7265] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:08 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1693 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:09.269679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a7a6d6f3-123d-4f4a-9d40-c71dbfe7e3d7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:09.270468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a7a6d6f3-123d-4f4a-9d40-c71dbfe7e3d7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:09.278142 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7a6d6f3-123d-4f4a-9d40-c71dbfe7e3d7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:09.278700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7a6d6f3-123d-4f4a-9d40-c71dbfe7e3d7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:09.279200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7a6d6f3-123d-4f4a-9d40-c71dbfe7e3d7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:09.279959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7a6d6f3-123d-4f4a-9d40-c71dbfe7e3d7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:09.280465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7a6d6f3-123d-4f4a-9d40-c71dbfe7e3d7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:09.280918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a7a6d6f3-123d-4f4a-9d40-c71dbfe7e3d7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:09.450918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a7a6d6f3-123d-4f4a-9d40-c71dbfe7e3d7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:09.459342 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a7a6d6f3-123d-4f4a-9d40-c71dbfe7e3d7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1693 microversion: 2.1 time: 0.195591 Aug 18 12:50:09.459929 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4612/7266] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:09 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1693 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:10.480991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-239ddc34-2b23-4bf5-8a6a-b647b190d4b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:10.481759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-239ddc34-2b23-4bf5-8a6a-b647b190d4b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:10.494193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-239ddc34-2b23-4bf5-8a6a-b647b190d4b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:10.495188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-239ddc34-2b23-4bf5-8a6a-b647b190d4b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:10.495682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-239ddc34-2b23-4bf5-8a6a-b647b190d4b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:10.496720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-239ddc34-2b23-4bf5-8a6a-b647b190d4b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:10.497594 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-239ddc34-2b23-4bf5-8a6a-b647b190d4b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:10.498164 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-239ddc34-2b23-4bf5-8a6a-b647b190d4b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:10.647682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-239ddc34-2b23-4bf5-8a6a-b647b190d4b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:10.655782 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-239ddc34-2b23-4bf5-8a6a-b647b190d4b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1693 microversion: 2.1 time: 0.178868 Aug 18 12:50:10.656392 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4613/7267] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:10 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:11.677949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0c15043a-a639-4187-a5dc-2d9fc1aae246 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:11.678751 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0c15043a-a639-4187-a5dc-2d9fc1aae246 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:11.687980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c15043a-a639-4187-a5dc-2d9fc1aae246 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:11.688459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c15043a-a639-4187-a5dc-2d9fc1aae246 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:11.688985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c15043a-a639-4187-a5dc-2d9fc1aae246 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:11.689794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c15043a-a639-4187-a5dc-2d9fc1aae246 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:11.690278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c15043a-a639-4187-a5dc-2d9fc1aae246 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:11.690760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0c15043a-a639-4187-a5dc-2d9fc1aae246 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:11.842825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0c15043a-a639-4187-a5dc-2d9fc1aae246 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:11.852752 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0c15043a-a639-4187-a5dc-2d9fc1aae246 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1693 microversion: 2.1 time: 0.178813 Aug 18 12:50:11.853355 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4614/7268] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:11 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:50:12.874639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c13b1868-347a-4e23-81f7-84e6be93219b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:12.875454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c13b1868-347a-4e23-81f7-84e6be93219b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:12.883276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c13b1868-347a-4e23-81f7-84e6be93219b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:12.883777 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c13b1868-347a-4e23-81f7-84e6be93219b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:12.884231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c13b1868-347a-4e23-81f7-84e6be93219b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:12.884972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c13b1868-347a-4e23-81f7-84e6be93219b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:12.885437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c13b1868-347a-4e23-81f7-84e6be93219b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:12.885875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c13b1868-347a-4e23-81f7-84e6be93219b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:13.035134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c13b1868-347a-4e23-81f7-84e6be93219b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:13.043265 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c13b1868-347a-4e23-81f7-84e6be93219b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1693 microversion: 2.1 time: 0.172695 Aug 18 12:50:13.043859 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4615/7269] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:12 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:14.066075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a8fadf23-af45-468d-b459-a3add32d9866 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:14.067064 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a8fadf23-af45-468d-b459-a3add32d9866 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:14.075343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8fadf23-af45-468d-b459-a3add32d9866 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:14.075854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8fadf23-af45-468d-b459-a3add32d9866 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:14.076307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8fadf23-af45-468d-b459-a3add32d9866 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:14.077043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8fadf23-af45-468d-b459-a3add32d9866 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:14.077513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8fadf23-af45-468d-b459-a3add32d9866 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:14.077952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8fadf23-af45-468d-b459-a3add32d9866 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:14.246849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a8fadf23-af45-468d-b459-a3add32d9866 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:14.258150 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a8fadf23-af45-468d-b459-a3add32d9866 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1693 microversion: 2.1 time: 0.196180 Aug 18 12:50:14.258797 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4616/7270] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:14 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1693 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:15.283415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-29b08152-1ced-4808-a04b-a8209c7ad160 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:15.284435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-29b08152-1ced-4808-a04b-a8209c7ad160 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:15.291908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29b08152-1ced-4808-a04b-a8209c7ad160 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:15.291908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29b08152-1ced-4808-a04b-a8209c7ad160 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:15.292344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29b08152-1ced-4808-a04b-a8209c7ad160 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:15.293125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29b08152-1ced-4808-a04b-a8209c7ad160 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:15.293560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29b08152-1ced-4808-a04b-a8209c7ad160 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:15.294014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29b08152-1ced-4808-a04b-a8209c7ad160 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:15.463417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-29b08152-1ced-4808-a04b-a8209c7ad160 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:15.472929 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-29b08152-1ced-4808-a04b-a8209c7ad160 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1693 microversion: 2.1 time: 0.194298 Aug 18 12:50:15.473841 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4617/7271] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:15 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:16.498662 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1c9e74e8-0322-4c1d-8828-771a143357d0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:16.499378 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1c9e74e8-0322-4c1d-8828-771a143357d0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:16.507991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c9e74e8-0322-4c1d-8828-771a143357d0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:16.508549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c9e74e8-0322-4c1d-8828-771a143357d0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:16.509057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c9e74e8-0322-4c1d-8828-771a143357d0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:16.509910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c9e74e8-0322-4c1d-8828-771a143357d0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:16.510541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c9e74e8-0322-4c1d-8828-771a143357d0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:16.511114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1c9e74e8-0322-4c1d-8828-771a143357d0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:16.704891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1c9e74e8-0322-4c1d-8828-771a143357d0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:16.714540 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1c9e74e8-0322-4c1d-8828-771a143357d0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1693 microversion: 2.1 time: 0.220707 Aug 18 12:50:16.715153 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4618/7272] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:16 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1693 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:17.754974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-82ad8218-1b07-4b4e-868c-0b74f7ff1c44 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:17.755933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-82ad8218-1b07-4b4e-868c-0b74f7ff1c44 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:17.769686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82ad8218-1b07-4b4e-868c-0b74f7ff1c44 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:17.770658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82ad8218-1b07-4b4e-868c-0b74f7ff1c44 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:17.771500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82ad8218-1b07-4b4e-868c-0b74f7ff1c44 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:17.772849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82ad8218-1b07-4b4e-868c-0b74f7ff1c44 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:17.773737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82ad8218-1b07-4b4e-868c-0b74f7ff1c44 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:17.775654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82ad8218-1b07-4b4e-868c-0b74f7ff1c44 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:17.981321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-82ad8218-1b07-4b4e-868c-0b74f7ff1c44 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:17.996097 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-82ad8218-1b07-4b4e-868c-0b74f7ff1c44 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1693 microversion: 2.1 time: 0.249704 Aug 18 12:50:17.996853 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4619/7273] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:17 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1693 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:19.029448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-22a741d0-02c5-4ce1-9aaf-44349bf71e36 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:19.030250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-22a741d0-02c5-4ce1-9aaf-44349bf71e36 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:19.040470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22a741d0-02c5-4ce1-9aaf-44349bf71e36 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:19.041705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22a741d0-02c5-4ce1-9aaf-44349bf71e36 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:19.042332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22a741d0-02c5-4ce1-9aaf-44349bf71e36 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:19.043122 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22a741d0-02c5-4ce1-9aaf-44349bf71e36 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:19.043610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22a741d0-02c5-4ce1-9aaf-44349bf71e36 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:19.044058 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22a741d0-02c5-4ce1-9aaf-44349bf71e36 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:19.220211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-22a741d0-02c5-4ce1-9aaf-44349bf71e36 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:19.230976 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-22a741d0-02c5-4ce1-9aaf-44349bf71e36 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1670 microversion: 2.1 time: 0.205370 Aug 18 12:50:19.231587 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4620/7274] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:19 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1670 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:20.353106 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b83bb606-7582-4184-8e7e-726e2cb4e1bd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:50:20.355400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b83bb606-7582-4184-8e7e-726e2cb4e1bd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:20.362783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b83bb606-7582-4184-8e7e-726e2cb4e1bd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:20.363294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b83bb606-7582-4184-8e7e-726e2cb4e1bd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:20.363749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b83bb606-7582-4184-8e7e-726e2cb4e1bd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:20.364481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b83bb606-7582-4184-8e7e-726e2cb4e1bd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:20.364950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b83bb606-7582-4184-8e7e-726e2cb4e1bd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:20.365394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b83bb606-7582-4184-8e7e-726e2cb4e1bd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:20.397065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:50:20.443252 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b83bb606-7582-4184-8e7e-726e2cb4e1bd tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96/action" status: 200 len: 38383 microversion: 2.1 time: 0.094207 Aug 18 12:50:20.443946 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4621/7275] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:50:20 2022] POST /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96/action => generated 38383 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:50:20.457770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c021fe5a-c5a7-4509-9dd5-41e0d1770294 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:50:20.465654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c021fe5a-c5a7-4509-9dd5-41e0d1770294 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:20.466219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c021fe5a-c5a7-4509-9dd5-41e0d1770294 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:20.466940 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c021fe5a-c5a7-4509-9dd5-41e0d1770294 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:20.495080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c021fe5a-c5a7-4509-9dd5-41e0d1770294 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Going to try to start instance {{(pid=122210) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 18 12:50:20.546497 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c021fe5a-c5a7-4509-9dd5-41e0d1770294 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96/action" status: 202 len: 0 microversion: 2.1 time: 0.093200 Aug 18 12:50:20.547111 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4622/7276] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:50:20 2022] POST /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:50:20.561381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-398d62a5-35fc-447b-a10b-47fcd778f10a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:20.562687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-398d62a5-35fc-447b-a10b-47fcd778f10a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:20.578498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-398d62a5-35fc-447b-a10b-47fcd778f10a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:20.579459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-398d62a5-35fc-447b-a10b-47fcd778f10a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:20.580299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-398d62a5-35fc-447b-a10b-47fcd778f10a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:20.581636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-398d62a5-35fc-447b-a10b-47fcd778f10a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:20.582535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-398d62a5-35fc-447b-a10b-47fcd778f10a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:20.583328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-398d62a5-35fc-447b-a10b-47fcd778f10a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:21.229492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-398d62a5-35fc-447b-a10b-47fcd778f10a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:21.241064 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-398d62a5-35fc-447b-a10b-47fcd778f10a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1679 microversion: 2.1 time: 0.687245 Aug 18 12:50:21.242024 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4623/7277] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:20 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1679 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:22.267139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5cfbf8a9-4551-4522-a53f-2e132ef0127a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:22.268188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5cfbf8a9-4551-4522-a53f-2e132ef0127a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:22.276453 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cfbf8a9-4551-4522-a53f-2e132ef0127a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:22.276966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cfbf8a9-4551-4522-a53f-2e132ef0127a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:22.277424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cfbf8a9-4551-4522-a53f-2e132ef0127a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:22.278162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cfbf8a9-4551-4522-a53f-2e132ef0127a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:22.278677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cfbf8a9-4551-4522-a53f-2e132ef0127a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:22.279138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5cfbf8a9-4551-4522-a53f-2e132ef0127a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:22.441231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5cfbf8a9-4551-4522-a53f-2e132ef0127a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:22.449691 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5cfbf8a9-4551-4522-a53f-2e132ef0127a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1683 microversion: 2.1 time: 0.187506 Aug 18 12:50:22.450282 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4624/7278] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:22 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:46.667241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-388c7218-cc8a-4dad-a2f9-9884d3014836 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:50:46.669501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-388c7218-cc8a-4dad-a2f9-9884d3014836 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:46.672520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=38 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:50:46.673410 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:50:46.681264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-388c7218-cc8a-4dad-a2f9-9884d3014836 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:46.681990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-388c7218-cc8a-4dad-a2f9-9884d3014836 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:46.682201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-388c7218-cc8a-4dad-a2f9-9884d3014836 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:46.683051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-388c7218-cc8a-4dad-a2f9-9884d3014836 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:46.683535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-388c7218-cc8a-4dad-a2f9-9884d3014836 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:46.684093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-388c7218-cc8a-4dad-a2f9-9884d3014836 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:46.751015 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-388c7218-cc8a-4dad-a2f9-9884d3014836 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96/action" status: 200 len: 62945 microversion: 2.1 time: 0.087167 Aug 18 12:50:46.752185 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4625/7279] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:50:46 2022] POST /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96/action => generated 62945 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:50:53.954076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ddfc4f6b-b809-4fda-8db1-9eba03b490c8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:53.954761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ddfc4f6b-b809-4fda-8db1-9eba03b490c8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:53.963581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddfc4f6b-b809-4fda-8db1-9eba03b490c8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:53.964043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddfc4f6b-b809-4fda-8db1-9eba03b490c8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:53.964556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddfc4f6b-b809-4fda-8db1-9eba03b490c8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:53.965265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddfc4f6b-b809-4fda-8db1-9eba03b490c8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:53.965734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddfc4f6b-b809-4fda-8db1-9eba03b490c8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:53.966183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ddfc4f6b-b809-4fda-8db1-9eba03b490c8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:53.995930 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ddfc4f6b-b809-4fda-8db1-9eba03b490c8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:50:54.083851 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ddfc4f6b-b809-4fda-8db1-9eba03b490c8 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 204 len: 0 microversion: 2.1 time: 0.133623 Aug 18 12:50:54.087754 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4626/7280] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:50:53 2022] DELETE /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:50:54.093043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ad87a18e-0be2-4443-a1d6-b52810c46723 req-4353a9b0-6415-4572-b1e4-934dfb6dd04c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94e481f-3211-43eb-8f31-8a7719d6fc96", "tag": "58978e7e-fb52-402a-89c5-1b413c994c8f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:50:54.104319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ad87a18e-0be2-4443-a1d6-b52810c46723 req-4353a9b0-6415-4572-b1e4-934dfb6dd04c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:54.104815 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ad87a18e-0be2-4443-a1d6-b52810c46723 req-4353a9b0-6415-4572-b1e4-934dfb6dd04c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:54.105262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ad87a18e-0be2-4443-a1d6-b52810c46723 req-4353a9b0-6415-4572-b1e4-934dfb6dd04c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:54.116602 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ad87a18e-0be2-4443-a1d6-b52810c46723 req-4353a9b0-6415-4572-b1e4-934dfb6dd04c service nova] Creating event network-changed:58978e7e-fb52-402a-89c5-1b413c994c8f for instance b94e481f-3211-43eb-8f31-8a7719d6fc96 on n-h2-853611-3 Aug 18 12:50:54.121546 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ad87a18e-0be2-4443-a1d6-b52810c46723 req-4353a9b0-6415-4572-b1e4-934dfb6dd04c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032349 Aug 18 12:50:54.122162 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4627/7281] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:50:54.127193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7882064f-bad9-4127-81be-01500146e2e4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:54.127901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7882064f-bad9-4127-81be-01500146e2e4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:54.134493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7882064f-bad9-4127-81be-01500146e2e4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:54.135003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7882064f-bad9-4127-81be-01500146e2e4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:54.135454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7882064f-bad9-4127-81be-01500146e2e4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:54.136167 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7882064f-bad9-4127-81be-01500146e2e4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:54.136636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7882064f-bad9-4127-81be-01500146e2e4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:54.137078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7882064f-bad9-4127-81be-01500146e2e4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:54.283406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7882064f-bad9-4127-81be-01500146e2e4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:54.292534 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7882064f-bad9-4127-81be-01500146e2e4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1689 microversion: 2.1 time: 0.169155 Aug 18 12:50:54.293118 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4628/7282] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:54 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:50:55.315243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-06bd8860-536c-4e9d-9d4d-82ad1934e413 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:55.315925 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-06bd8860-536c-4e9d-9d4d-82ad1934e413 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:55.322883 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06bd8860-536c-4e9d-9d4d-82ad1934e413 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:55.323385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06bd8860-536c-4e9d-9d4d-82ad1934e413 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:55.323844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06bd8860-536c-4e9d-9d4d-82ad1934e413 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:55.324554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06bd8860-536c-4e9d-9d4d-82ad1934e413 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:55.325026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06bd8860-536c-4e9d-9d4d-82ad1934e413 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:55.325471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-06bd8860-536c-4e9d-9d4d-82ad1934e413 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:55.496210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-06bd8860-536c-4e9d-9d4d-82ad1934e413 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:55.504098 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-06bd8860-536c-4e9d-9d4d-82ad1934e413 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1689 microversion: 2.1 time: 0.192793 Aug 18 12:50:55.505435 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4629/7283] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:55 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1689 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:50:56.141040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-d6fb54c3-3894-4b1e-8254-91a1e25ef184 req-9816da78-0e47-42a9-af8f-d886bd14ca67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94e481f-3211-43eb-8f31-8a7719d6fc96", "name": "network-vif-deleted", "tag": "58978e7e-fb52-402a-89c5-1b413c994c8f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:50:56.153701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d6fb54c3-3894-4b1e-8254-91a1e25ef184 req-9816da78-0e47-42a9-af8f-d886bd14ca67 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:56.154188 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d6fb54c3-3894-4b1e-8254-91a1e25ef184 req-9816da78-0e47-42a9-af8f-d886bd14ca67 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:56.154806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-d6fb54c3-3894-4b1e-8254-91a1e25ef184 req-9816da78-0e47-42a9-af8f-d886bd14ca67 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:56.168824 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-d6fb54c3-3894-4b1e-8254-91a1e25ef184 req-9816da78-0e47-42a9-af8f-d886bd14ca67 service nova] Creating event network-vif-deleted:58978e7e-fb52-402a-89c5-1b413c994c8f for instance b94e481f-3211-43eb-8f31-8a7719d6fc96 on n-h2-853611-3 Aug 18 12:50:56.175423 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-d6fb54c3-3894-4b1e-8254-91a1e25ef184 req-9816da78-0e47-42a9-af8f-d886bd14ca67 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038387 Aug 18 12:50:56.176018 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4630/7284] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:50:56.531375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-740305b8-eaac-470d-9e1e-8deb68337687 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:56.532193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-740305b8-eaac-470d-9e1e-8deb68337687 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:56.553567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-740305b8-eaac-470d-9e1e-8deb68337687 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:56.554072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-740305b8-eaac-470d-9e1e-8deb68337687 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:56.554553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-740305b8-eaac-470d-9e1e-8deb68337687 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:56.557432 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-740305b8-eaac-470d-9e1e-8deb68337687 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:56.557920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-740305b8-eaac-470d-9e1e-8deb68337687 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:56.558372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-740305b8-eaac-470d-9e1e-8deb68337687 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:56.597556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-740305b8-eaac-470d-9e1e-8deb68337687 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:56.598342 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-740305b8-eaac-470d-9e1e-8deb68337687 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:56.599493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-740305b8-eaac-470d-9e1e-8deb68337687 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:56.600324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-740305b8-eaac-470d-9e1e-8deb68337687 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lazy-loading 'fault' on Instance uuid b94e481f-3211-43eb-8f31-8a7719d6fc96 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:50:56.651857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-740305b8-eaac-470d-9e1e-8deb68337687 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:50:56.660229 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-740305b8-eaac-470d-9e1e-8deb68337687 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 200 len: 1356 microversion: 2.1 time: 0.136465 Aug 18 12:50:56.660845 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4631/7285] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:56 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 1356 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:50:57.683485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-516464d2-eac7-4abe-96ff-c7c65e580f5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:50:57.684379 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-516464d2-eac7-4abe-96ff-c7c65e580f5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: b94e481f-3211-43eb-8f31-8a7719d6fc96] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:50:57.691931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-516464d2-eac7-4abe-96ff-c7c65e580f5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:57.692584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-516464d2-eac7-4abe-96ff-c7c65e580f5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:57.693575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-516464d2-eac7-4abe-96ff-c7c65e580f5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:57.694306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-516464d2-eac7-4abe-96ff-c7c65e580f5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:50:57.694953 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-516464d2-eac7-4abe-96ff-c7c65e580f5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:50:57.695402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-516464d2-eac7-4abe-96ff-c7c65e580f5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:50:57.710391 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-516464d2-eac7-4abe-96ff-c7c65e580f5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] HTTP exception thrown: Instance b94e481f-3211-43eb-8f31-8a7719d6fc96 could not be found. Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-516464d2-eac7-4abe-96ff-c7c65e580f5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Request method failure captured: Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 HTTP/1.1 Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jQeQZPOFUsCvPq9KJ45C83hU_4PBqTwbXRk1jzU3ZGP69rWq4GCsfSstUtl_fGSuFj9IIScCSANx3NuCkMMOA9dHVMwOwl_vghoFlSI0Mp5C2A5UMmer5lfR-ujm4tsvONIGKbYuCFqRFqUS-ZdywsiNZI2ndTb8o6EwBql0c3GNVE Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 0f1aa7dfe3f74f5ab3b45373c1a17574 Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 0f1aa7dfe3f74f5ab3b45373c1a17574 Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestNetworkAdvancedServerOps-1530263574-project Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 064db809a9034ebc85b986c87d0036d1 Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1530263574-project Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance b94e481f-3211-43eb-8f31-8a7719d6fc96 could not be found. Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'b94e481f-3211-43eb-8f31-8a7719d6fc96'} Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b94e481f-3211-43eb-8f31-8a7719d6fc96 could not be found. Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b94e481f-3211-43eb-8f31-8a7719d6fc96 could not be found. Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:50:57.712126 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:50:57.716481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:50:57.716481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:50:57.716481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:50:57.716481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:50:57.716481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:50:57.716481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:50:57.716481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b94e481f-3211-43eb-8f31-8a7719d6fc96 could not be found. Aug 18 12:50:57.716481 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:50:57.716481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-516464d2-eac7-4abe-96ff-c7c65e580f5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Returning 404 to user: Instance b94e481f-3211-43eb-8f31-8a7719d6fc96 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:50:57.716481 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-516464d2-eac7-4abe-96ff-c7c65e580f5a tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96" status: 404 len: 111 microversion: 2.1 time: 0.034271 Aug 18 12:50:57.716481 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4632/7286] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:50:57 2022] GET /compute/v2.1/servers/b94e481f-3211-43eb-8f31-8a7719d6fc96 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:51:01.682017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7d3caa27-f63e-4020-a531-c9c1d01629fc tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '.version_select at 0x7f51b0dc3700>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:01.716329 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7d3caa27-f63e-4020-a531-c9c1d01629fc tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1787826261" status: 202 len: 0 microversion: 2.1 time: 0.040138 Aug 18 12:51:01.717085 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4633/7287] 10.222.0.73 () {58 vars in 1284 bytes} [Thu Aug 18 12:51:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1787826261 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:51:01.753653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-37baf57c-55ac-4ec3-935e-1dfb0bdf53f1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'create', calling method: .version_select at 0x7f519ee12820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-441532186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuKUzpaERsAaS4Md4SEgopp1ii4ptMy1pXQ3fBpjdJvWLs+dJtKU1doC0wIaxIxMyGK44j1GWAU6UIqtMHQZOxV4GpcVPnJeaK6cKvK7Yfqd+TYa3vcRQQq1rLP2yAd8w=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:51:01.780848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-37baf57c-55ac-4ec3-935e-1dfb0bdf53f1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:51:01.787193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-37baf57c-55ac-4ec3-935e-1dfb0bdf53f1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for user 064db809a9034ebc85b986c87d0036d1 and project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:51:01.813013 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-37baf57c-55ac-4ec3-935e-1dfb0bdf53f1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.063292 Aug 18 12:51:01.813627 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4634/7288] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:51:01 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:51:08.420208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1774730665", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "networks": [{"uuid": "9c61f01e-26ce-4304-bb32-655fbac00107"}], "key_name": "tempest-TestNetworkAdvancedServerOps-441532186", "security_groups": [{"name": "tempest-secgroup-smoke-1656062954"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:51:08.431980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:51:08.568776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] validate_networks() for [('9c61f01e-26ce-4304-bb32-655fbac00107', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:51:09.124081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:51:09.128131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:51:09.129349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:51:09.130757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:51:09.131443 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:51:09.145186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:09.147368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:09.150840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:09.151927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:09.152688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:09.153372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:09.179466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:51:09.188687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Getting quotas for user 064db809a9034ebc85b986c87d0036d1 and project 0f1aa7dfe3f74f5ab3b45373c1a17574. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:51:09.205814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:51:09.211686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:51:09.266580 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ba6cb302-f55d-455f-8348-3a1ba1778899 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.854087 Aug 18 12:51:09.270524 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4635/7289] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:51:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:51:09.285849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cc8533d8-2b56-465c-9133-b4577559f888 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:09.289283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cc8533d8-2b56-465c-9133-b4577559f888 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:09.372229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cc8533d8-2b56-465c-9133-b4577559f888 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:09.383270 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cc8533d8-2b56-465c-9133-b4577559f888 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1266 microversion: 2.1 time: 0.106927 Aug 18 12:51:09.383882 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4636/7290] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:09 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:51:10.406837 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a2ccf175-13e3-472d-83b3-c9ad5fe56da4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:10.413126 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a2ccf175-13e3-472d-83b3-c9ad5fe56da4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:10.453333 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2ccf175-13e3-472d-83b3-c9ad5fe56da4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:10.464478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2ccf175-13e3-472d-83b3-c9ad5fe56da4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:10.465080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2ccf175-13e3-472d-83b3-c9ad5fe56da4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:10.465990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2ccf175-13e3-472d-83b3-c9ad5fe56da4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:10.466601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2ccf175-13e3-472d-83b3-c9ad5fe56da4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:10.467401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2ccf175-13e3-472d-83b3-c9ad5fe56da4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:10.566810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a2ccf175-13e3-472d-83b3-c9ad5fe56da4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:10.576444 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a2ccf175-13e3-472d-83b3-c9ad5fe56da4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1318 microversion: 2.1 time: 0.173635 Aug 18 12:51:10.577188 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4637/7291] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:10 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:51:11.600766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-07fa2ce6-826d-44c8-a08b-bb60d09c48b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:11.601479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-07fa2ce6-826d-44c8-a08b-bb60d09c48b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:11.609154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07fa2ce6-826d-44c8-a08b-bb60d09c48b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:11.609670 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07fa2ce6-826d-44c8-a08b-bb60d09c48b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:11.610396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07fa2ce6-826d-44c8-a08b-bb60d09c48b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:11.611363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07fa2ce6-826d-44c8-a08b-bb60d09c48b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:11.611878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07fa2ce6-826d-44c8-a08b-bb60d09c48b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:11.612331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07fa2ce6-826d-44c8-a08b-bb60d09c48b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:11.728857 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-07fa2ce6-826d-44c8-a08b-bb60d09c48b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:11.741252 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-07fa2ce6-826d-44c8-a08b-bb60d09c48b2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1324 microversion: 2.1 time: 0.144656 Aug 18 12:51:11.743211 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4638/7292] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:11 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1324 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:51:12.766673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ced2e9e7-bf2c-4e41-9122-b3e1c3795aac req-11136a69-9229-43bf-91a2-64c99e46141c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6269b7d8-c0f2-462c-9171-4315b6ba33a1", "tag": "7cfadf3e-433f-40b4-b430-82e2dbb90460"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:51:12.779494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ced2e9e7-bf2c-4e41-9122-b3e1c3795aac req-11136a69-9229-43bf-91a2-64c99e46141c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:12.780481 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ced2e9e7-bf2c-4e41-9122-b3e1c3795aac req-11136a69-9229-43bf-91a2-64c99e46141c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:12.781053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ced2e9e7-bf2c-4e41-9122-b3e1c3795aac req-11136a69-9229-43bf-91a2-64c99e46141c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:12.796616 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ced2e9e7-bf2c-4e41-9122-b3e1c3795aac req-11136a69-9229-43bf-91a2-64c99e46141c service nova] Creating event network-changed:7cfadf3e-433f-40b4-b430-82e2dbb90460 for instance 6269b7d8-c0f2-462c-9171-4315b6ba33a1 on n-h2-853611-3 Aug 18 12:51:12.802364 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ced2e9e7-bf2c-4e41-9122-b3e1c3795aac req-11136a69-9229-43bf-91a2-64c99e46141c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043690 Aug 18 12:51:12.803223 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4639/7293] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:51:12.808648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7de56f14-fe47-4596-acd1-5bebcb95b204 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:12.809389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7de56f14-fe47-4596-acd1-5bebcb95b204 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:12.816543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7de56f14-fe47-4596-acd1-5bebcb95b204 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:12.817184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7de56f14-fe47-4596-acd1-5bebcb95b204 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:12.818216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7de56f14-fe47-4596-acd1-5bebcb95b204 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:12.819119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7de56f14-fe47-4596-acd1-5bebcb95b204 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:12.819676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7de56f14-fe47-4596-acd1-5bebcb95b204 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:12.820209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7de56f14-fe47-4596-acd1-5bebcb95b204 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:12.994358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7de56f14-fe47-4596-acd1-5bebcb95b204 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:13.007692 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7de56f14-fe47-4596-acd1-5bebcb95b204 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1392 microversion: 2.1 time: 0.203096 Aug 18 12:51:13.009090 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4640/7294] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:12 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1392 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:51:14.029466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b1f30fa5-b132-4d81-8630-57b9e589be51 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:14.030169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b1f30fa5-b132-4d81-8630-57b9e589be51 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:14.038191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1f30fa5-b132-4d81-8630-57b9e589be51 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:14.038764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1f30fa5-b132-4d81-8630-57b9e589be51 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:14.039202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1f30fa5-b132-4d81-8630-57b9e589be51 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:14.039944 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1f30fa5-b132-4d81-8630-57b9e589be51 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:14.040416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1f30fa5-b132-4d81-8630-57b9e589be51 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:14.040860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1f30fa5-b132-4d81-8630-57b9e589be51 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:14.197249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b1f30fa5-b132-4d81-8630-57b9e589be51 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:14.209241 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b1f30fa5-b132-4d81-8630-57b9e589be51 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1392 microversion: 2.1 time: 0.182702 Aug 18 12:51:14.210605 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4641/7295] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:14 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:51:15.243069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-98db26d4-dce0-475e-a60a-c29a258b83b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:15.243929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-98db26d4-dce0-475e-a60a-c29a258b83b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:15.251204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98db26d4-dce0-475e-a60a-c29a258b83b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:15.251710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98db26d4-dce0-475e-a60a-c29a258b83b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:15.252154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98db26d4-dce0-475e-a60a-c29a258b83b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:15.252889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98db26d4-dce0-475e-a60a-c29a258b83b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:15.253352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98db26d4-dce0-475e-a60a-c29a258b83b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:15.253791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-98db26d4-dce0-475e-a60a-c29a258b83b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:15.416268 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-98db26d4-dce0-475e-a60a-c29a258b83b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:15.426142 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-98db26d4-dce0-475e-a60a-c29a258b83b1 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1392 microversion: 2.1 time: 0.187381 Aug 18 12:51:15.427267 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4642/7296] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:15 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:51:16.452821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a51b8154-e6cb-4e95-a6db-edb1c1455c84 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:16.453770 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a51b8154-e6cb-4e95-a6db-edb1c1455c84 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:16.462833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51b8154-e6cb-4e95-a6db-edb1c1455c84 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:16.463634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51b8154-e6cb-4e95-a6db-edb1c1455c84 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:16.464455 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51b8154-e6cb-4e95-a6db-edb1c1455c84 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:16.465773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51b8154-e6cb-4e95-a6db-edb1c1455c84 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:16.466579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51b8154-e6cb-4e95-a6db-edb1c1455c84 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:16.467817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a51b8154-e6cb-4e95-a6db-edb1c1455c84 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:16.671874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a51b8154-e6cb-4e95-a6db-edb1c1455c84 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:16.685003 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a51b8154-e6cb-4e95-a6db-edb1c1455c84 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1392 microversion: 2.1 time: 0.239485 Aug 18 12:51:16.685622 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4643/7297] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:16 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:51:17.707716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5f870fb4-4d4b-479c-81b5-11c878c7f4b4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:17.708966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5f870fb4-4d4b-479c-81b5-11c878c7f4b4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:17.712135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:51:17.718162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f870fb4-4d4b-479c-81b5-11c878c7f4b4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:17.718707 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f870fb4-4d4b-479c-81b5-11c878c7f4b4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:17.719163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f870fb4-4d4b-479c-81b5-11c878c7f4b4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:17.719901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f870fb4-4d4b-479c-81b5-11c878c7f4b4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:17.720398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f870fb4-4d4b-479c-81b5-11c878c7f4b4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:17.720823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5f870fb4-4d4b-479c-81b5-11c878c7f4b4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:17.893804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5f870fb4-4d4b-479c-81b5-11c878c7f4b4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:17.902855 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5f870fb4-4d4b-479c-81b5-11c878c7f4b4 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1392 microversion: 2.1 time: 0.199385 Aug 18 12:51:17.903487 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4644/7298] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:17 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1392 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:51:18.517540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7cd3a4f2-7156-4162-86f8-1231f1c0269d req-9868ad60-92c7-4302-b820-58e5cda316a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6269b7d8-c0f2-462c-9171-4315b6ba33a1", "name": "network-vif-plugged", "status": "completed", "tag": "7cfadf3e-433f-40b4-b430-82e2dbb90460"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:51:18.529458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7cd3a4f2-7156-4162-86f8-1231f1c0269d req-9868ad60-92c7-4302-b820-58e5cda316a3 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:18.529907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7cd3a4f2-7156-4162-86f8-1231f1c0269d req-9868ad60-92c7-4302-b820-58e5cda316a3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:18.530843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7cd3a4f2-7156-4162-86f8-1231f1c0269d req-9868ad60-92c7-4302-b820-58e5cda316a3 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:18.544827 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7cd3a4f2-7156-4162-86f8-1231f1c0269d req-9868ad60-92c7-4302-b820-58e5cda316a3 service nova] Creating event network-vif-plugged:7cfadf3e-433f-40b4-b430-82e2dbb90460 for instance 6269b7d8-c0f2-462c-9171-4315b6ba33a1 on n-h2-853611-3 Aug 18 12:51:18.552774 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7cd3a4f2-7156-4162-86f8-1231f1c0269d req-9868ad60-92c7-4302-b820-58e5cda316a3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038990 Aug 18 12:51:18.553916 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4645/7299] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:51:18.926209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b126d53c-4926-4a1f-9cec-da03ef102889 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:18.926996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b126d53c-4926-4a1f-9cec-da03ef102889 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:18.934630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b126d53c-4926-4a1f-9cec-da03ef102889 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:18.935140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b126d53c-4926-4a1f-9cec-da03ef102889 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:18.935586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b126d53c-4926-4a1f-9cec-da03ef102889 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:18.936320 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b126d53c-4926-4a1f-9cec-da03ef102889 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:18.936786 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b126d53c-4926-4a1f-9cec-da03ef102889 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:18.937219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b126d53c-4926-4a1f-9cec-da03ef102889 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:19.092202 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b126d53c-4926-4a1f-9cec-da03ef102889 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:19.103028 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b126d53c-4926-4a1f-9cec-da03ef102889 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1392 microversion: 2.1 time: 0.181920 Aug 18 12:51:19.103720 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4646/7300] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:18 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:51:20.127179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-035d6833-98fb-46e0-bdfb-f46b18871bda tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:20.127934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-035d6833-98fb-46e0-bdfb-f46b18871bda tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:20.130048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:51:20.130879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:51:20.140567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-035d6833-98fb-46e0-bdfb-f46b18871bda tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:20.141486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-035d6833-98fb-46e0-bdfb-f46b18871bda tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:20.142081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-035d6833-98fb-46e0-bdfb-f46b18871bda tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:20.143072 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-035d6833-98fb-46e0-bdfb-f46b18871bda tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:20.143723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-035d6833-98fb-46e0-bdfb-f46b18871bda tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:20.144279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-035d6833-98fb-46e0-bdfb-f46b18871bda tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:20.331979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-035d6833-98fb-46e0-bdfb-f46b18871bda tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:20.343295 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-035d6833-98fb-46e0-bdfb-f46b18871bda tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1565 microversion: 2.1 time: 0.219976 Aug 18 12:51:20.343889 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4647/7301] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:20 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1565 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:51:20.364221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e745a9ff-5401-42c9-bd6c-d51d36d9d02f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:20.364912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e745a9ff-5401-42c9-bd6c-d51d36d9d02f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:20.371528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e745a9ff-5401-42c9-bd6c-d51d36d9d02f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:20.372038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e745a9ff-5401-42c9-bd6c-d51d36d9d02f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:20.372493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e745a9ff-5401-42c9-bd6c-d51d36d9d02f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:20.373238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e745a9ff-5401-42c9-bd6c-d51d36d9d02f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:20.373712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e745a9ff-5401-42c9-bd6c-d51d36d9d02f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:20.374160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e745a9ff-5401-42c9-bd6c-d51d36d9d02f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:20.527876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e745a9ff-5401-42c9-bd6c-d51d36d9d02f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:20.536960 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e745a9ff-5401-42c9-bd6c-d51d36d9d02f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1565 microversion: 2.1 time: 0.175971 Aug 18 12:51:20.538014 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4648/7302] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:20 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:51:22.821261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-50d30d09-f2ae-49e6-9e8d-5be80247822d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:22.822323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-50d30d09-f2ae-49e6-9e8d-5be80247822d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:22.832713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50d30d09-f2ae-49e6-9e8d-5be80247822d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:22.834103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50d30d09-f2ae-49e6-9e8d-5be80247822d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:22.835000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50d30d09-f2ae-49e6-9e8d-5be80247822d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:22.836221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50d30d09-f2ae-49e6-9e8d-5be80247822d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:22.836850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50d30d09-f2ae-49e6-9e8d-5be80247822d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:22.837348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50d30d09-f2ae-49e6-9e8d-5be80247822d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:23.025057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-50d30d09-f2ae-49e6-9e8d-5be80247822d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:23.034722 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-50d30d09-f2ae-49e6-9e8d-5be80247822d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1565 microversion: 2.1 time: 0.221777 Aug 18 12:51:23.035606 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4649/7303] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:22 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1565 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:51:23.040985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9b6a7de0-d783-41c0-8fc9-813e7d86c243 req-85facf4e-2609-4911-bd08-c15f921d50ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6269b7d8-c0f2-462c-9171-4315b6ba33a1", "tag": "7cfadf3e-433f-40b4-b430-82e2dbb90460"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:51:23.055539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9b6a7de0-d783-41c0-8fc9-813e7d86c243 req-85facf4e-2609-4911-bd08-c15f921d50ec service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:23.056046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9b6a7de0-d783-41c0-8fc9-813e7d86c243 req-85facf4e-2609-4911-bd08-c15f921d50ec service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:23.056504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9b6a7de0-d783-41c0-8fc9-813e7d86c243 req-85facf4e-2609-4911-bd08-c15f921d50ec service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:23.072742 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9b6a7de0-d783-41c0-8fc9-813e7d86c243 req-85facf4e-2609-4911-bd08-c15f921d50ec service nova] Creating event network-changed:7cfadf3e-433f-40b4-b430-82e2dbb90460 for instance 6269b7d8-c0f2-462c-9171-4315b6ba33a1 on n-h2-853611-3 Aug 18 12:51:23.082290 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9b6a7de0-d783-41c0-8fc9-813e7d86c243 req-85facf4e-2609-4911-bd08-c15f921d50ec service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045172 Aug 18 12:51:23.084194 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4650/7304] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:51:40.233049 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:51:40.233690 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:51:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:51:45.440465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=13 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:51:45.441227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=74 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:51:45.446215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-03d972ad-3559-48e7-8a2b-ff70d15f6669 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:51:45.448510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-03d972ad-3559-48e7-8a2b-ff70d15f6669 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:45.455579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03d972ad-3559-48e7-8a2b-ff70d15f6669 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:45.456079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03d972ad-3559-48e7-8a2b-ff70d15f6669 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:45.456528 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03d972ad-3559-48e7-8a2b-ff70d15f6669 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:45.457240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03d972ad-3559-48e7-8a2b-ff70d15f6669 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:45.457711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03d972ad-3559-48e7-8a2b-ff70d15f6669 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:45.458154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-03d972ad-3559-48e7-8a2b-ff70d15f6669 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:45.511732 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-03d972ad-3559-48e7-8a2b-ff70d15f6669 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1/action" status: 200 len: 24566 microversion: 2.1 time: 0.073094 Aug 18 12:51:45.512394 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4651/7305] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:51:45 2022] POST /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1/action => generated 24566 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:51:51.971120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a2b5d7d8-8717-4e71-8146-aa15165d7079 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:51:51.971851 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a2b5d7d8-8717-4e71-8146-aa15165d7079 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:51.980646 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2b5d7d8-8717-4e71-8146-aa15165d7079 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:51.981150 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2b5d7d8-8717-4e71-8146-aa15165d7079 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:51.981601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2b5d7d8-8717-4e71-8146-aa15165d7079 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:51.982371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2b5d7d8-8717-4e71-8146-aa15165d7079 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:51.982863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2b5d7d8-8717-4e71-8146-aa15165d7079 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:51.983311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2b5d7d8-8717-4e71-8146-aa15165d7079 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:52.009595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-a2b5d7d8-8717-4e71-8146-aa15165d7079 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lazy-loading 'flavor' on Instance uuid 6269b7d8-c0f2-462c-9171-4315b6ba33a1 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:51:52.092776 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a2b5d7d8-8717-4e71-8146-aa15165d7079 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1/action" status: 202 len: 0 microversion: 2.1 time: 0.125746 Aug 18 12:51:52.094091 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4652/7306] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:51:51 2022] POST /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:51:52.107382 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08e1e96c-6c2e-4d86-a99c-0a2a6b9a84e7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:52.108178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-08e1e96c-6c2e-4d86-a99c-0a2a6b9a84e7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:52.115569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e1e96c-6c2e-4d86-a99c-0a2a6b9a84e7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:52.116127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e1e96c-6c2e-4d86-a99c-0a2a6b9a84e7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:52.116715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e1e96c-6c2e-4d86-a99c-0a2a6b9a84e7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:52.118854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e1e96c-6c2e-4d86-a99c-0a2a6b9a84e7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:52.120231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e1e96c-6c2e-4d86-a99c-0a2a6b9a84e7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:52.120231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e1e96c-6c2e-4d86-a99c-0a2a6b9a84e7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:52.291094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-08e1e96c-6c2e-4d86-a99c-0a2a6b9a84e7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:52.299070 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-08e1e96c-6c2e-4d86-a99c-0a2a6b9a84e7 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1691 microversion: 2.1 time: 0.198922 Aug 18 12:51:52.299675 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4653/7307] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:52 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1691 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:51:53.322462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-79ba72c1-fba8-48b8-abf9-5ff91a56bd3d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:53.323192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-79ba72c1-fba8-48b8-abf9-5ff91a56bd3d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:53.331034 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79ba72c1-fba8-48b8-abf9-5ff91a56bd3d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:53.331303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79ba72c1-fba8-48b8-abf9-5ff91a56bd3d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:53.331680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79ba72c1-fba8-48b8-abf9-5ff91a56bd3d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:53.332420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79ba72c1-fba8-48b8-abf9-5ff91a56bd3d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:53.332898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79ba72c1-fba8-48b8-abf9-5ff91a56bd3d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:53.333350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-79ba72c1-fba8-48b8-abf9-5ff91a56bd3d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:53.487190 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-79ba72c1-fba8-48b8-abf9-5ff91a56bd3d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:53.496538 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-79ba72c1-fba8-48b8-abf9-5ff91a56bd3d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1674 microversion: 2.1 time: 0.178281 Aug 18 12:51:53.497148 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4654/7308] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:53 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:51:54.597641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-595123c9-4e48-4f89-bae1-de8be48b02b0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:51:54.599906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-595123c9-4e48-4f89-bae1-de8be48b02b0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:54.607116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-595123c9-4e48-4f89-bae1-de8be48b02b0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:54.607612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-595123c9-4e48-4f89-bae1-de8be48b02b0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:54.608061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-595123c9-4e48-4f89-bae1-de8be48b02b0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:54.608774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-595123c9-4e48-4f89-bae1-de8be48b02b0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:54.609248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-595123c9-4e48-4f89-bae1-de8be48b02b0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:54.609685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-595123c9-4e48-4f89-bae1-de8be48b02b0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:54.661738 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-595123c9-4e48-4f89-bae1-de8be48b02b0 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1/action" status: 200 len: 36571 microversion: 2.1 time: 0.068008 Aug 18 12:51:54.662396 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4655/7309] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:51:54 2022] POST /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1/action => generated 36571 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 12:51:54.675568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5bc5e972-bc9b-4650-95d0-efe7fc17f1d2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:51:54.676192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5bc5e972-bc9b-4650-95d0-efe7fc17f1d2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:54.683968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bc5e972-bc9b-4650-95d0-efe7fc17f1d2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:54.684480 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bc5e972-bc9b-4650-95d0-efe7fc17f1d2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:54.684918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bc5e972-bc9b-4650-95d0-efe7fc17f1d2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:54.685632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bc5e972-bc9b-4650-95d0-efe7fc17f1d2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:54.686103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bc5e972-bc9b-4650-95d0-efe7fc17f1d2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:54.687025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bc5e972-bc9b-4650-95d0-efe7fc17f1d2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:54.757304 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5bc5e972-bc9b-4650-95d0-efe7fc17f1d2 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1/action" status: 202 len: 0 microversion: 2.1 time: 0.085743 Aug 18 12:51:54.760365 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4656/7310] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:51:54 2022] POST /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:51:54.769518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-22b2fb0f-e8b7-49bf-9e45-7cbee107d37e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:54.770241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-22b2fb0f-e8b7-49bf-9e45-7cbee107d37e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:54.777465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22b2fb0f-e8b7-49bf-9e45-7cbee107d37e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:54.777980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22b2fb0f-e8b7-49bf-9e45-7cbee107d37e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:54.778456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22b2fb0f-e8b7-49bf-9e45-7cbee107d37e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:54.779200 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22b2fb0f-e8b7-49bf-9e45-7cbee107d37e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:54.779679 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22b2fb0f-e8b7-49bf-9e45-7cbee107d37e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:54.780134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-22b2fb0f-e8b7-49bf-9e45-7cbee107d37e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:54.925600 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-22b2fb0f-e8b7-49bf-9e45-7cbee107d37e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:54.934945 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-22b2fb0f-e8b7-49bf-9e45-7cbee107d37e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1680 microversion: 2.1 time: 0.170236 Aug 18 12:51:54.935551 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4657/7311] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:54 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:51:55.958502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fe30cee4-c93a-4c22-ab99-08071f206855 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:55.959186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fe30cee4-c93a-4c22-ab99-08071f206855 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:55.967178 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe30cee4-c93a-4c22-ab99-08071f206855 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:55.967676 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe30cee4-c93a-4c22-ab99-08071f206855 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:55.968289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe30cee4-c93a-4c22-ab99-08071f206855 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:55.969104 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe30cee4-c93a-4c22-ab99-08071f206855 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:55.969608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe30cee4-c93a-4c22-ab99-08071f206855 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:55.970055 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe30cee4-c93a-4c22-ab99-08071f206855 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:56.138946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fe30cee4-c93a-4c22-ab99-08071f206855 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:56.147424 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fe30cee4-c93a-4c22-ab99-08071f206855 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1680 microversion: 2.1 time: 0.193002 Aug 18 12:51:56.148026 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4658/7312] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:55 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:51:56.808304 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:51:56.808965 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:51:57.171516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8b49b049-e70c-4e56-b6f2-43b6d8615f8f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:57.172329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8b49b049-e70c-4e56-b6f2-43b6d8615f8f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:57.180661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b49b049-e70c-4e56-b6f2-43b6d8615f8f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:57.181065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b49b049-e70c-4e56-b6f2-43b6d8615f8f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:57.181526 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b49b049-e70c-4e56-b6f2-43b6d8615f8f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:57.182247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b49b049-e70c-4e56-b6f2-43b6d8615f8f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:57.182752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b49b049-e70c-4e56-b6f2-43b6d8615f8f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:57.183195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8b49b049-e70c-4e56-b6f2-43b6d8615f8f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:57.334210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8b49b049-e70c-4e56-b6f2-43b6d8615f8f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:57.342853 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8b49b049-e70c-4e56-b6f2-43b6d8615f8f tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1683 microversion: 2.1 time: 0.175385 Aug 18 12:51:57.343454 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4659/7313] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:57 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:51:57.441319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a597a5c5-2f11-45ac-b2d8-0da4dde459aa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:51:57.443544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a597a5c5-2f11-45ac-b2d8-0da4dde459aa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:57.450211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a597a5c5-2f11-45ac-b2d8-0da4dde459aa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:57.450750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a597a5c5-2f11-45ac-b2d8-0da4dde459aa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:57.451208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a597a5c5-2f11-45ac-b2d8-0da4dde459aa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:57.451933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a597a5c5-2f11-45ac-b2d8-0da4dde459aa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:57.452408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a597a5c5-2f11-45ac-b2d8-0da4dde459aa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:57.452849 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a597a5c5-2f11-45ac-b2d8-0da4dde459aa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:57.502412 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a597a5c5-2f11-45ac-b2d8-0da4dde459aa tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "POST /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1/action" status: 200 len: 36571 microversion: 2.1 time: 0.064830 Aug 18 12:51:57.503106 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4660/7314] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:51:57 2022] POST /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1/action => generated 36571 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 12:51:58.752487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-36400347-88f5-4482-97ca-af74e22dd49e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:58.753199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-36400347-88f5-4482-97ca-af74e22dd49e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:58.762627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36400347-88f5-4482-97ca-af74e22dd49e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:58.763143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36400347-88f5-4482-97ca-af74e22dd49e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:58.763599 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36400347-88f5-4482-97ca-af74e22dd49e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:58.764360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36400347-88f5-4482-97ca-af74e22dd49e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:58.764828 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36400347-88f5-4482-97ca-af74e22dd49e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:58.765273 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36400347-88f5-4482-97ca-af74e22dd49e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:58.794802 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-36400347-88f5-4482-97ca-af74e22dd49e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:51:58.885224 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-36400347-88f5-4482-97ca-af74e22dd49e tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 204 len: 0 microversion: 2.1 time: 0.136939 Aug 18 12:51:58.885607 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4661/7315] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:51:58 2022] DELETE /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 12:51:58.897022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5c48baed-896d-42b8-90c3-e08d5e80c79c req-31e93cf1-7989-44f7-a78a-1d027d5738aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6269b7d8-c0f2-462c-9171-4315b6ba33a1", "tag": "7cfadf3e-433f-40b4-b430-82e2dbb90460"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:51:58.909464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c48baed-896d-42b8-90c3-e08d5e80c79c req-31e93cf1-7989-44f7-a78a-1d027d5738aa service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:58.910023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c48baed-896d-42b8-90c3-e08d5e80c79c req-31e93cf1-7989-44f7-a78a-1d027d5738aa service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:58.910765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5c48baed-896d-42b8-90c3-e08d5e80c79c req-31e93cf1-7989-44f7-a78a-1d027d5738aa service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:58.923288 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5c48baed-896d-42b8-90c3-e08d5e80c79c req-31e93cf1-7989-44f7-a78a-1d027d5738aa service nova] Creating event network-changed:7cfadf3e-433f-40b4-b430-82e2dbb90460 for instance 6269b7d8-c0f2-462c-9171-4315b6ba33a1 on n-h2-853611-3 Aug 18 12:51:58.928534 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5c48baed-896d-42b8-90c3-e08d5e80c79c req-31e93cf1-7989-44f7-a78a-1d027d5738aa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041158 Aug 18 12:51:58.929152 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4662/7316] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:51:58.934584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-474b1103-99c0-47b8-97e0-d12670c05f70 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:51:58.935313 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-474b1103-99c0-47b8-97e0-d12670c05f70 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:51:58.941880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-474b1103-99c0-47b8-97e0-d12670c05f70 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:58.942383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-474b1103-99c0-47b8-97e0-d12670c05f70 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:58.942873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-474b1103-99c0-47b8-97e0-d12670c05f70 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:58.943784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-474b1103-99c0-47b8-97e0-d12670c05f70 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:51:58.944284 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-474b1103-99c0-47b8-97e0-d12670c05f70 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:51:58.944846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-474b1103-99c0-47b8-97e0-d12670c05f70 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:51:59.111934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-474b1103-99c0-47b8-97e0-d12670c05f70 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:51:59.120609 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-474b1103-99c0-47b8-97e0-d12670c05f70 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1689 microversion: 2.1 time: 0.190156 Aug 18 12:51:59.121202 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4663/7317] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:51:58 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:52:00.147354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1cdc856d-172b-400e-ac2e-da6a27292724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:00.148091 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1cdc856d-172b-400e-ac2e-da6a27292724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:00.156077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cdc856d-172b-400e-ac2e-da6a27292724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:00.156629 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cdc856d-172b-400e-ac2e-da6a27292724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:00.157118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cdc856d-172b-400e-ac2e-da6a27292724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:00.157961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cdc856d-172b-400e-ac2e-da6a27292724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:00.158506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cdc856d-172b-400e-ac2e-da6a27292724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:00.158994 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1cdc856d-172b-400e-ac2e-da6a27292724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:00.334495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1cdc856d-172b-400e-ac2e-da6a27292724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:52:00.340475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:52:00.347125 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1cdc856d-172b-400e-ac2e-da6a27292724 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1689 microversion: 2.1 time: 0.207730 Aug 18 12:52:00.348000 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4664/7318] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:00 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1689 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:52:01.042845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-711c5fe1-875e-44fe-802f-e679cd301840 req-f0fc8700-42aa-4b8c-87d7-1a56fcd5f419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6269b7d8-c0f2-462c-9171-4315b6ba33a1", "name": "network-vif-deleted", "tag": "7cfadf3e-433f-40b4-b430-82e2dbb90460"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:52:01.056401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-711c5fe1-875e-44fe-802f-e679cd301840 req-f0fc8700-42aa-4b8c-87d7-1a56fcd5f419 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:01.056910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-711c5fe1-875e-44fe-802f-e679cd301840 req-f0fc8700-42aa-4b8c-87d7-1a56fcd5f419 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:01.057354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-711c5fe1-875e-44fe-802f-e679cd301840 req-f0fc8700-42aa-4b8c-87d7-1a56fcd5f419 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:01.075167 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-711c5fe1-875e-44fe-802f-e679cd301840 req-f0fc8700-42aa-4b8c-87d7-1a56fcd5f419 service nova] Creating event network-vif-deleted:7cfadf3e-433f-40b4-b430-82e2dbb90460 for instance 6269b7d8-c0f2-462c-9171-4315b6ba33a1 on n-h2-853611-3 Aug 18 12:52:01.082126 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-711c5fe1-875e-44fe-802f-e679cd301840 req-f0fc8700-42aa-4b8c-87d7-1a56fcd5f419 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043938 Aug 18 12:52:01.082792 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4665/7319] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:52:01.373368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ae26ec7e-37f6-4458-8a78-e8324196c128 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:01.375211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ae26ec7e-37f6-4458-8a78-e8324196c128 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:01.381758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae26ec7e-37f6-4458-8a78-e8324196c128 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:01.382540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae26ec7e-37f6-4458-8a78-e8324196c128 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:01.384737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae26ec7e-37f6-4458-8a78-e8324196c128 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:01.385623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae26ec7e-37f6-4458-8a78-e8324196c128 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:01.386172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae26ec7e-37f6-4458-8a78-e8324196c128 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:01.386863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae26ec7e-37f6-4458-8a78-e8324196c128 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:01.428275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae26ec7e-37f6-4458-8a78-e8324196c128 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:01.428779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae26ec7e-37f6-4458-8a78-e8324196c128 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:01.429384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae26ec7e-37f6-4458-8a78-e8324196c128 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:01.430680 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-ae26ec7e-37f6-4458-8a78-e8324196c128 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lazy-loading 'fault' on Instance uuid 6269b7d8-c0f2-462c-9171-4315b6ba33a1 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:52:01.483900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ae26ec7e-37f6-4458-8a78-e8324196c128 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064db809a9034ebc85b986c87d0036d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f1aa7dfe3f74f5ab3b45373c1a17574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:52:01.493033 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ae26ec7e-37f6-4458-8a78-e8324196c128 tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 200 len: 1356 microversion: 2.1 time: 0.123691 Aug 18 12:52:01.495900 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4666/7320] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:01 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 1356 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:52:02.514615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08822d49-8295-43dd-8379-c719b5f9556b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:02.515331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-08822d49-8295-43dd-8379-c719b5f9556b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] [instance: 6269b7d8-c0f2-462c-9171-4315b6ba33a1] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:02.522325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08822d49-8295-43dd-8379-c719b5f9556b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:02.522845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08822d49-8295-43dd-8379-c719b5f9556b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:02.523976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08822d49-8295-43dd-8379-c719b5f9556b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:02.524689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08822d49-8295-43dd-8379-c719b5f9556b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:02.525155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08822d49-8295-43dd-8379-c719b5f9556b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:02.525672 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08822d49-8295-43dd-8379-c719b5f9556b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:02.539177 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-08822d49-8295-43dd-8379-c719b5f9556b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] HTTP exception thrown: Instance 6269b7d8-c0f2-462c-9171-4315b6ba33a1 could not be found. Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08822d49-8295-43dd-8379-c719b5f9556b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Request method failure captured: Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 HTTP/1.1 Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jQeQZPOFUsCvPq9KJ45C83hU_4PBqTwbXRk1jzU3ZGP69rWq4GCsfSstUtl_fGSuFj9IIScCSANx3NuCkMMOA9dHVMwOwl_vghoFlSI0Mp5C2A5UMmer5lfR-ujm4tsvONIGKbYuCFqRFqUS-ZdywsiNZI2ndTb8o6EwBql0c3GNVE Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 0f1aa7dfe3f74f5ab3b45373c1a17574 Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/0f1aa7dfe3f74f5ab3b45373c1a17574"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 0f1aa7dfe3f74f5ab3b45373c1a17574 Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1530263574 Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestNetworkAdvancedServerOps-1530263574-project Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 064db809a9034ebc85b986c87d0036d1 Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1530263574-project Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 6269b7d8-c0f2-462c-9171-4315b6ba33a1 could not be found. Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '6269b7d8-c0f2-462c-9171-4315b6ba33a1'} Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6269b7d8-c0f2-462c-9171-4315b6ba33a1 could not be found. Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6269b7d8-c0f2-462c-9171-4315b6ba33a1 could not be found. Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:52:02.540730 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:52:02.546576 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:52:02.546576 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:52:02.546576 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:52:02.546576 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:52:02.546576 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:52:02.546576 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:52:02.546576 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6269b7d8-c0f2-462c-9171-4315b6ba33a1 could not be found. Aug 18 12:52:02.546576 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:52:02.546576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08822d49-8295-43dd-8379-c719b5f9556b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Returning 404 to user: Instance 6269b7d8-c0f2-462c-9171-4315b6ba33a1 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:52:02.546576 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-08822d49-8295-43dd-8379-c719b5f9556b tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1" status: 404 len: 111 microversion: 2.1 time: 0.031453 Aug 18 12:52:02.546576 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4667/7321] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:02 2022] GET /compute/v2.1/servers/6269b7d8-c0f2-462c-9171-4315b6ba33a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:52:06.065312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f261a3f8-05d2-4505-80c7-105fcb9e964d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] Calling method '.version_select at 0x7f519c5c6e50>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:06.091155 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f261a3f8-05d2-4505-80c7-105fcb9e964d tempest-TestNetworkAdvancedServerOps-1530263574 tempest-TestNetworkAdvancedServerOps-1530263574-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-441532186" status: 202 len: 0 microversion: 2.1 time: 0.030491 Aug 18 12:52:06.095169 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4668/7322] 10.222.0.73 () {58 vars in 1281 bytes} [Thu Aug 18 12:52:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-441532186 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:52:17.815267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:52:17.816315 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:52:18.011978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c4dcd001-16c6-4915-9c7a-3d4a14e24589 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Action: 'create', calling method: .version_select at 0x7f519c5934c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1808770185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnsSDza7y7rGl3dgj+FaUGj1WLWcAPJ24l9Zuajc8rH2Gep3LQd+p5s0TNPLS41qQs3mfJQ1OWeLwVeqPybjx/me/WPXXxO6VoS7PO9EbLOLIWoUblYXe/WbueEDHcRAQ=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:52:18.031858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c4dcd001-16c6-4915-9c7a-3d4a14e24589 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Getting quotas for project 7d023eb3bcae40c5a9fc1459a886ef5c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:52:18.037787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-c4dcd001-16c6-4915-9c7a-3d4a14e24589 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Getting quotas for user 9b92adb3a9c84d9da71647453003126b and project 7d023eb3bcae40c5a9fc1459a886ef5c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:52:18.065890 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c4dcd001-16c6-4915-9c7a-3d4a14e24589 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.252519 Aug 18 12:52:18.066705 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4669/7323] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:52:17 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:52:19.231234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-929708738", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1808770185", "security_groups": [{"name": "tempest-secgroup-smoke-115848854"}], "networks": [{"uuid": "18a835dc-9e30-4cfd-b9e1-3763d157e9dc"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:52:19.346694 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] validate_networks() for [('18a835dc-9e30-4cfd-b9e1-3763d157e9dc', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:52:20.213901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:52:20.214367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:52:20.214999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:52:20.215499 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:52:20.216047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:52:20.225696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:20.226231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:20.227012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:20.227912 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:20.228427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:20.228879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:20.248561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Getting quotas for project 7d023eb3bcae40c5a9fc1459a886ef5c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:52:20.254048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Getting quotas for user 9b92adb3a9c84d9da71647453003126b and project 7d023eb3bcae40c5a9fc1459a886ef5c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:52:20.269120 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:52:20.271485 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:52:20.325326 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-70411f16-ae47-456a-93f2-e04d8c57c5f5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.100900 Aug 18 12:52:20.326272 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4670/7324] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:52:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 12:52:20.342219 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-72b17dcf-e66b-4a51-b770-2d03898d8e7f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:20.343217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-72b17dcf-e66b-4a51-b770-2d03898d8e7f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:20.410046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-72b17dcf-e66b-4a51-b770-2d03898d8e7f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:52:20.418993 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-72b17dcf-e66b-4a51-b770-2d03898d8e7f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1246 microversion: 2.1 time: 0.083297 Aug 18 12:52:20.420223 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4671/7325] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:20 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:52:21.441077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d9b73976-fe08-4299-ba58-5699fcd85d65 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:21.441739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d9b73976-fe08-4299-ba58-5699fcd85d65 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:21.449467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9b73976-fe08-4299-ba58-5699fcd85d65 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:21.449968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9b73976-fe08-4299-ba58-5699fcd85d65 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:21.450413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9b73976-fe08-4299-ba58-5699fcd85d65 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:21.451246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9b73976-fe08-4299-ba58-5699fcd85d65 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:21.451713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9b73976-fe08-4299-ba58-5699fcd85d65 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:21.452154 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d9b73976-fe08-4299-ba58-5699fcd85d65 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:21.525765 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d9b73976-fe08-4299-ba58-5699fcd85d65 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:52:21.533684 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d9b73976-fe08-4299-ba58-5699fcd85d65 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1298 microversion: 2.1 time: 0.096362 Aug 18 12:52:21.534512 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4672/7326] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:21 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:52:22.556346 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b583c854-52ea-4a5f-b86e-3d798e625d73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:22.557027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b583c854-52ea-4a5f-b86e-3d798e625d73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:22.563810 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b583c854-52ea-4a5f-b86e-3d798e625d73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:22.564318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b583c854-52ea-4a5f-b86e-3d798e625d73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:22.564774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b583c854-52ea-4a5f-b86e-3d798e625d73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:22.565529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b583c854-52ea-4a5f-b86e-3d798e625d73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:22.566216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b583c854-52ea-4a5f-b86e-3d798e625d73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:22.566549 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b583c854-52ea-4a5f-b86e-3d798e625d73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:22.724961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b583c854-52ea-4a5f-b86e-3d798e625d73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:52:22.734622 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b583c854-52ea-4a5f-b86e-3d798e625d73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1371 microversion: 2.1 time: 0.182898 Aug 18 12:52:22.735232 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4673/7327] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:22 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:52:23.089051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-67f0b0ea-40b5-4164-926c-3c9b85938cb2 req-29ca34ca-74b8-4a94-b244-0842d334ebdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370a6c43-a41c-42b4-b4dd-82759d31aff8", "tag": "af741034-8b57-4cc1-9fa9-806c61f3a112"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:52:23.109596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-67f0b0ea-40b5-4164-926c-3c9b85938cb2 req-29ca34ca-74b8-4a94-b244-0842d334ebdc service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:23.110287 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-67f0b0ea-40b5-4164-926c-3c9b85938cb2 req-29ca34ca-74b8-4a94-b244-0842d334ebdc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:23.111119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-67f0b0ea-40b5-4164-926c-3c9b85938cb2 req-29ca34ca-74b8-4a94-b244-0842d334ebdc service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:23.123418 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-67f0b0ea-40b5-4164-926c-3c9b85938cb2 req-29ca34ca-74b8-4a94-b244-0842d334ebdc service nova] Creating event network-changed:af741034-8b57-4cc1-9fa9-806c61f3a112 for instance 370a6c43-a41c-42b4-b4dd-82759d31aff8 on n-h1-853611-3 Aug 18 12:52:23.130008 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-67f0b0ea-40b5-4164-926c-3c9b85938cb2 req-29ca34ca-74b8-4a94-b244-0842d334ebdc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124629 Aug 18 12:52:23.130928 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4674/7328] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:52:23.759260 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-32145de6-405d-41ff-9685-825ba3c66f8f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:23.759974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-32145de6-405d-41ff-9685-825ba3c66f8f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:23.766347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32145de6-405d-41ff-9685-825ba3c66f8f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:23.766871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32145de6-405d-41ff-9685-825ba3c66f8f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:23.767321 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32145de6-405d-41ff-9685-825ba3c66f8f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:23.768023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32145de6-405d-41ff-9685-825ba3c66f8f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:23.768741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32145de6-405d-41ff-9685-825ba3c66f8f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:23.769179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-32145de6-405d-41ff-9685-825ba3c66f8f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:23.908767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-32145de6-405d-41ff-9685-825ba3c66f8f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:52:23.916875 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-32145de6-405d-41ff-9685-825ba3c66f8f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1371 microversion: 2.1 time: 0.163515 Aug 18 12:52:23.917461 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4675/7329] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:23 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:52:24.937418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-88a53a81-0a4a-4a84-9fc7-9972dfcc0525 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:24.938092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88a53a81-0a4a-4a84-9fc7-9972dfcc0525 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:24.945510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88a53a81-0a4a-4a84-9fc7-9972dfcc0525 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:24.946011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88a53a81-0a4a-4a84-9fc7-9972dfcc0525 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:24.946479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88a53a81-0a4a-4a84-9fc7-9972dfcc0525 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:24.947191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88a53a81-0a4a-4a84-9fc7-9972dfcc0525 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:24.947669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88a53a81-0a4a-4a84-9fc7-9972dfcc0525 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:24.948093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88a53a81-0a4a-4a84-9fc7-9972dfcc0525 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:25.083124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-88a53a81-0a4a-4a84-9fc7-9972dfcc0525 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:52:25.090966 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-88a53a81-0a4a-4a84-9fc7-9972dfcc0525 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1371 microversion: 2.1 time: 0.157447 Aug 18 12:52:25.091543 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4676/7330] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:24 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:52:26.111511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-7e8d2ecd-a47d-41e9-80bb-04f1e01c6071 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:26.112175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-7e8d2ecd-a47d-41e9-80bb-04f1e01c6071 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:26.119235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e8d2ecd-a47d-41e9-80bb-04f1e01c6071 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:26.119733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e8d2ecd-a47d-41e9-80bb-04f1e01c6071 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:26.120183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e8d2ecd-a47d-41e9-80bb-04f1e01c6071 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:26.120888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e8d2ecd-a47d-41e9-80bb-04f1e01c6071 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:26.121353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e8d2ecd-a47d-41e9-80bb-04f1e01c6071 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:26.121791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-7e8d2ecd-a47d-41e9-80bb-04f1e01c6071 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:26.264124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-7e8d2ecd-a47d-41e9-80bb-04f1e01c6071 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:52:26.272302 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-7e8d2ecd-a47d-41e9-80bb-04f1e01c6071 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1371 microversion: 2.1 time: 0.164752 Aug 18 12:52:26.272887 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4677/7331] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:26 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:52:27.293962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0327b85a-1418-4286-9eba-6c18316c9fce tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:27.294695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0327b85a-1418-4286-9eba-6c18316c9fce tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:27.301493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0327b85a-1418-4286-9eba-6c18316c9fce tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:27.301990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0327b85a-1418-4286-9eba-6c18316c9fce tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:27.302458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0327b85a-1418-4286-9eba-6c18316c9fce tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:27.303183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0327b85a-1418-4286-9eba-6c18316c9fce tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:27.303654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0327b85a-1418-4286-9eba-6c18316c9fce tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:27.304092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0327b85a-1418-4286-9eba-6c18316c9fce tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:27.441351 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0327b85a-1418-4286-9eba-6c18316c9fce tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:52:27.449514 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0327b85a-1418-4286-9eba-6c18316c9fce tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1371 microversion: 2.1 time: 0.160155 Aug 18 12:52:27.450095 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4678/7332] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:27 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:52:28.470296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f1947a9b-111e-4181-8b9e-e8ef8ee50810 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:28.471015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f1947a9b-111e-4181-8b9e-e8ef8ee50810 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:28.478013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1947a9b-111e-4181-8b9e-e8ef8ee50810 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:28.478569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1947a9b-111e-4181-8b9e-e8ef8ee50810 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:28.479078 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1947a9b-111e-4181-8b9e-e8ef8ee50810 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:28.479733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1947a9b-111e-4181-8b9e-e8ef8ee50810 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:28.480223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1947a9b-111e-4181-8b9e-e8ef8ee50810 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:28.480899 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f1947a9b-111e-4181-8b9e-e8ef8ee50810 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:28.631768 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f1947a9b-111e-4181-8b9e-e8ef8ee50810 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:52:28.642985 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f1947a9b-111e-4181-8b9e-e8ef8ee50810 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1371 microversion: 2.1 time: 0.176396 Aug 18 12:52:28.644281 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4679/7333] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:28 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:52:29.666655 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b76260c8-0057-43b2-80c9-c061cef44f7e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:29.667290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b76260c8-0057-43b2-80c9-c061cef44f7e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:29.675544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b76260c8-0057-43b2-80c9-c061cef44f7e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:29.676051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b76260c8-0057-43b2-80c9-c061cef44f7e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:29.676519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b76260c8-0057-43b2-80c9-c061cef44f7e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:29.677278 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b76260c8-0057-43b2-80c9-c061cef44f7e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:29.677749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b76260c8-0057-43b2-80c9-c061cef44f7e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:29.678212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b76260c8-0057-43b2-80c9-c061cef44f7e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:29.821951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b76260c8-0057-43b2-80c9-c061cef44f7e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:52:29.831083 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b76260c8-0057-43b2-80c9-c061cef44f7e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1371 microversion: 2.1 time: 0.168234 Aug 18 12:52:29.832457 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4680/7334] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:29 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:52:30.268852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:52:30.338631 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-87ec1b23-065d-4fdd-ab83-26b1420d2dbd req-64ff63b4-aae0-416c-924a-3d22aa8b6af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370a6c43-a41c-42b4-b4dd-82759d31aff8", "name": "network-vif-plugged", "status": "completed", "tag": "af741034-8b57-4cc1-9fa9-806c61f3a112"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:52:30.348554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-87ec1b23-065d-4fdd-ab83-26b1420d2dbd req-64ff63b4-aae0-416c-924a-3d22aa8b6af6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:30.349053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-87ec1b23-065d-4fdd-ab83-26b1420d2dbd req-64ff63b4-aae0-416c-924a-3d22aa8b6af6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:30.349500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-87ec1b23-065d-4fdd-ab83-26b1420d2dbd req-64ff63b4-aae0-416c-924a-3d22aa8b6af6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:30.363650 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-87ec1b23-065d-4fdd-ab83-26b1420d2dbd req-64ff63b4-aae0-416c-924a-3d22aa8b6af6 service nova] Creating event network-vif-plugged:af741034-8b57-4cc1-9fa9-806c61f3a112 for instance 370a6c43-a41c-42b4-b4dd-82759d31aff8 on n-h1-853611-3 Aug 18 12:52:30.368664 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-87ec1b23-065d-4fdd-ab83-26b1420d2dbd req-64ff63b4-aae0-416c-924a-3d22aa8b6af6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106474 Aug 18 12:52:30.369277 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4681/7335] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:52:30.850667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=12 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:52:30.855743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4ea627b7-6f8a-4cff-a9e2-5e508e6c5b14 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:30.856466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4ea627b7-6f8a-4cff-a9e2-5e508e6c5b14 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:30.863149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ea627b7-6f8a-4cff-a9e2-5e508e6c5b14 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:30.863582 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ea627b7-6f8a-4cff-a9e2-5e508e6c5b14 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:30.864026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ea627b7-6f8a-4cff-a9e2-5e508e6c5b14 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:30.864732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ea627b7-6f8a-4cff-a9e2-5e508e6c5b14 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:30.865195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ea627b7-6f8a-4cff-a9e2-5e508e6c5b14 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:30.865630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4ea627b7-6f8a-4cff-a9e2-5e508e6c5b14 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:31.003836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4ea627b7-6f8a-4cff-a9e2-5e508e6c5b14 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:52:31.011564 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4ea627b7-6f8a-4cff-a9e2-5e508e6c5b14 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1371 microversion: 2.1 time: 0.161875 Aug 18 12:52:31.012143 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4682/7336] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:30 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:52:32.033194 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9887dcea-da16-4690-a616-b62df3fb67b9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:32.033854 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9887dcea-da16-4690-a616-b62df3fb67b9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:32.040732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9887dcea-da16-4690-a616-b62df3fb67b9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:32.041220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9887dcea-da16-4690-a616-b62df3fb67b9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:32.041664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9887dcea-da16-4690-a616-b62df3fb67b9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:32.042361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9887dcea-da16-4690-a616-b62df3fb67b9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:32.042861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9887dcea-da16-4690-a616-b62df3fb67b9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:32.043296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9887dcea-da16-4690-a616-b62df3fb67b9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:32.178914 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9887dcea-da16-4690-a616-b62df3fb67b9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:52:32.187075 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9887dcea-da16-4690-a616-b62df3fb67b9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1555 microversion: 2.1 time: 0.157840 Aug 18 12:52:32.187709 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4683/7337] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:32 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:52:32.208390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b33d9167-3232-4b92-a477-dc3c8e53e0c3 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:52:32.209023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b33d9167-3232-4b92-a477-dc3c8e53e0c3 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:52:32.215032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b33d9167-3232-4b92-a477-dc3c8e53e0c3 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:32.215533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b33d9167-3232-4b92-a477-dc3c8e53e0c3 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:32.215984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b33d9167-3232-4b92-a477-dc3c8e53e0c3 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:32.216688 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b33d9167-3232-4b92-a477-dc3c8e53e0c3 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:32.217160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b33d9167-3232-4b92-a477-dc3c8e53e0c3 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:32.218982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b33d9167-3232-4b92-a477-dc3c8e53e0c3 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:32.357015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b33d9167-3232-4b92-a477-dc3c8e53e0c3 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:52:32.364808 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b33d9167-3232-4b92-a477-dc3c8e53e0c3 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1555 microversion: 2.1 time: 0.160248 Aug 18 12:52:32.365386 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4684/7338] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:52:32 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:52:34.401946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5b348210-7577-4357-bfca-3f1329cb5e1f req-a32580b7-39c4-4e2b-b4a4-ba2a09296d0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370a6c43-a41c-42b4-b4dd-82759d31aff8", "tag": "af741034-8b57-4cc1-9fa9-806c61f3a112"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:52:34.412175 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5b348210-7577-4357-bfca-3f1329cb5e1f req-a32580b7-39c4-4e2b-b4a4-ba2a09296d0c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:52:34.412759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5b348210-7577-4357-bfca-3f1329cb5e1f req-a32580b7-39c4-4e2b-b4a4-ba2a09296d0c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:52:34.413220 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5b348210-7577-4357-bfca-3f1329cb5e1f req-a32580b7-39c4-4e2b-b4a4-ba2a09296d0c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:52:34.428102 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5b348210-7577-4357-bfca-3f1329cb5e1f req-a32580b7-39c4-4e2b-b4a4-ba2a09296d0c service nova] Creating event network-changed:af741034-8b57-4cc1-9fa9-806c61f3a112 for instance 370a6c43-a41c-42b4-b4dd-82759d31aff8 on n-h1-853611-3 Aug 18 12:52:34.433630 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5b348210-7577-4357-bfca-3f1329cb5e1f req-a32580b7-39c4-4e2b-b4a4-ba2a09296d0c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035427 Aug 18 12:52:34.434246 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4685/7339] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:53:18.879030 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:53:18.879648 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:53:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:54:27.319184 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8703f2a-f745-4e9b-8afb-efe543c268f1] AMQP server on 10.222.0.73:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 18 12:54:27.320507 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4032abb9-abb5-4d06-9561-525583ca96a6] AMQP server on 10.222.0.73:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 18 12:54:27.321829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:54:27.322671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=74 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:54:27.327567 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-54235081-af39-44d2-a9c7-e0f4faeac3e8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:54:27.328208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-54235081-af39-44d2-a9c7-e0f4faeac3e8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:27.336146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54235081-af39-44d2-a9c7-e0f4faeac3e8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:27.336826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54235081-af39-44d2-a9c7-e0f4faeac3e8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:27.337286 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54235081-af39-44d2-a9c7-e0f4faeac3e8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:27.338006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54235081-af39-44d2-a9c7-e0f4faeac3e8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:27.338504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54235081-af39-44d2-a9c7-e0f4faeac3e8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:27.338951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-54235081-af39-44d2-a9c7-e0f4faeac3e8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:27.361896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-54235081-af39-44d2-a9c7-e0f4faeac3e8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lazy-loading 'flavor' on Instance uuid 370a6c43-a41c-42b4-b4dd-82759d31aff8 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:54:27.720982 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-54235081-af39-44d2-a9c7-e0f4faeac3e8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "POST /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8/action" status: 202 len: 0 microversion: 2.1 time: 0.404112 Aug 18 12:54:27.721580 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4686/7340] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:54:27 2022] POST /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:54:27.731153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a550cf93-2999-4c33-9d38-d97d702da246 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:27.731869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a550cf93-2999-4c33-9d38-d97d702da246 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:27.739700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a550cf93-2999-4c33-9d38-d97d702da246 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:27.740253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a550cf93-2999-4c33-9d38-d97d702da246 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:27.740862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a550cf93-2999-4c33-9d38-d97d702da246 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:27.741767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a550cf93-2999-4c33-9d38-d97d702da246 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:27.743650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a550cf93-2999-4c33-9d38-d97d702da246 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:27.744137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a550cf93-2999-4c33-9d38-d97d702da246 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:27.881380 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a550cf93-2999-4c33-9d38-d97d702da246 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:27.889041 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a550cf93-2999-4c33-9d38-d97d702da246 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1678 microversion: 2.1 time: 0.163048 Aug 18 12:54:27.889616 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4687/7341] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:27 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:28.910065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b1b3a830-b173-4004-be48-3b905bc4a3b7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:28.910737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b1b3a830-b173-4004-be48-3b905bc4a3b7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:28.920908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1b3a830-b173-4004-be48-3b905bc4a3b7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:28.921337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1b3a830-b173-4004-be48-3b905bc4a3b7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:28.921793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1b3a830-b173-4004-be48-3b905bc4a3b7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:28.922532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1b3a830-b173-4004-be48-3b905bc4a3b7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:28.923006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1b3a830-b173-4004-be48-3b905bc4a3b7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:28.923450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b1b3a830-b173-4004-be48-3b905bc4a3b7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:28.933111 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8703f2a-f745-4e9b-8afb-efe543c268f1] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54508. Aug 18 12:54:28.933955 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] [4032abb9-abb5-4d06-9561-525583ca96a6] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54510. Aug 18 12:54:29.070132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b1b3a830-b173-4004-be48-3b905bc4a3b7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:29.078486 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b1b3a830-b173-4004-be48-3b905bc4a3b7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1678 microversion: 2.1 time: 0.172262 Aug 18 12:54:29.079092 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4688/7342] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:28 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:30.100610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a2378ae2-e5e6-4af9-9d57-73b188bac46c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:30.101365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a2378ae2-e5e6-4af9-9d57-73b188bac46c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:30.108634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2378ae2-e5e6-4af9-9d57-73b188bac46c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:30.109229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2378ae2-e5e6-4af9-9d57-73b188bac46c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:30.109690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2378ae2-e5e6-4af9-9d57-73b188bac46c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:30.110406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2378ae2-e5e6-4af9-9d57-73b188bac46c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:30.110905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2378ae2-e5e6-4af9-9d57-73b188bac46c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:30.111343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a2378ae2-e5e6-4af9-9d57-73b188bac46c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:30.259384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a2378ae2-e5e6-4af9-9d57-73b188bac46c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:30.270731 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a2378ae2-e5e6-4af9-9d57-73b188bac46c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1678 microversion: 2.1 time: 0.174139 Aug 18 12:54:30.271335 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4689/7343] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:30 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:31.293518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5b338705-8db7-4e3c-a953-37c3ddd836fc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:31.294305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5b338705-8db7-4e3c-a953-37c3ddd836fc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:31.301343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b338705-8db7-4e3c-a953-37c3ddd836fc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:31.301847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b338705-8db7-4e3c-a953-37c3ddd836fc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:31.302295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b338705-8db7-4e3c-a953-37c3ddd836fc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:31.303041 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b338705-8db7-4e3c-a953-37c3ddd836fc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:31.303504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b338705-8db7-4e3c-a953-37c3ddd836fc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:31.303942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5b338705-8db7-4e3c-a953-37c3ddd836fc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:31.444374 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5b338705-8db7-4e3c-a953-37c3ddd836fc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:31.453287 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5b338705-8db7-4e3c-a953-37c3ddd836fc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1678 microversion: 2.1 time: 0.164996 Aug 18 12:54:31.453867 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4690/7344] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:31 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:32.475214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-39e3226b-ccfd-45c7-83d0-9db5e07acb2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:32.475843 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-39e3226b-ccfd-45c7-83d0-9db5e07acb2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:32.483609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39e3226b-ccfd-45c7-83d0-9db5e07acb2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:32.484114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39e3226b-ccfd-45c7-83d0-9db5e07acb2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:32.484562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39e3226b-ccfd-45c7-83d0-9db5e07acb2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:32.485275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39e3226b-ccfd-45c7-83d0-9db5e07acb2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:32.485749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39e3226b-ccfd-45c7-83d0-9db5e07acb2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:32.486186 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-39e3226b-ccfd-45c7-83d0-9db5e07acb2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:32.626196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-39e3226b-ccfd-45c7-83d0-9db5e07acb2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:32.633837 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-39e3226b-ccfd-45c7-83d0-9db5e07acb2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1678 microversion: 2.1 time: 0.162638 Aug 18 12:54:32.634438 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4691/7345] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:32 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:33.654995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4199d7a5-1621-4424-a926-a9f096b1c0f7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:33.655705 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4199d7a5-1621-4424-a926-a9f096b1c0f7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:33.662656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4199d7a5-1621-4424-a926-a9f096b1c0f7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:33.663086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4199d7a5-1621-4424-a926-a9f096b1c0f7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:33.663539 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4199d7a5-1621-4424-a926-a9f096b1c0f7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:33.664245 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4199d7a5-1621-4424-a926-a9f096b1c0f7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:33.664713 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4199d7a5-1621-4424-a926-a9f096b1c0f7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:33.665153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4199d7a5-1621-4424-a926-a9f096b1c0f7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:33.802066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4199d7a5-1621-4424-a926-a9f096b1c0f7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:33.810278 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4199d7a5-1621-4424-a926-a9f096b1c0f7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1678 microversion: 2.1 time: 0.159247 Aug 18 12:54:33.810891 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4692/7346] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:33 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:34.832279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8054c5a1-002d-44a0-b906-d1789dbe913b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:34.832976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8054c5a1-002d-44a0-b906-d1789dbe913b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:34.840421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8054c5a1-002d-44a0-b906-d1789dbe913b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:34.840929 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8054c5a1-002d-44a0-b906-d1789dbe913b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:34.841384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8054c5a1-002d-44a0-b906-d1789dbe913b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:34.842094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8054c5a1-002d-44a0-b906-d1789dbe913b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:34.842604 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8054c5a1-002d-44a0-b906-d1789dbe913b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:34.843048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8054c5a1-002d-44a0-b906-d1789dbe913b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:34.978813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8054c5a1-002d-44a0-b906-d1789dbe913b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:34.987172 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8054c5a1-002d-44a0-b906-d1789dbe913b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1678 microversion: 2.1 time: 0.158770 Aug 18 12:54:34.987749 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4693/7347] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:34 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:36.008836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3f3679e9-00a6-4534-8b9b-36dcef56dd84 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:36.009517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3f3679e9-00a6-4534-8b9b-36dcef56dd84 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:36.018848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f3679e9-00a6-4534-8b9b-36dcef56dd84 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:36.019381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f3679e9-00a6-4534-8b9b-36dcef56dd84 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:36.019951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f3679e9-00a6-4534-8b9b-36dcef56dd84 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:36.021087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f3679e9-00a6-4534-8b9b-36dcef56dd84 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:36.021601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f3679e9-00a6-4534-8b9b-36dcef56dd84 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:36.022069 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f3679e9-00a6-4534-8b9b-36dcef56dd84 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:36.164232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3f3679e9-00a6-4534-8b9b-36dcef56dd84 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:36.172639 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3f3679e9-00a6-4534-8b9b-36dcef56dd84 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1678 microversion: 2.1 time: 0.167933 Aug 18 12:54:36.173228 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4694/7348] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:36 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:37.194907 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0b9f5e05-2699-4ec4-9c63-dcf27ca9a731 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:37.195598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0b9f5e05-2699-4ec4-9c63-dcf27ca9a731 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:37.203179 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b9f5e05-2699-4ec4-9c63-dcf27ca9a731 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:37.203681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b9f5e05-2699-4ec4-9c63-dcf27ca9a731 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:37.204134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b9f5e05-2699-4ec4-9c63-dcf27ca9a731 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:37.204844 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b9f5e05-2699-4ec4-9c63-dcf27ca9a731 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:37.205319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b9f5e05-2699-4ec4-9c63-dcf27ca9a731 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:37.205761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0b9f5e05-2699-4ec4-9c63-dcf27ca9a731 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:37.346121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0b9f5e05-2699-4ec4-9c63-dcf27ca9a731 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:37.353656 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0b9f5e05-2699-4ec4-9c63-dcf27ca9a731 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1678 microversion: 2.1 time: 0.162653 Aug 18 12:54:37.354225 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4695/7349] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:37 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:38.375968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1fb4cd88-df88-4097-8431-5c65903e8629 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:38.376684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1fb4cd88-df88-4097-8431-5c65903e8629 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:38.383962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fb4cd88-df88-4097-8431-5c65903e8629 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:38.384478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fb4cd88-df88-4097-8431-5c65903e8629 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:38.384942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fb4cd88-df88-4097-8431-5c65903e8629 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:38.385684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fb4cd88-df88-4097-8431-5c65903e8629 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:38.386265 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fb4cd88-df88-4097-8431-5c65903e8629 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:38.386789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1fb4cd88-df88-4097-8431-5c65903e8629 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:38.532984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1fb4cd88-df88-4097-8431-5c65903e8629 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:38.540754 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1fb4cd88-df88-4097-8431-5c65903e8629 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1699 microversion: 2.1 time: 0.169408 Aug 18 12:54:38.541158 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4696/7350] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:38 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1699 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:39.563700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e49f05d5-e7a9-47fd-b914-93091c2a41cc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:39.564456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e49f05d5-e7a9-47fd-b914-93091c2a41cc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:39.572311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e49f05d5-e7a9-47fd-b914-93091c2a41cc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:39.572893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e49f05d5-e7a9-47fd-b914-93091c2a41cc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:39.573364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e49f05d5-e7a9-47fd-b914-93091c2a41cc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:39.574074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e49f05d5-e7a9-47fd-b914-93091c2a41cc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:39.574585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e49f05d5-e7a9-47fd-b914-93091c2a41cc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:39.575114 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e49f05d5-e7a9-47fd-b914-93091c2a41cc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:39.719014 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e49f05d5-e7a9-47fd-b914-93091c2a41cc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:39.727049 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e49f05d5-e7a9-47fd-b914-93091c2a41cc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1699 microversion: 2.1 time: 0.168433 Aug 18 12:54:39.728021 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4697/7351] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:39 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1699 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:40.751047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f42d3b96-6d0e-400c-a188-47b175c9f329 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:40.752564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f42d3b96-6d0e-400c-a188-47b175c9f329 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:40.761053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f42d3b96-6d0e-400c-a188-47b175c9f329 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:40.761951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f42d3b96-6d0e-400c-a188-47b175c9f329 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:40.762673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f42d3b96-6d0e-400c-a188-47b175c9f329 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:40.763685 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f42d3b96-6d0e-400c-a188-47b175c9f329 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:40.764436 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f42d3b96-6d0e-400c-a188-47b175c9f329 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:40.765107 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f42d3b96-6d0e-400c-a188-47b175c9f329 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:40.946340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f42d3b96-6d0e-400c-a188-47b175c9f329 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:40.956963 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f42d3b96-6d0e-400c-a188-47b175c9f329 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1694 microversion: 2.1 time: 0.210416 Aug 18 12:54:40.957833 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4698/7352] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:40 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1694 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:54:41.980827 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4b7ccd85-a51d-43b9-b56b-a30b6fa5f631 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:41.982139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4b7ccd85-a51d-43b9-b56b-a30b6fa5f631 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:41.991335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b7ccd85-a51d-43b9-b56b-a30b6fa5f631 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:41.992203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b7ccd85-a51d-43b9-b56b-a30b6fa5f631 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:41.992885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b7ccd85-a51d-43b9-b56b-a30b6fa5f631 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:41.993876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b7ccd85-a51d-43b9-b56b-a30b6fa5f631 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:41.994423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b7ccd85-a51d-43b9-b56b-a30b6fa5f631 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:41.995192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4b7ccd85-a51d-43b9-b56b-a30b6fa5f631 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:42.164061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4b7ccd85-a51d-43b9-b56b-a30b6fa5f631 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:42.171793 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4b7ccd85-a51d-43b9-b56b-a30b6fa5f631 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1694 microversion: 2.1 time: 0.195376 Aug 18 12:54:42.172371 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4699/7353] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:41 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1694 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:42.915654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-73674d81-6ed5-4101-8495-fdac27762696 req-1624e426-8a9f-4ca9-ae70-870bfb28336b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370a6c43-a41c-42b4-b4dd-82759d31aff8", "name": "network-vif-plugged", "status": "completed", "tag": "af741034-8b57-4cc1-9fa9-806c61f3a112"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:54:42.926721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-73674d81-6ed5-4101-8495-fdac27762696 req-1624e426-8a9f-4ca9-ae70-870bfb28336b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:42.927610 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-73674d81-6ed5-4101-8495-fdac27762696 req-1624e426-8a9f-4ca9-ae70-870bfb28336b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:42.928812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-73674d81-6ed5-4101-8495-fdac27762696 req-1624e426-8a9f-4ca9-ae70-870bfb28336b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:42.945481 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-73674d81-6ed5-4101-8495-fdac27762696 req-1624e426-8a9f-4ca9-ae70-870bfb28336b service nova] Creating event network-vif-plugged:af741034-8b57-4cc1-9fa9-806c61f3a112 for instance 370a6c43-a41c-42b4-b4dd-82759d31aff8 on n-h1-853611-3 Aug 18 12:54:42.951150 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-73674d81-6ed5-4101-8495-fdac27762696 req-1624e426-8a9f-4ca9-ae70-870bfb28336b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039150 Aug 18 12:54:42.952379 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4700/7354] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:54:43.198814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cb99d22c-b084-4e29-acee-6ba6d0f09c2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:43.199529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cb99d22c-b084-4e29-acee-6ba6d0f09c2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:43.217987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb99d22c-b084-4e29-acee-6ba6d0f09c2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:43.221140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb99d22c-b084-4e29-acee-6ba6d0f09c2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:43.221621 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb99d22c-b084-4e29-acee-6ba6d0f09c2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:43.222486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb99d22c-b084-4e29-acee-6ba6d0f09c2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:43.222978 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb99d22c-b084-4e29-acee-6ba6d0f09c2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:43.223427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cb99d22c-b084-4e29-acee-6ba6d0f09c2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:43.235811 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:54:43.402675 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cb99d22c-b084-4e29-acee-6ba6d0f09c2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:43.411172 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cb99d22c-b084-4e29-acee-6ba6d0f09c2b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1694 microversion: 2.1 time: 0.217452 Aug 18 12:54:43.412326 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4701/7355] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:43 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1694 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:44.434955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6f1dd719-f678-4882-899b-c1bfd028c11e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:44.437939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6f1dd719-f678-4882-899b-c1bfd028c11e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:44.448209 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f1dd719-f678-4882-899b-c1bfd028c11e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:44.449115 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f1dd719-f678-4882-899b-c1bfd028c11e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:44.450496 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f1dd719-f678-4882-899b-c1bfd028c11e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:44.451434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f1dd719-f678-4882-899b-c1bfd028c11e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:44.451919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f1dd719-f678-4882-899b-c1bfd028c11e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:44.452633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6f1dd719-f678-4882-899b-c1bfd028c11e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:44.617697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6f1dd719-f678-4882-899b-c1bfd028c11e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:44.629540 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6f1dd719-f678-4882-899b-c1bfd028c11e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1694 microversion: 2.1 time: 0.198634 Aug 18 12:54:44.630464 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4702/7356] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:44 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1694 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:45.653070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9b9bc14c-f306-46dc-98fb-a4882cff2046 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:45.653780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9b9bc14c-f306-46dc-98fb-a4882cff2046 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:45.661517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b9bc14c-f306-46dc-98fb-a4882cff2046 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:45.662019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b9bc14c-f306-46dc-98fb-a4882cff2046 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:45.662487 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b9bc14c-f306-46dc-98fb-a4882cff2046 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:45.663201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b9bc14c-f306-46dc-98fb-a4882cff2046 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:45.663884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b9bc14c-f306-46dc-98fb-a4882cff2046 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:45.664508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9b9bc14c-f306-46dc-98fb-a4882cff2046 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:45.823450 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9b9bc14c-f306-46dc-98fb-a4882cff2046 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:45.831512 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9b9bc14c-f306-46dc-98fb-a4882cff2046 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1694 microversion: 2.1 time: 0.182277 Aug 18 12:54:45.832096 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4703/7357] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:45 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1694 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:46.857934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-80fbd785-9ffd-4a32-9b94-4151f8c83c8b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:46.858669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-80fbd785-9ffd-4a32-9b94-4151f8c83c8b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:46.866951 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80fbd785-9ffd-4a32-9b94-4151f8c83c8b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:46.867515 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80fbd785-9ffd-4a32-9b94-4151f8c83c8b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:46.867959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80fbd785-9ffd-4a32-9b94-4151f8c83c8b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:46.868684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80fbd785-9ffd-4a32-9b94-4151f8c83c8b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:46.869161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80fbd785-9ffd-4a32-9b94-4151f8c83c8b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:46.869607 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-80fbd785-9ffd-4a32-9b94-4151f8c83c8b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:47.035348 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-80fbd785-9ffd-4a32-9b94-4151f8c83c8b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:47.043436 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-80fbd785-9ffd-4a32-9b94-4151f8c83c8b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1694 microversion: 2.1 time: 0.191654 Aug 18 12:54:47.051551 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4704/7358] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:46 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1694 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:48.066364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1d5659fe-4de3-4853-a4e2-ad384a46a577 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:48.067109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1d5659fe-4de3-4853-a4e2-ad384a46a577 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:48.074517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d5659fe-4de3-4853-a4e2-ad384a46a577 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:48.075204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d5659fe-4de3-4853-a4e2-ad384a46a577 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:48.075901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d5659fe-4de3-4853-a4e2-ad384a46a577 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:48.076773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d5659fe-4de3-4853-a4e2-ad384a46a577 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:48.077301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d5659fe-4de3-4853-a4e2-ad384a46a577 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:48.078097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1d5659fe-4de3-4853-a4e2-ad384a46a577 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:48.244551 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1d5659fe-4de3-4853-a4e2-ad384a46a577 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:48.253376 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1d5659fe-4de3-4853-a4e2-ad384a46a577 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1694 microversion: 2.1 time: 0.191518 Aug 18 12:54:48.254001 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4705/7359] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:48 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:49.275298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ceb36ee5-37e2-4cdb-b1e3-b773c3a683b5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:49.276066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ceb36ee5-37e2-4cdb-b1e3-b773c3a683b5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:49.283189 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceb36ee5-37e2-4cdb-b1e3-b773c3a683b5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:49.283692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceb36ee5-37e2-4cdb-b1e3-b773c3a683b5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:49.284148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceb36ee5-37e2-4cdb-b1e3-b773c3a683b5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:49.284860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceb36ee5-37e2-4cdb-b1e3-b773c3a683b5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:49.285329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceb36ee5-37e2-4cdb-b1e3-b773c3a683b5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:49.285769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ceb36ee5-37e2-4cdb-b1e3-b773c3a683b5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:49.458406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ceb36ee5-37e2-4cdb-b1e3-b773c3a683b5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:49.466889 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ceb36ee5-37e2-4cdb-b1e3-b773c3a683b5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1694 microversion: 2.1 time: 0.195715 Aug 18 12:54:49.467494 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4706/7360] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:49 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1694 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:50.488061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a631116b-9817-4102-8378-d6f30f88af1f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:50.488967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a631116b-9817-4102-8378-d6f30f88af1f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:50.496376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a631116b-9817-4102-8378-d6f30f88af1f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:50.496882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a631116b-9817-4102-8378-d6f30f88af1f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:50.497329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a631116b-9817-4102-8378-d6f30f88af1f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:50.498044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a631116b-9817-4102-8378-d6f30f88af1f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:50.498541 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a631116b-9817-4102-8378-d6f30f88af1f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:50.498974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a631116b-9817-4102-8378-d6f30f88af1f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:50.896203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a631116b-9817-4102-8378-d6f30f88af1f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:50.904325 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a631116b-9817-4102-8378-d6f30f88af1f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1676 microversion: 2.1 time: 0.420243 Aug 18 12:54:50.904899 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4707/7361] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:50 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1676 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:51.926967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e949ee9e-9850-4038-b087-9cc42f309108 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:51.927634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e949ee9e-9850-4038-b087-9cc42f309108 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:51.934800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e949ee9e-9850-4038-b087-9cc42f309108 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:51.935302 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e949ee9e-9850-4038-b087-9cc42f309108 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:51.935749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e949ee9e-9850-4038-b087-9cc42f309108 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:51.936458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e949ee9e-9850-4038-b087-9cc42f309108 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:51.936924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e949ee9e-9850-4038-b087-9cc42f309108 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:51.937359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e949ee9e-9850-4038-b087-9cc42f309108 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:52.081887 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e949ee9e-9850-4038-b087-9cc42f309108 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:52.089601 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e949ee9e-9850-4038-b087-9cc42f309108 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1676 microversion: 2.1 time: 0.166873 Aug 18 12:54:52.090179 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4708/7362] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:51 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:53.111478 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6ca32a53-1990-4eb8-90a4-3bf95ec5bb4c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:53.112421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6ca32a53-1990-4eb8-90a4-3bf95ec5bb4c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:53.119398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ca32a53-1990-4eb8-90a4-3bf95ec5bb4c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:53.119906 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ca32a53-1990-4eb8-90a4-3bf95ec5bb4c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:53.120363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ca32a53-1990-4eb8-90a4-3bf95ec5bb4c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:53.121082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ca32a53-1990-4eb8-90a4-3bf95ec5bb4c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:53.121561 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ca32a53-1990-4eb8-90a4-3bf95ec5bb4c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:53.122004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6ca32a53-1990-4eb8-90a4-3bf95ec5bb4c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:53.255923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6ca32a53-1990-4eb8-90a4-3bf95ec5bb4c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:53.263550 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6ca32a53-1990-4eb8-90a4-3bf95ec5bb4c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1619 microversion: 2.1 time: 0.156705 Aug 18 12:54:53.264125 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4709/7363] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:53 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1619 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:53.284782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3d23fb47-851a-4246-974d-e36ff81d4ac8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:54:53.285391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3d23fb47-851a-4246-974d-e36ff81d4ac8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:53.291462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d23fb47-851a-4246-974d-e36ff81d4ac8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:53.291903 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d23fb47-851a-4246-974d-e36ff81d4ac8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:53.292345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d23fb47-851a-4246-974d-e36ff81d4ac8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:53.293043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d23fb47-851a-4246-974d-e36ff81d4ac8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:53.293510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d23fb47-851a-4246-974d-e36ff81d4ac8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:53.293945 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d23fb47-851a-4246-974d-e36ff81d4ac8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:53.335519 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3d23fb47-851a-4246-974d-e36ff81d4ac8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122210) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 18 12:54:53.405734 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3d23fb47-851a-4246-974d-e36ff81d4ac8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [ad34efef-0f66-4b0e-ae92-01c0f6623531] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 12:54:54.413098 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [None req-3d23fb47-851a-4246-974d-e36ff81d4ac8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [ad34efef-0f66-4b0e-ae92-01c0f6623531] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54608. Aug 18 12:54:54.416218 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3d23fb47-851a-4246-974d-e36ff81d4ac8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "POST /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8/action" status: 202 len: 0 microversion: 2.1 time: 1.135907 Aug 18 12:54:54.416843 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4710/7364] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:54:53 2022] POST /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8/action => generated 0 bytes in 1137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:54:54.425372 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-daafc563-b1ee-47de-9ab8-8d308a8e5b47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:54.425999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-daafc563-b1ee-47de-9ab8-8d308a8e5b47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:54.433011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-daafc563-b1ee-47de-9ab8-8d308a8e5b47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:54.433507 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-daafc563-b1ee-47de-9ab8-8d308a8e5b47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:54.433952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-daafc563-b1ee-47de-9ab8-8d308a8e5b47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:54.434699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-daafc563-b1ee-47de-9ab8-8d308a8e5b47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:54.435148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-daafc563-b1ee-47de-9ab8-8d308a8e5b47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:54.435581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-daafc563-b1ee-47de-9ab8-8d308a8e5b47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:54.580809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-daafc563-b1ee-47de-9ab8-8d308a8e5b47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:54.588551 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-daafc563-b1ee-47de-9ab8-8d308a8e5b47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1627 microversion: 2.1 time: 0.167496 Aug 18 12:54:54.589243 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4711/7365] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:54 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1627 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:54.927252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c8b30c41-1d66-42be-873c-f939244c79f6 req-4bcb3faf-13a3-4453-90ae-f8a784e35b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370a6c43-a41c-42b4-b4dd-82759d31aff8", "name": "network-vif-unplugged", "status": "completed", "tag": "af741034-8b57-4cc1-9fa9-806c61f3a112"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:54:54.939565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c8b30c41-1d66-42be-873c-f939244c79f6 req-4bcb3faf-13a3-4453-90ae-f8a784e35b4f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:54.940336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c8b30c41-1d66-42be-873c-f939244c79f6 req-4bcb3faf-13a3-4453-90ae-f8a784e35b4f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:54.941002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c8b30c41-1d66-42be-873c-f939244c79f6 req-4bcb3faf-13a3-4453-90ae-f8a784e35b4f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:54.956928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.compute.server_external_events [req-c8b30c41-1d66-42be-873c-f939244c79f6 req-4bcb3faf-13a3-4453-90ae-f8a784e35b4f service nova] Unable to find a host for instance 370a6c43-a41c-42b4-b4dd-82759d31aff8. Dropping event network-vif-unplugged {{(pid=122210) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 12:54:54.958124 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c8b30c41-1d66-42be-873c-f939244c79f6 req-4bcb3faf-13a3-4453-90ae-f8a784e35b4f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035665 Aug 18 12:54:54.959279 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4712/7366] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 18 12:54:55.611242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df14f800-534b-4d74-a26a-26799a372807 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:55.612517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df14f800-534b-4d74-a26a-26799a372807 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:55.619546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df14f800-534b-4d74-a26a-26799a372807 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:55.620050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df14f800-534b-4d74-a26a-26799a372807 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:55.620506 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df14f800-534b-4d74-a26a-26799a372807 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:55.621235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df14f800-534b-4d74-a26a-26799a372807 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:55.621695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df14f800-534b-4d74-a26a-26799a372807 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:55.622140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df14f800-534b-4d74-a26a-26799a372807 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:55.800873 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df14f800-534b-4d74-a26a-26799a372807 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:55.808644 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df14f800-534b-4d74-a26a-26799a372807 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1685 microversion: 2.1 time: 0.201351 Aug 18 12:54:55.809232 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4713/7367] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:55 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1685 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:56.616739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a7b31bbd-1f5c-45ee-b28f-af4994318f4e req-f8d48177-4a87-4650-8984-a1a860da0dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370a6c43-a41c-42b4-b4dd-82759d31aff8", "tag": "af741034-8b57-4cc1-9fa9-806c61f3a112"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:54:56.628737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a7b31bbd-1f5c-45ee-b28f-af4994318f4e req-f8d48177-4a87-4650-8984-a1a860da0dc8 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:56.629244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a7b31bbd-1f5c-45ee-b28f-af4994318f4e req-f8d48177-4a87-4650-8984-a1a860da0dc8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:56.629701 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a7b31bbd-1f5c-45ee-b28f-af4994318f4e req-f8d48177-4a87-4650-8984-a1a860da0dc8 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:56.641830 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a7b31bbd-1f5c-45ee-b28f-af4994318f4e req-f8d48177-4a87-4650-8984-a1a860da0dc8 service nova] Creating event network-changed:af741034-8b57-4cc1-9fa9-806c61f3a112 for instance 370a6c43-a41c-42b4-b4dd-82759d31aff8 on n-h2-853611-3 Aug 18 12:54:56.647512 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a7b31bbd-1f5c-45ee-b28f-af4994318f4e req-f8d48177-4a87-4650-8984-a1a860da0dc8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101072 Aug 18 12:54:56.648130 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4714/7368] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:54:56.831959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5926ab7f-cffb-450c-b8bf-f73509400f80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:56.832956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5926ab7f-cffb-450c-b8bf-f73509400f80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:56.839299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5926ab7f-cffb-450c-b8bf-f73509400f80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:56.839886 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5926ab7f-cffb-450c-b8bf-f73509400f80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:56.840350 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5926ab7f-cffb-450c-b8bf-f73509400f80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:56.841075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5926ab7f-cffb-450c-b8bf-f73509400f80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:56.841557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5926ab7f-cffb-450c-b8bf-f73509400f80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:56.842001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5926ab7f-cffb-450c-b8bf-f73509400f80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:57.066544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5926ab7f-cffb-450c-b8bf-f73509400f80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:57.074726 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5926ab7f-cffb-450c-b8bf-f73509400f80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1685 microversion: 2.1 time: 0.247044 Aug 18 12:54:57.075319 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4715/7369] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:56 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1685 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:58.096573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3b351fd2-3639-4ece-ba24-f3458e6df25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:58.097444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3b351fd2-3639-4ece-ba24-f3458e6df25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:58.100512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:54:58.106767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b351fd2-3639-4ece-ba24-f3458e6df25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:58.107283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b351fd2-3639-4ece-ba24-f3458e6df25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:58.107743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b351fd2-3639-4ece-ba24-f3458e6df25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:58.108492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b351fd2-3639-4ece-ba24-f3458e6df25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:58.109119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b351fd2-3639-4ece-ba24-f3458e6df25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:58.109626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3b351fd2-3639-4ece-ba24-f3458e6df25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:58.290081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3b351fd2-3639-4ece-ba24-f3458e6df25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:58.298802 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3b351fd2-3639-4ece-ba24-f3458e6df25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1685 microversion: 2.1 time: 0.206264 Aug 18 12:54:58.300290 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4716/7370] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:58 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1685 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:54:59.322180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-962abe39-71ad-4650-adda-41cc88d9bf1a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:54:59.323612 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-962abe39-71ad-4650-adda-41cc88d9bf1a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:54:59.330174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-962abe39-71ad-4650-adda-41cc88d9bf1a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:59.331581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-962abe39-71ad-4650-adda-41cc88d9bf1a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:59.332180 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-962abe39-71ad-4650-adda-41cc88d9bf1a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:59.332933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-962abe39-71ad-4650-adda-41cc88d9bf1a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:54:59.333418 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-962abe39-71ad-4650-adda-41cc88d9bf1a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:54:59.333877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-962abe39-71ad-4650-adda-41cc88d9bf1a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:54:59.498061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-962abe39-71ad-4650-adda-41cc88d9bf1a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:54:59.506452 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-962abe39-71ad-4650-adda-41cc88d9bf1a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1685 microversion: 2.1 time: 0.188292 Aug 18 12:54:59.507060 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4717/7371] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:54:59 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1685 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:55:00.263314 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:55:00.264286 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:55:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:55:00.529744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a40ae195-89ea-41ff-9623-2113ee21c196 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:55:00.530414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a40ae195-89ea-41ff-9623-2113ee21c196 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:55:00.537847 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a40ae195-89ea-41ff-9623-2113ee21c196 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:00.538389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a40ae195-89ea-41ff-9623-2113ee21c196 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:00.538880 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a40ae195-89ea-41ff-9623-2113ee21c196 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:00.539715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a40ae195-89ea-41ff-9623-2113ee21c196 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:00.540406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a40ae195-89ea-41ff-9623-2113ee21c196 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:00.540927 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a40ae195-89ea-41ff-9623-2113ee21c196 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:00.545597 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:55:00.707066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a40ae195-89ea-41ff-9623-2113ee21c196 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:55:00.715593 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a40ae195-89ea-41ff-9623-2113ee21c196 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1685 microversion: 2.1 time: 0.189885 Aug 18 12:55:00.716409 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4718/7372] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:55:00 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1685 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:55:01.741308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cfe111ee-5677-48ed-a62f-1cfbf2923ccc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:55:01.742766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cfe111ee-5677-48ed-a62f-1cfbf2923ccc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:55:01.750922 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfe111ee-5677-48ed-a62f-1cfbf2923ccc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:01.751523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfe111ee-5677-48ed-a62f-1cfbf2923ccc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:01.751923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfe111ee-5677-48ed-a62f-1cfbf2923ccc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:01.752960 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfe111ee-5677-48ed-a62f-1cfbf2923ccc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:01.753495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfe111ee-5677-48ed-a62f-1cfbf2923ccc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:01.754149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cfe111ee-5677-48ed-a62f-1cfbf2923ccc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:01.910797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cfe111ee-5677-48ed-a62f-1cfbf2923ccc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:55:01.919987 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cfe111ee-5677-48ed-a62f-1cfbf2923ccc tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1685 microversion: 2.1 time: 0.182928 Aug 18 12:55:01.920942 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4719/7373] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:55:01 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:55:02.944508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6da740e4-841b-4c53-bda3-0fbe1078d8db tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:55:02.946250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6da740e4-841b-4c53-bda3-0fbe1078d8db tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:55:02.953874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da740e4-841b-4c53-bda3-0fbe1078d8db tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:02.954375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da740e4-841b-4c53-bda3-0fbe1078d8db tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:02.954981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da740e4-841b-4c53-bda3-0fbe1078d8db tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:02.956344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da740e4-841b-4c53-bda3-0fbe1078d8db tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:02.956813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da740e4-841b-4c53-bda3-0fbe1078d8db tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:02.957253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6da740e4-841b-4c53-bda3-0fbe1078d8db tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:03.158817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6da740e4-841b-4c53-bda3-0fbe1078d8db tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:55:03.171258 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6da740e4-841b-4c53-bda3-0fbe1078d8db tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1685 microversion: 2.1 time: 0.231694 Aug 18 12:55:03.172206 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4720/7374] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:55:02 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1685 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:55:04.199991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1e0e2539-a472-4c49-bdf9-03eb9a35ca80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:55:04.203094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1e0e2539-a472-4c49-bdf9-03eb9a35ca80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:55:04.222874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e0e2539-a472-4c49-bdf9-03eb9a35ca80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:04.223381 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e0e2539-a472-4c49-bdf9-03eb9a35ca80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:04.223835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e0e2539-a472-4c49-bdf9-03eb9a35ca80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:04.224879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e0e2539-a472-4c49-bdf9-03eb9a35ca80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:04.225458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e0e2539-a472-4c49-bdf9-03eb9a35ca80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:04.225782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1e0e2539-a472-4c49-bdf9-03eb9a35ca80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:04.433999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1e0e2539-a472-4c49-bdf9-03eb9a35ca80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:55:04.445603 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1e0e2539-a472-4c49-bdf9-03eb9a35ca80 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1685 microversion: 2.1 time: 0.252784 Aug 18 12:55:04.450478 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4721/7375] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:55:04 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1685 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:55:05.467735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3bda0409-d2a1-463d-8b2d-3104be387332 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:55:05.468426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3bda0409-d2a1-463d-8b2d-3104be387332 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:55:05.475317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bda0409-d2a1-463d-8b2d-3104be387332 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:05.475819 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bda0409-d2a1-463d-8b2d-3104be387332 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:05.476270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bda0409-d2a1-463d-8b2d-3104be387332 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:05.476979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bda0409-d2a1-463d-8b2d-3104be387332 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:05.477448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bda0409-d2a1-463d-8b2d-3104be387332 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:05.477918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bda0409-d2a1-463d-8b2d-3104be387332 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:05.613201 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3bda0409-d2a1-463d-8b2d-3104be387332 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:55:05.620850 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3bda0409-d2a1-463d-8b2d-3104be387332 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1685 microversion: 2.1 time: 0.157080 Aug 18 12:55:05.621430 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4722/7376] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:55:05 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:55:06.643633 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3f9c1ff5-e358-47ff-91e8-43653d390163 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:55:06.645324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3f9c1ff5-e358-47ff-91e8-43653d390163 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:55:06.652818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f9c1ff5-e358-47ff-91e8-43653d390163 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:06.653319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f9c1ff5-e358-47ff-91e8-43653d390163 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:06.653800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f9c1ff5-e358-47ff-91e8-43653d390163 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:06.654583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f9c1ff5-e358-47ff-91e8-43653d390163 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:06.655056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f9c1ff5-e358-47ff-91e8-43653d390163 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:06.655495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3f9c1ff5-e358-47ff-91e8-43653d390163 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:06.796119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3f9c1ff5-e358-47ff-91e8-43653d390163 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:55:06.804884 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3f9c1ff5-e358-47ff-91e8-43653d390163 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1685 microversion: 2.1 time: 0.165911 Aug 18 12:55:06.805476 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4723/7377] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:55:06 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:55:07.826299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ce18dc86-67cf-4921-aa4f-f5002a6fb4fa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:55:07.826975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ce18dc86-67cf-4921-aa4f-f5002a6fb4fa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:55:07.833957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce18dc86-67cf-4921-aa4f-f5002a6fb4fa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:07.834484 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce18dc86-67cf-4921-aa4f-f5002a6fb4fa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:07.834935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce18dc86-67cf-4921-aa4f-f5002a6fb4fa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:07.835668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce18dc86-67cf-4921-aa4f-f5002a6fb4fa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:07.836138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce18dc86-67cf-4921-aa4f-f5002a6fb4fa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:07.836574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce18dc86-67cf-4921-aa4f-f5002a6fb4fa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:07.971934 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ce18dc86-67cf-4921-aa4f-f5002a6fb4fa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:55:07.980244 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ce18dc86-67cf-4921-aa4f-f5002a6fb4fa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1685 microversion: 2.1 time: 0.157842 Aug 18 12:55:07.980825 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4724/7378] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:55:07 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:55:09.002537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e3b7267c-c007-4939-a0e1-a22f9982308f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:55:09.003235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e3b7267c-c007-4939-a0e1-a22f9982308f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:55:09.010957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3b7267c-c007-4939-a0e1-a22f9982308f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:09.011493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3b7267c-c007-4939-a0e1-a22f9982308f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:09.011955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3b7267c-c007-4939-a0e1-a22f9982308f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:09.012715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3b7267c-c007-4939-a0e1-a22f9982308f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:09.013218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3b7267c-c007-4939-a0e1-a22f9982308f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:09.013667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e3b7267c-c007-4939-a0e1-a22f9982308f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:09.157435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e3b7267c-c007-4939-a0e1-a22f9982308f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:55:09.165757 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e3b7267c-c007-4939-a0e1-a22f9982308f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1685 microversion: 2.1 time: 0.167408 Aug 18 12:55:09.166338 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4725/7379] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:55:08 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:55:09.678537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c215e78c-f473-4fa5-995b-e2871d6c1cfc req-f7302af3-e5e4-4180-90c7-11a86065cb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370a6c43-a41c-42b4-b4dd-82759d31aff8", "name": "network-vif-plugged", "status": "completed", "tag": "af741034-8b57-4cc1-9fa9-806c61f3a112"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:55:09.690471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c215e78c-f473-4fa5-995b-e2871d6c1cfc req-f7302af3-e5e4-4180-90c7-11a86065cb13 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:09.691157 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c215e78c-f473-4fa5-995b-e2871d6c1cfc req-f7302af3-e5e4-4180-90c7-11a86065cb13 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:09.691820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c215e78c-f473-4fa5-995b-e2871d6c1cfc req-f7302af3-e5e4-4180-90c7-11a86065cb13 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:09.703692 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c215e78c-f473-4fa5-995b-e2871d6c1cfc req-f7302af3-e5e4-4180-90c7-11a86065cb13 service nova] Creating event network-vif-plugged:af741034-8b57-4cc1-9fa9-806c61f3a112 for instance 370a6c43-a41c-42b4-b4dd-82759d31aff8 on n-h2-853611-3 Aug 18 12:55:09.712629 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c215e78c-f473-4fa5-995b-e2871d6c1cfc req-f7302af3-e5e4-4180-90c7-11a86065cb13 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035382 Aug 18 12:55:09.712629 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4726/7380] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:55:10.190650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-df48d274-1672-496e-80c0-96ead3e8748f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:55:10.192039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-df48d274-1672-496e-80c0-96ead3e8748f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:55:10.198583 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df48d274-1672-496e-80c0-96ead3e8748f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:10.199092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df48d274-1672-496e-80c0-96ead3e8748f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:10.199572 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df48d274-1672-496e-80c0-96ead3e8748f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:10.200297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df48d274-1672-496e-80c0-96ead3e8748f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:10.200766 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df48d274-1672-496e-80c0-96ead3e8748f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:10.201227 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-df48d274-1672-496e-80c0-96ead3e8748f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:10.344686 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-df48d274-1672-496e-80c0-96ead3e8748f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:55:10.355008 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-df48d274-1672-496e-80c0-96ead3e8748f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1685 microversion: 2.1 time: 0.170159 Aug 18 12:55:10.356136 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4727/7381] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:55:10 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:55:11.380760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b7727172-a6ad-420d-b29e-6c1dc65b9e6b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:55:11.381715 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b7727172-a6ad-420d-b29e-6c1dc65b9e6b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:55:11.390524 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7727172-a6ad-420d-b29e-6c1dc65b9e6b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:11.391391 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7727172-a6ad-420d-b29e-6c1dc65b9e6b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:11.391852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7727172-a6ad-420d-b29e-6c1dc65b9e6b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:11.392615 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7727172-a6ad-420d-b29e-6c1dc65b9e6b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:11.393252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7727172-a6ad-420d-b29e-6c1dc65b9e6b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:11.393728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b7727172-a6ad-420d-b29e-6c1dc65b9e6b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:11.558924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b7727172-a6ad-420d-b29e-6c1dc65b9e6b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:55:11.567153 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b7727172-a6ad-420d-b29e-6c1dc65b9e6b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1685 microversion: 2.1 time: 0.190941 Aug 18 12:55:11.567869 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4728/7382] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:55:11 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1685 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:55:12.588247 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4d24c750-2ea7-4399-8829-8118e516b592 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:55:12.588961 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4d24c750-2ea7-4399-8829-8118e516b592 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:55:12.595835 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d24c750-2ea7-4399-8829-8118e516b592 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:12.596341 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d24c750-2ea7-4399-8829-8118e516b592 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:12.596801 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d24c750-2ea7-4399-8829-8118e516b592 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:12.597544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d24c750-2ea7-4399-8829-8118e516b592 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:55:12.598693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d24c750-2ea7-4399-8829-8118e516b592 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:55:12.599153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4d24c750-2ea7-4399-8829-8118e516b592 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:55:12.734574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4d24c750-2ea7-4399-8829-8118e516b592 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:55:12.742231 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4d24c750-2ea7-4399-8829-8118e516b592 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1672 microversion: 2.1 time: 0.157832 Aug 18 12:55:12.743199 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4729/7383] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:55:12 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:55:16.817113 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:55:16.817764 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:55:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:56:23.212696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=27 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:56:23.213586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=66 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:56:23.217850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2349fad9-d8d0-41ce-a8ed-8553dc0b8e16 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:23.218404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2349fad9-d8d0-41ce-a8ed-8553dc0b8e16 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:23.225440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2349fad9-d8d0-41ce-a8ed-8553dc0b8e16 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:23.225955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2349fad9-d8d0-41ce-a8ed-8553dc0b8e16 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:23.226404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2349fad9-d8d0-41ce-a8ed-8553dc0b8e16 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:23.227161 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2349fad9-d8d0-41ce-a8ed-8553dc0b8e16 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:23.227635 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2349fad9-d8d0-41ce-a8ed-8553dc0b8e16 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:23.228979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2349fad9-d8d0-41ce-a8ed-8553dc0b8e16 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:23.256139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2349fad9-d8d0-41ce-a8ed-8553dc0b8e16 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 12:56:23.342905 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2349fad9-d8d0-41ce-a8ed-8553dc0b8e16 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "DELETE /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 204 len: 0 microversion: 2.1 time: 0.132150 Aug 18 12:56:23.346974 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4730/7384] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 12:56:23 2022] DELETE /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 12:56:23.349100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a2d8bfb2-0a56-4410-b076-d7b13acd604d req-24c92f8c-ff76-4db1-8e62-6d833cc8c767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370a6c43-a41c-42b4-b4dd-82759d31aff8", "tag": "af741034-8b57-4cc1-9fa9-806c61f3a112"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:56:23.360276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a2d8bfb2-0a56-4410-b076-d7b13acd604d req-24c92f8c-ff76-4db1-8e62-6d833cc8c767 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:23.360780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a2d8bfb2-0a56-4410-b076-d7b13acd604d req-24c92f8c-ff76-4db1-8e62-6d833cc8c767 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:23.361236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a2d8bfb2-0a56-4410-b076-d7b13acd604d req-24c92f8c-ff76-4db1-8e62-6d833cc8c767 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:23.373276 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a2d8bfb2-0a56-4410-b076-d7b13acd604d req-24c92f8c-ff76-4db1-8e62-6d833cc8c767 service nova] Creating event network-changed:af741034-8b57-4cc1-9fa9-806c61f3a112 for instance 370a6c43-a41c-42b4-b4dd-82759d31aff8 on n-h2-853611-3 Aug 18 12:56:23.378435 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a2d8bfb2-0a56-4410-b076-d7b13acd604d req-24c92f8c-ff76-4db1-8e62-6d833cc8c767 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033464 Aug 18 12:56:23.379339 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4731/7385] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:56:23.384702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-b70fd98e-fecc-47b5-a901-b51b622932a2 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:23.385993 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-b70fd98e-fecc-47b5-a901-b51b622932a2 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:23.394897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b70fd98e-fecc-47b5-a901-b51b622932a2 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:23.395408 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b70fd98e-fecc-47b5-a901-b51b622932a2 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:23.395865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b70fd98e-fecc-47b5-a901-b51b622932a2 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:23.396602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b70fd98e-fecc-47b5-a901-b51b622932a2 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:23.397079 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b70fd98e-fecc-47b5-a901-b51b622932a2 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:23.397527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-b70fd98e-fecc-47b5-a901-b51b622932a2 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:23.587174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-b70fd98e-fecc-47b5-a901-b51b622932a2 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:23.595580 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-b70fd98e-fecc-47b5-a901-b51b622932a2 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1678 microversion: 2.1 time: 0.215100 Aug 18 12:56:23.596189 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4732/7386] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:23 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1678 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:56:24.617163 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-35b87be0-e762-41a5-a7ee-8b3e316ac45a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:24.617838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-35b87be0-e762-41a5-a7ee-8b3e316ac45a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:24.625595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35b87be0-e762-41a5-a7ee-8b3e316ac45a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:24.626101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35b87be0-e762-41a5-a7ee-8b3e316ac45a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:24.626589 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35b87be0-e762-41a5-a7ee-8b3e316ac45a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:24.627309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35b87be0-e762-41a5-a7ee-8b3e316ac45a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:24.627790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35b87be0-e762-41a5-a7ee-8b3e316ac45a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:24.628240 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35b87be0-e762-41a5-a7ee-8b3e316ac45a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:24.858013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-35b87be0-e762-41a5-a7ee-8b3e316ac45a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:24.866859 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-35b87be0-e762-41a5-a7ee-8b3e316ac45a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1678 microversion: 2.1 time: 0.253488 Aug 18 12:56:24.867465 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4733/7387] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:24 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:56:25.488585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4308c468-db25-4402-b9c5-bb27fc49ec0c req-0a748b6e-7cbe-40bb-bf2c-c584c24d1a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370a6c43-a41c-42b4-b4dd-82759d31aff8", "name": "network-vif-deleted", "tag": "af741034-8b57-4cc1-9fa9-806c61f3a112"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:56:25.503535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4308c468-db25-4402-b9c5-bb27fc49ec0c req-0a748b6e-7cbe-40bb-bf2c-c584c24d1a9a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:25.504043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4308c468-db25-4402-b9c5-bb27fc49ec0c req-0a748b6e-7cbe-40bb-bf2c-c584c24d1a9a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:25.504588 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4308c468-db25-4402-b9c5-bb27fc49ec0c req-0a748b6e-7cbe-40bb-bf2c-c584c24d1a9a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:25.517769 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4308c468-db25-4402-b9c5-bb27fc49ec0c req-0a748b6e-7cbe-40bb-bf2c-c584c24d1a9a service nova] Creating event network-vif-deleted:af741034-8b57-4cc1-9fa9-806c61f3a112 for instance 370a6c43-a41c-42b4-b4dd-82759d31aff8 on n-h2-853611-3 Aug 18 12:56:25.522883 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4308c468-db25-4402-b9c5-bb27fc49ec0c req-0a748b6e-7cbe-40bb-bf2c-c584c24d1a9a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039120 Aug 18 12:56:25.523560 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4734/7388] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:56:25.891939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3347c69a-d20d-45b8-a87d-9350f52bfe01 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:25.891939 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3347c69a-d20d-45b8-a87d-9350f52bfe01 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:25.898783 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347c69a-d20d-45b8-a87d-9350f52bfe01 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:25.899318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347c69a-d20d-45b8-a87d-9350f52bfe01 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:25.899969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347c69a-d20d-45b8-a87d-9350f52bfe01 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:25.900933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347c69a-d20d-45b8-a87d-9350f52bfe01 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:25.901587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347c69a-d20d-45b8-a87d-9350f52bfe01 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:25.902290 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347c69a-d20d-45b8-a87d-9350f52bfe01 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:25.946208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347c69a-d20d-45b8-a87d-9350f52bfe01 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:25.947673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347c69a-d20d-45b8-a87d-9350f52bfe01 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:25.948155 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3347c69a-d20d-45b8-a87d-9350f52bfe01 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:25.948640 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-3347c69a-d20d-45b8-a87d-9350f52bfe01 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lazy-loading 'fault' on Instance uuid 370a6c43-a41c-42b4-b4dd-82759d31aff8 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:56:25.994548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3347c69a-d20d-45b8-a87d-9350f52bfe01 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:26.002472 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3347c69a-d20d-45b8-a87d-9350f52bfe01 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 200 len: 1336 microversion: 2.1 time: 0.116561 Aug 18 12:56:26.002997 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4735/7389] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:25 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 1336 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:56:27.025289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bcd200bf-77db-470a-8dc6-7f3dd6b27655 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:27.026263 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bcd200bf-77db-470a-8dc6-7f3dd6b27655 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: 370a6c43-a41c-42b4-b4dd-82759d31aff8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:27.033737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcd200bf-77db-470a-8dc6-7f3dd6b27655 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:27.034243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcd200bf-77db-470a-8dc6-7f3dd6b27655 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:27.034749 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcd200bf-77db-470a-8dc6-7f3dd6b27655 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:27.035474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcd200bf-77db-470a-8dc6-7f3dd6b27655 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:27.035950 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcd200bf-77db-470a-8dc6-7f3dd6b27655 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:27.036401 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bcd200bf-77db-470a-8dc6-7f3dd6b27655 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:27.050661 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-bcd200bf-77db-470a-8dc6-7f3dd6b27655 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] HTTP exception thrown: Instance 370a6c43-a41c-42b4-b4dd-82759d31aff8 could not be found. Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bcd200bf-77db-470a-8dc6-7f3dd6b27655 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Request method failure captured: Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 HTTP/1.1 Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jX83l5slugRA8Or8JXAAVqtjBcxQ3WEmrbu2MTRDYUNSA6sdTebRlFsYf6nHTl56IXON0so4UlohuXwT2p0nAy0kVekg6269oXoipmhXjuy99wLTHc3DfA42IfQNh_swg3Ht19K0HEONYpXBMfRxyIOGyky-J8vKIG2UTKIuTIO658 Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 7d023eb3bcae40c5a9fc1459a886ef5c Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestShelveInstance-1957773267 Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7d023eb3bcae40c5a9fc1459a886ef5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7d023eb3bcae40c5a9fc1459a886ef5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7d023eb3bcae40c5a9fc1459a886ef5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7d023eb3bcae40c5a9fc1459a886ef5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestShelveInstance-1957773267 Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 7d023eb3bcae40c5a9fc1459a886ef5c Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestShelveInstance-1957773267 Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestShelveInstance-1957773267-project Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 9b92adb3a9c84d9da71647453003126b Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestShelveInstance-1957773267-project Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance 370a6c43-a41c-42b4-b4dd-82759d31aff8 could not be found. Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': '370a6c43-a41c-42b4-b4dd-82759d31aff8'} Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 370a6c43-a41c-42b4-b4dd-82759d31aff8 could not be found. Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 370a6c43-a41c-42b4-b4dd-82759d31aff8 could not be found. Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 12:56:27.052386 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:56:27.057736 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 12:56:27.057736 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 12:56:27.057736 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 12:56:27.057736 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 12:56:27.057736 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 12:56:27.057736 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 370a6c43-a41c-42b4-b4dd-82759d31aff8 could not be found. Aug 18 12:56:27.057736 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 12:56:27.057736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bcd200bf-77db-470a-8dc6-7f3dd6b27655 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Returning 404 to user: Instance 370a6c43-a41c-42b4-b4dd-82759d31aff8 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 12:56:27.057736 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bcd200bf-77db-470a-8dc6-7f3dd6b27655 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8" status: 404 len: 111 microversion: 2.1 time: 0.033426 Aug 18 12:56:27.057736 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4736/7390] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:27 2022] GET /compute/v2.1/servers/370a6c43-a41c-42b4-b4dd-82759d31aff8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 12:56:27.225347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e387fc74-8745-4b96-bbde-59dce2dafdbb tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '.version_select at 0x7f519e827280>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:27.255942 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e387fc74-8745-4b96-bbde-59dce2dafdbb tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1808770185" status: 202 len: 0 microversion: 2.1 time: 0.034773 Aug 18 12:56:27.256537 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4737/7391] 10.222.0.73 () {58 vars in 1254 bytes} [Thu Aug 18 12:56:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1808770185 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:56:27.280569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8d5e4011-b80d-4586-aa42-87ad57771598 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Action: 'create', calling method: .version_select at 0x7f51adb8f8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-833698371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRYGWTNg0+Ov/edkBjmwSSrV2R6FOQm4QHXP3r0MCQmiDpqDMBcga0I4U7yVc3xxJHVF7pXpjEplJJuzevYBxS3u6M0lt4WBnxJIdFVvg6EzDNYnrcGiTz0M7Eq7+GMEQ=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:56:27.297723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-8d5e4011-b80d-4586-aa42-87ad57771598 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Getting quotas for project 7d023eb3bcae40c5a9fc1459a886ef5c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:56:27.303074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-8d5e4011-b80d-4586-aa42-87ad57771598 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Getting quotas for user 9b92adb3a9c84d9da71647453003126b and project 7d023eb3bcae40c5a9fc1459a886ef5c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:56:27.329355 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8d5e4011-b80d-4586-aa42-87ad57771598 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.053041 Aug 18 12:56:27.330061 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4738/7392] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 12:56:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:56:38.887311 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:56:38.887855 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:56:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:56:43.991206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:56:43.991998 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:56:43.992721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:56:43.997270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1765242979", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-833698371", "security_groups": [{"name": "tempest-secgroup-smoke-1543064516"}], "networks": [{"uuid": "18a835dc-9e30-4cfd-b9e1-3763d157e9dc"}], "block_device_mapping_v2": [{"uuid": "3bbaad97-9fdc-4f28-8a14-f5a8cda96fb2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:56:44.126570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] validate_networks() for [('18a835dc-9e30-4cfd-b9e1-3763d157e9dc', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 12:56:44.528644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 12:56:44.529065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 12:56:44.529573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 12:56:44.530032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 12:56:44.530495 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 12:56:44.539325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:44.539817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:44.540269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:44.541648 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:44.542119 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:44.542593 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:44.562412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Getting quotas for project 7d023eb3bcae40c5a9fc1459a886ef5c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 12:56:44.568038 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Getting quotas for user 9b92adb3a9c84d9da71647453003126b and project 7d023eb3bcae40c5a9fc1459a886ef5c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 12:56:44.629435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 12:56:44.631732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3bbaad97-9fdc-4f28-8a14-f5a8cda96fb2',volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 12:56:44.781273 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-83af20fb-ce14-4dcb-b1a6-58f90c421a97 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.791806 Aug 18 12:56:44.781845 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4739/7393] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 12:56:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 12:56:44.795525 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8dcb90fa-a62c-4b92-8b72-82eb00b8a4d8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:44.796198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8dcb90fa-a62c-4b92-8b72-82eb00b8a4d8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:44.853645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8dcb90fa-a62c-4b92-8b72-82eb00b8a4d8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:44.862953 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8dcb90fa-a62c-4b92-8b72-82eb00b8a4d8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1088 microversion: 2.1 time: 0.073380 Aug 18 12:56:44.863657 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4740/7394] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:44 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:56:45.884846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4c55e79b-e091-44c6-9fc3-4f342d83c315 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:45.885888 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4c55e79b-e091-44c6-9fc3-4f342d83c315 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:45.894151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c55e79b-e091-44c6-9fc3-4f342d83c315 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:45.894733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c55e79b-e091-44c6-9fc3-4f342d83c315 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:45.895139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c55e79b-e091-44c6-9fc3-4f342d83c315 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:45.896101 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c55e79b-e091-44c6-9fc3-4f342d83c315 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:45.896608 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c55e79b-e091-44c6-9fc3-4f342d83c315 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:45.897077 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4c55e79b-e091-44c6-9fc3-4f342d83c315 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:45.972297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-4c55e79b-e091-44c6-9fc3-4f342d83c315 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:45.983484 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4c55e79b-e091-44c6-9fc3-4f342d83c315 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1204 microversion: 2.1 time: 0.102867 Aug 18 12:56:45.984071 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4741/7395] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:45 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:56:47.005232 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2bc12396-d5d6-41b7-bec8-e048e2b0e25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:47.006663 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2bc12396-d5d6-41b7-bec8-e048e2b0e25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:47.014644 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bc12396-d5d6-41b7-bec8-e048e2b0e25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:47.015159 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bc12396-d5d6-41b7-bec8-e048e2b0e25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:47.015641 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bc12396-d5d6-41b7-bec8-e048e2b0e25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:47.016375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bc12396-d5d6-41b7-bec8-e048e2b0e25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:47.016846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bc12396-d5d6-41b7-bec8-e048e2b0e25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:47.017318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2bc12396-d5d6-41b7-bec8-e048e2b0e25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:47.174595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-2bc12396-d5d6-41b7-bec8-e048e2b0e25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:47.184239 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2bc12396-d5d6-41b7-bec8-e048e2b0e25e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1272 microversion: 2.1 time: 0.182808 Aug 18 12:56:47.185078 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4742/7396] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:47 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1272 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:56:47.272359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-6d522db6-ce2c-46a2-b989-556ca5c7743e req-bdfbeddf-8fba-4d59-b82e-805e84b667f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b558a8a3-cf37-412d-bb64-c0f1fc399fb8", "tag": "2a5699e1-5c48-483b-a814-b11318202a73"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:56:47.288543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6d522db6-ce2c-46a2-b989-556ca5c7743e req-bdfbeddf-8fba-4d59-b82e-805e84b667f0 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:47.289568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6d522db6-ce2c-46a2-b989-556ca5c7743e req-bdfbeddf-8fba-4d59-b82e-805e84b667f0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:47.291208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-6d522db6-ce2c-46a2-b989-556ca5c7743e req-bdfbeddf-8fba-4d59-b82e-805e84b667f0 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:47.306756 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-6d522db6-ce2c-46a2-b989-556ca5c7743e req-bdfbeddf-8fba-4d59-b82e-805e84b667f0 service nova] Creating event network-changed:2a5699e1-5c48-483b-a814-b11318202a73 for instance b558a8a3-cf37-412d-bb64-c0f1fc399fb8 on n-h1-853611-3 Aug 18 12:56:47.312414 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-6d522db6-ce2c-46a2-b989-556ca5c7743e req-bdfbeddf-8fba-4d59-b82e-805e84b667f0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051128 Aug 18 12:56:47.313660 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4743/7397] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:56:48.207868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-713addad-b0bf-4f8b-92ee-04322d915970 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:48.209384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-713addad-b0bf-4f8b-92ee-04322d915970 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:48.217920 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-713addad-b0bf-4f8b-92ee-04322d915970 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:48.218624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-713addad-b0bf-4f8b-92ee-04322d915970 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:48.219139 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-713addad-b0bf-4f8b-92ee-04322d915970 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:48.219964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-713addad-b0bf-4f8b-92ee-04322d915970 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:48.220516 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-713addad-b0bf-4f8b-92ee-04322d915970 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:48.221043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-713addad-b0bf-4f8b-92ee-04322d915970 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:48.367043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-713addad-b0bf-4f8b-92ee-04322d915970 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:48.375222 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-713addad-b0bf-4f8b-92ee-04322d915970 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1272 microversion: 2.1 time: 0.173396 Aug 18 12:56:48.376011 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4744/7398] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:48 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:56:49.397430 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1a74f020-bf42-42ad-9dc1-9660d3d4ab0e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:49.398127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1a74f020-bf42-42ad-9dc1-9660d3d4ab0e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:49.405742 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a74f020-bf42-42ad-9dc1-9660d3d4ab0e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:49.406253 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a74f020-bf42-42ad-9dc1-9660d3d4ab0e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:49.406740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a74f020-bf42-42ad-9dc1-9660d3d4ab0e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:49.407467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a74f020-bf42-42ad-9dc1-9660d3d4ab0e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:49.408045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a74f020-bf42-42ad-9dc1-9660d3d4ab0e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:49.408383 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1a74f020-bf42-42ad-9dc1-9660d3d4ab0e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:49.553696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1a74f020-bf42-42ad-9dc1-9660d3d4ab0e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:49.562556 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1a74f020-bf42-42ad-9dc1-9660d3d4ab0e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1272 microversion: 2.1 time: 0.169024 Aug 18 12:56:49.563145 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4745/7399] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:49 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:56:50.583725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f794a0a2-d708-4e0e-a359-7707bb47199c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:50.584400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f794a0a2-d708-4e0e-a359-7707bb47199c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:50.591780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f794a0a2-d708-4e0e-a359-7707bb47199c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:50.592295 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f794a0a2-d708-4e0e-a359-7707bb47199c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:50.592759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f794a0a2-d708-4e0e-a359-7707bb47199c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:50.593490 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f794a0a2-d708-4e0e-a359-7707bb47199c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:50.593968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f794a0a2-d708-4e0e-a359-7707bb47199c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:50.594417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f794a0a2-d708-4e0e-a359-7707bb47199c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:50.735156 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f794a0a2-d708-4e0e-a359-7707bb47199c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:50.743441 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f794a0a2-d708-4e0e-a359-7707bb47199c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1272 microversion: 2.1 time: 0.163697 Aug 18 12:56:50.744911 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4746/7400] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:50 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:56:51.765780 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-29984698-19b5-4711-bb75-3bc411c7e283 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:51.766468 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-29984698-19b5-4711-bb75-3bc411c7e283 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:51.773744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29984698-19b5-4711-bb75-3bc411c7e283 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:51.774246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29984698-19b5-4711-bb75-3bc411c7e283 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:51.774733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29984698-19b5-4711-bb75-3bc411c7e283 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:51.775776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29984698-19b5-4711-bb75-3bc411c7e283 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:51.776267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29984698-19b5-4711-bb75-3bc411c7e283 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:51.776726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29984698-19b5-4711-bb75-3bc411c7e283 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:51.918618 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-29984698-19b5-4711-bb75-3bc411c7e283 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:51.926872 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-29984698-19b5-4711-bb75-3bc411c7e283 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1260 microversion: 2.1 time: 0.164904 Aug 18 12:56:51.927589 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4747/7401] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:51 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:56:52.951808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-56a46fc1-9244-4dd4-989b-aa9968e63060 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:52.952863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-56a46fc1-9244-4dd4-989b-aa9968e63060 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:52.960722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56a46fc1-9244-4dd4-989b-aa9968e63060 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:52.961225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56a46fc1-9244-4dd4-989b-aa9968e63060 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:52.961673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56a46fc1-9244-4dd4-989b-aa9968e63060 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:52.962529 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56a46fc1-9244-4dd4-989b-aa9968e63060 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:52.963001 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56a46fc1-9244-4dd4-989b-aa9968e63060 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:52.963442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-56a46fc1-9244-4dd4-989b-aa9968e63060 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:53.114343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-56a46fc1-9244-4dd4-989b-aa9968e63060 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:53.122838 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-56a46fc1-9244-4dd4-989b-aa9968e63060 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1260 microversion: 2.1 time: 0.176400 Aug 18 12:56:53.123426 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4748/7402] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:52 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:56:54.144093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0d087041-5500-49f1-93ae-5d6852735176 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:54.144794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0d087041-5500-49f1-93ae-5d6852735176 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:54.152254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d087041-5500-49f1-93ae-5d6852735176 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:54.152774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d087041-5500-49f1-93ae-5d6852735176 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:54.153494 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d087041-5500-49f1-93ae-5d6852735176 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:54.154212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d087041-5500-49f1-93ae-5d6852735176 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:54.154716 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d087041-5500-49f1-93ae-5d6852735176 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:54.155195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0d087041-5500-49f1-93ae-5d6852735176 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:54.299653 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0d087041-5500-49f1-93ae-5d6852735176 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:54.307238 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0d087041-5500-49f1-93ae-5d6852735176 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1260 microversion: 2.1 time: 0.167141 Aug 18 12:56:54.307866 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4749/7403] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:54 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:56:55.329303 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ba4ef005-5560-4eab-b5d6-0479b6594361 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:55.329931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ba4ef005-5560-4eab-b5d6-0479b6594361 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:55.331937 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:56:55.332649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:56:55.339368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba4ef005-5560-4eab-b5d6-0479b6594361 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:55.339874 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba4ef005-5560-4eab-b5d6-0479b6594361 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:55.340328 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba4ef005-5560-4eab-b5d6-0479b6594361 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:55.341052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba4ef005-5560-4eab-b5d6-0479b6594361 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:55.341522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba4ef005-5560-4eab-b5d6-0479b6594361 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:55.341970 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ba4ef005-5560-4eab-b5d6-0479b6594361 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:55.480066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ba4ef005-5560-4eab-b5d6-0479b6594361 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:55.487735 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ba4ef005-5560-4eab-b5d6-0479b6594361 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1260 microversion: 2.1 time: 0.162658 Aug 18 12:56:55.488311 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4750/7404] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:55 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:56:56.509005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d2e3d349-5edb-4e58-9907-14fd2620b4e4 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:56.509697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d2e3d349-5edb-4e58-9907-14fd2620b4e4 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:56.517248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2e3d349-5edb-4e58-9907-14fd2620b4e4 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:56.517750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2e3d349-5edb-4e58-9907-14fd2620b4e4 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:56.518213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2e3d349-5edb-4e58-9907-14fd2620b4e4 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:56.518959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2e3d349-5edb-4e58-9907-14fd2620b4e4 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:56.519444 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2e3d349-5edb-4e58-9907-14fd2620b4e4 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:56.519891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d2e3d349-5edb-4e58-9907-14fd2620b4e4 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:56.653479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d2e3d349-5edb-4e58-9907-14fd2620b4e4 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:56.661108 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d2e3d349-5edb-4e58-9907-14fd2620b4e4 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1260 microversion: 2.1 time: 0.156117 Aug 18 12:56:56.661691 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4751/7405] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:56 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:56:57.681832 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8020042f-716c-4adb-a141-a39b301b2761 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:57.682915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8020042f-716c-4adb-a141-a39b301b2761 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:57.691305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8020042f-716c-4adb-a141-a39b301b2761 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:57.691817 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8020042f-716c-4adb-a141-a39b301b2761 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:57.692269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8020042f-716c-4adb-a141-a39b301b2761 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:57.693003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8020042f-716c-4adb-a141-a39b301b2761 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:57.693473 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8020042f-716c-4adb-a141-a39b301b2761 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:57.693915 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8020042f-716c-4adb-a141-a39b301b2761 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:57.835029 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8020042f-716c-4adb-a141-a39b301b2761 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:57.843530 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8020042f-716c-4adb-a141-a39b301b2761 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1260 microversion: 2.1 time: 0.166184 Aug 18 12:56:57.844300 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4752/7406] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:57 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:56:58.864331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-43a6d66b-2410-4f41-b650-2249791a7dd9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:56:58.865051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-43a6d66b-2410-4f41-b650-2249791a7dd9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:56:58.871897 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43a6d66b-2410-4f41-b650-2249791a7dd9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:58.872415 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43a6d66b-2410-4f41-b650-2249791a7dd9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:58.872943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43a6d66b-2410-4f41-b650-2249791a7dd9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:58.873775 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43a6d66b-2410-4f41-b650-2249791a7dd9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:56:58.874250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43a6d66b-2410-4f41-b650-2249791a7dd9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:56:58.874720 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-43a6d66b-2410-4f41-b650-2249791a7dd9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:56:59.009051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-43a6d66b-2410-4f41-b650-2249791a7dd9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:56:59.017978 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-43a6d66b-2410-4f41-b650-2249791a7dd9 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1260 microversion: 2.1 time: 0.157642 Aug 18 12:56:59.018589 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4753/7407] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:56:58 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:57:00.039360 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-94ee04ae-29ed-468b-958f-67f20f460837 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:57:00.040061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-94ee04ae-29ed-468b-958f-67f20f460837 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:57:00.047393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ee04ae-29ed-468b-958f-67f20f460837 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:57:00.047895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ee04ae-29ed-468b-958f-67f20f460837 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:57:00.048344 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ee04ae-29ed-468b-958f-67f20f460837 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:57:00.049061 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ee04ae-29ed-468b-958f-67f20f460837 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:57:00.049536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ee04ae-29ed-468b-958f-67f20f460837 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:57:00.050005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-94ee04ae-29ed-468b-958f-67f20f460837 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:57:00.193661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-94ee04ae-29ed-468b-958f-67f20f460837 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:57:00.202029 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-94ee04ae-29ed-468b-958f-67f20f460837 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1260 microversion: 2.1 time: 0.166672 Aug 18 12:57:00.202665 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4754/7408] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:57:00 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:57:01.223349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fa4c9185-e702-4093-8ee0-24cfcf464893 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:57:01.224032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fa4c9185-e702-4093-8ee0-24cfcf464893 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:57:01.230875 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4c9185-e702-4093-8ee0-24cfcf464893 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:57:01.231389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4c9185-e702-4093-8ee0-24cfcf464893 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:57:01.232850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4c9185-e702-4093-8ee0-24cfcf464893 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:57:01.233708 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4c9185-e702-4093-8ee0-24cfcf464893 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:57:01.234195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4c9185-e702-4093-8ee0-24cfcf464893 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:57:01.234958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fa4c9185-e702-4093-8ee0-24cfcf464893 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:57:01.368049 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fa4c9185-e702-4093-8ee0-24cfcf464893 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:57:01.376832 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fa4c9185-e702-4093-8ee0-24cfcf464893 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1260 microversion: 2.1 time: 0.157443 Aug 18 12:57:01.377420 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4755/7409] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:57:01 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:57:01.802867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5ccb8b51-142f-4fc1-9c3d-e0e4dcb279a4 req-2864f65d-c16f-49c3-b125-d6f33c36dbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b558a8a3-cf37-412d-bb64-c0f1fc399fb8", "name": "network-vif-plugged", "status": "completed", "tag": "2a5699e1-5c48-483b-a814-b11318202a73"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:57:01.814984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5ccb8b51-142f-4fc1-9c3d-e0e4dcb279a4 req-2864f65d-c16f-49c3-b125-d6f33c36dbb7 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:57:01.815517 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5ccb8b51-142f-4fc1-9c3d-e0e4dcb279a4 req-2864f65d-c16f-49c3-b125-d6f33c36dbb7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:57:01.815969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5ccb8b51-142f-4fc1-9c3d-e0e4dcb279a4 req-2864f65d-c16f-49c3-b125-d6f33c36dbb7 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:57:01.828974 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5ccb8b51-142f-4fc1-9c3d-e0e4dcb279a4 req-2864f65d-c16f-49c3-b125-d6f33c36dbb7 service nova] Creating event network-vif-plugged:2a5699e1-5c48-483b-a814-b11318202a73 for instance b558a8a3-cf37-412d-bb64-c0f1fc399fb8 on n-h1-853611-3 Aug 18 12:57:01.834323 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5ccb8b51-142f-4fc1-9c3d-e0e4dcb279a4 req-2864f65d-c16f-49c3-b125-d6f33c36dbb7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035720 Aug 18 12:57:01.834976 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4756/7410] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:57:02.398081 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-381595bc-42a6-4d7d-a25d-fcdbdeec5f73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:57:02.398818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-381595bc-42a6-4d7d-a25d-fcdbdeec5f73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:57:02.406299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-381595bc-42a6-4d7d-a25d-fcdbdeec5f73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:57:02.406826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-381595bc-42a6-4d7d-a25d-fcdbdeec5f73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:57:02.407271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-381595bc-42a6-4d7d-a25d-fcdbdeec5f73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:57:02.407976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-381595bc-42a6-4d7d-a25d-fcdbdeec5f73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:57:02.408441 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-381595bc-42a6-4d7d-a25d-fcdbdeec5f73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:57:02.408879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-381595bc-42a6-4d7d-a25d-fcdbdeec5f73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:57:02.546941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-381595bc-42a6-4d7d-a25d-fcdbdeec5f73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:57:02.554820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-381595bc-42a6-4d7d-a25d-fcdbdeec5f73 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1260 microversion: 2.1 time: 0.161072 Aug 18 12:57:02.555404 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4757/7411] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:57:02 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:57:03.576556 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-10e00a68-427f-4e2e-88f3-4b4710f3db39 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:57:03.577217 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-10e00a68-427f-4e2e-88f3-4b4710f3db39 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:57:03.584151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10e00a68-427f-4e2e-88f3-4b4710f3db39 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:57:03.584651 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10e00a68-427f-4e2e-88f3-4b4710f3db39 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:57:03.585111 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10e00a68-427f-4e2e-88f3-4b4710f3db39 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:57:03.585826 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10e00a68-427f-4e2e-88f3-4b4710f3db39 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:57:03.586291 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10e00a68-427f-4e2e-88f3-4b4710f3db39 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:57:03.586769 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-10e00a68-427f-4e2e-88f3-4b4710f3db39 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:57:03.604722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=100 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:57:03.733684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-10e00a68-427f-4e2e-88f3-4b4710f3db39 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:57:03.741601 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-10e00a68-427f-4e2e-88f3-4b4710f3db39 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1444 microversion: 2.1 time: 0.169923 Aug 18 12:57:03.742189 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4758/7412] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:57:03 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:57:03.761967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ee4c7a7a-769c-45db-b762-9feb1921145e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:57:03.762636 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ee4c7a7a-769c-45db-b762-9feb1921145e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:57:03.770345 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee4c7a7a-769c-45db-b762-9feb1921145e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:57:03.771198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee4c7a7a-769c-45db-b762-9feb1921145e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:57:03.772023 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee4c7a7a-769c-45db-b762-9feb1921145e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:57:03.773297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee4c7a7a-769c-45db-b762-9feb1921145e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:57:03.773787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee4c7a7a-769c-45db-b762-9feb1921145e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:57:03.774246 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee4c7a7a-769c-45db-b762-9feb1921145e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:57:03.911404 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ee4c7a7a-769c-45db-b762-9feb1921145e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:57:03.919759 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ee4c7a7a-769c-45db-b762-9feb1921145e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1444 microversion: 2.1 time: 0.160784 Aug 18 12:57:03.920414 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4759/7413] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:57:03 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:57:05.546991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-ecd8fc99-ce56-4fa6-84d6-0c027d4bfaab req-101f1ecc-db08-42e4-bf54-48dda84c02c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b558a8a3-cf37-412d-bb64-c0f1fc399fb8", "tag": "2a5699e1-5c48-483b-a814-b11318202a73"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:57:05.557829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ecd8fc99-ce56-4fa6-84d6-0c027d4bfaab req-101f1ecc-db08-42e4-bf54-48dda84c02c9 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:57:05.558639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ecd8fc99-ce56-4fa6-84d6-0c027d4bfaab req-101f1ecc-db08-42e4-bf54-48dda84c02c9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:57:05.559092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-ecd8fc99-ce56-4fa6-84d6-0c027d4bfaab req-101f1ecc-db08-42e4-bf54-48dda84c02c9 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:57:05.571912 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-ecd8fc99-ce56-4fa6-84d6-0c027d4bfaab req-101f1ecc-db08-42e4-bf54-48dda84c02c9 service nova] Creating event network-changed:2a5699e1-5c48-483b-a814-b11318202a73 for instance b558a8a3-cf37-412d-bb64-c0f1fc399fb8 on n-h1-853611-3 Aug 18 12:57:05.577824 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-ecd8fc99-ce56-4fa6-84d6-0c027d4bfaab req-101f1ecc-db08-42e4-bf54-48dda84c02c9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034984 Aug 18 12:57:05.578356 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4760/7414] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:58:20.274273 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:58:20.274987 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:58:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:58:36.824993 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:58:36.825713 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:58:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 12:59:02.869923 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8703f2a-f745-4e9b-8afb-efe543c268f1] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 12:59:02.871332 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4032abb9-abb5-4d06-9561-525583ca96a6] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 12:59:02.872040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:59:02.872830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=10 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:59:02.944799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5a8fc816-ca30-4d72-bc5f-51d6375aa583 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:59:02.945573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5a8fc816-ca30-4d72-bc5f-51d6375aa583 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:02.952555 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a8fc816-ca30-4d72-bc5f-51d6375aa583 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:02.953067 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a8fc816-ca30-4d72-bc5f-51d6375aa583 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:02.953522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a8fc816-ca30-4d72-bc5f-51d6375aa583 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:02.954252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a8fc816-ca30-4d72-bc5f-51d6375aa583 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:02.954764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a8fc816-ca30-4d72-bc5f-51d6375aa583 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:02.955218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a8fc816-ca30-4d72-bc5f-51d6375aa583 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:02.980760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-5a8fc816-ca30-4d72-bc5f-51d6375aa583 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lazy-loading 'flavor' on Instance uuid b558a8a3-cf37-412d-bb64-c0f1fc399fb8 {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 12:59:03.069405 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5a8fc816-ca30-4d72-bc5f-51d6375aa583 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "POST /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8/action" status: 202 len: 0 microversion: 2.1 time: 0.201122 Aug 18 12:59:03.070037 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4761/7415] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:59:02 2022] POST /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 12:59:03.080995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f49c68e3-c2ad-4951-b1eb-d48a46fef9b8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:03.081771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f49c68e3-c2ad-4951-b1eb-d48a46fef9b8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:03.088806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f49c68e3-c2ad-4951-b1eb-d48a46fef9b8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:03.089311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f49c68e3-c2ad-4951-b1eb-d48a46fef9b8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:03.090007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f49c68e3-c2ad-4951-b1eb-d48a46fef9b8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:03.090877 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f49c68e3-c2ad-4951-b1eb-d48a46fef9b8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:03.091309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f49c68e3-c2ad-4951-b1eb-d48a46fef9b8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:03.091758 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f49c68e3-c2ad-4951-b1eb-d48a46fef9b8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:03.243952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f49c68e3-c2ad-4951-b1eb-d48a46fef9b8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:03.252575 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f49c68e3-c2ad-4951-b1eb-d48a46fef9b8 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1568 microversion: 2.1 time: 0.177669 Aug 18 12:59:03.253162 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4762/7416] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:03 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:04.276238 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9dd23b0e-c274-47a8-8f19-d89fd2dea705 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:04.277092 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9dd23b0e-c274-47a8-8f19-d89fd2dea705 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:04.292225 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9dd23b0e-c274-47a8-8f19-d89fd2dea705 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:04.292741 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9dd23b0e-c274-47a8-8f19-d89fd2dea705 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:04.293222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9dd23b0e-c274-47a8-8f19-d89fd2dea705 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:04.293958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9dd23b0e-c274-47a8-8f19-d89fd2dea705 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:04.294458 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9dd23b0e-c274-47a8-8f19-d89fd2dea705 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:04.294898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9dd23b0e-c274-47a8-8f19-d89fd2dea705 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:04.300167 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] [4032abb9-abb5-4d06-9561-525583ca96a6] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 55042. Aug 18 12:59:04.302578 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8703f2a-f745-4e9b-8afb-efe543c268f1] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 55040. Aug 18 12:59:04.459573 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9dd23b0e-c274-47a8-8f19-d89fd2dea705 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:04.469252 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9dd23b0e-c274-47a8-8f19-d89fd2dea705 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1568 microversion: 2.1 time: 0.199181 Aug 18 12:59:04.469849 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4763/7417] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:04 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:05.491393 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-be80c5da-1d5b-4ef3-84b2-789ef2f917a0 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:05.492131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-be80c5da-1d5b-4ef3-84b2-789ef2f917a0 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:05.499560 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be80c5da-1d5b-4ef3-84b2-789ef2f917a0 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:05.500074 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be80c5da-1d5b-4ef3-84b2-789ef2f917a0 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:05.500534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be80c5da-1d5b-4ef3-84b2-789ef2f917a0 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:05.501271 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be80c5da-1d5b-4ef3-84b2-789ef2f917a0 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:05.501750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be80c5da-1d5b-4ef3-84b2-789ef2f917a0 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:05.502197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-be80c5da-1d5b-4ef3-84b2-789ef2f917a0 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:05.652700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-be80c5da-1d5b-4ef3-84b2-789ef2f917a0 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:05.661504 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-be80c5da-1d5b-4ef3-84b2-789ef2f917a0 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1568 microversion: 2.1 time: 0.174125 Aug 18 12:59:05.662111 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4764/7418] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:05 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:06.685862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-452c8653-2566-4ce6-bcdb-b9cebd468cac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:06.686627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-452c8653-2566-4ce6-bcdb-b9cebd468cac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:06.694276 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-452c8653-2566-4ce6-bcdb-b9cebd468cac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:06.694825 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-452c8653-2566-4ce6-bcdb-b9cebd468cac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:06.695279 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-452c8653-2566-4ce6-bcdb-b9cebd468cac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:06.696006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-452c8653-2566-4ce6-bcdb-b9cebd468cac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:06.696475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-452c8653-2566-4ce6-bcdb-b9cebd468cac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:06.696928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-452c8653-2566-4ce6-bcdb-b9cebd468cac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:06.845816 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-452c8653-2566-4ce6-bcdb-b9cebd468cac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:06.853992 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-452c8653-2566-4ce6-bcdb-b9cebd468cac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1568 microversion: 2.1 time: 0.172701 Aug 18 12:59:06.854673 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4765/7419] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:06 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:07.876836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-adb42897-9de0-4abe-8dd0-b608e226b4f1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:07.878325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-adb42897-9de0-4abe-8dd0-b608e226b4f1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:07.886040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-adb42897-9de0-4abe-8dd0-b608e226b4f1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:07.886645 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-adb42897-9de0-4abe-8dd0-b608e226b4f1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:07.887103 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-adb42897-9de0-4abe-8dd0-b608e226b4f1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:07.887876 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-adb42897-9de0-4abe-8dd0-b608e226b4f1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:07.888357 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-adb42897-9de0-4abe-8dd0-b608e226b4f1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:07.888800 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-adb42897-9de0-4abe-8dd0-b608e226b4f1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:08.061537 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-adb42897-9de0-4abe-8dd0-b608e226b4f1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:08.071843 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-adb42897-9de0-4abe-8dd0-b608e226b4f1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1568 microversion: 2.1 time: 0.198079 Aug 18 12:59:08.072901 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4766/7420] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:07 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 12:59:09.094464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-50b150e4-c4a0-479b-ba16-51b8ae08e9a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:09.095243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-50b150e4-c4a0-479b-ba16-51b8ae08e9a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:09.103852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50b150e4-c4a0-479b-ba16-51b8ae08e9a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:09.104369 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50b150e4-c4a0-479b-ba16-51b8ae08e9a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:09.104831 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50b150e4-c4a0-479b-ba16-51b8ae08e9a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:09.105575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50b150e4-c4a0-479b-ba16-51b8ae08e9a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:09.106056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50b150e4-c4a0-479b-ba16-51b8ae08e9a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:09.106544 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-50b150e4-c4a0-479b-ba16-51b8ae08e9a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:09.264602 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-50b150e4-c4a0-479b-ba16-51b8ae08e9a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:09.272585 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-50b150e4-c4a0-479b-ba16-51b8ae08e9a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1568 microversion: 2.1 time: 0.182283 Aug 18 12:59:09.273192 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4767/7421] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:09 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:10.295318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e0976b1c-9ba8-4552-a5fc-583d1cbb8109 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:10.296323 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e0976b1c-9ba8-4552-a5fc-583d1cbb8109 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:10.303438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0976b1c-9ba8-4552-a5fc-583d1cbb8109 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:10.303788 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0976b1c-9ba8-4552-a5fc-583d1cbb8109 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:10.304244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0976b1c-9ba8-4552-a5fc-583d1cbb8109 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:10.304989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0976b1c-9ba8-4552-a5fc-583d1cbb8109 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:10.305454 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0976b1c-9ba8-4552-a5fc-583d1cbb8109 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:10.305896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0976b1c-9ba8-4552-a5fc-583d1cbb8109 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:10.460964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e0976b1c-9ba8-4552-a5fc-583d1cbb8109 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:10.470105 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e0976b1c-9ba8-4552-a5fc-583d1cbb8109 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1568 microversion: 2.1 time: 0.178781 Aug 18 12:59:10.470745 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4768/7422] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:10 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:11.491703 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-55106b01-e964-43a2-9d25-c39c22713007 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:11.492385 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-55106b01-e964-43a2-9d25-c39c22713007 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:11.500262 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55106b01-e964-43a2-9d25-c39c22713007 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:11.500767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55106b01-e964-43a2-9d25-c39c22713007 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:11.501229 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55106b01-e964-43a2-9d25-c39c22713007 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:11.501952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55106b01-e964-43a2-9d25-c39c22713007 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:11.502456 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55106b01-e964-43a2-9d25-c39c22713007 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:11.502910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-55106b01-e964-43a2-9d25-c39c22713007 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:11.642215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-55106b01-e964-43a2-9d25-c39c22713007 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:11.651745 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-55106b01-e964-43a2-9d25-c39c22713007 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1568 microversion: 2.1 time: 0.164051 Aug 18 12:59:11.652363 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4769/7423] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:11 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:12.675285 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6345f7fe-f171-46b4-a51b-8e046727e04a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:12.675943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6345f7fe-f171-46b4-a51b-8e046727e04a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:12.682982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6345f7fe-f171-46b4-a51b-8e046727e04a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:12.683486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6345f7fe-f171-46b4-a51b-8e046727e04a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:12.683949 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6345f7fe-f171-46b4-a51b-8e046727e04a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:12.684691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6345f7fe-f171-46b4-a51b-8e046727e04a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:12.685690 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6345f7fe-f171-46b4-a51b-8e046727e04a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:12.686236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6345f7fe-f171-46b4-a51b-8e046727e04a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:12.826392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6345f7fe-f171-46b4-a51b-8e046727e04a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:12.834269 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6345f7fe-f171-46b4-a51b-8e046727e04a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1568 microversion: 2.1 time: 0.162953 Aug 18 12:59:12.834881 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4770/7424] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:12 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:13.855417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-704534f7-fd06-4c05-99f2-4420c157331a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:13.856052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-704534f7-fd06-4c05-99f2-4420c157331a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:13.863177 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-704534f7-fd06-4c05-99f2-4420c157331a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:13.863681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-704534f7-fd06-4c05-99f2-4420c157331a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:13.864137 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-704534f7-fd06-4c05-99f2-4420c157331a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:13.864852 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-704534f7-fd06-4c05-99f2-4420c157331a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:13.865329 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-704534f7-fd06-4c05-99f2-4420c157331a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:13.865772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-704534f7-fd06-4c05-99f2-4420c157331a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:14.003162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-704534f7-fd06-4c05-99f2-4420c157331a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:14.010831 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-704534f7-fd06-4c05-99f2-4420c157331a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1568 microversion: 2.1 time: 0.159298 Aug 18 12:59:14.011407 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4771/7425] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:13 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:15.033642 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e0bfb259-6013-4855-a099-d04b65fc010e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:15.034325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e0bfb259-6013-4855-a099-d04b65fc010e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:15.041297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0bfb259-6013-4855-a099-d04b65fc010e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:15.041806 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0bfb259-6013-4855-a099-d04b65fc010e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:15.042264 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0bfb259-6013-4855-a099-d04b65fc010e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:15.043024 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0bfb259-6013-4855-a099-d04b65fc010e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:15.043505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0bfb259-6013-4855-a099-d04b65fc010e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:15.043948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e0bfb259-6013-4855-a099-d04b65fc010e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:15.183193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e0bfb259-6013-4855-a099-d04b65fc010e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:15.195226 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e0bfb259-6013-4855-a099-d04b65fc010e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1568 microversion: 2.1 time: 0.165915 Aug 18 12:59:15.195842 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4772/7426] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:15 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:16.220168 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-29c6333f-7c1a-4800-8589-a9037babfff1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:16.221562 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-29c6333f-7c1a-4800-8589-a9037babfff1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:16.229695 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29c6333f-7c1a-4800-8589-a9037babfff1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:16.230216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29c6333f-7c1a-4800-8589-a9037babfff1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:16.230728 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29c6333f-7c1a-4800-8589-a9037babfff1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:16.231522 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29c6333f-7c1a-4800-8589-a9037babfff1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:16.232984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29c6333f-7c1a-4800-8589-a9037babfff1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:16.233568 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-29c6333f-7c1a-4800-8589-a9037babfff1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:16.386980 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-29c6333f-7c1a-4800-8589-a9037babfff1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:16.394901 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-29c6333f-7c1a-4800-8589-a9037babfff1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1568 microversion: 2.1 time: 0.179565 Aug 18 12:59:16.395517 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4773/7427] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:16 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:17.416151 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-42a17c9a-6b66-4b29-a340-052eb409d57e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:17.416809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-42a17c9a-6b66-4b29-a340-052eb409d57e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:17.423895 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42a17c9a-6b66-4b29-a340-052eb409d57e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:17.424395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42a17c9a-6b66-4b29-a340-052eb409d57e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:17.424850 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42a17c9a-6b66-4b29-a340-052eb409d57e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:17.426017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42a17c9a-6b66-4b29-a340-052eb409d57e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:17.426521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42a17c9a-6b66-4b29-a340-052eb409d57e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:17.426972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-42a17c9a-6b66-4b29-a340-052eb409d57e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:17.572712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-42a17c9a-6b66-4b29-a340-052eb409d57e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:17.581766 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-42a17c9a-6b66-4b29-a340-052eb409d57e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1569 microversion: 2.1 time: 0.169596 Aug 18 12:59:17.582358 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4774/7428] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:17 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:17.604918 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aab43d1b-bdee-40e1-828d-4dac7a1fd890 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:59:17.605744 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aab43d1b-bdee-40e1-828d-4dac7a1fd890 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:17.612465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aab43d1b-bdee-40e1-828d-4dac7a1fd890 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:17.612971 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aab43d1b-bdee-40e1-828d-4dac7a1fd890 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:17.613423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aab43d1b-bdee-40e1-828d-4dac7a1fd890 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:17.614149 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aab43d1b-bdee-40e1-828d-4dac7a1fd890 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:17.614649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aab43d1b-bdee-40e1-828d-4dac7a1fd890 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:17.615094 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aab43d1b-bdee-40e1-828d-4dac7a1fd890 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:17.634792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:59:17.651317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aab43d1b-bdee-40e1-828d-4dac7a1fd890 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122210) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 18 12:59:17.720078 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aab43d1b-bdee-40e1-828d-4dac7a1fd890 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [ad34efef-0f66-4b0e-ae92-01c0f6623531] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 12:59:18.726643 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [None req-aab43d1b-bdee-40e1-828d-4dac7a1fd890 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [ad34efef-0f66-4b0e-ae92-01c0f6623531] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 55074. Aug 18 12:59:18.730492 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aab43d1b-bdee-40e1-828d-4dac7a1fd890 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "POST /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8/action" status: 202 len: 0 microversion: 2.1 time: 1.130229 Aug 18 12:59:18.731163 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4775/7429] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 12:59:17 2022] POST /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8/action => generated 0 bytes in 1132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 12:59:18.740169 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0280a749-d6c3-4627-893e-b8c26078b606 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:18.740848 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0280a749-d6c3-4627-893e-b8c26078b606 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:18.749426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0280a749-d6c3-4627-893e-b8c26078b606 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:18.749957 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0280a749-d6c3-4627-893e-b8c26078b606 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:18.750420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0280a749-d6c3-4627-893e-b8c26078b606 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:18.751195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0280a749-d6c3-4627-893e-b8c26078b606 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:18.751833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0280a749-d6c3-4627-893e-b8c26078b606 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:18.752251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0280a749-d6c3-4627-893e-b8c26078b606 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:18.897706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0280a749-d6c3-4627-893e-b8c26078b606 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:18.913257 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0280a749-d6c3-4627-893e-b8c26078b606 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1517 microversion: 2.1 time: 0.176965 Aug 18 12:59:18.913871 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4776/7430] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:18 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:19.935696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f80883a9-1e91-47e2-9c9a-edb0254f1fdd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:19.936630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f80883a9-1e91-47e2-9c9a-edb0254f1fdd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:19.943898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80883a9-1e91-47e2-9c9a-edb0254f1fdd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:19.944395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80883a9-1e91-47e2-9c9a-edb0254f1fdd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:19.944846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80883a9-1e91-47e2-9c9a-edb0254f1fdd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:19.945698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80883a9-1e91-47e2-9c9a-edb0254f1fdd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:19.946160 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80883a9-1e91-47e2-9c9a-edb0254f1fdd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:19.946671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f80883a9-1e91-47e2-9c9a-edb0254f1fdd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:20.105093 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f80883a9-1e91-47e2-9c9a-edb0254f1fdd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:20.113765 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f80883a9-1e91-47e2-9c9a-edb0254f1fdd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1517 microversion: 2.1 time: 0.182105 Aug 18 12:59:20.114351 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4777/7431] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:19 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:20.516677 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-bfd6979f-6f92-4acf-a286-7c5872584603 req-3eab6fee-8c9c-4871-a093-9f8e2ee18a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b558a8a3-cf37-412d-bb64-c0f1fc399fb8", "name": "network-vif-unplugged", "status": "completed", "tag": "2a5699e1-5c48-483b-a814-b11318202a73"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:59:20.526534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bfd6979f-6f92-4acf-a286-7c5872584603 req-3eab6fee-8c9c-4871-a093-9f8e2ee18a45 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:20.527032 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bfd6979f-6f92-4acf-a286-7c5872584603 req-3eab6fee-8c9c-4871-a093-9f8e2ee18a45 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:20.527479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-bfd6979f-6f92-4acf-a286-7c5872584603 req-3eab6fee-8c9c-4871-a093-9f8e2ee18a45 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:20.541109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.compute.server_external_events [req-bfd6979f-6f92-4acf-a286-7c5872584603 req-3eab6fee-8c9c-4871-a093-9f8e2ee18a45 service nova] Unable to find a host for instance b558a8a3-cf37-412d-bb64-c0f1fc399fb8. Dropping event network-vif-unplugged {{(pid=122210) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 12:59:20.542132 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-bfd6979f-6f92-4acf-a286-7c5872584603 req-3eab6fee-8c9c-4871-a093-9f8e2ee18a45 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.088976 Aug 18 12:59:20.542546 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4778/7432] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 92 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 18 12:59:21.135699 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ee9a159a-964a-4e80-ae71-e9249ca2197a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:21.136387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ee9a159a-964a-4e80-ae71-e9249ca2197a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:21.146371 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee9a159a-964a-4e80-ae71-e9249ca2197a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:21.146996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee9a159a-964a-4e80-ae71-e9249ca2197a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:21.147523 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee9a159a-964a-4e80-ae71-e9249ca2197a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:21.148316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee9a159a-964a-4e80-ae71-e9249ca2197a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:21.148789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee9a159a-964a-4e80-ae71-e9249ca2197a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:21.149337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ee9a159a-964a-4e80-ae71-e9249ca2197a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:21.282011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ee9a159a-964a-4e80-ae71-e9249ca2197a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:21.290393 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ee9a159a-964a-4e80-ae71-e9249ca2197a tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1517 microversion: 2.1 time: 0.158968 Aug 18 12:59:21.291024 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4779/7433] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:21 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:22.318211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-185009f1-f464-4e3c-808b-c5e07a19e284 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:22.318943 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-185009f1-f464-4e3c-808b-c5e07a19e284 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:22.326195 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-185009f1-f464-4e3c-808b-c5e07a19e284 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:22.326845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-185009f1-f464-4e3c-808b-c5e07a19e284 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:22.327416 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-185009f1-f464-4e3c-808b-c5e07a19e284 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:22.328143 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-185009f1-f464-4e3c-808b-c5e07a19e284 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:22.328624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-185009f1-f464-4e3c-808b-c5e07a19e284 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:22.329075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-185009f1-f464-4e3c-808b-c5e07a19e284 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:22.470748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-185009f1-f464-4e3c-808b-c5e07a19e284 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:22.478611 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-185009f1-f464-4e3c-808b-c5e07a19e284 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1517 microversion: 2.1 time: 0.169246 Aug 18 12:59:22.479191 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4780/7434] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:22 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:23.502395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-0e7a8039-61d3-486a-b43a-79dd665b583e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:23.503466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-0e7a8039-61d3-486a-b43a-79dd665b583e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:23.510296 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e7a8039-61d3-486a-b43a-79dd665b583e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:23.510871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e7a8039-61d3-486a-b43a-79dd665b583e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:23.511335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e7a8039-61d3-486a-b43a-79dd665b583e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:23.512075 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e7a8039-61d3-486a-b43a-79dd665b583e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:23.512554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e7a8039-61d3-486a-b43a-79dd665b583e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:23.513025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-0e7a8039-61d3-486a-b43a-79dd665b583e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:23.671868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-0e7a8039-61d3-486a-b43a-79dd665b583e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:23.680209 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-0e7a8039-61d3-486a-b43a-79dd665b583e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1519 microversion: 2.1 time: 0.182885 Aug 18 12:59:23.681157 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4781/7435] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:23 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:24.703390 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-70aaffbc-2324-470a-bc86-eb8d04829d0f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:24.704042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-70aaffbc-2324-470a-bc86-eb8d04829d0f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:24.711223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70aaffbc-2324-470a-bc86-eb8d04829d0f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:24.711731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70aaffbc-2324-470a-bc86-eb8d04829d0f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:24.712182 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70aaffbc-2324-470a-bc86-eb8d04829d0f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:24.712962 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70aaffbc-2324-470a-bc86-eb8d04829d0f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:24.713370 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70aaffbc-2324-470a-bc86-eb8d04829d0f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:24.713809 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-70aaffbc-2324-470a-bc86-eb8d04829d0f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:24.861617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-70aaffbc-2324-470a-bc86-eb8d04829d0f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:24.870030 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-70aaffbc-2324-470a-bc86-eb8d04829d0f tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1519 microversion: 2.1 time: 0.170529 Aug 18 12:59:24.870649 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4782/7436] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:24 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:25.892995 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c6a67f18-efa2-4ed1-aa61-4b47e766ee1b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:25.893647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c6a67f18-efa2-4ed1-aa61-4b47e766ee1b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:25.900540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6a67f18-efa2-4ed1-aa61-4b47e766ee1b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:25.901046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6a67f18-efa2-4ed1-aa61-4b47e766ee1b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:25.901504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6a67f18-efa2-4ed1-aa61-4b47e766ee1b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:25.902233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6a67f18-efa2-4ed1-aa61-4b47e766ee1b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:25.902736 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6a67f18-efa2-4ed1-aa61-4b47e766ee1b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:25.903183 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c6a67f18-efa2-4ed1-aa61-4b47e766ee1b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:26.048269 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c6a67f18-efa2-4ed1-aa61-4b47e766ee1b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:26.056605 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c6a67f18-efa2-4ed1-aa61-4b47e766ee1b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1519 microversion: 2.1 time: 0.168112 Aug 18 12:59:26.057216 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4783/7437] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:25 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:27.078261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e1a9bcba-3bc1-470f-a6cf-f5105cce65ac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:27.078972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e1a9bcba-3bc1-470f-a6cf-f5105cce65ac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:27.086145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1a9bcba-3bc1-470f-a6cf-f5105cce65ac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:27.086725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1a9bcba-3bc1-470f-a6cf-f5105cce65ac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:27.087191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1a9bcba-3bc1-470f-a6cf-f5105cce65ac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:27.087923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1a9bcba-3bc1-470f-a6cf-f5105cce65ac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:27.088406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1a9bcba-3bc1-470f-a6cf-f5105cce65ac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:27.088862 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e1a9bcba-3bc1-470f-a6cf-f5105cce65ac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:27.287088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e1a9bcba-3bc1-470f-a6cf-f5105cce65ac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:27.300417 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e1a9bcba-3bc1-470f-a6cf-f5105cce65ac tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1519 microversion: 2.1 time: 0.226408 Aug 18 12:59:27.301024 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4784/7438] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:27 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:28.321299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c5138b86-8a25-4c55-a5ce-906d09afdfa7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:28.322046 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c5138b86-8a25-4c55-a5ce-906d09afdfa7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:28.332212 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5138b86-8a25-4c55-a5ce-906d09afdfa7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:28.333082 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5138b86-8a25-4c55-a5ce-906d09afdfa7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:28.334952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5138b86-8a25-4c55-a5ce-906d09afdfa7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:28.334952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5138b86-8a25-4c55-a5ce-906d09afdfa7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:28.335512 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5138b86-8a25-4c55-a5ce-906d09afdfa7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:28.336327 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c5138b86-8a25-4c55-a5ce-906d09afdfa7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:28.479682 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c5138b86-8a25-4c55-a5ce-906d09afdfa7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:28.492066 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c5138b86-8a25-4c55-a5ce-906d09afdfa7 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1575 microversion: 2.1 time: 0.174656 Aug 18 12:59:28.492682 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4785/7439] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:28 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:29.380557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9ec4aab1-5677-4ce6-a8e1-3706eb753527 req-6e116af5-852b-4e03-b75d-40a749d152a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b558a8a3-cf37-412d-bb64-c0f1fc399fb8", "tag": "2a5699e1-5c48-483b-a814-b11318202a73"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:59:29.391059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9ec4aab1-5677-4ce6-a8e1-3706eb753527 req-6e116af5-852b-4e03-b75d-40a749d152a6 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:29.391624 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9ec4aab1-5677-4ce6-a8e1-3706eb753527 req-6e116af5-852b-4e03-b75d-40a749d152a6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:29.392005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9ec4aab1-5677-4ce6-a8e1-3706eb753527 req-6e116af5-852b-4e03-b75d-40a749d152a6 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:29.407068 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9ec4aab1-5677-4ce6-a8e1-3706eb753527 req-6e116af5-852b-4e03-b75d-40a749d152a6 service nova] Creating event network-changed:2a5699e1-5c48-483b-a814-b11318202a73 for instance b558a8a3-cf37-412d-bb64-c0f1fc399fb8 on n-h2-853611-3 Aug 18 12:59:29.412340 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9ec4aab1-5677-4ce6-a8e1-3706eb753527 req-6e116af5-852b-4e03-b75d-40a749d152a6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089057 Aug 18 12:59:29.413149 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4786/7440] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 12:59:29.514575 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-810c0a27-9cf8-43fe-9c87-5adf463163cd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:29.515299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-810c0a27-9cf8-43fe-9c87-5adf463163cd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:29.521543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-810c0a27-9cf8-43fe-9c87-5adf463163cd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:29.522036 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-810c0a27-9cf8-43fe-9c87-5adf463163cd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:29.522511 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-810c0a27-9cf8-43fe-9c87-5adf463163cd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:29.523228 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-810c0a27-9cf8-43fe-9c87-5adf463163cd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:29.523698 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-810c0a27-9cf8-43fe-9c87-5adf463163cd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:29.524132 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-810c0a27-9cf8-43fe-9c87-5adf463163cd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:29.677627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-810c0a27-9cf8-43fe-9c87-5adf463163cd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:29.688212 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-810c0a27-9cf8-43fe-9c87-5adf463163cd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1575 microversion: 2.1 time: 0.178657 Aug 18 12:59:29.689074 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4787/7441] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:29 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:30.714692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-08e96ff9-9565-4760-983a-7a7532782f1c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:30.715332 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-08e96ff9-9565-4760-983a-7a7532782f1c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:30.723006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e96ff9-9565-4760-983a-7a7532782f1c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:30.723598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e96ff9-9565-4760-983a-7a7532782f1c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:30.724056 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e96ff9-9565-4760-983a-7a7532782f1c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:30.724779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e96ff9-9565-4760-983a-7a7532782f1c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:30.725249 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e96ff9-9565-4760-983a-7a7532782f1c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:30.725684 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-08e96ff9-9565-4760-983a-7a7532782f1c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:30.898100 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-08e96ff9-9565-4760-983a-7a7532782f1c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:30.907090 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-08e96ff9-9565-4760-983a-7a7532782f1c tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1575 microversion: 2.1 time: 0.201523 Aug 18 12:59:30.907614 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4788/7442] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:30 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:31.930935 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-91733f4e-3ac0-4cfc-9bb3-9d43ac8d688e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:31.931609 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-91733f4e-3ac0-4cfc-9bb3-9d43ac8d688e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:31.939045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91733f4e-3ac0-4cfc-9bb3-9d43ac8d688e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:31.939550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91733f4e-3ac0-4cfc-9bb3-9d43ac8d688e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:31.940008 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91733f4e-3ac0-4cfc-9bb3-9d43ac8d688e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:31.940726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91733f4e-3ac0-4cfc-9bb3-9d43ac8d688e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:31.941204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91733f4e-3ac0-4cfc-9bb3-9d43ac8d688e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:31.941652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-91733f4e-3ac0-4cfc-9bb3-9d43ac8d688e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:32.088349 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-91733f4e-3ac0-4cfc-9bb3-9d43ac8d688e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:32.096508 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-91733f4e-3ac0-4cfc-9bb3-9d43ac8d688e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1575 microversion: 2.1 time: 0.169759 Aug 18 12:59:32.097114 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4789/7443] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:31 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:33.118317 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ce96e40c-5096-475f-ab7e-4fa19fb3f982 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:33.119026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ce96e40c-5096-475f-ab7e-4fa19fb3f982 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:33.121778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:59:33.127625 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce96e40c-5096-475f-ab7e-4fa19fb3f982 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:33.128124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce96e40c-5096-475f-ab7e-4fa19fb3f982 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:33.128579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce96e40c-5096-475f-ab7e-4fa19fb3f982 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:33.129289 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce96e40c-5096-475f-ab7e-4fa19fb3f982 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:33.129761 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce96e40c-5096-475f-ab7e-4fa19fb3f982 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:33.130203 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ce96e40c-5096-475f-ab7e-4fa19fb3f982 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:33.272433 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ce96e40c-5096-475f-ab7e-4fa19fb3f982 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:33.281241 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ce96e40c-5096-475f-ab7e-4fa19fb3f982 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1575 microversion: 2.1 time: 0.166795 Aug 18 12:59:33.281863 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4790/7444] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:33 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:34.303617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-93ab590c-9b6d-4597-9ec2-d5dbac249410 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:34.304340 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-93ab590c-9b6d-4597-9ec2-d5dbac249410 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:34.310985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93ab590c-9b6d-4597-9ec2-d5dbac249410 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:34.311483 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93ab590c-9b6d-4597-9ec2-d5dbac249410 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:34.311931 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93ab590c-9b6d-4597-9ec2-d5dbac249410 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:34.312632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93ab590c-9b6d-4597-9ec2-d5dbac249410 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:34.313096 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93ab590c-9b6d-4597-9ec2-d5dbac249410 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:34.313532 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-93ab590c-9b6d-4597-9ec2-d5dbac249410 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:34.472336 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-93ab590c-9b6d-4597-9ec2-d5dbac249410 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:34.480351 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-93ab590c-9b6d-4597-9ec2-d5dbac249410 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1575 microversion: 2.1 time: 0.180940 Aug 18 12:59:34.480945 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4791/7445] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:34 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:35.502760 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-483dd58b-01e0-4b16-bef2-0ff2b115d3df tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:35.503428 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-483dd58b-01e0-4b16-bef2-0ff2b115d3df tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:35.510318 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-483dd58b-01e0-4b16-bef2-0ff2b115d3df tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:35.510839 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-483dd58b-01e0-4b16-bef2-0ff2b115d3df tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:35.511288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-483dd58b-01e0-4b16-bef2-0ff2b115d3df tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:35.511997 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-483dd58b-01e0-4b16-bef2-0ff2b115d3df tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:35.512467 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-483dd58b-01e0-4b16-bef2-0ff2b115d3df tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:35.512948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-483dd58b-01e0-4b16-bef2-0ff2b115d3df tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:35.532689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 12:59:35.653398 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-483dd58b-01e0-4b16-bef2-0ff2b115d3df tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:35.661765 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-483dd58b-01e0-4b16-bef2-0ff2b115d3df tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1575 microversion: 2.1 time: 0.162995 Aug 18 12:59:35.662368 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4792/7446] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:35 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:36.683711 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-07ec7b39-6cfa-495e-b0bd-c9a5a975e6a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:36.684354 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-07ec7b39-6cfa-495e-b0bd-c9a5a975e6a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:36.694231 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07ec7b39-6cfa-495e-b0bd-c9a5a975e6a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:36.694773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07ec7b39-6cfa-495e-b0bd-c9a5a975e6a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:36.695236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07ec7b39-6cfa-495e-b0bd-c9a5a975e6a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:36.697916 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07ec7b39-6cfa-495e-b0bd-c9a5a975e6a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:36.698440 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07ec7b39-6cfa-495e-b0bd-c9a5a975e6a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:36.698908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-07ec7b39-6cfa-495e-b0bd-c9a5a975e6a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:36.844985 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-07ec7b39-6cfa-495e-b0bd-c9a5a975e6a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:36.853117 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-07ec7b39-6cfa-495e-b0bd-c9a5a975e6a1 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1575 microversion: 2.1 time: 0.173392 Aug 18 12:59:36.853718 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4793/7447] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:36 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:37.875012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9df20292-6872-44e8-94c6-3cf348f187e5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:37.875678 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9df20292-6872-44e8-94c6-3cf348f187e5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:37.882722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9df20292-6872-44e8-94c6-3cf348f187e5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:37.883223 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9df20292-6872-44e8-94c6-3cf348f187e5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:37.883667 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9df20292-6872-44e8-94c6-3cf348f187e5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:37.884396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9df20292-6872-44e8-94c6-3cf348f187e5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:37.884860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9df20292-6872-44e8-94c6-3cf348f187e5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:37.885294 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9df20292-6872-44e8-94c6-3cf348f187e5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:38.028746 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9df20292-6872-44e8-94c6-3cf348f187e5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:38.037543 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9df20292-6872-44e8-94c6-3cf348f187e5 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1575 microversion: 2.1 time: 0.166372 Aug 18 12:59:38.038137 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4794/7448] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:37 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:39.059047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3bf82997-50fb-4713-9b83-ff05f06f9737 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:39.059771 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3bf82997-50fb-4713-9b83-ff05f06f9737 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:39.067521 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bf82997-50fb-4713-9b83-ff05f06f9737 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:39.068042 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bf82997-50fb-4713-9b83-ff05f06f9737 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:39.068500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bf82997-50fb-4713-9b83-ff05f06f9737 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:39.069233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bf82997-50fb-4713-9b83-ff05f06f9737 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:39.069718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bf82997-50fb-4713-9b83-ff05f06f9737 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:39.070174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bf82997-50fb-4713-9b83-ff05f06f9737 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:39.213420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3bf82997-50fb-4713-9b83-ff05f06f9737 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:39.222256 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3bf82997-50fb-4713-9b83-ff05f06f9737 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1575 microversion: 2.1 time: 0.167166 Aug 18 12:59:39.222880 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4795/7449] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:39 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:40.244135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-11049e20-d4de-4f64-ae34-d76535b97f47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:40.244824 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-11049e20-d4de-4f64-ae34-d76535b97f47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:40.252737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11049e20-d4de-4f64-ae34-d76535b97f47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:40.253252 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11049e20-d4de-4f64-ae34-d76535b97f47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:40.253712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11049e20-d4de-4f64-ae34-d76535b97f47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:40.254471 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11049e20-d4de-4f64-ae34-d76535b97f47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:40.254952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11049e20-d4de-4f64-ae34-d76535b97f47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:40.255400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-11049e20-d4de-4f64-ae34-d76535b97f47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:40.401882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-11049e20-d4de-4f64-ae34-d76535b97f47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:40.410840 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-11049e20-d4de-4f64-ae34-d76535b97f47 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1575 microversion: 2.1 time: 0.170626 Aug 18 12:59:40.411433 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4796/7450] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:40 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:41.084384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7bf50ca2-53f0-4d15-9ffe-e2acf5b89cf9 req-8fbdd9d2-2c32-40e1-bd6b-565bc0bfca31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b558a8a3-cf37-412d-bb64-c0f1fc399fb8", "name": "network-vif-plugged", "status": "completed", "tag": "2a5699e1-5c48-483b-a814-b11318202a73"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 12:59:41.095097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7bf50ca2-53f0-4d15-9ffe-e2acf5b89cf9 req-8fbdd9d2-2c32-40e1-bd6b-565bc0bfca31 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:41.095361 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7bf50ca2-53f0-4d15-9ffe-e2acf5b89cf9 req-8fbdd9d2-2c32-40e1-bd6b-565bc0bfca31 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:41.096598 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7bf50ca2-53f0-4d15-9ffe-e2acf5b89cf9 req-8fbdd9d2-2c32-40e1-bd6b-565bc0bfca31 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:41.109788 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7bf50ca2-53f0-4d15-9ffe-e2acf5b89cf9 req-8fbdd9d2-2c32-40e1-bd6b-565bc0bfca31 service nova] Creating event network-vif-plugged:2a5699e1-5c48-483b-a814-b11318202a73 for instance b558a8a3-cf37-412d-bb64-c0f1fc399fb8 on n-h2-853611-3 Aug 18 12:59:41.115263 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7bf50ca2-53f0-4d15-9ffe-e2acf5b89cf9 req-8fbdd9d2-2c32-40e1-bd6b-565bc0bfca31 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034662 Aug 18 12:59:41.115873 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4797/7451] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 12:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 12:59:41.437620 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-36edb398-834f-40ed-9f87-637fced1d73d tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:41.438358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-36edb398-834f-40ed-9f87-637fced1d73d tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:41.445911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36edb398-834f-40ed-9f87-637fced1d73d tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:41.446406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36edb398-834f-40ed-9f87-637fced1d73d tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:41.446893 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36edb398-834f-40ed-9f87-637fced1d73d tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:41.447933 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36edb398-834f-40ed-9f87-637fced1d73d tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:41.448414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36edb398-834f-40ed-9f87-637fced1d73d tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:41.448861 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-36edb398-834f-40ed-9f87-637fced1d73d tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:41.594866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-36edb398-834f-40ed-9f87-637fced1d73d tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:41.602783 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-36edb398-834f-40ed-9f87-637fced1d73d tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1575 microversion: 2.1 time: 0.170408 Aug 18 12:59:41.603380 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4798/7452] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:41 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:42.624619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3c70ba63-55e0-4aff-93f5-06c1b6402710 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 12:59:42.625726 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3c70ba63-55e0-4aff-93f5-06c1b6402710 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 12:59:42.632319 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c70ba63-55e0-4aff-93f5-06c1b6402710 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:42.632820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c70ba63-55e0-4aff-93f5-06c1b6402710 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:42.633270 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c70ba63-55e0-4aff-93f5-06c1b6402710 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:42.633984 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c70ba63-55e0-4aff-93f5-06c1b6402710 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 12:59:42.634470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c70ba63-55e0-4aff-93f5-06c1b6402710 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 12:59:42.634911 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c70ba63-55e0-4aff-93f5-06c1b6402710 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 12:59:42.778784 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3c70ba63-55e0-4aff-93f5-06c1b6402710 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 12:59:42.787567 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3c70ba63-55e0-4aff-93f5-06c1b6402710 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1562 microversion: 2.1 time: 0.167384 Aug 18 12:59:42.788160 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4799/7453] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 12:59:42 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 12:59:58.897161 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 12:59:58.898416 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 12:59:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 13:00:56.888003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-2934fc42-044d-413b-9861-7fc3a2349c64 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:00:56.888632 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2934fc42-044d-413b-9861-7fc3a2349c64 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:00:56.891420 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=19 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 13:00:56.892043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=40 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 13:00:56.900131 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2934fc42-044d-413b-9861-7fc3a2349c64 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:00:56.900697 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2934fc42-044d-413b-9861-7fc3a2349c64 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:00:56.901199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2934fc42-044d-413b-9861-7fc3a2349c64 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:00:56.902000 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2934fc42-044d-413b-9861-7fc3a2349c64 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:00:56.902498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2934fc42-044d-413b-9861-7fc3a2349c64 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:00:56.902965 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-2934fc42-044d-413b-9861-7fc3a2349c64 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:00:56.933564 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-2934fc42-044d-413b-9861-7fc3a2349c64 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 13:00:57.023363 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-2934fc42-044d-413b-9861-7fc3a2349c64 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 204 len: 0 microversion: 2.1 time: 0.141213 Aug 18 13:00:57.024810 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4800/7454] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 13:00:56 2022] DELETE /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 13:00:57.030248 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-882dc879-5b4c-4c8c-b175-f6bb851edb37 req-3658a09a-7ff4-4f4b-8ed0-23131530b53b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b558a8a3-cf37-412d-bb64-c0f1fc399fb8", "tag": "2a5699e1-5c48-483b-a814-b11318202a73"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:00:57.041896 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-882dc879-5b4c-4c8c-b175-f6bb851edb37 req-3658a09a-7ff4-4f4b-8ed0-23131530b53b service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:00:57.042872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-882dc879-5b4c-4c8c-b175-f6bb851edb37 req-3658a09a-7ff4-4f4b-8ed0-23131530b53b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:00:57.042872 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-882dc879-5b4c-4c8c-b175-f6bb851edb37 req-3658a09a-7ff4-4f4b-8ed0-23131530b53b service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:00:57.055425 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-882dc879-5b4c-4c8c-b175-f6bb851edb37 req-3658a09a-7ff4-4f4b-8ed0-23131530b53b service nova] Creating event network-changed:2a5699e1-5c48-483b-a814-b11318202a73 for instance b558a8a3-cf37-412d-bb64-c0f1fc399fb8 on n-h2-853611-3 Aug 18 13:00:57.060798 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-882dc879-5b4c-4c8c-b175-f6bb851edb37 req-3658a09a-7ff4-4f4b-8ed0-23131530b53b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034597 Aug 18 13:00:57.061430 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4801/7455] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 13:00:57.066836 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8bd5462-0ad2-4281-bbf1-2cd18163857b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:00:57.067574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e8bd5462-0ad2-4281-bbf1-2cd18163857b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:00:57.075251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8bd5462-0ad2-4281-bbf1-2cd18163857b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:00:57.075767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8bd5462-0ad2-4281-bbf1-2cd18163857b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:00:57.076224 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8bd5462-0ad2-4281-bbf1-2cd18163857b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:00:57.076963 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8bd5462-0ad2-4281-bbf1-2cd18163857b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:00:57.077442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8bd5462-0ad2-4281-bbf1-2cd18163857b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:00:57.077968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8bd5462-0ad2-4281-bbf1-2cd18163857b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:00:57.236990 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e8bd5462-0ad2-4281-bbf1-2cd18163857b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:00:57.246684 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e8bd5462-0ad2-4281-bbf1-2cd18163857b tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1568 microversion: 2.1 time: 0.184008 Aug 18 13:00:57.247620 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4802/7456] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:00:57 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 13:00:58.270097 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-97932976-13c8-49ca-8512-c63c91eed8ef tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:00:58.271013 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-97932976-13c8-49ca-8512-c63c91eed8ef tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:00:58.279534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97932976-13c8-49ca-8512-c63c91eed8ef tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:00:58.280040 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97932976-13c8-49ca-8512-c63c91eed8ef tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:00:58.280664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97932976-13c8-49ca-8512-c63c91eed8ef tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:00:58.281234 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97932976-13c8-49ca-8512-c63c91eed8ef tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:00:58.281696 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97932976-13c8-49ca-8512-c63c91eed8ef tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:00:58.282127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-97932976-13c8-49ca-8512-c63c91eed8ef tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:00:58.439358 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-97932976-13c8-49ca-8512-c63c91eed8ef tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:00:58.447906 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-97932976-13c8-49ca-8512-c63c91eed8ef tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1568 microversion: 2.1 time: 0.182520 Aug 18 13:00:58.448484 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4803/7457] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:00:58 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:00:59.062193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-7973bd31-bf95-42d4-8c49-b29c4828f85e req-383eb838-78f7-4d45-b3e7-df00c79ab62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b558a8a3-cf37-412d-bb64-c0f1fc399fb8", "name": "network-vif-deleted", "tag": "2a5699e1-5c48-483b-a814-b11318202a73"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:00:59.078574 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7973bd31-bf95-42d4-8c49-b29c4828f85e req-383eb838-78f7-4d45-b3e7-df00c79ab62c service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:00:59.079216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7973bd31-bf95-42d4-8c49-b29c4828f85e req-383eb838-78f7-4d45-b3e7-df00c79ab62c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:00:59.079693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-7973bd31-bf95-42d4-8c49-b29c4828f85e req-383eb838-78f7-4d45-b3e7-df00c79ab62c service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:00:59.091757 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-7973bd31-bf95-42d4-8c49-b29c4828f85e req-383eb838-78f7-4d45-b3e7-df00c79ab62c service nova] Creating event network-vif-deleted:2a5699e1-5c48-483b-a814-b11318202a73 for instance b558a8a3-cf37-412d-bb64-c0f1fc399fb8 on n-h2-853611-3 Aug 18 13:00:59.096925 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-7973bd31-bf95-42d4-8c49-b29c4828f85e req-383eb838-78f7-4d45-b3e7-df00c79ab62c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094507 Aug 18 13:00:59.097438 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4804/7458] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 13:00:59.470823 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-01170be0-2ead-42a3-800e-0e96cffe79fd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:00:59.471538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-01170be0-2ead-42a3-800e-0e96cffe79fd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:00:59.479352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01170be0-2ead-42a3-800e-0e96cffe79fd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:00:59.479878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01170be0-2ead-42a3-800e-0e96cffe79fd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:00:59.480335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01170be0-2ead-42a3-800e-0e96cffe79fd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:00:59.481071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01170be0-2ead-42a3-800e-0e96cffe79fd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:00:59.481554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01170be0-2ead-42a3-800e-0e96cffe79fd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:00:59.482005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-01170be0-2ead-42a3-800e-0e96cffe79fd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:00:59.557554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-01170be0-2ead-42a3-800e-0e96cffe79fd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:00:59.565783 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-01170be0-2ead-42a3-800e-0e96cffe79fd tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1219 microversion: 2.1 time: 0.100120 Aug 18 13:00:59.566406 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4805/7459] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:00:59 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 13:01:00.587389 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3c15a956-0dd6-4bec-b56b-2924b2c9ca27 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:00.588829 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3c15a956-0dd6-4bec-b56b-2924b2c9ca27 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:00.595973 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c15a956-0dd6-4bec-b56b-2924b2c9ca27 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:00.596502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c15a956-0dd6-4bec-b56b-2924b2c9ca27 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:00.596969 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c15a956-0dd6-4bec-b56b-2924b2c9ca27 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:00.597714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c15a956-0dd6-4bec-b56b-2924b2c9ca27 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:00.598191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c15a956-0dd6-4bec-b56b-2924b2c9ca27 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:00.598668 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3c15a956-0dd6-4bec-b56b-2924b2c9ca27 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:00.671942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3c15a956-0dd6-4bec-b56b-2924b2c9ca27 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:00.683389 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3c15a956-0dd6-4bec-b56b-2924b2c9ca27 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1219 microversion: 2.1 time: 0.099705 Aug 18 13:01:00.684322 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4806/7460] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:00 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:01:01.705687 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-efde258d-c5a8-4965-af53-541ce7594b81 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:01.706535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-efde258d-c5a8-4965-af53-541ce7594b81 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:01.715272 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efde258d-c5a8-4965-af53-541ce7594b81 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:01.715790 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efde258d-c5a8-4965-af53-541ce7594b81 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:01.716462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efde258d-c5a8-4965-af53-541ce7594b81 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:01.717330 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efde258d-c5a8-4965-af53-541ce7594b81 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:01.717820 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efde258d-c5a8-4965-af53-541ce7594b81 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:01.718275 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-efde258d-c5a8-4965-af53-541ce7594b81 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:01.791335 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-efde258d-c5a8-4965-af53-541ce7594b81 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:01.799194 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-efde258d-c5a8-4965-af53-541ce7594b81 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1219 microversion: 2.1 time: 0.097648 Aug 18 13:01:01.799784 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4807/7461] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:01 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:01:02.823550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-fe3b4fc0-2c6a-46b9-850b-ecbb3ef7d4aa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:02.824627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-fe3b4fc0-2c6a-46b9-850b-ecbb3ef7d4aa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:02.832213 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe3b4fc0-2c6a-46b9-850b-ecbb3ef7d4aa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:02.832732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe3b4fc0-2c6a-46b9-850b-ecbb3ef7d4aa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:02.833191 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe3b4fc0-2c6a-46b9-850b-ecbb3ef7d4aa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:02.833928 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe3b4fc0-2c6a-46b9-850b-ecbb3ef7d4aa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:02.834411 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe3b4fc0-2c6a-46b9-850b-ecbb3ef7d4aa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:02.834882 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-fe3b4fc0-2c6a-46b9-850b-ecbb3ef7d4aa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:02.932198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-fe3b4fc0-2c6a-46b9-850b-ecbb3ef7d4aa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b92adb3a9c84d9da71647453003126b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d023eb3bcae40c5a9fc1459a886ef5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:02.940669 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-fe3b4fc0-2c6a-46b9-850b-ecbb3ef7d4aa tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 200 len: 1219 microversion: 2.1 time: 0.122769 Aug 18 13:01:02.941273 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4808/7462] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:02 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 1219 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:01:03.963353 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4f86fa56-8651-4c72-889f-775d546c662e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:03.964005 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-4f86fa56-8651-4c72-889f-775d546c662e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] [instance: b558a8a3-cf37-412d-bb64-c0f1fc399fb8] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:03.971941 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f86fa56-8651-4c72-889f-775d546c662e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:03.972535 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f86fa56-8651-4c72-889f-775d546c662e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:03.973080 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f86fa56-8651-4c72-889f-775d546c662e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:03.973889 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f86fa56-8651-4c72-889f-775d546c662e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:03.974894 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f86fa56-8651-4c72-889f-775d546c662e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:03.975352 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-4f86fa56-8651-4c72-889f-775d546c662e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:03.996262 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-4f86fa56-8651-4c72-889f-775d546c662e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] HTTP exception thrown: Instance b558a8a3-cf37-412d-bb64-c0f1fc399fb8 could not be found. Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4f86fa56-8651-4c72-889f-775d546c662e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Request method failure captured: Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 HTTP/1.1 Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jX83l5slugRA8Or8JXAAVqtjBcxQ3WEmrbu2MTRDYUNSA6sdTebRlFsYf6nHTl56IXON0so4UlohuXwT2p0nAy0kVekg6269oXoipmhXjuy99wLTHc3DfA42IfQNh_swg3Ht19K0HEONYpXBMfRxyIOGyky-J8vKIG2UTKIuTIO658 Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: 7d023eb3bcae40c5a9fc1459a886ef5c Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestShelveInstance-1957773267 Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7d023eb3bcae40c5a9fc1459a886ef5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/7d023eb3bcae40c5a9fc1459a886ef5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_7d023eb3bcae40c5a9fc1459a886ef5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/7d023eb3bcae40c5a9fc1459a886ef5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestShelveInstance-1957773267 Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: 7d023eb3bcae40c5a9fc1459a886ef5c Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestShelveInstance-1957773267 Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestShelveInstance-1957773267-project Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: 9b92adb3a9c84d9da71647453003126b Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestShelveInstance-1957773267-project Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance b558a8a3-cf37-412d-bb64-c0f1fc399fb8 could not be found. Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'b558a8a3-cf37-412d-bb64-c0f1fc399fb8'} Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b558a8a3-cf37-412d-bb64-c0f1fc399fb8 could not be found. Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b558a8a3-cf37-412d-bb64-c0f1fc399fb8 could not be found. Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 13:01:03.997983 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:01:04.003043 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 13:01:04.003043 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 13:01:04.003043 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 13:01:04.003043 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 13:01:04.003043 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 13:01:04.003043 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b558a8a3-cf37-412d-bb64-c0f1fc399fb8 could not be found. Aug 18 13:01:04.003043 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:01:04.003043 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-4f86fa56-8651-4c72-889f-775d546c662e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Returning 404 to user: Instance b558a8a3-cf37-412d-bb64-c0f1fc399fb8 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 13:01:04.003043 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-4f86fa56-8651-4c72-889f-775d546c662e tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8" status: 404 len: 111 microversion: 2.1 time: 0.041054 Aug 18 13:01:04.003043 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4809/7463] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:03 2022] GET /compute/v2.1/servers/b558a8a3-cf37-412d-bb64-c0f1fc399fb8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 13:01:04.190486 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f57cd4bb-e12a-4ee8-83c5-26d158e08815 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] Calling method '.version_select at 0x7f519fec7f70>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:04.233615 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f57cd4bb-e12a-4ee8-83c5-26d158e08815 tempest-TestShelveInstance-1957773267 tempest-TestShelveInstance-1957773267-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-833698371" status: 202 len: 0 microversion: 2.1 time: 0.047249 Aug 18 13:01:04.234618 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4810/7464] 10.222.0.73 () {58 vars in 1251 bytes} [Thu Aug 18 13:01:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-833698371 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 13:01:22.965772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 13:01:22.966606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 13:01:23.205833 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-34d2aba2-cae6-440e-a341-305b1220cdd9 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Action: 'create', calling method: .version_select at 0x7f519eeb3280>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1852791311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN7fUJ5x2EY2rhJSF49+qZAsRjxI0dYYQ4dzFoiO4dTNr6AnwxBlHcfe4QH4pNN5BXoNm9XmjT1lbgdI04lp32mKazdmRG9MlXXx0uFv/W+Lzrcb5L4rWpSfn8osp9Byw=="}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:01:23.226405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-34d2aba2-cae6-440e-a341-305b1220cdd9 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Getting quotas for project fc7ef9312a034fcd8771409cab57723c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 13:01:23.233722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-34d2aba2-cae6-440e-a341-305b1220cdd9 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Getting quotas for user e5e6976f81154287908f4522710adefa and project fc7ef9312a034fcd8771409cab57723c. Resources: {'key_pairs'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 13:01:23.272827 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-34d2aba2-cae6-440e-a341-305b1220cdd9 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.309022 Aug 18 13:01:23.274126 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4811/7465] 10.222.0.73 () {60 vars in 1159 bytes} [Thu Aug 18 13:01:22 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 13:01:24.291501 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1349013117", "imageRef": "1073d795-16bf-4b88-a573-c9b71aeef18a", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1852791311", "security_groups": [{"name": "tempest-secgroup-smoke-161821785"}], "networks": [{"uuid": "54d8884e-130f-4796-9b44-62c6cd94117f"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:01:24.406691 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] validate_networks() for [('54d8884e-130f-4796-9b44-62c6cd94117f', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 13:01:24.916664 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 13:01:24.917109 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 13:01:24.917606 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 13:01:24.918037 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 13:01:24.918502 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 13:01:24.927498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:24.928004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:24.928493 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:24.929244 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:24.929767 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:24.930558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:24.951812 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Getting quotas for project fc7ef9312a034fcd8771409cab57723c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 13:01:24.957669 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Getting quotas for user e5e6976f81154287908f4522710adefa and project fc7ef9312a034fcd8771409cab57723c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 13:01:24.971134 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 13:01:24.973491 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1073d795-16bf-4b88-a573-c9b71aeef18a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 13:01:25.022387 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-150a4a57-3131-4cba-964d-19d75b93cd9f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.737426 Aug 18 13:01:25.030177 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4812/7466] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 13:01:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 13:01:25.038563 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-37e4bf14-a6e2-402a-b477-145caa09064a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:25.039885 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-37e4bf14-a6e2-402a-b477-145caa09064a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:25.095739 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-37e4bf14-a6e2-402a-b477-145caa09064a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:25.103606 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-37e4bf14-a6e2-402a-b477-145caa09064a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1249 microversion: 2.1 time: 0.071989 Aug 18 13:01:25.104219 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4813/7467] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:25 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1249 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 13:01:26.125065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3f1a3e38-6aa9-4e51-bb85-ec181559d536 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:26.125919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3f1a3e38-6aa9-4e51-bb85-ec181559d536 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:26.189148 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3f1a3e38-6aa9-4e51-bb85-ec181559d536 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:26.199649 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3f1a3e38-6aa9-4e51-bb85-ec181559d536 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1249 microversion: 2.1 time: 0.078706 Aug 18 13:01:26.200746 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4814/7468] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:26 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 13:01:27.220596 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-47fc21de-95dd-43b3-97e4-2c9f5bccec13 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:27.221306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-47fc21de-95dd-43b3-97e4-2c9f5bccec13 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:27.278301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-47fc21de-95dd-43b3-97e4-2c9f5bccec13 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:27.285899 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-47fc21de-95dd-43b3-97e4-2c9f5bccec13 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1249 microversion: 2.1 time: 0.069234 Aug 18 13:01:27.286633 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4815/7469] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:27 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1249 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:01:28.307959 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-70166e8e-dd5b-48e1-973b-fd94499e9d00 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:28.308649 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-70166e8e-dd5b-48e1-973b-fd94499e9d00 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:28.363110 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-70166e8e-dd5b-48e1-973b-fd94499e9d00 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:28.371614 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-70166e8e-dd5b-48e1-973b-fd94499e9d00 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1249 microversion: 2.1 time: 0.068147 Aug 18 13:01:28.372176 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4816/7470] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:28 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1249 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:01:29.392387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-82da50bc-0409-4918-b6bb-3bfa95744935 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:29.393050 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-82da50bc-0409-4918-b6bb-3bfa95744935 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:29.400584 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82da50bc-0409-4918-b6bb-3bfa95744935 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:29.401121 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82da50bc-0409-4918-b6bb-3bfa95744935 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:29.401569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82da50bc-0409-4918-b6bb-3bfa95744935 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:29.402283 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82da50bc-0409-4918-b6bb-3bfa95744935 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:29.402785 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82da50bc-0409-4918-b6bb-3bfa95744935 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:29.403236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-82da50bc-0409-4918-b6bb-3bfa95744935 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:29.465797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-82da50bc-0409-4918-b6bb-3bfa95744935 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:29.473395 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-82da50bc-0409-4918-b6bb-3bfa95744935 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1253 microversion: 2.1 time: 0.084991 Aug 18 13:01:29.473975 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4817/7471] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:29 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1253 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:01:30.498750 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f289faa1-4d3e-4289-a3e0-58633c179283 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:30.499692 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f289faa1-4d3e-4289-a3e0-58633c179283 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:30.506422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f289faa1-4d3e-4289-a3e0-58633c179283 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:30.507116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f289faa1-4d3e-4289-a3e0-58633c179283 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:30.508033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f289faa1-4d3e-4289-a3e0-58633c179283 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:30.508979 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f289faa1-4d3e-4289-a3e0-58633c179283 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:30.509996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f289faa1-4d3e-4289-a3e0-58633c179283 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:30.510756 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f289faa1-4d3e-4289-a3e0-58633c179283 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:30.608007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f289faa1-4d3e-4289-a3e0-58633c179283 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:30.615760 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f289faa1-4d3e-4289-a3e0-58633c179283 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1307 microversion: 2.1 time: 0.124598 Aug 18 13:01:30.616352 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4818/7472] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:30 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1307 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 13:01:31.638538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-219b2c12-7b08-4df0-a1b9-381be3f679d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:31.639211 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-219b2c12-7b08-4df0-a1b9-381be3f679d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:31.646445 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-219b2c12-7b08-4df0-a1b9-381be3f679d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:31.647044 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-219b2c12-7b08-4df0-a1b9-381be3f679d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:31.647553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-219b2c12-7b08-4df0-a1b9-381be3f679d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:31.648442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-219b2c12-7b08-4df0-a1b9-381be3f679d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:31.648926 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-219b2c12-7b08-4df0-a1b9-381be3f679d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:31.649498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-219b2c12-7b08-4df0-a1b9-381be3f679d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:31.902153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-219b2c12-7b08-4df0-a1b9-381be3f679d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:31.910921 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-219b2c12-7b08-4df0-a1b9-381be3f679d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1374 microversion: 2.1 time: 0.277644 Aug 18 13:01:31.911535 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4819/7473] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:31 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1374 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:01:32.036325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-5413abd5-0256-429c-984b-3172b87b0452 req-1e3a25ca-e7e0-4b96-b3bf-cfc72656d239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb783c17-047d-4cbe-8e9d-7e8e8ed21804", "tag": "662e3fe8-d0c7-42ec-85b6-d1d66f402ac8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:01:32.051197 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5413abd5-0256-429c-984b-3172b87b0452 req-1e3a25ca-e7e0-4b96-b3bf-cfc72656d239 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:32.051919 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5413abd5-0256-429c-984b-3172b87b0452 req-1e3a25ca-e7e0-4b96-b3bf-cfc72656d239 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:32.052376 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-5413abd5-0256-429c-984b-3172b87b0452 req-1e3a25ca-e7e0-4b96-b3bf-cfc72656d239 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:32.066373 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-5413abd5-0256-429c-984b-3172b87b0452 req-1e3a25ca-e7e0-4b96-b3bf-cfc72656d239 service nova] Creating event network-changed:662e3fe8-d0c7-42ec-85b6-d1d66f402ac8 for instance eb783c17-047d-4cbe-8e9d-7e8e8ed21804 on n-h2-853611-3 Aug 18 13:01:32.072316 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-5413abd5-0256-429c-984b-3172b87b0452 req-1e3a25ca-e7e0-4b96-b3bf-cfc72656d239 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039753 Aug 18 13:01:32.073447 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4820/7474] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 13:01:32.934027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-49e14559-d841-4bf6-98bf-ac047793842b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:32.934791 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-49e14559-d841-4bf6-98bf-ac047793842b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:32.941866 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49e14559-d841-4bf6-98bf-ac047793842b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:32.942356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49e14559-d841-4bf6-98bf-ac047793842b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:32.942830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49e14559-d841-4bf6-98bf-ac047793842b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:32.943536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49e14559-d841-4bf6-98bf-ac047793842b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:32.944003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49e14559-d841-4bf6-98bf-ac047793842b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:32.944438 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-49e14559-d841-4bf6-98bf-ac047793842b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:33.086558 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-49e14559-d841-4bf6-98bf-ac047793842b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:33.094479 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-49e14559-d841-4bf6-98bf-ac047793842b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1374 microversion: 2.1 time: 0.165238 Aug 18 13:01:33.095051 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4821/7475] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:32 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:01:34.114891 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-6c3a3e13-14f5-4af9-88e4-e529f862f723 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:34.115712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-6c3a3e13-14f5-4af9-88e4-e529f862f723 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:34.123298 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c3a3e13-14f5-4af9-88e4-e529f862f723 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:34.123799 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c3a3e13-14f5-4af9-88e4-e529f862f723 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:34.124250 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c3a3e13-14f5-4af9-88e4-e529f862f723 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:34.124964 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c3a3e13-14f5-4af9-88e4-e529f862f723 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:34.125426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c3a3e13-14f5-4af9-88e4-e529f862f723 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:34.125864 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-6c3a3e13-14f5-4af9-88e4-e529f862f723 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:34.270465 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-6c3a3e13-14f5-4af9-88e4-e529f862f723 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:34.278878 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-6c3a3e13-14f5-4af9-88e4-e529f862f723 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1374 microversion: 2.1 time: 0.168309 Aug 18 13:01:34.279493 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4822/7476] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:34 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:01:35.300689 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-107808de-b36a-489d-88b0-475ae93e9b96 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:35.301414 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-107808de-b36a-489d-88b0-475ae93e9b96 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:35.303462 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 13:01:35.309592 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107808de-b36a-489d-88b0-475ae93e9b96 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:35.310133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107808de-b36a-489d-88b0-475ae93e9b96 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:35.310634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107808de-b36a-489d-88b0-475ae93e9b96 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:35.311365 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107808de-b36a-489d-88b0-475ae93e9b96 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:35.311842 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107808de-b36a-489d-88b0-475ae93e9b96 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:35.312292 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-107808de-b36a-489d-88b0-475ae93e9b96 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:35.444324 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-107808de-b36a-489d-88b0-475ae93e9b96 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:35.452451 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-107808de-b36a-489d-88b0-475ae93e9b96 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1374 microversion: 2.1 time: 0.156159 Aug 18 13:01:35.453056 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4823/7477] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:35 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:01:36.473347 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f72c7e49-dfe0-4d5d-a2cd-327d8340c1de tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:36.474007 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f72c7e49-dfe0-4d5d-a2cd-327d8340c1de tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:36.481734 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f72c7e49-dfe0-4d5d-a2cd-327d8340c1de tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:36.482235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f72c7e49-dfe0-4d5d-a2cd-327d8340c1de tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:36.482714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f72c7e49-dfe0-4d5d-a2cd-327d8340c1de tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:36.483427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f72c7e49-dfe0-4d5d-a2cd-327d8340c1de tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:36.483902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f72c7e49-dfe0-4d5d-a2cd-327d8340c1de tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:36.484343 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f72c7e49-dfe0-4d5d-a2cd-327d8340c1de tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:36.622808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-f72c7e49-dfe0-4d5d-a2cd-327d8340c1de tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:36.630606 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f72c7e49-dfe0-4d5d-a2cd-327d8340c1de tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1374 microversion: 2.1 time: 0.161197 Aug 18 13:01:36.631338 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4824/7478] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:36 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:01:37.653565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ae47a534-b1e8-4906-814d-e4dd1c19e07f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:37.654656 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ae47a534-b1e8-4906-814d-e4dd1c19e07f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:37.662233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae47a534-b1e8-4906-814d-e4dd1c19e07f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:37.662722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae47a534-b1e8-4906-814d-e4dd1c19e07f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:37.663435 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae47a534-b1e8-4906-814d-e4dd1c19e07f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:37.664181 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae47a534-b1e8-4906-814d-e4dd1c19e07f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:37.664796 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae47a534-b1e8-4906-814d-e4dd1c19e07f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:37.665366 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ae47a534-b1e8-4906-814d-e4dd1c19e07f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:37.813647 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ae47a534-b1e8-4906-814d-e4dd1c19e07f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:37.821379 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ae47a534-b1e8-4906-814d-e4dd1c19e07f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1374 microversion: 2.1 time: 0.172173 Aug 18 13:01:37.822234 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4825/7479] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:37 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:01:37.826793 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-20ffd70b-2ee6-42a3-b161-8e98283a4f7b req-beac9cfb-9e36-4d65-9586-8da141138674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb783c17-047d-4cbe-8e9d-7e8e8ed21804", "name": "network-vif-plugged", "status": "completed", "tag": "662e3fe8-d0c7-42ec-85b6-d1d66f402ac8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:01:37.836325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-20ffd70b-2ee6-42a3-b161-8e98283a4f7b req-beac9cfb-9e36-4d65-9586-8da141138674 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:37.836822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-20ffd70b-2ee6-42a3-b161-8e98283a4f7b req-beac9cfb-9e36-4d65-9586-8da141138674 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:37.837306 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-20ffd70b-2ee6-42a3-b161-8e98283a4f7b req-beac9cfb-9e36-4d65-9586-8da141138674 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:37.848919 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-20ffd70b-2ee6-42a3-b161-8e98283a4f7b req-beac9cfb-9e36-4d65-9586-8da141138674 service nova] Creating event network-vif-plugged:662e3fe8-d0c7-42ec-85b6-d1d66f402ac8 for instance eb783c17-047d-4cbe-8e9d-7e8e8ed21804 on n-h2-853611-3 Aug 18 13:01:37.854867 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-20ffd70b-2ee6-42a3-b161-8e98283a4f7b req-beac9cfb-9e36-4d65-9586-8da141138674 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031289 Aug 18 13:01:37.855498 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4826/7480] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 13:01:38.844003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-902fbd8f-6db9-48e7-a954-87865159e021 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:38.844712 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-902fbd8f-6db9-48e7-a954-87865159e021 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:38.846818 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=18 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 13:01:38.861057 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-902fbd8f-6db9-48e7-a954-87865159e021 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:38.861595 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-902fbd8f-6db9-48e7-a954-87865159e021 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:38.862047 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-902fbd8f-6db9-48e7-a954-87865159e021 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:38.862807 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-902fbd8f-6db9-48e7-a954-87865159e021 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:38.863280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-902fbd8f-6db9-48e7-a954-87865159e021 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:38.863723 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-902fbd8f-6db9-48e7-a954-87865159e021 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:39.026659 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-902fbd8f-6db9-48e7-a954-87865159e021 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:39.035426 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-902fbd8f-6db9-48e7-a954-87865159e021 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1374 microversion: 2.1 time: 0.195811 Aug 18 13:01:39.036202 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4827/7481] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:38 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1374 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 13:01:40.059900 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ad713c8f-ba0e-4ffb-aad0-25c6e420b8d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:40.060634 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ad713c8f-ba0e-4ffb-aad0-25c6e420b8d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:40.067553 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad713c8f-ba0e-4ffb-aad0-25c6e420b8d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:40.068059 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad713c8f-ba0e-4ffb-aad0-25c6e420b8d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:40.068518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad713c8f-ba0e-4ffb-aad0-25c6e420b8d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:40.069266 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad713c8f-ba0e-4ffb-aad0-25c6e420b8d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:40.069743 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad713c8f-ba0e-4ffb-aad0-25c6e420b8d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:40.070196 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ad713c8f-ba0e-4ffb-aad0-25c6e420b8d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:40.211065 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ad713c8f-ba0e-4ffb-aad0-25c6e420b8d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:40.218927 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ad713c8f-ba0e-4ffb-aad0-25c6e420b8d1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1559 microversion: 2.1 time: 0.163743 Aug 18 13:01:40.219513 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4828/7482] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:40 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:01:40.239241 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-124e97ef-7d0d-4ed8-b5b1-359a7b27ded6 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:01:40.239905 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-124e97ef-7d0d-4ed8-b5b1-359a7b27ded6 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:01:40.247053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124e97ef-7d0d-4ed8-b5b1-359a7b27ded6 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:40.247557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124e97ef-7d0d-4ed8-b5b1-359a7b27ded6 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:40.248017 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124e97ef-7d0d-4ed8-b5b1-359a7b27ded6 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:40.248731 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124e97ef-7d0d-4ed8-b5b1-359a7b27ded6 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:40.249206 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124e97ef-7d0d-4ed8-b5b1-359a7b27ded6 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:40.249650 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-124e97ef-7d0d-4ed8-b5b1-359a7b27ded6 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:40.284526 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:01:40.285128 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 13:01:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 13:01:40.384987 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-124e97ef-7d0d-4ed8-b5b1-359a7b27ded6 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:01:40.392562 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-124e97ef-7d0d-4ed8-b5b1-359a7b27ded6 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1559 microversion: 2.1 time: 0.157121 Aug 18 13:01:40.393134 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4829/7483] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:01:40 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:01:42.072860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-1910d19e-08c3-498b-b2cd-79558c9b6663 req-fc2c8f80-9861-4d23-9c2a-ed7bfa6e6194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb783c17-047d-4cbe-8e9d-7e8e8ed21804", "tag": "662e3fe8-d0c7-42ec-85b6-d1d66f402ac8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:01:42.083721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1910d19e-08c3-498b-b2cd-79558c9b6663 req-fc2c8f80-9861-4d23-9c2a-ed7bfa6e6194 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:01:42.084214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1910d19e-08c3-498b-b2cd-79558c9b6663 req-fc2c8f80-9861-4d23-9c2a-ed7bfa6e6194 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:01:42.084658 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-1910d19e-08c3-498b-b2cd-79558c9b6663 req-fc2c8f80-9861-4d23-9c2a-ed7bfa6e6194 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:01:42.096526 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-1910d19e-08c3-498b-b2cd-79558c9b6663 req-fc2c8f80-9861-4d23-9c2a-ed7bfa6e6194 service nova] Creating event network-changed:662e3fe8-d0c7-42ec-85b6-d1d66f402ac8 for instance eb783c17-047d-4cbe-8e9d-7e8e8ed21804 on n-h2-853611-3 Aug 18 13:01:42.101662 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-1910d19e-08c3-498b-b2cd-79558c9b6663 req-fc2c8f80-9861-4d23-9c2a-ed7bfa6e6194 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033190 Aug 18 13:01:42.102346 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4830/7484] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 13:01:56.833610 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:01:56.834295 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 13:01:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 13:03:18.910788 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:03:18.911573 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 13:03:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 13:03:37.384491 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4032abb9-abb5-4d06-9561-525583ca96a6] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 13:03:37.385358 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8703f2a-f745-4e9b-8afb-efe543c268f1] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 13:03:37.386052 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 13:03:37.386840 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=74 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 13:03:37.391643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-46cf8399-0332-4966-b539-32000e30b26a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-270103026"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:03:37.394102 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-46cf8399-0332-4966-b539-32000e30b26a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:03:37.402822 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46cf8399-0332-4966-b539-32000e30b26a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:37.403331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46cf8399-0332-4966-b539-32000e30b26a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:37.403792 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46cf8399-0332-4966-b539-32000e30b26a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:37.404514 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46cf8399-0332-4966-b539-32000e30b26a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:37.404991 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46cf8399-0332-4966-b539-32000e30b26a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:37.405442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-46cf8399-0332-4966-b539-32000e30b26a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:37.601722 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-46cf8399-0332-4966-b539-32000e30b26a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "POST /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804/action" status: 202 len: 0 microversion: 2.1 time: 0.218892 Aug 18 13:03:37.602387 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4831/7485] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 13:03:37 2022] POST /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 18 13:03:42.291308 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-532d0364-5947-49f3-8873-570efb150915 req-8479e30a-3973-464c-8475-ad796cbf0790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb783c17-047d-4cbe-8e9d-7e8e8ed21804", "name": "network-vif-plugged", "status": "completed", "tag": "662e3fe8-d0c7-42ec-85b6-d1d66f402ac8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:03:42.308674 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-532d0364-5947-49f3-8873-570efb150915 req-8479e30a-3973-464c-8475-ad796cbf0790 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:42.309469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-532d0364-5947-49f3-8873-570efb150915 req-8479e30a-3973-464c-8475-ad796cbf0790 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:42.310125 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-532d0364-5947-49f3-8873-570efb150915 req-8479e30a-3973-464c-8475-ad796cbf0790 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:42.323415 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-532d0364-5947-49f3-8873-570efb150915 req-8479e30a-3973-464c-8475-ad796cbf0790 service nova] Creating event network-vif-plugged:662e3fe8-d0c7-42ec-85b6-d1d66f402ac8 for instance eb783c17-047d-4cbe-8e9d-7e8e8ed21804 on n-h2-853611-3 Aug 18 13:03:42.330373 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-532d0364-5947-49f3-8873-570efb150915 req-8479e30a-3973-464c-8475-ad796cbf0790 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048020 Aug 18 13:03:42.331329 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4832/7486] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 13:03:50.168316 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-673007422", "imageRef": "e0dd895b-13cf-4595-bd7f-05e619058a74", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1852791311", "security_groups": [{"name": "tempest-secgroup-smoke-161821785"}], "networks": [{"uuid": "54d8884e-130f-4796-9b44-62c6cd94117f"}]}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:03:50.178972 n-d-853611-3 devstack@n-api.service[122210]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8703f2a-f745-4e9b-8afb-efe543c268f1] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 18 13:03:50.181229 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] [4032abb9-abb5-4d06-9561-525583ca96a6] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 55484. Aug 18 13:03:50.292309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.network.neutron [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] validate_networks() for [('54d8884e-130f-4796-9b44-62c6cd94117f', None, None, None, None, None)] {{(pid=122210) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 13:03:50.710208 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Flavor limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 13:03:50.710714 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Image limits 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 13:03:50.711204 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Flavor pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 13:03:50.711626 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Image pref 0:0:0 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 13:03:50.712053 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.virt.hardware [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 13:03:50.723127 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:50.723627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:50.724076 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:50.724871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:50.725339 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:50.725774 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:50.742671 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Getting quotas for project fc7ef9312a034fcd8771409cab57723c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 13:03:50.747779 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.quota [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Getting quotas for user e5e6976f81154287908f4522710adefa and project fc7ef9312a034fcd8771409cab57723c. Resources: {'instances', 'cores', 'ram'} {{(pid=122210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 13:03:50.760331 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Going to run 1 instances... {{(pid=122210) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 13:03:50.762813 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0dd895b-13cf-4595-bd7f-05e619058a74',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 18 13:03:50.810024 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-26e7ee83-080e-47cb-bfc5-bc62d9605fee tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.646176 Aug 18 13:03:50.810729 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4833/7487] 10.222.0.73 () {60 vars in 1147 bytes} [Thu Aug 18 13:03:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 13:03:50.821772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-17a5512a-9076-4da1-a919-1784a34a3526 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:03:50.822472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-17a5512a-9076-4da1-a919-1784a34a3526 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:03:50.877617 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-17a5512a-9076-4da1-a919-1784a34a3526 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:03:50.884558 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-17a5512a-9076-4da1-a919-1784a34a3526 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1248 microversion: 2.1 time: 0.066624 Aug 18 13:03:50.885139 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4834/7488] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:03:50 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1248 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 13:03:51.905146 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ea89bd78-0fee-483b-9ea4-bcf1dc6814bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:03:51.905936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ea89bd78-0fee-483b-9ea4-bcf1dc6814bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:03:51.919627 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea89bd78-0fee-483b-9ea4-bcf1dc6814bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:51.920141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea89bd78-0fee-483b-9ea4-bcf1dc6814bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:51.920601 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea89bd78-0fee-483b-9ea4-bcf1dc6814bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:51.921334 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea89bd78-0fee-483b-9ea4-bcf1dc6814bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:51.922006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea89bd78-0fee-483b-9ea4-bcf1dc6814bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:51.922479 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ea89bd78-0fee-483b-9ea4-bcf1dc6814bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:51.949408 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8703f2a-f745-4e9b-8afb-efe543c268f1] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 55578. Aug 18 13:03:51.995412 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ea89bd78-0fee-483b-9ea4-bcf1dc6814bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:03:52.009281 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ea89bd78-0fee-483b-9ea4-bcf1dc6814bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1318 microversion: 2.1 time: 0.107834 Aug 18 13:03:52.010836 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4835/7489] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:03:51 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1318 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:03:53.032569 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-470a4844-5651-4b73-a128-5ce06b260852 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:03:53.034475 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-470a4844-5651-4b73-a128-5ce06b260852 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:03:53.045395 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-470a4844-5651-4b73-a128-5ce06b260852 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:53.045958 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-470a4844-5651-4b73-a128-5ce06b260852 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:53.046972 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-470a4844-5651-4b73-a128-5ce06b260852 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:53.047367 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-470a4844-5651-4b73-a128-5ce06b260852 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:53.047908 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-470a4844-5651-4b73-a128-5ce06b260852 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:53.049394 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-470a4844-5651-4b73-a128-5ce06b260852 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:53.205725 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-470a4844-5651-4b73-a128-5ce06b260852 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:03:53.213846 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-470a4844-5651-4b73-a128-5ce06b260852 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.185153 Aug 18 13:03:53.229020 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4836/7490] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:03:53 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:03:54.235062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-60dee7c5-59f0-4272-9685-5295ecfe0ce1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:03:54.237003 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-60dee7c5-59f0-4272-9685-5295ecfe0ce1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:03:54.243652 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60dee7c5-59f0-4272-9685-5295ecfe0ce1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:54.244199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60dee7c5-59f0-4272-9685-5295ecfe0ce1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:54.244681 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60dee7c5-59f0-4272-9685-5295ecfe0ce1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:54.246550 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60dee7c5-59f0-4272-9685-5295ecfe0ce1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:54.247022 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60dee7c5-59f0-4272-9685-5295ecfe0ce1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:54.247466 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-60dee7c5-59f0-4272-9685-5295ecfe0ce1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:54.408554 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-60dee7c5-59f0-4272-9685-5295ecfe0ce1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:03:54.416157 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-60dee7c5-59f0-4272-9685-5295ecfe0ce1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.184968 Aug 18 13:03:54.416747 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4837/7491] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:03:54 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:03:54.421198 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-9baf0233-c29d-4ffd-8ac1-98973bee0509 req-004489ea-18e9-4b87-9183-e203c1103134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb783c17-047d-4cbe-8e9d-7e8e8ed21804", "name": "network-vif-unplugged", "status": "completed", "tag": "662e3fe8-d0c7-42ec-85b6-d1d66f402ac8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:03:54.431235 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9baf0233-c29d-4ffd-8ac1-98973bee0509 req-004489ea-18e9-4b87-9183-e203c1103134 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:54.431738 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9baf0233-c29d-4ffd-8ac1-98973bee0509 req-004489ea-18e9-4b87-9183-e203c1103134 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:54.432193 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-9baf0233-c29d-4ffd-8ac1-98973bee0509 req-004489ea-18e9-4b87-9183-e203c1103134 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:54.444519 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-9baf0233-c29d-4ffd-8ac1-98973bee0509 req-004489ea-18e9-4b87-9183-e203c1103134 service nova] Creating event network-vif-unplugged:662e3fe8-d0c7-42ec-85b6-d1d66f402ac8 for instance eb783c17-047d-4cbe-8e9d-7e8e8ed21804 on n-h2-853611-3 Aug 18 13:03:54.450118 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-9baf0233-c29d-4ffd-8ac1-98973bee0509 req-004489ea-18e9-4b87-9183-e203c1103134 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032197 Aug 18 13:03:54.450785 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4838/7492] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 13:03:55.440062 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-9546f420-cf98-4330-9437-9d607378d11b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:03:55.441570 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-9546f420-cf98-4330-9437-9d607378d11b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:03:55.449472 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9546f420-cf98-4330-9437-9d607378d11b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:55.450135 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9546f420-cf98-4330-9437-9d607378d11b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:55.450722 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9546f420-cf98-4330-9437-9d607378d11b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:55.451981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9546f420-cf98-4330-9437-9d607378d11b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:55.451981 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9546f420-cf98-4330-9437-9d607378d11b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:55.452509 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-9546f420-cf98-4330-9437-9d607378d11b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:55.597533 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-9546f420-cf98-4330-9437-9d607378d11b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:03:55.605149 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-9546f420-cf98-4330-9437-9d607378d11b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.170860 Aug 18 13:03:55.605721 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4839/7493] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:03:55 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 13:03:56.627534 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-bdf2c918-ba9a-4120-8c95-f165dd714f69 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:03:56.628239 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-bdf2c918-ba9a-4120-8c95-f165dd714f69 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:03:56.647019 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdf2c918-ba9a-4120-8c95-f165dd714f69 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:56.648878 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdf2c918-ba9a-4120-8c95-f165dd714f69 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:56.649368 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdf2c918-ba9a-4120-8c95-f165dd714f69 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:56.650222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdf2c918-ba9a-4120-8c95-f165dd714f69 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:56.650732 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdf2c918-ba9a-4120-8c95-f165dd714f69 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:56.653130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-bdf2c918-ba9a-4120-8c95-f165dd714f69 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:56.832830 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-bdf2c918-ba9a-4120-8c95-f165dd714f69 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:03:56.842042 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-bdf2c918-ba9a-4120-8c95-f165dd714f69 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.218614 Aug 18 13:03:56.842876 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4840/7494] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:03:56 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:03:57.862838 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-cacd4c46-c49b-4028-8229-3c4ccee1d3ce tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:03:57.863643 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-cacd4c46-c49b-4028-8229-3c4ccee1d3ce tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:03:57.870585 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cacd4c46-c49b-4028-8229-3c4ccee1d3ce tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:57.871087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cacd4c46-c49b-4028-8229-3c4ccee1d3ce tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:57.871540 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cacd4c46-c49b-4028-8229-3c4ccee1d3ce tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:57.872259 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cacd4c46-c49b-4028-8229-3c4ccee1d3ce tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:57.872730 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cacd4c46-c49b-4028-8229-3c4ccee1d3ce tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:57.873172 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-cacd4c46-c49b-4028-8229-3c4ccee1d3ce tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:58.008702 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-cacd4c46-c49b-4028-8229-3c4ccee1d3ce tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:03:58.018107 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-cacd4c46-c49b-4028-8229-3c4ccee1d3ce tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.158991 Aug 18 13:03:58.019498 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4841/7495] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:03:57 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:03:59.041776 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-ab20a3b6-4502-4acb-93b4-6f9b6bca8cc2 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:03:59.042546 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-ab20a3b6-4502-4acb-93b4-6f9b6bca8cc2 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:03:59.051748 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab20a3b6-4502-4acb-93b4-6f9b6bca8cc2 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:59.052145 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab20a3b6-4502-4acb-93b4-6f9b6bca8cc2 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:59.052623 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab20a3b6-4502-4acb-93b4-6f9b6bca8cc2 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:59.053402 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab20a3b6-4502-4acb-93b4-6f9b6bca8cc2 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:03:59.053932 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab20a3b6-4502-4acb-93b4-6f9b6bca8cc2 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:03:59.055565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-ab20a3b6-4502-4acb-93b4-6f9b6bca8cc2 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:03:59.205311 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-ab20a3b6-4502-4acb-93b4-6f9b6bca8cc2 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:03:59.212934 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-ab20a3b6-4502-4acb-93b4-6f9b6bca8cc2 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.175575 Aug 18 13:03:59.213512 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4842/7496] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:03:59 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 13:04:00.233221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-88fa97e6-8e3f-410c-962c-80d8cb2f351a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:04:00.233956 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-88fa97e6-8e3f-410c-962c-80d8cb2f351a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:04:00.241804 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88fa97e6-8e3f-410c-962c-80d8cb2f351a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:00.242312 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88fa97e6-8e3f-410c-962c-80d8cb2f351a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:00.242808 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88fa97e6-8e3f-410c-962c-80d8cb2f351a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:00.243531 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88fa97e6-8e3f-410c-962c-80d8cb2f351a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:00.244004 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88fa97e6-8e3f-410c-962c-80d8cb2f351a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:00.244464 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-88fa97e6-8e3f-410c-962c-80d8cb2f351a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:00.385281 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-88fa97e6-8e3f-410c-962c-80d8cb2f351a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:04:00.394025 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-88fa97e6-8e3f-410c-962c-80d8cb2f351a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.164556 Aug 18 13:04:00.394904 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4843/7497] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:04:00 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:04:01.417881 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5a9fbedd-17e0-4a41-869e-03e7cb853b2c tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:04:01.418706 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5a9fbedd-17e0-4a41-869e-03e7cb853b2c tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:04:01.420700 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=2 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 13:04:01.421422 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell0:SELECT=8 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 13:04:01.429251 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a9fbedd-17e0-4a41-869e-03e7cb853b2c tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:01.429757 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a9fbedd-17e0-4a41-869e-03e7cb853b2c tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:01.430215 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a9fbedd-17e0-4a41-869e-03e7cb853b2c tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:01.430982 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a9fbedd-17e0-4a41-869e-03e7cb853b2c tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:01.431460 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a9fbedd-17e0-4a41-869e-03e7cb853b2c tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:01.431910 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5a9fbedd-17e0-4a41-869e-03e7cb853b2c tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:01.581288 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5a9fbedd-17e0-4a41-869e-03e7cb853b2c tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:04:01.591056 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5a9fbedd-17e0-4a41-869e-03e7cb853b2c tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.177084 Aug 18 13:04:01.591801 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4844/7498] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:04:01 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:04:02.613218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-d8bfed5c-83df-4a4d-bde4-669fa47ca794 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:04:02.613946 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-d8bfed5c-83df-4a4d-bde4-669fa47ca794 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:04:02.621789 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8bfed5c-83df-4a4d-bde4-669fa47ca794 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:02.622325 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8bfed5c-83df-4a4d-bde4-669fa47ca794 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:02.622865 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8bfed5c-83df-4a4d-bde4-669fa47ca794 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:02.623710 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8bfed5c-83df-4a4d-bde4-669fa47ca794 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:02.624210 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8bfed5c-83df-4a4d-bde4-669fa47ca794 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:02.624735 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-d8bfed5c-83df-4a4d-bde4-669fa47ca794 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:02.776392 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-d8bfed5c-83df-4a4d-bde4-669fa47ca794 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:04:02.784760 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-d8bfed5c-83df-4a4d-bde4-669fa47ca794 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.176463 Aug 18 13:04:02.785351 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4845/7499] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:04:02 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:04:03.805442 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c1cbc1ae-e166-4e5e-907d-fa3c750d90af tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:04:03.806174 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c1cbc1ae-e166-4e5e-907d-fa3c750d90af tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:04:03.813518 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1cbc1ae-e166-4e5e-907d-fa3c750d90af tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:03.814619 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1cbc1ae-e166-4e5e-907d-fa3c750d90af tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:03.815073 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1cbc1ae-e166-4e5e-907d-fa3c750d90af tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:03.815936 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1cbc1ae-e166-4e5e-907d-fa3c750d90af tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:03.816413 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1cbc1ae-e166-4e5e-907d-fa3c750d90af tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:03.816860 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c1cbc1ae-e166-4e5e-907d-fa3c750d90af tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:03.968375 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-c1cbc1ae-e166-4e5e-907d-fa3c750d90af tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:04:03.976782 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c1cbc1ae-e166-4e5e-907d-fa3c750d90af tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.175131 Aug 18 13:04:03.977295 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4846/7500] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:04:03 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:04:04.351999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-4efa2907-526a-435d-9fb8-d6adc0cf053d req-79f64ee7-7886-47c7-9a06-e8bf180e1f62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc096b5-3470-4022-b56f-0afad526a8dc", "tag": "e8394cc8-35bc-4ff8-a1f6-5514417b174f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:04:04.363721 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4efa2907-526a-435d-9fb8-d6adc0cf053d req-79f64ee7-7886-47c7-9a06-e8bf180e1f62 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:04.364326 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4efa2907-526a-435d-9fb8-d6adc0cf053d req-79f64ee7-7886-47c7-9a06-e8bf180e1f62 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:04.364846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-4efa2907-526a-435d-9fb8-d6adc0cf053d req-79f64ee7-7886-47c7-9a06-e8bf180e1f62 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:04.377776 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-4efa2907-526a-435d-9fb8-d6adc0cf053d req-79f64ee7-7886-47c7-9a06-e8bf180e1f62 service nova] Creating event network-changed:e8394cc8-35bc-4ff8-a1f6-5514417b174f for instance dbc096b5-3470-4022-b56f-0afad526a8dc on n-h1-853611-3 Aug 18 13:04:04.383212 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-4efa2907-526a-435d-9fb8-d6adc0cf053d req-79f64ee7-7886-47c7-9a06-e8bf180e1f62 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035583 Aug 18 13:04:04.383833 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4847/7501] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 13:04:04.999869 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3d431ad0-b5e8-44b1-98c4-98f6b2bd64a1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:04:05.000586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3d431ad0-b5e8-44b1-98c4-98f6b2bd64a1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:04:05.007396 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d431ad0-b5e8-44b1-98c4-98f6b2bd64a1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:05.007898 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d431ad0-b5e8-44b1-98c4-98f6b2bd64a1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:05.008356 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d431ad0-b5e8-44b1-98c4-98f6b2bd64a1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:05.009070 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d431ad0-b5e8-44b1-98c4-98f6b2bd64a1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:05.009548 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d431ad0-b5e8-44b1-98c4-98f6b2bd64a1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:05.009996 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3d431ad0-b5e8-44b1-98c4-98f6b2bd64a1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:05.169538 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3d431ad0-b5e8-44b1-98c4-98f6b2bd64a1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:04:05.177582 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3d431ad0-b5e8-44b1-98c4-98f6b2bd64a1 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.182950 Aug 18 13:04:05.178185 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4848/7502] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:04:04 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:04:06.200305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-a8cff328-67dd-46e8-894f-09f310f68c9d tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:04:06.201030 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-a8cff328-67dd-46e8-894f-09f310f68c9d tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:04:06.207948 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8cff328-67dd-46e8-894f-09f310f68c9d tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:06.208448 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8cff328-67dd-46e8-894f-09f310f68c9d tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:06.208901 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8cff328-67dd-46e8-894f-09f310f68c9d tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:06.209614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8cff328-67dd-46e8-894f-09f310f68c9d tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:06.210087 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8cff328-67dd-46e8-894f-09f310f68c9d tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:06.210552 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-a8cff328-67dd-46e8-894f-09f310f68c9d tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:06.434488 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-a8cff328-67dd-46e8-894f-09f310f68c9d tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:04:06.438166 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 13:04:06.444154 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-a8cff328-67dd-46e8-894f-09f310f68c9d tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.247719 Aug 18 13:04:06.444991 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4849/7503] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:04:06 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:04:07.465187 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-5bea6e7d-e1f3-4369-be68-54cd14f80932 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:04:07.465904 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-5bea6e7d-e1f3-4369-be68-54cd14f80932 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:04:07.469199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 13:04:07.476309 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bea6e7d-e1f3-4369-be68-54cd14f80932 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:07.476890 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bea6e7d-e1f3-4369-be68-54cd14f80932 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:07.477387 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bea6e7d-e1f3-4369-be68-54cd14f80932 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:07.478162 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bea6e7d-e1f3-4369-be68-54cd14f80932 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:07.478661 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bea6e7d-e1f3-4369-be68-54cd14f80932 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:07.479118 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-5bea6e7d-e1f3-4369-be68-54cd14f80932 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:07.620337 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-5bea6e7d-e1f3-4369-be68-54cd14f80932 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:04:07.628823 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-5bea6e7d-e1f3-4369-be68-54cd14f80932 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.167537 Aug 18 13:04:07.629430 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4850/7504] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:04:07 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:04:08.649727 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-e8908fa5-69d7-43aa-a1db-255fc81c37b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:04:08.650400 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-e8908fa5-69d7-43aa-a1db-255fc81c37b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:04:08.659778 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8908fa5-69d7-43aa-a1db-255fc81c37b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:08.660300 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8908fa5-69d7-43aa-a1db-255fc81c37b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:08.661012 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8908fa5-69d7-43aa-a1db-255fc81c37b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:08.661740 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8908fa5-69d7-43aa-a1db-255fc81c37b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:08.662242 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8908fa5-69d7-43aa-a1db-255fc81c37b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:08.662729 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-e8908fa5-69d7-43aa-a1db-255fc81c37b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:08.806461 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-e8908fa5-69d7-43aa-a1db-255fc81c37b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:04:08.815399 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-e8908fa5-69d7-43aa-a1db-255fc81c37b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.169544 Aug 18 13:04:08.816009 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4851/7505] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:04:08 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:04:09.821797 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-032636fb-f854-410d-ae01-63b9592a6092 req-25d3b2c5-765e-4e14-ad90-cc4dd74da25a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc096b5-3470-4022-b56f-0afad526a8dc", "name": "network-vif-plugged", "status": "completed", "tag": "e8394cc8-35bc-4ff8-a1f6-5514417b174f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:04:09.835226 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-032636fb-f854-410d-ae01-63b9592a6092 req-25d3b2c5-765e-4e14-ad90-cc4dd74da25a service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:09.835737 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-032636fb-f854-410d-ae01-63b9592a6092 req-25d3b2c5-765e-4e14-ad90-cc4dd74da25a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:09.836192 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-032636fb-f854-410d-ae01-63b9592a6092 req-25d3b2c5-765e-4e14-ad90-cc4dd74da25a service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:09.848951 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-032636fb-f854-410d-ae01-63b9592a6092 req-25d3b2c5-765e-4e14-ad90-cc4dd74da25a service nova] Creating event network-vif-plugged:e8394cc8-35bc-4ff8-a1f6-5514417b174f for instance dbc096b5-3470-4022-b56f-0afad526a8dc on n-h1-853611-3 Aug 18 13:04:09.855073 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-032636fb-f854-410d-ae01-63b9592a6092 req-25d3b2c5-765e-4e14-ad90-cc4dd74da25a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036761 Aug 18 13:04:09.855708 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4852/7506] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 13:04:09.861693 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-3bbc5d14-c494-4699-abd3-5bcd6a1fe3b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:04:09.862437 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-3bbc5d14-c494-4699-abd3-5bcd6a1fe3b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:04:09.870254 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bbc5d14-c494-4699-abd3-5bcd6a1fe3b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:09.870821 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bbc5d14-c494-4699-abd3-5bcd6a1fe3b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:09.871282 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bbc5d14-c494-4699-abd3-5bcd6a1fe3b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:09.872021 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bbc5d14-c494-4699-abd3-5bcd6a1fe3b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:09.872504 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bbc5d14-c494-4699-abd3-5bcd6a1fe3b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:09.872952 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-3bbc5d14-c494-4699-abd3-5bcd6a1fe3b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:10.038733 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-3bbc5d14-c494-4699-abd3-5bcd6a1fe3b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:04:10.046458 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-3bbc5d14-c494-4699-abd3-5bcd6a1fe3b0 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1373 microversion: 2.1 time: 0.189586 Aug 18 13:04:10.047728 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4853/7507] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:04:09 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 13:04:11.068884 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-256765ae-7193-4f8d-9914-8d56890de236 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:04:11.069630 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-256765ae-7193-4f8d-9914-8d56890de236 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:04:11.077470 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-256765ae-7193-4f8d-9914-8d56890de236 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:11.078794 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-256765ae-7193-4f8d-9914-8d56890de236 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:11.079301 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-256765ae-7193-4f8d-9914-8d56890de236 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:11.080117 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-256765ae-7193-4f8d-9914-8d56890de236 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:11.080587 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-256765ae-7193-4f8d-9914-8d56890de236 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:11.081027 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-256765ae-7193-4f8d-9914-8d56890de236 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:11.229421 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-256765ae-7193-4f8d-9914-8d56890de236 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:04:11.237961 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-256765ae-7193-4f8d-9914-8d56890de236 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1558 microversion: 2.1 time: 0.173080 Aug 18 13:04:11.238606 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4854/7508] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:04:11 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 13:04:11.258871 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-59dfdaa5-4832-4208-a1ed-4d435988ae59 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:04:11.259508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-59dfdaa5-4832-4208-a1ed-4d435988ae59 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:04:11.267025 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59dfdaa5-4832-4208-a1ed-4d435988ae59 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:11.267543 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59dfdaa5-4832-4208-a1ed-4d435988ae59 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:11.268006 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59dfdaa5-4832-4208-a1ed-4d435988ae59 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:11.268745 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59dfdaa5-4832-4208-a1ed-4d435988ae59 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:11.269222 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59dfdaa5-4832-4208-a1ed-4d435988ae59 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:11.269673 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-59dfdaa5-4832-4208-a1ed-4d435988ae59 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:11.422654 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-59dfdaa5-4832-4208-a1ed-4d435988ae59 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:04:11.430956 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-59dfdaa5-4832-4208-a1ed-4d435988ae59 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1558 microversion: 2.1 time: 0.175977 Aug 18 13:04:11.431736 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4855/7509] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:04:11 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:04:13.287565 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a09e9e75-ee49-44bd-a2b6-ea03c72205f2 req-3dc58a46-b7fb-4940-9d9c-662c9fa17460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc096b5-3470-4022-b56f-0afad526a8dc", "tag": "e8394cc8-35bc-4ff8-a1f6-5514417b174f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:04:13.298218 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a09e9e75-ee49-44bd-a2b6-ea03c72205f2 req-3dc58a46-b7fb-4940-9d9c-662c9fa17460 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:04:13.298782 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a09e9e75-ee49-44bd-a2b6-ea03c72205f2 req-3dc58a46-b7fb-4940-9d9c-662c9fa17460 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:04:13.299233 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a09e9e75-ee49-44bd-a2b6-ea03c72205f2 req-3dc58a46-b7fb-4940-9d9c-662c9fa17460 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:04:13.311366 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a09e9e75-ee49-44bd-a2b6-ea03c72205f2 req-3dc58a46-b7fb-4940-9d9c-662c9fa17460 service nova] Creating event network-changed:e8394cc8-35bc-4ff8-a1f6-5514417b174f for instance dbc096b5-3470-4022-b56f-0afad526a8dc on n-h1-853611-3 Aug 18 13:04:13.318099 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a09e9e75-ee49-44bd-a2b6-ea03c72205f2 req-3dc58a46-b7fb-4940-9d9c-662c9fa17460 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034873 Aug 18 13:04:13.318754 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4856/7510] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 13:05:00.294977 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:05:00.295651 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 13:05:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 13:05:16.844143 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:05:16.844818 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 13:05:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 13:05:40.451406 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_api:SELECT=13 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 13:05:40.452124 n-d-853611-3 devstack@n-api.service[122210]: DEBUG dbcounter [-] [122210] Writing DB stats nova_cell1:SELECT=34 {{(pid=122210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 13:05:40.457536 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-35c5820a-78d5-44b9-a753-794e705e9022 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1382619769"}} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:05:40.460071 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-35c5820a-78d5-44b9-a753-794e705e9022 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:05:40.467787 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35c5820a-78d5-44b9-a753-794e705e9022 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:40.468299 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35c5820a-78d5-44b9-a753-794e705e9022 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:40.468759 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35c5820a-78d5-44b9-a753-794e705e9022 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:40.469492 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35c5820a-78d5-44b9-a753-794e705e9022 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:40.469966 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35c5820a-78d5-44b9-a753-794e705e9022 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:40.470405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-35c5820a-78d5-44b9-a753-794e705e9022 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:40.907159 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-35c5820a-78d5-44b9-a753-794e705e9022 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "POST /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc/action" status: 202 len: 0 microversion: 2.1 time: 0.457545 Aug 18 13:05:40.907832 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4857/7511] 10.222.0.73 () {60 vars in 1278 bytes} [Thu Aug 18 13:05:40 2022] POST /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 18 13:05:46.815026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c2ef4980-15e7-472c-b800-1e5376a7cdac req-3ee8d95c-bb02-4ee4-8309-a0174af71c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc096b5-3470-4022-b56f-0afad526a8dc", "name": "network-vif-plugged", "status": "completed", "tag": "e8394cc8-35bc-4ff8-a1f6-5514417b174f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:05:46.840858 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c2ef4980-15e7-472c-b800-1e5376a7cdac req-3ee8d95c-bb02-4ee4-8309-a0174af71c29 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:46.842814 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c2ef4980-15e7-472c-b800-1e5376a7cdac req-3ee8d95c-bb02-4ee4-8309-a0174af71c29 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:46.854459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c2ef4980-15e7-472c-b800-1e5376a7cdac req-3ee8d95c-bb02-4ee4-8309-a0174af71c29 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:46.869136 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c2ef4980-15e7-472c-b800-1e5376a7cdac req-3ee8d95c-bb02-4ee4-8309-a0174af71c29 service nova] Creating event network-vif-plugged:e8394cc8-35bc-4ff8-a1f6-5514417b174f for instance dbc096b5-3470-4022-b56f-0afad526a8dc on n-h1-853611-3 Aug 18 13:05:46.874571 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c2ef4980-15e7-472c-b800-1e5376a7cdac req-3ee8d95c-bb02-4ee4-8309-a0174af71c29 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149167 Aug 18 13:05:46.875250 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4858/7512] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 13:05:54.721133 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-c9e5e30d-ee57-434c-b062-5522e1bed8bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:05:54.721967 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c9e5e30d-ee57-434c-b062-5522e1bed8bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:05:54.729989 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9e5e30d-ee57-434c-b062-5522e1bed8bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:54.730508 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9e5e30d-ee57-434c-b062-5522e1bed8bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:54.730968 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9e5e30d-ee57-434c-b062-5522e1bed8bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:54.732221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9e5e30d-ee57-434c-b062-5522e1bed8bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:54.732221 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9e5e30d-ee57-434c-b062-5522e1bed8bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:54.732657 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-c9e5e30d-ee57-434c-b062-5522e1bed8bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:54.767184 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-c9e5e30d-ee57-434c-b062-5522e1bed8bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 13:05:54.870961 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-c9e5e30d-ee57-434c-b062-5522e1bed8bd tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 204 len: 0 microversion: 2.1 time: 0.158409 Aug 18 13:05:54.871504 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4859/7513] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 13:05:54 2022] DELETE /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 13:05:54.878469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c7fcd41e-799d-4c1d-8121-4d5adf935431 req-131b4f74-36a7-4cc3-a6d4-c9ac27556460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc096b5-3470-4022-b56f-0afad526a8dc", "tag": "e8394cc8-35bc-4ff8-a1f6-5514417b174f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:05:54.889364 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c7fcd41e-799d-4c1d-8121-4d5adf935431 req-131b4f74-36a7-4cc3-a6d4-c9ac27556460 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:54.889867 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c7fcd41e-799d-4c1d-8121-4d5adf935431 req-131b4f74-36a7-4cc3-a6d4-c9ac27556460 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:54.890314 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c7fcd41e-799d-4c1d-8121-4d5adf935431 req-131b4f74-36a7-4cc3-a6d4-c9ac27556460 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:54.905784 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c7fcd41e-799d-4c1d-8121-4d5adf935431 req-131b4f74-36a7-4cc3-a6d4-c9ac27556460 service nova] Creating event network-changed:e8394cc8-35bc-4ff8-a1f6-5514417b174f for instance dbc096b5-3470-4022-b56f-0afad526a8dc on n-h1-853611-3 Aug 18 13:05:54.912356 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c7fcd41e-799d-4c1d-8121-4d5adf935431 req-131b4f74-36a7-4cc3-a6d4-c9ac27556460 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038725 Aug 18 13:05:54.912984 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4860/7514] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 13:05:54.918863 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-8dc9ef65-60f6-4d27-9fea-3788296e8449 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:05:54.919581 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-8dc9ef65-60f6-4d27-9fea-3788296e8449 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:05:54.927513 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dc9ef65-60f6-4d27-9fea-3788296e8449 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:54.928424 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dc9ef65-60f6-4d27-9fea-3788296e8449 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:54.929426 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dc9ef65-60f6-4d27-9fea-3788296e8449 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:54.929924 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dc9ef65-60f6-4d27-9fea-3788296e8449 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:54.930773 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dc9ef65-60f6-4d27-9fea-3788296e8449 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:54.931510 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-8dc9ef65-60f6-4d27-9fea-3788296e8449 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:55.112051 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-8dc9ef65-60f6-4d27-9fea-3788296e8449 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:05:55.124383 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-8dc9ef65-60f6-4d27-9fea-3788296e8449 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1683 microversion: 2.1 time: 0.209585 Aug 18 13:05:55.125290 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4861/7515] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:05:54 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1683 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 13:05:56.149557 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-87356385-b142-44b5-9288-cb2665cfa994 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:05:56.150359 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-87356385-b142-44b5-9288-cb2665cfa994 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:05:56.158039 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87356385-b142-44b5-9288-cb2665cfa994 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:56.158579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87356385-b142-44b5-9288-cb2665cfa994 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:56.159026 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87356385-b142-44b5-9288-cb2665cfa994 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:56.159752 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87356385-b142-44b5-9288-cb2665cfa994 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:56.160216 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87356385-b142-44b5-9288-cb2665cfa994 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:56.160666 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-87356385-b142-44b5-9288-cb2665cfa994 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:56.310086 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-87356385-b142-44b5-9288-cb2665cfa994 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:05:56.318848 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-87356385-b142-44b5-9288-cb2665cfa994 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1683 microversion: 2.1 time: 0.173598 Aug 18 13:05:56.319438 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4862/7516] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:05:56 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:05:57.244591 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-039c6650-454c-49ee-828a-f657d9356295 req-11bd309b-d06d-4224-af84-44791813f84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc096b5-3470-4022-b56f-0afad526a8dc", "name": "network-vif-deleted", "tag": "e8394cc8-35bc-4ff8-a1f6-5514417b174f"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:05:57.259140 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-039c6650-454c-49ee-828a-f657d9356295 req-11bd309b-d06d-4224-af84-44791813f84f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:57.259846 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-039c6650-454c-49ee-828a-f657d9356295 req-11bd309b-d06d-4224-af84-44791813f84f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:57.260452 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-039c6650-454c-49ee-828a-f657d9356295 req-11bd309b-d06d-4224-af84-44791813f84f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:57.274402 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-039c6650-454c-49ee-828a-f657d9356295 req-11bd309b-d06d-4224-af84-44791813f84f service nova] Creating event network-vif-deleted:e8394cc8-35bc-4ff8-a1f6-5514417b174f for instance dbc096b5-3470-4022-b56f-0afad526a8dc on n-h1-853611-3 Aug 18 13:05:57.279972 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-039c6650-454c-49ee-828a-f657d9356295 req-11bd309b-d06d-4224-af84-44791813f84f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041798 Aug 18 13:05:57.280709 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4863/7517] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 13:05:57.340772 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-aae9a610-ea27-4ea1-824b-495ce1555efc tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:05:57.341500 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-aae9a610-ea27-4ea1-824b-495ce1555efc tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:05:57.349477 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9a610-ea27-4ea1-824b-495ce1555efc tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:57.349999 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9a610-ea27-4ea1-824b-495ce1555efc tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:57.350498 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9a610-ea27-4ea1-824b-495ce1555efc tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:57.351474 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9a610-ea27-4ea1-824b-495ce1555efc tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:57.351955 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9a610-ea27-4ea1-824b-495ce1555efc tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:57.352405 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9a610-ea27-4ea1-824b-495ce1555efc tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:57.390459 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9a610-ea27-4ea1-824b-495ce1555efc tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:57.391639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9a610-ea27-4ea1-824b-495ce1555efc tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:57.392261 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-aae9a610-ea27-4ea1-824b-495ce1555efc tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:57.392853 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.objects.instance [None req-aae9a610-ea27-4ea1-824b-495ce1555efc tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lazy-loading 'fault' on Instance uuid dbc096b5-3470-4022-b56f-0afad526a8dc {{(pid=122210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 13:05:57.436141 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-aae9a610-ea27-4ea1-824b-495ce1555efc tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:05:57.444482 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-aae9a610-ea27-4ea1-824b-495ce1555efc tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 200 len: 1338 microversion: 2.1 time: 0.108104 Aug 18 13:05:57.445066 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4864/7518] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:05:57 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 1338 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:05:58.465280 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f3c790ac-61eb-465c-abc8-f681c685e33b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:05:58.465976 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f3c790ac-61eb-465c-abc8-f681c685e33b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: dbc096b5-3470-4022-b56f-0afad526a8dc] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:05:58.472718 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c790ac-61eb-465c-abc8-f681c685e33b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:58.473214 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c790ac-61eb-465c-abc8-f681c685e33b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:58.473665 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c790ac-61eb-465c-abc8-f681c685e33b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:58.474363 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c790ac-61eb-465c-abc8-f681c685e33b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:58.474868 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c790ac-61eb-465c-abc8-f681c685e33b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:58.475305 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f3c790ac-61eb-465c-abc8-f681c685e33b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:58.488730 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-f3c790ac-61eb-465c-abc8-f681c685e33b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] HTTP exception thrown: Instance dbc096b5-3470-4022-b56f-0afad526a8dc could not be found. Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f3c790ac-61eb-465c-abc8-f681c685e33b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Request method failure captured: Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc HTTP/1.1 Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jgd7IxIBq9iESjjNiWuuV9Qh9Tx8qBlfmxpRxuRFErLYGF5dAJNS9_n8jEMOXg0VeVTPSijSq-DGVChW85O0qbJX2pFmgHyL0knHH5_D5ppoGcnQjVF_tNA_jierzdVHKDwgkRRvF2Lj-Zj9KmFpJJFxJIV2JyYu_CZmloTzyJixb8 Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: fc7ef9312a034fcd8771409cab57723c Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestSnapshotPattern-1661548125 Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc7ef9312a034fcd8771409cab57723c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/fc7ef9312a034fcd8771409cab57723c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_fc7ef9312a034fcd8771409cab57723c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc7ef9312a034fcd8771409cab57723c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestSnapshotPattern-1661548125 Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: fc7ef9312a034fcd8771409cab57723c Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestSnapshotPattern-1661548125 Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestSnapshotPattern-1661548125-project Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e5e6976f81154287908f4522710adefa Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestSnapshotPattern-1661548125-project Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance dbc096b5-3470-4022-b56f-0afad526a8dc could not be found. Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'dbc096b5-3470-4022-b56f-0afad526a8dc'} Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc096b5-3470-4022-b56f-0afad526a8dc could not be found. Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc096b5-3470-4022-b56f-0afad526a8dc could not be found. Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 13:05:58.490399 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:05:58.496138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 13:05:58.496138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 13:05:58.496138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 13:05:58.496138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 13:05:58.496138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 13:05:58.496138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc096b5-3470-4022-b56f-0afad526a8dc could not be found. Aug 18 13:05:58.496138 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:05:58.496138 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f3c790ac-61eb-465c-abc8-f681c685e33b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Returning 404 to user: Instance dbc096b5-3470-4022-b56f-0afad526a8dc could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 13:05:58.496138 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f3c790ac-61eb-465c-abc8-f681c685e33b tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc" status: 404 len: 111 microversion: 2.1 time: 0.030538 Aug 18 13:05:58.496138 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4865/7519] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:05:58 2022] GET /compute/v2.1/servers/dbc096b5-3470-4022-b56f-0afad526a8dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 13:05:59.868579 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-f6a31e9a-0e31-4c90-bcdf-880a5eb426f3 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:05:59.869307 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f6a31e9a-0e31-4c90-bcdf-880a5eb426f3 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:05:59.876423 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a31e9a-0e31-4c90-bcdf-880a5eb426f3 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:59.877015 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a31e9a-0e31-4c90-bcdf-880a5eb426f3 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:59.877527 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a31e9a-0e31-4c90-bcdf-880a5eb426f3 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:59.878469 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a31e9a-0e31-4c90-bcdf-880a5eb426f3 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:05:59.878974 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a31e9a-0e31-4c90-bcdf-880a5eb426f3 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:05:59.879505 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-f6a31e9a-0e31-4c90-bcdf-880a5eb426f3 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:05:59.905355 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-f6a31e9a-0e31-4c90-bcdf-880a5eb426f3 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Going to try to terminate instance {{(pid=122210) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 18 13:06:00.014156 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-f6a31e9a-0e31-4c90-bcdf-880a5eb426f3 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "DELETE /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 204 len: 0 microversion: 2.1 time: 0.149555 Aug 18 13:06:00.014980 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4866/7520] 10.222.0.73 () {58 vars in 1239 bytes} [Thu Aug 18 13:05:59 2022] DELETE /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 13:06:00.080417 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-c2a8eb1e-03e6-4ac3-8081-9cb4dd30fb6e req-e5319301-2532-4e41-893d-e02b0f92822f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb783c17-047d-4cbe-8e9d-7e8e8ed21804", "tag": "662e3fe8-d0c7-42ec-85b6-d1d66f402ac8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:06:00.090243 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c2a8eb1e-03e6-4ac3-8081-9cb4dd30fb6e req-e5319301-2532-4e41-893d-e02b0f92822f service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:06:00.090845 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c2a8eb1e-03e6-4ac3-8081-9cb4dd30fb6e req-e5319301-2532-4e41-893d-e02b0f92822f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:06:00.091297 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-c2a8eb1e-03e6-4ac3-8081-9cb4dd30fb6e req-e5319301-2532-4e41-893d-e02b0f92822f service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:06:00.103520 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-c2a8eb1e-03e6-4ac3-8081-9cb4dd30fb6e req-e5319301-2532-4e41-893d-e02b0f92822f service nova] Creating event network-changed:662e3fe8-d0c7-42ec-85b6-d1d66f402ac8 for instance eb783c17-047d-4cbe-8e9d-7e8e8ed21804 on n-h2-853611-3 Aug 18 13:06:00.108707 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-c2a8eb1e-03e6-4ac3-8081-9cb4dd30fb6e req-e5319301-2532-4e41-893d-e02b0f92822f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092223 Aug 18 13:06:00.109999 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4867/7521] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 13:06:00.115153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-1b7fb413-7755-4d51-bd89-2638a3135c6e tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:06:00.115879 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-1b7fb413-7755-4d51-bd89-2638a3135c6e tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:06:00.122045 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b7fb413-7755-4d51-bd89-2638a3135c6e tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:06:00.122586 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b7fb413-7755-4d51-bd89-2638a3135c6e tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:06:00.123048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b7fb413-7755-4d51-bd89-2638a3135c6e tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:06:00.123764 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b7fb413-7755-4d51-bd89-2638a3135c6e tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:06:00.124236 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b7fb413-7755-4d51-bd89-2638a3135c6e tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:06:00.125002 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-1b7fb413-7755-4d51-bd89-2638a3135c6e tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:06:00.279571 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-1b7fb413-7755-4d51-bd89-2638a3135c6e tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:06:00.288587 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-1b7fb413-7755-4d51-bd89-2638a3135c6e tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1684 microversion: 2.1 time: 0.177371 Aug 18 13:06:00.289535 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4868/7522] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:06:00 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 13:06:01.309431 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-159ea5d8-429e-4f72-a1c5-085e21556918 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:06:01.310130 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-159ea5d8-429e-4f72-a1c5-085e21556918 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:06:01.326520 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-159ea5d8-429e-4f72-a1c5-085e21556918 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:06:01.327153 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-159ea5d8-429e-4f72-a1c5-085e21556918 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:06:01.327614 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-159ea5d8-429e-4f72-a1c5-085e21556918 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:06:01.328427 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-159ea5d8-429e-4f72-a1c5-085e21556918 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:06:01.328902 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-159ea5d8-429e-4f72-a1c5-085e21556918 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:06:01.329384 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-159ea5d8-429e-4f72-a1c5-085e21556918 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:06:01.559011 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.policy [None req-159ea5d8-429e-4f72-a1c5-085e21556918 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e6976f81154287908f4522710adefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7ef9312a034fcd8771409cab57723c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122210) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 13:06:01.566820 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-159ea5d8-429e-4f72-a1c5-085e21556918 tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 200 len: 1684 microversion: 2.1 time: 0.261373 Aug 18 13:06:01.567411 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4869/7523] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:06:01 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 1684 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 13:06:02.100267 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [req-a3600a0b-f675-40fe-90ed-3660b0076ba7 req-1a4a16a6-e062-4336-8bc6-a0bcd5833d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb783c17-047d-4cbe-8e9d-7e8e8ed21804", "name": "network-vif-deleted", "tag": "662e3fe8-d0c7-42ec-85b6-d1d66f402ac8"}]} {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 13:06:02.111066 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a3600a0b-f675-40fe-90ed-3660b0076ba7 req-1a4a16a6-e062-4336-8bc6-a0bcd5833d45 service nova] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:06:02.111576 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a3600a0b-f675-40fe-90ed-3660b0076ba7 req-1a4a16a6-e062-4336-8bc6-a0bcd5833d45 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:06:02.112033 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [req-a3600a0b-f675-40fe-90ed-3660b0076ba7 req-1a4a16a6-e062-4336-8bc6-a0bcd5833d45 service nova] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:06:02.123543 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.compute.server_external_events [req-a3600a0b-f675-40fe-90ed-3660b0076ba7 req-1a4a16a6-e062-4336-8bc6-a0bcd5833d45 service nova] Creating event network-vif-deleted:662e3fe8-d0c7-42ec-85b6-d1d66f402ac8 for instance eb783c17-047d-4cbe-8e9d-7e8e8ed21804 on n-h2-853611-3 Aug 18 13:06:02.128764 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [req-a3600a0b-f675-40fe-90ed-3660b0076ba7 req-1a4a16a6-e062-4336-8bc6-a0bcd5833d45 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107940 Aug 18 13:06:02.129634 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4870/7524] 10.222.0.73 () {64 vars in 1317 bytes} [Thu Aug 18 13:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 13:06:02.589199 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-84ba182b-876f-4942-b881-410f14d1e86f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:06:02.589923 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.compute.api [None req-84ba182b-876f-4942-b881-410f14d1e86f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] [instance: eb783c17-047d-4cbe-8e9d-7e8e8ed21804] Fetching instance by UUID {{(pid=122210) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 18 13:06:02.596434 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84ba182b-876f-4942-b881-410f14d1e86f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:06:02.596942 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84ba182b-876f-4942-b881-410f14d1e86f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:06:02.597399 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84ba182b-876f-4942-b881-410f14d1e86f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:06:02.598116 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84ba182b-876f-4942-b881-410f14d1e86f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Acquiring lock "68989ef7-340f-4449-87c1-932f111c2bdb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 13:06:02.598639 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84ba182b-876f-4942-b881-410f14d1e86f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 13:06:02.599088 n-d-853611-3 devstack@n-api.service[122210]: DEBUG oslo_concurrency.lockutils [None req-84ba182b-876f-4942-b881-410f14d1e86f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Lock "68989ef7-340f-4449-87c1-932f111c2bdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 13:06:02.613232 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.wsgi [None req-84ba182b-876f-4942-b881-410f14d1e86f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] HTTP exception thrown: Instance eb783c17-047d-4cbe-8e9d-7e8e8ed21804 could not be found. Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-84ba182b-876f-4942-b881-410f14d1e86f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Request method failure captured: Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: request: GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 HTTP/1.1 Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: Accept: application/json Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: Accept-Encoding: identity Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: Connection: close Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: Content-Length: 0 Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: Content-Type: application/json Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: Host: 10.222.0.73 Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: Openstack-System-Scope: None Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: User-Agent: python-urllib3/1.26.11 Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Auth-Token: gAAAAABi_jgd7IxIBq9iESjjNiWuuV9Qh9Tx8qBlfmxpRxuRFErLYGF5dAJNS9_n8jEMOXg0VeVTPSijSq-DGVChW85O0qbJX2pFmgHyL0knHH5_D5ppoGcnQjVF_tNA_jierzdVHKDwgkRRvF2Lj-Zj9KmFpJJFxJIV2JyYu_CZmloTzyJixb8 Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Id: None Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Domain-Name: None Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Identity-Status: Confirmed Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Is-Admin-Project: True Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Id: default Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Domain-Name: Default Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Id: fc7ef9312a034fcd8771409cab57723c Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Project-Name: tempest-TestSnapshotPattern-1661548125 Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Role: member,reader Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Roles: member,reader Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc7ef9312a034fcd8771409cab57723c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/fc7ef9312a034fcd8771409cab57723c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_fc7ef9312a034fcd8771409cab57723c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/fc7ef9312a034fcd8771409cab57723c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}] Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant: tempest-TestSnapshotPattern-1661548125 Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Id: fc7ef9312a034fcd8771409cab57723c Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-Tenant-Name: tempest-TestSnapshotPattern-1661548125 Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-User: tempest-TestSnapshotPattern-1661548125-project Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Id: default Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-User-Domain-Name: Default Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-User-Id: e5e6976f81154287908f4522710adefa Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: X-User-Name: tempest-TestSnapshotPattern-1661548125-project Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: method: > Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: exception: Instance eb783c17-047d-4cbe-8e9d-7e8e8ed21804 could not be found. Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: action_args: {'id': 'eb783c17-047d-4cbe-8e9d-7e8e8ed21804'} Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb783c17-047d-4cbe-8e9d-7e8e8ed21804 could not be found. Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb783c17-047d-4cbe-8e9d-7e8e8ed21804 could not be found. Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 13:06:02.614975 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:06:02.620048 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 13:06:02.620048 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 13:06:02.620048 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 13:06:02.620048 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 13:06:02.620048 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 13:06:02.620048 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb783c17-047d-4cbe-8e9d-7e8e8ed21804 could not be found. Aug 18 13:06:02.620048 n-d-853611-3 devstack@n-api.service[122210]: ERROR nova.api.openstack.wsgi Aug 18 13:06:02.620048 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-84ba182b-876f-4942-b881-410f14d1e86f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Returning 404 to user: Instance eb783c17-047d-4cbe-8e9d-7e8e8ed21804 could not be found. {{(pid=122210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 13:06:02.620048 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-84ba182b-876f-4942-b881-410f14d1e86f tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804" status: 404 len: 111 microversion: 2.1 time: 0.032345 Aug 18 13:06:02.620048 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4871/7525] 10.222.0.73 () {58 vars in 1236 bytes} [Thu Aug 18 13:06:02 2022] GET /compute/v2.1/servers/eb783c17-047d-4cbe-8e9d-7e8e8ed21804 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 13:06:02.785165 n-d-853611-3 devstack@n-api.service[122210]: DEBUG nova.api.openstack.wsgi [None req-73be37c7-4e61-4ff6-9202-a6361f706f0a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] Calling method '.version_select at 0x7f519faa7b80>' {{(pid=122210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 13:06:02.811612 n-d-853611-3 devstack@n-api.service[122210]: INFO nova.api.openstack.requestlog [None req-73be37c7-4e61-4ff6-9202-a6361f706f0a tempest-TestSnapshotPattern-1661548125 tempest-TestSnapshotPattern-1661548125-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1852791311" status: 202 len: 0 microversion: 2.1 time: 0.031235 Aug 18 13:06:02.816351 n-d-853611-3 devstack@n-api.service[122210]: [pid: 122210|app: 0|req: 4872/7526] 10.222.0.73 () {58 vars in 1257 bytes} [Thu Aug 18 13:06:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1852791311 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 13:06:36.846167 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:06:36.846923 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 13:06:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 13:06:38.922017 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:06:38.922754 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 13:06:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 13:08:16.790195 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:08:16.790857 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 13:08:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 13:08:20.303948 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:08:20.304652 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 13:08:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 13:08:36.852480 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:08:36.853471 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 13:08:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 13:08:50.725698 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:08:50.726212 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 13:08:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 13:09:56.855359 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:09:56.856132 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 13:09:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 13:09:58.930875 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:09:58.931503 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 13:09:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 13:11:36.798889 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:11:36.799519 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 13:11:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 13:11:40.313861 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:11:40.314625 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 13:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 13:11:56.862516 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:11:56.863252 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 13:11:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!! Aug 18 13:12:10.734398 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:12:10.734955 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 13:12:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 13:13:16.864147 n-d-853611-3 devstack@n-api.service[122210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:13:16.864819 n-d-853611-3 devstack@n-api.service[122210]: Thu Aug 18 13:13:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 13:13:18.940271 n-d-853611-3 devstack@n-api.service[122209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 13:13:18.940859 n-d-853611-3 devstack@n-api.service[122209]: Thu Aug 18 13:13:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f1e4e16-a47a-4137-b059-c45fd3308070 (ip 10.222.0.73) !!!